-- Logs begin at Sat 2022-01-22 20:01:15 UTC, end at Sat 2022-01-22 22:50:23 UTC. -- Jan 22 20:48:33.121110 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jan 22 20:48:33.129956 ncdv-master-1 devstack@n-api.service[120876]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 22 20:48:33.131978 ncdv-master-1 devstack@n-api.service[120876]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jan 22 20:48:33 2022] *** Jan 22 20:48:33.131978 ncdv-master-1 devstack@n-api.service[120876]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 22 20:48:33.131978 ncdv-master-1 devstack@n-api.service[120876]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 22 20:48:33.131978 ncdv-master-1 devstack@n-api.service[120876]: nodename: ncdv-master-1 Jan 22 20:48:33.131978 ncdv-master-1 devstack@n-api.service[120876]: machine: x86_64 Jan 22 20:48:33.131978 ncdv-master-1 devstack@n-api.service[120876]: clock source: unix Jan 22 20:48:33.131978 ncdv-master-1 devstack@n-api.service[120876]: pcre jit disabled Jan 22 20:48:33.131978 ncdv-master-1 devstack@n-api.service[120876]: detected number of CPU cores: 4 Jan 22 20:48:33.131978 ncdv-master-1 devstack@n-api.service[120876]: current working directory: / Jan 22 20:48:33.131978 ncdv-master-1 devstack@n-api.service[120876]: detected binary path: /usr/bin/uwsgi-core Jan 22 20:48:33.132671 ncdv-master-1 devstack@n-api.service[120876]: your processes number limit is 47680 Jan 22 20:48:33.132671 ncdv-master-1 devstack@n-api.service[120876]: your memory page size is 4096 bytes Jan 22 20:48:33.132671 ncdv-master-1 devstack@n-api.service[120876]: detected max file descriptor number: 2048 Jan 22 20:48:33.132671 ncdv-master-1 devstack@n-api.service[120876]: lock engine: pthread robust mutexes Jan 22 20:48:33.132671 ncdv-master-1 devstack@n-api.service[120876]: thunder lock: enabled Jan 22 20:48:33.132671 ncdv-master-1 devstack@n-api.service[120876]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 22 20:48:33.132671 ncdv-master-1 devstack@n-api.service[120876]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 22 20:48:33.181198 ncdv-master-1 devstack@n-api.service[120876]: Python main interpreter initialized at 0x55d25a83b9c0 Jan 22 20:48:33.181198 ncdv-master-1 devstack@n-api.service[120876]: python threads support enabled Jan 22 20:48:33.181198 ncdv-master-1 devstack@n-api.service[120876]: your server socket listen backlog is limited to 100 connections Jan 22 20:48:33.181198 ncdv-master-1 devstack@n-api.service[120876]: your mercy for graceful operations on workers is 90 seconds Jan 22 20:48:33.181566 ncdv-master-1 devstack@n-api.service[120876]: mapped 403077 bytes (393 KB) for 2 cores Jan 22 20:48:33.181644 ncdv-master-1 devstack@n-api.service[120876]: *** Operational MODE: preforking *** Jan 22 20:48:33.181869 ncdv-master-1 devstack@n-api.service[120876]: *** uWSGI is running in multiple interpreter mode *** Jan 22 20:48:33.181869 ncdv-master-1 devstack@n-api.service[120876]: spawned uWSGI master process (pid: 120876) Jan 22 20:48:33.182059 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jan 22 20:48:33.182989 ncdv-master-1 devstack@n-api.service[120876]: spawned uWSGI worker 1 (pid: 120877, cores: 1) Jan 22 20:48:33.182989 ncdv-master-1 devstack@n-api.service[120876]: spawned uWSGI worker 2 (pid: 120878, cores: 1) Jan 22 20:48:33.183149 ncdv-master-1 devstack@n-api.service[120876]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 22 20:48:35.038887 ncdv-master-1 devstack@n-api.service[120877]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 22 20:48:35.038887 ncdv-master-1 devstack@n-api.service[120877]: from cryptography.utils import int_from_bytes Jan 22 20:48:35.039561 ncdv-master-1 devstack@n-api.service[120877]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 22 20:48:35.039561 ncdv-master-1 devstack@n-api.service[120877]: from cryptography.utils import int_from_bytes Jan 22 20:48:35.045924 ncdv-master-1 devstack@n-api.service[120878]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 22 20:48:35.045924 ncdv-master-1 devstack@n-api.service[120878]: from cryptography.utils import int_from_bytes Jan 22 20:48:35.046426 ncdv-master-1 devstack@n-api.service[120878]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 22 20:48:35.046426 ncdv-master-1 devstack@n-api.service[120878]: from cryptography.utils import int_from_bytes Jan 22 20:48:37.626403 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 22 20:48:37.637678 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 22 20:48:37.637678 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 22 20:48:37.637678 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 22 20:48:37.637678 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 22 20:48:37.637678 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.637678 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.637678 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.637678 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.638373 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.638373 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.638373 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.638373 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.638373 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.638373 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.638373 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.638373 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.638966 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.638966 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.638966 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.638966 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.638966 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.639350 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 22 20:48:37.639724 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.639820 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 22 20:48:37.639907 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.640016 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 22 20:48:37.640102 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.640205 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 22 20:48:37.640299 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.640386 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 22 20:48:37.640471 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.640555 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.640633 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.640717 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.640804 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.640894 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.640980 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.641067 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.641152 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.641239 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.641333 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.641419 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.641553 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.641686 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.641842 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.642018 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.642136 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.642288 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.642405 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.642561 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.642712 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.642842 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.642999 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.643125 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.643283 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.643435 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.643567 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.643799 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.643940 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.644067 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.644153 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.644242 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.644358 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.644447 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.644532 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.644620 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.644712 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.644792 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.644875 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.644960 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.645088 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.645250 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.645343 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.645428 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.645531 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.645615 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.649890 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.650155 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.650247 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.650327 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.650425 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.650519 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.650605 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.650691 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.650777 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.650864 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.650956 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.650956 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.651173 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.651264 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.651344 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.651429 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.651521 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.651603 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.651681 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.651772 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.651868 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.651948 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.651948 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.652102 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.652182 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.652273 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.652360 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.652441 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.652520 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.652604 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.652688 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.652779 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.652865 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.652865 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.653026 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.653105 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.653182 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.653272 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.653357 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.653448 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.653545 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.653639 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.653735 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.653843 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.653926 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.654013 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.654099 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.654178 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.654265 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.654510 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.654614 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.654702 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.654823 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.654823 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.655053 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.655053 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.655219 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.655219 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.655385 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.655472 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.655563 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.655644 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.655728 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.655807 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.655884 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.655968 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.656060 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.656146 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.656226 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.656310 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.656390 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.656476 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.656562 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.656647 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.656726 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.656804 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.656882 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.656971 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.657056 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.657136 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.657220 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.657305 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.657399 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.657489 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.657663 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.657743 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.657833 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.657913 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.658007 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.658088 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.658172 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.658257 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.658345 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.658425 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.658511 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.658599 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.658685 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.658765 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.658848 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.658932 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.659032 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.659032 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.659233 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.659233 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.659395 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.659487 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.659575 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.659575 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.659786 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.659877 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.659958 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.660044 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.660129 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.660214 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.660827 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.660919 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.661005 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.661094 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.661216 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.661305 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.661391 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.661471 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.661636 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.661738 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.661825 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.661910 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.662007 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.662088 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.662172 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.662260 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.662260 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.662404 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.662482 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.662574 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.662654 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.662740 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.662925 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.663010 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.663090 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.663175 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.663263 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.663344 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.663429 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.663518 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.663605 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.663684 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.663876 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.663974 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.664173 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.664262 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.664529 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.664630 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.664778 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.664867 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.665077 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.665174 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.665373 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.665469 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.665705 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.665790 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.666004 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.666137 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.666280 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.666374 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.666576 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.666671 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.666874 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.666960 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.667166 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.667262 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.667475 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.667563 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.667778 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.667869 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.668077 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.668171 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.668375 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.668471 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.668673 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.668760 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.668973 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.669068 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.669290 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.669377 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.669619 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.669720 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.669923 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.670025 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.670239 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.670326 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.670541 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.670634 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.670842 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.670942 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.671155 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.671243 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.671451 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.671537 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.671752 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.671840 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.672065 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.672158 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.672369 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.672462 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.672656 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.672750 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.672954 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.673048 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.673253 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.673341 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.673580 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.673668 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.673881 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.673968 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.674184 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.674272 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.674484 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.674593 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.674780 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.674889 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.675081 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.675177 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.675390 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.675490 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.675690 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.675784 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.676603 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.676714 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.676987 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.677151 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.677331 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.677560 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:48:37.677697 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.677903 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.677992 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.678237 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.678325 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.678578 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.678686 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.678892 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.678982 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.679204 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.679299 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.679510 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.679597 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.679816 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.679914 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.680139 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.680227 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.680443 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.680532 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.680746 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.680857 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.681057 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.681149 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.681368 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.681468 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.681704 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.681793 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.682005 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.682090 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.682307 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.682406 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.682607 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.682705 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.682911 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.683001 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.683212 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.683309 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.683525 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.683612 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.683831 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.683923 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.684132 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.684230 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.684457 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.684555 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.684756 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.684880 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.685063 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.685163 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.685366 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.685455 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.685708 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.685798 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.686016 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.686112 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.686321 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.686408 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.686620 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.686707 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.686935 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.687025 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.687237 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.687324 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.687537 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.687624 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.687847 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.687943 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.688142 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.688229 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.688439 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.688539 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.688746 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.688850 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.689048 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.689135 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.689349 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.689447 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.689684 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.689781 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.689986 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.690079 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.690290 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.690393 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.690592 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.690688 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.690897 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.690984 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.691200 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.691297 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.691507 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.691632 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.691850 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.691970 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.692166 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.692474 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.692571 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.692772 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.692860 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.693072 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.693173 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.693367 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.693456 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.693688 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.693778 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.693986 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.694090 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.694288 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.694377 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.694584 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.694678 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.694881 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.694982 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.695177 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.695276 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.695467 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.695555 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.695761 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.695849 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.696075 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.696162 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.696376 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.696464 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.696672 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.696761 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.696968 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.697057 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.697262 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.697358 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.697588 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.697679 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.697899 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.698000 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.698218 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.698306 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.698526 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.698616 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.698832 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.698920 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.699145 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.699240 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.699448 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.699537 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.699755 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.699849 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.700057 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.700150 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.700361 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.700448 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.700663 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.700758 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.700961 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.701055 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.701266 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.701354 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.701592 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.701727 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.701896 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.702015 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.702194 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.702302 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.702500 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.702598 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.702800 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.702909 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.703097 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.703195 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.703393 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.703489 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.703689 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.703785 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.703988 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.704086 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.704310 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.704428 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.704615 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.704714 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.704913 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.705053 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.705196 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.705393 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.705555 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.705697 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.705823 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.705947 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.706117 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.706247 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.706417 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.706558 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.706719 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.706849 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.707029 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.707172 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.707386 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.707523 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.707656 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.707951 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.708079 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.708264 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.708394 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.708566 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.708701 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.708876 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.709003 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.709172 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.709309 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.709477 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.709640 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.709820 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.709950 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.710130 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.710254 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.710430 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.710558 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.710734 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.710872 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.711051 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.711191 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.711353 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.711481 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.711661 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.711781 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.711962 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.712067 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.712259 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.712355 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.712557 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.712665 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.712857 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.712955 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.713164 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.713262 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.713466 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.713595 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.713796 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.713886 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.714092 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.714180 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.714398 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.714511 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.714699 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.714806 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.715080 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.715176 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.715276 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.715358 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.715575 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.715663 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.715886 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.715975 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.716189 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.716281 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.716491 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.716578 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.716798 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.716885 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.717093 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.717183 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.717389 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.717493 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.717713 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.717801 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.718018 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.718107 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.718314 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.718402 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.718610 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.718712 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.718904 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.719001 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.719235 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.719321 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.719535 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.719632 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.719831 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.719919 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.720138 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.720224 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.720446 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.720542 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.720746 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.720832 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.721048 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.721144 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.721346 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.721448 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.721676 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.721768 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.721987 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.722074 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.722290 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.722378 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.722590 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.722684 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.723428 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.723529 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.723934 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.724022 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.724289 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.724377 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.724602 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.724692 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.724916 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.725006 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.725221 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.725308 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.725545 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.725637 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.725854 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.725945 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.726151 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.726239 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.726455 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.726552 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.726755 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.726849 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.727076 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.727316 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.727409 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.727642 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.727732 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.727949 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.728044 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.728248 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.728335 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.728559 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.728647 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.728869 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.728965 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.729171 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.729258 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.729485 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.729601 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.729813 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.729900 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.730110 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.730208 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.730411 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.730498 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.730709 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.730804 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.731008 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.731109 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.731310 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.731412 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.731607 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.731697 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.731956 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.732063 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.732195 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.732278 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.732492 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.732581 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.732788 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.732885 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.733089 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.733201 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.733407 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.733518 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.733728 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.733843 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.734039 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.734129 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.734335 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.734422 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.734637 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.734726 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.734932 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.735020 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.735243 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.735334 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.735542 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.735805 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.735895 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.736118 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.736204 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.736412 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.736499 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.736744 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.736831 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.737038 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.737124 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.737365 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.737451 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.737710 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.737809 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.738036 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.738123 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.738334 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.739099 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.739223 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.739314 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.739543 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.739801 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.739903 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.740115 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.740213 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.740414 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.740500 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.740719 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.740807 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.741023 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.741111 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.741319 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.741405 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.741645 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.741738 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.741950 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.742062 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.742254 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.742354 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.742552 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.742646 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.742848 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.742947 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.743151 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.743240 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.743448 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.743548 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.743752 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.743848 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.744052 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.744139 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.744348 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.744434 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.744643 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.744730 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.744946 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.745033 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.745249 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.745340 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.745565 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.745668 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.745868 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.745957 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.746164 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.746261 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.746471 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.746561 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.746768 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.746857 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.747066 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.747154 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.747364 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.747462 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.747666 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.747755 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.747968 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.748066 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.748264 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.748353 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.748580 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.748668 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.748882 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.748985 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.749179 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.749266 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.749476 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.749581 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.750053 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.750159 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.750351 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.750438 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.750646 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.750740 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.750948 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.751047 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.751252 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.751347 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.751558 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.751646 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.751852 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.751948 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.752152 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.752238 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.752448 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.752535 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.752744 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.752833 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.753041 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.753129 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.753340 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.753425 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.753659 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.753762 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.753958 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.754102 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.754279 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.754375 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.754573 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.754842 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.754931 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.755156 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.755253 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.755460 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.755553 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.755754 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.755841 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.756053 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.756142 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.756349 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.756438 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.756648 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.756742 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.756955 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.757047 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.757261 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.757360 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.757584 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.757676 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.757909 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.757997 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.758217 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.758307 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.758518 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.758606 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.758818 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.758915 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.759123 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.759218 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.759421 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.759509 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.759721 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.759818 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.760021 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.760108 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.760329 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.760416 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.760627 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.760723 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.760924 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.761012 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.761230 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.761334 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.761557 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.761660 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.761860 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.761947 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.762163 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.762251 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.762471 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.762568 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.762770 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.762859 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.763067 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.763161 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.763360 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.763450 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.763656 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.763752 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.763952 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.764040 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.764252 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.764340 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.764555 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.764651 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.764851 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.764946 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.765150 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.765248 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.765445 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.765554 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.765774 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.765862 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.766077 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.766167 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.766375 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.766470 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.766677 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.766775 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.766979 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.767069 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.767278 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.767368 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.767594 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.767692 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.767897 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.767984 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.768192 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.768278 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.768487 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.768582 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.768783 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.768870 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.769087 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.769214 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.769384 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.769483 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.769773 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.769874 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.770178 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.770266 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.770488 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.770678 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.770769 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.770990 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.771088 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.771300 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.771401 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.771619 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.771715 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.771938 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.772034 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.772241 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.772339 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.772546 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.772633 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.772852 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.772941 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.773160 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.773258 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.773464 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.773577 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.773795 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.773887 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.774102 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.774223 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.774402 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.774490 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.774711 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.774799 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.775005 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.775102 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.775301 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.775390 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.775596 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.775685 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.775896 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.775992 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.776190 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.776277 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.776493 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.776580 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.776795 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.776894 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.777114 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.777204 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.777425 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.777543 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.777756 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.777897 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.778060 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.778201 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.778360 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.778504 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.778669 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.778818 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.778991 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.779133 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.779398 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.779500 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.779710 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.779807 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.780016 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.780105 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.780315 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.780412 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.780617 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.780704 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.780922 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.781020 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.781222 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.781318 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.781543 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.781648 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.781846 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.781936 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.782167 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.782314 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.782479 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.782569 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.782784 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.782881 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.783098 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.783195 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.783420 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.783508 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.783719 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.783820 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.784028 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.784118 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.784347 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.784436 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.784655 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.784919 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.785033 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.785119 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.785240 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.785856 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.786096 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.786268 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.786395 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.786687 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.786785 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.786999 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.787087 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.787298 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.787424 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.787605 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.787738 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.787907 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.788043 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.788209 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.788457 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.788547 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.788768 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.788859 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.789078 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.789168 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.789403 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.789540 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.789712 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.789809 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.790001 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.790087 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.790314 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.790408 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.790624 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.790722 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.790918 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.791006 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.791230 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.791328 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.791531 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.791621 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.791828 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.791925 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.792130 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.792220 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.792427 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.792524 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.792742 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.792842 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.793043 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.793132 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.793353 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.793444 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.793697 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.793838 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.794018 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.794109 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.794319 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.794408 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.794645 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.794744 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.794960 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.795050 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.795266 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.795357 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.795573 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.795672 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.795890 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.796022 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.796184 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.796273 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.796480 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.796578 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.796778 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.796866 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.797074 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.797170 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.797369 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.797473 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.797689 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.797781 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.797989 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.798090 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.798285 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.798377 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.798579 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.798678 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.798871 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.798968 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.799182 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.799272 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.799476 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.799574 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.799789 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.799879 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.800089 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.800192 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.800385 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.800475 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.800680 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.800779 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.801573 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.801690 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.801962 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.802218 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.802309 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.802555 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.802647 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.802867 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.802969 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.803175 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.803273 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.803483 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.803575 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.803783 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.803872 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.804097 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.804187 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.804405 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.804503 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.804710 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.804799 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.805017 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.805121 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.805323 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.805424 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.805662 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.805753 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.805972 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.806073 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.806277 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.806367 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.806577 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.806679 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.806883 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.806986 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.807188 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.807286 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.807489 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.807576 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.807797 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.807996 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.808087 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.808316 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.808414 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.808621 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.808724 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.808924 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.809025 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.809228 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.809320 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.809551 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.809659 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.809854 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.809942 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.810155 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.810245 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.810457 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.810618 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.810758 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.810847 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.811058 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.811224 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.811355 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.811455 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.811656 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.811754 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.811955 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.812046 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.812292 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.812385 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.812589 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.812679 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.812894 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.813030 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.813200 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.813294 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.813635 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.813730 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.813859 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.813947 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.814164 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.814257 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.814462 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.814553 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.814768 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.814867 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.815078 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.815175 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.815384 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.815482 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.815686 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.815786 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.815986 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.816089 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.816290 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.816380 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.816704 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.816811 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.816921 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.817182 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.817272 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.817522 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.817628 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.817848 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.817950 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.818164 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.818254 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.818492 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.818712 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.818812 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.819040 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.819130 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.819355 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.819452 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.819669 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.819761 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.819981 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.820180 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.820293 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.820495 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.820586 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.820825 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.820915 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.821148 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.821245 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.821468 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.821602 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.821806 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.821903 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.822120 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.822209 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.822436 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.822527 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.822736 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.822824 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.823036 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.823135 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.823339 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.823430 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.823641 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.823730 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.823937 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.824037 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.824251 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.824341 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.824554 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.824652 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.824852 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.824951 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.825161 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.825252 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.825463 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.825584 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.825820 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.826002 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.826133 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.826339 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.826437 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.826646 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.826745 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.826963 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.827053 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.827290 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.827457 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.827587 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.827687 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.827885 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.827975 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.828198 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.828287 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.828495 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.828594 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.828792 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.828882 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.829098 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.829196 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.829398 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.829526 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.829720 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.829814 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.830016 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.830105 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.830315 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.830406 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.830615 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.830832 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.830923 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.831144 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.831243 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.831474 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.831564 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.831788 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.831876 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.832089 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.832198 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.832468 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.832595 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.832952 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.833040 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.833344 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.833435 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.833677 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.833769 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.833980 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.834147 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.834285 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.834378 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.834588 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.834677 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.834888 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.834977 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.835185 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.835275 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.835493 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.835591 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.835795 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.835893 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.836100 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.836190 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.836400 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.836491 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.836705 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.836922 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.837014 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.837268 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.837364 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.837607 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.837701 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.837906 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.837998 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.838215 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.838313 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.838522 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.838612 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.838834 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.838924 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.839138 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.839233 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.839440 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.839608 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.839742 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.839831 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.840054 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.840152 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.840361 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.840585 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.840677 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.840946 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.841036 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.841254 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.841351 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.841588 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.841683 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.841889 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.841981 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.842195 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.842298 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.842494 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.842601 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.842791 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.842894 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.843098 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.843201 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.843399 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.843495 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.843697 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.843786 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.843998 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.844101 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.844296 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.844385 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.844596 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.844684 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.844895 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.844993 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.845195 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.845285 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.845495 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.845654 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.845817 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.845909 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.846118 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.846207 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.846415 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.846543 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.846723 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.846822 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.847022 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.847114 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.847325 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.847422 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.847625 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.847716 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.848492 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.848584 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.848802 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.849049 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.849149 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.849363 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.849465 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.849705 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.849797 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.850014 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.850114 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.850335 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.850424 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.850640 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.850728 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.850938 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.851029 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.851280 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.851368 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.851594 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.851685 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.851931 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.852120 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.852243 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.852493 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.852591 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.852811 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.852902 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.853140 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.853231 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.853441 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.853550 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.853783 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.853875 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.854084 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.854181 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.854386 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.854476 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.854706 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.854803 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.855013 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.855102 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.855320 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.855464 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.855617 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.855707 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.855915 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.856012 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.856210 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.856308 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.856511 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.856596 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.856815 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.856904 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.857121 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.857219 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.857426 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.857537 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.857758 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.857851 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.858062 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.858187 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.858376 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.858480 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.858676 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.858772 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.858989 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.859079 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.859300 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.859396 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.859607 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.859705 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.859907 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.859999 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.860208 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.860296 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.860515 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.860607 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.860816 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.860913 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.861117 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.861211 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.861421 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.861532 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.861749 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.861850 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.862047 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.862176 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.862363 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.862464 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.862684 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.862783 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.862981 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.863121 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.863296 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.863396 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.864244 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.864340 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.864565 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.864876 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.864976 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.865182 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.865273 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.865550 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.865644 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.865831 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.865931 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.866138 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.866235 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.866439 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.866529 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.866743 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.866847 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.867053 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.867144 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.867361 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.867458 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.867679 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.867778 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.867979 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.868067 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.868280 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.868369 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.868586 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.868678 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.868910 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.869011 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.869214 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.869310 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.869552 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.869657 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.869874 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.869964 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.870178 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.870282 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.870481 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.870571 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.870776 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.870873 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.871012 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 22 20:48:37.871112 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.871393 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.871703 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.872008 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.872340 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.872647 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.872954 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.873259 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.873588 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.873895 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.874201 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.874522 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.875099 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.875405 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.875726 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.876035 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.876348 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.876658 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.876966 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.877287 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.877687 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.878001 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.878306 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.878612 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.878921 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.879417 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.879956 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.880287 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.880611 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.880934 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.881277 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.881610 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.881952 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.882277 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.882590 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.882895 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.883196 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:48:37.883435 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 22 20:48:37.893962 ncdv-master-1 devstack@n-api.service[120877]: DEBUG oslo_db.sqlalchemy.engines [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:48:37.906065 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_db.sqlalchemy.engines [None req-9f3a154a-2b2c-4ba2-9f88-3c051f05063d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:48:37.955807 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.context [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52f5c6ef-d4de-4047-a310-d7aef14748aa(cell1) {{(pid=120877) load_cells /opt/stack/nova/nova/context.py:464}} Jan 22 20:48:37.960574 ncdv-master-1 devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:48:37.962172 ncdv-master-1 devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:48:37.962962 ncdv-master-1 devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:48:37.964860 ncdv-master-1 devstack@n-api.service[120877]: DEBUG oslo_concurrency.lockutils [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:48:37.969470 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.context [None req-9f3a154a-2b2c-4ba2-9f88-3c051f05063d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52f5c6ef-d4de-4047-a310-d7aef14748aa(cell1) {{(pid=120878) load_cells /opt/stack/nova/nova/context.py:464}} Jan 22 20:48:37.974203 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_concurrency.lockutils [None req-9f3a154a-2b2c-4ba2-9f88-3c051f05063d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:48:37.975965 ncdv-master-1 devstack@n-api.service[120877]: DEBUG oslo_db.sqlalchemy.engines [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:48:37.976307 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_concurrency.lockutils [None req-9f3a154a-2b2c-4ba2-9f88-3c051f05063d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:48:37.977144 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_concurrency.lockutils [None req-9f3a154a-2b2c-4ba2-9f88-3c051f05063d None None] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:48:37.978077 ncdv-master-1 devstack@n-api.service[120877]: DEBUG oslo_db.sqlalchemy.engines [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:48:37.979129 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_concurrency.lockutils [None req-9f3a154a-2b2c-4ba2-9f88-3c051f05063d None None] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:48:37.992265 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_db.sqlalchemy.engines [None req-9f3a154a-2b2c-4ba2-9f88-3c051f05063d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:48:37.995220 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_db.sqlalchemy.engines [None req-9f3a154a-2b2c-4ba2-9f88-3c051f05063d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:48:38.135105 ncdv-master-1 devstack@n-api.service[120877]: DEBUG oslo_db.sqlalchemy.engines [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:48:38.153571 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_db.sqlalchemy.engines [None req-9f3a154a-2b2c-4ba2-9f88-3c051f05063d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:48:38.577029 ncdv-master-1 devstack@n-api.service[120877]: WARNING keystonemiddleware.auth_token [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 22 20:48:38.583695 ncdv-master-1 devstack@n-api.service[120877]: WARNING keystonemiddleware.auth_token [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 22 20:48:38.600935 ncdv-master-1 devstack@n-api.service[120878]: WARNING keystonemiddleware.auth_token [None req-9f3a154a-2b2c-4ba2-9f88-3c051f05063d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 22 20:48:38.607377 ncdv-master-1 devstack@n-api.service[120878]: WARNING keystonemiddleware.auth_token [None req-9f3a154a-2b2c-4ba2-9f88-3c051f05063d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 22 20:48:38.943120 ncdv-master-1 devstack@n-api.service[120877]: WARNING keystonemiddleware.auth_token [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 22 20:48:38.948324 ncdv-master-1 devstack@n-api.service[120877]: WARNING keystonemiddleware.auth_token [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 22 20:48:38.953580 ncdv-master-1 devstack@n-api.service[120877]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d25a83b9c0 pid: 120877 (default app) Jan 22 20:48:38.955609 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:48:38.956751 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] 10.222.0.100 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001681 Jan 22 20:48:38.957779 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 1/1] 10.222.0.100 () {50 vars in 793 bytes} [Sat Jan 22 20:48:38 2022] GET /compute/v2.1/ => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:48:38.968705 ncdv-master-1 devstack@n-api.service[120878]: WARNING keystonemiddleware.auth_token [None req-9f3a154a-2b2c-4ba2-9f88-3c051f05063d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 22 20:48:38.974903 ncdv-master-1 devstack@n-api.service[120878]: WARNING keystonemiddleware.auth_token [None req-9f3a154a-2b2c-4ba2-9f88-3c051f05063d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 22 20:48:38.980166 ncdv-master-1 devstack@n-api.service[120878]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d25a83b9c0 pid: 120878 (default app) Jan 22 20:50:10.593382 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:50:10.594449 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001486 Jan 22 20:50:10.597195 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 2/2] 10.222.0.100 () {54 vars in 935 bytes} [Sat Jan 22 20:50:10 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:50:11.023948 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-58e2a402-b9ae-4461-9bf9-b9fa45142e5e admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:50:11.053717 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-58e2a402-b9ae-4461-9bf9-b9fa45142e5e admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.452021 Jan 22 20:50:11.054601 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 1/3] 10.222.0.100 () {60 vars in 1296 bytes} [Sat Jan 22 20:50:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:50:13.395046 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:50:13.396023 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5d07ba8f-5d76-4404-920b-055dd539a7a8 None None] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001389 Jan 22 20:50:13.397699 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 3/4] 10.222.0.100 () {54 vars in 935 bytes} [Sat Jan 22 20:50:13 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:50:13.460712 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-eb7285ab-09fd-4c32-86fe-e1d3d3dc97e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:13.479280 ncdv-master-1 devstack@n-api.service[120878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:50:13.479280 ncdv-master-1 devstack@n-api.service[120878]: warnings.warn(msg) Jan 22 20:50:13.579078 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-eb7285ab-09fd-4c32-86fe-e1d3d3dc97e3 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.176740 Jan 22 20:50:13.580049 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 2/5] 10.222.0.100 () {64 vars in 1287 bytes} [Sat Jan 22 20:50:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:50:13.794054 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5cc8383e-834c-4111-b4a1-b90c0a59ccb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:13.796371 ncdv-master-1 devstack@n-api.service[120877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:50:13.796371 ncdv-master-1 devstack@n-api.service[120877]: warnings.warn(msg) Jan 22 20:50:13.905593 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5cc8383e-834c-4111-b4a1-b90c0a59ccb9 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.317772 Jan 22 20:50:13.906325 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 4/6] 10.222.0.100 () {64 vars in 1340 bytes} [Sat Jan 22 20:50:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:50:16.267740 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-eb7285ab-09fd-4c32-86fe-e1d3d3dc97e3 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:50:16.268847 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-eb7285ab-09fd-4c32-86fe-e1d3d3dc97e3 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002269 Jan 22 20:50:16.269316 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 3/7] 10.222.0.100 () {54 vars in 935 bytes} [Sat Jan 22 20:50:16 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:50:16.372520 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e75dff48-efa7-44c0-a188-488f2b330678 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "ram": 512, "rxtx_factor": 1.0, "disk": 5, "name": "ds512M"}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:16.393618 ncdv-master-1 devstack@n-api.service[120877]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:50:16.393618 ncdv-master-1 devstack@n-api.service[120877]: warnings.warn(msg) Jan 22 20:50:16.517756 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e75dff48-efa7-44c0-a188-488f2b330678 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.242491 Jan 22 20:50:16.521560 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 5/8] 10.222.0.100 () {64 vars in 1287 bytes} [Sat Jan 22 20:50:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:50:16.530299 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-0d6015a5-aabf-4758-ab31-1e3322148013 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:16.531793 ncdv-master-1 devstack@n-api.service[120878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:50:16.531793 ncdv-master-1 devstack@n-api.service[120878]: warnings.warn(msg) Jan 22 20:50:16.654940 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-0d6015a5-aabf-4758-ab31-1e3322148013 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128344 Jan 22 20:50:16.657748 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 4/9] 10.222.0.100 () {64 vars in 1340 bytes} [Sat Jan 22 20:50:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:50:19.253655 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e75dff48-efa7-44c0-a188-488f2b330678 admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:50:19.255515 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e75dff48-efa7-44c0-a188-488f2b330678 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002110 Jan 22 20:50:19.256272 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 6/10] 10.222.0.100 () {54 vars in 935 bytes} [Sat Jan 22 20:50:19 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:50:19.398198 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-f3e5f01e-7095-4dec-99e4-9065f4b2ef54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "ds1G"}} {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:19.520341 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-f3e5f01e-7095-4dec-99e4-9065f4b2ef54 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.247926 Jan 22 20:50:19.521704 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 5/11] 10.222.0.100 () {64 vars in 1287 bytes} [Sat Jan 22 20:50:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:50:19.532752 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7539a1bb-4bc4-4de7-b058-b489fc0cfa33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:19.649391 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7539a1bb-4bc4-4de7-b058-b489fc0cfa33 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120376 Jan 22 20:50:19.662765 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 7/12] 10.222.0.100 () {64 vars in 1340 bytes} [Sat Jan 22 20:50:19 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 20:50:22.400868 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-f3e5f01e-7095-4dec-99e4-9065f4b2ef54 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:50:22.402190 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-f3e5f01e-7095-4dec-99e4-9065f4b2ef54 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001447 Jan 22 20:50:22.414210 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 6/13] 10.222.0.100 () {54 vars in 935 bytes} [Sat Jan 22 20:50:22 2022] GET /compute/v2.1 => generated 389 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:50:22.467601 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-515e781f-ef8c-4491-b2c0-986e71eda354 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3", "disk": 10, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:22.556267 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-515e781f-ef8c-4491-b2c0-986e71eda354 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.143684 Jan 22 20:50:22.576392 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-95ece68a-d3a4-4f13-b8c6-d4ef756a6873 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:22.582798 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 8/14] 10.222.0.100 () {64 vars in 1287 bytes} [Sat Jan 22 20:50:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:50:22.690614 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-95ece68a-d3a4-4f13-b8c6-d4ef756a6873 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120770 Jan 22 20:50:22.691323 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 7/15] 10.222.0.100 () {64 vars in 1340 bytes} [Sat Jan 22 20:50:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:50:25.154319 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-515e781f-ef8c-4491-b2c0-986e71eda354 admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:50:25.158494 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-515e781f-ef8c-4491-b2c0-986e71eda354 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.003794 Jan 22 20:50:25.159352 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 9/16] 10.222.0.100 () {54 vars in 935 bytes} [Sat Jan 22 20:50:25 2022] GET /compute/v2.1 => generated 389 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:50:25.229682 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-5e6bbfc3-9862-48e1-8b74-928cf7226e55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "swap": 0, "vcpus": 4}} {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:25.288739 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-5e6bbfc3-9862-48e1-8b74-928cf7226e55 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.122801 Jan 22 20:50:25.289285 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 8/17] 10.222.0.100 () {64 vars in 1287 bytes} [Sat Jan 22 20:50:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:50:25.301717 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-8131e046-12f5-4c2d-ad0c-9fe9059ad6ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:25.390199 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-8131e046-12f5-4c2d-ad0c-9fe9059ad6ec admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092067 Jan 22 20:50:25.390315 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 10/18] 10.222.0.100 () {64 vars in 1340 bytes} [Sat Jan 22 20:50:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:50:27.816608 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-5e6bbfc3-9862-48e1-8b74-928cf7226e55 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:50:27.817666 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-5e6bbfc3-9862-48e1-8b74-928cf7226e55 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001417 Jan 22 20:50:27.818332 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 9/19] 10.222.0.100 () {54 vars in 935 bytes} [Sat Jan 22 20:50:27 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:50:27.878201 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2f1d3405-46f9-4735-b2f1-42bee4bb73bd admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:50:27.901213 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-2f1d3405-46f9-4735-b2f1-42bee4bb73bd admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.077069 Jan 22 20:50:27.901859 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 11/20] 10.222.0.100 () {60 vars in 1296 bytes} [Sat Jan 22 20:50:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 20:50:30.361631 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-5e6bbfc3-9862-48e1-8b74-928cf7226e55 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:50:30.369571 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-5e6bbfc3-9862-48e1-8b74-928cf7226e55 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001497 Jan 22 20:50:30.369571 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 10/21] 10.222.0.100 () {54 vars in 935 bytes} [Sat Jan 22 20:50:30 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:50:30.428716 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9a906091-a4d9-45bf-b34d-8d5361f63a80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "name": "m1.tiny", "disk": 1, "id": "1", "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:30.523106 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9a906091-a4d9-45bf-b34d-8d5361f63a80 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154185 Jan 22 20:50:30.524154 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 12/22] 10.222.0.100 () {64 vars in 1287 bytes} [Sat Jan 22 20:50:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:50:30.536622 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-456d4184-2b4c-4b1b-8074-787d5921deb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:30.601099 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-456d4184-2b4c-4b1b-8074-787d5921deb8 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068246 Jan 22 20:50:30.602338 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 11/23] 10.222.0.100 () {64 vars in 1337 bytes} [Sat Jan 22 20:50:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:50:33.753179 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-9a906091-a4d9-45bf-b34d-8d5361f63a80 admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:50:33.754210 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-9a906091-a4d9-45bf-b34d-8d5361f63a80 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001463 Jan 22 20:50:33.754613 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 13/24] 10.222.0.100 () {54 vars in 935 bytes} [Sat Jan 22 20:50:33 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:50:33.817817 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-6b79aac7-d26b-4ff2-a95e-0d04c509e0f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "id": "2", "vcpus": 1, "swap": 0}} {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:33.950472 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-6b79aac7-d26b-4ff2-a95e-0d04c509e0f8 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.189618 Jan 22 20:50:33.957560 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 12/25] 10.222.0.100 () {64 vars in 1287 bytes} [Sat Jan 22 20:50:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:50:33.963867 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2f7b13c1-ec09-4b5c-a648-97f8c1cd1c92 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:34.079902 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-2f7b13c1-ec09-4b5c-a648-97f8c1cd1c92 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119639 Jan 22 20:50:34.080484 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 14/26] 10.222.0.100 () {64 vars in 1337 bytes} [Sat Jan 22 20:50:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:50:36.731202 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-6b79aac7-d26b-4ff2-a95e-0d04c509e0f8 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:50:36.732187 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-6b79aac7-d26b-4ff2-a95e-0d04c509e0f8 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001431 Jan 22 20:50:36.732841 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 13/27] 10.222.0.100 () {54 vars in 935 bytes} [Sat Jan 22 20:50:36 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:50:36.795663 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-78a40aed-ef61-4cd9-a52d-85acfe3961c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "ram": 4096, "name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:36.864673 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-78a40aed-ef61-4cd9-a52d-85acfe3961c9 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.125495 Jan 22 20:50:36.865233 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 15/28] 10.222.0.100 () {64 vars in 1287 bytes} [Sat Jan 22 20:50:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:50:36.877418 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-a23350be-28ec-4dda-9622-78f0f47e14ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:36.948748 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-a23350be-28ec-4dda-9622-78f0f47e14ff admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074836 Jan 22 20:50:36.949715 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 14/29] 10.222.0.100 () {64 vars in 1337 bytes} [Sat Jan 22 20:50:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:50:39.409182 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-78a40aed-ef61-4cd9-a52d-85acfe3961c9 admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:50:39.410274 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-78a40aed-ef61-4cd9-a52d-85acfe3961c9 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001521 Jan 22 20:50:39.410701 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 16/30] 10.222.0.100 () {54 vars in 935 bytes} [Sat Jan 22 20:50:39 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:50:39.485624 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-54138e20-df3f-468f-8cd3-311d45635dae admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:39.589988 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-54138e20-df3f-468f-8cd3-311d45635dae admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.173286 Jan 22 20:50:39.590665 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 15/31] 10.222.0.100 () {64 vars in 1287 bytes} [Sat Jan 22 20:50:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 20:50:39.603020 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e76e7715-22d9-4420-9ddc-cafd85f00467 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:39.684745 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e76e7715-22d9-4420-9ddc-cafd85f00467 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085478 Jan 22 20:50:39.685373 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 17/32] 10.222.0.100 () {64 vars in 1337 bytes} [Sat Jan 22 20:50:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:50:42.080045 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-54138e20-df3f-468f-8cd3-311d45635dae admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:50:42.081044 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-54138e20-df3f-468f-8cd3-311d45635dae admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001441 Jan 22 20:50:42.081450 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 16/33] 10.222.0.100 () {54 vars in 935 bytes} [Sat Jan 22 20:50:42 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:50:42.148534 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e9c9dd11-6fcb-4978-a4cd-4fd7b242bc2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "swap": 0, "id": "5", "ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:42.218847 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e9c9dd11-6fcb-4978-a4cd-4fd7b242bc2b admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.130825 Jan 22 20:50:42.220064 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 18/34] 10.222.0.100 () {64 vars in 1287 bytes} [Sat Jan 22 20:50:42 2022] POST /compute/v2.1/flavors => generated 410 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:50:42.232291 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-a44574d7-5b6e-4f5e-b89f-5b17fc10f107 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:50:42.332104 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-a44574d7-5b6e-4f5e-b89f-5b17fc10f107 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103884 Jan 22 20:50:42.333744 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 17/35] 10.222.0.100 () {64 vars in 1337 bytes} [Sat Jan 22 20:50:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:51:08.701393 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e9c9dd11-6fcb-4978-a4cd-4fd7b242bc2b admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:08.702426 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e9c9dd11-6fcb-4978-a4cd-4fd7b242bc2b admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001472 Jan 22 20:51:08.702826 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 19/36] 10.222.0.100 () {54 vars in 935 bytes} [Sat Jan 22 20:51:08 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:51:08.760852 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-a578f67d-3366-4975-a689-c238c85f40da admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:08.777694 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-a578f67d-3366-4975-a689-c238c85f40da admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.068882 Jan 22 20:51:08.778219 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 18/37] 10.222.0.100 () {60 vars in 1296 bytes} [Sat Jan 22 20:51:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 20:51:10.239995 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-e9c9dd11-6fcb-4978-a4cd-4fd7b242bc2b admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:10.240983 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-e9c9dd11-6fcb-4978-a4cd-4fd7b242bc2b admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001403 Jan 22 20:51:10.241376 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 20/38] 10.222.0.100 () {56 vars in 1079 bytes} [Sat Jan 22 20:51:10 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:51:10.476499 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-606925f1-47de-4357-b295-f4cfbb2b5252 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:10.482027 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.wsgi [None req-606925f1-47de-4357-b295-f4cfbb2b5252 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 22 20:51:10.482589 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-606925f1-47de-4357-b295-f4cfbb2b5252 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:51:10.483370 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-606925f1-47de-4357-b295-f4cfbb2b5252 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059702 Jan 22 20:51:10.483875 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 19/39] 10.222.0.100 () {60 vars in 1195 bytes} [Sat Jan 22 20:51:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 22 20:51:10.493492 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-5d4b6be9-0b5b-4651-afd2-5a16a50d7caa admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:10.514816 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-5d4b6be9-0b5b-4651-afd2-5a16a50d7caa admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.024942 Jan 22 20:51:10.516175 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 21/40] 10.222.0.100 () {60 vars in 1215 bytes} [Sat Jan 22 20:51:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 20:51:10.528414 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-1154fbe2-d7df-4de8-bd48-d9da7e1d44e7 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:10.550454 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-1154fbe2-d7df-4de8-bd48-d9da7e1d44e7 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.026344 Jan 22 20:51:10.556467 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 20/41] 10.222.0.100 () {60 vars in 1215 bytes} [Sat Jan 22 20:51:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 20:51:10.565432 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3fb56d95-a094-4a6d-bfd9-a19c40049fa0 admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:10.570929 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-3fb56d95-a094-4a6d-bfd9-a19c40049fa0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 22 20:51:10.571490 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-3fb56d95-a094-4a6d-bfd9-a19c40049fa0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:51:10.572269 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-3fb56d95-a094-4a6d-bfd9-a19c40049fa0 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011290 Jan 22 20:51:10.572786 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 22/42] 10.222.0.100 () {60 vars in 1195 bytes} [Sat Jan 22 20:51:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 22 20:51:11.941671 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-1154fbe2-d7df-4de8-bd48-d9da7e1d44e7 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:11.942661 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-1154fbe2-d7df-4de8-bd48-d9da7e1d44e7 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001442 Jan 22 20:51:11.943047 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 21/43] 10.222.0.100 () {56 vars in 1079 bytes} [Sat Jan 22 20:51:11 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:51:12.143346 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2e1f3526-6ab3-4087-b379-034145a37098 admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:12.149606 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-2e1f3526-6ab3-4087-b379-034145a37098 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 22 20:51:12.150206 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-2e1f3526-6ab3-4087-b379-034145a37098 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:51:12.151047 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-2e1f3526-6ab3-4087-b379-034145a37098 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059314 Jan 22 20:51:12.151611 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 23/44] 10.222.0.100 () {60 vars in 1195 bytes} [Sat Jan 22 20:51:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 22 20:51:12.161147 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-0c51124e-00b1-47aa-82e3-f33b78b085b2 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:12.174973 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-0c51124e-00b1-47aa-82e3-f33b78b085b2 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017279 Jan 22 20:51:12.175486 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 22/45] 10.222.0.100 () {60 vars in 1215 bytes} [Sat Jan 22 20:51:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 20:51:12.184763 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0d9dfe3a-3523-4af8-91e2-dbcb4e6ddcc1 admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:12.198671 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0d9dfe3a-3523-4af8-91e2-dbcb4e6ddcc1 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017414 Jan 22 20:51:12.199210 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 24/46] 10.222.0.100 () {60 vars in 1215 bytes} [Sat Jan 22 20:51:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 20:51:12.208410 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-f63befa8-ef75-47c1-bb87-e0ad703bc30e admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:12.213818 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.wsgi [None req-f63befa8-ef75-47c1-bb87-e0ad703bc30e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 22 20:51:12.214377 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-f63befa8-ef75-47c1-bb87-e0ad703bc30e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:51:12.217601 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-f63befa8-ef75-47c1-bb87-e0ad703bc30e admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010315 Jan 22 20:51:12.217601 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 23/47] 10.222.0.100 () {60 vars in 1195 bytes} [Sat Jan 22 20:51:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 22 20:51:13.565955 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-0d9dfe3a-3523-4af8-91e2-dbcb4e6ddcc1 admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:13.567003 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-0d9dfe3a-3523-4af8-91e2-dbcb4e6ddcc1 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001465 Jan 22 20:51:13.567552 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 25/48] 10.222.0.100 () {56 vars in 1079 bytes} [Sat Jan 22 20:51:13 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:51:13.765066 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-9ffb67e8-a2d7-4750-8523-cc42bb1055c4 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:13.771101 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.wsgi [None req-9ffb67e8-a2d7-4750-8523-cc42bb1055c4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 22 20:51:13.771648 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-9ffb67e8-a2d7-4750-8523-cc42bb1055c4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:51:13.773622 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-9ffb67e8-a2d7-4750-8523-cc42bb1055c4 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058301 Jan 22 20:51:13.773622 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 24/49] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 20:51:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 22 20:51:13.782918 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-047d45ad-d725-4309-9189-36724e9a3ba4 admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:13.796154 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-047d45ad-d725-4309-9189-36724e9a3ba4 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017438 Jan 22 20:51:13.796881 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 26/50] 10.222.0.100 () {60 vars in 1215 bytes} [Sat Jan 22 20:51:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 20:51:13.806471 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-5a18385b-d607-4e43-8ef0-f8a7e87438e6 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:13.819455 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-5a18385b-d607-4e43-8ef0-f8a7e87438e6 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.016733 Jan 22 20:51:13.819965 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 25/51] 10.222.0.100 () {60 vars in 1215 bytes} [Sat Jan 22 20:51:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 20:51:13.829781 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4f354274-b53f-489f-8f95-4443ac8bb42e admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:13.834966 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.wsgi [None req-4f354274-b53f-489f-8f95-4443ac8bb42e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 22 20:51:13.835600 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-4f354274-b53f-489f-8f95-4443ac8bb42e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:51:13.836371 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-4f354274-b53f-489f-8f95-4443ac8bb42e admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010769 Jan 22 20:51:13.836847 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 27/52] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 20:51:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 22 20:51:15.222089 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-5a18385b-d607-4e43-8ef0-f8a7e87438e6 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:15.223081 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-5a18385b-d607-4e43-8ef0-f8a7e87438e6 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001445 Jan 22 20:51:15.223471 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 26/53] 10.222.0.100 () {56 vars in 1079 bytes} [Sat Jan 22 20:51:15 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:51:15.430247 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-11b3adba-8000-4ad1-a05b-3a8cb643bf02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:51:15.524307 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-11b3adba-8000-4ad1-a05b-3a8cb643bf02 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.145439 Jan 22 20:51:15.524840 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 28/54] 10.222.0.100 () {64 vars in 1240 bytes} [Sat Jan 22 20:51:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:51:16.967201 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-5a18385b-d607-4e43-8ef0-f8a7e87438e6 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:16.968217 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-5a18385b-d607-4e43-8ef0-f8a7e87438e6 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001488 Jan 22 20:51:16.968660 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 27/55] 10.222.0.100 () {56 vars in 1079 bytes} [Sat Jan 22 20:51:16 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:51:17.206925 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-87627df5-d536-4303-ac85-2b4f6d17544e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:51:17.307450 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-87627df5-d536-4303-ac85-2b4f6d17544e admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.165235 Jan 22 20:51:17.307989 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 29/56] 10.222.0.100 () {64 vars in 1240 bytes} [Sat Jan 22 20:51:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:51:18.732721 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-5a18385b-d607-4e43-8ef0-f8a7e87438e6 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:18.733859 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-5a18385b-d607-4e43-8ef0-f8a7e87438e6 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001387 Jan 22 20:51:18.734877 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 28/57] 10.222.0.100 () {56 vars in 1079 bytes} [Sat Jan 22 20:51:18 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:51:18.935181 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-ef57b9f9-ac28-4eff-8792-36ca2763cf21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:51:18.998769 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-ef57b9f9-ac28-4eff-8792-36ca2763cf21 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.115911 Jan 22 20:51:18.999305 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 30/58] 10.222.0.100 () {64 vars in 1240 bytes} [Sat Jan 22 20:51:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:51:20.353294 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-5a18385b-d607-4e43-8ef0-f8a7e87438e6 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:20.354379 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-5a18385b-d607-4e43-8ef0-f8a7e87438e6 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001428 Jan 22 20:51:20.354822 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 29/59] 10.222.0.100 () {56 vars in 1079 bytes} [Sat Jan 22 20:51:20 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:51:20.557042 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-dba91b12-331c-4b73-bac3-dc9e465408f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:51:20.661965 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-dba91b12-331c-4b73-bac3-dc9e465408f5 admin admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.156431 Jan 22 20:51:20.662429 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 31/60] 10.222.0.100 () {64 vars in 1240 bytes} [Sat Jan 22 20:51:20 2022] POST /compute/v2.1/flavors => generated 411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:51:22.017227 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-5a18385b-d607-4e43-8ef0-f8a7e87438e6 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:22.018252 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-5a18385b-d607-4e43-8ef0-f8a7e87438e6 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002207 Jan 22 20:51:22.018653 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 30/61] 10.222.0.100 () {56 vars in 1079 bytes} [Sat Jan 22 20:51:22 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:51:22.220394 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-181d5b08-3c15-423b-98b1-954cdce1b39e admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:51:22.240011 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-181d5b08-3c15-423b-98b1-954cdce1b39e admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.071620 Jan 22 20:51:22.240466 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 32/62] 10.222.0.100 () {60 vars in 1207 bytes} [Sat Jan 22 20:51:22 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 20:52:10.820374 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-5a18385b-d607-4e43-8ef0-f8a7e87438e6 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:52:10.821453 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-5a18385b-d607-4e43-8ef0-f8a7e87438e6 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001530 Jan 22 20:52:10.822015 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 31/63] 10.222.0.100 () {54 vars in 935 bytes} [Sat Jan 22 20:52:10 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:52:10.881049 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-480a77dd-5fbb-442c-9474-85e7f1287d2e admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:52:10.901135 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-480a77dd-5fbb-442c-9474-85e7f1287d2e admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.073036 Jan 22 20:52:10.901717 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 33/64] 10.222.0.100 () {60 vars in 1296 bytes} [Sat Jan 22 20:52:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 20:52:10.924408 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-9c9cb5ad-8b3b-437b-8c5e-b37b8bf831ca admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:52:10.932134 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-9c9cb5ad-8b3b-437b-8c5e-b37b8bf831ca admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011592 Jan 22 20:52:10.932639 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 32/65] 10.222.0.100 () {60 vars in 1287 bytes} [Sat Jan 22 20:52:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:52:10.944515 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-18cd16c5-1aea-42da-aa91-da2fbbe12275 admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:52:10.952141 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-18cd16c5-1aea-42da-aa91-da2fbbe12275 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011059 Jan 22 20:52:10.952604 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 34/66] 10.222.0.100 () {60 vars in 1290 bytes} [Sat Jan 22 20:52:10 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:52:10.964399 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-530c6349-3cf0-4ba0-825e-4acbaaeacf05 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:52:10.972670 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-530c6349-3cf0-4ba0-825e-4acbaaeacf05 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011813 Jan 22 20:52:10.973189 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 33/67] 10.222.0.100 () {60 vars in 1290 bytes} [Sat Jan 22 20:52:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:52:10.984139 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7e82259c-88b7-444e-8e68-86094e0b4de1 admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:52:10.992469 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7e82259c-88b7-444e-8e68-86094e0b4de1 admin admin] 10.222.0.100 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011847 Jan 22 20:52:10.992981 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 35/68] 10.222.0.100 () {60 vars in 1287 bytes} [Sat Jan 22 20:52:10 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:54:12.221525 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-4b772e09-a3b8-4e10-9fd9-99ca7bcb0333 tempest-verify_tempest_config-1806827078 tempest-verify_tempest_config-1806827078-project] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:54:12.223734 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-4b772e09-a3b8-4e10-9fd9-99ca7bcb0333 tempest-verify_tempest_config-1806827078 tempest-verify_tempest_config-1806827078-project] 10.222.0.100 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106720 Jan 22 20:54:12.224041 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 34/69] 10.222.0.100 () {58 vars in 1138 bytes} [Sat Jan 22 20:54:12 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:58:14.614938 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7e82259c-88b7-444e-8e68-86094e0b4de1 admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:58:14.615914 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7e82259c-88b7-444e-8e68-86094e0b4de1 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001466 Jan 22 20:58:14.616295 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 36/70] 10.222.0.100 () {56 vars in 1079 bytes} [Sat Jan 22 20:58:14 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:58:14.886013 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-e9fe3ed8-4d9d-4d57-9863-c0bc69012850 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:58:14.887188 ncdv-master-1 devstack@n-api.service[120878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:58:14.887188 ncdv-master-1 devstack@n-api.service[120878]: warnings.warn(msg) Jan 22 20:58:14.888732 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_concurrency.lockutils [None req-e9fe3ed8-4d9d-4d57-9863-c0bc69012850 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:58:14.889170 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_concurrency.lockutils [None req-e9fe3ed8-4d9d-4d57-9863-c0bc69012850 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:58:14.889990 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_concurrency.lockutils [None req-e9fe3ed8-4d9d-4d57-9863-c0bc69012850 admin admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:58:14.890415 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_concurrency.lockutils [None req-e9fe3ed8-4d9d-4d57-9863-c0bc69012850 admin admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:58:14.930616 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-e9fe3ed8-4d9d-4d57-9863-c0bc69012850 admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.160226 Jan 22 20:58:14.931302 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 35/71] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 20:58:14 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 20:58:16.291803 ncdv-master-1 devstack@n-api.service[120877]: DEBUG nova.api.openstack.wsgi [None req-7e82259c-88b7-444e-8e68-86094e0b4de1 admin admin] Calling method '>' {{(pid=120877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:58:16.292807 ncdv-master-1 devstack@n-api.service[120877]: INFO nova.api.openstack.requestlog [None req-7e82259c-88b7-444e-8e68-86094e0b4de1 admin admin] 10.222.0.100 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001384 Jan 22 20:58:16.293189 ncdv-master-1 devstack@n-api.service[120877]: [pid: 120877|app: 0|req: 37/72] 10.222.0.100 () {56 vars in 1079 bytes} [Sat Jan 22 20:58:16 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:58:16.491500 ncdv-master-1 devstack@n-api.service[120878]: DEBUG nova.api.openstack.wsgi [None req-3d4a8ef4-1fd9-4f0d-b2dc-d355264172d4 admin admin] Calling method '>' {{(pid=120878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:58:16.492682 ncdv-master-1 devstack@n-api.service[120878]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:58:16.492682 ncdv-master-1 devstack@n-api.service[120878]: warnings.warn(msg) Jan 22 20:58:16.494745 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_concurrency.lockutils [None req-3d4a8ef4-1fd9-4f0d-b2dc-d355264172d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:58:16.495187 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_concurrency.lockutils [None req-3d4a8ef4-1fd9-4f0d-b2dc-d355264172d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:58:16.495978 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_concurrency.lockutils [None req-3d4a8ef4-1fd9-4f0d-b2dc-d355264172d4 admin admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:58:16.496407 ncdv-master-1 devstack@n-api.service[120878]: DEBUG oslo_concurrency.lockutils [None req-3d4a8ef4-1fd9-4f0d-b2dc-d355264172d4 admin admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:58:16.518190 ncdv-master-1 devstack@n-api.service[120878]: INFO nova.api.openstack.requestlog [None req-3d4a8ef4-1fd9-4f0d-b2dc-d355264172d4 admin admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.079156 Jan 22 20:58:16.518661 ncdv-master-1 devstack@n-api.service[120878]: [pid: 120878|app: 0|req: 36/73] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 20:58:16 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 20:59:03.205611 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Jan 22 20:59:03.206550 ncdv-master-1 devstack@n-api.service[120876]: Sat Jan 22 20:59:03 2022 - graceful shutdown triggered... Jan 22 20:59:03.207187 ncdv-master-1 devstack@n-api.service[120877]: Gracefully killing worker 1 (pid: 120877)... Jan 22 20:59:03.207655 ncdv-master-1 devstack@n-api.service[120878]: Gracefully killing worker 2 (pid: 120878)... Jan 22 20:59:04.208248 ncdv-master-1 devstack@n-api.service[120876]: worker 1 buried after 1 seconds Jan 22 20:59:04.208248 ncdv-master-1 devstack@n-api.service[120876]: worker 2 buried after 1 seconds Jan 22 20:59:04.208248 ncdv-master-1 devstack@n-api.service[120876]: goodbye to uWSGI. Jan 22 20:59:04.210319 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Jan 22 20:59:04.210892 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Jan 22 20:59:04.213773 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jan 22 20:59:04.250521 ncdv-master-1 devstack@n-api.service[137020]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 22 20:59:04.267585 ncdv-master-1 devstack@n-api.service[137020]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jan 22 20:59:04 2022] *** Jan 22 20:59:04.267585 ncdv-master-1 devstack@n-api.service[137020]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 22 20:59:04.267585 ncdv-master-1 devstack@n-api.service[137020]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 22 20:59:04.267585 ncdv-master-1 devstack@n-api.service[137020]: nodename: ncdv-master-1 Jan 22 20:59:04.267585 ncdv-master-1 devstack@n-api.service[137020]: machine: x86_64 Jan 22 20:59:04.267585 ncdv-master-1 devstack@n-api.service[137020]: clock source: unix Jan 22 20:59:04.267585 ncdv-master-1 devstack@n-api.service[137020]: pcre jit disabled Jan 22 20:59:04.267585 ncdv-master-1 devstack@n-api.service[137020]: detected number of CPU cores: 4 Jan 22 20:59:04.267585 ncdv-master-1 devstack@n-api.service[137020]: current working directory: / Jan 22 20:59:04.267585 ncdv-master-1 devstack@n-api.service[137020]: detected binary path: /usr/bin/uwsgi-core Jan 22 20:59:04.268367 ncdv-master-1 devstack@n-api.service[137020]: your processes number limit is 47680 Jan 22 20:59:04.268367 ncdv-master-1 devstack@n-api.service[137020]: your memory page size is 4096 bytes Jan 22 20:59:04.268367 ncdv-master-1 devstack@n-api.service[137020]: detected max file descriptor number: 2048 Jan 22 20:59:04.268367 ncdv-master-1 devstack@n-api.service[137020]: lock engine: pthread robust mutexes Jan 22 20:59:04.268367 ncdv-master-1 devstack@n-api.service[137020]: thunder lock: enabled Jan 22 20:59:04.268367 ncdv-master-1 devstack@n-api.service[137020]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 22 20:59:04.268367 ncdv-master-1 devstack@n-api.service[137020]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 22 20:59:04.320351 ncdv-master-1 devstack@n-api.service[137020]: Python main interpreter initialized at 0x55f2f1f569c0 Jan 22 20:59:04.320351 ncdv-master-1 devstack@n-api.service[137020]: python threads support enabled Jan 22 20:59:04.320351 ncdv-master-1 devstack@n-api.service[137020]: your server socket listen backlog is limited to 100 connections Jan 22 20:59:04.320351 ncdv-master-1 devstack@n-api.service[137020]: your mercy for graceful operations on workers is 90 seconds Jan 22 20:59:04.320805 ncdv-master-1 devstack@n-api.service[137020]: mapped 403077 bytes (393 KB) for 2 cores Jan 22 20:59:04.320805 ncdv-master-1 devstack@n-api.service[137020]: *** Operational MODE: preforking *** Jan 22 20:59:04.321045 ncdv-master-1 devstack@n-api.service[137020]: *** uWSGI is running in multiple interpreter mode *** Jan 22 20:59:04.321045 ncdv-master-1 devstack@n-api.service[137020]: spawned uWSGI master process (pid: 137020) Jan 22 20:59:04.321248 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jan 22 20:59:04.321876 ncdv-master-1 devstack@n-api.service[137020]: spawned uWSGI worker 1 (pid: 137032, cores: 1) Jan 22 20:59:04.322255 ncdv-master-1 devstack@n-api.service[137020]: spawned uWSGI worker 2 (pid: 137033, cores: 1) Jan 22 20:59:04.322441 ncdv-master-1 devstack@n-api.service[137020]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 22 20:59:06.376096 ncdv-master-1 devstack@n-api.service[137033]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 22 20:59:06.376096 ncdv-master-1 devstack@n-api.service[137033]: from cryptography.utils import int_from_bytes Jan 22 20:59:06.376773 ncdv-master-1 devstack@n-api.service[137033]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 22 20:59:06.376773 ncdv-master-1 devstack@n-api.service[137033]: from cryptography.utils import int_from_bytes Jan 22 20:59:06.426208 ncdv-master-1 devstack@n-api.service[137032]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 22 20:59:06.426208 ncdv-master-1 devstack@n-api.service[137032]: from cryptography.utils import int_from_bytes Jan 22 20:59:06.426864 ncdv-master-1 devstack@n-api.service[137032]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 22 20:59:06.426864 ncdv-master-1 devstack@n-api.service[137032]: from cryptography.utils import int_from_bytes Jan 22 20:59:08.866180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 22 20:59:08.866738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 22 20:59:08.866956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 22 20:59:08.867388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 22 20:59:08.867599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 22 20:59:08.868022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.868328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.868661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.870257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.870257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.870257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.870257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.870600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.870689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.870910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.871210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.871548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.871888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.872225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.872509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.872837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.873339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.873720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.874059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.878396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.878396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.878396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.878396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.878396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.878396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.878882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.878882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.878882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.878882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.878882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.878882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.878882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.878882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.879412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.879647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.879937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.880256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.881128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.881478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.881890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.882235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.882573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.882909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.883246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.883564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.883888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.884216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.884550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.884870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.885190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.885453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.885813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.886152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.886488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.886825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.887088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.887351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.887685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.888040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.888366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.888668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.888988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.889311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.889660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.890008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.890373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.890697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.891031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.891360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.891699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.892020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.892356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.892766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.893033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.893353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.893746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.894087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.894636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.894978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.895316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.895639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.895963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.896970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.897321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.897705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.898030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.898473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.898966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.899299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.899640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.899962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.900283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.900782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.901102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.901426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.901779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.902107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.902429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.902753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.903073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.903394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.903715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.904040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.904373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.904709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.905035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.905355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.905698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.906019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.906355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.906675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.906994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.907329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.907650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.907969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.908304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.908628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.908948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.909278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.909617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.909941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.910270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.910589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.910909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.911225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.911544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.911916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.912237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.912558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.912904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.913191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.913547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.913888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.914219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.914537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.914854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.915187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.915539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.915883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.916242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.916571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.916874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 22 20:59:08.917290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.917375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 22 20:59:08.917450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.917719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.917808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 22 20:59:08.918044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.918216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 22 20:59:08.918374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.918526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 22 20:59:08.918715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.918905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.919062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.919218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.919362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.919513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.919657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.919834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.919992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.920148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.920304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.920455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.920634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.920795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.920993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.921154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.921319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.921463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.921646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.921834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.922020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.922197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.922360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.922504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.922656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.922800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.922990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.923283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.923454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.923680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.923843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.923989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.924144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.924297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.924448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.924598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.924598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.924888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.924888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.925177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.925350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.925541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.925693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.925847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.926032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.926192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.926347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.926505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.926657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.926801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.926943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.927120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.927286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.927442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.927594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.927739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.927881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.928034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.928034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.928317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.928317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.928746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.928911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.929113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.929271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.930121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.930283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.930430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.930590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.930590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.930900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.931047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.931198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.931198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.931479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.931632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.931777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.932038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.932184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.932184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.932472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.932617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.932769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.932913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.933057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.933228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.933585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.933822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.933973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.934159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.934326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.934471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.934626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.934771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.934923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.935109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.935265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.935417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.935578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.935731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.935885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.936035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.936186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.936354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.936499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.936643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.936787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.936929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.937079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.937232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.937387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.937387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.937712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.937863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.938043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.938241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.938401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.938552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.938705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.938851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.939011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.939190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.939386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.939548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.939693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.939845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.940000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.940257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.940407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.940551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.940705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.940705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.941011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.941155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.941299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.941443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.941608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.941770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.941916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.942060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.942303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.942455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.942608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.942816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.943778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.944173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.944336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.100 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.944497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.944643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.100 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.944801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.944801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.945086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.945290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.945442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.945645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.945645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.946014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.946224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.946371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.946579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.946739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.946890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.947051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.947205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.947349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.947349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.947641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.947823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.947982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.947982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.948302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.948561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.948714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.948867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.949019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.949165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.949319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.949471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.949678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.949846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.950044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.950201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.950381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.950534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.950733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.950898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.950898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.951177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.951334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.951572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.951719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.951890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.952034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.952178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.952321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.952474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.952619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.952776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.952930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.953085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.953238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.953389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.953591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.953908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.954069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.954295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.954454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.954600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.954753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.954905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.955056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.955780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.955938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.956095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.956378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.956529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.956696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.956849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.956994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.957137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.957291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.957436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.957617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.957787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.957933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.958076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.958230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.958415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.959236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.959469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.959662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.959822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.959968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.960111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.960269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.960422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.960582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.960735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.960892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.961051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.961242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.961400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.961600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.961751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.961903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.962062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.962262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.962420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.962566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.962743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.962891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.963064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.963211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.963382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.964306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.964544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.964696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.964850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.965004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.965150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.965294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.965438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.965625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.965779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.965779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.966054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.966198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.966342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.966511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.966657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.966800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.966952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.967105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.967257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.967410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.967563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.967708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 22 20:59:08.967852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.967996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.968155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.968155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.968447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.968599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.968743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.968897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.969050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.969203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.969354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.969557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.969721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.969866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.970019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.970165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.970326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.970471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.970623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.970778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.971005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.971153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.971297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.971449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.971593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.971593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.971877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.971877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.972156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.972156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.972448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.972448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.972729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.972881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.973027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.973027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.973318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.973476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.973644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.973937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.974161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.974464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.974727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.974888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.975041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.975185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.975329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.975475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.975628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.975628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.975958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.976103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.976247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.976392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.976561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.976714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.976859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.977350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.977531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.977684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.977840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.977987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.978130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.978316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.978472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.978626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.978785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.978948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.979093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.979093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.979374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.979525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.979684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.979829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.979974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.980117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.980269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.980427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.980595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.981315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.981480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.981653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.981801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.981959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.982104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.982255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.982432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.982589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.982774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.982933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.983089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.983234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.983397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.983550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.983695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.983850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.983995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.984166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.984409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.984649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.984893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.985053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.985199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.985344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.985525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.985690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.985848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.986002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.986147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.986298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.986450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.986595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.986748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.986893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.987054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.987214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.987359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.987504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.987667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.987819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.987971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.988126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.988279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.988423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.988567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.988710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.988855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.989007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.989153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.989296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.989441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.989633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.989808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.989996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.990152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.990304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.990450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.990639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.990799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.990943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.991087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.991241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.991386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.991549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.991704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.991888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.992041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.992195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.992347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.992498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.992652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.992804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.992963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.993108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.993254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.993431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.993657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.993804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.993804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.994086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.994086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.994486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.994669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.994923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.995144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.995292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.995446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.995607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.995752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.995906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.996060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.996204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.996355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.996510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.996655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.996806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.996959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.997103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.997254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.997411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.997584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.997744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.997889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.998044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.998199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.998350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.998496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.998648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.998792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.998943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.999097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.999249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.999400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.999554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.999716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:08.999868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.000096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.000249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.000395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.000545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.000701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.000854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.001008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.001152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.001303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.001447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.001633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.001808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.001954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.002097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.002248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.002441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.002607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.002733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.002829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.002926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.003023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.003111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.003207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.003306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.003506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.003621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.003717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.003820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.003904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.003988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.004072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.004145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.004224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.004304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.004387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.004461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.004533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.004614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.004695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.004768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.004851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.004925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.005004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.005093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.005169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.005169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.005321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.005944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.006025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.006112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.006246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.006350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.006436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.006520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.006594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.006594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.006594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.006594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.006868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.006940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.007011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.007083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.007162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.007244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.007318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.007390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.007461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.007540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.007614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.007700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.007991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.008090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.008408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.008516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.008753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.009028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.010717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.010844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.010941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.011029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.011124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.011228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.011316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.011410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.011504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.011504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.011504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.011755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.011907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.012227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.012408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.012575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.012739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.012902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.013056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.013218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.013382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.013563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.013736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.013943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.014100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.014272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.014432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.014592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.014762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.014932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.015157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.015324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.015519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.015722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.015879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.016031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.016191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.016345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.016513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.016680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.016833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.016984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.017145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.017306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.017466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.017661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.017821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.018008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.018172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.018323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.018323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.018643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.018803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.018954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.019112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.019264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.019442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.019669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.019834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.019987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.020146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.020298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.020460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.020641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.021014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.021873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.022048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.022252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.022252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.022554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.022707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.022910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.023084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.023244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.023421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.023574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.023743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.023906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.024059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.024218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.024371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.024522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.024681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.024842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.024993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.025179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.025448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.025662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.025841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.025994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.026145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.026311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.026507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.026662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.026858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.027023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.027185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.027390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.027578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.027740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.027894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.028065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.028233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.028393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.028545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.028545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.028545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.028983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.029212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.029212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.029533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.029706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.029931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.029931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.030255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.030409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.030560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.030718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.030890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.031242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.031405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.031405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.031708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.031708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.032010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.032010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.032324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.032475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.032633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.032784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.032978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.033150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.033322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.033475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.033665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.033819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.033969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.034137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.034291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.034461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.034620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.034772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.034932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.035123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.035907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.036071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.036233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.036397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.036563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.036563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.036953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.037176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.037353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.037527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.037688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.037852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.038011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.038172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.038336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.038488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.038648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.038800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.038960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.039121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.039281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.039281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.039589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.039748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.039748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.040143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.040302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.040302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.040590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.040742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.040893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.041073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.041434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.041643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.041806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.041958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.042109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.042275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.042428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.042587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.042746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.042905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.043076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.043243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.043243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.043533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.043706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.043859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.044024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.044176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.044334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.044499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.044661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.044813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.044974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.045140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.045292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.045442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.045632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.045796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.046042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.046210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.046372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.046524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.046524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.046901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.047055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.047213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.047371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.047524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.047691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.047854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.047854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.048161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.048320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.048471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.048621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.048785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.048945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.049105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.049263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.049423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.049636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.049636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.049958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.050129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.050129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.050494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.050656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.050807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.050960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.051119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.051475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.051635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.051797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.051950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.052102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.052303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.052475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.052628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.052854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.053014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.053181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.053347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.053530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.053689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.053853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.054005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.054156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.054316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.054487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.054649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.054809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.054961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.055114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.055273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.055424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.055589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.055742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.055893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.056061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.056284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.056497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.056678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.056840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.056991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.057142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.057293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.057452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.057672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.057831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.057998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.058159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.058359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.058562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.058737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.058896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.059056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.059215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.059366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.059594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.059747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.059905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.059905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.060198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.060367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.060601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.060766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.060766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.061072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.061072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.061674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.061853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.062013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.062166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.062316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.062476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.062642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.062794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.062953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.063118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.063293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.063454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.063616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.063616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.063917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.064077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.064229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.064393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.064556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.064708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.064859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.065009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.065184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.065344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.065496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.065675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.065828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.065828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.066137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.066314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.066535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.066700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.066860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.067012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.067173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.067336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.067488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.067637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.067796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.068490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.068686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.068928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.069083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.069242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.069395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.069587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.069755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.069924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.070083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.070242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.070394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.070394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.071882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.072042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.072205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.072360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.072527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.072689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.072850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.073012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.073184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.073344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.073523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.073687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.073838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.073991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.074158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.074320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.074487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.074641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.074791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.074943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.075118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.075281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.075440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.075600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.075760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.075760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.076056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.076056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.076356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.076525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.076746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.076903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.077053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.077226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.077386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.077598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.077767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.077920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.078070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.078236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.078389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.078548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.078706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.078866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.079032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.079195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.079354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.079513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.079513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.079799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.079959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.080111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.080268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.080428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.080729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.080897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.081059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.081059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.081366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.081549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.081968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.082141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.082305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.082459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.082621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.082781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.082940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.083102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.083261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.083414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.084160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.084388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.084545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.084774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.084774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.085063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.085224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.085375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.085563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.085739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.085893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.086043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.086194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.086352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.086352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.086662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.086898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.087065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.087218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.087370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.087370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.087679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.087831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.087982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.088133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.088284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.088454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.088615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.088768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.088919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.089078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.089237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.089397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.089567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.089770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.089926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.090085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.090236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.090397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.090397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.090737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.090891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.090891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.091190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.091349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.091500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.091659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.092089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.092264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.092264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.092568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.092719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.092890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.093044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.093195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.093362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.093553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.093724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.093877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.094037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.094187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.094354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.094505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.094657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.094807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.095075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.095206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.095321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.095441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.095554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.095673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.095785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.095909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.096022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.096022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.096246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.096246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.096478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.096599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.096599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.096817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.097016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.097146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.097260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.097386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.097516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.101747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.102449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.102618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.102788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.103016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.103177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.103333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.103486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.103638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.104018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.104189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.104352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.104505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.104505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.104794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.104954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.104954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.105253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.105405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.105405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.105776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.105930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.106088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.106248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.106409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.106587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.107431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.108641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.108822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.109135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.109399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.109597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.109966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.110146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.110410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.110576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.110739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.110906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.111060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.111212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.111374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.111535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.111700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.111868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.112026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.112185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.112704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.112879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.113042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.113210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.113374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.113592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.113764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.113919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.114097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.114250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.114411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.114571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.114759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.115022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.115221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.115976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.116150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.116304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.116465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.116465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.116774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.116984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.117150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.117305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.117573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.117573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.117945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.118128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.118548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.118707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.118868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.119035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.119287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.119287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.119839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.119839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.120336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.120615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.120783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.120944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.121110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.121264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.121424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.121617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.121813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.121986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.122169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.123154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.123334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.123491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.123645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.123805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.123966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.124118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.124278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.124440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.124592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.124743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.124902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.125081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.125248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.125402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.125586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.125744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.125895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.126047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.126213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.126375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.126528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.126680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.126832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.127002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.127155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.127322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.127485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.127811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.127974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.128142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.128297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.128448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.128608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.128760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.128920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.129086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.129276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.131220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.131407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.131575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.131575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.131886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.132043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.132205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.132373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.132530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.132693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.132855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.133364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.133569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.133741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.133741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.134043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.134204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.134357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.134517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.134671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.134825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.135006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.135170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.135332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.135499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.135659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.135828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.136040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.136200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.136366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.136527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.136680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.136846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.137001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.137154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.137310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.137425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.144770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.144969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.145127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.145283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.145444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.145706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.145876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.146111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.146275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.146431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137033) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 22 20:59:09.146585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.146585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.146585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.146585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.146585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.146585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.146585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.146585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.148045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.148045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.148045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.148045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.148045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.148045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.148045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.148045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.150130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.150130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.150130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.150130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.150130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.150130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.150130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.150130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.151678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.151678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.151678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.151678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.151678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.151678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.151678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.151678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.154246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.154246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.154246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.154246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.154246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.154246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.154246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.154246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.155412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.155412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.155412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.155412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.155412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.155412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.155412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.155412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.156612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.156612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.156612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.156612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.156612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.156612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.156612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.156612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.158540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.158540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.158540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.158540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.158540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.158540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.159417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_db.sqlalchemy.engines [None req-de2abd5b-a015-4f36-8123-fbfde231ea9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:59:09.159587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.159587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.159587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.159587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.159587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.159587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.159587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.159587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.160971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.160971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.160971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.160971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.160971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.160971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.160971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.160971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.163153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.163153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.163153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.163153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.163153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.163153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.163153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.163153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.164521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.164521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.164521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.164521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.164521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.164521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.164521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.165589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.165589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.165589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.165589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.166185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.166346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.166551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.166880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.167212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.167674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.168294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.168579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.168930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.169252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.169604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.170079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.170292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.170623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.170965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.171315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.171714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.171968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.172537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.172738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.173075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.173414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.173838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.174198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.174575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.174905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.175243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.175572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.175922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.176279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.176626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.176969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.177848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.178208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.178538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.179379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.179379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.179699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.179860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.180264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.180628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.180863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.181193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.181560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.186513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.186513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.186513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.186513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.186513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.186513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.186513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.186513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.187718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.187718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.187718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.187718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.187718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.187718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.187718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.187718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.188872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.188872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.188872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.188872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.188872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.188872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.189883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.189883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.189883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.190498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.190498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.190887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.191042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.191346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.191676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.192043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.192386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.192834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.193184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.193529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 22 20:59:09.193794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 22 20:59:09.217900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_db.sqlalchemy.engines [None req-4ac910c4-7098-4bcf-b262-cfa22bfbf5b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:59:09.220640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.context [None req-de2abd5b-a015-4f36-8123-fbfde231ea9a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52f5c6ef-d4de-4047-a310-d7aef14748aa(cell1) {{(pid=137033) load_cells /opt/stack/nova/nova/context.py:464}} Jan 22 20:59:09.225850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de2abd5b-a015-4f36-8123-fbfde231ea9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:09.227750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de2abd5b-a015-4f36-8123-fbfde231ea9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:09.228626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de2abd5b-a015-4f36-8123-fbfde231ea9a None None] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:09.230658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de2abd5b-a015-4f36-8123-fbfde231ea9a None None] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:09.245858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_db.sqlalchemy.engines [None req-de2abd5b-a015-4f36-8123-fbfde231ea9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:59:09.246700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_db.sqlalchemy.engines [None req-de2abd5b-a015-4f36-8123-fbfde231ea9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:59:09.290361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.context [None req-4ac910c4-7098-4bcf-b262-cfa22bfbf5b1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52f5c6ef-d4de-4047-a310-d7aef14748aa(cell1) {{(pid=137032) load_cells /opt/stack/nova/nova/context.py:464}} Jan 22 20:59:09.295017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ac910c4-7098-4bcf-b262-cfa22bfbf5b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:09.296970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ac910c4-7098-4bcf-b262-cfa22bfbf5b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:09.298186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ac910c4-7098-4bcf-b262-cfa22bfbf5b1 None None] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:09.300193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ac910c4-7098-4bcf-b262-cfa22bfbf5b1 None None] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:09.314489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_db.sqlalchemy.engines [None req-4ac910c4-7098-4bcf-b262-cfa22bfbf5b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:59:09.315954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_db.sqlalchemy.engines [None req-4ac910c4-7098-4bcf-b262-cfa22bfbf5b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:59:09.418409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_db.sqlalchemy.engines [None req-de2abd5b-a015-4f36-8123-fbfde231ea9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137033) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:59:09.488352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_db.sqlalchemy.engines [None req-4ac910c4-7098-4bcf-b262-cfa22bfbf5b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 22 20:59:09.748938 ncdv-master-1 devstack@n-api.service[137033]: WARNING keystonemiddleware.auth_token [None req-de2abd5b-a015-4f36-8123-fbfde231ea9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 22 20:59:09.755693 ncdv-master-1 devstack@n-api.service[137033]: WARNING keystonemiddleware.auth_token [None req-de2abd5b-a015-4f36-8123-fbfde231ea9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 22 20:59:09.860826 ncdv-master-1 devstack@n-api.service[137032]: WARNING keystonemiddleware.auth_token [None req-4ac910c4-7098-4bcf-b262-cfa22bfbf5b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 22 20:59:09.868413 ncdv-master-1 devstack@n-api.service[137032]: WARNING keystonemiddleware.auth_token [None req-4ac910c4-7098-4bcf-b262-cfa22bfbf5b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 22 20:59:10.097168 ncdv-master-1 devstack@n-api.service[137033]: WARNING keystonemiddleware.auth_token [None req-de2abd5b-a015-4f36-8123-fbfde231ea9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 22 20:59:10.103417 ncdv-master-1 devstack@n-api.service[137033]: WARNING keystonemiddleware.auth_token [None req-de2abd5b-a015-4f36-8123-fbfde231ea9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 22 20:59:10.108779 ncdv-master-1 devstack@n-api.service[137033]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f2f1f569c0 pid: 137033 (default app) Jan 22 20:59:10.215723 ncdv-master-1 devstack@n-api.service[137032]: WARNING keystonemiddleware.auth_token [None req-4ac910c4-7098-4bcf-b262-cfa22bfbf5b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 22 20:59:10.221058 ncdv-master-1 devstack@n-api.service[137032]: WARNING keystonemiddleware.auth_token [None req-4ac910c4-7098-4bcf-b262-cfa22bfbf5b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 22 20:59:10.227742 ncdv-master-1 devstack@n-api.service[137032]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f2f1f569c0 pid: 137032 (default app) Jan 22 20:59:53.173804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dd7fc328-286a-4487-9848-cf3a9d9931cd tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Calling method '.version_select at 0x7f1ed831b5e0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:53.176061 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:53.176061 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:53.182316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dd7fc328-286a-4487-9848-cf3a9d9931cd tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52f5c6ef-d4de-4047-a310-d7aef14748aa(cell1) {{(pid=137033) load_cells /opt/stack/nova/nova/compute/api.py:302}} Jan 22 20:59:53.183163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd7fc328-286a-4487-9848-cf3a9d9931cd tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:53.183616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd7fc328-286a-4487-9848-cf3a9d9931cd tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:53.211691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd7fc328-286a-4487-9848-cf3a9d9931cd tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:53.212151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd7fc328-286a-4487-9848-cf3a9d9931cd tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:53.229712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd7fc328-286a-4487-9848-cf3a9d9931cd tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:53.229712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd7fc328-286a-4487-9848-cf3a9d9931cd tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:53.236301 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dd7fc328-286a-4487-9848-cf3a9d9931cd tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1424 microversion: 2.41 time: 1.157652 Jan 22 20:59:53.244641 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1/1] 10.222.0.100 () {60 vars in 1212 bytes} [Sat Jan 22 20:59:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1424 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 20:59:53.352251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-afadcb9e-ff28-4951-ae4f-b512df77c2f8 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-306321593", "id": 1357069781, "os-flavor-access:is_public": "True"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:53.370270 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:53.370270 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:53.402462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d72fa927-d1ca-4868-ae2c-77432799642c tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1686587075", "ram": 512, "vcpus": 1, "disk": 10, "id": 1725907186, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:53.419245 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:53.419245 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:53.459196 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-afadcb9e-ff28-4951-ae4f-b512df77c2f8 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 1.250059 Jan 22 20:59:53.459794 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1/2] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 20:59:52 2022] POST /compute/v2.1/flavors => generated 431 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:53.511154 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d72fa927-d1ca-4868-ae2c-77432799642c tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 418 microversion: 2.1 time: 0.272600 Jan 22 20:59:53.511778 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2/3] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 20:59:53 2022] POST /compute/v2.1/flavors => generated 418 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:53.570644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c5e26d84-e143-4939-951e-5a78e9203482 tempest-AZAdminV2TestJSON-623762614 tempest-AZAdminV2TestJSON-623762614-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:53.572429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5e26d84-e143-4939-951e-5a78e9203482 tempest-AZAdminV2TestJSON-623762614 tempest-AZAdminV2TestJSON-623762614-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:53.572780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5e26d84-e143-4939-951e-5a78e9203482 tempest-AZAdminV2TestJSON-623762614 tempest-AZAdminV2TestJSON-623762614-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:53.573609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5e26d84-e143-4939-951e-5a78e9203482 tempest-AZAdminV2TestJSON-623762614 tempest-AZAdminV2TestJSON-623762614-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:53.574041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5e26d84-e143-4939-951e-5a78e9203482 tempest-AZAdminV2TestJSON-623762614 tempest-AZAdminV2TestJSON-623762614-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:53.613611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8aca2717-63a8-4a06-9b86-16450d60d1ed tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1436616879", "ram": 512, "vcpus": 1, "disk": 10, "id": 1403652222, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:53.613911 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c5e26d84-e143-4939-951e-5a78e9203482 tempest-AZAdminV2TestJSON-623762614 tempest-AZAdminV2TestJSON-623762614-project-admin] 10.222.0.100 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.152991 Jan 22 20:59:53.614989 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2/4] 10.222.0.100 () {58 vars in 1168 bytes} [Sat Jan 22 20:59:53 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 20:59:53.696979 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8aca2717-63a8-4a06-9b86-16450d60d1ed tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 418 microversion: 2.1 time: 0.184119 Jan 22 20:59:53.698336 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3/5] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 20:59:53 2022] POST /compute/v2.1/flavors => generated 418 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:53.703926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e1d18be7-236f-4599-8751-0ad8fb221f7d tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1089668596"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:53.706124 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:53.706124 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:53.710174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.aggregate [None req-e1d18be7-236f-4599-8751-0ad8fb221f7d tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Generated uuid 9be384de-f876-4c6f-96d3-9b2e6283ae84 for aggregate {{(pid=137033) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 20:59:53.717871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4812da30-5e0b-49ca-a5fe-df7474a97e12 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '.version_select at 0x7f1ed81ab160>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:53.718694 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:53.718694 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:53.725716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4812da30-5e0b-49ca-a5fe-df7474a97e12 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),52f5c6ef-d4de-4047-a310-d7aef14748aa(cell1) {{(pid=137032) load_cells /opt/stack/nova/nova/compute/api.py:302}} Jan 22 20:59:53.727785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4812da30-5e0b-49ca-a5fe-df7474a97e12 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:53.728435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4812da30-5e0b-49ca-a5fe-df7474a97e12 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:53.761076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4812da30-5e0b-49ca-a5fe-df7474a97e12 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:53.761076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4812da30-5e0b-49ca-a5fe-df7474a97e12 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:53.772682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4812da30-5e0b-49ca-a5fe-df7474a97e12 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:53.773141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4812da30-5e0b-49ca-a5fe-df7474a97e12 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:53.783685 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4812da30-5e0b-49ca-a5fe-df7474a97e12 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.167228 Jan 22 20:59:53.784284 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3/6] 10.222.0.100 () {58 vars in 1171 bytes} [Sat Jan 22 20:59:53 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:53.826632 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e1d18be7-236f-4599-8751-0ad8fb221f7d tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.126394 Jan 22 20:59:53.833472 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4/7] 10.222.0.100 () {62 vars in 1209 bytes} [Sat Jan 22 20:59:53 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:59:53.836186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-548902456", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:53.884590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9b219b99-04d6-4710-9d4c-2cd48c4c0ef4 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:53.885943 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:53.885943 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:53.887554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b219b99-04d6-4710-9d4c-2cd48c4c0ef4 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:53.888014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b219b99-04d6-4710-9d4c-2cd48c4c0ef4 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:53.888828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b219b99-04d6-4710-9d4c-2cd48c4c0ef4 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:53.889267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b219b99-04d6-4710-9d4c-2cd48c4c0ef4 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:53.927240 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9b219b99-04d6-4710-9d4c-2cd48c4c0ef4 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.092501 Jan 22 20:59:53.927935 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 5/8] 10.222.0.100 () {58 vars in 1180 bytes} [Sat Jan 22 20:59:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:53.932139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-827e1ac3-9030-4dbb-bcdc-bae533cf9e0b tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:53.932995 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:53.932995 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:54.011952 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-827e1ac3-9030-4dbb-bcdc-bae533cf9e0b tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/1357069781" status: 202 len: 0 microversion: 2.1 time: 0.082968 Jan 22 20:59:54.012538 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 6/9] 10.222.0.100 () {58 vars in 1165 bytes} [Sat Jan 22 20:59:53 2022] DELETE /compute/v2.1/flavors/1357069781 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 20:59:54.063500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 20:59:54.112436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dd580ab7-e86b-4a73-9c6a-a8665e45ca7a tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:54.135803 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-dd580ab7-e86b-4a73-9c6a-a8665e45ca7a tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] HTTP exception thrown: Flavor 1725907186 has no extra specs with key hw:cpu_thread_policy. Jan 22 20:59:54.136491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dd580ab7-e86b-4a73-9c6a-a8665e45ca7a tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] Returning 404 to user: Flavor 1725907186 has no extra specs with key hw:cpu_thread_policy. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:54.137327 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dd580ab7-e86b-4a73-9c6a-a8665e45ca7a tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] 10.222.0.100 "GET /compute/v2.1/flavors/1725907186/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.123869 Jan 22 20:59:54.141580 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 7/10] 10.222.0.100 () {58 vars in 1270 bytes} [Sat Jan 22 20:59:54 2022] GET /compute/v2.1/flavors/1725907186/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 20:59:54.143522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cbc94a1f-c190-4042-901e-7cd2c01793ef tempest-AZAdminV2TestJSON-623762614 tempest-AZAdminV2TestJSON-623762614-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:54.143522 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:54.143522 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:54.144728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbc94a1f-c190-4042-901e-7cd2c01793ef tempest-AZAdminV2TestJSON-623762614 tempest-AZAdminV2TestJSON-623762614-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:54.145182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbc94a1f-c190-4042-901e-7cd2c01793ef tempest-AZAdminV2TestJSON-623762614 tempest-AZAdminV2TestJSON-623762614-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:54.146725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbc94a1f-c190-4042-901e-7cd2c01793ef tempest-AZAdminV2TestJSON-623762614 tempest-AZAdminV2TestJSON-623762614-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:54.147173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbc94a1f-c190-4042-901e-7cd2c01793ef tempest-AZAdminV2TestJSON-623762614 tempest-AZAdminV2TestJSON-623762614-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:54.169698 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cbc94a1f-c190-4042-901e-7cd2c01793ef tempest-AZAdminV2TestJSON-623762614 tempest-AZAdminV2TestJSON-623762614-project-admin] 10.222.0.100 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.030719 Jan 22 20:59:54.170281 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 8/11] 10.222.0.100 () {58 vars in 1189 bytes} [Sat Jan 22 20:59:54 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:54.174575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-61b88e82-ce48-44b7-8de4-1045c18d4f13 tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:54.176872 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:54.176872 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:54.268264 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-61b88e82-ce48-44b7-8de4-1045c18d4f13 tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors/1403652222/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.096926 Jan 22 20:59:54.274405 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 9/12] 10.222.0.100 () {60 vars in 1228 bytes} [Sat Jan 22 20:59:54 2022] POST /compute/v2.1/flavors/1403652222/os-extra_specs => generated 66 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 20:59:54.274592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-621c8cf4-404b-4a2b-9b3d-a2a385400932 tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-916375624"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:54.346256 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:54.346256 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:54.375010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 20:59:54.375469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 20:59:54.375987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 20:59:54.376677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 20:59:54.377336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 20:59:54.391320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:54.391817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:54.392638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:54.393074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:54.425103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Getting quotas for project 1c73a223b87c4f078727025f1c3c9929. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 20:59:54.431738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Getting quotas for user 711120a6fba843b69bf61afa378f3218 and project 1c73a223b87c4f078727025f1c3c9929. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 20:59:54.443015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 20:59:54.445863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 20:59:54.450379 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-621c8cf4-404b-4a2b-9b3d-a2a385400932 tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.180264 Jan 22 20:59:54.451670 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 10/13] 10.222.0.100 () {62 vars in 1214 bytes} [Sat Jan 22 20:59:54 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:59:54.456089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2a4b7965-1700-4c9f-88da-1efdf7acb5ab tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:54.485956 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2a4b7965-1700-4c9f-88da-1efdf7acb5ab tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5835 microversion: 2.1 time: 0.033098 Jan 22 20:59:54.486551 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 11/14] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 20:59:54 2022] GET /compute/v2.1/flavors/detail => generated 5835 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:54.491278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eb35c4f1-b1a5-41dd-a10f-548f368f7d83 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:54.492689 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:54.492689 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:54.493684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eb35c4f1-b1a5-41dd-a10f-548f368f7d83 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '414d151e57c34bb2b07f19985f602acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f7de3df8e348e18c08c0070a6c9802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 20:59:54.505009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eb35c4f1-b1a5-41dd-a10f-548f368f7d83 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:54.505009 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eb35c4f1-b1a5-41dd-a10f-548f368f7d83 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] 10.222.0.100 "POST /compute/v2.1/flavors/1725907186/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.007662 Jan 22 20:59:54.505009 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 12/15] 10.222.0.100 () {60 vars in 1228 bytes} [Sat Jan 22 20:59:54 2022] POST /compute/v2.1/flavors/1725907186/os-extra_specs => generated 124 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 20:59:54.585486 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-60aef776-95a4-4996-bc51-a10ffa1a9162 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.800134 Jan 22 20:59:54.586453 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4/16] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 20:59:53 2022] POST /compute/v2.1/servers => generated 382 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 20:59:54.591305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a4307b23-7238-41a6-bdd0-c200d0a8cbaf tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:54.592146 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:54.592146 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:54.609013 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a4307b23-7238-41a6-bdd0-c200d0a8cbaf tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] 10.222.0.100 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.021484 Jan 22 20:59:54.609602 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5/17] 10.222.0.100 () {60 vars in 1194 bytes} [Sat Jan 22 20:59:54 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:59:54.614112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9afca2a8-f603-40f2-926e-e461020d7c50 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1972214644", "id": 263530454, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:54.616730 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:54.616730 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:54.700815 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9afca2a8-f603-40f2-926e-e461020d7c50 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.081334 Jan 22 20:59:54.700815 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 6/18] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 20:59:54 2022] POST /compute/v2.1/flavors => generated 416 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:54.700948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-df6aacb4-2b32-49b1-a9c3-c86c94909d03 tempest-FlavorsExtraSpecsTestJSON-1531252281 tempest-FlavorsExtraSpecsTestJSON-1531252281-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:54.701018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-007f4018-0740-417c-81d7-13ba52b147fa tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:54.701103 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:54.701103 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:54.715245 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-df6aacb4-2b32-49b1-a9c3-c86c94909d03 tempest-FlavorsExtraSpecsTestJSON-1531252281 tempest-FlavorsExtraSpecsTestJSON-1531252281-project] 10.222.0.100 "GET /compute/v2.1/flavors/1403652222/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.218354 Jan 22 20:59:54.715833 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 13/19] 10.222.0.100 () {58 vars in 1207 bytes} [Sat Jan 22 20:59:54 2022] GET /compute/v2.1/flavors/1403652222/os-extra_specs => generated 66 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 20:59:54.727505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-981edbce-0ce3-410b-9b99-a41b955e9154 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:54.728986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-981edbce-0ce3-410b-9b99-a41b955e9154 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 20:59:54.828105 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-007f4018-0740-417c-81d7-13ba52b147fa tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors/1725907186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.132065 Jan 22 20:59:54.829881 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 7/20] 10.222.0.100 () {60 vars in 1228 bytes} [Sat Jan 22 20:59:54 2022] POST /compute/v2.1/flavors/1725907186/os-extra_specs => generated 66 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 20:59:54.837215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b400f609-5698-4548-a70d-2e1b08777b01 tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:54.839050 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:54.839050 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:54.867427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b400f609-5698-4548-a70d-2e1b08777b01 tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:54.868161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b400f609-5698-4548-a70d-2e1b08777b01 tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:54.946321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-981edbce-0ce3-410b-9b99-a41b955e9154 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 20:59:54.961871 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-981edbce-0ce3-410b-9b99-a41b955e9154 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1226 microversion: 2.1 time: 0.244907 Jan 22 20:59:54.963005 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 14/21] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 20:59:54 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1226 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:54.968651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b2d93a61-5998-471c-9a51-d2ebc08c3ef9 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:54.991107 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b2d93a61-5998-471c-9a51-d2ebc08c3ef9 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 6241 microversion: 2.1 time: 0.026529 Jan 22 20:59:54.991893 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 15/22] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 20:59:54 2022] GET /compute/v2.1/flavors/detail => generated 6241 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:54.996408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5fbed567-eb75-4f3b-843b-47e9340e400b tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:54.997758 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:54.997758 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:55.031410 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5fbed567-eb75-4f3b-843b-47e9340e400b tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors/1403652222/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038239 Jan 22 20:59:55.032479 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 16/23] 10.222.0.100 () {60 vars in 1228 bytes} [Sat Jan 22 20:59:54 2022] POST /compute/v2.1/flavors/1403652222/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 20:59:55.040801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b557d11b-aae6-4bbc-a97f-29c5a55325df tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:55.041911 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:55.041911 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:55.043256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b557d11b-aae6-4bbc-a97f-29c5a55325df tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '414d151e57c34bb2b07f19985f602acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f7de3df8e348e18c08c0070a6c9802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 20:59:55.044262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b557d11b-aae6-4bbc-a97f-29c5a55325df tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:55.045773 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b557d11b-aae6-4bbc-a97f-29c5a55325df tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] 10.222.0.100 "DELETE /compute/v2.1/flavors/1725907186/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.011837 Jan 22 20:59:55.050786 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 17/24] 10.222.0.100 () {58 vars in 1252 bytes} [Sat Jan 22 20:59:55 2022] DELETE /compute/v2.1/flavors/1725907186/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 20:59:55.056647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b696a9cf-0767-45fa-ac8c-c95b69b5244a tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:55.057978 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:55.057978 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:55.149270 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b696a9cf-0767-45fa-ac8c-c95b69b5244a tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/263530454" status: 202 len: 0 microversion: 2.1 time: 0.097257 Jan 22 20:59:55.152901 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 18/25] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 20:59:55 2022] DELETE /compute/v2.1/flavors/263530454 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 20:59:55.155638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3c02b023-dc7e-4b6d-ae30-d583c4603e0f tempest-FlavorsExtraSpecsTestJSON-1531252281 tempest-FlavorsExtraSpecsTestJSON-1531252281-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:55.170324 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3c02b023-dc7e-4b6d-ae30-d583c4603e0f tempest-FlavorsExtraSpecsTestJSON-1531252281 tempest-FlavorsExtraSpecsTestJSON-1531252281-project] 10.222.0.100 "GET /compute/v2.1/flavors/1403652222/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.019079 Jan 22 20:59:55.175303 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 19/26] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 20:59:55 2022] GET /compute/v2.1/flavors/1403652222/os-extra_specs/hw:numa_nodes => generated 22 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 20:59:55.176237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-423a56cf-9134-47dc-95b4-bea89a124586 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:55.198255 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-423a56cf-9134-47dc-95b4-bea89a124586 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors/1725907186/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.026091 Jan 22 20:59:55.198859 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 20/27] 10.222.0.100 () {60 vars in 1228 bytes} [Sat Jan 22 20:59:55 2022] POST /compute/v2.1/flavors/1725907186/os-extra_specs => generated 66 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 20:59:55.203395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f0776f38-8eaf-4bfe-95e0-83fd4eb31a21 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:55.223431 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f0776f38-8eaf-4bfe-95e0-83fd4eb31a21 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5835 microversion: 2.1 time: 0.023583 Jan 22 20:59:55.224724 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 21/28] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 20:59:55 2022] GET /compute/v2.1/flavors/detail => generated 5835 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:55.229358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aba2fb06-8fab-443d-a77f-2377ad78572b tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:55.250962 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aba2fb06-8fab-443d-a77f-2377ad78572b tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors/1403652222/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.025169 Jan 22 20:59:55.251544 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 22/29] 10.222.0.100 () {60 vars in 1228 bytes} [Sat Jan 22 20:59:55 2022] POST /compute/v2.1/flavors/1403652222/os-extra_specs => generated 66 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 20:59:55.261082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a2cf2d39-2e27-413b-ae51-3caba3af8262 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:55.262300 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:55.262300 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:55.263225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a2cf2d39-2e27-413b-ae51-3caba3af8262 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '414d151e57c34bb2b07f19985f602acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f7de3df8e348e18c08c0070a6c9802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 20:59:55.263861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a2cf2d39-2e27-413b-ae51-3caba3af8262 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:55.271331 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a2cf2d39-2e27-413b-ae51-3caba3af8262 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715 tempest-FlavorsExtraSpecsNegativeTestJSON-34727715-project] 10.222.0.100 "PUT /compute/v2.1/flavors/1725907186/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018206 Jan 22 20:59:55.277956 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 23/30] 10.222.0.100 () {60 vars in 1269 bytes} [Sat Jan 22 20:59:55 2022] PUT /compute/v2.1/flavors/1725907186/os-extra_specs/hw:numa_nodes => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 20:59:55.283363 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b400f609-5698-4548-a70d-2e1b08777b01 tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.450604 Jan 22 20:59:55.284643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-22906b96-bdd5-4578-b8d5-d613d410b67d tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1355289456", "id": 30944473, "os-flavor-access:is_public": "True"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:55.286404 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:55.286404 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:55.291959 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 8/31] 10.222.0.100 () {62 vars in 1236 bytes} [Sat Jan 22 20:59:54 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:59:55.297134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d5a9c239-c64d-4177-935e-a45e24b2c26d tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:55.311667 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d5a9c239-c64d-4177-935e-a45e24b2c26d tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/1403652222/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018206 Jan 22 20:59:55.312424 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 9/32] 10.222.0.100 () {58 vars in 1207 bytes} [Sat Jan 22 20:59:55 2022] GET /compute/v2.1/flavors/1403652222/os-extra_specs => generated 66 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 20:59:55.316961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c9802046-2c5a-40f1-ae0a-79421210bb40 tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:55.320303 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:55.320303 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:55.328753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9802046-2c5a-40f1-ae0a-79421210bb40 tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:55.329207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9802046-2c5a-40f1-ae0a-79421210bb40 tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:55.367759 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-22906b96-bdd5-4578-b8d5-d613d410b67d tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.088475 Jan 22 20:59:55.368361 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 24/33] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 20:59:55 2022] POST /compute/v2.1/flavors => generated 425 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:55.382092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7e66a468-8a1b-47ab-abe1-4beb4f275209 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:55.390862 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-7e66a468-8a1b-47ab-abe1-4beb4f275209 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] HTTP exception thrown: Flavor 1725907186 has no extra specs with key hw:cpu_thread_policy. Jan 22 20:59:55.391490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7e66a468-8a1b-47ab-abe1-4beb4f275209 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] Returning 404 to user: Flavor 1725907186 has no extra specs with key hw:cpu_thread_policy. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:55.392386 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7e66a468-8a1b-47ab-abe1-4beb4f275209 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/1725907186/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.021816 Jan 22 20:59:55.393389 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 25/34] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 20:59:55 2022] DELETE /compute/v2.1/flavors/1725907186/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 20:59:55.404931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-330317f0-0703-4cae-85e0-23be58b5caee tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:55.515482 ncdv-master-1 devstack@n-api.service[137032]: WARNING nova.scheduler.client.report [None req-c9802046-2c5a-40f1-ae0a-79421210bb40 tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] [req-2fc2f61d-6149-41b5-b2db-47ad82d9dc3f] Failed to update aggregates to [] for resource provider with UUID 6a081bc1-ca65-4925-b851-729227d53c20. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-2fc2f61d-6149-41b5-b2db-47ad82d9dc3f"}]} Jan 22 20:59:55.539182 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-330317f0-0703-4cae-85e0-23be58b5caee tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] 10.222.0.100 "PUT /compute/v2.1/flavors/1403652222/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.143894 Jan 22 20:59:55.544339 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 26/35] 10.222.0.100 () {60 vars in 1269 bytes} [Sat Jan 22 20:59:55 2022] PUT /compute/v2.1/flavors/1403652222/os-extra_specs/hw:numa_nodes => generated 22 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 20:59:55.549670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4dd8bffa-1c97-4e80-a08a-2eb6d61a73d1 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:55.638717 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4dd8bffa-1c97-4e80-a08a-2eb6d61a73d1 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/30944473" status: 202 len: 0 microversion: 2.1 time: 0.092796 Jan 22 20:59:55.639262 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 27/36] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 20:59:55 2022] DELETE /compute/v2.1/flavors/30944473 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 20:59:55.643855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-18dc3c85-760f-437d-8fef-043979223440 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:55.647258 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-18dc3c85-760f-437d-8fef-043979223440 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] HTTP exception thrown: Request body and URI mismatch Jan 22 20:59:55.647828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-18dc3c85-760f-437d-8fef-043979223440 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:55.648624 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-18dc3c85-760f-437d-8fef-043979223440 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] 10.222.0.100 "PUT /compute/v2.1/flavors/1725907186/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.008422 Jan 22 20:59:55.649161 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 28/37] 10.222.0.100 () {60 vars in 1269 bytes} [Sat Jan 22 20:59:55 2022] PUT /compute/v2.1/flavors/1725907186/os-extra_specs/hw:numa_nodes => generated 73 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 22 20:59:55.653571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-766fe451-39b5-4ecf-906f-2e1bfc4c7f96 tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:55.662189 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-766fe451-39b5-4ecf-906f-2e1bfc4c7f96 tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/1403652222/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012104 Jan 22 20:59:55.662731 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 29/38] 10.222.0.100 () {58 vars in 1207 bytes} [Sat Jan 22 20:59:55 2022] GET /compute/v2.1/flavors/1403652222/os-extra_specs => generated 66 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 20:59:55.672597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee6526d7-9308-4b60-a1e0-ccc1ff884958 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:55.693691 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee6526d7-9308-4b60-a1e0-ccc1ff884958 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5835 microversion: 2.1 time: 0.024488 Jan 22 20:59:55.694392 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 30/39] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 20:59:55 2022] GET /compute/v2.1/flavors/detail => generated 5835 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:55.698744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6fb1e33d-2d95-4d98-a388-e96779b64063 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:55.699897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6fb1e33d-2d95-4d98-a388-e96779b64063 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:55.700683 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6fb1e33d-2d95-4d98-a388-e96779b64063 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] 10.222.0.100 "PUT /compute/v2.1/flavors/1725907186/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.005387 Jan 22 20:59:55.705419 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 31/40] 10.222.0.100 () {60 vars in 1269 bytes} [Sat Jan 22 20:59:55 2022] PUT /compute/v2.1/flavors/1725907186/os-extra_specs/hw:numa_nodes => generated 117 bytes in 6 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 20:59:55.705862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-30e35d67-f968-4ae9-bb77-36b6294c87d7 tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:55.768181 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c9802046-2c5a-40f1-ae0a-79421210bb40 tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.454717 Jan 22 20:59:55.768760 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 10/41] 10.222.0.100 () {62 vars in 1236 bytes} [Sat Jan 22 20:59:55 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 20:59:55.773655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fbbe32e6-d7bd-463b-aa2c-4fad54678b8e tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-263146780", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:55.775190 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:55.775190 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:55.798056 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-30e35d67-f968-4ae9-bb77-36b6294c87d7 tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/1403652222/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.095451 Jan 22 20:59:55.798637 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 32/42] 10.222.0.100 () {58 vars in 1252 bytes} [Sat Jan 22 20:59:55 2022] DELETE /compute/v2.1/flavors/1403652222/os-extra_specs/hw:numa_nodes => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 22 20:59:55.803996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6c763179-77c9-4ed5-bc6d-4b6993c4d6d0 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:55.856914 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fbbe32e6-d7bd-463b-aa2c-4fad54678b8e tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 508 microversion: 2.1 time: 0.087069 Jan 22 20:59:55.857527 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 11/43] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 20:59:55 2022] POST /compute/v2.1/flavors => generated 508 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:55.861812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6295f592-7a5d-43df-b244-c50fd5bd9798 tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:55.862566 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:55.862566 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:55.878625 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6c763179-77c9-4ed5-bc6d-4b6993c4d6d0 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/1725907186" status: 202 len: 0 microversion: 2.1 time: 0.078933 Jan 22 20:59:55.879211 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 33/44] 10.222.0.100 () {58 vars in 1165 bytes} [Sat Jan 22 20:59:55 2022] DELETE /compute/v2.1/flavors/1725907186 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 20:59:55.883930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f94496e1-c8a2-422d-b3d8-002ff8aefb8a tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:55.964503 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6295f592-7a5d-43df-b244-c50fd5bd9798 tempest-AggregatesAdminTestV241-199684431 tempest-AggregatesAdminTestV241-199684431-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.105879 Jan 22 20:59:55.965388 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 12/45] 10.222.0.100 () {60 vars in 1197 bytes} [Sat Jan 22 20:59:55 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:55.968709 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f94496e1-c8a2-422d-b3d8-002ff8aefb8a tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/1403652222/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.088445 Jan 22 20:59:55.970227 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 34/46] 10.222.0.100 () {58 vars in 1252 bytes} [Sat Jan 22 20:59:55 2022] DELETE /compute/v2.1/flavors/1403652222/os-extra_specs/hw:cpu_policy => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 22 20:59:55.970398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9a431ce6-bd98-487f-9372-73f06d6ab1ac tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:55.973276 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:55.973276 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:55.976392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-75631ebc-61ca-4461-8478-2529200cf044 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:55.999545 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-75631ebc-61ca-4461-8478-2529200cf044 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236 tempest-FlavorsExtraSpecsNegativeTestJSON-679833236-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5925 microversion: 2.1 time: 0.028092 Jan 22 20:59:56.003348 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 35/47] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 20:59:55 2022] GET /compute/v2.1/flavors/detail => generated 5925 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:56.004689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-83b0f0f7-97c3-41f0-89fe-974f33cce0db tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:56.014305 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-83b0f0f7-97c3-41f0-89fe-974f33cce0db tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/1403652222/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013167 Jan 22 20:59:56.015536 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 36/48] 10.222.0.100 () {58 vars in 1207 bytes} [Sat Jan 22 20:59:56 2022] GET /compute/v2.1/flavors/1403652222/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 20:59:56.020123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-260fff3f-b662-4705-9f69-f161351bb53b tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:56.020985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-260fff3f-b662-4705-9f69-f161351bb53b tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 20:59:56.079060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-260fff3f-b662-4705-9f69-f161351bb53b tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 20:59:56.085955 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-260fff3f-b662-4705-9f69-f161351bb53b tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1226 microversion: 2.1 time: 0.069438 Jan 22 20:59:56.086567 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 37/49] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 20:59:56 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1226 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:56.086700 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9a431ce6-bd98-487f-9372-73f06d6ab1ac tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/8155142a-525d-49ea-9c21-8fe909d681e5" status: 202 len: 0 microversion: 2.1 time: 0.119994 Jan 22 20:59:56.090384 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 13/50] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 20:59:55 2022] DELETE /compute/v2.1/flavors/8155142a-525d-49ea-9c21-8fe909d681e5 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 20:59:56.095470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-704858c3-b935-4367-8051-10a9a1e0b601 tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:56.100038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6bbd932b-d52b-4d95-b96e-66488e154b57 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-192547212"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:56.102238 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:56.102238 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:56.104047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.aggregate [None req-6bbd932b-d52b-4d95-b96e-66488e154b57 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Generated uuid 41dea067-05fd-4450-ab85-eb4a694a06d4 for aggregate {{(pid=137033) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 20:59:56.186891 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-704858c3-b935-4367-8051-10a9a1e0b601 tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/1403652222" status: 202 len: 0 microversion: 2.1 time: 0.095269 Jan 22 20:59:56.189522 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 14/51] 10.222.0.100 () {58 vars in 1165 bytes} [Sat Jan 22 20:59:56 2022] DELETE /compute/v2.1/flavors/1403652222 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 20:59:56.194590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6304cd4f-f4ca-4856-89f9-4b3b8e326e55 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:56.221017 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6304cd4f-f4ca-4856-89f9-4b3b8e326e55 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.030161 Jan 22 20:59:56.222240 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 15/52] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 20:59:56 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:56.238272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61b489f0-be47-4f14-b949-639860f26d16 tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:56.238464 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6bbd932b-d52b-4d95-b96e-66488e154b57 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.149842 Jan 22 20:59:56.242125 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 38/53] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 20:59:56 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:56.246934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9d93ee35-534f-47ac-867a-5718c24ff4ea tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1244394476", "id": "397127b7-0277-44ba-8324-b8f735347e7c", "os-flavor-access:is_public": "True"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:56.249460 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:56.249460 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:56.260615 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61b489f0-be47-4f14-b949-639860f26d16 tempest-FlavorsExtraSpecsTestJSON-603372920 tempest-FlavorsExtraSpecsTestJSON-603372920-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.031704 Jan 22 20:59:56.261395 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 16/54] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 20:59:56 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:56.265926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8716d8a7-0d12-42db-a8b0-2f873b1b8e19 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:56.267196 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:56.267196 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:56.275864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8716d8a7-0d12-42db-a8b0-2f873b1b8e19 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:56.276350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8716d8a7-0d12-42db-a8b0-2f873b1b8e19 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:56.312992 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9d93ee35-534f-47ac-867a-5718c24ff4ea tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 509 microversion: 2.1 time: 0.071661 Jan 22 20:59:56.313651 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 39/55] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 20:59:56 2022] POST /compute/v2.1/flavors => generated 509 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:56.324726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-70b8bd33-f72a-4916-824a-3d64a2c59d15 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:56.325776 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:56.325776 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:56.446681 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-70b8bd33-f72a-4916-824a-3d64a2c59d15 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/397127b7-0277-44ba-8324-b8f735347e7c" status: 202 len: 0 microversion: 2.1 time: 0.125965 Jan 22 20:59:56.447840 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 40/56] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 20:59:56 2022] DELETE /compute/v2.1/flavors/397127b7-0277-44ba-8324-b8f735347e7c => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 20:59:56.455732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-352df2ba-98b2-4902-a043-e49a98cfc8c5 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:56.482876 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-352df2ba-98b2-4902-a043-e49a98cfc8c5 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.031106 Jan 22 20:59:56.483475 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 41/57] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 20:59:56 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 20:59:56.503466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2435ef40-a046-4ee8-8ea4-1f0a04344e12 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-253561401", "id": 1900296622, "os-flavor-access:is_public": "True"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:56.605847 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8716d8a7-0d12-42db-a8b0-2f873b1b8e19 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.343324 Jan 22 20:59:56.608095 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 17/58] 10.222.0.100 () {60 vars in 1195 bytes} [Sat Jan 22 20:59:56 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:56.617053 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2435ef40-a046-4ee8-8ea4-1f0a04344e12 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.117334 Jan 22 20:59:56.617917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-03a49904-fa1b-47cd-818d-ba70e4d93d30 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:56.618156 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 42/59] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 20:59:56 2022] POST /compute/v2.1/flavors => generated 415 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 20:59:56.623431 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:56.623431 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:56.629669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4ff52f1f-ae67-4235-ac79-225491a6ae2b tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:56.639078 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4ff52f1f-ae67-4235-ac79-225491a6ae2b tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/1900296622" status: 200 len: 415 microversion: 2.1 time: 0.012352 Jan 22 20:59:56.640579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03a49904-fa1b-47cd-818d-ba70e4d93d30 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:56.641470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03a49904-fa1b-47cd-818d-ba70e4d93d30 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:56.644711 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 43/60] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 20:59:56 2022] GET /compute/v2.1/flavors/1900296622 => generated 415 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 20:59:56.732341 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-03a49904-fa1b-47cd-818d-ba70e4d93d30 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] HTTP exception thrown: Aggregate 2 already has host nch1-master-1. Jan 22 20:59:56.733012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-03a49904-fa1b-47cd-818d-ba70e4d93d30 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Returning 409 to user: Aggregate 2 already has host nch1-master-1. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:56.734258 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-03a49904-fa1b-47cd-818d-ba70e4d93d30 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.120812 Jan 22 20:59:56.734841 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 18/61] 10.222.0.100 () {60 vars in 1195 bytes} [Sat Jan 22 20:59:56 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 377 bytes (2 switches on core 0) Jan 22 20:59:56.743031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-64d21e0f-6e7d-4565-8397-5cc60fec0c0a tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:56.744954 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:56.744954 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:56.760081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64d21e0f-6e7d-4565-8397-5cc60fec0c0a tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:56.761736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64d21e0f-6e7d-4565-8397-5cc60fec0c0a tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:57.036122 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-64d21e0f-6e7d-4565-8397-5cc60fec0c0a tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.296675 Jan 22 20:59:57.037809 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 19/62] 10.222.0.100 () {60 vars in 1195 bytes} [Sat Jan 22 20:59:56 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 20:59:57.048935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7f8f2291-bf5d-4acb-a342-e775580b67e8 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:57.049839 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:57.049839 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:57.151070 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7f8f2291-bf5d-4acb-a342-e775580b67e8 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.106741 Jan 22 20:59:57.152040 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 20/63] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 20:59:57 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jan 22 20:59:57.168095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5c9fc2a0-136c-42b6-a094-88936a6198cd tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:57.168095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5c9fc2a0-136c-42b6-a094-88936a6198cd tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 20:59:57.179058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c9fc2a0-136c-42b6-a094-88936a6198cd tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:57.179736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c9fc2a0-136c-42b6-a094-88936a6198cd tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:57.180958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c9fc2a0-136c-42b6-a094-88936a6198cd tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:57.181622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c9fc2a0-136c-42b6-a094-88936a6198cd tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:57.325868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-92048dc7-2d59-4630-97b4-f21aab11aaac tempest-FlavorsAdminTestJSON-1328995144 tempest-FlavorsAdminTestJSON-1328995144-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:57.361549 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-92048dc7-2d59-4630-97b4-f21aab11aaac tempest-FlavorsAdminTestJSON-1328995144 tempest-FlavorsAdminTestJSON-1328995144-project] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5424 microversion: 2.1 time: 0.714477 Jan 22 20:59:57.362143 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 44/64] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 20:59:56 2022] GET /compute/v2.1/flavors/detail => generated 5424 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:57.366557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-63516890-d300-4c5f-a504-2e069c6cbd48 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-425223515"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:57.368001 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:57.368001 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:57.369449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.aggregate [None req-63516890-d300-4c5f-a504-2e069c6cbd48 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Generated uuid e08e207e-19f3-438e-9b5b-49dc90a958f2 for aggregate {{(pid=137033) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 20:59:57.376714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5c9fc2a0-136c-42b6-a094-88936a6198cd tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 20:59:57.398861 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5c9fc2a0-136c-42b6-a094-88936a6198cd tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1278 microversion: 2.1 time: 0.245612 Jan 22 20:59:57.399574 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 21/65] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 20:59:57 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:57.414219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2a7d081c-3d87-4838-b39d-54fa873f6866 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1536702829", "name": "tempest-test_aggregate-1462659426"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:57.422686 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:57.422686 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:57.424110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.aggregate [None req-2a7d081c-3d87-4838-b39d-54fa873f6866 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Generated uuid df2b8207-2b50-4c70-ae35-72610fc64526 for aggregate {{(pid=137032) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 20:59:57.518532 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-63516890-d300-4c5f-a504-2e069c6cbd48 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.155310 Jan 22 20:59:57.519446 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 45/66] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 20:59:57 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:57.527268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b876d642-518d-43b3-9a72-39e2f53d0f49 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:57.536158 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:57.536158 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:57.559319 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2a7d081c-3d87-4838-b39d-54fa873f6866 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.158692 Jan 22 20:59:57.560280 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 22/67] 10.222.0.100 () {60 vars in 1169 bytes} [Sat Jan 22 20:59:57 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:57.613492 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b876d642-518d-43b3-9a72-39e2f53d0f49 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/1900296622" status: 202 len: 0 microversion: 2.1 time: 0.092572 Jan 22 20:59:57.617277 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 46/68] 10.222.0.100 () {58 vars in 1165 bytes} [Sat Jan 22 20:59:57 2022] DELETE /compute/v2.1/flavors/1900296622 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 20:59:57.620453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a966c67-9d87-413c-bd07-90c84fee4ac4 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:57.621218 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:57.621218 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:57.636242 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a966c67-9d87-413c-bd07-90c84fee4ac4 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "GET /compute/v2.1/os-aggregates" status: 200 len: 516 microversion: 2.1 time: 0.020775 Jan 22 20:59:57.642605 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 47/69] 10.222.0.100 () {58 vars in 1147 bytes} [Sat Jan 22 20:59:57 2022] GET /compute/v2.1/os-aggregates => generated 516 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:57.648763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-56fcfbd8-c62b-41cb-a109-b9c3de9736a9 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:57.688024 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-56fcfbd8-c62b-41cb-a109-b9c3de9736a9 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.044253 Jan 22 20:59:57.702408 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 48/70] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 20:59:57 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:57.707877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-440c4463-f0a9-49ce-8d92-e0c35b4c7775 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:57.709893 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:57.709893 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:57.730622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-440c4463-f0a9-49ce-8d92-e0c35b4c7775 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:57.731094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-440c4463-f0a9-49ce-8d92-e0c35b4c7775 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:57.765441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6c2f981f-67fc-4622-9b49-336b95966cf3 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:57.767793 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:57.767793 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:57.769379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6c2f981f-67fc-4622-9b49-336b95966cf3 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '83de1c90e2be4e6b9358c4c957d1fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee98e5cdf72f4ed2a6dd6cb4648b0446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 20:59:57.770077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6c2f981f-67fc-4622-9b49-336b95966cf3 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:57.770934 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6c2f981f-67fc-4622-9b49-336b95966cf3 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] 10.222.0.100 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.209401 Jan 22 20:59:57.771795 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 23/71] 10.222.0.100 () {60 vars in 1195 bytes} [Sat Jan 22 20:59:57 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 211 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 20:59:57.781180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a5614959-f279-4685-b170-97d7b7b413a4 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1604193433", "id": 344462885, "os-flavor-access:is_public": "False"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:57.782990 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:57.782990 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:57.886856 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a5614959-f279-4685-b170-97d7b7b413a4 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.111505 Jan 22 20:59:57.887499 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 24/72] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 20:59:57 2022] POST /compute/v2.1/flavors => generated 429 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:57.894774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b8c76e6a-ca2f-46ef-9c59-89440a18ff80 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:57.895766 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:57.895766 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:58.027748 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b8c76e6a-ca2f-46ef-9c59-89440a18ff80 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.133641 Jan 22 20:59:58.027748 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 25/73] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 20:59:57 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 22 20:59:58.030628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b994e607-fbc8-40e3-9983-520773d87193 tempest-FlavorsAdminTestJSON-1328995144 tempest-FlavorsAdminTestJSON-1328995144-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "344462885"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:58.053375 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-b994e607-fbc8-40e3-9983-520773d87193 tempest-FlavorsAdminTestJSON-1328995144 tempest-FlavorsAdminTestJSON-1328995144-project] HTTP exception thrown: Flavor 344462885 could not be found. Jan 22 20:59:58.054859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b994e607-fbc8-40e3-9983-520773d87193 tempest-FlavorsAdminTestJSON-1328995144 tempest-FlavorsAdminTestJSON-1328995144-project] Returning 400 to user: Flavor 344462885 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:58.055956 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b994e607-fbc8-40e3-9983-520773d87193 tempest-FlavorsAdminTestJSON-1328995144 tempest-FlavorsAdminTestJSON-1328995144-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.031446 Jan 22 20:59:58.060587 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 26/74] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 20:59:58 2022] POST /compute/v2.1/servers => generated 80 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 22 20:59:58.067241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fff14e63-2ffc-496d-8d68-cc83520f0216 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-319353582"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:58.070005 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:58.070005 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:58.071483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.aggregate [None req-fff14e63-2ffc-496d-8d68-cc83520f0216 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Generated uuid 2e7864b3-e685-4596-8c17-12deb4b43f2b for aggregate {{(pid=137032) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 20:59:58.184476 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fff14e63-2ffc-496d-8d68-cc83520f0216 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.122571 Jan 22 20:59:58.185554 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 27/75] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 20:59:58 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:58.189544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-50c3d8e4-fe11-41f6-9a5d-29c151f761c6 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:58.190412 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:58.190412 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:58.301901 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-50c3d8e4-fe11-41f6-9a5d-29c151f761c6 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/344462885" status: 202 len: 0 microversion: 2.1 time: 0.115555 Jan 22 20:59:58.303448 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 28/76] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 20:59:58 2022] DELETE /compute/v2.1/flavors/344462885 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 20:59:58.309806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-008e0aff-bd22-454e-b90a-084b573fe659 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-490408424"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:58.311718 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:58.311718 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:58.323246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-008e0aff-bd22-454e-b90a-084b573fe659 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:58.325072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-008e0aff-bd22-454e-b90a-084b573fe659 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:58.338315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-008e0aff-bd22-454e-b90a-084b573fe659 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:58.339147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-008e0aff-bd22-454e-b90a-084b573fe659 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:58.350700 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-008e0aff-bd22-454e-b90a-084b573fe659 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-490408424 could not be found. Jan 22 20:59:58.351849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-008e0aff-bd22-454e-b90a-084b573fe659 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-490408424 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:58.353099 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-008e0aff-bd22-454e-b90a-084b573fe659 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 110 microversion: 2.1 time: 0.048292 Jan 22 20:59:58.357587 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 29/77] 10.222.0.100 () {60 vars in 1195 bytes} [Sat Jan 22 20:59:58 2022] POST /compute/v2.1/os-aggregates/5/action => generated 110 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 20:59:58.360409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fec55cae-098f-418c-b790-58377767e3c7 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:58.380028 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fec55cae-098f-418c-b790-58377767e3c7 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.022995 Jan 22 20:59:58.381189 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 30/78] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 20:59:58 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:58.385430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5215f9ad-e792-445f-ae01-b4e24561fdfc tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:58.386214 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:58.386214 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:58.481759 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5215f9ad-e792-445f-ae01-b4e24561fdfc tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.099453 Jan 22 20:59:58.482326 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 31/79] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 20:59:58 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 22 20:59:58.490606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-76f8dddd-1649-428b-80c4-81a71894578a tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-581592660", "id": 1909218186, "os-flavor-access:is_public": "False"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:58.492351 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:58.492351 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:58.584095 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-76f8dddd-1649-428b-80c4-81a71894578a tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.099479 Jan 22 20:59:58.585788 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 32/80] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 20:59:58 2022] POST /compute/v2.1/flavors => generated 416 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:58.591955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d5c1b08d-e3f1-40af-a7f8-ef5db86bd204 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:58.592757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d5c1b08d-e3f1-40af-a7f8-ef5db86bd204 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 20:59:58.604591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5c1b08d-e3f1-40af-a7f8-ef5db86bd204 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:58.605403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5c1b08d-e3f1-40af-a7f8-ef5db86bd204 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:58.606472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5c1b08d-e3f1-40af-a7f8-ef5db86bd204 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:58.607233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5c1b08d-e3f1-40af-a7f8-ef5db86bd204 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:58.695161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d5c1b08d-e3f1-40af-a7f8-ef5db86bd204 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 20:59:58.702428 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d5c1b08d-e3f1-40af-a7f8-ef5db86bd204 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1284 microversion: 2.1 time: 0.115509 Jan 22 20:59:58.713041 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 33/81] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 20:59:58 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:58.713041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8a4531fb-0a76-4449-ac7c-41a63f4eb478 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:58.713041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8a4531fb-0a76-4449-ac7c-41a63f4eb478 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:58.713338 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8a4531fb-0a76-4449-ac7c-41a63f4eb478 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.005946 Jan 22 20:59:58.713338 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 34/82] 10.222.0.100 () {60 vars in 1169 bytes} [Sat Jan 22 20:59:58 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 20:59:58.718509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e48fe582-7b5c-4fe1-a1e8-500f329040ce tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2073271539", "id": 425512177, "os-flavor-access:is_public": "True"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:58.724755 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:58.724755 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:58.763090 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-440c4463-f0a9-49ce-8d92-e0c35b4c7775 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 315 microversion: 2.1 time: 1.058764 Jan 22 20:59:58.763689 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 49/83] 10.222.0.100 () {60 vars in 1195 bytes} [Sat Jan 22 20:59:57 2022] POST /compute/v2.1/os-aggregates/4/action => generated 315 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:58.768953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f0abaae-e371-478e-b941-e697cdde1374 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:58.770730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f0abaae-e371-478e-b941-e697cdde1374 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:58.772114 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9f0abaae-e371-478e-b941-e697cdde1374 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.006961 Jan 22 20:59:58.772862 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 50/84] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 20:59:58 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 20:59:58.793246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a6e5fc81-37a1-4ae2-9858-c7612516f6c6 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-726146104"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:58.794978 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:58.794978 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:58.796394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a6e5fc81-37a1-4ae2-9858-c7612516f6c6 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '83de1c90e2be4e6b9358c4c957d1fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee98e5cdf72f4ed2a6dd6cb4648b0446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 20:59:58.797207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a6e5fc81-37a1-4ae2-9858-c7612516f6c6 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:58.798852 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a6e5fc81-37a1-4ae2-9858-c7612516f6c6 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.010256 Jan 22 20:59:58.805786 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 51/85] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 20:59:58 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 20:59:58.807939 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e48fe582-7b5c-4fe1-a1e8-500f329040ce tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.095491 Jan 22 20:59:58.809285 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 35/86] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 20:59:58 2022] POST /compute/v2.1/flavors => generated 413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:58.818845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48915d7c-48aa-44ea-9845-b11ccd6d0298 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-256214284"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:58.819565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6e74fb2-66d3-4bf3-8825-debf52dae3c4 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:58.822624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.aggregate [None req-48915d7c-48aa-44ea-9845-b11ccd6d0298 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Generated uuid 025d3937-0d43-443b-b331-9b83773672c7 for aggregate {{(pid=137033) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 20:59:58.838001 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b6e74fb2-66d3-4bf3-8825-debf52dae3c4 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 419 microversion: 2.1 time: 0.022629 Jan 22 20:59:58.838747 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 36/87] 10.222.0.100 () {58 vars in 1173 bytes} [Sat Jan 22 20:59:58 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 419 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 20:59:58.853477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e3e51b46-27fc-402b-80a2-0d2ff00d7ec9 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:58.863489 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e3e51b46-27fc-402b-80a2-0d2ff00d7ec9 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 419 microversion: 2.1 time: 0.017674 Jan 22 20:59:58.865665 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 37/88] 10.222.0.100 () {58 vars in 1181 bytes} [Sat Jan 22 20:59:58 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 419 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:58.876853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-41da40c1-f987-4b76-b135-f22587cbc6ac tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:58.889878 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-41da40c1-f987-4b76-b135-f22587cbc6ac tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 419 microversion: 2.1 time: 0.016357 Jan 22 20:59:58.893682 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 38/89] 10.222.0.100 () {58 vars in 1175 bytes} [Sat Jan 22 20:59:58 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 419 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:58.902309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9b51d584-831f-4d27-8536-677f9de5d4d5 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:58.912439 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9b51d584-831f-4d27-8536-677f9de5d4d5 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 419 microversion: 2.1 time: 0.013125 Jan 22 20:59:58.921647 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 39/90] 10.222.0.100 () {58 vars in 1173 bytes} [Sat Jan 22 20:59:58 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 419 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:58.923326 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48915d7c-48aa-44ea-9845-b11ccd6d0298 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.110264 Jan 22 20:59:58.924250 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 52/91] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 20:59:58 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:58.932518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-26031b52-6948-4422-90bf-11c88dab5646 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:58.934739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1bfb32f6-4f7f-4678-9b2c-4fe2a11bde17 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-256214284"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:58.936008 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:58.936008 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:58.937189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.aggregate [None req-1bfb32f6-4f7f-4678-9b2c-4fe2a11bde17 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Generated uuid 69f27aaf-a340-4cfc-9be3-f7046875bd5b for aggregate {{(pid=137033) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 20:59:58.953390 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-1bfb32f6-4f7f-4678-9b2c-4fe2a11bde17 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-256214284 already exists. Jan 22 20:59:58.954061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1bfb32f6-4f7f-4678-9b2c-4fe2a11bde17 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-256214284 already exists. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:58.954946 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1bfb32f6-4f7f-4678-9b2c-4fe2a11bde17 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.023935 Jan 22 20:59:58.960041 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 53/92] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 20:59:58 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 29 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 20:59:58.963443 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-26031b52-6948-4422-90bf-11c88dab5646 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5422 microversion: 2.1 time: 0.040061 Jan 22 20:59:58.964307 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 40/93] 10.222.0.100 () {58 vars in 1173 bytes} [Sat Jan 22 20:59:58 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5422 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 20:59:58.967057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9800a1ed-f5eb-472c-a53f-ffc706341c0e tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:58.967871 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:58.967871 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:58.979701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b93e79bd-4d23-467b-bdbd-9cc6bae68bce tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:58.999429 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b93e79bd-4d23-467b-bdbd-9cc6bae68bce tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5422 microversion: 2.1 time: 0.023548 Jan 22 20:59:59.000005 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 41/94] 10.222.0.100 () {58 vars in 1179 bytes} [Sat Jan 22 20:59:58 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5422 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 20:59:59.014721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-423688b9-a687-4fda-8ae9-c3928d0026d7 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:59.034008 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-423688b9-a687-4fda-8ae9-c3928d0026d7 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5422 microversion: 2.1 time: 0.022674 Jan 22 20:59:59.034597 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 42/95] 10.222.0.100 () {58 vars in 1177 bytes} [Sat Jan 22 20:59:59 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5422 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 20:59:59.049407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-611f2e8a-40d5-40c7-8f9a-7cbe3ac723d5 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:59.068789 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-611f2e8a-40d5-40c7-8f9a-7cbe3ac723d5 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5422 microversion: 2.1 time: 0.022271 Jan 22 20:59:59.069365 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 43/96] 10.222.0.100 () {58 vars in 1173 bytes} [Sat Jan 22 20:59:59 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5422 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 20:59:59.083041 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9800a1ed-f5eb-472c-a53f-ffc706341c0e tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.121695 Jan 22 20:59:59.084515 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 54/97] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 20:59:58 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 22 20:59:59.090923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e8d33401-79c7-42fd-bd67-30c606a44860 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:59.092102 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:59.092102 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:59.096902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8fb79118-0249-432a-8317-bce72e1a6a99 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1985331734"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:59.098232 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:59.098232 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:59.099612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.aggregate [None req-8fb79118-0249-432a-8317-bce72e1a6a99 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Generated uuid aff2058f-2d01-4394-9b8e-0a2a2e3aacda for aggregate {{(pid=137033) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 20:59:59.231076 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e8d33401-79c7-42fd-bd67-30c606a44860 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/425512177" status: 202 len: 0 microversion: 2.1 time: 0.143675 Jan 22 20:59:59.233429 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 44/98] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 20:59:59 2022] DELETE /compute/v2.1/flavors/425512177 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 20:59:59.239429 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8fb79118-0249-432a-8317-bce72e1a6a99 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.145943 Jan 22 20:59:59.241803 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 55/99] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 20:59:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 20:59:59.253931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bfe1fee3-9d3f-4627-b748-9ce6718a6fe8 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:59.254414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-86d80692-6e19-415d-b8fa-a0e70aefe977 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:59.255506 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:59.255506 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:59.257640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-86d80692-6e19-415d-b8fa-a0e70aefe977 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '83de1c90e2be4e6b9358c4c957d1fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee98e5cdf72f4ed2a6dd6cb4648b0446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 20:59:59.259011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-86d80692-6e19-415d-b8fa-a0e70aefe977 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:59.260128 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-86d80692-6e19-415d-b8fa-a0e70aefe977 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.011262 Jan 22 20:59:59.261898 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 56/100] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 20:59:59 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jan 22 20:59:59.278417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-751b7b9e-66f4-481b-81f3-68fd296b24c1 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:59.293087 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bfe1fee3-9d3f-4627-b748-9ce6718a6fe8 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.055669 Jan 22 20:59:59.293995 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 45/101] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 20:59:59 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:59.312654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-303812af-ee73-4f57-aca5-18ae0df2cde0 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:59.409135 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-751b7b9e-66f4-481b-81f3-68fd296b24c1 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.138843 Jan 22 20:59:59.410083 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 57/102] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 20:59:59 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jan 22 20:59:59.423181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c3c1658a-0940-4c85-918e-f324708697d9 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:59.423689 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-303812af-ee73-4f57-aca5-18ae0df2cde0 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/1909218186" status: 202 len: 0 microversion: 2.1 time: 0.108112 Jan 22 20:59:59.423878 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:59.423878 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:59.426842 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 46/103] 10.222.0.100 () {58 vars in 1165 bytes} [Sat Jan 22 20:59:59 2022] DELETE /compute/v2.1/flavors/1909218186 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 20:59:59.448904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a49297fd-2061-43bd-895c-d337f9c0a484 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:59.449346 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-c3c1658a-0940-4c85-918e-f324708697d9 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jan 22 20:59:59.449989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c3c1658a-0940-4c85-918e-f324708697d9 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:59.450851 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c3c1658a-0940-4c85-918e-f324708697d9 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.032227 Jan 22 20:59:59.452854 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 58/104] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 20:59:59 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 20:59:59.469561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3efcea8c-3b09-4f8e-be72-503647c295ff tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1129743185"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:59.470895 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:59.470895 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 20:59:59.472776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.aggregate [None req-3efcea8c-3b09-4f8e-be72-503647c295ff tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Generated uuid f3d4c919-8c21-4934-abc0-e602a7367fdb for aggregate {{(pid=137033) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 20:59:59.482613 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a49297fd-2061-43bd-895c-d337f9c0a484 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.045419 Jan 22 20:59:59.483560 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 47/105] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 20:59:59 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:59.503709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cf5fb89d-7138-47af-b598-f577e85cb1e6 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1670872501", "id": 1315653428, "os-flavor-access:is_public": "False"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 20:59:59.638889 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3efcea8c-3b09-4f8e-be72-503647c295ff tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.181416 Jan 22 20:59:59.639585 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 59/106] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 20:59:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:59.650788 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cf5fb89d-7138-47af-b598-f577e85cb1e6 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.151391 Jan 22 20:59:59.652949 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 48/107] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 20:59:59 2022] POST /compute/v2.1/flavors => generated 417 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 20:59:59.662488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0b04f168-11f3-476f-a777-ae141d190135 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:59.664062 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:59.664062 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:59.665932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0b04f168-11f3-476f-a777-ae141d190135 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '83de1c90e2be4e6b9358c4c957d1fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee98e5cdf72f4ed2a6dd6cb4648b0446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 20:59:59.666845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0b04f168-11f3-476f-a777-ae141d190135 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 20:59:59.667927 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0b04f168-11f3-476f-a777-ae141d190135 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] 10.222.0.100 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.013533 Jan 22 20:59:59.669698 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 49/108] 10.222.0.100 () {58 vars in 1153 bytes} [Sat Jan 22 20:59:59 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 20:59:59.677262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4dc0d57b-510d-489d-9049-a13b10feafd2 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:59.703482 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4dc0d57b-510d-489d-9049-a13b10feafd2 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.030964 Jan 22 20:59:59.704411 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 50/109] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 20:59:59 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:59.712260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e741dd27-7590-4ff5-93dc-d6b81c5b1986 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:59.713828 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 20:59:59.713828 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 20:59:59.794511 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e741dd27-7590-4ff5-93dc-d6b81c5b1986 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.088746 Jan 22 20:59:59.795818 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 51/110] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 20:59:59 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 22 20:59:59.805370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-124b2b16-fb47-49b4-8570-363c65fbd296 tempest-FlavorsAdminTestJSON-1328995144 tempest-FlavorsAdminTestJSON-1328995144-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:59.840103 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-124b2b16-fb47-49b4-8570-363c65fbd296 tempest-FlavorsAdminTestJSON-1328995144 tempest-FlavorsAdminTestJSON-1328995144-project] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.038928 Jan 22 20:59:59.842334 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 52/111] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 20:59:59 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 20:59:59.848987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-52d0efd1-6674-43c5-929e-c4ea3e1c023b tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 20:59:59.850074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-52d0efd1-6674-43c5-929e-c4ea3e1c023b tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 20:59:59.869641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52d0efd1-6674-43c5-929e-c4ea3e1c023b tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:59.870206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52d0efd1-6674-43c5-929e-c4ea3e1c023b tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 20:59:59.871093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52d0efd1-6674-43c5-929e-c4ea3e1c023b tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 20:59:59.871619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52d0efd1-6674-43c5-929e-c4ea3e1c023b tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:00.095921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-52d0efd1-6674-43c5-929e-c4ea3e1c023b tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:00.104254 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-52d0efd1-6674-43c5-929e-c4ea3e1c023b tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.259312 Jan 22 21:00:00.114348 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 53/112] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 20:59:59 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:00.120333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e342b26a-fae2-42d2-b166-65aeacbfdc3c tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:00.121348 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:00.121348 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:00.127759 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-e342b26a-fae2-42d2-b166-65aeacbfdc3c tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jan 22 21:00:00.128391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e342b26a-fae2-42d2-b166-65aeacbfdc3c tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:00.129473 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e342b26a-fae2-42d2-b166-65aeacbfdc3c tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.012928 Jan 22 21:00:00.130145 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 54/113] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:00:00 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:00:00.134991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2bfe1ff1-7535-4be1-8d59-189bf05ea11e tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:00.135744 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:00.135744 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:00.228047 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2bfe1ff1-7535-4be1-8d59-189bf05ea11e tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/1315653428" status: 202 len: 0 microversion: 2.1 time: 0.096492 Jan 22 21:00:00.229011 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 55/114] 10.222.0.100 () {58 vars in 1165 bytes} [Sat Jan 22 21:00:00 2022] DELETE /compute/v2.1/flavors/1315653428 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:00:00.233944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3800ec69-d09e-4485-b0ae-d5bf975fdd32 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:00.234927 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:00.234927 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:00.236102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3800ec69-d09e-4485-b0ae-d5bf975fdd32 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '83de1c90e2be4e6b9358c4c957d1fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee98e5cdf72f4ed2a6dd6cb4648b0446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:00.236746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3800ec69-d09e-4485-b0ae-d5bf975fdd32 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:00.237736 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3800ec69-d09e-4485-b0ae-d5bf975fdd32 tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] 10.222.0.100 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.007343 Jan 22 21:00:00.238236 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 56/115] 10.222.0.100 () {58 vars in 1147 bytes} [Sat Jan 22 21:00:00 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:00.247496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4218d698-71af-4c99-8a28-014196f4075a tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:00.264381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1120685825", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "availability_zone": "tempest-test_az-1536702829"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:00.280024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:00.281637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:00.282283 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4218d698-71af-4c99-8a28-014196f4075a tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.038551 Jan 22 21:00:00.283411 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 57/116] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:00:00 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:00.284326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:00.286166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:00.340343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6bb7481e-371c-457a-8896-0d169ce7b61d tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-489903205", "id": 1983921983, "os-flavor-access:is_public": "True"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:00.342889 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:00.342889 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:00.394238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:00:00.511066 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6bb7481e-371c-457a-8896-0d169ce7b61d tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.195906 Jan 22 21:00:00.512395 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 58/117] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:00:00 2022] POST /compute/v2.1/flavors => generated 415 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:00.524761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a0b7052-0a05-41fe-b63a-3c254ff4d341 tempest-FlavorsAdminTestJSON-1328995144 tempest-FlavorsAdminTestJSON-1328995144-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:00.594149 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a0b7052-0a05-41fe-b63a-3c254ff4d341 tempest-FlavorsAdminTestJSON-1328995144 tempest-FlavorsAdminTestJSON-1328995144-project] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5424 microversion: 2.1 time: 0.075203 Jan 22 21:00:00.599991 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 59/118] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:00:00 2022] GET /compute/v2.1/flavors/detail => generated 5424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:00.613557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d226f779-370a-4a7d-af31-6703230fcf75 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:00.774044 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d226f779-370a-4a7d-af31-6703230fcf75 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/1983921983" status: 202 len: 0 microversion: 2.1 time: 0.164417 Jan 22 21:00:00.775275 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 60/119] 10.222.0.100 () {58 vars in 1165 bytes} [Sat Jan 22 21:00:00 2022] DELETE /compute/v2.1/flavors/1983921983 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:00:00.804511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e9185389-f46d-4537-a5f0-19c8fd4166c5 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:00.836947 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e9185389-f46d-4537-a5f0-19c8fd4166c5 tempest-FlavorsAdminTestJSON-1557617619 tempest-FlavorsAdminTestJSON-1557617619-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.048330 Jan 22 21:00:00.838610 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 61/120] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:00:00 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:00.868325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:00:00.868970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:00:00.869654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:00:00.870557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:00:00.871308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:00:00.903116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:00.903821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:00.905606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:00.908279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:00.964478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Getting quotas for project 5a4d0e6473d941fbbfdb0e9c7da837e4. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:00:00.977478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Getting quotas for user 026360880da64c5792b16424b3e0b74d and project 5a4d0e6473d941fbbfdb0e9c7da837e4. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:00:01.001644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:00:01.007203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:00:01.125710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6e75b8ce-3005-4fae-889a-fdcb3f0cabff tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:01.126417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6e75b8ce-3005-4fae-889a-fdcb3f0cabff tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:01.144760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e75b8ce-3005-4fae-889a-fdcb3f0cabff tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:01.145223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e75b8ce-3005-4fae-889a-fdcb3f0cabff tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:01.151211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e75b8ce-3005-4fae-889a-fdcb3f0cabff tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:01.151723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e75b8ce-3005-4fae-889a-fdcb3f0cabff tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:01.191913 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-85398106-009e-49ee-98f9-edc0ddb252f0 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.550581 Jan 22 21:00:01.194429 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 60/121] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 20:59:59 2022] POST /compute/v2.1/servers => generated 382 bytes in 1554 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:00:01.205329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0fd21fee-2030-4b03-a95b-08e84705ceff tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:01.206558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0fd21fee-2030-4b03-a95b-08e84705ceff tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:01.328101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0fd21fee-2030-4b03-a95b-08e84705ceff tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:01.340490 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0fd21fee-2030-4b03-a95b-08e84705ceff tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1247 microversion: 2.1 time: 0.138419 Jan 22 21:00:01.343254 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 61/122] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:01 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1247 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:01.587825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6e75b8ce-3005-4fae-889a-fdcb3f0cabff tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:01.595238 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6e75b8ce-3005-4fae-889a-fdcb3f0cabff tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.475655 Jan 22 21:00:01.595842 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 62/123] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:01 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:02.376017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cc35139c-5003-4d25-acc9-d8818f1514c1 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:02.377472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cc35139c-5003-4d25-acc9-d8818f1514c1 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:02.525674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cc35139c-5003-4d25-acc9-d8818f1514c1 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:02.542895 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cc35139c-5003-4d25-acc9-d8818f1514c1 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1247 microversion: 2.1 time: 0.182158 Jan 22 21:00:02.546492 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 62/124] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:02 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1247 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:02.613681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bfd77cd9-2ea5-4e1f-84ad-0e11633ea009 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:02.616020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bfd77cd9-2ea5-4e1f-84ad-0e11633ea009 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:02.632536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bfd77cd9-2ea5-4e1f-84ad-0e11633ea009 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:02.634236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bfd77cd9-2ea5-4e1f-84ad-0e11633ea009 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:02.637378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bfd77cd9-2ea5-4e1f-84ad-0e11633ea009 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:02.638767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bfd77cd9-2ea5-4e1f-84ad-0e11633ea009 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:02.883618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bfd77cd9-2ea5-4e1f-84ad-0e11633ea009 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:02.892281 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bfd77cd9-2ea5-4e1f-84ad-0e11633ea009 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.283170 Jan 22 21:00:02.894078 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 63/125] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:02 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:03.563274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-330a6fdc-8c4d-44e7-9262-166cad248cff tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:03.563893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-330a6fdc-8c4d-44e7-9262-166cad248cff tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:03.633490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-330a6fdc-8c4d-44e7-9262-166cad248cff tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:03.645013 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-330a6fdc-8c4d-44e7-9262-166cad248cff tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1247 microversion: 2.1 time: 0.085234 Jan 22 21:00:03.645519 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 64/126] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:03 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1247 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:03.912132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a1b0b3e6-f121-4768-9912-76b6385cade0 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:03.913050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a1b0b3e6-f121-4768-9912-76b6385cade0 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:03.919102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1b0b3e6-f121-4768-9912-76b6385cade0 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:03.919559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1b0b3e6-f121-4768-9912-76b6385cade0 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:03.920376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1b0b3e6-f121-4768-9912-76b6385cade0 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:03.920802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1b0b3e6-f121-4768-9912-76b6385cade0 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:04.078837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a1b0b3e6-f121-4768-9912-76b6385cade0 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:04.088938 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a1b0b3e6-f121-4768-9912-76b6385cade0 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.181279 Jan 22 21:00:04.093665 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 65/127] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:03 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:04.361673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d57b7875-7218-4b02-a40e-58ba3d0303e6 tempest-AZAdminNegativeTestJSON-1425819307 tempest-AZAdminNegativeTestJSON-1425819307-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:04.362521 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:04.362521 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:04.364560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d57b7875-7218-4b02-a40e-58ba3d0303e6 tempest-AZAdminNegativeTestJSON-1425819307 tempest-AZAdminNegativeTestJSON-1425819307-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '9a76af3fe9994737be2517e8ce344b83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9c0012764448a7b458bf57f7a0fb67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:04.365987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d57b7875-7218-4b02-a40e-58ba3d0303e6 tempest-AZAdminNegativeTestJSON-1425819307 tempest-AZAdminNegativeTestJSON-1425819307-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:04.374976 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d57b7875-7218-4b02-a40e-58ba3d0303e6 tempest-AZAdminNegativeTestJSON-1425819307 tempest-AZAdminNegativeTestJSON-1425819307-project] 10.222.0.100 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.451885 Jan 22 21:00:04.375625 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 63/128] 10.222.0.100 () {58 vars in 1189 bytes} [Sat Jan 22 21:00:02 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1462 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:04.663765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ed07ccb3-c9ce-4156-a7b0-ad7189186d28 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:04.665585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ed07ccb3-c9ce-4156-a7b0-ad7189186d28 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:04.671365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed07ccb3-c9ce-4156-a7b0-ad7189186d28 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:04.671761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed07ccb3-c9ce-4156-a7b0-ad7189186d28 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:04.672735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed07ccb3-c9ce-4156-a7b0-ad7189186d28 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:04.673181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed07ccb3-c9ce-4156-a7b0-ad7189186d28 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:04.814566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ed07ccb3-c9ce-4156-a7b0-ad7189186d28 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:04.830786 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ed07ccb3-c9ce-4156-a7b0-ad7189186d28 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1247 microversion: 2.1 time: 0.170892 Jan 22 21:00:04.832412 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 64/129] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:04 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1247 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:05.022553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5de429ed-6eb4-402f-9d4d-7de0844d6a30 req-a7bd13b8-fe96-423c-ad01-b07a8fa814f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1509ec0c-4416-407f-8221-41708f8f2e0c", "tag": "673878c9-2195-4e4b-9123-b895a2073851"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:05.024254 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:05.024254 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:05.039347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5de429ed-6eb4-402f-9d4d-7de0844d6a30 req-a7bd13b8-fe96-423c-ad01-b07a8fa814f2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:05.039941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5de429ed-6eb4-402f-9d4d-7de0844d6a30 req-a7bd13b8-fe96-423c-ad01-b07a8fa814f2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:05.078143 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5de429ed-6eb4-402f-9d4d-7de0844d6a30 req-a7bd13b8-fe96-423c-ad01-b07a8fa814f2 service nova] Creating event network-changed:673878c9-2195-4e4b-9123-b895a2073851 for instance 1509ec0c-4416-407f-8221-41708f8f2e0c on nch1-master-1 Jan 22 21:00:05.078912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5de429ed-6eb4-402f-9d4d-7de0844d6a30 req-a7bd13b8-fe96-423c-ad01-b07a8fa814f2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=137032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 22 21:00:05.080309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d23e0032-8428-49b9-a758-06c424fd1f4d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:05.086225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d23e0032-8428-49b9-a758-06c424fd1f4d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:05.086225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d23e0032-8428-49b9-a758-06c424fd1f4d None None] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:05.086225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d23e0032-8428-49b9-a758-06c424fd1f4d None None] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:05.092106 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.compute.rpcapi [None req-d23e0032-8428-49b9-a758-06c424fd1f4d None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 22 21:00:05.092980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d23e0032-8428-49b9-a758-06c424fd1f4d None None] Releasing lock "compute-rpcapi-router" {{(pid=137032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 22 21:00:05.110309 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d23e0032-8428-49b9-a758-06c424fd1f4d None None] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.592918 Jan 22 21:00:05.111190 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 66/130] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:05.115180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-afeb174f-151e-4275-bad4-9117fb4c1d92 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:05.115902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-afeb174f-151e-4275-bad4-9117fb4c1d92 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:05.122119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afeb174f-151e-4275-bad4-9117fb4c1d92 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:05.122577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afeb174f-151e-4275-bad4-9117fb4c1d92 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:05.129926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afeb174f-151e-4275-bad4-9117fb4c1d92 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:05.129926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afeb174f-151e-4275-bad4-9117fb4c1d92 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:05.311958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-afeb174f-151e-4275-bad4-9117fb4c1d92 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:05.320998 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-afeb174f-151e-4275-bad4-9117fb4c1d92 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.210694 Jan 22 21:00:05.321855 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 65/131] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:05 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:05.852402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-749db8a7-79fd-4f05-889e-b830cb705847 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:05.852402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-749db8a7-79fd-4f05-889e-b830cb705847 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:05.862740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-749db8a7-79fd-4f05-889e-b830cb705847 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:05.863293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-749db8a7-79fd-4f05-889e-b830cb705847 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:05.866269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-749db8a7-79fd-4f05-889e-b830cb705847 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:05.869908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-749db8a7-79fd-4f05-889e-b830cb705847 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:05.947810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-749db8a7-79fd-4f05-889e-b830cb705847 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:05.955225 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-749db8a7-79fd-4f05-889e-b830cb705847 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1247 microversion: 2.1 time: 0.110538 Jan 22 21:00:05.962449 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 67/132] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:05 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1247 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:06.338408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1a86049b-e948-4ee7-a0df-629dd0e7a25a tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:06.341838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1a86049b-e948-4ee7-a0df-629dd0e7a25a tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:06.346424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a86049b-e948-4ee7-a0df-629dd0e7a25a tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:06.346881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a86049b-e948-4ee7-a0df-629dd0e7a25a tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:06.349444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a86049b-e948-4ee7-a0df-629dd0e7a25a tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:06.350612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a86049b-e948-4ee7-a0df-629dd0e7a25a tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:06.587699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1a86049b-e948-4ee7-a0df-629dd0e7a25a tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:06.598011 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1a86049b-e948-4ee7-a0df-629dd0e7a25a tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.263603 Jan 22 21:00:06.610035 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 66/133] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:06 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:06.975042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-83359802-ea5a-4289-a751-1b90494de0de tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:06.975918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-83359802-ea5a-4289-a751-1b90494de0de tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:06.981803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83359802-ea5a-4289-a751-1b90494de0de tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:06.982242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83359802-ea5a-4289-a751-1b90494de0de tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:06.983019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83359802-ea5a-4289-a751-1b90494de0de tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:06.983453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83359802-ea5a-4289-a751-1b90494de0de tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:07.075065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-83359802-ea5a-4289-a751-1b90494de0de tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:07.086438 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-83359802-ea5a-4289-a751-1b90494de0de tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1247 microversion: 2.1 time: 0.115388 Jan 22 21:00:07.097207 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 68/134] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:06 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1247 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:07.617749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-afba297c-4add-4adb-9bbe-f5cba97777a5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:07.619088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-afba297c-4add-4adb-9bbe-f5cba97777a5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:07.626185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afba297c-4add-4adb-9bbe-f5cba97777a5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:07.626865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afba297c-4add-4adb-9bbe-f5cba97777a5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:07.627909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afba297c-4add-4adb-9bbe-f5cba97777a5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:07.628425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afba297c-4add-4adb-9bbe-f5cba97777a5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:07.889014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-afba297c-4add-4adb-9bbe-f5cba97777a5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:07.903110 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-afba297c-4add-4adb-9bbe-f5cba97777a5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.289241 Jan 22 21:00:07.904398 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 67/135] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:07 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:08.104331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-736a45bf-e42d-497b-9ef3-1808401448a8 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:08.105447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-736a45bf-e42d-497b-9ef3-1808401448a8 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:08.111659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736a45bf-e42d-497b-9ef3-1808401448a8 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:08.112416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736a45bf-e42d-497b-9ef3-1808401448a8 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:08.113394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736a45bf-e42d-497b-9ef3-1808401448a8 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:08.113919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736a45bf-e42d-497b-9ef3-1808401448a8 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:08.371763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-736a45bf-e42d-497b-9ef3-1808401448a8 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:08.410272 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-736a45bf-e42d-497b-9ef3-1808401448a8 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1247 microversion: 2.1 time: 0.299819 Jan 22 21:00:08.410272 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 69/136] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:08 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1247 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:09.129277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b4ed3ec-d043-4ae2-b5ac-de3b7d2be9d0 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Calling method '.version_select at 0x7f1ed66a2940>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:09.130373 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:09.130373 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:09.132287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b4ed3ec-d043-4ae2-b5ac-de3b7d2be9d0 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.132814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b4ed3ec-d043-4ae2-b5ac-de3b7d2be9d0 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.164624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b4ed3ec-d043-4ae2-b5ac-de3b7d2be9d0 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.165221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b4ed3ec-d043-4ae2-b5ac-de3b7d2be9d0 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.177476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b4ed3ec-d043-4ae2-b5ac-de3b7d2be9d0 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.178648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b4ed3ec-d043-4ae2-b5ac-de3b7d2be9d0 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.185595 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b4ed3ec-d043-4ae2-b5ac-de3b7d2be9d0 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.524459 Jan 22 21:00:09.186581 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 68/137] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:00:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:09.195685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9e395ae2-44d4-43be-b799-9801c87b6558 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:09.196301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9e395ae2-44d4-43be-b799-9801c87b6558 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:09.203186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e395ae2-44d4-43be-b799-9801c87b6558 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.203807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e395ae2-44d4-43be-b799-9801c87b6558 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.204737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e395ae2-44d4-43be-b799-9801c87b6558 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.205319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e395ae2-44d4-43be-b799-9801c87b6558 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.207022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9c6406cd-1532-40d5-8758-53abd6b77c69 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Calling method '.version_select at 0x7f1ed666eb80>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:09.209366 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:09.209366 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:09.211395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c6406cd-1532-40d5-8758-53abd6b77c69 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.212183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c6406cd-1532-40d5-8758-53abd6b77c69 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.277957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c6406cd-1532-40d5-8758-53abd6b77c69 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.278414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c6406cd-1532-40d5-8758-53abd6b77c69 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.330492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c6406cd-1532-40d5-8758-53abd6b77c69 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.330947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c6406cd-1532-40d5-8758-53abd6b77c69 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.344281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c6406cd-1532-40d5-8758-53abd6b77c69 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.345019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c6406cd-1532-40d5-8758-53abd6b77c69 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.360405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c6406cd-1532-40d5-8758-53abd6b77c69 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.360861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c6406cd-1532-40d5-8758-53abd6b77c69 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.367812 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9c6406cd-1532-40d5-8758-53abd6b77c69 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1665 microversion: 2.53 time: 0.545962 Jan 22 21:00:09.368424 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 70/138] 10.222.0.100 () {60 vars in 1247 bytes} [Sat Jan 22 21:00:08 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1665 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:00:09.495990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9e395ae2-44d4-43be-b799-9801c87b6558 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:09.503180 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9e395ae2-44d4-43be-b799-9801c87b6558 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.315405 Jan 22 21:00:09.515820 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 69/139] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:09 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:09.515820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f81ee7c8-480c-493a-9a7d-1a34a4b9d7d9 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Calling method '.version_select at 0x7f1ed67420d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:09.515820 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:09.515820 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:09.515820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f81ee7c8-480c-493a-9a7d-1a34a4b9d7d9 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.516184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f81ee7c8-480c-493a-9a7d-1a34a4b9d7d9 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.524646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f81ee7c8-480c-493a-9a7d-1a34a4b9d7d9 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.525096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f81ee7c8-480c-493a-9a7d-1a34a4b9d7d9 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.535010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f81ee7c8-480c-493a-9a7d-1a34a4b9d7d9 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.535460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f81ee7c8-480c-493a-9a7d-1a34a4b9d7d9 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.544734 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f81ee7c8-480c-493a-9a7d-1a34a4b9d7d9 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.037460 Jan 22 21:00:09.544734 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 70/140] 10.222.0.100 () {58 vars in 1171 bytes} [Sat Jan 22 21:00:09 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:09.547266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb65413e-e599-4e54-93e3-6a2a52a1be31 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Calling method '.version_select at 0x7f1ed6742c10>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:09.548875 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:09.548875 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:09.553005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb65413e-e599-4e54-93e3-6a2a52a1be31 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.553626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb65413e-e599-4e54-93e3-6a2a52a1be31 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.567329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb65413e-e599-4e54-93e3-6a2a52a1be31 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.568927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb65413e-e599-4e54-93e3-6a2a52a1be31 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.611426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb65413e-e599-4e54-93e3-6a2a52a1be31 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.611879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb65413e-e599-4e54-93e3-6a2a52a1be31 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.622813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb65413e-e599-4e54-93e3-6a2a52a1be31 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.623260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb65413e-e599-4e54-93e3-6a2a52a1be31 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.636414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb65413e-e599-4e54-93e3-6a2a52a1be31 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.636870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb65413e-e599-4e54-93e3-6a2a52a1be31 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.642917 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb65413e-e599-4e54-93e3-6a2a52a1be31 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.099258 Jan 22 21:00:09.643763 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 71/141] 10.222.0.100 () {60 vars in 1226 bytes} [Sat Jan 22 21:00:09 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:00:09.649028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e849178f-0c22-44db-a0c5-52fe5bbb966b tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:09.649662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e849178f-0c22-44db-a0c5-52fe5bbb966b tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:09.655477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e849178f-0c22-44db-a0c5-52fe5bbb966b tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.655930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e849178f-0c22-44db-a0c5-52fe5bbb966b tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.656723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e849178f-0c22-44db-a0c5-52fe5bbb966b tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.657162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e849178f-0c22-44db-a0c5-52fe5bbb966b tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.717145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e849178f-0c22-44db-a0c5-52fe5bbb966b tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:09.717304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-123c4062-08a1-4df8-9067-5379ac04e7a6 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Calling method '.version_select at 0x7f1ed666e160>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:09.718348 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:09.718348 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:09.720138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-123c4062-08a1-4df8-9067-5379ac04e7a6 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.720967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-123c4062-08a1-4df8-9067-5379ac04e7a6 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.722033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-123c4062-08a1-4df8-9067-5379ac04e7a6 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.722684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-123c4062-08a1-4df8-9067-5379ac04e7a6 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.727174 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e849178f-0c22-44db-a0c5-52fe5bbb966b tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1247 microversion: 2.1 time: 0.082449 Jan 22 21:00:09.736185 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 72/142] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:09 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1247 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:09.736185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-65d04429-8c76-4eb1-9c96-52a05d5d7d0f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Calling method '.version_select at 0x7f1ed66a20d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:09.736185 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:09.736185 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:09.736185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65d04429-8c76-4eb1-9c96-52a05d5d7d0f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.740233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65d04429-8c76-4eb1-9c96-52a05d5d7d0f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.757542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65d04429-8c76-4eb1-9c96-52a05d5d7d0f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.758016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65d04429-8c76-4eb1-9c96-52a05d5d7d0f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.763300 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-123c4062-08a1-4df8-9067-5379ac04e7a6 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.392716 Jan 22 21:00:09.764168 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 71/143] 10.222.0.100 () {58 vars in 1132 bytes} [Sat Jan 22 21:00:09 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:09.770308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2820516f-1312-4a49-ba37-72587510fa62 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Calling method '.version_select at 0x7f1ed661b280>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:09.770308 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:09.770308 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:09.775080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2820516f-1312-4a49-ba37-72587510fa62 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.775080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2820516f-1312-4a49-ba37-72587510fa62 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.776756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65d04429-8c76-4eb1-9c96-52a05d5d7d0f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.777553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65d04429-8c76-4eb1-9c96-52a05d5d7d0f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.790749 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-65d04429-8c76-4eb1-9c96-52a05d5d7d0f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.061562 Jan 22 21:00:09.792038 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 73/144] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:00:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:09.797265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2820516f-1312-4a49-ba37-72587510fa62 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.797981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2820516f-1312-4a49-ba37-72587510fa62 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.798121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a13ccc9a-ad5a-4063-9fbe-5d51f47be7ca tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Calling method '.version_select at 0x7f1ed6742ee0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:09.799392 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:09.799392 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:09.801191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a13ccc9a-ad5a-4063-9fbe-5d51f47be7ca tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.802991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a13ccc9a-ad5a-4063-9fbe-5d51f47be7ca tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.804169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a13ccc9a-ad5a-4063-9fbe-5d51f47be7ca tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.804736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a13ccc9a-ad5a-4063-9fbe-5d51f47be7ca tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.806447 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2820516f-1312-4a49-ba37-72587510fa62 tempest-HypervisorAdminV253TestBase-1725126846 tempest-HypervisorAdminV253TestBase-1725126846-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/6a081bc1-ca65-4925-b851-729227d53c20" status: 200 len: 793 microversion: 2.53 time: 0.041209 Jan 22 21:00:09.807480 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 72/145] 10.222.0.100 () {60 vars in 1302 bytes} [Sat Jan 22 21:00:09 2022] GET /compute/v2.1/os-hypervisors/6a081bc1-ca65-4925-b851-729227d53c20 => generated 793 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:00:09.812583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9b3b3e0c-1ae2-4b9b-91a8-b5022549f46f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Calling method '.version_select at 0x7f1ed666e700>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:09.813815 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:09.813815 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:09.815537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b3b3e0c-1ae2-4b9b-91a8-b5022549f46f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.816157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b3b3e0c-1ae2-4b9b-91a8-b5022549f46f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.834827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b3b3e0c-1ae2-4b9b-91a8-b5022549f46f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.835291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b3b3e0c-1ae2-4b9b-91a8-b5022549f46f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.838045 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a13ccc9a-ad5a-4063-9fbe-5d51f47be7ca tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 401 microversion: 2.1 time: 0.044156 Jan 22 21:00:09.839684 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 74/146] 10.222.0.100 () {58 vars in 1143 bytes} [Sat Jan 22 21:00:09 2022] GET /compute/v2.1/os-hosts?zone= => generated 401 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:09.841814 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9b3b3e0c-1ae2-4b9b-91a8-b5022549f46f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.033010 Jan 22 21:00:09.848495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e6e565bf-e462-4fa4-a406-6fad350d0c2e tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Calling method '.version_select at 0x7f1ed66a2e50>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:09.849962 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:09.849962 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:09.850260 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 73/147] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:00:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:09.851959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6e565bf-e462-4fa4-a406-6fad350d0c2e tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.852417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6e565bf-e462-4fa4-a406-6fad350d0c2e tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.853225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6e565bf-e462-4fa4-a406-6fad350d0c2e tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.853687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6e565bf-e462-4fa4-a406-6fad350d0c2e tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.854970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-097f3278-1f40-4ee2-8cb3-3631709159ec tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Calling method '.version_select at 0x7f1ed66dc280>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:09.855779 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:09.855779 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:09.857218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-097f3278-1f40-4ee2-8cb3-3631709159ec tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.857704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-097f3278-1f40-4ee2-8cb3-3631709159ec tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.876042 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-097f3278-1f40-4ee2-8cb3-3631709159ec tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.024514 Jan 22 21:00:09.876798 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 74/148] 10.222.0.100 () {58 vars in 1183 bytes} [Sat Jan 22 21:00:09 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:09.877486 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e6e565bf-e462-4fa4-a406-6fad350d0c2e tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.032417 Jan 22 21:00:09.883326 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 75/149] 10.222.0.100 () {58 vars in 1149 bytes} [Sat Jan 22 21:00:09 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:00:09.888168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-80b768c1-9be6-41e5-a329-7ac1a5780b39 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Calling method '.version_select at 0x7f1ed8b84dc0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:09.888979 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:09.888979 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:09.890547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80b768c1-9be6-41e5-a329-7ac1a5780b39 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.890997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80b768c1-9be6-41e5-a329-7ac1a5780b39 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.907855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80b768c1-9be6-41e5-a329-7ac1a5780b39 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.908400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80b768c1-9be6-41e5-a329-7ac1a5780b39 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.921637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80b768c1-9be6-41e5-a329-7ac1a5780b39 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.921637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80b768c1-9be6-41e5-a329-7ac1a5780b39 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:09.926319 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-80b768c1-9be6-41e5-a329-7ac1a5780b39 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.041493 Jan 22 21:00:09.927073 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 75/150] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:00:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:09.938314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-674bc583-2b16-4c7c-9589-411e07c593b1 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Calling method '.version_select at 0x7f1ed667a9d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:09.939454 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:09.939454 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:09.940956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-674bc583-2b16-4c7c-9589-411e07c593b1 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:09.941408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-674bc583-2b16-4c7c-9589-411e07c593b1 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:10.099821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-674bc583-2b16-4c7c-9589-411e07c593b1 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:10.100280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-674bc583-2b16-4c7c-9589-411e07c593b1 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:10.106725 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-674bc583-2b16-4c7c-9589-411e07c593b1 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.172025 Jan 22 21:00:10.107312 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 76/151] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:00:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:10.119581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e4bd5319-26ef-4a8b-af85-a9d38a5316a1 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Calling method '.version_select at 0x7f1ed6699040>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:10.120407 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:10.120407 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:10.122031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4bd5319-26ef-4a8b-af85-a9d38a5316a1 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:10.122491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4bd5319-26ef-4a8b-af85-a9d38a5316a1 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:10.135942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4bd5319-26ef-4a8b-af85-a9d38a5316a1 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:10.136395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4bd5319-26ef-4a8b-af85-a9d38a5316a1 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:10.142291 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e4bd5319-26ef-4a8b-af85-a9d38a5316a1 tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.026633 Jan 22 21:00:10.142869 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 76/152] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:00:10 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:00:10.154849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-63d700ad-15f6-423f-b86f-1cececa1bf6f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Calling method '.version_select at 0x7f1ed66c88b0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:10.155640 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:10.155640 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:10.157400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63d700ad-15f6-423f-b86f-1cececa1bf6f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:10.157876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63d700ad-15f6-423f-b86f-1cececa1bf6f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:10.170815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63d700ad-15f6-423f-b86f-1cececa1bf6f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:10.171254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63d700ad-15f6-423f-b86f-1cececa1bf6f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:10.180882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63d700ad-15f6-423f-b86f-1cececa1bf6f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:10.181331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63d700ad-15f6-423f-b86f-1cececa1bf6f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:10.186892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63d700ad-15f6-423f-b86f-1cececa1bf6f tempest-HypervisorAdminTestJSON-1625166721 tempest-HypervisorAdminTestJSON-1625166721-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 22 21:00:10.191437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3920381c-257e-43ef-b14a-1bb0d6b860af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:10.191437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3920381c-257e-43ef-b14a-1bb0d6b860af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:10.191437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3920381c-257e-43ef-b14a-1bb0d6b860af None None] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:10.191437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3920381c-257e-43ef-b14a-1bb0d6b860af None None] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:10.198683 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.compute.rpcapi [None req-3920381c-257e-43ef-b14a-1bb0d6b860af None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 22 21:00:10.199563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3920381c-257e-43ef-b14a-1bb0d6b860af None None] Releasing lock "compute-rpcapi-router" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 22 21:00:10.264129 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3920381c-257e-43ef-b14a-1bb0d6b860af None None] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.112721 Jan 22 21:00:10.264748 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 77/153] 10.222.0.100 () {58 vars in 1177 bytes} [Sat Jan 22 21:00:10 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:10.531665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-22e544af-858b-48ca-9f64-50153d9c6430 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:10.532286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-22e544af-858b-48ca-9f64-50153d9c6430 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:10.539527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22e544af-858b-48ca-9f64-50153d9c6430 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:10.540097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22e544af-858b-48ca-9f64-50153d9c6430 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:10.540934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22e544af-858b-48ca-9f64-50153d9c6430 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:10.541529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22e544af-858b-48ca-9f64-50153d9c6430 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:10.745344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c6b90c5d-a6fe-4168-b4ea-761436f17488 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:10.746200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c6b90c5d-a6fe-4168-b4ea-761436f17488 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:10.761190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6b90c5d-a6fe-4168-b4ea-761436f17488 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:10.762824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6b90c5d-a6fe-4168-b4ea-761436f17488 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:10.765024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6b90c5d-a6fe-4168-b4ea-761436f17488 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:10.765584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6b90c5d-a6fe-4168-b4ea-761436f17488 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:10.826010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-22e544af-858b-48ca-9f64-50153d9c6430 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:10.835650 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-22e544af-858b-48ca-9f64-50153d9c6430 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.308054 Jan 22 21:00:10.845445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c6b90c5d-a6fe-4168-b4ea-761436f17488 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:10.846496 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 77/154] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:10 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:10.855951 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c6b90c5d-a6fe-4168-b4ea-761436f17488 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1239 microversion: 2.1 time: 0.115000 Jan 22 21:00:10.857300 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 78/155] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:10 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1239 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:11.140253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19b5d40d-d5ec-4c88-b899-923fc4b785f9 tempest-FlavorsV255TestJSON-1333138173 tempest-FlavorsV255TestJSON-1333138173-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1939997157", "id": 898095957, "os-flavor-access:is_public": "True"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:11.141941 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:11.141941 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:11.235112 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19b5d40d-d5ec-4c88-b899-923fc4b785f9 tempest-FlavorsV255TestJSON-1333138173 tempest-FlavorsV255TestJSON-1333138173-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.273407 Jan 22 21:00:11.235726 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 78/156] 10.222.0.100 () {62 vars in 1192 bytes} [Sat Jan 22 21:00:10 2022] POST /compute/v2.1/flavors => generated 448 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:00:11.494497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8d9b8cd2-7885-4916-95e9-7186a4b56613 tempest-FlavorsV255TestJSON-207301906 tempest-FlavorsV255TestJSON-207301906-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:11.509049 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8d9b8cd2-7885-4916-95e9-7186a4b56613 tempest-FlavorsV255TestJSON-207301906 tempest-FlavorsV255TestJSON-207301906-project] 10.222.0.100 "GET /compute/v2.1/flavors/898095957" status: 200 len: 448 microversion: 2.55 time: 0.265341 Jan 22 21:00:11.515280 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 79/157] 10.222.0.100 () {60 vars in 1200 bytes} [Sat Jan 22 21:00:11 2022] GET /compute/v2.1/flavors/898095957 => generated 448 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:00:11.523251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a604a245-30d4-481c-af64-2b33452e5a26 tempest-FlavorsV255TestJSON-1333138173 tempest-FlavorsV255TestJSON-1333138173-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed86d9af0>, body: {"flavor": {"description": "new"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:11.550157 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:11.550157 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:11.703148 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a604a245-30d4-481c-af64-2b33452e5a26 tempest-FlavorsV255TestJSON-1333138173 tempest-FlavorsV255TestJSON-1333138173-project-admin] 10.222.0.100 "PUT /compute/v2.1/flavors/898095957" status: 200 len: 449 microversion: 2.55 time: 0.185919 Jan 22 21:00:11.704098 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 79/158] 10.222.0.100 () {62 vars in 1220 bytes} [Sat Jan 22 21:00:11 2022] PUT /compute/v2.1/flavors/898095957 => generated 449 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:00:11.716576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e9bb3b4c-52fe-4ae2-a4b5-f3080603c1a7 tempest-FlavorsV255TestJSON-207301906 tempest-FlavorsV255TestJSON-207301906-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:11.745723 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e9bb3b4c-52fe-4ae2-a4b5-f3080603c1a7 tempest-FlavorsV255TestJSON-207301906 tempest-FlavorsV255TestJSON-207301906-project] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5752 microversion: 2.55 time: 0.033796 Jan 22 21:00:11.746693 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 80/159] 10.222.0.100 () {60 vars in 1191 bytes} [Sat Jan 22 21:00:11 2022] GET /compute/v2.1/flavors/detail => generated 5752 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:00:11.762877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-03f80f0b-cfcb-4332-bc96-bd9439314031 tempest-FlavorsV255TestJSON-207301906 tempest-FlavorsV255TestJSON-207301906-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:11.790293 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-03f80f0b-cfcb-4332-bc96-bd9439314031 tempest-FlavorsV255TestJSON-207301906 tempest-FlavorsV255TestJSON-207301906-project] 10.222.0.100 "GET /compute/v2.1/flavors" status: 200 len: 3184 microversion: 2.55 time: 0.031187 Jan 22 21:00:11.791479 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 80/160] 10.222.0.100 () {60 vars in 1170 bytes} [Sat Jan 22 21:00:11 2022] GET /compute/v2.1/flavors => generated 3184 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:00:11.806197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-95280401-7207-4184-85fa-ce2949247145 tempest-FlavorsV255TestJSON-1333138173 tempest-FlavorsV255TestJSON-1333138173-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:11.807069 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:11.807069 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:11.852302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b44b46d4-59d8-4da6-a3ac-e1706c64e249 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:11.853576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b44b46d4-59d8-4da6-a3ac-e1706c64e249 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:11.859923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b44b46d4-59d8-4da6-a3ac-e1706c64e249 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:11.860671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b44b46d4-59d8-4da6-a3ac-e1706c64e249 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:11.861701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b44b46d4-59d8-4da6-a3ac-e1706c64e249 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:11.862644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b44b46d4-59d8-4da6-a3ac-e1706c64e249 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:11.928770 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-95280401-7207-4184-85fa-ce2949247145 tempest-FlavorsV255TestJSON-1333138173 tempest-FlavorsV255TestJSON-1333138173-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/898095957" status: 202 len: 0 microversion: 2.55 time: 0.127181 Jan 22 21:00:11.929361 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 81/161] 10.222.0.100 () {60 vars in 1203 bytes} [Sat Jan 22 21:00:11 2022] DELETE /compute/v2.1/flavors/898095957 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:00:11.934423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-03d7cc70-25a4-441d-8016-43ee957b6e82 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:11.937089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-03d7cc70-25a4-441d-8016-43ee957b6e82 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:11.944470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03d7cc70-25a4-441d-8016-43ee957b6e82 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:11.945097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03d7cc70-25a4-441d-8016-43ee957b6e82 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:11.946095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03d7cc70-25a4-441d-8016-43ee957b6e82 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:11.946682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03d7cc70-25a4-441d-8016-43ee957b6e82 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:12.044551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-03d7cc70-25a4-441d-8016-43ee957b6e82 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:12.056057 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-03d7cc70-25a4-441d-8016-43ee957b6e82 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1301 microversion: 2.1 time: 0.125342 Jan 22 21:00:12.061559 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 82/162] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:11 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1301 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:12.063588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-77cceac7-13be-40ba-a845-bea87bd94e56 tempest-FlavorsV255TestJSON-1333138173 tempest-FlavorsV255TestJSON-1333138173-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:12.101568 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-77cceac7-13be-40ba-a845-bea87bd94e56 tempest-FlavorsV255TestJSON-1333138173 tempest-FlavorsV255TestJSON-1333138173-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5313 microversion: 2.55 time: 0.042093 Jan 22 21:00:12.103258 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 83/163] 10.222.0.100 () {60 vars in 1191 bytes} [Sat Jan 22 21:00:12 2022] GET /compute/v2.1/flavors/detail => generated 5313 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:00:12.139173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b44b46d4-59d8-4da6-a3ac-e1706c64e249 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:12.152037 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b44b46d4-59d8-4da6-a3ac-e1706c64e249 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.302807 Jan 22 21:00:12.153222 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 81/164] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:11 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:12.446163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ffdb0894-a5e8-4d6c-82d1-f15fc1245079 tempest-FlavorsV261TestJSON-917006140 tempest-FlavorsV261TestJSON-917006140-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-568038673", "id": 340859383, "os-flavor-access:is_public": "True"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:12.448928 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:12.448928 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:12.539367 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ffdb0894-a5e8-4d6c-82d1-f15fc1245079 tempest-FlavorsV261TestJSON-917006140 tempest-FlavorsV261TestJSON-917006140-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 466 microversion: 2.61 time: 0.369927 Jan 22 21:00:12.540099 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 84/165] 10.222.0.100 () {62 vars in 1192 bytes} [Sat Jan 22 21:00:12 2022] POST /compute/v2.1/flavors => generated 466 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:00:12.799694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-33214bfe-29fc-4d6d-8e4b-142597c74dfd tempest-FlavorsV261TestJSON-649950962 tempest-FlavorsV261TestJSON-649950962-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:12.810625 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-33214bfe-29fc-4d6d-8e4b-142597c74dfd tempest-FlavorsV261TestJSON-649950962 tempest-FlavorsV261TestJSON-649950962-project] 10.222.0.100 "GET /compute/v2.1/flavors/340859383" status: 200 len: 466 microversion: 2.61 time: 0.263122 Jan 22 21:00:12.811394 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 82/166] 10.222.0.100 () {60 vars in 1200 bytes} [Sat Jan 22 21:00:12 2022] GET /compute/v2.1/flavors/340859383 => generated 466 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:00:12.823642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-38fa1ecd-3072-456d-ad0c-c10d875ceab5 tempest-FlavorsV261TestJSON-917006140 tempest-FlavorsV261TestJSON-917006140-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed86e3ca0>, body: {"flavor": {"description": "new"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:12.834291 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:12.834291 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:12.915445 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-38fa1ecd-3072-456d-ad0c-c10d875ceab5 tempest-FlavorsV261TestJSON-917006140 tempest-FlavorsV261TestJSON-917006140-project-admin] 10.222.0.100 "PUT /compute/v2.1/flavors/340859383" status: 200 len: 467 microversion: 2.61 time: 0.095805 Jan 22 21:00:12.919806 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 85/167] 10.222.0.100 () {62 vars in 1220 bytes} [Sat Jan 22 21:00:12 2022] PUT /compute/v2.1/flavors/340859383 => generated 467 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:00:12.928677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-208202d4-59ac-41c6-94f2-b674d370db94 tempest-FlavorsV261TestJSON-649950962 tempest-FlavorsV261TestJSON-649950962-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:12.956212 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-208202d4-59ac-41c6-94f2-b674d370db94 tempest-FlavorsV261TestJSON-649950962 tempest-FlavorsV261TestJSON-649950962-project] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 6276 microversion: 2.61 time: 0.032426 Jan 22 21:00:12.969655 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 83/168] 10.222.0.100 () {60 vars in 1191 bytes} [Sat Jan 22 21:00:12 2022] GET /compute/v2.1/flavors/detail => generated 6276 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:00:12.976936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1e315b39-387c-4aa1-ac90-aff78d45ebc3 tempest-FlavorsV261TestJSON-649950962 tempest-FlavorsV261TestJSON-649950962-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:12.999363 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1e315b39-387c-4aa1-ac90-aff78d45ebc3 tempest-FlavorsV261TestJSON-649950962 tempest-FlavorsV261TestJSON-649950962-project] 10.222.0.100 "GET /compute/v2.1/flavors" status: 200 len: 3183 microversion: 2.61 time: 0.028084 Jan 22 21:00:12.999949 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 86/169] 10.222.0.100 () {60 vars in 1170 bytes} [Sat Jan 22 21:00:12 2022] GET /compute/v2.1/flavors => generated 3183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:00:13.018948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb4be28c-f96d-4531-9eea-e8a2ecc423d6 tempest-FlavorsV261TestJSON-917006140 tempest-FlavorsV261TestJSON-917006140-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:13.018948 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:13.018948 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:13.077806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4a2866ee-ab00-4c86-a8f0-4a7d5a3df463 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:13.079104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4a2866ee-ab00-4c86-a8f0-4a7d5a3df463 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:13.090136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a2866ee-ab00-4c86-a8f0-4a7d5a3df463 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:13.090797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a2866ee-ab00-4c86-a8f0-4a7d5a3df463 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:13.092101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a2866ee-ab00-4c86-a8f0-4a7d5a3df463 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:13.092859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a2866ee-ab00-4c86-a8f0-4a7d5a3df463 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:13.126846 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fb4be28c-f96d-4531-9eea-e8a2ecc423d6 tempest-FlavorsV261TestJSON-917006140 tempest-FlavorsV261TestJSON-917006140-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/340859383" status: 202 len: 0 microversion: 2.61 time: 0.116182 Jan 22 21:00:13.127755 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 84/170] 10.222.0.100 () {60 vars in 1203 bytes} [Sat Jan 22 21:00:13 2022] DELETE /compute/v2.1/flavors/340859383 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:00:13.140374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-59c398df-07da-4c00-9e97-90f9b2790ea9 tempest-FlavorsV261TestJSON-917006140 tempest-FlavorsV261TestJSON-917006140-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:13.173136 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-59c398df-07da-4c00-9e97-90f9b2790ea9 tempest-FlavorsV261TestJSON-917006140 tempest-FlavorsV261TestJSON-917006140-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.61 time: 0.038039 Jan 22 21:00:13.174989 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 85/171] 10.222.0.100 () {60 vars in 1191 bytes} [Sat Jan 22 21:00:13 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:00:13.181111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7c03c3e1-cf71-4020-a5e5-a250b03ab9ab tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:13.182077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7c03c3e1-cf71-4020-a5e5-a250b03ab9ab tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:13.188738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c03c3e1-cf71-4020-a5e5-a250b03ab9ab tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:13.189638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c03c3e1-cf71-4020-a5e5-a250b03ab9ab tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:13.191097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c03c3e1-cf71-4020-a5e5-a250b03ab9ab tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:13.191758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c03c3e1-cf71-4020-a5e5-a250b03ab9ab tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:13.407237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4a2866ee-ab00-4c86-a8f0-4a7d5a3df463 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:13.435373 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4a2866ee-ab00-4c86-a8f0-4a7d5a3df463 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1343 microversion: 2.1 time: 0.362846 Jan 22 21:00:13.439443 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 87/172] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:13 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1343 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:13.511281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7c03c3e1-cf71-4020-a5e5-a250b03ab9ab tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:13.535566 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7c03c3e1-cf71-4020-a5e5-a250b03ab9ab tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.358885 Jan 22 21:00:13.536620 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 86/173] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:13 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:14.467099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d8943c0f-4d21-462a-b624-02f73bac8bbd tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:14.467592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d8943c0f-4d21-462a-b624-02f73bac8bbd tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:14.485994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8943c0f-4d21-462a-b624-02f73bac8bbd tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:14.487591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8943c0f-4d21-462a-b624-02f73bac8bbd tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:14.488409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8943c0f-4d21-462a-b624-02f73bac8bbd tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:14.489003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8943c0f-4d21-462a-b624-02f73bac8bbd tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:14.554078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-75f02938-85ee-4590-bca0-56eb0e9fbe80 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:14.554827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-75f02938-85ee-4590-bca0-56eb0e9fbe80 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:14.566802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75f02938-85ee-4590-bca0-56eb0e9fbe80 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:14.571070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75f02938-85ee-4590-bca0-56eb0e9fbe80 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:14.572095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75f02938-85ee-4590-bca0-56eb0e9fbe80 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:14.572649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75f02938-85ee-4590-bca0-56eb0e9fbe80 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:14.796797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-75f02938-85ee-4590-bca0-56eb0e9fbe80 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:14.808667 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-75f02938-85ee-4590-bca0-56eb0e9fbe80 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.259858 Jan 22 21:00:14.809716 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 87/174] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:14 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:14.936260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d8943c0f-4d21-462a-b624-02f73bac8bbd tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:14.946830 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d8943c0f-4d21-462a-b624-02f73bac8bbd tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1343 microversion: 2.1 time: 0.495155 Jan 22 21:00:14.947629 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 88/175] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:14 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1343 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:15.362837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-ac492ecb-97b5-4c0f-a548-fcca1644e1a3 req-a98d8618-ef7a-4457-a3b1-a3f2ac6e0d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1370130f-3f03-44d2-ba98-49dc6604336b", "tag": "5af353eb-2753-40d8-bdac-8441acd8c04d"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:15.364380 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:15.364380 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:15.376432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ac492ecb-97b5-4c0f-a548-fcca1644e1a3 req-a98d8618-ef7a-4457-a3b1-a3f2ac6e0d62 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:15.377149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ac492ecb-97b5-4c0f-a548-fcca1644e1a3 req-a98d8618-ef7a-4457-a3b1-a3f2ac6e0d62 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:15.392916 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-ac492ecb-97b5-4c0f-a548-fcca1644e1a3 req-a98d8618-ef7a-4457-a3b1-a3f2ac6e0d62 service nova] Creating event network-changed:5af353eb-2753-40d8-bdac-8441acd8c04d for instance 1370130f-3f03-44d2-ba98-49dc6604336b on nch1-master-1 Jan 22 21:00:15.400527 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-ac492ecb-97b5-4c0f-a548-fcca1644e1a3 req-a98d8618-ef7a-4457-a3b1-a3f2ac6e0d62 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.493720 Jan 22 21:00:15.402571 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 88/176] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:15.827217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c01dc6b7-5bab-421c-93f0-8c37f6584173 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:15.828476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c01dc6b7-5bab-421c-93f0-8c37f6584173 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:15.835522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c01dc6b7-5bab-421c-93f0-8c37f6584173 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:15.835991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c01dc6b7-5bab-421c-93f0-8c37f6584173 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:15.836803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c01dc6b7-5bab-421c-93f0-8c37f6584173 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:15.837276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c01dc6b7-5bab-421c-93f0-8c37f6584173 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:15.965895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-544c0da4-e849-4dbb-8039-73a0132d918c tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:15.967344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-544c0da4-e849-4dbb-8039-73a0132d918c tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:15.974509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-544c0da4-e849-4dbb-8039-73a0132d918c tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:15.974909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-544c0da4-e849-4dbb-8039-73a0132d918c tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:15.976009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-544c0da4-e849-4dbb-8039-73a0132d918c tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:15.976522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-544c0da4-e849-4dbb-8039-73a0132d918c tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:16.068172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c01dc6b7-5bab-421c-93f0-8c37f6584173 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:16.076430 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c01dc6b7-5bab-421c-93f0-8c37f6584173 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.252936 Jan 22 21:00:16.077551 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 89/177] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:15 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:16.143567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-544c0da4-e849-4dbb-8039-73a0132d918c tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:16.151033 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-544c0da4-e849-4dbb-8039-73a0132d918c tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1343 microversion: 2.1 time: 0.190115 Jan 22 21:00:16.151590 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 89/178] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:15 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1343 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:17.094050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6dde505f-f0e7-4a13-9d79-766341a52981 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:17.094670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6dde505f-f0e7-4a13-9d79-766341a52981 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:17.101311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6dde505f-f0e7-4a13-9d79-766341a52981 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:17.101791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6dde505f-f0e7-4a13-9d79-766341a52981 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:17.102580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6dde505f-f0e7-4a13-9d79-766341a52981 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:17.103023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6dde505f-f0e7-4a13-9d79-766341a52981 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:17.212374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-36a38814-88a9-4bb3-884f-9932e24826ad tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Action: 'create', calling method: .version_select at 0x7f1ed66a2940>, body: {"keypair": {"name": "tempest-keypair-1604598010", "type": "ssh", "user_id": "cebde7da85f844038572517780f8d15e"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:17.236399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-36a38814-88a9-4bb3-884f-9932e24826ad tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Getting quotas for project 4edda533a7804e68a38418b0d5abf407. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:00:17.241526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-36a38814-88a9-4bb3-884f-9932e24826ad tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Getting quotas for user 5306bc95f81340e59c4c6f64b6b5b67c and project 4edda533a7804e68a38418b0d5abf407. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:00:17.256077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6dde505f-f0e7-4a13-9d79-766341a52981 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:17.266344 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6dde505f-f0e7-4a13-9d79-766341a52981 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.175949 Jan 22 21:00:17.267653 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 90/179] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:17 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:17.276730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b95f6797-5b53-4534-96fd-1c4db42a260d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:17.276730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b95f6797-5b53-4534-96fd-1c4db42a260d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:17.281870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b95f6797-5b53-4534-96fd-1c4db42a260d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:17.282499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b95f6797-5b53-4534-96fd-1c4db42a260d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:17.283440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b95f6797-5b53-4534-96fd-1c4db42a260d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:17.284026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b95f6797-5b53-4534-96fd-1c4db42a260d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:17.417303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-36a38814-88a9-4bb3-884f-9932e24826ad tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Getting quotas for project 4edda533a7804e68a38418b0d5abf407. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:00:17.421670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-36a38814-88a9-4bb3-884f-9932e24826ad tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Getting quotas for user 5306bc95f81340e59c4c6f64b6b5b67c and project 4edda533a7804e68a38418b0d5abf407. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:00:17.433717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b95f6797-5b53-4534-96fd-1c4db42a260d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:17.438234 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-36a38814-88a9-4bb3-884f-9932e24826ad tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.10 time: 0.553047 Jan 22 21:00:17.443280 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 90/180] 10.222.0.100 () {62 vars in 1204 bytes} [Sat Jan 22 21:00:16 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 555 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:00:17.453134 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b95f6797-5b53-4534-96fd-1c4db42a260d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1343 microversion: 2.1 time: 0.184027 Jan 22 21:00:17.453747 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 91/181] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:17 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1343 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:17.462185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9827b409-1a82-4ed5-9419-887284e80dca tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Action: 'create', calling method: .version_select at 0x7f1ed661b700>, body: {"keypair": {"name": "tempest-keypair-373609670", "type": "ssh", "user_id": "cebde7da85f844038572517780f8d15e"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:17.483294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-9827b409-1a82-4ed5-9419-887284e80dca tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Getting quotas for project 4edda533a7804e68a38418b0d5abf407. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:00:17.487102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-9827b409-1a82-4ed5-9419-887284e80dca tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Getting quotas for user 5306bc95f81340e59c4c6f64b6b5b67c and project 4edda533a7804e68a38418b0d5abf407. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:00:17.544048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-73365336-c7e3-4b70-8f50-4994dfcba04c req-93bdf205-c102-4ae3-b0e1-62587d64dd36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1509ec0c-4416-407f-8221-41708f8f2e0c", "name": "network-vif-plugged", "status": "completed", "tag": "673878c9-2195-4e4b-9123-b895a2073851"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:17.545717 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:17.545717 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:17.558684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-73365336-c7e3-4b70-8f50-4994dfcba04c req-93bdf205-c102-4ae3-b0e1-62587d64dd36 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:17.559325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-73365336-c7e3-4b70-8f50-4994dfcba04c req-93bdf205-c102-4ae3-b0e1-62587d64dd36 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:17.585206 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-73365336-c7e3-4b70-8f50-4994dfcba04c req-93bdf205-c102-4ae3-b0e1-62587d64dd36 service nova] Creating event network-vif-plugged:673878c9-2195-4e4b-9123-b895a2073851 for instance 1509ec0c-4416-407f-8221-41708f8f2e0c on nch1-master-1 Jan 22 21:00:17.590418 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-73365336-c7e3-4b70-8f50-4994dfcba04c req-93bdf205-c102-4ae3-b0e1-62587d64dd36 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149949 Jan 22 21:00:17.591747 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 91/182] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:17.763966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-9827b409-1a82-4ed5-9419-887284e80dca tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Getting quotas for project 4edda533a7804e68a38418b0d5abf407. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:00:17.767841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-9827b409-1a82-4ed5-9419-887284e80dca tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Getting quotas for user 5306bc95f81340e59c4c6f64b6b5b67c and project 4edda533a7804e68a38418b0d5abf407. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:00:17.782491 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9827b409-1a82-4ed5-9419-887284e80dca tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.10 time: 0.324338 Jan 22 21:00:17.783116 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 92/183] 10.222.0.100 () {62 vars in 1204 bytes} [Sat Jan 22 21:00:17 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 329 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:00:17.794662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c668695a-a4a9-4c3e-ab34-7fac4fc532dd tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Calling method '.version_select at 0x7f1ed6627160>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:17.804702 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c668695a-a4a9-4c3e-ab34-7fac4fc532dd tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] 10.222.0.100 "GET /compute/v2.1/os-keypairs/tempest-keypair-1604598010?user_id=cebde7da85f844038572517780f8d15e" status: 200 len: 706 microversion: 2.10 time: 0.014961 Jan 22 21:00:17.815983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aa26bce1-246f-4288-833c-c8bb8a733e2c tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Action: 'create', calling method: .version_select at 0x7f1ed6755b80>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1838926411", "type": "ssh"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:17.817759 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 92/184] 10.222.0.100 () {60 vars in 1344 bytes} [Sat Jan 22 21:00:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1604598010?user_id=cebde7da85f844038572517780f8d15e => generated 706 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:00:17.834116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-aa26bce1-246f-4288-833c-c8bb8a733e2c tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Getting quotas for project 4edda533a7804e68a38418b0d5abf407. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:00:17.841727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-aa26bce1-246f-4288-833c-c8bb8a733e2c tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Getting quotas for user 5306bc95f81340e59c4c6f64b6b5b67c and project 4edda533a7804e68a38418b0d5abf407. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:00:18.247585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-aa26bce1-246f-4288-833c-c8bb8a733e2c tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Getting quotas for project 4edda533a7804e68a38418b0d5abf407. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:00:18.253405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-aa26bce1-246f-4288-833c-c8bb8a733e2c tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Getting quotas for user 5306bc95f81340e59c4c6f64b6b5b67c and project 4edda533a7804e68a38418b0d5abf407. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:00:18.268080 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aa26bce1-246f-4288-833c-c8bb8a733e2c tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 2337 microversion: 2.10 time: 0.456141 Jan 22 21:00:18.268681 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 93/185] 10.222.0.100 () {62 vars in 1203 bytes} [Sat Jan 22 21:00:17 2022] POST /compute/v2.1/os-keypairs => generated 2337 bytes in 457 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:00:18.278541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-495f03bf-5ea5-4ebb-afe6-a1f294396c09 tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Calling method '.version_select at 0x7f1ed658aee0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:18.281664 ncdv-master-1 devstack@n-api.service[137032]: WARNING oslo_db.sqlalchemy.utils [None req-495f03bf-5ea5-4ebb-afe6-a1f294396c09 tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jan 22 21:00:18.288822 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-495f03bf-5ea5-4ebb-afe6-a1f294396c09 tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] 10.222.0.100 "GET /compute/v2.1/os-keypairs?user_id=cebde7da85f844038572517780f8d15e" status: 200 len: 1113 microversion: 2.10 time: 0.013870 Jan 22 21:00:18.289374 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 94/186] 10.222.0.100 () {60 vars in 1263 bytes} [Sat Jan 22 21:00:18 2022] GET /compute/v2.1/os-keypairs?user_id=cebde7da85f844038572517780f8d15e => generated 1113 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:00:18.293383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-57bf1050-2816-4d72-9bd8-f66ebf0e2cd5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:18.294005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-57bf1050-2816-4d72-9bd8-f66ebf0e2cd5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:18.300090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57bf1050-2816-4d72-9bd8-f66ebf0e2cd5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:18.300543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57bf1050-2816-4d72-9bd8-f66ebf0e2cd5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:18.301321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57bf1050-2816-4d72-9bd8-f66ebf0e2cd5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:18.301934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57bf1050-2816-4d72-9bd8-f66ebf0e2cd5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:18.439027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-71667a20-1b2a-41bf-9aad-ad49d4d28208 tempest-InstanceUsageAuditLogTestJSON-907928644 tempest-InstanceUsageAuditLogTestJSON-907928644-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:18.440147 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:18.440147 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:18.468310 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-71667a20-1b2a-41bf-9aad-ad49d4d28208 tempest-InstanceUsageAuditLogTestJSON-907928644 tempest-InstanceUsageAuditLogTestJSON-907928644-project-admin] 10.222.0.100 "GET /compute/v2.1/os-instance_usage_audit_log/2022-01-22 21:00:18" status: 200 len: 318 microversion: 2.1 time: 0.219638 Jan 22 21:00:18.469160 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 93/187] 10.222.0.100 () {58 vars in 1255 bytes} [Sat Jan 22 21:00:18 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-01-22%2021%3A00%3A18 => generated 318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:00:18.470064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-57bf1050-2816-4d72-9bd8-f66ebf0e2cd5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:18.479776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc0c9422-1938-4081-a58d-b19ffdcf8798 tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Calling method '.version_select at 0x7f1ed6729f70>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:18.484396 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-57bf1050-2816-4d72-9bd8-f66ebf0e2cd5 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.192443 Jan 22 21:00:18.485632 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 95/188] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:18 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:18.498587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-214583d1-afe1-4790-a386-e1b3f4b48c52 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:18.499359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-214583d1-afe1-4790-a386-e1b3f4b48c52 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:18.510194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-214583d1-afe1-4790-a386-e1b3f4b48c52 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:18.510729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-214583d1-afe1-4790-a386-e1b3f4b48c52 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:18.511708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-214583d1-afe1-4790-a386-e1b3f4b48c52 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:18.512242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-214583d1-afe1-4790-a386-e1b3f4b48c52 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:18.602328 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bc0c9422-1938-4081-a58d-b19ffdcf8798 tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1838926411" status: 204 len: 0 microversion: 2.10 time: 0.131921 Jan 22 21:00:18.603022 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 94/189] 10.222.0.100 () {60 vars in 1329 bytes} [Sat Jan 22 21:00:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1838926411 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:00:18.609082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b5747607-31ee-46a4-bf49-be2b3e40044c tempest-InstanceUsageAuditLogTestJSON-907928644 tempest-InstanceUsageAuditLogTestJSON-907928644-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:18.610041 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:18.610041 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:18.623366 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b5747607-31ee-46a4-bf49-be2b3e40044c tempest-InstanceUsageAuditLogTestJSON-907928644 tempest-InstanceUsageAuditLogTestJSON-907928644-project-admin] 10.222.0.100 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.018805 Jan 22 21:00:18.624027 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 95/190] 10.222.0.100 () {58 vars in 1189 bytes} [Sat Jan 22 21:00:18 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:18.628449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-20a11bde-f68a-4ea6-9754-8918b1342a33 tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Calling method '.version_select at 0x7f1ed6588040>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:18.673299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-214583d1-afe1-4790-a386-e1b3f4b48c52 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:18.682654 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-214583d1-afe1-4790-a386-e1b3f4b48c52 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1343 microversion: 2.1 time: 0.192158 Jan 22 21:00:18.683832 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 96/191] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:18 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1343 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:18.732612 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-20a11bde-f68a-4ea6-9754-8918b1342a33 tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-373609670?user_id=cebde7da85f844038572517780f8d15e" status: 204 len: 0 microversion: 2.10 time: 0.107360 Jan 22 21:00:18.733275 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 96/192] 10.222.0.100 () {60 vars in 1344 bytes} [Sat Jan 22 21:00:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-373609670?user_id=cebde7da85f844038572517780f8d15e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:00:18.741692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fae802bb-8a42-4797-9a6d-d234a3c07d59 tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] Calling method '.version_select at 0x7f1ed65c51f0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:18.853242 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fae802bb-8a42-4797-9a6d-d234a3c07d59 tempest-KeyPairsV210TestJSON-1442828365 tempest-KeyPairsV210TestJSON-1442828365-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604598010?user_id=cebde7da85f844038572517780f8d15e" status: 204 len: 0 microversion: 2.10 time: 0.115313 Jan 22 21:00:18.853883 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 97/193] 10.222.0.100 () {60 vars in 1347 bytes} [Sat Jan 22 21:00:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604598010?user_id=cebde7da85f844038572517780f8d15e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:00:19.455280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-10c2dbdf-0c83-4b82-adb3-224113573af2 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] Calling method '.version_select at 0x7f1ed658aaf0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:19.456647 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:19.456647 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:19.458806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-10c2dbdf-0c83-4b82-adb3-224113573af2 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'd9c9311a911d4a21835bc62c02b68032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4cb3358845d4e3d9b01ecced83862b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:19.459633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-10c2dbdf-0c83-4b82-adb3-224113573af2 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:19.460449 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-10c2dbdf-0c83-4b82-adb3-224113573af2 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.295945 Jan 22 21:00:19.460972 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 97/194] 10.222.0.100 () {58 vars in 1171 bytes} [Sat Jan 22 21:00:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 297 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:19.470014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dd17eac7-9530-49c4-a469-2747b1b06ef7 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] Calling method '.version_select at 0x7f1ed65c54c0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:19.471427 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:19.471427 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:19.472960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dd17eac7-9530-49c4-a469-2747b1b06ef7 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'd9c9311a911d4a21835bc62c02b68032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4cb3358845d4e3d9b01ecced83862b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:19.473824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dd17eac7-9530-49c4-a469-2747b1b06ef7 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:19.487302 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dd17eac7-9530-49c4-a469-2747b1b06ef7 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] 10.222.0.100 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.008670 Jan 22 21:00:19.487302 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 98/195] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:00:19 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:19.502212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9550a2ee-c3b5-4eb3-8590-972bcd99108c tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:19.502822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9550a2ee-c3b5-4eb3-8590-972bcd99108c tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:19.508695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-16e0af6d-635e-497a-992a-0ebe993d5e04 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] Calling method '.version_select at 0x7f1ed667a1f0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:19.508695 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:19.508695 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:19.508962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-16e0af6d-635e-497a-992a-0ebe993d5e04 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'd9c9311a911d4a21835bc62c02b68032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4cb3358845d4e3d9b01ecced83862b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:19.509555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-16e0af6d-635e-497a-992a-0ebe993d5e04 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:19.514522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9550a2ee-c3b5-4eb3-8590-972bcd99108c tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:19.514970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9550a2ee-c3b5-4eb3-8590-972bcd99108c tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:19.515768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9550a2ee-c3b5-4eb3-8590-972bcd99108c tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:19.516208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9550a2ee-c3b5-4eb3-8590-972bcd99108c tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:19.518954 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-16e0af6d-635e-497a-992a-0ebe993d5e04 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.020259 Jan 22 21:00:19.519813 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 98/196] 10.222.0.100 () {58 vars in 1183 bytes} [Sat Jan 22 21:00:19 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:19.670526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9550a2ee-c3b5-4eb3-8590-972bcd99108c tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:19.681684 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9550a2ee-c3b5-4eb3-8590-972bcd99108c tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1348 microversion: 2.1 time: 0.183916 Jan 22 21:00:19.682657 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 99/197] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:19 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1348 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:19.700384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-97200c8d-3632-4e46-8711-5d6a7b2fece6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:19.700984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-97200c8d-3632-4e46-8711-5d6a7b2fece6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:19.706863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-97200c8d-3632-4e46-8711-5d6a7b2fece6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:19.707418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-97200c8d-3632-4e46-8711-5d6a7b2fece6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:19.708849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-97200c8d-3632-4e46-8711-5d6a7b2fece6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:19.709275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-97200c8d-3632-4e46-8711-5d6a7b2fece6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:19.772753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cd9747ac-50a9-453e-81a7-c99b551ebb10 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Calling method '.version_select at 0x7f1ed658a280>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:19.774106 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:19.774106 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:19.775881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd9747ac-50a9-453e-81a7-c99b551ebb10 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:19.776488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd9747ac-50a9-453e-81a7-c99b551ebb10 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:19.795524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd9747ac-50a9-453e-81a7-c99b551ebb10 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:19.796210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd9747ac-50a9-453e-81a7-c99b551ebb10 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:19.808344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd9747ac-50a9-453e-81a7-c99b551ebb10 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:19.809025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd9747ac-50a9-453e-81a7-c99b551ebb10 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:19.816229 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cd9747ac-50a9-453e-81a7-c99b551ebb10 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.289300 Jan 22 21:00:19.818655 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 99/198] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:00:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:00:19.829878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-00601df5-bc3b-4a83-b670-4b0bf92003b1 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] Calling method '.version_select at 0x7f1ed658adc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:19.830749 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:19.830749 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:19.834115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-00601df5-bc3b-4a83-b670-4b0bf92003b1 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'd9c9311a911d4a21835bc62c02b68032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4cb3358845d4e3d9b01ecced83862b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:19.834969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-00601df5-bc3b-4a83-b670-4b0bf92003b1 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:19.836208 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-00601df5-bc3b-4a83-b670-4b0bf92003b1 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.012022 Jan 22 21:00:19.837093 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 100/199] 10.222.0.100 () {58 vars in 1177 bytes} [Sat Jan 22 21:00:19 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:00:19.847260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2fe4ba33-0139-4b82-9e5f-653eb6d16191 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Calling method '.version_select at 0x7f1ed6627af0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:19.851132 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-2fe4ba33-0139-4b82-9e5f-653eb6d16191 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] HTTP exception thrown: Hypervisor with ID 'aa3da4b5-5c8b-4eeb-8621-e87dd7d71726' could not be found. Jan 22 21:00:19.851904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2fe4ba33-0139-4b82-9e5f-653eb6d16191 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Returning 404 to user: Hypervisor with ID 'aa3da4b5-5c8b-4eeb-8621-e87dd7d71726' could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:19.852920 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2fe4ba33-0139-4b82-9e5f-653eb6d16191 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/aa3da4b5-5c8b-4eeb-8621-e87dd7d71726/uptime" status: 404 len: 123 microversion: 2.1 time: 0.010166 Jan 22 21:00:19.858360 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 101/200] 10.222.0.100 () {58 vars in 1282 bytes} [Sat Jan 22 21:00:19 2022] GET /compute/v2.1/os-hypervisors/aa3da4b5-5c8b-4eeb-8621-e87dd7d71726/uptime => generated 123 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:19.863766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6994ee92-e462-4bb7-b8ab-22b0027bc0bc tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Calling method '.version_select at 0x7f1ed6697790>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:19.865379 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:19.865379 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:19.867776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6994ee92-e462-4bb7-b8ab-22b0027bc0bc tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:19.868440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6994ee92-e462-4bb7-b8ab-22b0027bc0bc tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:19.878642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-97200c8d-3632-4e46-8711-5d6a7b2fece6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:19.887365 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-97200c8d-3632-4e46-8711-5d6a7b2fece6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1343 microversion: 2.1 time: 0.191392 Jan 22 21:00:19.891482 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 100/201] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:19 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1343 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:19.896448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6994ee92-e462-4bb7-b8ab-22b0027bc0bc tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:19.896924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6994ee92-e462-4bb7-b8ab-22b0027bc0bc tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:19.907062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6994ee92-e462-4bb7-b8ab-22b0027bc0bc tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:19.907702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6994ee92-e462-4bb7-b8ab-22b0027bc0bc tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:19.914387 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6994ee92-e462-4bb7-b8ab-22b0027bc0bc tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.054624 Jan 22 21:00:19.914973 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 102/202] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:00:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:19.925302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f769dd80-bb7f-471b-8de6-269615f0a774 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] Calling method '.version_select at 0x7f1ed659fdc0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:19.926446 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:19.926446 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:19.928502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f769dd80-bb7f-471b-8de6-269615f0a774 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'd9c9311a911d4a21835bc62c02b68032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4cb3358845d4e3d9b01ecced83862b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:19.929715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f769dd80-bb7f-471b-8de6-269615f0a774 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:19.930686 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f769dd80-bb7f-471b-8de6-269615f0a774 tempest-HypervisorAdminNegativeTestJSON-1263674386 tempest-HypervisorAdminNegativeTestJSON-1263674386-project] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.009871 Jan 22 21:00:19.931675 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 101/203] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:00:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:19.940616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ec281d7-f2f5-46ec-9b0a-2cee46a1bcd1 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Calling method '.version_select at 0x7f1ed66a20d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:19.941420 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:19.941420 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:19.943518 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-1ec281d7-f2f5-46ec-9b0a-2cee46a1bcd1 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] HTTP exception thrown: Hypervisor with ID 'a7cda711-a6dc-49fc-8997-4ea04d66c5be' could not be found. Jan 22 21:00:19.944255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ec281d7-f2f5-46ec-9b0a-2cee46a1bcd1 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] Returning 404 to user: Hypervisor with ID 'a7cda711-a6dc-49fc-8997-4ea04d66c5be' could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:19.945208 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1ec281d7-f2f5-46ec-9b0a-2cee46a1bcd1 tempest-HypervisorAdminNegativeTestJSON-221759090 tempest-HypervisorAdminNegativeTestJSON-221759090-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/a7cda711-a6dc-49fc-8997-4ea04d66c5be" status: 404 len: 123 microversion: 2.1 time: 0.008242 Jan 22 21:00:19.946196 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 103/204] 10.222.0.100 () {58 vars in 1261 bytes} [Sat Jan 22 21:00:19 2022] GET /compute/v2.1/os-hypervisors/a7cda711-a6dc-49fc-8997-4ea04d66c5be => generated 123 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:20.227038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-190e66cf-b7a5-4fd3-867f-4e4c69f7408f tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Calling method '.version_select at 0x7f1ed658a820>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:20.227758 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:20.227758 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:20.229365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-190e66cf-b7a5-4fd3-867f-4e4c69f7408f tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:20.229852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-190e66cf-b7a5-4fd3-867f-4e4c69f7408f tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:20.244322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-190e66cf-b7a5-4fd3-867f-4e4c69f7408f tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:20.244771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-190e66cf-b7a5-4fd3-867f-4e4c69f7408f tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:20.258681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-190e66cf-b7a5-4fd3-867f-4e4c69f7408f tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:20.259202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-190e66cf-b7a5-4fd3-867f-4e4c69f7408f tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:20.265064 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-190e66cf-b7a5-4fd3-867f-4e4c69f7408f tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.154940 Jan 22 21:00:20.265685 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 102/205] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:00:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:20.664452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4c54dcc-efef-4c1d-9eac-06a03a0b1874 tempest-HypervisorAdminNegativeUnderV252Test-892596823 tempest-HypervisorAdminNegativeUnderV252Test-892596823-project] Calling method '.version_select at 0x7f1ed6588700>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:20.665366 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:20.665366 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:20.666819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c4c54dcc-efef-4c1d-9eac-06a03a0b1874 tempest-HypervisorAdminNegativeUnderV252Test-892596823 tempest-HypervisorAdminNegativeUnderV252Test-892596823-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '08925cd38cfc4da389e6c24ae2d5c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c0c346ceae405798b51724c77bf4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:20.668474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4c54dcc-efef-4c1d-9eac-06a03a0b1874 tempest-HypervisorAdminNegativeUnderV252Test-892596823 tempest-HypervisorAdminNegativeUnderV252Test-892596823-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:20.669217 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c4c54dcc-efef-4c1d-9eac-06a03a0b1874 tempest-HypervisorAdminNegativeUnderV252Test-892596823 tempest-HypervisorAdminNegativeUnderV252Test-892596823-project] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.397055 Jan 22 21:00:20.671872 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 104/206] 10.222.0.100 () {58 vars in 1213 bytes} [Sat Jan 22 21:00:20 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 400 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:20.687786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7fbfca16-3406-40b6-a3c2-f6172b3ff870 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Calling method '.version_select at 0x7f1ed658a9d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:20.689930 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:20.689930 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:20.699647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fbfca16-3406-40b6-a3c2-f6172b3ff870 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:20.704237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fbfca16-3406-40b6-a3c2-f6172b3ff870 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:20.706777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d8efbce7-8b3d-4d6b-89cf-a5e836d57508 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:20.709862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d8efbce7-8b3d-4d6b-89cf-a5e836d57508 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:20.721096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8efbce7-8b3d-4d6b-89cf-a5e836d57508 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:20.728872 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-7fbfca16-3406-40b6-a3c2-f6172b3ff870 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jan 22 21:00:20.728872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7fbfca16-3406-40b6-a3c2-f6172b3ff870 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:20.728872 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7fbfca16-3406-40b6-a3c2-f6172b3ff870 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.048454 Jan 22 21:00:20.728872 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 103/207] 10.222.0.100 () {58 vars in 1255 bytes} [Sat Jan 22 21:00:20 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:20.729165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8efbce7-8b3d-4d6b-89cf-a5e836d57508 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:20.729165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8efbce7-8b3d-4d6b-89cf-a5e836d57508 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:20.729165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8efbce7-8b3d-4d6b-89cf-a5e836d57508 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:20.746168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cfdd71e7-0c98-4bfc-8124-2cd73f5e4d67 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Calling method '.version_select at 0x7f1ed65c59d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:20.746645 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:20.746645 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:20.748828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfdd71e7-0c98-4bfc-8124-2cd73f5e4d67 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:20.749288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfdd71e7-0c98-4bfc-8124-2cd73f5e4d67 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:20.786460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfdd71e7-0c98-4bfc-8124-2cd73f5e4d67 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:20.787187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfdd71e7-0c98-4bfc-8124-2cd73f5e4d67 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:20.804683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfdd71e7-0c98-4bfc-8124-2cd73f5e4d67 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:20.805262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfdd71e7-0c98-4bfc-8124-2cd73f5e4d67 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:20.811499 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cfdd71e7-0c98-4bfc-8124-2cd73f5e4d67 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.074187 Jan 22 21:00:20.812261 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 104/208] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:00:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:20.816408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-14fd4b1b-5188-4637-b8e7-d25e6f3e1836 req-b8c382fc-0f8d-4988-838c-b64783303bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1370130f-3f03-44d2-ba98-49dc6604336b", "name": "network-vif-plugged", "status": "completed", "tag": "5af353eb-2753-40d8-bdac-8441acd8c04d"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:20.818976 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:20.818976 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:20.825830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-14fd4b1b-5188-4637-b8e7-d25e6f3e1836 req-b8c382fc-0f8d-4988-838c-b64783303bf3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:20.826270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-14fd4b1b-5188-4637-b8e7-d25e6f3e1836 req-b8c382fc-0f8d-4988-838c-b64783303bf3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:20.836989 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-14fd4b1b-5188-4637-b8e7-d25e6f3e1836 req-b8c382fc-0f8d-4988-838c-b64783303bf3 service nova] Creating event network-vif-plugged:5af353eb-2753-40d8-bdac-8441acd8c04d for instance 1370130f-3f03-44d2-ba98-49dc6604336b on nch1-master-1 Jan 22 21:00:20.842030 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-14fd4b1b-5188-4637-b8e7-d25e6f3e1836 req-b8c382fc-0f8d-4988-838c-b64783303bf3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028762 Jan 22 21:00:20.843002 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 105/209] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:20.847628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-91e52925-95b6-419b-a151-f73c7c945631 tempest-HypervisorAdminNegativeUnderV252Test-892596823 tempest-HypervisorAdminNegativeUnderV252Test-892596823-project] Calling method '.version_select at 0x7f1ed65c51f0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:20.849172 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:20.849172 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:20.851475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-91e52925-95b6-419b-a151-f73c7c945631 tempest-HypervisorAdminNegativeUnderV252Test-892596823 tempest-HypervisorAdminNegativeUnderV252Test-892596823-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '08925cd38cfc4da389e6c24ae2d5c03e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c0c346ceae405798b51724c77bf4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:20.852295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-91e52925-95b6-419b-a151-f73c7c945631 tempest-HypervisorAdminNegativeUnderV252Test-892596823 tempest-HypervisorAdminNegativeUnderV252Test-892596823-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:20.853092 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-91e52925-95b6-419b-a151-f73c7c945631 tempest-HypervisorAdminNegativeUnderV252Test-892596823 tempest-HypervisorAdminNegativeUnderV252Test-892596823-project] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009248 Jan 22 21:00:20.853797 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 106/210] 10.222.0.100 () {58 vars in 1180 bytes} [Sat Jan 22 21:00:20 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:20.862474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5bcd1b38-87b3-4232-ad53-947b3668c557 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Calling method '.version_select at 0x7f1ed6755ca0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:20.865386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bcd1b38-87b3-4232-ad53-947b3668c557 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:20.865808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bcd1b38-87b3-4232-ad53-947b3668c557 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:20.873741 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-5bcd1b38-87b3-4232-ad53-947b3668c557 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] HTTP exception thrown: No hypervisor matching 'f399d707-ec1b-4413-8a8f-fcdccd87939e' could be found. Jan 22 21:00:20.874325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5bcd1b38-87b3-4232-ad53-947b3668c557 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] Returning 404 to user: No hypervisor matching 'f399d707-ec1b-4413-8a8f-fcdccd87939e' could be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:20.875405 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5bcd1b38-87b3-4232-ad53-947b3668c557 tempest-HypervisorAdminNegativeUnderV252Test-561621431 tempest-HypervisorAdminNegativeUnderV252Test-561621431-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/f399d707-ec1b-4413-8a8f-fcdccd87939e/servers" status: 404 len: 123 microversion: 2.1 time: 0.016114 Jan 22 21:00:20.876172 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 107/211] 10.222.0.100 () {58 vars in 1285 bytes} [Sat Jan 22 21:00:20 2022] GET /compute/v2.1/os-hypervisors/f399d707-ec1b-4413-8a8f-fcdccd87939e/servers => generated 123 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:00:20.911886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a0cf0681-d03c-4e71-afc7-d3c48349cbae tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:20.912722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a0cf0681-d03c-4e71-afc7-d3c48349cbae tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:20.919338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0cf0681-d03c-4e71-afc7-d3c48349cbae tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:20.919832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d8efbce7-8b3d-4d6b-89cf-a5e836d57508 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:20.920072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0cf0681-d03c-4e71-afc7-d3c48349cbae tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:20.920764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0cf0681-d03c-4e71-afc7-d3c48349cbae tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:20.921201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0cf0681-d03c-4e71-afc7-d3c48349cbae tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:20.929882 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d8efbce7-8b3d-4d6b-89cf-a5e836d57508 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1498 microversion: 2.1 time: 0.234784 Jan 22 21:00:20.942189 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 105/212] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:20 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1498 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:20.947072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-769b0b11-3383-4509-a3de-0066868c2a0d tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:20.947580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-769b0b11-3383-4509-a3de-0066868c2a0d tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:20.953732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-769b0b11-3383-4509-a3de-0066868c2a0d tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:20.954389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-769b0b11-3383-4509-a3de-0066868c2a0d tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:20.955349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-769b0b11-3383-4509-a3de-0066868c2a0d tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:20.955847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-769b0b11-3383-4509-a3de-0066868c2a0d tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:21.024056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-769b0b11-3383-4509-a3de-0066868c2a0d tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:21.024652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-769b0b11-3383-4509-a3de-0066868c2a0d tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:21.025520 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-769b0b11-3383-4509-a3de-0066868c2a0d tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.082215 Jan 22 21:00:21.026060 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 106/213] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:00:20 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c/diagnostics => generated 117 bytes in 83 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:21.037200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-84e569c1-94b4-452d-a3d9-e0f81c080d04 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:21.037906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-84e569c1-94b4-452d-a3d9-e0f81c080d04 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:21.044470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84e569c1-94b4-452d-a3d9-e0f81c080d04 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:21.044926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84e569c1-94b4-452d-a3d9-e0f81c080d04 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:21.045774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84e569c1-94b4-452d-a3d9-e0f81c080d04 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:21.046221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84e569c1-94b4-452d-a3d9-e0f81c080d04 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:21.073966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-84e569c1-94b4-452d-a3d9-e0f81c080d04 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:00:21.074404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a0cf0681-d03c-4e71-afc7-d3c48349cbae tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:21.081803 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a0cf0681-d03c-4e71-afc7-d3c48349cbae tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1343 microversion: 2.1 time: 0.176406 Jan 22 21:00:21.082365 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 108/214] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:20 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1343 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:21.441172 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-84e569c1-94b4-452d-a3d9-e0f81c080d04 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 204 len: 0 microversion: 2.1 time: 0.407927 Jan 22 21:00:21.443093 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 107/215] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:00:21 2022] DELETE /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:00:21.455575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0b8875e8-2d8f-4528-83db-6172fdbe13ed tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:21.456326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0b8875e8-2d8f-4528-83db-6172fdbe13ed tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:21.462856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b8875e8-2d8f-4528-83db-6172fdbe13ed tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:21.463394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b8875e8-2d8f-4528-83db-6172fdbe13ed tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:21.464262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b8875e8-2d8f-4528-83db-6172fdbe13ed tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:21.464783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b8875e8-2d8f-4528-83db-6172fdbe13ed tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:21.632064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0b8875e8-2d8f-4528-83db-6172fdbe13ed tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:21.640640 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0b8875e8-2d8f-4528-83db-6172fdbe13ed tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1504 microversion: 2.1 time: 0.188552 Jan 22 21:00:21.641211 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 109/216] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:21 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:22.101358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3b4e48a7-c8b6-4afc-8782-76ffe1bcae6d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:22.102267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3b4e48a7-c8b6-4afc-8782-76ffe1bcae6d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:22.123576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3b4e48a7-c8b6-4afc-8782-76ffe1bcae6d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:22.124383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3b4e48a7-c8b6-4afc-8782-76ffe1bcae6d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:22.126290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3b4e48a7-c8b6-4afc-8782-76ffe1bcae6d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:22.126848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3b4e48a7-c8b6-4afc-8782-76ffe1bcae6d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:22.419196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3b4e48a7-c8b6-4afc-8782-76ffe1bcae6d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:22.427672 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3b4e48a7-c8b6-4afc-8782-76ffe1bcae6d tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1343 microversion: 2.1 time: 0.332129 Jan 22 21:00:22.428510 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 108/217] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:22 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1343 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:22.658574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-069f8bed-6da5-4a1a-972d-381b68beca91 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:22.659436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-069f8bed-6da5-4a1a-972d-381b68beca91 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:22.666265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-069f8bed-6da5-4a1a-972d-381b68beca91 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:22.666938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-069f8bed-6da5-4a1a-972d-381b68beca91 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:22.668553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-069f8bed-6da5-4a1a-972d-381b68beca91 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:22.669326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-069f8bed-6da5-4a1a-972d-381b68beca91 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:22.915892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-069f8bed-6da5-4a1a-972d-381b68beca91 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:22.923405 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-069f8bed-6da5-4a1a-972d-381b68beca91 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1504 microversion: 2.1 time: 0.268499 Jan 22 21:00:22.927505 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 110/218] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:22 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:23.444467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-af648c63-c2f4-4bee-8849-dd48c183edf1 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:23.445107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-af648c63-c2f4-4bee-8849-dd48c183edf1 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:23.452532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af648c63-c2f4-4bee-8849-dd48c183edf1 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:23.453082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af648c63-c2f4-4bee-8849-dd48c183edf1 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:23.454137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af648c63-c2f4-4bee-8849-dd48c183edf1 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:23.454769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af648c63-c2f4-4bee-8849-dd48c183edf1 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:23.710072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-af648c63-c2f4-4bee-8849-dd48c183edf1 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:23.727625 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-af648c63-c2f4-4bee-8849-dd48c183edf1 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1493 microversion: 2.1 time: 0.287237 Jan 22 21:00:23.729997 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 109/219] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:23 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1493 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:23.747771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-320e2b73-a538-43b7-b706-6b06490b7c34 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:23.748395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-320e2b73-a538-43b7-b706-6b06490b7c34 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:23.756095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-320e2b73-a538-43b7-b706-6b06490b7c34 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:23.757200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-320e2b73-a538-43b7-b706-6b06490b7c34 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:23.758216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-320e2b73-a538-43b7-b706-6b06490b7c34 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:23.758816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-320e2b73-a538-43b7-b706-6b06490b7c34 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:23.945858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0db8a77e-7f08-4a2d-959d-cd7aaa726f62 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:23.947945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0db8a77e-7f08-4a2d-959d-cd7aaa726f62 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:23.968942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0db8a77e-7f08-4a2d-959d-cd7aaa726f62 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:23.968942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0db8a77e-7f08-4a2d-959d-cd7aaa726f62 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:23.969787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0db8a77e-7f08-4a2d-959d-cd7aaa726f62 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:23.979748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0db8a77e-7f08-4a2d-959d-cd7aaa726f62 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:24.189816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0db8a77e-7f08-4a2d-959d-cd7aaa726f62 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:24.214079 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0db8a77e-7f08-4a2d-959d-cd7aaa726f62 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1462 microversion: 2.1 time: 0.274309 Jan 22 21:00:24.214791 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 110/220] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:23 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1462 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:24.257147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-6852f6d8-c786-4b3f-9d92-1d0d946f921a req-5848a610-cdaa-4f84-8b20-381c38c64894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1509ec0c-4416-407f-8221-41708f8f2e0c", "name": "network-vif-deleted", "tag": "673878c9-2195-4e4b-9123-b895a2073851"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:24.259112 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:24.259112 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:24.267054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6852f6d8-c786-4b3f-9d92-1d0d946f921a req-5848a610-cdaa-4f84-8b20-381c38c64894 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:24.267547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6852f6d8-c786-4b3f-9d92-1d0d946f921a req-5848a610-cdaa-4f84-8b20-381c38c64894 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:24.282768 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-6852f6d8-c786-4b3f-9d92-1d0d946f921a req-5848a610-cdaa-4f84-8b20-381c38c64894 service nova] Creating event network-vif-deleted:673878c9-2195-4e4b-9123-b895a2073851 for instance 1509ec0c-4416-407f-8221-41708f8f2e0c on nch1-master-1 Jan 22 21:00:24.308389 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-6852f6d8-c786-4b3f-9d92-1d0d946f921a req-5848a610-cdaa-4f84-8b20-381c38c64894 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037654 Jan 22 21:00:24.308389 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 111/221] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:00:24.359781 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-320e2b73-a538-43b7-b706-6b06490b7c34 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1644 microversion: 2.1 time: 0.615808 Jan 22 21:00:24.360962 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 111/222] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:23 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1644 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:24.379079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3fe515d1-3ee5-434f-85a3-e776cc5602d9 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:24.381284 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:24.381284 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:24.391368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fe515d1-3ee5-434f-85a3-e776cc5602d9 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:24.392456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fe515d1-3ee5-434f-85a3-e776cc5602d9 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:25.129218 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3fe515d1-3ee5-434f-85a3-e776cc5602d9 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 300 microversion: 2.1 time: 0.755139 Jan 22 21:00:25.130845 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 112/223] 10.222.0.100 () {60 vars in 1195 bytes} [Sat Jan 22 21:00:24 2022] POST /compute/v2.1/os-aggregates/4/action => generated 300 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:25.141186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f9b0fe59-f3fa-4ed4-b888-941577703308 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:25.142022 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:25.142022 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:25.233132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2636cd15-f96e-41da-a58f-cf40437921b8 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:25.234005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2636cd15-f96e-41da-a58f-cf40437921b8 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:25.240869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2636cd15-f96e-41da-a58f-cf40437921b8 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:25.241325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2636cd15-f96e-41da-a58f-cf40437921b8 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:25.242155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2636cd15-f96e-41da-a58f-cf40437921b8 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:25.242635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2636cd15-f96e-41da-a58f-cf40437921b8 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:25.304696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2636cd15-f96e-41da-a58f-cf40437921b8 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '711120a6fba843b69bf61afa378f3218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c73a223b87c4f078727025f1c3c9929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:25.312450 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f9b0fe59-f3fa-4ed4-b888-941577703308 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.174832 Jan 22 21:00:25.315883 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 112/224] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:00:25 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 22 21:00:25.316008 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2636cd15-f96e-41da-a58f-cf40437921b8 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 200 len: 1311 microversion: 2.1 time: 0.085473 Jan 22 21:00:25.316008 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 113/225] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:25 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:25.328206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-920bea3f-2cf9-417f-87e5-b5c2111341b9 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-594188776"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:25.330252 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:25.330252 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:25.332314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.aggregate [None req-920bea3f-2cf9-417f-87e5-b5c2111341b9 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Generated uuid d2e7d885-74d6-4f12-a114-8fa746ae8595 for aggregate {{(pid=137032) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 21:00:25.443041 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-920bea3f-2cf9-417f-87e5-b5c2111341b9 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.119386 Jan 22 21:00:25.457211 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 113/226] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 21:00:25 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:25.457747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-97dcf1f9-d936-4d0d-ae46-ad70169cc55d tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:25.459905 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:25.459905 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:25.471269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97dcf1f9-d936-4d0d-ae46-ad70169cc55d tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:25.471730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97dcf1f9-d936-4d0d-ae46-ad70169cc55d tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:25.731182 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-97dcf1f9-d936-4d0d-ae46-ad70169cc55d tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.277035 Jan 22 21:00:25.732156 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 114/227] 10.222.0.100 () {60 vars in 1195 bytes} [Sat Jan 22 21:00:25 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:00:25.742220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-833233f8-46b7-4bd7-9de7-833583a4c357 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:25.743687 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:25.743687 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:25.752531 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-833233f8-46b7-4bd7-9de7-833583a4c357 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.014275 Jan 22 21:00:25.760541 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 114/228] 10.222.0.100 () {58 vars in 1153 bytes} [Sat Jan 22 21:00:25 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:25.765475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a38182aa-c491-4d3b-8438-8dbee6675d59 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:25.766810 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:25.766810 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:25.776364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a38182aa-c491-4d3b-8438-8dbee6675d59 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:25.776826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a38182aa-c491-4d3b-8438-8dbee6675d59 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:26.048912 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a38182aa-c491-4d3b-8438-8dbee6675d59 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.287015 Jan 22 21:00:26.054238 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 115/229] 10.222.0.100 () {60 vars in 1195 bytes} [Sat Jan 22 21:00:25 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:26.063246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-21f7bb46-0533-49eb-b626-81463e3a78aa tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:26.064007 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:26.064007 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:26.152726 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-21f7bb46-0533-49eb-b626-81463e3a78aa tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.093113 Jan 22 21:00:26.163339 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 115/230] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:00:26 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 22 21:00:26.171788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eb5927a6-3f6b-474c-a1d4-b63e44abc424 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-135142865"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:26.173130 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:26.173130 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:26.174456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.aggregate [None req-eb5927a6-3f6b-474c-a1d4-b63e44abc424 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Generated uuid 3cbe132f-c2b7-46ed-b301-feb7b2b706aa for aggregate {{(pid=137033) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 21:00:26.289400 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eb5927a6-3f6b-474c-a1d4-b63e44abc424 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.121197 Jan 22 21:00:26.290407 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 116/231] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 21:00:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:00:26.300719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fc39d174-b79c-46f9-a9d9-1d8448d83047 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:26.302940 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:26.302940 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:26.313890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc39d174-b79c-46f9-a9d9-1d8448d83047 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:26.314655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc39d174-b79c-46f9-a9d9-1d8448d83047 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:26.337288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7e028c77-f7ee-4282-8016-38a6901096c2 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:26.338196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7e028c77-f7ee-4282-8016-38a6901096c2 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] [instance: 1509ec0c-4416-407f-8221-41708f8f2e0c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:26.345689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e028c77-f7ee-4282-8016-38a6901096c2 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:26.346063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e028c77-f7ee-4282-8016-38a6901096c2 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:26.346862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e028c77-f7ee-4282-8016-38a6901096c2 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:26.347304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e028c77-f7ee-4282-8016-38a6901096c2 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:26.363036 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-7e028c77-f7ee-4282-8016-38a6901096c2 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] HTTP exception thrown: Instance 1509ec0c-4416-407f-8221-41708f8f2e0c could not be found. Jan 22 21:00:26.363634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7e028c77-f7ee-4282-8016-38a6901096c2 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] Returning 404 to user: Instance 1509ec0c-4416-407f-8221-41708f8f2e0c could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:26.365093 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7e028c77-f7ee-4282-8016-38a6901096c2 tempest-ServerDiagnosticsNegativeTest-220609872 tempest-ServerDiagnosticsNegativeTest-220609872-project] 10.222.0.100 "GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c" status: 404 len: 111 microversion: 2.1 time: 0.033124 Jan 22 21:00:26.369155 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 117/232] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:26 2022] GET /compute/v2.1/servers/1509ec0c-4416-407f-8221-41708f8f2e0c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:26.585192 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fc39d174-b79c-46f9-a9d9-1d8448d83047 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.288643 Jan 22 21:00:26.595047 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 116/233] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 21:00:26 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:26.595488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-465ea661-7dea-4904-bede-7b65fa767659 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:26.596301 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:26.596301 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:26.603767 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-465ea661-7dea-4904-bede-7b65fa767659 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.011959 Jan 22 21:00:26.604286 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 118/234] 10.222.0.100 () {58 vars in 1147 bytes} [Sat Jan 22 21:00:26 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:26.614070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-efc064e8-e187-49eb-bcb8-6c1c96e93446 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:26.616387 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:26.616387 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:26.625120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-efc064e8-e187-49eb-bcb8-6c1c96e93446 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:26.628228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-efc064e8-e187-49eb-bcb8-6c1c96e93446 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:26.869658 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-efc064e8-e187-49eb-bcb8-6c1c96e93446 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.259159 Jan 22 21:00:26.870263 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 117/235] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 21:00:26 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:00:27.157336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1756633632", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:27.188179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a35a53d7-9f05-4a91-abee-f4b96346652a tempest-InstanceUsageAuditLogNegativeTestJSON-1305475479 tempest-InstanceUsageAuditLogNegativeTestJSON-1305475479-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:27.189612 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:27.189612 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:27.191629 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-a35a53d7-9f05-4a91-abee-f4b96346652a tempest-InstanceUsageAuditLogNegativeTestJSON-1305475479 tempest-InstanceUsageAuditLogNegativeTestJSON-1305475479-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jan 22 21:00:27.192416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a35a53d7-9f05-4a91-abee-f4b96346652a tempest-InstanceUsageAuditLogNegativeTestJSON-1305475479 tempest-InstanceUsageAuditLogNegativeTestJSON-1305475479-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:27.194376 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a35a53d7-9f05-4a91-abee-f4b96346652a tempest-InstanceUsageAuditLogNegativeTestJSON-1305475479 tempest-InstanceUsageAuditLogNegativeTestJSON-1305475479-project-admin] 10.222.0.100 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.425931 Jan 22 21:00:27.199965 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 119/236] 10.222.0.100 () {58 vars in 1228 bytes} [Sat Jan 22 21:00:26 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 432 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jan 22 21:00:27.206529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-36cd24f4-787f-4506-a370-225afb104d0c tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:27.207403 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:27.207403 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:27.214778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:00:27.285142 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-36cd24f4-787f-4506-a370-225afb104d0c tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.083226 Jan 22 21:00:27.287558 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 120/237] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:00:27 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 22 21:00:27.430602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:00:27.431028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:00:27.431504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:00:27.431927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:00:27.432343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:00:27.449352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:27.462503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:27.462503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:27.462503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:27.481384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Getting quotas for project 678b6ef2fa6b4f8b9aa67ef59b77ade5. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:00:27.491792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Getting quotas for user f62c70b6289f4c17a797c522a9326388 and project 678b6ef2fa6b4f8b9aa67ef59b77ade5. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:00:27.508910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:00:27.511481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:00:27.608042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-073d2466-c67c-4290-841b-a0953d2ba155 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:27.611955 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:27.611955 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:27.611955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-073d2466-c67c-4290-841b-a0953d2ba155 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'eea6d062e40f499b9b3f88d6cf905256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c3c5b8b994884a04c87a1fc0d694d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:27.611955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-073d2466-c67c-4290-841b-a0953d2ba155 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:27.611955 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-073d2466-c67c-4290-841b-a0953d2ba155 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012-project] 10.222.0.100 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.322572 Jan 22 21:00:27.616645 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 121/238] 10.222.0.100 () {58 vars in 1189 bytes} [Sat Jan 22 21:00:27 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 328 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:27.621271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b59cbe71-b2f0-415d-a82f-52c6a23b4f65 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-355630587"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:27.622771 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:27.622771 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:27.624247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.aggregate [None req-b59cbe71-b2f0-415d-a82f-52c6a23b4f65 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Generated uuid f5a9f603-e5e2-4319-b88b-2508b082d31b for aggregate {{(pid=137033) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 21:00:27.644345 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-31ee24a2-1ed2-4871-9b50-dc0d26a40039 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.773063 Jan 22 21:00:27.644978 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 118/239] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:00:26 2022] POST /compute/v2.1/servers => generated 382 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:00:27.649880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8566136e-2023-40e0-b59b-d4f58843ac98 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:27.650812 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:27.650812 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:27.652099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8566136e-2023-40e0-b59b-d4f58843ac98 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'eea6d062e40f499b9b3f88d6cf905256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b53c3c5b8b994884a04c87a1fc0d694d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:27.652742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8566136e-2023-40e0-b59b-d4f58843ac98 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:27.653613 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8566136e-2023-40e0-b59b-d4f58843ac98 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012 tempest-InstanceUsageAuditLogNegativeTestJSON-517743012-project] 10.222.0.100 "GET /compute/v2.1/os-instance_usage_audit_log/2022-01-22 21:00:27" status: 403 len: 128 microversion: 2.1 time: 0.007481 Jan 22 21:00:27.654117 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 119/240] 10.222.0.100 () {58 vars in 1255 bytes} [Sat Jan 22 21:00:27 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-01-22%2021%3A00%3A27 => generated 128 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:27.663248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ec2384d0-c103-4a00-b4e7-3995d4408ff3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:27.663848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ec2384d0-c103-4a00-b4e7-3995d4408ff3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:27.727224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ec2384d0-c103-4a00-b4e7-3995d4408ff3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:27.735089 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ec2384d0-c103-4a00-b4e7-3995d4408ff3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1218 microversion: 2.1 time: 0.076228 Jan 22 21:00:27.736005 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 120/241] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:27 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:27.763523 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b59cbe71-b2f0-415d-a82f-52c6a23b4f65 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.145570 Jan 22 21:00:27.764118 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 122/242] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 21:00:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:27.775801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-be7ac212-c703-4e3b-8d3f-b63cfc30646c tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:27.780401 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:27.780401 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:27.792603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be7ac212-c703-4e3b-8d3f-b63cfc30646c tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:27.793069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be7ac212-c703-4e3b-8d3f-b63cfc30646c tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:28.036974 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-be7ac212-c703-4e3b-8d3f-b63cfc30646c tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.265595 Jan 22 21:00:28.044777 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 121/243] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 21:00:27 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:28.047609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dd3b3394-d9a8-4198-9818-f515b3ea4a05 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:28.048878 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:28.048878 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:28.058751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd3b3394-d9a8-4198-9818-f515b3ea4a05 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:28.059677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd3b3394-d9a8-4198-9818-f515b3ea4a05 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:28.369635 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dd3b3394-d9a8-4198-9818-f515b3ea4a05 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.325545 Jan 22 21:00:28.382146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8463072f-ec25-450e-98b3-60ee0d8df6f8 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:28.383053 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:28.383053 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:28.383281 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 123/244] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 21:00:28 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:28.485613 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8463072f-ec25-450e-98b3-60ee0d8df6f8 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.108273 Jan 22 21:00:28.490540 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 122/245] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:00:28 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 22 21:00:28.495867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-601f4e9e-aeda-4571-935c-30b5f874c3bb tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1000351382"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:28.497701 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:28.497701 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:28.498987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.aggregate [None req-601f4e9e-aeda-4571-935c-30b5f874c3bb tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Generated uuid e0379fe4-3014-48b0-83cf-be595e2375fd for aggregate {{(pid=137033) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 21:00:28.561130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f4530eee-4993-456a-82ea-fc78014a0e6e tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-352159476"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:28.562603 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:28.562603 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:28.564054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.aggregate [None req-f4530eee-4993-456a-82ea-fc78014a0e6e tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Generated uuid b4ed7447-2e66-4a18-8763-aff1926e7a2c for aggregate {{(pid=137032) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 21:00:28.590789 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-601f4e9e-aeda-4571-935c-30b5f874c3bb tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.098948 Jan 22 21:00:28.591585 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 124/246] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 21:00:28 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:28.601542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2d879f1f-9789-496e-be7a-679d47f2fdad tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:28.602314 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:28.602314 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:28.724184 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f4530eee-4993-456a-82ea-fc78014a0e6e tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.166493 Jan 22 21:00:28.725058 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 123/247] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 21:00:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:00:28.743955 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2d879f1f-9789-496e-be7a-679d47f2fdad tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.146497 Jan 22 21:00:28.744547 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 125/248] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:00:28 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jan 22 21:00:28.749398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0c47c9ba-acbf-4271-af75-94b0359fe607 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:28.750765 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:28.750765 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:28.756666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1432cb4c-7518-4616-a205-f075a49d5042 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:28.757483 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:28.757483 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:28.769001 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-1432cb4c-7518-4616-a205-f075a49d5042 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jan 22 21:00:28.769619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1432cb4c-7518-4616-a205-f075a49d5042 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:28.770471 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1432cb4c-7518-4616-a205-f075a49d5042 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.018414 Jan 22 21:00:28.771284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c47c9ba-acbf-4271-af75-94b0359fe607 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:28.771560 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 126/249] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:00:28 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:00:28.771924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c47c9ba-acbf-4271-af75-94b0359fe607 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:28.776558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5e4d759f-907c-4878-b7bd-ebe9b6e999e5 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:28.777454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5e4d759f-907c-4878-b7bd-ebe9b6e999e5 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:28.837118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5e4d759f-907c-4878-b7bd-ebe9b6e999e5 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:28.850584 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5e4d759f-907c-4878-b7bd-ebe9b6e999e5 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1218 microversion: 2.1 time: 0.076936 Jan 22 21:00:28.852641 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 127/250] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:28 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:28.860080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-66e40ae4-a19c-434e-bfe6-afd461839c5c tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:28.861084 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:28.861084 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:28.881804 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-66e40ae4-a19c-434e-bfe6-afd461839c5c tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jan 22 21:00:28.882644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-66e40ae4-a19c-434e-bfe6-afd461839c5c tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:28.889766 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-66e40ae4-a19c-434e-bfe6-afd461839c5c tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.029379 Jan 22 21:00:28.889766 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 128/251] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:00:28 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:00:28.895016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-779d9729-593e-43b4-b64a-5730bcaa6e87 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-729632965", "name": "tempest-test_aggregate-1203830309"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:28.915577 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:28.915577 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:28.917355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.aggregate [None req-779d9729-593e-43b4-b64a-5730bcaa6e87 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Generated uuid 7c84e385-bcd8-41e9-80aa-33d129fbf3ee for aggregate {{(pid=137033) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 21:00:29.022045 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-779d9729-593e-43b4-b64a-5730bcaa6e87 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.130712 Jan 22 21:00:29.025640 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 129/252] 10.222.0.100 () {60 vars in 1169 bytes} [Sat Jan 22 21:00:28 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:29.033327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9e75c660-cb08-4ad5-a47b-b4f15d82bf37 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:29.034092 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:29.034092 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:29.085830 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0c47c9ba-acbf-4271-af75-94b0359fe607 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 242 microversion: 2.1 time: 0.353350 Jan 22 21:00:29.086440 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 124/253] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 21:00:28 2022] POST /compute/v2.1/os-aggregates/13/action => generated 242 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:00:29.107881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-14580c06-cdeb-4b56-9efa-7a548c37cdbb tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:29.107881 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:29.107881 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:29.108525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-14580c06-cdeb-4b56-9efa-7a548c37cdbb tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '83de1c90e2be4e6b9358c4c957d1fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee98e5cdf72f4ed2a6dd6cb4648b0446', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:29.110445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-14580c06-cdeb-4b56-9efa-7a548c37cdbb tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:29.118617 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-14580c06-cdeb-4b56-9efa-7a548c37cdbb tempest-AggregatesAdminNegativeTestJSON-2105517636 tempest-AggregatesAdminNegativeTestJSON-2105517636-project] 10.222.0.100 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.015161 Jan 22 21:00:29.122675 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 125/254] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 21:00:29 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:29.127941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-45668e9e-8ec0-4586-8b28-16db574265d1 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:29.139446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45668e9e-8ec0-4586-8b28-16db574265d1 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:29.140270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45668e9e-8ec0-4586-8b28-16db574265d1 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:29.177700 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9e75c660-cb08-4ad5-a47b-b4f15d82bf37 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.146983 Jan 22 21:00:29.178307 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 130/255] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:00:29 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jan 22 21:00:29.198078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4144c6cc-97f8-4041-b222-2e9eb6be1767 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:29.199287 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:29.199287 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:29.208904 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-4144c6cc-97f8-4041-b222-2e9eb6be1767 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jan 22 21:00:29.209792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4144c6cc-97f8-4041-b222-2e9eb6be1767 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:29.210741 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4144c6cc-97f8-4041-b222-2e9eb6be1767 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.027534 Jan 22 21:00:29.216821 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 131/256] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:00:29 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:00:29.224812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bf14debc-ecc3-4b0e-8502-7487bf6e7673 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:29.226213 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:29.226213 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:29.240833 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-bf14debc-ecc3-4b0e-8502-7487bf6e7673 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jan 22 21:00:29.241695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bf14debc-ecc3-4b0e-8502-7487bf6e7673 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:29.242634 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bf14debc-ecc3-4b0e-8502-7487bf6e7673 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.023789 Jan 22 21:00:29.243255 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 132/257] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:00:29 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:00:29.251984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-36f859b2-008c-4ed4-9e6e-662f05f555fa tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-687180359"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:29.253828 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:29.253828 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:29.255563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.aggregate [None req-36f859b2-008c-4ed4-9e6e-662f05f555fa tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Generated uuid 503516b8-8b5c-45cb-a777-5c68434749b1 for aggregate {{(pid=137033) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 21:00:29.445407 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-45668e9e-8ec0-4586-8b28-16db574265d1 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 227 microversion: 2.1 time: 0.321079 Jan 22 21:00:29.446084 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 126/258] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 21:00:29 2022] POST /compute/v2.1/os-aggregates/13/action => generated 227 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:29.452131 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-36f859b2-008c-4ed4-9e6e-662f05f555fa tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.174574 Jan 22 21:00:29.459275 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 133/259] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 21:00:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:29.464232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1e6dd370-c27a-410c-8d0d-6bbdd298907a tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:29.466641 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:29.466641 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:29.479830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-28def8e8-38e1-4553-8406-1b07f7429e0a tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:29.484752 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:29.484752 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:29.499096 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-28def8e8-38e1-4553-8406-1b07f7429e0a tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.034250 Jan 22 21:00:29.504828 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 134/260] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:00:29 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:29.511370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5581462f-beac-46f1-9dbf-0ef345c8e3c5 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:29.513538 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:29.513538 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:29.567304 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1e6dd370-c27a-410c-8d0d-6bbdd298907a tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.110960 Jan 22 21:00:29.569597 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 127/261] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:00:29 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 22 21:00:29.578657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f8c1e38-bd5e-471b-befe-83ea41f55e4d tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1866106959"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:29.580053 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:29.580053 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:29.581443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.aggregate [None req-5f8c1e38-bd5e-471b-befe-83ea41f55e4d tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Generated uuid e6605c09-4e80-4101-b893-16ac9b9ff237 for aggregate {{(pid=137032) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 21:00:29.650837 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5581462f-beac-46f1-9dbf-0ef345c8e3c5 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.144144 Jan 22 21:00:29.656984 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 135/262] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 21:00:29 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:29.662929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-18af8f69-5992-4ad4-a84d-b2a2724e2a5b tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Calling method '.version_select at 0x7f1ed64e0f70>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:29.664227 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:29.664227 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:29.667325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18af8f69-5992-4ad4-a84d-b2a2724e2a5b tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:29.667860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18af8f69-5992-4ad4-a84d-b2a2724e2a5b tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:29.668872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18af8f69-5992-4ad4-a84d-b2a2724e2a5b tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:29.669314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18af8f69-5992-4ad4-a84d-b2a2724e2a5b tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:29.693374 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-18af8f69-5992-4ad4-a84d-b2a2724e2a5b tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.034999 Jan 22 21:00:29.695256 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 136/263] 10.222.0.100 () {58 vars in 1132 bytes} [Sat Jan 22 21:00:29 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:29.700639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ca935c2e-4c3e-4f16-8b0c-03067ccc6987 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:29.703544 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:29.703544 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:29.710477 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ca935c2e-4c3e-4f16-8b0c-03067ccc6987 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.013837 Jan 22 21:00:29.716025 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 137/264] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:00:29 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:29.716274 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f8c1e38-bd5e-471b-befe-83ea41f55e4d tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.138164 Jan 22 21:00:29.716274 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 128/265] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 21:00:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:00:29.719521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2bdd3523-ee9c-420e-85d6-1fd633216866 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Calling method '.version_select at 0x7f1ed6551b80>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:29.720849 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:29.720849 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:29.722925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2bdd3523-ee9c-420e-85d6-1fd633216866 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:29.724341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2bdd3523-ee9c-420e-85d6-1fd633216866 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:29.726371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2bdd3523-ee9c-420e-85d6-1fd633216866 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:29.726956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2bdd3523-ee9c-420e-85d6-1fd633216866 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:29.753030 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2bdd3523-ee9c-420e-85d6-1fd633216866 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.038742 Jan 22 21:00:29.753656 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 129/266] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:00:29 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:29.759290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-13fd3931-d5dc-4c2f-bc72-57fdb29535e4 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:29.760054 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:29.760054 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:29.984848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2dc4920c-e52d-41ca-aaf6-774b1d7dc661 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Calling method '.version_select at 0x7f1ed64e09d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:30.107841 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2dc4920c-e52d-41ca-aaf6-774b1d7dc661 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/f48e6733eed74282a9400be171b666de" status: 200 len: 371 microversion: 2.1 time: 0.395257 Jan 22 21:00:30.108569 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 138/267] 10.222.0.100 () {58 vars in 1246 bytes} [Sat Jan 22 21:00:29 2022] GET /compute/v2.1/os-quota-sets/f48e6733eed74282a9400be171b666de => generated 371 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:30.117727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-27aef37a-ce73-4ead-9b01-63616b24776a tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:30.118972 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:30.118972 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:30.127449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27aef37a-ce73-4ead-9b01-63616b24776a tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:30.127932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27aef37a-ce73-4ead-9b01-63616b24776a tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:30.136201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27aef37a-ce73-4ead-9b01-63616b24776a tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:30.136666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27aef37a-ce73-4ead-9b01-63616b24776a tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:30.173560 ncdv-master-1 devstack@n-api.service[137033]: ERROR nova.api.openstack.compute.aggregates [None req-27aef37a-ce73-4ead-9b01-63616b24776a tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jan 22 21:00:30.174256 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-27aef37a-ce73-4ead-9b01-63616b24776a tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Jan 22 21:00:30.174879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-27aef37a-ce73-4ead-9b01-63616b24776a tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:30.175733 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-27aef37a-ce73-4ead-9b01-63616b24776a tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.065722 Jan 22 21:00:30.176330 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 139/268] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 21:00:30 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:00:30.182403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d04107e-09fd-4e1a-8a1b-3f96a89b9e47 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Calling method '.version_select at 0x7f1ed6479550>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:30.183544 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:30.183544 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:30.185101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d04107e-09fd-4e1a-8a1b-3f96a89b9e47 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:30.185670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d04107e-09fd-4e1a-8a1b-3f96a89b9e47 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:30.186746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d04107e-09fd-4e1a-8a1b-3f96a89b9e47 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:30.187186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d04107e-09fd-4e1a-8a1b-3f96a89b9e47 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:30.212759 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d04107e-09fd-4e1a-8a1b-3f96a89b9e47 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.033747 Jan 22 21:00:30.213352 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 140/269] 10.222.0.100 () {58 vars in 1132 bytes} [Sat Jan 22 21:00:30 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:30.218145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-909e3b71-8588-4c29-bd1d-5548755be760 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:30.218714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-909e3b71-8588-4c29-bd1d-5548755be760 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:30.226610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-909e3b71-8588-4c29-bd1d-5548755be760 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:30.227127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-909e3b71-8588-4c29-bd1d-5548755be760 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:30.228015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-909e3b71-8588-4c29-bd1d-5548755be760 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:30.228560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-909e3b71-8588-4c29-bd1d-5548755be760 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:30.295128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-909e3b71-8588-4c29-bd1d-5548755be760 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:30.303200 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-909e3b71-8588-4c29-bd1d-5548755be760 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1270 microversion: 2.1 time: 0.088541 Jan 22 21:00:30.312510 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 141/270] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:30 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:30.312510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-58e9c41d-4819-4760-a556-95a7123451ef tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed6479d30>, body: {"quota_set": {"ram": "5120"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:30.312510 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:30.312510 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:30.458141 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-13fd3931-d5dc-4c2f-bc72-57fdb29535e4 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.703382 Jan 22 21:00:30.458786 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 130/271] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:00:29 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 22 21:00:30.463158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fcacba5e-cbf6-4d0a-9d30-adc339ad0566 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:30.463953 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:30.463953 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:30.608183 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fcacba5e-cbf6-4d0a-9d30-adc339ad0566 tempest-AggregatesAdminNegativeTestJSON-2046607649 tempest-AggregatesAdminNegativeTestJSON-2046607649-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.147858 Jan 22 21:00:30.608911 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 131/272] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:00:30 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 22 21:00:30.614383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c07e35fe-5fe3-48e8-85d6-2b107f2d4f86 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Calling method '.version_select at 0x7f1ed65abe50>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:30.616325 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:30.616325 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:30.623182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c07e35fe-5fe3-48e8-85d6-2b107f2d4f86 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:30.623688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c07e35fe-5fe3-48e8-85d6-2b107f2d4f86 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:30.639560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c07e35fe-5fe3-48e8-85d6-2b107f2d4f86 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:30.640094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c07e35fe-5fe3-48e8-85d6-2b107f2d4f86 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:30.658171 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c07e35fe-5fe3-48e8-85d6-2b107f2d4f86 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.047913 Jan 22 21:00:30.658960 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 132/273] 10.222.0.100 () {58 vars in 1174 bytes} [Sat Jan 22 21:00:30 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:30.664067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c3b29347-77c2-4a83-9030-fec8a658c355 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1133164171", "availability_zone": "tempest-test_az-713139227"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:30.665858 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:30.665858 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:30.667103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.aggregate [None req-c3b29347-77c2-4a83-9030-fec8a658c355 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Generated uuid 3eb114ae-15d1-42e4-bb81-ad3bdc8beb98 for aggregate {{(pid=137032) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 21:00:30.772958 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c3b29347-77c2-4a83-9030-fec8a658c355 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.112803 Jan 22 21:00:30.774137 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 133/274] 10.222.0.100 () {60 vars in 1169 bytes} [Sat Jan 22 21:00:30 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:30.778442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-87e157da-c9ec-4185-b9c9-e0192e32cd53 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Calling method '.version_select at 0x7f1ed65c5a60>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:30.779231 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:30.779231 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:30.786277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87e157da-c9ec-4185-b9c9-e0192e32cd53 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:30.786843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87e157da-c9ec-4185-b9c9-e0192e32cd53 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:30.800792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87e157da-c9ec-4185-b9c9-e0192e32cd53 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:30.801245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87e157da-c9ec-4185-b9c9-e0192e32cd53 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:30.816652 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-87e157da-c9ec-4185-b9c9-e0192e32cd53 tempest-HostsAdminTestJSON-2129731281 tempest-HostsAdminTestJSON-2129731281-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 467 microversion: 2.1 time: 0.041469 Jan 22 21:00:30.817301 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 134/275] 10.222.0.100 () {58 vars in 1174 bytes} [Sat Jan 22 21:00:30 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 467 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:30.827389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fe273e6b-8048-42a9-acf5-2890a7b315bf tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1133164171_new", "availability_zone": "tempest-test_az-713139227_new"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:30.907858 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:30.907858 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:30.941911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58e9c41d-4819-4760-a556-95a7123451ef tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:30.943607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58e9c41d-4819-4760-a556-95a7123451ef tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:30.944588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58e9c41d-4819-4760-a556-95a7123451ef tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:30.945177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58e9c41d-4819-4760-a556-95a7123451ef tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:31.043141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe273e6b-8048-42a9-acf5-2890a7b315bf tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:31.043778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe273e6b-8048-42a9-acf5-2890a7b315bf tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:31.087356 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-58e9c41d-4819-4760-a556-95a7123451ef tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/f48e6733eed74282a9400be171b666de" status: 200 len: 328 microversion: 2.1 time: 0.782521 Jan 22 21:00:31.088222 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 142/276] 10.222.0.100 () {60 vars in 1266 bytes} [Sat Jan 22 21:00:30 2022] PUT /compute/v2.1/os-quota-sets/f48e6733eed74282a9400be171b666de => generated 328 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:31.114110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f326b1bf-39f9-42fe-86f3-a766a85db9ac tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:31.115946 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:31.115946 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:31.134120 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fe273e6b-8048-42a9-acf5-2890a7b315bf tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.311111 Jan 22 21:00:31.135226 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 135/277] 10.222.0.100 () {60 vars in 1177 bytes} [Sat Jan 22 21:00:30 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:31.148319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3ffa7b88-0b31-4f86-8f61-9b65c08abab4 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:31.150100 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:31.150100 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:31.160904 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3ffa7b88-0b31-4f86-8f61-9b65c08abab4 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.018020 Jan 22 21:00:31.162566 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 136/278] 10.222.0.100 () {58 vars in 1147 bytes} [Sat Jan 22 21:00:31 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:31.173980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4bae6353-8d54-4909-ac87-2fd998c10ccd tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:31.175007 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:31.175007 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:31.211400 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f326b1bf-39f9-42fe-86f3-a766a85db9ac tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-quota-sets/f48e6733eed74282a9400be171b666de" status: 202 len: 0 microversion: 2.1 time: 0.105534 Jan 22 21:00:31.212050 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 143/279] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:00:31 2022] DELETE /compute/v2.1/os-quota-sets/f48e6733eed74282a9400be171b666de => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:00:31.219997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5926cdad-9096-4018-be09-6f35e6e88b6b tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Calling method '.version_select at 0x7f1ed647d820>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:31.290107 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4bae6353-8d54-4909-ac87-2fd998c10ccd tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.120354 Jan 22 21:00:31.292732 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 137/280] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:00:31 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jan 22 21:00:31.305986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2b6e5a5f-37cb-4edb-baa3-6610369d6234 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-366670070"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:31.307673 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:31.307673 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:31.309213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.aggregate [None req-2b6e5a5f-37cb-4edb-baa3-6610369d6234 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Generated uuid 407e62f8-c42f-4f72-954f-5efde9795cfe for aggregate {{(pid=137032) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 21:00:31.450549 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2b6e5a5f-37cb-4edb-baa3-6610369d6234 tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.152123 Jan 22 21:00:31.456659 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 138/281] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 21:00:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:31.456659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bbc04c76-57fd-4418-87dc-979aaf8f71e8 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:31.457002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bbc04c76-57fd-4418-87dc-979aaf8f71e8 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:31.464808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbc04c76-57fd-4418-87dc-979aaf8f71e8 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:31.465538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbc04c76-57fd-4418-87dc-979aaf8f71e8 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:31.466552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbc04c76-57fd-4418-87dc-979aaf8f71e8 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:31.467150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbc04c76-57fd-4418-87dc-979aaf8f71e8 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:31.601163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bbc04c76-57fd-4418-87dc-979aaf8f71e8 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:31.615856 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bbc04c76-57fd-4418-87dc-979aaf8f71e8 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1276 microversion: 2.1 time: 0.162585 Jan 22 21:00:31.631608 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 139/282] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:31 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:31.642921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ff9806e6-f31f-419a-8a6d-87b33e20d06c tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:31.646601 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:31.646601 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:31.659782 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ff9806e6-f31f-419a-8a6d-87b33e20d06c tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.025257 Jan 22 21:00:31.661256 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 140/283] 10.222.0.100 () {58 vars in 1147 bytes} [Sat Jan 22 21:00:31 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:31.671139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0ffa0d97-4b97-4a2f-beb8-fd0ea769b87a tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:31.678538 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:31.678538 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:31.785816 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0ffa0d97-4b97-4a2f-beb8-fd0ea769b87a tempest-AggregatesAdminTestJSON-2021999403 tempest-AggregatesAdminTestJSON-2021999403-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.117594 Jan 22 21:00:31.791746 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 141/284] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:00:31 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 22 21:00:31.798467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a9b7ef49-d583-4cb3-b581-c11fbc5981e6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:31.802437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a9b7ef49-d583-4cb3-b581-c11fbc5981e6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:31.821099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9b7ef49-d583-4cb3-b581-c11fbc5981e6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:31.822658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9b7ef49-d583-4cb3-b581-c11fbc5981e6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:31.825623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9b7ef49-d583-4cb3-b581-c11fbc5981e6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:31.826286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9b7ef49-d583-4cb3-b581-c11fbc5981e6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:31.900968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a9b7ef49-d583-4cb3-b581-c11fbc5981e6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:00:32.283714 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5926cdad-9096-4018-be09-6f35e6e88b6b tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/f48e6733eed74282a9400be171b666de" status: 200 len: 371 microversion: 2.1 time: 1.067406 Jan 22 21:00:32.287698 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 144/285] 10.222.0.100 () {58 vars in 1246 bytes} [Sat Jan 22 21:00:31 2022] GET /compute/v2.1/os-quota-sets/f48e6733eed74282a9400be171b666de => generated 371 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:00:32.332945 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a9b7ef49-d583-4cb3-b581-c11fbc5981e6 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 204 len: 0 microversion: 2.1 time: 0.539881 Jan 22 21:00:32.337564 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 142/286] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:00:31 2022] DELETE /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:00:32.346556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dc555c38-3d65-4d14-95b1-623880a13104 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:32.347250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dc555c38-3d65-4d14-95b1-623880a13104 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:32.357470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc555c38-3d65-4d14-95b1-623880a13104 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:32.357968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc555c38-3d65-4d14-95b1-623880a13104 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:32.359568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc555c38-3d65-4d14-95b1-623880a13104 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:32.359902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc555c38-3d65-4d14-95b1-623880a13104 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:32.573048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dc555c38-3d65-4d14-95b1-623880a13104 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:32.580805 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dc555c38-3d65-4d14-95b1-623880a13104 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1477 microversion: 2.1 time: 0.241841 Jan 22 21:00:32.581367 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 145/287] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:32 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1477 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:32.639775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0e39863c-8e73-40dd-9950-d6aa09812d2b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:32.641053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0e39863c-8e73-40dd-9950-d6aa09812d2b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:32.653704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e39863c-8e73-40dd-9950-d6aa09812d2b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:32.654482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e39863c-8e73-40dd-9950-d6aa09812d2b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:32.655503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e39863c-8e73-40dd-9950-d6aa09812d2b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:32.656102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e39863c-8e73-40dd-9950-d6aa09812d2b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:32.726464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a7ec0887-8f8d-45c4-a7ae-192be15fa513 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Calling method '.version_select at 0x7f1ed63c9ee0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:32.886577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0e39863c-8e73-40dd-9950-d6aa09812d2b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:32.893966 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0e39863c-8e73-40dd-9950-d6aa09812d2b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1318 microversion: 2.1 time: 0.258431 Jan 22 21:00:32.897565 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 143/288] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:32 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:33.319906 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a7ec0887-8f8d-45c4-a7ae-192be15fa513 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/5f54894c42004f3eaa3273cb6648f62b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.597949 Jan 22 21:00:33.320929 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 146/289] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 21:00:32 2022] GET /compute/v2.1/os-quota-sets/5f54894c42004f3eaa3273cb6648f62b/defaults => generated 371 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:33.600679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cc142b6a-ef4d-4acf-8a90-2452ad07df6a tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:33.601312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cc142b6a-ef4d-4acf-8a90-2452ad07df6a tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:33.615820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc142b6a-ef4d-4acf-8a90-2452ad07df6a tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:33.616330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc142b6a-ef4d-4acf-8a90-2452ad07df6a tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:33.617153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc142b6a-ef4d-4acf-8a90-2452ad07df6a tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:33.617695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc142b6a-ef4d-4acf-8a90-2452ad07df6a tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:33.811637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cc142b6a-ef4d-4acf-8a90-2452ad07df6a tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:33.825660 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cc142b6a-ef4d-4acf-8a90-2452ad07df6a tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1477 microversion: 2.1 time: 0.230447 Jan 22 21:00:33.835847 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 144/290] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:33 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1477 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:33.913955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9ce5287b-25f6-45ab-8744-c528431fc824 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:33.914924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9ce5287b-25f6-45ab-8744-c528431fc824 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:33.924130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9ce5287b-25f6-45ab-8744-c528431fc824 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:33.924750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9ce5287b-25f6-45ab-8744-c528431fc824 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:33.925871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9ce5287b-25f6-45ab-8744-c528431fc824 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:33.926468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9ce5287b-25f6-45ab-8744-c528431fc824 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:34.195962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9ce5287b-25f6-45ab-8744-c528431fc824 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:34.203873 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9ce5287b-25f6-45ab-8744-c528431fc824 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1318 microversion: 2.1 time: 0.296018 Jan 22 21:00:34.204819 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 147/291] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:33 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:34.694689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-2b9bfc3b-d7ff-479f-be25-7459fd353189 req-050ca9d7-3343-43f8-8c43-632d0da9621c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1370130f-3f03-44d2-ba98-49dc6604336b", "name": "network-vif-deleted", "tag": "5af353eb-2753-40d8-bdac-8441acd8c04d"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:34.700510 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:34.700510 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:34.707054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2b9bfc3b-d7ff-479f-be25-7459fd353189 req-050ca9d7-3343-43f8-8c43-632d0da9621c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:34.708076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2b9bfc3b-d7ff-479f-be25-7459fd353189 req-050ca9d7-3343-43f8-8c43-632d0da9621c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:34.730080 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-2b9bfc3b-d7ff-479f-be25-7459fd353189 req-050ca9d7-3343-43f8-8c43-632d0da9621c service nova] Creating event network-vif-deleted:5af353eb-2753-40d8-bdac-8441acd8c04d for instance 1370130f-3f03-44d2-ba98-49dc6604336b on nch1-master-1 Jan 22 21:00:34.741896 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-2b9bfc3b-d7ff-479f-be25-7459fd353189 req-050ca9d7-3343-43f8-8c43-632d0da9621c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056533 Jan 22 21:00:34.743371 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 145/292] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:34.844097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bee92053-1f71-49f6-a084-21c84b18da96 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:34.850404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bee92053-1f71-49f6-a084-21c84b18da96 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:34.860713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bee92053-1f71-49f6-a084-21c84b18da96 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:34.862100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bee92053-1f71-49f6-a084-21c84b18da96 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:34.863462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bee92053-1f71-49f6-a084-21c84b18da96 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:34.864093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bee92053-1f71-49f6-a084-21c84b18da96 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:34.894933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-31b86766-e0ac-4f2a-984e-9d7fe13a9f8e tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed656c790>, body: {"quota_set": {"ram": "5120"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:34.898397 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:34.898397 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:34.951170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bee92053-1f71-49f6-a084-21c84b18da96 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026360880da64c5792b16424b3e0b74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d0e6473d941fbbfdb0e9c7da837e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:34.962934 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bee92053-1f71-49f6-a084-21c84b18da96 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 200 len: 1306 microversion: 2.1 time: 0.121238 Jan 22 21:00:34.962934 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 148/293] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:34 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 1306 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:35.418076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31b86766-e0ac-4f2a-984e-9d7fe13a9f8e tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:35.418733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31b86766-e0ac-4f2a-984e-9d7fe13a9f8e tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:35.420087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31b86766-e0ac-4f2a-984e-9d7fe13a9f8e tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:35.420557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31b86766-e0ac-4f2a-984e-9d7fe13a9f8e tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:35.592774 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-31b86766-e0ac-4f2a-984e-9d7fe13a9f8e tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/41f1fd88f44841588b66a6faf4744a8e" status: 200 len: 328 microversion: 2.1 time: 0.703465 Jan 22 21:00:35.600417 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 146/294] 10.222.0.100 () {60 vars in 1266 bytes} [Sat Jan 22 21:00:34 2022] PUT /compute/v2.1/os-quota-sets/41f1fd88f44841588b66a6faf4744a8e => generated 328 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:35.609940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e44d10bb-8238-471a-b66f-3f821b3619f9 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:35.611154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e44d10bb-8238-471a-b66f-3f821b3619f9 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:35.619407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e44d10bb-8238-471a-b66f-3f821b3619f9 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:35.620116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e44d10bb-8238-471a-b66f-3f821b3619f9 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:35.621162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e44d10bb-8238-471a-b66f-3f821b3619f9 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:35.622367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e44d10bb-8238-471a-b66f-3f821b3619f9 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:35.714258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-86133f26-9182-4b29-a64f-a75dbf08a42c tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:35.715612 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:35.715612 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:35.717354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86133f26-9182-4b29-a64f-a75dbf08a42c tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:35.721717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86133f26-9182-4b29-a64f-a75dbf08a42c tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:35.723927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86133f26-9182-4b29-a64f-a75dbf08a42c tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:35.724454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86133f26-9182-4b29-a64f-a75dbf08a42c tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:35.757719 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-86133f26-9182-4b29-a64f-a75dbf08a42c tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.616634 Jan 22 21:00:35.758414 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 149/295] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:00:35 2022] GET /compute/v2.1/os-services => generated 947 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:00:35.762760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-020eb08d-bc21-42d0-989c-31728f21f327 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Calling method '.version_select at 0x7f1ed647ddc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:35.819097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e44d10bb-8238-471a-b66f-3f821b3619f9 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:35.828594 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e44d10bb-8238-471a-b66f-3f821b3619f9 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1318 microversion: 2.1 time: 0.226325 Jan 22 21:00:35.829670 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 147/296] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:35 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:35.834266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-36d7c6fc-27e4-4a20-aeac-9d84f1e47fda tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:35.835585 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:35.835585 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:35.837116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36d7c6fc-27e4-4a20-aeac-9d84f1e47fda tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:35.837594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36d7c6fc-27e4-4a20-aeac-9d84f1e47fda tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:35.849393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36d7c6fc-27e4-4a20-aeac-9d84f1e47fda tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:35.849393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36d7c6fc-27e4-4a20-aeac-9d84f1e47fda tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:35.871436 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-36d7c6fc-27e4-4a20-aeac-9d84f1e47fda tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.040655 Jan 22 21:00:35.872157 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 148/297] 10.222.0.100 () {58 vars in 1174 bytes} [Sat Jan 22 21:00:35 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:35.883692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5522f607-68af-4edc-a0b5-b70e170d8ff4 tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:35.885101 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:35.885101 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:35.886825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5522f607-68af-4edc-a0b5-b70e170d8ff4 tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:35.887445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5522f607-68af-4edc-a0b5-b70e170d8ff4 tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:35.888445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5522f607-68af-4edc-a0b5-b70e170d8ff4 tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:35.889104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5522f607-68af-4edc-a0b5-b70e170d8ff4 tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:35.920941 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5522f607-68af-4edc-a0b5-b70e170d8ff4 tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.040826 Jan 22 21:00:35.925660 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 149/298] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:00:35 2022] GET /compute/v2.1/os-services => generated 947 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:35.940445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bbd83c89-5686-4f76-a6cd-80921179a4bb tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:35.940445 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:35.940445 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:35.940445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbd83c89-5686-4f76-a6cd-80921179a4bb tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:35.940445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbd83c89-5686-4f76-a6cd-80921179a4bb tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:35.942173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbd83c89-5686-4f76-a6cd-80921179a4bb tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:35.942794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbd83c89-5686-4f76-a6cd-80921179a4bb tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:35.971242 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bbd83c89-5686-4f76-a6cd-80921179a4bb tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.038784 Jan 22 21:00:35.972428 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 150/299] 10.222.0.100 () {58 vars in 1200 bytes} [Sat Jan 22 21:00:35 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:00:35.978207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-31a7d2e3-cede-4041-804d-3d438d638494 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:35.979387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-31a7d2e3-cede-4041-804d-3d438d638494 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] [instance: 1370130f-3f03-44d2-ba98-49dc6604336b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:35.988785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31a7d2e3-cede-4041-804d-3d438d638494 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:35.990138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31a7d2e3-cede-4041-804d-3d438d638494 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:35.991466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31a7d2e3-cede-4041-804d-3d438d638494 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:35.992133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31a7d2e3-cede-4041-804d-3d438d638494 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:36.007315 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-31a7d2e3-cede-4041-804d-3d438d638494 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] HTTP exception thrown: Instance 1370130f-3f03-44d2-ba98-49dc6604336b could not be found. Jan 22 21:00:36.008098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-31a7d2e3-cede-4041-804d-3d438d638494 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] Returning 404 to user: Instance 1370130f-3f03-44d2-ba98-49dc6604336b could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:36.008994 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-31a7d2e3-cede-4041-804d-3d438d638494 tempest-AggregatesAdminTestJSON-1624622478 tempest-AggregatesAdminTestJSON-1624622478-project] 10.222.0.100 "GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b" status: 404 len: 111 microversion: 2.1 time: 0.035332 Jan 22 21:00:36.009642 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 151/300] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:35 2022] GET /compute/v2.1/servers/1370130f-3f03-44d2-ba98-49dc6604336b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:36.014306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a2c6256e-5cd8-4942-8aae-89ba9f152252 tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:36.015562 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:36.015562 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:36.017234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2c6256e-5cd8-4942-8aae-89ba9f152252 tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:36.017712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2c6256e-5cd8-4942-8aae-89ba9f152252 tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:36.018534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2c6256e-5cd8-4942-8aae-89ba9f152252 tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:36.018973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2c6256e-5cd8-4942-8aae-89ba9f152252 tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:36.043431 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a2c6256e-5cd8-4942-8aae-89ba9f152252 tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.032727 Jan 22 21:00:36.044173 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 152/301] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:00:36 2022] GET /compute/v2.1/os-services => generated 947 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:36.054844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9335ef4f-252d-4d50-bf0f-07bf4178d6fa tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:36.056150 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:36.056150 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:36.057724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9335ef4f-252d-4d50-bf0f-07bf4178d6fa tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:36.058176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9335ef4f-252d-4d50-bf0f-07bf4178d6fa tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:36.058990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9335ef4f-252d-4d50-bf0f-07bf4178d6fa tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:36.059472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9335ef4f-252d-4d50-bf0f-07bf4178d6fa tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:36.084895 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9335ef4f-252d-4d50-bf0f-07bf4178d6fa tempest-ServicesAdminNegativeTestJSON-1318462230 tempest-ServicesAdminNegativeTestJSON-1318462230-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.033746 Jan 22 21:00:36.085646 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 153/302] 10.222.0.100 () {58 vars in 1202 bytes} [Sat Jan 22 21:00:36 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:00:36.284545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-020eb08d-bc21-42d0-989c-31728f21f327 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:36.285090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-020eb08d-bc21-42d0-989c-31728f21f327 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:36.286073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-020eb08d-bc21-42d0-989c-31728f21f327 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:36.287166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-020eb08d-bc21-42d0-989c-31728f21f327 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:36.308008 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-020eb08d-bc21-42d0-989c-31728f21f327 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/41f1fd88f44841588b66a6faf4744a8e/detail" status: 200 len: 916 microversion: 2.1 time: 0.548426 Jan 22 21:00:36.308622 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 150/303] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:00:35 2022] GET /compute/v2.1/os-quota-sets/41f1fd88f44841588b66a6faf4744a8e/detail => generated 916 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:36.396977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9ada35af-d669-4ffa-9e8b-797210f955cd tempest-ServicesAdminNegativeTestJSON-403181730 tempest-ServicesAdminNegativeTestJSON-403181730-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:36.398317 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:36.398317 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:36.399648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9ada35af-d669-4ffa-9e8b-797210f955cd tempest-ServicesAdminNegativeTestJSON-403181730 tempest-ServicesAdminNegativeTestJSON-403181730-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '28514a5ef97c4d008ec1a909196af240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deeaee6aa16045ab9c45026a389de1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:36.400314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9ada35af-d669-4ffa-9e8b-797210f955cd tempest-ServicesAdminNegativeTestJSON-403181730 tempest-ServicesAdminNegativeTestJSON-403181730-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:00:36.401132 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9ada35af-d669-4ffa-9e8b-797210f955cd tempest-ServicesAdminNegativeTestJSON-403181730 tempest-ServicesAdminNegativeTestJSON-403181730-project] 10.222.0.100 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.306478 Jan 22 21:00:36.402141 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 154/304] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:00:36 2022] GET /compute/v2.1/os-services => generated 112 bytes in 308 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:00:36.845395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fc2e06d3-2f09-43cb-a21c-8368e4e5088e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:36.846078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fc2e06d3-2f09-43cb-a21c-8368e4e5088e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:36.852263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc2e06d3-2f09-43cb-a21c-8368e4e5088e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:36.852728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc2e06d3-2f09-43cb-a21c-8368e4e5088e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:36.853590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc2e06d3-2f09-43cb-a21c-8368e4e5088e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:36.853974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc2e06d3-2f09-43cb-a21c-8368e4e5088e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:37.101357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fc2e06d3-2f09-43cb-a21c-8368e4e5088e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:37.110054 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fc2e06d3-2f09-43cb-a21c-8368e4e5088e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1318 microversion: 2.1 time: 0.268209 Jan 22 21:00:37.111419 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 151/305] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:36 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:37.290917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-721a6579-2d58-4d8a-9715-5ccbff4a0ada tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed656ca60>, body: {"quota_set": {"ram": "2048"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:37.290917 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:37.290917 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:37.716502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-721a6579-2d58-4d8a-9715-5ccbff4a0ada tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:37.722005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-721a6579-2d58-4d8a-9715-5ccbff4a0ada tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:37.723055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-721a6579-2d58-4d8a-9715-5ccbff4a0ada tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:37.724315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-721a6579-2d58-4d8a-9715-5ccbff4a0ada tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:37.782419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-721a6579-2d58-4d8a-9715-5ccbff4a0ada tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:37.782882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-721a6579-2d58-4d8a-9715-5ccbff4a0ada tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:37.787700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-721a6579-2d58-4d8a-9715-5ccbff4a0ada tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:37.788952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-721a6579-2d58-4d8a-9715-5ccbff4a0ada tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:37.972825 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-721a6579-2d58-4d8a-9715-5ccbff4a0ada tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/41f1fd88f44841588b66a6faf4744a8e?user_id=b0c01e7806ce48e8a6a6ced0b248b45c" status: 200 len: 328 microversion: 2.1 time: 0.689052 Jan 22 21:00:37.974540 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 155/306] 10.222.0.100 () {60 vars in 1347 bytes} [Sat Jan 22 21:00:37 2022] PUT /compute/v2.1/os-quota-sets/41f1fd88f44841588b66a6faf4744a8e?user_id=b0c01e7806ce48e8a6a6ced0b248b45c => generated 328 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:37.986459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-26a468d0-7e45-4c0c-ab75-bae9972890bf tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Calling method '.version_select at 0x7f1ed647d700>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:38.128839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-963477da-b883-4f6f-bd5a-df8bfb2babb3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:38.129270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-963477da-b883-4f6f-bd5a-df8bfb2babb3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:38.137496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-963477da-b883-4f6f-bd5a-df8bfb2babb3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:38.138862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-963477da-b883-4f6f-bd5a-df8bfb2babb3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:38.139890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-963477da-b883-4f6f-bd5a-df8bfb2babb3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:38.140805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-963477da-b883-4f6f-bd5a-df8bfb2babb3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:38.447635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-963477da-b883-4f6f-bd5a-df8bfb2babb3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:38.456006 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-963477da-b883-4f6f-bd5a-df8bfb2babb3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1318 microversion: 2.1 time: 0.332066 Jan 22 21:00:38.456806 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 156/307] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:38 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:39.010445 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-26a468d0-7e45-4c0c-ab75-bae9972890bf tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/41f1fd88f44841588b66a6faf4744a8e?user_id=b0c01e7806ce48e8a6a6ced0b248b45c" status: 200 len: 370 microversion: 2.1 time: 1.027511 Jan 22 21:00:39.011585 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 152/308] 10.222.0.100 () {58 vars in 1327 bytes} [Sat Jan 22 21:00:37 2022] GET /compute/v2.1/os-quota-sets/41f1fd88f44841588b66a6faf4744a8e?user_id=b0c01e7806ce48e8a6a6ced0b248b45c => generated 370 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:39.475306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-42ac9015-69bc-4f80-9048-52dc109766c6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:39.476122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-42ac9015-69bc-4f80-9048-52dc109766c6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:39.486883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42ac9015-69bc-4f80-9048-52dc109766c6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:39.487965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42ac9015-69bc-4f80-9048-52dc109766c6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:39.494359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42ac9015-69bc-4f80-9048-52dc109766c6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:39.494359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42ac9015-69bc-4f80-9048-52dc109766c6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:39.693965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-42ac9015-69bc-4f80-9048-52dc109766c6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:39.701849 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-42ac9015-69bc-4f80-9048-52dc109766c6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1318 microversion: 2.1 time: 0.231770 Jan 22 21:00:39.702492 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 157/309] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:39 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:40.455696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-066c54e9-06f7-439a-a897-0a8aa83b84dc tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Calling method '.version_select at 0x7f1ed63c6790>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:40.720527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d25d190-3d32-494f-900e-b8e4ddefc83e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:40.721206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d25d190-3d32-494f-900e-b8e4ddefc83e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:40.730748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d25d190-3d32-494f-900e-b8e4ddefc83e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:40.731722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d25d190-3d32-494f-900e-b8e4ddefc83e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:40.732940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d25d190-3d32-494f-900e-b8e4ddefc83e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:40.733457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d25d190-3d32-494f-900e-b8e4ddefc83e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:40.914862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5d25d190-3d32-494f-900e-b8e4ddefc83e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:40.940427 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d25d190-3d32-494f-900e-b8e4ddefc83e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1318 microversion: 2.1 time: 0.213768 Jan 22 21:00:40.940427 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 158/310] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:40 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:40.940427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-c331b6aa-0cf0-4cde-88c4-ec9d895c5a0a req-877651e1-cb39-4099-99c1-5d29cf64139f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a0a09a-4064-4c04-871b-3b1dc966dbc2", "tag": "efd0b522-24e7-4d12-9315-9c9a798f9c3b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:40.940427 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:40.940427 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:40.945489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c331b6aa-0cf0-4cde-88c4-ec9d895c5a0a req-877651e1-cb39-4099-99c1-5d29cf64139f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:40.945982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c331b6aa-0cf0-4cde-88c4-ec9d895c5a0a req-877651e1-cb39-4099-99c1-5d29cf64139f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:40.957619 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-c331b6aa-0cf0-4cde-88c4-ec9d895c5a0a req-877651e1-cb39-4099-99c1-5d29cf64139f service nova] Creating event network-changed:efd0b522-24e7-4d12-9315-9c9a798f9c3b for instance 57a0a09a-4064-4c04-871b-3b1dc966dbc2 on nch2-master-1 Jan 22 21:00:40.963693 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-c331b6aa-0cf0-4cde-88c4-ec9d895c5a0a req-877651e1-cb39-4099-99c1-5d29cf64139f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031678 Jan 22 21:00:40.964615 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 159/311] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:41.310743 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-066c54e9-06f7-439a-a897-0a8aa83b84dc tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/5f54894c42004f3eaa3273cb6648f62b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.858257 Jan 22 21:00:41.311760 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 153/312] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 21:00:40 2022] GET /compute/v2.1/os-quota-sets/5f54894c42004f3eaa3273cb6648f62b/defaults => generated 371 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:41.327576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6267db47-630a-4821-861a-5ad6df1534c6 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed6452e50>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:41.332393 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:41.332393 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:41.920324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6267db47-630a-4821-861a-5ad6df1534c6 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:41.922217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6267db47-630a-4821-861a-5ad6df1534c6 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:41.924681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6267db47-630a-4821-861a-5ad6df1534c6 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:41.925691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6267db47-630a-4821-861a-5ad6df1534c6 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:41.950112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a88c2316-9def-4bc4-8437-9107213270e4 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:41.950851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a88c2316-9def-4bc4-8437-9107213270e4 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:41.970896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a88c2316-9def-4bc4-8437-9107213270e4 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:41.971256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a88c2316-9def-4bc4-8437-9107213270e4 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:41.972508 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a88c2316-9def-4bc4-8437-9107213270e4 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:41.973211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a88c2316-9def-4bc4-8437-9107213270e4 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:42.213940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a88c2316-9def-4bc4-8437-9107213270e4 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:42.224299 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a88c2316-9def-4bc4-8437-9107213270e4 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1318 microversion: 2.1 time: 0.279313 Jan 22 21:00:42.237735 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 154/313] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:41 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:43.331623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-235418493", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "3da6de85-e0d4-4a7c-ad9b-73d085f0c931"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:43.337685 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6267db47-630a-4821-861a-5ad6df1534c6 tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/5f54894c42004f3eaa3273cb6648f62b" status: 200 len: 329 microversion: 2.1 time: 2.018461 Jan 22 21:00:43.338805 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 160/314] 10.222.0.100 () {60 vars in 1267 bytes} [Sat Jan 22 21:00:41 2022] PUT /compute/v2.1/os-quota-sets/5f54894c42004f3eaa3273cb6648f62b => generated 329 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:00:43.343725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4af06444-6361-4816-b05c-9810612d2f7f tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:43.344824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4af06444-6361-4816-b05c-9810612d2f7f tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:43.353260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4af06444-6361-4816-b05c-9810612d2f7f tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:43.353948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4af06444-6361-4816-b05c-9810612d2f7f tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:43.354898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4af06444-6361-4816-b05c-9810612d2f7f tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:43.355645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4af06444-6361-4816-b05c-9810612d2f7f tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:43.394141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] validate_networks() for [('3da6de85-e0d4-4a7c-ad9b-73d085f0c931', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:00:43.747348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4af06444-6361-4816-b05c-9810612d2f7f tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:43.759759 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4af06444-6361-4816-b05c-9810612d2f7f tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1318 microversion: 2.1 time: 0.419641 Jan 22 21:00:43.761637 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 161/315] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:43 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:43.770740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7e99163d-4a71-4657-a446-9bb3bccdbbfe tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed63c8700>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:43.773012 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:43.773012 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:44.029366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e99163d-4a71-4657-a446-9bb3bccdbbfe tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:44.029857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e99163d-4a71-4657-a446-9bb3bccdbbfe tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:44.030676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e99163d-4a71-4657-a446-9bb3bccdbbfe tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:44.035289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e99163d-4a71-4657-a446-9bb3bccdbbfe tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:44.091800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:00:44.092239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:00:44.092726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:00:44.093224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:00:44.093678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:00:44.109246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:44.109246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:44.109957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:44.110493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:44.133957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Getting quotas for project b277338cf6c4478e8e35cf79b34caaf6. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:00:44.139867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Getting quotas for user b07a1bb09ad44501925664aa61ac3e6d and project b277338cf6c4478e8e35cf79b34caaf6. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:00:44.153411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:00:44.156792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:00:44.287192 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e870a8b9-7eae-4a5d-8f38-fa860c86ea0d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.091227 Jan 22 21:00:44.289886 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 155/316] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:00:43 2022] POST /compute/v2.1/servers => generated 382 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:00:44.357921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-504238260", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:44.422161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:00:44.743202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:00:44.743732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:00:44.744293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:00:44.744818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:00:44.745284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:00:44.754292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:44.755388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:44.756376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:44.756810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:44.773340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Getting quotas for project cfbdb8e94e9c48f49f240f4eecde539a. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:00:44.777422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Getting quotas for user 4f8e24e6af4842f6b280ceaba346cd08 and project cfbdb8e94e9c48f49f240f4eecde539a. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:00:44.789398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:00:44.791632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:00:44.993661 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-26e065c5-1d41-4f0b-9fc9-f33f27008235 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.701363 Jan 22 21:00:44.994216 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 156/317] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:00:44 2022] POST /compute/v2.1/servers => generated 382 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:00:44.998802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e4ba6ec7-2de2-473c-a70a-50fcba0a9f09 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:44.999885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e4ba6ec7-2de2-473c-a70a-50fcba0a9f09 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:45.095193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e4ba6ec7-2de2-473c-a70a-50fcba0a9f09 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:45.103475 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e4ba6ec7-2de2-473c-a70a-50fcba0a9f09 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1214 microversion: 2.1 time: 0.108080 Jan 22 21:00:45.104543 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 157/318] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:44 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:45.169558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-97579989", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "129e825a-cd9c-4303-b118-ba3cd4ee673c"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:45.230203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] validate_networks() for [('129e825a-cd9c-4303-b118-ba3cd4ee673c', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:00:45.767861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:00:45.774108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:00:45.774108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:00:45.775008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:00:45.775630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:00:45.788292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:45.789186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:45.790395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:45.791208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:45.811913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Getting quotas for project 4aa958f703204cbca5fd08472e45909f. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:00:45.816512 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Getting quotas for user c8fa58b4de634969ba8dcaf054e0b8b8 and project 4aa958f703204cbca5fd08472e45909f. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:00:45.830099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:00:45.832399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:00:46.021413 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5c92b997-835f-42a7-90b1-e6cc06c42200 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.25 time: 0.915596 Jan 22 21:00:46.022121 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 158/319] 10.222.0.100 () {62 vars in 1192 bytes} [Sat Jan 22 21:00:45 2022] POST /compute/v2.1/servers => generated 382 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 22 21:00:46.035591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fa6df42e-9452-4a62-92ac-343c61b37f50 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:46.042139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fa6df42e-9452-4a62-92ac-343c61b37f50 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:46.051092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa6df42e-9452-4a62-92ac-343c61b37f50 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:46.052113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa6df42e-9452-4a62-92ac-343c61b37f50 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:46.082212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa6df42e-9452-4a62-92ac-343c61b37f50 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:46.082212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa6df42e-9452-4a62-92ac-343c61b37f50 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:46.456252 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7e99163d-4a71-4657-a446-9bb3bccdbbfe tempest-QuotasAdminTestJSON-1542716951 tempest-QuotasAdminTestJSON-1542716951-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/5f54894c42004f3eaa3273cb6648f62b" status: 200 len: 329 microversion: 2.1 time: 2.691200 Jan 22 21:00:46.458759 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 162/320] 10.222.0.100 () {60 vars in 1267 bytes} [Sat Jan 22 21:00:43 2022] PUT /compute/v2.1/os-quota-sets/5f54894c42004f3eaa3273cb6648f62b => generated 329 bytes in 2696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:46.479234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a865fc42-e014-448a-9cbc-6f59fccaf071 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:46.482503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a865fc42-e014-448a-9cbc-6f59fccaf071 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:46.604987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fa6df42e-9452-4a62-92ac-343c61b37f50 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:46.617332 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fa6df42e-9452-4a62-92ac-343c61b37f50 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1318 microversion: 2.1 time: 0.594143 Jan 22 21:00:46.617948 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 159/321] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:46 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1318 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:46.632527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cb57a7d8-5fca-465d-9853-4932f8742c2a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:46.637108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cb57a7d8-5fca-465d-9853-4932f8742c2a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:46.732520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cb57a7d8-5fca-465d-9853-4932f8742c2a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:46.743465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cb57a7d8-5fca-465d-9853-4932f8742c2a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:46.746010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cb57a7d8-5fca-465d-9853-4932f8742c2a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:46.747334 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cb57a7d8-5fca-465d-9853-4932f8742c2a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1264 microversion: 2.25 time: 0.128475 Jan 22 21:00:46.748044 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 160/322] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:00:46 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1264 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:00:46.767439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a865fc42-e014-448a-9cbc-6f59fccaf071 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:46.767669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2de69fb4-b046-4fec-b4a6-56fb62a2aa96 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:46.768468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2de69fb4-b046-4fec-b4a6-56fb62a2aa96 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:46.776704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2de69fb4-b046-4fec-b4a6-56fb62a2aa96 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:46.777376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2de69fb4-b046-4fec-b4a6-56fb62a2aa96 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:46.777824 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a865fc42-e014-448a-9cbc-6f59fccaf071 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1223 microversion: 2.1 time: 0.317641 Jan 22 21:00:46.781121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2de69fb4-b046-4fec-b4a6-56fb62a2aa96 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:46.781394 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 163/323] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:46 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1223 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:46.781482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2de69fb4-b046-4fec-b4a6-56fb62a2aa96 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:46.890221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2de69fb4-b046-4fec-b4a6-56fb62a2aa96 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:46.904708 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2de69fb4-b046-4fec-b4a6-56fb62a2aa96 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1266 microversion: 2.1 time: 0.155475 Jan 22 21:00:46.905396 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 161/324] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:46 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:47.453348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cafee9fd-f8c0-46cd-88ca-a83a694b44e2 tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed63828b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:47.455746 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:47.455746 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:47.620512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cafee9fd-f8c0-46cd-88ca-a83a694b44e2 tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:47.621151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cafee9fd-f8c0-46cd-88ca-a83a694b44e2 tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:47.621841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cafee9fd-f8c0-46cd-88ca-a83a694b44e2 tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:47.622290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cafee9fd-f8c0-46cd-88ca-a83a694b44e2 tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:47.634929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48a31858-133d-4f92-8e5c-76d98c3adcd6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:47.635544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48a31858-133d-4f92-8e5c-76d98c3adcd6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:47.642743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48a31858-133d-4f92-8e5c-76d98c3adcd6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:47.651672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48a31858-133d-4f92-8e5c-76d98c3adcd6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:47.655644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48a31858-133d-4f92-8e5c-76d98c3adcd6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:47.656183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48a31858-133d-4f92-8e5c-76d98c3adcd6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:47.920272 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cafee9fd-f8c0-46cd-88ca-a83a694b44e2 tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/435d95d8cda84df0b56c7c6fa18fbea6" status: 200 len: 148 microversion: 2.57 time: 0.691159 Jan 22 21:00:47.921397 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 164/325] 10.222.0.100 () {62 vars in 1307 bytes} [Sat Jan 22 21:00:47 2022] PUT /compute/v2.1/os-quota-sets/435d95d8cda84df0b56c7c6fa18fbea6 => generated 148 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:00:47.935408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-39549835-2021-43d9-a78a-d1405093a583 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:47.942073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-39549835-2021-43d9-a78a-d1405093a583 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:47.952029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39549835-2021-43d9-a78a-d1405093a583 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:47.952604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39549835-2021-43d9-a78a-d1405093a583 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:47.956244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39549835-2021-43d9-a78a-d1405093a583 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:47.956776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39549835-2021-43d9-a78a-d1405093a583 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:48.214761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-39549835-2021-43d9-a78a-d1405093a583 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:48.226677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-39549835-2021-43d9-a78a-d1405093a583 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:48.231363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-39549835-2021-43d9-a78a-d1405093a583 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:48.232616 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-39549835-2021-43d9-a78a-d1405093a583 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1268 microversion: 2.25 time: 0.308768 Jan 22 21:00:48.247019 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 165/326] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:00:47 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1268 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:00:48.252423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4e52f527-9edd-422e-9291-70ee7151cc57 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:48.255862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4e52f527-9edd-422e-9291-70ee7151cc57 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:48.268361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e52f527-9edd-422e-9291-70ee7151cc57 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:48.272900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e52f527-9edd-422e-9291-70ee7151cc57 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:48.273853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e52f527-9edd-422e-9291-70ee7151cc57 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:48.276262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e52f527-9edd-422e-9291-70ee7151cc57 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:48.437731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-48a31858-133d-4f92-8e5c-76d98c3adcd6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:48.446997 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48a31858-133d-4f92-8e5c-76d98c3adcd6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1318 microversion: 2.1 time: 0.815558 Jan 22 21:00:48.447585 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 162/327] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:47 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1318 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:48.463504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0a227cff-b330-4c8f-9f37-3b8001b8b725 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:48.464890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0a227cff-b330-4c8f-9f37-3b8001b8b725 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:48.477399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a227cff-b330-4c8f-9f37-3b8001b8b725 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:48.481921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a227cff-b330-4c8f-9f37-3b8001b8b725 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:48.483653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a227cff-b330-4c8f-9f37-3b8001b8b725 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:48.490615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a227cff-b330-4c8f-9f37-3b8001b8b725 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:48.520755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4e52f527-9edd-422e-9291-70ee7151cc57 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:48.536637 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4e52f527-9edd-422e-9291-70ee7151cc57 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1275 microversion: 2.1 time: 0.287699 Jan 22 21:00:48.537314 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 166/328] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:48 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1275 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:48.547485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2b522e0f-34b9-497a-9143-a148adaa9d9e tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Calling method '.version_select at 0x7f1ed63c80d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:48.624724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b522e0f-34b9-497a-9143-a148adaa9d9e tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:48.626337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b522e0f-34b9-497a-9143-a148adaa9d9e tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:48.627388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b522e0f-34b9-497a-9143-a148adaa9d9e tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:48.628027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b522e0f-34b9-497a-9143-a148adaa9d9e tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:48.653023 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2b522e0f-34b9-497a-9143-a148adaa9d9e tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/435d95d8cda84df0b56c7c6fa18fbea6/detail" status: 200 len: 463 microversion: 2.57 time: 0.114121 Jan 22 21:00:48.654348 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 167/329] 10.222.0.100 () {60 vars in 1308 bytes} [Sat Jan 22 21:00:48 2022] GET /compute/v2.1/os-quota-sets/435d95d8cda84df0b56c7c6fa18fbea6/detail => generated 463 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:00:48.662063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0a227cff-b330-4c8f-9f37-3b8001b8b725 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:48.686331 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0a227cff-b330-4c8f-9f37-3b8001b8b725 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1272 microversion: 2.1 time: 0.224881 Jan 22 21:00:48.686331 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 163/330] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:48 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:49.022781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d7b9603a-68fd-4db2-9eea-a3bf41c857ab tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed63c8d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:49.026958 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:49.026958 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:49.135427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7b9603a-68fd-4db2-9eea-a3bf41c857ab tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:49.136137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7b9603a-68fd-4db2-9eea-a3bf41c857ab tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:49.137250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7b9603a-68fd-4db2-9eea-a3bf41c857ab tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:49.137960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7b9603a-68fd-4db2-9eea-a3bf41c857ab tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:49.184841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7b9603a-68fd-4db2-9eea-a3bf41c857ab tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:49.185793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7b9603a-68fd-4db2-9eea-a3bf41c857ab tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:49.186968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7b9603a-68fd-4db2-9eea-a3bf41c857ab tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:49.187649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7b9603a-68fd-4db2-9eea-a3bf41c857ab tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:49.252091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ecd1e0f6-2cb6-42ba-b49a-862461f3fe82 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:49.253137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ecd1e0f6-2cb6-42ba-b49a-862461f3fe82 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:49.265490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecd1e0f6-2cb6-42ba-b49a-862461f3fe82 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:49.265977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecd1e0f6-2cb6-42ba-b49a-862461f3fe82 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:49.266794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecd1e0f6-2cb6-42ba-b49a-862461f3fe82 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:49.267237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecd1e0f6-2cb6-42ba-b49a-862461f3fe82 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:49.337443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ecd1e0f6-2cb6-42ba-b49a-862461f3fe82 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:49.354312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ecd1e0f6-2cb6-42ba-b49a-862461f3fe82 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:49.358770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ecd1e0f6-2cb6-42ba-b49a-862461f3fe82 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:49.367134 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ecd1e0f6-2cb6-42ba-b49a-862461f3fe82 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1316 microversion: 2.25 time: 0.118008 Jan 22 21:00:49.369529 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d7b9603a-68fd-4db2-9eea-a3bf41c857ab tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/435d95d8cda84df0b56c7c6fa18fbea6?user_id=dcf1e80d4a6e4e5cb3740338437ff769" status: 200 len: 148 microversion: 2.57 time: 0.357758 Jan 22 21:00:49.375662 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 168/331] 10.222.0.100 () {62 vars in 1388 bytes} [Sat Jan 22 21:00:49 2022] PUT /compute/v2.1/os-quota-sets/435d95d8cda84df0b56c7c6fa18fbea6?user_id=dcf1e80d4a6e4e5cb3740338437ff769 => generated 148 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:00:49.377645 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 164/332] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:00:49 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1316 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:00:49.389443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-65ee3f5c-7930-43e7-b766-3cbea27c994d tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] Calling method '.version_select at 0x7f1ed63eba60>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:49.466442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6aabad86-cad4-4a46-86a3-174c49a064c3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:49.467384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6aabad86-cad4-4a46-86a3-174c49a064c3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:49.478551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aabad86-cad4-4a46-86a3-174c49a064c3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:49.479973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aabad86-cad4-4a46-86a3-174c49a064c3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:49.487958 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-65ee3f5c-7930-43e7-b766-3cbea27c994d tempest-QuotasAdminTestV257-878192998 tempest-QuotasAdminTestV257-878192998-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/435d95d8cda84df0b56c7c6fa18fbea6?user_id=dcf1e80d4a6e4e5cb3740338437ff769" status: 200 len: 190 microversion: 2.57 time: 0.107817 Jan 22 21:00:49.488095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aabad86-cad4-4a46-86a3-174c49a064c3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:49.488429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aabad86-cad4-4a46-86a3-174c49a064c3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:49.495423 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 169/333] 10.222.0.100 () {60 vars in 1368 bytes} [Sat Jan 22 21:00:49 2022] GET /compute/v2.1/os-quota-sets/435d95d8cda84df0b56c7c6fa18fbea6?user_id=dcf1e80d4a6e4e5cb3740338437ff769 => generated 190 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:00:49.555319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-174bb4f6-c67c-4659-8801-a629f8014f44 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:49.556158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-174bb4f6-c67c-4659-8801-a629f8014f44 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:49.569911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-174bb4f6-c67c-4659-8801-a629f8014f44 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:49.574546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-174bb4f6-c67c-4659-8801-a629f8014f44 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:49.575301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-174bb4f6-c67c-4659-8801-a629f8014f44 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:49.575937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-174bb4f6-c67c-4659-8801-a629f8014f44 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:49.698354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-174bb4f6-c67c-4659-8801-a629f8014f44 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:49.708021 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-174bb4f6-c67c-4659-8801-a629f8014f44 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1281 microversion: 2.1 time: 0.156299 Jan 22 21:00:49.717460 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 170/334] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:49 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1281 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:49.722889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9ee19020-5379-4827-a9b7-e9efb874ea51 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:49.726507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9ee19020-5379-4827-a9b7-e9efb874ea51 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:49.749319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ee19020-5379-4827-a9b7-e9efb874ea51 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:49.750221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ee19020-5379-4827-a9b7-e9efb874ea51 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:49.751470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ee19020-5379-4827-a9b7-e9efb874ea51 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:49.755171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ee19020-5379-4827-a9b7-e9efb874ea51 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:50.520410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6aabad86-cad4-4a46-86a3-174c49a064c3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:50.531664 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6aabad86-cad4-4a46-86a3-174c49a064c3 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1318 microversion: 2.1 time: 1.070884 Jan 22 21:00:50.543296 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 165/335] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:49 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1318 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:50.560109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-3dd27a66-0896-4a7a-ac75-7deea2277c67 req-ca5fade3-b89b-4c5c-8236-b23b8c6f8de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a0a09a-4064-4c04-871b-3b1dc966dbc2", "name": "network-vif-plugged", "status": "completed", "tag": "efd0b522-24e7-4d12-9315-9c9a798f9c3b"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:50.562920 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:50.562920 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:50.577760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3dd27a66-0896-4a7a-ac75-7deea2277c67 req-ca5fade3-b89b-4c5c-8236-b23b8c6f8de1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:50.579633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3dd27a66-0896-4a7a-ac75-7deea2277c67 req-ca5fade3-b89b-4c5c-8236-b23b8c6f8de1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:50.594939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9ee19020-5379-4827-a9b7-e9efb874ea51 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:50.603305 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-3dd27a66-0896-4a7a-ac75-7deea2277c67 req-ca5fade3-b89b-4c5c-8236-b23b8c6f8de1 service nova] Creating event network-vif-plugged:efd0b522-24e7-4d12-9315-9c9a798f9c3b for instance 57a0a09a-4064-4c04-871b-3b1dc966dbc2 on nch2-master-1 Jan 22 21:00:50.608931 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9ee19020-5379-4827-a9b7-e9efb874ea51 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1314 microversion: 2.1 time: 0.888271 Jan 22 21:00:50.610528 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 171/336] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:49 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1314 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:50.622783 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-3dd27a66-0896-4a7a-ac75-7deea2277c67 req-ca5fade3-b89b-4c5c-8236-b23b8c6f8de1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077799 Jan 22 21:00:50.623895 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 166/337] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:50.627247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9b2db306-d73e-41a5-8d84-819e9b6faef3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:50.628028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9b2db306-d73e-41a5-8d84-819e9b6faef3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:50.650259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b2db306-d73e-41a5-8d84-819e9b6faef3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:50.651628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b2db306-d73e-41a5-8d84-819e9b6faef3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:50.656199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b2db306-d73e-41a5-8d84-819e9b6faef3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:50.657344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b2db306-d73e-41a5-8d84-819e9b6faef3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:50.742644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b2f6b9c7-bae9-442b-bf6d-0e31eefb2df8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:50.743593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b2f6b9c7-bae9-442b-bf6d-0e31eefb2df8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:50.750397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2f6b9c7-bae9-442b-bf6d-0e31eefb2df8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:50.755666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2f6b9c7-bae9-442b-bf6d-0e31eefb2df8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:50.755666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2f6b9c7-bae9-442b-bf6d-0e31eefb2df8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:50.755666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2f6b9c7-bae9-442b-bf6d-0e31eefb2df8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:50.819275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9b2db306-d73e-41a5-8d84-819e9b6faef3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:50.861953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9b2db306-d73e-41a5-8d84-819e9b6faef3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:50.863713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9b2db306-d73e-41a5-8d84-819e9b6faef3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:50.866469 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9b2db306-d73e-41a5-8d84-819e9b6faef3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1322 microversion: 2.25 time: 0.253445 Jan 22 21:00:50.870878 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 172/338] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:00:50 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:00:50.923556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b2f6b9c7-bae9-442b-bf6d-0e31eefb2df8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:50.954283 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b2f6b9c7-bae9-442b-bf6d-0e31eefb2df8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1281 microversion: 2.1 time: 0.219885 Jan 22 21:00:50.956360 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 167/339] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:50 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1281 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:51.552563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6bc244a3-7e0f-42ba-897e-e730a171a271 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:51.553367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6bc244a3-7e0f-42ba-897e-e730a171a271 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:51.570683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bc244a3-7e0f-42ba-897e-e730a171a271 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:51.572241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bc244a3-7e0f-42ba-897e-e730a171a271 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:51.574585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bc244a3-7e0f-42ba-897e-e730a171a271 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:51.576680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bc244a3-7e0f-42ba-897e-e730a171a271 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:51.634267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d7d1500a-ab64-4fb4-8961-6f0621cffcbf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:51.635064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d7d1500a-ab64-4fb4-8961-6f0621cffcbf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:51.652629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7d1500a-ab64-4fb4-8961-6f0621cffcbf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:51.663378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7d1500a-ab64-4fb4-8961-6f0621cffcbf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:51.668497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7d1500a-ab64-4fb4-8961-6f0621cffcbf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:51.669445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7d1500a-ab64-4fb4-8961-6f0621cffcbf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:52.267744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6bc244a3-7e0f-42ba-897e-e730a171a271 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:52.277935 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6bc244a3-7e0f-42ba-897e-e730a171a271 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1318 microversion: 2.1 time: 0.730227 Jan 22 21:00:52.278508 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 173/340] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:51 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1318 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:52.288532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-48a377ff-ef37-4a2b-a28a-3620cbc427de tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:52.291139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-48a377ff-ef37-4a2b-a28a-3620cbc427de tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:52.305154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d7d1500a-ab64-4fb4-8961-6f0621cffcbf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:52.311242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48a377ff-ef37-4a2b-a28a-3620cbc427de tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:52.311642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48a377ff-ef37-4a2b-a28a-3620cbc427de tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:52.312444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48a377ff-ef37-4a2b-a28a-3620cbc427de tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:52.313019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48a377ff-ef37-4a2b-a28a-3620cbc427de tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:52.315556 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d7d1500a-ab64-4fb4-8961-6f0621cffcbf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1314 microversion: 2.1 time: 0.691594 Jan 22 21:00:52.326969 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 168/341] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:51 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:52.374653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1fc00626-34d4-40a4-b94a-a7bfbc1331fe tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:52.376033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1fc00626-34d4-40a4-b94a-a7bfbc1331fe tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:52.392187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fc00626-34d4-40a4-b94a-a7bfbc1331fe tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:52.393712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fc00626-34d4-40a4-b94a-a7bfbc1331fe tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:52.395850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fc00626-34d4-40a4-b94a-a7bfbc1331fe tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:52.396975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fc00626-34d4-40a4-b94a-a7bfbc1331fe tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:52.490299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-48a377ff-ef37-4a2b-a28a-3620cbc427de tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:52.503663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-48a377ff-ef37-4a2b-a28a-3620cbc427de tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:52.505750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-48a377ff-ef37-4a2b-a28a-3620cbc427de tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:52.506868 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-48a377ff-ef37-4a2b-a28a-3620cbc427de tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1322 microversion: 2.25 time: 0.227266 Jan 22 21:00:52.507423 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 174/342] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:00:52 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:00:52.939991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1fc00626-34d4-40a4-b94a-a7bfbc1331fe tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:52.967423 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1fc00626-34d4-40a4-b94a-a7bfbc1331fe tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1323 microversion: 2.1 time: 0.625788 Jan 22 21:00:52.968020 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 169/343] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:52 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1323 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:53.127236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-132e49d2-c044-4f3d-bf4e-f3ac8df16810 req-173a3326-deb3-4413-8e05-5735df23d9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "077c7fdf-b28f-48a5-9c20-4b5b45babfed", "tag": "4892bd95-44cd-4f32-8d2d-11536ea7b4ee"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:53.129735 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:53.129735 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:53.147407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-132e49d2-c044-4f3d-bf4e-f3ac8df16810 req-173a3326-deb3-4413-8e05-5735df23d9b4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:53.147860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-132e49d2-c044-4f3d-bf4e-f3ac8df16810 req-173a3326-deb3-4413-8e05-5735df23d9b4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:53.183805 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-132e49d2-c044-4f3d-bf4e-f3ac8df16810 req-173a3326-deb3-4413-8e05-5735df23d9b4 service nova] Creating event network-changed:4892bd95-44cd-4f32-8d2d-11536ea7b4ee for instance 077c7fdf-b28f-48a5-9c20-4b5b45babfed on nch1-master-1 Jan 22 21:00:53.196241 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-132e49d2-c044-4f3d-bf4e-f3ac8df16810 req-173a3326-deb3-4413-8e05-5735df23d9b4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072486 Jan 22 21:00:53.197245 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 175/344] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:53.307611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c62dd1ce-f4f8-4a04-a384-abfefa84d25e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:53.308230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c62dd1ce-f4f8-4a04-a384-abfefa84d25e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:53.322228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c62dd1ce-f4f8-4a04-a384-abfefa84d25e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:53.322694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c62dd1ce-f4f8-4a04-a384-abfefa84d25e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:53.323514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c62dd1ce-f4f8-4a04-a384-abfefa84d25e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:53.323961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c62dd1ce-f4f8-4a04-a384-abfefa84d25e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:53.337095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-879a7fcd-6534-474d-a9e7-81043ecb3964 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:53.337826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-879a7fcd-6534-474d-a9e7-81043ecb3964 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:53.345626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-879a7fcd-6534-474d-a9e7-81043ecb3964 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:53.347277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-879a7fcd-6534-474d-a9e7-81043ecb3964 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:53.366286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-879a7fcd-6534-474d-a9e7-81043ecb3964 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:53.367193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-879a7fcd-6534-474d-a9e7-81043ecb3964 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:53.974103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-879a7fcd-6534-474d-a9e7-81043ecb3964 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:53.992359 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-879a7fcd-6534-474d-a9e7-81043ecb3964 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1314 microversion: 2.1 time: 0.659794 Jan 22 21:00:53.994607 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 176/345] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:53 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:54.006882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-997aa0f5-5745-473a-8d38-b0a11b16d8b1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:54.007919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-997aa0f5-5745-473a-8d38-b0a11b16d8b1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:54.022744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-997aa0f5-5745-473a-8d38-b0a11b16d8b1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:54.023533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-997aa0f5-5745-473a-8d38-b0a11b16d8b1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:54.025257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-997aa0f5-5745-473a-8d38-b0a11b16d8b1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:54.025762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-997aa0f5-5745-473a-8d38-b0a11b16d8b1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:54.110193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c62dd1ce-f4f8-4a04-a384-abfefa84d25e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:54.140873 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c62dd1ce-f4f8-4a04-a384-abfefa84d25e tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1318 microversion: 2.1 time: 0.835246 Jan 22 21:00:54.146145 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 170/346] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:53 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1318 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:54.150863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e6da237d-a06c-4f25-8daa-cf2d6e7af6a8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:54.151774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e6da237d-a06c-4f25-8daa-cf2d6e7af6a8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:54.169399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6da237d-a06c-4f25-8daa-cf2d6e7af6a8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:54.169882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6da237d-a06c-4f25-8daa-cf2d6e7af6a8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:54.170681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6da237d-a06c-4f25-8daa-cf2d6e7af6a8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:54.177482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6da237d-a06c-4f25-8daa-cf2d6e7af6a8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:54.593452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-997aa0f5-5745-473a-8d38-b0a11b16d8b1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:54.608708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-997aa0f5-5745-473a-8d38-b0a11b16d8b1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:54.617530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-997aa0f5-5745-473a-8d38-b0a11b16d8b1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:54.619049 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-997aa0f5-5745-473a-8d38-b0a11b16d8b1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1364 microversion: 2.25 time: 0.623216 Jan 22 21:00:54.620173 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 177/347] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:00:53 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1364 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:00:54.934339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e6da237d-a06c-4f25-8daa-cf2d6e7af6a8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:54.945863 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e6da237d-a06c-4f25-8daa-cf2d6e7af6a8 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1323 microversion: 2.1 time: 0.797044 Jan 22 21:00:54.946508 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 171/348] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:54 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1323 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:55.007731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-b9ddce34-5a23-4884-8135-5067382a17d0 req-45bb5180-ca98-4655-bf4f-839f4a27143c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99966147-7dbb-4eee-86c6-65e8fdc9f14c", "tag": "c4491a12-f660-45ed-b9d7-e57ab1de1fd7"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:55.010409 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:55.010409 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:55.010944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2ecea1f2-ae0e-4249-9132-70dfd5a62ed5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:55.012344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2ecea1f2-ae0e-4249-9132-70dfd5a62ed5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:55.031208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ecea1f2-ae0e-4249-9132-70dfd5a62ed5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:55.031668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ecea1f2-ae0e-4249-9132-70dfd5a62ed5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:55.032486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ecea1f2-ae0e-4249-9132-70dfd5a62ed5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:55.032929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ecea1f2-ae0e-4249-9132-70dfd5a62ed5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:55.039723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b9ddce34-5a23-4884-8135-5067382a17d0 req-45bb5180-ca98-4655-bf4f-839f4a27143c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:55.040572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b9ddce34-5a23-4884-8135-5067382a17d0 req-45bb5180-ca98-4655-bf4f-839f4a27143c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:55.086879 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-b9ddce34-5a23-4884-8135-5067382a17d0 req-45bb5180-ca98-4655-bf4f-839f4a27143c service nova] Creating event network-changed:c4491a12-f660-45ed-b9d7-e57ab1de1fd7 for instance 99966147-7dbb-4eee-86c6-65e8fdc9f14c on nch1-master-1 Jan 22 21:00:55.115016 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-b9ddce34-5a23-4884-8135-5067382a17d0 req-45bb5180-ca98-4655-bf4f-839f4a27143c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112490 Jan 22 21:00:55.116484 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 178/349] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:55.161752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d24d7358-1bda-416f-9550-9b514bb8c254 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:55.163028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d24d7358-1bda-416f-9550-9b514bb8c254 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:55.175693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d24d7358-1bda-416f-9550-9b514bb8c254 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:55.176216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d24d7358-1bda-416f-9550-9b514bb8c254 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:55.177172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d24d7358-1bda-416f-9550-9b514bb8c254 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:55.181705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d24d7358-1bda-416f-9550-9b514bb8c254 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:55.652894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2ecea1f2-ae0e-4249-9132-70dfd5a62ed5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:55.664014 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2ecea1f2-ae0e-4249-9132-70dfd5a62ed5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1314 microversion: 2.1 time: 0.656585 Jan 22 21:00:55.679489 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 172/350] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:55 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:55.698841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-b82d2513-c70c-4f09-96a4-cb43b258a0a7 req-5758bf8c-67ca-4beb-a701-d3b297125875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c2ce33-a108-4be0-bb41-068138160281", "tag": "bd951644-4535-4dbd-b4a8-1c4994056609"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:00:55.700825 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:55.700825 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:55.727137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-b82d2513-c70c-4f09-96a4-cb43b258a0a7 req-5758bf8c-67ca-4beb-a701-d3b297125875 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:55.728152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-b82d2513-c70c-4f09-96a4-cb43b258a0a7 req-5758bf8c-67ca-4beb-a701-d3b297125875 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:55.767965 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-b82d2513-c70c-4f09-96a4-cb43b258a0a7 req-5758bf8c-67ca-4beb-a701-d3b297125875 service nova] Creating event network-changed:bd951644-4535-4dbd-b4a8-1c4994056609 for instance 34c2ce33-a108-4be0-bb41-068138160281 on nch1-master-1 Jan 22 21:00:55.777776 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-b82d2513-c70c-4f09-96a4-cb43b258a0a7 req-5758bf8c-67ca-4beb-a701-d3b297125875 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095628 Jan 22 21:00:55.779321 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 173/351] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:55.798324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6bfe98c0-5c92-4b82-bbed-0b88a73f82cb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:55.803036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6bfe98c0-5c92-4b82-bbed-0b88a73f82cb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:55.821320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6bfe98c0-5c92-4b82-bbed-0b88a73f82cb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:55.836106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6bfe98c0-5c92-4b82-bbed-0b88a73f82cb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:55.837294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6bfe98c0-5c92-4b82-bbed-0b88a73f82cb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:55.841439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6bfe98c0-5c92-4b82-bbed-0b88a73f82cb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:56.266048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6bfe98c0-5c92-4b82-bbed-0b88a73f82cb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:56.279975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6bfe98c0-5c92-4b82-bbed-0b88a73f82cb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:56.286543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6bfe98c0-5c92-4b82-bbed-0b88a73f82cb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:56.289355 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6bfe98c0-5c92-4b82-bbed-0b88a73f82cb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1364 microversion: 2.25 time: 0.507778 Jan 22 21:00:56.301599 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 174/352] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:00:55 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1364 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:00:56.301599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4828f009-405d-4276-8eda-f9a6bdfd53d1 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:56.301599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4828f009-405d-4276-8eda-f9a6bdfd53d1 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:56.314306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4828f009-405d-4276-8eda-f9a6bdfd53d1 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:56.314771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4828f009-405d-4276-8eda-f9a6bdfd53d1 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:56.315579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4828f009-405d-4276-8eda-f9a6bdfd53d1 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:56.316208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4828f009-405d-4276-8eda-f9a6bdfd53d1 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:56.571693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4828f009-405d-4276-8eda-f9a6bdfd53d1 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:56.581604 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4828f009-405d-4276-8eda-f9a6bdfd53d1 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1323 microversion: 2.1 time: 0.287935 Jan 22 21:00:56.584489 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 175/353] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:56 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1323 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:56.807475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d24d7358-1bda-416f-9550-9b514bb8c254 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:56.818191 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d24d7358-1bda-416f-9550-9b514bb8c254 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1468 microversion: 2.1 time: 1.662637 Jan 22 21:00:56.819359 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 179/354] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:55 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1468 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:56.834712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-43d0574a-9bbe-4268-9762-b0a3dbb90752 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:56.835741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-43d0574a-9bbe-4268-9762-b0a3dbb90752 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:56.849682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43d0574a-9bbe-4268-9762-b0a3dbb90752 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:56.849682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43d0574a-9bbe-4268-9762-b0a3dbb90752 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:56.849682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43d0574a-9bbe-4268-9762-b0a3dbb90752 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:56.849682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43d0574a-9bbe-4268-9762-b0a3dbb90752 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:56.851184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-22210dcf-9ff8-4e79-be99-a2b6fe33d497 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:56.852652 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:56.852652 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:56.854435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22210dcf-9ff8-4e79-be99-a2b6fe33d497 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:56.854899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22210dcf-9ff8-4e79-be99-a2b6fe33d497 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:56.855729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22210dcf-9ff8-4e79-be99-a2b6fe33d497 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:56.856176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22210dcf-9ff8-4e79-be99-a2b6fe33d497 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:56.900349 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-22210dcf-9ff8-4e79-be99-a2b6fe33d497 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.313123 Jan 22 21:00:56.907900 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 176/355] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:00:56 2022] GET /compute/v2.1/os-services => generated 947 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:57.085571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ce8f9eae-5511-483e-9ecf-218c52a47f44 tempest-TenantUsagesTestJSON-539653141 tempest-TenantUsagesTestJSON-539653141-project-admin] Calling method '.version_select at 0x7f1ed647d700>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:57.095717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce8f9eae-5511-483e-9ecf-218c52a47f44 tempest-TenantUsagesTestJSON-539653141 tempest-TenantUsagesTestJSON-539653141-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.096380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce8f9eae-5511-483e-9ecf-218c52a47f44 tempest-TenantUsagesTestJSON-539653141 tempest-TenantUsagesTestJSON-539653141-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.156786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce8f9eae-5511-483e-9ecf-218c52a47f44 tempest-TenantUsagesTestJSON-539653141 tempest-TenantUsagesTestJSON-539653141-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.158275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce8f9eae-5511-483e-9ecf-218c52a47f44 tempest-TenantUsagesTestJSON-539653141 tempest-TenantUsagesTestJSON-539653141-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.213811 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ce8f9eae-5511-483e-9ecf-218c52a47f44 tempest-TenantUsagesTestJSON-539653141 tempest-TenantUsagesTestJSON-539653141-project-admin] 10.222.0.100 "GET /compute/v2.1/os-simple-tenant-usage/678b6ef2fa6b4f8b9aa67ef59b77ade5?start=2022-01-21T21%3A00%3A56.828619&end=2022-01-23T21%3A00%3A56.828619" status: 200 len: 691 microversion: 2.1 time: 0.304554 Jan 22 21:00:57.215035 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 177/356] 10.222.0.100 () {58 vars in 1416 bytes} [Sat Jan 22 21:00:56 2022] GET /compute/v2.1/os-simple-tenant-usage/678b6ef2fa6b4f8b9aa67ef59b77ade5?start=2022-01-21T21%3A00%3A56.828619&end=2022-01-23T21%3A00%3A56.828619 => generated 691 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:57.228619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0f26b8d5-f225-4d2c-9d66-3c91ef0b1444 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:57.231208 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:57.231208 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:57.233925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f26b8d5-f225-4d2c-9d66-3c91ef0b1444 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.234565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f26b8d5-f225-4d2c-9d66-3c91ef0b1444 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.235922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f26b8d5-f225-4d2c-9d66-3c91ef0b1444 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.236540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f26b8d5-f225-4d2c-9d66-3c91ef0b1444 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.321435 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0f26b8d5-f225-4d2c-9d66-3c91ef0b1444 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.103370 Jan 22 21:00:57.330673 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 178/357] 10.222.0.100 () {58 vars in 1178 bytes} [Sat Jan 22 21:00:57 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:57.337475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3b8922a1-6ae1-4a6b-8943-0a2428995aa6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '.version_select at 0x7f1ed63c9b80>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:57.349017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3b8922a1-6ae1-4a6b-8943-0a2428995aa6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.350747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3b8922a1-6ae1-4a6b-8943-0a2428995aa6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.369796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3b8922a1-6ae1-4a6b-8943-0a2428995aa6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.370418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3b8922a1-6ae1-4a6b-8943-0a2428995aa6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.423711 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3b8922a1-6ae1-4a6b-8943-0a2428995aa6 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/os-simple-tenant-usage/678b6ef2fa6b4f8b9aa67ef59b77ade5?start=2022-01-21T21%3A00%3A56.828619&end=2022-01-23T21%3A00%3A56.828619" status: 200 len: 650 microversion: 2.1 time: 0.088804 Jan 22 21:00:57.425277 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 179/358] 10.222.0.100 () {58 vars in 1416 bytes} [Sat Jan 22 21:00:57 2022] GET /compute/v2.1/os-simple-tenant-usage/678b6ef2fa6b4f8b9aa67ef59b77ade5?start=2022-01-21T21%3A00%3A56.828619&end=2022-01-23T21%3A00%3A56.828619 => generated 650 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:57.436979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-005c4285-ab33-440e-9832-8f58e2e8d84b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:57.442690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-005c4285-ab33-440e-9832-8f58e2e8d84b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:57.453243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-005c4285-ab33-440e-9832-8f58e2e8d84b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.453834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-005c4285-ab33-440e-9832-8f58e2e8d84b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.455028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-005c4285-ab33-440e-9832-8f58e2e8d84b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.455484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-005c4285-ab33-440e-9832-8f58e2e8d84b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.524855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-43d0574a-9bbe-4268-9762-b0a3dbb90752 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:57.552160 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-43d0574a-9bbe-4268-9762-b0a3dbb90752 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1314 microversion: 2.1 time: 0.727203 Jan 22 21:00:57.552160 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 180/359] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:56 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:57.560902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eda65bc0-a22a-4359-b904-0223c5707ad3 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:57.576149 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:57.576149 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:57.582533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eda65bc0-a22a-4359-b904-0223c5707ad3 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.585541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eda65bc0-a22a-4359-b904-0223c5707ad3 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.587311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eda65bc0-a22a-4359-b904-0223c5707ad3 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.589891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eda65bc0-a22a-4359-b904-0223c5707ad3 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.642257 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eda65bc0-a22a-4359-b904-0223c5707ad3 tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.090966 Jan 22 21:00:57.643442 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 181/360] 10.222.0.100 () {58 vars in 1180 bytes} [Sat Jan 22 21:00:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:57.652556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2e1f3097-ce44-4465-a704-b6be1ee80114 tempest-TenantUsagesTestJSON-539653141 tempest-TenantUsagesTestJSON-539653141-project-admin] Calling method '.version_select at 0x7f1ed63c8d30>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:57.654257 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-simple-tenant-usage:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:57.654257 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:00:57.672011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e1f3097-ce44-4465-a704-b6be1ee80114 tempest-TenantUsagesTestJSON-539653141 tempest-TenantUsagesTestJSON-539653141-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.672728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e1f3097-ce44-4465-a704-b6be1ee80114 tempest-TenantUsagesTestJSON-539653141 tempest-TenantUsagesTestJSON-539653141-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.696016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e1f3097-ce44-4465-a704-b6be1ee80114 tempest-TenantUsagesTestJSON-539653141 tempest-TenantUsagesTestJSON-539653141-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.696651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e1f3097-ce44-4465-a704-b6be1ee80114 tempest-TenantUsagesTestJSON-539653141 tempest-TenantUsagesTestJSON-539653141-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.723168 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2e1f3097-ce44-4465-a704-b6be1ee80114 tempest-TenantUsagesTestJSON-539653141 tempest-TenantUsagesTestJSON-539653141-project-admin] 10.222.0.100 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-01-21T21%3A00%3A56.828619&end=2022-01-23T21%3A00%3A56.828619&detailed=1" status: 200 len: 2119 microversion: 2.1 time: 0.078357 Jan 22 21:00:57.724684 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 182/361] 10.222.0.100 () {58 vars in 1339 bytes} [Sat Jan 22 21:00:57 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-01-21T21%3A00%3A56.828619&end=2022-01-23T21%3A00%3A56.828619&detailed=1 => generated 2119 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:57.736409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a98ec33a-de55-4519-8107-4d1b8aeb5ff6 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:57.737528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a98ec33a-de55-4519-8107-4d1b8aeb5ff6 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:57.745462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a98ec33a-de55-4519-8107-4d1b8aeb5ff6 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.746168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a98ec33a-de55-4519-8107-4d1b8aeb5ff6 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.752226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a98ec33a-de55-4519-8107-4d1b8aeb5ff6 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.752226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a98ec33a-de55-4519-8107-4d1b8aeb5ff6 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.757183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-005c4285-ab33-440e-9832-8f58e2e8d84b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:57.766788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-005c4285-ab33-440e-9832-8f58e2e8d84b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:57.769009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-005c4285-ab33-440e-9832-8f58e2e8d84b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:57.772157 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-005c4285-ab33-440e-9832-8f58e2e8d84b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1364 microversion: 2.25 time: 0.343296 Jan 22 21:00:57.773116 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 180/362] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:00:57 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1364 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:00:57.779761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-33dfdded-b5cd-44ac-aca1-ffca1577d7bc tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:57.786942 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:00:57.786942 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:00:57.786942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33dfdded-b5cd-44ac-aca1-ffca1577d7bc tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.786942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33dfdded-b5cd-44ac-aca1-ffca1577d7bc tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.786942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33dfdded-b5cd-44ac-aca1-ffca1577d7bc tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.787865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33dfdded-b5cd-44ac-aca1-ffca1577d7bc tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.818898 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-33dfdded-b5cd-44ac-aca1-ffca1577d7bc tempest-ServicesAdminTestJSON-248588584 tempest-ServicesAdminTestJSON-248588584-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.044425 Jan 22 21:00:57.826412 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 181/363] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:00:57 2022] GET /compute/v2.1/os-services => generated 947 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:00:57.826412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6503e85d-9a43-4a26-846a-1c7175d8278b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:57.826412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6503e85d-9a43-4a26-846a-1c7175d8278b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:57.850394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6503e85d-9a43-4a26-846a-1c7175d8278b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.851310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6503e85d-9a43-4a26-846a-1c7175d8278b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.852735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6503e85d-9a43-4a26-846a-1c7175d8278b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:57.853195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6503e85d-9a43-4a26-846a-1c7175d8278b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:57.934269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6503e85d-9a43-4a26-846a-1c7175d8278b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:00:58.179575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a98ec33a-de55-4519-8107-4d1b8aeb5ff6 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:58.186961 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a98ec33a-de55-4519-8107-4d1b8aeb5ff6 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1323 microversion: 2.1 time: 0.460999 Jan 22 21:00:58.187529 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 183/364] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:57 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1323 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:00:58.273896 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6503e85d-9a43-4a26-846a-1c7175d8278b tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "DELETE /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 204 len: 0 microversion: 2.1 time: 0.452226 Jan 22 21:00:58.275518 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 182/365] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:00:57 2022] DELETE /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:00:58.290887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9758be80-c031-4c96-bb3a-96d1948395c2 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:58.292054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9758be80-c031-4c96-bb3a-96d1948395c2 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:58.299357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9758be80-c031-4c96-bb3a-96d1948395c2 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:58.300043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9758be80-c031-4c96-bb3a-96d1948395c2 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:58.301658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9758be80-c031-4c96-bb3a-96d1948395c2 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:58.306175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9758be80-c031-4c96-bb3a-96d1948395c2 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:58.569140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a33f50b5-80d6-4445-bdfa-4f2dcc19812e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:58.570141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a33f50b5-80d6-4445-bdfa-4f2dcc19812e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:58.607132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a33f50b5-80d6-4445-bdfa-4f2dcc19812e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:58.607617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a33f50b5-80d6-4445-bdfa-4f2dcc19812e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:58.608463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a33f50b5-80d6-4445-bdfa-4f2dcc19812e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:58.608910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a33f50b5-80d6-4445-bdfa-4f2dcc19812e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:59.045730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9758be80-c031-4c96-bb3a-96d1948395c2 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:59.059402 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9758be80-c031-4c96-bb3a-96d1948395c2 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1474 microversion: 2.1 time: 0.770415 Jan 22 21:00:59.063147 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 184/366] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:58 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1474 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:59.080397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9dee80f7-96e8-4050-9959-d377c807d0e4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:59.082857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9dee80f7-96e8-4050-9959-d377c807d0e4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:59.104347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9dee80f7-96e8-4050-9959-d377c807d0e4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:59.108183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9dee80f7-96e8-4050-9959-d377c807d0e4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:59.112136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9dee80f7-96e8-4050-9959-d377c807d0e4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:59.115085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9dee80f7-96e8-4050-9959-d377c807d0e4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:59.173396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a33f50b5-80d6-4445-bdfa-4f2dcc19812e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:59.186540 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a33f50b5-80d6-4445-bdfa-4f2dcc19812e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1314 microversion: 2.1 time: 0.622518 Jan 22 21:00:59.189109 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 183/367] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:58 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:00:59.204605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3f02fd75-df85-4439-b1ab-d70d1ebd4150 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:00:59.205662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3f02fd75-df85-4439-b1ab-d70d1ebd4150 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:00:59.218112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f02fd75-df85-4439-b1ab-d70d1ebd4150 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:59.220687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f02fd75-df85-4439-b1ab-d70d1ebd4150 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:59.223734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f02fd75-df85-4439-b1ab-d70d1ebd4150 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:00:59.224683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f02fd75-df85-4439-b1ab-d70d1ebd4150 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:00:59.829191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9dee80f7-96e8-4050-9959-d377c807d0e4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:59.840654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9dee80f7-96e8-4050-9959-d377c807d0e4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:59.846310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9dee80f7-96e8-4050-9959-d377c807d0e4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:00:59.854092 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9dee80f7-96e8-4050-9959-d377c807d0e4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1364 microversion: 2.25 time: 0.788697 Jan 22 21:00:59.865584 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 185/368] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:00:59 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1364 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:00.003225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3f02fd75-df85-4439-b1ab-d70d1ebd4150 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:00.016756 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3f02fd75-df85-4439-b1ab-d70d1ebd4150 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1323 microversion: 2.1 time: 0.816280 Jan 22 21:01:00.022643 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 184/369] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:00:59 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1323 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:01:00.084322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fd0ad1fb-020b-49cd-87f7-f94b69eab045 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:00.085709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fd0ad1fb-020b-49cd-87f7-f94b69eab045 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:00.100502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd0ad1fb-020b-49cd-87f7-f94b69eab045 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:00.103285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd0ad1fb-020b-49cd-87f7-f94b69eab045 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:00.105305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd0ad1fb-020b-49cd-87f7-f94b69eab045 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:00.108007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd0ad1fb-020b-49cd-87f7-f94b69eab045 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:00.351568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8ccf7e11-a753-45cc-9b54-9bee7df36233 tempest-FloatingIPsNegativeTestJSON-1225991715 tempest-FloatingIPsNegativeTestJSON-1225991715-project] Calling method '.version_select at 0x7f1ed63a6b80>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:00.491635 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8ccf7e11-a753-45cc-9b54-9bee7df36233 tempest-FloatingIPsNegativeTestJSON-1225991715 tempest-FloatingIPsNegativeTestJSON-1225991715-project] 10.222.0.100 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.480193 Jan 22 21:01:00.492821 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 186/370] 10.222.0.100 () {58 vars in 1153 bytes} [Sat Jan 22 21:01:00 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:00.498143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-10a5b7f8-9331-4021-8dda-fe4222e6c5f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:00.499417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-10a5b7f8-9331-4021-8dda-fe4222e6c5f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:00.517144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10a5b7f8-9331-4021-8dda-fe4222e6c5f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:00.523285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10a5b7f8-9331-4021-8dda-fe4222e6c5f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:00.525799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10a5b7f8-9331-4021-8dda-fe4222e6c5f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:00.526273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10a5b7f8-9331-4021-8dda-fe4222e6c5f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:00.591542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fd0ad1fb-020b-49cd-87f7-f94b69eab045 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:00.625402 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fd0ad1fb-020b-49cd-87f7-f94b69eab045 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1474 microversion: 2.1 time: 0.531473 Jan 22 21:01:00.625402 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 185/371] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:00 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1474 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:00.625402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1632ccbf-c9de-40c4-b6ef-138d35a4d8fb tempest-FloatingIPsNegativeTestJSON-1225991715 tempest-FloatingIPsNegativeTestJSON-1225991715-project] Action: 'create', calling method: .version_select at 0x7f1ed63c9b80>, body: {"pool": "non_exist_pool"} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:00.713135 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-1632ccbf-c9de-40c4-b6ef-138d35a4d8fb tempest-FloatingIPsNegativeTestJSON-1225991715 tempest-FloatingIPsNegativeTestJSON-1225991715-project] HTTP exception thrown: Floating IP pool not found. Jan 22 21:01:00.714028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1632ccbf-c9de-40c4-b6ef-138d35a4d8fb tempest-FloatingIPsNegativeTestJSON-1225991715 tempest-FloatingIPsNegativeTestJSON-1225991715-project] Returning 404 to user: Floating IP pool not found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:00.715076 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1632ccbf-c9de-40c4-b6ef-138d35a4d8fb tempest-FloatingIPsNegativeTestJSON-1225991715 tempest-FloatingIPsNegativeTestJSON-1225991715-project] 10.222.0.100 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.101534 Jan 22 21:01:00.720446 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 186/372] 10.222.0.100 () {60 vars in 1174 bytes} [Sat Jan 22 21:01:00 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:01:00.727867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-56784cbf-d046-497d-88d4-9a133c51104c tempest-FloatingIPsNegativeTestJSON-1225991715 tempest-FloatingIPsNegativeTestJSON-1225991715-project] Calling method '.version_select at 0x7f1ed638baf0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:00.972580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-10a5b7f8-9331-4021-8dda-fe4222e6c5f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:00.982690 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-10a5b7f8-9331-4021-8dda-fe4222e6c5f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1314 microversion: 2.1 time: 0.488403 Jan 22 21:01:00.997729 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 187/373] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:00 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:01.009712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ea01d709-a426-410b-927e-4caf7baa863e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:01.011786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ea01d709-a426-410b-927e-4caf7baa863e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:01.021385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea01d709-a426-410b-927e-4caf7baa863e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:01.022284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea01d709-a426-410b-927e-4caf7baa863e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:01.023303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea01d709-a426-410b-927e-4caf7baa863e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:01.026333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea01d709-a426-410b-927e-4caf7baa863e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:01.192111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG neutronclient.v2_0.client [None req-56784cbf-d046-497d-88d4-9a133c51104c tempest-FloatingIPsNegativeTestJSON-1225991715 tempest-FloatingIPsNegativeTestJSON-1225991715-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 670e2953-8db1-42cb-8b75-934e12d6eda6 could not be found", "detail": ""}} {{(pid=137033) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:01:01.192111 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-56784cbf-d046-497d-88d4-9a133c51104c tempest-FloatingIPsNegativeTestJSON-1225991715 tempest-FloatingIPsNegativeTestJSON-1225991715-project] HTTP exception thrown: Floating IP not found for ID 670e2953-8db1-42cb-8b75-934e12d6eda6 Jan 22 21:01:01.192111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-56784cbf-d046-497d-88d4-9a133c51104c tempest-FloatingIPsNegativeTestJSON-1225991715 tempest-FloatingIPsNegativeTestJSON-1225991715-project] Returning 404 to user: Floating IP not found for ID 670e2953-8db1-42cb-8b75-934e12d6eda6 {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:01.192111 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-56784cbf-d046-497d-88d4-9a133c51104c tempest-FloatingIPsNegativeTestJSON-1225991715 tempest-FloatingIPsNegativeTestJSON-1225991715-project] 10.222.0.100 "DELETE /compute/v2.1/os-floating-ips/670e2953-8db1-42cb-8b75-934e12d6eda6" status: 404 len: 111 microversion: 2.1 time: 0.467894 Jan 22 21:01:01.192111 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 187/374] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:01:00 2022] DELETE /compute/v2.1/os-floating-ips/670e2953-8db1-42cb-8b75-934e12d6eda6 => generated 111 bytes in 470 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:01:01.196717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5b5ece08-3134-4be7-a948-9fb480a8f12e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:01.197342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5b5ece08-3134-4be7-a948-9fb480a8f12e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:01.214610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b5ece08-3134-4be7-a948-9fb480a8f12e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:01.216763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b5ece08-3134-4be7-a948-9fb480a8f12e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:01.217671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b5ece08-3134-4be7-a948-9fb480a8f12e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:01.218156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b5ece08-3134-4be7-a948-9fb480a8f12e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:01.506647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ea01d709-a426-410b-927e-4caf7baa863e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:01.514853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ea01d709-a426-410b-927e-4caf7baa863e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:01.516378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ea01d709-a426-410b-927e-4caf7baa863e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:01.521674 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ea01d709-a426-410b-927e-4caf7baa863e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1364 microversion: 2.25 time: 0.522789 Jan 22 21:01:01.529806 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 188/375] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:00 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1364 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:01.610046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5b5ece08-3134-4be7-a948-9fb480a8f12e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:01.627003 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5b5ece08-3134-4be7-a948-9fb480a8f12e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1323 microversion: 2.1 time: 0.434203 Jan 22 21:01:01.629696 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 188/376] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:01 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1323 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:01.642022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-244e7d73-69f3-4c42-9896-cda7a50ea33c tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:01.644100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-244e7d73-69f3-4c42-9896-cda7a50ea33c tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:01.652508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-244e7d73-69f3-4c42-9896-cda7a50ea33c tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:01.656929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-244e7d73-69f3-4c42-9896-cda7a50ea33c tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:01.658012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-244e7d73-69f3-4c42-9896-cda7a50ea33c tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:01.659929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-244e7d73-69f3-4c42-9896-cda7a50ea33c tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:01.695379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-332b709d-21d9-4f29-b216-43f36e69bd34 req-497e56ba-f7d5-4ec3-b9c2-36dde8cf019a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a0a09a-4064-4c04-871b-3b1dc966dbc2", "name": "network-vif-deleted", "tag": "efd0b522-24e7-4d12-9315-9c9a798f9c3b"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:01.697026 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:01.697026 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:01.716164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-332b709d-21d9-4f29-b216-43f36e69bd34 req-497e56ba-f7d5-4ec3-b9c2-36dde8cf019a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:01.716164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-332b709d-21d9-4f29-b216-43f36e69bd34 req-497e56ba-f7d5-4ec3-b9c2-36dde8cf019a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:01.744315 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-332b709d-21d9-4f29-b216-43f36e69bd34 req-497e56ba-f7d5-4ec3-b9c2-36dde8cf019a service nova] Creating event network-vif-deleted:efd0b522-24e7-4d12-9315-9c9a798f9c3b for instance 57a0a09a-4064-4c04-871b-3b1dc966dbc2 on nch2-master-1 Jan 22 21:01:01.761322 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-332b709d-21d9-4f29-b216-43f36e69bd34 req-497e56ba-f7d5-4ec3-b9c2-36dde8cf019a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068864 Jan 22 21:01:01.765793 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 189/377] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:01:01.792403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-244e7d73-69f3-4c42-9896-cda7a50ea33c tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f62c70b6289f4c17a797c522a9326388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678b6ef2fa6b4f8b9aa67ef59b77ade5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:01.802554 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-244e7d73-69f3-4c42-9896-cda7a50ea33c tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 200 len: 1432 microversion: 2.1 time: 0.172942 Jan 22 21:01:01.805470 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 189/378] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:01 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 1432 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:01:01.955700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-63d6357b-f188-48d6-a2da-ee74c37ab276 tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Calling method '.version_select at 0x7f1ed638b160>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:02.006684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5167b49e-6101-44eb-97cd-12ac16c1fbe7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:02.007295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5167b49e-6101-44eb-97cd-12ac16c1fbe7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:02.019830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5167b49e-6101-44eb-97cd-12ac16c1fbe7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:02.022170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5167b49e-6101-44eb-97cd-12ac16c1fbe7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:02.024676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5167b49e-6101-44eb-97cd-12ac16c1fbe7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:02.025905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5167b49e-6101-44eb-97cd-12ac16c1fbe7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:02.113913 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-63d6357b-f188-48d6-a2da-ee74c37ab276 tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926" status: 200 len: 371 microversion: 2.1 time: 0.314563 Jan 22 21:01:02.116386 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 190/379] 10.222.0.100 () {58 vars in 1246 bytes} [Sat Jan 22 21:01:01 2022] GET /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926 => generated 371 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:02.134644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1e5923c8-9a8f-4bfe-834c-e3fb62e433ba tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed63783a0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:02.137551 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:02.137551 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:02.231863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e5923c8-9a8f-4bfe-834c-e3fb62e433ba tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:02.235156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e5923c8-9a8f-4bfe-834c-e3fb62e433ba tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:02.235156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e5923c8-9a8f-4bfe-834c-e3fb62e433ba tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:02.235156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e5923c8-9a8f-4bfe-834c-e3fb62e433ba tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:02.376312 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1e5923c8-9a8f-4bfe-834c-e3fb62e433ba tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926" status: 200 len: 328 microversion: 2.1 time: 0.251566 Jan 22 21:01:02.377969 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 191/380] 10.222.0.100 () {60 vars in 1266 bytes} [Sat Jan 22 21:01:02 2022] PUT /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926 => generated 328 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:02.584989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2145344330", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:02.642846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:01:02.828742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5167b49e-6101-44eb-97cd-12ac16c1fbe7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:02.846614 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5167b49e-6101-44eb-97cd-12ac16c1fbe7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1314 microversion: 2.1 time: 0.847936 Jan 22 21:01:02.848541 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 190/381] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:01 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1314 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:02.856050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cfee05f8-43df-4a99-81ef-cfa13f96302c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:02.857021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cfee05f8-43df-4a99-81ef-cfa13f96302c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:02.867986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfee05f8-43df-4a99-81ef-cfa13f96302c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:02.868777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfee05f8-43df-4a99-81ef-cfa13f96302c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:02.871402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfee05f8-43df-4a99-81ef-cfa13f96302c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:02.872011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfee05f8-43df-4a99-81ef-cfa13f96302c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:03.005863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:01:03.006301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:01:03.006786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:01:03.007513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:01:03.007959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:01:03.023752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:03.027707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:03.028690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:03.029146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:03.076789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Getting quotas for project 1f91deb350a648bcae33b568d9b99926. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:03.081936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Getting quotas for user b1690e22316547cf9109683ffc9fb714 and project 1f91deb350a648bcae33b568d9b99926. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:03.097025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.utils [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] cores quota exceeded for 1f91deb350a648bcae33b568d9b99926, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=137033) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Jan 22 21:01:03.098371 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jan 22 21:01:03.100427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:03.100427 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c9046db0-72ae-4f58-a565-3763a23261d5 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.582480 Jan 22 21:01:03.108403 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 192/382] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:01:02 2022] POST /compute/v2.1/servers => generated 111 bytes in 591 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:01:03.114643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ccdbae53-e432-48a1-aded-8055d3ad6beb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:03.115704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ccdbae53-e432-48a1-aded-8055d3ad6beb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:03.123400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccdbae53-e432-48a1-aded-8055d3ad6beb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:03.124860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccdbae53-e432-48a1-aded-8055d3ad6beb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:03.125176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccdbae53-e432-48a1-aded-8055d3ad6beb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:03.125861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccdbae53-e432-48a1-aded-8055d3ad6beb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:03.328434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ccdbae53-e432-48a1-aded-8055d3ad6beb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:03.337640 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ccdbae53-e432-48a1-aded-8055d3ad6beb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1323 microversion: 2.1 time: 0.227728 Jan 22 21:01:03.338438 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 193/383] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:03 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1323 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:03.352437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d2b4e915-b105-4f8d-96dc-96f2a126bc41 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:03.354865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d2b4e915-b105-4f8d-96dc-96f2a126bc41 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] [instance: 57a0a09a-4064-4c04-871b-3b1dc966dbc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:03.366632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2b4e915-b105-4f8d-96dc-96f2a126bc41 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:03.368834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2b4e915-b105-4f8d-96dc-96f2a126bc41 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:03.370089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2b4e915-b105-4f8d-96dc-96f2a126bc41 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:03.370656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2b4e915-b105-4f8d-96dc-96f2a126bc41 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:03.390321 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-d2b4e915-b105-4f8d-96dc-96f2a126bc41 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] HTTP exception thrown: Instance 57a0a09a-4064-4c04-871b-3b1dc966dbc2 could not be found. Jan 22 21:01:03.391029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d2b4e915-b105-4f8d-96dc-96f2a126bc41 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] Returning 404 to user: Instance 57a0a09a-4064-4c04-871b-3b1dc966dbc2 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:03.399558 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d2b4e915-b105-4f8d-96dc-96f2a126bc41 tempest-TenantUsagesTestJSON-801071265 tempest-TenantUsagesTestJSON-801071265-project] 10.222.0.100 "GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2" status: 404 len: 111 microversion: 2.1 time: 0.052587 Jan 22 21:01:03.399558 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 194/384] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:03 2022] GET /compute/v2.1/servers/57a0a09a-4064-4c04-871b-3b1dc966dbc2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:01:03.400378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3237718c-efbf-4a20-8fe1-32da168ba414 tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed63c9670>, body: {"quota_set": {"cores": 20}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:03.402059 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:03.402059 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:03.581397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cfee05f8-43df-4a99-81ef-cfa13f96302c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:03.598072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cfee05f8-43df-4a99-81ef-cfa13f96302c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:03.600132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cfee05f8-43df-4a99-81ef-cfa13f96302c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:03.602154 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cfee05f8-43df-4a99-81ef-cfa13f96302c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1364 microversion: 2.25 time: 0.752249 Jan 22 21:01:03.610294 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 191/385] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:02 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1364 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:03.867438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1b973bc9-b2df-4935-83c8-6a89d9739bda tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:03.869725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1b973bc9-b2df-4935-83c8-6a89d9739bda tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:03.880999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b973bc9-b2df-4935-83c8-6a89d9739bda tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:03.881933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b973bc9-b2df-4935-83c8-6a89d9739bda tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:03.882982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b973bc9-b2df-4935-83c8-6a89d9739bda tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:03.884201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b973bc9-b2df-4935-83c8-6a89d9739bda tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:04.060760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3237718c-efbf-4a20-8fe1-32da168ba414 tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:04.061328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3237718c-efbf-4a20-8fe1-32da168ba414 tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:04.062074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3237718c-efbf-4a20-8fe1-32da168ba414 tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:04.062502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3237718c-efbf-4a20-8fe1-32da168ba414 tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:04.267332 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3237718c-efbf-4a20-8fe1-32da168ba414 tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926" status: 200 len: 329 microversion: 2.1 time: 0.871191 Jan 22 21:01:04.268626 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 195/386] 10.222.0.100 () {60 vars in 1266 bytes} [Sat Jan 22 21:01:03 2022] PUT /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926 => generated 329 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:04.289631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6c276fd1-5b8e-4ab5-b626-a08a0155a7ea tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Calling method '.version_select at 0x7f1ed6378ca0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:04.542119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1b973bc9-b2df-4935-83c8-6a89d9739bda tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:04.559061 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1b973bc9-b2df-4935-83c8-6a89d9739bda tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1314 microversion: 2.1 time: 0.695527 Jan 22 21:01:04.560089 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 192/387] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:03 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:01:04.570065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cce120b9-7092-42e0-8fa4-16224b1fdba3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:04.574177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cce120b9-7092-42e0-8fa4-16224b1fdba3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:04.583772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cce120b9-7092-42e0-8fa4-16224b1fdba3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:04.585222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cce120b9-7092-42e0-8fa4-16224b1fdba3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:04.586220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cce120b9-7092-42e0-8fa4-16224b1fdba3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:04.586819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cce120b9-7092-42e0-8fa4-16224b1fdba3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:04.678301 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6c276fd1-5b8e-4ab5-b626-a08a0155a7ea tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926" status: 200 len: 371 microversion: 2.1 time: 0.399705 Jan 22 21:01:04.678977 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 196/388] 10.222.0.100 () {58 vars in 1246 bytes} [Sat Jan 22 21:01:04 2022] GET /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926 => generated 371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:04.765241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1c9a52d8-fd88-42e9-9b93-657ec5dcae53 tempest-FlavorsV2NegativeTest-191092150 tempest-FlavorsV2NegativeTest-191092150-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:04.778255 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1c9a52d8-fd88-42e9-9b93-657ec5dcae53 tempest-FlavorsV2NegativeTest-191092150 tempest-FlavorsV2NegativeTest-191092150-project] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.097128 Jan 22 21:01:04.787956 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 197/389] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:01:04 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:04.799647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1b82e461-f4cd-458e-b53e-d82d0aae30b4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:04.802647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1b82e461-f4cd-458e-b53e-d82d0aae30b4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:04.817848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b82e461-f4cd-458e-b53e-d82d0aae30b4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:04.818594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b82e461-f4cd-458e-b53e-d82d0aae30b4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:04.819585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b82e461-f4cd-458e-b53e-d82d0aae30b4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:04.820248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b82e461-f4cd-458e-b53e-d82d0aae30b4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:04.923392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cce120b9-7092-42e0-8fa4-16224b1fdba3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:04.943099 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cce120b9-7092-42e0-8fa4-16224b1fdba3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1323 microversion: 2.1 time: 0.380616 Jan 22 21:01:04.963038 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 193/390] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:04 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1323 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:04.976298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f2285621-6915-480c-bc7a-b5e122e6c5bb tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed6382ee0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:04.983122 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:04.983122 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:05.208566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1b82e461-f4cd-458e-b53e-d82d0aae30b4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:05.217919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2285621-6915-480c-bc7a-b5e122e6c5bb tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:05.218574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2285621-6915-480c-bc7a-b5e122e6c5bb tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:05.219489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2285621-6915-480c-bc7a-b5e122e6c5bb tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:05.220097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2285621-6915-480c-bc7a-b5e122e6c5bb tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:05.235069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1b82e461-f4cd-458e-b53e-d82d0aae30b4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:05.236595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1b82e461-f4cd-458e-b53e-d82d0aae30b4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:05.247696 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1b82e461-f4cd-458e-b53e-d82d0aae30b4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1364 microversion: 2.25 time: 0.453413 Jan 22 21:01:05.250905 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 198/391] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:04 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1364 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:05.264452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-dd275ead-3bcf-4666-8aa2-a73a66c1caa2 req-a876d104-c0c6-4327-9e8b-013ad37d3f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077c7fdf-b28f-48a5-9c20-4b5b45babfed", "name": "network-vif-plugged", "status": "completed", "tag": "4892bd95-44cd-4f32-8d2d-11536ea7b4ee"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:05.272771 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:05.272771 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:05.297252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-dd275ead-3bcf-4666-8aa2-a73a66c1caa2 req-a876d104-c0c6-4327-9e8b-013ad37d3f82 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:05.302310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-dd275ead-3bcf-4666-8aa2-a73a66c1caa2 req-a876d104-c0c6-4327-9e8b-013ad37d3f82 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:05.343763 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-dd275ead-3bcf-4666-8aa2-a73a66c1caa2 req-a876d104-c0c6-4327-9e8b-013ad37d3f82 service nova] Creating event network-vif-plugged:4892bd95-44cd-4f32-8d2d-11536ea7b4ee for instance 077c7fdf-b28f-48a5-9c20-4b5b45babfed on nch1-master-1 Jan 22 21:01:05.379874 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-dd275ead-3bcf-4666-8aa2-a73a66c1caa2 req-a876d104-c0c6-4327-9e8b-013ad37d3f82 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125380 Jan 22 21:01:05.381319 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 199/392] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:05.454064 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f2285621-6915-480c-bc7a-b5e122e6c5bb tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926" status: 200 len: 328 microversion: 2.1 time: 0.487808 Jan 22 21:01:05.454692 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 194/393] 10.222.0.100 () {60 vars in 1266 bytes} [Sat Jan 22 21:01:04 2022] PUT /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926 => generated 328 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:05.576501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ba805f47-db66-4ff0-ae5a-1a075fe7f297 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:05.577661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ba805f47-db66-4ff0-ae5a-1a075fe7f297 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:05.589080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba805f47-db66-4ff0-ae5a-1a075fe7f297 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:05.590699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba805f47-db66-4ff0-ae5a-1a075fe7f297 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:05.591603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba805f47-db66-4ff0-ae5a-1a075fe7f297 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:05.592097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba805f47-db66-4ff0-ae5a-1a075fe7f297 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:05.644043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-918357221", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:05.768253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:01:05.893220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ba805f47-db66-4ff0-ae5a-1a075fe7f297 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:05.910623 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ba805f47-db66-4ff0-ae5a-1a075fe7f297 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1314 microversion: 2.1 time: 0.337307 Jan 22 21:01:05.912329 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 200/394] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:05 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:05.986398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-714f2215-048a-443b-96b4-faf0e4f6b567 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:05.987620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-714f2215-048a-443b-96b4-faf0e4f6b567 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:05.995652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-714f2215-048a-443b-96b4-faf0e4f6b567 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:05.997274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-714f2215-048a-443b-96b4-faf0e4f6b567 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:06.000157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-714f2215-048a-443b-96b4-faf0e4f6b567 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:06.000852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-714f2215-048a-443b-96b4-faf0e4f6b567 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:06.243249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-714f2215-048a-443b-96b4-faf0e4f6b567 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:06.260188 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-714f2215-048a-443b-96b4-faf0e4f6b567 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1323 microversion: 2.1 time: 0.284279 Jan 22 21:01:06.263353 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 201/395] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:05 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1323 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:01:06.276872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ac099b2-195f-4cd7-8421-3f3ad2c08e2c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:06.277596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3ac099b2-195f-4cd7-8421-3f3ad2c08e2c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:06.287574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ac099b2-195f-4cd7-8421-3f3ad2c08e2c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:06.288342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ac099b2-195f-4cd7-8421-3f3ad2c08e2c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:06.290253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ac099b2-195f-4cd7-8421-3f3ad2c08e2c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:06.290963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ac099b2-195f-4cd7-8421-3f3ad2c08e2c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:06.649892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:01:06.650413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:01:06.650791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:01:06.651206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:01:06.652819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:01:06.673620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:06.674420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:06.676497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:06.677172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:06.706232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Getting quotas for project 1f91deb350a648bcae33b568d9b99926. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:06.711264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Getting quotas for user b1690e22316547cf9109683ffc9fb714 and project 1f91deb350a648bcae33b568d9b99926. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:06.715858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3ac099b2-195f-4cd7-8421-3f3ad2c08e2c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:06.726721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3ac099b2-195f-4cd7-8421-3f3ad2c08e2c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:06.728839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3ac099b2-195f-4cd7-8421-3f3ad2c08e2c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:06.730685 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3ac099b2-195f-4cd7-8421-3f3ad2c08e2c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1364 microversion: 2.25 time: 0.465473 Jan 22 21:01:06.731947 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 202/396] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:06 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1364 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:06.733219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.utils [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] instances quota exceeded for 1f91deb350a648bcae33b568d9b99926, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=137032) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Jan 22 21:01:06.735106 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jan 22 21:01:06.736006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:06.737054 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fcde28b7-e59f-422d-9fdc-71fbc963426d tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.097163 Jan 22 21:01:06.738741 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 195/397] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:01:05 2022] POST /compute/v2.1/servers => generated 119 bytes in 1099 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:01:06.739786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0a555682-48b7-4f66-84ab-5d96ac0945d2 tempest-FlavorsV2NegativeTest-191092150 tempest-FlavorsV2NegativeTest-191092150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-168797945", "imageRef": "af1cac90-e3f6-4cc2-9c0a-6d2b5216bfe7", "flavorRef": "452"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:06.748147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ebca9f4-fc39-4d8e-a2c2-fec3acb7fc1d tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed6382790>, body: {"quota_set": {"instances": 10}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:06.750289 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:06.750289 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:06.880285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-0a555682-48b7-4f66-84ab-5d96ac0945d2 tempest-FlavorsV2NegativeTest-191092150 tempest-FlavorsV2NegativeTest-191092150-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:01:07.074415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ebca9f4-fc39-4d8e-a2c2-fec3acb7fc1d tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:07.074887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ebca9f4-fc39-4d8e-a2c2-fec3acb7fc1d tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:07.075698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ebca9f4-fc39-4d8e-a2c2-fec3acb7fc1d tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:07.076152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ebca9f4-fc39-4d8e-a2c2-fec3acb7fc1d tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:07.283601 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-0a555682-48b7-4f66-84ab-5d96ac0945d2 tempest-FlavorsV2NegativeTest-191092150 tempest-FlavorsV2NegativeTest-191092150-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jan 22 21:01:07.283601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0a555682-48b7-4f66-84ab-5d96ac0945d2 tempest-FlavorsV2NegativeTest-191092150 tempest-FlavorsV2NegativeTest-191092150-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:07.283601 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0a555682-48b7-4f66-84ab-5d96ac0945d2 tempest-FlavorsV2NegativeTest-191092150 tempest-FlavorsV2NegativeTest-191092150-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.544744 Jan 22 21:01:07.283601 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 203/398] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:01:06 2022] POST /compute/v2.1/servers => generated 93 bytes in 546 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 22 21:01:07.291895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a9912205-e93a-4407-93a5-68eb238a8b4c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:07.292544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a9912205-e93a-4407-93a5-68eb238a8b4c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:07.301576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9912205-e93a-4407-93a5-68eb238a8b4c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:07.305435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9912205-e93a-4407-93a5-68eb238a8b4c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:07.305435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9912205-e93a-4407-93a5-68eb238a8b4c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:07.305435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9912205-e93a-4407-93a5-68eb238a8b4c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:07.316705 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ebca9f4-fc39-4d8e-a2c2-fec3acb7fc1d tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926" status: 200 len: 329 microversion: 2.1 time: 0.571583 Jan 22 21:01:07.317344 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 196/399] 10.222.0.100 () {60 vars in 1266 bytes} [Sat Jan 22 21:01:06 2022] PUT /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926 => generated 329 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:01:07.328167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1918d0a-a028-4714-9435-eb0aa6e81a0d tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:07.328768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1918d0a-a028-4714-9435-eb0aa6e81a0d tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:07.345009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1918d0a-a028-4714-9435-eb0aa6e81a0d tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:07.345650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1918d0a-a028-4714-9435-eb0aa6e81a0d tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:07.346613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1918d0a-a028-4714-9435-eb0aa6e81a0d tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:07.347348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1918d0a-a028-4714-9435-eb0aa6e81a0d tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:07.567863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a9912205-e93a-4407-93a5-68eb238a8b4c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:07.580253 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a9912205-e93a-4407-93a5-68eb238a8b4c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1314 microversion: 2.1 time: 0.300869 Jan 22 21:01:07.582789 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 204/400] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:07 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:07.601582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7614136d-6ea7-402b-8833-0e900ffc354b tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Calling method '.version_select at 0x7f1ed63c9c10>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:07.705144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1918d0a-a028-4714-9435-eb0aa6e81a0d tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:07.724977 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1918d0a-a028-4714-9435-eb0aa6e81a0d tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1323 microversion: 2.1 time: 0.392966 Jan 22 21:01:07.724977 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 197/401] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:07 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1323 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:07.728383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-0c1186e8-4a3a-4866-8d8b-24f79aec56ca req-508078cd-6b44-4d71-b4b3-d65c5bd1d1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99966147-7dbb-4eee-86c6-65e8fdc9f14c", "name": "network-vif-plugged", "status": "completed", "tag": "c4491a12-f660-45ed-b9d7-e57ab1de1fd7"}, {"server_uuid": "34c2ce33-a108-4be0-bb41-068138160281", "name": "network-vif-plugged", "status": "completed", "tag": "bd951644-4535-4dbd-b4a8-1c4994056609"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:07.730020 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:07.730020 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:07.738789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0c1186e8-4a3a-4866-8d8b-24f79aec56ca req-508078cd-6b44-4d71-b4b3-d65c5bd1d1e7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:07.739222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0c1186e8-4a3a-4866-8d8b-24f79aec56ca req-508078cd-6b44-4d71-b4b3-d65c5bd1d1e7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:07.764680 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-0c1186e8-4a3a-4866-8d8b-24f79aec56ca req-508078cd-6b44-4d71-b4b3-d65c5bd1d1e7 service nova] Creating event network-vif-plugged:c4491a12-f660-45ed-b9d7-e57ab1de1fd7 for instance 99966147-7dbb-4eee-86c6-65e8fdc9f14c on nch1-master-1 Jan 22 21:01:07.764680 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-0c1186e8-4a3a-4866-8d8b-24f79aec56ca req-508078cd-6b44-4d71-b4b3-d65c5bd1d1e7 service nova] Creating event network-vif-plugged:bd951644-4535-4dbd-b4a8-1c4994056609 for instance 34c2ce33-a108-4be0-bb41-068138160281 on nch1-master-1 Jan 22 21:01:07.766600 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-0c1186e8-4a3a-4866-8d8b-24f79aec56ca req-508078cd-6b44-4d71-b4b3-d65c5bd1d1e7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044675 Jan 22 21:01:07.767643 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 198/402] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:07.773857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b3e9de69-7492-4a5d-9d0f-12510cb201c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:07.774748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b3e9de69-7492-4a5d-9d0f-12510cb201c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:07.782478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3e9de69-7492-4a5d-9d0f-12510cb201c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:07.782968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3e9de69-7492-4a5d-9d0f-12510cb201c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:07.783822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3e9de69-7492-4a5d-9d0f-12510cb201c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:07.788280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3e9de69-7492-4a5d-9d0f-12510cb201c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:08.408268 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7614136d-6ea7-402b-8833-0e900ffc354b tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926" status: 200 len: 371 microversion: 2.1 time: 0.822362 Jan 22 21:01:08.408268 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 205/403] 10.222.0.100 () {58 vars in 1246 bytes} [Sat Jan 22 21:01:07 2022] GET /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926 => generated 371 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:08.418451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-03caa76f-c2ba-4fe3-8090-a01b941326d6 tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed6482820>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:08.421094 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:08.421094 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:08.703749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b3e9de69-7492-4a5d-9d0f-12510cb201c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:08.711932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b3e9de69-7492-4a5d-9d0f-12510cb201c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:08.713444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b3e9de69-7492-4a5d-9d0f-12510cb201c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:08.714570 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b3e9de69-7492-4a5d-9d0f-12510cb201c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1364 microversion: 2.25 time: 0.945451 Jan 22 21:01:08.715120 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 199/404] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:07 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1364 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:08.730727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3d030f7a-8eed-46ac-8fa8-ffb0003a042a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:08.734612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3d030f7a-8eed-46ac-8fa8-ffb0003a042a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:08.745905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d030f7a-8eed-46ac-8fa8-ffb0003a042a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:08.747154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03caa76f-c2ba-4fe3-8090-a01b941326d6 tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:08.747611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d030f7a-8eed-46ac-8fa8-ffb0003a042a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:08.748393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03caa76f-c2ba-4fe3-8090-a01b941326d6 tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:08.749368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d030f7a-8eed-46ac-8fa8-ffb0003a042a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:08.751111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03caa76f-c2ba-4fe3-8090-a01b941326d6 tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:08.751883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d030f7a-8eed-46ac-8fa8-ffb0003a042a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:08.752355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03caa76f-c2ba-4fe3-8090-a01b941326d6 tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:08.936990 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-03caa76f-c2ba-4fe3-8090-a01b941326d6 tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926" status: 200 len: 325 microversion: 2.1 time: 0.522295 Jan 22 21:01:08.946312 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 206/405] 10.222.0.100 () {60 vars in 1266 bytes} [Sat Jan 22 21:01:08 2022] PUT /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926 => generated 325 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:08.946312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-26393443-1cc7-4bdb-8d44-36f48b871594 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:08.946312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-26393443-1cc7-4bdb-8d44-36f48b871594 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:08.951826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26393443-1cc7-4bdb-8d44-36f48b871594 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:08.958075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26393443-1cc7-4bdb-8d44-36f48b871594 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:08.958075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26393443-1cc7-4bdb-8d44-36f48b871594 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:08.958075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26393443-1cc7-4bdb-8d44-36f48b871594 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:09.103080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3d030f7a-8eed-46ac-8fa8-ffb0003a042a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:09.114031 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3d030f7a-8eed-46ac-8fa8-ffb0003a042a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1497 microversion: 2.1 time: 0.389904 Jan 22 21:01:09.115350 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 200/406] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:08 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1497 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:09.145877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-26393443-1cc7-4bdb-8d44-36f48b871594 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:09.156706 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-26393443-1cc7-4bdb-8d44-36f48b871594 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1323 microversion: 2.1 time: 0.217818 Jan 22 21:01:09.157627 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 207/407] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:08 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1323 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:09.350999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-378113174", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:09.458437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:01:09.521449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-52aac401-aa80-4b33-8139-af300f3b5d16 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:09.522510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-52aac401-aa80-4b33-8139-af300f3b5d16 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:09.546490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52aac401-aa80-4b33-8139-af300f3b5d16 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:09.550960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52aac401-aa80-4b33-8139-af300f3b5d16 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:09.550960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52aac401-aa80-4b33-8139-af300f3b5d16 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:09.550960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52aac401-aa80-4b33-8139-af300f3b5d16 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:09.841393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:01:09.843121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:01:09.843730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:01:09.844165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:01:09.845339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:01:09.880090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:09.884074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:09.885288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:09.885873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:09.925149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Getting quotas for project 1f91deb350a648bcae33b568d9b99926. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:09.936585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Getting quotas for user b1690e22316547cf9109683ffc9fb714 and project 1f91deb350a648bcae33b568d9b99926. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:09.950902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.utils [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] ram quota exceeded for 1f91deb350a648bcae33b568d9b99926, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=137033) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Jan 22 21:01:09.952149 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jan 22 21:01:09.953025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:09.954920 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-98d65706-47af-4889-b22c-dde2a149187a tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.607968 Jan 22 21:01:09.957555 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 208/408] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:01:09 2022] POST /compute/v2.1/servers => generated 110 bytes in 612 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:01:09.971027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-93cb21c6-e42a-428e-861b-15d585ba332f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:09.973990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-93cb21c6-e42a-428e-861b-15d585ba332f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:09.983663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93cb21c6-e42a-428e-861b-15d585ba332f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:09.984758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93cb21c6-e42a-428e-861b-15d585ba332f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:09.986141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93cb21c6-e42a-428e-861b-15d585ba332f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:09.986796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93cb21c6-e42a-428e-861b-15d585ba332f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:10.115915 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-52aac401-aa80-4b33-8139-af300f3b5d16 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1648 microversion: 2.1 time: 0.979302 Jan 22 21:01:10.130374 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 201/409] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:09 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1648 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:10.147682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8150e77f-d58b-47bf-88a4-78f1fdacaccd tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed656cee0>, body: {"quota_set": {"ram": 51200}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:10.153607 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:10.153607 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:10.278116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-93cb21c6-e42a-428e-861b-15d585ba332f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:10.287604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-93cb21c6-e42a-428e-861b-15d585ba332f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:10.290513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-93cb21c6-e42a-428e-861b-15d585ba332f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:10.291950 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-93cb21c6-e42a-428e-861b-15d585ba332f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1560 microversion: 2.25 time: 0.333055 Jan 22 21:01:10.292730 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 209/410] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:09 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1560 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:10.298477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb4fc9ef-c739-4250-bce2-08fcc0cd372b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:10.299281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb4fc9ef-c739-4250-bce2-08fcc0cd372b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:10.308084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb4fc9ef-c739-4250-bce2-08fcc0cd372b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:10.308084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb4fc9ef-c739-4250-bce2-08fcc0cd372b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:10.309032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb4fc9ef-c739-4250-bce2-08fcc0cd372b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:10.309579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb4fc9ef-c739-4250-bce2-08fcc0cd372b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:10.453344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8150e77f-d58b-47bf-88a4-78f1fdacaccd tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:10.453344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8150e77f-d58b-47bf-88a4-78f1fdacaccd tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:10.454526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8150e77f-d58b-47bf-88a4-78f1fdacaccd tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:10.455052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8150e77f-d58b-47bf-88a4-78f1fdacaccd tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:10.540675 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb4fc9ef-c739-4250-bce2-08fcc0cd372b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1648 microversion: 2.1 time: 0.246676 Jan 22 21:01:10.541389 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 210/411] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:10 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1648 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:10.546308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5a7599cb-5f7f-409f-8c60-2afa5f3554c7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:10.547003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5a7599cb-5f7f-409f-8c60-2afa5f3554c7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:10.553280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a7599cb-5f7f-409f-8c60-2afa5f3554c7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:10.553720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a7599cb-5f7f-409f-8c60-2afa5f3554c7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:10.554505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a7599cb-5f7f-409f-8c60-2afa5f3554c7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:10.554942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a7599cb-5f7f-409f-8c60-2afa5f3554c7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:10.671717 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8150e77f-d58b-47bf-88a4-78f1fdacaccd tempest-QuotasAdminNegativeTest-1823185207 tempest-QuotasAdminNegativeTest-1823185207-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926" status: 200 len: 329 microversion: 2.1 time: 0.536808 Jan 22 21:01:10.672499 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 202/412] 10.222.0.100 () {60 vars in 1266 bytes} [Sat Jan 22 21:01:10 2022] PUT /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926 => generated 329 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:10.762557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5a7599cb-5f7f-409f-8c60-2afa5f3554c7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:10.772346 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5a7599cb-5f7f-409f-8c60-2afa5f3554c7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1473 microversion: 2.1 time: 0.229516 Jan 22 21:01:10.773629 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 211/413] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:10 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1473 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:10.796546 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bfce88e5-1ec6-4841-84c1-833ac6951d44 tempest-TenantUsagesNegativeTestJSON-2065910125 tempest-TenantUsagesNegativeTestJSON-2065910125-project-admin] 10.222.0.100 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-01-21T21%3A01%3A10.263663&end=2022-01-23T21%3A01%3A10.263663" status: 404 len: 112 microversion: - time: 0.122628 Jan 22 21:01:10.805303 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 203/414] 10.222.0.100 () {58 vars in 1320 bytes} [Sat Jan 22 21:01:10 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-01-21T21%3A01%3A10.263663&end=2022-01-23T21%3A01%3A10.263663 => generated 112 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 22 21:01:10.809817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e2962c30-69f8-4d21-8613-dd55536e3248 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:10.819261 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:10.819261 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:10.821620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2962c30-69f8-4d21-8613-dd55536e3248 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:10.822239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2962c30-69f8-4d21-8613-dd55536e3248 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:10.823223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2962c30-69f8-4d21-8613-dd55536e3248 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:10.824015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2962c30-69f8-4d21-8613-dd55536e3248 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:10.853132 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e2962c30-69f8-4d21-8613-dd55536e3248 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046745 Jan 22 21:01:10.854271 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 204/415] 10.222.0.100 () {58 vars in 1180 bytes} [Sat Jan 22 21:01:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:10.858914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-609065bd-1815-4169-93ef-798de1958717 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Action: 'update', calling method: .version_select at 0x7f1ed63a6160>, body: {"quota_set": {"ram": 0}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:10.871530 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:10.871530 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:10.872953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-609065bd-1815-4169-93ef-798de1958717 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'b1690e22316547cf9109683ffc9fb714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f91deb350a648bcae33b568d9b99926', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:10.874434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-609065bd-1815-4169-93ef-798de1958717 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:10.875712 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-609065bd-1815-4169-93ef-798de1958717 tempest-QuotasAdminNegativeTest-1147996687 tempest-QuotasAdminNegativeTest-1147996687-project] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926" status: 403 len: 116 microversion: 2.1 time: 0.020263 Jan 22 21:01:10.876755 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 205/416] 10.222.0.100 () {60 vars in 1266 bytes} [Sat Jan 22 21:01:10 2022] PUT /compute/v2.1/os-quota-sets/1f91deb350a648bcae33b568d9b99926 => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:01:11.059839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5b98fd42-fcc9-4356-a9a0-d7e44ba64fe5 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:11.060449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5b98fd42-fcc9-4356-a9a0-d7e44ba64fe5 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:11.069075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b98fd42-fcc9-4356-a9a0-d7e44ba64fe5 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:11.080742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b98fd42-fcc9-4356-a9a0-d7e44ba64fe5 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:11.083168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b98fd42-fcc9-4356-a9a0-d7e44ba64fe5 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:11.083168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b98fd42-fcc9-4356-a9a0-d7e44ba64fe5 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:11.306052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a67eb43e-22a8-46ec-9b18-6ebc3c39f105 tempest-DeleteServersAdminTestJSON-1298935322 tempest-DeleteServersAdminTestJSON-1298935322-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:11.306821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a67eb43e-22a8-46ec-9b18-6ebc3c39f105 tempest-DeleteServersAdminTestJSON-1298935322 tempest-DeleteServersAdminTestJSON-1298935322-project-admin] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:11.326507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a67eb43e-22a8-46ec-9b18-6ebc3c39f105 tempest-DeleteServersAdminTestJSON-1298935322 tempest-DeleteServersAdminTestJSON-1298935322-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:11.328351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a67eb43e-22a8-46ec-9b18-6ebc3c39f105 tempest-DeleteServersAdminTestJSON-1298935322 tempest-DeleteServersAdminTestJSON-1298935322-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:11.330732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a67eb43e-22a8-46ec-9b18-6ebc3c39f105 tempest-DeleteServersAdminTestJSON-1298935322 tempest-DeleteServersAdminTestJSON-1298935322-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:11.331055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a67eb43e-22a8-46ec-9b18-6ebc3c39f105 tempest-DeleteServersAdminTestJSON-1298935322 tempest-DeleteServersAdminTestJSON-1298935322-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:11.343999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-5b98fd42-fcc9-4356-a9a0-d7e44ba64fe5 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'services' on Instance uuid 34c2ce33-a108-4be0-bb41-068138160281 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:01:11.404217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a67eb43e-22a8-46ec-9b18-6ebc3c39f105 tempest-DeleteServersAdminTestJSON-1298935322 tempest-DeleteServersAdminTestJSON-1298935322-project-admin] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:01:11.435789 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5b98fd42-fcc9-4356-a9a0-d7e44ba64fe5 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 2051 microversion: 2.25 time: 0.660721 Jan 22 21:01:11.437023 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 212/417] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:10 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 2051 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:11.445700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-71f6f6c2-f83f-4caf-bf4c-6962b9712877 tempest-TenantUsagesNegativeTestJSON-2065910125 tempest-TenantUsagesNegativeTestJSON-2065910125-project-admin] Calling method '.version_select at 0x7f1ed6378550>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:11.451922 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-71f6f6c2-f83f-4caf-bf4c-6962b9712877 tempest-TenantUsagesNegativeTestJSON-2065910125 tempest-TenantUsagesNegativeTestJSON-2065910125-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jan 22 21:01:11.455830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-71f6f6c2-f83f-4caf-bf4c-6962b9712877 tempest-TenantUsagesNegativeTestJSON-2065910125 tempest-TenantUsagesNegativeTestJSON-2065910125-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:11.462643 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-71f6f6c2-f83f-4caf-bf4c-6962b9712877 tempest-TenantUsagesNegativeTestJSON-2065910125 tempest-TenantUsagesNegativeTestJSON-2065910125-project-admin] 10.222.0.100 "GET /compute/v2.1/os-simple-tenant-usage/d94c8818eed947b0bdecd90f79b970fe?start=2022-01-23T21%3A01%3A10.263663&end=2022-01-21T21%3A01%3A10.263663" status: 400 len: 111 microversion: 2.1 time: 0.024224 Jan 22 21:01:11.463284 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 213/418] 10.222.0.100 () {58 vars in 1416 bytes} [Sat Jan 22 21:01:11 2022] GET /compute/v2.1/os-simple-tenant-usage/d94c8818eed947b0bdecd90f79b970fe?start=2022-01-23T21%3A01%3A10.263663&end=2022-01-21T21%3A01%3A10.263663 => generated 111 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:01:11.476045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d0e070e3-e40e-415c-b1b0-9d4a429a13af tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:11.477278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d0e070e3-e40e-415c-b1b0-9d4a429a13af tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:11.504531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0e070e3-e40e-415c-b1b0-9d4a429a13af tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:11.510681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0e070e3-e40e-415c-b1b0-9d4a429a13af tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:11.512834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0e070e3-e40e-415c-b1b0-9d4a429a13af tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:11.514977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0e070e3-e40e-415c-b1b0-9d4a429a13af tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:11.714846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-d0e070e3-e40e-415c-b1b0-9d4a429a13af tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lazy-loading 'flavor' on Instance uuid 077c7fdf-b28f-48a5-9c20-4b5b45babfed {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:01:11.806301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d0e070e3-e40e-415c-b1b0-9d4a429a13af tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Going to try to live migrate instance to nch2-master-1 {{(pid=137033) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 22 21:01:11.872762 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a67eb43e-22a8-46ec-9b18-6ebc3c39f105 tempest-DeleteServersAdminTestJSON-1298935322 tempest-DeleteServersAdminTestJSON-1298935322-project-admin] 10.222.0.100 "DELETE /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 204 len: 0 microversion: 2.1 time: 0.994073 Jan 22 21:01:11.873761 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 206/419] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:01:10 2022] DELETE /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 0 bytes in 996 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:01:11.882884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e5dfaa82-ca60-4062-b004-9fddea9033d8 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:11.884020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e5dfaa82-ca60-4062-b004-9fddea9033d8 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:11.900306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5dfaa82-ca60-4062-b004-9fddea9033d8 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:11.902954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5dfaa82-ca60-4062-b004-9fddea9033d8 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:11.904482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5dfaa82-ca60-4062-b004-9fddea9033d8 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:11.905166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5dfaa82-ca60-4062-b004-9fddea9033d8 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:12.523534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-e5dfaa82-ca60-4062-b004-9fddea9033d8 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'services' on Instance uuid 34c2ce33-a108-4be0-bb41-068138160281 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:01:12.635748 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e5dfaa82-ca60-4062-b004-9fddea9033d8 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 2051 microversion: 2.25 time: 0.760002 Jan 22 21:01:12.636894 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 207/420] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:11 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 2051 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:12.975478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-017ae9e8-7e6d-4857-a4bb-859e43818ada tempest-TenantUsagesNegativeTestJSON-659418583 tempest-TenantUsagesNegativeTestJSON-659418583-project] Calling method '.version_select at 0x7f1ed86d94c0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:12.977977 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-simple-tenant-usage:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:12.977977 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:12.979943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-017ae9e8-7e6d-4857-a4bb-859e43818ada tempest-TenantUsagesNegativeTestJSON-659418583 tempest-TenantUsagesNegativeTestJSON-659418583-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '378092794c934235af9a867a9523c10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd94c8818eed947b0bdecd90f79b970fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:12.980724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-017ae9e8-7e6d-4857-a4bb-859e43818ada tempest-TenantUsagesNegativeTestJSON-659418583 tempest-TenantUsagesNegativeTestJSON-659418583-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:12.981581 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-017ae9e8-7e6d-4857-a4bb-859e43818ada tempest-TenantUsagesNegativeTestJSON-659418583 tempest-TenantUsagesNegativeTestJSON-659418583-project] 10.222.0.100 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-01-21T21%3A01%3A10.263663&end=2022-01-23T21%3A01%3A10.263663&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.343075 Jan 22 21:01:12.982271 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 208/421] 10.222.0.100 () {58 vars in 1339 bytes} [Sat Jan 22 21:01:12 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-01-21T21%3A01%3A10.263663&end=2022-01-23T21%3A01%3A10.263663&detailed=1 => generated 123 bytes in 345 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:01:12.990331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8d2766b8-7c17-40d4-8132-38e3c7d0de94 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:12.993078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8d2766b8-7c17-40d4-8132-38e3c7d0de94 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:13.006994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d2766b8-7c17-40d4-8132-38e3c7d0de94 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:13.007458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d2766b8-7c17-40d4-8132-38e3c7d0de94 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:13.008347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d2766b8-7c17-40d4-8132-38e3c7d0de94 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:13.008977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d2766b8-7c17-40d4-8132-38e3c7d0de94 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:13.211602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8d2766b8-7c17-40d4-8132-38e3c7d0de94 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:13.219627 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8d2766b8-7c17-40d4-8132-38e3c7d0de94 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 200 len: 1479 microversion: 2.1 time: 0.236217 Jan 22 21:01:13.220195 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 209/422] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:12 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 1479 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:13.242782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-50373326-5dc7-4201-8f71-8bf52a4c8279 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:13.242782 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:13.242782 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:13.242782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50373326-5dc7-4201-8f71-8bf52a4c8279 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:13.242782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50373326-5dc7-4201-8f71-8bf52a4c8279 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:13.243864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50373326-5dc7-4201-8f71-8bf52a4c8279 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:13.245241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50373326-5dc7-4201-8f71-8bf52a4c8279 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:13.275872 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-50373326-5dc7-4201-8f71-8bf52a4c8279 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.052088 Jan 22 21:01:13.276730 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 210/423] 10.222.0.100 () {60 vars in 1221 bytes} [Sat Jan 22 21:01:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:01:13.289256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-668acccf-de5f-40cb-b83e-6dd05c16ad34 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:13.290372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-668acccf-de5f-40cb-b83e-6dd05c16ad34 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:13.297738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-668acccf-de5f-40cb-b83e-6dd05c16ad34 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:13.301330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-668acccf-de5f-40cb-b83e-6dd05c16ad34 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:13.301330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-668acccf-de5f-40cb-b83e-6dd05c16ad34 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:13.301330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-668acccf-de5f-40cb-b83e-6dd05c16ad34 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:15.002091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-668acccf-de5f-40cb-b83e-6dd05c16ad34 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'flavor' on Instance uuid 34c2ce33-a108-4be0-bb41-068138160281 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:01:15.064969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-668acccf-de5f-40cb-b83e-6dd05c16ad34 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Going to try to live migrate instance to nch2-master-1 {{(pid=137032) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 22 21:01:18.658781 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d0e070e3-e40e-415c-b1b0-9d4a429a13af tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed/action" status: 202 len: 0 microversion: 2.1 time: 7.187120 Jan 22 21:01:18.661091 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 214/424] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:01:11 2022] POST /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed/action => generated 0 bytes in 7196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:01:18.667929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-010d4afb-5223-47fb-abea-5098eb02a1f3 req-9a6fd4a2-f910-4260-865c-56803128aa75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99966147-7dbb-4eee-86c6-65e8fdc9f14c", "name": "network-vif-deleted", "tag": "c4491a12-f660-45ed-b9d7-e57ab1de1fd7"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:18.670793 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:18.670793 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:18.688921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-010d4afb-5223-47fb-abea-5098eb02a1f3 req-9a6fd4a2-f910-4260-865c-56803128aa75 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:18.688921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-010d4afb-5223-47fb-abea-5098eb02a1f3 req-9a6fd4a2-f910-4260-865c-56803128aa75 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:18.718070 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-010d4afb-5223-47fb-abea-5098eb02a1f3 req-9a6fd4a2-f910-4260-865c-56803128aa75 service nova] Creating event network-vif-deleted:c4491a12-f660-45ed-b9d7-e57ab1de1fd7 for instance 99966147-7dbb-4eee-86c6-65e8fdc9f14c on nch1-master-1 Jan 22 21:01:18.731152 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-010d4afb-5223-47fb-abea-5098eb02a1f3 req-9a6fd4a2-f910-4260-865c-56803128aa75 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063487 Jan 22 21:01:18.741112 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 215/425] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:19.014399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7adf0fc8-c59e-4738-a2d3-0aa0b1b30b59 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:19.024359 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7adf0fc8-c59e-4738-a2d3-0aa0b1b30b59 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.287873 Jan 22 21:01:19.033622 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 216/426] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:01:18 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:19.044576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3c68aaa7-526d-4388-91c3-4019fae312fb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:19.045175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3c68aaa7-526d-4388-91c3-4019fae312fb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:19.052480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c68aaa7-526d-4388-91c3-4019fae312fb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:19.054102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c68aaa7-526d-4388-91c3-4019fae312fb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:19.055071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c68aaa7-526d-4388-91c3-4019fae312fb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:19.055655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c68aaa7-526d-4388-91c3-4019fae312fb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:19.090564 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-3c68aaa7-526d-4388-91c3-4019fae312fb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] HTTP exception thrown: Instance 99966147-7dbb-4eee-86c6-65e8fdc9f14c could not be found. Jan 22 21:01:19.091167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3c68aaa7-526d-4388-91c3-4019fae312fb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Returning 404 to user: Instance 99966147-7dbb-4eee-86c6-65e8fdc9f14c could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:19.092521 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3c68aaa7-526d-4388-91c3-4019fae312fb tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 404 len: 111 microversion: 2.1 time: 0.057007 Jan 22 21:01:19.093876 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 217/427] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:19 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:01:19.111670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3131349a-c572-4e20-aeae-17e3febe186c tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Calling method '.version_select at 0x7f1ed619e160>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:19.176503 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3131349a-c572-4e20-aeae-17e3febe186c tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "GET /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742" status: 200 len: 639 microversion: 2.1 time: 0.081300 Jan 22 21:01:19.179001 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 218/428] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:01:19 2022] GET /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742 => generated 639 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:19.188293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d75d0f4f-6d03-4d0e-addc-61c7fa2cd0e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:19.188889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d75d0f4f-6d03-4d0e-addc-61c7fa2cd0e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:19.201839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d75d0f4f-6d03-4d0e-addc-61c7fa2cd0e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:19.202289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d75d0f4f-6d03-4d0e-addc-61c7fa2cd0e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:19.203093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d75d0f4f-6d03-4d0e-addc-61c7fa2cd0e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:19.209899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d75d0f4f-6d03-4d0e-addc-61c7fa2cd0e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:19.652804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d75d0f4f-6d03-4d0e-addc-61c7fa2cd0e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:19.661814 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d75d0f4f-6d03-4d0e-addc-61c7fa2cd0e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1507 microversion: 2.1 time: 0.480268 Jan 22 21:01:19.662434 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 219/429] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:19 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1507 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:19.966459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-069023cc-6e9b-48db-8059-ae781ecaa5a7 tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1444183379", "id": 155056716, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:19.969684 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:19.969684 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:19.984162 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-668acccf-de5f-40cb-b83e-6dd05c16ad34 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281/action" status: 202 len: 0 microversion: 2.25 time: 6.700083 Jan 22 21:01:19.984783 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 211/430] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:01:13 2022] POST /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281/action => generated 0 bytes in 6701 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:01:19.990673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-830b1bf1-23dd-4d87-8aed-6b5a868ce917 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Action: 'update_all', calling method: .version_select at 0x7f1ed6382c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:20.068846 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-069023cc-6e9b-48db-8059-ae781ecaa5a7 tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.388568 Jan 22 21:01:20.069634 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 220/431] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:01:19 2022] POST /compute/v2.1/flavors => generated 424 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:20.087479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-258204570", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:20.097748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-830b1bf1-23dd-4d87-8aed-6b5a868ce917 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:20.139641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-830b1bf1-23dd-4d87-8aed-6b5a868ce917 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for user 0b8d2f41f06d461f9ca41f37f332fc8e and project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:20.178312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:01:20.726119 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-830b1bf1-23dd-4d87-8aed-6b5a868ce917 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata" status: 200 len: 61 microversion: 2.1 time: 0.739870 Jan 22 21:01:20.727115 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 212/432] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:01:19 2022] PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata => generated 61 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:20.732856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-52ea4cfa-efa2-4d99-93a9-c1bb1725ac9a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:20.733917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-52ea4cfa-efa2-4d99-93a9-c1bb1725ac9a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:20.745484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52ea4cfa-efa2-4d99-93a9-c1bb1725ac9a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:20.746418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52ea4cfa-efa2-4d99-93a9-c1bb1725ac9a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:20.747374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52ea4cfa-efa2-4d99-93a9-c1bb1725ac9a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:20.747919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52ea4cfa-efa2-4d99-93a9-c1bb1725ac9a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:20.765601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:01:20.766117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:01:20.766505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:01:20.767612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:01:20.768039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:01:20.788680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:20.791299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:20.792383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:20.794051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:20.820246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Getting quotas for project cfbdb8e94e9c48f49f240f4eecde539a. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:20.827938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Getting quotas for user 4f8e24e6af4842f6b280ceaba346cd08 and project cfbdb8e94e9c48f49f240f4eecde539a. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:20.849089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:01:20.853990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:01:20.994136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-52ea4cfa-efa2-4d99-93a9-c1bb1725ac9a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:21.005768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-52ea4cfa-efa2-4d99-93a9-c1bb1725ac9a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:21.007880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-52ea4cfa-efa2-4d99-93a9-c1bb1725ac9a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:21.009059 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-52ea4cfa-efa2-4d99-93a9-c1bb1725ac9a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1570 microversion: 2.25 time: 0.280597 Jan 22 21:01:21.009811 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 213/433] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:20 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1570 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:21.014589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9214fbf7-c7ed-404e-85cd-2aadcc0ca9bd tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:21.025194 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9214fbf7-c7ed-404e-85cd-2aadcc0ca9bd tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014063 Jan 22 21:01:21.025839 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 214/434] 10.222.0.100 () {58 vars in 1186 bytes} [Sat Jan 22 21:01:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:21.030475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a0175eca-d70f-4945-afed-9f319278efe6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:21.031284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a0175eca-d70f-4945-afed-9f319278efe6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:21.039065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0175eca-d70f-4945-afed-9f319278efe6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:21.039560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0175eca-d70f-4945-afed-9f319278efe6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:21.040431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0175eca-d70f-4945-afed-9f319278efe6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:21.040875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0175eca-d70f-4945-afed-9f319278efe6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:21.054822 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8cd8d8ff-06d8-4fda-96c3-3657e34e8efa tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.973874 Jan 22 21:01:21.056070 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 221/435] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:01:20 2022] POST /compute/v2.1/servers => generated 382 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:01:21.061225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-20b92412-bcaf-4035-85ca-e7f8d5064b05 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Calling method '.version_select at 0x7f1ed619e550>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:21.534767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a0175eca-d70f-4945-afed-9f319278efe6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:21.544397 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a0175eca-d70f-4945-afed-9f319278efe6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1507 microversion: 2.1 time: 0.517066 Jan 22 21:01:21.545719 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 215/436] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:21 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1507 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:21.552208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-62af1e12-2ea2-48e1-9e10-082b98529f6d req-4827983e-fd86-4e53-a9aa-f79210e85fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077c7fdf-b28f-48a5-9c20-4b5b45babfed", "name": "network-vif-unplugged", "status": "completed", "tag": "4892bd95-44cd-4f32-8d2d-11536ea7b4ee"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:21.554214 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:21.554214 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:21.562604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-62af1e12-2ea2-48e1-9e10-082b98529f6d req-4827983e-fd86-4e53-a9aa-f79210e85fc5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:21.563341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-62af1e12-2ea2-48e1-9e10-082b98529f6d req-4827983e-fd86-4e53-a9aa-f79210e85fc5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:21.579194 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-62af1e12-2ea2-48e1-9e10-082b98529f6d req-4827983e-fd86-4e53-a9aa-f79210e85fc5 service nova] Creating event network-vif-unplugged:4892bd95-44cd-4f32-8d2d-11536ea7b4ee for instance 077c7fdf-b28f-48a5-9c20-4b5b45babfed on nch1-master-1 Jan 22 21:01:21.585321 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-62af1e12-2ea2-48e1-9e10-082b98529f6d req-4827983e-fd86-4e53-a9aa-f79210e85fc5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037361 Jan 22 21:01:21.586388 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 216/437] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:21.591924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2fbb04d6-f0f1-42dd-902e-e57a43c3b682 tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-755900476", "id": 40083115, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:21.593496 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:21.593496 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:21.681144 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-20b92412-bcaf-4035-85ca-e7f8d5064b05 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "DELETE /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.623822 Jan 22 21:01:21.682061 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 222/438] 10.222.0.100 () {58 vars in 1300 bytes} [Sat Jan 22 21:01:21 2022] DELETE /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata/os_version => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:01:21.687379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8277244d-6eee-4c4e-ad51-90ffb919c169 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:21.688228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8277244d-6eee-4c4e-ad51-90ffb919c169 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:21.691156 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2fbb04d6-f0f1-42dd-902e-e57a43c3b682 tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 420 microversion: 2.1 time: 0.101930 Jan 22 21:01:21.698011 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 217/439] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:01:21 2022] POST /compute/v2.1/flavors => generated 420 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:21.706143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-50e47015-969a-4508-8aad-957ae762d38e tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Calling method '.version_select at 0x7f1ed618a5e0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:21.781071 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-50e47015-969a-4508-8aad-957ae762d38e tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "GET /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata" status: 200 len: 37 microversion: 2.1 time: 0.087041 Jan 22 21:01:21.787395 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 218/440] 10.222.0.100 () {58 vars in 1264 bytes} [Sat Jan 22 21:01:21 2022] GET /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata => generated 37 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:21.793988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad89c776-f61f-4036-951e-6972f90b1da9 tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:21.802616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8277244d-6eee-4c4e-ad51-90ffb919c169 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:21.810156 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8277244d-6eee-4c4e-ad51-90ffb919c169 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1223 microversion: 2.1 time: 0.126495 Jan 22 21:01:21.814137 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 223/441] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:21 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1223 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:21.822425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cca7a4a5-1258-4c00-ab65-05b4f5f71219 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Action: 'update_all', calling method: .version_select at 0x7f1ed61a3e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:21.831021 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad89c776-f61f-4036-951e-6972f90b1da9 tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.035807 Jan 22 21:01:21.831021 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 219/442] 10.222.0.100 () {58 vars in 1186 bytes} [Sat Jan 22 21:01:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:21.842291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61be8a69-5810-4ce0-ae6e-df73db1eba42 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'create', calling method: .version_select at 0x7f1ed61df430>, body: {"keypair": {"name": "tempest-keypair-563767088"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:21.882763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-61be8a69-5810-4ce0-ae6e-df73db1eba42 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Getting quotas for project adbc7daf2ad2476fb707aab0b887c7be. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:21.894491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-61be8a69-5810-4ce0-ae6e-df73db1eba42 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Getting quotas for user b417a76de72c45a899648d658713bafc and project adbc7daf2ad2476fb707aab0b887c7be. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:21.912144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-cca7a4a5-1258-4c00-ab65-05b4f5f71219 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:21.924408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-cca7a4a5-1258-4c00-ab65-05b4f5f71219 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for user 0b8d2f41f06d461f9ca41f37f332fc8e and project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:22.507875 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cca7a4a5-1258-4c00-ab65-05b4f5f71219 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata" status: 200 len: 61 microversion: 2.1 time: 0.692263 Jan 22 21:01:22.512819 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 224/443] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:01:21 2022] PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata => generated 61 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:22.523677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5475420a-1cad-4495-988d-0d6fc7a3ea98 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:22.524575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5475420a-1cad-4495-988d-0d6fc7a3ea98 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:22.531171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5475420a-1cad-4495-988d-0d6fc7a3ea98 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:22.531817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5475420a-1cad-4495-988d-0d6fc7a3ea98 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:22.532938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5475420a-1cad-4495-988d-0d6fc7a3ea98 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:22.533562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5475420a-1cad-4495-988d-0d6fc7a3ea98 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:22.797392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5475420a-1cad-4495-988d-0d6fc7a3ea98 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:22.798585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-61be8a69-5810-4ce0-ae6e-df73db1eba42 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Getting quotas for project adbc7daf2ad2476fb707aab0b887c7be. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:22.807161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5475420a-1cad-4495-988d-0d6fc7a3ea98 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:22.808832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5475420a-1cad-4495-988d-0d6fc7a3ea98 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:22.809000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-61be8a69-5810-4ce0-ae6e-df73db1eba42 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Getting quotas for user b417a76de72c45a899648d658713bafc and project adbc7daf2ad2476fb707aab0b887c7be. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:22.814554 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5475420a-1cad-4495-988d-0d6fc7a3ea98 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1570 microversion: 2.25 time: 0.300092 Jan 22 21:01:22.816185 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 225/444] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:22 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1570 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:22.823667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-92e2e62a-14d3-4ea1-9413-47fc2265e7ef tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Calling method '.version_select at 0x7f1ed60f93a0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:22.832935 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61be8a69-5810-4ce0-ae6e-df73db1eba42 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.000146 Jan 22 21:01:22.833655 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 220/445] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:01:21 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:22.846552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-84307488-a37f-4696-81f1-4dc8cd45bbf5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:22.847909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-84307488-a37f-4696-81f1-4dc8cd45bbf5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:22.854902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84307488-a37f-4696-81f1-4dc8cd45bbf5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:22.855370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84307488-a37f-4696-81f1-4dc8cd45bbf5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:22.856179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84307488-a37f-4696-81f1-4dc8cd45bbf5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:22.856632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84307488-a37f-4696-81f1-4dc8cd45bbf5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:22.916312 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-92e2e62a-14d3-4ea1-9413-47fc2265e7ef tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "GET /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.093550 Jan 22 21:01:22.916312 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 226/446] 10.222.0.100 () {58 vars in 1294 bytes} [Sat Jan 22 21:01:22 2022] GET /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata/os_distro => generated 33 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:22.918469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-926c7331-1d34-4d21-8c90-e55c5ecf3530 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:22.919096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-926c7331-1d34-4d21-8c90-e55c5ecf3530 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:22.929931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-926c7331-1d34-4d21-8c90-e55c5ecf3530 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:22.930448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-926c7331-1d34-4d21-8c90-e55c5ecf3530 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:22.931426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-926c7331-1d34-4d21-8c90-e55c5ecf3530 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:22.932070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-926c7331-1d34-4d21-8c90-e55c5ecf3530 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:23.218278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-926c7331-1d34-4d21-8c90-e55c5ecf3530 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:23.251303 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-926c7331-1d34-4d21-8c90-e55c5ecf3530 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1219 microversion: 2.1 time: 0.331053 Jan 22 21:01:23.251303 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 227/447] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:22 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1219 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:23.254195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1e5d1790-2c9c-445a-844c-db48bbe8f848 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Action: 'update_all', calling method: .version_select at 0x7f1ed6165ee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:23.326875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-1e5d1790-2c9c-445a-844c-db48bbe8f848 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:23.336915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-1e5d1790-2c9c-445a-844c-db48bbe8f848 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for user 0b8d2f41f06d461f9ca41f37f332fc8e and project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:23.399867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-84307488-a37f-4696-81f1-4dc8cd45bbf5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:23.413763 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-84307488-a37f-4696-81f1-4dc8cd45bbf5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1507 microversion: 2.1 time: 0.578942 Jan 22 21:01:23.417415 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 221/448] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:22 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1507 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:23.672042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-583b17d5-0e51-4487-b6c5-340f69699b96 req-29991141-afd4-4ec5-b4be-2d037768ecbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "077c7fdf-b28f-48a5-9c20-4b5b45babfed", "tag": "4892bd95-44cd-4f32-8d2d-11536ea7b4ee"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:23.674001 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:23.674001 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:23.696912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-583b17d5-0e51-4487-b6c5-340f69699b96 req-29991141-afd4-4ec5-b4be-2d037768ecbc service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:23.697662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-583b17d5-0e51-4487-b6c5-340f69699b96 req-29991141-afd4-4ec5-b4be-2d037768ecbc service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:23.738379 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-583b17d5-0e51-4487-b6c5-340f69699b96 req-29991141-afd4-4ec5-b4be-2d037768ecbc service nova] Creating event network-changed:4892bd95-44cd-4f32-8d2d-11536ea7b4ee for instance 077c7fdf-b28f-48a5-9c20-4b5b45babfed on nch1-master-1 Jan 22 21:01:23.755374 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-583b17d5-0e51-4487-b6c5-340f69699b96 req-29991141-afd4-4ec5-b4be-2d037768ecbc service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088265 Jan 22 21:01:23.757828 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 222/449] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:01:23.796940 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1e5d1790-2c9c-445a-844c-db48bbe8f848 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata" status: 200 len: 61 microversion: 2.1 time: 0.545173 Jan 22 21:01:23.796940 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 228/450] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:01:23 2022] PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata => generated 61 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:23.808632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fbe9a977-a740-417d-b6da-d02efed8343a tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Calling method '.version_select at 0x7f1ed61df670>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:23.843567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ca352944-9e83-4908-b305-b223a587e1da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:23.847089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ca352944-9e83-4908-b305-b223a587e1da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:23.859540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca352944-9e83-4908-b305-b223a587e1da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:23.864453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca352944-9e83-4908-b305-b223a587e1da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:23.867892 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fbe9a977-a740-417d-b6da-d02efed8343a tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "GET /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata" status: 200 len: 61 microversion: 2.1 time: 0.065195 Jan 22 21:01:23.868929 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 223/451] 10.222.0.100 () {58 vars in 1264 bytes} [Sat Jan 22 21:01:23 2022] GET /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata => generated 61 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:23.870138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca352944-9e83-4908-b305-b223a587e1da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:23.873306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca352944-9e83-4908-b305-b223a587e1da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:23.879166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ce174f28-2ba5-4ab5-849e-704f76690da6 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Action: 'update_all', calling method: .version_select at 0x7f1ed61dfe50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:23.972784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ce174f28-2ba5-4ab5-849e-704f76690da6 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:23.979779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ce174f28-2ba5-4ab5-849e-704f76690da6 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for user 0b8d2f41f06d461f9ca41f37f332fc8e and project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:24.372595 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ce174f28-2ba5-4ab5-849e-704f76690da6 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata" status: 200 len: 61 microversion: 2.1 time: 0.497666 Jan 22 21:01:24.396156 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 224/452] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:01:23 2022] PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata => generated 61 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:01:24.402674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ca352944-9e83-4908-b305-b223a587e1da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:24.418553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ca352944-9e83-4908-b305-b223a587e1da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:24.420675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ca352944-9e83-4908-b305-b223a587e1da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:24.422790 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ca352944-9e83-4908-b305-b223a587e1da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1570 microversion: 2.25 time: 0.588233 Jan 22 21:01:24.440124 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 229/453] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:23 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1570 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:24.450173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7ab7854c-b36a-4d8c-a6df-1054ec4257ec tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:24.450173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7ab7854c-b36a-4d8c-a6df-1054ec4257ec tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:24.464338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ab7854c-b36a-4d8c-a6df-1054ec4257ec tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:24.464799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ab7854c-b36a-4d8c-a6df-1054ec4257ec tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:24.465640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ab7854c-b36a-4d8c-a6df-1054ec4257ec tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:24.466085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ab7854c-b36a-4d8c-a6df-1054ec4257ec tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:24.584430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7ab7854c-b36a-4d8c-a6df-1054ec4257ec tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:24.591825 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7ab7854c-b36a-4d8c-a6df-1054ec4257ec tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1281 microversion: 2.1 time: 0.149895 Jan 22 21:01:24.592687 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 230/454] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:24 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1281 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:24.607611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-42515dd5-b030-471a-8634-7bd135c8cd85 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Action: 'update_all', calling method: .version_select at 0x7f1ed6105430>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:24.679770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-42515dd5-b030-471a-8634-7bd135c8cd85 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:24.684928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-42515dd5-b030-471a-8634-7bd135c8cd85 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for user 0b8d2f41f06d461f9ca41f37f332fc8e and project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:24.771166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1555545887", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "4a2c59ad-01e2-4c50-bbab-aa5b1350e16a"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:24.901819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] validate_networks() for [('4a2c59ad-01e2-4c50-bbab-aa5b1350e16a', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:01:25.334966 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-42515dd5-b030-471a-8634-7bd135c8cd85 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata" status: 200 len: 64 microversion: 2.1 time: 0.731329 Jan 22 21:01:25.338991 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 231/455] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:01:24 2022] PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata => generated 64 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:25.340723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-470c2fdd-4685-4686-b6d9-b6a274c97569 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:25.341351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-470c2fdd-4685-4686-b6d9-b6a274c97569 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:25.350586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-470c2fdd-4685-4686-b6d9-b6a274c97569 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:25.350908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-470c2fdd-4685-4686-b6d9-b6a274c97569 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:25.351627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-470c2fdd-4685-4686-b6d9-b6a274c97569 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:25.352071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-470c2fdd-4685-4686-b6d9-b6a274c97569 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:25.797200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-470c2fdd-4685-4686-b6d9-b6a274c97569 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:25.806301 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-470c2fdd-4685-4686-b6d9-b6a274c97569 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1507 microversion: 2.1 time: 0.469450 Jan 22 21:01:25.806910 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 232/456] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:25 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:25.824458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e17908c5-647a-488b-9614-2ad105587c04 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Calling method '.version_select at 0x7f1ed61a8af0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:25.908392 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e17908c5-647a-488b-9614-2ad105587c04 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "GET /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata" status: 200 len: 64 microversion: 2.1 time: 0.097711 Jan 22 21:01:25.908976 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 233/457] 10.222.0.100 () {58 vars in 1264 bytes} [Sat Jan 22 21:01:25 2022] GET /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata => generated 64 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:25.919815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cd209630-7d2e-4c20-979b-75090d8d7f3e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:25.922214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cd209630-7d2e-4c20-979b-75090d8d7f3e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:25.945583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd209630-7d2e-4c20-979b-75090d8d7f3e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:25.946400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd209630-7d2e-4c20-979b-75090d8d7f3e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:25.947613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd209630-7d2e-4c20-979b-75090d8d7f3e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:25.948064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd209630-7d2e-4c20-979b-75090d8d7f3e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:26.030993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:01:26.033817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:01:26.036294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:01:26.037575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:01:26.039011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:01:26.052612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:26.053464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:26.055404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:26.056018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:26.080125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Getting quotas for project 0ca97602282f40168d95eb37d81f93e4. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:26.085959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Getting quotas for user c921b8a098454af8becc1074ab0eb4ff and project 0ca97602282f40168d95eb37d81f93e4. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:26.100661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:01:26.102907 ncdv-master-1 devstack@n-api.service[137032]: WARNING nova.utils [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1555545887 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-155554588 Jan 22 21:01:26.103828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:01:26.228768 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b8f71cb9-8fc9-4db9-afdf-78f3b316a114 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.831143 Jan 22 21:01:26.235267 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 225/458] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:01:24 2022] POST /compute/v2.1/servers => generated 382 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:01:26.235946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f2bacfd2-460e-4465-af69-35e45b3c11b9 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:26.236558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f2bacfd2-460e-4465-af69-35e45b3c11b9 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:26.244113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2bacfd2-460e-4465-af69-35e45b3c11b9 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:26.244570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2bacfd2-460e-4465-af69-35e45b3c11b9 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:26.246460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2bacfd2-460e-4465-af69-35e45b3c11b9 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:26.246460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2bacfd2-460e-4465-af69-35e45b3c11b9 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:26.503639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f2bacfd2-460e-4465-af69-35e45b3c11b9 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:26.513150 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f2bacfd2-460e-4465-af69-35e45b3c11b9 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1323 microversion: 2.1 time: 0.281840 Jan 22 21:01:26.516840 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 226/459] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:26 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1323 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:26.527121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9f646996-75a7-4c28-8dca-20906fc44ffb tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Action: 'update_all', calling method: .version_select at 0x7f1ed61df160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:26.583773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-9f646996-75a7-4c28-8dca-20906fc44ffb tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:26.588392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-9f646996-75a7-4c28-8dca-20906fc44ffb tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for user 0b8d2f41f06d461f9ca41f37f332fc8e and project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:26.756910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cd209630-7d2e-4c20-979b-75090d8d7f3e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:26.773772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cd209630-7d2e-4c20-979b-75090d8d7f3e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:26.790698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cd209630-7d2e-4c20-979b-75090d8d7f3e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:26.791940 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cd209630-7d2e-4c20-979b-75090d8d7f3e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1570 microversion: 2.25 time: 0.876413 Jan 22 21:01:26.792724 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 234/460] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:25 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1570 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:26.806925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-70e69349-5448-42f2-9d3b-cc2164198aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:26.807909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-70e69349-5448-42f2-9d3b-cc2164198aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:27.003146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-70e69349-5448-42f2-9d3b-cc2164198aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c921b8a098454af8becc1074ab0eb4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca97602282f40168d95eb37d81f93e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:27.003146 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-70e69349-5448-42f2-9d3b-cc2164198aa8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 200 len: 1236 microversion: 2.1 time: 0.161878 Jan 22 21:01:27.003146 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 235/461] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:26 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 1236 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:27.003146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dbe3cf9f-1088-497e-8fc2-8c762d79f147 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:27.004735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dbe3cf9f-1088-497e-8fc2-8c762d79f147 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:27.004735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbe3cf9f-1088-497e-8fc2-8c762d79f147 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:27.004735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbe3cf9f-1088-497e-8fc2-8c762d79f147 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:27.004735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbe3cf9f-1088-497e-8fc2-8c762d79f147 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:27.005161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbe3cf9f-1088-497e-8fc2-8c762d79f147 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:27.303354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dbe3cf9f-1088-497e-8fc2-8c762d79f147 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:27.303354 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dbe3cf9f-1088-497e-8fc2-8c762d79f147 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1507 microversion: 2.1 time: 0.218180 Jan 22 21:01:27.303354 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 236/462] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:26 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:27.531475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-61bd9104-337c-4e62-be99-b163afa1dec7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:27.533686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-61bd9104-337c-4e62-be99-b163afa1dec7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:27.549442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61bd9104-337c-4e62-be99-b163afa1dec7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:27.555570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61bd9104-337c-4e62-be99-b163afa1dec7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:27.563798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61bd9104-337c-4e62-be99-b163afa1dec7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:27.564219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61bd9104-337c-4e62-be99-b163afa1dec7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:27.595144 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9f646996-75a7-4c28-8dca-20906fc44ffb tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata" status: 200 len: 61 microversion: 2.1 time: 1.072518 Jan 22 21:01:27.595881 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 227/463] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:01:26 2022] PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata => generated 61 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:27.609213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e1247c5f-6ae3-46ac-9716-fbc82583923f tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Action: 'update', calling method: .version_select at 0x7f1ed6191040>, body: {"meta": {"os_version": "alt"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:27.707113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e1247c5f-6ae3-46ac-9716-fbc82583923f tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:27.707113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e1247c5f-6ae3-46ac-9716-fbc82583923f tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for user 0b8d2f41f06d461f9ca41f37f332fc8e and project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:28.340272 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e1247c5f-6ae3-46ac-9716-fbc82583923f tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.737048 Jan 22 21:01:28.341006 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 228/464] 10.222.0.100 () {60 vars in 1317 bytes} [Sat Jan 22 21:01:27 2022] PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata/os_version => generated 31 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:28.346100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d3e5df9-b627-45bd-a5c6-200b25cd0138 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:28.354275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d3e5df9-b627-45bd-a5c6-200b25cd0138 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:28.357732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d3e5df9-b627-45bd-a5c6-200b25cd0138 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:28.358971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d3e5df9-b627-45bd-a5c6-200b25cd0138 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:28.360120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d3e5df9-b627-45bd-a5c6-200b25cd0138 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:28.360591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d3e5df9-b627-45bd-a5c6-200b25cd0138 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:28.504759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-61bd9104-337c-4e62-be99-b163afa1dec7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:28.513767 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-61bd9104-337c-4e62-be99-b163afa1dec7 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1323 microversion: 2.1 time: 0.986356 Jan 22 21:01:28.523360 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 237/465] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:27 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1323 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:28.525438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eb2f0fbb-028b-4654-a41d-274e1ca8dea1 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:28.526430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eb2f0fbb-028b-4654-a41d-274e1ca8dea1 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:28.533365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb2f0fbb-028b-4654-a41d-274e1ca8dea1 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:28.533857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb2f0fbb-028b-4654-a41d-274e1ca8dea1 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:28.535988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb2f0fbb-028b-4654-a41d-274e1ca8dea1 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:28.537271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb2f0fbb-028b-4654-a41d-274e1ca8dea1 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:28.546480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0d3e5df9-b627-45bd-a5c6-200b25cd0138 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:28.556005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0d3e5df9-b627-45bd-a5c6-200b25cd0138 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:28.557763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0d3e5df9-b627-45bd-a5c6-200b25cd0138 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:28.558936 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d3e5df9-b627-45bd-a5c6-200b25cd0138 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1570 microversion: 2.25 time: 0.216874 Jan 22 21:01:28.559738 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 229/466] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:28 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1570 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:28.578437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-095bc21b-d03c-43b7-b68d-f3101f0d30df tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:28.579589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-095bc21b-d03c-43b7-b68d-f3101f0d30df tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:28.588879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-095bc21b-d03c-43b7-b68d-f3101f0d30df tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:28.589783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-095bc21b-d03c-43b7-b68d-f3101f0d30df tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:28.594485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-095bc21b-d03c-43b7-b68d-f3101f0d30df tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:28.603224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-095bc21b-d03c-43b7-b68d-f3101f0d30df tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:28.655984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eb2f0fbb-028b-4654-a41d-274e1ca8dea1 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c921b8a098454af8becc1074ab0eb4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca97602282f40168d95eb37d81f93e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:28.667359 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eb2f0fbb-028b-4654-a41d-274e1ca8dea1 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 200 len: 1240 microversion: 2.1 time: 0.146983 Jan 22 21:01:28.669824 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 238/467] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:28 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 1240 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:28.676059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4fe5c6d9-c639-4be7-917a-8780150864dd tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Calling method '.version_select at 0x7f1ed6105940>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:28.747712 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4fe5c6d9-c639-4be7-917a-8780150864dd tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "GET /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata" status: 200 len: 58 microversion: 2.1 time: 0.076270 Jan 22 21:01:28.756577 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 239/468] 10.222.0.100 () {58 vars in 1264 bytes} [Sat Jan 22 21:01:28 2022] GET /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata => generated 58 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:28.766256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e3bd7e61-aca5-4d18-8430-cd7f710fb1e0 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Action: 'update_all', calling method: .version_select at 0x7f1ed6105430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:28.841839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-e3bd7e61-aca5-4d18-8430-cd7f710fb1e0 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:28.850607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-e3bd7e61-aca5-4d18-8430-cd7f710fb1e0 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for user 0b8d2f41f06d461f9ca41f37f332fc8e and project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:28.961757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-095bc21b-d03c-43b7-b68d-f3101f0d30df tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:28.974389 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-095bc21b-d03c-43b7-b68d-f3101f0d30df tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1507 microversion: 2.1 time: 0.398904 Jan 22 21:01:28.979147 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 230/469] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:28 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1507 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:29.110616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5379d117-bc44-42e5-9251-97ed93080ade req-026e14f9-2398-434a-baed-3f4b234948d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c65aa5-3070-400c-8137-94e83ffff9cc", "tag": "24333c19-e976-4803-9358-a5dd93f4bef8"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:29.114981 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:29.114981 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:29.127928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5379d117-bc44-42e5-9251-97ed93080ade req-026e14f9-2398-434a-baed-3f4b234948d3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:29.128760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5379d117-bc44-42e5-9251-97ed93080ade req-026e14f9-2398-434a-baed-3f4b234948d3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:29.145760 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5379d117-bc44-42e5-9251-97ed93080ade req-026e14f9-2398-434a-baed-3f4b234948d3 service nova] Creating event network-changed:24333c19-e976-4803-9358-a5dd93f4bef8 for instance 29c65aa5-3070-400c-8137-94e83ffff9cc on nch2-master-1 Jan 22 21:01:29.153769 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-5379d117-bc44-42e5-9251-97ed93080ade req-026e14f9-2398-434a-baed-3f4b234948d3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058843 Jan 22 21:01:29.156107 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 231/470] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:29.513346 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e3bd7e61-aca5-4d18-8430-cd7f710fb1e0 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata" status: 200 len: 61 microversion: 2.1 time: 0.755186 Jan 22 21:01:29.519225 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 240/471] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:01:28 2022] PUT /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata => generated 61 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:29.525135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c51cb47e-b628-4d70-a8c6-9a789020c2d5 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Action: 'create', calling method: .version_select at 0x7f1ed619e430>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:29.550316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-897503971", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "9a09940d-6f24-46f0-81b2-415eef5f5554"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:29.623981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-c51cb47e-b628-4d70-a8c6-9a789020c2d5 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:29.634083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-c51cb47e-b628-4d70-a8c6-9a789020c2d5 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Getting quotas for user 0b8d2f41f06d461f9ca41f37f332fc8e and project 86198b407db349a2ac6f94b050ad2387. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:29.675433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] validate_networks() for [('9a09940d-6f24-46f0-81b2-415eef5f5554', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:01:30.265024 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c51cb47e-b628-4d70-a8c6-9a789020c2d5 tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "POST /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata" status: 200 len: 85 microversion: 2.1 time: 0.744388 Jan 22 21:01:30.270668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 241/472] 10.222.0.100 () {60 vars in 1285 bytes} [Sat Jan 22 21:01:29 2022] POST /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata => generated 85 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:30.273677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7d2344ec-8a89-4128-9497-ec312a0eb908 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:30.274365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7d2344ec-8a89-4128-9497-ec312a0eb908 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:30.277967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:01:30.278485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:01:30.279034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:01:30.279518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:01:30.280002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:01:30.281476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d2344ec-8a89-4128-9497-ec312a0eb908 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:30.282110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d2344ec-8a89-4128-9497-ec312a0eb908 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:30.282933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d2344ec-8a89-4128-9497-ec312a0eb908 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:30.283372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d2344ec-8a89-4128-9497-ec312a0eb908 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:30.291180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:30.291814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:30.292932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:30.293363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:30.314771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Getting quotas for project ffe12a63826247c889a1700eba378728. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:30.322902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Getting quotas for user 05643e88435d482fb3ed96d0a7f15208 and project ffe12a63826247c889a1700eba378728. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:30.341118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:01:30.343659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:01:30.430923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7d2344ec-8a89-4128-9497-ec312a0eb908 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:30.439011 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7d2344ec-8a89-4128-9497-ec312a0eb908 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1323 microversion: 2.1 time: 0.172221 Jan 22 21:01:30.439709 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 242/473] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:30 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1323 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:30.444965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d0ab8b7-2b0b-40c2-a22c-e2bf9b4b9c90 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:30.445604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d0ab8b7-2b0b-40c2-a22c-e2bf9b4b9c90 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:30.451911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d0ab8b7-2b0b-40c2-a22c-e2bf9b4b9c90 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:30.452417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d0ab8b7-2b0b-40c2-a22c-e2bf9b4b9c90 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:30.453387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d0ab8b7-2b0b-40c2-a22c-e2bf9b4b9c90 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:30.454039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d0ab8b7-2b0b-40c2-a22c-e2bf9b4b9c90 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:30.493131 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-27f1dff1-874a-4426-a01f-a9d301a668ed tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.136566 Jan 22 21:01:30.494227 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 232/474] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:01:29 2022] POST /compute/v2.1/servers => generated 382 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:01:30.510595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ed44f038-b478-449b-8464-c24133d41583 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:30.515969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ed44f038-b478-449b-8464-c24133d41583 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:30.520726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed44f038-b478-449b-8464-c24133d41583 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:30.521391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed44f038-b478-449b-8464-c24133d41583 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:30.522388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed44f038-b478-449b-8464-c24133d41583 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:30.522986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed44f038-b478-449b-8464-c24133d41583 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:30.617595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3d0ab8b7-2b0b-40c2-a22c-e2bf9b4b9c90 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:30.626290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3d0ab8b7-2b0b-40c2-a22c-e2bf9b4b9c90 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:30.628905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3d0ab8b7-2b0b-40c2-a22c-e2bf9b4b9c90 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:30.630388 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d0ab8b7-2b0b-40c2-a22c-e2bf9b4b9c90 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1570 microversion: 2.25 time: 0.189568 Jan 22 21:01:30.640961 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 243/475] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:30 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1570 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:30.641168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed44f038-b478-449b-8464-c24133d41583 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c921b8a098454af8becc1074ab0eb4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca97602282f40168d95eb37d81f93e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:30.641303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-763038956", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "40083115", "adminPass": "***", "networks": [{"uuid": "f03ccb4a-a599-47d8-bf5d-025fd4411b36"}], "security_groups": [{"name": "tempest-securitygroup--401507773"}], "key_name": "tempest-keypair-563767088", "user_data": "}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:30.642809 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ed44f038-b478-449b-8464-c24133d41583 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 200 len: 1294 microversion: 2.1 time: 0.135873 Jan 22 21:01:30.645873 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 233/476] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:30 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 1294 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:30.656707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a6bfe929-5743-4cea-9dcd-32b419d52bd9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:30.657464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a6bfe929-5743-4cea-9dcd-32b419d52bd9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:30.677098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6bfe929-5743-4cea-9dcd-32b419d52bd9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:30.681386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6bfe929-5743-4cea-9dcd-32b419d52bd9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:30.684097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6bfe929-5743-4cea-9dcd-32b419d52bd9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:30.684550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6bfe929-5743-4cea-9dcd-32b419d52bd9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:30.783681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] validate_networks() for [('f03ccb4a-a599-47d8-bf5d-025fd4411b36', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:01:30.880332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a6bfe929-5743-4cea-9dcd-32b419d52bd9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:30.884469 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a6bfe929-5743-4cea-9dcd-32b419d52bd9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1507 microversion: 2.1 time: 0.237573 Jan 22 21:01:30.885042 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 234/477] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:30 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:30.956543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-538633202", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "9c00559f-de2d-48cc-a51a-3429ed0dc4c4"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:31.029031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] validate_networks() for [('9c00559f-de2d-48cc-a51a-3429ed0dc4c4', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:01:31.452903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:01:31.453602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:01:31.454247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:01:31.454823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:01:31.455412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:01:31.472490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:31.473059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:31.482977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:31.482977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:31.508631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Getting quotas for project adbc7daf2ad2476fb707aab0b887c7be. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:31.512641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Getting quotas for user b417a76de72c45a899648d658713bafc and project adbc7daf2ad2476fb707aab0b887c7be. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:31.526594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:01:31.529248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:01:31.676084 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a376f91f-a718-4d0f-ae55-4fc7ca58513e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.042791 Jan 22 21:01:31.679580 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 244/478] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:01:30 2022] POST /compute/v2.1/servers => generated 403 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:01:31.701960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11ae6a4d-5bf9-4659-8143-8a1d5e3691aa tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] Calling method '.version_select at 0x7f1ed61a8c10>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:31.764889 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-11ae6a4d-5bf9-4659-8143-8a1d5e3691aa tempest-ImagesMetadataTestJSON-2019709853 tempest-ImagesMetadataTestJSON-2019709853-project] 10.222.0.100 "GET /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata" status: 200 len: 85 microversion: 2.1 time: 0.083970 Jan 22 21:01:31.771170 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 245/479] 10.222.0.100 () {58 vars in 1264 bytes} [Sat Jan 22 21:01:31 2022] GET /compute/v2.1/images/24cc2793-007a-4d12-b3c4-ec8b7a5ac742/metadata => generated 85 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:31.777084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cf66caa8-430d-4816-9d14-fd6c46b12197 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:31.777916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cf66caa8-430d-4816-9d14-fd6c46b12197 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:31.839238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:01:31.839727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:01:31.840229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:01:31.840578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:01:31.841068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:01:31.853082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cf66caa8-430d-4816-9d14-fd6c46b12197 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05643e88435d482fb3ed96d0a7f15208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe12a63826247c889a1700eba378728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:31.870554 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cf66caa8-430d-4816-9d14-fd6c46b12197 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8" status: 200 len: 1221 microversion: 2.1 time: 0.091568 Jan 22 21:01:31.870554 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 246/480] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:31 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8 => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:31.872483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-64b004e5-1d9e-443f-8f5b-0e5a17282112 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:31.873099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-64b004e5-1d9e-443f-8f5b-0e5a17282112 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:31.881646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64b004e5-1d9e-443f-8f5b-0e5a17282112 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:31.882293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64b004e5-1d9e-443f-8f5b-0e5a17282112 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:31.882929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:31.883462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64b004e5-1d9e-443f-8f5b-0e5a17282112 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:31.884177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64b004e5-1d9e-443f-8f5b-0e5a17282112 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:31.884751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:31.886662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:31.894331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:31.920109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Getting quotas for project 01b1a67e790046629fe2b636fcefd01d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:31.926357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Getting quotas for user 946cce9cf6874d60912e69c1169ed379 and project 01b1a67e790046629fe2b636fcefd01d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:31.939376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:01:31.944361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:01:32.229067 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ce31af5c-53f7-4b09-909e-b1cb46c2eaa0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.335356 Jan 22 21:01:32.232146 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 235/481] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:01:30 2022] POST /compute/v2.1/servers => generated 382 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:01:32.239079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-162f3209-daeb-400d-92a3-121189ceee9b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:32.243412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-162f3209-daeb-400d-92a3-121189ceee9b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:32.267571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-162f3209-daeb-400d-92a3-121189ceee9b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:32.267571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-162f3209-daeb-400d-92a3-121189ceee9b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:32.267571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-162f3209-daeb-400d-92a3-121189ceee9b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:32.267571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-162f3209-daeb-400d-92a3-121189ceee9b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:32.287671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-64b004e5-1d9e-443f-8f5b-0e5a17282112 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:32.296559 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-64b004e5-1d9e-443f-8f5b-0e5a17282112 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1323 microversion: 2.1 time: 0.430598 Jan 22 21:01:32.305163 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 247/482] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:31 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1323 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:32.311017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bb26cab7-5e30-4a5a-af77-d1801c8ab667 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:32.317796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bb26cab7-5e30-4a5a-af77-d1801c8ab667 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:32.329784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb26cab7-5e30-4a5a-af77-d1801c8ab667 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:32.331949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb26cab7-5e30-4a5a-af77-d1801c8ab667 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:32.333536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb26cab7-5e30-4a5a-af77-d1801c8ab667 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:32.335108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb26cab7-5e30-4a5a-af77-d1801c8ab667 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:32.808817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bb26cab7-5e30-4a5a-af77-d1801c8ab667 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c921b8a098454af8becc1074ab0eb4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca97602282f40168d95eb37d81f93e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:32.822672 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bb26cab7-5e30-4a5a-af77-d1801c8ab667 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 200 len: 1336 microversion: 2.1 time: 0.518130 Jan 22 21:01:32.833712 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 248/483] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:32 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 1336 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:32.838587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-62d58024-9c4f-4c60-a436-ddfb03337449 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:32.839422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-62d58024-9c4f-4c60-a436-ddfb03337449 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:32.884668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-162f3209-daeb-400d-92a3-121189ceee9b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:32.892900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-162f3209-daeb-400d-92a3-121189ceee9b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:32.894490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-162f3209-daeb-400d-92a3-121189ceee9b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:32.895872 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-162f3209-daeb-400d-92a3-121189ceee9b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1570 microversion: 2.25 time: 0.662612 Jan 22 21:01:32.896441 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 236/484] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:32 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1570 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:32.901127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-de5d6273-7777-4c28-b35e-bbf8791af303 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:32.901762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-de5d6273-7777-4c28-b35e-bbf8791af303 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:32.908131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5d6273-7777-4c28-b35e-bbf8791af303 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:32.908287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-62d58024-9c4f-4c60-a436-ddfb03337449 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:32.908586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5d6273-7777-4c28-b35e-bbf8791af303 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:32.910224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5d6273-7777-4c28-b35e-bbf8791af303 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:32.910822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5d6273-7777-4c28-b35e-bbf8791af303 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:32.915557 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-62d58024-9c4f-4c60-a436-ddfb03337449 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 200 len: 1263 microversion: 2.1 time: 0.080519 Jan 22 21:01:32.916128 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 249/485] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:32 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:32.920755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b263731f-a75e-4364-b820-cdf5a2fcc220 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:32.921351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b263731f-a75e-4364-b820-cdf5a2fcc220 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:32.975560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b263731f-a75e-4364-b820-cdf5a2fcc220 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:32.984856 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b263731f-a75e-4364-b820-cdf5a2fcc220 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 200 len: 1211 microversion: 2.1 time: 0.067387 Jan 22 21:01:32.985530 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 250/486] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:32 2022] GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 1211 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:32.991838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f380c67b-42c7-4c6f-ba22-b33703afaea8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:32.992666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f380c67b-42c7-4c6f-ba22-b33703afaea8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:33.000124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f380c67b-42c7-4c6f-ba22-b33703afaea8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:33.000725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f380c67b-42c7-4c6f-ba22-b33703afaea8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:33.001634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f380c67b-42c7-4c6f-ba22-b33703afaea8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:33.002148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f380c67b-42c7-4c6f-ba22-b33703afaea8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:33.115317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f380c67b-42c7-4c6f-ba22-b33703afaea8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05643e88435d482fb3ed96d0a7f15208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe12a63826247c889a1700eba378728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:33.157553 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f380c67b-42c7-4c6f-ba22-b33703afaea8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8" status: 200 len: 1273 microversion: 2.1 time: 0.170668 Jan 22 21:01:33.163792 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 251/487] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:32 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8 => generated 1273 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:33.198953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-ba84d86c-bb19-4c24-be65-e5e7b219d12f req-47a2056d-f4d4-4ff2-b299-e16a0261b2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "077c7fdf-b28f-48a5-9c20-4b5b45babfed", "tag": "4892bd95-44cd-4f32-8d2d-11536ea7b4ee"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:33.205477 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:33.205477 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:33.254361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-ba84d86c-bb19-4c24-be65-e5e7b219d12f req-47a2056d-f4d4-4ff2-b299-e16a0261b2e9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:33.266549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-ba84d86c-bb19-4c24-be65-e5e7b219d12f req-47a2056d-f4d4-4ff2-b299-e16a0261b2e9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:33.271998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-de5d6273-7777-4c28-b35e-bbf8791af303 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:33.280204 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-de5d6273-7777-4c28-b35e-bbf8791af303 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1497 microversion: 2.1 time: 0.382377 Jan 22 21:01:33.280822 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 237/488] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:32 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1497 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:33.294866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-b4662656-c4d8-4cdf-a295-19ff1b22365c req-465e8397-2456-412a-aef8-8c85ea6823a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc09b6eb-2701-4e2c-a135-a2f65c05eabf", "tag": "9c612c1a-080f-4f7f-a757-7d20ac1cee0d"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:33.300763 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-ba84d86c-bb19-4c24-be65-e5e7b219d12f req-47a2056d-f4d4-4ff2-b299-e16a0261b2e9 service nova] Creating event network-changed:4892bd95-44cd-4f32-8d2d-11536ea7b4ee for instance 077c7fdf-b28f-48a5-9c20-4b5b45babfed on nch1-master-1 Jan 22 21:01:33.305269 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:33.305269 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:33.313360 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-ba84d86c-bb19-4c24-be65-e5e7b219d12f req-47a2056d-f4d4-4ff2-b299-e16a0261b2e9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144746 Jan 22 21:01:33.314598 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 252/489] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:33.322749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b4662656-c4d8-4cdf-a295-19ff1b22365c req-465e8397-2456-412a-aef8-8c85ea6823a6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:33.326072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b4662656-c4d8-4cdf-a295-19ff1b22365c req-465e8397-2456-412a-aef8-8c85ea6823a6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:33.331857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-06271a61-edde-470d-869b-095e4e99ea07 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '.version_select at 0x7f1ed619e820>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:33.335091 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:33.335091 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:33.342635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06271a61-edde-470d-869b-095e4e99ea07 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:33.343098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06271a61-edde-470d-869b-095e4e99ea07 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:33.361193 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-b4662656-c4d8-4cdf-a295-19ff1b22365c req-465e8397-2456-412a-aef8-8c85ea6823a6 service nova] Creating event network-changed:9c612c1a-080f-4f7f-a757-7d20ac1cee0d for instance bc09b6eb-2701-4e2c-a135-a2f65c05eabf on nch2-master-1 Jan 22 21:01:33.393183 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-b4662656-c4d8-4cdf-a295-19ff1b22365c req-465e8397-2456-412a-aef8-8c85ea6823a6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110003 Jan 22 21:01:33.401602 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 238/490] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:33.421527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bd369696-46cc-4549-9387-9ed462eee2b3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:33.427663 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-06271a61-edde-470d-869b-095e4e99ea07 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/os-migrations" status: 200 len: 781 microversion: 2.1 time: 0.106831 Jan 22 21:01:33.428030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bd369696-46cc-4549-9387-9ed462eee2b3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:33.430801 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 253/491] 10.222.0.100 () {58 vars in 1147 bytes} [Sat Jan 22 21:01:33 2022] GET /compute/v2.1/os-migrations => generated 781 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:33.444849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dd217949-7189-4f32-bd04-62375f3e976b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:33.453965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dd217949-7189-4f32-bd04-62375f3e976b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:33.454288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd369696-46cc-4549-9387-9ed462eee2b3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:33.454288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd369696-46cc-4549-9387-9ed462eee2b3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:33.454288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd369696-46cc-4549-9387-9ed462eee2b3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:33.454288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd369696-46cc-4549-9387-9ed462eee2b3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:33.468509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd217949-7189-4f32-bd04-62375f3e976b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:33.468973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd217949-7189-4f32-bd04-62375f3e976b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:33.472347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd217949-7189-4f32-bd04-62375f3e976b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:33.477216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd217949-7189-4f32-bd04-62375f3e976b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:34.040124 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dd217949-7189-4f32-bd04-62375f3e976b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1648 microversion: 2.1 time: 0.602497 Jan 22 21:01:34.041850 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 254/492] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:33 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1648 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:34.073156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ac2af8fa-9617-4e8d-a26d-adaf9a5cd19d tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:34.074026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ac2af8fa-9617-4e8d-a26d-adaf9a5cd19d tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:34.107787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac2af8fa-9617-4e8d-a26d-adaf9a5cd19d tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:34.107787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac2af8fa-9617-4e8d-a26d-adaf9a5cd19d tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:34.108614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac2af8fa-9617-4e8d-a26d-adaf9a5cd19d tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:34.109289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac2af8fa-9617-4e8d-a26d-adaf9a5cd19d tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:34.248719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bd369696-46cc-4549-9387-9ed462eee2b3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:34.263156 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bd369696-46cc-4549-9387-9ed462eee2b3 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1323 microversion: 2.1 time: 0.859396 Jan 22 21:01:34.264002 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 239/493] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:33 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1323 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:34.275093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d147d9bd-cf1a-49eb-b60b-73b92d8ef06f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:34.276012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d147d9bd-cf1a-49eb-b60b-73b92d8ef06f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:34.283578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d147d9bd-cf1a-49eb-b60b-73b92d8ef06f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:34.284875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d147d9bd-cf1a-49eb-b60b-73b92d8ef06f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:34.285933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d147d9bd-cf1a-49eb-b60b-73b92d8ef06f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:34.286540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d147d9bd-cf1a-49eb-b60b-73b92d8ef06f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:34.337686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ac2af8fa-9617-4e8d-a26d-adaf9a5cd19d tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c921b8a098454af8becc1074ab0eb4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca97602282f40168d95eb37d81f93e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:34.347661 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ac2af8fa-9617-4e8d-a26d-adaf9a5cd19d tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 200 len: 1336 microversion: 2.1 time: 0.304472 Jan 22 21:01:34.348897 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 255/494] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:34 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 1336 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:34.353815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c972b7b8-38b9-4337-81f0-9338a4e33762 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:34.354722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c972b7b8-38b9-4337-81f0-9338a4e33762 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:34.363375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c972b7b8-38b9-4337-81f0-9338a4e33762 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:34.363375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c972b7b8-38b9-4337-81f0-9338a4e33762 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:34.363930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c972b7b8-38b9-4337-81f0-9338a4e33762 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:34.364397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c972b7b8-38b9-4337-81f0-9338a4e33762 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:34.496786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c972b7b8-38b9-4337-81f0-9338a4e33762 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:34.512888 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c972b7b8-38b9-4337-81f0-9338a4e33762 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 200 len: 1315 microversion: 2.1 time: 0.162405 Jan 22 21:01:34.514516 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 256/495] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:34 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:34.521367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-929f54e2-0168-4cee-a188-9f7f5b202707 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:34.522423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-929f54e2-0168-4cee-a188-9f7f5b202707 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:34.532641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-929f54e2-0168-4cee-a188-9f7f5b202707 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:34.532641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-929f54e2-0168-4cee-a188-9f7f5b202707 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:34.532641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-929f54e2-0168-4cee-a188-9f7f5b202707 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:34.532641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-929f54e2-0168-4cee-a188-9f7f5b202707 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:34.621108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-929f54e2-0168-4cee-a188-9f7f5b202707 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:34.630234 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-929f54e2-0168-4cee-a188-9f7f5b202707 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 200 len: 1263 microversion: 2.1 time: 0.114356 Jan 22 21:01:34.631234 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 257/496] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:34 2022] GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 1263 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:34.636218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b6afd5af-31cb-47a9-9776-29a626b88b55 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:34.637047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b6afd5af-31cb-47a9-9776-29a626b88b55 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:34.644287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6afd5af-31cb-47a9-9776-29a626b88b55 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:34.645054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6afd5af-31cb-47a9-9776-29a626b88b55 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:34.646143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6afd5af-31cb-47a9-9776-29a626b88b55 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:34.646769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6afd5af-31cb-47a9-9776-29a626b88b55 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:34.728599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b6afd5af-31cb-47a9-9776-29a626b88b55 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05643e88435d482fb3ed96d0a7f15208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe12a63826247c889a1700eba378728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:34.736666 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b6afd5af-31cb-47a9-9776-29a626b88b55 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8" status: 200 len: 1279 microversion: 2.1 time: 0.104159 Jan 22 21:01:34.740137 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 258/497] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:34 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8 => generated 1279 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:34.745740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-391388211", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "3da6de85-e0d4-4a7c-ad9b-73d085f0c931"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:34.833841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] validate_networks() for [('3da6de85-e0d4-4a7c-ad9b-73d085f0c931', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:01:35.010503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d147d9bd-cf1a-49eb-b60b-73b92d8ef06f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:35.023791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d147d9bd-cf1a-49eb-b60b-73b92d8ef06f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:35.025906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d147d9bd-cf1a-49eb-b60b-73b92d8ef06f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:35.028199 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d147d9bd-cf1a-49eb-b60b-73b92d8ef06f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1570 microversion: 2.25 time: 0.762908 Jan 22 21:01:35.039774 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 240/498] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:34 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1570 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:35.280057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-616a122a-1a36-4ab2-a1a5-7cbb7f8f4554 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:35.280846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-616a122a-1a36-4ab2-a1a5-7cbb7f8f4554 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:35.289798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-616a122a-1a36-4ab2-a1a5-7cbb7f8f4554 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:35.290804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-616a122a-1a36-4ab2-a1a5-7cbb7f8f4554 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:35.292221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-616a122a-1a36-4ab2-a1a5-7cbb7f8f4554 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:35.293374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-616a122a-1a36-4ab2-a1a5-7cbb7f8f4554 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:35.876819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:01:35.877313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:01:35.878235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:01:35.878665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:01:35.879118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:01:35.888826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:35.889295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:35.891125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:35.891988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:35.893867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-616a122a-1a36-4ab2-a1a5-7cbb7f8f4554 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:35.909657 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-616a122a-1a36-4ab2-a1a5-7cbb7f8f4554 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1323 microversion: 2.1 time: 0.625853 Jan 22 21:01:35.912503 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 241/499] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:35 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1323 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:01:35.916895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Getting quotas for project b277338cf6c4478e8e35cf79b34caaf6. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:35.917706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5df700c5-cdad-40da-b828-10776f508e04 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:35.918552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5df700c5-cdad-40da-b828-10776f508e04 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:35.921472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Getting quotas for user b07a1bb09ad44501925664aa61ac3e6d and project b277338cf6c4478e8e35cf79b34caaf6. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:35.925632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5df700c5-cdad-40da-b828-10776f508e04 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:35.926423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5df700c5-cdad-40da-b828-10776f508e04 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:35.927682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5df700c5-cdad-40da-b828-10776f508e04 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:35.928353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5df700c5-cdad-40da-b828-10776f508e04 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:35.942155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:01:35.944619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:01:36.094201 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6e4ab58c-b5b7-499f-b682-63a5e0c75a98 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.352852 Jan 22 21:01:36.096352 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 259/500] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:01:34 2022] POST /compute/v2.1/servers => generated 382 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:01:36.104660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-4d6782c1-2822-40d4-9276-869f5e0e4b8d req-0a70878e-cdba-4a3c-9e24-0e588d678007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c2ce33-a108-4be0-bb41-068138160281", "name": "network-vif-unplugged", "status": "completed", "tag": "bd951644-4535-4dbd-b4a8-1c4994056609"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:36.107430 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:36.107430 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:36.120694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4d6782c1-2822-40d4-9276-869f5e0e4b8d req-0a70878e-cdba-4a3c-9e24-0e588d678007 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:36.122342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4d6782c1-2822-40d4-9276-869f5e0e4b8d req-0a70878e-cdba-4a3c-9e24-0e588d678007 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:36.142426 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-4d6782c1-2822-40d4-9276-869f5e0e4b8d req-0a70878e-cdba-4a3c-9e24-0e588d678007 service nova] Creating event network-vif-unplugged:bd951644-4535-4dbd-b4a8-1c4994056609 for instance 34c2ce33-a108-4be0-bb41-068138160281 on nch1-master-1 Jan 22 21:01:36.150089 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-4d6782c1-2822-40d4-9276-869f5e0e4b8d req-0a70878e-cdba-4a3c-9e24-0e588d678007 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051096 Jan 22 21:01:36.153068 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 260/501] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:36.162680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bdfdd27d-4fbf-4a39-9ae2-25ec88cbe6fa tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:36.163796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bdfdd27d-4fbf-4a39-9ae2-25ec88cbe6fa tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:36.173141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdfdd27d-4fbf-4a39-9ae2-25ec88cbe6fa tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:36.174020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdfdd27d-4fbf-4a39-9ae2-25ec88cbe6fa tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:36.177362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdfdd27d-4fbf-4a39-9ae2-25ec88cbe6fa tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:36.178101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdfdd27d-4fbf-4a39-9ae2-25ec88cbe6fa tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:36.274466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5df700c5-cdad-40da-b828-10776f508e04 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c921b8a098454af8becc1074ab0eb4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca97602282f40168d95eb37d81f93e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:36.289625 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5df700c5-cdad-40da-b828-10776f508e04 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 200 len: 1336 microversion: 2.1 time: 0.375709 Jan 22 21:01:36.291337 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 242/502] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:35 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 1336 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:36.296405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-05a7ce0f-f75d-4de7-bc36-b64359ec20f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:36.297242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-05a7ce0f-f75d-4de7-bc36-b64359ec20f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:36.307034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05a7ce0f-f75d-4de7-bc36-b64359ec20f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:36.307495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05a7ce0f-f75d-4de7-bc36-b64359ec20f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:36.308304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05a7ce0f-f75d-4de7-bc36-b64359ec20f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:36.309020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05a7ce0f-f75d-4de7-bc36-b64359ec20f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:36.388584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bdfdd27d-4fbf-4a39-9ae2-25ec88cbe6fa tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:36.397167 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bdfdd27d-4fbf-4a39-9ae2-25ec88cbe6fa tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 200 len: 1321 microversion: 2.1 time: 0.244665 Jan 22 21:01:36.397780 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 261/503] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:36 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:36.414399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3e121ddc-012e-40d0-809b-1af9a6424063 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:36.414910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3e121ddc-012e-40d0-809b-1af9a6424063 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:36.429294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e121ddc-012e-40d0-809b-1af9a6424063 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:36.432986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e121ddc-012e-40d0-809b-1af9a6424063 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:36.434591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e121ddc-012e-40d0-809b-1af9a6424063 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:36.435875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e121ddc-012e-40d0-809b-1af9a6424063 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:36.448548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-05a7ce0f-f75d-4de7-bc36-b64359ec20f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:36.462861 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-05a7ce0f-f75d-4de7-bc36-b64359ec20f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 200 len: 1269 microversion: 2.1 time: 0.170193 Jan 22 21:01:36.463980 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 243/504] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:36 2022] GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:36.473955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-075b811f-f9c2-4fa5-bf5e-8bcc00e36b4a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:36.474679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-075b811f-f9c2-4fa5-bf5e-8bcc00e36b4a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:36.490591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-075b811f-f9c2-4fa5-bf5e-8bcc00e36b4a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:36.491372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-075b811f-f9c2-4fa5-bf5e-8bcc00e36b4a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:36.493090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-075b811f-f9c2-4fa5-bf5e-8bcc00e36b4a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:36.493765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-075b811f-f9c2-4fa5-bf5e-8bcc00e36b4a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:36.750067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-075b811f-f9c2-4fa5-bf5e-8bcc00e36b4a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:36.759521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-075b811f-f9c2-4fa5-bf5e-8bcc00e36b4a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:36.762898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-075b811f-f9c2-4fa5-bf5e-8bcc00e36b4a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:36.766329 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-075b811f-f9c2-4fa5-bf5e-8bcc00e36b4a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1570 microversion: 2.25 time: 0.299846 Jan 22 21:01:36.766329 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 244/505] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:36 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1570 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:36.771930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2aa17f5e-cb14-4a7b-b833-6ab91d26ca16 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:36.772594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2aa17f5e-cb14-4a7b-b833-6ab91d26ca16 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:36.843433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2aa17f5e-cb14-4a7b-b833-6ab91d26ca16 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:36.853653 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2aa17f5e-cb14-4a7b-b833-6ab91d26ca16 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1214 microversion: 2.1 time: 0.086597 Jan 22 21:01:36.854950 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 245/506] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:36 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:36.861721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-20ae46b2-a271-4478-8176-30de8a0b5aad req-8c35a222-bcbf-48e9-a407-683e57ef2171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c65aa5-3070-400c-8137-94e83ffff9cc", "name": "network-vif-plugged", "status": "completed", "tag": "24333c19-e976-4803-9358-a5dd93f4bef8"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:36.864045 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:36.864045 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:36.872622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-20ae46b2-a271-4478-8176-30de8a0b5aad req-8c35a222-bcbf-48e9-a407-683e57ef2171 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:36.873345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-20ae46b2-a271-4478-8176-30de8a0b5aad req-8c35a222-bcbf-48e9-a407-683e57ef2171 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:36.888166 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-20ae46b2-a271-4478-8176-30de8a0b5aad req-8c35a222-bcbf-48e9-a407-683e57ef2171 service nova] Creating event network-vif-plugged:24333c19-e976-4803-9358-a5dd93f4bef8 for instance 29c65aa5-3070-400c-8137-94e83ffff9cc on nch2-master-1 Jan 22 21:01:36.895190 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-20ae46b2-a271-4478-8176-30de8a0b5aad req-8c35a222-bcbf-48e9-a407-683e57ef2171 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038569 Jan 22 21:01:36.897992 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 246/507] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:36.928495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-56591e2b-023b-4e64-801a-657568758cdc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:36.930071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-56591e2b-023b-4e64-801a-657568758cdc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:36.938716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56591e2b-023b-4e64-801a-657568758cdc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:36.939902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56591e2b-023b-4e64-801a-657568758cdc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:36.940894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56591e2b-023b-4e64-801a-657568758cdc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:36.941378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56591e2b-023b-4e64-801a-657568758cdc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:37.172040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-56591e2b-023b-4e64-801a-657568758cdc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:37.180748 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-56591e2b-023b-4e64-801a-657568758cdc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1323 microversion: 2.1 time: 0.263348 Jan 22 21:01:37.181416 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 247/508] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:36 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1323 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:37.213945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3e121ddc-012e-40d0-809b-1af9a6424063 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05643e88435d482fb3ed96d0a7f15208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe12a63826247c889a1700eba378728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:37.225951 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3e121ddc-012e-40d0-809b-1af9a6424063 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8" status: 200 len: 1321 microversion: 2.1 time: 0.827081 Jan 22 21:01:37.226752 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 262/509] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:36 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8 => generated 1321 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:37.310792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dda5f422-ba71-483e-af26-dea186d9e066 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:37.311409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dda5f422-ba71-483e-af26-dea186d9e066 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:37.318916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dda5f422-ba71-483e-af26-dea186d9e066 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:37.319638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dda5f422-ba71-483e-af26-dea186d9e066 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:37.320682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dda5f422-ba71-483e-af26-dea186d9e066 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:37.321289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dda5f422-ba71-483e-af26-dea186d9e066 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:37.356407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-223888100", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:37.420622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:01:37.655017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:01:37.655301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:01:37.655787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:01:37.656313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:01:37.656604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:01:37.673898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:37.675302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:37.676353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:37.676999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:37.701398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Getting quotas for project 681cd204f3dd4dc698a9a4a15a6e728c. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:37.706489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Getting quotas for user 66edcb96865e4215b5055587592192e3 and project 681cd204f3dd4dc698a9a4a15a6e728c. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:37.718095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:01:37.720736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:01:37.725685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dda5f422-ba71-483e-af26-dea186d9e066 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c921b8a098454af8becc1074ab0eb4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca97602282f40168d95eb37d81f93e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:37.736704 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dda5f422-ba71-483e-af26-dea186d9e066 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 200 len: 1336 microversion: 2.1 time: 0.429542 Jan 22 21:01:37.738824 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 263/510] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:37 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 1336 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:37.744455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f08b8a9-f04b-44ce-8b2b-6dd6c7ac959c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:37.745288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9f08b8a9-f04b-44ce-8b2b-6dd6c7ac959c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:37.755038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f08b8a9-f04b-44ce-8b2b-6dd6c7ac959c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:37.755636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f08b8a9-f04b-44ce-8b2b-6dd6c7ac959c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:37.756659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f08b8a9-f04b-44ce-8b2b-6dd6c7ac959c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:37.757434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f08b8a9-f04b-44ce-8b2b-6dd6c7ac959c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:37.871616 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-122a3608-612b-4a29-9e24-e42a31a26df5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.678853 Jan 22 21:01:37.872272 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 248/511] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:01:37 2022] POST /compute/v2.1/servers => generated 382 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:01:37.888788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ec5ddbe1-c8a3-42be-92ad-6bcc38612723 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:37.888788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ec5ddbe1-c8a3-42be-92ad-6bcc38612723 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:37.904215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec5ddbe1-c8a3-42be-92ad-6bcc38612723 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:37.904987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec5ddbe1-c8a3-42be-92ad-6bcc38612723 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:37.906002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec5ddbe1-c8a3-42be-92ad-6bcc38612723 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:37.906618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec5ddbe1-c8a3-42be-92ad-6bcc38612723 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:38.250752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ec5ddbe1-c8a3-42be-92ad-6bcc38612723 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:38.266081 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ec5ddbe1-c8a3-42be-92ad-6bcc38612723 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 200 len: 1311 microversion: 2.1 time: 0.390465 Jan 22 21:01:38.268766 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 249/512] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:37 2022] GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 1311 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:38.273845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1c23327f-b90d-444c-b69f-7a4db77299da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:38.274778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1c23327f-b90d-444c-b69f-7a4db77299da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:38.281663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c23327f-b90d-444c-b69f-7a4db77299da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:38.282500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c23327f-b90d-444c-b69f-7a4db77299da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:38.283270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c23327f-b90d-444c-b69f-7a4db77299da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:38.283780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c23327f-b90d-444c-b69f-7a4db77299da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:38.294002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9f08b8a9-f04b-44ce-8b2b-6dd6c7ac959c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:38.299582 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9f08b8a9-f04b-44ce-8b2b-6dd6c7ac959c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 200 len: 1388 microversion: 2.1 time: 0.558027 Jan 22 21:01:38.303450 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 264/513] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:37 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 1388 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:38.312682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c1b9f24c-5ac5-4124-a2e8-450a3d662cb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:38.315094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c1b9f24c-5ac5-4124-a2e8-450a3d662cb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:38.325943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1b9f24c-5ac5-4124-a2e8-450a3d662cb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:38.326397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1b9f24c-5ac5-4124-a2e8-450a3d662cb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:38.327204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1b9f24c-5ac5-4124-a2e8-450a3d662cb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:38.327628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1b9f24c-5ac5-4124-a2e8-450a3d662cb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:38.530435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c1b9f24c-5ac5-4124-a2e8-450a3d662cb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:38.552687 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c1b9f24c-5ac5-4124-a2e8-450a3d662cb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1266 microversion: 2.1 time: 0.243998 Jan 22 21:01:38.554219 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 265/514] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:38 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:38.559596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-855b0ee3-339a-46b1-9ba8-0e0f2e267c80 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:38.561091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-855b0ee3-339a-46b1-9ba8-0e0f2e267c80 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:38.577906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1c23327f-b90d-444c-b69f-7a4db77299da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:38.589232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1c23327f-b90d-444c-b69f-7a4db77299da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:38.590780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1c23327f-b90d-444c-b69f-7a4db77299da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:38.592135 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1c23327f-b90d-444c-b69f-7a4db77299da tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1560 microversion: 2.25 time: 0.322246 Jan 22 21:01:38.592704 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 250/515] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:38 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1560 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:38.597791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-2d804aae-b00c-43d5-affc-ced3dc4e789c req-6ab06e91-af85-4ead-9a73-6b13602464c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc1b81e-307f-4153-ae1a-a192c15f6db8", "tag": "3493c6ae-bbe9-465d-8bee-47a6ee910cac"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:38.599836 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:38.599836 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:38.607863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2d804aae-b00c-43d5-affc-ced3dc4e789c req-6ab06e91-af85-4ead-9a73-6b13602464c3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:38.608515 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2d804aae-b00c-43d5-affc-ced3dc4e789c req-6ab06e91-af85-4ead-9a73-6b13602464c3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:38.621348 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-2d804aae-b00c-43d5-affc-ced3dc4e789c req-6ab06e91-af85-4ead-9a73-6b13602464c3 service nova] Creating event network-changed:3493c6ae-bbe9-465d-8bee-47a6ee910cac for instance 6bc1b81e-307f-4153-ae1a-a192c15f6db8 on nch1-master-1 Jan 22 21:01:38.626231 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-2d804aae-b00c-43d5-affc-ced3dc4e789c req-6ab06e91-af85-4ead-9a73-6b13602464c3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032190 Jan 22 21:01:38.626837 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 251/516] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:38.632175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-dc1bd338-b48c-43d3-9c3a-340178e69ed6 req-4387178c-948c-4373-a0a7-9b10994ecd22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c2ce33-a108-4be0-bb41-068138160281", "tag": "bd951644-4535-4dbd-b4a8-1c4994056609"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:38.634061 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:38.634061 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:38.641389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-dc1bd338-b48c-43d3-9c3a-340178e69ed6 req-4387178c-948c-4373-a0a7-9b10994ecd22 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:38.641863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-dc1bd338-b48c-43d3-9c3a-340178e69ed6 req-4387178c-948c-4373-a0a7-9b10994ecd22 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:38.654201 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-dc1bd338-b48c-43d3-9c3a-340178e69ed6 req-4387178c-948c-4373-a0a7-9b10994ecd22 service nova] Creating event network-changed:bd951644-4535-4dbd-b4a8-1c4994056609 for instance 34c2ce33-a108-4be0-bb41-068138160281 on nch1-master-1 Jan 22 21:01:38.659566 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-dc1bd338-b48c-43d3-9c3a-340178e69ed6 req-4387178c-948c-4373-a0a7-9b10994ecd22 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030784 Jan 22 21:01:38.661588 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 252/517] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:38.665047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bccd2113-3951-4318-9bd8-ad85b46d0537 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:38.665804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bccd2113-3951-4318-9bd8-ad85b46d0537 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:38.672024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bccd2113-3951-4318-9bd8-ad85b46d0537 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:38.672485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bccd2113-3951-4318-9bd8-ad85b46d0537 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:38.673283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bccd2113-3951-4318-9bd8-ad85b46d0537 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:38.673750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bccd2113-3951-4318-9bd8-ad85b46d0537 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:38.713825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-855b0ee3-339a-46b1-9ba8-0e0f2e267c80 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66edcb96865e4215b5055587592192e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681cd204f3dd4dc698a9a4a15a6e728c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:38.723246 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-855b0ee3-339a-46b1-9ba8-0e0f2e267c80 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 200 len: 1219 microversion: 2.1 time: 0.167591 Jan 22 21:01:38.733453 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 266/518] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:38 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 1219 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:38.740366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f331fdc3-e1bb-4fc9-84ef-2fc0fa087f00 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:38.743609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f331fdc3-e1bb-4fc9-84ef-2fc0fa087f00 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:38.751683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f331fdc3-e1bb-4fc9-84ef-2fc0fa087f00 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:38.753411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f331fdc3-e1bb-4fc9-84ef-2fc0fa087f00 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:38.754400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f331fdc3-e1bb-4fc9-84ef-2fc0fa087f00 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:38.754999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f331fdc3-e1bb-4fc9-84ef-2fc0fa087f00 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:39.218992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bccd2113-3951-4318-9bd8-ad85b46d0537 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:39.233665 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bccd2113-3951-4318-9bd8-ad85b46d0537 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1323 microversion: 2.1 time: 0.571614 Jan 22 21:01:39.235037 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 253/519] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:38 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1323 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:39.244502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-348e5048-1bba-44e3-a393-f672b0203ceb tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '.version_select at 0x7f1ed61d8670>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:39.246251 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:39.246251 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:39.248080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-348e5048-1bba-44e3-a393-f672b0203ceb tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:39.248609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-348e5048-1bba-44e3-a393-f672b0203ceb tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:39.267963 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-348e5048-1bba-44e3-a393-f672b0203ceb tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/os-migrations" status: 200 len: 850 microversion: 2.25 time: 0.030915 Jan 22 21:01:39.270134 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 254/520] 10.222.0.100 () {60 vars in 1188 bytes} [Sat Jan 22 21:01:39 2022] GET /compute/v2.1/os-migrations => generated 850 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:01:39.275584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eaf19f62-1221-4a0f-973c-3c4c25e842b9 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:39.278239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eaf19f62-1221-4a0f-973c-3c4c25e842b9 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:39.286204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eaf19f62-1221-4a0f-973c-3c4c25e842b9 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:39.287069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eaf19f62-1221-4a0f-973c-3c4c25e842b9 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:39.292667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eaf19f62-1221-4a0f-973c-3c4c25e842b9 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:39.292667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eaf19f62-1221-4a0f-973c-3c4c25e842b9 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:39.477625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f331fdc3-e1bb-4fc9-84ef-2fc0fa087f00 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05643e88435d482fb3ed96d0a7f15208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe12a63826247c889a1700eba378728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:39.486314 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f331fdc3-e1bb-4fc9-84ef-2fc0fa087f00 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8" status: 200 len: 1321 microversion: 2.1 time: 0.751448 Jan 22 21:01:39.487719 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 267/521] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:38 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8 => generated 1321 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:39.503636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-45c7c0ee-b6b4-4c6c-a13d-237deba2d3b0 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:39.504430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-45c7c0ee-b6b4-4c6c-a13d-237deba2d3b0 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:39.514697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ee-b6b4-4c6c-a13d-237deba2d3b0 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:39.515383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ee-b6b4-4c6c-a13d-237deba2d3b0 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:39.516532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ee-b6b4-4c6c-a13d-237deba2d3b0 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:39.517124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45c7c0ee-b6b4-4c6c-a13d-237deba2d3b0 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:39.811586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-eaf19f62-1221-4a0f-973c-3c4c25e842b9 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c921b8a098454af8becc1074ab0eb4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca97602282f40168d95eb37d81f93e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:39.822029 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eaf19f62-1221-4a0f-973c-3c4c25e842b9 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 200 len: 1336 microversion: 2.1 time: 0.549694 Jan 22 21:01:39.823372 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 255/522] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:39 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 1336 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:39.828257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3026a97e-b9ac-4cc6-8ba3-cef2c680e368 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:39.829069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3026a97e-b9ac-4cc6-8ba3-cef2c680e368 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:39.847769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3026a97e-b9ac-4cc6-8ba3-cef2c680e368 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:39.848756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3026a97e-b9ac-4cc6-8ba3-cef2c680e368 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:39.849761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3026a97e-b9ac-4cc6-8ba3-cef2c680e368 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:39.850374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3026a97e-b9ac-4cc6-8ba3-cef2c680e368 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:40.266823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-45c7c0ee-b6b4-4c6c-a13d-237deba2d3b0 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'services' on Instance uuid 34c2ce33-a108-4be0-bb41-068138160281 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:01:40.374867 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-45c7c0ee-b6b4-4c6c-a13d-237deba2d3b0 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 2051 microversion: 2.25 time: 0.872483 Jan 22 21:01:40.392434 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 268/523] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:39 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 2051 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:40.439539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eb4b12ae-af09-4de5-8f77-5e77f3d0d9fc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:40.442945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eb4b12ae-af09-4de5-8f77-5e77f3d0d9fc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:40.472262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb4b12ae-af09-4de5-8f77-5e77f3d0d9fc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:40.474034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb4b12ae-af09-4de5-8f77-5e77f3d0d9fc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:40.474843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb4b12ae-af09-4de5-8f77-5e77f3d0d9fc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:40.475383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb4b12ae-af09-4de5-8f77-5e77f3d0d9fc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:40.660225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3026a97e-b9ac-4cc6-8ba3-cef2c680e368 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:40.669579 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3026a97e-b9ac-4cc6-8ba3-cef2c680e368 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 200 len: 1311 microversion: 2.1 time: 0.844836 Jan 22 21:01:40.670137 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 256/524] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:39 2022] GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 1311 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:40.682424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-afa2cb14-d855-4bce-b9e7-22ba6f6b9975 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:40.683310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-afa2cb14-d855-4bce-b9e7-22ba6f6b9975 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:40.701769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afa2cb14-d855-4bce-b9e7-22ba6f6b9975 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:40.702551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afa2cb14-d855-4bce-b9e7-22ba6f6b9975 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:40.703562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afa2cb14-d855-4bce-b9e7-22ba6f6b9975 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:40.704158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afa2cb14-d855-4bce-b9e7-22ba6f6b9975 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:40.833723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-afa2cb14-d855-4bce-b9e7-22ba6f6b9975 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:40.844010 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-afa2cb14-d855-4bce-b9e7-22ba6f6b9975 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1272 microversion: 2.1 time: 0.165207 Jan 22 21:01:40.846138 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 257/525] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:40 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:40.852492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ba773049-9f32-4e67-8fc7-1f0786415f40 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:40.855622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ba773049-9f32-4e67-8fc7-1f0786415f40 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:40.869683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba773049-9f32-4e67-8fc7-1f0786415f40 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:40.870572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba773049-9f32-4e67-8fc7-1f0786415f40 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:40.871577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba773049-9f32-4e67-8fc7-1f0786415f40 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:40.872225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba773049-9f32-4e67-8fc7-1f0786415f40 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:40.975071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ba773049-9f32-4e67-8fc7-1f0786415f40 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66edcb96865e4215b5055587592192e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681cd204f3dd4dc698a9a4a15a6e728c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:40.984823 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ba773049-9f32-4e67-8fc7-1f0786415f40 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 200 len: 1279 microversion: 2.1 time: 0.135692 Jan 22 21:01:40.985530 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 258/526] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:40 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 1279 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:41.012453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f77998d6-7e2b-4760-a302-33b786bcf95c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:41.013074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f77998d6-7e2b-4760-a302-33b786bcf95c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:41.029124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f77998d6-7e2b-4760-a302-33b786bcf95c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:41.029952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f77998d6-7e2b-4760-a302-33b786bcf95c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:41.031236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f77998d6-7e2b-4760-a302-33b786bcf95c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:41.032714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f77998d6-7e2b-4760-a302-33b786bcf95c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:41.219916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eb4b12ae-af09-4de5-8f77-5e77f3d0d9fc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:41.249857 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eb4b12ae-af09-4de5-8f77-5e77f3d0d9fc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 200 len: 1388 microversion: 2.1 time: 0.866308 Jan 22 21:01:41.251103 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 269/527] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:40 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 1388 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:41.262216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c1794a94-49c1-4f5f-b437-cdb4fc0827a8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:41.264646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c1794a94-49c1-4f5f-b437-cdb4fc0827a8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:41.275145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1794a94-49c1-4f5f-b437-cdb4fc0827a8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:41.276051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1794a94-49c1-4f5f-b437-cdb4fc0827a8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:41.277091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1794a94-49c1-4f5f-b437-cdb4fc0827a8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:41.278466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1794a94-49c1-4f5f-b437-cdb4fc0827a8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:41.389805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f77998d6-7e2b-4760-a302-33b786bcf95c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:41.395243 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f77998d6-7e2b-4760-a302-33b786bcf95c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1473 microversion: 2.1 time: 0.402898 Jan 22 21:01:41.395997 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 259/528] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:40 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1473 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:41.403116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-575645558", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "129e825a-cd9c-4303-b118-ba3cd4ee673c"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:41.528844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] validate_networks() for [('129e825a-cd9c-4303-b118-ba3cd4ee673c', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:01:41.939006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c1794a94-49c1-4f5f-b437-cdb4fc0827a8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05643e88435d482fb3ed96d0a7f15208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe12a63826247c889a1700eba378728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:41.947022 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c1794a94-49c1-4f5f-b437-cdb4fc0827a8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8" status: 200 len: 1321 microversion: 2.1 time: 0.692597 Jan 22 21:01:41.956672 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 270/529] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:41 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8 => generated 1321 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:41.960122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-6ff03349-1b80-42e1-87c7-c3be7819b01d req-40430d9f-1a56-4115-9994-50be3740cc65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94e22853-aa4b-47cb-a69e-0e6fd8af5720", "tag": "ac2be3fd-0a96-49fc-9bdb-d6f6fc743c9b"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:41.961931 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:41.961931 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:41.974390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6ff03349-1b80-42e1-87c7-c3be7819b01d req-40430d9f-1a56-4115-9994-50be3740cc65 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:41.975656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6ff03349-1b80-42e1-87c7-c3be7819b01d req-40430d9f-1a56-4115-9994-50be3740cc65 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:41.992337 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-6ff03349-1b80-42e1-87c7-c3be7819b01d req-40430d9f-1a56-4115-9994-50be3740cc65 service nova] Creating event network-changed:ac2be3fd-0a96-49fc-9bdb-d6f6fc743c9b for instance 94e22853-aa4b-47cb-a69e-0e6fd8af5720 on nch1-master-1 Jan 22 21:01:42.000945 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-6ff03349-1b80-42e1-87c7-c3be7819b01d req-40430d9f-1a56-4115-9994-50be3740cc65 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050976 Jan 22 21:01:42.003167 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 271/530] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:42.010142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fc817969-5c81-4f11-84be-027a2d41f1b4 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:42.017825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fc817969-5c81-4f11-84be-027a2d41f1b4 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:42.023981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc817969-5c81-4f11-84be-027a2d41f1b4 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:42.025949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc817969-5c81-4f11-84be-027a2d41f1b4 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:42.027191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc817969-5c81-4f11-84be-027a2d41f1b4 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:42.027836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc817969-5c81-4f11-84be-027a2d41f1b4 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:42.161946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:01:42.162466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:01:42.162832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:01:42.163244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:01:42.163657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:01:42.174010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:42.175513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:42.176785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:42.177419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:42.198474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Getting quotas for project 4aa958f703204cbca5fd08472e45909f. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:01:42.202942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Getting quotas for user c8fa58b4de634969ba8dcaf054e0b8b8 and project 4aa958f703204cbca5fd08472e45909f. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:01:42.216178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:01:42.219118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:01:42.269156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fc817969-5c81-4f11-84be-027a2d41f1b4 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c921b8a098454af8becc1074ab0eb4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca97602282f40168d95eb37d81f93e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:42.282336 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fc817969-5c81-4f11-84be-027a2d41f1b4 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 200 len: 1336 microversion: 2.1 time: 0.276999 Jan 22 21:01:42.283409 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 272/531] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:42 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 1336 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:42.291575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-36b58ad9-2cf3-4c03-a6f3-536698fa6b23 req-2ef4f7a5-9c32-4c20-af5a-ed73d814df13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c2ce33-a108-4be0-bb41-068138160281", "tag": "bd951644-4535-4dbd-b4a8-1c4994056609"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:42.297737 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:42.297737 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:42.308578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-36b58ad9-2cf3-4c03-a6f3-536698fa6b23 req-2ef4f7a5-9c32-4c20-af5a-ed73d814df13 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:42.309042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-36b58ad9-2cf3-4c03-a6f3-536698fa6b23 req-2ef4f7a5-9c32-4c20-af5a-ed73d814df13 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:42.325427 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-36b58ad9-2cf3-4c03-a6f3-536698fa6b23 req-2ef4f7a5-9c32-4c20-af5a-ed73d814df13 service nova] Creating event network-changed:bd951644-4535-4dbd-b4a8-1c4994056609 for instance 34c2ce33-a108-4be0-bb41-068138160281 on nch1-master-1 Jan 22 21:01:42.331645 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-36b58ad9-2cf3-4c03-a6f3-536698fa6b23 req-2ef4f7a5-9c32-4c20-af5a-ed73d814df13 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045844 Jan 22 21:01:42.332665 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 273/532] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:42.338968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aba290e7-fb51-4e2b-a815-8ae14fe275b4 tempest-DeleteServersAdminTestJSON-1298935322 tempest-DeleteServersAdminTestJSON-1298935322-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:42.340316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aba290e7-fb51-4e2b-a815-8ae14fe275b4 tempest-DeleteServersAdminTestJSON-1298935322 tempest-DeleteServersAdminTestJSON-1298935322-project-admin] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:42.348492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aba290e7-fb51-4e2b-a815-8ae14fe275b4 tempest-DeleteServersAdminTestJSON-1298935322 tempest-DeleteServersAdminTestJSON-1298935322-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:42.348765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aba290e7-fb51-4e2b-a815-8ae14fe275b4 tempest-DeleteServersAdminTestJSON-1298935322 tempest-DeleteServersAdminTestJSON-1298935322-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:42.349791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aba290e7-fb51-4e2b-a815-8ae14fe275b4 tempest-DeleteServersAdminTestJSON-1298935322 tempest-DeleteServersAdminTestJSON-1298935322-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:42.354382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aba290e7-fb51-4e2b-a815-8ae14fe275b4 tempest-DeleteServersAdminTestJSON-1298935322 tempest-DeleteServersAdminTestJSON-1298935322-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:42.422348 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3a72fde1-8517-40e0-8f1f-cc4773aac44e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.25 time: 1.025489 Jan 22 21:01:42.424081 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 260/533] 10.222.0.100 () {62 vars in 1192 bytes} [Sat Jan 22 21:01:41 2022] POST /compute/v2.1/servers => generated 382 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 22 21:01:42.432367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-18ebc60c-aab1-4c23-8662-674a7d7c5f01 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:42.436806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-18ebc60c-aab1-4c23-8662-674a7d7c5f01 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:42.451167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18ebc60c-aab1-4c23-8662-674a7d7c5f01 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:42.455663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18ebc60c-aab1-4c23-8662-674a7d7c5f01 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:42.455663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18ebc60c-aab1-4c23-8662-674a7d7c5f01 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:42.455663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18ebc60c-aab1-4c23-8662-674a7d7c5f01 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:42.715298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-18ebc60c-aab1-4c23-8662-674a7d7c5f01 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:42.726954 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-18ebc60c-aab1-4c23-8662-674a7d7c5f01 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 200 len: 1311 microversion: 2.1 time: 0.300573 Jan 22 21:01:42.727919 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 261/534] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:42 2022] GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 1311 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:42.732858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17f3127d-f079-4b0a-93cf-0610ba13c6e9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:42.734092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17f3127d-f079-4b0a-93cf-0610ba13c6e9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:42.748809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17f3127d-f079-4b0a-93cf-0610ba13c6e9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:42.749712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17f3127d-f079-4b0a-93cf-0610ba13c6e9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:42.750723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17f3127d-f079-4b0a-93cf-0610ba13c6e9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:42.751423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17f3127d-f079-4b0a-93cf-0610ba13c6e9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:42.768655 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aba290e7-fb51-4e2b-a815-8ae14fe275b4 tempest-DeleteServersAdminTestJSON-1298935322 tempest-DeleteServersAdminTestJSON-1298935322-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc/action" status: 202 len: 0 microversion: 2.1 time: 0.434319 Jan 22 21:01:42.769711 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 274/535] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:01:42 2022] POST /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:01:42.776126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-61efe012-60eb-414c-aca3-bd515d824d4c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:42.776749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-61efe012-60eb-414c-aca3-bd515d824d4c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:42.791393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61efe012-60eb-414c-aca3-bd515d824d4c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:42.791853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61efe012-60eb-414c-aca3-bd515d824d4c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:42.792657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61efe012-60eb-414c-aca3-bd515d824d4c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:42.793320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61efe012-60eb-414c-aca3-bd515d824d4c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:42.905969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-61efe012-60eb-414c-aca3-bd515d824d4c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66edcb96865e4215b5055587592192e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681cd204f3dd4dc698a9a4a15a6e728c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:42.908646 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-61efe012-60eb-414c-aca3-bd515d824d4c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 200 len: 1277 microversion: 2.1 time: 0.137736 Jan 22 21:01:42.909820 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 275/536] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:42 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 1277 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:42.929929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1fa4f613-b63f-474c-abf3-1ca59f6b546e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:42.929929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1fa4f613-b63f-474c-abf3-1ca59f6b546e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:42.933654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fa4f613-b63f-474c-abf3-1ca59f6b546e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:42.934309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fa4f613-b63f-474c-abf3-1ca59f6b546e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:42.935118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fa4f613-b63f-474c-abf3-1ca59f6b546e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:42.935567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fa4f613-b63f-474c-abf3-1ca59f6b546e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:43.014899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-17f3127d-f079-4b0a-93cf-0610ba13c6e9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:43.020521 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17f3127d-f079-4b0a-93cf-0610ba13c6e9 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1314 microversion: 2.1 time: 0.291252 Jan 22 21:01:43.021536 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 262/537] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:42 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:43.038097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-82813459-3f46-4b8f-9d2d-2c3c8292afff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:43.038954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-82813459-3f46-4b8f-9d2d-2c3c8292afff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:43.141341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-82813459-3f46-4b8f-9d2d-2c3c8292afff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:43.150281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-82813459-3f46-4b8f-9d2d-2c3c8292afff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:43.152078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-82813459-3f46-4b8f-9d2d-2c3c8292afff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:43.153370 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-82813459-3f46-4b8f-9d2d-2c3c8292afff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1265 microversion: 2.25 time: 0.130808 Jan 22 21:01:43.164712 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 263/538] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:43 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:43.169936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-71fd1da3-3d60-409a-9c33-2be2fada74ab req-705862a5-ca27-42d5-91f1-2aced7e967a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc09b6eb-2701-4e2c-a135-a2f65c05eabf", "name": "network-vif-plugged", "status": "completed", "tag": "9c612c1a-080f-4f7f-a757-7d20ac1cee0d"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:43.172816 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:43.172816 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:43.184399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-71fd1da3-3d60-409a-9c33-2be2fada74ab req-705862a5-ca27-42d5-91f1-2aced7e967a0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:43.189751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-71fd1da3-3d60-409a-9c33-2be2fada74ab req-705862a5-ca27-42d5-91f1-2aced7e967a0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:43.202009 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-71fd1da3-3d60-409a-9c33-2be2fada74ab req-705862a5-ca27-42d5-91f1-2aced7e967a0 service nova] Creating event network-vif-plugged:9c612c1a-080f-4f7f-a757-7d20ac1cee0d for instance bc09b6eb-2701-4e2c-a135-a2f65c05eabf on nch2-master-1 Jan 22 21:01:43.212722 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-71fd1da3-3d60-409a-9c33-2be2fada74ab req-705862a5-ca27-42d5-91f1-2aced7e967a0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045084 Jan 22 21:01:43.212722 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 264/539] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:43.217734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d0fa2648-2204-49cf-aba8-cb17469b4ccc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:43.219097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d0fa2648-2204-49cf-aba8-cb17469b4ccc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:43.245600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0fa2648-2204-49cf-aba8-cb17469b4ccc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:43.246117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0fa2648-2204-49cf-aba8-cb17469b4ccc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:43.246866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0fa2648-2204-49cf-aba8-cb17469b4ccc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:43.247419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0fa2648-2204-49cf-aba8-cb17469b4ccc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:43.283080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0fa2648-2204-49cf-aba8-cb17469b4ccc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:43.285087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0fa2648-2204-49cf-aba8-cb17469b4ccc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:43.285783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-d0fa2648-2204-49cf-aba8-cb17469b4ccc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lazy-loading 'fault' on Instance uuid 29c65aa5-3070-400c-8137-94e83ffff9cc {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:01:43.385450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1fa4f613-b63f-474c-abf3-1ca59f6b546e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:43.396063 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1fa4f613-b63f-474c-abf3-1ca59f6b546e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 200 len: 1388 microversion: 2.1 time: 0.471379 Jan 22 21:01:43.404431 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 276/540] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:42 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 1388 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:43.409954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0dd49bc1-39c2-4e51-9b07-d8d47a848245 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:43.410703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0dd49bc1-39c2-4e51-9b07-d8d47a848245 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:43.419074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dd49bc1-39c2-4e51-9b07-d8d47a848245 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:43.419074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dd49bc1-39c2-4e51-9b07-d8d47a848245 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:43.419074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dd49bc1-39c2-4e51-9b07-d8d47a848245 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:43.419074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dd49bc1-39c2-4e51-9b07-d8d47a848245 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:43.568426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d0fa2648-2204-49cf-aba8-cb17469b4ccc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:43.577870 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d0fa2648-2204-49cf-aba8-cb17469b4ccc tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1456 microversion: 2.1 time: 0.366132 Jan 22 21:01:43.578449 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 265/541] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:43 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1456 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:43.587814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-79673d64-7853-4cba-8caa-72614d77edae tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:43.595043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-79673d64-7853-4cba-8caa-72614d77edae tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:43.600667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79673d64-7853-4cba-8caa-72614d77edae tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:43.601736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79673d64-7853-4cba-8caa-72614d77edae tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:43.603126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79673d64-7853-4cba-8caa-72614d77edae tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:43.603689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79673d64-7853-4cba-8caa-72614d77edae tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:43.835096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-79673d64-7853-4cba-8caa-72614d77edae tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c921b8a098454af8becc1074ab0eb4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca97602282f40168d95eb37d81f93e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:43.842995 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-79673d64-7853-4cba-8caa-72614d77edae tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 200 len: 1336 microversion: 2.1 time: 0.262785 Jan 22 21:01:43.844666 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 266/542] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:43 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 1336 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:43.860058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a541a291-912c-477d-b127-b2b636427b1e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:43.860798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a541a291-912c-477d-b127-b2b636427b1e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:43.869125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a541a291-912c-477d-b127-b2b636427b1e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:43.870051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a541a291-912c-477d-b127-b2b636427b1e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:43.871007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a541a291-912c-477d-b127-b2b636427b1e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:43.871594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a541a291-912c-477d-b127-b2b636427b1e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:43.900666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a541a291-912c-477d-b127-b2b636427b1e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:01:44.102527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0dd49bc1-39c2-4e51-9b07-d8d47a848245 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05643e88435d482fb3ed96d0a7f15208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe12a63826247c889a1700eba378728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:44.110189 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0dd49bc1-39c2-4e51-9b07-d8d47a848245 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8" status: 200 len: 1321 microversion: 2.1 time: 0.704667 Jan 22 21:01:44.121028 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 277/543] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:43 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8 => generated 1321 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:44.121028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0ea6996d-ac3b-4f78-a2a8-2dfcdced97d5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:44.121028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0ea6996d-ac3b-4f78-a2a8-2dfcdced97d5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:44.125632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ea6996d-ac3b-4f78-a2a8-2dfcdced97d5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:44.126380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ea6996d-ac3b-4f78-a2a8-2dfcdced97d5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:44.128098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ea6996d-ac3b-4f78-a2a8-2dfcdced97d5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:44.128491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ea6996d-ac3b-4f78-a2a8-2dfcdced97d5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:44.242817 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a541a291-912c-477d-b127-b2b636427b1e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "DELETE /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 204 len: 0 microversion: 2.1 time: 0.396660 Jan 22 21:01:44.244024 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 267/544] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:01:43 2022] DELETE /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:01:44.251278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-442412e5-b817-4f93-8912-8beda99aaec7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:44.251975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-442412e5-b817-4f93-8912-8beda99aaec7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:44.258496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-442412e5-b817-4f93-8912-8beda99aaec7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:44.258943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-442412e5-b817-4f93-8912-8beda99aaec7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:44.259736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-442412e5-b817-4f93-8912-8beda99aaec7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:44.260173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-442412e5-b817-4f93-8912-8beda99aaec7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:44.661025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-442412e5-b817-4f93-8912-8beda99aaec7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66edcb96865e4215b5055587592192e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681cd204f3dd4dc698a9a4a15a6e728c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:44.668523 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-442412e5-b817-4f93-8912-8beda99aaec7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 200 len: 1319 microversion: 2.1 time: 0.422401 Jan 22 21:01:44.669097 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 268/545] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:44 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 1319 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:44.673532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-20fe41ca-1ce8-4dc9-ae0e-0c69420bd9c7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:44.674146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-20fe41ca-1ce8-4dc9-ae0e-0c69420bd9c7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:44.680972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20fe41ca-1ce8-4dc9-ae0e-0c69420bd9c7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:44.681430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20fe41ca-1ce8-4dc9-ae0e-0c69420bd9c7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:44.682253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20fe41ca-1ce8-4dc9-ae0e-0c69420bd9c7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:44.682696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20fe41ca-1ce8-4dc9-ae0e-0c69420bd9c7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:44.803297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0ea6996d-ac3b-4f78-a2a8-2dfcdced97d5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:44.811137 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0ea6996d-ac3b-4f78-a2a8-2dfcdced97d5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 200 len: 1311 microversion: 2.1 time: 0.696966 Jan 22 21:01:44.812004 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 278/546] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:44 2022] GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 1311 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:44.817681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f28e32a2-ccc2-4543-aa6e-5f32caf527c5 req-6850bcc8-0227-4250-ac6a-82e1ed1ff4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59386c42-117b-4309-9c99-c977fc1cbdef", "tag": "79c00dcb-7c5c-472a-a9f9-846204b548e1"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:44.819701 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:44.819701 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:44.827881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-20fe41ca-1ce8-4dc9-ae0e-0c69420bd9c7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:44.830217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f28e32a2-ccc2-4543-aa6e-5f32caf527c5 req-6850bcc8-0227-4250-ac6a-82e1ed1ff4c8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:44.833711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f28e32a2-ccc2-4543-aa6e-5f32caf527c5 req-6850bcc8-0227-4250-ac6a-82e1ed1ff4c8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:44.837586 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-20fe41ca-1ce8-4dc9-ae0e-0c69420bd9c7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1314 microversion: 2.1 time: 0.167400 Jan 22 21:01:44.841292 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 269/547] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:44 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:44.851816 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f28e32a2-ccc2-4543-aa6e-5f32caf527c5 req-6850bcc8-0227-4250-ac6a-82e1ed1ff4c8 service nova] Creating event network-changed:79c00dcb-7c5c-472a-a9f9-846204b548e1 for instance 59386c42-117b-4309-9c99-c977fc1cbdef on nch1-master-1 Jan 22 21:01:44.855473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c57d3fd4-5c2d-4c6e-8b51-263aac67d1c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:44.861513 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f28e32a2-ccc2-4543-aa6e-5f32caf527c5 req-6850bcc8-0227-4250-ac6a-82e1ed1ff4c8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047812 Jan 22 21:01:44.862218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c57d3fd4-5c2d-4c6e-8b51-263aac67d1c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:44.862619 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 279/548] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:44.869255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dd07a4b5-d7f9-4521-a345-182fae6e6a3b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:44.870224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dd07a4b5-d7f9-4521-a345-182fae6e6a3b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:44.871399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c57d3fd4-5c2d-4c6e-8b51-263aac67d1c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:44.872097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c57d3fd4-5c2d-4c6e-8b51-263aac67d1c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:44.873195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c57d3fd4-5c2d-4c6e-8b51-263aac67d1c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:44.873881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c57d3fd4-5c2d-4c6e-8b51-263aac67d1c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:44.879081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd07a4b5-d7f9-4521-a345-182fae6e6a3b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:44.879081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd07a4b5-d7f9-4521-a345-182fae6e6a3b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:44.879951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd07a4b5-d7f9-4521-a345-182fae6e6a3b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:44.880391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd07a4b5-d7f9-4521-a345-182fae6e6a3b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:44.921671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd07a4b5-d7f9-4521-a345-182fae6e6a3b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:44.922063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd07a4b5-d7f9-4521-a345-182fae6e6a3b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:44.922673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-dd07a4b5-d7f9-4521-a345-182fae6e6a3b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lazy-loading 'fault' on Instance uuid 29c65aa5-3070-400c-8137-94e83ffff9cc {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:01:44.959281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c57d3fd4-5c2d-4c6e-8b51-263aac67d1c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:44.969728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c57d3fd4-5c2d-4c6e-8b51-263aac67d1c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:44.971374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c57d3fd4-5c2d-4c6e-8b51-263aac67d1c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:44.972723 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c57d3fd4-5c2d-4c6e-8b51-263aac67d1c8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1325 microversion: 2.25 time: 0.124330 Jan 22 21:01:44.973579 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 270/549] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:44 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1325 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:44.979093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ed066469-79f7-4218-bfe7-3f4f15e963ab tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:44.979704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ed066469-79f7-4218-bfe7-3f4f15e963ab tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:44.985849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed066469-79f7-4218-bfe7-3f4f15e963ab tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:44.986314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed066469-79f7-4218-bfe7-3f4f15e963ab tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:44.987285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed066469-79f7-4218-bfe7-3f4f15e963ab tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:44.987736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed066469-79f7-4218-bfe7-3f4f15e963ab tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:45.141241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed066469-79f7-4218-bfe7-3f4f15e963ab tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:45.149261 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ed066469-79f7-4218-bfe7-3f4f15e963ab tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 200 len: 1388 microversion: 2.1 time: 0.174660 Jan 22 21:01:45.149926 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 271/550] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:44 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 1388 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:45.154372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-51833952-f664-45d9-b874-abed1869a8f0 req-ca415bf5-eac6-467e-a852-612c6d812e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "664d69ee-34da-42b7-8e5e-7dc8adc0ed77", "tag": "c24f136c-37da-4fb5-bd76-da0d44ee4299"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:45.159492 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:45.159492 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:45.163767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-51833952-f664-45d9-b874-abed1869a8f0 req-ca415bf5-eac6-467e-a852-612c6d812e06 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:45.164218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-51833952-f664-45d9-b874-abed1869a8f0 req-ca415bf5-eac6-467e-a852-612c6d812e06 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:45.175993 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-51833952-f664-45d9-b874-abed1869a8f0 req-ca415bf5-eac6-467e-a852-612c6d812e06 service nova] Creating event network-changed:c24f136c-37da-4fb5-bd76-da0d44ee4299 for instance 664d69ee-34da-42b7-8e5e-7dc8adc0ed77 on nch2-master-1 Jan 22 21:01:45.180960 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-51833952-f664-45d9-b874-abed1869a8f0 req-ca415bf5-eac6-467e-a852-612c6d812e06 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029922 Jan 22 21:01:45.181584 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 272/551] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:45.186970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-79f34ce3-2247-4fc5-a55d-2d17981b00cc tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:45.187295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-79f34ce3-2247-4fc5-a55d-2d17981b00cc tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:45.193668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79f34ce3-2247-4fc5-a55d-2d17981b00cc tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:45.194120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79f34ce3-2247-4fc5-a55d-2d17981b00cc tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:45.194907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79f34ce3-2247-4fc5-a55d-2d17981b00cc tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:45.195346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79f34ce3-2247-4fc5-a55d-2d17981b00cc tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:45.416781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-79f34ce3-2247-4fc5-a55d-2d17981b00cc tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c921b8a098454af8becc1074ab0eb4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca97602282f40168d95eb37d81f93e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:45.429092 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-79f34ce3-2247-4fc5-a55d-2d17981b00cc tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 200 len: 1336 microversion: 2.1 time: 0.245895 Jan 22 21:01:45.430867 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 273/552] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:45 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 1336 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:45.437451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a18a2d40-d8ed-4539-88b8-cbca5016a560 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:45.439637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a18a2d40-d8ed-4539-88b8-cbca5016a560 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:45.446669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a18a2d40-d8ed-4539-88b8-cbca5016a560 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:45.447425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a18a2d40-d8ed-4539-88b8-cbca5016a560 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:45.448445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a18a2d40-d8ed-4539-88b8-cbca5016a560 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:45.449059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a18a2d40-d8ed-4539-88b8-cbca5016a560 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:45.537188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dd07a4b5-d7f9-4521-a345-182fae6e6a3b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:45.546251 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dd07a4b5-d7f9-4521-a345-182fae6e6a3b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1462 microversion: 2.1 time: 0.682251 Jan 22 21:01:45.557755 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 280/553] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:44 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1462 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:45.694755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8bd5c0f5-1029-482c-b5c4-c9ae3f3bbb74 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:45.695633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8bd5c0f5-1029-482c-b5c4-c9ae3f3bbb74 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:45.706675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bd5c0f5-1029-482c-b5c4-c9ae3f3bbb74 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:45.707385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bd5c0f5-1029-482c-b5c4-c9ae3f3bbb74 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:45.708425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bd5c0f5-1029-482c-b5c4-c9ae3f3bbb74 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:45.709055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bd5c0f5-1029-482c-b5c4-c9ae3f3bbb74 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:45.805278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a18a2d40-d8ed-4539-88b8-cbca5016a560 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05643e88435d482fb3ed96d0a7f15208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe12a63826247c889a1700eba378728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:45.816167 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a18a2d40-d8ed-4539-88b8-cbca5016a560 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8" status: 200 len: 1321 microversion: 2.1 time: 0.382589 Jan 22 21:01:45.819218 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 274/554] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:45 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:45.833645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1a5897a8-1d6a-400c-a9dc-29764b7db8c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:45.834700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1a5897a8-1d6a-400c-a9dc-29764b7db8c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:45.845783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a5897a8-1d6a-400c-a9dc-29764b7db8c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:45.847011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a5897a8-1d6a-400c-a9dc-29764b7db8c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:45.848604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a5897a8-1d6a-400c-a9dc-29764b7db8c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:45.849213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a5897a8-1d6a-400c-a9dc-29764b7db8c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:46.086449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1a5897a8-1d6a-400c-a9dc-29764b7db8c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:46.094013 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1a5897a8-1d6a-400c-a9dc-29764b7db8c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 200 len: 1311 microversion: 2.1 time: 0.265667 Jan 22 21:01:46.095352 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 275/555] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:45 2022] GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 1311 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:01:46.103733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-906cd3c5-af33-4ca8-9fb4-54f3b0b7c4b4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:46.104556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-906cd3c5-af33-4ca8-9fb4-54f3b0b7c4b4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:46.110743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-906cd3c5-af33-4ca8-9fb4-54f3b0b7c4b4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:46.111443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-906cd3c5-af33-4ca8-9fb4-54f3b0b7c4b4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:46.112829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-906cd3c5-af33-4ca8-9fb4-54f3b0b7c4b4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:46.113570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-906cd3c5-af33-4ca8-9fb4-54f3b0b7c4b4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:46.272660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-906cd3c5-af33-4ca8-9fb4-54f3b0b7c4b4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:46.281251 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-906cd3c5-af33-4ca8-9fb4-54f3b0b7c4b4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1314 microversion: 2.1 time: 0.180783 Jan 22 21:01:46.294052 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 276/556] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:46 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:46.299660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7364d776-2707-4d64-b92e-c53e836294af tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:46.300626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7364d776-2707-4d64-b92e-c53e836294af tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:46.310768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7364d776-2707-4d64-b92e-c53e836294af tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:46.311431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7364d776-2707-4d64-b92e-c53e836294af tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:46.312432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7364d776-2707-4d64-b92e-c53e836294af tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:46.313220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7364d776-2707-4d64-b92e-c53e836294af tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:46.397622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8bd5c0f5-1029-482c-b5c4-c9ae3f3bbb74 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66edcb96865e4215b5055587592192e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681cd204f3dd4dc698a9a4a15a6e728c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:46.412305 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8bd5c0f5-1029-482c-b5c4-c9ae3f3bbb74 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 200 len: 1319 microversion: 2.1 time: 0.727164 Jan 22 21:01:46.413730 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 281/557] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:45 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 1319 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:46.423114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f46bc81-8c34-4b28-af3c-52107d2c5968 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:46.428864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9f46bc81-8c34-4b28-af3c-52107d2c5968 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:46.445280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f46bc81-8c34-4b28-af3c-52107d2c5968 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:46.445893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f46bc81-8c34-4b28-af3c-52107d2c5968 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:46.446943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f46bc81-8c34-4b28-af3c-52107d2c5968 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:46.447494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f46bc81-8c34-4b28-af3c-52107d2c5968 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:46.450772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7364d776-2707-4d64-b92e-c53e836294af tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:46.479938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7364d776-2707-4d64-b92e-c53e836294af tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:46.481536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7364d776-2707-4d64-b92e-c53e836294af tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:46.486510 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7364d776-2707-4d64-b92e-c53e836294af tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1323 microversion: 2.25 time: 0.190879 Jan 22 21:01:46.488933 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 277/558] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:46 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:46.497606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-8ce5b7f7-9b5f-4356-9717-f4f83041b491 req-4f9b26cb-c8ed-4892-95bf-29b728933143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc1b81e-307f-4153-ae1a-a192c15f6db8", "name": "network-vif-plugged", "status": "completed", "tag": "3493c6ae-bbe9-465d-8bee-47a6ee910cac"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:46.499359 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:46.499359 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:46.508629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8ce5b7f7-9b5f-4356-9717-f4f83041b491 req-4f9b26cb-c8ed-4892-95bf-29b728933143 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:46.509071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8ce5b7f7-9b5f-4356-9717-f4f83041b491 req-4f9b26cb-c8ed-4892-95bf-29b728933143 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:46.525834 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-8ce5b7f7-9b5f-4356-9717-f4f83041b491 req-4f9b26cb-c8ed-4892-95bf-29b728933143 service nova] Creating event network-vif-plugged:3493c6ae-bbe9-465d-8bee-47a6ee910cac for instance 6bc1b81e-307f-4153-ae1a-a192c15f6db8 on nch1-master-1 Jan 22 21:01:46.531770 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-8ce5b7f7-9b5f-4356-9717-f4f83041b491 req-4f9b26cb-c8ed-4892-95bf-29b728933143 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041054 Jan 22 21:01:46.532694 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 278/559] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:46.539499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4449fe81-973a-4b11-9a64-54b4a5a0dce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:46.540396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4449fe81-973a-4b11-9a64-54b4a5a0dce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:46.548705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4449fe81-973a-4b11-9a64-54b4a5a0dce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:46.549195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4449fe81-973a-4b11-9a64-54b4a5a0dce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:46.550710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4449fe81-973a-4b11-9a64-54b4a5a0dce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:46.551136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4449fe81-973a-4b11-9a64-54b4a5a0dce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:46.722854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4449fe81-973a-4b11-9a64-54b4a5a0dce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c921b8a098454af8becc1074ab0eb4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca97602282f40168d95eb37d81f93e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:46.732156 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4449fe81-973a-4b11-9a64-54b4a5a0dce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 200 len: 1541 microversion: 2.1 time: 0.198027 Jan 22 21:01:46.742627 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 279/560] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:46 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 1541 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:46.742627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6905da98-4010-48fe-bdb3-64824ce2a49b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:46.742627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6905da98-4010-48fe-bdb3-64824ce2a49b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:46.747262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6905da98-4010-48fe-bdb3-64824ce2a49b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:46.747262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6905da98-4010-48fe-bdb3-64824ce2a49b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:46.747262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6905da98-4010-48fe-bdb3-64824ce2a49b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:46.747877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6905da98-4010-48fe-bdb3-64824ce2a49b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:46.784565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6905da98-4010-48fe-bdb3-64824ce2a49b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:46.785807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6905da98-4010-48fe-bdb3-64824ce2a49b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:46.786353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-6905da98-4010-48fe-bdb3-64824ce2a49b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lazy-loading 'fault' on Instance uuid 29c65aa5-3070-400c-8137-94e83ffff9cc {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:01:46.910189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6905da98-4010-48fe-bdb3-64824ce2a49b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:46.917695 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6905da98-4010-48fe-bdb3-64824ce2a49b tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1462 microversion: 2.1 time: 0.183833 Jan 22 21:01:46.918269 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 280/561] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:46 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1462 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:46.923079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-101951da-c640-4d27-a228-749b8f6b00dd tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Action: 'create', calling method: .version_select at 0x7f1ed61d85e0>, body: {"pool": "7238f98a-601e-4ad2-8860-b11b52ffa4fe"} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:47.214154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9f46bc81-8c34-4b28-af3c-52107d2c5968 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:47.225081 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9f46bc81-8c34-4b28-af3c-52107d2c5968 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 200 len: 1388 microversion: 2.1 time: 0.808393 Jan 22 21:01:47.225879 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 282/562] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:46 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 1388 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:47.231879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fbfb7c37-ba5f-4e7a-bfdd-bc84f47ce51a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:47.232497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fbfb7c37-ba5f-4e7a-bfdd-bc84f47ce51a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:47.239589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbfb7c37-ba5f-4e7a-bfdd-bc84f47ce51a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:47.240255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbfb7c37-ba5f-4e7a-bfdd-bc84f47ce51a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:47.244612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbfb7c37-ba5f-4e7a-bfdd-bc84f47ce51a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:47.244612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbfb7c37-ba5f-4e7a-bfdd-bc84f47ce51a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:47.648278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fbfb7c37-ba5f-4e7a-bfdd-bc84f47ce51a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05643e88435d482fb3ed96d0a7f15208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe12a63826247c889a1700eba378728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:47.655831 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fbfb7c37-ba5f-4e7a-bfdd-bc84f47ce51a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8" status: 200 len: 1321 microversion: 2.1 time: 0.428712 Jan 22 21:01:47.656402 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 283/563] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:47 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8 => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:47.661953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-bf0a0431-182a-4bff-b34f-4dcfae7ffb75 req-070a3546-4dbc-4a87-acef-1686e3326dcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "820ae2cd-bf19-499c-a236-4a8e92f974cc", "tag": "422a108d-537c-4443-bbb2-9257b333140e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:47.663577 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:47.663577 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:47.670805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bf0a0431-182a-4bff-b34f-4dcfae7ffb75 req-070a3546-4dbc-4a87-acef-1686e3326dcf service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:47.671267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bf0a0431-182a-4bff-b34f-4dcfae7ffb75 req-070a3546-4dbc-4a87-acef-1686e3326dcf service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:47.684899 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-bf0a0431-182a-4bff-b34f-4dcfae7ffb75 req-070a3546-4dbc-4a87-acef-1686e3326dcf service nova] Creating event network-changed:422a108d-537c-4443-bbb2-9257b333140e for instance 820ae2cd-bf19-499c-a236-4a8e92f974cc on nch2-master-1 Jan 22 21:01:47.689600 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-bf0a0431-182a-4bff-b34f-4dcfae7ffb75 req-070a3546-4dbc-4a87-acef-1686e3326dcf service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032069 Jan 22 21:01:47.690338 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 284/564] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:47.695435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5b099e23-eea1-4e72-995d-22b2b9a13f94 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:47.700675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5b099e23-eea1-4e72-995d-22b2b9a13f94 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:47.707792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b099e23-eea1-4e72-995d-22b2b9a13f94 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:47.708241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b099e23-eea1-4e72-995d-22b2b9a13f94 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:47.709244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b099e23-eea1-4e72-995d-22b2b9a13f94 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:47.709707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b099e23-eea1-4e72-995d-22b2b9a13f94 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:47.990073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5b099e23-eea1-4e72-995d-22b2b9a13f94 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:47.997648 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5b099e23-eea1-4e72-995d-22b2b9a13f94 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 200 len: 1311 microversion: 2.1 time: 0.305926 Jan 22 21:01:47.998361 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 285/565] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:47 2022] GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 1311 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:48.003224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-31846c6d-1f22-4b02-909c-ae1e77b31a68 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:48.004032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-31846c6d-1f22-4b02-909c-ae1e77b31a68 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:48.010052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31846c6d-1f22-4b02-909c-ae1e77b31a68 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:48.010788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31846c6d-1f22-4b02-909c-ae1e77b31a68 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:48.011797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31846c6d-1f22-4b02-909c-ae1e77b31a68 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:48.012241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31846c6d-1f22-4b02-909c-ae1e77b31a68 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:48.497584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-31846c6d-1f22-4b02-909c-ae1e77b31a68 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:48.509260 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-31846c6d-1f22-4b02-909c-ae1e77b31a68 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1314 microversion: 2.1 time: 0.509853 Jan 22 21:01:48.520678 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 286/566] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:47 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:48.526359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dcb11e07-bf91-4d23-9cfa-fd317ef415f1 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:48.527212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dcb11e07-bf91-4d23-9cfa-fd317ef415f1 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:48.535524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcb11e07-bf91-4d23-9cfa-fd317ef415f1 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:48.536154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcb11e07-bf91-4d23-9cfa-fd317ef415f1 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:48.540226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcb11e07-bf91-4d23-9cfa-fd317ef415f1 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:48.540226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcb11e07-bf91-4d23-9cfa-fd317ef415f1 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:48.774779 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-101951da-c640-4d27-a228-749b8f6b00dd tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.855130 Jan 22 21:01:48.776519 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 281/567] 10.222.0.100 () {60 vars in 1174 bytes} [Sat Jan 22 21:01:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:48.785047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7214dd6b-6c75-4141-9d96-139a89027fb8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:48.785771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7214dd6b-6c75-4141-9d96-139a89027fb8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:48.793129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7214dd6b-6c75-4141-9d96-139a89027fb8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:48.794023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7214dd6b-6c75-4141-9d96-139a89027fb8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:48.794869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7214dd6b-6c75-4141-9d96-139a89027fb8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:48.795320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7214dd6b-6c75-4141-9d96-139a89027fb8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:48.871624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dcb11e07-bf91-4d23-9cfa-fd317ef415f1 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66edcb96865e4215b5055587592192e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681cd204f3dd4dc698a9a4a15a6e728c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:48.885819 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dcb11e07-bf91-4d23-9cfa-fd317ef415f1 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 200 len: 1319 microversion: 2.1 time: 0.363422 Jan 22 21:01:48.896464 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 287/568] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:48 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:48.896464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3fd5f08f-7970-410c-8a14-2b4ca976fcee tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:48.896464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3fd5f08f-7970-410c-8a14-2b4ca976fcee tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:48.910387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fd5f08f-7970-410c-8a14-2b4ca976fcee tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:48.910901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fd5f08f-7970-410c-8a14-2b4ca976fcee tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:48.917056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fd5f08f-7970-410c-8a14-2b4ca976fcee tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:48.917056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fd5f08f-7970-410c-8a14-2b4ca976fcee tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:48.971906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fd5f08f-7970-410c-8a14-2b4ca976fcee tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:48.972703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fd5f08f-7970-410c-8a14-2b4ca976fcee tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:48.973456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-3fd5f08f-7970-410c-8a14-2b4ca976fcee tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lazy-loading 'fault' on Instance uuid 29c65aa5-3070-400c-8137-94e83ffff9cc {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:01:48.983895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7214dd6b-6c75-4141-9d96-139a89027fb8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:48.997099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7214dd6b-6c75-4141-9d96-139a89027fb8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:48.998638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7214dd6b-6c75-4141-9d96-139a89027fb8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:48.999935 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7214dd6b-6c75-4141-9d96-139a89027fb8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1365 microversion: 2.25 time: 0.221833 Jan 22 21:01:49.000818 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 282/569] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:48 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:49.006749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-884e5d46-b0a5-452d-b58d-6422833003d4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:49.007562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-884e5d46-b0a5-452d-b58d-6422833003d4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:49.018004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-884e5d46-b0a5-452d-b58d-6422833003d4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:49.018792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-884e5d46-b0a5-452d-b58d-6422833003d4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:49.020410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-884e5d46-b0a5-452d-b58d-6422833003d4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:49.020527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-884e5d46-b0a5-452d-b58d-6422833003d4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:49.032736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3fd5f08f-7970-410c-8a14-2b4ca976fcee tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8e24e6af4842f6b280ceaba346cd08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfbdb8e94e9c48f49f240f4eecde539a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:49.058699 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3fd5f08f-7970-410c-8a14-2b4ca976fcee tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 200 len: 1313 microversion: 2.1 time: 0.169534 Jan 22 21:01:49.059796 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 288/570] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:48 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:49.067457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-49fc22e3-8999-4052-9f97-b9492ff4b82d tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:49.069365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-49fc22e3-8999-4052-9f97-b9492ff4b82d tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:49.076632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49fc22e3-8999-4052-9f97-b9492ff4b82d tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:49.077367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49fc22e3-8999-4052-9f97-b9492ff4b82d tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:49.078487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49fc22e3-8999-4052-9f97-b9492ff4b82d tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:49.079220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49fc22e3-8999-4052-9f97-b9492ff4b82d tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:49.211356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-884e5d46-b0a5-452d-b58d-6422833003d4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:49.219388 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-884e5d46-b0a5-452d-b58d-6422833003d4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 200 len: 1388 microversion: 2.1 time: 0.217243 Jan 22 21:01:49.229962 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 283/571] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:49 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 1388 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:49.234991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1057df2b-6e67-4b4b-b26c-cc98a353d9e3 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Action: 'action', calling method: .version_select at 0x7f1ed8497550>, body: {"addFloatingIp": {"address": "172.35.1.182"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:49.236308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1057df2b-6e67-4b4b-b26c-cc98a353d9e3 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:49.242980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1057df2b-6e67-4b4b-b26c-cc98a353d9e3 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:49.243432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1057df2b-6e67-4b4b-b26c-cc98a353d9e3 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:49.247275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1057df2b-6e67-4b4b-b26c-cc98a353d9e3 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:49.247275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1057df2b-6e67-4b4b-b26c-cc98a353d9e3 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:49.321253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-49fc22e3-8999-4052-9f97-b9492ff4b82d tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05643e88435d482fb3ed96d0a7f15208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe12a63826247c889a1700eba378728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:49.331640 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-49fc22e3-8999-4052-9f97-b9492ff4b82d tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8" status: 200 len: 1511 microversion: 2.1 time: 0.270536 Jan 22 21:01:49.332237 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 289/572] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:49 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8 => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:49.335525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1057df2b-6e67-4b4b-b26c-cc98a353d9e3 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Acquired lock "refresh_cache-bc09b6eb-2701-4e2c-a135-a2f65c05eabf" {{(pid=137032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 22 21:01:49.337009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7234c2d0-ebfa-495a-860f-e891a71322a8 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:49.337666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7234c2d0-ebfa-495a-860f-e891a71322a8 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:49.343760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7234c2d0-ebfa-495a-860f-e891a71322a8 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:49.344215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7234c2d0-ebfa-495a-860f-e891a71322a8 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:49.345047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7234c2d0-ebfa-495a-860f-e891a71322a8 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:49.345495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7234c2d0-ebfa-495a-860f-e891a71322a8 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:49.610185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7234c2d0-ebfa-495a-860f-e891a71322a8 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:49.622110 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7234c2d0-ebfa-495a-860f-e891a71322a8 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 200 len: 1311 microversion: 2.1 time: 0.288497 Jan 22 21:01:49.622707 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 290/573] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:49 2022] GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 1311 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:49.632736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-4c2b66cf-772f-47a5-b420-9845535efa4d req-619e7bd4-2048-4eb3-aa4e-29fb3ab9f244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59386c42-117b-4309-9c99-c977fc1cbdef", "name": "network-vif-plugged", "status": "completed", "tag": "79c00dcb-7c5c-472a-a9f9-846204b548e1"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:49.634592 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:49.634592 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:49.641992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4c2b66cf-772f-47a5-b420-9845535efa4d req-619e7bd4-2048-4eb3-aa4e-29fb3ab9f244 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:49.642447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4c2b66cf-772f-47a5-b420-9845535efa4d req-619e7bd4-2048-4eb3-aa4e-29fb3ab9f244 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:49.655984 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-4c2b66cf-772f-47a5-b420-9845535efa4d req-619e7bd4-2048-4eb3-aa4e-29fb3ab9f244 service nova] Creating event network-vif-plugged:79c00dcb-7c5c-472a-a9f9-846204b548e1 for instance 59386c42-117b-4309-9c99-c977fc1cbdef on nch1-master-1 Jan 22 21:01:49.660937 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-4c2b66cf-772f-47a5-b420-9845535efa4d req-619e7bd4-2048-4eb3-aa4e-29fb3ab9f244 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035936 Jan 22 21:01:49.661816 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 291/574] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:49.666499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-84f3ffc5-241f-49ac-b70a-7f0a9fdfe32e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:49.669269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-84f3ffc5-241f-49ac-b70a-7f0a9fdfe32e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:49.683829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84f3ffc5-241f-49ac-b70a-7f0a9fdfe32e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:49.684146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84f3ffc5-241f-49ac-b70a-7f0a9fdfe32e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:49.684919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84f3ffc5-241f-49ac-b70a-7f0a9fdfe32e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:49.686346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84f3ffc5-241f-49ac-b70a-7f0a9fdfe32e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:50.234447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-84f3ffc5-241f-49ac-b70a-7f0a9fdfe32e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:50.245973 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-84f3ffc5-241f-49ac-b70a-7f0a9fdfe32e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1314 microversion: 2.1 time: 0.583064 Jan 22 21:01:50.246967 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 292/575] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:49 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:50.263246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-b37e8f81-db86-405b-8bb8-028ab686963b req-2ad0996c-3c04-46a3-9303-02469d1ac8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c65aa5-3070-400c-8137-94e83ffff9cc", "name": "network-vif-deleted", "tag": "24333c19-e976-4803-9358-a5dd93f4bef8"}, {"name": "network-changed", "server_uuid": "d9618ff2-a2cc-41d5-9d2f-1fd0c63658df", "tag": "b50148da-7bff-4e1e-9ed5-bfed58c0e2bf"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:50.265354 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:50.265354 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:50.279221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-b37e8f81-db86-405b-8bb8-028ab686963b req-2ad0996c-3c04-46a3-9303-02469d1ac8af service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:50.280125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-b37e8f81-db86-405b-8bb8-028ab686963b req-2ad0996c-3c04-46a3-9303-02469d1ac8af service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:50.319177 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-b37e8f81-db86-405b-8bb8-028ab686963b req-2ad0996c-3c04-46a3-9303-02469d1ac8af service nova] Creating event network-vif-deleted:24333c19-e976-4803-9358-a5dd93f4bef8 for instance 29c65aa5-3070-400c-8137-94e83ffff9cc on nch2-master-1 Jan 22 21:01:50.319878 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-b37e8f81-db86-405b-8bb8-028ab686963b req-2ad0996c-3c04-46a3-9303-02469d1ac8af service nova] Creating event network-changed:b50148da-7bff-4e1e-9ed5-bfed58c0e2bf for instance d9618ff2-a2cc-41d5-9d2f-1fd0c63658df on nch1-master-1 Jan 22 21:01:50.328147 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-b37e8f81-db86-405b-8bb8-028ab686963b req-2ad0996c-3c04-46a3-9303-02469d1ac8af service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.077895 Jan 22 21:01:50.329183 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 293/576] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:50.338493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1e735c4e-fdc8-4a52-9c4b-4c509b6b8bd9 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:50.338493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1e735c4e-fdc8-4a52-9c4b-4c509b6b8bd9 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:50.344322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e735c4e-fdc8-4a52-9c4b-4c509b6b8bd9 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:50.344915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e735c4e-fdc8-4a52-9c4b-4c509b6b8bd9 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:50.345970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e735c4e-fdc8-4a52-9c4b-4c509b6b8bd9 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:50.346615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e735c4e-fdc8-4a52-9c4b-4c509b6b8bd9 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:50.619284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1e735c4e-fdc8-4a52-9c4b-4c509b6b8bd9 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66edcb96865e4215b5055587592192e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681cd204f3dd4dc698a9a4a15a6e728c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:50.629367 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1e735c4e-fdc8-4a52-9c4b-4c509b6b8bd9 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 200 len: 1319 microversion: 2.1 time: 0.298879 Jan 22 21:01:50.630020 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 294/577] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:50 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:50.634560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b231b59c-fbf5-4c94-b97b-69e5f48b1da7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:50.635562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b231b59c-fbf5-4c94-b97b-69e5f48b1da7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:50.641439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b231b59c-fbf5-4c94-b97b-69e5f48b1da7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:50.642018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b231b59c-fbf5-4c94-b97b-69e5f48b1da7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:50.642876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b231b59c-fbf5-4c94-b97b-69e5f48b1da7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:50.643348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b231b59c-fbf5-4c94-b97b-69e5f48b1da7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:50.890146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b231b59c-fbf5-4c94-b97b-69e5f48b1da7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:50.898960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b231b59c-fbf5-4c94-b97b-69e5f48b1da7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:50.900854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b231b59c-fbf5-4c94-b97b-69e5f48b1da7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:50.902296 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b231b59c-fbf5-4c94-b97b-69e5f48b1da7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1365 microversion: 2.25 time: 0.271220 Jan 22 21:01:50.914055 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 295/578] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:50 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:50.919210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-91d26d3f-8f66-42d5-8570-6d2b8a25429c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:50.919907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-91d26d3f-8f66-42d5-8570-6d2b8a25429c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:50.927440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91d26d3f-8f66-42d5-8570-6d2b8a25429c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:50.927978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91d26d3f-8f66-42d5-8570-6d2b8a25429c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:50.928903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91d26d3f-8f66-42d5-8570-6d2b8a25429c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:50.929419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91d26d3f-8f66-42d5-8570-6d2b8a25429c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:50.945218 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-91d26d3f-8f66-42d5-8570-6d2b8a25429c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] HTTP exception thrown: Instance 29c65aa5-3070-400c-8137-94e83ffff9cc could not be found. Jan 22 21:01:50.946101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-91d26d3f-8f66-42d5-8570-6d2b8a25429c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Returning 404 to user: Instance 29c65aa5-3070-400c-8137-94e83ffff9cc could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:50.947234 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-91d26d3f-8f66-42d5-8570-6d2b8a25429c tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 404 len: 111 microversion: 2.1 time: 0.032027 Jan 22 21:01:50.947980 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 296/579] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:50 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:01:50.958633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fd0dfa35-d430-4c95-9f88-0cee02267236 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:50.959446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fd0dfa35-d430-4c95-9f88-0cee02267236 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:50.966178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd0dfa35-d430-4c95-9f88-0cee02267236 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:50.966870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd0dfa35-d430-4c95-9f88-0cee02267236 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:50.967988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd0dfa35-d430-4c95-9f88-0cee02267236 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:50.968628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd0dfa35-d430-4c95-9f88-0cee02267236 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:51.188336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-1057df2b-6e67-4b4b-b26c-cc98a353d9e3 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Building network info cache for instance {{(pid=137032) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 22 21:01:51.209161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fd0dfa35-d430-4c95-9f88-0cee02267236 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:51.217218 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fd0dfa35-d430-4c95-9f88-0cee02267236 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 200 len: 1388 microversion: 2.1 time: 0.267790 Jan 22 21:01:51.217833 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 297/580] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:50 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 1388 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:51.225284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cfe7a592-b490-45a9-b23b-b8f0f9c5acc3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:51.227888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cfe7a592-b490-45a9-b23b-b8f0f9c5acc3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:51.234602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfe7a592-b490-45a9-b23b-b8f0f9c5acc3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:51.235820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfe7a592-b490-45a9-b23b-b8f0f9c5acc3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:51.236986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfe7a592-b490-45a9-b23b-b8f0f9c5acc3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:51.237547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfe7a592-b490-45a9-b23b-b8f0f9c5acc3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:51.501589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cfe7a592-b490-45a9-b23b-b8f0f9c5acc3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:51.515121 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cfe7a592-b490-45a9-b23b-b8f0f9c5acc3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 200 len: 1311 microversion: 2.1 time: 0.296195 Jan 22 21:01:51.518247 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 298/581] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:51 2022] GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 1311 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:51.525020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-66d49ed4-0ccf-4c58-8639-eeb8f640cb9e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:51.528593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-66d49ed4-0ccf-4c58-8639-eeb8f640cb9e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:51.538496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66d49ed4-0ccf-4c58-8639-eeb8f640cb9e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:51.538993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66d49ed4-0ccf-4c58-8639-eeb8f640cb9e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:51.539758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66d49ed4-0ccf-4c58-8639-eeb8f640cb9e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:51.540831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66d49ed4-0ccf-4c58-8639-eeb8f640cb9e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:51.557843 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-66d49ed4-0ccf-4c58-8639-eeb8f640cb9e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] HTTP exception thrown: Instance 29c65aa5-3070-400c-8137-94e83ffff9cc could not be found. Jan 22 21:01:51.558449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-66d49ed4-0ccf-4c58-8639-eeb8f640cb9e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Returning 404 to user: Instance 29c65aa5-3070-400c-8137-94e83ffff9cc could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:51.559291 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-66d49ed4-0ccf-4c58-8639-eeb8f640cb9e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "DELETE /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 404 len: 111 microversion: 2.1 time: 0.040061 Jan 22 21:01:51.560043 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 299/582] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:01:51 2022] DELETE /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:01:51.564211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-fa5c3207-f9d7-40c1-8336-a4c5628e8853 req-e0e2373b-9093-4697-9f2a-220a1d326785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc09b6eb-2701-4e2c-a135-a2f65c05eabf", "tag": "9c612c1a-080f-4f7f-a757-7d20ac1cee0d"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:51.565956 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:51.565956 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:51.573244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fa5c3207-f9d7-40c1-8336-a4c5628e8853 req-e0e2373b-9093-4697-9f2a-220a1d326785 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:51.573761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fa5c3207-f9d7-40c1-8336-a4c5628e8853 req-e0e2373b-9093-4697-9f2a-220a1d326785 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:51.590216 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-fa5c3207-f9d7-40c1-8336-a4c5628e8853 req-e0e2373b-9093-4697-9f2a-220a1d326785 service nova] Creating event network-changed:9c612c1a-080f-4f7f-a757-7d20ac1cee0d for instance bc09b6eb-2701-4e2c-a135-a2f65c05eabf on nch2-master-1 Jan 22 21:01:51.595293 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-fa5c3207-f9d7-40c1-8336-a4c5628e8853 req-e0e2373b-9093-4697-9f2a-220a1d326785 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034271 Jan 22 21:01:51.596697 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 300/583] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:51.607306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d28cd02d-3b10-41e7-b2a1-a044bd0d6345 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:51.607306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d28cd02d-3b10-41e7-b2a1-a044bd0d6345 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:51.609189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d28cd02d-3b10-41e7-b2a1-a044bd0d6345 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:51.609774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d28cd02d-3b10-41e7-b2a1-a044bd0d6345 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:51.610504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d28cd02d-3b10-41e7-b2a1-a044bd0d6345 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:51.610952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d28cd02d-3b10-41e7-b2a1-a044bd0d6345 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:51.854824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-1057df2b-6e67-4b4b-b26c-cc98a353d9e3 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Updating instance_info_cache with network_info: [{"id": "9c612c1a-080f-4f7f-a757-7d20ac1cee0d", "address": "fa:16:3e:cd:63:51", "network": {"id": "4a2c59ad-01e2-4c50-bbab-aa5b1350e16a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1961092801-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0ca97602282f40168d95eb37d81f93e4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9c612c1a-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137032) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 22 21:01:51.879541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d28cd02d-3b10-41e7-b2a1-a044bd0d6345 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:51.886924 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d28cd02d-3b10-41e7-b2a1-a044bd0d6345 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1314 microversion: 2.1 time: 0.289159 Jan 22 21:01:51.887774 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 301/584] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:51 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:51.901958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-722e85ac-ea16-4d25-a9d2-8a5a2654a88e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:51.902579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-722e85ac-ea16-4d25-a9d2-8a5a2654a88e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 29c65aa5-3070-400c-8137-94e83ffff9cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:51.911119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-722e85ac-ea16-4d25-a9d2-8a5a2654a88e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:51.911119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-722e85ac-ea16-4d25-a9d2-8a5a2654a88e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:51.911660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-722e85ac-ea16-4d25-a9d2-8a5a2654a88e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:51.912107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-722e85ac-ea16-4d25-a9d2-8a5a2654a88e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:51.916300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1057df2b-6e67-4b4b-b26c-cc98a353d9e3 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Releasing lock "refresh_cache-bc09b6eb-2701-4e2c-a135-a2f65c05eabf" {{(pid=137032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 22 21:01:51.917251 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1057df2b-6e67-4b4b-b26c-cc98a353d9e3 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "POST /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf/action" status: 202 len: 0 microversion: 2.1 time: 2.686046 Jan 22 21:01:51.920979 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 284/585] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:01:49 2022] POST /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf/action => generated 0 bytes in 2687 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 22 21:01:51.923181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-97ca3547-66a1-45d8-9a57-dca9f7d39ba8 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:51.923874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-97ca3547-66a1-45d8-9a57-dca9f7d39ba8 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:51.930571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-97ca3547-66a1-45d8-9a57-dca9f7d39ba8 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:51.931027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-97ca3547-66a1-45d8-9a57-dca9f7d39ba8 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:51.931829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-97ca3547-66a1-45d8-9a57-dca9f7d39ba8 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:51.932270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-97ca3547-66a1-45d8-9a57-dca9f7d39ba8 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:51.934843 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-722e85ac-ea16-4d25-a9d2-8a5a2654a88e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] HTTP exception thrown: Instance 29c65aa5-3070-400c-8137-94e83ffff9cc could not be found. Jan 22 21:01:51.935436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-722e85ac-ea16-4d25-a9d2-8a5a2654a88e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Returning 404 to user: Instance 29c65aa5-3070-400c-8137-94e83ffff9cc could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:51.936281 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-722e85ac-ea16-4d25-a9d2-8a5a2654a88e tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc" status: 404 len: 111 microversion: 2.1 time: 0.038224 Jan 22 21:01:51.937143 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 302/586] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:51 2022] GET /compute/v2.1/servers/29c65aa5-3070-400c-8137-94e83ffff9cc => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:01:51.942036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-fd3bb235-42fb-4ffe-8e31-8295f940905e req-9ce97824-250c-4fcc-8bc8-78654de31010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94e22853-aa4b-47cb-a69e-0e6fd8af5720", "name": "network-vif-plugged", "status": "completed", "tag": "ac2be3fd-0a96-49fc-9bdb-d6f6fc743c9b"}, {"server_uuid": "664d69ee-34da-42b7-8e5e-7dc8adc0ed77", "name": "network-vif-plugged", "status": "completed", "tag": "c24f136c-37da-4fb5-bd76-da0d44ee4299"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:51.943971 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:51.943971 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:51.952349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fd3bb235-42fb-4ffe-8e31-8295f940905e req-9ce97824-250c-4fcc-8bc8-78654de31010 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:51.953076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fd3bb235-42fb-4ffe-8e31-8295f940905e req-9ce97824-250c-4fcc-8bc8-78654de31010 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:51.967059 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-fd3bb235-42fb-4ffe-8e31-8295f940905e req-9ce97824-250c-4fcc-8bc8-78654de31010 service nova] Creating event network-vif-plugged:ac2be3fd-0a96-49fc-9bdb-d6f6fc743c9b for instance 94e22853-aa4b-47cb-a69e-0e6fd8af5720 on nch1-master-1 Jan 22 21:01:51.967827 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-fd3bb235-42fb-4ffe-8e31-8295f940905e req-9ce97824-250c-4fcc-8bc8-78654de31010 service nova] Creating event network-vif-plugged:c24f136c-37da-4fb5-bd76-da0d44ee4299 for instance 664d69ee-34da-42b7-8e5e-7dc8adc0ed77 on nch2-master-1 Jan 22 21:01:51.977743 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-fd3bb235-42fb-4ffe-8e31-8295f940905e req-9ce97824-250c-4fcc-8bc8-78654de31010 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039097 Jan 22 21:01:51.979083 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 303/587] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:51.984632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-38ad7d63-ca8c-45f1-a1a5-f01b929f207f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:51.996244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-38ad7d63-ca8c-45f1-a1a5-f01b929f207f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:52.014301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38ad7d63-ca8c-45f1-a1a5-f01b929f207f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:52.015099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38ad7d63-ca8c-45f1-a1a5-f01b929f207f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:52.016134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38ad7d63-ca8c-45f1-a1a5-f01b929f207f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:52.016778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38ad7d63-ca8c-45f1-a1a5-f01b929f207f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:52.111295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-97ca3547-66a1-45d8-9a57-dca9f7d39ba8 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66edcb96865e4215b5055587592192e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681cd204f3dd4dc698a9a4a15a6e728c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:52.122345 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-97ca3547-66a1-45d8-9a57-dca9f7d39ba8 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 200 len: 1319 microversion: 2.1 time: 0.202394 Jan 22 21:01:52.122932 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 285/588] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:51 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:52.132892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a48b049a-c52c-410b-9f73-d1a1826c8184 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Action: 'create', calling method: .version_select at 0x7f1ed61600d0>, body: {"pool": "7238f98a-601e-4ad2-8860-b11b52ffa4fe"} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:52.395625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-38ad7d63-ca8c-45f1-a1a5-f01b929f207f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:52.405932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-38ad7d63-ca8c-45f1-a1a5-f01b929f207f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:52.407825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-38ad7d63-ca8c-45f1-a1a5-f01b929f207f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:52.410712 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-38ad7d63-ca8c-45f1-a1a5-f01b929f207f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1365 microversion: 2.25 time: 0.430285 Jan 22 21:01:52.422309 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 304/589] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:51 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1365 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:52.428116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cb2067ee-ee0a-41b0-a118-97589117b4ed tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:52.429950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cb2067ee-ee0a-41b0-a118-97589117b4ed tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:52.436235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb2067ee-ee0a-41b0-a118-97589117b4ed tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:52.436771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb2067ee-ee0a-41b0-a118-97589117b4ed tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:52.437614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb2067ee-ee0a-41b0-a118-97589117b4ed tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:52.438222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb2067ee-ee0a-41b0-a118-97589117b4ed tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:52.454844 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-cb2067ee-ee0a-41b0-a118-97589117b4ed tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] HTTP exception thrown: Instance 99966147-7dbb-4eee-86c6-65e8fdc9f14c could not be found. Jan 22 21:01:52.457217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cb2067ee-ee0a-41b0-a118-97589117b4ed tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Returning 404 to user: Instance 99966147-7dbb-4eee-86c6-65e8fdc9f14c could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:52.458301 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cb2067ee-ee0a-41b0-a118-97589117b4ed tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "DELETE /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 404 len: 111 microversion: 2.1 time: 0.034586 Jan 22 21:01:52.459336 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 305/590] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:01:52 2022] DELETE /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:01:52.465069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-01651f82-5bf7-4df3-9d20-ae9d6b859084 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:52.465956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-01651f82-5bf7-4df3-9d20-ae9d6b859084 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:52.473322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01651f82-5bf7-4df3-9d20-ae9d6b859084 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:52.474003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01651f82-5bf7-4df3-9d20-ae9d6b859084 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:52.475026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01651f82-5bf7-4df3-9d20-ae9d6b859084 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:52.475637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01651f82-5bf7-4df3-9d20-ae9d6b859084 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:52.664790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-01651f82-5bf7-4df3-9d20-ae9d6b859084 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:52.674588 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-01651f82-5bf7-4df3-9d20-ae9d6b859084 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 200 len: 1388 microversion: 2.1 time: 0.213394 Jan 22 21:01:52.686085 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 306/591] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:52 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 1388 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:52.692303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a7e12510-3e24-4450-bca5-c92e0b1602b2 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:52.693296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a7e12510-3e24-4450-bca5-c92e0b1602b2 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] [instance: 99966147-7dbb-4eee-86c6-65e8fdc9f14c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:52.705007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7e12510-3e24-4450-bca5-c92e0b1602b2 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:52.705643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7e12510-3e24-4450-bca5-c92e0b1602b2 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:52.707809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7e12510-3e24-4450-bca5-c92e0b1602b2 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:52.708266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7e12510-3e24-4450-bca5-c92e0b1602b2 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:52.726079 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-a7e12510-3e24-4450-bca5-c92e0b1602b2 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] HTTP exception thrown: Instance 99966147-7dbb-4eee-86c6-65e8fdc9f14c could not be found. Jan 22 21:01:52.726993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a7e12510-3e24-4450-bca5-c92e0b1602b2 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] Returning 404 to user: Instance 99966147-7dbb-4eee-86c6-65e8fdc9f14c could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:52.727838 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a7e12510-3e24-4450-bca5-c92e0b1602b2 tempest-DeleteServersAdminTestJSON-768750177 tempest-DeleteServersAdminTestJSON-768750177-project] 10.222.0.100 "GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c" status: 404 len: 111 microversion: 2.1 time: 0.040774 Jan 22 21:01:52.731756 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 307/592] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:52 2022] GET /compute/v2.1/servers/99966147-7dbb-4eee-86c6-65e8fdc9f14c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:01:52.738027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96beb4fc-2ab6-4c25-8109-732d2b31baf8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "501de85a-fda7-4063-a24a-b37457b69381"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:52.739208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96beb4fc-2ab6-4c25-8109-732d2b31baf8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:52.746064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96beb4fc-2ab6-4c25-8109-732d2b31baf8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:52.746696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96beb4fc-2ab6-4c25-8109-732d2b31baf8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:52.747828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96beb4fc-2ab6-4c25-8109-732d2b31baf8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:52.748293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96beb4fc-2ab6-4c25-8109-732d2b31baf8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:53.515559 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96beb4fc-2ab6-4c25-8109-732d2b31baf8 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "POST /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.782432 Jan 22 21:01:53.521471 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 308/593] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:01:52 2022] POST /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8/os-volume_attachments => generated 194 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:53.527487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-754f366f-fa28-4604-84b3-a9883a00fc20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:53.528506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-754f366f-fa28-4604-84b3-a9883a00fc20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:53.545611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-754f366f-fa28-4604-84b3-a9883a00fc20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:53.546084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-754f366f-fa28-4604-84b3-a9883a00fc20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:53.547059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-754f366f-fa28-4604-84b3-a9883a00fc20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:53.547516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-754f366f-fa28-4604-84b3-a9883a00fc20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:53.717427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-754f366f-fa28-4604-84b3-a9883a00fc20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:53.735709 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-754f366f-fa28-4604-84b3-a9883a00fc20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 200 len: 1490 microversion: 2.1 time: 0.212894 Jan 22 21:01:53.741164 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 309/594] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:53 2022] GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 1490 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:53.746245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ecf56e35-ceb9-4a25-8fdf-a69350d14c73 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:53.749709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ecf56e35-ceb9-4a25-8fdf-a69350d14c73 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:53.763474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecf56e35-ceb9-4a25-8fdf-a69350d14c73 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:53.764180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecf56e35-ceb9-4a25-8fdf-a69350d14c73 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:53.765141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecf56e35-ceb9-4a25-8fdf-a69350d14c73 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:53.765760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecf56e35-ceb9-4a25-8fdf-a69350d14c73 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:53.983581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ecf56e35-ceb9-4a25-8fdf-a69350d14c73 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:53.995835 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ecf56e35-ceb9-4a25-8fdf-a69350d14c73 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1314 microversion: 2.1 time: 0.251828 Jan 22 21:01:53.996435 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 310/595] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:53 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:54.003659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-47376302-7ee3-44ba-9616-45c589f89adc tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:54.004535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-47376302-7ee3-44ba-9616-45c589f89adc tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:54.011798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47376302-7ee3-44ba-9616-45c589f89adc tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:54.012338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47376302-7ee3-44ba-9616-45c589f89adc tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:54.013213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47376302-7ee3-44ba-9616-45c589f89adc tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:54.013846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47376302-7ee3-44ba-9616-45c589f89adc tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:54.196477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-47376302-7ee3-44ba-9616-45c589f89adc tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66edcb96865e4215b5055587592192e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681cd204f3dd4dc698a9a4a15a6e728c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:54.207092 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-47376302-7ee3-44ba-9616-45c589f89adc tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 200 len: 1319 microversion: 2.1 time: 0.206004 Jan 22 21:01:54.208016 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 311/596] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:53 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:54.213412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-04d35ae6-f320-4e1c-9c83-76ea6c13342b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:54.214302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-04d35ae6-f320-4e1c-9c83-76ea6c13342b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:54.222104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04d35ae6-f320-4e1c-9c83-76ea6c13342b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:54.222648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04d35ae6-f320-4e1c-9c83-76ea6c13342b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:54.223810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04d35ae6-f320-4e1c-9c83-76ea6c13342b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:54.224329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04d35ae6-f320-4e1c-9c83-76ea6c13342b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:54.342256 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a48b049a-c52c-410b-9f73-d1a1826c8184 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.217960 Jan 22 21:01:54.343541 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 286/597] 10.222.0.100 () {60 vars in 1174 bytes} [Sat Jan 22 21:01:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:54.349873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-35b22832-8aba-4777-b763-1ca3ea89420c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:54.350741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-35b22832-8aba-4777-b763-1ca3ea89420c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:54.357824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-35b22832-8aba-4777-b763-1ca3ea89420c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:54.358613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-35b22832-8aba-4777-b763-1ca3ea89420c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:54.359650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-35b22832-8aba-4777-b763-1ca3ea89420c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:54.360288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-35b22832-8aba-4777-b763-1ca3ea89420c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:54.385764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-04d35ae6-f320-4e1c-9c83-76ea6c13342b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:54.403522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-04d35ae6-f320-4e1c-9c83-76ea6c13342b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:54.418765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-04d35ae6-f320-4e1c-9c83-76ea6c13342b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:54.421779 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-04d35ae6-f320-4e1c-9c83-76ea6c13342b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1365 microversion: 2.25 time: 0.210695 Jan 22 21:01:54.421779 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 312/598] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:54 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:54.435165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-666048b9-bb18-4a9f-b14e-f65ed9ed853a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:54.435823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-666048b9-bb18-4a9f-b14e-f65ed9ed853a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:54.442712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-666048b9-bb18-4a9f-b14e-f65ed9ed853a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:54.443387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-666048b9-bb18-4a9f-b14e-f65ed9ed853a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:54.445070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-666048b9-bb18-4a9f-b14e-f65ed9ed853a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:54.445707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-666048b9-bb18-4a9f-b14e-f65ed9ed853a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:54.563182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-35b22832-8aba-4777-b763-1ca3ea89420c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:54.572752 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-35b22832-8aba-4777-b763-1ca3ea89420c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 200 len: 1587 microversion: 2.1 time: 0.228030 Jan 22 21:01:54.573592 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 287/599] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:54 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 1587 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:54.578394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a193b445-5da3-4997-8912-0877d4f9bce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.211"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:54.579777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a193b445-5da3-4997-8912-0877d4f9bce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:54.590615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a193b445-5da3-4997-8912-0877d4f9bce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:54.593652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a193b445-5da3-4997-8912-0877d4f9bce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:54.593652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a193b445-5da3-4997-8912-0877d4f9bce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:54.593652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a193b445-5da3-4997-8912-0877d4f9bce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:54.628249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a193b445-5da3-4997-8912-0877d4f9bce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Acquired lock "refresh_cache-bc09b6eb-2701-4e2c-a135-a2f65c05eabf" {{(pid=137032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 22 21:01:54.682728 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-666048b9-bb18-4a9f-b14e-f65ed9ed853a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "POST /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef/action" status: 202 len: 0 microversion: 2.1 time: 0.260175 Jan 22 21:01:54.683368 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 313/600] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:01:54 2022] POST /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:01:54.693571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ed5ee05-77b1-4aea-a34d-d4ca89813609 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:54.693571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1ed5ee05-77b1-4aea-a34d-d4ca89813609 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:54.725987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ed5ee05-77b1-4aea-a34d-d4ca89813609 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:54.726662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ed5ee05-77b1-4aea-a34d-d4ca89813609 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:54.727696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ed5ee05-77b1-4aea-a34d-d4ca89813609 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:54.728230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ed5ee05-77b1-4aea-a34d-d4ca89813609 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:54.870832 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1ed5ee05-77b1-4aea-a34d-d4ca89813609 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.186218 Jan 22 21:01:54.877017 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 314/601] 10.222.0.100 () {58 vars in 1279 bytes} [Sat Jan 22 21:01:54 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:54.877017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-165f7f97-75f3-4ca1-92ad-8025b713c638 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:54.877645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-165f7f97-75f3-4ca1-92ad-8025b713c638 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:54.884209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-165f7f97-75f3-4ca1-92ad-8025b713c638 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:54.884809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-165f7f97-75f3-4ca1-92ad-8025b713c638 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:54.885917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-165f7f97-75f3-4ca1-92ad-8025b713c638 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:54.886338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-165f7f97-75f3-4ca1-92ad-8025b713c638 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:55.130615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG neutronclient.v2_0.client [None req-a193b445-5da3-4997-8912-0877d4f9bce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.1.211 (0e82db7e-3821-40a7-bfb1-3d31866e2d01) with port 9c612c1a-080f-4f7f-a757-7d20ac1cee0d using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 7238f98a-601e-4ad2-8860-b11b52ffa4fe.", "detail": ""}} {{(pid=137032) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:01:55.131312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a193b445-5da3-4997-8912-0877d4f9bce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Releasing lock "refresh_cache-bc09b6eb-2701-4e2c-a135-a2f65c05eabf" {{(pid=137032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 22 21:01:55.131951 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-a193b445-5da3-4997-8912-0877d4f9bce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] HTTP exception thrown: Cannot associate floating IP 172.35.1.211 (0e82db7e-3821-40a7-bfb1-3d31866e2d01) with port 9c612c1a-080f-4f7f-a757-7d20ac1cee0d using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 7238f98a-601e-4ad2-8860-b11b52ffa4fe. Jan 22 21:01:55.131951 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-f725dc40-653e-4529-a6d5-26ea9952d5fd'] Jan 22 21:01:55.132851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a193b445-5da3-4997-8912-0877d4f9bce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Returning 400 to user: Cannot associate floating IP 172.35.1.211 (0e82db7e-3821-40a7-bfb1-3d31866e2d01) with port 9c612c1a-080f-4f7f-a757-7d20ac1cee0d using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 7238f98a-601e-4ad2-8860-b11b52ffa4fe. Jan 22 21:01:55.132851 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-f725dc40-653e-4529-a6d5-26ea9952d5fd'] {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:01:55.133853 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a193b445-5da3-4997-8912-0877d4f9bce8 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "POST /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf/action" status: 400 len: 382 microversion: 2.1 time: 0.559087 Jan 22 21:01:55.134938 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 288/602] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:01:54 2022] POST /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf/action => generated 382 bytes in 560 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:01:55.139832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-86ed42fa-7b46-438f-85ce-18df74ed4857 req-681672d0-5ab4-49cd-a519-d4296a03b518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820ae2cd-bf19-499c-a236-4a8e92f974cc", "name": "network-vif-plugged", "status": "completed", "tag": "422a108d-537c-4443-bbb2-9257b333140e"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:55.151345 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:55.151345 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:55.159439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-86ed42fa-7b46-438f-85ce-18df74ed4857 req-681672d0-5ab4-49cd-a519-d4296a03b518 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:55.160133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-86ed42fa-7b46-438f-85ce-18df74ed4857 req-681672d0-5ab4-49cd-a519-d4296a03b518 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:55.171789 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-86ed42fa-7b46-438f-85ce-18df74ed4857 req-681672d0-5ab4-49cd-a519-d4296a03b518 service nova] Creating event network-vif-plugged:422a108d-537c-4443-bbb2-9257b333140e for instance 820ae2cd-bf19-499c-a236-4a8e92f974cc on nch2-master-1 Jan 22 21:01:55.176803 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-86ed42fa-7b46-438f-85ce-18df74ed4857 req-681672d0-5ab4-49cd-a519-d4296a03b518 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040496 Jan 22 21:01:55.177401 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 289/603] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:55.183538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-826e3cc0-108d-4485-8d55-be0d30a30bbe tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:55.184394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-826e3cc0-108d-4485-8d55-be0d30a30bbe tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:55.208104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-826e3cc0-108d-4485-8d55-be0d30a30bbe tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:55.208579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-826e3cc0-108d-4485-8d55-be0d30a30bbe tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:55.209410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-826e3cc0-108d-4485-8d55-be0d30a30bbe tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:55.210095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-826e3cc0-108d-4485-8d55-be0d30a30bbe tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:55.247174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-165f7f97-75f3-4ca1-92ad-8025b713c638 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:55.256341 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-165f7f97-75f3-4ca1-92ad-8025b713c638 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 200 len: 1495 microversion: 2.1 time: 0.383870 Jan 22 21:01:55.269529 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 315/604] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:54 2022] GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 1495 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:55.273641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0a387524-2740-4d10-bbc5-c7a60a77ace5 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '.version_select at 0x7f1ed602a5e0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:55.406907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-826e3cc0-108d-4485-8d55-be0d30a30bbe tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:55.415829 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-826e3cc0-108d-4485-8d55-be0d30a30bbe tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1497 microversion: 2.1 time: 0.236985 Jan 22 21:01:55.416408 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 290/605] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:55 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1497 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:55.420967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7694fb8d-1bb4-471b-b8f5-183d39d46f91 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:55.421826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7694fb8d-1bb4-471b-b8f5-183d39d46f91 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:55.428405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7694fb8d-1bb4-471b-b8f5-183d39d46f91 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:55.429171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7694fb8d-1bb4-471b-b8f5-183d39d46f91 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:55.430218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7694fb8d-1bb4-471b-b8f5-183d39d46f91 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:55.430864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7694fb8d-1bb4-471b-b8f5-183d39d46f91 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:55.582418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7694fb8d-1bb4-471b-b8f5-183d39d46f91 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66edcb96865e4215b5055587592192e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681cd204f3dd4dc698a9a4a15a6e728c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:55.590422 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7694fb8d-1bb4-471b-b8f5-183d39d46f91 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 200 len: 1319 microversion: 2.1 time: 0.172950 Jan 22 21:01:55.591301 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 291/606] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:55 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:55.596091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d0716e7c-4c6c-42cf-a47b-59fd684dca83 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:55.596899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d0716e7c-4c6c-42cf-a47b-59fd684dca83 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:55.603826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0716e7c-4c6c-42cf-a47b-59fd684dca83 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:55.605113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0716e7c-4c6c-42cf-a47b-59fd684dca83 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:55.606042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0716e7c-4c6c-42cf-a47b-59fd684dca83 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:55.606572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0716e7c-4c6c-42cf-a47b-59fd684dca83 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:55.748628 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d0716e7c-4c6c-42cf-a47b-59fd684dca83 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1648 microversion: 2.1 time: 0.155770 Jan 22 21:01:55.750247 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 292/607] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:55 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1648 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:55.756754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bf06b0d8-4ef8-4df5-8910-c6dfedb70199 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:55.757361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bf06b0d8-4ef8-4df5-8910-c6dfedb70199 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:55.766022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf06b0d8-4ef8-4df5-8910-c6dfedb70199 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:55.766459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf06b0d8-4ef8-4df5-8910-c6dfedb70199 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:55.767257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf06b0d8-4ef8-4df5-8910-c6dfedb70199 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:55.767739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf06b0d8-4ef8-4df5-8910-c6dfedb70199 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:55.915938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bf06b0d8-4ef8-4df5-8910-c6dfedb70199 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:55.924309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bf06b0d8-4ef8-4df5-8910-c6dfedb70199 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:55.926071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bf06b0d8-4ef8-4df5-8910-c6dfedb70199 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:55.927386 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bf06b0d8-4ef8-4df5-8910-c6dfedb70199 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1365 microversion: 2.25 time: 0.175604 Jan 22 21:01:55.927941 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 293/608] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:55 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:55.933555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9a26b64e-3512-41cf-870c-e46e7382b914 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:55.934331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9a26b64e-3512-41cf-870c-e46e7382b914 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:55.940964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a26b64e-3512-41cf-870c-e46e7382b914 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:55.941413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a26b64e-3512-41cf-870c-e46e7382b914 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:55.946313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a26b64e-3512-41cf-870c-e46e7382b914 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:55.946313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a26b64e-3512-41cf-870c-e46e7382b914 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:56.105840 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9a26b64e-3512-41cf-870c-e46e7382b914 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1648 microversion: 2.1 time: 0.176583 Jan 22 21:01:56.106508 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 294/609] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:55 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1648 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:56.121830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-768ec033-87cb-464e-8159-e798c9af2922 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:56.123523 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:56.123523 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:56.125409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-768ec033-87cb-464e-8159-e798c9af2922 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:56.126037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-768ec033-87cb-464e-8159-e798c9af2922 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:56.127765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-768ec033-87cb-464e-8159-e798c9af2922 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:56.131717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-768ec033-87cb-464e-8159-e798c9af2922 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:56.153426 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-768ec033-87cb-464e-8159-e798c9af2922 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.035125 Jan 22 21:01:56.154056 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 295/610] 10.222.0.100 () {58 vars in 1180 bytes} [Sat Jan 22 21:01:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:01:56.164564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0a10e3b1-7942-4e46-b35f-e59d12d88c7f tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:56.165100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0a10e3b1-7942-4e46-b35f-e59d12d88c7f tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:56.172878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a10e3b1-7942-4e46-b35f-e59d12d88c7f tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:56.173626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a10e3b1-7942-4e46-b35f-e59d12d88c7f tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:56.174658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a10e3b1-7942-4e46-b35f-e59d12d88c7f tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:56.175291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a10e3b1-7942-4e46-b35f-e59d12d88c7f tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:56.417376 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0a10e3b1-7942-4e46-b35f-e59d12d88c7f tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77/action" status: 202 len: 0 microversion: 2.1 time: 0.256220 Jan 22 21:01:56.418385 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 296/611] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:01:56 2022] POST /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:01:56.423653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1789a6a7-217d-470c-9aaf-c2a260109f2b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:56.425043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1789a6a7-217d-470c-9aaf-c2a260109f2b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:56.431695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1789a6a7-217d-470c-9aaf-c2a260109f2b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:56.432436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1789a6a7-217d-470c-9aaf-c2a260109f2b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:56.433291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1789a6a7-217d-470c-9aaf-c2a260109f2b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:56.433920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1789a6a7-217d-470c-9aaf-c2a260109f2b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:56.607811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1789a6a7-217d-470c-9aaf-c2a260109f2b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:56.617754 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1789a6a7-217d-470c-9aaf-c2a260109f2b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 200 len: 1475 microversion: 2.1 time: 0.197939 Jan 22 21:01:56.630059 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 297/612] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:56 2022] GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 1475 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:56.634816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b112656-44ff-495d-809c-05069df1d68e tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:56.635433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b112656-44ff-495d-809c-05069df1d68e tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:56.641365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b112656-44ff-495d-809c-05069df1d68e tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:56.646601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b112656-44ff-495d-809c-05069df1d68e tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:56.647649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b112656-44ff-495d-809c-05069df1d68e tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:56.650298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b112656-44ff-495d-809c-05069df1d68e tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:56.807855 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b112656-44ff-495d-809c-05069df1d68e tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1653 microversion: 2.1 time: 0.176557 Jan 22 21:01:56.808446 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 298/613] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:56 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1653 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:56.817472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-506e1e45-6371-4739-b6b7-c43bab9a747c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:56.818288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-506e1e45-6371-4739-b6b7-c43bab9a747c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:56.825582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-506e1e45-6371-4739-b6b7-c43bab9a747c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:56.826354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-506e1e45-6371-4739-b6b7-c43bab9a747c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:56.827800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-506e1e45-6371-4739-b6b7-c43bab9a747c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:56.828234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-506e1e45-6371-4739-b6b7-c43bab9a747c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:56.984194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-506e1e45-6371-4739-b6b7-c43bab9a747c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66edcb96865e4215b5055587592192e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681cd204f3dd4dc698a9a4a15a6e728c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:56.995088 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-506e1e45-6371-4739-b6b7-c43bab9a747c tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 200 len: 1319 microversion: 2.1 time: 0.185054 Jan 22 21:01:56.997382 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 299/614] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:56 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:57.002466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1dd26f09-6038-4d8c-9087-12282040125a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2032934140"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:57.003678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1dd26f09-6038-4d8c-9087-12282040125a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:57.012700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1dd26f09-6038-4d8c-9087-12282040125a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:57.013067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1dd26f09-6038-4d8c-9087-12282040125a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:57.014189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1dd26f09-6038-4d8c-9087-12282040125a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:57.014641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1dd26f09-6038-4d8c-9087-12282040125a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:57.113835 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0a387524-2740-4d10-bbc5-c7a60a77ace5 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "DELETE /compute/v2.1/os-floating-ips/0e82db7e-3821-40a7-bfb1-3d31866e2d01" status: 202 len: 0 microversion: 2.1 time: 1.843466 Jan 22 21:01:57.115188 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 316/615] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:01:55 2022] DELETE /compute/v2.1/os-floating-ips/0e82db7e-3821-40a7-bfb1-3d31866e2d01 => generated 0 bytes in 1845 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:01:57.122443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5343d13f-86d0-4196-9ebd-1e5ec67fb22b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:57.123059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5343d13f-86d0-4196-9ebd-1e5ec67fb22b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:57.131706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5343d13f-86d0-4196-9ebd-1e5ec67fb22b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:57.132444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5343d13f-86d0-4196-9ebd-1e5ec67fb22b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:57.133446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5343d13f-86d0-4196-9ebd-1e5ec67fb22b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:57.134107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5343d13f-86d0-4196-9ebd-1e5ec67fb22b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:57.318587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5343d13f-86d0-4196-9ebd-1e5ec67fb22b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:57.327610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5343d13f-86d0-4196-9ebd-1e5ec67fb22b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:57.329291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5343d13f-86d0-4196-9ebd-1e5ec67fb22b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:57.330649 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5343d13f-86d0-4196-9ebd-1e5ec67fb22b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1365 microversion: 2.25 time: 0.215124 Jan 22 21:01:57.331494 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 317/616] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:57 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:01:57.346318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-01d2968f-5500-4a5c-8785-8402d0ae223a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:57.348018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-01d2968f-5500-4a5c-8785-8402d0ae223a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:57.354289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01d2968f-5500-4a5c-8785-8402d0ae223a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:57.355051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01d2968f-5500-4a5c-8785-8402d0ae223a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:57.365959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01d2968f-5500-4a5c-8785-8402d0ae223a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:57.366427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01d2968f-5500-4a5c-8785-8402d0ae223a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:57.428719 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-01d2968f-5500-4a5c-8785-8402d0ae223a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 14 microversion: 2.1 time: 0.095746 Jan 22 21:01:57.429341 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 318/617] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:01:57 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:57.434786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-4b3760b1-77d7-403d-8a20-22b76658e417 req-f322ef81-846c-41cd-8a69-f3f59fc0e096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94e22853-aa4b-47cb-a69e-0e6fd8af5720", "tag": "ac2be3fd-0a96-49fc-9bdb-d6f6fc743c9b"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:57.436276 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:57.436276 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:01:57.445291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4b3760b1-77d7-403d-8a20-22b76658e417 req-f322ef81-846c-41cd-8a69-f3f59fc0e096 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:57.445785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4b3760b1-77d7-403d-8a20-22b76658e417 req-f322ef81-846c-41cd-8a69-f3f59fc0e096 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:57.457673 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-4b3760b1-77d7-403d-8a20-22b76658e417 req-f322ef81-846c-41cd-8a69-f3f59fc0e096 service nova] Creating event network-changed:ac2be3fd-0a96-49fc-9bdb-d6f6fc743c9b for instance 94e22853-aa4b-47cb-a69e-0e6fd8af5720 on nch1-master-1 Jan 22 21:01:57.462531 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-4b3760b1-77d7-403d-8a20-22b76658e417 req-f322ef81-846c-41cd-8a69-f3f59fc0e096 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031662 Jan 22 21:01:57.463293 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 319/618] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:57.468903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-38b16dc8-b18f-4b02-91d4-a2f84bce44fe tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Action: 'action', calling method: .version_select at 0x7f1ed851e0d0>, body: {"removeFloatingIp": {"address": "172.35.1.182"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:57.610604 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1dd26f09-6038-4d8c-9087-12282040125a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "POST /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef/action" status: 202 len: 0 microversion: 2.1 time: 0.611911 Jan 22 21:01:57.612748 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 300/619] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:01:56 2022] POST /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 22 21:01:57.624877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a98466ff-8a19-46d4-9bde-c93b05436c77 req-c8dc30c4-f56e-49c3-9f69-34c1c5e653a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9618ff2-a2cc-41d5-9d2f-1fd0c63658df", "name": "network-vif-plugged", "status": "completed", "tag": "b50148da-7bff-4e1e-9ed5-bfed58c0e2bf"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:57.628003 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:57.628003 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:57.635849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a98466ff-8a19-46d4-9bde-c93b05436c77 req-c8dc30c4-f56e-49c3-9f69-34c1c5e653a8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:57.636388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a98466ff-8a19-46d4-9bde-c93b05436c77 req-c8dc30c4-f56e-49c3-9f69-34c1c5e653a8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:57.651188 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a98466ff-8a19-46d4-9bde-c93b05436c77 req-c8dc30c4-f56e-49c3-9f69-34c1c5e653a8 service nova] Creating event network-vif-plugged:b50148da-7bff-4e1e-9ed5-bfed58c0e2bf for instance d9618ff2-a2cc-41d5-9d2f-1fd0c63658df on nch1-master-1 Jan 22 21:01:57.656424 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a98466ff-8a19-46d4-9bde-c93b05436c77 req-c8dc30c4-f56e-49c3-9f69-34c1c5e653a8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041850 Jan 22 21:01:57.657554 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 301/620] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:57.826353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ece9226c-acb6-4b50-a055-babe097b529d tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-693081479", "id": 441574340, "os-flavor-access:is_public": "False"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:57.829106 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:57.829106 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:57.921194 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ece9226c-acb6-4b50-a055-babe097b529d tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.258430 Jan 22 21:01:57.921194 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 302/621] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:01:57 2022] POST /compute/v2.1/flavors => generated 429 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:01:57.926621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3b877211-21b0-42d9-90ef-f711dd65bed0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed608aaf0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:57.962224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-38b16dc8-b18f-4b02-91d4-a2f84bce44fe tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:57.973200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38b16dc8-b18f-4b02-91d4-a2f84bce44fe tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:57.973200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38b16dc8-b18f-4b02-91d4-a2f84bce44fe tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:57.973200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38b16dc8-b18f-4b02-91d4-a2f84bce44fe tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:57.973475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38b16dc8-b18f-4b02-91d4-a2f84bce44fe tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:58.001584 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3b877211-21b0-42d9-90ef-f711dd65bed0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.079784 Jan 22 21:01:58.001993 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 303/622] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:01:57 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:58.013125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bc9aab87-99fb-4be1-a919-383b0c00b8bb tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:58.018546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bc9aab87-99fb-4be1-a919-383b0c00b8bb tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:58.026842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc9aab87-99fb-4be1-a919-383b0c00b8bb tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:58.027799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc9aab87-99fb-4be1-a919-383b0c00b8bb tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:58.028993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc9aab87-99fb-4be1-a919-383b0c00b8bb tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:58.029617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc9aab87-99fb-4be1-a919-383b0c00b8bb tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:58.206072 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bc9aab87-99fb-4be1-a919-383b0c00b8bb tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1633 microversion: 2.1 time: 0.202018 Jan 22 21:01:58.206986 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 304/623] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:58 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1633 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:58.212400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-15ed9c38-67bb-4441-abea-63941629f9dd tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "47bff54e547b438385c88ce3552f35c0"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:58.213890 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:01:58.213890 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:01:58.362285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38b16dc8-b18f-4b02-91d4-a2f84bce44fe tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Acquired lock "refresh_cache-bc09b6eb-2701-4e2c-a135-a2f65c05eabf" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 22 21:01:58.584677 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-15ed9c38-67bb-4441-abea-63941629f9dd tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors/441574340/action" status: 200 len: 96 microversion: 2.1 time: 0.376189 Jan 22 21:01:58.585394 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 305/624] 10.222.0.100 () {60 vars in 1201 bytes} [Sat Jan 22 21:01:58 2022] POST /compute/v2.1/flavors/441574340/action => generated 96 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:01:58.594354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bf2580f4-6ee1-469f-9ad6-cad966dcff3d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:58.595084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bf2580f4-6ee1-469f-9ad6-cad966dcff3d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:58.603242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf2580f4-6ee1-469f-9ad6-cad966dcff3d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:58.603789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf2580f4-6ee1-469f-9ad6-cad966dcff3d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:58.604792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf2580f4-6ee1-469f-9ad6-cad966dcff3d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:58.605232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf2580f4-6ee1-469f-9ad6-cad966dcff3d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:58.751350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bf2580f4-6ee1-469f-9ad6-cad966dcff3d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66edcb96865e4215b5055587592192e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681cd204f3dd4dc698a9a4a15a6e728c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:01:58.759556 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bf2580f4-6ee1-469f-9ad6-cad966dcff3d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 200 len: 1469 microversion: 2.1 time: 0.168922 Jan 22 21:01:58.760518 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 306/625] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:01:58 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:01:58.764532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9f127fcc-c004-493d-913c-0ee2eddad4ef tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:01:58.765745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9f127fcc-c004-493d-913c-0ee2eddad4ef tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:58.773383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f127fcc-c004-493d-913c-0ee2eddad4ef tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:58.773383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f127fcc-c004-493d-913c-0ee2eddad4ef tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:58.773383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f127fcc-c004-493d-913c-0ee2eddad4ef tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:58.773383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f127fcc-c004-493d-913c-0ee2eddad4ef tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:58.797884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-9f127fcc-c004-493d-913c-0ee2eddad4ef tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lazy-loading 'flavor' on Instance uuid 664d69ee-34da-42b7-8e5e-7dc8adc0ed77 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:01:58.811331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9f127fcc-c004-493d-913c-0ee2eddad4ef tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Going to try to live migrate instance to nch1-master-1 {{(pid=137032) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 22 21:01:59.231979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-38b16dc8-b18f-4b02-91d4-a2f84bce44fe tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Building network info cache for instance {{(pid=137033) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 22 21:01:59.769999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-38b16dc8-b18f-4b02-91d4-a2f84bce44fe tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Updating instance_info_cache with network_info: [{"id": "9c612c1a-080f-4f7f-a757-7d20ac1cee0d", "address": "fa:16:3e:cd:63:51", "network": {"id": "4a2c59ad-01e2-4c50-bbab-aa5b1350e16a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1961092801-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0ca97602282f40168d95eb37d81f93e4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap9c612c1a-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137033) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 22 21:01:59.816032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38b16dc8-b18f-4b02-91d4-a2f84bce44fe tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Releasing lock "refresh_cache-bc09b6eb-2701-4e2c-a135-a2f65c05eabf" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 22 21:01:59.817400 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-38b16dc8-b18f-4b02-91d4-a2f84bce44fe tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "POST /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf/action" status: 202 len: 0 microversion: 2.1 time: 2.352313 Jan 22 21:01:59.823320 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 320/626] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:01:57 2022] POST /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf/action => generated 0 bytes in 2359 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 22 21:01:59.828694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9662faf2-3404-4aa5-bae0-cc4b2b30373a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:01:59.829581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9662faf2-3404-4aa5-bae0-cc4b2b30373a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:01:59.838609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9662faf2-3404-4aa5-bae0-cc4b2b30373a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:59.838609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9662faf2-3404-4aa5-bae0-cc4b2b30373a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:01:59.838609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9662faf2-3404-4aa5-bae0-cc4b2b30373a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:01:59.838609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9662faf2-3404-4aa5-bae0-cc4b2b30373a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:00.021598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9662faf2-3404-4aa5-bae0-cc4b2b30373a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:00.030460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9662faf2-3404-4aa5-bae0-cc4b2b30373a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:00.032402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9662faf2-3404-4aa5-bae0-cc4b2b30373a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:00.034789 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9662faf2-3404-4aa5-bae0-cc4b2b30373a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1365 microversion: 2.25 time: 0.210180 Jan 22 21:02:00.035900 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 321/627] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:01:59 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:00.040898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-18d1ef50-bde9-4b6b-bfff-c74a2cd53fe3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:00.041906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-18d1ef50-bde9-4b6b-bfff-c74a2cd53fe3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:00.048186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18d1ef50-bde9-4b6b-bfff-c74a2cd53fe3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:00.050387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18d1ef50-bde9-4b6b-bfff-c74a2cd53fe3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:00.051497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18d1ef50-bde9-4b6b-bfff-c74a2cd53fe3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:00.052122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18d1ef50-bde9-4b6b-bfff-c74a2cd53fe3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:00.093231 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-18d1ef50-bde9-4b6b-bfff-c74a2cd53fe3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 14 microversion: 2.1 time: 0.055613 Jan 22 21:02:00.093931 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 322/628] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:00 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:02:00.214589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9c814424-a4cc-466a-b7cc-c52d53812b98 tempest-FlavorsAccessTestJSON-1658679917 tempest-FlavorsAccessTestJSON-1658679917-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:00.237866 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9c814424-a4cc-466a-b7cc-c52d53812b98 tempest-FlavorsAccessTestJSON-1658679917 tempest-FlavorsAccessTestJSON-1658679917-project] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 6262 microversion: 2.1 time: 0.142631 Jan 22 21:02:00.248343 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 323/629] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:02:00 2022] GET /compute/v2.1/flavors/detail => generated 6262 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:00.248343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-81050557-7b70-4bcd-ac58-b309a0e15fba tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:00.248343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-81050557-7b70-4bcd-ac58-b309a0e15fba tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:00.251000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81050557-7b70-4bcd-ac58-b309a0e15fba tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:00.251457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81050557-7b70-4bcd-ac58-b309a0e15fba tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:00.252460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81050557-7b70-4bcd-ac58-b309a0e15fba tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:00.253178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81050557-7b70-4bcd-ac58-b309a0e15fba tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:00.287111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-81050557-7b70-4bcd-ac58-b309a0e15fba tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:02:00.534528 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-81050557-7b70-4bcd-ac58-b309a0e15fba tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "DELETE /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 204 len: 0 microversion: 2.1 time: 0.294420 Jan 22 21:02:00.535628 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 324/630] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:02:00 2022] DELETE /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:02:00.541366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5e6e7d76-9840-4bbe-9b80-aad729607a6f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5fb19d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:00.587499 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5e6e7d76-9840-4bbe-9b80-aad729607a6f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.050465 Jan 22 21:02:00.588049 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 325/631] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:00 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:00.592285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-302f75eb-71c2-4608-9ba1-654b14dbe15b req-fd97cdd2-a83d-4cda-bad1-03e7ca9d97c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc09b6eb-2701-4e2c-a135-a2f65c05eabf", "tag": "9c612c1a-080f-4f7f-a757-7d20ac1cee0d"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:00.594032 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:00.594032 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:00.602463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-302f75eb-71c2-4608-9ba1-654b14dbe15b req-fd97cdd2-a83d-4cda-bad1-03e7ca9d97c1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:00.602914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-302f75eb-71c2-4608-9ba1-654b14dbe15b req-fd97cdd2-a83d-4cda-bad1-03e7ca9d97c1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:00.618477 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-302f75eb-71c2-4608-9ba1-654b14dbe15b req-fd97cdd2-a83d-4cda-bad1-03e7ca9d97c1 service nova] Creating event network-changed:9c612c1a-080f-4f7f-a757-7d20ac1cee0d for instance bc09b6eb-2701-4e2c-a135-a2f65c05eabf on nch2-master-1 Jan 22 21:02:00.625702 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-302f75eb-71c2-4608-9ba1-654b14dbe15b req-fd97cdd2-a83d-4cda-bad1-03e7ca9d97c1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034058 Jan 22 21:02:00.625702 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 326/632] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:00.630124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-37233e1c-82fa-4015-ab08-035955daf558 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '.version_select at 0x7f1ed5ffca60>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:01.122491 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9f127fcc-c004-493d-913c-0ee2eddad4ef tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77/action" status: 202 len: 0 microversion: 2.1 time: 2.361109 Jan 22 21:02:01.129995 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 307/633] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:01:58 2022] POST /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77/action => generated 0 bytes in 2362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:01.258658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7c5ae268-1eab-408a-88b6-85ef37abe413 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "561f52ee-9469-4cb7-990d-9efb55b39e45"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:01.259796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7c5ae268-1eab-408a-88b6-85ef37abe413 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:01.266616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c5ae268-1eab-408a-88b6-85ef37abe413 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:01.273200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c5ae268-1eab-408a-88b6-85ef37abe413 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:01.273200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c5ae268-1eab-408a-88b6-85ef37abe413 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:01.273200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c5ae268-1eab-408a-88b6-85ef37abe413 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:01.290941 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-volumes-attachments:swap": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:01.290941 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:01.485653 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-7c5ae268-1eab-408a-88b6-85ef37abe413 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] HTTP exception thrown: Volume 561f52ee-9469-4cb7-990d-9efb55b39e45 could not be found. Jan 22 21:02:01.487895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7c5ae268-1eab-408a-88b6-85ef37abe413 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] Returning 400 to user: Volume 561f52ee-9469-4cb7-990d-9efb55b39e45 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:01.489237 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7c5ae268-1eab-408a-88b6-85ef37abe413 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] 10.222.0.100 "PUT /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8/os-volume_attachments/501de85a-fda7-4063-a24a-b37457b69381" status: 400 len: 107 microversion: 2.1 time: 0.364851 Jan 22 21:02:01.494565 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 308/634] 10.222.0.100 () {60 vars in 1437 bytes} [Sat Jan 22 21:02:01 2022] PUT /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8/os-volume_attachments/501de85a-fda7-4063-a24a-b37457b69381 => generated 107 bytes in 371 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:02:01.513903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-68aea1f7-9f71-4963-aa7b-b2cacad3ba66 tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "47bff54e547b438385c88ce3552f35c0"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:01.515622 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:01.515622 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:01.745998 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-68aea1f7-9f71-4963-aa7b-b2cacad3ba66 tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors/441574340/action" status: 200 len: 21 microversion: 2.1 time: 0.243964 Jan 22 21:02:01.748088 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 309/635] 10.222.0.100 () {60 vars in 1201 bytes} [Sat Jan 22 21:02:01 2022] POST /compute/v2.1/flavors/441574340/action => generated 21 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:02:01.753607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d9af866e-92c0-4897-af67-3303f5afe23d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:01.754589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d9af866e-92c0-4897-af67-3303f5afe23d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:01.762495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9af866e-92c0-4897-af67-3303f5afe23d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:01.763520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9af866e-92c0-4897-af67-3303f5afe23d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:01.764451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9af866e-92c0-4897-af67-3303f5afe23d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:01.765221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9af866e-92c0-4897-af67-3303f5afe23d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:02.021661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d9af866e-92c0-4897-af67-3303f5afe23d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66edcb96865e4215b5055587592192e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681cd204f3dd4dc698a9a4a15a6e728c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:02.030484 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d9af866e-92c0-4897-af67-3303f5afe23d tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 200 len: 1475 microversion: 2.1 time: 0.282158 Jan 22 21:02:02.031326 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 310/636] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:01 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 1475 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:02.048294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7edccec5-7c5d-4640-ad73-42fcdebdcd72 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:02.049115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7edccec5-7c5d-4640-ad73-42fcdebdcd72 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:02.367787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7edccec5-7c5d-4640-ad73-42fcdebdcd72 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:02.367787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7edccec5-7c5d-4640-ad73-42fcdebdcd72 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:02.367787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7edccec5-7c5d-4640-ad73-42fcdebdcd72 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:02.367787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7edccec5-7c5d-4640-ad73-42fcdebdcd72 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:02.368805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7edccec5-7c5d-4640-ad73-42fcdebdcd72 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:02.368805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7edccec5-7c5d-4640-ad73-42fcdebdcd72 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:02.369081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7edccec5-7c5d-4640-ad73-42fcdebdcd72 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:02.369081 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7edccec5-7c5d-4640-ad73-42fcdebdcd72 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1561 microversion: 2.25 time: 0.278548 Jan 22 21:02:02.369081 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 311/637] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:02 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1561 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:02.369081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-79a40548-9f69-4edb-bce3-aa21e3adbe02 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:02.369730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-79a40548-9f69-4edb-bce3-aa21e3adbe02 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:02.369730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79a40548-9f69-4edb-bce3-aa21e3adbe02 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:02.369730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79a40548-9f69-4edb-bce3-aa21e3adbe02 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:02.369730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79a40548-9f69-4edb-bce3-aa21e3adbe02 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:02.370273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79a40548-9f69-4edb-bce3-aa21e3adbe02 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:02.426010 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-79a40548-9f69-4edb-bce3-aa21e3adbe02 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 14 microversion: 2.1 time: 0.103106 Jan 22 21:02:02.427263 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 312/638] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:02 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:02:02.432375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4ff1d40d-9a65-4d8e-b231-6c7fff145591 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:02.433291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4ff1d40d-9a65-4d8e-b231-6c7fff145591 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:02.441871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ff1d40d-9a65-4d8e-b231-6c7fff145591 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:02.442599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ff1d40d-9a65-4d8e-b231-6c7fff145591 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:02.443615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ff1d40d-9a65-4d8e-b231-6c7fff145591 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:02.444232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ff1d40d-9a65-4d8e-b231-6c7fff145591 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:02.653364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4ff1d40d-9a65-4d8e-b231-6c7fff145591 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:02.674782 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4ff1d40d-9a65-4d8e-b231-6c7fff145591 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1507 microversion: 2.1 time: 0.245234 Jan 22 21:02:02.684782 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 313/639] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:02 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:02.692034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f62b0916-c2e7-4527-863b-ea1ebb100319 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:02.692793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f62b0916-c2e7-4527-863b-ea1ebb100319 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:02.700840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f62b0916-c2e7-4527-863b-ea1ebb100319 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:02.701306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f62b0916-c2e7-4527-863b-ea1ebb100319 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:02.702121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f62b0916-c2e7-4527-863b-ea1ebb100319 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:02.702871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f62b0916-c2e7-4527-863b-ea1ebb100319 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:02.715418 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-37233e1c-82fa-4015-ab08-035955daf558 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "DELETE /compute/v2.1/os-floating-ips/2df4a64c-8088-4501-b834-fd14b0a6bbb3" status: 202 len: 0 microversion: 2.1 time: 2.088735 Jan 22 21:02:02.720050 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 327/640] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:02:00 2022] DELETE /compute/v2.1/os-floating-ips/2df4a64c-8088-4501-b834-fd14b0a6bbb3 => generated 0 bytes in 2091 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:02.725616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-78125df1-7d66-4edb-9fa0-2cf30226afda tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5f585e0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:02.793153 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-78125df1-7d66-4edb-9fa0-2cf30226afda tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.076225 Jan 22 21:02:02.801714 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 328/641] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:02 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:02.813258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b321be59-1ec0-4182-987c-2ed4d1024f0e tempest-FlavorsAccessTestJSON-1658679917 tempest-FlavorsAccessTestJSON-1658679917-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:02.851076 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b321be59-1ec0-4182-987c-2ed4d1024f0e tempest-FlavorsAccessTestJSON-1658679917 tempest-FlavorsAccessTestJSON-1658679917-project] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5843 microversion: 2.1 time: 0.047932 Jan 22 21:02:02.861000 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 329/642] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:02:02 2022] GET /compute/v2.1/flavors/detail => generated 5843 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:02.861000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f2e39842-7397-4c95-b0e7-249cc8386b72 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:02.861000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f2e39842-7397-4c95-b0e7-249cc8386b72 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:02.869967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2e39842-7397-4c95-b0e7-249cc8386b72 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:02.870429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2e39842-7397-4c95-b0e7-249cc8386b72 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:02.871251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2e39842-7397-4c95-b0e7-249cc8386b72 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:02.871693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2e39842-7397-4c95-b0e7-249cc8386b72 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:02.942350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-f62b0916-c2e7-4527-863b-ea1ebb100319 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lazy-loading 'services' on Instance uuid 6bc1b81e-307f-4153-ae1a-a192c15f6db8 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:02:03.201438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-f2e39842-7397-4c95-b0e7-249cc8386b72 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'services' on Instance uuid d9618ff2-a2cc-41d5-9d2f-1fd0c63658df {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:02:03.235080 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f2e39842-7397-4c95-b0e7-249cc8386b72 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 2053 microversion: 2.25 time: 0.381618 Jan 22 21:02:03.248182 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 330/643] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:02 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 2053 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:03.254318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a63605e8-1be8-42e2-b317-a4173083c7aa tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Action: 'action', calling method: .version_select at 0x7f1ed851e040>, body: {"addFloatingIp": {"address": ""}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:03.256573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a63605e8-1be8-42e2-b317-a4173083c7aa tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:03.258125 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a63605e8-1be8-42e2-b317-a4173083c7aa tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "POST /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf/action" status: 400 len: 142 microversion: 2.1 time: 0.008361 Jan 22 21:02:03.258918 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 331/644] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:03 2022] POST /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf/action => generated 142 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:02:03.263421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-592d9fd1-6f2f-4e1d-915e-561179425e40 tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:03.264542 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:03.264542 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:03.351456 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-592d9fd1-6f2f-4e1d-915e-561179425e40 tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/441574340" status: 202 len: 0 microversion: 2.1 time: 0.091252 Jan 22 21:02:03.364385 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 332/645] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 21:02:03 2022] DELETE /compute/v2.1/flavors/441574340 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:03.375242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-90e3d2d6-f0df-4e18-bc3d-c260c207d7d7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:03.378702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-90e3d2d6-f0df-4e18-bc3d-c260c207d7d7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:03.385465 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f62b0916-c2e7-4527-863b-ea1ebb100319 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8/os-volume_attachments/501de85a-fda7-4063-a24a-b37457b69381" status: 202 len: 0 microversion: 2.1 time: 0.698780 Jan 22 21:02:03.388125 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 314/646] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 21:02:02 2022] DELETE /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8/os-volume_attachments/501de85a-fda7-4063-a24a-b37457b69381 => generated 0 bytes in 712 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:03.397471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90e3d2d6-f0df-4e18-bc3d-c260c207d7d7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:03.397471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90e3d2d6-f0df-4e18-bc3d-c260c207d7d7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:03.397471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90e3d2d6-f0df-4e18-bc3d-c260c207d7d7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:03.397471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90e3d2d6-f0df-4e18-bc3d-c260c207d7d7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:03.403972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1c695420-4dd9-4b3d-ba61-e1f378b14005 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:03.405252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1c695420-4dd9-4b3d-ba61-e1f378b14005 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:03.417263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c695420-4dd9-4b3d-ba61-e1f378b14005 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:03.417755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c695420-4dd9-4b3d-ba61-e1f378b14005 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:03.418573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c695420-4dd9-4b3d-ba61-e1f378b14005 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:03.425608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c695420-4dd9-4b3d-ba61-e1f378b14005 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:03.610853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-90e3d2d6-f0df-4e18-bc3d-c260c207d7d7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66edcb96865e4215b5055587592192e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681cd204f3dd4dc698a9a4a15a6e728c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:03.619205 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-90e3d2d6-f0df-4e18-bc3d-c260c207d7d7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 200 len: 1433 microversion: 2.1 time: 0.253448 Jan 22 21:02:03.620432 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 333/647] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:03 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 1433 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:03.625260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-37b966df-56a6-4a87-a325-9e4be6dcc1eb tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:03.627451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-37b966df-56a6-4a87-a325-9e4be6dcc1eb tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:03.635297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37b966df-56a6-4a87-a325-9e4be6dcc1eb tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:03.636143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37b966df-56a6-4a87-a325-9e4be6dcc1eb tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:03.637177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37b966df-56a6-4a87-a325-9e4be6dcc1eb tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:03.637960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37b966df-56a6-4a87-a325-9e4be6dcc1eb tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:03.672776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-1c695420-4dd9-4b3d-ba61-e1f378b14005 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'services' on Instance uuid d9618ff2-a2cc-41d5-9d2f-1fd0c63658df {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:02:03.691272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37b966df-56a6-4a87-a325-9e4be6dcc1eb tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Acquired lock "refresh_cache-bc09b6eb-2701-4e2c-a135-a2f65c05eabf" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 22 21:02:03.699275 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1c695420-4dd9-4b3d-ba61-e1f378b14005 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 2053 microversion: 2.25 time: 0.309025 Jan 22 21:02:03.699723 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 315/648] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:03 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 2053 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:03.716385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a6ae8afa-e903-4b93-a8aa-d8a7db88c4f6 tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:03.754312 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a6ae8afa-e903-4b93-a8aa-d8a7db88c4f6 tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5843 microversion: 2.1 time: 0.053058 Jan 22 21:02:03.769327 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 316/649] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:02:03 2022] GET /compute/v2.1/flavors/detail => generated 5843 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:03.774596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b94d8b3c-df77-4bff-90f9-5604e1537700 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:03.775781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b94d8b3c-df77-4bff-90f9-5604e1537700 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:03.782391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b94d8b3c-df77-4bff-90f9-5604e1537700 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:03.782875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b94d8b3c-df77-4bff-90f9-5604e1537700 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:03.783934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b94d8b3c-df77-4bff-90f9-5604e1537700 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:03.784379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b94d8b3c-df77-4bff-90f9-5604e1537700 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:03.837945 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b94d8b3c-df77-4bff-90f9-5604e1537700 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066501 Jan 22 21:02:03.839816 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 317/650] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:02:03 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:03.853792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a3e92d10-86fb-4878-bf30-1383e5de3dca tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:03.854928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a3e92d10-86fb-4878-bf30-1383e5de3dca tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:03.870502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3e92d10-86fb-4878-bf30-1383e5de3dca tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:03.870958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3e92d10-86fb-4878-bf30-1383e5de3dca tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:03.871865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3e92d10-86fb-4878-bf30-1383e5de3dca tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:03.881912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3e92d10-86fb-4878-bf30-1383e5de3dca tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:03.905466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37b966df-56a6-4a87-a325-9e4be6dcc1eb tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Releasing lock "refresh_cache-bc09b6eb-2701-4e2c-a135-a2f65c05eabf" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 22 21:02:03.906092 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-37b966df-56a6-4a87-a325-9e4be6dcc1eb tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] HTTP exception thrown: floating IP not found Jan 22 21:02:03.906688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-37b966df-56a6-4a87-a325-9e4be6dcc1eb tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Returning 404 to user: floating IP not found {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:03.907540 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-37b966df-56a6-4a87-a325-9e4be6dcc1eb tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "POST /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf/action" status: 404 len: 67 microversion: 2.1 time: 0.285907 Jan 22 21:02:03.913168 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 334/651] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:03 2022] POST /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf/action => generated 67 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:02:03.918517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-8de96aec-2f9f-4809-b86a-4783e9b4f989 req-4eb3e4b1-4d9f-42cd-a8d4-a694d8acf97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "820ae2cd-bf19-499c-a236-4a8e92f974cc", "name": "network-vif-deleted", "tag": "422a108d-537c-4443-bbb2-9257b333140e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:03.925247 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:03.925247 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:03.940949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8de96aec-2f9f-4809-b86a-4783e9b4f989 req-4eb3e4b1-4d9f-42cd-a8d4-a694d8acf97f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:03.941456 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a3e92d10-86fb-4878-bf30-1383e5de3dca tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 14 microversion: 2.1 time: 0.099998 Jan 22 21:02:03.945667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8de96aec-2f9f-4809-b86a-4783e9b4f989 req-4eb3e4b1-4d9f-42cd-a8d4-a694d8acf97f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:03.947541 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 318/652] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:03 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:02:03.953548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d302b26e-1022-479d-acfd-622ceff22849 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:03.955265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d302b26e-1022-479d-acfd-622ceff22849 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:03.964311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d302b26e-1022-479d-acfd-622ceff22849 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:03.965950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d302b26e-1022-479d-acfd-622ceff22849 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:03.968753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d302b26e-1022-479d-acfd-622ceff22849 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:03.969473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d302b26e-1022-479d-acfd-622ceff22849 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:03.977613 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8de96aec-2f9f-4809-b86a-4783e9b4f989 req-4eb3e4b1-4d9f-42cd-a8d4-a694d8acf97f service nova] Creating event network-vif-deleted:422a108d-537c-4443-bbb2-9257b333140e for instance 820ae2cd-bf19-499c-a236-4a8e92f974cc on nch2-master-1 Jan 22 21:02:03.984185 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-8de96aec-2f9f-4809-b86a-4783e9b4f989 req-4eb3e4b1-4d9f-42cd-a8d4-a694d8acf97f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068951 Jan 22 21:02:03.985066 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 335/653] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:04.000950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c8e1f7e8-5403-42c1-836a-5b5ae6673f02 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:04.004499 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:04.004499 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:04.007298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8e1f7e8-5403-42c1-836a-5b5ae6673f02 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:04.007962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8e1f7e8-5403-42c1-836a-5b5ae6673f02 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:04.008986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8e1f7e8-5403-42c1-836a-5b5ae6673f02 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:04.009762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8e1f7e8-5403-42c1-836a-5b5ae6673f02 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:04.037172 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c8e1f7e8-5403-42c1-836a-5b5ae6673f02 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.049968 Jan 22 21:02:04.038080 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 336/654] 10.222.0.100 () {60 vars in 1221 bytes} [Sat Jan 22 21:02:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:04.042911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e27ff375-5188-470a-bf30-14d267bf93c9 tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-622846708", "id": 1896867541, "os-flavor-access:is_public": "False"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:04.044607 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:04.044607 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:04.146722 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e27ff375-5188-470a-bf30-14d267bf93c9 tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.107404 Jan 22 21:02:04.151486 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 337/655] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:02:04 2022] POST /compute/v2.1/flavors => generated 432 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:04.158444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-488d9411-aedc-460c-89c8-efe1dede70a9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed60f03a0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:04.222869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d302b26e-1022-479d-acfd-622ceff22849 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:04.227754 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-488d9411-aedc-460c-89c8-efe1dede70a9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.077362 Jan 22 21:02:04.228372 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 338/656] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:04 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:04.238062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7c4eb486-6bd4-40b5-921f-a81e63577b6e tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:04.241747 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d302b26e-1022-479d-acfd-622ceff22849 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1507 microversion: 2.1 time: 0.292457 Jan 22 21:02:04.242646 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 319/657] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:03 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1507 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:04.256739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-52032cbe-3794-417e-87d9-e14aa5cb0cd3 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:04.258648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-52032cbe-3794-417e-87d9-e14aa5cb0cd3 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:04.268869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52032cbe-3794-417e-87d9-e14aa5cb0cd3 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:04.268869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52032cbe-3794-417e-87d9-e14aa5cb0cd3 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:04.268869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52032cbe-3794-417e-87d9-e14aa5cb0cd3 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:04.269221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52032cbe-3794-417e-87d9-e14aa5cb0cd3 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:04.302280 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-7c4eb486-6bd4-40b5-921f-a81e63577b6e tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jan 22 21:02:04.303108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7c4eb486-6bd4-40b5-921f-a81e63577b6e tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:04.303961 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7c4eb486-6bd4-40b5-921f-a81e63577b6e tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "POST /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf/action" status: 404 len: 88 microversion: 2.1 time: 0.074649 Jan 22 21:02:04.304530 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 339/658] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:04 2022] POST /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf/action => generated 88 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:02:04.313060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-bce101f4-1eab-462f-a660-8c30fe15148a req-4f1dcc64-b043-48c5-8f61-9eeee507e59e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59386c42-117b-4309-9c99-c977fc1cbdef", "name": "network-vif-plugged", "status": "completed", "tag": "79c00dcb-7c5c-472a-a9f9-846204b548e1"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:04.316724 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:04.316724 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:04.346085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bce101f4-1eab-462f-a660-8c30fe15148a req-4f1dcc64-b043-48c5-8f61-9eeee507e59e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:04.346085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bce101f4-1eab-462f-a660-8c30fe15148a req-4f1dcc64-b043-48c5-8f61-9eeee507e59e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:04.364317 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-bce101f4-1eab-462f-a660-8c30fe15148a req-4f1dcc64-b043-48c5-8f61-9eeee507e59e service nova] Creating event network-vif-plugged:79c00dcb-7c5c-472a-a9f9-846204b548e1 for instance 59386c42-117b-4309-9c99-c977fc1cbdef on nch1-master-1 Jan 22 21:02:04.382618 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-bce101f4-1eab-462f-a660-8c30fe15148a req-4f1dcc64-b043-48c5-8f61-9eeee507e59e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076530 Jan 22 21:02:04.383458 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 340/659] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:04.401471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6b403012-bf0c-47a2-9a44-e472c0cd68c7 tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:04.401471 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:04.401471 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:04.421802 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6b403012-bf0c-47a2-9a44-e472c0cd68c7 tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/1896867541/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.036067 Jan 22 21:02:04.425693 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 341/660] 10.222.0.100 () {58 vars in 1213 bytes} [Sat Jan 22 21:02:04 2022] GET /compute/v2.1/flavors/1896867541/os-flavor-access => generated 21 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:02:04.429191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eb9de83a-c8d0-4702-885a-3377ed08df1c tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:04.429882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eb9de83a-c8d0-4702-885a-3377ed08df1c tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:04.440730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb9de83a-c8d0-4702-885a-3377ed08df1c tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:04.441630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb9de83a-c8d0-4702-885a-3377ed08df1c tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:04.442646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb9de83a-c8d0-4702-885a-3377ed08df1c tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:04.443264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb9de83a-c8d0-4702-885a-3377ed08df1c tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:04.476817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eb9de83a-c8d0-4702-885a-3377ed08df1c tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:02:04.502754 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-52032cbe-3794-417e-87d9-e14aa5cb0cd3 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df/action" status: 202 len: 0 microversion: 2.25 time: 0.249037 Jan 22 21:02:04.503419 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 320/661] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:02:04 2022] POST /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:02:04.525284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b2777e8c-8bfc-4aaf-921b-9f1e63b24f0e tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:04.529237 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:04.529237 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:04.608806 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b2777e8c-8bfc-4aaf-921b-9f1e63b24f0e tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/1896867541" status: 202 len: 0 microversion: 2.1 time: 0.104203 Jan 22 21:02:04.609741 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 321/662] 10.222.0.100 () {58 vars in 1165 bytes} [Sat Jan 22 21:02:04 2022] DELETE /compute/v2.1/flavors/1896867541 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:04.617986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b0629a8f-38e2-4952-952c-2a96da91454b tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:04.619360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b0629a8f-38e2-4952-952c-2a96da91454b tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:04.628934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0629a8f-38e2-4952-952c-2a96da91454b tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:04.634046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0629a8f-38e2-4952-952c-2a96da91454b tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:04.636782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0629a8f-38e2-4952-952c-2a96da91454b tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:04.640708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0629a8f-38e2-4952-952c-2a96da91454b tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:04.863768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-b0629a8f-38e2-4952-952c-2a96da91454b tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'services' on Instance uuid d9618ff2-a2cc-41d5-9d2f-1fd0c63658df {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:02:04.873129 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eb9de83a-c8d0-4702-885a-3377ed08df1c tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "DELETE /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 204 len: 0 microversion: 2.1 time: 0.448946 Jan 22 21:02:04.875530 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 342/663] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:02:04 2022] DELETE /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:02:04.884241 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b0629a8f-38e2-4952-952c-2a96da91454b tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 2058 microversion: 2.25 time: 0.269909 Jan 22 21:02:04.884526 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 322/664] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:04 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 2058 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:04.887131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1e480810-dc97-42a6-b1de-0182a274cf86 tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:04.889758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2e8437a8-85b9-4d11-8bd4-8c0dc31aea42 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:04.890533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2e8437a8-85b9-4d11-8bd4-8c0dc31aea42 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:04.897756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e8437a8-85b9-4d11-8bd4-8c0dc31aea42 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:04.898463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e8437a8-85b9-4d11-8bd4-8c0dc31aea42 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:04.899576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e8437a8-85b9-4d11-8bd4-8c0dc31aea42 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:04.900307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e8437a8-85b9-4d11-8bd4-8c0dc31aea42 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:04.917662 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1e480810-dc97-42a6-b1de-0182a274cf86 tempest-FlavorsAccessTestJSON-126488099 tempest-FlavorsAccessTestJSON-126488099-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5843 microversion: 2.1 time: 0.038223 Jan 22 21:02:04.917662 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 343/665] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:02:04 2022] GET /compute/v2.1/flavors/detail => generated 5843 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:04.926123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-778b695d-c1ff-42fd-9b43-f187991224e5 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:04.926123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-778b695d-c1ff-42fd-9b43-f187991224e5 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:04.937447 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-2e8437a8-85b9-4d11-8bd4-8c0dc31aea42 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] HTTP exception thrown: Instance 820ae2cd-bf19-499c-a236-4a8e92f974cc could not be found. Jan 22 21:02:04.938490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2e8437a8-85b9-4d11-8bd4-8c0dc31aea42 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Returning 404 to user: Instance 820ae2cd-bf19-499c-a236-4a8e92f974cc could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:04.941116 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2e8437a8-85b9-4d11-8bd4-8c0dc31aea42 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 404 len: 111 microversion: 2.1 time: 0.054435 Jan 22 21:02:04.947612 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 323/666] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:04 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:04.958909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c940cec8-2b80-4c08-90b4-442cb639cd33 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:04.959535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c940cec8-2b80-4c08-90b4-442cb639cd33 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:04.970096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-778b695d-c1ff-42fd-9b43-f187991224e5 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:04.973271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c940cec8-2b80-4c08-90b4-442cb639cd33 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:04.975588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c940cec8-2b80-4c08-90b4-442cb639cd33 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:04.976116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-778b695d-c1ff-42fd-9b43-f187991224e5 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:04.976399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c940cec8-2b80-4c08-90b4-442cb639cd33 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:04.976858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c940cec8-2b80-4c08-90b4-442cb639cd33 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:04.980322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-778b695d-c1ff-42fd-9b43-f187991224e5 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:04.981046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-778b695d-c1ff-42fd-9b43-f187991224e5 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:05.027769 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-778b695d-c1ff-42fd-9b43-f187991224e5 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108804 Jan 22 21:02:05.028995 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 344/667] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:02:04 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:02:05.035501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ae9fb796-6826-4110-b385-06072097a13b tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1438657948", "metadata": {"image_type": "test"}}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:05.036873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ae9fb796-6826-4110-b385-06072097a13b tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:05.045231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae9fb796-6826-4110-b385-06072097a13b tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:05.046023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae9fb796-6826-4110-b385-06072097a13b tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:05.047108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae9fb796-6826-4110-b385-06072097a13b tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:05.047789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae9fb796-6826-4110-b385-06072097a13b tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:05.070522 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-ae9fb796-6826-4110-b385-06072097a13b tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] HTTP exception thrown: Instance 820ae2cd-bf19-499c-a236-4a8e92f974cc could not be found. Jan 22 21:02:05.071132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ae9fb796-6826-4110-b385-06072097a13b tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Returning 404 to user: Instance 820ae2cd-bf19-499c-a236-4a8e92f974cc could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:05.071976 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ae9fb796-6826-4110-b385-06072097a13b tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "POST /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc/action" status: 404 len: 111 microversion: 2.1 time: 0.041832 Jan 22 21:02:05.078784 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 345/668] 10.222.0.100 () {60 vars in 1283 bytes} [Sat Jan 22 21:02:05 2022] POST /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:05.085954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8dd71fe1-4369-48a2-98d5-5615868704f1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:05.087180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8dd71fe1-4369-48a2-98d5-5615868704f1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:05.098617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd71fe1-4369-48a2-98d5-5615868704f1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:05.099112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd71fe1-4369-48a2-98d5-5615868704f1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:05.099962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd71fe1-4369-48a2-98d5-5615868704f1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:05.103772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd71fe1-4369-48a2-98d5-5615868704f1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:05.199459 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8dd71fe1-4369-48a2-98d5-5615868704f1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 14 microversion: 2.1 time: 0.119265 Jan 22 21:02:05.201141 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 346/669] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:05 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:02:05.214844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4e7cd41-3070-40e8-ab2e-fccdd9b576f7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1194571584", "metadata": {"image_type": "test"}}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:05.219689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c4e7cd41-3070-40e8-ab2e-fccdd9b576f7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Failed to fetch instance by id tempest-invalid-1850425634 {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2871}} Jan 22 21:02:05.221085 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-c4e7cd41-3070-40e8-ab2e-fccdd9b576f7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] HTTP exception thrown: Instance tempest-invalid-1850425634 could not be found. Jan 22 21:02:05.223927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4e7cd41-3070-40e8-ab2e-fccdd9b576f7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Returning 404 to user: Instance tempest-invalid-1850425634 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:05.225256 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c4e7cd41-3070-40e8-ab2e-fccdd9b576f7 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "POST /compute/v2.1/servers/tempest-invalid-1850425634/action" status: 404 len: 101 microversion: 2.1 time: 0.022687 Jan 22 21:02:05.232642 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 347/670] 10.222.0.100 () {60 vars in 1253 bytes} [Sat Jan 22 21:02:05 2022] POST /compute/v2.1/servers/tempest-invalid-1850425634/action => generated 101 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:05.250460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-235032c1-5113-4eb6-a823-6aa85cf59be6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5fb10d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:05.252522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c940cec8-2b80-4c08-90b4-442cb639cd33 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c921b8a098454af8becc1074ab0eb4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca97602282f40168d95eb37d81f93e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:05.263445 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c940cec8-2b80-4c08-90b4-442cb639cd33 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 200 len: 1547 microversion: 2.1 time: 0.312569 Jan 22 21:02:05.266469 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 324/671] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:04 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 1547 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:05.277247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dfc59532-3130-42fb-8ef3-f9231aacfdb5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2121730357"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:05.278266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dfc59532-3130-42fb-8ef3-f9231aacfdb5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2871}} Jan 22 21:02:05.278796 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-dfc59532-3130-42fb-8ef3-f9231aacfdb5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jan 22 21:02:05.279372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dfc59532-3130-42fb-8ef3-f9231aacfdb5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:05.280279 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dfc59532-3130-42fb-8ef3-f9231aacfdb5 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.015180 Jan 22 21:02:05.285736 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 325/672] 10.222.0.100 () {60 vars in 1279 bytes} [Sat Jan 22 21:02:05 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:05.290576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-30cdbd41-b312-4ef0-9578-689a1ca02823 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:05.291198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-30cdbd41-b312-4ef0-9578-689a1ca02823 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:05.299264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30cdbd41-b312-4ef0-9578-689a1ca02823 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:05.299514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30cdbd41-b312-4ef0-9578-689a1ca02823 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:05.300340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30cdbd41-b312-4ef0-9578-689a1ca02823 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:05.300794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30cdbd41-b312-4ef0-9578-689a1ca02823 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:05.373795 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-235032c1-5113-4eb6-a823-6aa85cf59be6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.130140 Jan 22 21:02:05.374876 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 348/673] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:05 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:05.383824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-441ad604-76fe-4496-9bf9-edd84ec6a5f4 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1427764764"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:05.385653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-441ad604-76fe-4496-9bf9-edd84ec6a5f4 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2871}} Jan 22 21:02:05.386433 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-441ad604-76fe-4496-9bf9-edd84ec6a5f4 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jan 22 21:02:05.387212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-441ad604-76fe-4496-9bf9-edd84ec6a5f4 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:05.388312 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-441ad604-76fe-4496-9bf9-edd84ec6a5f4 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.012159 Jan 22 21:02:05.389169 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 349/674] 10.222.0.100 () {60 vars in 1285 bytes} [Sat Jan 22 21:02:05 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:05.401128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4abdc4c2-b185-4d22-b249-074c66ed4505 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:05.401128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4abdc4c2-b185-4d22-b249-074c66ed4505 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:05.410106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4abdc4c2-b185-4d22-b249-074c66ed4505 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:05.410412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4abdc4c2-b185-4d22-b249-074c66ed4505 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:05.411389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4abdc4c2-b185-4d22-b249-074c66ed4505 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:05.412071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4abdc4c2-b185-4d22-b249-074c66ed4505 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:05.429141 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-4abdc4c2-b185-4d22-b249-074c66ed4505 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] HTTP exception thrown: Instance 820ae2cd-bf19-499c-a236-4a8e92f974cc could not be found. Jan 22 21:02:05.429998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4abdc4c2-b185-4d22-b249-074c66ed4505 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Returning 404 to user: Instance 820ae2cd-bf19-499c-a236-4a8e92f974cc could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:05.430943 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4abdc4c2-b185-4d22-b249-074c66ed4505 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "DELETE /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 404 len: 111 microversion: 2.1 time: 0.035703 Jan 22 21:02:05.432055 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 350/675] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:02:05 2022] DELETE /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:02:05.440742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1d95e118-28a1-421c-96af-d804eb5cd100 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:05.444992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1d95e118-28a1-421c-96af-d804eb5cd100 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] [instance: 820ae2cd-bf19-499c-a236-4a8e92f974cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:05.460500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d95e118-28a1-421c-96af-d804eb5cd100 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:05.460970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d95e118-28a1-421c-96af-d804eb5cd100 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:05.462597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d95e118-28a1-421c-96af-d804eb5cd100 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:05.463427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d95e118-28a1-421c-96af-d804eb5cd100 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:05.481751 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-1d95e118-28a1-421c-96af-d804eb5cd100 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] HTTP exception thrown: Instance 820ae2cd-bf19-499c-a236-4a8e92f974cc could not be found. Jan 22 21:02:05.482393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1d95e118-28a1-421c-96af-d804eb5cd100 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] Returning 404 to user: Instance 820ae2cd-bf19-499c-a236-4a8e92f974cc could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:05.483336 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1d95e118-28a1-421c-96af-d804eb5cd100 tempest-ImagesNegativeTestJSON-607993770 tempest-ImagesNegativeTestJSON-607993770-project] 10.222.0.100 "GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc" status: 404 len: 111 microversion: 2.1 time: 0.046986 Jan 22 21:02:05.484041 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 351/676] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:05 2022] GET /compute/v2.1/servers/820ae2cd-bf19-499c-a236-4a8e92f974cc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:05.510857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-30cdbd41-b312-4ef0-9578-689a1ca02823 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:05.528536 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-30cdbd41-b312-4ef0-9578-689a1ca02823 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1507 microversion: 2.1 time: 0.231696 Jan 22 21:02:05.528536 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 326/677] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:05 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:05.904791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d359d4a-bf9b-44d5-87ed-0fc8633cf94e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:05.906056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d359d4a-bf9b-44d5-87ed-0fc8633cf94e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:05.921144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d359d4a-bf9b-44d5-87ed-0fc8633cf94e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:05.922536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d359d4a-bf9b-44d5-87ed-0fc8633cf94e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:05.925959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d359d4a-bf9b-44d5-87ed-0fc8633cf94e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:05.927924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d359d4a-bf9b-44d5-87ed-0fc8633cf94e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:06.013044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-08e0ebb1-c306-4318-a012-d1e753485c0a req-ce028101-7a38-4f42-8c96-ab09dab39fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "664d69ee-34da-42b7-8e5e-7dc8adc0ed77", "name": "network-vif-unplugged", "status": "completed", "tag": "c24f136c-37da-4fb5-bd76-da0d44ee4299"}, {"name": "network-changed", "server_uuid": "664d69ee-34da-42b7-8e5e-7dc8adc0ed77", "tag": "c24f136c-37da-4fb5-bd76-da0d44ee4299"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:06.015057 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:06.015057 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:06.032148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-08e0ebb1-c306-4318-a012-d1e753485c0a req-ce028101-7a38-4f42-8c96-ab09dab39fbb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:06.039860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-08e0ebb1-c306-4318-a012-d1e753485c0a req-ce028101-7a38-4f42-8c96-ab09dab39fbb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:06.080098 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-08e0ebb1-c306-4318-a012-d1e753485c0a req-ce028101-7a38-4f42-8c96-ab09dab39fbb service nova] Creating event network-vif-unplugged:c24f136c-37da-4fb5-bd76-da0d44ee4299 for instance 664d69ee-34da-42b7-8e5e-7dc8adc0ed77 on nch2-master-1 Jan 22 21:02:06.081136 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-08e0ebb1-c306-4318-a012-d1e753485c0a req-ce028101-7a38-4f42-8c96-ab09dab39fbb service nova] Creating event network-changed:c24f136c-37da-4fb5-bd76-da0d44ee4299 for instance 664d69ee-34da-42b7-8e5e-7dc8adc0ed77 on nch2-master-1 Jan 22 21:02:06.089012 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-08e0ebb1-c306-4318-a012-d1e753485c0a req-ce028101-7a38-4f42-8c96-ab09dab39fbb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.080043 Jan 22 21:02:06.092231 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 327/678] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:06.228611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a194e747-3481-4132-a3cf-694dc0cea924 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:06.229688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a194e747-3481-4132-a3cf-694dc0cea924 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:06.259438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-3d359d4a-bf9b-44d5-87ed-0fc8633cf94e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'services' on Instance uuid d9618ff2-a2cc-41d5-9d2f-1fd0c63658df {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:02:06.266866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a194e747-3481-4132-a3cf-694dc0cea924 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:06.267884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a194e747-3481-4132-a3cf-694dc0cea924 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:06.271559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a194e747-3481-4132-a3cf-694dc0cea924 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:06.272028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a194e747-3481-4132-a3cf-694dc0cea924 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:06.343496 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d359d4a-bf9b-44d5-87ed-0fc8633cf94e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 2038 microversion: 2.25 time: 0.414891 Jan 22 21:02:06.343496 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 352/679] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:05 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 2038 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:02:06.343496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-98c951b3-6530-4816-bd7b-c38de2710c28 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:06.343496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-98c951b3-6530-4816-bd7b-c38de2710c28 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:06.363487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98c951b3-6530-4816-bd7b-c38de2710c28 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:06.364484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98c951b3-6530-4816-bd7b-c38de2710c28 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:06.365314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98c951b3-6530-4816-bd7b-c38de2710c28 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:06.365820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98c951b3-6530-4816-bd7b-c38de2710c28 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:06.374868 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a194e747-3481-4132-a3cf-694dc0cea924 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 14 microversion: 2.1 time: 0.166450 Jan 22 21:02:06.375970 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 328/680] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:06 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:02:06.398009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d7b2f850-fe3e-4ac6-9172-cf45c97def00 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:06.400317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d7b2f850-fe3e-4ac6-9172-cf45c97def00 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:06.410526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7b2f850-fe3e-4ac6-9172-cf45c97def00 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:06.411176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7b2f850-fe3e-4ac6-9172-cf45c97def00 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:06.412456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7b2f850-fe3e-4ac6-9172-cf45c97def00 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:06.413874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7b2f850-fe3e-4ac6-9172-cf45c97def00 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:06.445722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-d7b2f850-fe3e-4ac6-9172-cf45c97def00 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'flavor' on Instance uuid d9618ff2-a2cc-41d5-9d2f-1fd0c63658df {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:02:06.460961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d7b2f850-fe3e-4ac6-9172-cf45c97def00 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Going to try to live migrate instance to nch2-master-1 {{(pid=137032) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 22 21:02:07.120944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-98c951b3-6530-4816-bd7b-c38de2710c28 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c921b8a098454af8becc1074ab0eb4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca97602282f40168d95eb37d81f93e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:07.133264 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-98c951b3-6530-4816-bd7b-c38de2710c28 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 200 len: 1547 microversion: 2.1 time: 0.810021 Jan 22 21:02:07.167108 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 353/681] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:06 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 1547 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:07.183805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aec96cb1-6bdd-4dc1-b6b7-a38cc89876f7 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5f570d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:07.271436 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aec96cb1-6bdd-4dc1-b6b7-a38cc89876f7 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.100006 Jan 22 21:02:07.273608 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 354/682] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:07 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:07.279731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-291fabdd-b65e-420e-bdac-571c0e110c06 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:07.280952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-291fabdd-b65e-420e-bdac-571c0e110c06 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:07.304853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-291fabdd-b65e-420e-bdac-571c0e110c06 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:07.305636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-291fabdd-b65e-420e-bdac-571c0e110c06 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:07.306603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-291fabdd-b65e-420e-bdac-571c0e110c06 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:07.307141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-291fabdd-b65e-420e-bdac-571c0e110c06 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:07.609899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-291fabdd-b65e-420e-bdac-571c0e110c06 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:07.620808 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-291fabdd-b65e-420e-bdac-571c0e110c06 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1507 microversion: 2.1 time: 0.345618 Jan 22 21:02:07.622370 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 355/683] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:07 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:07.627507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2df4ecd7-0550-408d-b113-ebaabbeb7aaf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:07.632136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2df4ecd7-0550-408d-b113-ebaabbeb7aaf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:07.634953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2df4ecd7-0550-408d-b113-ebaabbeb7aaf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:07.635420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2df4ecd7-0550-408d-b113-ebaabbeb7aaf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:07.636301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2df4ecd7-0550-408d-b113-ebaabbeb7aaf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:07.636746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2df4ecd7-0550-408d-b113-ebaabbeb7aaf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:07.691355 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2df4ecd7-0550-408d-b113-ebaabbeb7aaf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 14 microversion: 2.1 time: 0.066994 Jan 22 21:02:07.694730 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 356/684] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:07 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:02:08.106736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-a07566b6-f872-4891-815e-3f35485e1f8c req-4de5fba7-e381-46d0-8fcd-de35bfa7ec75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc09b6eb-2701-4e2c-a135-a2f65c05eabf", "name": "network-vif-deleted", "tag": "9c612c1a-080f-4f7f-a757-7d20ac1cee0d"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:08.108242 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:08.108242 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:08.121813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a07566b6-f872-4891-815e-3f35485e1f8c req-4de5fba7-e381-46d0-8fcd-de35bfa7ec75 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:08.122410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a07566b6-f872-4891-815e-3f35485e1f8c req-4de5fba7-e381-46d0-8fcd-de35bfa7ec75 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:08.140684 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-a07566b6-f872-4891-815e-3f35485e1f8c req-4de5fba7-e381-46d0-8fcd-de35bfa7ec75 service nova] Creating event network-vif-deleted:9c612c1a-080f-4f7f-a757-7d20ac1cee0d for instance bc09b6eb-2701-4e2c-a135-a2f65c05eabf on nch2-master-1 Jan 22 21:02:08.146088 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-a07566b6-f872-4891-815e-3f35485e1f8c req-4de5fba7-e381-46d0-8fcd-de35bfa7ec75 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043195 Jan 22 21:02:08.147102 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 357/685] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:02:08.161375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b93edc71-0335-4a30-a332-d527f2f76eef tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:08.162623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b93edc71-0335-4a30-a332-d527f2f76eef tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:08.169346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b93edc71-0335-4a30-a332-d527f2f76eef tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:08.173186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b93edc71-0335-4a30-a332-d527f2f76eef tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:08.173186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b93edc71-0335-4a30-a332-d527f2f76eef tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:08.173186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b93edc71-0335-4a30-a332-d527f2f76eef tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:08.254620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b93edc71-0335-4a30-a332-d527f2f76eef tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c921b8a098454af8becc1074ab0eb4ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca97602282f40168d95eb37d81f93e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:08.264666 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b93edc71-0335-4a30-a332-d527f2f76eef tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 200 len: 1505 microversion: 2.1 time: 0.113737 Jan 22 21:02:08.269670 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 358/686] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:08 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 1505 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:02:08.287316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b4c3fd9b-8a15-4c0d-9bab-4c1b650c8804 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed6002670>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:08.355734 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b4c3fd9b-8a15-4c0d-9bab-4c1b650c8804 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.074152 Jan 22 21:02:08.356626 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 359/687] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:08 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:02:08.572864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0d912e6c-95a4-417c-a7ac-627551b06137 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b20a5c1c-3e92-457f-a478-05a4796c0718"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:08.574460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0d912e6c-95a4-417c-a7ac-627551b06137 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:08.596045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d912e6c-95a4-417c-a7ac-627551b06137 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:08.601550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d912e6c-95a4-417c-a7ac-627551b06137 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:08.603816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d912e6c-95a4-417c-a7ac-627551b06137 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:08.605213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d912e6c-95a4-417c-a7ac-627551b06137 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:08.638399 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-volumes-attachments:swap": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:08.638399 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:08.677579 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-0d912e6c-95a4-417c-a7ac-627551b06137 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] HTTP exception thrown: Volume fd8124a6-5469-491a-b4c0-647feff21d6a could not be found. Jan 22 21:02:08.678201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0d912e6c-95a4-417c-a7ac-627551b06137 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] Returning 404 to user: Volume fd8124a6-5469-491a-b4c0-647feff21d6a could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:08.679046 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0d912e6c-95a4-417c-a7ac-627551b06137 tempest-VolumesAdminNegativeTest-449460056 tempest-VolumesAdminNegativeTest-449460056-project-admin] 10.222.0.100 "PUT /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8/os-volume_attachments/fd8124a6-5469-491a-b4c0-647feff21d6a" status: 404 len: 109 microversion: 2.1 time: 0.121219 Jan 22 21:02:08.683288 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 360/688] 10.222.0.100 () {60 vars in 1437 bytes} [Sat Jan 22 21:02:08 2022] PUT /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8/os-volume_attachments/fd8124a6-5469-491a-b4c0-647feff21d6a => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:02:08.691217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b938c230-0181-42cf-9f75-f03f6b4fdaa2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:08.691829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b938c230-0181-42cf-9f75-f03f6b4fdaa2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:08.702069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b938c230-0181-42cf-9f75-f03f6b4fdaa2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:08.703461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b938c230-0181-42cf-9f75-f03f6b4fdaa2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:08.707880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b938c230-0181-42cf-9f75-f03f6b4fdaa2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:08.708603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b938c230-0181-42cf-9f75-f03f6b4fdaa2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:09.036049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b938c230-0181-42cf-9f75-f03f6b4fdaa2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:09.080625 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b938c230-0181-42cf-9f75-f03f6b4fdaa2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1507 microversion: 2.1 time: 0.395871 Jan 22 21:02:09.093786 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 361/689] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:08 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1507 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:09.104389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-947258b6-52cc-46f3-9f7f-775b8d438b04 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:09.118707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-947258b6-52cc-46f3-9f7f-775b8d438b04 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:09.140310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-947258b6-52cc-46f3-9f7f-775b8d438b04 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:09.145738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-947258b6-52cc-46f3-9f7f-775b8d438b04 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:09.146752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-947258b6-52cc-46f3-9f7f-775b8d438b04 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:09.148230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-947258b6-52cc-46f3-9f7f-775b8d438b04 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:09.261399 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-947258b6-52cc-46f3-9f7f-775b8d438b04 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 8207 microversion: 2.1 time: 0.166151 Jan 22 21:02:09.263634 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 362/690] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:09 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 8207 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:09.460504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bce83414-9642-4d11-8fe6-0da44abc1ffb tempest-ListImagesTestJSON-1076371706 tempest-ListImagesTestJSON-1076371706-project] Calling method '.version_select at 0x7f1ed5eb6ee0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:09.529529 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bce83414-9642-4d11-8fe6-0da44abc1ffb tempest-ListImagesTestJSON-1076371706 tempest-ListImagesTestJSON-1076371706-project] 10.222.0.100 "GET /compute/v2.1/images/373cb480-3bc4-4821-93e2-442b4e852b80" status: 200 len: 787 microversion: 2.1 time: 0.264227 Jan 22 21:02:09.530491 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 363/691] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:09 2022] GET /compute/v2.1/images/373cb480-3bc4-4821-93e2-442b4e852b80 => generated 787 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:09.542188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-add3daab-a7c2-4b7c-ba5e-1edc83ba7b48 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:09.543379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-add3daab-a7c2-4b7c-ba5e-1edc83ba7b48 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] [instance: bc09b6eb-2701-4e2c-a135-a2f65c05eabf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:09.552788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-add3daab-a7c2-4b7c-ba5e-1edc83ba7b48 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:09.553590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-add3daab-a7c2-4b7c-ba5e-1edc83ba7b48 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:09.554750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-add3daab-a7c2-4b7c-ba5e-1edc83ba7b48 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:09.555410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-add3daab-a7c2-4b7c-ba5e-1edc83ba7b48 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:09.581127 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-add3daab-a7c2-4b7c-ba5e-1edc83ba7b48 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] HTTP exception thrown: Instance bc09b6eb-2701-4e2c-a135-a2f65c05eabf could not be found. Jan 22 21:02:09.581872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-add3daab-a7c2-4b7c-ba5e-1edc83ba7b48 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] Returning 404 to user: Instance bc09b6eb-2701-4e2c-a135-a2f65c05eabf could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:09.582850 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-add3daab-a7c2-4b7c-ba5e-1edc83ba7b48 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642 tempest-FloatingIPsAssociationNegativeTestJSON-1453241642-project] 10.222.0.100 "GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf" status: 404 len: 111 microversion: 2.1 time: 0.051217 Jan 22 21:02:09.594425 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 364/692] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:09 2022] GET /compute/v2.1/servers/bc09b6eb-2701-4e2c-a135-a2f65c05eabf => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:09.594425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eea5e9bc-49c7-4577-9578-886af546b255 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5f57160>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:09.651608 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eea5e9bc-49c7-4577-9578-886af546b255 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.067004 Jan 22 21:02:09.658828 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 365/693] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:09 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:09.663342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4ad5b604-50ca-4635-a604-e5bd38acfed9 tempest-ListImagesTestJSON-1076371706 tempest-ListImagesTestJSON-1076371706-project] Calling method '.version_select at 0x7f1ed61100d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:09.847215 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4ad5b604-50ca-4635-a604-e5bd38acfed9 tempest-ListImagesTestJSON-1076371706 tempest-ListImagesTestJSON-1076371706-project] 10.222.0.100 "GET /compute/v2.1/images" status: 200 len: 448 microversion: 2.1 time: 0.192127 Jan 22 21:02:09.848486 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 366/694] 10.222.0.100 () {58 vars in 1126 bytes} [Sat Jan 22 21:02:09 2022] GET /compute/v2.1/images => generated 448 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:09.869405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-190cc26a-1f11-4f7d-9c15-948b64c4f32c tempest-ListImagesTestJSON-1076371706 tempest-ListImagesTestJSON-1076371706-project] Calling method '.version_select at 0x7f1ed5f57c10>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:09.948845 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-190cc26a-1f11-4f7d-9c15-948b64c4f32c tempest-ListImagesTestJSON-1076371706 tempest-ListImagesTestJSON-1076371706-project] 10.222.0.100 "GET /compute/v2.1/images/detail" status: 200 len: 790 microversion: 2.1 time: 0.087304 Jan 22 21:02:09.963399 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 367/695] 10.222.0.100 () {58 vars in 1147 bytes} [Sat Jan 22 21:02:09 2022] GET /compute/v2.1/images/detail => generated 790 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:10.111122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-43d20fc3-3288-4706-a498-db140ae51b79 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:10.115391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-43d20fc3-3288-4706-a498-db140ae51b79 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:10.122604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43d20fc3-3288-4706-a498-db140ae51b79 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:10.123050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43d20fc3-3288-4706-a498-db140ae51b79 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:10.123946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43d20fc3-3288-4706-a498-db140ae51b79 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:10.124387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43d20fc3-3288-4706-a498-db140ae51b79 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:10.396227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-43d20fc3-3288-4706-a498-db140ae51b79 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:10.414811 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-43d20fc3-3288-4706-a498-db140ae51b79 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1507 microversion: 2.1 time: 0.298987 Jan 22 21:02:10.414811 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 368/696] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:10 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1507 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:10.417573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-41e0bfe8-f665-4a91-9ceb-6f276647d643 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:10.420852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-41e0bfe8-f665-4a91-9ceb-6f276647d643 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:10.439449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41e0bfe8-f665-4a91-9ceb-6f276647d643 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:10.445403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41e0bfe8-f665-4a91-9ceb-6f276647d643 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:10.446460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41e0bfe8-f665-4a91-9ceb-6f276647d643 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:10.448815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41e0bfe8-f665-4a91-9ceb-6f276647d643 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:10.530321 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-41e0bfe8-f665-4a91-9ceb-6f276647d643 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 16401 microversion: 2.1 time: 0.122119 Jan 22 21:02:10.535030 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 369/697] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:10 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 16401 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:10.668391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-685377c0-aa37-4294-b8be-480bcf89730c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5f01b80>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:10.751081 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-685377c0-aa37-4294-b8be-480bcf89730c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.088398 Jan 22 21:02:10.757016 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 370/698] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:10 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:11.010928 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d7b2f850-fe3e-4ac6-9172-cf45c97def00 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df/action" status: 202 len: 0 microversion: 2.25 time: 4.632555 Jan 22 21:02:11.013086 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 329/699] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:02:06 2022] POST /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df/action => generated 0 bytes in 4636 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:02:11.022745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9ca74df5-1a0e-40cb-a5ed-f5ce3e3b99a7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:11.023940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9ca74df5-1a0e-40cb-a5ed-f5ce3e3b99a7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:11.038952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9ca74df5-1a0e-40cb-a5ed-f5ce3e3b99a7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:11.040657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9ca74df5-1a0e-40cb-a5ed-f5ce3e3b99a7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:11.043278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9ca74df5-1a0e-40cb-a5ed-f5ce3e3b99a7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:11.043807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9ca74df5-1a0e-40cb-a5ed-f5ce3e3b99a7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:11.476723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9f89bba3-e8f8-4839-940d-82b8fff3918c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:11.476723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9f89bba3-e8f8-4839-940d-82b8fff3918c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:11.476723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f89bba3-e8f8-4839-940d-82b8fff3918c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:11.476723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f89bba3-e8f8-4839-940d-82b8fff3918c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:11.478180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f89bba3-e8f8-4839-940d-82b8fff3918c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:11.478180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f89bba3-e8f8-4839-940d-82b8fff3918c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:11.480786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9ca74df5-1a0e-40cb-a5ed-f5ce3e3b99a7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:11.491454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9ca74df5-1a0e-40cb-a5ed-f5ce3e3b99a7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:11.493637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9ca74df5-1a0e-40cb-a5ed-f5ce3e3b99a7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:11.495261 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9ca74df5-1a0e-40cb-a5ed-f5ce3e3b99a7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1571 microversion: 2.25 time: 0.478071 Jan 22 21:02:11.496522 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 371/700] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:11 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1571 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:11.550862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3a1f9e9b-a101-49ac-b40a-607b54f6d0b4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:11.552177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3a1f9e9b-a101-49ac-b40a-607b54f6d0b4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:11.560593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a1f9e9b-a101-49ac-b40a-607b54f6d0b4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:11.598633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a1f9e9b-a101-49ac-b40a-607b54f6d0b4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:11.598633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a1f9e9b-a101-49ac-b40a-607b54f6d0b4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:11.598633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a1f9e9b-a101-49ac-b40a-607b54f6d0b4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:11.672053 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3a1f9e9b-a101-49ac-b40a-607b54f6d0b4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 16401 microversion: 2.1 time: 0.130389 Jan 22 21:02:11.672982 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 372/701] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:11 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 16401 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:11.767972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e1e280a2-c93d-42dd-8a61-a8ea7c67f73f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5f57b80>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:11.837669 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e1e280a2-c93d-42dd-8a61-a8ea7c67f73f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.076999 Jan 22 21:02:11.844982 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 373/702] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:11 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:02:11.895646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9f89bba3-e8f8-4839-940d-82b8fff3918c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:11.906898 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9f89bba3-e8f8-4839-940d-82b8fff3918c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1507 microversion: 2.1 time: 0.486446 Jan 22 21:02:11.910475 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 330/703] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:11 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1507 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:02:12.537638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4c31b6a2-4ee2-47ce-bc19-1691530a7300 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:12.542005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4c31b6a2-4ee2-47ce-bc19-1691530a7300 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:12.568171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c31b6a2-4ee2-47ce-bc19-1691530a7300 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:12.568961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c31b6a2-4ee2-47ce-bc19-1691530a7300 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:12.584515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c31b6a2-4ee2-47ce-bc19-1691530a7300 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:12.585517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c31b6a2-4ee2-47ce-bc19-1691530a7300 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:12.686554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c5dc45d3-ae9c-4cd0-95fc-078af23f646a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:12.688207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c5dc45d3-ae9c-4cd0-95fc-078af23f646a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:12.723237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5dc45d3-ae9c-4cd0-95fc-078af23f646a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:12.725034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5dc45d3-ae9c-4cd0-95fc-078af23f646a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:12.732170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5dc45d3-ae9c-4cd0-95fc-078af23f646a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:12.732916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5dc45d3-ae9c-4cd0-95fc-078af23f646a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:12.851510 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c5dc45d3-ae9c-4cd0-95fc-078af23f646a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 16401 microversion: 2.1 time: 0.165329 Jan 22 21:02:12.852794 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 331/704] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:12 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 16401 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:02:12.873220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e045f333-e837-45c3-aca4-8a151818aa1c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed61d8550>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:12.940554 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e045f333-e837-45c3-aca4-8a151818aa1c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.085272 Jan 22 21:02:12.941367 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 332/705] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:12 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:12.959347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-75efb95e-400c-4e04-9985-28d8d0dacde7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:12.960532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-75efb95e-400c-4e04-9985-28d8d0dacde7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:12.978094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75efb95e-400c-4e04-9985-28d8d0dacde7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:12.986335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75efb95e-400c-4e04-9985-28d8d0dacde7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:12.986335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75efb95e-400c-4e04-9985-28d8d0dacde7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:12.986335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75efb95e-400c-4e04-9985-28d8d0dacde7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:13.334762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4c31b6a2-4ee2-47ce-bc19-1691530a7300 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:13.345873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4c31b6a2-4ee2-47ce-bc19-1691530a7300 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:13.353215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4c31b6a2-4ee2-47ce-bc19-1691530a7300 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:13.357724 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4c31b6a2-4ee2-47ce-bc19-1691530a7300 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1571 microversion: 2.25 time: 0.842846 Jan 22 21:02:13.359541 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 374/706] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:12 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1571 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:13.567988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-75efb95e-400c-4e04-9985-28d8d0dacde7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:13.592754 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-75efb95e-400c-4e04-9985-28d8d0dacde7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1482 microversion: 2.1 time: 0.650012 Jan 22 21:02:13.596712 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 333/707] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:12 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1482 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:13.616586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-23bf831b-b285-4e94-86c5-8d59f229e287 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '.version_select at 0x7f1ed5f01670>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:13.619829 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:13.619829 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:13.622779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23bf831b-b285-4e94-86c5-8d59f229e287 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:13.623414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23bf831b-b285-4e94-86c5-8d59f229e287 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:13.639259 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-23bf831b-b285-4e94-86c5-8d59f229e287 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/os-migrations" status: 200 len: 1544 microversion: 2.1 time: 0.027108 Jan 22 21:02:13.640668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 375/708] 10.222.0.100 () {58 vars in 1147 bytes} [Sat Jan 22 21:02:13 2022] GET /compute/v2.1/os-migrations => generated 1544 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:13.657177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b6ba0f4-006c-48fc-afa6-b9051cc8b910 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:13.663353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b6ba0f4-006c-48fc-afa6-b9051cc8b910 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:13.666359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b6ba0f4-006c-48fc-afa6-b9051cc8b910 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:13.667042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b6ba0f4-006c-48fc-afa6-b9051cc8b910 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:13.668223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b6ba0f4-006c-48fc-afa6-b9051cc8b910 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:13.668938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b6ba0f4-006c-48fc-afa6-b9051cc8b910 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:13.863950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bff40586-6748-448c-ae59-96fc7b3f8e06 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:13.865718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bff40586-6748-448c-ae59-96fc7b3f8e06 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:13.880341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bff40586-6748-448c-ae59-96fc7b3f8e06 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:13.880881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bff40586-6748-448c-ae59-96fc7b3f8e06 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:13.881799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bff40586-6748-448c-ae59-96fc7b3f8e06 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:13.885458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bff40586-6748-448c-ae59-96fc7b3f8e06 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:13.992002 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bff40586-6748-448c-ae59-96fc7b3f8e06 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 16401 microversion: 2.1 time: 0.132211 Jan 22 21:02:13.993866 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 376/709] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:13 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 16401 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:14.001168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2ddc2ae3-4d87-42eb-b775-28a0eb4e5544 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5f01040>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:14.092730 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2ddc2ae3-4d87-42eb-b775-28a0eb4e5544 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.097527 Jan 22 21:02:14.093716 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 377/710] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:13 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:14.282057 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b6ba0f4-006c-48fc-afa6-b9051cc8b910 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1633 microversion: 2.1 time: 0.630332 Jan 22 21:02:14.291588 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 334/711] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:13 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1633 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:14.396799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-826bcc2e-1564-4830-aba4-2074c6e8856c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:14.397880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-826bcc2e-1564-4830-aba4-2074c6e8856c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:14.411774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-826bcc2e-1564-4830-aba4-2074c6e8856c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:14.412062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-826bcc2e-1564-4830-aba4-2074c6e8856c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:14.417605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-826bcc2e-1564-4830-aba4-2074c6e8856c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:14.419385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-826bcc2e-1564-4830-aba4-2074c6e8856c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:14.521325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-71ea87d9-e1d7-43f7-af1f-091ddd5c31aa req-430b0e2a-54bd-4b50-bcf9-e469494d7427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9618ff2-a2cc-41d5-9d2f-1fd0c63658df", "name": "network-vif-unplugged", "status": "completed", "tag": "b50148da-7bff-4e1e-9ed5-bfed58c0e2bf"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:14.522981 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:14.522981 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:14.541017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-71ea87d9-e1d7-43f7-af1f-091ddd5c31aa req-430b0e2a-54bd-4b50-bcf9-e469494d7427 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:14.541017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-71ea87d9-e1d7-43f7-af1f-091ddd5c31aa req-430b0e2a-54bd-4b50-bcf9-e469494d7427 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:14.579995 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-71ea87d9-e1d7-43f7-af1f-091ddd5c31aa req-430b0e2a-54bd-4b50-bcf9-e469494d7427 service nova] Creating event network-vif-unplugged:b50148da-7bff-4e1e-9ed5-bfed58c0e2bf for instance d9618ff2-a2cc-41d5-9d2f-1fd0c63658df on nch1-master-1 Jan 22 21:02:14.596500 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-71ea87d9-e1d7-43f7-af1f-091ddd5c31aa req-430b0e2a-54bd-4b50-bcf9-e469494d7427 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078825 Jan 22 21:02:14.602771 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 335/712] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:02:15.185254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-826bcc2e-1564-4830-aba4-2074c6e8856c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:15.194595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-826bcc2e-1564-4830-aba4-2074c6e8856c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:15.205791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-826bcc2e-1564-4830-aba4-2074c6e8856c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:15.207384 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-826bcc2e-1564-4830-aba4-2074c6e8856c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1571 microversion: 2.25 time: 0.825781 Jan 22 21:02:15.223358 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 378/713] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:14 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1571 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:15.232104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1798337726", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "3da6de85-e0d4-4a7c-ad9b-73d085f0c931"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:15.291002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-141fb71e-500f-4471-87d0-098b165adcc9 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-386350682", "id": 276213983, "os-flavor-access:is_public": "False"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:15.292720 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:15.292720 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:15.312471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] validate_networks() for [('3da6de85-e0d4-4a7c-ad9b-73d085f0c931', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:02:15.403023 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-141fb71e-500f-4471-87d0-098b165adcc9 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.787901 Jan 22 21:02:15.403932 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 336/714] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:02:14 2022] POST /compute/v2.1/flavors => generated 437 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:15.414670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-79a91f35-6f53-4343-a277-a7cc9006135b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:15.415744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-79a91f35-6f53-4343-a277-a7cc9006135b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:15.432701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79a91f35-6f53-4343-a277-a7cc9006135b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:15.435279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79a91f35-6f53-4343-a277-a7cc9006135b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:15.436205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79a91f35-6f53-4343-a277-a7cc9006135b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:15.436871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79a91f35-6f53-4343-a277-a7cc9006135b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:15.484713 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-79a91f35-6f53-4343-a277-a7cc9006135b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 16401 microversion: 2.1 time: 0.079518 Jan 22 21:02:15.487515 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 337/715] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:15 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 16401 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:15.495042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7d9d6d1f-e5a6-42a1-bae6-aebec7d80916 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed63a6af0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:15.584474 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7d9d6d1f-e5a6-42a1-bae6-aebec7d80916 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.095467 Jan 22 21:02:15.586541 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 338/716] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:15 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:15.601468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3d4be7c1-dee9-4ea3-9651-a6444e4af23a tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6885b20994554e0ab5a69765b9fc5009"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:15.602885 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:15.602885 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:15.786463 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3d4be7c1-dee9-4ea3-9651-a6444e4af23a tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors/276213983/action" status: 200 len: 96 microversion: 2.1 time: 0.197921 Jan 22 21:02:15.787352 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 339/717] 10.222.0.100 () {60 vars in 1201 bytes} [Sat Jan 22 21:02:15 2022] POST /compute/v2.1/flavors/276213983/action => generated 96 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:02:15.801101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-37b63382-213a-498e-8dd7-480f15a2430c tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6885b20994554e0ab5a69765b9fc5009"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:15.984269 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-37b63382-213a-498e-8dd7-480f15a2430c tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] HTTP exception thrown: Flavor access already exists for flavor 34 and project 6885b20994554e0ab5a69765b9fc5009 combination. Jan 22 21:02:15.985162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-37b63382-213a-498e-8dd7-480f15a2430c tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Returning 409 to user: Flavor access already exists for flavor 34 and project 6885b20994554e0ab5a69765b9fc5009 combination. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:15.988176 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-37b63382-213a-498e-8dd7-480f15a2430c tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors/276213983/action" status: 409 len: 152 microversion: 2.1 time: 0.190268 Jan 22 21:02:15.990034 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 340/718] 10.222.0.100 () {60 vars in 1201 bytes} [Sat Jan 22 21:02:15 2022] POST /compute/v2.1/flavors/276213983/action => generated 152 bytes in 194 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:02:15.998135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-496a8b67-dad5-436b-a745-5df85f5e2c98 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6885b20994554e0ab5a69765b9fc5009"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:16.000055 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:16.000055 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:16.145048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:02:16.145682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:02:16.146278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:02:16.146925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:02:16.148282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:02:16.166580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:16.166580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:16.166580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:16.166580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:16.196306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Getting quotas for project b277338cf6c4478e8e35cf79b34caaf6. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:16.202499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Getting quotas for user b07a1bb09ad44501925664aa61ac3e6d and project b277338cf6c4478e8e35cf79b34caaf6. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:16.237293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:02:16.240312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:02:16.265940 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-496a8b67-dad5-436b-a745-5df85f5e2c98 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors/276213983/action" status: 200 len: 21 microversion: 2.1 time: 0.271642 Jan 22 21:02:16.267774 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 341/719] 10.222.0.100 () {60 vars in 1201 bytes} [Sat Jan 22 21:02:15 2022] POST /compute/v2.1/flavors/276213983/action => generated 21 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:02:16.272668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-98845f64-027e-40c3-b738-4b3d6198c793 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:16.273693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-98845f64-027e-40c3-b738-4b3d6198c793 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:16.281533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98845f64-027e-40c3-b738-4b3d6198c793 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:16.282674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98845f64-027e-40c3-b738-4b3d6198c793 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:16.283795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98845f64-027e-40c3-b738-4b3d6198c793 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:16.284502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98845f64-027e-40c3-b738-4b3d6198c793 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:16.469331 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3f8b0b28-12bf-4c44-895d-84b4729a8751 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.249438 Jan 22 21:02:16.471705 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 379/720] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:02:15 2022] POST /compute/v2.1/servers => generated 382 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:02:16.483504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a6bd4987-0a3a-4b8a-a89d-7bb370f122ab tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:16.485378 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:16.485378 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:16.615020 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a6bd4987-0a3a-4b8a-a89d-7bb370f122ab tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/276213983" status: 202 len: 0 microversion: 2.1 time: 0.141475 Jan 22 21:02:16.616124 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 380/721] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 21:02:16 2022] DELETE /compute/v2.1/flavors/276213983 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:16.622741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-01768ab0-30e9-4719-83db-b2e109416bc3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:16.627907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-01768ab0-30e9-4719-83db-b2e109416bc3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:16.787179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-98845f64-027e-40c3-b738-4b3d6198c793 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:16.795499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-98845f64-027e-40c3-b738-4b3d6198c793 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:16.802435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-98845f64-027e-40c3-b738-4b3d6198c793 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:16.803904 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-98845f64-027e-40c3-b738-4b3d6198c793 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1571 microversion: 2.25 time: 0.535119 Jan 22 21:02:16.805736 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 342/722] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:16 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1571 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:16.810572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b594aaa9-66f6-48ca-8640-b1175a69eea5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:16.818903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b594aaa9-66f6-48ca-8640-b1175a69eea5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:16.831798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-01768ab0-30e9-4719-83db-b2e109416bc3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:16.833591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b594aaa9-66f6-48ca-8640-b1175a69eea5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:16.834260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b594aaa9-66f6-48ca-8640-b1175a69eea5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:16.835245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b594aaa9-66f6-48ca-8640-b1175a69eea5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:16.837428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b594aaa9-66f6-48ca-8640-b1175a69eea5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:16.839708 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-01768ab0-30e9-4719-83db-b2e109416bc3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1215 microversion: 2.1 time: 0.222494 Jan 22 21:02:16.848808 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 381/723] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:16 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1215 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:16.875683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6cf7477b-f642-4865-893f-fa7101d4f752 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5ec1b80>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:16.914871 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b594aaa9-66f6-48ca-8640-b1175a69eea5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 24566 microversion: 2.1 time: 0.107539 Jan 22 21:02:16.918323 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 343/724] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:16 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 24566 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:16.927282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f0f20c0d-261c-4f59-a24e-1cfd95ab7614 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:16.965988 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f0f20c0d-261c-4f59-a24e-1cfd95ab7614 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5843 microversion: 2.1 time: 0.042596 Jan 22 21:02:16.966662 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 344/725] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:02:16 2022] GET /compute/v2.1/flavors/detail => generated 5843 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:16.972182 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6cf7477b-f642-4865-893f-fa7101d4f752 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.122139 Jan 22 21:02:16.980881 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 382/726] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:16 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:16.986688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-e9b5cb8f-3bd6-44ca-84de-c07d3b1afd7e req-6a9272ae-3f66-4ef0-aed6-d59baa8e7531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9618ff2-a2cc-41d5-9d2f-1fd0c63658df", "tag": "b50148da-7bff-4e1e-9ed5-bfed58c0e2bf"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:16.986688 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:16.986688 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:16.987097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-27cfce18-abe5-45cd-ba0a-1b8cb7718ac7 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-838771110", "id": 968138765, "os-flavor-access:is_public": "True"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:16.987839 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:16.987839 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:16.998657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e9b5cb8f-3bd6-44ca-84de-c07d3b1afd7e req-6a9272ae-3f66-4ef0-aed6-d59baa8e7531 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:16.999645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e9b5cb8f-3bd6-44ca-84de-c07d3b1afd7e req-6a9272ae-3f66-4ef0-aed6-d59baa8e7531 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:17.014693 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-e9b5cb8f-3bd6-44ca-84de-c07d3b1afd7e req-6a9272ae-3f66-4ef0-aed6-d59baa8e7531 service nova] Creating event network-changed:b50148da-7bff-4e1e-9ed5-bfed58c0e2bf for instance d9618ff2-a2cc-41d5-9d2f-1fd0c63658df on nch1-master-1 Jan 22 21:02:17.021956 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-e9b5cb8f-3bd6-44ca-84de-c07d3b1afd7e req-6a9272ae-3f66-4ef0-aed6-d59baa8e7531 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051558 Jan 22 21:02:17.023180 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 345/727] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:17.074684 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-27cfce18-abe5-45cd-ba0a-1b8cb7718ac7 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.092224 Jan 22 21:02:17.075488 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 383/728] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:02:16 2022] POST /compute/v2.1/flavors => generated 436 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:17.088561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8a954b2b-e39f-44a9-aba8-1f91c6c95db1 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:17.089404 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:17.089404 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:17.108275 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-8a954b2b-e39f-44a9-aba8-1f91c6c95db1 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] HTTP exception thrown: Access list not available for public flavors. Jan 22 21:02:17.109197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8a954b2b-e39f-44a9-aba8-1f91c6c95db1 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:17.112031 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8a954b2b-e39f-44a9-aba8-1f91c6c95db1 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/968138765/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.027975 Jan 22 21:02:17.116414 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 346/729] 10.222.0.100 () {58 vars in 1210 bytes} [Sat Jan 22 21:02:17 2022] GET /compute/v2.1/flavors/968138765/os-flavor-access => generated 91 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:02:17.133245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f878c4e6-70c8-4332-8d81-29c37dcb55d2 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:17.135400 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:17.135400 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:17.237681 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f878c4e6-70c8-4332-8d81-29c37dcb55d2 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/968138765" status: 202 len: 0 microversion: 2.1 time: 0.111827 Jan 22 21:02:17.239495 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 384/730] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 21:02:17 2022] DELETE /compute/v2.1/flavors/968138765 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:17.248574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9e0e3a6e-d6ee-4f24-8c09-21282452dd8f tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:17.294563 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9e0e3a6e-d6ee-4f24-8c09-21282452dd8f tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5843 microversion: 2.1 time: 0.049605 Jan 22 21:02:17.295501 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 347/731] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:02:17 2022] GET /compute/v2.1/flavors/detail => generated 5843 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:17.312436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-717ea21b-ccdb-45a3-aee4-daadf8c7b7b4 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-636915976", "id": 1607185677, "os-flavor-access:is_public": "False"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:17.421435 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-717ea21b-ccdb-45a3-aee4-daadf8c7b7b4 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 440 microversion: 2.1 time: 0.113713 Jan 22 21:02:17.422591 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 385/732] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:02:17 2022] POST /compute/v2.1/flavors => generated 440 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:02:17.672922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-18ecd24c-28ac-4fe8-8ffc-6dd3f116a4be tempest-FlavorsAccessNegativeTestJSON-1806435624 tempest-FlavorsAccessNegativeTestJSON-1806435624-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6885b20994554e0ab5a69765b9fc5009"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:17.678670 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:17.678670 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:17.684247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-18ecd24c-28ac-4fe8-8ffc-6dd3f116a4be tempest-FlavorsAccessNegativeTestJSON-1806435624 tempest-FlavorsAccessNegativeTestJSON-1806435624-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '96956e9fa9bb45ff87f78921937bca00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6885b20994554e0ab5a69765b9fc5009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:17.686600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-18ecd24c-28ac-4fe8-8ffc-6dd3f116a4be tempest-FlavorsAccessNegativeTestJSON-1806435624 tempest-FlavorsAccessNegativeTestJSON-1806435624-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:17.687639 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-18ecd24c-28ac-4fe8-8ffc-6dd3f116a4be tempest-FlavorsAccessNegativeTestJSON-1806435624 tempest-FlavorsAccessNegativeTestJSON-1806435624-project] 10.222.0.100 "POST /compute/v2.1/flavors/1607185677/action" status: 403 len: 130 microversion: 2.1 time: 0.257272 Jan 22 21:02:17.690797 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 348/733] 10.222.0.100 () {60 vars in 1204 bytes} [Sat Jan 22 21:02:17 2022] POST /compute/v2.1/flavors/1607185677/action => generated 130 bytes in 262 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:17.701912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bfd7b9bb-63fa-4201-aed1-183eecfc239d tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:17.814804 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bfd7b9bb-63fa-4201-aed1-183eecfc239d tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/1607185677" status: 202 len: 0 microversion: 2.1 time: 0.118334 Jan 22 21:02:17.815702 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 386/734] 10.222.0.100 () {58 vars in 1165 bytes} [Sat Jan 22 21:02:17 2022] DELETE /compute/v2.1/flavors/1607185677 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:17.826026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c2e9620a-f801-447d-844c-96a9f83fefd0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:17.832713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c2e9620a-f801-447d-844c-96a9f83fefd0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:17.832949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c7c6d580-2529-48c5-9d21-f32f225e14fa tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:17.853142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2e9620a-f801-447d-844c-96a9f83fefd0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:17.853621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2e9620a-f801-447d-844c-96a9f83fefd0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:17.854442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2e9620a-f801-447d-844c-96a9f83fefd0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:17.854891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2e9620a-f801-447d-844c-96a9f83fefd0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:17.878550 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c7c6d580-2529-48c5-9d21-f32f225e14fa tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5843 microversion: 2.1 time: 0.056147 Jan 22 21:02:17.880674 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 349/735] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:02:17 2022] GET /compute/v2.1/flavors/detail => generated 5843 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:17.887870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2c5692e9-1689-40aa-8bc4-fd962301fe0f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:17.888700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2c5692e9-1689-40aa-8bc4-fd962301fe0f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:17.911786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c5692e9-1689-40aa-8bc4-fd962301fe0f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:17.912237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c5692e9-1689-40aa-8bc4-fd962301fe0f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:17.913046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c5692e9-1689-40aa-8bc4-fd962301fe0f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:17.922405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c5692e9-1689-40aa-8bc4-fd962301fe0f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:18.045533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2c5692e9-1689-40aa-8bc4-fd962301fe0f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:18.065968 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2c5692e9-1689-40aa-8bc4-fd962301fe0f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1219 microversion: 2.1 time: 0.183026 Jan 22 21:02:18.069180 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 350/736] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:17 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1219 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:18.090391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-41bcc5cf-1cb1-4cd9-a5c9-025218c843c0 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-328066924", "id": 918977638, "os-flavor-access:is_public": "False"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:18.095726 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:18.095726 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:18.222037 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-41bcc5cf-1cb1-4cd9-a5c9-025218c843c0 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.151576 Jan 22 21:02:18.226877 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 351/737] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:02:18 2022] POST /compute/v2.1/flavors => generated 437 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:18.248183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dba91c8c-8224-49cb-9669-ea5899afb641 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:18.250598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dba91c8c-8224-49cb-9669-ea5899afb641 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:18.293388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dba91c8c-8224-49cb-9669-ea5899afb641 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:18.297309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dba91c8c-8224-49cb-9669-ea5899afb641 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:18.299228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dba91c8c-8224-49cb-9669-ea5899afb641 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:18.317518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dba91c8c-8224-49cb-9669-ea5899afb641 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:18.526679 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dba91c8c-8224-49cb-9669-ea5899afb641 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 24566 microversion: 2.1 time: 0.298224 Jan 22 21:02:18.528235 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 352/738] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:18 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 24566 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:18.539008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f053d9e8-823d-43ac-8843-5557fbee3205 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed6382af0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:18.659259 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f053d9e8-823d-43ac-8843-5557fbee3205 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.129409 Jan 22 21:02:18.665171 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 353/739] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:18 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:18.667165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e5ae48eb-a1ea-4d8b-9391-9a8568294f82 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6885b20994554e0ab5a69765b9fc5009"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:18.669889 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:18.669889 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:18.866983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c2e9620a-f801-447d-844c-96a9f83fefd0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:18.875682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c2e9620a-f801-447d-844c-96a9f83fefd0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:18.878100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c2e9620a-f801-447d-844c-96a9f83fefd0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:18.879649 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c2e9620a-f801-447d-844c-96a9f83fefd0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1571 microversion: 2.25 time: 1.057939 Jan 22 21:02:18.880716 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 387/740] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:17 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1571 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:19.082802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e41ad4df-085d-4f51-aee2-f4f7c42ed2ec tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:19.083413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e41ad4df-085d-4f51-aee2-f4f7c42ed2ec tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:19.090347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e41ad4df-085d-4f51-aee2-f4f7c42ed2ec tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:19.090803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e41ad4df-085d-4f51-aee2-f4f7c42ed2ec tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:19.091591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e41ad4df-085d-4f51-aee2-f4f7c42ed2ec tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:19.092035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e41ad4df-085d-4f51-aee2-f4f7c42ed2ec tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:19.191370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e41ad4df-085d-4f51-aee2-f4f7c42ed2ec tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:19.198656 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e41ad4df-085d-4f51-aee2-f4f7c42ed2ec tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1267 microversion: 2.1 time: 0.119858 Jan 22 21:02:19.199230 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 388/741] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:19 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1267 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:02:19.216939 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e5ae48eb-a1ea-4d8b-9391-9a8568294f82 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors/918977638/action" status: 200 len: 96 microversion: 2.1 time: 0.555186 Jan 22 21:02:19.217884 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 354/742] 10.222.0.100 () {60 vars in 1201 bytes} [Sat Jan 22 21:02:18 2022] POST /compute/v2.1/flavors/918977638/action => generated 96 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:02:19.234667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d79b9c13-2a89-4e41-b6a7-21bd61daa34b tempest-FlavorsAccessNegativeTestJSON-1806435624 tempest-FlavorsAccessNegativeTestJSON-1806435624-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6885b20994554e0ab5a69765b9fc5009"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:19.240337 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:19.240337 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:19.240337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d79b9c13-2a89-4e41-b6a7-21bd61daa34b tempest-FlavorsAccessNegativeTestJSON-1806435624 tempest-FlavorsAccessNegativeTestJSON-1806435624-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '96956e9fa9bb45ff87f78921937bca00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6885b20994554e0ab5a69765b9fc5009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:19.240337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d79b9c13-2a89-4e41-b6a7-21bd61daa34b tempest-FlavorsAccessNegativeTestJSON-1806435624 tempest-FlavorsAccessNegativeTestJSON-1806435624-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:19.240337 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d79b9c13-2a89-4e41-b6a7-21bd61daa34b tempest-FlavorsAccessNegativeTestJSON-1806435624 tempest-FlavorsAccessNegativeTestJSON-1806435624-project] 10.222.0.100 "POST /compute/v2.1/flavors/918977638/action" status: 403 len: 133 microversion: 2.1 time: 0.008519 Jan 22 21:02:19.242640 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 389/743] 10.222.0.100 () {60 vars in 1201 bytes} [Sat Jan 22 21:02:19 2022] POST /compute/v2.1/flavors/918977638/action => generated 133 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:19.247560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b08bd958-a8f5-4234-9155-8a310d5dc81c tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6885b20994554e0ab5a69765b9fc5009"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:19.248835 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:19.248835 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:19.634365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1412762302", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "f2f664c9-4305-4e89-83dd-d4a09e707645"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:19.709538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] validate_networks() for [('f2f664c9-4305-4e89-83dd-d4a09e707645', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:02:19.749646 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b08bd958-a8f5-4234-9155-8a310d5dc81c tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors/918977638/action" status: 200 len: 21 microversion: 2.1 time: 0.505705 Jan 22 21:02:19.778452 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 355/744] 10.222.0.100 () {60 vars in 1201 bytes} [Sat Jan 22 21:02:19 2022] POST /compute/v2.1/flavors/918977638/action => generated 21 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:02:19.801193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6138aa3e-9749-4559-a1fd-d10d43cfad44 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:19.808939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6138aa3e-9749-4559-a1fd-d10d43cfad44 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:19.827580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6138aa3e-9749-4559-a1fd-d10d43cfad44 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:19.828434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6138aa3e-9749-4559-a1fd-d10d43cfad44 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:19.830923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6138aa3e-9749-4559-a1fd-d10d43cfad44 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:19.834458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6138aa3e-9749-4559-a1fd-d10d43cfad44 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:19.914184 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6138aa3e-9749-4559-a1fd-d10d43cfad44 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 24566 microversion: 2.1 time: 0.133471 Jan 22 21:02:19.917654 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 356/745] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:19 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 24566 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:19.927780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3c7ffbdf-c6c6-4085-a08c-74f96efeab67 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed602cc10>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:19.995095 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3c7ffbdf-c6c6-4085-a08c-74f96efeab67 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1419 microversion: 2.1 time: 0.074251 Jan 22 21:02:19.996049 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 357/746] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:19 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1419 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:20.006016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bcf2442e-a112-495f-ba78-ee6c7324198f tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:20.007212 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:20.007212 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:20.112355 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bcf2442e-a112-495f-ba78-ee6c7324198f tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/918977638" status: 202 len: 0 microversion: 2.1 time: 0.109794 Jan 22 21:02:20.116698 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 358/747] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 21:02:19 2022] DELETE /compute/v2.1/flavors/918977638 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:20.123099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-763faa2c-e249-40af-be65-88a3703c43c1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:20.123918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-763faa2c-e249-40af-be65-88a3703c43c1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:20.132848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-763faa2c-e249-40af-be65-88a3703c43c1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:20.135253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-763faa2c-e249-40af-be65-88a3703c43c1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:20.135253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-763faa2c-e249-40af-be65-88a3703c43c1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:20.135667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-763faa2c-e249-40af-be65-88a3703c43c1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:20.298745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-763faa2c-e249-40af-be65-88a3703c43c1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:20.311412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-763faa2c-e249-40af-be65-88a3703c43c1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:20.315116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-763faa2c-e249-40af-be65-88a3703c43c1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:20.315116 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-763faa2c-e249-40af-be65-88a3703c43c1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1546 microversion: 2.25 time: 0.199733 Jan 22 21:02:20.315546 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 359/748] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:20 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1546 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:20.331361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-268a2163-4edb-4fcd-baf8-52c08308ae1d tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:20.354131 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-268a2163-4edb-4fcd-baf8-52c08308ae1d tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5843 microversion: 2.1 time: 0.037431 Jan 22 21:02:20.354936 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 360/749] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:02:20 2022] GET /compute/v2.1/flavors/detail => generated 5843 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:20.361072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-83ea4c9a-9e13-4234-8054-c7b656a48403 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:20.361957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-83ea4c9a-9e13-4234-8054-c7b656a48403 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:20.376640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83ea4c9a-9e13-4234-8054-c7b656a48403 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:20.378501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83ea4c9a-9e13-4234-8054-c7b656a48403 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:20.378994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83ea4c9a-9e13-4234-8054-c7b656a48403 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:20.379463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83ea4c9a-9e13-4234-8054-c7b656a48403 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:20.469229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-83ea4c9a-9e13-4234-8054-c7b656a48403 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:20.479297 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-83ea4c9a-9e13-4234-8054-c7b656a48403 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1273 microversion: 2.1 time: 0.123360 Jan 22 21:02:20.480217 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 361/750] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:20 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:20.484617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a7c641b1-d1d8-4af0-9ada-a2cb5a56f7d9 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '.version_select at 0x7f1ed6167700>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:20.492114 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:20.492114 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:20.495885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7c641b1-d1d8-4af0-9ada-a2cb5a56f7d9 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:20.496831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7c641b1-d1d8-4af0-9ada-a2cb5a56f7d9 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:20.518402 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a7c641b1-d1d8-4af0-9ada-a2cb5a56f7d9 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/os-migrations" status: 200 len: 1687 microversion: 2.25 time: 0.036874 Jan 22 21:02:20.519418 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 362/751] 10.222.0.100 () {60 vars in 1188 bytes} [Sat Jan 22 21:02:20 2022] GET /compute/v2.1/os-migrations => generated 1687 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:20.526401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-711f362e-bf65-4d72-b786-a11de4060203 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-20949870", "id": 1554699877, "os-flavor-access:is_public": "False"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:20.528988 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:20.528988 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:20.622714 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-711f362e-bf65-4d72-b786-a11de4060203 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.102213 Jan 22 21:02:20.623488 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 363/752] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:02:20 2022] POST /compute/v2.1/flavors => generated 439 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:20.628062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-379794f1-3ed6-4100-bc1b-a9142263ff50 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:20.628568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-379794f1-3ed6-4100-bc1b-a9142263ff50 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:20.634632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-379794f1-3ed6-4100-bc1b-a9142263ff50 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:20.635068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-379794f1-3ed6-4100-bc1b-a9142263ff50 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:20.635851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-379794f1-3ed6-4100-bc1b-a9142263ff50 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:20.636289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-379794f1-3ed6-4100-bc1b-a9142263ff50 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:20.668583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-379794f1-3ed6-4100-bc1b-a9142263ff50 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:02:20.700334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:02:20.700759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:02:20.701235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:02:20.701692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:02:20.702964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:02:20.717450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:20.718259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:20.719348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:20.720270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:20.745678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Getting quotas for project 0ac10456f0ea4fd5b1d2948b4856ca84. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:20.750335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Getting quotas for user 4847dd82943e4bbfb54cdd49aed12b7b and project 0ac10456f0ea4fd5b1d2948b4856ca84. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:20.763407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:02:20.765980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:02:20.888742 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eff85084-3e2a-4b16-93fe-035fdae4b97e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.360009 Jan 22 21:02:20.889748 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 390/753] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:02:19 2022] POST /compute/v2.1/servers => generated 382 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:02:20.894766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2c2d8d64-a474-45b0-9657-a6cf51b828c2 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:20.895380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2c2d8d64-a474-45b0-9657-a6cf51b828c2 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:20.910768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c2d8d64-a474-45b0-9657-a6cf51b828c2 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:20.911224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c2d8d64-a474-45b0-9657-a6cf51b828c2 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:20.912491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c2d8d64-a474-45b0-9657-a6cf51b828c2 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:20.913263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c2d8d64-a474-45b0-9657-a6cf51b828c2 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:21.042687 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-379794f1-3ed6-4100-bc1b-a9142263ff50 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8" status: 204 len: 0 microversion: 2.1 time: 0.417972 Jan 22 21:02:21.046368 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 364/754] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:02:20 2022] DELETE /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:02:21.049967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7b857f8c-1a3a-41f9-92fb-d3773db8a134 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "892c6f0b06984577a28dd252164f4381"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:21.052147 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:21.052147 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:21.336558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-2c2d8d64-a474-45b0-9657-a6cf51b828c2 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'services' on Instance uuid d9618ff2-a2cc-41d5-9d2f-1fd0c63658df {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:02:21.350005 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2c2d8d64-a474-45b0-9657-a6cf51b828c2 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 2038 microversion: 2.25 time: 0.458912 Jan 22 21:02:21.350583 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 391/755] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:20 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 2038 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:21.375388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1a2d882f-61a4-43ce-a994-219a806a25e4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:21.376663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1a2d882f-61a4-43ce-a994-219a806a25e4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:21.433328 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-7b857f8c-1a3a-41f9-92fb-d3773db8a134 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] HTTP exception thrown: Flavor access not found for 38 / 892c6f0b06984577a28dd252164f4381 combination. Jan 22 21:02:21.434104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7b857f8c-1a3a-41f9-92fb-d3773db8a134 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Returning 404 to user: Flavor access not found for 38 / 892c6f0b06984577a28dd252164f4381 combination. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:21.434843 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7b857f8c-1a3a-41f9-92fb-d3773db8a134 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors/1554699877/action" status: 404 len: 124 microversion: 2.1 time: 0.390475 Jan 22 21:02:21.436180 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 365/756] 10.222.0.100 () {60 vars in 1204 bytes} [Sat Jan 22 21:02:21 2022] POST /compute/v2.1/flavors/1554699877/action => generated 124 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:21.442501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8383039a-50ec-4f73-ba97-bdeb0d1a345c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:21.443582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8383039a-50ec-4f73-ba97-bdeb0d1a345c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:21.449805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8383039a-50ec-4f73-ba97-bdeb0d1a345c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:21.450267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8383039a-50ec-4f73-ba97-bdeb0d1a345c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:21.451080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8383039a-50ec-4f73-ba97-bdeb0d1a345c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:21.452039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8383039a-50ec-4f73-ba97-bdeb0d1a345c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:21.485215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1a2d882f-61a4-43ce-a994-219a806a25e4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:21.495291 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1a2d882f-61a4-43ce-a994-219a806a25e4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1222 microversion: 2.1 time: 0.143189 Jan 22 21:02:21.496429 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 392/757] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:21 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1222 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:21.501928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d9b21ec8-6c0f-4497-929b-eace099acd10 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5eb6a60>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:21.513297 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8383039a-50ec-4f73-ba97-bdeb0d1a345c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 24566 microversion: 2.1 time: 0.075872 Jan 22 21:02:21.520901 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 366/758] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:21 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 24566 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:21.528932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ee597a50-c9b1-45d5-a597-f5b6db03987b tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:21.529983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ee597a50-c9b1-45d5-a597-f5b6db03987b tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:21.546056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee597a50-c9b1-45d5-a597-f5b6db03987b tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:21.546448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee597a50-c9b1-45d5-a597-f5b6db03987b tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:21.547269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee597a50-c9b1-45d5-a597-f5b6db03987b tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:21.547960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee597a50-c9b1-45d5-a597-f5b6db03987b tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:21.567319 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d9b21ec8-6c0f-4497-929b-eace099acd10 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1428 microversion: 2.1 time: 0.069040 Jan 22 21:02:21.567890 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 393/759] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:21 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1428 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:21.594949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-39dc6fb0-609c-4c4f-be24-863ea0c209e6 req-9ed96e88-5bad-405b-bcc6-7898c1491bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9618ff2-a2cc-41d5-9d2f-1fd0c63658df", "tag": "b50148da-7bff-4e1e-9ed5-bfed58c0e2bf"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:21.600872 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:21.600872 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:21.614055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-39dc6fb0-609c-4c4f-be24-863ea0c209e6 req-9ed96e88-5bad-405b-bcc6-7898c1491bf1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:21.614521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-39dc6fb0-609c-4c4f-be24-863ea0c209e6 req-9ed96e88-5bad-405b-bcc6-7898c1491bf1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:21.629892 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-39dc6fb0-609c-4c4f-be24-863ea0c209e6 req-9ed96e88-5bad-405b-bcc6-7898c1491bf1 service nova] Creating event network-changed:b50148da-7bff-4e1e-9ed5-bfed58c0e2bf for instance d9618ff2-a2cc-41d5-9d2f-1fd0c63658df on nch1-master-1 Jan 22 21:02:21.635042 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-39dc6fb0-609c-4c4f-be24-863ea0c209e6 req-9ed96e88-5bad-405b-bcc6-7898c1491bf1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053132 Jan 22 21:02:21.635960 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 394/760] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:21.780842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ee597a50-c9b1-45d5-a597-f5b6db03987b tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05643e88435d482fb3ed96d0a7f15208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe12a63826247c889a1700eba378728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:21.790592 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ee597a50-c9b1-45d5-a597-f5b6db03987b tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8" status: 200 len: 1517 microversion: 2.1 time: 0.268119 Jan 22 21:02:21.791162 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 367/761] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:21 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8 => generated 1517 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:21.796577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-afb37e0f-99d5-4bd7-8571-97303f4f2175 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:21.797692 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:21.797692 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:21.798897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-925c9fc9-9d12-4d9f-abdd-07f8e76667be tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Action: 'create', calling method: .version_select at 0x7f1ed5ec1550>, body: {"keypair": {"name": "tempest-keypair-1458738764"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:21.814884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-925c9fc9-9d12-4d9f-abdd-07f8e76667be tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:21.823933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-925c9fc9-9d12-4d9f-abdd-07f8e76667be tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for user b78c81d71d59434ab574e62cf58beedc and project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:21.917217 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-afb37e0f-99d5-4bd7-8571-97303f4f2175 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/1554699877" status: 202 len: 0 microversion: 2.1 time: 0.124580 Jan 22 21:02:21.918330 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 368/762] 10.222.0.100 () {58 vars in 1165 bytes} [Sat Jan 22 21:02:21 2022] DELETE /compute/v2.1/flavors/1554699877 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:21.925776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-113513313", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "129e825a-cd9c-4303-b118-ba3cd4ee673c"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:21.985848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] validate_networks() for [('129e825a-cd9c-4303-b118-ba3cd4ee673c', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:02:22.078218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-925c9fc9-9d12-4d9f-abdd-07f8e76667be tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:22.083563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-925c9fc9-9d12-4d9f-abdd-07f8e76667be tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for user b78c81d71d59434ab574e62cf58beedc and project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:22.099396 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-925c9fc9-9d12-4d9f-abdd-07f8e76667be tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.461947 Jan 22 21:02:22.100011 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 395/763] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:02:21 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:22.106275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-260c993c-18c3-4f40-bdcc-43f7c6215fc1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:22.107215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-260c993c-18c3-4f40-bdcc-43f7c6215fc1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:22.114300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-260c993c-18c3-4f40-bdcc-43f7c6215fc1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:22.117526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-260c993c-18c3-4f40-bdcc-43f7c6215fc1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:22.117526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-260c993c-18c3-4f40-bdcc-43f7c6215fc1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:22.117526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-260c993c-18c3-4f40-bdcc-43f7c6215fc1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:22.381068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:02:22.381744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:02:22.382724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:02:22.383153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:02:22.383609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:02:22.397027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:22.398475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:22.398475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:22.398872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:22.417752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Getting quotas for project 4aa958f703204cbca5fd08472e45909f. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:22.422241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Getting quotas for user c8fa58b4de634969ba8dcaf054e0b8b8 and project 4aa958f703204cbca5fd08472e45909f. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:22.434773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:02:22.437227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:02:22.530177 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8150d111-1cf8-419a-b0fd-6ae8d1993185 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.25 time: 0.610571 Jan 22 21:02:22.531014 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 369/764] 10.222.0.100 () {62 vars in 1192 bytes} [Sat Jan 22 21:02:21 2022] POST /compute/v2.1/servers => generated 382 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 22 21:02:22.535988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bf84aa05-67a2-4502-adb1-0fa83f98ee72 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed608f5e0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:22.605386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-260c993c-18c3-4f40-bdcc-43f7c6215fc1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:22.607995 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bf84aa05-67a2-4502-adb1-0fa83f98ee72 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 200 len: 1428 microversion: 2.1 time: 0.076051 Jan 22 21:02:22.609425 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 370/765] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:02:22 2022] GET /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 1428 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:22.613171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17f61125-8c1b-4964-a594-07f2280d0d98 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:22.619880 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-260c993c-18c3-4f40-bdcc-43f7c6215fc1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1315 microversion: 2.1 time: 0.518335 Jan 22 21:02:22.620466 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 396/766] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:22 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:22.624791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e03c852f-ec84-4236-a06d-afb5de0056f3 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Calling method '.version_select at 0x7f1ed5ec1dc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:22.633971 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e03c852f-ec84-4236-a06d-afb5de0056f3 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] 10.222.0.100 "GET /compute/v2.1/os-keypairs/tempest-keypair-1458738764" status: 200 len: 691 microversion: 2.1 time: 0.012355 Jan 22 21:02:22.639873 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 397/767] 10.222.0.100 () {58 vars in 1222 bytes} [Sat Jan 22 21:02:22 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1458738764 => generated 691 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:22.646073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9d0b64ae-624b-4576-a098-3b5ad86ae09a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:22.646692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9d0b64ae-624b-4576-a098-3b5ad86ae09a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:22.652816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d0b64ae-624b-4576-a098-3b5ad86ae09a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:22.657900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d0b64ae-624b-4576-a098-3b5ad86ae09a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:22.657900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d0b64ae-624b-4576-a098-3b5ad86ae09a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:22.657900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d0b64ae-624b-4576-a098-3b5ad86ae09a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:22.670914 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17f61125-8c1b-4964-a594-07f2280d0d98 tempest-FlavorsAccessNegativeTestJSON-2018518705 tempest-FlavorsAccessNegativeTestJSON-2018518705-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5843 microversion: 2.1 time: 0.061105 Jan 22 21:02:22.682917 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 371/768] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:02:22 2022] GET /compute/v2.1/flavors/detail => generated 5843 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:22.695643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f7754f4b-ad03-48d4-ae69-a92d87949c50 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:22.696697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f7754f4b-ad03-48d4-ae69-a92d87949c50 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:22.703385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7754f4b-ad03-48d4-ae69-a92d87949c50 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:22.703839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7754f4b-ad03-48d4-ae69-a92d87949c50 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:22.705308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7754f4b-ad03-48d4-ae69-a92d87949c50 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:22.705961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7754f4b-ad03-48d4-ae69-a92d87949c50 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:22.778116 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f7754f4b-ad03-48d4-ae69-a92d87949c50 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 24566 microversion: 2.1 time: 0.093582 Jan 22 21:02:22.779195 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 372/769] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:22 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 24566 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:22.786845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cd6999c9-a5f5-4c95-babd-dd2f094efc51 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:22.788838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cd6999c9-a5f5-4c95-babd-dd2f094efc51 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:22.798406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9d0b64ae-624b-4576-a098-3b5ad86ae09a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:22.807233 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9d0b64ae-624b-4576-a098-3b5ad86ae09a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1218 microversion: 2.1 time: 0.166001 Jan 22 21:02:22.811016 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 398/770] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:22 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1218 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:22.825906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9981aaa3-8688-46e2-89d2-994df3768c63 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5f01670>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:22.885616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cd6999c9-a5f5-4c95-babd-dd2f094efc51 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:22.898491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cd6999c9-a5f5-4c95-babd-dd2f094efc51 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:22.900088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cd6999c9-a5f5-4c95-babd-dd2f094efc51 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:22.901168 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cd6999c9-a5f5-4c95-babd-dd2f094efc51 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1265 microversion: 2.25 time: 0.120622 Jan 22 21:02:22.903493 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 373/771] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:22 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1265 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:22.918684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c7eb11bd-3761-453c-a95d-497b9ead57f9 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Calling method '.version_select at 0x7f1ed608f9d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:23.067269 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c7eb11bd-3761-453c-a95d-497b9ead57f9 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458738764" status: 202 len: 0 microversion: 2.1 time: 0.162691 Jan 22 21:02:23.067964 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 374/772] 10.222.0.100 () {58 vars in 1225 bytes} [Sat Jan 22 21:02:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458738764 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:23.078573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a46b3fc7-bd3a-4888-a72b-572c22450ed5 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:23.079907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a46b3fc7-bd3a-4888-a72b-572c22450ed5 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:23.088582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a46b3fc7-bd3a-4888-a72b-572c22450ed5 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:23.089072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a46b3fc7-bd3a-4888-a72b-572c22450ed5 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:23.090041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a46b3fc7-bd3a-4888-a72b-572c22450ed5 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:23.090495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a46b3fc7-bd3a-4888-a72b-572c22450ed5 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:23.285271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a46b3fc7-bd3a-4888-a72b-572c22450ed5 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05643e88435d482fb3ed96d0a7f15208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe12a63826247c889a1700eba378728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:23.294529 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a46b3fc7-bd3a-4888-a72b-572c22450ed5 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8" status: 200 len: 1517 microversion: 2.1 time: 0.219700 Jan 22 21:02:23.296261 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 375/773] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:23 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8 => generated 1517 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:23.305706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6ec93dbc-39ac-4dd8-91d5-8a7d8836d454 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Action: 'create', calling method: .version_select at 0x7f1ed608f940>, body: {"keypair": {"name": "tempest-keypair-673513687"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:23.321480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-6ec93dbc-39ac-4dd8-91d5-8a7d8836d454 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:23.334380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-6ec93dbc-39ac-4dd8-91d5-8a7d8836d454 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for user b78c81d71d59434ab574e62cf58beedc and project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:23.633243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-6ec93dbc-39ac-4dd8-91d5-8a7d8836d454 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:23.638296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-6ec93dbc-39ac-4dd8-91d5-8a7d8836d454 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for user b78c81d71d59434ab574e62cf58beedc and project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:23.653843 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6ec93dbc-39ac-4dd8-91d5-8a7d8836d454 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.356019 Jan 22 21:02:23.655117 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 376/774] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:02:23 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:23.660436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f7b05285-1e53-4bac-b460-4cd1c95ef709 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:23.661108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f7b05285-1e53-4bac-b460-4cd1c95ef709 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:23.684947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7b05285-1e53-4bac-b460-4cd1c95ef709 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:23.685465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7b05285-1e53-4bac-b460-4cd1c95ef709 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:23.686332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7b05285-1e53-4bac-b460-4cd1c95ef709 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:23.686778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7b05285-1e53-4bac-b460-4cd1c95ef709 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:23.916888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f7b05285-1e53-4bac-b460-4cd1c95ef709 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:23.925536 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f7b05285-1e53-4bac-b460-4cd1c95ef709 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1315 microversion: 2.1 time: 0.269030 Jan 22 21:02:23.926826 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 377/775] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:23 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:23.931577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-88aad152-54d0-4ecf-a49f-70935bdc4ec7 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Calling method '.version_select at 0x7f1ed63c85e0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:24.020810 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-88aad152-54d0-4ecf-a49f-70935bdc4ec7 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-673513687" status: 202 len: 0 microversion: 2.1 time: 0.092763 Jan 22 21:02:24.021433 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 378/776] 10.222.0.100 () {58 vars in 1222 bytes} [Sat Jan 22 21:02:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-673513687 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:24.026760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-69abda54-2ee7-4872-9604-0bb91c900fbe req-11e8d488-2d90-4abe-9122-30c943176485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "184726b1-102f-49b3-ae81-7b721c165473", "tag": "a28676ad-ae18-4da0-ba64-c6c2ec99218f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:24.030934 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:24.030934 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:24.036922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-69abda54-2ee7-4872-9604-0bb91c900fbe req-11e8d488-2d90-4abe-9122-30c943176485 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:24.037369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-69abda54-2ee7-4872-9604-0bb91c900fbe req-11e8d488-2d90-4abe-9122-30c943176485 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:24.049079 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-69abda54-2ee7-4872-9604-0bb91c900fbe req-11e8d488-2d90-4abe-9122-30c943176485 service nova] Creating event network-changed:a28676ad-ae18-4da0-ba64-c6c2ec99218f for instance 184726b1-102f-49b3-ae81-7b721c165473 on nch2-master-1 Jan 22 21:02:24.058146 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-69abda54-2ee7-4872-9604-0bb91c900fbe req-11e8d488-2d90-4abe-9122-30c943176485 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034863 Jan 22 21:02:24.063305 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 379/777] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:24.067256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b09c0cd9-e6e9-4ac5-9be5-34e7eb8607cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:24.068772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b09c0cd9-e6e9-4ac5-9be5-34e7eb8607cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:24.076242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b09c0cd9-e6e9-4ac5-9be5-34e7eb8607cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:24.076995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b09c0cd9-e6e9-4ac5-9be5-34e7eb8607cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:24.077837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b09c0cd9-e6e9-4ac5-9be5-34e7eb8607cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:24.078293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b09c0cd9-e6e9-4ac5-9be5-34e7eb8607cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:24.122965 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b09c0cd9-e6e9-4ac5-9be5-34e7eb8607cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 24566 microversion: 2.1 time: 0.062366 Jan 22 21:02:24.124333 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 380/778] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:24 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 24566 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:24.131540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-032a17ea-0057-449d-8f83-00c65c59ce05 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:24.132530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-032a17ea-0057-449d-8f83-00c65c59ce05 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:24.140346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-032a17ea-0057-449d-8f83-00c65c59ce05 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:24.140962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-032a17ea-0057-449d-8f83-00c65c59ce05 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:24.142590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-032a17ea-0057-449d-8f83-00c65c59ce05 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:24.143359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-032a17ea-0057-449d-8f83-00c65c59ce05 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:24.214538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-032a17ea-0057-449d-8f83-00c65c59ce05 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:24.224422 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-032a17ea-0057-449d-8f83-00c65c59ce05 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1280 microversion: 2.1 time: 0.098449 Jan 22 21:02:24.234363 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 381/779] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:24 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1280 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:24.239485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d7be147-fee7-4d3f-b325-039bb9938c1f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:24.240106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d7be147-fee7-4d3f-b325-039bb9938c1f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:24.246769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d7be147-fee7-4d3f-b325-039bb9938c1f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:24.247339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d7be147-fee7-4d3f-b325-039bb9938c1f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:24.248148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d7be147-fee7-4d3f-b325-039bb9938c1f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:24.248598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d7be147-fee7-4d3f-b325-039bb9938c1f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:24.329698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0d7be147-fee7-4d3f-b325-039bb9938c1f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:24.333431 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9981aaa3-8688-46e2-89d2-994df3768c63 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 204 len: 0 microversion: 2.1 time: 1.511166 Jan 22 21:02:24.334771 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 399/780] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:22 2022] DELETE /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 0 bytes in 1526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:02:24.339846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0d7be147-fee7-4d3f-b325-039bb9938c1f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:24.340385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f73f6b5f-7fbb-4c08-99f2-626081148530 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Action: 'create', calling method: .version_select at 0x7f1ed5f2fdc0>, body: {"keypair": {"name": "tempest-keypair-1206601375", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:24.341368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0d7be147-fee7-4d3f-b325-039bb9938c1f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:24.342848 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d7be147-fee7-4d3f-b325-039bb9938c1f tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1317 microversion: 2.25 time: 0.107466 Jan 22 21:02:24.353720 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 382/781] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:24 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1317 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:24.353720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8e998e94-472e-43c7-99c1-0fb27d098fe4 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:24.353720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8e998e94-472e-43c7-99c1-0fb27d098fe4 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:24.355436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-f73f6b5f-7fbb-4c08-99f2-626081148530 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:24.355869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e998e94-472e-43c7-99c1-0fb27d098fe4 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:24.356324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e998e94-472e-43c7-99c1-0fb27d098fe4 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:24.357258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e998e94-472e-43c7-99c1-0fb27d098fe4 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:24.357970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e998e94-472e-43c7-99c1-0fb27d098fe4 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:24.363959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-f73f6b5f-7fbb-4c08-99f2-626081148530 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for user b78c81d71d59434ab574e62cf58beedc and project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:24.429907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8e998e94-472e-43c7-99c1-0fb27d098fe4 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05643e88435d482fb3ed96d0a7f15208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffe12a63826247c889a1700eba378728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:24.453629 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8e998e94-472e-43c7-99c1-0fb27d098fe4 tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8" status: 200 len: 1475 microversion: 2.1 time: 0.094195 Jan 22 21:02:24.453629 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 383/782] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:24 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8 => generated 1475 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:24.453629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4ba76e5d-6680-4752-8bbf-7915028bfb05 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:24.453629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4ba76e5d-6680-4752-8bbf-7915028bfb05 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:24.458330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ba76e5d-6680-4752-8bbf-7915028bfb05 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:24.458742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ba76e5d-6680-4752-8bbf-7915028bfb05 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:24.459585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ba76e5d-6680-4752-8bbf-7915028bfb05 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:24.460028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ba76e5d-6680-4752-8bbf-7915028bfb05 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:24.461779 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f73f6b5f-7fbb-4c08-99f2-626081148530 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.125595 Jan 22 21:02:24.462383 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 400/783] 10.222.0.100 () {60 vars in 1163 bytes} [Sat Jan 22 21:02:24 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:24.479045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a38182d1-3e20-4d70-90f5-c19c2d1a9f6a tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Calling method '.version_select at 0x7f1ed5f0ce50>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:24.496260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4ba76e5d-6680-4752-8bbf-7915028bfb05 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:02:24.568576 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a38182d1-3e20-4d70-90f5-c19c2d1a9f6a tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1206601375" status: 202 len: 0 microversion: 2.1 time: 0.093288 Jan 22 21:02:24.569448 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 401/784] 10.222.0.100 () {58 vars in 1225 bytes} [Sat Jan 22 21:02:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1206601375 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:02:24.578398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff0e7949-ebbc-4427-8ff7-d17dea4b5d0c tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Action: 'create', calling method: .version_select at 0x7f1ed5ec9ca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-794258728"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:24.593861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-ff0e7949-ebbc-4427-8ff7-d17dea4b5d0c tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:24.599293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-ff0e7949-ebbc-4427-8ff7-d17dea4b5d0c tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for user b78c81d71d59434ab574e62cf58beedc and project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:24.783396 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4ba76e5d-6680-4752-8bbf-7915028bfb05 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 204 len: 0 microversion: 2.1 time: 0.341123 Jan 22 21:02:24.790946 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 384/785] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:02:24 2022] DELETE /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:02:24.925141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1445414154", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "9c00559f-de2d-48cc-a51a-3429ed0dc4c4"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:24.997819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] validate_networks() for [('9c00559f-de2d-48cc-a51a-3429ed0dc4c4', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:02:25.022151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-ff0e7949-ebbc-4427-8ff7-d17dea4b5d0c tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:25.027022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-ff0e7949-ebbc-4427-8ff7-d17dea4b5d0c tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for user b78c81d71d59434ab574e62cf58beedc and project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:25.044496 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff0e7949-ebbc-4427-8ff7-d17dea4b5d0c tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.469414 Jan 22 21:02:25.045963 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 402/786] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:02:24 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:25.052235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f6b0bab9-67f2-4dbd-8635-a20d5df8bf76 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:25.053363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f6b0bab9-67f2-4dbd-8635-a20d5df8bf76 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:25.060644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6b0bab9-67f2-4dbd-8635-a20d5df8bf76 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:25.061447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6b0bab9-67f2-4dbd-8635-a20d5df8bf76 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:25.062804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6b0bab9-67f2-4dbd-8635-a20d5df8bf76 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:25.064542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6b0bab9-67f2-4dbd-8635-a20d5df8bf76 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:25.358986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f6b0bab9-67f2-4dbd-8635-a20d5df8bf76 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:25.368106 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f6b0bab9-67f2-4dbd-8635-a20d5df8bf76 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1315 microversion: 2.1 time: 0.320560 Jan 22 21:02:25.368895 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 403/787] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:25 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:25.383206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bae8b3d2-b0a2-440f-95fa-fbe4b52e4d0c tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Action: 'create', calling method: .version_select at 0x7f1ed5f57160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1214460340"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:25.409829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-bae8b3d2-b0a2-440f-95fa-fbe4b52e4d0c tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:25.414064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-bae8b3d2-b0a2-440f-95fa-fbe4b52e4d0c tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for user b78c81d71d59434ab574e62cf58beedc and project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:25.557307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-bae8b3d2-b0a2-440f-95fa-fbe4b52e4d0c tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:25.561733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-bae8b3d2-b0a2-440f-95fa-fbe4b52e4d0c tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for user b78c81d71d59434ab574e62cf58beedc and project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:25.576963 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bae8b3d2-b0a2-440f-95fa-fbe4b52e4d0c tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 0.206867 Jan 22 21:02:25.577606 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 404/788] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:02:25 2022] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:25.583517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-408ad282-6a45-483a-9c91-6331c99a0e87 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:25.584452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-408ad282-6a45-483a-9c91-6331c99a0e87 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:25.599789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-408ad282-6a45-483a-9c91-6331c99a0e87 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:25.600485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-408ad282-6a45-483a-9c91-6331c99a0e87 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:25.601536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-408ad282-6a45-483a-9c91-6331c99a0e87 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:25.601985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-408ad282-6a45-483a-9c91-6331c99a0e87 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:25.652664 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-408ad282-6a45-483a-9c91-6331c99a0e87 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 24566 microversion: 2.1 time: 0.073625 Jan 22 21:02:25.653475 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 405/789] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:25 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 24566 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:25.659046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d0dc4920-f097-4c06-9d0a-236620c38e6e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:25.659750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d0dc4920-f097-4c06-9d0a-236620c38e6e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:25.667425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0dc4920-f097-4c06-9d0a-236620c38e6e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:25.667886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0dc4920-f097-4c06-9d0a-236620c38e6e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:25.668694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0dc4920-f097-4c06-9d0a-236620c38e6e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:25.669138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0dc4920-f097-4c06-9d0a-236620c38e6e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:25.797221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:02:25.798870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:02:25.799601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:02:25.800234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:02:25.800866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:02:25.810057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:25.810626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:25.811481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:25.811934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:25.830837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Getting quotas for project 01b1a67e790046629fe2b636fcefd01d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:25.835291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Getting quotas for user 946cce9cf6874d60912e69c1169ed379 and project 01b1a67e790046629fe2b636fcefd01d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:25.850561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:02:25.853113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:02:25.944924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d0dc4920-f097-4c06-9d0a-236620c38e6e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:25.952885 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d0dc4920-f097-4c06-9d0a-236620c38e6e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1322 microversion: 2.1 time: 0.297872 Jan 22 21:02:25.953745 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 406/790] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:25 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:25.964495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ff48b26-219a-414b-93b1-4539ea6f2402 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:25.965225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ff48b26-219a-414b-93b1-4539ea6f2402 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:25.974113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ff48b26-219a-414b-93b1-4539ea6f2402 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:25.975055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ff48b26-219a-414b-93b1-4539ea6f2402 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:25.976734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ff48b26-219a-414b-93b1-4539ea6f2402 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:25.977829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ff48b26-219a-414b-93b1-4539ea6f2402 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:25.994610 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad7ed2c7-f302-4ebe-8350-93d43a1c1166 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.074522 Jan 22 21:02:26.001006 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 385/791] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:02:24 2022] POST /compute/v2.1/servers => generated 382 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:02:26.010313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-efce72cf-80e5-4952-8152-0a8418f1714a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:26.010313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-efce72cf-80e5-4952-8152-0a8418f1714a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] [instance: 6bc1b81e-307f-4153-ae1a-a192c15f6db8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:26.014905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-efce72cf-80e5-4952-8152-0a8418f1714a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:26.015611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-efce72cf-80e5-4952-8152-0a8418f1714a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:26.016996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-efce72cf-80e5-4952-8152-0a8418f1714a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:26.017680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-efce72cf-80e5-4952-8152-0a8418f1714a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:26.032450 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-efce72cf-80e5-4952-8152-0a8418f1714a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] HTTP exception thrown: Instance 6bc1b81e-307f-4153-ae1a-a192c15f6db8 could not be found. Jan 22 21:02:26.033405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-efce72cf-80e5-4952-8152-0a8418f1714a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] Returning 404 to user: Instance 6bc1b81e-307f-4153-ae1a-a192c15f6db8 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:26.034453 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-efce72cf-80e5-4952-8152-0a8418f1714a tempest-VolumesAdminNegativeTest-602683037 tempest-VolumesAdminNegativeTest-602683037-project] 10.222.0.100 "GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8" status: 404 len: 111 microversion: 2.1 time: 0.037618 Jan 22 21:02:26.035200 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 386/792] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:25 2022] GET /compute/v2.1/servers/6bc1b81e-307f-4153-ae1a-a192c15f6db8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:26.040549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f8a6585d-52b7-4bfc-b41e-3f63ab688d92 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Action: 'create', calling method: .version_select at 0x7f1ed608f280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1638277464"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:26.060974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f8a6585d-52b7-4bfc-b41e-3f63ab688d92 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:26.067953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f8a6585d-52b7-4bfc-b41e-3f63ab688d92 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for user b78c81d71d59434ab574e62cf58beedc and project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:26.105321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8ff48b26-219a-414b-93b1-4539ea6f2402 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:26.118770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8ff48b26-219a-414b-93b1-4539ea6f2402 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:26.120412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8ff48b26-219a-414b-93b1-4539ea6f2402 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:26.121545 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ff48b26-219a-414b-93b1-4539ea6f2402 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1323 microversion: 2.25 time: 0.166088 Jan 22 21:02:26.123698 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 407/793] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:25 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1323 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:26.141025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-75266542-5e2d-415e-9fe5-15dc1a320650 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:26.141828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-75266542-5e2d-415e-9fe5-15dc1a320650 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:26.521873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f8a6585d-52b7-4bfc-b41e-3f63ab688d92 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:26.535726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f8a6585d-52b7-4bfc-b41e-3f63ab688d92 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Getting quotas for user b78c81d71d59434ab574e62cf58beedc and project 3c717e77da7346c6adcc4d472cd0ffcf. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:26.551045 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f8a6585d-52b7-4bfc-b41e-3f63ab688d92 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.514574 Jan 22 21:02:26.551993 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 387/794] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:02:26 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:26.558234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-d58293ec-a786-4334-ac9a-778f9caa14b0 req-033cd41f-cf22-4cd3-b404-95bf14ef7ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc1b81e-307f-4153-ae1a-a192c15f6db8", "name": "network-vif-deleted", "tag": "3493c6ae-bbe9-465d-8bee-47a6ee910cac"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:26.559924 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:26.559924 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:26.570417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d58293ec-a786-4334-ac9a-778f9caa14b0 req-033cd41f-cf22-4cd3-b404-95bf14ef7ece service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:26.570802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d58293ec-a786-4334-ac9a-778f9caa14b0 req-033cd41f-cf22-4cd3-b404-95bf14ef7ece service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:26.586025 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d58293ec-a786-4334-ac9a-778f9caa14b0 req-033cd41f-cf22-4cd3-b404-95bf14ef7ece service nova] Creating event network-vif-deleted:3493c6ae-bbe9-465d-8bee-47a6ee910cac for instance 6bc1b81e-307f-4153-ae1a-a192c15f6db8 on nch1-master-1 Jan 22 21:02:26.618497 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-d58293ec-a786-4334-ac9a-778f9caa14b0 req-033cd41f-cf22-4cd3-b404-95bf14ef7ece service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062989 Jan 22 21:02:26.618596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-75266542-5e2d-415e-9fe5-15dc1a320650 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:26.620694 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 388/795] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:26.626674 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-75266542-5e2d-415e-9fe5-15dc1a320650 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1212 microversion: 2.1 time: 0.503509 Jan 22 21:02:26.629668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 408/796] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:26 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1212 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:26.642771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6193de43-014e-4854-996e-70494da4ec57 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:26.643296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6193de43-014e-4854-996e-70494da4ec57 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:26.648569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-92aa744f-c562-4095-96dd-fec30228962a req-e14f76c9-e998-40d0-9a51-5f19e09e50f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59386c42-117b-4309-9c99-c977fc1cbdef", "name": "network-vif-unplugged", "status": "completed", "tag": "79c00dcb-7c5c-472a-a9f9-846204b548e1"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:26.651515 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:26.651515 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:26.667928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6193de43-014e-4854-996e-70494da4ec57 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:26.668383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6193de43-014e-4854-996e-70494da4ec57 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:26.669193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6193de43-014e-4854-996e-70494da4ec57 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:26.676676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-92aa744f-c562-4095-96dd-fec30228962a req-e14f76c9-e998-40d0-9a51-5f19e09e50f5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:26.677127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-92aa744f-c562-4095-96dd-fec30228962a req-e14f76c9-e998-40d0-9a51-5f19e09e50f5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:26.677612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6193de43-014e-4854-996e-70494da4ec57 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:26.705494 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-92aa744f-c562-4095-96dd-fec30228962a req-e14f76c9-e998-40d0-9a51-5f19e09e50f5 service nova] Creating event network-vif-unplugged:79c00dcb-7c5c-472a-a9f9-846204b548e1 for instance 59386c42-117b-4309-9c99-c977fc1cbdef on nch1-master-1 Jan 22 21:02:26.712097 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-92aa744f-c562-4095-96dd-fec30228962a req-e14f76c9-e998-40d0-9a51-5f19e09e50f5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089197 Jan 22 21:02:26.713203 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 389/797] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:26.719623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-902c56ae-bc74-4ce5-9d49-5e390a9e9e6f tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Calling method '.version_select at 0x7f1ed602ce50>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:26.724069 ncdv-master-1 devstack@n-api.service[137032]: WARNING oslo_db.sqlalchemy.utils [None req-902c56ae-bc74-4ce5-9d49-5e390a9e9e6f tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Unique keys not in sort_keys. The sorting order may be unstable. Jan 22 21:02:26.730018 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-902c56ae-bc74-4ce5-9d49-5e390a9e9e6f tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] 10.222.0.100 "GET /compute/v2.1/os-keypairs" status: 200 len: 1675 microversion: 2.1 time: 0.015121 Jan 22 21:02:26.731209 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 390/798] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:02:26 2022] GET /compute/v2.1/os-keypairs => generated 1675 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:26.744632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c6884b1e-a9e3-43ac-a5dd-4e1f58e37d45 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:26.745994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c6884b1e-a9e3-43ac-a5dd-4e1f58e37d45 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:26.756347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6884b1e-a9e3-43ac-a5dd-4e1f58e37d45 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:26.756823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6884b1e-a9e3-43ac-a5dd-4e1f58e37d45 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:26.757855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6884b1e-a9e3-43ac-a5dd-4e1f58e37d45 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:26.758314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6884b1e-a9e3-43ac-a5dd-4e1f58e37d45 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:26.826282 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c6884b1e-a9e3-43ac-a5dd-4e1f58e37d45 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 24566 microversion: 2.1 time: 0.093591 Jan 22 21:02:26.828054 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 391/799] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:26 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 24566 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:26.836458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-be2b5368-c753-4ec7-a008-a4aa044c5184 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Calling method '.version_select at 0x7f1ed60d9f70>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:26.946922 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-be2b5368-c753-4ec7-a008-a4aa044c5184 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1638277464" status: 202 len: 0 microversion: 2.1 time: 0.116696 Jan 22 21:02:26.947513 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 392/800] 10.222.0.100 () {58 vars in 1282 bytes} [Sat Jan 22 21:02:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1638277464 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:26.959297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d44d73eb-d046-4d3a-be4a-a4835e153e80 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Calling method '.version_select at 0x7f1ed5f03310>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:27.044732 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d44d73eb-d046-4d3a-be4a-a4835e153e80 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1214460340" status: 202 len: 0 microversion: 2.1 time: 0.091965 Jan 22 21:02:27.045882 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 393/801] 10.222.0.100 () {58 vars in 1282 bytes} [Sat Jan 22 21:02:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1214460340 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:02:27.055538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e0882472-bac7-4911-b1b7-f7293b82f9e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:27.055819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e0882472-bac7-4911-b1b7-f7293b82f9e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:27.074554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0882472-bac7-4911-b1b7-f7293b82f9e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:27.079133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0882472-bac7-4911-b1b7-f7293b82f9e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:27.079133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0882472-bac7-4911-b1b7-f7293b82f9e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:27.079133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0882472-bac7-4911-b1b7-f7293b82f9e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:27.093609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6193de43-014e-4854-996e-70494da4ec57 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:27.102145 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6193de43-014e-4854-996e-70494da4ec57 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1315 microversion: 2.1 time: 0.471098 Jan 22 21:02:27.103383 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 409/802] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:26 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:27.120350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7a382915-168d-402f-85be-bc4e41cf13a6 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] Calling method '.version_select at 0x7f1ed5fd5ca0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:27.257757 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7a382915-168d-402f-85be-bc4e41cf13a6 tempest-KeyPairsV2TestJSON-1512427736 tempest-KeyPairsV2TestJSON-1512427736-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-794258728" status: 202 len: 0 microversion: 2.1 time: 0.150607 Jan 22 21:02:27.264306 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 410/803] 10.222.0.100 () {58 vars in 1279 bytes} [Sat Jan 22 21:02:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-794258728 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:27.283529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cc553916-8417-4192-b589-8bcc33be5d2e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:27.285103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cc553916-8417-4192-b589-8bcc33be5d2e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:27.301660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc553916-8417-4192-b589-8bcc33be5d2e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:27.301660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc553916-8417-4192-b589-8bcc33be5d2e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:27.301660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc553916-8417-4192-b589-8bcc33be5d2e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:27.301660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc553916-8417-4192-b589-8bcc33be5d2e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:27.536699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e0882472-bac7-4911-b1b7-f7293b82f9e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:27.544223 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e0882472-bac7-4911-b1b7-f7293b82f9e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1322 microversion: 2.1 time: 0.493181 Jan 22 21:02:27.545068 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 394/804] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:27 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1322 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:27.646206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61c6aaec-3add-404a-be45-2f29edeb25ea tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:27.646830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-61c6aaec-3add-404a-be45-2f29edeb25ea tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:27.663079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cc553916-8417-4192-b589-8bcc33be5d2e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:27.665619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61c6aaec-3add-404a-be45-2f29edeb25ea tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:27.666380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61c6aaec-3add-404a-be45-2f29edeb25ea tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:27.666893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61c6aaec-3add-404a-be45-2f29edeb25ea tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:27.667348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61c6aaec-3add-404a-be45-2f29edeb25ea tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:27.677432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cc553916-8417-4192-b589-8bcc33be5d2e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:27.681278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cc553916-8417-4192-b589-8bcc33be5d2e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:27.683575 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cc553916-8417-4192-b589-8bcc33be5d2e tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1365 microversion: 2.25 time: 0.417881 Jan 22 21:02:27.684925 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 411/805] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:27 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1365 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:27.845984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d4e7d46f-de54-49aa-a13f-65773fca8e35 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:27.845984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d4e7d46f-de54-49aa-a13f-65773fca8e35 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:27.846270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-61c6aaec-3add-404a-be45-2f29edeb25ea tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:27.851557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4e7d46f-de54-49aa-a13f-65773fca8e35 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:27.852428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4e7d46f-de54-49aa-a13f-65773fca8e35 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:27.853904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4e7d46f-de54-49aa-a13f-65773fca8e35 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:27.854574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4e7d46f-de54-49aa-a13f-65773fca8e35 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:27.861059 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61c6aaec-3add-404a-be45-2f29edeb25ea tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1208 microversion: 2.1 time: 0.214971 Jan 22 21:02:27.862155 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 395/806] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:27 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1208 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:27.907052 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d4e7d46f-de54-49aa-a13f-65773fca8e35 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 24566 microversion: 2.1 time: 0.070866 Jan 22 21:02:27.912821 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 412/807] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:27 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 24566 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:28.124504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-add21b5f-f11b-41eb-ba74-3b03f65491a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:28.125608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-add21b5f-f11b-41eb-ba74-3b03f65491a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:28.138704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-add21b5f-f11b-41eb-ba74-3b03f65491a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:28.140583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-add21b5f-f11b-41eb-ba74-3b03f65491a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:28.143087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-add21b5f-f11b-41eb-ba74-3b03f65491a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:28.144007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-add21b5f-f11b-41eb-ba74-3b03f65491a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:28.562732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e877ad29-7b42-41f3-ba8f-6c13fd702cc9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:28.564929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e877ad29-7b42-41f3-ba8f-6c13fd702cc9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:28.588439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e877ad29-7b42-41f3-ba8f-6c13fd702cc9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:28.589089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e877ad29-7b42-41f3-ba8f-6c13fd702cc9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:28.590368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e877ad29-7b42-41f3-ba8f-6c13fd702cc9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:28.600731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e877ad29-7b42-41f3-ba8f-6c13fd702cc9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:28.719058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-add21b5f-f11b-41eb-ba74-3b03f65491a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:28.729957 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-add21b5f-f11b-41eb-ba74-3b03f65491a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1315 microversion: 2.1 time: 0.613015 Jan 22 21:02:28.740352 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 396/808] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:28 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:28.745598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a0156371-3dec-4ab2-a9e7-16bdd1878175 req-63c996cc-2782-43b8-b8d6-ceba4ce116af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a", "tag": "d7ac1858-6f74-484f-bbcb-8043bae94378"}, {"server_uuid": "59386c42-117b-4309-9c99-c977fc1cbdef", "name": "network-vif-deleted", "tag": "79c00dcb-7c5c-472a-a9f9-846204b548e1"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:28.747551 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:28.747551 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:28.764140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a0156371-3dec-4ab2-a9e7-16bdd1878175 req-63c996cc-2782-43b8-b8d6-ceba4ce116af service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:28.764775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a0156371-3dec-4ab2-a9e7-16bdd1878175 req-63c996cc-2782-43b8-b8d6-ceba4ce116af service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:28.795759 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a0156371-3dec-4ab2-a9e7-16bdd1878175 req-63c996cc-2782-43b8-b8d6-ceba4ce116af service nova] Creating event network-changed:d7ac1858-6f74-484f-bbcb-8043bae94378 for instance 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a on nch2-master-1 Jan 22 21:02:28.798874 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a0156371-3dec-4ab2-a9e7-16bdd1878175 req-63c996cc-2782-43b8-b8d6-ceba4ce116af service nova] Creating event network-vif-deleted:79c00dcb-7c5c-472a-a9f9-846204b548e1 for instance 59386c42-117b-4309-9c99-c977fc1cbdef on nch1-master-1 Jan 22 21:02:28.812593 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a0156371-3dec-4ab2-a9e7-16bdd1878175 req-63c996cc-2782-43b8-b8d6-ceba4ce116af service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.069594 Jan 22 21:02:28.815990 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 397/809] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:28.828140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a886e928-971b-4fba-afd8-ec86b66384c4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:28.830634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a886e928-971b-4fba-afd8-ec86b66384c4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:28.843928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a886e928-971b-4fba-afd8-ec86b66384c4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:28.844438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a886e928-971b-4fba-afd8-ec86b66384c4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:28.845252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a886e928-971b-4fba-afd8-ec86b66384c4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:28.845742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a886e928-971b-4fba-afd8-ec86b66384c4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:29.192858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a886e928-971b-4fba-afd8-ec86b66384c4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:29.204704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a886e928-971b-4fba-afd8-ec86b66384c4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:29.207484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a886e928-971b-4fba-afd8-ec86b66384c4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:29.209199 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a886e928-971b-4fba-afd8-ec86b66384c4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1365 microversion: 2.25 time: 0.389112 Jan 22 21:02:29.210407 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 398/810] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:28 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1365 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:29.225871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-ed5521dc-635d-43c8-8984-ace189e24b41 req-ae7a550f-69d8-4fee-950b-76d913fc87a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d7803b5-681b-412b-9319-8aaaa574dca7", "tag": "f8a5d460-d57a-48e0-bcf8-f5891049005c"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:29.227857 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:29.227857 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:29.239131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ed5521dc-635d-43c8-8984-ace189e24b41 req-ae7a550f-69d8-4fee-950b-76d913fc87a4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:29.239873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ed5521dc-635d-43c8-8984-ace189e24b41 req-ae7a550f-69d8-4fee-950b-76d913fc87a4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:29.267361 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-ed5521dc-635d-43c8-8984-ace189e24b41 req-ae7a550f-69d8-4fee-950b-76d913fc87a4 service nova] Creating event network-changed:f8a5d460-d57a-48e0-bcf8-f5891049005c for instance 5d7803b5-681b-412b-9319-8aaaa574dca7 on nch2-master-1 Jan 22 21:02:29.275843 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-ed5521dc-635d-43c8-8984-ace189e24b41 req-ae7a550f-69d8-4fee-950b-76d913fc87a4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063927 Jan 22 21:02:29.280310 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 399/811] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:29.288279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c2182250-709e-40a8-b1a9-0f923b309b3b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:29.295010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c2182250-709e-40a8-b1a9-0f923b309b3b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:29.310778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e877ad29-7b42-41f3-ba8f-6c13fd702cc9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:29.321554 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e877ad29-7b42-41f3-ba8f-6c13fd702cc9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1322 microversion: 2.1 time: 0.763269 Jan 22 21:02:29.322384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2182250-709e-40a8-b1a9-0f923b309b3b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:29.323788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2182250-709e-40a8-b1a9-0f923b309b3b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:29.324343 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 413/812] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:28 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1322 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:29.325431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2182250-709e-40a8-b1a9-0f923b309b3b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:29.327399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2182250-709e-40a8-b1a9-0f923b309b3b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:29.335763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f295d7c7-1774-4d18-9b86-0c4b43392806 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:29.337148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f295d7c7-1774-4d18-9b86-0c4b43392806 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:29.353410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f295d7c7-1774-4d18-9b86-0c4b43392806 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:29.357186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f295d7c7-1774-4d18-9b86-0c4b43392806 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:29.358364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f295d7c7-1774-4d18-9b86-0c4b43392806 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:29.359033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f295d7c7-1774-4d18-9b86-0c4b43392806 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:29.435552 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f295d7c7-1774-4d18-9b86-0c4b43392806 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 24566 microversion: 2.1 time: 0.108566 Jan 22 21:02:29.446990 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 414/813] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:29 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 24566 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:29.518516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c2182250-709e-40a8-b1a9-0f923b309b3b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:29.536433 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c2182250-709e-40a8-b1a9-0f923b309b3b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1270 microversion: 2.1 time: 0.254152 Jan 22 21:02:29.554232 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 400/814] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:29 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1270 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:29.748081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-32b83598-ee92-45fd-9578-7c30286b5fd7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:29.748785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-32b83598-ee92-45fd-9578-7c30286b5fd7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:29.756976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32b83598-ee92-45fd-9578-7c30286b5fd7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:29.757439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32b83598-ee92-45fd-9578-7c30286b5fd7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:29.758371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32b83598-ee92-45fd-9578-7c30286b5fd7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:29.759053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32b83598-ee92-45fd-9578-7c30286b5fd7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:30.100051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-32b83598-ee92-45fd-9578-7c30286b5fd7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:30.109752 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-32b83598-ee92-45fd-9578-7c30286b5fd7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1315 microversion: 2.1 time: 0.365679 Jan 22 21:02:30.111189 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 415/815] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:29 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:30.229035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d0e52b93-9f68-4a6c-b1f3-f4c71eaa8946 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:30.230540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d0e52b93-9f68-4a6c-b1f3-f4c71eaa8946 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:30.242830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0e52b93-9f68-4a6c-b1f3-f4c71eaa8946 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:30.243548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0e52b93-9f68-4a6c-b1f3-f4c71eaa8946 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:30.244837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0e52b93-9f68-4a6c-b1f3-f4c71eaa8946 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:30.245738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0e52b93-9f68-4a6c-b1f3-f4c71eaa8946 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:30.339568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-73be7daf-d0f2-4e62-b0a6-23a354a0da33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:30.340255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-73be7daf-d0f2-4e62-b0a6-23a354a0da33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:30.349761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73be7daf-d0f2-4e62-b0a6-23a354a0da33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:30.350395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73be7daf-d0f2-4e62-b0a6-23a354a0da33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:30.351322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73be7daf-d0f2-4e62-b0a6-23a354a0da33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:30.351909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73be7daf-d0f2-4e62-b0a6-23a354a0da33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:30.545376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d0e52b93-9f68-4a6c-b1f3-f4c71eaa8946 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:30.558663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d0e52b93-9f68-4a6c-b1f3-f4c71eaa8946 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:30.560227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d0e52b93-9f68-4a6c-b1f3-f4c71eaa8946 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:30.562110 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d0e52b93-9f68-4a6c-b1f3-f4c71eaa8946 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1365 microversion: 2.25 time: 0.336701 Jan 22 21:02:30.562689 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 401/816] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:30 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1365 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:30.570365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3da679aa-25aa-4c81-8ba0-cefedae2ef8a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:30.573436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3da679aa-25aa-4c81-8ba0-cefedae2ef8a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:30.590765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3da679aa-25aa-4c81-8ba0-cefedae2ef8a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:30.595116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3da679aa-25aa-4c81-8ba0-cefedae2ef8a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:30.596695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3da679aa-25aa-4c81-8ba0-cefedae2ef8a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:30.597593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3da679aa-25aa-4c81-8ba0-cefedae2ef8a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:30.670263 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3da679aa-25aa-4c81-8ba0-cefedae2ef8a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 24566 microversion: 2.1 time: 0.103037 Jan 22 21:02:30.679056 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 402/817] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:30 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 24566 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:30.679940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f7cbe1f-816f-4f03-9420-c65799d52f22 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:30.681152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f7cbe1f-816f-4f03-9420-c65799d52f22 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:30.690292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f7cbe1f-816f-4f03-9420-c65799d52f22 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:30.691103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f7cbe1f-816f-4f03-9420-c65799d52f22 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:30.692085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f7cbe1f-816f-4f03-9420-c65799d52f22 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:30.692635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f7cbe1f-816f-4f03-9420-c65799d52f22 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:30.908671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f7cbe1f-816f-4f03-9420-c65799d52f22 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:30.918943 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f7cbe1f-816f-4f03-9420-c65799d52f22 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1312 microversion: 2.1 time: 0.246349 Jan 22 21:02:30.920372 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 403/818] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:30 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1312 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:30.927288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-af5d2209-897c-4c47-a17f-50b635505d19 req-beda1379-604f-4792-b466-b7a9586ae5fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184726b1-102f-49b3-ae81-7b721c165473", "name": "network-vif-plugged", "status": "completed", "tag": "a28676ad-ae18-4da0-ba64-c6c2ec99218f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:30.928816 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:30.928816 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:30.943702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-73be7daf-d0f2-4e62-b0a6-23a354a0da33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:30.947717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-af5d2209-897c-4c47-a17f-50b635505d19 req-beda1379-604f-4792-b466-b7a9586ae5fb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:30.948304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-af5d2209-897c-4c47-a17f-50b635505d19 req-beda1379-604f-4792-b466-b7a9586ae5fb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:30.962422 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-73be7daf-d0f2-4e62-b0a6-23a354a0da33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1322 microversion: 2.1 time: 0.622218 Jan 22 21:02:30.964019 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-af5d2209-897c-4c47-a17f-50b635505d19 req-beda1379-604f-4792-b466-b7a9586ae5fb service nova] Creating event network-vif-plugged:a28676ad-ae18-4da0-ba64-c6c2ec99218f for instance 184726b1-102f-49b3-ae81-7b721c165473 on nch2-master-1 Jan 22 21:02:30.973201 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 416/819] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:30 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1322 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:02:30.979923 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-af5d2209-897c-4c47-a17f-50b635505d19 req-beda1379-604f-4792-b466-b7a9586ae5fb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057939 Jan 22 21:02:30.980555 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 404/820] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:31.131245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ea1d95fe-fdaf-4193-97ef-0f35617a0d04 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:31.132174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ea1d95fe-fdaf-4193-97ef-0f35617a0d04 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:31.138675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea1d95fe-fdaf-4193-97ef-0f35617a0d04 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:31.142244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea1d95fe-fdaf-4193-97ef-0f35617a0d04 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:31.143777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea1d95fe-fdaf-4193-97ef-0f35617a0d04 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:31.144224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea1d95fe-fdaf-4193-97ef-0f35617a0d04 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:31.400347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ea1d95fe-fdaf-4193-97ef-0f35617a0d04 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:31.408640 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ea1d95fe-fdaf-4193-97ef-0f35617a0d04 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1315 microversion: 2.1 time: 0.282302 Jan 22 21:02:31.409464 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 417/821] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:31 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:31.507602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1c63278-61d0-47e4-8ee8-173d72269bb0 tempest-AbsoluteLimitsTestJSON-1301469848 tempest-AbsoluteLimitsTestJSON-1301469848-project] Calling method '.version_select at 0x7f1ed6167790>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:31.518388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1c63278-61d0-47e4-8ee8-173d72269bb0 tempest-AbsoluteLimitsTestJSON-1301469848 tempest-AbsoluteLimitsTestJSON-1301469848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:31.519021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1c63278-61d0-47e4-8ee8-173d72269bb0 tempest-AbsoluteLimitsTestJSON-1301469848 tempest-AbsoluteLimitsTestJSON-1301469848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:31.519802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1c63278-61d0-47e4-8ee8-173d72269bb0 tempest-AbsoluteLimitsTestJSON-1301469848 tempest-AbsoluteLimitsTestJSON-1301469848-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:31.520243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1c63278-61d0-47e4-8ee8-173d72269bb0 tempest-AbsoluteLimitsTestJSON-1301469848 tempest-AbsoluteLimitsTestJSON-1301469848-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:31.539193 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1c63278-61d0-47e4-8ee8-173d72269bb0 tempest-AbsoluteLimitsTestJSON-1301469848 tempest-AbsoluteLimitsTestJSON-1301469848-project] 10.222.0.100 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.243540 Jan 22 21:02:31.539707 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 405/822] 10.222.0.100 () {58 vars in 1126 bytes} [Sat Jan 22 21:02:31 2022] GET /compute/v2.1/limits => generated 511 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:31.580303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0c6b990d-1442-497f-bf29-6da4b6c5626c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:31.580954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0c6b990d-1442-497f-bf29-6da4b6c5626c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:31.586876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c6b990d-1442-497f-bf29-6da4b6c5626c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:31.587492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c6b990d-1442-497f-bf29-6da4b6c5626c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:31.588290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c6b990d-1442-497f-bf29-6da4b6c5626c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:31.588769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c6b990d-1442-497f-bf29-6da4b6c5626c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:31.683932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-056164ae-64ed-4be7-aa2b-e19fe74446ab tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:31.686077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-056164ae-64ed-4be7-aa2b-e19fe74446ab tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:31.700767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-056164ae-64ed-4be7-aa2b-e19fe74446ab tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:31.701760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-056164ae-64ed-4be7-aa2b-e19fe74446ab tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:31.702932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-056164ae-64ed-4be7-aa2b-e19fe74446ab tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:31.705896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-056164ae-64ed-4be7-aa2b-e19fe74446ab tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:31.784005 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-056164ae-64ed-4be7-aa2b-e19fe74446ab tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 24566 microversion: 2.1 time: 0.105099 Jan 22 21:02:31.784913 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 406/823] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:31 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 24566 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:02:31.819078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0c6b990d-1442-497f-bf29-6da4b6c5626c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:31.833739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0c6b990d-1442-497f-bf29-6da4b6c5626c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:31.833739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0c6b990d-1442-497f-bf29-6da4b6c5626c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:31.833739 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0c6b990d-1442-497f-bf29-6da4b6c5626c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1365 microversion: 2.25 time: 0.254948 Jan 22 21:02:31.834077 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 418/824] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:31 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:31.939716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7ffeab53-5439-4eba-8760-e93706f612cf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:31.940967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7ffeab53-5439-4eba-8760-e93706f612cf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:31.949049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ffeab53-5439-4eba-8760-e93706f612cf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:31.949524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ffeab53-5439-4eba-8760-e93706f612cf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:31.950348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ffeab53-5439-4eba-8760-e93706f612cf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:31.950878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ffeab53-5439-4eba-8760-e93706f612cf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:31.980109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d292fe16-2e76-4436-8626-08111c1f595b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:31.981037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d292fe16-2e76-4436-8626-08111c1f595b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:31.990762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d292fe16-2e76-4436-8626-08111c1f595b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:31.991648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d292fe16-2e76-4436-8626-08111c1f595b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:31.992920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d292fe16-2e76-4436-8626-08111c1f595b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:31.993692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d292fe16-2e76-4436-8626-08111c1f595b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:32.163025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7ffeab53-5439-4eba-8760-e93706f612cf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:32.172418 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7ffeab53-5439-4eba-8760-e93706f612cf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1312 microversion: 2.1 time: 0.238548 Jan 22 21:02:32.174290 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 407/825] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:31 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1312 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:02:32.179129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-2c9e5914-2311-41a6-b389-9238be79f6c1 req-730fb189-069a-484d-b3da-501770544ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b179432-605e-4dbc-af14-2e1933a509ec", "tag": "8d791b62-9f8e-47a8-b5ac-bd443a5163e8"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:32.180823 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:32.180823 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:32.189693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2c9e5914-2311-41a6-b389-9238be79f6c1 req-730fb189-069a-484d-b3da-501770544ada service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:32.190142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2c9e5914-2311-41a6-b389-9238be79f6c1 req-730fb189-069a-484d-b3da-501770544ada service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:32.202019 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-2c9e5914-2311-41a6-b389-9238be79f6c1 req-730fb189-069a-484d-b3da-501770544ada service nova] Creating event network-changed:8d791b62-9f8e-47a8-b5ac-bd443a5163e8 for instance 0b179432-605e-4dbc-af14-2e1933a509ec on nch2-master-1 Jan 22 21:02:32.211102 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-2c9e5914-2311-41a6-b389-9238be79f6c1 req-730fb189-069a-484d-b3da-501770544ada service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035223 Jan 22 21:02:32.212043 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 408/826] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:32.242273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d292fe16-2e76-4436-8626-08111c1f595b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:32.249967 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d292fe16-2e76-4436-8626-08111c1f595b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1322 microversion: 2.1 time: 0.275330 Jan 22 21:02:32.260303 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 419/827] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:31 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:32.437767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b2ab1248-4703-44ee-ac42-81b5d482a6e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:32.440623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b2ab1248-4703-44ee-ac42-81b5d482a6e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:32.460748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2ab1248-4703-44ee-ac42-81b5d482a6e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:32.471047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2ab1248-4703-44ee-ac42-81b5d482a6e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:32.472879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2ab1248-4703-44ee-ac42-81b5d482a6e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:32.473333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2ab1248-4703-44ee-ac42-81b5d482a6e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:32.674251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b2ab1248-4703-44ee-ac42-81b5d482a6e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:32.682939 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b2ab1248-4703-44ee-ac42-81b5d482a6e7 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1315 microversion: 2.1 time: 0.259079 Jan 22 21:02:32.693678 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 409/828] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:32 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:32.800495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f920eb3e-38fd-4d7c-a6d5-290f076cbe66 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:32.804619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f920eb3e-38fd-4d7c-a6d5-290f076cbe66 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:32.815707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f920eb3e-38fd-4d7c-a6d5-290f076cbe66 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:32.816762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f920eb3e-38fd-4d7c-a6d5-290f076cbe66 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:32.825071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f920eb3e-38fd-4d7c-a6d5-290f076cbe66 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:32.825071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f920eb3e-38fd-4d7c-a6d5-290f076cbe66 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:32.853002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ba0443c7-f805-494f-8970-1077f7676de8 tempest-FlavorMetadataValidation-1838059111 tempest-FlavorMetadataValidation-1838059111-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1215431332", "id": 16042379, "os-flavor-access:is_public": "True"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:32.854807 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:32.854807 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:32.889599 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f920eb3e-38fd-4d7c-a6d5-290f076cbe66 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.092227 Jan 22 21:02:32.889599 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 410/829] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:32 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:02:32.899056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cd1a0347-e20c-4685-b03d-3f0665a06eba tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:32.899909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cd1a0347-e20c-4685-b03d-3f0665a06eba tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:32.908971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd1a0347-e20c-4685-b03d-3f0665a06eba tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:32.909576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd1a0347-e20c-4685-b03d-3f0665a06eba tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:32.910492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd1a0347-e20c-4685-b03d-3f0665a06eba tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:32.911069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd1a0347-e20c-4685-b03d-3f0665a06eba tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:32.948913 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ba0443c7-f805-494f-8970-1077f7676de8 tempest-FlavorMetadataValidation-1838059111 tempest-FlavorMetadataValidation-1838059111-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.330026 Jan 22 21:02:32.950683 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 420/830] 10.222.0.100 () {62 vars in 1192 bytes} [Sat Jan 22 21:02:32 2022] POST /compute/v2.1/flavors => generated 467 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:02:32.962030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8766f7b6-95f7-4840-8ca1-d9c736cead73 tempest-FlavorMetadataValidation-1838059111 tempest-FlavorMetadataValidation-1838059111-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:32.963360 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:32.963360 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:33.187357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cd1a0347-e20c-4685-b03d-3f0665a06eba tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:33.204265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cd1a0347-e20c-4685-b03d-3f0665a06eba tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:33.211563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cd1a0347-e20c-4685-b03d-3f0665a06eba tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:33.212947 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cd1a0347-e20c-4685-b03d-3f0665a06eba tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1365 microversion: 2.25 time: 0.323141 Jan 22 21:02:33.215879 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 411/831] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:32 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1365 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:33.224812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-01e088e1-af7b-427f-9d25-bb4212a0edaf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:33.224812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-01e088e1-af7b-427f-9d25-bb4212a0edaf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:33.247397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01e088e1-af7b-427f-9d25-bb4212a0edaf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:33.247956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01e088e1-af7b-427f-9d25-bb4212a0edaf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:33.249277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01e088e1-af7b-427f-9d25-bb4212a0edaf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:33.258768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01e088e1-af7b-427f-9d25-bb4212a0edaf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:33.455865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-01e088e1-af7b-427f-9d25-bb4212a0edaf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:33.463659 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8766f7b6-95f7-4840-8ca1-d9c736cead73 tempest-FlavorMetadataValidation-1838059111 tempest-FlavorMetadataValidation-1838059111-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors/16042379/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.505304 Jan 22 21:02:33.464304 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 421/832] 10.222.0.100 () {62 vars in 1263 bytes} [Sat Jan 22 21:02:32 2022] POST /compute/v2.1/flavors/16042379/os-extra_specs => generated 62 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:33.465690 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-01e088e1-af7b-427f-9d25-bb4212a0edaf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1312 microversion: 2.1 time: 0.245446 Jan 22 21:02:33.465690 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 412/833] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:33 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1312 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:33.469780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-97d3cd40-6244-4dcc-b314-d19f01b4bf9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:33.470566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-97d3cd40-6244-4dcc-b314-d19f01b4bf9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:33.473902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f43350f4-ab31-4e20-b30b-a13797dab851 tempest-FlavorMetadataValidation-1838059111 tempest-FlavorMetadataValidation-1838059111-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:33.477151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97d3cd40-6244-4dcc-b314-d19f01b4bf9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:33.477647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97d3cd40-6244-4dcc-b314-d19f01b4bf9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:33.478268 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:33.478268 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:33.478463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97d3cd40-6244-4dcc-b314-d19f01b4bf9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:33.478902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97d3cd40-6244-4dcc-b314-d19f01b4bf9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:33.590166 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f43350f4-ab31-4e20-b30b-a13797dab851 tempest-FlavorMetadataValidation-1838059111 tempest-FlavorMetadataValidation-1838059111-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/16042379" status: 202 len: 0 microversion: 2.86 time: 0.116085 Jan 22 21:02:33.590823 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 413/834] 10.222.0.100 () {60 vars in 1200 bytes} [Sat Jan 22 21:02:33 2022] DELETE /compute/v2.1/flavors/16042379 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:02:33.601311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0fea7d5b-fc61-40d1-80b3-1c1388081cc3 tempest-FlavorMetadataValidation-1838059111 tempest-FlavorMetadataValidation-1838059111-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:33.623829 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0fea7d5b-fc61-40d1-80b3-1c1388081cc3 tempest-FlavorMetadataValidation-1838059111 tempest-FlavorMetadataValidation-1838059111-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 6707 microversion: 2.86 time: 0.027863 Jan 22 21:02:33.636147 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 414/835] 10.222.0.100 () {60 vars in 1191 bytes} [Sat Jan 22 21:02:33 2022] GET /compute/v2.1/flavors/detail => generated 6707 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:33.640779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-97d3cd40-6244-4dcc-b314-d19f01b4bf9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:33.648755 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-97d3cd40-6244-4dcc-b314-d19f01b4bf9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1322 microversion: 2.1 time: 0.182627 Jan 22 21:02:33.649496 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 422/836] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:33 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:33.701010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4a4e6b31-9a3b-4f0c-8b7e-63c633437bbd tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:33.702255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4a4e6b31-9a3b-4f0c-8b7e-63c633437bbd tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:33.709253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a4e6b31-9a3b-4f0c-8b7e-63c633437bbd tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:33.709760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a4e6b31-9a3b-4f0c-8b7e-63c633437bbd tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:33.710569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a4e6b31-9a3b-4f0c-8b7e-63c633437bbd tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:33.711026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a4e6b31-9a3b-4f0c-8b7e-63c633437bbd tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:33.869978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4a4e6b31-9a3b-4f0c-8b7e-63c633437bbd tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:33.881999 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4a4e6b31-9a3b-4f0c-8b7e-63c633437bbd tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1498 microversion: 2.1 time: 0.181982 Jan 22 21:02:33.881999 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 415/837] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:33 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1498 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:33.899094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4c26a01e-1d08-486d-9670-b5d3fdcaa450 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:33.900635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4c26a01e-1d08-486d-9670-b5d3fdcaa450 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:33.911065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c26a01e-1d08-486d-9670-b5d3fdcaa450 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:33.911769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c26a01e-1d08-486d-9670-b5d3fdcaa450 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:33.912617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c26a01e-1d08-486d-9670-b5d3fdcaa450 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:33.913075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c26a01e-1d08-486d-9670-b5d3fdcaa450 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:33.915882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3375ec0c-45c5-492e-bee1-5a902b1a1c50 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:33.920066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3375ec0c-45c5-492e-bee1-5a902b1a1c50 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:33.927547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3375ec0c-45c5-492e-bee1-5a902b1a1c50 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:33.927998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3375ec0c-45c5-492e-bee1-5a902b1a1c50 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:33.928804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3375ec0c-45c5-492e-bee1-5a902b1a1c50 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:33.929246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3375ec0c-45c5-492e-bee1-5a902b1a1c50 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:33.977493 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3375ec0c-45c5-492e-bee1-5a902b1a1c50 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.070565 Jan 22 21:02:33.978247 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 416/838] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:33 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:34.089626 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4c26a01e-1d08-486d-9670-b5d3fdcaa450 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1649 microversion: 2.1 time: 0.195174 Jan 22 21:02:34.093395 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 423/839] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:33 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1649 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:34.110469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0f7c5606-617b-41f3-831b-fbde219e20f4 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:34.112241 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:34.112241 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:34.113965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f7c5606-617b-41f3-831b-fbde219e20f4 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:34.114426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f7c5606-617b-41f3-831b-fbde219e20f4 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:34.115258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f7c5606-617b-41f3-831b-fbde219e20f4 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:34.115696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f7c5606-617b-41f3-831b-fbde219e20f4 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:34.161029 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0f7c5606-617b-41f3-831b-fbde219e20f4 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.055560 Jan 22 21:02:34.161680 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 417/840] 10.222.0.100 () {58 vars in 1180 bytes} [Sat Jan 22 21:02:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:34.234481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f8dcafba-ea2f-47ed-932c-9e2cf0f60bbe tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:34.235907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f8dcafba-ea2f-47ed-932c-9e2cf0f60bbe tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:34.242753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8dcafba-ea2f-47ed-932c-9e2cf0f60bbe tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:34.248957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8dcafba-ea2f-47ed-932c-9e2cf0f60bbe tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:34.248957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8dcafba-ea2f-47ed-932c-9e2cf0f60bbe tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:34.248957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8dcafba-ea2f-47ed-932c-9e2cf0f60bbe tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:34.465768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f8dcafba-ea2f-47ed-932c-9e2cf0f60bbe tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:34.478496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f8dcafba-ea2f-47ed-932c-9e2cf0f60bbe tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:34.481034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-85392af0-b1cb-4a33-9e89-7ccbe3e951cc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:34.481205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f8dcafba-ea2f-47ed-932c-9e2cf0f60bbe tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:34.482658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-85392af0-b1cb-4a33-9e89-7ccbe3e951cc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:34.482780 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f8dcafba-ea2f-47ed-932c-9e2cf0f60bbe tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1365 microversion: 2.25 time: 0.252405 Jan 22 21:02:34.483612 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 424/841] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:34 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:34.492231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85392af0-b1cb-4a33-9e89-7ccbe3e951cc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:34.494037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85392af0-b1cb-4a33-9e89-7ccbe3e951cc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:34.494037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85392af0-b1cb-4a33-9e89-7ccbe3e951cc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:34.494037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85392af0-b1cb-4a33-9e89-7ccbe3e951cc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:34.670291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-daa29446-1a11-41e1-a1e7-b0491062fa27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:34.671020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-daa29446-1a11-41e1-a1e7-b0491062fa27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:34.683447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa29446-1a11-41e1-a1e7-b0491062fa27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:34.684092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa29446-1a11-41e1-a1e7-b0491062fa27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:34.685030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa29446-1a11-41e1-a1e7-b0491062fa27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:34.685618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa29446-1a11-41e1-a1e7-b0491062fa27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:34.843914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-daa29446-1a11-41e1-a1e7-b0491062fa27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:34.852551 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-daa29446-1a11-41e1-a1e7-b0491062fa27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1322 microversion: 2.1 time: 0.190041 Jan 22 21:02:34.853259 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 425/842] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:34 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:02:34.920768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-8f4f47fa-8f9b-4c0c-8eb7-33b835c22789 req-f6bfa997-3d52-4263-8b2e-8ff01c73ba8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a", "name": "network-vif-plugged", "status": "completed", "tag": "d7ac1858-6f74-484f-bbcb-8043bae94378"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:34.922439 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:34.922439 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:34.926212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-85392af0-b1cb-4a33-9e89-7ccbe3e951cc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:34.934005 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-85392af0-b1cb-4a33-9e89-7ccbe3e951cc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1312 microversion: 2.1 time: 0.456425 Jan 22 21:02:34.934597 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 418/843] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:34 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1312 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:34.939332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8f4f47fa-8f9b-4c0c-8eb7-33b835c22789 req-f6bfa997-3d52-4263-8b2e-8ff01c73ba8f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:34.939786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8f4f47fa-8f9b-4c0c-8eb7-33b835c22789 req-f6bfa997-3d52-4263-8b2e-8ff01c73ba8f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:34.954889 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8f4f47fa-8f9b-4c0c-8eb7-33b835c22789 req-f6bfa997-3d52-4263-8b2e-8ff01c73ba8f service nova] Creating event network-vif-plugged:d7ac1858-6f74-484f-bbcb-8043bae94378 for instance 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a on nch2-master-1 Jan 22 21:02:34.961344 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-8f4f47fa-8f9b-4c0c-8eb7-33b835c22789 req-f6bfa997-3d52-4263-8b2e-8ff01c73ba8f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045384 Jan 22 21:02:34.962291 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 426/844] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:02:34.992907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f8c6b520-ca4d-4d46-899c-675941526a98 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:34.995407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f8c6b520-ca4d-4d46-899c-675941526a98 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:35.003729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f8c6b520-ca4d-4d46-899c-675941526a98 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:35.004191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f8c6b520-ca4d-4d46-899c-675941526a98 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:35.005383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f8c6b520-ca4d-4d46-899c-675941526a98 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:35.006023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f8c6b520-ca4d-4d46-899c-675941526a98 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:35.066393 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f8c6b520-ca4d-4d46-899c-675941526a98 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.080374 Jan 22 21:02:35.078262 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 419/845] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:34 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:35.503808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e86f0361-1ce9-4dc6-8ead-0458550569f2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:35.504754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e86f0361-1ce9-4dc6-8ead-0458550569f2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:35.512058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e86f0361-1ce9-4dc6-8ead-0458550569f2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:35.512577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e86f0361-1ce9-4dc6-8ead-0458550569f2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:35.513592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e86f0361-1ce9-4dc6-8ead-0458550569f2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:35.514038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e86f0361-1ce9-4dc6-8ead-0458550569f2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:35.678802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e86f0361-1ce9-4dc6-8ead-0458550569f2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:35.687501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e86f0361-1ce9-4dc6-8ead-0458550569f2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:35.689027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e86f0361-1ce9-4dc6-8ead-0458550569f2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:35.690226 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e86f0361-1ce9-4dc6-8ead-0458550569f2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1365 microversion: 2.25 time: 0.192756 Jan 22 21:02:35.690949 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 427/846] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:35 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:35.871315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-702e5a40-1722-4dc8-b109-85973993515c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:35.872023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-702e5a40-1722-4dc8-b109-85973993515c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:35.882172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-702e5a40-1722-4dc8-b109-85973993515c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:35.882635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-702e5a40-1722-4dc8-b109-85973993515c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:35.883504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-702e5a40-1722-4dc8-b109-85973993515c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:35.883919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-702e5a40-1722-4dc8-b109-85973993515c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:35.952805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-631b81e8-06d1-479a-8e31-1148e98538c3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:35.955280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-631b81e8-06d1-479a-8e31-1148e98538c3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:35.962525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-631b81e8-06d1-479a-8e31-1148e98538c3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:35.963356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-631b81e8-06d1-479a-8e31-1148e98538c3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:35.964522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-631b81e8-06d1-479a-8e31-1148e98538c3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:35.965292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-631b81e8-06d1-479a-8e31-1148e98538c3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:36.178974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-702e5a40-1722-4dc8-b109-85973993515c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:36.187455 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-702e5a40-1722-4dc8-b109-85973993515c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1322 microversion: 2.1 time: 0.320495 Jan 22 21:02:36.200129 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 420/847] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:35 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:36.217361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8e7eafc8-4693-401f-8f41-a6201ae7cddb tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:36.217361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8e7eafc8-4693-401f-8f41-a6201ae7cddb tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:36.224569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e7eafc8-4693-401f-8f41-a6201ae7cddb tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:36.225326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e7eafc8-4693-401f-8f41-a6201ae7cddb tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:36.225863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e7eafc8-4693-401f-8f41-a6201ae7cddb tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:36.226303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e7eafc8-4693-401f-8f41-a6201ae7cddb tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:36.274075 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8e7eafc8-4693-401f-8f41-a6201ae7cddb tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.069740 Jan 22 21:02:36.282419 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 421/848] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:36 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:36.312526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-631b81e8-06d1-479a-8e31-1148e98538c3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:36.324026 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-631b81e8-06d1-479a-8e31-1148e98538c3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1312 microversion: 2.1 time: 0.375329 Jan 22 21:02:36.335023 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 428/849] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:35 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1312 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:36.724074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c47cb7fa-fbe7-4344-ad95-91b738c140cd tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:36.731454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c47cb7fa-fbe7-4344-ad95-91b738c140cd tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:36.771744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c47cb7fa-fbe7-4344-ad95-91b738c140cd tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:36.772234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c47cb7fa-fbe7-4344-ad95-91b738c140cd tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:36.776324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c47cb7fa-fbe7-4344-ad95-91b738c140cd tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:36.776324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c47cb7fa-fbe7-4344-ad95-91b738c140cd tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:37.004176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c47cb7fa-fbe7-4344-ad95-91b738c140cd tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:37.015038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c47cb7fa-fbe7-4344-ad95-91b738c140cd tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:37.017866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c47cb7fa-fbe7-4344-ad95-91b738c140cd tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:37.019300 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c47cb7fa-fbe7-4344-ad95-91b738c140cd tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1365 microversion: 2.25 time: 0.313671 Jan 22 21:02:37.029831 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 422/850] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:36 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1365 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:37.055098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-76f1afdd-4cec-4c9f-952b-e2315f21ef99 req-1d2c9b20-eb7b-4a5d-8478-2ce627ee2deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d7803b5-681b-412b-9319-8aaaa574dca7", "name": "network-vif-plugged", "status": "completed", "tag": "f8a5d460-d57a-48e0-bcf8-f5891049005c"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:37.056844 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:37.056844 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:37.065706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-76f1afdd-4cec-4c9f-952b-e2315f21ef99 req-1d2c9b20-eb7b-4a5d-8478-2ce627ee2deb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:37.066376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-76f1afdd-4cec-4c9f-952b-e2315f21ef99 req-1d2c9b20-eb7b-4a5d-8478-2ce627ee2deb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:37.092918 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-76f1afdd-4cec-4c9f-952b-e2315f21ef99 req-1d2c9b20-eb7b-4a5d-8478-2ce627ee2deb service nova] Creating event network-vif-plugged:f8a5d460-d57a-48e0-bcf8-f5891049005c for instance 5d7803b5-681b-412b-9319-8aaaa574dca7 on nch2-master-1 Jan 22 21:02:37.101360 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-76f1afdd-4cec-4c9f-952b-e2315f21ef99 req-1d2c9b20-eb7b-4a5d-8478-2ce627ee2deb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047484 Jan 22 21:02:37.103008 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 429/851] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:37.206802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7012497d-4152-4c19-bc6a-206d4c2bf1ee tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:37.215596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7012497d-4152-4c19-bc6a-206d4c2bf1ee tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:37.221427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7012497d-4152-4c19-bc6a-206d4c2bf1ee tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:37.226308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7012497d-4152-4c19-bc6a-206d4c2bf1ee tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:37.227422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7012497d-4152-4c19-bc6a-206d4c2bf1ee tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:37.228062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7012497d-4152-4c19-bc6a-206d4c2bf1ee tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:37.240612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4a065e28-9efa-4bc5-b4b6-e65898407306 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce68f69a-0548-4980-9511-4b7d28d8afda", "device": "/dev/xvdb"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:37.242564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4a065e28-9efa-4bc5-b4b6-e65898407306 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:37.258605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a065e28-9efa-4bc5-b4b6-e65898407306 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:37.262245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a065e28-9efa-4bc5-b4b6-e65898407306 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:37.264252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a065e28-9efa-4bc5-b4b6-e65898407306 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:37.265255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a065e28-9efa-4bc5-b4b6-e65898407306 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:37.447570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7012497d-4152-4c19-bc6a-206d4c2bf1ee tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:37.458353 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7012497d-4152-4c19-bc6a-206d4c2bf1ee tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1510 microversion: 2.1 time: 0.255947 Jan 22 21:02:37.463026 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 423/852] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:37 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:37.483647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8ef8f84e-3934-41b4-bdbf-1df2f1e44ff2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:37.490363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8ef8f84e-3934-41b4-bdbf-1df2f1e44ff2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:37.501953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ef8f84e-3934-41b4-bdbf-1df2f1e44ff2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:37.502673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ef8f84e-3934-41b4-bdbf-1df2f1e44ff2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:37.506055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ef8f84e-3934-41b4-bdbf-1df2f1e44ff2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:37.506754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ef8f84e-3934-41b4-bdbf-1df2f1e44ff2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:37.569004 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8ef8f84e-3934-41b4-bdbf-1df2f1e44ff2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.104275 Jan 22 21:02:37.570130 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 424/853] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:37 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:37.582669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-370c95d3-792e-442d-a383-0f566d30007a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:37.583030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-370c95d3-792e-442d-a383-0f566d30007a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:37.599055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-370c95d3-792e-442d-a383-0f566d30007a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:37.599878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-370c95d3-792e-442d-a383-0f566d30007a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:37.601405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-370c95d3-792e-442d-a383-0f566d30007a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:37.602283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-370c95d3-792e-442d-a383-0f566d30007a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:37.840575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-370c95d3-792e-442d-a383-0f566d30007a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:37.851855 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-370c95d3-792e-442d-a383-0f566d30007a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1312 microversion: 2.1 time: 0.280306 Jan 22 21:02:37.853614 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 425/854] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:37 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1312 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:37.858807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e758f030-2309-4b8f-82bc-611c68580c33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:37.860787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e758f030-2309-4b8f-82bc-611c68580c33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:37.868305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e758f030-2309-4b8f-82bc-611c68580c33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:37.869210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e758f030-2309-4b8f-82bc-611c68580c33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:37.870466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e758f030-2309-4b8f-82bc-611c68580c33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:37.871291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e758f030-2309-4b8f-82bc-611c68580c33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:38.120102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e758f030-2309-4b8f-82bc-611c68580c33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:38.132178 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e758f030-2309-4b8f-82bc-611c68580c33 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1510 microversion: 2.1 time: 0.275927 Jan 22 21:02:38.133705 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 426/855] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:37 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:38.140892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ed7c9ba3-0900-4d7b-a7ec-edd00fe46dcb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:38.145145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ed7c9ba3-0900-4d7b-a7ec-edd00fe46dcb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:38.151804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed7c9ba3-0900-4d7b-a7ec-edd00fe46dcb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:38.152587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed7c9ba3-0900-4d7b-a7ec-edd00fe46dcb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:38.154177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed7c9ba3-0900-4d7b-a7ec-edd00fe46dcb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:38.154863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed7c9ba3-0900-4d7b-a7ec-edd00fe46dcb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:38.273457 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4a065e28-9efa-4bc5-b4b6-e65898407306 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "POST /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.038502 Jan 22 21:02:38.281456 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 430/856] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:02:37 2022] POST /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473/os-volume_attachments => generated 194 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:38.294416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "OS-DCF:diskConfig": "AUTO"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:38.296155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:38.327290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:38.329316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:38.334735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:38.336718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:38.389742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed7c9ba3-0900-4d7b-a7ec-edd00fe46dcb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:38.400439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed7c9ba3-0900-4d7b-a7ec-edd00fe46dcb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:38.409393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed7c9ba3-0900-4d7b-a7ec-edd00fe46dcb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:38.411289 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ed7c9ba3-0900-4d7b-a7ec-edd00fe46dcb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1365 microversion: 2.25 time: 0.275841 Jan 22 21:02:38.412982 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 427/857] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:38 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:38.489415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:02:38.490288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:02:38.490980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:02:38.491454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:02:38.491944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:02:38.580990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-53f60332-1d7c-43ee-844f-00000ebec5af tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:38.581780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-53f60332-1d7c-43ee-844f-00000ebec5af tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:38.592033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53f60332-1d7c-43ee-844f-00000ebec5af tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:38.592762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53f60332-1d7c-43ee-844f-00000ebec5af tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:38.594443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53f60332-1d7c-43ee-844f-00000ebec5af tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:38.595228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53f60332-1d7c-43ee-844f-00000ebec5af tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:38.658489 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-53f60332-1d7c-43ee-844f-00000ebec5af tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.081751 Jan 22 21:02:38.659439 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 428/858] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:38 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:02:38.753026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:38.777338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:38.779724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:38.780717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:38.781588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:38.831774 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-56a7a1b6-5029-4ff4-b24c-8cdbd579c84b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "POST /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a/action" status: 202 len: 1112 microversion: 2.1 time: 0.544237 Jan 22 21:02:38.833710 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 431/859] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:38 2022] POST /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a/action => generated 1112 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 22 21:02:38.852746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-12add03a-69cf-43d6-8ec9-a2c68390843b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:38.852746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-12add03a-69cf-43d6-8ec9-a2c68390843b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:38.866696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12add03a-69cf-43d6-8ec9-a2c68390843b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:38.867209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12add03a-69cf-43d6-8ec9-a2c68390843b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:38.868138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12add03a-69cf-43d6-8ec9-a2c68390843b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:38.868652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12add03a-69cf-43d6-8ec9-a2c68390843b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:38.871079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-00925329-0a81-448e-944a-8b3380520ecb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:38.871819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-00925329-0a81-448e-944a-8b3380520ecb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:38.884556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00925329-0a81-448e-944a-8b3380520ecb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:38.885016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00925329-0a81-448e-944a-8b3380520ecb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:38.885861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00925329-0a81-448e-944a-8b3380520ecb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:38.886394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00925329-0a81-448e-944a-8b3380520ecb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:39.178933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-12add03a-69cf-43d6-8ec9-a2c68390843b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:39.187027 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-12add03a-69cf-43d6-8ec9-a2c68390843b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.342371 Jan 22 21:02:39.198581 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 429/860] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:38 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:39.366396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-00925329-0a81-448e-944a-8b3380520ecb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:39.388412 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-00925329-0a81-448e-944a-8b3380520ecb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1312 microversion: 2.1 time: 0.515612 Jan 22 21:02:39.398178 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 432/861] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:38 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1312 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:02:39.430390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-884334a9-3d44-4641-8419-04a75c29eb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:39.431007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-884334a9-3d44-4641-8419-04a75c29eb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:39.441007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-884334a9-3d44-4641-8419-04a75c29eb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:39.441480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-884334a9-3d44-4641-8419-04a75c29eb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:39.442325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-884334a9-3d44-4641-8419-04a75c29eb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:39.442775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-884334a9-3d44-4641-8419-04a75c29eb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:39.467735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-36b8c488-826d-46ae-b4dc-b706d7176405 req-4a75c469-7dd6-4320-8bdc-5856d33728e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b179432-605e-4dbc-af14-2e1933a509ec", "name": "network-vif-plugged", "status": "completed", "tag": "8d791b62-9f8e-47a8-b5ac-bd443a5163e8"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:39.469359 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:39.469359 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:39.504334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-36b8c488-826d-46ae-b4dc-b706d7176405 req-4a75c469-7dd6-4320-8bdc-5856d33728e3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:39.504789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-36b8c488-826d-46ae-b4dc-b706d7176405 req-4a75c469-7dd6-4320-8bdc-5856d33728e3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:39.534538 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-36b8c488-826d-46ae-b4dc-b706d7176405 req-4a75c469-7dd6-4320-8bdc-5856d33728e3 service nova] Creating event network-vif-plugged:8d791b62-9f8e-47a8-b5ac-bd443a5163e8 for instance 0b179432-605e-4dbc-af14-2e1933a509ec on nch2-master-1 Jan 22 21:02:39.564528 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-36b8c488-826d-46ae-b4dc-b706d7176405 req-4a75c469-7dd6-4320-8bdc-5856d33728e3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100233 Jan 22 21:02:39.565667 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 433/862] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:39.672499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7f6a5055-3360-45b1-a6ea-601d14765539 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:39.673794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7f6a5055-3360-45b1-a6ea-601d14765539 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:39.683472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f6a5055-3360-45b1-a6ea-601d14765539 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:39.683937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f6a5055-3360-45b1-a6ea-601d14765539 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:39.697159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f6a5055-3360-45b1-a6ea-601d14765539 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:39.697796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f6a5055-3360-45b1-a6ea-601d14765539 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:39.814122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-884334a9-3d44-4641-8419-04a75c29eb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:39.824299 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7f6a5055-3360-45b1-a6ea-601d14765539 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.156636 Jan 22 21:02:39.826993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-884334a9-3d44-4641-8419-04a75c29eb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:39.829106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-884334a9-3d44-4641-8419-04a75c29eb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:39.838475 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 434/863] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:39 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:39.840144 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-884334a9-3d44-4641-8419-04a75c29eb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1365 microversion: 2.25 time: 0.413292 Jan 22 21:02:39.847329 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 430/864] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:39 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1365 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:40.205828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-99fc0209-2ca8-47a4-8337-cb9151c3ee67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:40.207805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-99fc0209-2ca8-47a4-8337-cb9151c3ee67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:40.225801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99fc0209-2ca8-47a4-8337-cb9151c3ee67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:40.228637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99fc0209-2ca8-47a4-8337-cb9151c3ee67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:40.236732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99fc0209-2ca8-47a4-8337-cb9151c3ee67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:40.236732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99fc0209-2ca8-47a4-8337-cb9151c3ee67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:40.243427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-03912d2d-d37b-4ced-8bcb-84af5e6d4106 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Calling method '.version_select at 0x7f1ed60a7b80>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:40.248840 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:40.248840 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:40.258921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03912d2d-d37b-4ced-8bcb-84af5e6d4106 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:40.259671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03912d2d-d37b-4ced-8bcb-84af5e6d4106 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:40.261072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03912d2d-d37b-4ced-8bcb-84af5e6d4106 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:40.264181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03912d2d-d37b-4ced-8bcb-84af5e6d4106 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:40.319255 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-03912d2d-d37b-4ced-8bcb-84af5e6d4106 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.352955 Jan 22 21:02:40.327093 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 435/865] 10.222.0.100 () {58 vars in 1132 bytes} [Sat Jan 22 21:02:39 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:40.581430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-89273c98-4841-4f2f-8f5b-6a687cb5c285 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Calling method '.version_select at 0x7f1ed6110dc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:40.584882 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:40.584882 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:40.589056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-89273c98-4841-4f2f-8f5b-6a687cb5c285 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '0a1a903652a44faba56c3a36a4347806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89136de32c5f4211ba1929beae4d5295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:40.590030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-89273c98-4841-4f2f-8f5b-6a687cb5c285 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:40.591108 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-89273c98-4841-4f2f-8f5b-6a687cb5c285 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] 10.222.0.100 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.262398 Jan 22 21:02:40.598236 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 436/866] 10.222.0.100 () {58 vars in 1132 bytes} [Sat Jan 22 21:02:40 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 270 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:40.605628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-19eaa288-4cf0-4d7c-8f08-194a3c82db41 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:40.606671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-19eaa288-4cf0-4d7c-8f08-194a3c82db41 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:40.606794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-99fc0209-2ca8-47a4-8337-cb9151c3ee67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:40.615562 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-99fc0209-2ca8-47a4-8337-cb9151c3ee67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.415057 Jan 22 21:02:40.626942 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 431/867] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:40 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:40.641565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19eaa288-4cf0-4d7c-8f08-194a3c82db41 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:40.641565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19eaa288-4cf0-4d7c-8f08-194a3c82db41 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:40.641565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19eaa288-4cf0-4d7c-8f08-194a3c82db41 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:40.641565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19eaa288-4cf0-4d7c-8f08-194a3c82db41 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:40.652686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cb45c7ca-e128-411f-a20d-2ac0a3c3e2d6 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Calling method '.version_select at 0x7f1ed61603a0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:40.653962 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:40.653962 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:40.655756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cb45c7ca-e128-411f-a20d-2ac0a3c3e2d6 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '0a1a903652a44faba56c3a36a4347806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89136de32c5f4211ba1929beae4d5295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:40.658123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cb45c7ca-e128-411f-a20d-2ac0a3c3e2d6 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:40.658123 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cb45c7ca-e128-411f-a20d-2ac0a3c3e2d6 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] 10.222.0.100 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.028134 Jan 22 21:02:40.658686 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 432/868] 10.222.0.100 () {58 vars in 1195 bytes} [Sat Jan 22 21:02:40 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:40.666846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0522026b-55de-4747-8783-68366cb97003 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Calling method '.version_select at 0x7f1ed63eb790>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:40.693863 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-0522026b-55de-4747-8783-68366cb97003 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jan 22 21:02:40.697066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0522026b-55de-4747-8783-68366cb97003 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:40.699239 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0522026b-55de-4747-8783-68366cb97003 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.035927 Jan 22 21:02:40.701997 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 433/869] 10.222.0.100 () {58 vars in 1216 bytes} [Sat Jan 22 21:02:40 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:02:40.725384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b3f2d2b7-304b-42de-9e32-30d882103e88 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Calling method '.version_select at 0x7f1ed61674c0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:40.725384 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:40.725384 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:40.725384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b3f2d2b7-304b-42de-9e32-30d882103e88 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '0a1a903652a44faba56c3a36a4347806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89136de32c5f4211ba1929beae4d5295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:40.725384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b3f2d2b7-304b-42de-9e32-30d882103e88 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:40.727344 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b3f2d2b7-304b-42de-9e32-30d882103e88 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] 10.222.0.100 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.020166 Jan 22 21:02:40.728058 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 434/870] 10.222.0.100 () {58 vars in 1174 bytes} [Sat Jan 22 21:02:40 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:02:40.738260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f3b89e01-169d-4d5c-83fc-c8b935acc58e tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Calling method '.version_select at 0x7f1ed5f24dc0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:40.753489 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-f3b89e01-169d-4d5c-83fc-c8b935acc58e tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jan 22 21:02:40.754381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f3b89e01-169d-4d5c-83fc-c8b935acc58e tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:40.755378 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f3b89e01-169d-4d5c-83fc-c8b935acc58e tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.021763 Jan 22 21:02:40.756407 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 435/871] 10.222.0.100 () {58 vars in 1195 bytes} [Sat Jan 22 21:02:40 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 22 21:02:40.765683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-10491f17-fa2f-4393-959f-1078c0269e11 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Calling method '.version_select at 0x7f1ed6048ca0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:40.766807 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:40.766807 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:40.768905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-10491f17-fa2f-4393-959f-1078c0269e11 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '0a1a903652a44faba56c3a36a4347806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89136de32c5f4211ba1929beae4d5295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:40.769794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-10491f17-fa2f-4393-959f-1078c0269e11 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:40.770781 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-10491f17-fa2f-4393-959f-1078c0269e11 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] 10.222.0.100 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009267 Jan 22 21:02:40.771794 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 436/872] 10.222.0.100 () {58 vars in 1201 bytes} [Sat Jan 22 21:02:40 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:40.784433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1cad66f5-fe79-4d19-a28e-6c6de837a4b8 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Calling method '.version_select at 0x7f1ed60d9790>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:40.804663 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-1cad66f5-fe79-4d19-a28e-6c6de837a4b8 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jan 22 21:02:40.805526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1cad66f5-fe79-4d19-a28e-6c6de837a4b8 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:40.806561 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1cad66f5-fe79-4d19-a28e-6c6de837a4b8 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.027924 Jan 22 21:02:40.808822 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 437/873] 10.222.0.100 () {58 vars in 1222 bytes} [Sat Jan 22 21:02:40 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:02:40.825011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5a7c89b7-aeb1-4c1a-8008-1eec12864321 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Calling method '.version_select at 0x7f1ed5f24820>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:40.833367 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:40.833367 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:40.837591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5a7c89b7-aeb1-4c1a-8008-1eec12864321 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '0a1a903652a44faba56c3a36a4347806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89136de32c5f4211ba1929beae4d5295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:40.837591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5a7c89b7-aeb1-4c1a-8008-1eec12864321 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:40.837591 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5a7c89b7-aeb1-4c1a-8008-1eec12864321 tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] 10.222.0.100 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.019507 Jan 22 21:02:40.837909 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 438/874] 10.222.0.100 () {58 vars in 1198 bytes} [Sat Jan 22 21:02:40 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:40.847385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c20f552f-0056-4f86-85d6-406af647258e tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Calling method '.version_select at 0x7f1ed5ef7160>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:40.869208 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-c20f552f-0056-4f86-85d6-406af647258e tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jan 22 21:02:40.870106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c20f552f-0056-4f86-85d6-406af647258e tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:40.871148 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c20f552f-0056-4f86-85d6-406af647258e tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.027991 Jan 22 21:02:40.872227 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 439/875] 10.222.0.100 () {58 vars in 1219 bytes} [Sat Jan 22 21:02:40 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:02:40.881211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c40886b7-10fb-4065-b677-2af88292f964 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:40.882477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c40886b7-10fb-4065-b677-2af88292f964 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:40.896163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c40886b7-10fb-4065-b677-2af88292f964 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:40.900908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c40886b7-10fb-4065-b677-2af88292f964 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:40.900908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c40886b7-10fb-4065-b677-2af88292f964 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:40.900908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c40886b7-10fb-4065-b677-2af88292f964 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:40.948480 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c40886b7-10fb-4065-b677-2af88292f964 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.074559 Jan 22 21:02:40.951468 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 440/876] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:40 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:40.964969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2ca0ebd7-f9a3-4ee0-8fc3-46ec0b65beb3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:40.966127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2ca0ebd7-f9a3-4ee0-8fc3-46ec0b65beb3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:40.992962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ca0ebd7-f9a3-4ee0-8fc3-46ec0b65beb3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:40.994022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ca0ebd7-f9a3-4ee0-8fc3-46ec0b65beb3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:40.994235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ca0ebd7-f9a3-4ee0-8fc3-46ec0b65beb3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:40.994675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ca0ebd7-f9a3-4ee0-8fc3-46ec0b65beb3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:41.053204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-19eaa288-4cf0-4d7c-8f08-194a3c82db41 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:41.062366 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-19eaa288-4cf0-4d7c-8f08-194a3c82db41 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1312 microversion: 2.1 time: 0.462193 Jan 22 21:02:41.063679 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 437/877] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:40 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1312 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:41.068432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dc749ca8-b952-46cd-a5ef-02bf47e48910 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed60d9310>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:41.069610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dc749ca8-b952-46cd-a5ef-02bf47e48910 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:41.077303 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dc749ca8-b952-46cd-a5ef-02bf47e48910 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.006023 Jan 22 21:02:41.077303 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 438/878] 10.222.0.100 () {60 vars in 1194 bytes} [Sat Jan 22 21:02:41 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:02:41.084754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9b2c4a42-2e55-49a2-b2ba-a1667c2c3b87 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed60a7820>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:41.086283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9b2c4a42-2e55-49a2-b2ba-a1667c2c3b87 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:41.087333 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9b2c4a42-2e55-49a2-b2ba-a1667c2c3b87 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.007231 Jan 22 21:02:41.092677 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 439/879] 10.222.0.100 () {60 vars in 1194 bytes} [Sat Jan 22 21:02:41 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:02:41.099268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4652ec19-d2f4-4ddf-9e72-9dd0a773852f tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Action: 'update', calling method: .version_select at 0x7f1ed5fd5d30>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:41.100808 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:41.100808 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:41.102400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4652ec19-d2f4-4ddf-9e72-9dd0a773852f tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '0a1a903652a44faba56c3a36a4347806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89136de32c5f4211ba1929beae4d5295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:41.103487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4652ec19-d2f4-4ddf-9e72-9dd0a773852f tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:41.104765 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4652ec19-d2f4-4ddf-9e72-9dd0a773852f tempest-HostsAdminNegativeTestJSON-131109723 tempest-HostsAdminNegativeTestJSON-131109723-project] 10.222.0.100 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.010776 Jan 22 21:02:41.109831 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 440/880] 10.222.0.100 () {60 vars in 1194 bytes} [Sat Jan 22 21:02:41 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:41.125049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-de6d40be-5c8c-4663-b729-1884004fb759 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed602a5e0>, body: {"status": null, "maintenance_mode": null} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:41.125049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-de6d40be-5c8c-4663-b729-1884004fb759 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:41.125049 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-de6d40be-5c8c-4663-b729-1884004fb759 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.006388 Jan 22 21:02:41.125049 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 441/881] 10.222.0.100 () {60 vars in 1194 bytes} [Sat Jan 22 21:02:41 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:02:41.136132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eafe4aa5-09a9-4b9e-9d83-801d11fbca86 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed60944c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:41.139137 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.hosts [None req-eafe4aa5-09a9-4b9e-9d83-801d11fbca86 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Enabling host nonexistent_hostname. Jan 22 21:02:41.169436 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-eafe4aa5-09a9-4b9e-9d83-801d11fbca86 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jan 22 21:02:41.170136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eafe4aa5-09a9-4b9e-9d83-801d11fbca86 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:41.171010 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eafe4aa5-09a9-4b9e-9d83-801d11fbca86 tempest-HostsAdminNegativeTestJSON-901767898 tempest-HostsAdminNegativeTestJSON-901767898-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.044121 Jan 22 21:02:41.171611 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 442/882] 10.222.0.100 () {60 vars in 1215 bytes} [Sat Jan 22 21:02:41 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:02:41.276080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2ca0ebd7-f9a3-4ee0-8fc3-46ec0b65beb3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:41.289348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2ca0ebd7-f9a3-4ee0-8fc3-46ec0b65beb3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:41.295980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2ca0ebd7-f9a3-4ee0-8fc3-46ec0b65beb3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:41.299080 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2ca0ebd7-f9a3-4ee0-8fc3-46ec0b65beb3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1562 microversion: 2.25 time: 0.344555 Jan 22 21:02:41.301095 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 441/883] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:40 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1562 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:41.320587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5833d0fa-9e46-428f-affd-f7f84e5e044c tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:41.321286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5833d0fa-9e46-428f-affd-f7f84e5e044c tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:41.327274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5833d0fa-9e46-428f-affd-f7f84e5e044c tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:41.327740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5833d0fa-9e46-428f-affd-f7f84e5e044c tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:41.329175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5833d0fa-9e46-428f-affd-f7f84e5e044c tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:41.329659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5833d0fa-9e46-428f-affd-f7f84e5e044c tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:41.655993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0dbeafb5-86cd-4390-9cb4-0e361168b27f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:41.656644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0dbeafb5-86cd-4390-9cb4-0e361168b27f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:41.671599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0dbeafb5-86cd-4390-9cb4-0e361168b27f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:41.672056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0dbeafb5-86cd-4390-9cb4-0e361168b27f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:41.673598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0dbeafb5-86cd-4390-9cb4-0e361168b27f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:41.674041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0dbeafb5-86cd-4390-9cb4-0e361168b27f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:42.028056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0dbeafb5-86cd-4390-9cb4-0e361168b27f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:42.038829 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0dbeafb5-86cd-4390-9cb4-0e361168b27f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.386452 Jan 22 21:02:42.043439 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 442/884] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:41 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:02:42.051767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-009ea1e9-076c-4525-82a3-e8c6780b8a08 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:42.061863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-009ea1e9-076c-4525-82a3-e8c6780b8a08 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:42.076869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-009ea1e9-076c-4525-82a3-e8c6780b8a08 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:42.080483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-009ea1e9-076c-4525-82a3-e8c6780b8a08 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:42.082030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-009ea1e9-076c-4525-82a3-e8c6780b8a08 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:42.082859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-009ea1e9-076c-4525-82a3-e8c6780b8a08 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:42.158472 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-009ea1e9-076c-4525-82a3-e8c6780b8a08 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.113023 Jan 22 21:02:42.159564 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 443/885] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:42 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:42.164489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-074d2837-fb9a-4f73-8874-7f0bf131713b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:42.165194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-074d2837-fb9a-4f73-8874-7f0bf131713b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:42.601154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-074d2837-fb9a-4f73-8874-7f0bf131713b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:42.601154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-074d2837-fb9a-4f73-8874-7f0bf131713b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:42.601154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-074d2837-fb9a-4f73-8874-7f0bf131713b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:42.601154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-074d2837-fb9a-4f73-8874-7f0bf131713b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:42.615263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-5833d0fa-9e46-428f-affd-f7f84e5e044c tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'services' on Instance uuid 5d7803b5-681b-412b-9319-8aaaa574dca7 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:02:42.615263 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5833d0fa-9e46-428f-affd-f7f84e5e044c tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 2054 microversion: 2.25 time: 0.946300 Jan 22 21:02:42.615263 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 443/886] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:41 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 2054 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:42.616582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-074d2837-fb9a-4f73-8874-7f0bf131713b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:42.616582 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-074d2837-fb9a-4f73-8874-7f0bf131713b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1312 microversion: 2.1 time: 0.281090 Jan 22 21:02:42.616582 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 444/887] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:42 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1312 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:42.617255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aff45f47-1536-43b5-a431-e9a27a7092cd tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:42.617255 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:42.617255 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:02:42.617255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aff45f47-1536-43b5-a431-e9a27a7092cd tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:42.617255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aff45f47-1536-43b5-a431-e9a27a7092cd tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:42.618229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aff45f47-1536-43b5-a431-e9a27a7092cd tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:42.618229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aff45f47-1536-43b5-a431-e9a27a7092cd tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:42.618229 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aff45f47-1536-43b5-a431-e9a27a7092cd tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.051450 Jan 22 21:02:42.618229 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 444/888] 10.222.0.100 () {60 vars in 1221 bytes} [Sat Jan 22 21:02:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:43.059921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1782c31c-b0d5-426d-999a-69635448ecc5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:43.061255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1782c31c-b0d5-426d-999a-69635448ecc5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:43.067982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1782c31c-b0d5-426d-999a-69635448ecc5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:43.073467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1782c31c-b0d5-426d-999a-69635448ecc5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:43.076080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1782c31c-b0d5-426d-999a-69635448ecc5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:43.079034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1782c31c-b0d5-426d-999a-69635448ecc5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:43.174599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b05bd5c0-a016-48eb-8bf7-5efab4fe3949 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:43.176053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b05bd5c0-a016-48eb-8bf7-5efab4fe3949 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:43.195650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b05bd5c0-a016-48eb-8bf7-5efab4fe3949 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:43.197308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b05bd5c0-a016-48eb-8bf7-5efab4fe3949 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:43.198614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b05bd5c0-a016-48eb-8bf7-5efab4fe3949 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:43.199596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b05bd5c0-a016-48eb-8bf7-5efab4fe3949 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:43.250615 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b05bd5c0-a016-48eb-8bf7-5efab4fe3949 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.084018 Jan 22 21:02:43.255648 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 445/889] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:43 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:02:43.459137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1782c31c-b0d5-426d-999a-69635448ecc5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:43.469292 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1782c31c-b0d5-426d-999a-69635448ecc5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.412912 Jan 22 21:02:43.470466 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 445/890] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:43 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:43.507714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6895527e-58ac-4ffc-bbf9-8c24c0dabd20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:43.513379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6895527e-58ac-4ffc-bbf9-8c24c0dabd20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:43.525681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6895527e-58ac-4ffc-bbf9-8c24c0dabd20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:43.526149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6895527e-58ac-4ffc-bbf9-8c24c0dabd20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:43.526972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6895527e-58ac-4ffc-bbf9-8c24c0dabd20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:43.527425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6895527e-58ac-4ffc-bbf9-8c24c0dabd20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:44.152918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6895527e-58ac-4ffc-bbf9-8c24c0dabd20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:44.154490 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6895527e-58ac-4ffc-bbf9-8c24c0dabd20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1492 microversion: 2.1 time: 0.656148 Jan 22 21:02:44.166794 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 446/891] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:43 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1492 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:44.175250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1654baed-df5c-4600-9ef1-635c730ce9e2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:44.201063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1654baed-df5c-4600-9ef1-635c730ce9e2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:44.202928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1654baed-df5c-4600-9ef1-635c730ce9e2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:44.263558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dac4333f-3a8e-4025-949d-e04b0e96286b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:44.265182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dac4333f-3a8e-4025-949d-e04b0e96286b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:44.277876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dac4333f-3a8e-4025-949d-e04b0e96286b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:44.278910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dac4333f-3a8e-4025-949d-e04b0e96286b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:44.280102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dac4333f-3a8e-4025-949d-e04b0e96286b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:44.281920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dac4333f-3a8e-4025-949d-e04b0e96286b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:44.366967 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dac4333f-3a8e-4025-949d-e04b0e96286b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.107477 Jan 22 21:02:44.368155 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 447/892] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:44 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:02:44.394989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1654baed-df5c-4600-9ef1-635c730ce9e2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Going to try to stop instance {{(pid=137032) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 22 21:02:44.503771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-646d4bcd-c6c2-4cce-87da-9f334e226ae8 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:44.504647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-646d4bcd-c6c2-4cce-87da-9f334e226ae8 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:44.520351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-646d4bcd-c6c2-4cce-87da-9f334e226ae8 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:44.520813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-646d4bcd-c6c2-4cce-87da-9f334e226ae8 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:44.522384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-646d4bcd-c6c2-4cce-87da-9f334e226ae8 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:44.522851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-646d4bcd-c6c2-4cce-87da-9f334e226ae8 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:44.720861 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1654baed-df5c-4600-9ef1-635c730ce9e2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "POST /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec/action" status: 202 len: 0 microversion: 2.1 time: 0.552275 Jan 22 21:02:44.721879 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 446/893] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:44 2022] POST /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:44.744291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7ef105b1-70a2-4f9b-a3c2-0713aa097b5f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:44.745708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7ef105b1-70a2-4f9b-a3c2-0713aa097b5f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:44.753604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ef105b1-70a2-4f9b-a3c2-0713aa097b5f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:44.754160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ef105b1-70a2-4f9b-a3c2-0713aa097b5f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:44.755245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ef105b1-70a2-4f9b-a3c2-0713aa097b5f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:44.756447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ef105b1-70a2-4f9b-a3c2-0713aa097b5f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:44.962598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-646d4bcd-c6c2-4cce-87da-9f334e226ae8 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:44.973342 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-646d4bcd-c6c2-4cce-87da-9f334e226ae8 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.490246 Jan 22 21:02:44.976023 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 448/894] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:44 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:02:45.295537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7ef105b1-70a2-4f9b-a3c2-0713aa097b5f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:45.321616 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7ef105b1-70a2-4f9b-a3c2-0713aa097b5f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.585223 Jan 22 21:02:45.330591 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 447/895] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:44 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:45.388222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2b44f81d-c536-43de-8a5a-a72e1c984009 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:45.390597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2b44f81d-c536-43de-8a5a-a72e1c984009 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:45.408531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b44f81d-c536-43de-8a5a-a72e1c984009 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:45.409140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b44f81d-c536-43de-8a5a-a72e1c984009 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:45.411510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b44f81d-c536-43de-8a5a-a72e1c984009 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:45.412214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b44f81d-c536-43de-8a5a-a72e1c984009 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:45.506342 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2b44f81d-c536-43de-8a5a-a72e1c984009 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.127738 Jan 22 21:02:45.507325 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 449/896] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:45 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:45.870753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-538de347-8935-4869-8969-62d837e9ea09 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "135c98ab-cd95-4a5b-baa2-e72e4414fe5b", "device": "/dev/xvdb"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:45.872865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-538de347-8935-4869-8969-62d837e9ea09 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:45.889355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-538de347-8935-4869-8969-62d837e9ea09 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:45.890245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-538de347-8935-4869-8969-62d837e9ea09 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:45.892017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-538de347-8935-4869-8969-62d837e9ea09 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:45.892653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-538de347-8935-4869-8969-62d837e9ea09 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:45.996375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-79d1af25-b0aa-4cf9-9099-3067541aa83c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:45.997542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-79d1af25-b0aa-4cf9-9099-3067541aa83c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:46.025496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79d1af25-b0aa-4cf9-9099-3067541aa83c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:46.029806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79d1af25-b0aa-4cf9-9099-3067541aa83c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:46.030893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79d1af25-b0aa-4cf9-9099-3067541aa83c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:46.038690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79d1af25-b0aa-4cf9-9099-3067541aa83c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:46.544823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-79d1af25-b0aa-4cf9-9099-3067541aa83c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:46.573712 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-79d1af25-b0aa-4cf9-9099-3067541aa83c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.581771 Jan 22 21:02:46.575555 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 450/897] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:45 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:46.813324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0eaec336-d30c-4019-be7e-48895cce5356 tempest-FloatingIPDetailsNegativeTestJSON-2112715493 tempest-FloatingIPDetailsNegativeTestJSON-2112715493-project] Calling method '.version_select at 0x7f1ed6094dc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:46.873535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG neutronclient.v2_0.client [None req-0eaec336-d30c-4019-be7e-48895cce5356 tempest-FloatingIPDetailsNegativeTestJSON-2112715493 tempest-FloatingIPDetailsNegativeTestJSON-2112715493-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 58911f23-9816-4e2c-b585-19ff4aa0b154 could not be found", "detail": ""}} {{(pid=137033) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:02:46.874246 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-0eaec336-d30c-4019-be7e-48895cce5356 tempest-FloatingIPDetailsNegativeTestJSON-2112715493 tempest-FloatingIPDetailsNegativeTestJSON-2112715493-project] HTTP exception thrown: Floating IP not found for ID 58911f23-9816-4e2c-b585-19ff4aa0b154 Jan 22 21:02:46.875131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0eaec336-d30c-4019-be7e-48895cce5356 tempest-FloatingIPDetailsNegativeTestJSON-2112715493 tempest-FloatingIPDetailsNegativeTestJSON-2112715493-project] Returning 404 to user: Floating IP not found for ID 58911f23-9816-4e2c-b585-19ff4aa0b154 {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:46.877282 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0eaec336-d30c-4019-be7e-48895cce5356 tempest-FloatingIPDetailsNegativeTestJSON-2112715493 tempest-FloatingIPDetailsNegativeTestJSON-2112715493-project] 10.222.0.100 "GET /compute/v2.1/os-floating-ips/58911f23-9816-4e2c-b585-19ff4aa0b154" status: 404 len: 111 microversion: 2.1 time: 0.300541 Jan 22 21:02:46.878077 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 451/898] 10.222.0.100 () {58 vars in 1264 bytes} [Sat Jan 22 21:02:46 2022] GET /compute/v2.1/os-floating-ips/58911f23-9816-4e2c-b585-19ff4aa0b154 => generated 111 bytes in 302 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:02:46.897906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2180fda0-72b7-4be9-aad7-a5887a93aab7 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:46.897906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2180fda0-72b7-4be9-aad7-a5887a93aab7 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:46.914727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2180fda0-72b7-4be9-aad7-a5887a93aab7 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:46.915192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2180fda0-72b7-4be9-aad7-a5887a93aab7 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:46.916887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2180fda0-72b7-4be9-aad7-a5887a93aab7 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:46.917566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2180fda0-72b7-4be9-aad7-a5887a93aab7 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:47.067843 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-538de347-8935-4869-8969-62d837e9ea09 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "POST /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.200087 Jan 22 21:02:47.069228 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 448/899] 10.222.0.100 () {62 vars in 1368 bytes} [Sat Jan 22 21:02:45 2022] POST /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7/os-volume_attachments => generated 194 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:47.094771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-73342d25-2912-42e7-ab8a-3c1463f08afe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:47.098001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-73342d25-2912-42e7-ab8a-3c1463f08afe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:47.126554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73342d25-2912-42e7-ab8a-3c1463f08afe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:47.127303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73342d25-2912-42e7-ab8a-3c1463f08afe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:47.131645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73342d25-2912-42e7-ab8a-3c1463f08afe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:47.132325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73342d25-2912-42e7-ab8a-3c1463f08afe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:47.173443 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2180fda0-72b7-4be9-aad7-a5887a93aab7 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1695 microversion: 2.1 time: 0.292506 Jan 22 21:02:47.174493 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 452/900] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:46 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1695 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:47.179404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-58302177-6a03-4d51-b932-32b7833ab33e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:47.180940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-58302177-6a03-4d51-b932-32b7833ab33e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:47.199805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58302177-6a03-4d51-b932-32b7833ab33e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:47.199805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58302177-6a03-4d51-b932-32b7833ab33e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:47.199805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58302177-6a03-4d51-b932-32b7833ab33e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:47.200046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58302177-6a03-4d51-b932-32b7833ab33e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:47.336697 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-58302177-6a03-4d51-b932-32b7833ab33e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.160634 Jan 22 21:02:47.337795 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 453/901] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:47 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:47.351582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:47.353366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:47.366387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:47.366387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:47.366387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:47.366387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:47.411204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lazy-loading 'flavor' on Instance uuid 184726b1-102f-49b3-ae81-7b721c165473 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:02:47.449565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Going to try to live migrate instance to nch1-master-1 {{(pid=137033) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 22 21:02:48.014304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-73342d25-2912-42e7-ab8a-3c1463f08afe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:48.033929 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-73342d25-2912-42e7-ab8a-3c1463f08afe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.955347 Jan 22 21:02:48.042111 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 449/902] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:47 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:48.054422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b597d261-17de-46d4-9ad5-8687293543f0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:48.063716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b597d261-17de-46d4-9ad5-8687293543f0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:48.082070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b597d261-17de-46d4-9ad5-8687293543f0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:48.082671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b597d261-17de-46d4-9ad5-8687293543f0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:48.083326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b597d261-17de-46d4-9ad5-8687293543f0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:48.093167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b597d261-17de-46d4-9ad5-8687293543f0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:48.503410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b597d261-17de-46d4-9ad5-8687293543f0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:48.521471 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b597d261-17de-46d4-9ad5-8687293543f0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.478011 Jan 22 21:02:48.537040 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 450/903] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:48 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:48.556163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c2007e7a-0cd4-48f0-ac26-104f587f9fb5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:48.561167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c2007e7a-0cd4-48f0-ac26-104f587f9fb5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:48.584746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2007e7a-0cd4-48f0-ac26-104f587f9fb5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:48.586308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2007e7a-0cd4-48f0-ac26-104f587f9fb5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:48.589261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2007e7a-0cd4-48f0-ac26-104f587f9fb5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:48.590554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2007e7a-0cd4-48f0-ac26-104f587f9fb5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:48.714294 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c2007e7a-0cd4-48f0-ac26-104f587f9fb5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.163846 Jan 22 21:02:48.721602 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 451/904] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:48 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:49.252471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-402f3940-f8b1-4300-ac96-eef799c49679 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'create', calling method: .version_select at 0x7f1ed5e8caf0>, body: {"keypair": {"name": "tempest-keypair-1655752577"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:49.273839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-402f3940-f8b1-4300-ac96-eef799c49679 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Getting quotas for project 4f514a46b97a47b3b928fe1135f8f5e7. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:49.277977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-402f3940-f8b1-4300-ac96-eef799c49679 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Getting quotas for user c02f7c20dc884b27958f7611f9abc2fb and project 4f514a46b97a47b3b928fe1135f8f5e7. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:49.736106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-402f3940-f8b1-4300-ac96-eef799c49679 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Getting quotas for project 4f514a46b97a47b3b928fe1135f8f5e7. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:49.740691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-402f3940-f8b1-4300-ac96-eef799c49679 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Getting quotas for user c02f7c20dc884b27958f7611f9abc2fb and project 4f514a46b97a47b3b928fe1135f8f5e7. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:49.763510 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-402f3940-f8b1-4300-ac96-eef799c49679 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.980807 Jan 22 21:02:49.764600 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 452/905] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:02:48 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:49.769343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d358d59a-a8a0-46c3-944b-f40743b8fde2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:49.774871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d358d59a-a8a0-46c3-944b-f40743b8fde2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:49.800365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d358d59a-a8a0-46c3-944b-f40743b8fde2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:49.805879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d358d59a-a8a0-46c3-944b-f40743b8fde2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:49.806742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d358d59a-a8a0-46c3-944b-f40743b8fde2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:49.807264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d358d59a-a8a0-46c3-944b-f40743b8fde2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:50.438528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d358d59a-a8a0-46c3-944b-f40743b8fde2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:50.449185 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d358d59a-a8a0-46c3-944b-f40743b8fde2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.682313 Jan 22 21:02:50.450077 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 453/906] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:49 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:50.557674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d16abd32-681d-4497-af63-d26c748def3f tempest-HypervisorAdminV228Test-658535511 tempest-HypervisorAdminV228Test-658535511-project-admin] Calling method '.version_select at 0x7f1ed6048820>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:50.558725 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:50.558725 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:50.560432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d16abd32-681d-4497-af63-d26c748def3f tempest-HypervisorAdminV228Test-658535511 tempest-HypervisorAdminV228Test-658535511-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:50.560966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d16abd32-681d-4497-af63-d26c748def3f tempest-HypervisorAdminV228Test-658535511 tempest-HypervisorAdminV228Test-658535511-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:50.585815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d16abd32-681d-4497-af63-d26c748def3f tempest-HypervisorAdminV228Test-658535511 tempest-HypervisorAdminV228Test-658535511-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:50.587566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d16abd32-681d-4497-af63-d26c748def3f tempest-HypervisorAdminV228Test-658535511 tempest-HypervisorAdminV228Test-658535511-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:50.599376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d16abd32-681d-4497-af63-d26c748def3f tempest-HypervisorAdminV228Test-658535511 tempest-HypervisorAdminV228Test-658535511-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:50.600014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d16abd32-681d-4497-af63-d26c748def3f tempest-HypervisorAdminV228Test-658535511 tempest-HypervisorAdminV228Test-658535511-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:50.611318 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d16abd32-681d-4497-af63-d26c748def3f tempest-HypervisorAdminV228Test-658535511 tempest-HypervisorAdminV228Test-658535511-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.158559 Jan 22 21:02:50.612462 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 454/907] 10.222.0.100 () {60 vars in 1191 bytes} [Sat Jan 22 21:02:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:50.619905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-153fb9b4-7bf9-44b7-ab4a-fdf76352712c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:50.620796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-153fb9b4-7bf9-44b7-ab4a-fdf76352712c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:50.631697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-153fb9b4-7bf9-44b7-ab4a-fdf76352712c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:50.632155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-153fb9b4-7bf9-44b7-ab4a-fdf76352712c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:50.633024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-153fb9b4-7bf9-44b7-ab4a-fdf76352712c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:50.633473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-153fb9b4-7bf9-44b7-ab4a-fdf76352712c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:50.936128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-153fb9b4-7bf9-44b7-ab4a-fdf76352712c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:50.948534 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-153fb9b4-7bf9-44b7-ab4a-fdf76352712c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.333586 Jan 22 21:02:50.949406 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 455/908] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:50 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:50.958287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d868af89-91ed-4f02-a334-376f7339053e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:50.961938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d868af89-91ed-4f02-a334-376f7339053e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:50.978496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d868af89-91ed-4f02-a334-376f7339053e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:50.979336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d868af89-91ed-4f02-a334-376f7339053e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:50.986654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d868af89-91ed-4f02-a334-376f7339053e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:50.987385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d868af89-91ed-4f02-a334-376f7339053e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:51.080471 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d868af89-91ed-4f02-a334-376f7339053e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.126515 Jan 22 21:02:51.084560 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 456/909] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:50 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:51.092133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a49f8ae-7285-4baa-8268-9baa75fa15c9 tempest-HypervisorAdminV228Test-658535511 tempest-HypervisorAdminV228Test-658535511-project-admin] Calling method '.version_select at 0x7f1ed5f53af0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:51.093081 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:51.093081 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:51.095705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a49f8ae-7285-4baa-8268-9baa75fa15c9 tempest-HypervisorAdminV228Test-658535511 tempest-HypervisorAdminV228Test-658535511-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:51.097312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a49f8ae-7285-4baa-8268-9baa75fa15c9 tempest-HypervisorAdminV228Test-658535511 tempest-HypervisorAdminV228Test-658535511-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:51.119623 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e4a3b68b-cd43-424d-9ca1-517e2a2e3bbc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473/action" status: 202 len: 0 microversion: 2.1 time: 3.779480 Jan 22 21:02:51.123029 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 454/910] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:47 2022] POST /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473/action => generated 0 bytes in 3784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:02:51.131172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8da43c82-0a58-4b22-9770-6a458f583e5c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:51.135095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8da43c82-0a58-4b22-9770-6a458f583e5c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:51.150602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8da43c82-0a58-4b22-9770-6a458f583e5c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:51.154094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8da43c82-0a58-4b22-9770-6a458f583e5c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:51.155151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8da43c82-0a58-4b22-9770-6a458f583e5c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:51.157265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8da43c82-0a58-4b22-9770-6a458f583e5c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:51.159884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a49f8ae-7285-4baa-8268-9baa75fa15c9 tempest-HypervisorAdminV228Test-658535511 tempest-HypervisorAdminV228Test-658535511-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:51.159884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a49f8ae-7285-4baa-8268-9baa75fa15c9 tempest-HypervisorAdminV228Test-658535511 tempest-HypervisorAdminV228Test-658535511-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:51.183145 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a49f8ae-7285-4baa-8268-9baa75fa15c9 tempest-HypervisorAdminV228Test-658535511 tempest-HypervisorAdminV228Test-658535511-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 719 microversion: 2.28 time: 0.097228 Jan 22 21:02:51.184642 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 457/911] 10.222.0.100 () {60 vars in 1197 bytes} [Sat Jan 22 21:02:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 719 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:51.467933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17541988-9945-45f5-a166-cd52f236160f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:51.470824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17541988-9945-45f5-a166-cd52f236160f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:51.477977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8da43c82-0a58-4b22-9770-6a458f583e5c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:51.487613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17541988-9945-45f5-a166-cd52f236160f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:51.488470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17541988-9945-45f5-a166-cd52f236160f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:51.489456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17541988-9945-45f5-a166-cd52f236160f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:51.492632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17541988-9945-45f5-a166-cd52f236160f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:51.504141 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8da43c82-0a58-4b22-9770-6a458f583e5c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1554 microversion: 2.1 time: 0.372519 Jan 22 21:02:51.520165 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 455/912] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:51 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1554 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:51.977074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1cfb2036-5b65-4179-b5d7-42bd23048548 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:51.978320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1cfb2036-5b65-4179-b5d7-42bd23048548 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:51.994929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1cfb2036-5b65-4179-b5d7-42bd23048548 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:51.997935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1cfb2036-5b65-4179-b5d7-42bd23048548 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:52.003964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1cfb2036-5b65-4179-b5d7-42bd23048548 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:52.003964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1cfb2036-5b65-4179-b5d7-42bd23048548 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:52.208252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-17541988-9945-45f5-a166-cd52f236160f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:52.219183 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17541988-9945-45f5-a166-cd52f236160f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.755467 Jan 22 21:02:52.219980 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 458/913] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:51 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:52.225191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bef146c8-fc15-4382-bdcb-238396ee9a65 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:52.226456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bef146c8-fc15-4382-bdcb-238396ee9a65 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:52.236772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bef146c8-fc15-4382-bdcb-238396ee9a65 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:52.237226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bef146c8-fc15-4382-bdcb-238396ee9a65 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:52.238073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bef146c8-fc15-4382-bdcb-238396ee9a65 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:52.238518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bef146c8-fc15-4382-bdcb-238396ee9a65 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:52.324318 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bef146c8-fc15-4382-bdcb-238396ee9a65 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.103003 Jan 22 21:02:52.325181 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 459/914] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:52 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:52.534299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-90b22cd8-c38d-4ffe-9891-117f7a94200d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:52.535050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-90b22cd8-c38d-4ffe-9891-117f7a94200d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:52.546692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90b22cd8-c38d-4ffe-9891-117f7a94200d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:52.548417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90b22cd8-c38d-4ffe-9891-117f7a94200d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:52.549531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90b22cd8-c38d-4ffe-9891-117f7a94200d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:52.550236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90b22cd8-c38d-4ffe-9891-117f7a94200d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:52.580758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1cfb2036-5b65-4179-b5d7-42bd23048548 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:52.595754 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1cfb2036-5b65-4179-b5d7-42bd23048548 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.626559 Jan 22 21:02:52.598259 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 456/915] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:51 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:52.731358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-06e5160f-f635-4564-a36c-df7b5e007804 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:52.732470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-06e5160f-f635-4564-a36c-df7b5e007804 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:52.740724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06e5160f-f635-4564-a36c-df7b5e007804 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:52.742101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06e5160f-f635-4564-a36c-df7b5e007804 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:52.743184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06e5160f-f635-4564-a36c-df7b5e007804 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:52.743865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06e5160f-f635-4564-a36c-df7b5e007804 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:52.848204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-90b22cd8-c38d-4ffe-9891-117f7a94200d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:52.865305 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-90b22cd8-c38d-4ffe-9891-117f7a94200d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1554 microversion: 2.1 time: 0.335606 Jan 22 21:02:52.878070 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 460/916] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:52 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1554 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:53.095527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-06e5160f-f635-4564-a36c-df7b5e007804 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'services' on Instance uuid 5d7803b5-681b-412b-9319-8aaaa574dca7 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:02:53.111242 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-06e5160f-f635-4564-a36c-df7b5e007804 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 2132 microversion: 2.25 time: 0.384945 Jan 22 21:02:53.112248 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 457/917] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:52 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 2132 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:53.130119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2678ce67-4798-4264-913b-22928daa06ca tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:53.131599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2678ce67-4798-4264-913b-22928daa06ca tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:53.141757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2678ce67-4798-4264-913b-22928daa06ca tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:53.142625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2678ce67-4798-4264-913b-22928daa06ca tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:53.143805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2678ce67-4798-4264-913b-22928daa06ca tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:53.144548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2678ce67-4798-4264-913b-22928daa06ca tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:53.176431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-2678ce67-4798-4264-913b-22928daa06ca tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'flavor' on Instance uuid 5d7803b5-681b-412b-9319-8aaaa574dca7 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:02:53.191317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2678ce67-4798-4264-913b-22928daa06ca tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Going to try to live migrate instance to nch1-master-1 {{(pid=137032) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 22 21:02:53.236958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b6bc9b4d-7b2c-421a-b077-f66b65dcbedb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:53.237915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b6bc9b4d-7b2c-421a-b077-f66b65dcbedb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:53.254941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6bc9b4d-7b2c-421a-b077-f66b65dcbedb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:53.255801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6bc9b4d-7b2c-421a-b077-f66b65dcbedb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:53.257271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6bc9b4d-7b2c-421a-b077-f66b65dcbedb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:53.259629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6bc9b4d-7b2c-421a-b077-f66b65dcbedb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:53.661070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b6bc9b4d-7b2c-421a-b077-f66b65dcbedb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:53.667690 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b6bc9b4d-7b2c-421a-b077-f66b65dcbedb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.435443 Jan 22 21:02:53.677712 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 458/918] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:53 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:02:53.689372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-847ab92f-a7c8-4956-82e0-cf95850ea423 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:53.690710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-847ab92f-a7c8-4956-82e0-cf95850ea423 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:53.698033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-847ab92f-a7c8-4956-82e0-cf95850ea423 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:53.698499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-847ab92f-a7c8-4956-82e0-cf95850ea423 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:53.699378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-847ab92f-a7c8-4956-82e0-cf95850ea423 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:53.699833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-847ab92f-a7c8-4956-82e0-cf95850ea423 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:53.770069 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-847ab92f-a7c8-4956-82e0-cf95850ea423 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.089514 Jan 22 21:02:53.774460 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 459/919] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:53 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:53.777022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc48cf17-5950-43b8-9f54-4815d42a46bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:53.780558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bc48cf17-5950-43b8-9f54-4815d42a46bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:53.801017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc48cf17-5950-43b8-9f54-4815d42a46bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:53.802145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc48cf17-5950-43b8-9f54-4815d42a46bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:53.803162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc48cf17-5950-43b8-9f54-4815d42a46bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:53.804239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc48cf17-5950-43b8-9f54-4815d42a46bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:54.151112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bc48cf17-5950-43b8-9f54-4815d42a46bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:54.160925 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bc48cf17-5950-43b8-9f54-4815d42a46bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.387326 Jan 22 21:02:54.162180 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 460/920] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:53 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:54.169758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-50c4a0b6-fc79-427e-a247-7f2fbe6fd6e0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:54.173554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-50c4a0b6-fc79-427e-a247-7f2fbe6fd6e0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:54.187750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50c4a0b6-fc79-427e-a247-7f2fbe6fd6e0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:54.188588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50c4a0b6-fc79-427e-a247-7f2fbe6fd6e0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:54.189592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50c4a0b6-fc79-427e-a247-7f2fbe6fd6e0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:54.190230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50c4a0b6-fc79-427e-a247-7f2fbe6fd6e0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:54.448587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-50c4a0b6-fc79-427e-a247-7f2fbe6fd6e0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:54.460287 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-50c4a0b6-fc79-427e-a247-7f2fbe6fd6e0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1554 microversion: 2.1 time: 0.296259 Jan 22 21:02:54.461423 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 461/921] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:54 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1554 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:54.474821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "24316dea-6068-4e0c-acaf-224ce6464aff"}], "security_groups": [{"name": "tempest-securitygroup--694812373"}], "key_name": "tempest-keypair-1655752577", "user_data": "}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:54.696798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] validate_networks() for [('24316dea-6068-4e0c-acaf-224ce6464aff', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:02:55.667979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:02:55.668597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:02:55.669291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:02:55.669976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:02:55.670804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:02:55.682681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:55.683180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:55.689389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:55.689389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:55.703071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Getting quotas for project 4f514a46b97a47b3b928fe1135f8f5e7. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:02:55.707272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Getting quotas for user c02f7c20dc884b27958f7611f9abc2fb and project 4f514a46b97a47b3b928fe1135f8f5e7. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:02:55.719915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:02:55.722949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:02:55.894814 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9faf6c4c-04b6-4296-bc5b-7752ba79e569 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 1.431862 Jan 22 21:02:55.902048 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 462/922] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:02:54 2022] POST /compute/v2.1/servers => generated 410 bytes in 1433 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:02:55.904152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-73b56df6-f59f-47bd-95dd-bf19cb2e8143 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:55.904760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-73b56df6-f59f-47bd-95dd-bf19cb2e8143 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:55.914402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73b56df6-f59f-47bd-95dd-bf19cb2e8143 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:55.915076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73b56df6-f59f-47bd-95dd-bf19cb2e8143 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:55.915888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73b56df6-f59f-47bd-95dd-bf19cb2e8143 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:55.916339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73b56df6-f59f-47bd-95dd-bf19cb2e8143 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:56.083180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-73b56df6-f59f-47bd-95dd-bf19cb2e8143 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:56.091680 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-73b56df6-f59f-47bd-95dd-bf19cb2e8143 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.195188 Jan 22 21:02:56.101562 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 463/923] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:55 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:56.113786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f888a26a-9002-475b-be00-50d2b32deaa1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:56.114908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f888a26a-9002-475b-be00-50d2b32deaa1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:56.121569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f888a26a-9002-475b-be00-50d2b32deaa1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:56.122097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f888a26a-9002-475b-be00-50d2b32deaa1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:56.122980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f888a26a-9002-475b-be00-50d2b32deaa1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:56.123552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f888a26a-9002-475b-be00-50d2b32deaa1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:56.172821 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f888a26a-9002-475b-be00-50d2b32deaa1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.077868 Jan 22 21:02:56.173491 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 464/924] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:56 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:56.183532 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2678ce67-4798-4264-913b-22928daa06ca tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7/action" status: 202 len: 0 microversion: 2.25 time: 3.058199 Jan 22 21:02:56.184923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-76f900a0-ff93-4c2b-bee7-5c7319f84cff tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:56.185680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-76f900a0-ff93-4c2b-bee7-5c7319f84cff tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:56.193308 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 461/925] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:02:53 2022] POST /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7/action => generated 0 bytes in 3067 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:02:56.193459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76f900a0-ff93-4c2b-bee7-5c7319f84cff tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:56.193595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76f900a0-ff93-4c2b-bee7-5c7319f84cff tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:56.194408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76f900a0-ff93-4c2b-bee7-5c7319f84cff tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:56.194849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76f900a0-ff93-4c2b-bee7-5c7319f84cff tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:56.206744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-878636a4-c616-4f5d-8a1c-3de6326984fa tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:56.207391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-878636a4-c616-4f5d-8a1c-3de6326984fa tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:56.216354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-878636a4-c616-4f5d-8a1c-3de6326984fa tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:56.216354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-878636a4-c616-4f5d-8a1c-3de6326984fa tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:56.216658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-878636a4-c616-4f5d-8a1c-3de6326984fa tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:56.217313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-878636a4-c616-4f5d-8a1c-3de6326984fa tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:56.378387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-76f900a0-ff93-4c2b-bee7-5c7319f84cff tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:56.392748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-878636a4-c616-4f5d-8a1c-3de6326984fa tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:56.393306 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-76f900a0-ff93-4c2b-bee7-5c7319f84cff tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.215297 Jan 22 21:02:56.397873 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 465/926] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:56 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:56.400872 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-878636a4-c616-4f5d-8a1c-3de6326984fa tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1554 microversion: 2.1 time: 0.206227 Jan 22 21:02:56.409677 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 462/927] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:56 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1554 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:56.418511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3400c0fc-6b56-4727-8a09-a0afedd86dde tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:56.419915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3400c0fc-6b56-4727-8a09-a0afedd86dde tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:56.424770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a23164fd-6287-42bd-bf81-58c132363bb0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:56.425424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a23164fd-6287-42bd-bf81-58c132363bb0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:56.427381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3400c0fc-6b56-4727-8a09-a0afedd86dde tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:56.427844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3400c0fc-6b56-4727-8a09-a0afedd86dde tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:56.428644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3400c0fc-6b56-4727-8a09-a0afedd86dde tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:56.429114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3400c0fc-6b56-4727-8a09-a0afedd86dde tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:56.503103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a23164fd-6287-42bd-bf81-58c132363bb0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:56.515142 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a23164fd-6287-42bd-bf81-58c132363bb0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1230 microversion: 2.1 time: 0.115708 Jan 22 21:02:56.516108 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 466/928] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:56 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1230 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:56.626536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3400c0fc-6b56-4727-8a09-a0afedd86dde tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:56.634983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3400c0fc-6b56-4727-8a09-a0afedd86dde tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:56.636480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3400c0fc-6b56-4727-8a09-a0afedd86dde tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:56.637848 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3400c0fc-6b56-4727-8a09-a0afedd86dde tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.233863 Jan 22 21:02:56.638563 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 463/929] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:56 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:57.110524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2983c25a-1a9f-449e-851a-d4da0285e449 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:57.111171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2983c25a-1a9f-449e-851a-d4da0285e449 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:57.117709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2983c25a-1a9f-449e-851a-d4da0285e449 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:57.118173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2983c25a-1a9f-449e-851a-d4da0285e449 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:57.118977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2983c25a-1a9f-449e-851a-d4da0285e449 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:57.119448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2983c25a-1a9f-449e-851a-d4da0285e449 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:57.185287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8d1ca118-4c79-4c4f-a744-7c6f3aff92b9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:57.186261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8d1ca118-4c79-4c4f-a744-7c6f3aff92b9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:57.193303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d1ca118-4c79-4c4f-a744-7c6f3aff92b9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:57.193788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d1ca118-4c79-4c4f-a744-7c6f3aff92b9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:57.194588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d1ca118-4c79-4c4f-a744-7c6f3aff92b9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:57.195028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d1ca118-4c79-4c4f-a744-7c6f3aff92b9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:57.240065 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8d1ca118-4c79-4c4f-a744-7c6f3aff92b9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.058392 Jan 22 21:02:57.241035 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 464/930] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:57 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:57.310899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2983c25a-1a9f-449e-851a-d4da0285e449 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:57.319635 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2983c25a-1a9f-449e-851a-d4da0285e449 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.213494 Jan 22 21:02:57.320182 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 467/931] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:57 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:57.410257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-78a1f53c-f6d6-42eb-bd20-9fd93c2223d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:57.410956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-78a1f53c-f6d6-42eb-bd20-9fd93c2223d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:57.418233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78a1f53c-f6d6-42eb-bd20-9fd93c2223d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:57.418687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78a1f53c-f6d6-42eb-bd20-9fd93c2223d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:57.419478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78a1f53c-f6d6-42eb-bd20-9fd93c2223d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:57.419915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78a1f53c-f6d6-42eb-bd20-9fd93c2223d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:57.426839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6122fc0b-cd10-414d-bfaa-15a2dd204b8c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:57.427448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6122fc0b-cd10-414d-bfaa-15a2dd204b8c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:57.441304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6122fc0b-cd10-414d-bfaa-15a2dd204b8c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:57.442184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6122fc0b-cd10-414d-bfaa-15a2dd204b8c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:57.443532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6122fc0b-cd10-414d-bfaa-15a2dd204b8c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:57.444253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6122fc0b-cd10-414d-bfaa-15a2dd204b8c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:57.600164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-78a1f53c-f6d6-42eb-bd20-9fd93c2223d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:57.614621 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-78a1f53c-f6d6-42eb-bd20-9fd93c2223d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.208330 Jan 22 21:02:57.624207 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 465/932] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:57 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:02:57.636613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-25b70edf-be88-494b-88c6-ceb446607e26 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:57.636613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-25b70edf-be88-494b-88c6-ceb446607e26 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:57.638896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25b70edf-be88-494b-88c6-ceb446607e26 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:57.639509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25b70edf-be88-494b-88c6-ceb446607e26 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:57.641196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25b70edf-be88-494b-88c6-ceb446607e26 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:57.642032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25b70edf-be88-494b-88c6-ceb446607e26 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:57.718625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-25b70edf-be88-494b-88c6-ceb446607e26 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:57.726736 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-25b70edf-be88-494b-88c6-ceb446607e26 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1226 microversion: 2.1 time: 0.100497 Jan 22 21:02:57.727394 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 466/933] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:57 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:57.738862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6122fc0b-cd10-414d-bfaa-15a2dd204b8c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:57.751096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6daaa5a2-67c5-4ec5-8d7b-13376b5c6632 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:57.751969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6daaa5a2-67c5-4ec5-8d7b-13376b5c6632 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:57.755914 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6122fc0b-cd10-414d-bfaa-15a2dd204b8c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1554 microversion: 2.1 time: 0.332720 Jan 22 21:02:57.760684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6daaa5a2-67c5-4ec5-8d7b-13376b5c6632 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:57.761433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6daaa5a2-67c5-4ec5-8d7b-13376b5c6632 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:57.762880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6daaa5a2-67c5-4ec5-8d7b-13376b5c6632 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:57.763485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6daaa5a2-67c5-4ec5-8d7b-13376b5c6632 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:57.770155 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 468/934] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:57 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1554 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:02:57.920596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6daaa5a2-67c5-4ec5-8d7b-13376b5c6632 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:57.939702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6daaa5a2-67c5-4ec5-8d7b-13376b5c6632 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:57.941613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6daaa5a2-67c5-4ec5-8d7b-13376b5c6632 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:57.943202 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6daaa5a2-67c5-4ec5-8d7b-13376b5c6632 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.214505 Jan 22 21:02:57.943810 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 467/935] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:57 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:57.954691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-3e28e671-1c71-4f22-bcda-d72b897e19de req-d516dd00-0e60-4049-94f9-6db2f5a9dca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184726b1-102f-49b3-ae81-7b721c165473", "name": "network-vif-unplugged", "status": "completed", "tag": "a28676ad-ae18-4da0-ba64-c6c2ec99218f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:57.958927 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:02:57.958927 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:02:57.968780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-3e28e671-1c71-4f22-bcda-d72b897e19de req-d516dd00-0e60-4049-94f9-6db2f5a9dca9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:57.968780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-3e28e671-1c71-4f22-bcda-d72b897e19de req-d516dd00-0e60-4049-94f9-6db2f5a9dca9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:57.985336 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-3e28e671-1c71-4f22-bcda-d72b897e19de req-d516dd00-0e60-4049-94f9-6db2f5a9dca9 service nova] Creating event network-vif-unplugged:a28676ad-ae18-4da0-ba64-c6c2ec99218f for instance 184726b1-102f-49b3-ae81-7b721c165473 on nch2-master-1 Jan 22 21:02:57.992431 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-3e28e671-1c71-4f22-bcda-d72b897e19de req-d516dd00-0e60-4049-94f9-6db2f5a9dca9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047077 Jan 22 21:02:57.997514 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 468/936] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:02:58.019244 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-83410c95-3506-4c0c-9056-960f2a8bf948 tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] 10.222.0.100 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.193456 Jan 22 21:02:58.024401 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 469/937] 10.222.0.100 () {58 vars in 1132 bytes} [Sat Jan 22 21:02:57 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 22 21:02:58.034853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aaf0ecf8-578c-4803-a15a-658be6e8ec5f tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] Calling method '.version_select at 0x7f1ed6048670>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:58.116153 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-aaf0ecf8-578c-4803-a15a-658be6e8ec5f tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] HTTP exception thrown: Image not found. Jan 22 21:02:58.116921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aaf0ecf8-578c-4803-a15a-658be6e8ec5f tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] Returning 404 to user: Image not found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:58.117995 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aaf0ecf8-578c-4803-a15a-658be6e8ec5f tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] 10.222.0.100 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.089268 Jan 22 21:02:58.119967 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 469/938] 10.222.0.100 () {58 vars in 1138 bytes} [Sat Jan 22 21:02:58 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:02:58.137000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8110ce53-df11-47ea-8b19-fd88710ea5b5 tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] Calling method '.version_select at 0x7f1ed61abb80>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:58.164146 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-8110ce53-df11-47ea-8b19-fd88710ea5b5 tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] HTTP exception thrown: Image not found. Jan 22 21:02:58.164947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8110ce53-df11-47ea-8b19-fd88710ea5b5 tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] Returning 404 to user: Image not found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:58.166030 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8110ce53-df11-47ea-8b19-fd88710ea5b5 tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] 10.222.0.100 "DELETE /compute/v2.1/images/33a5cfa1-d520-45db-a7ae-296ea1e66cbj" status: 404 len: 62 microversion: 2.1 time: 0.032765 Jan 22 21:02:58.166593 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 470/939] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:58 2022] DELETE /compute/v2.1/images/33a5cfa1-d520-45db-a7ae-296ea1e66cbj => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:02:58.176665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-003d823a-9bab-492e-a620-6f0ae13b7565 tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] Calling method '.version_select at 0x7f1ed5e96430>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:58.194625 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-003d823a-9bab-492e-a620-6f0ae13b7565 tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] HTTP exception thrown: Image not found. Jan 22 21:02:58.195239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-003d823a-9bab-492e-a620-6f0ae13b7565 tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] Returning 404 to user: Image not found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:58.196069 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-003d823a-9bab-492e-a620-6f0ae13b7565 tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] 10.222.0.100 "DELETE /compute/v2.1/images/837e3220-fd68-45b5-b759-a85a26afbc951" status: 404 len: 62 microversion: 2.1 time: 0.023647 Jan 22 21:02:58.196611 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 470/940] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:02:58 2022] DELETE /compute/v2.1/images/837e3220-fd68-45b5-b759-a85a26afbc951 => generated 62 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:02:58.206019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-365062b3-e9ec-4ae6-bf83-a000e6cf7012 tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] Calling method '.version_select at 0x7f1ed62d2550>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:58.228652 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-365062b3-e9ec-4ae6-bf83-a000e6cf7012 tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] HTTP exception thrown: Image not found. Jan 22 21:02:58.229264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-365062b3-e9ec-4ae6-bf83-a000e6cf7012 tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] Returning 404 to user: Image not found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:58.230161 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-365062b3-e9ec-4ae6-bf83-a000e6cf7012 tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] 10.222.0.100 "DELETE /compute/v2.1/images/tempest-invalid-1032982502" status: 404 len: 62 microversion: 2.1 time: 0.028470 Jan 22 21:02:58.230715 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 471/941] 10.222.0.100 () {58 vars in 1210 bytes} [Sat Jan 22 21:02:58 2022] DELETE /compute/v2.1/images/tempest-invalid-1032982502 => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:02:58.240122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c7df111f-33e3-4a03-a619-f04b7176295e tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] Calling method '.version_select at 0x7f1ed6167dc0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:58.252412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5006f357-323e-41ee-9f45-897f0417f9c3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:58.253393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5006f357-323e-41ee-9f45-897f0417f9c3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:58.259654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5006f357-323e-41ee-9f45-897f0417f9c3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:58.260187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5006f357-323e-41ee-9f45-897f0417f9c3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:58.260703 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-c7df111f-33e3-4a03-a619-f04b7176295e tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] HTTP exception thrown: Image not found. Jan 22 21:02:58.261052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5006f357-323e-41ee-9f45-897f0417f9c3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:58.261306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c7df111f-33e3-4a03-a619-f04b7176295e tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] Returning 404 to user: Image not found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:02:58.261525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5006f357-323e-41ee-9f45-897f0417f9c3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:58.262224 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c7df111f-33e3-4a03-a619-f04b7176295e tempest-ImagesDeleteNegativeTestJSON-1598454980 tempest-ImagesDeleteNegativeTestJSON-1598454980-project] 10.222.0.100 "DELETE /compute/v2.1/images/ec832e93-7036-486d-b496-0492c55dc9a4" status: 404 len: 62 microversion: 2.1 time: 0.025933 Jan 22 21:02:58.262774 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 471/942] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:58 2022] DELETE /compute/v2.1/images/ec832e93-7036-486d-b496-0492c55dc9a4 => generated 62 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:02:58.306025 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5006f357-323e-41ee-9f45-897f0417f9c3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.057576 Jan 22 21:02:58.306983 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 472/943] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:58 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:02:58.336744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-254eb259-00e2-4cd6-bc52-c42bc0b3c979 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:58.337450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-254eb259-00e2-4cd6-bc52-c42bc0b3c979 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:58.346532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-254eb259-00e2-4cd6-bc52-c42bc0b3c979 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:58.347028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-254eb259-00e2-4cd6-bc52-c42bc0b3c979 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:58.347870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-254eb259-00e2-4cd6-bc52-c42bc0b3c979 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:58.348314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-254eb259-00e2-4cd6-bc52-c42bc0b3c979 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:58.510326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-254eb259-00e2-4cd6-bc52-c42bc0b3c979 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:58.518466 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-254eb259-00e2-4cd6-bc52-c42bc0b3c979 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.185544 Jan 22 21:02:58.519355 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 472/944] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:58 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:58.633219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7064b349-e54a-4877-9936-3469c39b820d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:58.635049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7064b349-e54a-4877-9936-3469c39b820d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:58.652458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7064b349-e54a-4877-9936-3469c39b820d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:58.653652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7064b349-e54a-4877-9936-3469c39b820d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:58.654642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7064b349-e54a-4877-9936-3469c39b820d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:58.655257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7064b349-e54a-4877-9936-3469c39b820d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:58.747800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5545eb8f-e184-4278-bbc9-8818938f5bdf tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:58.748979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5545eb8f-e184-4278-bbc9-8818938f5bdf tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:58.786534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5545eb8f-e184-4278-bbc9-8818938f5bdf tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:58.789435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5545eb8f-e184-4278-bbc9-8818938f5bdf tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:58.792939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5545eb8f-e184-4278-bbc9-8818938f5bdf tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:58.803004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5545eb8f-e184-4278-bbc9-8818938f5bdf tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:58.902913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5545eb8f-e184-4278-bbc9-8818938f5bdf tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:58.913840 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5545eb8f-e184-4278-bbc9-8818938f5bdf tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1290 microversion: 2.1 time: 0.173317 Jan 22 21:02:58.914770 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 473/945] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:58 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1290 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:02:58.930318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3ce8c3cb-cfa3-46b0-90c0-5a8cb6222dff tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:58.931398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3ce8c3cb-cfa3-46b0-90c0-5a8cb6222dff tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:58.947937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ce8c3cb-cfa3-46b0-90c0-5a8cb6222dff tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:58.948910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ce8c3cb-cfa3-46b0-90c0-5a8cb6222dff tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:58.950424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ce8c3cb-cfa3-46b0-90c0-5a8cb6222dff tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:58.951082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ce8c3cb-cfa3-46b0-90c0-5a8cb6222dff tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:58.977828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7064b349-e54a-4877-9936-3469c39b820d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:58.993750 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7064b349-e54a-4877-9936-3469c39b820d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.357751 Jan 22 21:02:58.994625 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 473/946] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:58 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:59.002916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eafa170c-58fb-4ddd-a3b7-81bd2687be67 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:59.005532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eafa170c-58fb-4ddd-a3b7-81bd2687be67 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:59.018700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eafa170c-58fb-4ddd-a3b7-81bd2687be67 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:59.020870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eafa170c-58fb-4ddd-a3b7-81bd2687be67 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:59.021919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eafa170c-58fb-4ddd-a3b7-81bd2687be67 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:59.023601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eafa170c-58fb-4ddd-a3b7-81bd2687be67 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:59.182029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3ce8c3cb-cfa3-46b0-90c0-5a8cb6222dff tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:59.206673 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3ce8c3cb-cfa3-46b0-90c0-5a8cb6222dff tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1554 microversion: 2.1 time: 0.278925 Jan 22 21:02:59.207469 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 474/947] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:58 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1554 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:59.241371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eafa170c-58fb-4ddd-a3b7-81bd2687be67 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:59.251889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eafa170c-58fb-4ddd-a3b7-81bd2687be67 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:59.253551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eafa170c-58fb-4ddd-a3b7-81bd2687be67 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:59.254703 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eafa170c-58fb-4ddd-a3b7-81bd2687be67 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.258887 Jan 22 21:02:59.255262 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 474/948] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:02:58 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:02:59.318579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cf05a01c-9cc6-4385-80e6-258a22499906 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:02:59.319616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cf05a01c-9cc6-4385-80e6-258a22499906 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:59.325690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf05a01c-9cc6-4385-80e6-258a22499906 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:59.326171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf05a01c-9cc6-4385-80e6-258a22499906 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:59.326976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf05a01c-9cc6-4385-80e6-258a22499906 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:59.327492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf05a01c-9cc6-4385-80e6-258a22499906 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:59.380934 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cf05a01c-9cc6-4385-80e6-258a22499906 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.065768 Jan 22 21:02:59.382019 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 475/949] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:02:59 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:02:59.535562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ec82ade2-e6ec-420a-96c4-ad441dfa6fe6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:59.536178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ec82ade2-e6ec-420a-96c4-ad441dfa6fe6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:59.542276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec82ade2-e6ec-420a-96c4-ad441dfa6fe6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:59.542741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec82ade2-e6ec-420a-96c4-ad441dfa6fe6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:59.543543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec82ade2-e6ec-420a-96c4-ad441dfa6fe6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:59.543994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec82ade2-e6ec-420a-96c4-ad441dfa6fe6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:59.873429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ec82ade2-e6ec-420a-96c4-ad441dfa6fe6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:02:59.889875 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ec82ade2-e6ec-420a-96c4-ad441dfa6fe6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.358483 Jan 22 21:02:59.891651 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 475/950] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:59 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:02:59.932747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-72adce97-9726-4a98-84ca-0a1830c8cec3 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:02:59.937785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-72adce97-9726-4a98-84ca-0a1830c8cec3 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:02:59.948081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72adce97-9726-4a98-84ca-0a1830c8cec3 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:59.948820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72adce97-9726-4a98-84ca-0a1830c8cec3 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:02:59.949989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72adce97-9726-4a98-84ca-0a1830c8cec3 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:02:59.950593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72adce97-9726-4a98-84ca-0a1830c8cec3 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:00.010014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-94c9a266-47fd-4b0e-b22b-36a4f0a7737b req-cb2e2648-4d7a-4617-9ffb-416f9f258676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "184726b1-102f-49b3-ae81-7b721c165473", "tag": "a28676ad-ae18-4da0-ba64-c6c2ec99218f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:00.011643 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:00.011643 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:03:00.026817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-94c9a266-47fd-4b0e-b22b-36a4f0a7737b req-cb2e2648-4d7a-4617-9ffb-416f9f258676 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:00.026817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-94c9a266-47fd-4b0e-b22b-36a4f0a7737b req-cb2e2648-4d7a-4617-9ffb-416f9f258676 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:00.042776 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-94c9a266-47fd-4b0e-b22b-36a4f0a7737b req-cb2e2648-4d7a-4617-9ffb-416f9f258676 service nova] Creating event network-changed:a28676ad-ae18-4da0-ba64-c6c2ec99218f for instance 184726b1-102f-49b3-ae81-7b721c165473 on nch2-master-1 Jan 22 21:03:00.050125 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-94c9a266-47fd-4b0e-b22b-36a4f0a7737b req-cb2e2648-4d7a-4617-9ffb-416f9f258676 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045096 Jan 22 21:03:00.052114 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 476/951] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:00.071589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-baf9c8ef-0157-4ecf-8721-511b508a5770 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:00.072721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-baf9c8ef-0157-4ecf-8721-511b508a5770 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:00.083545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baf9c8ef-0157-4ecf-8721-511b508a5770 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:00.084356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baf9c8ef-0157-4ecf-8721-511b508a5770 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:00.085460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baf9c8ef-0157-4ecf-8721-511b508a5770 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:00.086176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baf9c8ef-0157-4ecf-8721-511b508a5770 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:00.139407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-72adce97-9726-4a98-84ca-0a1830c8cec3 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:00.151248 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-72adce97-9726-4a98-84ca-0a1830c8cec3 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1355 microversion: 2.1 time: 0.220942 Jan 22 21:03:00.164487 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 476/952] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:02:59 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1355 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:00.239846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ccd144df-dda4-4b81-87bd-8664704a816c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:00.241209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ccd144df-dda4-4b81-87bd-8664704a816c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:00.251038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccd144df-dda4-4b81-87bd-8664704a816c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:00.256076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccd144df-dda4-4b81-87bd-8664704a816c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:00.256076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccd144df-dda4-4b81-87bd-8664704a816c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:00.256076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccd144df-dda4-4b81-87bd-8664704a816c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:00.409471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ccd144df-dda4-4b81-87bd-8664704a816c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:00.428955 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ccd144df-dda4-4b81-87bd-8664704a816c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1554 microversion: 2.1 time: 0.193897 Jan 22 21:03:00.428955 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 477/953] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:00 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:00.428955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-030727ea-31e7-49e1-8121-bd5197f57a46 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:00.428955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-030727ea-31e7-49e1-8121-bd5197f57a46 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:00.434375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-030727ea-31e7-49e1-8121-bd5197f57a46 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:00.434829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-030727ea-31e7-49e1-8121-bd5197f57a46 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:00.435628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-030727ea-31e7-49e1-8121-bd5197f57a46 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:00.436072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-030727ea-31e7-49e1-8121-bd5197f57a46 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:00.595384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-030727ea-31e7-49e1-8121-bd5197f57a46 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:00.604732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-030727ea-31e7-49e1-8121-bd5197f57a46 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:00.619055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-030727ea-31e7-49e1-8121-bd5197f57a46 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:00.619055 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-030727ea-31e7-49e1-8121-bd5197f57a46 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.185038 Jan 22 21:03:00.619055 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 478/954] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:00 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:00.619055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e4ef9573-b3c8-4b94-99ff-dfae637ff314 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:00.619534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e4ef9573-b3c8-4b94-99ff-dfae637ff314 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:00.619701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-baf9c8ef-0157-4ecf-8721-511b508a5770 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:00.622627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4ef9573-b3c8-4b94-99ff-dfae637ff314 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:00.622980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4ef9573-b3c8-4b94-99ff-dfae637ff314 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:00.624051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4ef9573-b3c8-4b94-99ff-dfae637ff314 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:00.625283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4ef9573-b3c8-4b94-99ff-dfae637ff314 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:00.626682 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-baf9c8ef-0157-4ecf-8721-511b508a5770 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.573136 Jan 22 21:03:00.627440 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 477/955] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:00 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:00.669928 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e4ef9573-b3c8-4b94-99ff-dfae637ff314 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.060348 Jan 22 21:03:00.671093 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 479/956] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:00 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:00.909076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-82a60d08-6be8-4e3e-a289-93e613e0d474 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:00.909834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-82a60d08-6be8-4e3e-a289-93e613e0d474 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:00.916859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82a60d08-6be8-4e3e-a289-93e613e0d474 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:00.917362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82a60d08-6be8-4e3e-a289-93e613e0d474 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:00.918179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82a60d08-6be8-4e3e-a289-93e613e0d474 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:00.918637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82a60d08-6be8-4e3e-a289-93e613e0d474 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:01.174613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-50b9b8d1-223c-4496-b214-bbf367c80988 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:01.175599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-50b9b8d1-223c-4496-b214-bbf367c80988 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:01.184026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50b9b8d1-223c-4496-b214-bbf367c80988 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:01.184485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50b9b8d1-223c-4496-b214-bbf367c80988 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:01.185481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50b9b8d1-223c-4496-b214-bbf367c80988 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:01.186111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50b9b8d1-223c-4496-b214-bbf367c80988 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:01.383714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-82a60d08-6be8-4e3e-a289-93e613e0d474 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:01.400393 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-82a60d08-6be8-4e3e-a289-93e613e0d474 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.495678 Jan 22 21:03:01.401578 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 478/957] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:00 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:01.435593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0a496784-a3a6-4fe8-ba8f-83c753a6f538 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:01.436363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0a496784-a3a6-4fe8-ba8f-83c753a6f538 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:01.436564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-50b9b8d1-223c-4496-b214-bbf367c80988 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:01.442907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a496784-a3a6-4fe8-ba8f-83c753a6f538 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:01.443707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a496784-a3a6-4fe8-ba8f-83c753a6f538 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:01.444896 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-50b9b8d1-223c-4496-b214-bbf367c80988 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1355 microversion: 2.1 time: 0.274926 Jan 22 21:03:01.445619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a496784-a3a6-4fe8-ba8f-83c753a6f538 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:01.446312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a496784-a3a6-4fe8-ba8f-83c753a6f538 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:01.455117 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 480/958] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:01 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1355 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:01.627730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-334a0dea-ddb4-416d-9c99-243b346e7646 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:01.628536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-334a0dea-ddb4-416d-9c99-243b346e7646 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:01.631272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0a496784-a3a6-4fe8-ba8f-83c753a6f538 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:01.638375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-334a0dea-ddb4-416d-9c99-243b346e7646 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:01.639560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-334a0dea-ddb4-416d-9c99-243b346e7646 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:01.642490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-334a0dea-ddb4-416d-9c99-243b346e7646 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:01.643948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-334a0dea-ddb4-416d-9c99-243b346e7646 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:01.645888 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0a496784-a3a6-4fe8-ba8f-83c753a6f538 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1554 microversion: 2.1 time: 0.214140 Jan 22 21:03:01.647449 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 479/959] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:01 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1554 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:01.654704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-32e76fa8-131f-4bda-b288-f41df0b1b073 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:01.658373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-32e76fa8-131f-4bda-b288-f41df0b1b073 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:01.670417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32e76fa8-131f-4bda-b288-f41df0b1b073 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:01.672610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32e76fa8-131f-4bda-b288-f41df0b1b073 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:01.674629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32e76fa8-131f-4bda-b288-f41df0b1b073 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:01.675271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32e76fa8-131f-4bda-b288-f41df0b1b073 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:02.001861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-334a0dea-ddb4-416d-9c99-243b346e7646 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:02.008515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-32e76fa8-131f-4bda-b288-f41df0b1b073 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:02.011951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-334a0dea-ddb4-416d-9c99-243b346e7646 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:02.013849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-334a0dea-ddb4-416d-9c99-243b346e7646 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:02.016547 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-334a0dea-ddb4-416d-9c99-243b346e7646 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.392653 Jan 22 21:03:02.027668 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-32e76fa8-131f-4bda-b288-f41df0b1b073 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.370287 Jan 22 21:03:02.027668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 480/961] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:01 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:02.027945 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 481/961] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:01 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:03:02.035059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9009f3c3-5d86-43b5-9ca0-7e49a7ff7db9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:02.036059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9009f3c3-5d86-43b5-9ca0-7e49a7ff7db9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:02.042820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9009f3c3-5d86-43b5-9ca0-7e49a7ff7db9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:02.043310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9009f3c3-5d86-43b5-9ca0-7e49a7ff7db9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:02.044160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9009f3c3-5d86-43b5-9ca0-7e49a7ff7db9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:02.044600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9009f3c3-5d86-43b5-9ca0-7e49a7ff7db9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:02.089780 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9009f3c3-5d86-43b5-9ca0-7e49a7ff7db9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.066926 Jan 22 21:03:02.091648 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 481/962] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:02 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:02.092752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-fba46b5f-4821-4d3c-907f-ee5369d2973b req-e9ccbcb4-8ff0-4719-a668-b9eca880fc19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ff3712-7bf9-4973-8efb-b408f5a7532d", "tag": "9202e0cf-34b1-446b-8b3e-7b0dbb0b7c94"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:02.095134 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:02.095134 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:02.103325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-fba46b5f-4821-4d3c-907f-ee5369d2973b req-e9ccbcb4-8ff0-4719-a668-b9eca880fc19 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:02.103799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-fba46b5f-4821-4d3c-907f-ee5369d2973b req-e9ccbcb4-8ff0-4719-a668-b9eca880fc19 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:02.117950 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-fba46b5f-4821-4d3c-907f-ee5369d2973b req-e9ccbcb4-8ff0-4719-a668-b9eca880fc19 service nova] Creating event network-changed:9202e0cf-34b1-446b-8b3e-7b0dbb0b7c94 for instance 17ff3712-7bf9-4973-8efb-b408f5a7532d on nch1-master-1 Jan 22 21:03:02.122754 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-fba46b5f-4821-4d3c-907f-ee5369d2973b req-e9ccbcb4-8ff0-4719-a668-b9eca880fc19 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033673 Jan 22 21:03:02.123362 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 482/963] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:03:02.419505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-667e1656-32b6-429c-b889-927fc5a9748e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:02.420388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-667e1656-32b6-429c-b889-927fc5a9748e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:02.428518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-667e1656-32b6-429c-b889-927fc5a9748e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:02.428952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-667e1656-32b6-429c-b889-927fc5a9748e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:02.429865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-667e1656-32b6-429c-b889-927fc5a9748e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:02.430370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-667e1656-32b6-429c-b889-927fc5a9748e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:02.472198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-243ad4a0-a6eb-40ca-9195-0d0b38c5483a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:02.472198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-243ad4a0-a6eb-40ca-9195-0d0b38c5483a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:02.474020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-243ad4a0-a6eb-40ca-9195-0d0b38c5483a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:02.474477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-243ad4a0-a6eb-40ca-9195-0d0b38c5483a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:02.475311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-243ad4a0-a6eb-40ca-9195-0d0b38c5483a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:02.475832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-243ad4a0-a6eb-40ca-9195-0d0b38c5483a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:02.626016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-243ad4a0-a6eb-40ca-9195-0d0b38c5483a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:02.634199 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-243ad4a0-a6eb-40ca-9195-0d0b38c5483a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1355 microversion: 2.1 time: 0.176027 Jan 22 21:03:02.637904 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 483/964] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:02 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1355 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:02.664630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ccdb6a16-fb47-44e0-b860-dfb473b4c899 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:02.665746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ccdb6a16-fb47-44e0-b860-dfb473b4c899 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:02.677355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccdb6a16-fb47-44e0-b860-dfb473b4c899 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:02.677849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccdb6a16-fb47-44e0-b860-dfb473b4c899 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:02.683802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccdb6a16-fb47-44e0-b860-dfb473b4c899 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:02.683802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccdb6a16-fb47-44e0-b860-dfb473b4c899 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:02.726722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-667e1656-32b6-429c-b889-927fc5a9748e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:02.735018 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-667e1656-32b6-429c-b889-927fc5a9748e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.320457 Jan 22 21:03:02.736343 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 482/965] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:02 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:02.826430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ccdb6a16-fb47-44e0-b860-dfb473b4c899 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:02.835561 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ccdb6a16-fb47-44e0-b860-dfb473b4c899 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1554 microversion: 2.1 time: 0.175620 Jan 22 21:03:02.836134 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 484/966] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:02 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:03.035953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-62cc281a-37a5-45b6-8253-9d39b4e9d724 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:03.036685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-62cc281a-37a5-45b6-8253-9d39b4e9d724 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:03.036805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9e3e1fbb-dc8d-444e-b25a-54c02e05e2e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:03.037387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9e3e1fbb-dc8d-444e-b25a-54c02e05e2e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:03.044479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62cc281a-37a5-45b6-8253-9d39b4e9d724 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:03.044961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e3e1fbb-dc8d-444e-b25a-54c02e05e2e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:03.045381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e3e1fbb-dc8d-444e-b25a-54c02e05e2e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:03.049409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62cc281a-37a5-45b6-8253-9d39b4e9d724 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:03.049690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e3e1fbb-dc8d-444e-b25a-54c02e05e2e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:03.049787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62cc281a-37a5-45b6-8253-9d39b4e9d724 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:03.049881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e3e1fbb-dc8d-444e-b25a-54c02e05e2e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:03.050003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62cc281a-37a5-45b6-8253-9d39b4e9d724 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:03.226978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9e3e1fbb-dc8d-444e-b25a-54c02e05e2e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:03.237088 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9e3e1fbb-dc8d-444e-b25a-54c02e05e2e3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.203880 Jan 22 21:03:03.237849 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 485/967] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:03 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:03.243549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-841f883c-89e9-472e-b4fe-17c0fd13f467 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:03.251966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-841f883c-89e9-472e-b4fe-17c0fd13f467 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:03.258520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-841f883c-89e9-472e-b4fe-17c0fd13f467 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:03.259214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-841f883c-89e9-472e-b4fe-17c0fd13f467 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:03.260543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-841f883c-89e9-472e-b4fe-17c0fd13f467 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:03.260661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-841f883c-89e9-472e-b4fe-17c0fd13f467 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:03.310095 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-841f883c-89e9-472e-b4fe-17c0fd13f467 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.069337 Jan 22 21:03:03.311566 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 486/968] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:03 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:03.412069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-62cc281a-37a5-45b6-8253-9d39b4e9d724 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:03.429149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-62cc281a-37a5-45b6-8253-9d39b4e9d724 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:03.431597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-62cc281a-37a5-45b6-8253-9d39b4e9d724 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:03.433378 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-62cc281a-37a5-45b6-8253-9d39b4e9d724 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.401688 Jan 22 21:03:03.434323 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 483/969] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:03 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:03.652859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f3aab757-a225-40a7-9d47-3e43f32152e9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:03.653583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f3aab757-a225-40a7-9d47-3e43f32152e9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:03.661571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3aab757-a225-40a7-9d47-3e43f32152e9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:03.662429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3aab757-a225-40a7-9d47-3e43f32152e9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:03.663457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3aab757-a225-40a7-9d47-3e43f32152e9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:03.664117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3aab757-a225-40a7-9d47-3e43f32152e9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:03.765121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-243876c1-4676-43b7-acdb-0eb3098478dc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:03.770945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-243876c1-4676-43b7-acdb-0eb3098478dc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:03.781426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-243876c1-4676-43b7-acdb-0eb3098478dc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:03.784915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-243876c1-4676-43b7-acdb-0eb3098478dc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:03.786008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-243876c1-4676-43b7-acdb-0eb3098478dc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:03.786614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-243876c1-4676-43b7-acdb-0eb3098478dc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:03.862490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f3aab757-a225-40a7-9d47-3e43f32152e9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:03.875953 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f3aab757-a225-40a7-9d47-3e43f32152e9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1355 microversion: 2.1 time: 0.225523 Jan 22 21:03:03.876628 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 487/970] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:03 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1355 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:03.884861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6f74559-5745-475c-a9aa-b97393611639 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:03.886456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b6f74559-5745-475c-a9aa-b97393611639 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:03.898326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6f74559-5745-475c-a9aa-b97393611639 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:03.899149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6f74559-5745-475c-a9aa-b97393611639 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:03.900648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6f74559-5745-475c-a9aa-b97393611639 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:03.901267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6f74559-5745-475c-a9aa-b97393611639 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:04.050568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-243876c1-4676-43b7-acdb-0eb3098478dc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:04.065876 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-243876c1-4676-43b7-acdb-0eb3098478dc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.317375 Jan 22 21:03:04.066724 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 484/971] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:03 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:04.255660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-64d017db-7a41-4aeb-84a5-0c5a2e88cd49 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:04.255970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b6f74559-5745-475c-a9aa-b97393611639 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:04.256643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-64d017db-7a41-4aeb-84a5-0c5a2e88cd49 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:04.265994 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b6f74559-5745-475c-a9aa-b97393611639 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1554 microversion: 2.1 time: 0.387330 Jan 22 21:03:04.266588 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 488/972] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:03 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1554 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:04.277257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64d017db-7a41-4aeb-84a5-0c5a2e88cd49 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:04.277904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64d017db-7a41-4aeb-84a5-0c5a2e88cd49 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:04.278898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64d017db-7a41-4aeb-84a5-0c5a2e88cd49 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:04.279530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64d017db-7a41-4aeb-84a5-0c5a2e88cd49 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:04.322436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3d5af105-7036-4fe2-bc64-148d06ed1ecd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:04.323638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3d5af105-7036-4fe2-bc64-148d06ed1ecd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:04.335876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d5af105-7036-4fe2-bc64-148d06ed1ecd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:04.336396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d5af105-7036-4fe2-bc64-148d06ed1ecd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:04.337249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d5af105-7036-4fe2-bc64-148d06ed1ecd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:04.337774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d5af105-7036-4fe2-bc64-148d06ed1ecd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:04.400189 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3d5af105-7036-4fe2-bc64-148d06ed1ecd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.080899 Jan 22 21:03:04.400921 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 489/973] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:04 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:03:04.453208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1176aa86-c37b-4ab8-a7a7-a5ad10f6a62d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:04.454053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1176aa86-c37b-4ab8-a7a7-a5ad10f6a62d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:04.461161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1176aa86-c37b-4ab8-a7a7-a5ad10f6a62d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:04.461661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1176aa86-c37b-4ab8-a7a7-a5ad10f6a62d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:04.462476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1176aa86-c37b-4ab8-a7a7-a5ad10f6a62d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:04.463130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1176aa86-c37b-4ab8-a7a7-a5ad10f6a62d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:04.516308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-64d017db-7a41-4aeb-84a5-0c5a2e88cd49 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:04.525135 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-64d017db-7a41-4aeb-84a5-0c5a2e88cd49 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.273941 Jan 22 21:03:04.525899 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 485/974] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:04 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:04.636848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1176aa86-c37b-4ab8-a7a7-a5ad10f6a62d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:04.657896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1176aa86-c37b-4ab8-a7a7-a5ad10f6a62d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:04.661268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1176aa86-c37b-4ab8-a7a7-a5ad10f6a62d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:04.662747 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1176aa86-c37b-4ab8-a7a7-a5ad10f6a62d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.214202 Jan 22 21:03:04.664907 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 490/975] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:04 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:03:04.896081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ae5d54cc-8180-4a20-889d-309b55eca3a1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:04.896919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ae5d54cc-8180-4a20-889d-309b55eca3a1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:04.903465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae5d54cc-8180-4a20-889d-309b55eca3a1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:04.903926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae5d54cc-8180-4a20-889d-309b55eca3a1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:04.904739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae5d54cc-8180-4a20-889d-309b55eca3a1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:04.905189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae5d54cc-8180-4a20-889d-309b55eca3a1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:05.082636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d8d9bf06-e11c-414c-9c33-16301b6f8d89 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:05.083218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d8d9bf06-e11c-414c-9c33-16301b6f8d89 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:05.098559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8d9bf06-e11c-414c-9c33-16301b6f8d89 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:05.099039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8d9bf06-e11c-414c-9c33-16301b6f8d89 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:05.099865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8d9bf06-e11c-414c-9c33-16301b6f8d89 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:05.100316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8d9bf06-e11c-414c-9c33-16301b6f8d89 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:05.106089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ae5d54cc-8180-4a20-889d-309b55eca3a1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:05.116723 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ae5d54cc-8180-4a20-889d-309b55eca3a1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1355 microversion: 2.1 time: 0.227148 Jan 22 21:03:05.117307 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 486/976] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:04 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1355 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:05.283869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a3470915-0d4b-49f4-ad58-8c45f168583f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:05.284933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a3470915-0d4b-49f4-ad58-8c45f168583f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:05.303304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3470915-0d4b-49f4-ad58-8c45f168583f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:05.303837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3470915-0d4b-49f4-ad58-8c45f168583f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:05.304880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3470915-0d4b-49f4-ad58-8c45f168583f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:05.305299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3470915-0d4b-49f4-ad58-8c45f168583f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:05.507443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a3470915-0d4b-49f4-ad58-8c45f168583f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:05.520859 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a3470915-0d4b-49f4-ad58-8c45f168583f tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1554 microversion: 2.1 time: 0.241557 Jan 22 21:03:05.536340 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 487/977] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:05 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1554 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:05.544454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1a138621-a64e-410d-82e3-a4b6a9355fc5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:05.548307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1a138621-a64e-410d-82e3-a4b6a9355fc5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:05.560586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a138621-a64e-410d-82e3-a4b6a9355fc5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:05.562700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a138621-a64e-410d-82e3-a4b6a9355fc5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:05.563743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a138621-a64e-410d-82e3-a4b6a9355fc5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:05.564209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a138621-a64e-410d-82e3-a4b6a9355fc5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:05.617136 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1a138621-a64e-410d-82e3-a4b6a9355fc5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.077710 Jan 22 21:03:05.622005 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 488/978] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:05 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:05.629247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-41cb0be3-439a-40d7-8b7e-4fe916f0541f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:05.630603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-41cb0be3-439a-40d7-8b7e-4fe916f0541f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:05.638930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41cb0be3-439a-40d7-8b7e-4fe916f0541f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:05.639645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41cb0be3-439a-40d7-8b7e-4fe916f0541f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:05.640722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41cb0be3-439a-40d7-8b7e-4fe916f0541f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:05.641877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41cb0be3-439a-40d7-8b7e-4fe916f0541f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:05.696133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d8d9bf06-e11c-414c-9c33-16301b6f8d89 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:05.704459 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d8d9bf06-e11c-414c-9c33-16301b6f8d89 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.625648 Jan 22 21:03:05.707579 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 491/979] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:05 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:05.713891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f092158a-6039-457d-bf28-d3a7b8852d30 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:05.716564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f092158a-6039-457d-bf28-d3a7b8852d30 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:05.731761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f092158a-6039-457d-bf28-d3a7b8852d30 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:05.734749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f092158a-6039-457d-bf28-d3a7b8852d30 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:05.737620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f092158a-6039-457d-bf28-d3a7b8852d30 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:05.738247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f092158a-6039-457d-bf28-d3a7b8852d30 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:05.977516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-41cb0be3-439a-40d7-8b7e-4fe916f0541f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:05.989746 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-41cb0be3-439a-40d7-8b7e-4fe916f0541f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.365432 Jan 22 21:03:05.991105 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 489/980] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:05 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:06.006874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f092158a-6039-457d-bf28-d3a7b8852d30 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:06.017836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f092158a-6039-457d-bf28-d3a7b8852d30 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:06.021532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f092158a-6039-457d-bf28-d3a7b8852d30 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:06.021532 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f092158a-6039-457d-bf28-d3a7b8852d30 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.312120 Jan 22 21:03:06.022038 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 492/981] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:05 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:06.135898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4f785057-a57c-4787-8620-2ff0d4c31670 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:06.136793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4f785057-a57c-4787-8620-2ff0d4c31670 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:06.144408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f785057-a57c-4787-8620-2ff0d4c31670 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:06.145529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f785057-a57c-4787-8620-2ff0d4c31670 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:06.146510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f785057-a57c-4787-8620-2ff0d4c31670 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:06.147275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f785057-a57c-4787-8620-2ff0d4c31670 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:06.415687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4f785057-a57c-4787-8620-2ff0d4c31670 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:06.423294 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4f785057-a57c-4787-8620-2ff0d4c31670 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1355 microversion: 2.1 time: 0.292268 Jan 22 21:03:06.434114 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 490/982] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:06 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1355 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:06.537604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5780d10b-a203-4318-bb2d-f9e32feda104 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:06.538477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5780d10b-a203-4318-bb2d-f9e32feda104 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:06.553096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5780d10b-a203-4318-bb2d-f9e32feda104 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:06.553843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5780d10b-a203-4318-bb2d-f9e32feda104 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:06.554849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5780d10b-a203-4318-bb2d-f9e32feda104 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:06.555466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5780d10b-a203-4318-bb2d-f9e32feda104 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:06.631579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cd352cc3-d987-40b7-a88d-b9328a99ad70 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:06.633071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cd352cc3-d987-40b7-a88d-b9328a99ad70 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:06.642867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd352cc3-d987-40b7-a88d-b9328a99ad70 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:06.644334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd352cc3-d987-40b7-a88d-b9328a99ad70 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:06.645470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd352cc3-d987-40b7-a88d-b9328a99ad70 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:06.650927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd352cc3-d987-40b7-a88d-b9328a99ad70 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:06.737623 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cd352cc3-d987-40b7-a88d-b9328a99ad70 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.098061 Jan 22 21:03:06.737932 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 491/983] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:06 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:06.744548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-569244ea-a0a7-4b45-9b3b-6cb2d9492e5d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:06.747420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-569244ea-a0a7-4b45-9b3b-6cb2d9492e5d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:06.758012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-569244ea-a0a7-4b45-9b3b-6cb2d9492e5d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:06.758486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-569244ea-a0a7-4b45-9b3b-6cb2d9492e5d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:06.759309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-569244ea-a0a7-4b45-9b3b-6cb2d9492e5d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:06.759764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-569244ea-a0a7-4b45-9b3b-6cb2d9492e5d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:06.849595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5780d10b-a203-4318-bb2d-f9e32feda104 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:06.866703 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5780d10b-a203-4318-bb2d-f9e32feda104 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1554 microversion: 2.1 time: 0.332280 Jan 22 21:03:06.868262 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 493/984] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:06 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1554 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:06.963279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-569244ea-a0a7-4b45-9b3b-6cb2d9492e5d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:06.976840 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-569244ea-a0a7-4b45-9b3b-6cb2d9492e5d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.237233 Jan 22 21:03:06.987840 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 492/985] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:06 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:07.006800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bb9b8a1e-ece4-46f3-8d2e-b89023e28b9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:07.007386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bb9b8a1e-ece4-46f3-8d2e-b89023e28b9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:07.015742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb9b8a1e-ece4-46f3-8d2e-b89023e28b9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:07.016205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb9b8a1e-ece4-46f3-8d2e-b89023e28b9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:07.017051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb9b8a1e-ece4-46f3-8d2e-b89023e28b9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:07.017540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb9b8a1e-ece4-46f3-8d2e-b89023e28b9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:07.039543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-46d2321e-0138-4cf9-93e1-db0d470542fb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:07.041675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-46d2321e-0138-4cf9-93e1-db0d470542fb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:07.047740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-46d2321e-0138-4cf9-93e1-db0d470542fb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:07.048206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-46d2321e-0138-4cf9-93e1-db0d470542fb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:07.057760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-46d2321e-0138-4cf9-93e1-db0d470542fb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:07.058295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-46d2321e-0138-4cf9-93e1-db0d470542fb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:07.299997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bb9b8a1e-ece4-46f3-8d2e-b89023e28b9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:07.313763 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bb9b8a1e-ece4-46f3-8d2e-b89023e28b9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.306583 Jan 22 21:03:07.324521 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 494/986] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:07 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:07.385204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-46d2321e-0138-4cf9-93e1-db0d470542fb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:07.399209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-46d2321e-0138-4cf9-93e1-db0d470542fb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:07.401494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-46d2321e-0138-4cf9-93e1-db0d470542fb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:07.403013 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-46d2321e-0138-4cf9-93e1-db0d470542fb tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.367251 Jan 22 21:03:07.405351 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 493/987] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:07 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:07.442728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-488556c0-3bae-4da1-8e54-c6e2525de6e8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:07.443603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-488556c0-3bae-4da1-8e54-c6e2525de6e8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:07.450768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-488556c0-3bae-4da1-8e54-c6e2525de6e8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:07.451547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-488556c0-3bae-4da1-8e54-c6e2525de6e8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:07.453769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-488556c0-3bae-4da1-8e54-c6e2525de6e8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:07.454563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-488556c0-3bae-4da1-8e54-c6e2525de6e8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:07.651173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-488556c0-3bae-4da1-8e54-c6e2525de6e8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:07.657619 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-488556c0-3bae-4da1-8e54-c6e2525de6e8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1355 microversion: 2.1 time: 0.218442 Jan 22 21:03:07.659250 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 495/988] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:07 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1355 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:07.751526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee614b31-d322-4ed4-842e-13516d053139 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:07.752916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ee614b31-d322-4ed4-842e-13516d053139 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:07.763450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee614b31-d322-4ed4-842e-13516d053139 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:07.764150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee614b31-d322-4ed4-842e-13516d053139 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:07.765520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee614b31-d322-4ed4-842e-13516d053139 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:07.766871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee614b31-d322-4ed4-842e-13516d053139 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:07.818975 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee614b31-d322-4ed4-842e-13516d053139 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.073188 Jan 22 21:03:07.819651 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 494/989] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:07 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:03:07.884026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb2036a4-abe6-437b-8139-4634360c0eb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:07.885452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fb2036a4-abe6-437b-8139-4634360c0eb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:07.898531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb2036a4-abe6-437b-8139-4634360c0eb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:07.899336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb2036a4-abe6-437b-8139-4634360c0eb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:07.902276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb2036a4-abe6-437b-8139-4634360c0eb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:07.903154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb2036a4-abe6-437b-8139-4634360c0eb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:07.997319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e91cdace-1bbc-46a2-992c-5c6bce1999f5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:07.998662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e91cdace-1bbc-46a2-992c-5c6bce1999f5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:08.011276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e91cdace-1bbc-46a2-992c-5c6bce1999f5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:08.012902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e91cdace-1bbc-46a2-992c-5c6bce1999f5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:08.014142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e91cdace-1bbc-46a2-992c-5c6bce1999f5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:08.014904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e91cdace-1bbc-46a2-992c-5c6bce1999f5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:08.182416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fb2036a4-abe6-437b-8139-4634360c0eb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:08.192891 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fb2036a4-abe6-437b-8139-4634360c0eb8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1554 microversion: 2.1 time: 0.312597 Jan 22 21:03:08.194323 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 496/990] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:07 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1554 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:08.229097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e91cdace-1bbc-46a2-992c-5c6bce1999f5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:08.239551 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e91cdace-1bbc-46a2-992c-5c6bce1999f5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.247513 Jan 22 21:03:08.240726 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 495/991] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:07 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:08.331629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0a30c402-cf1c-4045-bc81-4a95de46287d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:08.332560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0a30c402-cf1c-4045-bc81-4a95de46287d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:08.338799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a30c402-cf1c-4045-bc81-4a95de46287d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:08.339309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a30c402-cf1c-4045-bc81-4a95de46287d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:08.340348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a30c402-cf1c-4045-bc81-4a95de46287d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:08.340850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a30c402-cf1c-4045-bc81-4a95de46287d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:08.425013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e9bd1823-2488-4318-a60e-34f0aa52f7d9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:08.425826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e9bd1823-2488-4318-a60e-34f0aa52f7d9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:08.437195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9bd1823-2488-4318-a60e-34f0aa52f7d9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:08.437770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9bd1823-2488-4318-a60e-34f0aa52f7d9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:08.438614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9bd1823-2488-4318-a60e-34f0aa52f7d9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:08.439241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9bd1823-2488-4318-a60e-34f0aa52f7d9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:08.541317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0a30c402-cf1c-4045-bc81-4a95de46287d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:08.554659 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0a30c402-cf1c-4045-bc81-4a95de46287d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.227419 Jan 22 21:03:08.556607 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 497/992] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:08 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:08.600393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-afcbdf22-2e3f-498b-9ad2-444adc8e765b req-3f74b7c5-4d14-4784-b989-cd27fb4edc93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ff3712-7bf9-4973-8efb-b408f5a7532d", "name": "network-vif-plugged", "status": "completed", "tag": "9202e0cf-34b1-446b-8b3e-7b0dbb0b7c94"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:08.602056 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:08.602056 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:08.615890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-afcbdf22-2e3f-498b-9ad2-444adc8e765b req-3f74b7c5-4d14-4784-b989-cd27fb4edc93 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:08.616312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-afcbdf22-2e3f-498b-9ad2-444adc8e765b req-3f74b7c5-4d14-4784-b989-cd27fb4edc93 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:08.646315 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-afcbdf22-2e3f-498b-9ad2-444adc8e765b req-3f74b7c5-4d14-4784-b989-cd27fb4edc93 service nova] Creating event network-vif-plugged:9202e0cf-34b1-446b-8b3e-7b0dbb0b7c94 for instance 17ff3712-7bf9-4973-8efb-b408f5a7532d on nch1-master-1 Jan 22 21:03:08.653276 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-afcbdf22-2e3f-498b-9ad2-444adc8e765b req-3f74b7c5-4d14-4784-b989-cd27fb4edc93 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056450 Jan 22 21:03:08.654249 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 498/993] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:08.681077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4625dbe4-a2ce-43ad-9a5b-2ac3bdffa17c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:08.682291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4625dbe4-a2ce-43ad-9a5b-2ac3bdffa17c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:08.707702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4625dbe4-a2ce-43ad-9a5b-2ac3bdffa17c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:08.710735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4625dbe4-a2ce-43ad-9a5b-2ac3bdffa17c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:08.721613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4625dbe4-a2ce-43ad-9a5b-2ac3bdffa17c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:08.725121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4625dbe4-a2ce-43ad-9a5b-2ac3bdffa17c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:08.962083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e9bd1823-2488-4318-a60e-34f0aa52f7d9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:08.972788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e9bd1823-2488-4318-a60e-34f0aa52f7d9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:08.982861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e9bd1823-2488-4318-a60e-34f0aa52f7d9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:08.990296 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e9bd1823-2488-4318-a60e-34f0aa52f7d9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.569758 Jan 22 21:03:09.002293 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 496/994] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:08 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:03:09.010579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eb8a1d73-ec1c-4ca7-bdf8-592e75df8748 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:09.011539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eb8a1d73-ec1c-4ca7-bdf8-592e75df8748 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:09.033312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb8a1d73-ec1c-4ca7-bdf8-592e75df8748 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:09.033974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb8a1d73-ec1c-4ca7-bdf8-592e75df8748 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:09.034851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb8a1d73-ec1c-4ca7-bdf8-592e75df8748 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:09.035381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb8a1d73-ec1c-4ca7-bdf8-592e75df8748 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:09.052087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4625dbe4-a2ce-43ad-9a5b-2ac3bdffa17c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:09.062001 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4625dbe4-a2ce-43ad-9a5b-2ac3bdffa17c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1355 microversion: 2.1 time: 0.389007 Jan 22 21:03:09.062772 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 499/995] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:08 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1355 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:09.107665 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eb8a1d73-ec1c-4ca7-bdf8-592e75df8748 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.103897 Jan 22 21:03:09.113460 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 497/996] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:09 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:09.211201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fbed1ba1-b681-4ef0-bc9f-eabd7f88d615 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:09.211902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fbed1ba1-b681-4ef0-bc9f-eabd7f88d615 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:09.220258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbed1ba1-b681-4ef0-bc9f-eabd7f88d615 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:09.221132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbed1ba1-b681-4ef0-bc9f-eabd7f88d615 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:09.221978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbed1ba1-b681-4ef0-bc9f-eabd7f88d615 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:09.222424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbed1ba1-b681-4ef0-bc9f-eabd7f88d615 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:09.288530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9ca31ffa-b470-47f9-8bf5-823e091d6ffb tempest-NetworksTest-837866100 tempest-NetworksTest-837866100-project-admin] Calling method '.version_select at 0x7f1ed5eb2e50>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:09.413817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fbed1ba1-b681-4ef0-bc9f-eabd7f88d615 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:09.424584 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fbed1ba1-b681-4ef0-bc9f-eabd7f88d615 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1544 microversion: 2.1 time: 0.217662 Jan 22 21:03:09.433722 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 498/997] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:09 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1544 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:09.433722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e8790be5-0e79-4785-bfd3-d2efcabaacee tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:09.433722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e8790be5-0e79-4785-bfd3-d2efcabaacee tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:09.439530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8790be5-0e79-4785-bfd3-d2efcabaacee tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:09.440138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8790be5-0e79-4785-bfd3-d2efcabaacee tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:09.441257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8790be5-0e79-4785-bfd3-d2efcabaacee tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:09.441875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8790be5-0e79-4785-bfd3-d2efcabaacee tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:09.455396 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9ca31ffa-b470-47f9-8bf5-823e091d6ffb tempest-NetworksTest-837866100 tempest-NetworksTest-837866100-project-admin] 10.222.0.100 "GET /compute/v2.1/os-networks" status: 200 len: 8792 microversion: 2.1 time: 0.387797 Jan 22 21:03:09.459939 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 500/998] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:03:09 2022] GET /compute/v2.1/os-networks => generated 8792 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:09.518569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eb425ba8-b917-4e8f-a9f5-fb5d39f815b9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'create', calling method: .version_select at 0x7f1ed6177dc0>, body: {"keypair": {"name": "tempest-keypair-793673175"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:09.533406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-eb425ba8-b917-4e8f-a9f5-fb5d39f815b9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Getting quotas for project c864966e7b1a471cb496ac2242826ab6. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:03:09.540871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-eb425ba8-b917-4e8f-a9f5-fb5d39f815b9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Getting quotas for user c3903d47f1514112b91f2ea281591bb9 and project c864966e7b1a471cb496ac2242826ab6. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:03:09.596806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e8790be5-0e79-4785-bfd3-d2efcabaacee tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:09.605160 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e8790be5-0e79-4785-bfd3-d2efcabaacee tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.178017 Jan 22 21:03:09.606076 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 499/999] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:09 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:09.610631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a05a4313-ec9d-4bac-8325-12662ee6cb2f tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '.version_select at 0x7f1ed6334430>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:09.612636 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:09.612636 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:03:09.614546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a05a4313-ec9d-4bac-8325-12662ee6cb2f tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:09.615190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a05a4313-ec9d-4bac-8325-12662ee6cb2f tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:09.626710 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a05a4313-ec9d-4bac-8325-12662ee6cb2f tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/os-migrations" status: 200 len: 2306 microversion: 2.1 time: 0.019594 Jan 22 21:03:09.627329 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 500/1000] 10.222.0.100 () {58 vars in 1147 bytes} [Sat Jan 22 21:03:09 2022] GET /compute/v2.1/os-migrations => generated 2306 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:09.638808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a84e239b-bcc7-4d0e-ad46-ee4f97d4752b tempest-NetworksTest-837866100 tempest-NetworksTest-837866100-project-admin] Calling method '.version_select at 0x7f1ed61a8310>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:09.770977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-eb425ba8-b917-4e8f-a9f5-fb5d39f815b9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Getting quotas for project c864966e7b1a471cb496ac2242826ab6. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:03:09.774048 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a84e239b-bcc7-4d0e-ad46-ee4f97d4752b tempest-NetworksTest-837866100 tempest-NetworksTest-837866100-project-admin] 10.222.0.100 "GET /compute/v2.1/os-networks/7238f98a-601e-4ad2-8860-b11b52ffa4fe" status: 200 len: 652 microversion: 2.1 time: 0.145316 Jan 22 21:03:09.778817 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 501/1001] 10.222.0.100 () {58 vars in 1252 bytes} [Sat Jan 22 21:03:09 2022] GET /compute/v2.1/os-networks/7238f98a-601e-4ad2-8860-b11b52ffa4fe => generated 652 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:09.783761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-daa8b3a5-6e45-4750-b195-4a1bad638410 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:09.785658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-daa8b3a5-6e45-4750-b195-4a1bad638410 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:09.786735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-eb425ba8-b917-4e8f-a9f5-fb5d39f815b9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Getting quotas for user c3903d47f1514112b91f2ea281591bb9 and project c864966e7b1a471cb496ac2242826ab6. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:03:09.795147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa8b3a5-6e45-4750-b195-4a1bad638410 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:09.795944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa8b3a5-6e45-4750-b195-4a1bad638410 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:09.798509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa8b3a5-6e45-4750-b195-4a1bad638410 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:09.799132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa8b3a5-6e45-4750-b195-4a1bad638410 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:09.808377 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eb425ba8-b917-4e8f-a9f5-fb5d39f815b9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.350443 Jan 22 21:03:09.814801 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 501/1002] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:03:09 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:09.816297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-71df79f4-4101-45d7-a7d1-759c40065cdc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:09.816970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-71df79f4-4101-45d7-a7d1-759c40065cdc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:09.825156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71df79f4-4101-45d7-a7d1-759c40065cdc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:09.825780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71df79f4-4101-45d7-a7d1-759c40065cdc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:09.826983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71df79f4-4101-45d7-a7d1-759c40065cdc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:09.829791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71df79f4-4101-45d7-a7d1-759c40065cdc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:09.976832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-daa8b3a5-6e45-4750-b195-4a1bad638410 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:09.993322 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-daa8b3a5-6e45-4750-b195-4a1bad638410 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.216808 Jan 22 21:03:09.994171 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 502/1003] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:09 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:09.998787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b8cdba1d-4f8f-4413-aff4-be7c9cb0c5ab tempest-NetworksTest-837866100 tempest-NetworksTest-837866100-project-admin] Calling method '.version_select at 0x7f1ed6033b80>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:10.035922 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-71df79f4-4101-45d7-a7d1-759c40065cdc tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1695 microversion: 2.1 time: 0.225251 Jan 22 21:03:10.037155 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 502/1004] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:09 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1695 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:10.041874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b38f28d1-a0f0-429a-a384-521d4ff647ff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:10.042715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b38f28d1-a0f0-429a-a384-521d4ff647ff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:10.055211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b38f28d1-a0f0-429a-a384-521d4ff647ff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:10.057811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b38f28d1-a0f0-429a-a384-521d4ff647ff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:10.058918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b38f28d1-a0f0-429a-a384-521d4ff647ff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:10.059381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b38f28d1-a0f0-429a-a384-521d4ff647ff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:10.239981 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b8cdba1d-4f8f-4413-aff4-be7c9cb0c5ab tempest-NetworksTest-837866100 tempest-NetworksTest-837866100-project-admin] 10.222.0.100 "GET /compute/v2.1/os-networks" status: 200 len: 8792 microversion: 2.1 time: 0.244561 Jan 22 21:03:10.241478 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 503/1005] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:03:09 2022] GET /compute/v2.1/os-networks => generated 8792 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:10.269614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-23f4d39a-9f83-4bf1-9c4a-4c04a1da0803 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:10.272905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-23f4d39a-9f83-4bf1-9c4a-4c04a1da0803 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:10.286113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23f4d39a-9f83-4bf1-9c4a-4c04a1da0803 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:10.286469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23f4d39a-9f83-4bf1-9c4a-4c04a1da0803 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:10.288596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23f4d39a-9f83-4bf1-9c4a-4c04a1da0803 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:10.293763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23f4d39a-9f83-4bf1-9c4a-4c04a1da0803 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:10.318240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b38f28d1-a0f0-429a-a384-521d4ff647ff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:10.329959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b38f28d1-a0f0-429a-a384-521d4ff647ff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:10.331477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b38f28d1-a0f0-429a-a384-521d4ff647ff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:10.332657 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b38f28d1-a0f0-429a-a384-521d4ff647ff tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.294266 Jan 22 21:03:10.333425 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 503/1006] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:10 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:10.349253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-541ad8b6-aabc-4782-aa6e-602140d49bf9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:10.349930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-541ad8b6-aabc-4782-aa6e-602140d49bf9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:10.356051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-541ad8b6-aabc-4782-aa6e-602140d49bf9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:10.356829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-541ad8b6-aabc-4782-aa6e-602140d49bf9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:10.357687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-541ad8b6-aabc-4782-aa6e-602140d49bf9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:10.358132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-541ad8b6-aabc-4782-aa6e-602140d49bf9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:10.552388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-541ad8b6-aabc-4782-aa6e-602140d49bf9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:10.559772 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-541ad8b6-aabc-4782-aa6e-602140d49bf9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1355 microversion: 2.1 time: 0.225265 Jan 22 21:03:10.560685 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 504/1007] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:10 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1355 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:10.567146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0810fa59-4c43-4306-8d4b-5a8915ecfac0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:10.568684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0810fa59-4c43-4306-8d4b-5a8915ecfac0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:10.575596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0810fa59-4c43-4306-8d4b-5a8915ecfac0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:10.576047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0810fa59-4c43-4306-8d4b-5a8915ecfac0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:10.576856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0810fa59-4c43-4306-8d4b-5a8915ecfac0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:10.577968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0810fa59-4c43-4306-8d4b-5a8915ecfac0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:10.623922 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0810fa59-4c43-4306-8d4b-5a8915ecfac0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.061766 Jan 22 21:03:10.628372 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 505/1008] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:10 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:10.635657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d5fe812-9809-4684-a6c5-a71b6878a226 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:10.636654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d5fe812-9809-4684-a6c5-a71b6878a226 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:10.645249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d5fe812-9809-4684-a6c5-a71b6878a226 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:10.645798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d5fe812-9809-4684-a6c5-a71b6878a226 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:10.646622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d5fe812-9809-4684-a6c5-a71b6878a226 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:10.647082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d5fe812-9809-4684-a6c5-a71b6878a226 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:10.810385 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-23f4d39a-9f83-4bf1-9c4a-4c04a1da0803 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1695 microversion: 2.1 time: 0.567499 Jan 22 21:03:10.811209 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 504/1009] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:10 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1695 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:10.904688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0d5fe812-9809-4684-a6c5-a71b6878a226 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:10.912046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e420916e-63ff-4d7b-85f5-0eca63aa5174 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:10.913926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e420916e-63ff-4d7b-85f5-0eca63aa5174 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:10.931212 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d5fe812-9809-4684-a6c5-a71b6878a226 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.298657 Jan 22 21:03:10.933086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e420916e-63ff-4d7b-85f5-0eca63aa5174 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:10.934365 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 506/1010] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:10 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:10.935111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e420916e-63ff-4d7b-85f5-0eca63aa5174 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:10.937276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e420916e-63ff-4d7b-85f5-0eca63aa5174 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:10.938543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e420916e-63ff-4d7b-85f5-0eca63aa5174 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:11.011772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-03c95dad-0d8f-48cf-b225-f5eeb4b5196b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:11.012595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-03c95dad-0d8f-48cf-b225-f5eeb4b5196b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:11.020168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03c95dad-0d8f-48cf-b225-f5eeb4b5196b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:11.020844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03c95dad-0d8f-48cf-b225-f5eeb4b5196b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:11.021998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03c95dad-0d8f-48cf-b225-f5eeb4b5196b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:11.022444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03c95dad-0d8f-48cf-b225-f5eeb4b5196b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:11.103736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-e420916e-63ff-4d7b-85f5-0eca63aa5174 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lazy-loading 'services' on Instance uuid 184726b1-102f-49b3-ae81-7b721c165473 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:03:11.239375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-03c95dad-0d8f-48cf-b225-f5eeb4b5196b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:11.252711 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-03c95dad-0d8f-48cf-b225-f5eeb4b5196b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1517 microversion: 2.1 time: 0.245350 Jan 22 21:03:11.253708 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 507/1011] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:11 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1517 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:11.352975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1611aca5-6dfd-4080-bddc-bef7d65a92fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:11.353647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1611aca5-6dfd-4080-bddc-bef7d65a92fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:11.363143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1611aca5-6dfd-4080-bddc-bef7d65a92fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:11.363597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1611aca5-6dfd-4080-bddc-bef7d65a92fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:11.364443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1611aca5-6dfd-4080-bddc-bef7d65a92fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:11.365079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1611aca5-6dfd-4080-bddc-bef7d65a92fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:11.486425 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e420916e-63ff-4d7b-85f5-0eca63aa5174 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "DELETE /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473/os-volume_attachments/ce68f69a-0548-4980-9511-4b7d28d8afda" status: 202 len: 0 microversion: 2.1 time: 0.583746 Jan 22 21:03:11.486956 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 505/1012] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 21:03:10 2022] DELETE /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473/os-volume_attachments/ce68f69a-0548-4980-9511-4b7d28d8afda => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:03:11.501260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cd45acfa-dbc5-496d-babd-e600eb59874e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:11.502607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cd45acfa-dbc5-496d-babd-e600eb59874e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:11.522247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd45acfa-dbc5-496d-babd-e600eb59874e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:11.522839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd45acfa-dbc5-496d-babd-e600eb59874e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:11.523734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd45acfa-dbc5-496d-babd-e600eb59874e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:11.524264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd45acfa-dbc5-496d-babd-e600eb59874e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:11.534574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1611aca5-6dfd-4080-bddc-bef7d65a92fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:11.562884 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cd45acfa-dbc5-496d-babd-e600eb59874e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070197 Jan 22 21:03:11.565557 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 506/1013] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:03:11 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:03:11.571009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1611aca5-6dfd-4080-bddc-bef7d65a92fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:11.575565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1611aca5-6dfd-4080-bddc-bef7d65a92fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:11.577415 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1611aca5-6dfd-4080-bddc-bef7d65a92fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.227994 Jan 22 21:03:11.585548 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 508/1014] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:11 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:03:11.593854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fdb62c82-234c-4f4a-bf07-624477810311 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:11.596736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fdb62c82-234c-4f4a-bf07-624477810311 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:11.603024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fdb62c82-234c-4f4a-bf07-624477810311 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:11.603482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fdb62c82-234c-4f4a-bf07-624477810311 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:11.604675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fdb62c82-234c-4f4a-bf07-624477810311 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:11.604810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fdb62c82-234c-4f4a-bf07-624477810311 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:11.637135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cc4e9f8d-f989-4a44-977a-c1dde2485b7b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:11.638241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cc4e9f8d-f989-4a44-977a-c1dde2485b7b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:11.651269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc4e9f8d-f989-4a44-977a-c1dde2485b7b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:11.652791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc4e9f8d-f989-4a44-977a-c1dde2485b7b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:11.653764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc4e9f8d-f989-4a44-977a-c1dde2485b7b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:11.655865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc4e9f8d-f989-4a44-977a-c1dde2485b7b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:11.750076 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cc4e9f8d-f989-4a44-977a-c1dde2485b7b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.115704 Jan 22 21:03:11.751200 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 509/1015] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:11 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:11.908337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fdb62c82-234c-4f4a-bf07-624477810311 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:11.917218 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fdb62c82-234c-4f4a-bf07-624477810311 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1545 microversion: 2.1 time: 0.344748 Jan 22 21:03:11.918414 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 507/1016] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:11 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1545 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:11.938723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-04f0e228-ce38-43a6-88f7-f8d52610e372 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:11.939322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-04f0e228-ce38-43a6-88f7-f8d52610e372 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:11.950950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-abedb63a-59bb-4d53-b555-e536055009fe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:11.951891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-abedb63a-59bb-4d53-b555-e536055009fe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:11.962797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f0e228-ce38-43a6-88f7-f8d52610e372 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:11.963263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f0e228-ce38-43a6-88f7-f8d52610e372 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:11.964083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f0e228-ce38-43a6-88f7-f8d52610e372 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:11.964527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f0e228-ce38-43a6-88f7-f8d52610e372 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:11.981347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abedb63a-59bb-4d53-b555-e536055009fe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:11.982289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abedb63a-59bb-4d53-b555-e536055009fe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:11.983542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abedb63a-59bb-4d53-b555-e536055009fe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:11.984903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abedb63a-59bb-4d53-b555-e536055009fe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:12.204096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-abedb63a-59bb-4d53-b555-e536055009fe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:12.213972 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-abedb63a-59bb-4d53-b555-e536055009fe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.268192 Jan 22 21:03:12.221519 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 508/1017] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:11 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:12.278726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-75607617-9c5f-4830-9364-9694b83fd275 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:12.282822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-75607617-9c5f-4830-9364-9694b83fd275 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:12.301189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75607617-9c5f-4830-9364-9694b83fd275 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:12.303510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75607617-9c5f-4830-9364-9694b83fd275 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:12.304517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75607617-9c5f-4830-9364-9694b83fd275 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:12.306404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75607617-9c5f-4830-9364-9694b83fd275 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:12.534944 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-04f0e228-ce38-43a6-88f7-f8d52610e372 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.601170 Jan 22 21:03:12.542420 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 510/1018] 10.222.0.100 () {58 vars in 1279 bytes} [Sat Jan 22 21:03:11 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/os-interface => generated 284 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:12.576692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3289b7c8-7d6c-476b-b271-fe82f420717e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:12.578516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3289b7c8-7d6c-476b-b271-fe82f420717e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:12.588474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3289b7c8-7d6c-476b-b271-fe82f420717e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:12.588929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3289b7c8-7d6c-476b-b271-fe82f420717e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:12.589776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3289b7c8-7d6c-476b-b271-fe82f420717e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:12.590224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3289b7c8-7d6c-476b-b271-fe82f420717e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:12.610494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-75607617-9c5f-4830-9364-9694b83fd275 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:12.624789 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-75607617-9c5f-4830-9364-9694b83fd275 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1523 microversion: 2.1 time: 0.355503 Jan 22 21:03:12.633383 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 509/1019] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:12 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1523 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:12.638163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-64ba09f6-465b-41b5-8e57-609e2d94eee5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:12.644535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-64ba09f6-465b-41b5-8e57-609e2d94eee5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:12.659501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64ba09f6-465b-41b5-8e57-609e2d94eee5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:12.659973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64ba09f6-465b-41b5-8e57-609e2d94eee5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:12.660801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64ba09f6-465b-41b5-8e57-609e2d94eee5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:12.661252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64ba09f6-465b-41b5-8e57-609e2d94eee5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:12.721677 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3289b7c8-7d6c-476b-b271-fe82f420717e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149879 Jan 22 21:03:12.722557 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 511/1020] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:03:12 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:12.761476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c32f88a7-ebe6-4cda-a08c-5e7fa1aa3b5a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:12.762545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c32f88a7-ebe6-4cda-a08c-5e7fa1aa3b5a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:12.777429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c32f88a7-ebe6-4cda-a08c-5e7fa1aa3b5a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:12.777937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c32f88a7-ebe6-4cda-a08c-5e7fa1aa3b5a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:12.779027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c32f88a7-ebe6-4cda-a08c-5e7fa1aa3b5a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:12.779692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c32f88a7-ebe6-4cda-a08c-5e7fa1aa3b5a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:12.830561 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c32f88a7-ebe6-4cda-a08c-5e7fa1aa3b5a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.072002 Jan 22 21:03:12.831811 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 512/1021] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:12 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:12.939795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-64ba09f6-465b-41b5-8e57-609e2d94eee5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:12.949325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-64ba09f6-465b-41b5-8e57-609e2d94eee5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:12.956583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-64ba09f6-465b-41b5-8e57-609e2d94eee5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:12.964886 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-64ba09f6-465b-41b5-8e57-609e2d94eee5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.330066 Jan 22 21:03:12.977229 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 510/1022] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:12 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:13.240269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5b00b398-da84-4cd0-9240-72f6b433ca4a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:13.241154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5b00b398-da84-4cd0-9240-72f6b433ca4a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:13.259213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b00b398-da84-4cd0-9240-72f6b433ca4a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:13.259919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b00b398-da84-4cd0-9240-72f6b433ca4a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:13.261285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b00b398-da84-4cd0-9240-72f6b433ca4a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:13.261547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b00b398-da84-4cd0-9240-72f6b433ca4a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:13.602521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5b00b398-da84-4cd0-9240-72f6b433ca4a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:13.611109 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5b00b398-da84-4cd0-9240-72f6b433ca4a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.375428 Jan 22 21:03:13.611701 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 513/1023] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:13 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:13.640803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-62e995d5-7a64-43a5-b5b7-37e79cd55476 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:13.641457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-62e995d5-7a64-43a5-b5b7-37e79cd55476 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:13.648857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62e995d5-7a64-43a5-b5b7-37e79cd55476 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:13.649380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62e995d5-7a64-43a5-b5b7-37e79cd55476 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:13.650129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62e995d5-7a64-43a5-b5b7-37e79cd55476 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:13.650569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62e995d5-7a64-43a5-b5b7-37e79cd55476 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:13.733117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-55ba5051-d6c5-4e51-aaf8-71a05d860ea3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:13.735345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-55ba5051-d6c5-4e51-aaf8-71a05d860ea3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:13.744740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55ba5051-d6c5-4e51-aaf8-71a05d860ea3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:13.745565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55ba5051-d6c5-4e51-aaf8-71a05d860ea3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:13.751297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55ba5051-d6c5-4e51-aaf8-71a05d860ea3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:13.751297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55ba5051-d6c5-4e51-aaf8-71a05d860ea3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:13.832809 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-55ba5051-d6c5-4e51-aaf8-71a05d860ea3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103582 Jan 22 21:03:13.844598 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 514/1024] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:03:13 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:03:13.854844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-59b7aeb4-d287-4e5f-9c64-a9d7eb96bd93 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:13.872944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-59b7aeb4-d287-4e5f-9c64-a9d7eb96bd93 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:13.889130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59b7aeb4-d287-4e5f-9c64-a9d7eb96bd93 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:13.891709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59b7aeb4-d287-4e5f-9c64-a9d7eb96bd93 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:13.892892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59b7aeb4-d287-4e5f-9c64-a9d7eb96bd93 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:13.894383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59b7aeb4-d287-4e5f-9c64-a9d7eb96bd93 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:13.946341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-62e995d5-7a64-43a5-b5b7-37e79cd55476 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:13.957679 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-62e995d5-7a64-43a5-b5b7-37e79cd55476 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1523 microversion: 2.1 time: 0.321320 Jan 22 21:03:13.959564 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 511/1025] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:13 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:13.985829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fc098aaf-27b6-40c7-a7c6-93689baddb27 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:13.986453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fc098aaf-27b6-40c7-a7c6-93689baddb27 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:13.988642 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-59b7aeb4-d287-4e5f-9c64-a9d7eb96bd93 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.135297 Jan 22 21:03:13.994076 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 515/1026] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:13 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:13.995809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc098aaf-27b6-40c7-a7c6-93689baddb27 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:13.996255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc098aaf-27b6-40c7-a7c6-93689baddb27 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:13.998768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc098aaf-27b6-40c7-a7c6-93689baddb27 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:14.001552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc098aaf-27b6-40c7-a7c6-93689baddb27 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:14.251851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fc098aaf-27b6-40c7-a7c6-93689baddb27 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:14.266548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fc098aaf-27b6-40c7-a7c6-93689baddb27 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:14.268095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fc098aaf-27b6-40c7-a7c6-93689baddb27 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:14.273902 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fc098aaf-27b6-40c7-a7c6-93689baddb27 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.292969 Jan 22 21:03:14.290646 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 512/1027] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:13 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:14.629275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d4102aa7-bb2f-4c95-9fc7-8110b2b34ffd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:14.629952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d4102aa7-bb2f-4c95-9fc7-8110b2b34ffd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:14.636519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4102aa7-bb2f-4c95-9fc7-8110b2b34ffd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:14.636982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4102aa7-bb2f-4c95-9fc7-8110b2b34ffd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:14.637816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4102aa7-bb2f-4c95-9fc7-8110b2b34ffd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:14.638279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4102aa7-bb2f-4c95-9fc7-8110b2b34ffd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:14.859322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f3151753-c8ea-4b8e-8ad9-7091fc02e9e8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:14.860369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f3151753-c8ea-4b8e-8ad9-7091fc02e9e8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:14.878264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3151753-c8ea-4b8e-8ad9-7091fc02e9e8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:14.878913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3151753-c8ea-4b8e-8ad9-7091fc02e9e8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:14.884108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3151753-c8ea-4b8e-8ad9-7091fc02e9e8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:14.884834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3151753-c8ea-4b8e-8ad9-7091fc02e9e8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:14.915798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d4102aa7-bb2f-4c95-9fc7-8110b2b34ffd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:14.926441 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d4102aa7-bb2f-4c95-9fc7-8110b2b34ffd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1502 microversion: 2.1 time: 0.301688 Jan 22 21:03:14.928581 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 516/1028] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:14 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1502 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:14.938277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-f8a5f620-d7f6-4019-a3cc-2584eba62715 req-6c7fa931-3b02-4ad8-92bc-0832e0afed7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ff3712-7bf9-4973-8efb-b408f5a7532d", "tag": "9202e0cf-34b1-446b-8b3e-7b0dbb0b7c94"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:14.944743 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:14.944743 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:14.961305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f8a5f620-d7f6-4019-a3cc-2584eba62715 req-6c7fa931-3b02-4ad8-92bc-0832e0afed7c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:14.961903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f8a5f620-d7f6-4019-a3cc-2584eba62715 req-6c7fa931-3b02-4ad8-92bc-0832e0afed7c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:14.974417 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f3151753-c8ea-4b8e-8ad9-7091fc02e9e8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 14 microversion: 2.1 time: 0.119718 Jan 22 21:03:14.977847 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 513/1029] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:14 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:03:14.984277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-031de098-59da-4dd9-b92e-cb68b0c5dc13 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:14.987088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-031de098-59da-4dd9-b92e-cb68b0c5dc13 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:14.994416 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f8a5f620-d7f6-4019-a3cc-2584eba62715 req-6c7fa931-3b02-4ad8-92bc-0832e0afed7c service nova] Creating event network-changed:9202e0cf-34b1-446b-8b3e-7b0dbb0b7c94 for instance 17ff3712-7bf9-4973-8efb-b408f5a7532d on nch1-master-1 Jan 22 21:03:15.004626 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-f8a5f620-d7f6-4019-a3cc-2584eba62715 req-6c7fa931-3b02-4ad8-92bc-0832e0afed7c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074140 Jan 22 21:03:15.005559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-031de098-59da-4dd9-b92e-cb68b0c5dc13 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:15.006210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-031de098-59da-4dd9-b92e-cb68b0c5dc13 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:15.006910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-031de098-59da-4dd9-b92e-cb68b0c5dc13 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:15.007418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-031de098-59da-4dd9-b92e-cb68b0c5dc13 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:15.009411 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 517/1030] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:15.021239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1bc7a128-9d9c-408a-8a2d-f2686b66c8d0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:15.022451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1bc7a128-9d9c-408a-8a2d-f2686b66c8d0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:15.032176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bc7a128-9d9c-408a-8a2d-f2686b66c8d0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:15.032716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bc7a128-9d9c-408a-8a2d-f2686b66c8d0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:15.033865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bc7a128-9d9c-408a-8a2d-f2686b66c8d0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:15.034306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bc7a128-9d9c-408a-8a2d-f2686b66c8d0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:15.118379 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1bc7a128-9d9c-408a-8a2d-f2686b66c8d0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.106922 Jan 22 21:03:15.119105 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 518/1031] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:15 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:15.295538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fdcb1aba-ac47-4f64-a62b-19ee4df2daec tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:15.297119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fdcb1aba-ac47-4f64-a62b-19ee4df2daec tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:15.308185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdcb1aba-ac47-4f64-a62b-19ee4df2daec tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:15.310151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdcb1aba-ac47-4f64-a62b-19ee4df2daec tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:15.312764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdcb1aba-ac47-4f64-a62b-19ee4df2daec tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:15.317993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdcb1aba-ac47-4f64-a62b-19ee4df2daec tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:15.382515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-031de098-59da-4dd9-b92e-cb68b0c5dc13 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:15.403773 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-031de098-59da-4dd9-b92e-cb68b0c5dc13 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1523 microversion: 2.1 time: 0.427436 Jan 22 21:03:15.404372 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 514/1032] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:14 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1523 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:15.437404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-912289984", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "39e6e04a-af42-4421-9e6d-68a34a2e0ec9"}], "security_groups": [{"name": "tempest-securitygroup--2032640059"}], "key_name": "tempest-keypair-793673175", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:15.668754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fdcb1aba-ac47-4f64-a62b-19ee4df2daec tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:15.681442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fdcb1aba-ac47-4f64-a62b-19ee4df2daec tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:15.689061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fdcb1aba-ac47-4f64-a62b-19ee4df2daec tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:15.691442 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fdcb1aba-ac47-4f64-a62b-19ee4df2daec tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.401291 Jan 22 21:03:15.704580 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 519/1033] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:15 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:15.704580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-75de95ce-1f7b-4818-8867-fee4da0f8fbf req-6670f8e3-29a8-4612-8b5e-40191507c754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a", "name": "network-vif-unplugged", "status": "completed", "tag": "d7ac1858-6f74-484f-bbcb-8043bae94378"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:15.704580 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:15.704580 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:15.717621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-75de95ce-1f7b-4818-8867-fee4da0f8fbf req-6670f8e3-29a8-4612-8b5e-40191507c754 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:15.719763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-75de95ce-1f7b-4818-8867-fee4da0f8fbf req-6670f8e3-29a8-4612-8b5e-40191507c754 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:15.722411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] validate_networks() for [('39e6e04a-af42-4421-9e6d-68a34a2e0ec9', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:03:15.743669 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-75de95ce-1f7b-4818-8867-fee4da0f8fbf req-6670f8e3-29a8-4612-8b5e-40191507c754 service nova] Creating event network-vif-unplugged:d7ac1858-6f74-484f-bbcb-8043bae94378 for instance 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a on nch2-master-1 Jan 22 21:03:15.748987 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-75de95ce-1f7b-4818-8867-fee4da0f8fbf req-6670f8e3-29a8-4612-8b5e-40191507c754 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053055 Jan 22 21:03:15.750399 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 520/1034] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:15.949669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7f37ac97-c6a3-4780-8b4e-0fd174373184 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:15.949669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7f37ac97-c6a3-4780-8b4e-0fd174373184 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:15.962053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f37ac97-c6a3-4780-8b4e-0fd174373184 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:15.964318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f37ac97-c6a3-4780-8b4e-0fd174373184 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:15.967175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f37ac97-c6a3-4780-8b4e-0fd174373184 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:15.972303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f37ac97-c6a3-4780-8b4e-0fd174373184 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:16.169770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7f37ac97-c6a3-4780-8b4e-0fd174373184 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:16.186135 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7f37ac97-c6a3-4780-8b4e-0fd174373184 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 200 len: 1479 microversion: 2.1 time: 0.243057 Jan 22 21:03:16.189567 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 521/1035] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:15 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 1479 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:16.196248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3dc29d95-141c-45d2-ad99-6e12c29d501c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:16.197444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3dc29d95-141c-45d2-ad99-6e12c29d501c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:16.204886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dc29d95-141c-45d2-ad99-6e12c29d501c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:16.205646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dc29d95-141c-45d2-ad99-6e12c29d501c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:16.207269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dc29d95-141c-45d2-ad99-6e12c29d501c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:16.208386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dc29d95-141c-45d2-ad99-6e12c29d501c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:16.284600 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3dc29d95-141c-45d2-ad99-6e12c29d501c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 14 microversion: 2.1 time: 0.092879 Jan 22 21:03:16.287904 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 522/1036] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:16 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:03:16.294497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a96df8e2-ce76-4d12-819f-db07d2980403 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:16.298408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a96df8e2-ce76-4d12-819f-db07d2980403 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:16.314697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a96df8e2-ce76-4d12-819f-db07d2980403 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:16.317960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a96df8e2-ce76-4d12-819f-db07d2980403 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:16.319132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a96df8e2-ce76-4d12-819f-db07d2980403 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:16.319738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a96df8e2-ce76-4d12-819f-db07d2980403 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:16.375167 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a96df8e2-ce76-4d12-819f-db07d2980403 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.085514 Jan 22 21:03:16.376443 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 523/1037] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:16 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:16.383959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c24cd690-a118-4b87-a5dc-6a347f31dfae tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-329062564"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:16.386425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c24cd690-a118-4b87-a5dc-6a347f31dfae tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:16.394366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Getting quotas for project c864966e7b1a471cb496ac2242826ab6. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:03:16.397824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c24cd690-a118-4b87-a5dc-6a347f31dfae tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:16.398519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c24cd690-a118-4b87-a5dc-6a347f31dfae tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:16.399044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Getting quotas for user c3903d47f1514112b91f2ea281591bb9 and project c864966e7b1a471cb496ac2242826ab6. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:03:16.399497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c24cd690-a118-4b87-a5dc-6a347f31dfae tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:16.399935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c24cd690-a118-4b87-a5dc-6a347f31dfae tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:16.415718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:03:16.416346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:03:16.417010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:03:16.417759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:03:16.418470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:03:16.435754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:16.436287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:16.437758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:16.438406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:16.476728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Getting quotas for project c864966e7b1a471cb496ac2242826ab6. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:03:16.484467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Getting quotas for user c3903d47f1514112b91f2ea281591bb9 and project c864966e7b1a471cb496ac2242826ab6. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:03:16.515589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:03:16.518393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:03:16.668721 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bc27e69d-afb9-4a56-909a-d3d2dbdbae41 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.242354 Jan 22 21:03:16.669693 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 515/1038] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:03:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 1265 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:03:16.675596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ade0b84a-2301-4bd7-b8c7-cd6d943dd1e1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:16.676220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ade0b84a-2301-4bd7-b8c7-cd6d943dd1e1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:16.684436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ade0b84a-2301-4bd7-b8c7-cd6d943dd1e1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:16.685613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ade0b84a-2301-4bd7-b8c7-cd6d943dd1e1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:16.687466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ade0b84a-2301-4bd7-b8c7-cd6d943dd1e1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:16.689680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ade0b84a-2301-4bd7-b8c7-cd6d943dd1e1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:16.999474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ade0b84a-2301-4bd7-b8c7-cd6d943dd1e1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:17.008050 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ade0b84a-2301-4bd7-b8c7-cd6d943dd1e1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1523 microversion: 2.1 time: 0.336966 Jan 22 21:03:17.024592 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 516/1039] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:16 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1523 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:17.029384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2175f044-1798-4216-a42d-50e872153b75 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:17.031324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2175f044-1798-4216-a42d-50e872153b75 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:17.059975 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c24cd690-a118-4b87-a5dc-6a347f31dfae tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "POST /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec/action" status: 202 len: 0 microversion: 2.1 time: 0.681952 Jan 22 21:03:17.060865 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 524/1040] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:16 2022] POST /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 22 21:03:17.099746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2175f044-1798-4216-a42d-50e872153b75 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:17.107385 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2175f044-1798-4216-a42d-50e872153b75 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 200 len: 1272 microversion: 2.1 time: 0.081640 Jan 22 21:03:17.107963 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 517/1041] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:17 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 1272 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:17.112550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4d8aa25-245b-429d-8743-d3263cec51b2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:17.113151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c4d8aa25-245b-429d-8743-d3263cec51b2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:17.120157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4d8aa25-245b-429d-8743-d3263cec51b2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:17.120615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4d8aa25-245b-429d-8743-d3263cec51b2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:17.121407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4d8aa25-245b-429d-8743-d3263cec51b2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:17.121895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4d8aa25-245b-429d-8743-d3263cec51b2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:17.247877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0b5d34dd-6aef-42ea-ac91-ee05a5f869e3 tempest-QuotaClassesAdminTestJSON-1665334595 tempest-QuotaClassesAdminTestJSON-1665334595-project-admin] Calling method '.version_select at 0x7f1ed61915e0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:17.248780 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:17.248780 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:17.273240 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0b5d34dd-6aef-42ea-ac91-ee05a5f869e3 tempest-QuotaClassesAdminTestJSON-1665334595 tempest-QuotaClassesAdminTestJSON-1665334595-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.208895 Jan 22 21:03:17.281657 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 525/1042] 10.222.0.100 () {58 vars in 1189 bytes} [Sat Jan 22 21:03:17 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:17.282174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-4be67c90-7224-4b6f-bc50-ca716b979a39 req-54abbb63-b779-42c6-951f-e45044757ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d7803b5-681b-412b-9319-8aaaa574dca7", "name": "network-vif-unplugged", "status": "completed", "tag": "f8a5d460-d57a-48e0-bcf8-f5891049005c"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:17.283845 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:17.283845 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:17.295125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4be67c90-7224-4b6f-bc50-ca716b979a39 req-54abbb63-b779-42c6-951f-e45044757ec2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:17.295830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4be67c90-7224-4b6f-bc50-ca716b979a39 req-54abbb63-b779-42c6-951f-e45044757ec2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:17.310028 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-4be67c90-7224-4b6f-bc50-ca716b979a39 req-54abbb63-b779-42c6-951f-e45044757ec2 service nova] Creating event network-vif-unplugged:f8a5d460-d57a-48e0-bcf8-f5891049005c for instance 5d7803b5-681b-412b-9319-8aaaa574dca7 on nch2-master-1 Jan 22 21:03:17.316539 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-4be67c90-7224-4b6f-bc50-ca716b979a39 req-54abbb63-b779-42c6-951f-e45044757ec2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038903 Jan 22 21:03:17.316539 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 526/1043] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:17.321168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7d82ad9f-fb4c-49b4-a085-fcc576c9d9d4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5e0a0d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:17.408395 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7d82ad9f-fb4c-49b4-a085-fcc576c9d9d4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 200 len: 1418 microversion: 2.1 time: 0.090959 Jan 22 21:03:17.409602 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 527/1044] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:03:17 2022] GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 1418 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:17.415388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-02abac45-ff94-4fc7-a2df-689bb0b0ac76 tempest-QuotaClassesAdminTestJSON-1665334595 tempest-QuotaClassesAdminTestJSON-1665334595-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed5e0a700>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:17.417439 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:17.417439 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:17.468429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c4d8aa25-245b-429d-8743-d3263cec51b2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:17.480263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c4d8aa25-245b-429d-8743-d3263cec51b2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:17.484312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c4d8aa25-245b-429d-8743-d3263cec51b2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:17.484312 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c4d8aa25-245b-429d-8743-d3263cec51b2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.374120 Jan 22 21:03:17.484312 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 518/1045] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:17 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:17.500741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d6490ea0-e991-41e5-b2e2-578afd7fe526 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:17.502401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d6490ea0-e991-41e5-b2e2-578afd7fe526 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:17.512529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6490ea0-e991-41e5-b2e2-578afd7fe526 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:17.512982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6490ea0-e991-41e5-b2e2-578afd7fe526 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:17.514454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6490ea0-e991-41e5-b2e2-578afd7fe526 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:17.515095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6490ea0-e991-41e5-b2e2-578afd7fe526 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:17.565993 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d6490ea0-e991-41e5-b2e2-578afd7fe526 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 14 microversion: 2.1 time: 0.080023 Jan 22 21:03:17.567021 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 519/1046] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:17 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:03:17.575623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9356be57-7745-448b-a07b-1cfc4fcc2d24 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:17.576851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9356be57-7745-448b-a07b-1cfc4fcc2d24 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:17.584804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9356be57-7745-448b-a07b-1cfc4fcc2d24 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:17.585681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9356be57-7745-448b-a07b-1cfc4fcc2d24 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:17.587381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9356be57-7745-448b-a07b-1cfc4fcc2d24 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:17.588026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9356be57-7745-448b-a07b-1cfc4fcc2d24 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:17.634831 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9356be57-7745-448b-a07b-1cfc4fcc2d24 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.066392 Jan 22 21:03:17.637112 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 520/1047] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:17 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:18.034924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-60bd284a-0b09-4b98-9ec6-f8d99437d960 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:18.036063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-60bd284a-0b09-4b98-9ec6-f8d99437d960 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:18.047571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60bd284a-0b09-4b98-9ec6-f8d99437d960 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:18.048305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60bd284a-0b09-4b98-9ec6-f8d99437d960 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:18.049352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60bd284a-0b09-4b98-9ec6-f8d99437d960 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:18.049875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60bd284a-0b09-4b98-9ec6-f8d99437d960 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:18.237759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-60bd284a-0b09-4b98-9ec6-f8d99437d960 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:18.261193 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-60bd284a-0b09-4b98-9ec6-f8d99437d960 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1523 microversion: 2.1 time: 0.230445 Jan 22 21:03:18.261816 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 521/1048] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:18 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:18.269006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a8bce77e-f6ff-4906-b08b-4ea5a6f0dcd1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:18.269006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a8bce77e-f6ff-4906-b08b-4ea5a6f0dcd1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:18.274768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8bce77e-f6ff-4906-b08b-4ea5a6f0dcd1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:18.275396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8bce77e-f6ff-4906-b08b-4ea5a6f0dcd1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:18.276350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8bce77e-f6ff-4906-b08b-4ea5a6f0dcd1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:18.276790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8bce77e-f6ff-4906-b08b-4ea5a6f0dcd1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:18.364376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a8bce77e-f6ff-4906-b08b-4ea5a6f0dcd1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:18.374580 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a8bce77e-f6ff-4906-b08b-4ea5a6f0dcd1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 200 len: 1276 microversion: 2.1 time: 0.110964 Jan 22 21:03:18.376022 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 522/1049] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:18 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 1276 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:18.422700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7eb5dced-e544-4efc-9225-e8724ac23321 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed81583a0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:18.469655 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7eb5dced-e544-4efc-9225-e8724ac23321 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 200 len: 1418 microversion: 2.1 time: 0.051714 Jan 22 21:03:18.471255 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 523/1050] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:03:18 2022] GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 1418 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:18.502801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2ef97102-a080-45d9-8a90-5ccccd172e69 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:18.503731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2ef97102-a080-45d9-8a90-5ccccd172e69 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:18.510293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ef97102-a080-45d9-8a90-5ccccd172e69 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:18.510793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ef97102-a080-45d9-8a90-5ccccd172e69 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:18.511670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ef97102-a080-45d9-8a90-5ccccd172e69 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:18.512154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ef97102-a080-45d9-8a90-5ccccd172e69 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:18.662409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2ef97102-a080-45d9-8a90-5ccccd172e69 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:18.669089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2ef97102-a080-45d9-8a90-5ccccd172e69 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:18.670631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2ef97102-a080-45d9-8a90-5ccccd172e69 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:18.672385 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2ef97102-a080-45d9-8a90-5ccccd172e69 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.174649 Jan 22 21:03:18.677556 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 524/1051] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:18 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:03:18.680079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3df86e11-4fee-40c9-96f9-7f37f8422c84 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:18.681069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3df86e11-4fee-40c9-96f9-7f37f8422c84 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:18.687840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3df86e11-4fee-40c9-96f9-7f37f8422c84 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:18.688397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3df86e11-4fee-40c9-96f9-7f37f8422c84 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:18.689210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3df86e11-4fee-40c9-96f9-7f37f8422c84 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:18.689687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3df86e11-4fee-40c9-96f9-7f37f8422c84 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:18.707795 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-02abac45-ff94-4fc7-a2df-689bb0b0ac76 tempest-QuotaClassesAdminTestJSON-1665334595 tempest-QuotaClassesAdminTestJSON-1665334595-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.296633 Jan 22 21:03:18.708432 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 528/1052] 10.222.0.100 () {60 vars in 1210 bytes} [Sat Jan 22 21:03:17 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:18.713042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e5f5f3ca-f484-437a-bf0d-e4ddc55c3085 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:18.714122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e5f5f3ca-f484-437a-bf0d-e4ddc55c3085 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:18.721710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5f5f3ca-f484-437a-bf0d-e4ddc55c3085 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:18.722172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5f5f3ca-f484-437a-bf0d-e4ddc55c3085 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:18.722993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5f5f3ca-f484-437a-bf0d-e4ddc55c3085 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:18.723439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5f5f3ca-f484-437a-bf0d-e4ddc55c3085 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:18.742412 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3df86e11-4fee-40c9-96f9-7f37f8422c84 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 14 microversion: 2.1 time: 0.064907 Jan 22 21:03:18.749455 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 525/1053] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:18 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:03:18.749455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ceb814d-39eb-49cb-87f1-4af3eb36c918 tempest-QuotaClassesAdminTestJSON-1665334595 tempest-QuotaClassesAdminTestJSON-1665334595-project-admin] Calling method '.version_select at 0x7f1ed63349d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:18.749455 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:18.749455 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:03:18.773272 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ceb814d-39eb-49cb-87f1-4af3eb36c918 tempest-QuotaClassesAdminTestJSON-1665334595 tempest-QuotaClassesAdminTestJSON-1665334595-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.029043 Jan 22 21:03:18.774092 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 526/1054] 10.222.0.100 () {58 vars in 1189 bytes} [Sat Jan 22 21:03:18 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:18.777474 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e5f5f3ca-f484-437a-bf0d-e4ddc55c3085 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.066785 Jan 22 21:03:18.777474 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 529/1055] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:18 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:18.787288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bb0d2dc3-2a25-455b-95fe-65ef97463501 tempest-QuotaClassesAdminTestJSON-1665334595 tempest-QuotaClassesAdminTestJSON-1665334595-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed635bb80>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:18.788980 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:18.788980 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:03:19.280064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2aae0d98-c0f6-4c08-9368-27bee486c662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:19.305880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2aae0d98-c0f6-4c08-9368-27bee486c662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:19.305880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aae0d98-c0f6-4c08-9368-27bee486c662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:19.305880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aae0d98-c0f6-4c08-9368-27bee486c662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:19.305880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aae0d98-c0f6-4c08-9368-27bee486c662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:19.306340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aae0d98-c0f6-4c08-9368-27bee486c662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:19.440368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2aae0d98-c0f6-4c08-9368-27bee486c662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:19.448863 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2aae0d98-c0f6-4c08-9368-27bee486c662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1523 microversion: 2.1 time: 0.172636 Jan 22 21:03:19.449771 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 530/1056] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:19 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:19.456107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-682eaef4-740a-451e-933d-8186cf2b36b0 req-6ebcdc51-c7e5-4138-ac17-7b730176aeaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d7803b5-681b-412b-9319-8aaaa574dca7", "tag": "f8a5d460-d57a-48e0-bcf8-f5891049005c"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:19.458876 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:19.458876 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:19.467004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-682eaef4-740a-451e-933d-8186cf2b36b0 req-6ebcdc51-c7e5-4138-ac17-7b730176aeaa service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:19.467460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-682eaef4-740a-451e-933d-8186cf2b36b0 req-6ebcdc51-c7e5-4138-ac17-7b730176aeaa service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:19.482776 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-682eaef4-740a-451e-933d-8186cf2b36b0 req-6ebcdc51-c7e5-4138-ac17-7b730176aeaa service nova] Creating event network-changed:f8a5d460-d57a-48e0-bcf8-f5891049005c for instance 5d7803b5-681b-412b-9319-8aaaa574dca7 on nch2-master-1 Jan 22 21:03:19.492419 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-682eaef4-740a-451e-933d-8186cf2b36b0 req-6ebcdc51-c7e5-4138-ac17-7b730176aeaa service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041225 Jan 22 21:03:19.493028 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 531/1057] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:19.498537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bac33d0b-b376-40c3-8cec-4b9d32d95daa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:19.499330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bac33d0b-b376-40c3-8cec-4b9d32d95daa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:19.505876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bac33d0b-b376-40c3-8cec-4b9d32d95daa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:19.506335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bac33d0b-b376-40c3-8cec-4b9d32d95daa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:19.507142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bac33d0b-b376-40c3-8cec-4b9d32d95daa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:19.507768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bac33d0b-b376-40c3-8cec-4b9d32d95daa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:19.573730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bac33d0b-b376-40c3-8cec-4b9d32d95daa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:19.586573 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bac33d0b-b376-40c3-8cec-4b9d32d95daa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 200 len: 1324 microversion: 2.1 time: 0.092092 Jan 22 21:03:19.587378 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 532/1058] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:19 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 1324 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:19.601785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-11d4341b-0e95-4d5c-9d40-ba3c3889b2bb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5dc4ca0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:19.675181 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-11d4341b-0e95-4d5c-9d40-ba3c3889b2bb tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 200 len: 1418 microversion: 2.1 time: 0.080162 Jan 22 21:03:19.679504 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 533/1059] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:03:19 2022] GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 1418 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:19.692681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-18c67338-d6b0-46e4-8493-250943f975bc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:19.696150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-18c67338-d6b0-46e4-8493-250943f975bc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:19.703635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18c67338-d6b0-46e4-8493-250943f975bc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:19.709206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18c67338-d6b0-46e4-8493-250943f975bc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:19.709206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18c67338-d6b0-46e4-8493-250943f975bc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:19.709206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18c67338-d6b0-46e4-8493-250943f975bc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:20.000997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-18c67338-d6b0-46e4-8493-250943f975bc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:20.010435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-18c67338-d6b0-46e4-8493-250943f975bc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:20.027475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-18c67338-d6b0-46e4-8493-250943f975bc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:20.027475 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-18c67338-d6b0-46e4-8493-250943f975bc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.326031 Jan 22 21:03:20.027475 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 534/1060] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:19 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:20.027982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5c2bc7ad-fa96-498c-921b-b0b530cf4fad req-5f57e78a-fd76-4fa2-9161-948a7d9bbadf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a", "name": "network-vif-plugged", "status": "completed", "tag": "d7ac1858-6f74-484f-bbcb-8043bae94378"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:20.027982 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:20.027982 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:20.031613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5c2bc7ad-fa96-498c-921b-b0b530cf4fad req-5f57e78a-fd76-4fa2-9161-948a7d9bbadf service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:20.032455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5c2bc7ad-fa96-498c-921b-b0b530cf4fad req-5f57e78a-fd76-4fa2-9161-948a7d9bbadf service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:20.046427 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5c2bc7ad-fa96-498c-921b-b0b530cf4fad req-5f57e78a-fd76-4fa2-9161-948a7d9bbadf service nova] Creating event network-vif-plugged:d7ac1858-6f74-484f-bbcb-8043bae94378 for instance 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a on nch2-master-1 Jan 22 21:03:20.052143 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-5c2bc7ad-fa96-498c-921b-b0b530cf4fad req-5f57e78a-fd76-4fa2-9161-948a7d9bbadf service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035851 Jan 22 21:03:20.057129 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 535/1061] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:20.059073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3c05c648-6cb8-44e5-b8b7-f37cfa0a9664 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:20.060327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3c05c648-6cb8-44e5-b8b7-f37cfa0a9664 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:20.068466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c05c648-6cb8-44e5-b8b7-f37cfa0a9664 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:20.069786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c05c648-6cb8-44e5-b8b7-f37cfa0a9664 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:20.070868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c05c648-6cb8-44e5-b8b7-f37cfa0a9664 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:20.071473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c05c648-6cb8-44e5-b8b7-f37cfa0a9664 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:20.125411 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3c05c648-6cb8-44e5-b8b7-f37cfa0a9664 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 14 microversion: 2.1 time: 0.069404 Jan 22 21:03:20.128847 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 536/1062] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:20 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:03:20.144214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6bf9a936-a84d-4997-8875-1acbd858b402 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:20.147351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6bf9a936-a84d-4997-8875-1acbd858b402 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:20.156172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bf9a936-a84d-4997-8875-1acbd858b402 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:20.157338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bf9a936-a84d-4997-8875-1acbd858b402 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:20.158421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bf9a936-a84d-4997-8875-1acbd858b402 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:20.159036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bf9a936-a84d-4997-8875-1acbd858b402 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:20.212211 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6bf9a936-a84d-4997-8875-1acbd858b402 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.080362 Jan 22 21:03:20.213852 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 537/1063] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:20 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:20.471958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c3a35e01-fec0-4593-9471-60d8398877fd tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:20.472691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c3a35e01-fec0-4593-9471-60d8398877fd tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:20.480636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3a35e01-fec0-4593-9471-60d8398877fd tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:20.481364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3a35e01-fec0-4593-9471-60d8398877fd tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:20.482471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3a35e01-fec0-4593-9471-60d8398877fd tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:20.482917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3a35e01-fec0-4593-9471-60d8398877fd tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:20.541201 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bb0d2dc3-2a25-455b-95fe-65ef97463501 tempest-QuotaClassesAdminTestJSON-1665334595 tempest-QuotaClassesAdminTestJSON-1665334595-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.757723 Jan 22 21:03:20.542511 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 527/1064] 10.222.0.100 () {60 vars in 1210 bytes} [Sat Jan 22 21:03:18 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:20.603932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-664407f2-6369-4d64-83e4-fda58bbbce08 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:20.604683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-664407f2-6369-4d64-83e4-fda58bbbce08 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:20.614983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-664407f2-6369-4d64-83e4-fda58bbbce08 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:20.616091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-664407f2-6369-4d64-83e4-fda58bbbce08 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:20.617914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-664407f2-6369-4d64-83e4-fda58bbbce08 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:20.619243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-664407f2-6369-4d64-83e4-fda58bbbce08 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:20.691820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-664407f2-6369-4d64-83e4-fda58bbbce08 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:20.699644 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-664407f2-6369-4d64-83e4-fda58bbbce08 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 200 len: 1330 microversion: 2.1 time: 0.099216 Jan 22 21:03:20.700052 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 528/1065] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:20 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:20.705406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-03b7f40d-a1ae-46b1-a182-731cdb12986d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed6087040>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:20.720300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c3a35e01-fec0-4593-9471-60d8398877fd tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:20.728161 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c3a35e01-fec0-4593-9471-60d8398877fd tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1523 microversion: 2.1 time: 0.263303 Jan 22 21:03:20.733547 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 538/1066] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:20 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:20.753348 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-03b7f40d-a1ae-46b1-a182-731cdb12986d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 200 len: 1418 microversion: 2.1 time: 0.052279 Jan 22 21:03:20.753964 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 529/1067] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:03:20 2022] GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 1418 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:21.032679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-488798a0-24e9-450e-b224-b600d6edfea7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:21.033381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-488798a0-24e9-450e-b224-b600d6edfea7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:21.042183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-488798a0-24e9-450e-b224-b600d6edfea7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:21.042647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-488798a0-24e9-450e-b224-b600d6edfea7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:21.043654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-488798a0-24e9-450e-b224-b600d6edfea7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:21.044474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-488798a0-24e9-450e-b224-b600d6edfea7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:21.140310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-92821d79-b971-4cff-aeb7-96ebdb31719e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:21.141959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-92821d79-b971-4cff-aeb7-96ebdb31719e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:21.158338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92821d79-b971-4cff-aeb7-96ebdb31719e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:21.159630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92821d79-b971-4cff-aeb7-96ebdb31719e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:21.160692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92821d79-b971-4cff-aeb7-96ebdb31719e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:21.161334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92821d79-b971-4cff-aeb7-96ebdb31719e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:21.209719 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-92821d79-b971-4cff-aeb7-96ebdb31719e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 14 microversion: 2.1 time: 0.074282 Jan 22 21:03:21.210897 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 530/1068] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:21 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:03:21.227838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a71fe22f-8d89-4785-8662-9cf661a2e325 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:21.229389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a71fe22f-8d89-4785-8662-9cf661a2e325 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:21.238165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a71fe22f-8d89-4785-8662-9cf661a2e325 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:21.244013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a71fe22f-8d89-4785-8662-9cf661a2e325 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:21.244013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a71fe22f-8d89-4785-8662-9cf661a2e325 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:21.244013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a71fe22f-8d89-4785-8662-9cf661a2e325 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:21.262499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-488798a0-24e9-450e-b224-b600d6edfea7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:21.277527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-488798a0-24e9-450e-b224-b600d6edfea7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:21.281699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-488798a0-24e9-450e-b224-b600d6edfea7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:21.283758 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-488798a0-24e9-450e-b224-b600d6edfea7 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.255498 Jan 22 21:03:21.296663 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 539/1069] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:21 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:21.366532 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a71fe22f-8d89-4785-8662-9cf661a2e325 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.144840 Jan 22 21:03:21.369108 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 531/1070] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:21 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:21.716732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ffb242f-5522-4d77-8615-bf6f5541860d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:21.717373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1ffb242f-5522-4d77-8615-bf6f5541860d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:21.724521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ffb242f-5522-4d77-8615-bf6f5541860d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:21.725152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ffb242f-5522-4d77-8615-bf6f5541860d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:21.725825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ffb242f-5522-4d77-8615-bf6f5541860d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:21.726326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ffb242f-5522-4d77-8615-bf6f5541860d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:21.752537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8cc1403f-b94f-4b98-9cda-b3133187fb9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:21.755878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8cc1403f-b94f-4b98-9cda-b3133187fb9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:21.775476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cc1403f-b94f-4b98-9cda-b3133187fb9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:21.778579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cc1403f-b94f-4b98-9cda-b3133187fb9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:21.786447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cc1403f-b94f-4b98-9cda-b3133187fb9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:21.786447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cc1403f-b94f-4b98-9cda-b3133187fb9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:22.026238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8cc1403f-b94f-4b98-9cda-b3133187fb9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:22.037327 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8cc1403f-b94f-4b98-9cda-b3133187fb9d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1523 microversion: 2.1 time: 0.294793 Jan 22 21:03:22.038666 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 532/1071] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:21 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:22.044653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7302bfd6-c750-4004-8428-e5c1b2e6fa40 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5eb69d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:22.107363 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7302bfd6-c750-4004-8428-e5c1b2e6fa40 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 200 len: 1418 microversion: 2.1 time: 0.067280 Jan 22 21:03:22.113673 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 533/1072] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:03:22 2022] GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 1418 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:22.123169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1ffb242f-5522-4d77-8615-bf6f5541860d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:22.136887 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ffb242f-5522-4d77-8615-bf6f5541860d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 200 len: 1398 microversion: 2.1 time: 0.423674 Jan 22 21:03:22.147352 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 540/1073] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:21 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 1398 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:22.224616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d81b5f2d-abe6-4024-8998-ec818cabdf2d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:22.226131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d81b5f2d-abe6-4024-8998-ec818cabdf2d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:22.238695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d81b5f2d-abe6-4024-8998-ec818cabdf2d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:22.238695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d81b5f2d-abe6-4024-8998-ec818cabdf2d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:22.239280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d81b5f2d-abe6-4024-8998-ec818cabdf2d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:22.239755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d81b5f2d-abe6-4024-8998-ec818cabdf2d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:22.292093 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d81b5f2d-abe6-4024-8998-ec818cabdf2d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 14 microversion: 2.1 time: 0.075192 Jan 22 21:03:22.296399 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 534/1074] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:22 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:03:22.305244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-46685782-f65c-4d42-8e34-3159d5037ce3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:22.306207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-46685782-f65c-4d42-8e34-3159d5037ce3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:22.314015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46685782-f65c-4d42-8e34-3159d5037ce3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:22.315722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46685782-f65c-4d42-8e34-3159d5037ce3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:22.315722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46685782-f65c-4d42-8e34-3159d5037ce3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:22.315722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46685782-f65c-4d42-8e34-3159d5037ce3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:22.359461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-a7fd2bd1-69b6-4192-a0c4-6946879cdcbd req-e4a2fc7b-1eeb-485d-8ccc-f5f5031ecef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a24268f7-fe8e-47cc-9ad1-abe07e244bee", "tag": "b819e488-2853-4e52-bb4c-aa0ca7352bc7"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:22.365666 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:22.365666 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:03:22.385392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a7fd2bd1-69b6-4192-a0c4-6946879cdcbd req-e4a2fc7b-1eeb-485d-8ccc-f5f5031ecef8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:22.393745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a7fd2bd1-69b6-4192-a0c4-6946879cdcbd req-e4a2fc7b-1eeb-485d-8ccc-f5f5031ecef8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:22.422751 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-a7fd2bd1-69b6-4192-a0c4-6946879cdcbd req-e4a2fc7b-1eeb-485d-8ccc-f5f5031ecef8 service nova] Creating event network-changed:b819e488-2853-4e52-bb4c-aa0ca7352bc7 for instance a24268f7-fe8e-47cc-9ad1-abe07e244bee on nch2-master-1 Jan 22 21:03:22.429376 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-a7fd2bd1-69b6-4192-a0c4-6946879cdcbd req-e4a2fc7b-1eeb-485d-8ccc-f5f5031ecef8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087001 Jan 22 21:03:22.435306 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 535/1075] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:22.437903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f3c8d9ba-256b-4952-ba35-f8bda794212f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:22.439601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f3c8d9ba-256b-4952-ba35-f8bda794212f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:22.448789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3c8d9ba-256b-4952-ba35-f8bda794212f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:22.450779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3c8d9ba-256b-4952-ba35-f8bda794212f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:22.452781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3c8d9ba-256b-4952-ba35-f8bda794212f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:22.455345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3c8d9ba-256b-4952-ba35-f8bda794212f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:22.523907 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f3c8d9ba-256b-4952-ba35-f8bda794212f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.091046 Jan 22 21:03:22.525725 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 536/1076] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:22 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:22.580389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-46685782-f65c-4d42-8e34-3159d5037ce3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:22.590088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-46685782-f65c-4d42-8e34-3159d5037ce3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:22.591662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-46685782-f65c-4d42-8e34-3159d5037ce3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:22.593691 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-46685782-f65c-4d42-8e34-3159d5037ce3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.294585 Jan 22 21:03:22.595812 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 541/1077] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:22 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:23.055933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1881ae6c-dd11-45cf-849b-ad37b6cc9e56 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:23.057590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1881ae6c-dd11-45cf-849b-ad37b6cc9e56 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:23.069146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1881ae6c-dd11-45cf-849b-ad37b6cc9e56 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:23.070160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1881ae6c-dd11-45cf-849b-ad37b6cc9e56 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:23.071317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1881ae6c-dd11-45cf-849b-ad37b6cc9e56 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:23.071778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1881ae6c-dd11-45cf-849b-ad37b6cc9e56 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:23.124434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-886d8e25-5f11-4e73-9f97-6f76f3ac7e73 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5dc9dc0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:23.189291 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-886d8e25-5f11-4e73-9f97-6f76f3ac7e73 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 200 len: 1418 microversion: 2.1 time: 0.072759 Jan 22 21:03:23.189816 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 542/1078] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:03:23 2022] GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 1418 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:23.195763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b85ad338-4630-4e89-83bf-5c9502392310 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:23.196394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b85ad338-4630-4e89-83bf-5c9502392310 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:23.205274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b85ad338-4630-4e89-83bf-5c9502392310 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:23.205821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b85ad338-4630-4e89-83bf-5c9502392310 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:23.206943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b85ad338-4630-4e89-83bf-5c9502392310 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:23.207491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b85ad338-4630-4e89-83bf-5c9502392310 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:23.297383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1881ae6c-dd11-45cf-849b-ad37b6cc9e56 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:23.307943 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1881ae6c-dd11-45cf-849b-ad37b6cc9e56 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1508 microversion: 2.1 time: 0.256115 Jan 22 21:03:23.309156 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 537/1079] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:23 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:23.315793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8691323a-09d7-4703-a916-c6a4691d1164 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:23.317189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8691323a-09d7-4703-a916-c6a4691d1164 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:23.324400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8691323a-09d7-4703-a916-c6a4691d1164 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:23.325110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8691323a-09d7-4703-a916-c6a4691d1164 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:23.326464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8691323a-09d7-4703-a916-c6a4691d1164 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:23.328644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8691323a-09d7-4703-a916-c6a4691d1164 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:23.374411 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8691323a-09d7-4703-a916-c6a4691d1164 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 14 microversion: 2.1 time: 0.062758 Jan 22 21:03:23.378026 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 538/1080] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:23 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:03:23.384088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-983e5bb6-84a4-4f37-b335-571506d0458d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:23.386309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-983e5bb6-84a4-4f37-b335-571506d0458d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:23.398593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-983e5bb6-84a4-4f37-b335-571506d0458d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:23.399058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-983e5bb6-84a4-4f37-b335-571506d0458d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:23.401605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-983e5bb6-84a4-4f37-b335-571506d0458d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:23.401605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-983e5bb6-84a4-4f37-b335-571506d0458d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:23.494021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b85ad338-4630-4e89-83bf-5c9502392310 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:23.503011 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b85ad338-4630-4e89-83bf-5c9502392310 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 200 len: 1398 microversion: 2.1 time: 0.311980 Jan 22 21:03:23.513195 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 543/1081] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:23 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 1398 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:23.541919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-982a10e9-ab4f-47c3-9363-6d4d4c8bdd52 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:23.546529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-982a10e9-ab4f-47c3-9363-6d4d4c8bdd52 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:23.559375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-982a10e9-ab4f-47c3-9363-6d4d4c8bdd52 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:23.559942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-982a10e9-ab4f-47c3-9363-6d4d4c8bdd52 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:23.561176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-982a10e9-ab4f-47c3-9363-6d4d4c8bdd52 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:23.561661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-982a10e9-ab4f-47c3-9363-6d4d4c8bdd52 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:23.612729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-983e5bb6-84a4-4f37-b335-571506d0458d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:23.621876 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-983e5bb6-84a4-4f37-b335-571506d0458d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 200 len: 1508 microversion: 2.1 time: 0.242913 Jan 22 21:03:23.622786 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 539/1082] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:23 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 1508 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:23.633783 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-982a10e9-ab4f-47c3-9363-6d4d4c8bdd52 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.094313 Jan 22 21:03:23.633783 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 544/1083] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:23 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:03:23.634743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ba032c7b-4acb-43cd-a6f7-850bd7d99945 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:23.635526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ba032c7b-4acb-43cd-a6f7-850bd7d99945 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:23.642576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-718464ad-1d82-4129-860d-3fdb5ee5d9cb tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:23.643097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-718464ad-1d82-4129-860d-3fdb5ee5d9cb tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:23.649512 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-718464ad-1d82-4129-860d-3fdb5ee5d9cb tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:23.650070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-718464ad-1d82-4129-860d-3fdb5ee5d9cb tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:23.650881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-718464ad-1d82-4129-860d-3fdb5ee5d9cb tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:23.651323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-718464ad-1d82-4129-860d-3fdb5ee5d9cb tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:23.668171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba032c7b-4acb-43cd-a6f7-850bd7d99945 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:23.668600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba032c7b-4acb-43cd-a6f7-850bd7d99945 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:23.672091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba032c7b-4acb-43cd-a6f7-850bd7d99945 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:23.672729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba032c7b-4acb-43cd-a6f7-850bd7d99945 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:23.707023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-718464ad-1d82-4129-860d-3fdb5ee5d9cb tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:03:24.042439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ba032c7b-4acb-43cd-a6f7-850bd7d99945 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:24.056087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ba032c7b-4acb-43cd-a6f7-850bd7d99945 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:24.057459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ba032c7b-4acb-43cd-a6f7-850bd7d99945 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:24.059093 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ba032c7b-4acb-43cd-a6f7-850bd7d99945 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1650 microversion: 2.25 time: 0.428839 Jan 22 21:03:24.059737 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 545/1084] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:23 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1650 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:24.066816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a40629af-4904-4a71-b81d-69b375f4d475 req-ace11c6e-fa9b-4ef4-b881-492485c9d9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b179432-605e-4dbc-af14-2e1933a509ec", "name": "network-vif-plugged", "status": "completed", "tag": "8d791b62-9f8e-47a8-b5ac-bd443a5163e8"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:24.068522 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:24.068522 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:24.077929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a40629af-4904-4a71-b81d-69b375f4d475 req-ace11c6e-fa9b-4ef4-b881-492485c9d9ff service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:24.078458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a40629af-4904-4a71-b81d-69b375f4d475 req-ace11c6e-fa9b-4ef4-b881-492485c9d9ff service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:24.093215 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a40629af-4904-4a71-b81d-69b375f4d475 req-ace11c6e-fa9b-4ef4-b881-492485c9d9ff service nova] Creating event network-vif-plugged:8d791b62-9f8e-47a8-b5ac-bd443a5163e8 for instance 0b179432-605e-4dbc-af14-2e1933a509ec on nch2-master-1 Jan 22 21:03:24.098505 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a40629af-4904-4a71-b81d-69b375f4d475 req-ace11c6e-fa9b-4ef4-b881-492485c9d9ff service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037389 Jan 22 21:03:24.115066 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-718464ad-1d82-4129-860d-3fdb5ee5d9cb tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 204 len: 0 microversion: 2.1 time: 0.462583 Jan 22 21:03:24.115519 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 546/1085] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:24.115611 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 540/1086] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:03:23 2022] DELETE /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:03:24.210551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-06a015c4-dda5-4f04-bb58-46b379366261 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed63b9280>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:24.258230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1323353216", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "f2f664c9-4305-4e89-83dd-d4a09e707645"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:32.127486 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-06a015c4-dda5-4f04-bb58-46b379366261 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 200 len: 1418 microversion: 2.1 time: 7.927100 Jan 22 21:03:32.130120 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 547/1087] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:03:24 2022] GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 1418 bytes in 7931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:32.136197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] validate_networks() for [('f2f664c9-4305-4e89-83dd-d4a09e707645', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:03:32.143092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3c8f2952-0366-43dc-aaa3-d5e1e1788a0a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:32.143092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3c8f2952-0366-43dc-aaa3-d5e1e1788a0a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:32.155227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c8f2952-0366-43dc-aaa3-d5e1e1788a0a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:32.156163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c8f2952-0366-43dc-aaa3-d5e1e1788a0a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:32.157494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c8f2952-0366-43dc-aaa3-d5e1e1788a0a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:32.158187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c8f2952-0366-43dc-aaa3-d5e1e1788a0a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:32.222110 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3c8f2952-0366-43dc-aaa3-d5e1e1788a0a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 24570 microversion: 2.1 time: 0.090355 Jan 22 21:03:32.227734 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 548/1088] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:32 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 24570 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:32.237691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c6b93d81-68cf-4719-81d3-6d39d67fd03c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:32.238747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c6b93d81-68cf-4719-81d3-6d39d67fd03c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:32.247143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6b93d81-68cf-4719-81d3-6d39d67fd03c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:32.248784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6b93d81-68cf-4719-81d3-6d39d67fd03c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:32.249940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6b93d81-68cf-4719-81d3-6d39d67fd03c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:32.250590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6b93d81-68cf-4719-81d3-6d39d67fd03c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:32.450108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c6b93d81-68cf-4719-81d3-6d39d67fd03c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:32.458833 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c6b93d81-68cf-4719-81d3-6d39d67fd03c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 200 len: 1398 microversion: 2.1 time: 0.229368 Jan 22 21:03:32.459416 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 549/1089] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:32 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 1398 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:32.469087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ed80ba24-d7fd-4999-a34f-fa761ecf1141 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:32.469087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ed80ba24-d7fd-4999-a34f-fa761ecf1141 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:32.472723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed80ba24-d7fd-4999-a34f-fa761ecf1141 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:32.473117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed80ba24-d7fd-4999-a34f-fa761ecf1141 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:32.473955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed80ba24-d7fd-4999-a34f-fa761ecf1141 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:32.474392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed80ba24-d7fd-4999-a34f-fa761ecf1141 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:32.527684 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ed80ba24-d7fd-4999-a34f-fa761ecf1141 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.066998 Jan 22 21:03:32.536276 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 550/1090] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:32 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:32.545412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0bae6365-11a2-4235-9e3d-57235f850930 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:32.546173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0bae6365-11a2-4235-9e3d-57235f850930 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:32.553892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bae6365-11a2-4235-9e3d-57235f850930 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:32.554351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bae6365-11a2-4235-9e3d-57235f850930 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:32.555794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bae6365-11a2-4235-9e3d-57235f850930 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:32.556255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bae6365-11a2-4235-9e3d-57235f850930 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:32.647921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:03:32.648345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:03:32.649035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:03:32.649457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:03:32.649896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:03:32.660254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:32.661083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:32.662179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:32.662895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:32.682306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Getting quotas for project 0ac10456f0ea4fd5b1d2948b4856ca84. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:03:32.695581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Getting quotas for user 4847dd82943e4bbfb54cdd49aed12b7b and project 0ac10456f0ea4fd5b1d2948b4856ca84. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:03:32.722573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:03:32.744907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:03:32.745214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0bae6365-11a2-4235-9e3d-57235f850930 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:32.745318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0bae6365-11a2-4235-9e3d-57235f850930 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:32.746895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0bae6365-11a2-4235-9e3d-57235f850930 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:32.748081 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0bae6365-11a2-4235-9e3d-57235f850930 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1640 microversion: 2.25 time: 0.210686 Jan 22 21:03:32.749377 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 551/1091] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:32 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1640 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:32.753820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-4fccf6fe-e00e-4664-a7fd-b01ce5c16700 req-c0d03f80-5d61-4c81-a891-4021ba8f8779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a", "name": "network-vif-deleted", "tag": "d7ac1858-6f74-484f-bbcb-8043bae94378"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:32.755328 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:32.755328 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:32.773909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4fccf6fe-e00e-4664-a7fd-b01ce5c16700 req-c0d03f80-5d61-4c81-a891-4021ba8f8779 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:32.774432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4fccf6fe-e00e-4664-a7fd-b01ce5c16700 req-c0d03f80-5d61-4c81-a891-4021ba8f8779 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:32.791191 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-4fccf6fe-e00e-4664-a7fd-b01ce5c16700 req-c0d03f80-5d61-4c81-a891-4021ba8f8779 service nova] Creating event network-vif-deleted:d7ac1858-6f74-484f-bbcb-8043bae94378 for instance 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a on nch2-master-1 Jan 22 21:03:32.801316 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-4fccf6fe-e00e-4664-a7fd-b01ce5c16700 req-c0d03f80-5d61-4c81-a891-4021ba8f8779 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050675 Jan 22 21:03:32.804061 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 552/1092] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:32.915932 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5609315b-6c95-4632-a5e9-1a3028111c0f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 8.663403 Jan 22 21:03:32.916591 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 541/1093] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:03:24 2022] POST /compute/v2.1/servers => generated 382 bytes in 8665 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:03:32.926093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-121a2c5a-cea2-4528-b4fa-223a7728770c req-0e5b708a-2c4d-4358-a0f2-c935c7d21be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a24268f7-fe8e-47cc-9ad1-abe07e244bee", "name": "network-vif-plugged", "status": "completed", "tag": "b819e488-2853-4e52-bb4c-aa0ca7352bc7"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:32.927997 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:32.927997 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:03:32.935346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-121a2c5a-cea2-4528-b4fa-223a7728770c req-0e5b708a-2c4d-4358-a0f2-c935c7d21be9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:32.936128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-121a2c5a-cea2-4528-b4fa-223a7728770c req-0e5b708a-2c4d-4358-a0f2-c935c7d21be9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:32.948226 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-121a2c5a-cea2-4528-b4fa-223a7728770c req-0e5b708a-2c4d-4358-a0f2-c935c7d21be9 service nova] Creating event network-vif-plugged:b819e488-2853-4e52-bb4c-aa0ca7352bc7 for instance a24268f7-fe8e-47cc-9ad1-abe07e244bee on nch2-master-1 Jan 22 21:03:32.974618 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-121a2c5a-cea2-4528-b4fa-223a7728770c req-0e5b708a-2c4d-4358-a0f2-c935c7d21be9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056471 Jan 22 21:03:32.975713 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 542/1094] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:32.982169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d07d564d-3d99-48b8-952f-262202f93789 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '.version_select at 0x7f1ed6697430>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:32.984696 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:32.984696 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:03:32.991892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d07d564d-3d99-48b8-952f-262202f93789 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:32.992643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d07d564d-3d99-48b8-952f-262202f93789 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:33.019412 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d07d564d-3d99-48b8-952f-262202f93789 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/os-migrations" status: 200 len: 2527 microversion: 2.25 time: 0.038930 Jan 22 21:03:33.025527 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 543/1095] 10.222.0.100 () {60 vars in 1188 bytes} [Sat Jan 22 21:03:32 2022] GET /compute/v2.1/os-migrations => generated 2527 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:33.031330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0b0ea562-70ec-49e3-b5b2-56ef22a5df45 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:33.038501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0b0ea562-70ec-49e3-b5b2-56ef22a5df45 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:33.042851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2ca5bfa2-926d-43b3-a7f3-845f6115494b tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed5dcc040>, body: {"quota_set": {"ram": "5120"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:33.044552 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:33.044552 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:33.153550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0b0ea562-70ec-49e3-b5b2-56ef22a5df45 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:33.164036 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0b0ea562-70ec-49e3-b5b2-56ef22a5df45 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1222 microversion: 2.1 time: 0.137095 Jan 22 21:03:33.166917 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 544/1096] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:33 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:33.193432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1d12f2a2-0a3d-4820-8d5b-59b035931abe tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:33.194100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1d12f2a2-0a3d-4820-8d5b-59b035931abe tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:33.199514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ca5bfa2-926d-43b3-a7f3-845f6115494b tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:33.200605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ca5bfa2-926d-43b3-a7f3-845f6115494b tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:33.202414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ca5bfa2-926d-43b3-a7f3-845f6115494b tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:33.203230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ca5bfa2-926d-43b3-a7f3-845f6115494b tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:33.209780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d12f2a2-0a3d-4820-8d5b-59b035931abe tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:33.211745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d12f2a2-0a3d-4820-8d5b-59b035931abe tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:33.213104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d12f2a2-0a3d-4820-8d5b-59b035931abe tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:33.213756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d12f2a2-0a3d-4820-8d5b-59b035931abe tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:33.350297 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2ca5bfa2-926d-43b3-a7f3-845f6115494b tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/af322247405f435eaeca8fbd32b094c2" status: 200 len: 240 microversion: 2.36 time: 0.541209 Jan 22 21:03:33.351566 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 553/1097] 10.222.0.100 () {62 vars in 1307 bytes} [Sat Jan 22 21:03:32 2022] PUT /compute/v2.1/os-quota-sets/af322247405f435eaeca8fbd32b094c2 => generated 240 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:33.356504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d84b6b11-0324-4163-a437-2c6a4dbd52a4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5deb280>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:33.408669 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d84b6b11-0324-4163-a437-2c6a4dbd52a4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 200 len: 1418 microversion: 2.1 time: 0.055838 Jan 22 21:03:33.409926 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 554/1098] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:03:33 2022] GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 1418 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:33.432091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-1d12f2a2-0a3d-4820-8d5b-59b035931abe tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'services' on Instance uuid 5d7803b5-681b-412b-9319-8aaaa574dca7 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:03:33.439227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b3a398ba-2e58-4135-abd5-a52780fa3611 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:33.442951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b3a398ba-2e58-4135-abd5-a52780fa3611 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:33.459272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3a398ba-2e58-4135-abd5-a52780fa3611 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:33.460095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3a398ba-2e58-4135-abd5-a52780fa3611 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:33.461457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3a398ba-2e58-4135-abd5-a52780fa3611 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:33.465021 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1d12f2a2-0a3d-4820-8d5b-59b035931abe tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 2132 microversion: 2.25 time: 0.287083 Jan 22 21:03:33.465786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3a398ba-2e58-4135-abd5-a52780fa3611 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:33.470390 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 545/1099] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:33 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 2132 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:33.485214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4fc27b11-6e7b-4b50-a11d-3b872c0af4af tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Calling method '.version_select at 0x7f1ed658a5e0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:33.543157 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b3a398ba-2e58-4135-abd5-a52780fa3611 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 24570 microversion: 2.1 time: 0.109309 Jan 22 21:03:33.558870 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 555/1100] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:33 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 24570 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:33.558870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-57c32a0a-5345-452d-b467-692ef2a9e34d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:33.558870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-57c32a0a-5345-452d-b467-692ef2a9e34d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:33.565190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57c32a0a-5345-452d-b467-692ef2a9e34d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:33.565675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57c32a0a-5345-452d-b467-692ef2a9e34d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:33.566473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57c32a0a-5345-452d-b467-692ef2a9e34d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:33.570739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57c32a0a-5345-452d-b467-692ef2a9e34d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:33.590634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fc27b11-6e7b-4b50-a11d-3b872c0af4af tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:33.591075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fc27b11-6e7b-4b50-a11d-3b872c0af4af tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:33.591884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fc27b11-6e7b-4b50-a11d-3b872c0af4af tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:33.593050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fc27b11-6e7b-4b50-a11d-3b872c0af4af tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:33.617241 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4fc27b11-6e7b-4b50-a11d-3b872c0af4af tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/af322247405f435eaeca8fbd32b094c2/detail" status: 200 len: 672 microversion: 2.36 time: 0.145492 Jan 22 21:03:33.618201 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 546/1101] 10.222.0.100 () {60 vars in 1308 bytes} [Sat Jan 22 21:03:33 2022] GET /compute/v2.1/os-quota-sets/af322247405f435eaeca8fbd32b094c2/detail => generated 672 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:33.632064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-625347e1-c7f3-45d3-afb3-becaf678e24e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:33.633179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-625347e1-c7f3-45d3-afb3-becaf678e24e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:33.642390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-625347e1-c7f3-45d3-afb3-becaf678e24e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:33.646379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-625347e1-c7f3-45d3-afb3-becaf678e24e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:33.646379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-625347e1-c7f3-45d3-afb3-becaf678e24e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:33.646379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-625347e1-c7f3-45d3-afb3-becaf678e24e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:33.860621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-625347e1-c7f3-45d3-afb3-becaf678e24e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'services' on Instance uuid 5d7803b5-681b-412b-9319-8aaaa574dca7 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:03:33.862652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-57c32a0a-5345-452d-b467-692ef2a9e34d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:33.872745 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-57c32a0a-5345-452d-b467-692ef2a9e34d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 200 len: 1398 microversion: 2.1 time: 0.327507 Jan 22 21:03:33.875412 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 556/1102] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:33 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 1398 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:33.880390 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-625347e1-c7f3-45d3-afb3-becaf678e24e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 2132 microversion: 2.25 time: 0.260848 Jan 22 21:03:33.880978 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 547/1103] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:03:33 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 2132 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:03:33.916917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c3819857-4aa7-4600-9ef8-a4e8c3915190 tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed5ffc790>, body: {"quota_set": {"ram": "2048"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:33.916917 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:33.916917 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:03:33.917266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3db477a2-0f5c-4f21-a549-299aba829adb tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:33.917266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3db477a2-0f5c-4f21-a549-299aba829adb tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:33.927235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3db477a2-0f5c-4f21-a549-299aba829adb tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:33.927598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3db477a2-0f5c-4f21-a549-299aba829adb tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:33.928353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3db477a2-0f5c-4f21-a549-299aba829adb tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:33.928794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3db477a2-0f5c-4f21-a549-299aba829adb tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:34.013152 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3db477a2-0f5c-4f21-a549-299aba829adb tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.134776 Jan 22 21:03:34.017692 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 557/1104] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:33 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:34.021940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f80aa2c5-5cef-4814-aa3d-a9351a56f4b5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:34.029717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3819857-4aa7-4600-9ef8-a4e8c3915190 tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:34.029717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3819857-4aa7-4600-9ef8-a4e8c3915190 tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:34.029717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3819857-4aa7-4600-9ef8-a4e8c3915190 tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:34.029717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3819857-4aa7-4600-9ef8-a4e8c3915190 tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:34.036893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f80aa2c5-5cef-4814-aa3d-a9351a56f4b5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:34.057777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f80aa2c5-5cef-4814-aa3d-a9351a56f4b5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:34.066219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f80aa2c5-5cef-4814-aa3d-a9351a56f4b5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:34.066219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f80aa2c5-5cef-4814-aa3d-a9351a56f4b5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:34.066219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f80aa2c5-5cef-4814-aa3d-a9351a56f4b5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:34.074759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3819857-4aa7-4600-9ef8-a4e8c3915190 tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:34.075431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3819857-4aa7-4600-9ef8-a4e8c3915190 tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:34.077256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3819857-4aa7-4600-9ef8-a4e8c3915190 tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:34.078204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3819857-4aa7-4600-9ef8-a4e8c3915190 tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:34.189854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-f80aa2c5-5cef-4814-aa3d-a9351a56f4b5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lazy-loading 'services' on Instance uuid 5d7803b5-681b-412b-9319-8aaaa574dca7 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:03:34.235217 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c3819857-4aa7-4600-9ef8-a4e8c3915190 tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-quota-sets/af322247405f435eaeca8fbd32b094c2?user_id=77815f86a8cd4f0dbf15dec7761f2109" status: 200 len: 240 microversion: 2.36 time: 0.325920 Jan 22 21:03:34.235848 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 548/1105] 10.222.0.100 () {62 vars in 1388 bytes} [Sat Jan 22 21:03:33 2022] PUT /compute/v2.1/os-quota-sets/af322247405f435eaeca8fbd32b094c2?user_id=77815f86a8cd4f0dbf15dec7761f2109 => generated 240 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:03:34.242117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-66b5e091-2821-4fac-9d20-1adf93319761 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:34.265780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-66b5e091-2821-4fac-9d20-1adf93319761 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:34.280569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66b5e091-2821-4fac-9d20-1adf93319761 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:34.281322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66b5e091-2821-4fac-9d20-1adf93319761 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:34.288598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66b5e091-2821-4fac-9d20-1adf93319761 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:34.289085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66b5e091-2821-4fac-9d20-1adf93319761 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:34.366818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-66b5e091-2821-4fac-9d20-1adf93319761 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:34.392764 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-66b5e091-2821-4fac-9d20-1adf93319761 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1226 microversion: 2.1 time: 0.155172 Jan 22 21:03:34.400369 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 549/1106] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:34 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1226 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:34.412483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0033d626-5a19-4905-bea3-6623ec23513e tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] Calling method '.version_select at 0x7f1ed6378d30>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:34.484883 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f80aa2c5-5cef-4814-aa3d-a9351a56f4b5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7/os-volume_attachments/135c98ab-cd95-4a5b-baa2-e72e4414fe5b" status: 202 len: 0 microversion: 2.25 time: 0.468697 Jan 22 21:03:34.485577 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 558/1107] 10.222.0.100 () {60 vars in 1461 bytes} [Sat Jan 22 21:03:34 2022] DELETE /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7/os-volume_attachments/135c98ab-cd95-4a5b-baa2-e72e4414fe5b => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:03:34.495915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a5521d88-d9b4-45db-b468-61d00d55b160 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5dc9a60>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:34.569824 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0033d626-5a19-4905-bea3-6623ec23513e tempest-QuotasAdminTestV236-626145803 tempest-QuotasAdminTestV236-626145803-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/af322247405f435eaeca8fbd32b094c2?user_id=77815f86a8cd4f0dbf15dec7761f2109" status: 200 len: 282 microversion: 2.36 time: 0.167998 Jan 22 21:03:34.570735 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 550/1108] 10.222.0.100 () {60 vars in 1368 bytes} [Sat Jan 22 21:03:34 2022] GET /compute/v2.1/os-quota-sets/af322247405f435eaeca8fbd32b094c2?user_id=77815f86a8cd4f0dbf15dec7761f2109 => generated 282 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:34.577125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-05bbcacb-efa0-459e-bdf3-7eba25f57b8c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:34.585905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-05bbcacb-efa0-459e-bdf3-7eba25f57b8c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:34.591239 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a5521d88-d9b4-45db-b468-61d00d55b160 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 200 len: 1418 microversion: 2.1 time: 0.100074 Jan 22 21:03:34.592214 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 559/1109] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:03:34 2022] GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 1418 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:34.612438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a37e732a-9108-436a-aed6-b8395246cdbd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:34.614813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a37e732a-9108-436a-aed6-b8395246cdbd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:34.622248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05bbcacb-efa0-459e-bdf3-7eba25f57b8c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:34.622835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05bbcacb-efa0-459e-bdf3-7eba25f57b8c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:34.634762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05bbcacb-efa0-459e-bdf3-7eba25f57b8c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:34.639597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05bbcacb-efa0-459e-bdf3-7eba25f57b8c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:34.643172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a37e732a-9108-436a-aed6-b8395246cdbd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:34.643172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a37e732a-9108-436a-aed6-b8395246cdbd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:34.644087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a37e732a-9108-436a-aed6-b8395246cdbd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:34.646063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a37e732a-9108-436a-aed6-b8395246cdbd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:34.714773 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a37e732a-9108-436a-aed6-b8395246cdbd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 24570 microversion: 2.1 time: 0.114848 Jan 22 21:03:34.723543 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 560/1110] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:34 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 24570 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:34.734810 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-05bbcacb-efa0-459e-bdf3-7eba25f57b8c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.162780 Jan 22 21:03:34.735833 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 551/1111] 10.222.0.100 () {60 vars in 1347 bytes} [Sat Jan 22 21:03:34 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:34.894192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-45fb82d2-9fcc-4cbc-80b6-ec9d1a5367c1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:34.894988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-45fb82d2-9fcc-4cbc-80b6-ec9d1a5367c1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:34.903454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45fb82d2-9fcc-4cbc-80b6-ec9d1a5367c1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:34.904007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45fb82d2-9fcc-4cbc-80b6-ec9d1a5367c1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:34.905468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45fb82d2-9fcc-4cbc-80b6-ec9d1a5367c1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:34.906021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45fb82d2-9fcc-4cbc-80b6-ec9d1a5367c1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:35.028402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-facf8bb1-fb20-4eef-8153-97cb87662ca8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:35.034412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-facf8bb1-fb20-4eef-8153-97cb87662ca8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:35.048756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-facf8bb1-fb20-4eef-8153-97cb87662ca8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:35.052871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-facf8bb1-fb20-4eef-8153-97cb87662ca8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:35.053945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-facf8bb1-fb20-4eef-8153-97cb87662ca8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:35.054309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-facf8bb1-fb20-4eef-8153-97cb87662ca8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:35.162493 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-facf8bb1-fb20-4eef-8153-97cb87662ca8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.140934 Jan 22 21:03:35.168264 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 552/1112] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:35 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:03:35.175813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-45fb82d2-9fcc-4cbc-80b6-ec9d1a5367c1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:35.190683 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-45fb82d2-9fcc-4cbc-80b6-ec9d1a5367c1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 200 len: 1398 microversion: 2.1 time: 0.301265 Jan 22 21:03:35.207043 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 561/1113] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:34 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 1398 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:35.425060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8a416a24-2d82-416a-9d6e-c34101d4b4c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:35.425775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8a416a24-2d82-416a-9d6e-c34101d4b4c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:35.434968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a416a24-2d82-416a-9d6e-c34101d4b4c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:35.436280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a416a24-2d82-416a-9d6e-c34101d4b4c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:35.437397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a416a24-2d82-416a-9d6e-c34101d4b4c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:35.438099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a416a24-2d82-416a-9d6e-c34101d4b4c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:35.521652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8a416a24-2d82-416a-9d6e-c34101d4b4c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:35.526772 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8a416a24-2d82-416a-9d6e-c34101d4b4c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1274 microversion: 2.1 time: 0.109567 Jan 22 21:03:35.527669 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 553/1114] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:35 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:35.605882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2277538c-0e9e-440a-9dbb-89d6e17a62e3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5e67550>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:35.758220 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2277538c-0e9e-440a-9dbb-89d6e17a62e3 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 200 len: 1418 microversion: 2.1 time: 0.077130 Jan 22 21:03:35.758220 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 562/1115] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:03:35 2022] GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 1418 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:35.758220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0cd39d59-27d9-4a94-a0c4-945965bfa819 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:35.758220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0cd39d59-27d9-4a94-a0c4-945965bfa819 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:35.765002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e000b336-7736-46fd-b1d0-81b332457ee7 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:35.766160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e000b336-7736-46fd-b1d0-81b332457ee7 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:35.777106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e000b336-7736-46fd-b1d0-81b332457ee7 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:35.781861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e000b336-7736-46fd-b1d0-81b332457ee7 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:35.781997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cd39d59-27d9-4a94-a0c4-945965bfa819 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:35.781997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cd39d59-27d9-4a94-a0c4-945965bfa819 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:35.782175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cd39d59-27d9-4a94-a0c4-945965bfa819 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:35.782648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cd39d59-27d9-4a94-a0c4-945965bfa819 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:35.784094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e000b336-7736-46fd-b1d0-81b332457ee7 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:35.784636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e000b336-7736-46fd-b1d0-81b332457ee7 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:35.831142 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0cd39d59-27d9-4a94-a0c4-945965bfa819 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.087104 Jan 22 21:03:35.835874 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 563/1116] 10.222.0.100 () {60 vars in 1347 bytes} [Sat Jan 22 21:03:35 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:35.894482 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e000b336-7736-46fd-b1d0-81b332457ee7 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 24570 microversion: 2.1 time: 0.166918 Jan 22 21:03:35.896292 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 554/1117] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:35 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 24570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:36.187755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-95ea0a71-8b3d-40fe-9a3c-b64fd548b073 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:36.189320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-95ea0a71-8b3d-40fe-9a3c-b64fd548b073 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:36.208605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95ea0a71-8b3d-40fe-9a3c-b64fd548b073 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:36.209355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95ea0a71-8b3d-40fe-9a3c-b64fd548b073 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:36.210692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95ea0a71-8b3d-40fe-9a3c-b64fd548b073 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:36.211300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95ea0a71-8b3d-40fe-9a3c-b64fd548b073 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:36.212390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-749da3a5-2f18-4521-a30e-f579dc7eed68 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:36.213106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-749da3a5-2f18-4521-a30e-f579dc7eed68 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:36.231421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-749da3a5-2f18-4521-a30e-f579dc7eed68 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:36.234621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-749da3a5-2f18-4521-a30e-f579dc7eed68 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:36.234621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-749da3a5-2f18-4521-a30e-f579dc7eed68 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:36.234621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-749da3a5-2f18-4521-a30e-f579dc7eed68 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:36.310972 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-95ea0a71-8b3d-40fe-9a3c-b64fd548b073 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.132717 Jan 22 21:03:36.315904 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 564/1118] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:36 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:36.548023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a880b9ba-b6cc-4c77-98ad-59805113538e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:36.548839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a880b9ba-b6cc-4c77-98ad-59805113538e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:36.572322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a880b9ba-b6cc-4c77-98ad-59805113538e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:36.572776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a880b9ba-b6cc-4c77-98ad-59805113538e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:36.573646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a880b9ba-b6cc-4c77-98ad-59805113538e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:36.574103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a880b9ba-b6cc-4c77-98ad-59805113538e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:36.615018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-749da3a5-2f18-4521-a30e-f579dc7eed68 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:36.626167 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-749da3a5-2f18-4521-a30e-f579dc7eed68 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 200 len: 1579 microversion: 2.1 time: 0.417783 Jan 22 21:03:36.626979 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 555/1119] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:36 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 1579 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:36.648494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fe3612a5-cfea-4cde-86e5-a4ea7c7a1489 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:36.649444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fe3612a5-cfea-4cde-86e5-a4ea7c7a1489 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:36.653376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a880b9ba-b6cc-4c77-98ad-59805113538e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:36.656967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe3612a5-cfea-4cde-86e5-a4ea7c7a1489 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:36.657659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe3612a5-cfea-4cde-86e5-a4ea7c7a1489 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:36.659216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe3612a5-cfea-4cde-86e5-a4ea7c7a1489 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:36.659705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe3612a5-cfea-4cde-86e5-a4ea7c7a1489 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:36.666513 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a880b9ba-b6cc-4c77-98ad-59805113538e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1280 microversion: 2.1 time: 0.123736 Jan 22 21:03:36.667690 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 565/1120] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:36 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1280 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:36.698277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7b24cb31-83b8-44cd-b8a3-df48f29f138c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5e0aee0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:36.745738 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7b24cb31-83b8-44cd-b8a3-df48f29f138c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 200 len: 1418 microversion: 2.1 time: 0.051063 Jan 22 21:03:36.746477 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 566/1121] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:03:36 2022] GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 1418 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:36.843877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0741611d-c8ff-491b-9044-0d853793aad5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:36.844688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0741611d-c8ff-491b-9044-0d853793aad5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:36.851590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0741611d-c8ff-491b-9044-0d853793aad5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:36.852045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0741611d-c8ff-491b-9044-0d853793aad5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:36.852866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0741611d-c8ff-491b-9044-0d853793aad5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:36.853294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0741611d-c8ff-491b-9044-0d853793aad5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:36.884278 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0741611d-c8ff-491b-9044-0d853793aad5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.044923 Jan 22 21:03:36.885041 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 567/1122] 10.222.0.100 () {60 vars in 1347 bytes} [Sat Jan 22 21:03:36 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:36.907935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c378d23f-01bf-4fee-a631-6d320c1a5c4d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:36.908856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c378d23f-01bf-4fee-a631-6d320c1a5c4d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:36.914893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c378d23f-01bf-4fee-a631-6d320c1a5c4d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:36.915498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c378d23f-01bf-4fee-a631-6d320c1a5c4d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:36.916358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c378d23f-01bf-4fee-a631-6d320c1a5c4d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:36.916801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c378d23f-01bf-4fee-a631-6d320c1a5c4d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:36.959195 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c378d23f-01bf-4fee-a631-6d320c1a5c4d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 24570 microversion: 2.1 time: 0.055785 Jan 22 21:03:36.960177 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 568/1123] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:36 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 24570 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:03:37.067319 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fe3612a5-cfea-4cde-86e5-a4ea7c7a1489 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.423058 Jan 22 21:03:37.067929 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 556/1124] 10.222.0.100 () {58 vars in 1279 bytes} [Sat Jan 22 21:03:36 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/os-interface => generated 284 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:03:37.323902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-14ec5d08-3ed8-4b89-81c5-79578da24fbd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:37.325051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-14ec5d08-3ed8-4b89-81c5-79578da24fbd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:37.337786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14ec5d08-3ed8-4b89-81c5-79578da24fbd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:37.338358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14ec5d08-3ed8-4b89-81c5-79578da24fbd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:37.339436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14ec5d08-3ed8-4b89-81c5-79578da24fbd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:37.340105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14ec5d08-3ed8-4b89-81c5-79578da24fbd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:37.409982 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-14ec5d08-3ed8-4b89-81c5-79578da24fbd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.087588 Jan 22 21:03:37.412016 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 569/1125] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:37 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:37.684501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-456b0791-6788-4d80-b1b8-fa733fc617c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:37.687323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-456b0791-6788-4d80-b1b8-fa733fc617c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:37.693669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-456b0791-6788-4d80-b1b8-fa733fc617c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:37.694392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-456b0791-6788-4d80-b1b8-fa733fc617c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:37.695435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-456b0791-6788-4d80-b1b8-fa733fc617c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:37.696114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-456b0791-6788-4d80-b1b8-fa733fc617c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:37.761928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61c1972d-2a5b-442a-9230-d5ea26075bbe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5dc9280>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:37.844803 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61c1972d-2a5b-442a-9230-d5ea26075bbe tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 200 len: 1418 microversion: 2.1 time: 0.087134 Jan 22 21:03:37.847490 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 570/1126] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:03:37 2022] GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 1418 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:37.971789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e7bea695-9497-4694-8f5c-3a318988c1de tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:37.972822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e7bea695-9497-4694-8f5c-3a318988c1de tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:37.982254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7bea695-9497-4694-8f5c-3a318988c1de tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:37.982763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7bea695-9497-4694-8f5c-3a318988c1de tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:37.983951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7bea695-9497-4694-8f5c-3a318988c1de tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:37.984800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7bea695-9497-4694-8f5c-3a318988c1de tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:38.031509 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e7bea695-9497-4694-8f5c-3a318988c1de tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 24570 microversion: 2.1 time: 0.064492 Jan 22 21:03:38.036128 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 571/1127] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:37 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 24570 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:38.066910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-456b0791-6788-4d80-b1b8-fa733fc617c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:38.094067 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-456b0791-6788-4d80-b1b8-fa733fc617c2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1322 microversion: 2.1 time: 0.413881 Jan 22 21:03:38.097129 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 557/1128] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:37 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:38.521992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8003e3c9-db7e-41a6-a0f6-520cbf58e8ac tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:38.521992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8003e3c9-db7e-41a6-a0f6-520cbf58e8ac tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:38.521992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8003e3c9-db7e-41a6-a0f6-520cbf58e8ac tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:38.521992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8003e3c9-db7e-41a6-a0f6-520cbf58e8ac tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:38.523804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8003e3c9-db7e-41a6-a0f6-520cbf58e8ac tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:38.523804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8003e3c9-db7e-41a6-a0f6-520cbf58e8ac tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:38.523804 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8003e3c9-db7e-41a6-a0f6-520cbf58e8ac tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.068826 Jan 22 21:03:38.523804 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 572/1129] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:38 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:38.866911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5f5c07b8-6774-4615-a279-97740a2f87d7 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5f2fe50>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:38.912428 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5f5c07b8-6774-4615-a279-97740a2f87d7 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 200 len: 1427 microversion: 2.1 time: 0.056882 Jan 22 21:03:38.913704 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 558/1130] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:03:38 2022] GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:38.926130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3bfa8d15-8ff9-4c13-aa2a-bdfef825c955 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5dee5e0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:39.014844 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3bfa8d15-8ff9-4c13-aa2a-bdfef825c955 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 200 len: 1427 microversion: 2.1 time: 0.092283 Jan 22 21:03:39.016787 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 573/1131] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:03:38 2022] GET /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:39.035914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4867a8e4-0c60-497f-9e9b-c38a9d14b0de tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5e2df70>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:39.037464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-40840cab-930a-4791-aad6-6d7f15b847ae tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:39.039181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-40840cab-930a-4791-aad6-6d7f15b847ae tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:39.048862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40840cab-930a-4791-aad6-6d7f15b847ae tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:39.049626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40840cab-930a-4791-aad6-6d7f15b847ae tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:39.050612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40840cab-930a-4791-aad6-6d7f15b847ae tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:39.051211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40840cab-930a-4791-aad6-6d7f15b847ae tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:39.099414 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-40840cab-930a-4791-aad6-6d7f15b847ae tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 14 microversion: 2.1 time: 0.070143 Jan 22 21:03:39.101583 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 574/1132] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:39 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:03:39.110151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-22a81353-2236-4ff0-b0a3-fd76aae06b49 req-c35a2a05-9af5-400b-a261-72deddf28aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a24268f7-fe8e-47cc-9ad1-abe07e244bee", "tag": "b819e488-2853-4e52-bb4c-aa0ca7352bc7"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:39.112070 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:39.112070 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:39.125837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-22a81353-2236-4ff0-b0a3-fd76aae06b49 req-c35a2a05-9af5-400b-a261-72deddf28aac service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:39.126235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-22a81353-2236-4ff0-b0a3-fd76aae06b49 req-c35a2a05-9af5-400b-a261-72deddf28aac service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:39.158918 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-22a81353-2236-4ff0-b0a3-fd76aae06b49 req-c35a2a05-9af5-400b-a261-72deddf28aac service nova] Creating event network-changed:b819e488-2853-4e52-bb4c-aa0ca7352bc7 for instance a24268f7-fe8e-47cc-9ad1-abe07e244bee on nch2-master-1 Jan 22 21:03:39.167898 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-22a81353-2236-4ff0-b0a3-fd76aae06b49 req-c35a2a05-9af5-400b-a261-72deddf28aac service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064386 Jan 22 21:03:39.171900 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 575/1133] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:39.178456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-98ee2b49-6384-43e6-b610-af8cb0b3353d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:39.179848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-98ee2b49-6384-43e6-b610-af8cb0b3353d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:39.187393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98ee2b49-6384-43e6-b610-af8cb0b3353d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:39.192335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98ee2b49-6384-43e6-b610-af8cb0b3353d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:39.192335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98ee2b49-6384-43e6-b610-af8cb0b3353d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:39.192335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98ee2b49-6384-43e6-b610-af8cb0b3353d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:39.239482 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-98ee2b49-6384-43e6-b610-af8cb0b3353d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 24570 microversion: 2.1 time: 0.065861 Jan 22 21:03:39.240958 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 576/1134] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:39 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 24570 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:39.255221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f254fe97-3e36-4ae6-9633-540ed581bbf7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:39.259776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f254fe97-3e36-4ae6-9633-540ed581bbf7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:39.278002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f254fe97-3e36-4ae6-9633-540ed581bbf7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:39.280086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f254fe97-3e36-4ae6-9633-540ed581bbf7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:39.281696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f254fe97-3e36-4ae6-9633-540ed581bbf7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:39.284491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f254fe97-3e36-4ae6-9633-540ed581bbf7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:39.657832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f254fe97-3e36-4ae6-9633-540ed581bbf7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:39.668325 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f254fe97-3e36-4ae6-9633-540ed581bbf7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1322 microversion: 2.1 time: 0.425858 Jan 22 21:03:39.668910 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 577/1135] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:39 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:39.677437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-10b626d8-5cdd-4dea-bacc-239fcdf2ca07 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:39.702157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-10b626d8-5cdd-4dea-bacc-239fcdf2ca07 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:39.723427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10b626d8-5cdd-4dea-bacc-239fcdf2ca07 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:39.723889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10b626d8-5cdd-4dea-bacc-239fcdf2ca07 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:39.724790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10b626d8-5cdd-4dea-bacc-239fcdf2ca07 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:39.725637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10b626d8-5cdd-4dea-bacc-239fcdf2ca07 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:39.813424 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-10b626d8-5cdd-4dea-bacc-239fcdf2ca07 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.139296 Jan 22 21:03:39.814128 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 578/1136] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:39 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:40.111352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e456a83a-7952-4d9a-ac30-d286c8063cfa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:40.113112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e456a83a-7952-4d9a-ac30-d286c8063cfa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:40.130044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e456a83a-7952-4d9a-ac30-d286c8063cfa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:40.131227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e456a83a-7952-4d9a-ac30-d286c8063cfa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:40.134478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e456a83a-7952-4d9a-ac30-d286c8063cfa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:40.134937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e456a83a-7952-4d9a-ac30-d286c8063cfa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:40.216561 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e456a83a-7952-4d9a-ac30-d286c8063cfa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 14 microversion: 2.1 time: 0.109396 Jan 22 21:03:40.222661 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 579/1137] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:40 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:03:40.254852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f5ca80d-371a-4f8e-9d47-c9e41cb622b0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:40.256186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8f5ca80d-371a-4f8e-9d47-c9e41cb622b0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:40.278264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f5ca80d-371a-4f8e-9d47-c9e41cb622b0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:40.283664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f5ca80d-371a-4f8e-9d47-c9e41cb622b0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:40.283664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f5ca80d-371a-4f8e-9d47-c9e41cb622b0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:40.283664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f5ca80d-371a-4f8e-9d47-c9e41cb622b0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:40.379069 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8f5ca80d-371a-4f8e-9d47-c9e41cb622b0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 24570 microversion: 2.1 time: 0.128226 Jan 22 21:03:40.383982 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 580/1138] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:40 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 24570 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:40.688904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f26c3bd8-efa5-49cf-ace0-01c7d88087da tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:40.691583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f26c3bd8-efa5-49cf-ace0-01c7d88087da tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:40.722471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f26c3bd8-efa5-49cf-ace0-01c7d88087da tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:40.727364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f26c3bd8-efa5-49cf-ace0-01c7d88087da tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:40.728602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f26c3bd8-efa5-49cf-ace0-01c7d88087da tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:40.730403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f26c3bd8-efa5-49cf-ace0-01c7d88087da tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:40.778666 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4867a8e4-0c60-497f-9e9b-c38a9d14b0de tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 204 len: 0 microversion: 2.1 time: 1.748432 Jan 22 21:03:40.782319 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 559/1139] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:39 2022] DELETE /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 0 bytes in 1757 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:03:40.798438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d5991425-0837-4a2f-81c1-5a5810794d86 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:40.799457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d5991425-0837-4a2f-81c1-5a5810794d86 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:40.816451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5991425-0837-4a2f-81c1-5a5810794d86 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:40.816971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5991425-0837-4a2f-81c1-5a5810794d86 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:40.821707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5991425-0837-4a2f-81c1-5a5810794d86 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:40.822199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5991425-0837-4a2f-81c1-5a5810794d86 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:40.878648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d5991425-0837-4a2f-81c1-5a5810794d86 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:03:40.949461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f26c3bd8-efa5-49cf-ace0-01c7d88087da tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:40.958777 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f26c3bd8-efa5-49cf-ace0-01c7d88087da tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1322 microversion: 2.1 time: 0.276034 Jan 22 21:03:40.969009 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 581/1140] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:40 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:40.971782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7957415a-f846-479f-8769-55333d0cd74d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:40.972717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7957415a-f846-479f-8769-55333d0cd74d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:40.978749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7957415a-f846-479f-8769-55333d0cd74d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:40.979299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7957415a-f846-479f-8769-55333d0cd74d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:40.980104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7957415a-f846-479f-8769-55333d0cd74d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:40.980549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7957415a-f846-479f-8769-55333d0cd74d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:41.030583 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7957415a-f846-479f-8769-55333d0cd74d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 32622 microversion: 2.1 time: 0.064583 Jan 22 21:03:41.031494 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 582/1141] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:40 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 32622 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:41.218530 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d5991425-0837-4a2f-81c1-5a5810794d86 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 204 len: 0 microversion: 2.1 time: 0.428026 Jan 22 21:03:41.219185 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 560/1142] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:03:40 2022] DELETE /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:03:41.229888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e4b56098-03f5-48ef-b7a9-5c1bb54220ce tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:41.231555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e4b56098-03f5-48ef-b7a9-5c1bb54220ce tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:41.250013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4b56098-03f5-48ef-b7a9-5c1bb54220ce tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:41.250702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4b56098-03f5-48ef-b7a9-5c1bb54220ce tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:41.251692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4b56098-03f5-48ef-b7a9-5c1bb54220ce tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:41.252293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4b56098-03f5-48ef-b7a9-5c1bb54220ce tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:41.252728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f467b3fc-77f2-48f2-b2d6-d69066d4a012 req-e4989026-a6b1-44fc-9e62-27e49392738e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e61d4e4a-a3e5-4329-94b0-bfcd080a47cb", "tag": "54742673-5698-4189-9534-ffa749b79f02"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:41.254542 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:41.254542 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:03:41.272151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f467b3fc-77f2-48f2-b2d6-d69066d4a012 req-e4989026-a6b1-44fc-9e62-27e49392738e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:41.273295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f467b3fc-77f2-48f2-b2d6-d69066d4a012 req-e4989026-a6b1-44fc-9e62-27e49392738e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:41.294311 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f467b3fc-77f2-48f2-b2d6-d69066d4a012 req-e4989026-a6b1-44fc-9e62-27e49392738e service nova] Creating event network-changed:54742673-5698-4189-9534-ffa749b79f02 for instance e61d4e4a-a3e5-4329-94b0-bfcd080a47cb on nch2-master-1 Jan 22 21:03:41.297427 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e4b56098-03f5-48ef-b7a9-5c1bb54220ce tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 14 microversion: 2.1 time: 0.071462 Jan 22 21:03:41.298595 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 583/1143] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:41 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:03:41.303555 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f467b3fc-77f2-48f2-b2d6-d69066d4a012 req-e4989026-a6b1-44fc-9e62-27e49392738e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058106 Jan 22 21:03:41.304172 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 561/1144] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:41.365189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-468157343", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "9c00559f-de2d-48cc-a51a-3429ed0dc4c4"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:41.400072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5fcd5ab4-fd65-410f-8a49-193dd0739ce1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:41.401602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5fcd5ab4-fd65-410f-8a49-193dd0739ce1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:41.422960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fcd5ab4-fd65-410f-8a49-193dd0739ce1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:41.426377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fcd5ab4-fd65-410f-8a49-193dd0739ce1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:41.427755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fcd5ab4-fd65-410f-8a49-193dd0739ce1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:41.428386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fcd5ab4-fd65-410f-8a49-193dd0739ce1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:41.454659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] validate_networks() for [('9c00559f-de2d-48cc-a51a-3429ed0dc4c4', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:03:41.512292 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5fcd5ab4-fd65-410f-8a49-193dd0739ce1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 24570 microversion: 2.1 time: 0.124011 Jan 22 21:03:41.517733 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 562/1145] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:41 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 24570 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:03:41.905571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:03:41.906400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:03:41.907694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:03:41.908407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:03:41.909361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:03:41.952177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:41.955169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:41.960738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:41.962077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:41.983261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab567548-5328-4306-aec2-9ea28ea44f8b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:41.985801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab567548-5328-4306-aec2-9ea28ea44f8b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:42.021415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab567548-5328-4306-aec2-9ea28ea44f8b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:42.021919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab567548-5328-4306-aec2-9ea28ea44f8b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:42.022767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab567548-5328-4306-aec2-9ea28ea44f8b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:42.023213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab567548-5328-4306-aec2-9ea28ea44f8b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:42.031579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Getting quotas for project 01b1a67e790046629fe2b636fcefd01d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:03:42.038447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Getting quotas for user 946cce9cf6874d60912e69c1169ed379 and project 01b1a67e790046629fe2b636fcefd01d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:03:42.072239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:03:42.076826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:03:42.209956 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-92eaf1a5-d202-44a2-8e2c-98431f74a0bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.848788 Jan 22 21:03:42.210650 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 584/1146] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:03:41 2022] POST /compute/v2.1/servers => generated 382 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:03:42.215776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3b89050b-287b-4658-aef8-342ccd003e5b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:42.216965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3b89050b-287b-4658-aef8-342ccd003e5b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:42.224695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b89050b-287b-4658-aef8-342ccd003e5b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:42.225544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b89050b-287b-4658-aef8-342ccd003e5b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:42.226559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b89050b-287b-4658-aef8-342ccd003e5b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:42.227203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b89050b-287b-4658-aef8-342ccd003e5b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:42.265843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab567548-5328-4306-aec2-9ea28ea44f8b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:42.277902 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab567548-5328-4306-aec2-9ea28ea44f8b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1322 microversion: 2.1 time: 0.302357 Jan 22 21:03:42.280063 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 563/1147] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:41 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:42.317173 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3b89050b-287b-4658-aef8-342ccd003e5b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action" status: 200 len: 40773 microversion: 2.1 time: 0.104796 Jan 22 21:03:42.318809 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 585/1148] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:42 2022] POST /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720/action => generated 40773 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:42.328295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-343a60db-cae7-461f-9f94-2f7e6dd2d13a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:42.329436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-343a60db-cae7-461f-9f94-2f7e6dd2d13a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:42.405469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-343a60db-cae7-461f-9f94-2f7e6dd2d13a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:42.437778 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-343a60db-cae7-461f-9f94-2f7e6dd2d13a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1211 microversion: 2.1 time: 0.113261 Jan 22 21:03:42.437778 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 586/1149] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:42 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1211 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:42.442277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-36a9b380-45e3-420a-b813-f43c05148dbe tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:42.443596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-36a9b380-45e3-420a-b813-f43c05148dbe tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:42.443755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-808200877", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:42.450934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36a9b380-45e3-420a-b813-f43c05148dbe tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:42.451696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36a9b380-45e3-420a-b813-f43c05148dbe tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:42.452548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36a9b380-45e3-420a-b813-f43c05148dbe tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:42.452999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36a9b380-45e3-420a-b813-f43c05148dbe tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:42.521014 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-36a9b380-45e3-420a-b813-f43c05148dbe tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 14 microversion: 2.1 time: 0.083169 Jan 22 21:03:42.522633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:03:42.523638 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 587/1150] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:42 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:03:42.534314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-67146e74-d338-4ce6-be9a-6bd07b09bac9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:42.535467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-67146e74-d338-4ce6-be9a-6bd07b09bac9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:42.548636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67146e74-d338-4ce6-be9a-6bd07b09bac9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:42.549098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67146e74-d338-4ce6-be9a-6bd07b09bac9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:42.549957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67146e74-d338-4ce6-be9a-6bd07b09bac9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:42.552460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67146e74-d338-4ce6-be9a-6bd07b09bac9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:42.746907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-67146e74-d338-4ce6-be9a-6bd07b09bac9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:42.772197 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-67146e74-d338-4ce6-be9a-6bd07b09bac9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 200 len: 1705 microversion: 2.1 time: 0.244886 Jan 22 21:03:42.773062 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 588/1151] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:42 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 1705 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:42.796366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0501ba1d-c5ba-44fb-ab2f-ed6643fde3f0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:42.797855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0501ba1d-c5ba-44fb-ab2f-ed6643fde3f0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:42.806954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0501ba1d-c5ba-44fb-ab2f-ed6643fde3f0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:42.807473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0501ba1d-c5ba-44fb-ab2f-ed6643fde3f0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:42.811104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0501ba1d-c5ba-44fb-ab2f-ed6643fde3f0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:42.811773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0501ba1d-c5ba-44fb-ab2f-ed6643fde3f0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:42.817079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:03:42.817567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:03:42.818031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:03:42.818485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:03:42.818949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:03:42.836043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:42.845987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:42.845987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:42.845987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:42.862595 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0501ba1d-c5ba-44fb-ab2f-ed6643fde3f0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 24570 microversion: 2.1 time: 0.088087 Jan 22 21:03:42.863330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Getting quotas for project 2566e2caf61643f7b603b8ab8f81e193. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:03:42.863529 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 589/1152] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:42 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 24570 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:42.868603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Getting quotas for user 1e062e80dcda4118963156134c040e67 and project 2566e2caf61643f7b603b8ab8f81e193. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:03:42.883588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:03:42.886156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:03:43.295942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f29d9b2-5d6d-4865-a3d9-f7fd5490f8c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:43.296642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f29d9b2-5d6d-4865-a3d9-f7fd5490f8c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:43.304736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f29d9b2-5d6d-4865-a3d9-f7fd5490f8c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:43.305200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f29d9b2-5d6d-4865-a3d9-f7fd5490f8c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:43.306036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f29d9b2-5d6d-4865-a3d9-f7fd5490f8c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:43.306488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f29d9b2-5d6d-4865-a3d9-f7fd5490f8c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:43.461929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f29d9b2-5d6d-4865-a3d9-f7fd5490f8c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:43.470564 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f29d9b2-5d6d-4865-a3d9-f7fd5490f8c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1322 microversion: 2.1 time: 0.178640 Jan 22 21:03:43.471344 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 590/1153] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:43 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:43.475650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cc45b0db-2bcb-485c-8cbe-456dece4afcf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:43.476248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cc45b0db-2bcb-485c-8cbe-456dece4afcf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:43.526172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cc45b0db-2bcb-485c-8cbe-456dece4afcf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:43.533666 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cc45b0db-2bcb-485c-8cbe-456dece4afcf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1211 microversion: 2.1 time: 0.061462 Jan 22 21:03:43.534234 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 591/1154] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:43 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1211 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:43.546906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b9527b5a-5229-457c-bbbd-955cc3c05720 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:43.548105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b9527b5a-5229-457c-bbbd-955cc3c05720 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:43.555775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9527b5a-5229-457c-bbbd-955cc3c05720 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:43.556270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9527b5a-5229-457c-bbbd-955cc3c05720 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:43.557015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9527b5a-5229-457c-bbbd-955cc3c05720 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:43.557453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9527b5a-5229-457c-bbbd-955cc3c05720 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:43.608628 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b9527b5a-5229-457c-bbbd-955cc3c05720 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 14 microversion: 2.1 time: 0.065196 Jan 22 21:03:43.609788 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 592/1155] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:43 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:03:43.615550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-080b4f53-66fb-46ca-b609-91af7e1fdc60 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:43.616359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-080b4f53-66fb-46ca-b609-91af7e1fdc60 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:43.623765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-080b4f53-66fb-46ca-b609-91af7e1fdc60 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:43.624222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-080b4f53-66fb-46ca-b609-91af7e1fdc60 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:43.625102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-080b4f53-66fb-46ca-b609-91af7e1fdc60 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:43.625744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-080b4f53-66fb-46ca-b609-91af7e1fdc60 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:43.652660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-080b4f53-66fb-46ca-b609-91af7e1fdc60 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:03:44.558116 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a263cea-d439-40b0-8dfb-4b2a83791b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.276641 Jan 22 21:03:44.560975 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 564/1156] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:03:42 2022] POST /compute/v2.1/servers => generated 382 bytes in 2278 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:03:44.563990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-237289ac-cb7d-42c0-9682-12541701d144 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:44.564965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-237289ac-cb7d-42c0-9682-12541701d144 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:44.573984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-237289ac-cb7d-42c0-9682-12541701d144 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:44.574552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-237289ac-cb7d-42c0-9682-12541701d144 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:44.575558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-237289ac-cb7d-42c0-9682-12541701d144 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:44.576678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-237289ac-cb7d-42c0-9682-12541701d144 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:44.624495 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-237289ac-cb7d-42c0-9682-12541701d144 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 24570 microversion: 2.1 time: 0.064343 Jan 22 21:03:44.629389 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 565/1157] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:44 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 24570 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:44.630974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0ec5d942-4f21-4d5a-874f-497c17c11d44 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:44.631684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0ec5d942-4f21-4d5a-874f-497c17c11d44 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:44.640264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ec5d942-4f21-4d5a-874f-497c17c11d44 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:44.640723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ec5d942-4f21-4d5a-874f-497c17c11d44 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:44.641571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ec5d942-4f21-4d5a-874f-497c17c11d44 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:44.642022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ec5d942-4f21-4d5a-874f-497c17c11d44 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:44.790091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0ec5d942-4f21-4d5a-874f-497c17c11d44 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:44.798469 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0ec5d942-4f21-4d5a-874f-497c17c11d44 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1322 microversion: 2.1 time: 0.172128 Jan 22 21:03:44.799042 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 566/1158] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:44 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:44.803422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-32b685f0-58ba-4680-bda4-a42407600796 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:44.804078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-32b685f0-58ba-4680-bda4-a42407600796 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:44.815886 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-080b4f53-66fb-46ca-b609-91af7e1fdc60 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 204 len: 0 microversion: 2.1 time: 1.204531 Jan 22 21:03:44.824392 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 593/1159] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:03:43 2022] DELETE /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 0 bytes in 1206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:03:44.824392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-549c8244-2144-4ebf-aeec-9d0b0102743f req-0e9659f1-09d1-424c-b09b-f1492286dd5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b179432-605e-4dbc-af14-2e1933a509ec", "name": "network-vif-deleted", "tag": "8d791b62-9f8e-47a8-b5ac-bd443a5163e8"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:44.824392 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:44.824392 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:44.829717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-549c8244-2144-4ebf-aeec-9d0b0102743f req-0e9659f1-09d1-424c-b09b-f1492286dd5a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:44.830164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-549c8244-2144-4ebf-aeec-9d0b0102743f req-0e9659f1-09d1-424c-b09b-f1492286dd5a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:44.845196 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-549c8244-2144-4ebf-aeec-9d0b0102743f req-0e9659f1-09d1-424c-b09b-f1492286dd5a service nova] Creating event network-vif-deleted:8d791b62-9f8e-47a8-b5ac-bd443a5163e8 for instance 0b179432-605e-4dbc-af14-2e1933a509ec on nch2-master-1 Jan 22 21:03:44.850880 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-549c8244-2144-4ebf-aeec-9d0b0102743f req-0e9659f1-09d1-424c-b09b-f1492286dd5a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033070 Jan 22 21:03:44.851615 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 594/1160] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:44.856953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1044812593", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:44.868606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-32b685f0-58ba-4680-bda4-a42407600796 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:44.876655 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-32b685f0-58ba-4680-bda4-a42407600796 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1211 microversion: 2.1 time: 0.075966 Jan 22 21:03:44.876927 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 567/1161] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:44 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1211 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:44.881450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-545873ea-cd09-4e42-9957-16a2564cd967 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:44.882442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-545873ea-cd09-4e42-9957-16a2564cd967 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:44.890953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-545873ea-cd09-4e42-9957-16a2564cd967 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:44.891593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-545873ea-cd09-4e42-9957-16a2564cd967 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:44.892591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-545873ea-cd09-4e42-9957-16a2564cd967 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:44.893210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-545873ea-cd09-4e42-9957-16a2564cd967 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:44.925043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:03:44.941702 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-545873ea-cd09-4e42-9957-16a2564cd967 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 14 microversion: 2.1 time: 0.063277 Jan 22 21:03:44.950973 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 568/1162] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:44 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:03:44.952443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-550840213", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "155056716", "adminPass": "***", "networks": [{"uuid": "f03ccb4a-a599-47d8-bf5d-025fd4411b36"}], "security_groups": [{"name": "tempest-securitygroup--401507773"}], "key_name": "tempest-keypair-563767088", "user_data": "}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:45.062093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] validate_networks() for [('f03ccb4a-a599-47d8-bf5d-025fd4411b36', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:03:45.150346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:03:45.150346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:03:45.150346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:03:45.150346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:03:45.150346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:03:45.160813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:45.161413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:45.162376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:45.162837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:45.183030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Getting quotas for project 2566e2caf61643f7b603b8ab8f81e193. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:03:45.191599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Getting quotas for user 1e062e80dcda4118963156134c040e67 and project 2566e2caf61643f7b603b8ab8f81e193. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:03:45.204476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:03:45.207088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:03:45.339859 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6701ff26-6aaf-4a67-ae39-b317b0e50ddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.486731 Jan 22 21:03:45.347137 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 595/1163] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:03:44 2022] POST /compute/v2.1/servers => generated 382 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:03:45.352545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3a274b42-ea19-4fed-ac90-0aaa3e69da9a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:45.353433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3a274b42-ea19-4fed-ac90-0aaa3e69da9a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:45.433265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3a274b42-ea19-4fed-ac90-0aaa3e69da9a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:45.452815 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3a274b42-ea19-4fed-ac90-0aaa3e69da9a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1218 microversion: 2.1 time: 0.091618 Jan 22 21:03:45.452815 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 596/1164] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:45 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:45.636600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4d68c27f-e4e2-481e-b8aa-a9f27fd9ca20 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:45.637643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4d68c27f-e4e2-481e-b8aa-a9f27fd9ca20 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:45.646319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d68c27f-e4e2-481e-b8aa-a9f27fd9ca20 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:45.647450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d68c27f-e4e2-481e-b8aa-a9f27fd9ca20 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:45.647829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d68c27f-e4e2-481e-b8aa-a9f27fd9ca20 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:45.648194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d68c27f-e4e2-481e-b8aa-a9f27fd9ca20 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:45.722848 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4d68c27f-e4e2-481e-b8aa-a9f27fd9ca20 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 24570 microversion: 2.1 time: 0.090109 Jan 22 21:03:45.726669 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 597/1165] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:45 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 24570 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:45.817583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3565710-6f09-415f-855c-00892e121731 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:45.818446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d3565710-6f09-415f-855c-00892e121731 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:45.825624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3565710-6f09-415f-855c-00892e121731 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:45.827141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3565710-6f09-415f-855c-00892e121731 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:45.827697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3565710-6f09-415f-855c-00892e121731 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:45.828201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3565710-6f09-415f-855c-00892e121731 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:45.914098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:03:45.922370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:03:45.922370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:03:45.922370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:03:45.922370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:03:45.936111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:45.936830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:45.937922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:45.938546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:45.974058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Getting quotas for project adbc7daf2ad2476fb707aab0b887c7be. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:03:45.982830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Getting quotas for user b417a76de72c45a899648d658713bafc and project adbc7daf2ad2476fb707aab0b887c7be. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:03:46.000012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:03:46.003626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:03:46.019714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d3565710-6f09-415f-855c-00892e121731 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:46.037608 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d3565710-6f09-415f-855c-00892e121731 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1322 microversion: 2.1 time: 0.224630 Jan 22 21:03:46.049785 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 598/1166] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:45 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:46.055600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5180d021-458c-4b58-a09a-68712b121d73 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:46.056238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5180d021-458c-4b58-a09a-68712b121d73 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:46.068857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5180d021-458c-4b58-a09a-68712b121d73 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:46.073184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5180d021-458c-4b58-a09a-68712b121d73 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:46.073184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5180d021-458c-4b58-a09a-68712b121d73 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:46.073184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5180d021-458c-4b58-a09a-68712b121d73 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:46.139529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5180d021-458c-4b58-a09a-68712b121d73 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:46.147351 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5180d021-458c-4b58-a09a-68712b121d73 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1263 microversion: 2.1 time: 0.095918 Jan 22 21:03:46.147940 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 599/1167] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:46 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1263 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:46.161271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d2a5efad-f041-4952-bfdc-a6e37519913f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:46.165968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d2a5efad-f041-4952-bfdc-a6e37519913f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:46.186586 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-005e6229-c5b1-4fa5-a952-07109f19b90c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.239002 Jan 22 21:03:46.188261 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 569/1168] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:03:44 2022] POST /compute/v2.1/servers => generated 403 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:03:46.198993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-532a76a6-f6bd-401a-a4c5-43bfee3fc690 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:46.199841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2a5efad-f041-4952-bfdc-a6e37519913f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:46.199841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2a5efad-f041-4952-bfdc-a6e37519913f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:46.200187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-532a76a6-f6bd-401a-a4c5-43bfee3fc690 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:46.200413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2a5efad-f041-4952-bfdc-a6e37519913f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:46.201482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2a5efad-f041-4952-bfdc-a6e37519913f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:46.273781 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d2a5efad-f041-4952-bfdc-a6e37519913f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 14 microversion: 2.1 time: 0.124332 Jan 22 21:03:46.278489 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 600/1169] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:46 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:03:46.446171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-532a76a6-f6bd-401a-a4c5-43bfee3fc690 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:46.457679 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-532a76a6-f6bd-401a-a4c5-43bfee3fc690 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1265 microversion: 2.1 time: 0.262947 Jan 22 21:03:46.459112 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 570/1170] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:46 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:46.460659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1fee0a69-9c0d-465d-b9fb-66e2aa06be6e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:46.461522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1fee0a69-9c0d-465d-b9fb-66e2aa06be6e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:46.521643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1fee0a69-9c0d-465d-b9fb-66e2aa06be6e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:46.528610 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1fee0a69-9c0d-465d-b9fb-66e2aa06be6e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1218 microversion: 2.1 time: 0.074309 Jan 22 21:03:46.534225 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 601/1171] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:46 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:46.736824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8b271a8b-4a55-4bd7-8fae-22ec4757334e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:46.738301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8b271a8b-4a55-4bd7-8fae-22ec4757334e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:46.750305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b271a8b-4a55-4bd7-8fae-22ec4757334e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:46.751373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b271a8b-4a55-4bd7-8fae-22ec4757334e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:46.753616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b271a8b-4a55-4bd7-8fae-22ec4757334e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:46.755140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b271a8b-4a55-4bd7-8fae-22ec4757334e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:46.870781 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8b271a8b-4a55-4bd7-8fae-22ec4757334e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.139708 Jan 22 21:03:46.871406 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 571/1172] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:46 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:03:47.057393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-70dcca6b-757e-4727-bc91-f5730efe1db5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:47.058196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-70dcca6b-757e-4727-bc91-f5730efe1db5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:47.067881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70dcca6b-757e-4727-bc91-f5730efe1db5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:47.068342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70dcca6b-757e-4727-bc91-f5730efe1db5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:47.069357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70dcca6b-757e-4727-bc91-f5730efe1db5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:47.069849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70dcca6b-757e-4727-bc91-f5730efe1db5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:47.166532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cd3ef3dc-14ea-4897-a08a-e997cd2e5510 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:47.168678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cd3ef3dc-14ea-4897-a08a-e997cd2e5510 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:47.177102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd3ef3dc-14ea-4897-a08a-e997cd2e5510 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:47.177865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd3ef3dc-14ea-4897-a08a-e997cd2e5510 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:47.188002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd3ef3dc-14ea-4897-a08a-e997cd2e5510 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:47.194287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd3ef3dc-14ea-4897-a08a-e997cd2e5510 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:47.215973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-70dcca6b-757e-4727-bc91-f5730efe1db5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:47.220159 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-70dcca6b-757e-4727-bc91-f5730efe1db5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1322 microversion: 2.1 time: 0.166451 Jan 22 21:03:47.220737 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 602/1173] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:47 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:47.288626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f20f2855-3237-4167-b07d-77a9f1941e6b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:47.289632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f20f2855-3237-4167-b07d-77a9f1941e6b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:47.297027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f20f2855-3237-4167-b07d-77a9f1941e6b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:47.298041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f20f2855-3237-4167-b07d-77a9f1941e6b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:47.298967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f20f2855-3237-4167-b07d-77a9f1941e6b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:47.299406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f20f2855-3237-4167-b07d-77a9f1941e6b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:47.309694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cd3ef3dc-14ea-4897-a08a-e997cd2e5510 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:47.321184 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cd3ef3dc-14ea-4897-a08a-e997cd2e5510 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1269 microversion: 2.1 time: 0.160176 Jan 22 21:03:47.322032 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 572/1174] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:47 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:47.348009 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f20f2855-3237-4167-b07d-77a9f1941e6b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 14 microversion: 2.1 time: 0.063711 Jan 22 21:03:47.348674 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 603/1175] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:47 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:03:47.475063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a2f34644-5212-4474-88a3-b511d31e6f22 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:47.476137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a2f34644-5212-4474-88a3-b511d31e6f22 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:47.483267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2f34644-5212-4474-88a3-b511d31e6f22 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:47.483730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2f34644-5212-4474-88a3-b511d31e6f22 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:47.484535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2f34644-5212-4474-88a3-b511d31e6f22 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:47.484990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2f34644-5212-4474-88a3-b511d31e6f22 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:47.547431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4c384686-bc22-47eb-a56c-e0b223dd687a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:47.548133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4c384686-bc22-47eb-a56c-e0b223dd687a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:47.555241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c384686-bc22-47eb-a56c-e0b223dd687a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:47.555707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c384686-bc22-47eb-a56c-e0b223dd687a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:47.556514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c384686-bc22-47eb-a56c-e0b223dd687a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:47.556964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c384686-bc22-47eb-a56c-e0b223dd687a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:47.621369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a2f34644-5212-4474-88a3-b511d31e6f22 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:47.633094 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a2f34644-5212-4474-88a3-b511d31e6f22 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1269 microversion: 2.1 time: 0.161440 Jan 22 21:03:47.634223 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 573/1176] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:47 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:47.649124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4c384686-bc22-47eb-a56c-e0b223dd687a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:47.657305 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4c384686-bc22-47eb-a56c-e0b223dd687a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1270 microversion: 2.1 time: 0.114495 Jan 22 21:03:47.658656 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 604/1177] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:47 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1270 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:47.878096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-d3662a98-3ee9-486f-86f5-b7f75d8eee5f req-0b0de1f5-e6ad-420c-a825-45a80f0250ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61d4e4a-a3e5-4329-94b0-bfcd080a47cb", "name": "network-vif-plugged", "status": "completed", "tag": "54742673-5698-4189-9534-ffa749b79f02"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:47.882863 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:47.882863 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:03:47.890067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-557a1b53-9f02-4a0a-8404-0847474bc793 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:47.891140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-557a1b53-9f02-4a0a-8404-0847474bc793 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:47.893545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d3662a98-3ee9-486f-86f5-b7f75d8eee5f req-0b0de1f5-e6ad-420c-a825-45a80f0250ce service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:47.893998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d3662a98-3ee9-486f-86f5-b7f75d8eee5f req-0b0de1f5-e6ad-420c-a825-45a80f0250ce service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:47.911022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-557a1b53-9f02-4a0a-8404-0847474bc793 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:47.911022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-557a1b53-9f02-4a0a-8404-0847474bc793 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:47.911022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-557a1b53-9f02-4a0a-8404-0847474bc793 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:47.911320 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-d3662a98-3ee9-486f-86f5-b7f75d8eee5f req-0b0de1f5-e6ad-420c-a825-45a80f0250ce service nova] Creating event network-vif-plugged:54742673-5698-4189-9534-ffa749b79f02 for instance e61d4e4a-a3e5-4329-94b0-bfcd080a47cb on nch2-master-1 Jan 22 21:03:47.911425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-557a1b53-9f02-4a0a-8404-0847474bc793 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:47.916890 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-d3662a98-3ee9-486f-86f5-b7f75d8eee5f req-0b0de1f5-e6ad-420c-a825-45a80f0250ce service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044775 Jan 22 21:03:47.917825 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 574/1178] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:48.004900 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-557a1b53-9f02-4a0a-8404-0847474bc793 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.122879 Jan 22 21:03:48.010375 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 605/1179] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:47 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:03:48.239237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c5f357c4-aae3-442d-8d5d-fe70a8882759 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:48.239972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c5f357c4-aae3-442d-8d5d-fe70a8882759 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:48.254925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5f357c4-aae3-442d-8d5d-fe70a8882759 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:48.255588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5f357c4-aae3-442d-8d5d-fe70a8882759 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:48.256451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5f357c4-aae3-442d-8d5d-fe70a8882759 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:48.256905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5f357c4-aae3-442d-8d5d-fe70a8882759 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:48.339919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3ccd5c3b-8742-4f24-bd95-9fee71685115 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:48.351966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3ccd5c3b-8742-4f24-bd95-9fee71685115 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:48.360323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ccd5c3b-8742-4f24-bd95-9fee71685115 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:48.364750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ccd5c3b-8742-4f24-bd95-9fee71685115 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:48.368668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ccd5c3b-8742-4f24-bd95-9fee71685115 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:48.369894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ccd5c3b-8742-4f24-bd95-9fee71685115 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:48.711334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c5f357c4-aae3-442d-8d5d-fe70a8882759 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:48.721595 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c5f357c4-aae3-442d-8d5d-fe70a8882759 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1322 microversion: 2.1 time: 0.487639 Jan 22 21:03:48.723331 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 575/1180] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:48 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:48.738433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3c003782-65d3-4572-b928-517bf6cdba46 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:48.739484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3c003782-65d3-4572-b928-517bf6cdba46 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:48.755582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3ccd5c3b-8742-4f24-bd95-9fee71685115 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:48.757971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c003782-65d3-4572-b928-517bf6cdba46 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:48.758424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c003782-65d3-4572-b928-517bf6cdba46 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:48.759243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c003782-65d3-4572-b928-517bf6cdba46 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:48.760976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c003782-65d3-4572-b928-517bf6cdba46 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:48.765418 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3ccd5c3b-8742-4f24-bd95-9fee71685115 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1311 microversion: 2.1 time: 0.429828 Jan 22 21:03:48.769969 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 606/1181] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:48 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1311 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:48.798366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-7e55b2f9-5771-4c00-bf05-a61dd4345a07 req-adfecbc6-0811-4368-8445-1009458ab31e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94e22853-aa4b-47cb-a69e-0e6fd8af5720", "name": "network-vif-deleted", "tag": "ac2be3fd-0a96-49fc-9bdb-d6f6fc743c9b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:48.798366 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:48.798366 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:48.802911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7e55b2f9-5771-4c00-bf05-a61dd4345a07 req-adfecbc6-0811-4368-8445-1009458ab31e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:48.803617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7e55b2f9-5771-4c00-bf05-a61dd4345a07 req-adfecbc6-0811-4368-8445-1009458ab31e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:48.834264 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-7e55b2f9-5771-4c00-bf05-a61dd4345a07 req-adfecbc6-0811-4368-8445-1009458ab31e service nova] Creating event network-vif-deleted:ac2be3fd-0a96-49fc-9bdb-d6f6fc743c9b for instance 94e22853-aa4b-47cb-a69e-0e6fd8af5720 on nch1-master-1 Jan 22 21:03:48.835424 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3c003782-65d3-4572-b928-517bf6cdba46 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 8208 microversion: 2.1 time: 0.110565 Jan 22 21:03:48.836795 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 576/1182] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:48 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 8208 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:48.844347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1e18d50a-f6dc-40a5-af92-d9015a5ba5fe tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:48.854737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1e18d50a-f6dc-40a5-af92-d9015a5ba5fe tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:48.855923 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-7e55b2f9-5771-4c00-bf05-a61dd4345a07 req-adfecbc6-0811-4368-8445-1009458ab31e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077800 Jan 22 21:03:48.855923 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 607/1183] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:48.868056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c1a86db8-6605-4ad2-b0ad-6c4730057036 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:48.874824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c1a86db8-6605-4ad2-b0ad-6c4730057036 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:48.878013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e18d50a-f6dc-40a5-af92-d9015a5ba5fe tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:48.878787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e18d50a-f6dc-40a5-af92-d9015a5ba5fe tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:48.879820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e18d50a-f6dc-40a5-af92-d9015a5ba5fe tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:48.880502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e18d50a-f6dc-40a5-af92-d9015a5ba5fe tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:48.887513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1a86db8-6605-4ad2-b0ad-6c4730057036 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:48.888931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1a86db8-6605-4ad2-b0ad-6c4730057036 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:48.890297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1a86db8-6605-4ad2-b0ad-6c4730057036 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:48.891211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1a86db8-6605-4ad2-b0ad-6c4730057036 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:48.962670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1e18d50a-f6dc-40a5-af92-d9015a5ba5fe tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:48.973915 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1e18d50a-f6dc-40a5-af92-d9015a5ba5fe tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1317 microversion: 2.1 time: 0.135846 Jan 22 21:03:48.984724 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 577/1184] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:48 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:48.985727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c1a86db8-6605-4ad2-b0ad-6c4730057036 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:49.021279 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c1a86db8-6605-4ad2-b0ad-6c4730057036 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1288 microversion: 2.1 time: 0.144903 Jan 22 21:03:49.021279 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 608/1185] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:48 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1288 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:49.023477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-76181a2f-0d37-4371-ac50-26fc7cffb798 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:49.025739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-76181a2f-0d37-4371-ac50-26fc7cffb798 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:49.040034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76181a2f-0d37-4371-ac50-26fc7cffb798 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:49.040687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76181a2f-0d37-4371-ac50-26fc7cffb798 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:49.041710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76181a2f-0d37-4371-ac50-26fc7cffb798 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:49.042481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76181a2f-0d37-4371-ac50-26fc7cffb798 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:49.109166 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-76181a2f-0d37-4371-ac50-26fc7cffb798 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.092185 Jan 22 21:03:49.111090 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 578/1186] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:49 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:49.739624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4bbee39f-7466-4638-9ced-0600b32bf141 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:49.741222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4bbee39f-7466-4638-9ced-0600b32bf141 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:49.751099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bbee39f-7466-4638-9ced-0600b32bf141 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:49.751809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bbee39f-7466-4638-9ced-0600b32bf141 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:49.752788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bbee39f-7466-4638-9ced-0600b32bf141 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:49.753445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bbee39f-7466-4638-9ced-0600b32bf141 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:49.825112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-69b06e26-107b-42cc-a401-15bd6f09026a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:49.826007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-69b06e26-107b-42cc-a401-15bd6f09026a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:49.835364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69b06e26-107b-42cc-a401-15bd6f09026a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:49.835920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69b06e26-107b-42cc-a401-15bd6f09026a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:49.836854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69b06e26-107b-42cc-a401-15bd6f09026a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:49.837535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69b06e26-107b-42cc-a401-15bd6f09026a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:49.946563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4bbee39f-7466-4638-9ced-0600b32bf141 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:49.955261 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4bbee39f-7466-4638-9ced-0600b32bf141 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1322 microversion: 2.1 time: 0.219954 Jan 22 21:03:49.960636 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 609/1187] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:49 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:49.960636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-acca98d0-83bb-46e6-afb0-2a3ecaec14bb tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:49.961293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-acca98d0-83bb-46e6-afb0-2a3ecaec14bb tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:49.970099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acca98d0-83bb-46e6-afb0-2a3ecaec14bb tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:49.975646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acca98d0-83bb-46e6-afb0-2a3ecaec14bb tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:49.975646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acca98d0-83bb-46e6-afb0-2a3ecaec14bb tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:49.976142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acca98d0-83bb-46e6-afb0-2a3ecaec14bb tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:50.011143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-69b06e26-107b-42cc-a401-15bd6f09026a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:50.019964 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-69b06e26-107b-42cc-a401-15bd6f09026a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1311 microversion: 2.1 time: 0.201261 Jan 22 21:03:50.020844 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 579/1188] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:49 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1311 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:50.030667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ef94747f-6b33-4dd0-8cc0-b34993c7a76d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:50.031292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ef94747f-6b33-4dd0-8cc0-b34993c7a76d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:50.034236 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-acca98d0-83bb-46e6-afb0-2a3ecaec14bb tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 16401 microversion: 2.1 time: 0.076936 Jan 22 21:03:50.034902 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 610/1189] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:49 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 16401 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:50.040421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-679ca948-89cc-45cf-bd0e-3d044af79496 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:50.041137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-679ca948-89cc-45cf-bd0e-3d044af79496 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:50.042741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef94747f-6b33-4dd0-8cc0-b34993c7a76d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:50.043395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef94747f-6b33-4dd0-8cc0-b34993c7a76d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:50.044375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef94747f-6b33-4dd0-8cc0-b34993c7a76d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:50.046392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef94747f-6b33-4dd0-8cc0-b34993c7a76d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:50.048869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-679ca948-89cc-45cf-bd0e-3d044af79496 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:50.049449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-679ca948-89cc-45cf-bd0e-3d044af79496 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:50.050516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-679ca948-89cc-45cf-bd0e-3d044af79496 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:50.050973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-679ca948-89cc-45cf-bd0e-3d044af79496 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:50.125145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ef94747f-6b33-4dd0-8cc0-b34993c7a76d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:50.128957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-679ca948-89cc-45cf-bd0e-3d044af79496 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:50.133448 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ef94747f-6b33-4dd0-8cc0-b34993c7a76d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1317 microversion: 2.1 time: 0.111616 Jan 22 21:03:50.134566 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 580/1190] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:50 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1317 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:50.140857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0a311c3c-72d4-40f5-9c12-181d568aad9a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:50.140857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0a311c3c-72d4-40f5-9c12-181d568aad9a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:50.143266 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-679ca948-89cc-45cf-bd0e-3d044af79496 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1288 microversion: 2.1 time: 0.107203 Jan 22 21:03:50.144057 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 611/1191] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:50 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1288 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:50.146746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a311c3c-72d4-40f5-9c12-181d568aad9a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:50.147209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a311c3c-72d4-40f5-9c12-181d568aad9a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:50.148010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a311c3c-72d4-40f5-9c12-181d568aad9a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:50.148456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a311c3c-72d4-40f5-9c12-181d568aad9a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:50.198932 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0a311c3c-72d4-40f5-9c12-181d568aad9a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.063033 Jan 22 21:03:50.199511 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 581/1192] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:50 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:50.974077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4aa62f74-63d0-41ac-a9c8-5856a842ca73 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:50.974816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4aa62f74-63d0-41ac-a9c8-5856a842ca73 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:50.983434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aa62f74-63d0-41ac-a9c8-5856a842ca73 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:50.985363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aa62f74-63d0-41ac-a9c8-5856a842ca73 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:50.986876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aa62f74-63d0-41ac-a9c8-5856a842ca73 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:50.987582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aa62f74-63d0-41ac-a9c8-5856a842ca73 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:51.038753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-09e71695-8f69-4bcc-a165-1023be853b9a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:51.039543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-09e71695-8f69-4bcc-a165-1023be853b9a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:51.053913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09e71695-8f69-4bcc-a165-1023be853b9a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:51.054374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09e71695-8f69-4bcc-a165-1023be853b9a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:51.055345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09e71695-8f69-4bcc-a165-1023be853b9a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:51.055797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09e71695-8f69-4bcc-a165-1023be853b9a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:51.251866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4aa62f74-63d0-41ac-a9c8-5856a842ca73 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:51.264785 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4aa62f74-63d0-41ac-a9c8-5856a842ca73 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1322 microversion: 2.1 time: 0.293445 Jan 22 21:03:51.276153 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 612/1193] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:50 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:51.276153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c4d054dd-958e-4716-bd1c-02e55f5cb8ca tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:51.276153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c4d054dd-958e-4716-bd1c-02e55f5cb8ca tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:51.281267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4d054dd-958e-4716-bd1c-02e55f5cb8ca tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:51.281903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4d054dd-958e-4716-bd1c-02e55f5cb8ca tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:51.282823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4d054dd-958e-4716-bd1c-02e55f5cb8ca tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:51.284093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4d054dd-958e-4716-bd1c-02e55f5cb8ca tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:51.332586 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c4d054dd-958e-4716-bd1c-02e55f5cb8ca tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 16401 microversion: 2.1 time: 0.065228 Jan 22 21:03:51.333469 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 613/1194] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:51 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 16401 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:51.349774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6dc1f7d8-9453-47fe-84ac-ef9bee641199 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:51.349774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6dc1f7d8-9453-47fe-84ac-ef9bee641199 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:51.352585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6dc1f7d8-9453-47fe-84ac-ef9bee641199 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:51.352585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6dc1f7d8-9453-47fe-84ac-ef9bee641199 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:51.353260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6dc1f7d8-9453-47fe-84ac-ef9bee641199 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:51.353810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6dc1f7d8-9453-47fe-84ac-ef9bee641199 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:51.432819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6dc1f7d8-9453-47fe-84ac-ef9bee641199 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:51.442631 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6dc1f7d8-9453-47fe-84ac-ef9bee641199 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1325 microversion: 2.1 time: 0.106894 Jan 22 21:03:51.443239 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 614/1195] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:51 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1325 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:51.452179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b07adc85-9864-486c-bd5e-a9d4b2f3d99d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:51.452789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b07adc85-9864-486c-bd5e-a9d4b2f3d99d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:51.458943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b07adc85-9864-486c-bd5e-a9d4b2f3d99d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:51.459402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b07adc85-9864-486c-bd5e-a9d4b2f3d99d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:51.460197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b07adc85-9864-486c-bd5e-a9d4b2f3d99d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:51.460642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b07adc85-9864-486c-bd5e-a9d4b2f3d99d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:51.522193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b07adc85-9864-486c-bd5e-a9d4b2f3d99d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:51.530101 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b07adc85-9864-486c-bd5e-a9d4b2f3d99d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1276 microversion: 2.1 time: 0.081603 Jan 22 21:03:51.530784 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 615/1196] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:51 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1276 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:51.535880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e51284a0-2a20-4eed-881e-5b4f0fa35830 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:51.536904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e51284a0-2a20-4eed-881e-5b4f0fa35830 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:51.546055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-09e71695-8f69-4bcc-a165-1023be853b9a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:51.546234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51284a0-2a20-4eed-881e-5b4f0fa35830 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:51.546814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51284a0-2a20-4eed-881e-5b4f0fa35830 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:51.547779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51284a0-2a20-4eed-881e-5b4f0fa35830 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:51.548232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51284a0-2a20-4eed-881e-5b4f0fa35830 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:51.573843 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-09e71695-8f69-4bcc-a165-1023be853b9a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1311 microversion: 2.1 time: 0.539021 Jan 22 21:03:51.574764 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 582/1197] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:51 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1311 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:51.599025 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e51284a0-2a20-4eed-881e-5b4f0fa35830 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.066929 Jan 22 21:03:51.601125 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 616/1198] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:51 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:51.969663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-a8a27b83-1349-4431-bb5f-3e56a4642b49 req-b6adbab7-d7b2-4435-b3c7-b218f93288b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e95589a-26dd-4aac-bbc5-5abc6d98536f", "tag": "d9c069fd-afb5-45a0-8595-74435df57e78"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:51.971940 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:51.971940 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:03:51.983773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a8a27b83-1349-4431-bb5f-3e56a4642b49 req-b6adbab7-d7b2-4435-b3c7-b218f93288b3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:51.984166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a8a27b83-1349-4431-bb5f-3e56a4642b49 req-b6adbab7-d7b2-4435-b3c7-b218f93288b3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:52.019021 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-a8a27b83-1349-4431-bb5f-3e56a4642b49 req-b6adbab7-d7b2-4435-b3c7-b218f93288b3 service nova] Creating event network-changed:d9c069fd-afb5-45a0-8595-74435df57e78 for instance 8e95589a-26dd-4aac-bbc5-5abc6d98536f on nch1-master-1 Jan 22 21:03:52.031312 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-a8a27b83-1349-4431-bb5f-3e56a4642b49 req-b6adbab7-d7b2-4435-b3c7-b218f93288b3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066496 Jan 22 21:03:52.032377 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 583/1199] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:03:52.286301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-01b62a1c-4c5a-437a-97ff-8746f2bcfe93 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:52.286301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-01b62a1c-4c5a-437a-97ff-8746f2bcfe93 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:52.291934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01b62a1c-4c5a-437a-97ff-8746f2bcfe93 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:52.292301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01b62a1c-4c5a-437a-97ff-8746f2bcfe93 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:52.293117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01b62a1c-4c5a-437a-97ff-8746f2bcfe93 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:52.293590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01b62a1c-4c5a-437a-97ff-8746f2bcfe93 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:52.346465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11dd6ac3-153f-42f5-a94b-c2309630af00 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:52.347605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-11dd6ac3-153f-42f5-a94b-c2309630af00 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:52.360612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11dd6ac3-153f-42f5-a94b-c2309630af00 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:52.361071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11dd6ac3-153f-42f5-a94b-c2309630af00 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:52.361944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11dd6ac3-153f-42f5-a94b-c2309630af00 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:52.362354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11dd6ac3-153f-42f5-a94b-c2309630af00 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:52.426799 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-11dd6ac3-153f-42f5-a94b-c2309630af00 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 16401 microversion: 2.1 time: 0.085841 Jan 22 21:03:52.428135 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 584/1200] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:52 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 16401 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:03:52.469892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-340777f8-389e-4c3d-aa47-336c2780c301 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:52.469892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-340777f8-389e-4c3d-aa47-336c2780c301 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:52.477399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-340777f8-389e-4c3d-aa47-336c2780c301 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:52.478111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-340777f8-389e-4c3d-aa47-336c2780c301 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:52.479302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-340777f8-389e-4c3d-aa47-336c2780c301 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:52.483636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-340777f8-389e-4c3d-aa47-336c2780c301 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:52.567582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-01b62a1c-4c5a-437a-97ff-8746f2bcfe93 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:52.576509 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-01b62a1c-4c5a-437a-97ff-8746f2bcfe93 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1510 microversion: 2.1 time: 0.296860 Jan 22 21:03:52.577381 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 617/1201] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:52 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:52.585061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f310c661-cafb-4506-a12a-c75c6454caf2 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:52.586048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f310c661-cafb-4506-a12a-c75c6454caf2 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:52.596694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f310c661-cafb-4506-a12a-c75c6454caf2 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:52.597154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f310c661-cafb-4506-a12a-c75c6454caf2 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:52.597990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f310c661-cafb-4506-a12a-c75c6454caf2 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:52.598432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f310c661-cafb-4506-a12a-c75c6454caf2 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:52.647629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-340777f8-389e-4c3d-aa47-336c2780c301 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:52.655559 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-340777f8-389e-4c3d-aa47-336c2780c301 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1323 microversion: 2.1 time: 0.197844 Jan 22 21:03:52.656159 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 585/1202] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:52 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1323 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:52.674018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7cffd19d-f979-45b0-bd08-aa87f2f50cc6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:52.674859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7cffd19d-f979-45b0-bd08-aa87f2f50cc6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:52.681957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cffd19d-f979-45b0-bd08-aa87f2f50cc6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:52.682670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cffd19d-f979-45b0-bd08-aa87f2f50cc6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:52.683799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cffd19d-f979-45b0-bd08-aa87f2f50cc6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:52.684414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cffd19d-f979-45b0-bd08-aa87f2f50cc6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:53.151679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f310c661-cafb-4506-a12a-c75c6454caf2 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:53.162852 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f310c661-cafb-4506-a12a-c75c6454caf2 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1318 microversion: 2.1 time: 0.583714 Jan 22 21:03:53.172480 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 618/1203] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:52 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1318 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:53.172480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-845e7367-3a68-47c9-8a1a-848fbb7faf5e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:53.172480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-845e7367-3a68-47c9-8a1a-848fbb7faf5e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:53.176282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-845e7367-3a68-47c9-8a1a-848fbb7faf5e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:53.176746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-845e7367-3a68-47c9-8a1a-848fbb7faf5e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:53.177589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-845e7367-3a68-47c9-8a1a-848fbb7faf5e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:53.178097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-845e7367-3a68-47c9-8a1a-848fbb7faf5e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:53.230496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7cffd19d-f979-45b0-bd08-aa87f2f50cc6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:53.239856 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7cffd19d-f979-45b0-bd08-aa87f2f50cc6 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1311 microversion: 2.1 time: 0.582657 Jan 22 21:03:53.241125 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 586/1204] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:52 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1311 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:53.246453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-44825f7d-5bbb-4a70-a72d-9fdbd59d9967 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:53.247620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-44825f7d-5bbb-4a70-a72d-9fdbd59d9967 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:53.254803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44825f7d-5bbb-4a70-a72d-9fdbd59d9967 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:53.258686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44825f7d-5bbb-4a70-a72d-9fdbd59d9967 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:53.258686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44825f7d-5bbb-4a70-a72d-9fdbd59d9967 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:53.258686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44825f7d-5bbb-4a70-a72d-9fdbd59d9967 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:53.302971 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-44825f7d-5bbb-4a70-a72d-9fdbd59d9967 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.060383 Jan 22 21:03:53.303715 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 587/1205] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:53 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:53.342323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-845e7367-3a68-47c9-8a1a-848fbb7faf5e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:53.350382 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-845e7367-3a68-47c9-8a1a-848fbb7faf5e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1510 microversion: 2.1 time: 0.186331 Jan 22 21:03:53.350963 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 619/1206] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:53 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:53.366754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e14350b4-1c08-48cc-930f-16499ca216c3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:53.368655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e14350b4-1c08-48cc-930f-16499ca216c3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:53.376813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e14350b4-1c08-48cc-930f-16499ca216c3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:53.377283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e14350b4-1c08-48cc-930f-16499ca216c3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:53.378152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e14350b4-1c08-48cc-930f-16499ca216c3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:53.378770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e14350b4-1c08-48cc-930f-16499ca216c3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:53.437545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-57f6725a-9153-4827-ad9d-ee13f88b45cd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:53.438473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-57f6725a-9153-4827-ad9d-ee13f88b45cd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:53.444407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57f6725a-9153-4827-ad9d-ee13f88b45cd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:53.444855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57f6725a-9153-4827-ad9d-ee13f88b45cd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:53.445718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57f6725a-9153-4827-ad9d-ee13f88b45cd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:53.446167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57f6725a-9153-4827-ad9d-ee13f88b45cd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:53.488884 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-57f6725a-9153-4827-ad9d-ee13f88b45cd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 16401 microversion: 2.1 time: 0.054871 Jan 22 21:03:53.489457 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 620/1207] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:53 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 16401 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:03:53.513769 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e14350b4-1c08-48cc-930f-16499ca216c3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "PUT /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1082 microversion: 2.1 time: 0.150550 Jan 22 21:03:53.515817 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 588/1208] 10.222.0.100 () {60 vars in 1260 bytes} [Sat Jan 22 21:03:53 2022] PUT /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1082 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:53.538215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d4d58a6-3e65-4c9b-9be1-13d106492353 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:53.538941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d4d58a6-3e65-4c9b-9be1-13d106492353 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:53.547235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d4d58a6-3e65-4c9b-9be1-13d106492353 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:53.547716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d4d58a6-3e65-4c9b-9be1-13d106492353 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:53.548538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d4d58a6-3e65-4c9b-9be1-13d106492353 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:53.548983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d4d58a6-3e65-4c9b-9be1-13d106492353 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:53.674875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-05c44946-4bfe-4b21-8799-934e2e63ac97 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:53.675861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-05c44946-4bfe-4b21-8799-934e2e63ac97 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:53.688161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05c44946-4bfe-4b21-8799-934e2e63ac97 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:53.689533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05c44946-4bfe-4b21-8799-934e2e63ac97 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:53.690542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05c44946-4bfe-4b21-8799-934e2e63ac97 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:53.691749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05c44946-4bfe-4b21-8799-934e2e63ac97 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:53.789592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5d4d58a6-3e65-4c9b-9be1-13d106492353 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:53.797841 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d4d58a6-3e65-4c9b-9be1-13d106492353 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1508 microversion: 2.1 time: 0.264603 Jan 22 21:03:53.801225 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 621/1209] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:53 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:53.829053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7545b720-dc5e-474c-b957-b769b5560668 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:53.832606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7545b720-dc5e-474c-b957-b769b5560668 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:53.845675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7545b720-dc5e-474c-b957-b769b5560668 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:53.846417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7545b720-dc5e-474c-b957-b769b5560668 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:53.847551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7545b720-dc5e-474c-b957-b769b5560668 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:53.853916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7545b720-dc5e-474c-b957-b769b5560668 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.047097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-05c44946-4bfe-4b21-8799-934e2e63ac97 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:54.058527 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-05c44946-4bfe-4b21-8799-934e2e63ac97 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1390 microversion: 2.1 time: 0.389643 Jan 22 21:03:54.060046 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 589/1210] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:53 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1390 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:54.090320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7545b720-dc5e-474c-b957-b769b5560668 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:54.099989 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7545b720-dc5e-474c-b957-b769b5560668 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1508 microversion: 2.1 time: 0.278535 Jan 22 21:03:54.100858 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 622/1211] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:53 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:54.117109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:54.118698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:54.125301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.125799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.126655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.127136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.179418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2ffc0581-81a0-4a24-b03e-1c6e5974bd78 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:54.180034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2ffc0581-81a0-4a24-b03e-1c6e5974bd78 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:54.190514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ffc0581-81a0-4a24-b03e-1c6e5974bd78 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.190983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ffc0581-81a0-4a24-b03e-1c6e5974bd78 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.194069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ffc0581-81a0-4a24-b03e-1c6e5974bd78 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.196704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ffc0581-81a0-4a24-b03e-1c6e5974bd78 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.273112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:03:54.274220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:03:54.276342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:03:54.276960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:03:54.277540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:03:54.470623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2ffc0581-81a0-4a24-b03e-1c6e5974bd78 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:54.487770 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2ffc0581-81a0-4a24-b03e-1c6e5974bd78 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1318 microversion: 2.1 time: 0.310494 Jan 22 21:03:54.489312 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 623/1212] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:54 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:54.498669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c36520c2-ab83-4c78-832b-9a2965dc4566 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:54.499536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c36520c2-ab83-4c78-832b-9a2965dc4566 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:54.508392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c36520c2-ab83-4c78-832b-9a2965dc4566 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.508902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c36520c2-ab83-4c78-832b-9a2965dc4566 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.509696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c36520c2-ab83-4c78-832b-9a2965dc4566 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.510404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c36520c2-ab83-4c78-832b-9a2965dc4566 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.683799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:54.697824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c36520c2-ab83-4c78-832b-9a2965dc4566 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:54.700038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.701277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.708071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.708071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.708294 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c36520c2-ab83-4c78-832b-9a2965dc4566 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1311 microversion: 2.1 time: 0.215791 Jan 22 21:03:54.708850 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 624/1213] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:54 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1311 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:54.714866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b103e89a-8d44-46d3-adee-8c39b160f9d7 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:54.718867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b103e89a-8d44-46d3-adee-8c39b160f9d7 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:54.726444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b103e89a-8d44-46d3-adee-8c39b160f9d7 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.727332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b103e89a-8d44-46d3-adee-8c39b160f9d7 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.730976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b103e89a-8d44-46d3-adee-8c39b160f9d7 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.733300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b103e89a-8d44-46d3-adee-8c39b160f9d7 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.741305 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2365a5c0-1b6c-4ac8-851d-8cda0ef224cc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "POST /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb/action" status: 202 len: 1114 microversion: 2.1 time: 0.627953 Jan 22 21:03:54.742355 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 590/1214] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:54 2022] POST /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb/action => generated 1114 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 22 21:03:54.746890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-4008ac7f-82a2-4ab0-9661-8cde3d856c42 req-98aa35fc-d160-4aef-8075-c2c65fb4d57e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b28df35b-8a9a-4010-aa14-89cc18350ba9", "tag": "e3a1c234-0a19-4371-944f-202cc47a018b"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:54.749251 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:54.749251 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:03:54.768032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4008ac7f-82a2-4ab0-9661-8cde3d856c42 req-98aa35fc-d160-4aef-8075-c2c65fb4d57e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.770135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4008ac7f-82a2-4ab0-9661-8cde3d856c42 req-98aa35fc-d160-4aef-8075-c2c65fb4d57e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.785957 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-4008ac7f-82a2-4ab0-9661-8cde3d856c42 req-98aa35fc-d160-4aef-8075-c2c65fb4d57e service nova] Creating event network-changed:e3a1c234-0a19-4371-944f-202cc47a018b for instance b28df35b-8a9a-4010-aa14-89cc18350ba9 on nch1-master-1 Jan 22 21:03:54.796919 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-4008ac7f-82a2-4ab0-9661-8cde3d856c42 req-98aa35fc-d160-4aef-8075-c2c65fb4d57e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053262 Jan 22 21:03:54.797934 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 591/1215] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:54.816193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-19958c40-9c48-45d4-9d78-8aa02a5c9e24 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:54.817427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-19958c40-9c48-45d4-9d78-8aa02a5c9e24 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:54.828836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19958c40-9c48-45d4-9d78-8aa02a5c9e24 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.829218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19958c40-9c48-45d4-9d78-8aa02a5c9e24 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.831237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19958c40-9c48-45d4-9d78-8aa02a5c9e24 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.832754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19958c40-9c48-45d4-9d78-8aa02a5c9e24 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.835704 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b103e89a-8d44-46d3-adee-8c39b160f9d7 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.125150 Jan 22 21:03:54.841103 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 625/1216] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:54 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:54.850558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2e72d857-0287-4a71-81d2-927437890341 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:54.852673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2e72d857-0287-4a71-81d2-927437890341 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:54.895097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e72d857-0287-4a71-81d2-927437890341 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.895762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e72d857-0287-4a71-81d2-927437890341 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.897021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e72d857-0287-4a71-81d2-927437890341 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.897571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e72d857-0287-4a71-81d2-927437890341 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:54.948356 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-19958c40-9c48-45d4-9d78-8aa02a5c9e24 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.148427 Jan 22 21:03:54.952791 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 592/1217] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:54 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:54.957953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-315de9e8-8bac-43af-b129-fe57101dc038 req-a054b579-1692-481c-a035-9e73aee86f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898fa5e5-16ac-437f-af78-9a70e358f284", "tag": "e6c739de-7e2a-4917-90a5-dd2e9abe25aa"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:54.965174 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:54.965174 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:03:54.985619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-315de9e8-8bac-43af-b129-fe57101dc038 req-a054b579-1692-481c-a035-9e73aee86f38 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:54.986072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-315de9e8-8bac-43af-b129-fe57101dc038 req-a054b579-1692-481c-a035-9e73aee86f38 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:55.008031 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-315de9e8-8bac-43af-b129-fe57101dc038 req-a054b579-1692-481c-a035-9e73aee86f38 service nova] Creating event network-changed:e6c739de-7e2a-4917-90a5-dd2e9abe25aa for instance 898fa5e5-16ac-437f-af78-9a70e358f284 on nch1-master-1 Jan 22 21:03:55.023172 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-315de9e8-8bac-43af-b129-fe57101dc038 req-a054b579-1692-481c-a035-9e73aee86f38 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072462 Jan 22 21:03:55.023714 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 593/1218] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:55.077430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee5f38f8-8407-4cc2-bea7-1f9a610e58d0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:55.078334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ee5f38f8-8407-4cc2-bea7-1f9a610e58d0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:55.085935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee5f38f8-8407-4cc2-bea7-1f9a610e58d0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:55.092788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee5f38f8-8407-4cc2-bea7-1f9a610e58d0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:55.095047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee5f38f8-8407-4cc2-bea7-1f9a610e58d0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:55.098302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee5f38f8-8407-4cc2-bea7-1f9a610e58d0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:55.287058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2e72d857-0287-4a71-81d2-927437890341 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:55.299539 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2e72d857-0287-4a71-81d2-927437890341 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.454517 Jan 22 21:03:55.300879 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 626/1219] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:54 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:55.505700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e6fa7ea1-f9e1-4f15-b2f9-04a3593b28f7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:55.506402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e6fa7ea1-f9e1-4f15-b2f9-04a3593b28f7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:55.513086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6fa7ea1-f9e1-4f15-b2f9-04a3593b28f7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:55.518017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6fa7ea1-f9e1-4f15-b2f9-04a3593b28f7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:55.518017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6fa7ea1-f9e1-4f15-b2f9-04a3593b28f7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:55.518017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6fa7ea1-f9e1-4f15-b2f9-04a3593b28f7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:55.597684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ee5f38f8-8407-4cc2-bea7-1f9a610e58d0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:55.611811 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee5f38f8-8407-4cc2-bea7-1f9a610e58d0 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1390 microversion: 2.1 time: 0.539037 Jan 22 21:03:55.612400 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 594/1220] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:55 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1390 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:55.726167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-be427823-65a9-409a-8309-0b0a2b6584c1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:55.735516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e6fa7ea1-f9e1-4f15-b2f9-04a3593b28f7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:55.735838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-be427823-65a9-409a-8309-0b0a2b6584c1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:55.738219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be427823-65a9-409a-8309-0b0a2b6584c1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:55.738727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be427823-65a9-409a-8309-0b0a2b6584c1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:55.739471 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e6fa7ea1-f9e1-4f15-b2f9-04a3593b28f7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1318 microversion: 2.1 time: 0.237411 Jan 22 21:03:55.739626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be427823-65a9-409a-8309-0b0a2b6584c1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:55.739978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be427823-65a9-409a-8309-0b0a2b6584c1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:55.741656 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 627/1221] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:55 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:55.849175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-15fbee62-d343-4ec7-9d62-8b62e00c04f4 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:55.853724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-15fbee62-d343-4ec7-9d62-8b62e00c04f4 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:55.883270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15fbee62-d343-4ec7-9d62-8b62e00c04f4 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:55.892322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15fbee62-d343-4ec7-9d62-8b62e00c04f4 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:55.894898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15fbee62-d343-4ec7-9d62-8b62e00c04f4 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:55.898390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15fbee62-d343-4ec7-9d62-8b62e00c04f4 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:55.986542 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-15fbee62-d343-4ec7-9d62-8b62e00c04f4 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.142867 Jan 22 21:03:55.987622 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 628/1222] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:55 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:03:55.996096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bc7d33e1-7377-41be-a00c-ef4d389052cb tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:55.996096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bc7d33e1-7377-41be-a00c-ef4d389052cb tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:56.002333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc7d33e1-7377-41be-a00c-ef4d389052cb tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:56.003078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc7d33e1-7377-41be-a00c-ef4d389052cb tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:56.004088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc7d33e1-7377-41be-a00c-ef4d389052cb tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:56.004539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc7d33e1-7377-41be-a00c-ef4d389052cb tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:56.069043 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bc7d33e1-7377-41be-a00c-ef4d389052cb tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.079353 Jan 22 21:03:56.070090 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 629/1223] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:55 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:56.091975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-be427823-65a9-409a-8309-0b0a2b6584c1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:56.100993 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-be427823-65a9-409a-8309-0b0a2b6584c1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1311 microversion: 2.1 time: 0.378404 Jan 22 21:03:56.105163 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 595/1224] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:55 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1311 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:56.317264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-73e5ae94-2aea-44d5-86b3-0296adbd3efa tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:56.317994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-73e5ae94-2aea-44d5-86b3-0296adbd3efa tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:56.327200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73e5ae94-2aea-44d5-86b3-0296adbd3efa tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:56.327985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73e5ae94-2aea-44d5-86b3-0296adbd3efa tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:56.328811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73e5ae94-2aea-44d5-86b3-0296adbd3efa tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:56.329438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73e5ae94-2aea-44d5-86b3-0296adbd3efa tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:56.530308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-73e5ae94-2aea-44d5-86b3-0296adbd3efa tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:56.537759 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-73e5ae94-2aea-44d5-86b3-0296adbd3efa tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.224480 Jan 22 21:03:56.538339 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 630/1225] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:56 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:56.629473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ba06097-1c08-4317-8316-108c2991b54f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:56.630081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1ba06097-1c08-4317-8316-108c2991b54f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:56.641862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ba06097-1c08-4317-8316-108c2991b54f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:56.642332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ba06097-1c08-4317-8316-108c2991b54f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:56.643139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ba06097-1c08-4317-8316-108c2991b54f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:56.643593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ba06097-1c08-4317-8316-108c2991b54f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:56.756292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4f0ef180-750d-4c2e-b7c7-3405199f1bd4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:56.756920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4f0ef180-750d-4c2e-b7c7-3405199f1bd4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:56.763305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f0ef180-750d-4c2e-b7c7-3405199f1bd4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:56.763767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f0ef180-750d-4c2e-b7c7-3405199f1bd4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:56.764571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f0ef180-750d-4c2e-b7c7-3405199f1bd4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:56.765023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f0ef180-750d-4c2e-b7c7-3405199f1bd4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:56.909249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4f0ef180-750d-4c2e-b7c7-3405199f1bd4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:56.909632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1ba06097-1c08-4317-8316-108c2991b54f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:56.916445 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4f0ef180-750d-4c2e-b7c7-3405199f1bd4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1318 microversion: 2.1 time: 0.164119 Jan 22 21:03:56.917336 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 631/1226] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:56 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:56.920418 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1ba06097-1c08-4317-8316-108c2991b54f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1390 microversion: 2.1 time: 0.294012 Jan 22 21:03:56.921640 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 596/1227] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:56 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1390 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:56.922661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-b32d7a36-eba7-4105-83d4-f5500b39914d req-bfed84ed-26c2-42f8-9166-556a220cead3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ab8dcc-d072-4e68-af27-2b4614db4cc2", "tag": "a4acdedb-d82e-4307-87e1-a851a52f7726"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:56.924147 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:56.924147 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:56.934749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b32d7a36-eba7-4105-83d4-f5500b39914d req-bfed84ed-26c2-42f8-9166-556a220cead3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:56.935363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b32d7a36-eba7-4105-83d4-f5500b39914d req-bfed84ed-26c2-42f8-9166-556a220cead3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:56.947515 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-b32d7a36-eba7-4105-83d4-f5500b39914d req-bfed84ed-26c2-42f8-9166-556a220cead3 service nova] Creating event network-changed:a4acdedb-d82e-4307-87e1-a851a52f7726 for instance 49ab8dcc-d072-4e68-af27-2b4614db4cc2 on nch2-master-1 Jan 22 21:03:56.955013 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-b32d7a36-eba7-4105-83d4-f5500b39914d req-bfed84ed-26c2-42f8-9166-556a220cead3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036055 Jan 22 21:03:56.955975 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 632/1228] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:56.997904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11fbda75-0f51-406a-8872-db7b37b3b3df tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:56.999277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-11fbda75-0f51-406a-8872-db7b37b3b3df tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:57.005781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11fbda75-0f51-406a-8872-db7b37b3b3df tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:57.006468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11fbda75-0f51-406a-8872-db7b37b3b3df tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:57.007472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11fbda75-0f51-406a-8872-db7b37b3b3df tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:57.008183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11fbda75-0f51-406a-8872-db7b37b3b3df tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:57.062538 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-11fbda75-0f51-406a-8872-db7b37b3b3df tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.068531 Jan 22 21:03:57.068036 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 597/1229] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:56 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:57.097139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2636eab1-fb91-465a-b908-20b47c6eabd8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:57.098617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2636eab1-fb91-465a-b908-20b47c6eabd8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:57.105543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2636eab1-fb91-465a-b908-20b47c6eabd8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:57.106208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2636eab1-fb91-465a-b908-20b47c6eabd8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:57.107756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2636eab1-fb91-465a-b908-20b47c6eabd8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:57.108267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2636eab1-fb91-465a-b908-20b47c6eabd8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:57.119709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2be9b5a2-d746-423b-868a-e839e29fa01f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:57.120656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2be9b5a2-d746-423b-868a-e839e29fa01f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:57.129486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2be9b5a2-d746-423b-868a-e839e29fa01f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:57.130316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2be9b5a2-d746-423b-868a-e839e29fa01f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:57.131326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2be9b5a2-d746-423b-868a-e839e29fa01f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:57.131967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2be9b5a2-d746-423b-868a-e839e29fa01f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:57.157646 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2636eab1-fb91-465a-b908-20b47c6eabd8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.072868 Jan 22 21:03:57.158944 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 633/1230] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:57 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:57.363977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2be9b5a2-d746-423b-868a-e839e29fa01f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:57.372002 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2be9b5a2-d746-423b-868a-e839e29fa01f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1311 microversion: 2.1 time: 0.256331 Jan 22 21:03:57.374035 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 598/1231] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:57 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1311 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:57.506518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-cdf4f06f-c6cb-4890-af11-4d9b22ffb7d7 req-e95371f3-15a8-475f-a2e7-e9cb4f27dfae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e95589a-26dd-4aac-bbc5-5abc6d98536f", "name": "network-vif-plugged", "status": "completed", "tag": "d9c069fd-afb5-45a0-8595-74435df57e78"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:57.508643 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:57.508643 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:57.517584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-cdf4f06f-c6cb-4890-af11-4d9b22ffb7d7 req-e95371f3-15a8-475f-a2e7-e9cb4f27dfae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:57.517839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-cdf4f06f-c6cb-4890-af11-4d9b22ffb7d7 req-e95371f3-15a8-475f-a2e7-e9cb4f27dfae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:57.528937 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-cdf4f06f-c6cb-4890-af11-4d9b22ffb7d7 req-e95371f3-15a8-475f-a2e7-e9cb4f27dfae service nova] Creating event network-vif-plugged:d9c069fd-afb5-45a0-8595-74435df57e78 for instance 8e95589a-26dd-4aac-bbc5-5abc6d98536f on nch1-master-1 Jan 22 21:03:57.534099 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-cdf4f06f-c6cb-4890-af11-4d9b22ffb7d7 req-e95371f3-15a8-475f-a2e7-e9cb4f27dfae service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042396 Jan 22 21:03:57.535046 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 634/1232] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:57.555576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c5d39b42-f3c8-4bbb-a1d7-d7d9025dff68 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:57.556196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c5d39b42-f3c8-4bbb-a1d7-d7d9025dff68 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:57.564542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5d39b42-f3c8-4bbb-a1d7-d7d9025dff68 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:57.565950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5d39b42-f3c8-4bbb-a1d7-d7d9025dff68 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:57.566993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5d39b42-f3c8-4bbb-a1d7-d7d9025dff68 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:57.567949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5d39b42-f3c8-4bbb-a1d7-d7d9025dff68 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:57.764550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c5d39b42-f3c8-4bbb-a1d7-d7d9025dff68 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:57.772766 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c5d39b42-f3c8-4bbb-a1d7-d7d9025dff68 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.221044 Jan 22 21:03:57.773349 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 599/1233] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:57 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:57.936416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b24b95e1-1e3b-4936-85b7-14c3158b6746 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:57.937220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b24b95e1-1e3b-4936-85b7-14c3158b6746 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:57.940540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-32bc928d-b81a-4680-a5ef-ecd065ebe774 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:57.941330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-32bc928d-b81a-4680-a5ef-ecd065ebe774 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:57.945392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b24b95e1-1e3b-4936-85b7-14c3158b6746 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:57.945896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b24b95e1-1e3b-4936-85b7-14c3158b6746 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:57.946783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b24b95e1-1e3b-4936-85b7-14c3158b6746 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:57.947234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b24b95e1-1e3b-4936-85b7-14c3158b6746 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:57.947751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32bc928d-b81a-4680-a5ef-ecd065ebe774 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:57.948204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32bc928d-b81a-4680-a5ef-ecd065ebe774 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:57.948992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32bc928d-b81a-4680-a5ef-ecd065ebe774 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:57.949433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32bc928d-b81a-4680-a5ef-ecd065ebe774 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:58.080847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b24b95e1-1e3b-4936-85b7-14c3158b6746 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:58.081935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-32bc928d-b81a-4680-a5ef-ecd065ebe774 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:58.088365 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b24b95e1-1e3b-4936-85b7-14c3158b6746 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1318 microversion: 2.1 time: 0.158155 Jan 22 21:03:58.088935 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 635/1234] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:57 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:58.089914 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-32bc928d-b81a-4680-a5ef-ecd065ebe774 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1390 microversion: 2.1 time: 0.153385 Jan 22 21:03:58.090709 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 600/1235] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:57 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:58.094123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4ff16a34-4e60-4e27-8794-97ebf25484aa tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:58.095283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4ff16a34-4e60-4e27-8794-97ebf25484aa tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:58.103243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ff16a34-4e60-4e27-8794-97ebf25484aa tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:58.103707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ff16a34-4e60-4e27-8794-97ebf25484aa tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:58.104666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ff16a34-4e60-4e27-8794-97ebf25484aa tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:58.105110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ff16a34-4e60-4e27-8794-97ebf25484aa tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:58.148011 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4ff16a34-4e60-4e27-8794-97ebf25484aa tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.057746 Jan 22 21:03:58.148661 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 636/1236] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:58 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:58.169739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1becaec8-0e2c-41c0-84fb-ba4c43d69543 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:58.170769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1becaec8-0e2c-41c0-84fb-ba4c43d69543 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:58.176771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1becaec8-0e2c-41c0-84fb-ba4c43d69543 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:58.177223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1becaec8-0e2c-41c0-84fb-ba4c43d69543 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:58.178050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1becaec8-0e2c-41c0-84fb-ba4c43d69543 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:58.178492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1becaec8-0e2c-41c0-84fb-ba4c43d69543 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:58.218724 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1becaec8-0e2c-41c0-84fb-ba4c43d69543 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.053037 Jan 22 21:03:58.219624 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 601/1237] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:58 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:58.391296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-22e4ce7d-7901-4901-8ef1-95187082525a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:58.392028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-22e4ce7d-7901-4901-8ef1-95187082525a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:58.399913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22e4ce7d-7901-4901-8ef1-95187082525a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:58.400370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22e4ce7d-7901-4901-8ef1-95187082525a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:58.401177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22e4ce7d-7901-4901-8ef1-95187082525a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:58.401659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22e4ce7d-7901-4901-8ef1-95187082525a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:58.540766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-22e4ce7d-7901-4901-8ef1-95187082525a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:58.549349 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-22e4ce7d-7901-4901-8ef1-95187082525a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1311 microversion: 2.1 time: 0.162577 Jan 22 21:03:58.549985 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 637/1238] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:58 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1311 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:58.791181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d96b27d2-e857-4eae-8c89-fd2d5568bd0c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:58.791890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d96b27d2-e857-4eae-8c89-fd2d5568bd0c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:58.799758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d96b27d2-e857-4eae-8c89-fd2d5568bd0c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:58.800217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d96b27d2-e857-4eae-8c89-fd2d5568bd0c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:58.801009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d96b27d2-e857-4eae-8c89-fd2d5568bd0c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:58.801455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d96b27d2-e857-4eae-8c89-fd2d5568bd0c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:58.936930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d96b27d2-e857-4eae-8c89-fd2d5568bd0c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:58.944393 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d96b27d2-e857-4eae-8c89-fd2d5568bd0c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.157252 Jan 22 21:03:58.944992 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 602/1239] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:58 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:59.105542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0078be48-5d40-4ff5-8a8b-fa208f74314f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:59.106090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0078be48-5d40-4ff5-8a8b-fa208f74314f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:59.112038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-180fe556-0ecf-4184-807e-9f09b13e7b74 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:59.125274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-180fe556-0ecf-4184-807e-9f09b13e7b74 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:59.125625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0078be48-5d40-4ff5-8a8b-fa208f74314f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:59.125625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0078be48-5d40-4ff5-8a8b-fa208f74314f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:59.125625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0078be48-5d40-4ff5-8a8b-fa208f74314f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:59.125625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0078be48-5d40-4ff5-8a8b-fa208f74314f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:59.126007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-180fe556-0ecf-4184-807e-9f09b13e7b74 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:59.126007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-180fe556-0ecf-4184-807e-9f09b13e7b74 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:59.126007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-180fe556-0ecf-4184-807e-9f09b13e7b74 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:59.126332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-180fe556-0ecf-4184-807e-9f09b13e7b74 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:59.271986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-180fe556-0ecf-4184-807e-9f09b13e7b74 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:59.276604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0078be48-5d40-4ff5-8a8b-fa208f74314f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:59.280876 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-180fe556-0ecf-4184-807e-9f09b13e7b74 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1390 microversion: 2.1 time: 0.174795 Jan 22 21:03:59.281463 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 603/1240] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:59 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:59.285133 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0078be48-5d40-4ff5-8a8b-fa208f74314f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1318 microversion: 2.1 time: 0.183635 Jan 22 21:03:59.285940 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 638/1241] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:59 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:03:59.290386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1f2759c6-0fd6-4b55-9eb2-88bb4ba41b07 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:59.291348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1f2759c6-0fd6-4b55-9eb2-88bb4ba41b07 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:59.295590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-75c62538-2726-4631-a8e9-3d8b475d3069 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:59.296507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-75c62538-2726-4631-a8e9-3d8b475d3069 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:59.298446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f2759c6-0fd6-4b55-9eb2-88bb4ba41b07 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:59.298902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f2759c6-0fd6-4b55-9eb2-88bb4ba41b07 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:59.299710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f2759c6-0fd6-4b55-9eb2-88bb4ba41b07 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:59.300153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f2759c6-0fd6-4b55-9eb2-88bb4ba41b07 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:59.303083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75c62538-2726-4631-a8e9-3d8b475d3069 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:59.303700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75c62538-2726-4631-a8e9-3d8b475d3069 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:59.304674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75c62538-2726-4631-a8e9-3d8b475d3069 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:59.305113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75c62538-2726-4631-a8e9-3d8b475d3069 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:59.343150 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1f2759c6-0fd6-4b55-9eb2-88bb4ba41b07 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.056059 Jan 22 21:03:59.344909 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 639/1242] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:59 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:59.348608 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-75c62538-2726-4631-a8e9-3d8b475d3069 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.057221 Jan 22 21:03:59.349262 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 604/1243] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:59 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:03:59.555019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-38ffeb6a-dd9f-411c-8ada-2c287e244a87 req-59906115-4483-4325-9eb8-deac6c2fb996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898fa5e5-16ac-437f-af78-9a70e358f284", "name": "network-vif-plugged", "status": "completed", "tag": "e6c739de-7e2a-4917-90a5-dd2e9abe25aa"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:59.556525 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:03:59.556525 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:03:59.565278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-38ffeb6a-dd9f-411c-8ada-2c287e244a87 req-59906115-4483-4325-9eb8-deac6c2fb996 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:59.565756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-38ffeb6a-dd9f-411c-8ada-2c287e244a87 req-59906115-4483-4325-9eb8-deac6c2fb996 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:59.566478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c7625c80-91c8-44db-951e-d3890d5c0519 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:59.567218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c7625c80-91c8-44db-951e-d3890d5c0519 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:59.574450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7625c80-91c8-44db-951e-d3890d5c0519 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:59.574907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7625c80-91c8-44db-951e-d3890d5c0519 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:59.575929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7625c80-91c8-44db-951e-d3890d5c0519 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:59.576430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7625c80-91c8-44db-951e-d3890d5c0519 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:59.577822 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-38ffeb6a-dd9f-411c-8ada-2c287e244a87 req-59906115-4483-4325-9eb8-deac6c2fb996 service nova] Creating event network-vif-plugged:e6c739de-7e2a-4917-90a5-dd2e9abe25aa for instance 898fa5e5-16ac-437f-af78-9a70e358f284 on nch1-master-1 Jan 22 21:03:59.582638 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-38ffeb6a-dd9f-411c-8ada-2c287e244a87 req-59906115-4483-4325-9eb8-deac6c2fb996 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031638 Jan 22 21:03:59.583233 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 640/1244] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:03:59.759409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c7625c80-91c8-44db-951e-d3890d5c0519 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:03:59.767624 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c7625c80-91c8-44db-951e-d3890d5c0519 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1491 microversion: 2.1 time: 0.205405 Jan 22 21:03:59.768205 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 605/1245] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:59 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1491 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:03:59.786934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-16c374d1-0d86-4b6a-9ea9-5064aa6b3e99 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:03:59.788215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-16c374d1-0d86-4b6a-9ea9-5064aa6b3e99 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:59.794686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16c374d1-0d86-4b6a-9ea9-5064aa6b3e99 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:59.795143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16c374d1-0d86-4b6a-9ea9-5064aa6b3e99 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:59.796077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16c374d1-0d86-4b6a-9ea9-5064aa6b3e99 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:59.796375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16c374d1-0d86-4b6a-9ea9-5064aa6b3e99 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:59.820981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-16c374d1-0d86-4b6a-9ea9-5064aa6b3e99 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lazy-loading 'flavor' on Instance uuid 8e95589a-26dd-4aac-bbc5-5abc6d98536f {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:03:59.961141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f645eac0-a9b4-4056-a521-936bdeabc3af tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:03:59.961794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f645eac0-a9b4-4056-a521-936bdeabc3af tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:03:59.970090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f645eac0-a9b4-4056-a521-936bdeabc3af tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:59.970582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f645eac0-a9b4-4056-a521-936bdeabc3af tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:03:59.971613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f645eac0-a9b4-4056-a521-936bdeabc3af tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:03:59.972063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f645eac0-a9b4-4056-a521-936bdeabc3af tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:00.171969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f645eac0-a9b4-4056-a521-936bdeabc3af tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:00.179529 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f645eac0-a9b4-4056-a521-936bdeabc3af tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.222260 Jan 22 21:04:00.180098 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 606/1246] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:03:59 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:00.192623 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-16c374d1-0d86-4b6a-9ea9-5064aa6b3e99 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "POST /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f/action" status: 202 len: 0 microversion: 2.1 time: 0.410053 Jan 22 21:04:00.193409 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 641/1247] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:03:59 2022] POST /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:04:00.202076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-094ec2fe-2608-4519-b1c6-669d0a5b74de tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:00.202700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-094ec2fe-2608-4519-b1c6-669d0a5b74de tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:00.208606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-094ec2fe-2608-4519-b1c6-669d0a5b74de tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:00.209099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-094ec2fe-2608-4519-b1c6-669d0a5b74de tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:00.209941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-094ec2fe-2608-4519-b1c6-669d0a5b74de tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:00.210384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-094ec2fe-2608-4519-b1c6-669d0a5b74de tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:00.298413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-770eb25c-2522-423f-84ea-f920ceff12cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:00.299129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-770eb25c-2522-423f-84ea-f920ceff12cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:00.306748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-770eb25c-2522-423f-84ea-f920ceff12cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:00.307215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-770eb25c-2522-423f-84ea-f920ceff12cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:00.308046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-770eb25c-2522-423f-84ea-f920ceff12cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:00.308483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-770eb25c-2522-423f-84ea-f920ceff12cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:00.351751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-094ec2fe-2608-4519-b1c6-669d0a5b74de tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:00.369369 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-094ec2fe-2608-4519-b1c6-669d0a5b74de tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1499 microversion: 2.1 time: 0.164209 Jan 22 21:04:00.369369 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 607/1248] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:00 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1499 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:00.369369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3565f8ad-58a7-464f-a20f-426e34011d2d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:00.369369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3565f8ad-58a7-464f-a20f-426e34011d2d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:00.380600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3565f8ad-58a7-464f-a20f-426e34011d2d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:00.381544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3565f8ad-58a7-464f-a20f-426e34011d2d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:00.382449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3565f8ad-58a7-464f-a20f-426e34011d2d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:00.382830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3565f8ad-58a7-464f-a20f-426e34011d2d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:00.453247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-770eb25c-2522-423f-84ea-f920ceff12cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:00.461174 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-770eb25c-2522-423f-84ea-f920ceff12cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1390 microversion: 2.1 time: 0.167817 Jan 22 21:04:00.461776 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 642/1249] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:00 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:00.466527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5468514c-eaa3-44f1-9c79-03dbab070a66 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:00.467687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5468514c-eaa3-44f1-9c79-03dbab070a66 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:00.474012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5468514c-eaa3-44f1-9c79-03dbab070a66 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:00.477797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5468514c-eaa3-44f1-9c79-03dbab070a66 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:00.477797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5468514c-eaa3-44f1-9c79-03dbab070a66 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:00.477797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5468514c-eaa3-44f1-9c79-03dbab070a66 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:00.520865 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5468514c-eaa3-44f1-9c79-03dbab070a66 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.057785 Jan 22 21:04:00.521554 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 643/1250] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:00 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:00.521884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3565f8ad-58a7-464f-a20f-426e34011d2d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:00.527060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-77ceea6b-57bb-4ade-8c25-9bc534453ae3 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:00.528045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-77ceea6b-57bb-4ade-8c25-9bc534453ae3 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:00.530363 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3565f8ad-58a7-464f-a20f-426e34011d2d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1318 microversion: 2.1 time: 0.166217 Jan 22 21:04:00.530946 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 608/1251] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:00 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:00.535323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77ceea6b-57bb-4ade-8c25-9bc534453ae3 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:00.535773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77ceea6b-57bb-4ade-8c25-9bc534453ae3 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:00.536559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77ceea6b-57bb-4ade-8c25-9bc534453ae3 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:00.536993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77ceea6b-57bb-4ade-8c25-9bc534453ae3 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:00.579863 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-77ceea6b-57bb-4ade-8c25-9bc534453ae3 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.056869 Jan 22 21:04:00.580526 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 644/1252] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:00 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:01.198941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-68d95849-48c2-4c15-9628-b4bdceced562 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:01.199608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-68d95849-48c2-4c15-9628-b4bdceced562 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:01.207402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68d95849-48c2-4c15-9628-b4bdceced562 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.209592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68d95849-48c2-4c15-9628-b4bdceced562 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:01.209592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68d95849-48c2-4c15-9628-b4bdceced562 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.209592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68d95849-48c2-4c15-9628-b4bdceced562 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:01.360218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-68d95849-48c2-4c15-9628-b4bdceced562 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:01.367661 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-68d95849-48c2-4c15-9628-b4bdceced562 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.173515 Jan 22 21:04:01.368231 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 609/1253] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:01 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:01.382696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fbba729f-57dc-406d-92d8-df7419110ccf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:01.382696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fbba729f-57dc-406d-92d8-df7419110ccf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:01.405846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fbba729f-57dc-406d-92d8-df7419110ccf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.405846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fbba729f-57dc-406d-92d8-df7419110ccf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:01.405846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fbba729f-57dc-406d-92d8-df7419110ccf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.405846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fbba729f-57dc-406d-92d8-df7419110ccf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:01.479094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6cc87027-e11d-49d8-b09c-b262d89ba166 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:01.479462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6cc87027-e11d-49d8-b09c-b262d89ba166 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:01.486678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6cc87027-e11d-49d8-b09c-b262d89ba166 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.487156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6cc87027-e11d-49d8-b09c-b262d89ba166 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:01.488180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6cc87027-e11d-49d8-b09c-b262d89ba166 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.488626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6cc87027-e11d-49d8-b09c-b262d89ba166 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:01.533246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fbba729f-57dc-406d-92d8-df7419110ccf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:01.541834 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fbba729f-57dc-406d-92d8-df7419110ccf tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 200 len: 1482 microversion: 2.1 time: 0.165102 Jan 22 21:04:01.551454 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 645/1254] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:01 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 1482 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:01.551454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a7b04335-1756-453d-a816-f2ab50fb32dd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:01.551454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a7b04335-1756-453d-a816-f2ab50fb32dd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:01.557110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7b04335-1756-453d-a816-f2ab50fb32dd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.557594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7b04335-1756-453d-a816-f2ab50fb32dd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:01.558417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7b04335-1756-453d-a816-f2ab50fb32dd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.558863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7b04335-1756-453d-a816-f2ab50fb32dd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:01.601487 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a7b04335-1756-453d-a816-f2ab50fb32dd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.057822 Jan 22 21:04:01.602195 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 646/1255] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:01 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:01.607918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f7c34c2-c33d-40b8-ac49-ce80d524cf9f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:01.608622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f7c34c2-c33d-40b8-ac49-ce80d524cf9f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:01.616671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f7c34c2-c33d-40b8-ac49-ce80d524cf9f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.617236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f7c34c2-c33d-40b8-ac49-ce80d524cf9f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:01.619334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f7c34c2-c33d-40b8-ac49-ce80d524cf9f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.619334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f7c34c2-c33d-40b8-ac49-ce80d524cf9f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:01.631659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6cc87027-e11d-49d8-b09c-b262d89ba166 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:01.641660 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6cc87027-e11d-49d8-b09c-b262d89ba166 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1390 microversion: 2.1 time: 0.166339 Jan 22 21:04:01.655029 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 610/1256] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:01 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:01.655029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8d12ca57-50f4-4dc8-8fff-ffe1d8cea018 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-297410416"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:01.655029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8d12ca57-50f4-4dc8-8fff-ffe1d8cea018 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:01.655992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d12ca57-50f4-4dc8-8fff-ffe1d8cea018 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.656309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d12ca57-50f4-4dc8-8fff-ffe1d8cea018 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:01.657208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d12ca57-50f4-4dc8-8fff-ffe1d8cea018 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.657845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d12ca57-50f4-4dc8-8fff-ffe1d8cea018 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:01.776528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f7c34c2-c33d-40b8-ac49-ce80d524cf9f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:01.789397 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f7c34c2-c33d-40b8-ac49-ce80d524cf9f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1468 microversion: 2.1 time: 0.181635 Jan 22 21:04:01.789397 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 647/1257] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:01 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1468 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:01.790686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-75776a08-1f6b-487a-82fa-61d3e0458ce6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:01.791862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-75776a08-1f6b-487a-82fa-61d3e0458ce6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:01.798007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75776a08-1f6b-487a-82fa-61d3e0458ce6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.798651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75776a08-1f6b-487a-82fa-61d3e0458ce6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:01.799913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75776a08-1f6b-487a-82fa-61d3e0458ce6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.800363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75776a08-1f6b-487a-82fa-61d3e0458ce6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:01.849871 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-75776a08-1f6b-487a-82fa-61d3e0458ce6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.062838 Jan 22 21:04:01.851032 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 648/1258] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:01 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:01.857096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3da526e8-df63-4a39-805f-b576c8e117f1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:01.858291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3da526e8-df63-4a39-805f-b576c8e117f1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:01.865589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3da526e8-df63-4a39-805f-b576c8e117f1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.866045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3da526e8-df63-4a39-805f-b576c8e117f1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:01.867057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3da526e8-df63-4a39-805f-b576c8e117f1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:01.867673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3da526e8-df63-4a39-805f-b576c8e117f1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:02.008232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3da526e8-df63-4a39-805f-b576c8e117f1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:02.016270 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3da526e8-df63-4a39-805f-b576c8e117f1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1317 microversion: 2.1 time: 0.163171 Jan 22 21:04:02.020594 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 649/1259] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:01 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:02.244464 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8d12ca57-50f4-4dc8-8fff-ffe1d8cea018 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "POST /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f/action" status: 202 len: 0 microversion: 2.1 time: 0.600641 Jan 22 21:04:02.245148 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 611/1260] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:01 2022] POST /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 22 21:04:02.254888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1c3433bd-79fd-44a4-9d77-c51dda14f91e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5d8f9d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:02.301659 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1c3433bd-79fd-44a4-9d77-c51dda14f91e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1444 microversion: 2.1 time: 0.050293 Jan 22 21:04:02.302264 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 650/1261] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:02 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1444 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:02.386717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0dce7372-b149-4ece-9208-c86e9eaf3ac3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:02.388523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0dce7372-b149-4ece-9208-c86e9eaf3ac3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:02.396817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dce7372-b149-4ece-9208-c86e9eaf3ac3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:02.397351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dce7372-b149-4ece-9208-c86e9eaf3ac3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:02.398201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dce7372-b149-4ece-9208-c86e9eaf3ac3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:02.398648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dce7372-b149-4ece-9208-c86e9eaf3ac3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:02.543364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0dce7372-b149-4ece-9208-c86e9eaf3ac3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:02.551314 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0dce7372-b149-4ece-9208-c86e9eaf3ac3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.170294 Jan 22 21:04:02.551897 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 612/1262] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:02 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:02.613687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-59921300-8017-4fc4-95a5-1945c9686f5e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:02.614785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-59921300-8017-4fc4-95a5-1945c9686f5e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:02.620856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59921300-8017-4fc4-95a5-1945c9686f5e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:02.621318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59921300-8017-4fc4-95a5-1945c9686f5e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:02.622246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59921300-8017-4fc4-95a5-1945c9686f5e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:02.622731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59921300-8017-4fc4-95a5-1945c9686f5e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:02.661778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d5051354-6d45-4de8-9385-d431e5893f46 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:02.662178 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-59921300-8017-4fc4-95a5-1945c9686f5e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.052691 Jan 22 21:04:02.662456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d5051354-6d45-4de8-9385-d431e5893f46 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:02.662858 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 651/1263] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:02 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:02.669286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5051354-6d45-4de8-9385-d431e5893f46 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:02.669889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5051354-6d45-4de8-9385-d431e5893f46 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:02.670746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5051354-6d45-4de8-9385-d431e5893f46 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:02.671206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5051354-6d45-4de8-9385-d431e5893f46 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:02.808929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d5051354-6d45-4de8-9385-d431e5893f46 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:02.817852 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d5051354-6d45-4de8-9385-d431e5893f46 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1390 microversion: 2.1 time: 0.159953 Jan 22 21:04:02.820565 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 613/1264] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:02 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:02.863821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-574041e9-8d74-46d4-9309-5b3e77b38b9d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:02.864830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-574041e9-8d74-46d4-9309-5b3e77b38b9d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:02.871917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-574041e9-8d74-46d4-9309-5b3e77b38b9d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:02.872434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-574041e9-8d74-46d4-9309-5b3e77b38b9d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:02.873265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-574041e9-8d74-46d4-9309-5b3e77b38b9d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:02.873745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-574041e9-8d74-46d4-9309-5b3e77b38b9d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:02.918748 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-574041e9-8d74-46d4-9309-5b3e77b38b9d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.059013 Jan 22 21:04:02.920350 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 652/1265] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:02 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:03.033826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1531d26b-e72b-4c9b-bf80-1a0ed81e0a68 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:03.042671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1531d26b-e72b-4c9b-bf80-1a0ed81e0a68 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:03.042671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1531d26b-e72b-4c9b-bf80-1a0ed81e0a68 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:03.042671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1531d26b-e72b-4c9b-bf80-1a0ed81e0a68 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:03.042671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1531d26b-e72b-4c9b-bf80-1a0ed81e0a68 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:03.043084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1531d26b-e72b-4c9b-bf80-1a0ed81e0a68 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:03.176845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1531d26b-e72b-4c9b-bf80-1a0ed81e0a68 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:03.184188 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1531d26b-e72b-4c9b-bf80-1a0ed81e0a68 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1317 microversion: 2.1 time: 0.154155 Jan 22 21:04:03.184797 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 614/1266] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:03 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:03.309095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-387b3fb2-7005-4b57-aa1c-e3feab8a9262 req-cda11761-92ec-4c85-80d5-26e7af1bf54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28df35b-8a9a-4010-aa14-89cc18350ba9", "name": "network-vif-plugged", "status": "completed", "tag": "e3a1c234-0a19-4371-944f-202cc47a018b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:03.311097 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:03.311097 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:03.314808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3758a662-590d-4190-9038-29683a133be5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5d8ef70>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:03.319668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-387b3fb2-7005-4b57-aa1c-e3feab8a9262 req-cda11761-92ec-4c85-80d5-26e7af1bf54b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:03.320452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-387b3fb2-7005-4b57-aa1c-e3feab8a9262 req-cda11761-92ec-4c85-80d5-26e7af1bf54b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:03.333545 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-387b3fb2-7005-4b57-aa1c-e3feab8a9262 req-cda11761-92ec-4c85-80d5-26e7af1bf54b service nova] Creating event network-vif-plugged:e3a1c234-0a19-4371-944f-202cc47a018b for instance b28df35b-8a9a-4010-aa14-89cc18350ba9 on nch1-master-1 Jan 22 21:04:03.338367 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-387b3fb2-7005-4b57-aa1c-e3feab8a9262 req-cda11761-92ec-4c85-80d5-26e7af1bf54b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033288 Jan 22 21:04:03.339162 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 653/1267] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:03.360284 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3758a662-590d-4190-9038-29683a133be5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1444 microversion: 2.1 time: 0.048987 Jan 22 21:04:03.360865 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 615/1268] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:03 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1444 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:03.568628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a98bcc56-8922-4e5f-ad25-2dda6dc18d92 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:03.569405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a98bcc56-8922-4e5f-ad25-2dda6dc18d92 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:03.576304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a98bcc56-8922-4e5f-ad25-2dda6dc18d92 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:03.576770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a98bcc56-8922-4e5f-ad25-2dda6dc18d92 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:03.577601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a98bcc56-8922-4e5f-ad25-2dda6dc18d92 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:03.578100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a98bcc56-8922-4e5f-ad25-2dda6dc18d92 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:03.674242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dc4c4742-c1d2-42e3-9ed7-f129027b0f56 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:03.675349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dc4c4742-c1d2-42e3-9ed7-f129027b0f56 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:03.684066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc4c4742-c1d2-42e3-9ed7-f129027b0f56 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:03.685627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc4c4742-c1d2-42e3-9ed7-f129027b0f56 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:03.686805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc4c4742-c1d2-42e3-9ed7-f129027b0f56 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:03.687814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc4c4742-c1d2-42e3-9ed7-f129027b0f56 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:03.721962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a98bcc56-8922-4e5f-ad25-2dda6dc18d92 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:03.730318 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a98bcc56-8922-4e5f-ad25-2dda6dc18d92 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.165743 Jan 22 21:04:03.731363 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 654/1269] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:03 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:03.735896 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dc4c4742-c1d2-42e3-9ed7-f129027b0f56 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.065238 Jan 22 21:04:03.737335 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 616/1270] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:03 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:03.835681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-521b93f8-5c69-42bf-8f1b-69a9c42e5be8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:03.836507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-521b93f8-5c69-42bf-8f1b-69a9c42e5be8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:03.845272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-521b93f8-5c69-42bf-8f1b-69a9c42e5be8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:03.846161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-521b93f8-5c69-42bf-8f1b-69a9c42e5be8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:03.847004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-521b93f8-5c69-42bf-8f1b-69a9c42e5be8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:03.847925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-521b93f8-5c69-42bf-8f1b-69a9c42e5be8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:03.932311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-652a08d5-3be4-414f-87f5-e682258192c5 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:03.933439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-652a08d5-3be4-414f-87f5-e682258192c5 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:03.941113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-652a08d5-3be4-414f-87f5-e682258192c5 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:03.944072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-652a08d5-3be4-414f-87f5-e682258192c5 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:03.944072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-652a08d5-3be4-414f-87f5-e682258192c5 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:03.944072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-652a08d5-3be4-414f-87f5-e682258192c5 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:03.990567 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-652a08d5-3be4-414f-87f5-e682258192c5 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.062296 Jan 22 21:04:03.993020 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 617/1271] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:03 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:03.994004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-521b93f8-5c69-42bf-8f1b-69a9c42e5be8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:04.003162 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-521b93f8-5c69-42bf-8f1b-69a9c42e5be8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1390 microversion: 2.1 time: 0.171360 Jan 22 21:04:04.003730 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 655/1272] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:03 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:04.201288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f3f92810-5e06-48a4-a1fc-caca49565427 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:04.201950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f3f92810-5e06-48a4-a1fc-caca49565427 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:04.208950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3f92810-5e06-48a4-a1fc-caca49565427 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:04.209427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3f92810-5e06-48a4-a1fc-caca49565427 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:04.210238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3f92810-5e06-48a4-a1fc-caca49565427 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:04.210687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3f92810-5e06-48a4-a1fc-caca49565427 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:04.342423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f3f92810-5e06-48a4-a1fc-caca49565427 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:04.350650 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f3f92810-5e06-48a4-a1fc-caca49565427 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1317 microversion: 2.1 time: 0.154142 Jan 22 21:04:04.351216 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 618/1273] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:04 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:04.374080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d8a4b48d-15ba-4853-a33e-6f1ded3ada00 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5ea0700>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:04.418165 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d8a4b48d-15ba-4853-a33e-6f1ded3ada00 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1444 microversion: 2.1 time: 0.048274 Jan 22 21:04:04.418738 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 656/1274] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:04 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1444 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:04.748590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1f06f161-e47b-4f02-b580-5424d7ffb32b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:04.749213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4d41b35a-b7de-4fed-b28d-440ea63f7a30 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:04.749804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1f06f161-e47b-4f02-b580-5424d7ffb32b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:04.750008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4d41b35a-b7de-4fed-b28d-440ea63f7a30 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:04.756801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d41b35a-b7de-4fed-b28d-440ea63f7a30 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:04.757126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f06f161-e47b-4f02-b580-5424d7ffb32b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:04.757288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d41b35a-b7de-4fed-b28d-440ea63f7a30 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:04.757626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f06f161-e47b-4f02-b580-5424d7ffb32b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:04.758132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d41b35a-b7de-4fed-b28d-440ea63f7a30 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:04.758460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f06f161-e47b-4f02-b580-5424d7ffb32b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:04.758584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d41b35a-b7de-4fed-b28d-440ea63f7a30 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:04.759068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f06f161-e47b-4f02-b580-5424d7ffb32b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:04.798693 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1f06f161-e47b-4f02-b580-5424d7ffb32b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.054600 Jan 22 21:04:04.799406 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 619/1275] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:04 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:04.892178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4d41b35a-b7de-4fed-b28d-440ea63f7a30 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:04.900028 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4d41b35a-b7de-4fed-b28d-440ea63f7a30 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.155952 Jan 22 21:04:04.900603 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 657/1276] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:04 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:05.004072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f9b475c4-f0a8-40ef-8983-02c5e503e25d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:05.005287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f9b475c4-f0a8-40ef-8983-02c5e503e25d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:05.012385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f9b475c4-f0a8-40ef-8983-02c5e503e25d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:05.013780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f9b475c4-f0a8-40ef-8983-02c5e503e25d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:05.014797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f9b475c4-f0a8-40ef-8983-02c5e503e25d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:05.015412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f9b475c4-f0a8-40ef-8983-02c5e503e25d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:05.020698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3b073fc3-6247-46c6-b6bd-aead26c2cef8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:05.025163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3b073fc3-6247-46c6-b6bd-aead26c2cef8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:05.029140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b073fc3-6247-46c6-b6bd-aead26c2cef8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:05.029846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b073fc3-6247-46c6-b6bd-aead26c2cef8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:05.030762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b073fc3-6247-46c6-b6bd-aead26c2cef8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:05.031524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b073fc3-6247-46c6-b6bd-aead26c2cef8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:05.059998 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f9b475c4-f0a8-40ef-8983-02c5e503e25d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.060208 Jan 22 21:04:05.061384 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 620/1277] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:04 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:05.173486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3b073fc3-6247-46c6-b6bd-aead26c2cef8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:05.181948 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3b073fc3-6247-46c6-b6bd-aead26c2cef8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1390 microversion: 2.1 time: 0.165286 Jan 22 21:04:05.182726 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 658/1278] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:05 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:05.355850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-7ff8c3e2-d24b-4658-9e31-463c19db8296 req-91b4d477-e8b6-47d9-afc8-e69091dc04f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ab8dcc-d072-4e68-af27-2b4614db4cc2", "name": "network-vif-plugged", "status": "completed", "tag": "a4acdedb-d82e-4307-87e1-a851a52f7726"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:05.358016 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:05.358016 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:05.366313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7ff8c3e2-d24b-4658-9e31-463c19db8296 req-91b4d477-e8b6-47d9-afc8-e69091dc04f4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:05.366833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7ff8c3e2-d24b-4658-9e31-463c19db8296 req-91b4d477-e8b6-47d9-afc8-e69091dc04f4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:05.367077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ae58e10b-b2a3-4091-8a93-4764603e6cf0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:05.367694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ae58e10b-b2a3-4091-8a93-4764603e6cf0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:05.374366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae58e10b-b2a3-4091-8a93-4764603e6cf0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:05.374824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae58e10b-b2a3-4091-8a93-4764603e6cf0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:05.375625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae58e10b-b2a3-4091-8a93-4764603e6cf0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:05.376068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae58e10b-b2a3-4091-8a93-4764603e6cf0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:05.383222 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-7ff8c3e2-d24b-4658-9e31-463c19db8296 req-91b4d477-e8b6-47d9-afc8-e69091dc04f4 service nova] Creating event network-vif-plugged:a4acdedb-d82e-4307-87e1-a851a52f7726 for instance 49ab8dcc-d072-4e68-af27-2b4614db4cc2 on nch2-master-1 Jan 22 21:04:05.388875 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-7ff8c3e2-d24b-4658-9e31-463c19db8296 req-91b4d477-e8b6-47d9-afc8-e69091dc04f4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037165 Jan 22 21:04:05.389999 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 621/1279] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:04:05.440799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-78de68a0-cb46-4fc6-a452-60a8cea5b00c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5d73e50>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:05.527536 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-78de68a0-cb46-4fc6-a452-60a8cea5b00c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1444 microversion: 2.1 time: 0.099406 Jan 22 21:04:05.535454 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 622/1280] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:05 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:05.572732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ae58e10b-b2a3-4091-8a93-4764603e6cf0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:05.581670 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ae58e10b-b2a3-4091-8a93-4764603e6cf0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1466 microversion: 2.1 time: 0.218237 Jan 22 21:04:05.582876 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 659/1281] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:05 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1466 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:05.639564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-906029113", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b28df35b-8a9a-4010-aa14-89cc18350ba9"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:05.687528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:04:05.813715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0f80c534-f0ec-4456-81c2-bf8b0d2fd9cc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:05.815679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0f80c534-f0ec-4456-81c2-bf8b0d2fd9cc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:05.822677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f80c534-f0ec-4456-81c2-bf8b0d2fd9cc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:05.823133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f80c534-f0ec-4456-81c2-bf8b0d2fd9cc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:05.823957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f80c534-f0ec-4456-81c2-bf8b0d2fd9cc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:05.824397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f80c534-f0ec-4456-81c2-bf8b0d2fd9cc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:05.886345 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0f80c534-f0ec-4456-81c2-bf8b0d2fd9cc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.080238 Jan 22 21:04:05.887236 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 660/1282] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:05 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:05.910683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:04:05.911118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:04:05.911889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:04:05.912317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:04:05.912730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:04:05.916777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-96eca3a4-5cad-4790-96ea-b44d6e0ee5d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:05.917472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-96eca3a4-5cad-4790-96ea-b44d6e0ee5d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:05.923293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:05.933227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:05.933227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:05.933227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:05.934293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96eca3a4-5cad-4790-96ea-b44d6e0ee5d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:05.934293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96eca3a4-5cad-4790-96ea-b44d6e0ee5d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:05.934293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96eca3a4-5cad-4790-96ea-b44d6e0ee5d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:05.934293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96eca3a4-5cad-4790-96ea-b44d6e0ee5d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:05.949555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Getting quotas for project 2566e2caf61643f7b603b8ab8f81e193. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:05.956597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Getting quotas for user 1e062e80dcda4118963156134c040e67 and project 2566e2caf61643f7b603b8ab8f81e193. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:05.976671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:04:05.979346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:04:06.075039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-96eca3a4-5cad-4790-96ea-b44d6e0ee5d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:06.083728 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-96eca3a4-5cad-4790-96ea-b44d6e0ee5d9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.170736 Jan 22 21:04:06.084456 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 661/1283] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:05 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:06.089250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6034efc4-130f-42d8-9cff-bc9ac0a0dc7f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:06.090572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6034efc4-130f-42d8-9cff-bc9ac0a0dc7f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:06.098062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6034efc4-130f-42d8-9cff-bc9ac0a0dc7f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:06.098517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6034efc4-130f-42d8-9cff-bc9ac0a0dc7f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:06.099322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6034efc4-130f-42d8-9cff-bc9ac0a0dc7f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:06.099766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6034efc4-130f-42d8-9cff-bc9ac0a0dc7f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:06.147804 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6034efc4-130f-42d8-9cff-bc9ac0a0dc7f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.061909 Jan 22 21:04:06.148706 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 662/1284] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:06 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:06.173611 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b9b92009-c01c-4705-8b68-1e995df8d413 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.538661 Jan 22 21:04:06.174234 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 623/1285] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:04:05 2022] POST /compute/v2.1/servers => generated 382 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:04:06.186540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-40de7df8-2bed-4f7d-89fe-303c1225e472 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:06.187448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-40de7df8-2bed-4f7d-89fe-303c1225e472 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:06.208070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ccb7e1b6-ca0c-473a-8814-3a96547cc267 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:06.208925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ccb7e1b6-ca0c-473a-8814-3a96547cc267 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:06.216742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccb7e1b6-ca0c-473a-8814-3a96547cc267 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:06.217203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccb7e1b6-ca0c-473a-8814-3a96547cc267 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:06.218349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccb7e1b6-ca0c-473a-8814-3a96547cc267 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:06.220094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccb7e1b6-ca0c-473a-8814-3a96547cc267 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:06.249154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-40de7df8-2bed-4f7d-89fe-303c1225e472 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:06.267172 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-40de7df8-2bed-4f7d-89fe-303c1225e472 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1217 microversion: 2.1 time: 0.086003 Jan 22 21:04:06.267772 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 663/1286] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:06 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:06.400028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ccb7e1b6-ca0c-473a-8814-3a96547cc267 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:06.410739 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ccb7e1b6-ca0c-473a-8814-3a96547cc267 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1390 microversion: 2.1 time: 0.216180 Jan 22 21:04:06.411340 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 624/1287] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:06 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1390 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:06.541429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c201a703-d21e-444e-be0a-e00232624138 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5d41d30>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:06.619382 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c201a703-d21e-444e-be0a-e00232624138 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1444 microversion: 2.1 time: 0.077213 Jan 22 21:04:06.620470 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 664/1288] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:06 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1444 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:06.905013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f6706b18-7637-4b18-8a26-156387c2b79f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:06.906463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f6706b18-7637-4b18-8a26-156387c2b79f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:06.914225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6706b18-7637-4b18-8a26-156387c2b79f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:06.915004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6706b18-7637-4b18-8a26-156387c2b79f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:06.916068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6706b18-7637-4b18-8a26-156387c2b79f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:06.916683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6706b18-7637-4b18-8a26-156387c2b79f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:06.979859 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f6706b18-7637-4b18-8a26-156387c2b79f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.080921 Jan 22 21:04:06.981828 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 625/1289] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:06 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:07.108011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b06a515-9dab-4ed7-80c6-7f1e44a4225a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:07.110474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6b06a515-9dab-4ed7-80c6-7f1e44a4225a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:07.121783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b06a515-9dab-4ed7-80c6-7f1e44a4225a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:07.125944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b06a515-9dab-4ed7-80c6-7f1e44a4225a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:07.130162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b06a515-9dab-4ed7-80c6-7f1e44a4225a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:07.130162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b06a515-9dab-4ed7-80c6-7f1e44a4225a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:07.160902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d869608d-ff30-4de4-ae3f-399de6838429 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:07.162010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d869608d-ff30-4de4-ae3f-399de6838429 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:07.177798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d869608d-ff30-4de4-ae3f-399de6838429 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:07.178256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d869608d-ff30-4de4-ae3f-399de6838429 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:07.179073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d869608d-ff30-4de4-ae3f-399de6838429 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:07.179518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d869608d-ff30-4de4-ae3f-399de6838429 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:07.266420 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d869608d-ff30-4de4-ae3f-399de6838429 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.109406 Jan 22 21:04:07.267248 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 626/1290] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:07 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:07.287008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0aa390bc-2b4d-424e-bdd9-5b2b00d37ea6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:07.287720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0aa390bc-2b4d-424e-bdd9-5b2b00d37ea6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:07.297760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0aa390bc-2b4d-424e-bdd9-5b2b00d37ea6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:07.298227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0aa390bc-2b4d-424e-bdd9-5b2b00d37ea6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:07.299066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0aa390bc-2b4d-424e-bdd9-5b2b00d37ea6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:07.299502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0aa390bc-2b4d-424e-bdd9-5b2b00d37ea6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:07.350531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6b06a515-9dab-4ed7-80c6-7f1e44a4225a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:07.359424 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b06a515-9dab-4ed7-80c6-7f1e44a4225a tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.259430 Jan 22 21:04:07.361246 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 665/1291] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:07 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:07.428099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d8467ef4-8a5f-42de-8724-f777a092f18f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:07.428719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d8467ef4-8a5f-42de-8724-f777a092f18f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:07.436828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8467ef4-8a5f-42de-8724-f777a092f18f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:07.437292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8467ef4-8a5f-42de-8724-f777a092f18f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:07.438167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8467ef4-8a5f-42de-8724-f777a092f18f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:07.438619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8467ef4-8a5f-42de-8724-f777a092f18f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:07.455174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0aa390bc-2b4d-424e-bdd9-5b2b00d37ea6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:07.465256 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0aa390bc-2b4d-424e-bdd9-5b2b00d37ea6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1221 microversion: 2.1 time: 0.181813 Jan 22 21:04:07.466462 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 627/1292] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:07 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1221 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:07.482711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-01644a72-f01c-4838-aa13-99eb045ab838 req-42576a0e-2322-4e88-84dc-7467ad73a94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e95589a-26dd-4aac-bbc5-5abc6d98536f", "name": "network-vif-plugged", "status": "completed", "tag": "d9c069fd-afb5-45a0-8595-74435df57e78"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:07.484788 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:07.484788 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:07.492015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-01644a72-f01c-4838-aa13-99eb045ab838 req-42576a0e-2322-4e88-84dc-7467ad73a94a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:07.492788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-01644a72-f01c-4838-aa13-99eb045ab838 req-42576a0e-2322-4e88-84dc-7467ad73a94a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:07.506790 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-01644a72-f01c-4838-aa13-99eb045ab838 req-42576a0e-2322-4e88-84dc-7467ad73a94a service nova] Creating event network-vif-plugged:d9c069fd-afb5-45a0-8595-74435df57e78 for instance 8e95589a-26dd-4aac-bbc5-5abc6d98536f on nch1-master-1 Jan 22 21:04:07.514764 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-01644a72-f01c-4838-aa13-99eb045ab838 req-42576a0e-2322-4e88-84dc-7467ad73a94a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046606 Jan 22 21:04:07.515719 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 628/1293] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:07.606203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d8467ef4-8a5f-42de-8724-f777a092f18f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:07.616748 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d8467ef4-8a5f-42de-8724-f777a092f18f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1589 microversion: 2.1 time: 0.192261 Jan 22 21:04:07.617666 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 666/1294] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:07 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1589 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:07.634732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8b25fecd-5b56-49ee-8b03-0f735fb63741 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5de50d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:07.635150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-64d84017-26aa-4683-ab74-e687c7bd1571 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:07.635662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-64d84017-26aa-4683-ab74-e687c7bd1571 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:07.664299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64d84017-26aa-4683-ab74-e687c7bd1571 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:07.664299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64d84017-26aa-4683-ab74-e687c7bd1571 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:07.664299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64d84017-26aa-4683-ab74-e687c7bd1571 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:07.668114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64d84017-26aa-4683-ab74-e687c7bd1571 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:07.715511 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8b25fecd-5b56-49ee-8b03-0f735fb63741 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1444 microversion: 2.1 time: 0.085239 Jan 22 21:04:07.725197 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 629/1295] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:07 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:07.788857 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-64d84017-26aa-4683-ab74-e687c7bd1571 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156770 Jan 22 21:04:07.791859 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 667/1296] 10.222.0.100 () {58 vars in 1279 bytes} [Sat Jan 22 21:04:07 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:04:07.994471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48837ec0-a0d3-4233-a4c5-45f9ba05ffa1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:07.995709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48837ec0-a0d3-4233-a4c5-45f9ba05ffa1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:08.012633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48837ec0-a0d3-4233-a4c5-45f9ba05ffa1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:08.018840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48837ec0-a0d3-4233-a4c5-45f9ba05ffa1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:08.020848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48837ec0-a0d3-4233-a4c5-45f9ba05ffa1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:08.025574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48837ec0-a0d3-4233-a4c5-45f9ba05ffa1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:08.147478 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48837ec0-a0d3-4233-a4c5-45f9ba05ffa1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.158266 Jan 22 21:04:08.149700 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 630/1297] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:07 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:08.289270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7d599b7d-541b-4e7a-a115-b5e2aa78976f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:08.290319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7d599b7d-541b-4e7a-a115-b5e2aa78976f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:08.299466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d599b7d-541b-4e7a-a115-b5e2aa78976f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:08.300282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d599b7d-541b-4e7a-a115-b5e2aa78976f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:08.301542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d599b7d-541b-4e7a-a115-b5e2aa78976f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:08.301975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d599b7d-541b-4e7a-a115-b5e2aa78976f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:08.352702 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7d599b7d-541b-4e7a-a115-b5e2aa78976f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.075066 Jan 22 21:04:08.353904 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 668/1298] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:08 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:08.391583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8d082627-0480-4036-8fb5-ecab7adb83b1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:08.392690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8d082627-0480-4036-8fb5-ecab7adb83b1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:08.410256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d082627-0480-4036-8fb5-ecab7adb83b1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:08.415163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d082627-0480-4036-8fb5-ecab7adb83b1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:08.415163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d082627-0480-4036-8fb5-ecab7adb83b1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:08.415163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d082627-0480-4036-8fb5-ecab7adb83b1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:08.484693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-292547a1-315f-41e7-b80d-4fac6bd7eff9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:08.485722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-292547a1-315f-41e7-b80d-4fac6bd7eff9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:08.504962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-292547a1-315f-41e7-b80d-4fac6bd7eff9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:08.505432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-292547a1-315f-41e7-b80d-4fac6bd7eff9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:08.507200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-292547a1-315f-41e7-b80d-4fac6bd7eff9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:08.508484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-292547a1-315f-41e7-b80d-4fac6bd7eff9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:08.589684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-292547a1-315f-41e7-b80d-4fac6bd7eff9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:08.601366 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-292547a1-315f-41e7-b80d-4fac6bd7eff9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1269 microversion: 2.1 time: 0.122913 Jan 22 21:04:08.602404 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 669/1299] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:08 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1269 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:08.687721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8d082627-0480-4036-8fb5-ecab7adb83b1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:08.700943 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8d082627-0480-4036-8fb5-ecab7adb83b1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.324970 Jan 22 21:04:08.701562 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 631/1300] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:08 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:08.728983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-01dca784-0372-4868-8d07-3674c9b434ab tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5dc90d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:08.785017 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-01dca784-0372-4868-8d07-3674c9b434ab tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1444 microversion: 2.1 time: 0.060553 Jan 22 21:04:08.791035 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 670/1301] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:08 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1444 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:09.162877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-16233471-1d88-4c15-8326-ea2a4a30021e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:09.171154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-16233471-1d88-4c15-8326-ea2a4a30021e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:09.178839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16233471-1d88-4c15-8326-ea2a4a30021e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:09.180283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16233471-1d88-4c15-8326-ea2a4a30021e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:09.181238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16233471-1d88-4c15-8326-ea2a4a30021e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:09.182260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16233471-1d88-4c15-8326-ea2a4a30021e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:09.253458 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-16233471-1d88-4c15-8326-ea2a4a30021e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.095649 Jan 22 21:04:09.254289 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 632/1302] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:09 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:09.365628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c5c4cc8b-fa0d-49a8-83bd-d52e6421c772 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:09.366639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c5c4cc8b-fa0d-49a8-83bd-d52e6421c772 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:09.374666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5c4cc8b-fa0d-49a8-83bd-d52e6421c772 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:09.375138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5c4cc8b-fa0d-49a8-83bd-d52e6421c772 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:09.375973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5c4cc8b-fa0d-49a8-83bd-d52e6421c772 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:09.376421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5c4cc8b-fa0d-49a8-83bd-d52e6421c772 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:09.422579 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c5c4cc8b-fa0d-49a8-83bd-d52e6421c772 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.061421 Jan 22 21:04:09.426832 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 671/1303] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:09 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:09.619360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-91aeb3c6-0559-42c2-9610-d699f4bbbcec tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:09.620073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-91aeb3c6-0559-42c2-9610-d699f4bbbcec tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:09.629271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91aeb3c6-0559-42c2-9610-d699f4bbbcec tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:09.629976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91aeb3c6-0559-42c2-9610-d699f4bbbcec tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:09.630835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91aeb3c6-0559-42c2-9610-d699f4bbbcec tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:09.631309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91aeb3c6-0559-42c2-9610-d699f4bbbcec tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:09.718730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-04c6b959-808b-42c4-8e2e-55a4b80d568f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:09.720630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-04c6b959-808b-42c4-8e2e-55a4b80d568f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:09.723847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-91aeb3c6-0559-42c2-9610-d699f4bbbcec tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:09.732252 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-91aeb3c6-0559-42c2-9610-d699f4bbbcec tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1275 microversion: 2.1 time: 0.117323 Jan 22 21:04:09.737575 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 633/1304] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:09 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1275 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:09.737885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8fcce353-8cf9-4e78-816c-765cfdaaeb96 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:09.738761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8fcce353-8cf9-4e78-816c-765cfdaaeb96 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:09.745310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fcce353-8cf9-4e78-816c-765cfdaaeb96 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:09.747761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fcce353-8cf9-4e78-816c-765cfdaaeb96 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:09.747761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fcce353-8cf9-4e78-816c-765cfdaaeb96 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:09.747761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fcce353-8cf9-4e78-816c-765cfdaaeb96 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:09.753957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04c6b959-808b-42c4-8e2e-55a4b80d568f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:09.755467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04c6b959-808b-42c4-8e2e-55a4b80d568f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:09.758747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04c6b959-808b-42c4-8e2e-55a4b80d568f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:09.762145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04c6b959-808b-42c4-8e2e-55a4b80d568f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:09.811308 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8fcce353-8cf9-4e78-816c-765cfdaaeb96 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 14 microversion: 2.1 time: 0.064637 Jan 22 21:04:09.811308 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 634/1305] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:09 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:04:09.811308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-752985ce-fc21-415f-aafc-7d0ca54a9e33 req-88310ba9-16af-41e0-823c-fd1c42a07309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ab8dcc-d072-4e68-af27-2b4614db4cc2", "tag": "a4acdedb-d82e-4307-87e1-a851a52f7726"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:09.811308 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:09.811308 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:09.819323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-752985ce-fc21-415f-aafc-7d0ca54a9e33 req-88310ba9-16af-41e0-823c-fd1c42a07309 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:09.819832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-752985ce-fc21-415f-aafc-7d0ca54a9e33 req-88310ba9-16af-41e0-823c-fd1c42a07309 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:09.847285 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-752985ce-fc21-415f-aafc-7d0ca54a9e33 req-88310ba9-16af-41e0-823c-fd1c42a07309 service nova] Creating event network-changed:a4acdedb-d82e-4307-87e1-a851a52f7726 for instance 49ab8dcc-d072-4e68-af27-2b4614db4cc2 on nch2-master-1 Jan 22 21:04:09.853627 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-752985ce-fc21-415f-aafc-7d0ca54a9e33 req-88310ba9-16af-41e0-823c-fd1c42a07309 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051775 Jan 22 21:04:09.854518 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 635/1306] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:09.866412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6f573c17-e0cc-4d51-86de-38a54855849b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5de5a60>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:09.935818 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6f573c17-e0cc-4d51-86de-38a54855849b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1444 microversion: 2.1 time: 0.077156 Jan 22 21:04:09.935818 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 636/1307] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:09 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1444 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:09.985378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-04c6b959-808b-42c4-8e2e-55a4b80d568f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:09.994096 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-04c6b959-808b-42c4-8e2e-55a4b80d568f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.279478 Jan 22 21:04:09.995101 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 672/1308] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:09 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:10.269451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-95f97ab4-f362-4f7b-890b-2af99342fdd7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:10.271364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-95f97ab4-f362-4f7b-890b-2af99342fdd7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:10.291304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95f97ab4-f362-4f7b-890b-2af99342fdd7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:10.291915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95f97ab4-f362-4f7b-890b-2af99342fdd7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:10.303684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95f97ab4-f362-4f7b-890b-2af99342fdd7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:10.303684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95f97ab4-f362-4f7b-890b-2af99342fdd7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:10.364078 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-95f97ab4-f362-4f7b-890b-2af99342fdd7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.101940 Jan 22 21:04:10.371352 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 637/1309] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:10 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:10.442839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9526d8a1-16e1-4fd6-9e0d-82c1e3856699 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:10.444542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9526d8a1-16e1-4fd6-9e0d-82c1e3856699 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:10.454489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9526d8a1-16e1-4fd6-9e0d-82c1e3856699 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:10.454950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9526d8a1-16e1-4fd6-9e0d-82c1e3856699 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:10.455759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9526d8a1-16e1-4fd6-9e0d-82c1e3856699 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:10.460042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9526d8a1-16e1-4fd6-9e0d-82c1e3856699 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:10.549303 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9526d8a1-16e1-4fd6-9e0d-82c1e3856699 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.118199 Jan 22 21:04:10.550747 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 673/1310] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:10 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:10.750175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab5b2353-cb5e-4526-a60a-f50fb2465249 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:10.750865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab5b2353-cb5e-4526-a60a-f50fb2465249 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:10.764649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab5b2353-cb5e-4526-a60a-f50fb2465249 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:10.765386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab5b2353-cb5e-4526-a60a-f50fb2465249 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:10.766460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab5b2353-cb5e-4526-a60a-f50fb2465249 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:10.767056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab5b2353-cb5e-4526-a60a-f50fb2465249 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:10.826162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cc16bd41-2578-430d-b6fd-7eb07832ac54 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:10.828923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cc16bd41-2578-430d-b6fd-7eb07832ac54 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:10.847761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc16bd41-2578-430d-b6fd-7eb07832ac54 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:10.849091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc16bd41-2578-430d-b6fd-7eb07832ac54 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:10.853555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc16bd41-2578-430d-b6fd-7eb07832ac54 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:10.853898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc16bd41-2578-430d-b6fd-7eb07832ac54 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:10.911150 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cc16bd41-2578-430d-b6fd-7eb07832ac54 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 14 microversion: 2.1 time: 0.103235 Jan 22 21:04:10.912527 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 674/1311] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:10 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:04:10.952261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-62054d19-77fb-47d6-9d70-7a595d9c9a66 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5d41940>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:11.041735 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-62054d19-77fb-47d6-9d70-7a595d9c9a66 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1444 microversion: 2.1 time: 0.098464 Jan 22 21:04:11.042518 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 675/1312] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:10 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:11.051435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c9f648af-5d45-4861-a3a6-7a41379ab08e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:11.053485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c9f648af-5d45-4861-a3a6-7a41379ab08e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:11.065559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9f648af-5d45-4861-a3a6-7a41379ab08e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:11.066299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9f648af-5d45-4861-a3a6-7a41379ab08e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:11.067285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9f648af-5d45-4861-a3a6-7a41379ab08e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:11.068383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9f648af-5d45-4861-a3a6-7a41379ab08e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:11.150865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab5b2353-cb5e-4526-a60a-f50fb2465249 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:11.162307 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab5b2353-cb5e-4526-a60a-f50fb2465249 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1317 microversion: 2.1 time: 0.417639 Jan 22 21:04:11.165204 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 638/1313] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:10 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:11.329575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c9f648af-5d45-4861-a3a6-7a41379ab08e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:11.341830 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c9f648af-5d45-4861-a3a6-7a41379ab08e tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.295638 Jan 22 21:04:11.343229 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 676/1314] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:11 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:11.404163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c180a639-1c54-4d12-9016-a94af461d96c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:11.404489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c180a639-1c54-4d12-9016-a94af461d96c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:11.430495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c180a639-1c54-4d12-9016-a94af461d96c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:11.431127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c180a639-1c54-4d12-9016-a94af461d96c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:11.435190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c180a639-1c54-4d12-9016-a94af461d96c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:11.435752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c180a639-1c54-4d12-9016-a94af461d96c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:11.506529 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c180a639-1c54-4d12-9016-a94af461d96c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.123671 Jan 22 21:04:11.508403 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 639/1315] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:11 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:11.566401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-842a97f8-41ad-405b-8971-f369c30e785b tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:11.567029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-842a97f8-41ad-405b-8971-f369c30e785b tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:11.574487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-842a97f8-41ad-405b-8971-f369c30e785b tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:11.575317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-842a97f8-41ad-405b-8971-f369c30e785b tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:11.576275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-842a97f8-41ad-405b-8971-f369c30e785b tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:11.576869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-842a97f8-41ad-405b-8971-f369c30e785b tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:11.642466 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-842a97f8-41ad-405b-8971-f369c30e785b tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.082471 Jan 22 21:04:11.643944 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 677/1316] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:11 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:11.924050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-413b7ae1-8ff2-4c55-af61-d918c088e30f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:11.925097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-413b7ae1-8ff2-4c55-af61-d918c088e30f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:11.940746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-413b7ae1-8ff2-4c55-af61-d918c088e30f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:11.943346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-413b7ae1-8ff2-4c55-af61-d918c088e30f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:11.945605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-413b7ae1-8ff2-4c55-af61-d918c088e30f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:11.946337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-413b7ae1-8ff2-4c55-af61-d918c088e30f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:12.021119 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-413b7ae1-8ff2-4c55-af61-d918c088e30f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 14 microversion: 2.1 time: 0.101765 Jan 22 21:04:12.024806 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 640/1317] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:11 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:04:12.057108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5a484fe2-d251-4b8e-8bf3-dc431bde5f15 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5dcd0d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:12.125385 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5a484fe2-d251-4b8e-8bf3-dc431bde5f15 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1444 microversion: 2.1 time: 0.072475 Jan 22 21:04:12.126432 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 678/1318] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:12 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1444 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:12.190021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-73284f02-f788-4d0e-9b5d-662321da2974 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:12.190736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-73284f02-f788-4d0e-9b5d-662321da2974 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:12.201704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73284f02-f788-4d0e-9b5d-662321da2974 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:12.202164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73284f02-f788-4d0e-9b5d-662321da2974 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:12.202974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73284f02-f788-4d0e-9b5d-662321da2974 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:12.203591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73284f02-f788-4d0e-9b5d-662321da2974 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:12.361607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-578fc9e9-58b0-4ef5-8bed-5903cc8f5895 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:12.362574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-578fc9e9-58b0-4ef5-8bed-5903cc8f5895 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:12.382102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-578fc9e9-58b0-4ef5-8bed-5903cc8f5895 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:12.382102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-578fc9e9-58b0-4ef5-8bed-5903cc8f5895 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:12.382814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-578fc9e9-58b0-4ef5-8bed-5903cc8f5895 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:12.383267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-578fc9e9-58b0-4ef5-8bed-5903cc8f5895 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:12.464475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-73284f02-f788-4d0e-9b5d-662321da2974 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:12.477012 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-73284f02-f788-4d0e-9b5d-662321da2974 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1317 microversion: 2.1 time: 0.291113 Jan 22 21:04:12.480743 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 641/1319] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:12 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:12.495369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-cfa9bdc1-a1fd-4a04-bd49-af4a52bf2017 req-3b9c0e92-5ca2-4cbe-93c2-515fd759dd94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8199f0ad-6b37-46ca-829a-cee02b1eaf83", "tag": "b15e2fda-9cee-4a6c-9e04-adc83b8e3620"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:12.511821 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:12.511821 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:12.527541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-cfa9bdc1-a1fd-4a04-bd49-af4a52bf2017 req-3b9c0e92-5ca2-4cbe-93c2-515fd759dd94 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:12.529296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-cfa9bdc1-a1fd-4a04-bd49-af4a52bf2017 req-3b9c0e92-5ca2-4cbe-93c2-515fd759dd94 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:12.543117 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-cfa9bdc1-a1fd-4a04-bd49-af4a52bf2017 req-3b9c0e92-5ca2-4cbe-93c2-515fd759dd94 service nova] Creating event network-changed:b15e2fda-9cee-4a6c-9e04-adc83b8e3620 for instance 8199f0ad-6b37-46ca-829a-cee02b1eaf83 on nch1-master-1 Jan 22 21:04:12.554117 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-cfa9bdc1-a1fd-4a04-bd49-af4a52bf2017 req-3b9c0e92-5ca2-4cbe-93c2-515fd759dd94 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069904 Jan 22 21:04:12.554743 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 642/1320] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:12.560666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cf6a2feb-76be-43ca-9017-e4c16f71ea0e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:12.561778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cf6a2feb-76be-43ca-9017-e4c16f71ea0e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:12.570662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf6a2feb-76be-43ca-9017-e4c16f71ea0e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:12.570662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf6a2feb-76be-43ca-9017-e4c16f71ea0e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:12.570662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf6a2feb-76be-43ca-9017-e4c16f71ea0e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:12.571233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf6a2feb-76be-43ca-9017-e4c16f71ea0e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:12.620489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-578fc9e9-58b0-4ef5-8bed-5903cc8f5895 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:12.621455 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cf6a2feb-76be-43ca-9017-e4c16f71ea0e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.065256 Jan 22 21:04:12.623087 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 643/1321] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:12 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:12.632438 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-578fc9e9-58b0-4ef5-8bed-5903cc8f5895 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.273858 Jan 22 21:04:12.634279 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 679/1322] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:12 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:12.655985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cb518398-66c3-4fc2-bd8a-e232fd8f9526 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:12.657012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cb518398-66c3-4fc2-bd8a-e232fd8f9526 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:12.665286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb518398-66c3-4fc2-bd8a-e232fd8f9526 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:12.665931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb518398-66c3-4fc2-bd8a-e232fd8f9526 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:12.666853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb518398-66c3-4fc2-bd8a-e232fd8f9526 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:12.667410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb518398-66c3-4fc2-bd8a-e232fd8f9526 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:12.724449 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cb518398-66c3-4fc2-bd8a-e232fd8f9526 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.073746 Jan 22 21:04:12.729042 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 644/1323] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:12 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:13.035325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7591ffd0-0bec-4592-8f88-5b20a0db66ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:13.036585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7591ffd0-0bec-4592-8f88-5b20a0db66ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:13.043348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7591ffd0-0bec-4592-8f88-5b20a0db66ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:13.043845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7591ffd0-0bec-4592-8f88-5b20a0db66ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:13.044796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7591ffd0-0bec-4592-8f88-5b20a0db66ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:13.045237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7591ffd0-0bec-4592-8f88-5b20a0db66ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:13.100382 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7591ffd0-0bec-4592-8f88-5b20a0db66ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 14 microversion: 2.1 time: 0.071703 Jan 22 21:04:13.115852 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 680/1324] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:13 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:04:13.140464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-260d75e3-d2bf-4191-8c75-0010aff56491 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed60f9280>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:13.194684 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-260d75e3-d2bf-4191-8c75-0010aff56491 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1444 microversion: 2.1 time: 0.059269 Jan 22 21:04:13.196562 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 645/1325] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:13 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1444 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:13.497071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab56cc92-8709-489d-a968-b04b28376f5e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:13.498016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ab56cc92-8709-489d-a968-b04b28376f5e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:13.505655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab56cc92-8709-489d-a968-b04b28376f5e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:13.506375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab56cc92-8709-489d-a968-b04b28376f5e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:13.507599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab56cc92-8709-489d-a968-b04b28376f5e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:13.508398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab56cc92-8709-489d-a968-b04b28376f5e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:13.634366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2e27ff4e-1bba-479e-a7ea-5b1b27a6b4e1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:13.635850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2e27ff4e-1bba-479e-a7ea-5b1b27a6b4e1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:13.650786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e27ff4e-1bba-479e-a7ea-5b1b27a6b4e1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:13.664008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e27ff4e-1bba-479e-a7ea-5b1b27a6b4e1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:13.664008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e27ff4e-1bba-479e-a7ea-5b1b27a6b4e1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:13.664008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e27ff4e-1bba-479e-a7ea-5b1b27a6b4e1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:13.717367 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2e27ff4e-1bba-479e-a7ea-5b1b27a6b4e1 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.086505 Jan 22 21:04:13.728201 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 646/1326] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:13 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:13.728201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9d49e8dc-9e1a-4b2e-b615-e8562186cddc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:13.728785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ab56cc92-8709-489d-a968-b04b28376f5e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:13.733985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9d49e8dc-9e1a-4b2e-b615-e8562186cddc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:13.743880 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab56cc92-8709-489d-a968-b04b28376f5e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1317 microversion: 2.1 time: 0.252112 Jan 22 21:04:13.748068 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 681/1327] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:13 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:13.754556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d49e8dc-9e1a-4b2e-b615-e8562186cddc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:13.758095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d49e8dc-9e1a-4b2e-b615-e8562186cddc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:13.759417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d49e8dc-9e1a-4b2e-b615-e8562186cddc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:13.760105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e5494c57-5685-4296-8447-cf26c50bae1e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:13.761352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e5494c57-5685-4296-8447-cf26c50bae1e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:13.762624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d49e8dc-9e1a-4b2e-b615-e8562186cddc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:13.776145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5494c57-5685-4296-8447-cf26c50bae1e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:13.778688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5494c57-5685-4296-8447-cf26c50bae1e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:13.779518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5494c57-5685-4296-8447-cf26c50bae1e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:13.780165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5494c57-5685-4296-8447-cf26c50bae1e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:13.834446 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e5494c57-5685-4296-8447-cf26c50bae1e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.084544 Jan 22 21:04:13.835587 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 682/1328] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:13 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:13.952631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9d49e8dc-9e1a-4b2e-b615-e8562186cddc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:13.959632 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9d49e8dc-9e1a-4b2e-b615-e8562186cddc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.239725 Jan 22 21:04:13.960201 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 647/1329] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:13 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:14.124018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08941694-f4eb-4a80-86d4-98f720fe343d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:14.125021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-08941694-f4eb-4a80-86d4-98f720fe343d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:14.133979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08941694-f4eb-4a80-86d4-98f720fe343d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:14.136966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08941694-f4eb-4a80-86d4-98f720fe343d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:14.144221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08941694-f4eb-4a80-86d4-98f720fe343d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:14.144908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08941694-f4eb-4a80-86d4-98f720fe343d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:14.191881 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-08941694-f4eb-4a80-86d4-98f720fe343d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 14 microversion: 2.1 time: 0.072501 Jan 22 21:04:14.192608 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 683/1330] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:14 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:04:14.208523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-017badef-033c-4c95-805e-3a6dde7c9766 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5fe01f0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:14.271348 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-017badef-033c-4c95-805e-3a6dde7c9766 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1444 microversion: 2.1 time: 0.067045 Jan 22 21:04:14.272434 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 648/1331] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:14 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1444 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:14.728870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8190bc1c-db27-4e8d-84d3-ebc5a0a9b134 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:14.730408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8190bc1c-db27-4e8d-84d3-ebc5a0a9b134 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:14.741687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8190bc1c-db27-4e8d-84d3-ebc5a0a9b134 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:14.742523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8190bc1c-db27-4e8d-84d3-ebc5a0a9b134 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:14.743567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8190bc1c-db27-4e8d-84d3-ebc5a0a9b134 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:14.744010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8190bc1c-db27-4e8d-84d3-ebc5a0a9b134 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:14.765196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-da6f67e0-4b79-4577-974a-c10bcf065fdf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:14.766269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-da6f67e0-4b79-4577-974a-c10bcf065fdf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:14.777391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da6f67e0-4b79-4577-974a-c10bcf065fdf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:14.778524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da6f67e0-4b79-4577-974a-c10bcf065fdf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:14.780130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da6f67e0-4b79-4577-974a-c10bcf065fdf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:14.782045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da6f67e0-4b79-4577-974a-c10bcf065fdf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:14.795098 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8190bc1c-db27-4e8d-84d3-ebc5a0a9b134 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.070114 Jan 22 21:04:14.796445 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 684/1332] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:14 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:14.850746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dfb0898e-762e-4b9e-8673-6c735278614a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:14.851689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dfb0898e-762e-4b9e-8673-6c735278614a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:14.861249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfb0898e-762e-4b9e-8673-6c735278614a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:14.862026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfb0898e-762e-4b9e-8673-6c735278614a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:14.865329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfb0898e-762e-4b9e-8673-6c735278614a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:14.865329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfb0898e-762e-4b9e-8673-6c735278614a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:14.920761 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dfb0898e-762e-4b9e-8673-6c735278614a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.069676 Jan 22 21:04:14.925801 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 685/1333] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:14 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:14.952282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-da6f67e0-4b79-4577-974a-c10bcf065fdf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:14.966529 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-da6f67e0-4b79-4577-974a-c10bcf065fdf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1317 microversion: 2.1 time: 0.204996 Jan 22 21:04:14.978427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-be05d166-b8c2-4fcd-9cc5-741fc04b9118 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:14.980134 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 649/1334] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:14 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:14.980257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-be05d166-b8c2-4fcd-9cc5-741fc04b9118 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:14.988021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be05d166-b8c2-4fcd-9cc5-741fc04b9118 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:14.988640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be05d166-b8c2-4fcd-9cc5-741fc04b9118 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:14.989574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be05d166-b8c2-4fcd-9cc5-741fc04b9118 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:14.990114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be05d166-b8c2-4fcd-9cc5-741fc04b9118 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:15.147040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-be05d166-b8c2-4fcd-9cc5-741fc04b9118 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:15.155997 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-be05d166-b8c2-4fcd-9cc5-741fc04b9118 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.181880 Jan 22 21:04:15.158265 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 686/1335] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:14 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:15.203954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ffdf63f5-2e56-433a-960e-705bf83c86c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:15.205483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ffdf63f5-2e56-433a-960e-705bf83c86c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:15.212382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffdf63f5-2e56-433a-960e-705bf83c86c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:15.213042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffdf63f5-2e56-433a-960e-705bf83c86c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:15.213720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffdf63f5-2e56-433a-960e-705bf83c86c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:15.214171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffdf63f5-2e56-433a-960e-705bf83c86c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:15.257268 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ffdf63f5-2e56-433a-960e-705bf83c86c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 14 microversion: 2.1 time: 0.057770 Jan 22 21:04:15.260893 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 650/1336] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:15 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:04:15.292728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-45d572a3-8cb5-4e65-953a-8743955b2276 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5d22af0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:15.356736 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-45d572a3-8cb5-4e65-953a-8743955b2276 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1444 microversion: 2.1 time: 0.075026 Jan 22 21:04:15.361660 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 687/1337] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:15 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1444 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:15.813087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-52a80acb-9f90-4e65-bbe7-fa40b3b4e8b5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:15.813721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-52a80acb-9f90-4e65-bbe7-fa40b3b4e8b5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:15.824558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52a80acb-9f90-4e65-bbe7-fa40b3b4e8b5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:15.825897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52a80acb-9f90-4e65-bbe7-fa40b3b4e8b5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:15.826758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52a80acb-9f90-4e65-bbe7-fa40b3b4e8b5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:15.827254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52a80acb-9f90-4e65-bbe7-fa40b3b4e8b5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:15.873446 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-52a80acb-9f90-4e65-bbe7-fa40b3b4e8b5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.067236 Jan 22 21:04:15.873446 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 651/1338] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:15 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:15.933122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6203e972-e628-4bd3-a199-61ea03546de4 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:15.934050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6203e972-e628-4bd3-a199-61ea03546de4 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:15.941235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6203e972-e628-4bd3-a199-61ea03546de4 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:15.941950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6203e972-e628-4bd3-a199-61ea03546de4 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:15.942750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6203e972-e628-4bd3-a199-61ea03546de4 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:15.943191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6203e972-e628-4bd3-a199-61ea03546de4 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:15.988468 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6203e972-e628-4bd3-a199-61ea03546de4 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.058733 Jan 22 21:04:15.988979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aaf84152-51b8-4fcd-a043-f965f2231b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:15.989840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aaf84152-51b8-4fcd-a043-f965f2231b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:15.993901 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 688/1339] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:15 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:15.998489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aaf84152-51b8-4fcd-a043-f965f2231b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:15.999069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aaf84152-51b8-4fcd-a043-f965f2231b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:15.999988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aaf84152-51b8-4fcd-a043-f965f2231b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:16.000569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aaf84152-51b8-4fcd-a043-f965f2231b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:16.173733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-aaf84152-51b8-4fcd-a043-f965f2231b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:16.176197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a6031ba-d0a2-4d6a-8dab-fc2623e416c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:16.177009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a6031ba-d0a2-4d6a-8dab-fc2623e416c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:16.187182 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aaf84152-51b8-4fcd-a043-f965f2231b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1317 microversion: 2.1 time: 0.203989 Jan 22 21:04:16.188032 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 652/1340] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:15 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:16.199493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a6031ba-d0a2-4d6a-8dab-fc2623e416c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:16.277651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a6031ba-d0a2-4d6a-8dab-fc2623e416c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:16.277651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a6031ba-d0a2-4d6a-8dab-fc2623e416c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:16.277651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a6031ba-d0a2-4d6a-8dab-fc2623e416c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:16.278024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ef8331ea-21c1-4f51-a13b-be22d7785536 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:16.278024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ef8331ea-21c1-4f51-a13b-be22d7785536 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:16.286397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef8331ea-21c1-4f51-a13b-be22d7785536 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:16.286649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef8331ea-21c1-4f51-a13b-be22d7785536 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:16.318531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef8331ea-21c1-4f51-a13b-be22d7785536 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:16.318531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef8331ea-21c1-4f51-a13b-be22d7785536 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:16.424770 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ef8331ea-21c1-4f51-a13b-be22d7785536 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 14 microversion: 2.1 time: 0.158815 Jan 22 21:04:16.429233 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 653/1341] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:16 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:04:16.433614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6a6031ba-d0a2-4d6a-8dab-fc2623e416c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:16.460375 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a6031ba-d0a2-4d6a-8dab-fc2623e416c7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.274998 Jan 22 21:04:16.460375 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 689/1342] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:16 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:16.464373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24600aed-61df-446d-92ee-a0e39b81d850 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5e68b80>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:16.535830 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-24600aed-61df-446d-92ee-a0e39b81d850 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1444 microversion: 2.1 time: 0.091635 Jan 22 21:04:16.536433 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 654/1343] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:16 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:16.883661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-07366f1e-807e-4f44-a052-9686b807e0e7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:16.884757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-07366f1e-807e-4f44-a052-9686b807e0e7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:16.891805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07366f1e-807e-4f44-a052-9686b807e0e7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:16.892260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07366f1e-807e-4f44-a052-9686b807e0e7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:16.893051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07366f1e-807e-4f44-a052-9686b807e0e7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:16.893495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07366f1e-807e-4f44-a052-9686b807e0e7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:16.938617 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-07366f1e-807e-4f44-a052-9686b807e0e7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.058526 Jan 22 21:04:16.939336 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 690/1344] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:16 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:17.010049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-36274db2-640f-47e7-9552-2f7e1685f767 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:17.010049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-36274db2-640f-47e7-9552-2f7e1685f767 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:17.010049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36274db2-640f-47e7-9552-2f7e1685f767 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:17.010464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36274db2-640f-47e7-9552-2f7e1685f767 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:17.010967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36274db2-640f-47e7-9552-2f7e1685f767 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:17.011405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36274db2-640f-47e7-9552-2f7e1685f767 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:17.058502 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-36274db2-640f-47e7-9552-2f7e1685f767 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.061400 Jan 22 21:04:17.059772 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 655/1345] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:16 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:17.213837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-526c7047-a3c3-4b5f-8eb7-bc07c81052c5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:17.215123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-526c7047-a3c3-4b5f-8eb7-bc07c81052c5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:17.225208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-526c7047-a3c3-4b5f-8eb7-bc07c81052c5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:17.226014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-526c7047-a3c3-4b5f-8eb7-bc07c81052c5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:17.226893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-526c7047-a3c3-4b5f-8eb7-bc07c81052c5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:17.227970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-526c7047-a3c3-4b5f-8eb7-bc07c81052c5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:17.422836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-526c7047-a3c3-4b5f-8eb7-bc07c81052c5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:17.433801 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-526c7047-a3c3-4b5f-8eb7-bc07c81052c5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1317 microversion: 2.1 time: 0.224487 Jan 22 21:04:17.443726 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 691/1346] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:17 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:17.443924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-16525382-d5f4-4f46-854c-5db2e329a7ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:17.443924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-16525382-d5f4-4f46-854c-5db2e329a7ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:17.445473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16525382-d5f4-4f46-854c-5db2e329a7ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:17.445930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16525382-d5f4-4f46-854c-5db2e329a7ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:17.446723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16525382-d5f4-4f46-854c-5db2e329a7ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:17.447302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16525382-d5f4-4f46-854c-5db2e329a7ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:17.468954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a8869b7f-638d-4b53-9af3-97a5a90eda17 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:17.469479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a8869b7f-638d-4b53-9af3-97a5a90eda17 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:17.475563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8869b7f-638d-4b53-9af3-97a5a90eda17 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:17.476156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8869b7f-638d-4b53-9af3-97a5a90eda17 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:17.477075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8869b7f-638d-4b53-9af3-97a5a90eda17 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:17.477675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8869b7f-638d-4b53-9af3-97a5a90eda17 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:17.504770 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-16525382-d5f4-4f46-854c-5db2e329a7ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 14 microversion: 2.1 time: 0.070006 Jan 22 21:04:17.506745 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 656/1347] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:17 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:04:17.550802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7e22bd0c-9c1f-4724-83c1-f93c7d320db1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5de34c0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:17.618882 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7e22bd0c-9c1f-4724-83c1-f93c7d320db1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1444 microversion: 2.1 time: 0.071852 Jan 22 21:04:17.625365 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 657/1348] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:17 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1444 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:17.659351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a8869b7f-638d-4b53-9af3-97a5a90eda17 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:17.668106 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a8869b7f-638d-4b53-9af3-97a5a90eda17 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.204222 Jan 22 21:04:17.674996 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 692/1349] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:17 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:17.950807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-30376c06-64c0-42d1-b355-e8a3bbb09177 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:17.951839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-30376c06-64c0-42d1-b355-e8a3bbb09177 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:17.958162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30376c06-64c0-42d1-b355-e8a3bbb09177 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:17.958619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30376c06-64c0-42d1-b355-e8a3bbb09177 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:17.959405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30376c06-64c0-42d1-b355-e8a3bbb09177 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:17.959852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30376c06-64c0-42d1-b355-e8a3bbb09177 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:18.005672 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-30376c06-64c0-42d1-b355-e8a3bbb09177 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.059207 Jan 22 21:04:18.006289 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 658/1350] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:17 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:18.071057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3ac23621-c7a9-41b3-8ab8-292963d60736 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:18.072012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3ac23621-c7a9-41b3-8ab8-292963d60736 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:18.079011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ac23621-c7a9-41b3-8ab8-292963d60736 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:18.079471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ac23621-c7a9-41b3-8ab8-292963d60736 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:18.080258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ac23621-c7a9-41b3-8ab8-292963d60736 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:18.081644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ac23621-c7a9-41b3-8ab8-292963d60736 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:18.121029 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3ac23621-c7a9-41b3-8ab8-292963d60736 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.053574 Jan 22 21:04:18.121802 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 693/1351] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:18 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:18.451874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-99a52b9f-7b38-4768-ac68-9f82cddc0a96 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:18.452507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-99a52b9f-7b38-4768-ac68-9f82cddc0a96 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:18.459557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99a52b9f-7b38-4768-ac68-9f82cddc0a96 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:18.460015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99a52b9f-7b38-4768-ac68-9f82cddc0a96 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:18.460803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99a52b9f-7b38-4768-ac68-9f82cddc0a96 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:18.461251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99a52b9f-7b38-4768-ac68-9f82cddc0a96 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:18.516467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dd29af1a-9344-4a43-af55-fed7c5e77f49 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:18.517635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dd29af1a-9344-4a43-af55-fed7c5e77f49 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:18.524651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd29af1a-9344-4a43-af55-fed7c5e77f49 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:18.525115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd29af1a-9344-4a43-af55-fed7c5e77f49 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:18.526040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd29af1a-9344-4a43-af55-fed7c5e77f49 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:18.526388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd29af1a-9344-4a43-af55-fed7c5e77f49 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:18.564892 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dd29af1a-9344-4a43-af55-fed7c5e77f49 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 14 microversion: 2.1 time: 0.052219 Jan 22 21:04:18.568275 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 694/1352] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:18 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:04:18.601495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-99a52b9f-7b38-4768-ac68-9f82cddc0a96 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:18.610379 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-99a52b9f-7b38-4768-ac68-9f82cddc0a96 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1317 microversion: 2.1 time: 0.162955 Jan 22 21:04:18.610939 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 659/1353] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:18 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:18.632675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74884e59-d5a9-4e29-a208-c062a24314b7 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5dc9280>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:18.680757 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-74884e59-d5a9-4e29-a208-c062a24314b7 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1453 microversion: 2.1 time: 0.052341 Jan 22 21:04:18.681318 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 695/1354] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:18 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1453 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:18.687307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f425fa23-81d1-4c4c-bd39-67bcf4fa7b3d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:18.687920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f425fa23-81d1-4c4c-bd39-67bcf4fa7b3d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:18.693106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6e12afb2-46d9-444b-8b67-6b5a7d9c8383 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5d103a0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:18.694106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f425fa23-81d1-4c4c-bd39-67bcf4fa7b3d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:18.694565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f425fa23-81d1-4c4c-bd39-67bcf4fa7b3d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:18.695846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f425fa23-81d1-4c4c-bd39-67bcf4fa7b3d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:18.695846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f425fa23-81d1-4c4c-bd39-67bcf4fa7b3d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:18.739774 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6e12afb2-46d9-444b-8b67-6b5a7d9c8383 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 200 len: 1453 microversion: 2.1 time: 0.050361 Jan 22 21:04:18.740430 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 696/1355] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:18 2022] GET /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 1453 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:18.752660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-197e5ab1-3425-4218-a18d-7cab0023f2d5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5dc4310>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:18.847238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f425fa23-81d1-4c4c-bd39-67bcf4fa7b3d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:18.855467 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f425fa23-81d1-4c4c-bd39-67bcf4fa7b3d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.172526 Jan 22 21:04:18.856363 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 660/1356] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:18 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:19.017475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b588cd29-bac3-4edf-8da8-7ae417043eb8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:19.018504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b588cd29-bac3-4edf-8da8-7ae417043eb8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:19.025288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b588cd29-bac3-4edf-8da8-7ae417043eb8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:19.025783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b588cd29-bac3-4edf-8da8-7ae417043eb8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:19.028931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b588cd29-bac3-4edf-8da8-7ae417043eb8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:19.028931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b588cd29-bac3-4edf-8da8-7ae417043eb8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:19.070462 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b588cd29-bac3-4edf-8da8-7ae417043eb8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.056548 Jan 22 21:04:19.071107 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 661/1357] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:19 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:19.133156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c2cabcf6-ba2a-4056-a0c9-f8b4e25cc1a2 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:19.134182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c2cabcf6-ba2a-4056-a0c9-f8b4e25cc1a2 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:19.142326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2cabcf6-ba2a-4056-a0c9-f8b4e25cc1a2 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:19.142792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2cabcf6-ba2a-4056-a0c9-f8b4e25cc1a2 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:19.143597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2cabcf6-ba2a-4056-a0c9-f8b4e25cc1a2 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:19.144052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2cabcf6-ba2a-4056-a0c9-f8b4e25cc1a2 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:19.190148 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c2cabcf6-ba2a-4056-a0c9-f8b4e25cc1a2 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.060696 Jan 22 21:04:19.190938 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 662/1358] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:19 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:19.334759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-76a93bcb-73b3-4751-b78f-871476f6ad80 req-0a234479-3b57-48d8-872e-bae6b7ba64d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8199f0ad-6b37-46ca-829a-cee02b1eaf83", "name": "network-vif-plugged", "status": "completed", "tag": "b15e2fda-9cee-4a6c-9e04-adc83b8e3620"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:19.336462 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:19.336462 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:19.346182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-76a93bcb-73b3-4751-b78f-871476f6ad80 req-0a234479-3b57-48d8-872e-bae6b7ba64d7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:19.348989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-76a93bcb-73b3-4751-b78f-871476f6ad80 req-0a234479-3b57-48d8-872e-bae6b7ba64d7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:19.358131 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-76a93bcb-73b3-4751-b78f-871476f6ad80 req-0a234479-3b57-48d8-872e-bae6b7ba64d7 service nova] Creating event network-vif-plugged:b15e2fda-9cee-4a6c-9e04-adc83b8e3620 for instance 8199f0ad-6b37-46ca-829a-cee02b1eaf83 on nch1-master-1 Jan 22 21:04:19.362720 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-76a93bcb-73b3-4751-b78f-871476f6ad80 req-0a234479-3b57-48d8-872e-bae6b7ba64d7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032047 Jan 22 21:04:19.363301 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 663/1359] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:19.578026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24a984ce-0a71-4c6e-80cb-a21e896488be tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:19.578964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-24a984ce-0a71-4c6e-80cb-a21e896488be tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:19.585366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a984ce-0a71-4c6e-80cb-a21e896488be tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:19.585864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a984ce-0a71-4c6e-80cb-a21e896488be tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:19.586708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a984ce-0a71-4c6e-80cb-a21e896488be tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:19.587102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a984ce-0a71-4c6e-80cb-a21e896488be tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:19.652037 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-24a984ce-0a71-4c6e-80cb-a21e896488be tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 8206 microversion: 2.1 time: 0.079285 Jan 22 21:04:19.652693 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 664/1360] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:19 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 8206 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:19.657523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2a17614e-f3a8-494c-9693-c1f3dace9a67 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:19.658219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2a17614e-f3a8-494c-9693-c1f3dace9a67 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:19.665009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a17614e-f3a8-494c-9693-c1f3dace9a67 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:19.665457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a17614e-f3a8-494c-9693-c1f3dace9a67 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:19.666267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a17614e-f3a8-494c-9693-c1f3dace9a67 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:19.666737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a17614e-f3a8-494c-9693-c1f3dace9a67 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:19.800819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2a17614e-f3a8-494c-9693-c1f3dace9a67 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:19.810534 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2a17614e-f3a8-494c-9693-c1f3dace9a67 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1317 microversion: 2.1 time: 0.156606 Jan 22 21:04:19.811126 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 665/1361] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:19 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:19.872959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5e9a0d0e-5483-4e3f-9272-12a18eca45bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:19.873602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5e9a0d0e-5483-4e3f-9272-12a18eca45bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:19.879767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e9a0d0e-5483-4e3f-9272-12a18eca45bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:19.882486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e9a0d0e-5483-4e3f-9272-12a18eca45bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:19.882486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e9a0d0e-5483-4e3f-9272-12a18eca45bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:19.882486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e9a0d0e-5483-4e3f-9272-12a18eca45bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:20.023351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5e9a0d0e-5483-4e3f-9272-12a18eca45bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:20.032355 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5e9a0d0e-5483-4e3f-9272-12a18eca45bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.163948 Jan 22 21:04:20.032927 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 666/1362] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:19 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:20.081926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ece3dc6-cc8f-4c31-921d-29023ac5b16c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:20.082881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1ece3dc6-cc8f-4c31-921d-29023ac5b16c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:20.088980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ece3dc6-cc8f-4c31-921d-29023ac5b16c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:20.089441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ece3dc6-cc8f-4c31-921d-29023ac5b16c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:20.090289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ece3dc6-cc8f-4c31-921d-29023ac5b16c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:20.090734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ece3dc6-cc8f-4c31-921d-29023ac5b16c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:20.107345 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-197e5ab1-3425-4218-a18d-7cab0023f2d5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 204 len: 0 microversion: 2.1 time: 1.358046 Jan 22 21:04:20.107962 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 697/1363] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:18 2022] DELETE /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 0 bytes in 1360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:20.115822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-781e7e0d-4cea-468d-86dd-a483fb92c1e9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:20.116472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-781e7e0d-4cea-468d-86dd-a483fb92c1e9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:20.123673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-781e7e0d-4cea-468d-86dd-a483fb92c1e9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:20.128455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-781e7e0d-4cea-468d-86dd-a483fb92c1e9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:20.129379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-781e7e0d-4cea-468d-86dd-a483fb92c1e9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:20.129894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-781e7e0d-4cea-468d-86dd-a483fb92c1e9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:20.135554 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1ece3dc6-cc8f-4c31-921d-29023ac5b16c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.057103 Jan 22 21:04:20.136656 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 667/1364] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:20 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:20.158511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-781e7e0d-4cea-468d-86dd-a483fb92c1e9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:04:20.204288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-78b6e4de-c2e4-46e3-af29-9962860d3eb2 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:20.205298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-78b6e4de-c2e4-46e3-af29-9962860d3eb2 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:20.212760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78b6e4de-c2e4-46e3-af29-9962860d3eb2 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:20.213216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78b6e4de-c2e4-46e3-af29-9962860d3eb2 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:20.214099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78b6e4de-c2e4-46e3-af29-9962860d3eb2 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:20.214542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78b6e4de-c2e4-46e3-af29-9962860d3eb2 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:20.265576 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-78b6e4de-c2e4-46e3-af29-9962860d3eb2 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.067118 Jan 22 21:04:20.266513 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 668/1365] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:20 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:20.498023 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-781e7e0d-4cea-468d-86dd-a483fb92c1e9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 204 len: 0 microversion: 2.1 time: 0.385351 Jan 22 21:04:20.498643 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 698/1366] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:04:20 2022] DELETE /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:04:20.602467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-335548751", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "9c00559f-de2d-48cc-a51a-3429ed0dc4c4"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:20.655702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] validate_networks() for [('9c00559f-de2d-48cc-a51a-3429ed0dc4c4', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:04:20.664756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6ec8d9c5-3994-4ec7-8504-945a7b1020d7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:20.666157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6ec8d9c5-3994-4ec7-8504-945a7b1020d7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:20.673373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ec8d9c5-3994-4ec7-8504-945a7b1020d7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:20.673865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ec8d9c5-3994-4ec7-8504-945a7b1020d7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:20.674674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ec8d9c5-3994-4ec7-8504-945a7b1020d7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:20.675119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ec8d9c5-3994-4ec7-8504-945a7b1020d7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:20.720961 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6ec8d9c5-3994-4ec7-8504-945a7b1020d7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 8206 microversion: 2.1 time: 0.060191 Jan 22 21:04:20.721797 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 699/1367] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:20 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 8206 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:20.828194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-70913627-b57f-4744-8591-03787f195b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:20.828887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-70913627-b57f-4744-8591-03787f195b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:20.843949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70913627-b57f-4744-8591-03787f195b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:20.844545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70913627-b57f-4744-8591-03787f195b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:20.845531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70913627-b57f-4744-8591-03787f195b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:20.845985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70913627-b57f-4744-8591-03787f195b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:20.998842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-70913627-b57f-4744-8591-03787f195b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:21.006392 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-70913627-b57f-4744-8591-03787f195b37 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1317 microversion: 2.1 time: 0.182657 Jan 22 21:04:21.006948 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 700/1368] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:20 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:21.049588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:04:21.050021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:04:21.050503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:04:21.050918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:04:21.051335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:04:21.057053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab7c6494-7725-48dc-8a9d-af52b821a525 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:21.057701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ab7c6494-7725-48dc-8a9d-af52b821a525 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:21.063390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:21.064081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:21.069202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:21.069348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab7c6494-7725-48dc-8a9d-af52b821a525 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:21.069454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:21.069563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab7c6494-7725-48dc-8a9d-af52b821a525 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:21.069563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab7c6494-7725-48dc-8a9d-af52b821a525 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:21.069563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab7c6494-7725-48dc-8a9d-af52b821a525 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:21.085013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Getting quotas for project 01b1a67e790046629fe2b636fcefd01d. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:21.092036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Getting quotas for user 946cce9cf6874d60912e69c1169ed379 and project 01b1a67e790046629fe2b636fcefd01d. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:21.105115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:04:21.108630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:04:21.207716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ab7c6494-7725-48dc-8a9d-af52b821a525 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:21.216053 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab7c6494-7725-48dc-8a9d-af52b821a525 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.168850 Jan 22 21:04:21.220592 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 701/1369] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:21 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:21.221866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4b6ffa4b-4546-40a9-939a-1ece4c83ee25 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:21.222832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4b6ffa4b-4546-40a9-939a-1ece4c83ee25 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:21.228885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b6ffa4b-4546-40a9-939a-1ece4c83ee25 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:21.229342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b6ffa4b-4546-40a9-939a-1ece4c83ee25 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:21.230203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b6ffa4b-4546-40a9-939a-1ece4c83ee25 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:21.230643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b6ffa4b-4546-40a9-939a-1ece4c83ee25 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:21.272169 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4b6ffa4b-4546-40a9-939a-1ece4c83ee25 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.053972 Jan 22 21:04:21.272807 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 702/1370] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:21 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:21.278415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1adb3cbd-3328-402d-ab09-20f7a3d10c94 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:21.279608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1adb3cbd-3328-402d-ab09-20f7a3d10c94 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:21.286752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1adb3cbd-3328-402d-ab09-20f7a3d10c94 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:21.287215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1adb3cbd-3328-402d-ab09-20f7a3d10c94 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:21.289715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1adb3cbd-3328-402d-ab09-20f7a3d10c94 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:21.289715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1adb3cbd-3328-402d-ab09-20f7a3d10c94 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:21.329955 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1adb3cbd-3328-402d-ab09-20f7a3d10c94 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.055630 Jan 22 21:04:21.336079 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 703/1371] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:21 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:21.336214 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-069d33df-58d3-447c-a4e5-a7afc2d60d20 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.743592 Jan 22 21:04:21.336480 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 669/1372] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:04:20 2022] POST /compute/v2.1/servers => generated 382 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:04:21.347672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ba050b9b-65ca-4789-b096-cbaf21d2725c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:21.348452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ba050b9b-65ca-4789-b096-cbaf21d2725c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:21.401586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ba050b9b-65ca-4789-b096-cbaf21d2725c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:21.409362 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ba050b9b-65ca-4789-b096-cbaf21d2725c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1211 microversion: 2.1 time: 0.066018 Jan 22 21:04:21.409979 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 704/1373] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:21 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1211 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:21.732639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cb532ef5-7e6a-40f0-93ce-5ad84e51337d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:21.733753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cb532ef5-7e6a-40f0-93ce-5ad84e51337d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:21.740114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb532ef5-7e6a-40f0-93ce-5ad84e51337d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:21.740598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb532ef5-7e6a-40f0-93ce-5ad84e51337d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:21.741385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb532ef5-7e6a-40f0-93ce-5ad84e51337d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:21.741845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb532ef5-7e6a-40f0-93ce-5ad84e51337d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:21.811174 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cb532ef5-7e6a-40f0-93ce-5ad84e51337d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 16397 microversion: 2.1 time: 0.082585 Jan 22 21:04:21.814930 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 670/1374] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:21 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 16397 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:22.023227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad6a3355-9f8f-435d-b255-3e0872149edb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:22.023837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad6a3355-9f8f-435d-b255-3e0872149edb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:22.031003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad6a3355-9f8f-435d-b255-3e0872149edb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.031461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad6a3355-9f8f-435d-b255-3e0872149edb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.032370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad6a3355-9f8f-435d-b255-3e0872149edb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.032829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad6a3355-9f8f-435d-b255-3e0872149edb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.166327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ad6a3355-9f8f-435d-b255-3e0872149edb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:22.173912 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad6a3355-9f8f-435d-b255-3e0872149edb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1466 microversion: 2.1 time: 0.154390 Jan 22 21:04:22.174528 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 705/1375] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:22 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1466 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:22.240427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a793a3cc-f6e4-4666-aee7-4475ad1926bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:22.241190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a793a3cc-f6e4-4666-aee7-4475ad1926bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:22.246654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-583de76a-eaa1-4a35-bbc3-ae179848b001 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:22.248140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a793a3cc-f6e4-4666-aee7-4475ad1926bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.248628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a793a3cc-f6e4-4666-aee7-4475ad1926bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.249743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a793a3cc-f6e4-4666-aee7-4475ad1926bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.249989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a793a3cc-f6e4-4666-aee7-4475ad1926bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.250987 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:22.250987 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:22.255738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-583de76a-eaa1-4a35-bbc3-ae179848b001 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Searching by: {'deleted': False, 'project_id': '2b8b0e9b9bab453fa9c5d8a4481773f5'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:04:22.268659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-583de76a-eaa1-4a35-bbc3-ae179848b001 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.269253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-583de76a-eaa1-4a35-bbc3-ae179848b001 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.270165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-583de76a-eaa1-4a35-bbc3-ae179848b001 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.270589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-583de76a-eaa1-4a35-bbc3-ae179848b001 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.377264 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-583de76a-eaa1-4a35-bbc3-ae179848b001 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.184316 Jan 22 21:04:22.378784 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 671/1376] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:04:22 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:04:22.384122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-428f2efa-f5af-42f2-8383-9eada4d61503 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:22.385367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-428f2efa-f5af-42f2-8383-9eada4d61503 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:22.394091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-428f2efa-f5af-42f2-8383-9eada4d61503 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.394546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-428f2efa-f5af-42f2-8383-9eada4d61503 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.395338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-428f2efa-f5af-42f2-8383-9eada4d61503 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.395778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-428f2efa-f5af-42f2-8383-9eada4d61503 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.411304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a793a3cc-f6e4-4666-aee7-4475ad1926bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:22.419441 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a793a3cc-f6e4-4666-aee7-4475ad1926bf tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1519 microversion: 2.1 time: 0.188053 Jan 22 21:04:22.420020 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 706/1377] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:22 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:22.425064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a6cc77c2-5298-4746-b075-80fd8bd5d816 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:22.426386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a6cc77c2-5298-4746-b075-80fd8bd5d816 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:22.431936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6cc77c2-5298-4746-b075-80fd8bd5d816 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.432394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6cc77c2-5298-4746-b075-80fd8bd5d816 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.433192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6cc77c2-5298-4746-b075-80fd8bd5d816 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.434446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6cc77c2-5298-4746-b075-80fd8bd5d816 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.437841 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-428f2efa-f5af-42f2-8383-9eada4d61503 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.057434 Jan 22 21:04:22.438893 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 672/1378] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:22 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:22.444095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-86df82c8-9fca-4329-9b53-24b62d237906 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:22.447030 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:22.447030 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:22.448324 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:22.448324 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:22.450277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-86df82c8-9fca-4329-9b53-24b62d237906 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Searching by: {'deleted': False} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:04:22.465335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86df82c8-9fca-4329-9b53-24b62d237906 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.465335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86df82c8-9fca-4329-9b53-24b62d237906 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.465335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86df82c8-9fca-4329-9b53-24b62d237906 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.465335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86df82c8-9fca-4329-9b53-24b62d237906 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.484741 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a6cc77c2-5298-4746-b075-80fd8bd5d816 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.062569 Jan 22 21:04:22.489321 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 707/1379] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:22 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:22.490941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6ba9431-caa0-420e-a302-d5058a03713d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:22.493972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b6ba9431-caa0-420e-a302-d5058a03713d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:22.499537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6ba9431-caa0-420e-a302-d5058a03713d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.500089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6ba9431-caa0-420e-a302-d5058a03713d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.500906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6ba9431-caa0-420e-a302-d5058a03713d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.501352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6ba9431-caa0-420e-a302-d5058a03713d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.586218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-86df82c8-9fca-4329-9b53-24b62d237906 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Listed batch of 15 results from cell out of 999 limit. Returned 15 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:04:22.591554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b6ba9431-caa0-420e-a302-d5058a03713d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:22.599176 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b6ba9431-caa0-420e-a302-d5058a03713d tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1215 microversion: 2.1 time: 0.112567 Jan 22 21:04:22.599752 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 708/1380] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:22 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:22.716861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86df82c8-9fca-4329-9b53-24b62d237906 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.717267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86df82c8-9fca-4329-9b53-24b62d237906 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.822768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-44bb3c74-6144-4ae6-a15b-1c0a27c31e0c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:22.823671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-44bb3c74-6144-4ae6-a15b-1c0a27c31e0c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:22.830482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44bb3c74-6144-4ae6-a15b-1c0a27c31e0c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.830940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44bb3c74-6144-4ae6-a15b-1c0a27c31e0c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.831733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44bb3c74-6144-4ae6-a15b-1c0a27c31e0c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:22.832171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44bb3c74-6144-4ae6-a15b-1c0a27c31e0c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:22.872549 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-44bb3c74-6144-4ae6-a15b-1c0a27c31e0c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 16397 microversion: 2.1 time: 0.053226 Jan 22 21:04:22.874649 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 709/1381] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:22 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 16397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:23.332689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-70bfe060-cf57-489e-acef-0090561920d5 req-576ee13a-cdea-4661-812c-05b66f625e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e95589a-26dd-4aac-bbc5-5abc6d98536f", "name": "network-vif-deleted", "tag": "d9c069fd-afb5-45a0-8595-74435df57e78"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:23.335601 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:23.335601 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:23.345273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-70bfe060-cf57-489e-acef-0090561920d5 req-576ee13a-cdea-4661-812c-05b66f625e76 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.345991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-70bfe060-cf57-489e-acef-0090561920d5 req-576ee13a-cdea-4661-812c-05b66f625e76 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.357977 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-70bfe060-cf57-489e-acef-0090561920d5 req-576ee13a-cdea-4661-812c-05b66f625e76 service nova] Creating event network-vif-deleted:d9c069fd-afb5-45a0-8595-74435df57e78 for instance 8e95589a-26dd-4aac-bbc5-5abc6d98536f on nch1-master-1 Jan 22 21:04:23.362744 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-70bfe060-cf57-489e-acef-0090561920d5 req-576ee13a-cdea-4661-812c-05b66f625e76 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035399 Jan 22 21:04:23.363338 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 710/1382] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:23.372885 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-86df82c8-9fca-4329-9b53-24b62d237906 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 24806 microversion: 2.1 time: 0.926069 Jan 22 21:04:23.372885 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 673/1383] 10.222.0.100 () {58 vars in 1175 bytes} [Sat Jan 22 21:04:22 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 24806 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:23.400425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f4f9cc0d-0d87-46d2-b694-32c1fd33649e tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:23.404180 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:23.404180 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:23.405564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f4f9cc0d-0d87-46d2-b694-32c1fd33649e tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Searching by: {'deleted': False, 'project_id': '2b8b0e9b9bab453fa9c5d8a4481773f5'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:04:23.411550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4f9cc0d-0d87-46d2-b694-32c1fd33649e tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.412008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4f9cc0d-0d87-46d2-b694-32c1fd33649e tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.412831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4f9cc0d-0d87-46d2-b694-32c1fd33649e tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.413282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4f9cc0d-0d87-46d2-b694-32c1fd33649e tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.436620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-789d170a-0c84-40a0-ae23-deadcd490c2d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:23.437701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-789d170a-0c84-40a0-ae23-deadcd490c2d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:23.445424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-789d170a-0c84-40a0-ae23-deadcd490c2d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.449037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-789d170a-0c84-40a0-ae23-deadcd490c2d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.449037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-789d170a-0c84-40a0-ae23-deadcd490c2d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.449037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-789d170a-0c84-40a0-ae23-deadcd490c2d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.512463 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f4f9cc0d-0d87-46d2-b694-32c1fd33649e tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/detail?tenant_id=2566e2caf61643f7b603b8ab8f81e193" status: 200 len: 15 microversion: 2.1 time: 0.115776 Jan 22 21:04:23.513389 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 711/1384] 10.222.0.100 () {58 vars in 1235 bytes} [Sat Jan 22 21:04:23 2022] GET /compute/v2.1/servers/detail?tenant_id=2566e2caf61643f7b603b8ab8f81e193 => generated 15 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:04:23.518083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aa7246fb-7f8e-4a5a-b002-3edd2930e6e2 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:23.519335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aa7246fb-7f8e-4a5a-b002-3edd2930e6e2 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:23.525398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa7246fb-7f8e-4a5a-b002-3edd2930e6e2 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.525898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa7246fb-7f8e-4a5a-b002-3edd2930e6e2 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.526731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa7246fb-7f8e-4a5a-b002-3edd2930e6e2 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.527178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa7246fb-7f8e-4a5a-b002-3edd2930e6e2 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.593183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-789d170a-0c84-40a0-ae23-deadcd490c2d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:23.601040 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-789d170a-0c84-40a0-ae23-deadcd490c2d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1525 microversion: 2.1 time: 0.168520 Jan 22 21:04:23.601627 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 674/1385] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:23 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1525 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:23.606624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-94268977-3437-4c60-8c12-d7ad45673c1c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:23.607594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-94268977-3437-4c60-8c12-d7ad45673c1c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:23.613690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94268977-3437-4c60-8c12-d7ad45673c1c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.614155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94268977-3437-4c60-8c12-d7ad45673c1c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.615031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94268977-3437-4c60-8c12-d7ad45673c1c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.615479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94268977-3437-4c60-8c12-d7ad45673c1c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.616487 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aa7246fb-7f8e-4a5a-b002-3edd2930e6e2 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.101609 Jan 22 21:04:23.617336 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 712/1386] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:23 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:23.622043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a2ccb4fa-3391-4fb3-9fb5-44323cd3e489 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:23.625146 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:23.625146 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:23.626824 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:23.626824 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:23.628204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a2ccb4fa-3391-4fb3-9fb5-44323cd3e489 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Searching by: {'tenant_id': '2566e2caf61643f7b603b8ab8f81e193', 'deleted': False} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:04:23.634532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2ccb4fa-3391-4fb3-9fb5-44323cd3e489 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.634814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2ccb4fa-3391-4fb3-9fb5-44323cd3e489 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.635590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2ccb4fa-3391-4fb3-9fb5-44323cd3e489 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.636075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2ccb4fa-3391-4fb3-9fb5-44323cd3e489 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.665395 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-94268977-3437-4c60-8c12-d7ad45673c1c tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.062449 Jan 22 21:04:23.666225 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 675/1387] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:23 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:23.671687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-71e43d00-d416-4d62-823e-cce64c53d757 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:23.672804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-71e43d00-d416-4d62-823e-cce64c53d757 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:23.679068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-a2ccb4fa-3391-4fb3-9fb5-44323cd3e489 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:04:23.685135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71e43d00-d416-4d62-823e-cce64c53d757 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.693468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71e43d00-d416-4d62-823e-cce64c53d757 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.693468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71e43d00-d416-4d62-823e-cce64c53d757 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.693468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71e43d00-d416-4d62-823e-cce64c53d757 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.751625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-71e43d00-d416-4d62-823e-cce64c53d757 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:23.760158 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-71e43d00-d416-4d62-823e-cce64c53d757 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1263 microversion: 2.1 time: 0.092883 Jan 22 21:04:23.765757 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 676/1388] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:23 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1263 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:23.800925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2ccb4fa-3391-4fb3-9fb5-44323cd3e489 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.801373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2ccb4fa-3391-4fb3-9fb5-44323cd3e489 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.884613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c0b9e0e1-55dd-4aac-93b3-b2835ad3a134 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:23.885571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c0b9e0e1-55dd-4aac-93b3-b2835ad3a134 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:23.892011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0b9e0e1-55dd-4aac-93b3-b2835ad3a134 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.892472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0b9e0e1-55dd-4aac-93b3-b2835ad3a134 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.893300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0b9e0e1-55dd-4aac-93b3-b2835ad3a134 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.893775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0b9e0e1-55dd-4aac-93b3-b2835ad3a134 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.916022 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a2ccb4fa-3391-4fb3-9fb5-44323cd3e489 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2566e2caf61643f7b603b8ab8f81e193" status: 200 len: 4836 microversion: 2.1 time: 0.297627 Jan 22 21:04:23.916631 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 713/1389] 10.222.0.100 () {58 vars in 1261 bytes} [Sat Jan 22 21:04:23 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2566e2caf61643f7b603b8ab8f81e193 => generated 4836 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:23.936088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2ac2e56a-5552-4f86-8f2b-8fe6b22a1d34 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:23.938299 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c0b9e0e1-55dd-4aac-93b3-b2835ad3a134 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 16397 microversion: 2.1 time: 0.057635 Jan 22 21:04:23.938925 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 677/1390] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:23 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 16397 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:23.939226 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:23.939226 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:23.940657 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:23.940657 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:23.941989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2ac2e56a-5552-4f86-8f2b-8fe6b22a1d34 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Searching by: {'tenant_id': '2b8b0e9b9bab453fa9c5d8a4481773f5', 'deleted': False} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:04:23.947784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ac2e56a-5552-4f86-8f2b-8fe6b22a1d34 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.948247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ac2e56a-5552-4f86-8f2b-8fe6b22a1d34 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.949068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ac2e56a-5552-4f86-8f2b-8fe6b22a1d34 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:23.950144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ac2e56a-5552-4f86-8f2b-8fe6b22a1d34 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:23.978916 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2ac2e56a-5552-4f86-8f2b-8fe6b22a1d34 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2b8b0e9b9bab453fa9c5d8a4481773f5" status: 200 len: 15 microversion: 2.1 time: 0.047034 Jan 22 21:04:23.979493 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 714/1391] 10.222.0.100 () {58 vars in 1261 bytes} [Sat Jan 22 21:04:23 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2b8b0e9b9bab453fa9c5d8a4481773f5 => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:04:24.001285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6d9ae7c2-9ca5-4e42-a0f8-256f5fc4dd4a tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:24.005542 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:24.005542 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:24.007020 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6d9ae7c2-9ca5-4e42-a0f8-256f5fc4dd4a tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010620 Jan 22 21:04:24.009538 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 678/1392] 10.222.0.100 () {58 vars in 1193 bytes} [Sat Jan 22 21:04:23 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:04:24.026857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-63c4642c-6205-440c-98e0-4eb4b89cd66b tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:24.031189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-63c4642c-6205-440c-98e0-4eb4b89cd66b tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:24.034264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63c4642c-6205-440c-98e0-4eb4b89cd66b tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:24.034723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63c4642c-6205-440c-98e0-4eb4b89cd66b tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:24.035533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63c4642c-6205-440c-98e0-4eb4b89cd66b tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:24.035971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63c4642c-6205-440c-98e0-4eb4b89cd66b tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:24.410106 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-63c4642c-6205-440c-98e0-4eb4b89cd66b tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9/action" status: 202 len: 0 microversion: 2.1 time: 0.383064 Jan 22 21:04:24.410638 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 715/1393] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:24 2022] POST /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:04:24.416427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9d00acc8-ce7f-40bc-bbe7-f4eedd4fb774 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:24.421327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9d00acc8-ce7f-40bc-bbe7-f4eedd4fb774 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:24.422357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9d00acc8-ce7f-40bc-bbe7-f4eedd4fb774 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '2566e2caf61643f7b603b8ab8f81e193'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:04:24.431504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d00acc8-ce7f-40bc-bbe7-f4eedd4fb774 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:24.432038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d00acc8-ce7f-40bc-bbe7-f4eedd4fb774 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:24.432865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d00acc8-ce7f-40bc-bbe7-f4eedd4fb774 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:24.435107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d00acc8-ce7f-40bc-bbe7-f4eedd4fb774 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:24.521652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-9d00acc8-ce7f-40bc-bbe7-f4eedd4fb774 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:04:24.579783 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9d00acc8-ce7f-40bc-bbe7-f4eedd4fb774 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers?status=error" status: 200 len: 340 microversion: 2.1 time: 0.167861 Jan 22 21:04:24.580297 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 679/1394] 10.222.0.100 () {58 vars in 1154 bytes} [Sat Jan 22 21:04:24 2022] GET /compute/v2.1/servers?status=error => generated 340 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:24.590938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ebf0fdcc-512e-4848-84ee-10909cbc3cb6 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:24.591878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ebf0fdcc-512e-4848-84ee-10909cbc3cb6 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:24.597944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebf0fdcc-512e-4848-84ee-10909cbc3cb6 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:24.598398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebf0fdcc-512e-4848-84ee-10909cbc3cb6 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:24.599187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebf0fdcc-512e-4848-84ee-10909cbc3cb6 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:24.599623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebf0fdcc-512e-4848-84ee-10909cbc3cb6 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:24.619739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8f4aabe5-6974-412c-aef6-57ba17e38950 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:24.622586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8f4aabe5-6974-412c-aef6-57ba17e38950 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:24.629458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f4aabe5-6974-412c-aef6-57ba17e38950 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:24.630011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f4aabe5-6974-412c-aef6-57ba17e38950 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:24.630787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f4aabe5-6974-412c-aef6-57ba17e38950 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:24.631235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f4aabe5-6974-412c-aef6-57ba17e38950 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:24.803600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8f4aabe5-6974-412c-aef6-57ba17e38950 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:24.811156 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8f4aabe5-6974-412c-aef6-57ba17e38950 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1525 microversion: 2.1 time: 0.195472 Jan 22 21:04:24.811732 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 680/1395] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:24 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1525 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:24.816800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e1b34c0b-a831-45a9-863c-b15077e183a0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:24.817749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e1b34c0b-a831-45a9-863c-b15077e183a0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:24.824713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1b34c0b-a831-45a9-863c-b15077e183a0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:24.825037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1b34c0b-a831-45a9-863c-b15077e183a0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:24.830141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1b34c0b-a831-45a9-863c-b15077e183a0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:24.830141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1b34c0b-a831-45a9-863c-b15077e183a0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:24.874630 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e1b34c0b-a831-45a9-863c-b15077e183a0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.061328 Jan 22 21:04:24.876140 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 681/1396] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:24 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:24.880732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7da4cc22-6fa1-4a53-801c-9c2687c2a7fe tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:24.881777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7da4cc22-6fa1-4a53-801c-9c2687c2a7fe tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:24.892578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7da4cc22-6fa1-4a53-801c-9c2687c2a7fe tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:24.893048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7da4cc22-6fa1-4a53-801c-9c2687c2a7fe tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:24.893915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7da4cc22-6fa1-4a53-801c-9c2687c2a7fe tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:24.894398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7da4cc22-6fa1-4a53-801c-9c2687c2a7fe tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:24.935742 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7da4cc22-6fa1-4a53-801c-9c2687c2a7fe tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.058921 Jan 22 21:04:24.936389 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 682/1397] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:24 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:24.941585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c5013e37-0237-419e-8091-9573bd98eb51 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:24.941920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c5013e37-0237-419e-8091-9573bd98eb51 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:24.949131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5013e37-0237-419e-8091-9573bd98eb51 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:24.951258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5013e37-0237-419e-8091-9573bd98eb51 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:24.951258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5013e37-0237-419e-8091-9573bd98eb51 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:24.951464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5013e37-0237-419e-8091-9573bd98eb51 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:24.993633 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ebf0fdcc-512e-4848-84ee-10909cbc3cb6 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9/action" status: 202 len: 0 microversion: 2.1 time: 0.406875 Jan 22 21:04:24.994286 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 716/1398] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:24 2022] POST /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:04:24.999508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-285cc752-9606-4336-b9fc-07cf4e0224f3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:25.000440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-285cc752-9606-4336-b9fc-07cf4e0224f3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:25.006403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-285cc752-9606-4336-b9fc-07cf4e0224f3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:25.006855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-285cc752-9606-4336-b9fc-07cf4e0224f3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:25.007709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-285cc752-9606-4336-b9fc-07cf4e0224f3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:25.008150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-285cc752-9606-4336-b9fc-07cf4e0224f3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:25.069781 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-285cc752-9606-4336-b9fc-07cf4e0224f3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 16397 microversion: 2.1 time: 0.074119 Jan 22 21:04:25.073869 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 717/1399] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:24 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 16397 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:25.076699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b7807ced-54e1-4c93-809f-df2a55c261ee tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:25.078080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b7807ced-54e1-4c93-809f-df2a55c261ee tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:25.085116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7807ced-54e1-4c93-809f-df2a55c261ee tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:25.085829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7807ced-54e1-4c93-809f-df2a55c261ee tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:25.086633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7807ced-54e1-4c93-809f-df2a55c261ee tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:25.087085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7807ced-54e1-4c93-809f-df2a55c261ee tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:25.096047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c5013e37-0237-419e-8091-9573bd98eb51 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:25.105694 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c5013e37-0237-419e-8091-9573bd98eb51 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1311 microversion: 2.1 time: 0.168005 Jan 22 21:04:25.107839 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 683/1400] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:24 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1311 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:25.225240 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b7807ced-54e1-4c93-809f-df2a55c261ee tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1617 microversion: 2.1 time: 0.153516 Jan 22 21:04:25.225854 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 718/1401] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:25 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1617 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:25.242122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f06c5ab7-0911-4523-be83-f5dd3677e5e9 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:25.242739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f06c5ab7-0911-4523-be83-f5dd3677e5e9 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:25.249480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06c5ab7-0911-4523-be83-f5dd3677e5e9 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:25.250012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06c5ab7-0911-4523-be83-f5dd3677e5e9 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:25.250961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06c5ab7-0911-4523-be83-f5dd3677e5e9 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:25.251396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06c5ab7-0911-4523-be83-f5dd3677e5e9 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:25.477861 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f06c5ab7-0911-4523-be83-f5dd3677e5e9 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1617 microversion: 2.1 time: 0.239399 Jan 22 21:04:25.479753 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 684/1402] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:25 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1617 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:25.499733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bc3c39e1-6548-4205-a78e-0f80e0f944e8 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:25.503029 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:25.503029 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:25.504302 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:index:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:25.504302 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:25.505529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bc3c39e1-6548-4205-a78e-0f80e0f944e8 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:04:25.513683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc3c39e1-6548-4205-a78e-0f80e0f944e8 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:25.513683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc3c39e1-6548-4205-a78e-0f80e0f944e8 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:25.513683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc3c39e1-6548-4205-a78e-0f80e0f944e8 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:25.514518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc3c39e1-6548-4205-a78e-0f80e0f944e8 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:25.610246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-bc3c39e1-6548-4205-a78e-0f80e0f944e8 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:04:25.828052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc3da73a-e4eb-480e-b373-8b9f612fccf9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:25.828851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bc3da73a-e4eb-480e-b373-8b9f612fccf9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:25.843759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc3da73a-e4eb-480e-b373-8b9f612fccf9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:25.844213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc3da73a-e4eb-480e-b373-8b9f612fccf9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:25.845025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc3da73a-e4eb-480e-b373-8b9f612fccf9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:25.845465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc3da73a-e4eb-480e-b373-8b9f612fccf9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:25.870217 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bc3c39e1-6548-4205-a78e-0f80e0f944e8 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 3287 microversion: 2.1 time: 0.374104 Jan 22 21:04:25.871864 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 719/1403] 10.222.0.100 () {58 vars in 1194 bytes} [Sat Jan 22 21:04:25 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 3287 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:25.888616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6bb19aaa-86bf-4af6-98ba-c65753f00364 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:25.892022 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:25.892022 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:25.893652 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:index:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:25.893652 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:25.895388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6bb19aaa-86bf-4af6-98ba-c65753f00364 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:04:25.902124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bb19aaa-86bf-4af6-98ba-c65753f00364 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:25.902124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bb19aaa-86bf-4af6-98ba-c65753f00364 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:25.902124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bb19aaa-86bf-4af6-98ba-c65753f00364 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:25.902740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bb19aaa-86bf-4af6-98ba-c65753f00364 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:25.926268 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6bb19aaa-86bf-4af6-98ba-c65753f00364 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.041690 Jan 22 21:04:25.927339 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 720/1404] 10.222.0.100 () {58 vars in 1200 bytes} [Sat Jan 22 21:04:25 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:04:25.932517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-11280de5-8de7-4924-a2c4-28c3eaf7c198 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:25.933170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-11280de5-8de7-4924-a2c4-28c3eaf7c198 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:25.940733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11280de5-8de7-4924-a2c4-28c3eaf7c198 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:25.940733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11280de5-8de7-4924-a2c4-28c3eaf7c198 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:25.940733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11280de5-8de7-4924-a2c4-28c3eaf7c198 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:25.942846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11280de5-8de7-4924-a2c4-28c3eaf7c198 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:25.995111 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-11280de5-8de7-4924-a2c4-28c3eaf7c198 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.066414 Jan 22 21:04:25.995798 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 721/1405] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:25 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:26.001712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a4a5d70-e458-4997-b7ec-825b1a6937a7 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:26.002746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a4a5d70-e458-4997-b7ec-825b1a6937a7 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:26.009923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a4a5d70-e458-4997-b7ec-825b1a6937a7 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.010384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a4a5d70-e458-4997-b7ec-825b1a6937a7 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:26.011197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a4a5d70-e458-4997-b7ec-825b1a6937a7 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.011641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a4a5d70-e458-4997-b7ec-825b1a6937a7 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:26.237733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bc3da73a-e4eb-480e-b373-8b9f612fccf9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:26.245491 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bc3da73a-e4eb-480e-b373-8b9f612fccf9 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1525 microversion: 2.1 time: 0.421148 Jan 22 21:04:26.246139 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 685/1406] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:25 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1525 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:26.251114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-80ebef39-f814-460d-a508-c1ac1d9fd6a6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:26.255769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-80ebef39-f814-460d-a508-c1ac1d9fd6a6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:26.259619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80ebef39-f814-460d-a508-c1ac1d9fd6a6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.260078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80ebef39-f814-460d-a508-c1ac1d9fd6a6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:26.260915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80ebef39-f814-460d-a508-c1ac1d9fd6a6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.261353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80ebef39-f814-460d-a508-c1ac1d9fd6a6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:26.305192 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-80ebef39-f814-460d-a508-c1ac1d9fd6a6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.057783 Jan 22 21:04:26.306036 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 686/1407] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:26 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:26.311377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-2ed77213-a41b-4dc0-bc0a-6a4ca921c325 req-9bfd9e05-9189-4076-bbdf-483a089fc26c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61d4e4a-a3e5-4329-94b0-bfcd080a47cb", "name": "network-vif-unplugged", "status": "completed", "tag": "54742673-5698-4189-9534-ffa749b79f02"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:26.312980 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:26.312980 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:26.321057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2ed77213-a41b-4dc0-bc0a-6a4ca921c325 req-9bfd9e05-9189-4076-bbdf-483a089fc26c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.322292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2ed77213-a41b-4dc0-bc0a-6a4ca921c325 req-9bfd9e05-9189-4076-bbdf-483a089fc26c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:26.333526 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-2ed77213-a41b-4dc0-bc0a-6a4ca921c325 req-9bfd9e05-9189-4076-bbdf-483a089fc26c service nova] Creating event network-vif-unplugged:54742673-5698-4189-9534-ffa749b79f02 for instance e61d4e4a-a3e5-4329-94b0-bfcd080a47cb on nch2-master-1 Jan 22 21:04:26.338125 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-2ed77213-a41b-4dc0-bc0a-6a4ca921c325 req-9bfd9e05-9189-4076-bbdf-483a089fc26c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030716 Jan 22 21:04:26.338710 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 687/1408] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:26.345554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7cd6d2a0-0864-42a5-a250-dc5f4eaa2525 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:26.345554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7cd6d2a0-0864-42a5-a250-dc5f4eaa2525 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:26.351346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cd6d2a0-0864-42a5-a250-dc5f4eaa2525 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.351792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cd6d2a0-0864-42a5-a250-dc5f4eaa2525 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:26.352562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cd6d2a0-0864-42a5-a250-dc5f4eaa2525 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.352996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cd6d2a0-0864-42a5-a250-dc5f4eaa2525 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:26.404322 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7cd6d2a0-0864-42a5-a250-dc5f4eaa2525 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.063857 Jan 22 21:04:26.405437 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 688/1409] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:26 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:26.410943 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a4a5d70-e458-4997-b7ec-825b1a6937a7 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9/action" status: 202 len: 0 microversion: 2.1 time: 0.413229 Jan 22 21:04:26.418759 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 722/1410] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:25 2022] POST /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:04:26.419776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5bbd7538-f73d-483f-b8db-3dd4d9a12dac tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:26.419776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5bbd7538-f73d-483f-b8db-3dd4d9a12dac tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:26.423409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bbd7538-f73d-483f-b8db-3dd4d9a12dac tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.423866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bbd7538-f73d-483f-b8db-3dd4d9a12dac tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:26.424909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bbd7538-f73d-483f-b8db-3dd4d9a12dac tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.425102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bbd7538-f73d-483f-b8db-3dd4d9a12dac tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:26.426297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:26.428402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:26.438887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.439796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:26.440710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.441838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:26.541958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:04:26.542675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:04:26.543828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:04:26.544374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:04:26.544856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:04:26.595162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5bbd7538-f73d-483f-b8db-3dd4d9a12dac tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:26.602746 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5bbd7538-f73d-483f-b8db-3dd4d9a12dac tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1311 microversion: 2.1 time: 0.196268 Jan 22 21:04:26.603423 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 689/1411] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:26 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1311 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:26.608806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-4c78b3cb-aaa6-4f6a-98e3-1800bea05be0 req-408addbf-02b7-4fa5-84b8-ae5f2a790f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7779535a-c217-4b7c-bd47-d83487d68e73", "tag": "74c18d40-5e04-41a9-b5c1-70950f848539"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:26.610849 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:26.610849 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:26.618918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4c78b3cb-aaa6-4f6a-98e3-1800bea05be0 req-408addbf-02b7-4fa5-84b8-ae5f2a790f76 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.621032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4c78b3cb-aaa6-4f6a-98e3-1800bea05be0 req-408addbf-02b7-4fa5-84b8-ae5f2a790f76 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:26.631628 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-4c78b3cb-aaa6-4f6a-98e3-1800bea05be0 req-408addbf-02b7-4fa5-84b8-ae5f2a790f76 service nova] Creating event network-changed:74c18d40-5e04-41a9-b5c1-70950f848539 for instance 7779535a-c217-4b7c-bd47-d83487d68e73 on nch2-master-1 Jan 22 21:04:26.636630 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-4c78b3cb-aaa6-4f6a-98e3-1800bea05be0 req-408addbf-02b7-4fa5-84b8-ae5f2a790f76 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031885 Jan 22 21:04:26.638135 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 690/1412] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:26.756748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:26.766212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.767028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:26.768184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.769619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:26.799243 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4939f72a-0bda-4317-82a9-037858e79c64 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "POST /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9/action" status: 202 len: 1070 microversion: 2.1 time: 0.377085 Jan 22 21:04:26.799962 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 723/1413] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:26 2022] POST /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9/action => generated 1070 bytes in 379 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 22 21:04:26.818261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-847c40fd-bdd1-4bce-a5df-60448b0817cf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:26.818966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-847c40fd-bdd1-4bce-a5df-60448b0817cf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:26.825470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-847c40fd-bdd1-4bce-a5df-60448b0817cf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.825958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-847c40fd-bdd1-4bce-a5df-60448b0817cf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:26.826770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-847c40fd-bdd1-4bce-a5df-60448b0817cf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:26.827217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-847c40fd-bdd1-4bce-a5df-60448b0817cf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:27.007614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dd6e1c01-1169-4175-8dcf-a6e72ce6d188 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:27.009028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dd6e1c01-1169-4175-8dcf-a6e72ce6d188 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:27.015412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd6e1c01-1169-4175-8dcf-a6e72ce6d188 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:27.015870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd6e1c01-1169-4175-8dcf-a6e72ce6d188 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:27.016672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd6e1c01-1169-4175-8dcf-a6e72ce6d188 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:27.017117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd6e1c01-1169-4175-8dcf-a6e72ce6d188 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:27.039838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-847c40fd-bdd1-4bce-a5df-60448b0817cf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:27.048048 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-847c40fd-bdd1-4bce-a5df-60448b0817cf tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1474 microversion: 2.1 time: 0.237224 Jan 22 21:04:27.048803 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 691/1414] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:26 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1474 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:27.067545 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dd6e1c01-1169-4175-8dcf-a6e72ce6d188 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.063522 Jan 22 21:04:27.068429 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 724/1415] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:27 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:27.263322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3fdb4a89-9e92-4066-96ae-b23f2a1abb74 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:27.265858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3fdb4a89-9e92-4066-96ae-b23f2a1abb74 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:27.270319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fdb4a89-9e92-4066-96ae-b23f2a1abb74 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:27.270773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fdb4a89-9e92-4066-96ae-b23f2a1abb74 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:27.271648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fdb4a89-9e92-4066-96ae-b23f2a1abb74 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:27.272094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fdb4a89-9e92-4066-96ae-b23f2a1abb74 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:27.318206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-09e19a7d-7c55-4ce5-8bf0-ecb6bc4864b8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:27.319221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-09e19a7d-7c55-4ce5-8bf0-ecb6bc4864b8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:27.327095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09e19a7d-7c55-4ce5-8bf0-ecb6bc4864b8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:27.327793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09e19a7d-7c55-4ce5-8bf0-ecb6bc4864b8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:27.328500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09e19a7d-7c55-4ce5-8bf0-ecb6bc4864b8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:27.328950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09e19a7d-7c55-4ce5-8bf0-ecb6bc4864b8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:27.374030 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-09e19a7d-7c55-4ce5-8bf0-ecb6bc4864b8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.059753 Jan 22 21:04:27.375733 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 725/1416] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:27 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:27.416941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4dbf1336-28d9-4c2e-abd0-a1864c410f2b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:27.418044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4dbf1336-28d9-4c2e-abd0-a1864c410f2b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:27.425532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dbf1336-28d9-4c2e-abd0-a1864c410f2b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:27.426000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dbf1336-28d9-4c2e-abd0-a1864c410f2b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:27.426820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dbf1336-28d9-4c2e-abd0-a1864c410f2b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:27.427264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dbf1336-28d9-4c2e-abd0-a1864c410f2b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:27.473743 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4dbf1336-28d9-4c2e-abd0-a1864c410f2b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.061226 Jan 22 21:04:27.474512 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 726/1417] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:27 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:27.528988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3fdb4a89-9e92-4066-96ae-b23f2a1abb74 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:27.536458 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3fdb4a89-9e92-4066-96ae-b23f2a1abb74 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1525 microversion: 2.1 time: 0.277228 Jan 22 21:04:27.537234 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 692/1418] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:27 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1525 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:27.621906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-334c20e8-186b-497d-ab9c-2dcacc78c7c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:27.622844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-334c20e8-186b-497d-ab9c-2dcacc78c7c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:27.630304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-334c20e8-186b-497d-ab9c-2dcacc78c7c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:27.630771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-334c20e8-186b-497d-ab9c-2dcacc78c7c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:27.631717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-334c20e8-186b-497d-ab9c-2dcacc78c7c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:27.632163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-334c20e8-186b-497d-ab9c-2dcacc78c7c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:27.766786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-334c20e8-186b-497d-ab9c-2dcacc78c7c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:27.774231 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-334c20e8-186b-497d-ab9c-2dcacc78c7c5 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1311 microversion: 2.1 time: 0.157197 Jan 22 21:04:27.774784 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 727/1419] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:27 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1311 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:28.081890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6d322dd5-8e05-4ed3-8ccf-db3f0dc9cc75 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:28.081890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6d322dd5-8e05-4ed3-8ccf-db3f0dc9cc75 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:28.088249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d322dd5-8e05-4ed3-8ccf-db3f0dc9cc75 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:28.088767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d322dd5-8e05-4ed3-8ccf-db3f0dc9cc75 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:28.090418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d322dd5-8e05-4ed3-8ccf-db3f0dc9cc75 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:28.090418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d322dd5-8e05-4ed3-8ccf-db3f0dc9cc75 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:28.090740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4b09385e-d1bf-41a7-9b81-041a66d553dd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:28.092057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4b09385e-d1bf-41a7-9b81-041a66d553dd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:28.100195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b09385e-d1bf-41a7-9b81-041a66d553dd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:28.100769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b09385e-d1bf-41a7-9b81-041a66d553dd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:28.102137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b09385e-d1bf-41a7-9b81-041a66d553dd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:28.102860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b09385e-d1bf-41a7-9b81-041a66d553dd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:28.151703 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4b09385e-d1bf-41a7-9b81-041a66d553dd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.066152 Jan 22 21:04:28.153079 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 728/1420] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:28 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:28.236269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6d322dd5-8e05-4ed3-8ccf-db3f0dc9cc75 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:28.251623 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6d322dd5-8e05-4ed3-8ccf-db3f0dc9cc75 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1474 microversion: 2.1 time: 0.189482 Jan 22 21:04:28.252358 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 693/1421] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:28 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1474 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:28.389361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c88aa220-bf44-4ebf-8e82-1ebfd8bd4776 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:28.390773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c88aa220-bf44-4ebf-8e82-1ebfd8bd4776 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:28.398375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c88aa220-bf44-4ebf-8e82-1ebfd8bd4776 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:28.398839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c88aa220-bf44-4ebf-8e82-1ebfd8bd4776 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:28.399653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c88aa220-bf44-4ebf-8e82-1ebfd8bd4776 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:28.400099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c88aa220-bf44-4ebf-8e82-1ebfd8bd4776 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:28.451090 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c88aa220-bf44-4ebf-8e82-1ebfd8bd4776 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.067743 Jan 22 21:04:28.451915 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 729/1422] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:28 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:28.486098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-781496b6-016d-40b2-a17a-4e767a4387f2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:28.487083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-781496b6-016d-40b2-a17a-4e767a4387f2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:28.493750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-781496b6-016d-40b2-a17a-4e767a4387f2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:28.494209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-781496b6-016d-40b2-a17a-4e767a4387f2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:28.495001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-781496b6-016d-40b2-a17a-4e767a4387f2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:28.495447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-781496b6-016d-40b2-a17a-4e767a4387f2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:28.537527 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-781496b6-016d-40b2-a17a-4e767a4387f2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.054862 Jan 22 21:04:28.538114 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 694/1423] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:28 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:28.553941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f10e9ca3-2fd5-4345-a3db-cff308732a1d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:28.555004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f10e9ca3-2fd5-4345-a3db-cff308732a1d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:28.563309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f10e9ca3-2fd5-4345-a3db-cff308732a1d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:28.563766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f10e9ca3-2fd5-4345-a3db-cff308732a1d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:28.564699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f10e9ca3-2fd5-4345-a3db-cff308732a1d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:28.564991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f10e9ca3-2fd5-4345-a3db-cff308732a1d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:28.718494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f10e9ca3-2fd5-4345-a3db-cff308732a1d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:28.726470 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f10e9ca3-2fd5-4345-a3db-cff308732a1d tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1525 microversion: 2.1 time: 0.176561 Jan 22 21:04:28.727406 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 730/1424] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:28 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1525 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:28.792768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f89ce225-2723-4eee-810d-ece895bf5cd1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:28.794404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f89ce225-2723-4eee-810d-ece895bf5cd1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:28.803668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f89ce225-2723-4eee-810d-ece895bf5cd1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:28.804409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f89ce225-2723-4eee-810d-ece895bf5cd1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:28.806197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f89ce225-2723-4eee-810d-ece895bf5cd1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:28.806644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f89ce225-2723-4eee-810d-ece895bf5cd1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:28.969046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f89ce225-2723-4eee-810d-ece895bf5cd1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:28.977318 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f89ce225-2723-4eee-810d-ece895bf5cd1 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1311 microversion: 2.1 time: 0.189612 Jan 22 21:04:28.977933 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 695/1425] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:28 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1311 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:29.164215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-290efd56-15aa-43ea-b4c6-89ee08fec77b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:29.165186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-290efd56-15aa-43ea-b4c6-89ee08fec77b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:29.176476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-290efd56-15aa-43ea-b4c6-89ee08fec77b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:29.177047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-290efd56-15aa-43ea-b4c6-89ee08fec77b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:29.177981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-290efd56-15aa-43ea-b4c6-89ee08fec77b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:29.178503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-290efd56-15aa-43ea-b4c6-89ee08fec77b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:29.231802 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-290efd56-15aa-43ea-b4c6-89ee08fec77b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.071187 Jan 22 21:04:29.232458 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 731/1426] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:29 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:29.269458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-733e8fdc-a0f2-4c47-8925-d986d04b398e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:29.270189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-733e8fdc-a0f2-4c47-8925-d986d04b398e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:29.276598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-733e8fdc-a0f2-4c47-8925-d986d04b398e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:29.277056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-733e8fdc-a0f2-4c47-8925-d986d04b398e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:29.278579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-733e8fdc-a0f2-4c47-8925-d986d04b398e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:29.279083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-733e8fdc-a0f2-4c47-8925-d986d04b398e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:29.444149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-733e8fdc-a0f2-4c47-8925-d986d04b398e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:29.453324 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-733e8fdc-a0f2-4c47-8925-d986d04b398e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1474 microversion: 2.1 time: 0.187580 Jan 22 21:04:29.453954 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 696/1427] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:29 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1474 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:29.464119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-503bae75-4331-45d3-9f42-0adf91d357fa tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:29.465159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-503bae75-4331-45d3-9f42-0adf91d357fa tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:29.475388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-503bae75-4331-45d3-9f42-0adf91d357fa tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:29.479836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-503bae75-4331-45d3-9f42-0adf91d357fa tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:29.479836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-503bae75-4331-45d3-9f42-0adf91d357fa tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:29.479836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-503bae75-4331-45d3-9f42-0adf91d357fa tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:29.525515 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-503bae75-4331-45d3-9f42-0adf91d357fa tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.065779 Jan 22 21:04:29.526189 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 732/1428] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:29 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:29.549013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-98db8707-8167-49f0-94c1-d13d28fed387 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:29.550027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-98db8707-8167-49f0-94c1-d13d28fed387 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:29.557178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98db8707-8167-49f0-94c1-d13d28fed387 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:29.557681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98db8707-8167-49f0-94c1-d13d28fed387 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:29.559065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98db8707-8167-49f0-94c1-d13d28fed387 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:29.559528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98db8707-8167-49f0-94c1-d13d28fed387 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:29.616976 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-98db8707-8167-49f0-94c1-d13d28fed387 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.072183 Jan 22 21:04:29.617555 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 697/1429] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:29 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:29.744560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d5d8928e-766c-433c-9f6b-63241f56c105 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:29.745254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d5d8928e-766c-433c-9f6b-63241f56c105 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:29.755341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5d8928e-766c-433c-9f6b-63241f56c105 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:29.755967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5d8928e-766c-433c-9f6b-63241f56c105 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:29.760088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5d8928e-766c-433c-9f6b-63241f56c105 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:29.760088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5d8928e-766c-433c-9f6b-63241f56c105 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:29.895967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d5d8928e-766c-433c-9f6b-63241f56c105 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:29.903989 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d5d8928e-766c-433c-9f6b-63241f56c105 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1525 microversion: 2.1 time: 0.163433 Jan 22 21:04:29.904945 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 733/1430] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:29 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1525 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:29.996508 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ba9bf013-f9e7-4537-b0fe-0d9a536b1789 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:29.997846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ba9bf013-f9e7-4537-b0fe-0d9a536b1789 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:30.004815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba9bf013-f9e7-4537-b0fe-0d9a536b1789 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:30.017213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba9bf013-f9e7-4537-b0fe-0d9a536b1789 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:30.017213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba9bf013-f9e7-4537-b0fe-0d9a536b1789 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:30.017213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba9bf013-f9e7-4537-b0fe-0d9a536b1789 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:30.017855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-19f781ea-a05a-4360-90bb-fec7f19a7304 req-c8f081df-1d77-426c-a38d-6dea38daa6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61d4e4a-a3e5-4329-94b0-bfcd080a47cb", "name": "network-vif-plugged", "status": "completed", "tag": "54742673-5698-4189-9534-ffa749b79f02"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:30.018324 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:30.018324 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:30.026982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-19f781ea-a05a-4360-90bb-fec7f19a7304 req-c8f081df-1d77-426c-a38d-6dea38daa6d5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:30.027430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-19f781ea-a05a-4360-90bb-fec7f19a7304 req-c8f081df-1d77-426c-a38d-6dea38daa6d5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:30.038085 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-19f781ea-a05a-4360-90bb-fec7f19a7304 req-c8f081df-1d77-426c-a38d-6dea38daa6d5 service nova] Creating event network-vif-plugged:54742673-5698-4189-9534-ffa749b79f02 for instance e61d4e4a-a3e5-4329-94b0-bfcd080a47cb on nch2-master-1 Jan 22 21:04:30.043043 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-19f781ea-a05a-4360-90bb-fec7f19a7304 req-c8f081df-1d77-426c-a38d-6dea38daa6d5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031368 Jan 22 21:04:30.044531 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 734/1431] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:30.151510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ba9bf013-f9e7-4537-b0fe-0d9a536b1789 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:30.167178 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ba9bf013-f9e7-4537-b0fe-0d9a536b1789 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1311 microversion: 2.1 time: 0.174628 Jan 22 21:04:30.167903 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 698/1432] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:29 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1311 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:30.244876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5dbd9236-8321-4b46-b21f-e45819bacb2b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:30.246027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5dbd9236-8321-4b46-b21f-e45819bacb2b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:30.252457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5dbd9236-8321-4b46-b21f-e45819bacb2b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:30.253013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5dbd9236-8321-4b46-b21f-e45819bacb2b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:30.253772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5dbd9236-8321-4b46-b21f-e45819bacb2b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:30.254220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5dbd9236-8321-4b46-b21f-e45819bacb2b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:30.471147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5ec70ca7-1af6-4734-8eed-2c465f0dd9d8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:30.471762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5ec70ca7-1af6-4734-8eed-2c465f0dd9d8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:30.478093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ec70ca7-1af6-4734-8eed-2c465f0dd9d8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:30.478555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ec70ca7-1af6-4734-8eed-2c465f0dd9d8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:30.479340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ec70ca7-1af6-4734-8eed-2c465f0dd9d8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:30.479780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ec70ca7-1af6-4734-8eed-2c465f0dd9d8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:30.545757 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5dbd9236-8321-4b46-b21f-e45819bacb2b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.304646 Jan 22 21:04:30.546790 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 735/1433] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:30 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:30.552438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fcaeeaf4-9477-4e65-a403-550ec74aaa2a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:30.553491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fcaeeaf4-9477-4e65-a403-550ec74aaa2a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:30.561386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcaeeaf4-9477-4e65-a403-550ec74aaa2a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:30.561874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcaeeaf4-9477-4e65-a403-550ec74aaa2a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:30.562675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcaeeaf4-9477-4e65-a403-550ec74aaa2a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:30.563118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcaeeaf4-9477-4e65-a403-550ec74aaa2a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:30.613136 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fcaeeaf4-9477-4e65-a403-550ec74aaa2a tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.064609 Jan 22 21:04:30.613831 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 736/1434] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:30 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:30.622459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5ec70ca7-1af6-4734-8eed-2c465f0dd9d8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:30.629314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-380201af-d8bb-408f-a9be-fb214904b1ba tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:30.630347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-380201af-d8bb-408f-a9be-fb214904b1ba tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:30.633888 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5ec70ca7-1af6-4734-8eed-2c465f0dd9d8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1474 microversion: 2.1 time: 0.163439 Jan 22 21:04:30.633888 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 699/1435] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:30 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1474 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:30.638008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-380201af-d8bb-408f-a9be-fb214904b1ba tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:30.638481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-380201af-d8bb-408f-a9be-fb214904b1ba tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:30.639408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-380201af-d8bb-408f-a9be-fb214904b1ba tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:30.639844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-380201af-d8bb-408f-a9be-fb214904b1ba tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:30.678465 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-380201af-d8bb-408f-a9be-fb214904b1ba tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.053463 Jan 22 21:04:30.679409 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 737/1436] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:30 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:30.921579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-34d548fe-fcdd-4fac-a096-e6628dc1dac7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:30.922100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-34d548fe-fcdd-4fac-a096-e6628dc1dac7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:30.928498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34d548fe-fcdd-4fac-a096-e6628dc1dac7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:30.928977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34d548fe-fcdd-4fac-a096-e6628dc1dac7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:30.929786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34d548fe-fcdd-4fac-a096-e6628dc1dac7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:30.930225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34d548fe-fcdd-4fac-a096-e6628dc1dac7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:31.061045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-34d548fe-fcdd-4fac-a096-e6628dc1dac7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:31.071153 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-34d548fe-fcdd-4fac-a096-e6628dc1dac7 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1525 microversion: 2.1 time: 0.153538 Jan 22 21:04:31.071734 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 700/1437] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:30 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1525 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:31.185326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f65004b9-0fff-4939-8d1d-1cd2fd090e63 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:31.185990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f65004b9-0fff-4939-8d1d-1cd2fd090e63 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:31.193636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f65004b9-0fff-4939-8d1d-1cd2fd090e63 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:31.194101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f65004b9-0fff-4939-8d1d-1cd2fd090e63 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:31.194905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f65004b9-0fff-4939-8d1d-1cd2fd090e63 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:31.195354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f65004b9-0fff-4939-8d1d-1cd2fd090e63 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:31.329196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f65004b9-0fff-4939-8d1d-1cd2fd090e63 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:31.337288 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f65004b9-0fff-4939-8d1d-1cd2fd090e63 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1311 microversion: 2.1 time: 0.156648 Jan 22 21:04:31.337923 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 738/1438] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:31 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1311 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:31.558003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d7203e81-44d4-4a2a-a803-158c841e09fa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:31.559001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d7203e81-44d4-4a2a-a803-158c841e09fa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:31.566363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7203e81-44d4-4a2a-a803-158c841e09fa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:31.566816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7203e81-44d4-4a2a-a803-158c841e09fa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:31.567604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7203e81-44d4-4a2a-a803-158c841e09fa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:31.568048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7203e81-44d4-4a2a-a803-158c841e09fa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:31.608202 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d7203e81-44d4-4a2a-a803-158c841e09fa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.053829 Jan 22 21:04:31.608819 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 701/1439] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:31 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:31.625091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cf3de420-f387-4e59-a4a9-244e0ff62855 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:31.626167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cf3de420-f387-4e59-a4a9-244e0ff62855 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:31.633655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf3de420-f387-4e59-a4a9-244e0ff62855 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:31.633655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf3de420-f387-4e59-a4a9-244e0ff62855 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:31.634066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf3de420-f387-4e59-a4a9-244e0ff62855 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:31.634551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf3de420-f387-4e59-a4a9-244e0ff62855 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:31.649124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-79f538d2-98bb-4469-956e-abe813429682 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:31.649878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-79f538d2-98bb-4469-956e-abe813429682 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:31.657245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79f538d2-98bb-4469-956e-abe813429682 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:31.657955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79f538d2-98bb-4469-956e-abe813429682 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:31.658750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79f538d2-98bb-4469-956e-abe813429682 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:31.659187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79f538d2-98bb-4469-956e-abe813429682 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:31.677463 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cf3de420-f387-4e59-a4a9-244e0ff62855 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.056727 Jan 22 21:04:31.678138 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 739/1440] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:31 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:31.690865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d1690fd6-7027-4ff2-a7e3-f88618cac93d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:31.691871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d1690fd6-7027-4ff2-a7e3-f88618cac93d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:31.698925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1690fd6-7027-4ff2-a7e3-f88618cac93d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:31.699382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1690fd6-7027-4ff2-a7e3-f88618cac93d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:31.705860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1690fd6-7027-4ff2-a7e3-f88618cac93d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:31.705860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1690fd6-7027-4ff2-a7e3-f88618cac93d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:31.747899 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d1690fd6-7027-4ff2-a7e3-f88618cac93d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.060353 Jan 22 21:04:31.749603 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 740/1441] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:31 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:31.820162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-79f538d2-98bb-4469-956e-abe813429682 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:31.828628 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-79f538d2-98bb-4469-956e-abe813429682 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1474 microversion: 2.1 time: 0.183351 Jan 22 21:04:31.829200 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 702/1442] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:31 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1474 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:32.092879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-94e602ed-d93c-4ad5-9474-25bc2f5d7632 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:32.093779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-94e602ed-d93c-4ad5-9474-25bc2f5d7632 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:32.100839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94e602ed-d93c-4ad5-9474-25bc2f5d7632 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.101302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94e602ed-d93c-4ad5-9474-25bc2f5d7632 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.102128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94e602ed-d93c-4ad5-9474-25bc2f5d7632 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.102580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94e602ed-d93c-4ad5-9474-25bc2f5d7632 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.245675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-94e602ed-d93c-4ad5-9474-25bc2f5d7632 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:32.254517 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-94e602ed-d93c-4ad5-9474-25bc2f5d7632 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1510 microversion: 2.1 time: 0.167335 Jan 22 21:04:32.255417 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 741/1443] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:32 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:32.277386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d239e2ce-49b4-4afa-bd3a-3c0772148953 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:32.278709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d239e2ce-49b4-4afa-bd3a-3c0772148953 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:32.285235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d239e2ce-49b4-4afa-bd3a-3c0772148953 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.285821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d239e2ce-49b4-4afa-bd3a-3c0772148953 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.286523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d239e2ce-49b4-4afa-bd3a-3c0772148953 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.286973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d239e2ce-49b4-4afa-bd3a-3c0772148953 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.355154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1a901245-dbc6-421a-9a7a-214838a4647b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:32.357479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1a901245-dbc6-421a-9a7a-214838a4647b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:32.369039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a901245-dbc6-421a-9a7a-214838a4647b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.369681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a901245-dbc6-421a-9a7a-214838a4647b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.370599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a901245-dbc6-421a-9a7a-214838a4647b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.371124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a901245-dbc6-421a-9a7a-214838a4647b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.434791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d239e2ce-49b4-4afa-bd3a-3c0772148953 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:32.450376 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d239e2ce-49b4-4afa-bd3a-3c0772148953 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 200 len: 1510 microversion: 2.1 time: 0.175831 Jan 22 21:04:32.452993 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 703/1444] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:32 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:32.468902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c85209d0-2e4c-4964-a919-056ee13103b3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:32.468902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c85209d0-2e4c-4964-a919-056ee13103b3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:32.475027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c85209d0-2e4c-4964-a919-056ee13103b3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.475259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c85209d0-2e4c-4964-a919-056ee13103b3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.476325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c85209d0-2e4c-4964-a919-056ee13103b3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.476764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c85209d0-2e4c-4964-a919-056ee13103b3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.503495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c85209d0-2e4c-4964-a919-056ee13103b3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:04:32.533245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1a901245-dbc6-421a-9a7a-214838a4647b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:32.540980 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1a901245-dbc6-421a-9a7a-214838a4647b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1311 microversion: 2.1 time: 0.190859 Jan 22 21:04:32.541607 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 742/1445] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:32 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1311 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:32.619810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-047c0e81-1e02-4473-9f89-c370c759167d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:32.620705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-047c0e81-1e02-4473-9f89-c370c759167d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:32.628040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-047c0e81-1e02-4473-9f89-c370c759167d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.628492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-047c0e81-1e02-4473-9f89-c370c759167d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.629281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-047c0e81-1e02-4473-9f89-c370c759167d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.629746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-047c0e81-1e02-4473-9f89-c370c759167d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.673829 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-047c0e81-1e02-4473-9f89-c370c759167d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.057649 Jan 22 21:04:32.674464 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 743/1446] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:32 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:32.690635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4012047c-34f7-40b8-83a3-89eea1741fbd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:32.691658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4012047c-34f7-40b8-83a3-89eea1741fbd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:32.698949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4012047c-34f7-40b8-83a3-89eea1741fbd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.699439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4012047c-34f7-40b8-83a3-89eea1741fbd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.700990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4012047c-34f7-40b8-83a3-89eea1741fbd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.701350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4012047c-34f7-40b8-83a3-89eea1741fbd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.742992 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4012047c-34f7-40b8-83a3-89eea1741fbd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.056338 Jan 22 21:04:32.743566 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 744/1447] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:32 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:32.759739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3f848a99-4441-4e9b-989e-36e3af44755b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:32.760734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3f848a99-4441-4e9b-989e-36e3af44755b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:32.767818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f848a99-4441-4e9b-989e-36e3af44755b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.768282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f848a99-4441-4e9b-989e-36e3af44755b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.769076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f848a99-4441-4e9b-989e-36e3af44755b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.774471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f848a99-4441-4e9b-989e-36e3af44755b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.794803 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c85209d0-2e4c-4964-a919-056ee13103b3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "DELETE /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 204 len: 0 microversion: 2.1 time: 0.329819 Jan 22 21:04:32.799540 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 704/1448] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:04:32 2022] DELETE /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:04:32.812761 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3f848a99-4441-4e9b-989e-36e3af44755b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.056594 Jan 22 21:04:32.813439 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 745/1449] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:32 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:32.847018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-423f793b-98c3-49be-904d-d92024ecbe3e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:32.847777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-423f793b-98c3-49be-904d-d92024ecbe3e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:32.853543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-423f793b-98c3-49be-904d-d92024ecbe3e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.854181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-423f793b-98c3-49be-904d-d92024ecbe3e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.854972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-423f793b-98c3-49be-904d-d92024ecbe3e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:32.855411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-423f793b-98c3-49be-904d-d92024ecbe3e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:32.902786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1565811080", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "f2f664c9-4305-4e89-83dd-d4a09e707645"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:32.955111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] validate_networks() for [('f2f664c9-4305-4e89-83dd-d4a09e707645', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:04:32.988928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-423f793b-98c3-49be-904d-d92024ecbe3e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:32.996930 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-423f793b-98c3-49be-904d-d92024ecbe3e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1474 microversion: 2.1 time: 0.154283 Jan 22 21:04:32.998015 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 705/1450] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:32 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1474 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:33.320357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:04:33.320812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:04:33.321245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:04:33.321682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:04:33.322099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:04:33.331312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:33.331764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:33.332582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:33.333022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:33.350771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Getting quotas for project 0ac10456f0ea4fd5b1d2948b4856ca84. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:33.356589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Getting quotas for user 4847dd82943e4bbfb54cdd49aed12b7b and project 0ac10456f0ea4fd5b1d2948b4856ca84. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:33.368972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:04:33.371527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:04:33.530286 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f2b69c14-d3bd-43fd-870f-e6f3206a0a67 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.631500 Jan 22 21:04:33.531255 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 746/1451] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:04:32 2022] POST /compute/v2.1/servers => generated 382 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:04:33.542179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6884d190-f31e-45bd-8320-5db9b20d9ab6 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:33.542179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6884d190-f31e-45bd-8320-5db9b20d9ab6 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:33.565938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e71bb18c-2e2d-4249-a01f-a56f499f2079 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:33.566639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e71bb18c-2e2d-4249-a01f-a56f499f2079 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:33.573366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e71bb18c-2e2d-4249-a01f-a56f499f2079 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:33.573862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e71bb18c-2e2d-4249-a01f-a56f499f2079 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:33.574802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e71bb18c-2e2d-4249-a01f-a56f499f2079 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:33.575717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e71bb18c-2e2d-4249-a01f-a56f499f2079 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:33.609723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6884d190-f31e-45bd-8320-5db9b20d9ab6 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:33.620592 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6884d190-f31e-45bd-8320-5db9b20d9ab6 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1222 microversion: 2.1 time: 0.083336 Jan 22 21:04:33.625673 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 706/1452] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:33 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:33.685621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0a252544-2a6a-4a24-9d7b-7f37bccfdeb6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:33.686760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0a252544-2a6a-4a24-9d7b-7f37bccfdeb6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:33.693935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a252544-2a6a-4a24-9d7b-7f37bccfdeb6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:33.694785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a252544-2a6a-4a24-9d7b-7f37bccfdeb6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:33.696037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a252544-2a6a-4a24-9d7b-7f37bccfdeb6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:33.696865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a252544-2a6a-4a24-9d7b-7f37bccfdeb6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:33.731708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e71bb18c-2e2d-4249-a01f-a56f499f2079 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:33.739165 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e71bb18c-2e2d-4249-a01f-a56f499f2079 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1311 microversion: 2.1 time: 0.177355 Jan 22 21:04:33.739736 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 747/1453] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:33 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1311 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:33.743932 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0a252544-2a6a-4a24-9d7b-7f37bccfdeb6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.062865 Jan 22 21:04:33.744992 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 707/1454] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:33 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:33.755201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1e8d3bc-df2f-4b9a-be56-eeb667c6631e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:33.756209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1e8d3bc-df2f-4b9a-be56-eeb667c6631e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:33.763024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1e8d3bc-df2f-4b9a-be56-eeb667c6631e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:33.763581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1e8d3bc-df2f-4b9a-be56-eeb667c6631e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:33.764379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1e8d3bc-df2f-4b9a-be56-eeb667c6631e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:33.764824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1e8d3bc-df2f-4b9a-be56-eeb667c6631e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:33.803468 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1e8d3bc-df2f-4b9a-be56-eeb667c6631e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.051950 Jan 22 21:04:33.804102 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 748/1455] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:33 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:33.824662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96e4ba84-6d35-4f99-8c74-0a08d2d05ae5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:33.826692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96e4ba84-6d35-4f99-8c74-0a08d2d05ae5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:33.833362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96e4ba84-6d35-4f99-8c74-0a08d2d05ae5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:33.833848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96e4ba84-6d35-4f99-8c74-0a08d2d05ae5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:33.834642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96e4ba84-6d35-4f99-8c74-0a08d2d05ae5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:33.835089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96e4ba84-6d35-4f99-8c74-0a08d2d05ae5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:33.876941 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96e4ba84-6d35-4f99-8c74-0a08d2d05ae5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.056165 Jan 22 21:04:33.884021 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 708/1456] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:33 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:34.015322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ef7c5b7e-7c83-4d0a-aed8-910cf8fa2508 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:34.015965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ef7c5b7e-7c83-4d0a-aed8-910cf8fa2508 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:34.023530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef7c5b7e-7c83-4d0a-aed8-910cf8fa2508 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:34.024039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef7c5b7e-7c83-4d0a-aed8-910cf8fa2508 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:34.024888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef7c5b7e-7c83-4d0a-aed8-910cf8fa2508 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:34.025302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef7c5b7e-7c83-4d0a-aed8-910cf8fa2508 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:34.150479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-3905e8a0-9c60-4178-a56b-ff731e1796e1 req-46f4ae2f-0cf2-4f7c-a4ab-abb1e774fb6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7779535a-c217-4b7c-bd47-d83487d68e73", "name": "network-vif-plugged", "status": "completed", "tag": "74c18d40-5e04-41a9-b5c1-70950f848539"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:34.151982 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:34.151982 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:34.160848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3905e8a0-9c60-4178-a56b-ff731e1796e1 req-46f4ae2f-0cf2-4f7c-a4ab-abb1e774fb6c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:34.161290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3905e8a0-9c60-4178-a56b-ff731e1796e1 req-46f4ae2f-0cf2-4f7c-a4ab-abb1e774fb6c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:34.174096 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-3905e8a0-9c60-4178-a56b-ff731e1796e1 req-46f4ae2f-0cf2-4f7c-a4ab-abb1e774fb6c service nova] Creating event network-vif-plugged:74c18d40-5e04-41a9-b5c1-70950f848539 for instance 7779535a-c217-4b7c-bd47-d83487d68e73 on nch2-master-1 Jan 22 21:04:34.179270 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-3905e8a0-9c60-4178-a56b-ff731e1796e1 req-46f4ae2f-0cf2-4f7c-a4ab-abb1e774fb6c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033497 Jan 22 21:04:34.180406 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 709/1457] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:04:34.191762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ef7c5b7e-7c83-4d0a-aed8-910cf8fa2508 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:34.201119 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ef7c5b7e-7c83-4d0a-aed8-910cf8fa2508 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1474 microversion: 2.1 time: 0.190278 Jan 22 21:04:34.201864 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 749/1458] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:34 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1474 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:34.640033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d32c39d2-12d1-45b7-b070-4ae44cc91e95 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:34.640729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d32c39d2-12d1-45b7-b070-4ae44cc91e95 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:34.647086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d32c39d2-12d1-45b7-b070-4ae44cc91e95 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:34.647560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d32c39d2-12d1-45b7-b070-4ae44cc91e95 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:34.648371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d32c39d2-12d1-45b7-b070-4ae44cc91e95 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:34.648817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d32c39d2-12d1-45b7-b070-4ae44cc91e95 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:34.739369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d32c39d2-12d1-45b7-b070-4ae44cc91e95 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:34.748032 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d32c39d2-12d1-45b7-b070-4ae44cc91e95 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1226 microversion: 2.1 time: 0.113733 Jan 22 21:04:34.748601 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 710/1459] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:34 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:34.756317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-060058cb-0fff-4278-8c6f-9832ea5f1eb0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:34.757549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-060058cb-0fff-4278-8c6f-9832ea5f1eb0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:34.762946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c47b53d9-1ac2-4864-bf08-e4dd791d2761 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:34.764024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c47b53d9-1ac2-4864-bf08-e4dd791d2761 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:34.765282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-060058cb-0fff-4278-8c6f-9832ea5f1eb0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:34.765991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-060058cb-0fff-4278-8c6f-9832ea5f1eb0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:34.766957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-060058cb-0fff-4278-8c6f-9832ea5f1eb0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:34.768179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-060058cb-0fff-4278-8c6f-9832ea5f1eb0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:34.770815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c47b53d9-1ac2-4864-bf08-e4dd791d2761 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:34.771862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c47b53d9-1ac2-4864-bf08-e4dd791d2761 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:34.772772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c47b53d9-1ac2-4864-bf08-e4dd791d2761 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:34.773425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c47b53d9-1ac2-4864-bf08-e4dd791d2761 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:34.829343 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c47b53d9-1ac2-4864-bf08-e4dd791d2761 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.070443 Jan 22 21:04:34.830307 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 711/1460] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:34 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:34.835311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1a60035b-49ff-4b9b-a6be-c26ccecef109 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:34.836373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1a60035b-49ff-4b9b-a6be-c26ccecef109 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:34.844726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a60035b-49ff-4b9b-a6be-c26ccecef109 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:34.845186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a60035b-49ff-4b9b-a6be-c26ccecef109 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:34.846018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a60035b-49ff-4b9b-a6be-c26ccecef109 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:34.846694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a60035b-49ff-4b9b-a6be-c26ccecef109 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:34.893008 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1a60035b-49ff-4b9b-a6be-c26ccecef109 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.061242 Jan 22 21:04:34.894129 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 712/1461] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:34 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:34.900122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11c90dc0-3769-4b4b-96b4-854fee600202 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:34.901458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-11c90dc0-3769-4b4b-96b4-854fee600202 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:34.911239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c90dc0-3769-4b4b-96b4-854fee600202 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:34.912085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c90dc0-3769-4b4b-96b4-854fee600202 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:34.913226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c90dc0-3769-4b4b-96b4-854fee600202 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:34.913798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c90dc0-3769-4b4b-96b4-854fee600202 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:34.931426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-060058cb-0fff-4278-8c6f-9832ea5f1eb0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:34.939111 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-060058cb-0fff-4278-8c6f-9832ea5f1eb0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1311 microversion: 2.1 time: 0.186740 Jan 22 21:04:34.940043 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 750/1462] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:34 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1311 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:34.964836 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-11c90dc0-3769-4b4b-96b4-854fee600202 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.068950 Jan 22 21:04:34.966439 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 713/1463] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:34 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:35.219663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9bfda49f-8ef4-42cf-baa8-6d1e1b86e386 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:35.220710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9bfda49f-8ef4-42cf-baa8-6d1e1b86e386 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:35.235690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bfda49f-8ef4-42cf-baa8-6d1e1b86e386 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:35.235900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bfda49f-8ef4-42cf-baa8-6d1e1b86e386 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:35.237437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bfda49f-8ef4-42cf-baa8-6d1e1b86e386 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:35.239246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bfda49f-8ef4-42cf-baa8-6d1e1b86e386 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:35.318379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-819a14a3-169a-46c3-9718-180ae25474c1 req-ccd2701d-9d59-49ea-8e5a-b51e19d8f2aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61d4e4a-a3e5-4329-94b0-bfcd080a47cb", "name": "network-vif-deleted", "tag": "54742673-5698-4189-9534-ffa749b79f02"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:35.319891 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:35.319891 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:35.329730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-819a14a3-169a-46c3-9718-180ae25474c1 req-ccd2701d-9d59-49ea-8e5a-b51e19d8f2aa service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:35.330185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-819a14a3-169a-46c3-9718-180ae25474c1 req-ccd2701d-9d59-49ea-8e5a-b51e19d8f2aa service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:35.342147 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-819a14a3-169a-46c3-9718-180ae25474c1 req-ccd2701d-9d59-49ea-8e5a-b51e19d8f2aa service nova] Creating event network-vif-deleted:54742673-5698-4189-9534-ffa749b79f02 for instance e61d4e4a-a3e5-4329-94b0-bfcd080a47cb on nch2-master-1 Jan 22 21:04:35.347306 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-819a14a3-169a-46c3-9718-180ae25474c1 req-ccd2701d-9d59-49ea-8e5a-b51e19d8f2aa service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034801 Jan 22 21:04:35.348089 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 714/1464] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:35.390531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9bfda49f-8ef4-42cf-baa8-6d1e1b86e386 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:35.398653 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9bfda49f-8ef4-42cf-baa8-6d1e1b86e386 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1474 microversion: 2.1 time: 0.183754 Jan 22 21:04:35.399218 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 751/1465] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:35 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1474 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:35.765462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a13d763e-4fe0-42bd-bfed-a9dc67255b01 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:35.766131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a13d763e-4fe0-42bd-bfed-a9dc67255b01 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:35.773231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a13d763e-4fe0-42bd-bfed-a9dc67255b01 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:35.773764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a13d763e-4fe0-42bd-bfed-a9dc67255b01 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:35.774584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a13d763e-4fe0-42bd-bfed-a9dc67255b01 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:35.775030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a13d763e-4fe0-42bd-bfed-a9dc67255b01 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:35.838681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a13d763e-4fe0-42bd-bfed-a9dc67255b01 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:35.842731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2c9d18f0-1457-42c1-9948-aba6988c7b34 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:35.843931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2c9d18f0-1457-42c1-9948-aba6988c7b34 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:35.847033 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a13d763e-4fe0-42bd-bfed-a9dc67255b01 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1274 microversion: 2.1 time: 0.086552 Jan 22 21:04:35.847619 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 715/1466] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:35 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:35.851916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c9d18f0-1457-42c1-9948-aba6988c7b34 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:35.852795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c9d18f0-1457-42c1-9948-aba6988c7b34 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:35.853628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c9d18f0-1457-42c1-9948-aba6988c7b34 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:35.854507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c9d18f0-1457-42c1-9948-aba6988c7b34 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:35.894868 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2c9d18f0-1457-42c1-9948-aba6988c7b34 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.057255 Jan 22 21:04:35.895788 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 752/1467] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:35 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:35.904601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a6f52c2b-75cb-45f9-a591-c0fcb827f63e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:35.905525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a6f52c2b-75cb-45f9-a591-c0fcb827f63e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:35.911938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6f52c2b-75cb-45f9-a591-c0fcb827f63e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:35.912392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6f52c2b-75cb-45f9-a591-c0fcb827f63e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:35.913179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6f52c2b-75cb-45f9-a591-c0fcb827f63e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:35.913662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6f52c2b-75cb-45f9-a591-c0fcb827f63e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:35.957914 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a6f52c2b-75cb-45f9-a591-c0fcb827f63e tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.057309 Jan 22 21:04:35.958199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5ad103fc-787b-44cf-91e7-adf2d028810c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:35.958690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5ad103fc-787b-44cf-91e7-adf2d028810c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:35.962668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 716/1468] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:35 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:35.966895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ad103fc-787b-44cf-91e7-adf2d028810c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:35.967354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ad103fc-787b-44cf-91e7-adf2d028810c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:35.968406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ad103fc-787b-44cf-91e7-adf2d028810c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:35.968848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ad103fc-787b-44cf-91e7-adf2d028810c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:35.985068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6a2b059a-0803-4029-9b30-3f576ef5be34 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:35.986442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6a2b059a-0803-4029-9b30-3f576ef5be34 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:35.993716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a2b059a-0803-4029-9b30-3f576ef5be34 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:35.994230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a2b059a-0803-4029-9b30-3f576ef5be34 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:35.995028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a2b059a-0803-4029-9b30-3f576ef5be34 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:35.995463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a2b059a-0803-4029-9b30-3f576ef5be34 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:36.050009 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6a2b059a-0803-4029-9b30-3f576ef5be34 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.074747 Jan 22 21:04:36.052343 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 717/1469] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:35 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:36.114894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5ad103fc-787b-44cf-91e7-adf2d028810c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:36.124133 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5ad103fc-787b-44cf-91e7-adf2d028810c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1490 microversion: 2.1 time: 0.171279 Jan 22 21:04:36.127159 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 753/1470] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:35 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1490 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:36.143587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-488decbd-3d4a-44d1-b641-99d4ac86a63c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1828398479"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:36.144830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-488decbd-3d4a-44d1-b641-99d4ac86a63c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:36.152425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-488decbd-3d4a-44d1-b641-99d4ac86a63c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:36.153440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-488decbd-3d4a-44d1-b641-99d4ac86a63c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:36.154694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-488decbd-3d4a-44d1-b641-99d4ac86a63c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:36.155354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-488decbd-3d4a-44d1-b641-99d4ac86a63c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:36.420540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aadab15f-1a80-4419-838e-f7fa7e724ee8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:36.421170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aadab15f-1a80-4419-838e-f7fa7e724ee8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:36.427493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aadab15f-1a80-4419-838e-f7fa7e724ee8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:36.428238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aadab15f-1a80-4419-838e-f7fa7e724ee8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:36.429037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aadab15f-1a80-4419-838e-f7fa7e724ee8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:36.429478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aadab15f-1a80-4419-838e-f7fa7e724ee8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:36.589522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aadab15f-1a80-4419-838e-f7fa7e724ee8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:36.605704 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aadab15f-1a80-4419-838e-f7fa7e724ee8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1474 microversion: 2.1 time: 0.191531 Jan 22 21:04:36.607102 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 754/1471] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:36 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1474 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:36.805784 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-488decbd-3d4a-44d1-b641-99d4ac86a63c tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "POST /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73/action" status: 202 len: 0 microversion: 2.1 time: 0.666908 Jan 22 21:04:36.806379 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 718/1472] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:36 2022] POST /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 22 21:04:36.816497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e8808eba-2100-4190-a4f9-ceee3c50fb05 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5e134c0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:36.864375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-989ef287-c49f-442f-995e-8b8ade8d56a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:36.864934 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e8808eba-2100-4190-a4f9-ceee3c50fb05 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/d21b11d3-4e8d-4c57-b549-5fd85bf2bb8f" status: 200 len: 1419 microversion: 2.1 time: 0.052114 Jan 22 21:04:36.865296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-989ef287-c49f-442f-995e-8b8ade8d56a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:36.871799 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 755/1473] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:36 2022] GET /compute/v2.1/images/d21b11d3-4e8d-4c57-b549-5fd85bf2bb8f => generated 1419 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:36.872228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-989ef287-c49f-442f-995e-8b8ade8d56a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:36.872712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-989ef287-c49f-442f-995e-8b8ade8d56a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:36.873631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-989ef287-c49f-442f-995e-8b8ade8d56a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:36.874011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-989ef287-c49f-442f-995e-8b8ade8d56a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:36.879545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-68498a3c-80e5-4ac9-8726-633cfd6ad035 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5e0a820>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:36.939026 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-68498a3c-80e5-4ac9-8726-633cfd6ad035 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/d21b11d3-4e8d-4c57-b549-5fd85bf2bb8f" status: 200 len: 1419 microversion: 2.1 time: 0.065604 Jan 22 21:04:36.940811 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 756/1474] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:36 2022] GET /compute/v2.1/images/d21b11d3-4e8d-4c57-b549-5fd85bf2bb8f => generated 1419 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:36.945986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1756f6b-0730-4f1c-8713-38ac4383c04b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:36.947435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1756f6b-0730-4f1c-8713-38ac4383c04b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:36.954555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1756f6b-0730-4f1c-8713-38ac4383c04b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:36.958097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1756f6b-0730-4f1c-8713-38ac4383c04b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:36.958097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1756f6b-0730-4f1c-8713-38ac4383c04b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:36.958097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1756f6b-0730-4f1c-8713-38ac4383c04b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:36.999360 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1756f6b-0730-4f1c-8713-38ac4383c04b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.056849 Jan 22 21:04:37.000015 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 757/1475] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:36 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:37.005050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-52308e70-550f-454c-9c14-0547dad4ee0a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5e5a550>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:37.058042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-989ef287-c49f-442f-995e-8b8ade8d56a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:37.065668 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-989ef287-c49f-442f-995e-8b8ade8d56a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1322 microversion: 2.1 time: 0.205296 Jan 22 21:04:37.066241 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 719/1476] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:36 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:37.080795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5f4253cc-68bb-41bb-823a-ff248b88fa1f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:37.081790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5f4253cc-68bb-41bb-823a-ff248b88fa1f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:37.087786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f4253cc-68bb-41bb-823a-ff248b88fa1f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:37.088245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f4253cc-68bb-41bb-823a-ff248b88fa1f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:37.089076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f4253cc-68bb-41bb-823a-ff248b88fa1f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:37.089539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f4253cc-68bb-41bb-823a-ff248b88fa1f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:37.131794 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5f4253cc-68bb-41bb-823a-ff248b88fa1f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.054499 Jan 22 21:04:37.136399 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 720/1477] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:37 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:37.139170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cd03ab08-e31f-4d99-9418-e369a64d7cc2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:37.140186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cd03ab08-e31f-4d99-9418-e369a64d7cc2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:37.148019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd03ab08-e31f-4d99-9418-e369a64d7cc2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:37.148475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd03ab08-e31f-4d99-9418-e369a64d7cc2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:37.149426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd03ab08-e31f-4d99-9418-e369a64d7cc2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:37.149908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd03ab08-e31f-4d99-9418-e369a64d7cc2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:37.190927 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cd03ab08-e31f-4d99-9418-e369a64d7cc2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.055863 Jan 22 21:04:37.191728 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 721/1478] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:37 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:37.301851 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-52308e70-550f-454c-9c14-0547dad4ee0a tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/images/d21b11d3-4e8d-4c57-b549-5fd85bf2bb8f" status: 204 len: 0 microversion: 2.1 time: 0.300258 Jan 22 21:04:37.302457 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 758/1479] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:37 2022] DELETE /compute/v2.1/images/d21b11d3-4e8d-4c57-b549-5fd85bf2bb8f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:37.312215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-30a5dbd0-0d0f-46a9-9e24-398cf0104661 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5cf9c10>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:37.338550 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-30a5dbd0-0d0f-46a9-9e24-398cf0104661 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] HTTP exception thrown: Image not found. Jan 22 21:04:37.339179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-30a5dbd0-0d0f-46a9-9e24-398cf0104661 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Returning 404 to user: Image not found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:37.340117 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-30a5dbd0-0d0f-46a9-9e24-398cf0104661 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/images/d21b11d3-4e8d-4c57-b549-5fd85bf2bb8f" status: 404 len: 62 microversion: 2.1 time: 0.033042 Jan 22 21:04:37.344475 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 722/1480] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:04:37 2022] GET /compute/v2.1/images/d21b11d3-4e8d-4c57-b549-5fd85bf2bb8f => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 22 21:04:37.349440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7f12fd92-033f-4cf9-87a3-6a728f3accae tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:37.350208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7f12fd92-033f-4cf9-87a3-6a728f3accae tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:37.357209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f12fd92-033f-4cf9-87a3-6a728f3accae tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:37.357790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f12fd92-033f-4cf9-87a3-6a728f3accae tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:37.358666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f12fd92-033f-4cf9-87a3-6a728f3accae tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:37.359151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f12fd92-033f-4cf9-87a3-6a728f3accae tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:37.494868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7f12fd92-033f-4cf9-87a3-6a728f3accae tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:37.503342 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7f12fd92-033f-4cf9-87a3-6a728f3accae tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1502 microversion: 2.1 time: 0.157603 Jan 22 21:04:37.503914 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 759/1481] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:37 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:37.625105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a51d5404-6192-4d52-8793-28e03944d2a5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:37.626023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a51d5404-6192-4d52-8793-28e03944d2a5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:37.632239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a51d5404-6192-4d52-8793-28e03944d2a5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:37.632786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a51d5404-6192-4d52-8793-28e03944d2a5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:37.633688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a51d5404-6192-4d52-8793-28e03944d2a5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:37.634201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a51d5404-6192-4d52-8793-28e03944d2a5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:37.857674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a51d5404-6192-4d52-8793-28e03944d2a5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:37.865173 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a51d5404-6192-4d52-8793-28e03944d2a5 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1474 microversion: 2.1 time: 0.246050 Jan 22 21:04:37.868519 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 723/1482] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:37 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1474 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:38.011647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-738fbbfc-28fa-4d2b-a7f6-82b8c395a9ed req-090b3cd1-2a7e-482e-ac7b-8a5d9d8aabda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "479ddfa2-304b-488e-ad75-0f509ecae3aa", "tag": "5fb54162-4687-4417-9f29-8c8d96aaa6ce"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:38.015651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-538211ed-97df-4cb5-b92d-31634727c67e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:38.016693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-538211ed-97df-4cb5-b92d-31634727c67e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:38.020805 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:38.020805 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:38.024589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-538211ed-97df-4cb5-b92d-31634727c67e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:38.025429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-538211ed-97df-4cb5-b92d-31634727c67e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:38.031351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-538211ed-97df-4cb5-b92d-31634727c67e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:38.031351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-538211ed-97df-4cb5-b92d-31634727c67e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:38.031725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-738fbbfc-28fa-4d2b-a7f6-82b8c395a9ed req-090b3cd1-2a7e-482e-ac7b-8a5d9d8aabda service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:38.031725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-738fbbfc-28fa-4d2b-a7f6-82b8c395a9ed req-090b3cd1-2a7e-482e-ac7b-8a5d9d8aabda service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:38.042953 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-738fbbfc-28fa-4d2b-a7f6-82b8c395a9ed req-090b3cd1-2a7e-482e-ac7b-8a5d9d8aabda service nova] Creating event network-changed:5fb54162-4687-4417-9f29-8c8d96aaa6ce for instance 479ddfa2-304b-488e-ad75-0f509ecae3aa on nch2-master-1 Jan 22 21:04:38.048091 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-738fbbfc-28fa-4d2b-a7f6-82b8c395a9ed req-090b3cd1-2a7e-482e-ac7b-8a5d9d8aabda service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043951 Jan 22 21:04:38.050358 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 760/1483] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:38.071576 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-538211ed-97df-4cb5-b92d-31634727c67e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.064374 Jan 22 21:04:38.072215 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 724/1484] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:38 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:38.083565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6796805e-aaff-40fe-82e6-a6a035b682d3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:38.084191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6796805e-aaff-40fe-82e6-a6a035b682d3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:38.091940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6796805e-aaff-40fe-82e6-a6a035b682d3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:38.092403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6796805e-aaff-40fe-82e6-a6a035b682d3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:38.093479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6796805e-aaff-40fe-82e6-a6a035b682d3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:38.093955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6796805e-aaff-40fe-82e6-a6a035b682d3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:38.145056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b2b4586b-6d46-46e4-bce6-7cfa18dd737d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:38.146169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b2b4586b-6d46-46e4-bce6-7cfa18dd737d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:38.154243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2b4586b-6d46-46e4-bce6-7cfa18dd737d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:38.154986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2b4586b-6d46-46e4-bce6-7cfa18dd737d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:38.155953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2b4586b-6d46-46e4-bce6-7cfa18dd737d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:38.156555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2b4586b-6d46-46e4-bce6-7cfa18dd737d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:38.202535 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b2b4586b-6d46-46e4-bce6-7cfa18dd737d tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.061425 Jan 22 21:04:38.203458 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 725/1485] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:38 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:38.208775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e9a7084f-e5e0-42ae-a78b-f5d7bbe52168 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:38.209797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e9a7084f-e5e0-42ae-a78b-f5d7bbe52168 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:38.218760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a7084f-e5e0-42ae-a78b-f5d7bbe52168 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:38.219214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a7084f-e5e0-42ae-a78b-f5d7bbe52168 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:38.220030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a7084f-e5e0-42ae-a78b-f5d7bbe52168 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:38.220466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a7084f-e5e0-42ae-a78b-f5d7bbe52168 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:38.241851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6796805e-aaff-40fe-82e6-a6a035b682d3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:38.250397 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6796805e-aaff-40fe-82e6-a6a035b682d3 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1322 microversion: 2.1 time: 0.170876 Jan 22 21:04:38.250980 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 761/1486] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:38 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:38.265609 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e9a7084f-e5e0-42ae-a78b-f5d7bbe52168 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.060570 Jan 22 21:04:38.266250 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 726/1487] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:38 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:38.520519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8854c866-604e-4176-9d3b-7b4a54c81392 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:38.521146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8854c866-604e-4176-9d3b-7b4a54c81392 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:38.527646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8854c866-604e-4176-9d3b-7b4a54c81392 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:38.529783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8854c866-604e-4176-9d3b-7b4a54c81392 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:38.529783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8854c866-604e-4176-9d3b-7b4a54c81392 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:38.530016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8854c866-604e-4176-9d3b-7b4a54c81392 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:38.666625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8854c866-604e-4176-9d3b-7b4a54c81392 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:38.674385 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8854c866-604e-4176-9d3b-7b4a54c81392 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1502 microversion: 2.1 time: 0.157947 Jan 22 21:04:38.680143 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 762/1488] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:38 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:38.883066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-84176963-fbae-42e7-b7a3-296019739b76 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:38.883691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-84176963-fbae-42e7-b7a3-296019739b76 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:38.891483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84176963-fbae-42e7-b7a3-296019739b76 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:38.895336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84176963-fbae-42e7-b7a3-296019739b76 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:38.895336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84176963-fbae-42e7-b7a3-296019739b76 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:38.895336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84176963-fbae-42e7-b7a3-296019739b76 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:39.027655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-84176963-fbae-42e7-b7a3-296019739b76 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:39.035700 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-84176963-fbae-42e7-b7a3-296019739b76 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1474 microversion: 2.1 time: 0.156922 Jan 22 21:04:39.036322 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 727/1489] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:38 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1474 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:39.083880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c521f695-914c-4865-bbbb-72dda4ecf1be tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:39.084814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c521f695-914c-4865-bbbb-72dda4ecf1be tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:39.091337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c521f695-914c-4865-bbbb-72dda4ecf1be tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:39.091798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c521f695-914c-4865-bbbb-72dda4ecf1be tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:39.092604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c521f695-914c-4865-bbbb-72dda4ecf1be tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:39.093323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c521f695-914c-4865-bbbb-72dda4ecf1be tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:39.132337 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c521f695-914c-4865-bbbb-72dda4ecf1be tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.052089 Jan 22 21:04:39.132979 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 763/1490] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:39 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:39.214944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a1048874-4491-4947-acc2-199ec9feb8dd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:39.216081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a1048874-4491-4947-acc2-199ec9feb8dd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:39.223102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1048874-4491-4947-acc2-199ec9feb8dd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:39.223556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1048874-4491-4947-acc2-199ec9feb8dd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:39.224348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1048874-4491-4947-acc2-199ec9feb8dd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:39.224783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1048874-4491-4947-acc2-199ec9feb8dd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:39.266982 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a1048874-4491-4947-acc2-199ec9feb8dd tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.055847 Jan 22 21:04:39.268190 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 728/1491] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:39 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:39.268947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4dd5beb3-2853-49d3-9cff-229622e6dea5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:39.271070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4dd5beb3-2853-49d3-9cff-229622e6dea5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:39.276589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dd5beb3-2853-49d3-9cff-229622e6dea5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:39.276754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fd6ad196-b112-487b-95b7-d0ebb222d263 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:39.277049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dd5beb3-2853-49d3-9cff-229622e6dea5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:39.278406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fd6ad196-b112-487b-95b7-d0ebb222d263 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:39.278570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dd5beb3-2853-49d3-9cff-229622e6dea5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:39.279035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dd5beb3-2853-49d3-9cff-229622e6dea5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:39.285908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd6ad196-b112-487b-95b7-d0ebb222d263 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:39.286362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd6ad196-b112-487b-95b7-d0ebb222d263 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:39.287153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd6ad196-b112-487b-95b7-d0ebb222d263 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:39.287594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd6ad196-b112-487b-95b7-d0ebb222d263 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:39.327882 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fd6ad196-b112-487b-95b7-d0ebb222d263 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.055042 Jan 22 21:04:39.328538 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 729/1492] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:39 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:39.417702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4dd5beb3-2853-49d3-9cff-229622e6dea5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:39.425081 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4dd5beb3-2853-49d3-9cff-229622e6dea5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1322 microversion: 2.1 time: 0.160524 Jan 22 21:04:39.425678 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 764/1493] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:39 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:39.695909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5b500093-335c-45bd-864b-0dbeec569dc0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:39.696806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5b500093-335c-45bd-864b-0dbeec569dc0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:39.708561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b500093-335c-45bd-864b-0dbeec569dc0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:39.709021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b500093-335c-45bd-864b-0dbeec569dc0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:39.709867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b500093-335c-45bd-864b-0dbeec569dc0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:39.710815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b500093-335c-45bd-864b-0dbeec569dc0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:39.853701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5b500093-335c-45bd-864b-0dbeec569dc0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:39.858206 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5b500093-335c-45bd-864b-0dbeec569dc0 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1508 microversion: 2.1 time: 0.166788 Jan 22 21:04:39.858909 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 730/1494] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:39 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:40.053103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9bdecec6-9793-4802-be04-097d6429269f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:40.053788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9bdecec6-9793-4802-be04-097d6429269f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:40.060772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bdecec6-9793-4802-be04-097d6429269f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:40.061233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bdecec6-9793-4802-be04-097d6429269f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:40.062072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bdecec6-9793-4802-be04-097d6429269f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:40.062551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bdecec6-9793-4802-be04-097d6429269f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:40.144203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b98b9608-8afe-4f65-bf3f-3802c2a01f70 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:40.145132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b98b9608-8afe-4f65-bf3f-3802c2a01f70 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:40.152215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b98b9608-8afe-4f65-bf3f-3802c2a01f70 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:40.153273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b98b9608-8afe-4f65-bf3f-3802c2a01f70 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:40.154315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b98b9608-8afe-4f65-bf3f-3802c2a01f70 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:40.154758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b98b9608-8afe-4f65-bf3f-3802c2a01f70 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:40.198570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9bdecec6-9793-4802-be04-097d6429269f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:40.206811 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9bdecec6-9793-4802-be04-097d6429269f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1480 microversion: 2.1 time: 0.157441 Jan 22 21:04:40.207391 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 765/1495] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:40 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1480 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:40.211272 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b98b9608-8afe-4f65-bf3f-3802c2a01f70 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.070711 Jan 22 21:04:40.212477 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 731/1496] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:40 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:40.279449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5082fe94-af5c-470f-b233-9eceeb8e5d99 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:40.280428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5082fe94-af5c-470f-b233-9eceeb8e5d99 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:40.286560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5082fe94-af5c-470f-b233-9eceeb8e5d99 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:40.287026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5082fe94-af5c-470f-b233-9eceeb8e5d99 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:40.288005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5082fe94-af5c-470f-b233-9eceeb8e5d99 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:40.288463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5082fe94-af5c-470f-b233-9eceeb8e5d99 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:40.329973 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5082fe94-af5c-470f-b233-9eceeb8e5d99 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.054736 Jan 22 21:04:40.330811 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 766/1497] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:40 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:40.340725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-af667522-791c-40d4-a634-bafdf6502be4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:40.345384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-af667522-791c-40d4-a634-bafdf6502be4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:40.349276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af667522-791c-40d4-a634-bafdf6502be4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:40.349763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af667522-791c-40d4-a634-bafdf6502be4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:40.350561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af667522-791c-40d4-a634-bafdf6502be4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:40.351008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af667522-791c-40d4-a634-bafdf6502be4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:40.393525 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-af667522-791c-40d4-a634-bafdf6502be4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.057406 Jan 22 21:04:40.394298 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 732/1498] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:40 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:40.442308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-409b66bc-02c1-4f23-acbe-261c342d3036 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:40.443001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-409b66bc-02c1-4f23-acbe-261c342d3036 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:40.450053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-409b66bc-02c1-4f23-acbe-261c342d3036 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:40.450510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-409b66bc-02c1-4f23-acbe-261c342d3036 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:40.451328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-409b66bc-02c1-4f23-acbe-261c342d3036 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:40.451734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-409b66bc-02c1-4f23-acbe-261c342d3036 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:40.595481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-409b66bc-02c1-4f23-acbe-261c342d3036 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:40.604653 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-409b66bc-02c1-4f23-acbe-261c342d3036 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1322 microversion: 2.1 time: 0.166391 Jan 22 21:04:40.605490 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 767/1499] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:40 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:40.877134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4f9efcee-31f7-42c9-ab97-a4e8d76a94dd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:40.877858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4f9efcee-31f7-42c9-ab97-a4e8d76a94dd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:40.885321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f9efcee-31f7-42c9-ab97-a4e8d76a94dd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:40.885898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f9efcee-31f7-42c9-ab97-a4e8d76a94dd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:40.886724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f9efcee-31f7-42c9-ab97-a4e8d76a94dd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:40.888175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f9efcee-31f7-42c9-ab97-a4e8d76a94dd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:41.030987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4f9efcee-31f7-42c9-ab97-a4e8d76a94dd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:41.038552 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4f9efcee-31f7-42c9-ab97-a4e8d76a94dd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1508 microversion: 2.1 time: 0.166868 Jan 22 21:04:41.039536 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 733/1500] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:40 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:41.224686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e42fdd2c-7c53-4547-aeca-09209442ea1f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:41.225566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e42fdd2c-7c53-4547-aeca-09209442ea1f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:41.225760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e78a60ab-398d-442b-9524-f11edeb9992d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:41.226380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e78a60ab-398d-442b-9524-f11edeb9992d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:41.233414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e42fdd2c-7c53-4547-aeca-09209442ea1f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:41.233604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e78a60ab-398d-442b-9524-f11edeb9992d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:41.233907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e42fdd2c-7c53-4547-aeca-09209442ea1f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:41.234021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e78a60ab-398d-442b-9524-f11edeb9992d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:41.234750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e42fdd2c-7c53-4547-aeca-09209442ea1f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:41.234863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e78a60ab-398d-442b-9524-f11edeb9992d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:41.235199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e42fdd2c-7c53-4547-aeca-09209442ea1f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:41.235327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e78a60ab-398d-442b-9524-f11edeb9992d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:41.283988 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e42fdd2c-7c53-4547-aeca-09209442ea1f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.062933 Jan 22 21:04:41.284669 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 768/1501] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:41 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:41.342327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fee5928f-1c9c-44f0-834a-eb1a5fa8b0ee tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:41.343621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fee5928f-1c9c-44f0-834a-eb1a5fa8b0ee tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:41.350799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fee5928f-1c9c-44f0-834a-eb1a5fa8b0ee tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:41.351260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fee5928f-1c9c-44f0-834a-eb1a5fa8b0ee tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:41.352066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fee5928f-1c9c-44f0-834a-eb1a5fa8b0ee tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:41.352644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fee5928f-1c9c-44f0-834a-eb1a5fa8b0ee tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:41.369160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e78a60ab-398d-442b-9524-f11edeb9992d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:41.378396 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e78a60ab-398d-442b-9524-f11edeb9992d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1480 microversion: 2.1 time: 0.156186 Jan 22 21:04:41.378972 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 734/1502] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:41 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1480 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:41.393374 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fee5928f-1c9c-44f0-834a-eb1a5fa8b0ee tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.055257 Jan 22 21:04:41.394114 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 769/1503] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:41 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:41.404310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ea04fd12-1a02-49dc-8b43-48773cee9ca2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:41.405227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ea04fd12-1a02-49dc-8b43-48773cee9ca2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:41.411479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea04fd12-1a02-49dc-8b43-48773cee9ca2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:41.411931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea04fd12-1a02-49dc-8b43-48773cee9ca2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:41.412705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea04fd12-1a02-49dc-8b43-48773cee9ca2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:41.413138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea04fd12-1a02-49dc-8b43-48773cee9ca2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:41.452993 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ea04fd12-1a02-49dc-8b43-48773cee9ca2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.052387 Jan 22 21:04:41.453647 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 735/1504] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:41 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:41.623957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d53eeffe-cc22-41df-a282-0aa7742e66c0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:41.624693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d53eeffe-cc22-41df-a282-0aa7742e66c0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:41.631731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d53eeffe-cc22-41df-a282-0aa7742e66c0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:41.632219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d53eeffe-cc22-41df-a282-0aa7742e66c0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:41.633012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d53eeffe-cc22-41df-a282-0aa7742e66c0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:41.633522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d53eeffe-cc22-41df-a282-0aa7742e66c0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:41.767914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d53eeffe-cc22-41df-a282-0aa7742e66c0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:41.775105 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d53eeffe-cc22-41df-a282-0aa7742e66c0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1322 microversion: 2.1 time: 0.156089 Jan 22 21:04:41.775668 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 770/1505] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:41 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:42.057040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ca9841d2-e4d6-4e0a-8857-bfabe20ee693 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:42.058190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ca9841d2-e4d6-4e0a-8857-bfabe20ee693 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:42.065998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca9841d2-e4d6-4e0a-8857-bfabe20ee693 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:42.066453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca9841d2-e4d6-4e0a-8857-bfabe20ee693 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:42.067249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca9841d2-e4d6-4e0a-8857-bfabe20ee693 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:42.067716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca9841d2-e4d6-4e0a-8857-bfabe20ee693 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:42.205147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ca9841d2-e4d6-4e0a-8857-bfabe20ee693 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:42.212678 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ca9841d2-e4d6-4e0a-8857-bfabe20ee693 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1508 microversion: 2.1 time: 0.159973 Jan 22 21:04:42.213235 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 736/1506] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:42 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:42.296168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-30c18eeb-50cb-4831-948f-9dadcfe0e2aa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:42.297100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-30c18eeb-50cb-4831-948f-9dadcfe0e2aa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:42.304700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30c18eeb-50cb-4831-948f-9dadcfe0e2aa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:42.305168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30c18eeb-50cb-4831-948f-9dadcfe0e2aa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:42.306011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30c18eeb-50cb-4831-948f-9dadcfe0e2aa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:42.311023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30c18eeb-50cb-4831-948f-9dadcfe0e2aa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:42.352556 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-30c18eeb-50cb-4831-948f-9dadcfe0e2aa tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.060562 Jan 22 21:04:42.353356 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 771/1507] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:42 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:42.396083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-059640f1-98e3-4778-a84b-2c4ef5e75501 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:42.396817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-059640f1-98e3-4778-a84b-2c4ef5e75501 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:42.405019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-059640f1-98e3-4778-a84b-2c4ef5e75501 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:42.405273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-956cbd8b-7dea-4f32-afd3-eba7cf806a82 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:42.405459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-059640f1-98e3-4778-a84b-2c4ef5e75501 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:42.406327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-059640f1-98e3-4778-a84b-2c4ef5e75501 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:42.406773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-059640f1-98e3-4778-a84b-2c4ef5e75501 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:42.406884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-956cbd8b-7dea-4f32-afd3-eba7cf806a82 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:42.414384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-956cbd8b-7dea-4f32-afd3-eba7cf806a82 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:42.415057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-956cbd8b-7dea-4f32-afd3-eba7cf806a82 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:42.419547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-956cbd8b-7dea-4f32-afd3-eba7cf806a82 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:42.419547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-956cbd8b-7dea-4f32-afd3-eba7cf806a82 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:42.463827 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-956cbd8b-7dea-4f32-afd3-eba7cf806a82 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.063081 Jan 22 21:04:42.464599 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 772/1508] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:42 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:42.470921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-888d83f0-4eef-4e8c-bc9f-0d0429e59c25 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:42.471922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-888d83f0-4eef-4e8c-bc9f-0d0429e59c25 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:42.482883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-888d83f0-4eef-4e8c-bc9f-0d0429e59c25 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:42.483334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-888d83f0-4eef-4e8c-bc9f-0d0429e59c25 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:42.484205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-888d83f0-4eef-4e8c-bc9f-0d0429e59c25 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:42.484708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-888d83f0-4eef-4e8c-bc9f-0d0429e59c25 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:42.531254 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-888d83f0-4eef-4e8c-bc9f-0d0429e59c25 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.064613 Jan 22 21:04:42.535373 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 773/1509] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:42 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:42.551338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-059640f1-98e3-4778-a84b-2c4ef5e75501 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:42.559414 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-059640f1-98e3-4778-a84b-2c4ef5e75501 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1480 microversion: 2.1 time: 0.166453 Jan 22 21:04:42.561745 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 737/1510] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:42 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1480 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:42.792027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-93133c74-2b9b-4c76-80ab-5dc99813d8f1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:42.792769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-93133c74-2b9b-4c76-80ab-5dc99813d8f1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:42.799960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93133c74-2b9b-4c76-80ab-5dc99813d8f1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:42.800491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93133c74-2b9b-4c76-80ab-5dc99813d8f1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:42.801279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93133c74-2b9b-4c76-80ab-5dc99813d8f1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:42.801894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93133c74-2b9b-4c76-80ab-5dc99813d8f1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:42.938805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-93133c74-2b9b-4c76-80ab-5dc99813d8f1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:42.946210 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-93133c74-2b9b-4c76-80ab-5dc99813d8f1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1322 microversion: 2.1 time: 0.158379 Jan 22 21:04:42.946787 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 774/1511] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:42 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:43.231161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5e3a60d5-8dcf-41ef-804d-8a2180d6658e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:43.232181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5e3a60d5-8dcf-41ef-804d-8a2180d6658e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:43.238484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e3a60d5-8dcf-41ef-804d-8a2180d6658e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:43.238939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e3a60d5-8dcf-41ef-804d-8a2180d6658e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:43.239732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e3a60d5-8dcf-41ef-804d-8a2180d6658e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:43.240174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e3a60d5-8dcf-41ef-804d-8a2180d6658e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:43.364450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-707ac39f-5437-438f-addd-7aa099478add tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:43.365454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-707ac39f-5437-438f-addd-7aa099478add tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:43.378102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5e3a60d5-8dcf-41ef-804d-8a2180d6658e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:43.379610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-707ac39f-5437-438f-addd-7aa099478add tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:43.380482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-707ac39f-5437-438f-addd-7aa099478add tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:43.382099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-707ac39f-5437-438f-addd-7aa099478add tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:43.382765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-707ac39f-5437-438f-addd-7aa099478add tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:43.386396 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5e3a60d5-8dcf-41ef-804d-8a2180d6658e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1508 microversion: 2.1 time: 0.159036 Jan 22 21:04:43.386579 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 738/1512] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:43 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:43.407100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-0318cb02-2f42-4cca-8327-c5b1b871caae req-56ae1747-55b5-4082-b5e3-2fabe4f3d1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28df35b-8a9a-4010-aa14-89cc18350ba9", "name": "network-vif-unplugged", "status": "completed", "tag": "e3a1c234-0a19-4371-944f-202cc47a018b"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:43.409128 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:43.409128 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:43.415811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-0318cb02-2f42-4cca-8327-c5b1b871caae req-56ae1747-55b5-4082-b5e3-2fabe4f3d1b9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:43.416450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-0318cb02-2f42-4cca-8327-c5b1b871caae req-56ae1747-55b5-4082-b5e3-2fabe4f3d1b9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:43.428410 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-0318cb02-2f42-4cca-8327-c5b1b871caae req-56ae1747-55b5-4082-b5e3-2fabe4f3d1b9 service nova] Creating event network-vif-unplugged:e3a1c234-0a19-4371-944f-202cc47a018b for instance b28df35b-8a9a-4010-aa14-89cc18350ba9 on nch1-master-1 Jan 22 21:04:43.433057 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-0318cb02-2f42-4cca-8327-c5b1b871caae req-56ae1747-55b5-4082-b5e3-2fabe4f3d1b9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030461 Jan 22 21:04:43.434272 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 739/1513] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:04:43.435382 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-707ac39f-5437-438f-addd-7aa099478add tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.073160 Jan 22 21:04:43.436192 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 775/1514] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:43 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:43.477394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4e829289-915a-45d2-8919-45aac4fe5116 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:43.478353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4e829289-915a-45d2-8919-45aac4fe5116 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:43.484688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e829289-915a-45d2-8919-45aac4fe5116 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:43.485146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e829289-915a-45d2-8919-45aac4fe5116 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:43.486223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e829289-915a-45d2-8919-45aac4fe5116 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:43.486670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e829289-915a-45d2-8919-45aac4fe5116 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:43.529192 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4e829289-915a-45d2-8919-45aac4fe5116 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.056234 Jan 22 21:04:43.530030 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 740/1515] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:43 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:43.543486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74b991a3-4f55-4b87-abc5-83a2946ecbee tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:43.544710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-74b991a3-4f55-4b87-abc5-83a2946ecbee tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:43.552626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b991a3-4f55-4b87-abc5-83a2946ecbee tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:43.553099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b991a3-4f55-4b87-abc5-83a2946ecbee tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:43.554156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b991a3-4f55-4b87-abc5-83a2946ecbee tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:43.554597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b991a3-4f55-4b87-abc5-83a2946ecbee tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:43.586950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fbb6efc0-00fc-42dd-bed9-a31d8024c5dc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:43.587672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fbb6efc0-00fc-42dd-bed9-a31d8024c5dc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:43.595667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbb6efc0-00fc-42dd-bed9-a31d8024c5dc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:43.596127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbb6efc0-00fc-42dd-bed9-a31d8024c5dc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:43.596935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbb6efc0-00fc-42dd-bed9-a31d8024c5dc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:43.597381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbb6efc0-00fc-42dd-bed9-a31d8024c5dc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:43.605700 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-74b991a3-4f55-4b87-abc5-83a2946ecbee tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.066258 Jan 22 21:04:43.608501 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 776/1516] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:43 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:43.735515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fbb6efc0-00fc-42dd-bed9-a31d8024c5dc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:43.742968 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fbb6efc0-00fc-42dd-bed9-a31d8024c5dc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1480 microversion: 2.1 time: 0.160089 Jan 22 21:04:43.743527 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 741/1517] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:43 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1480 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:43.964614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6875686f-c4a4-45e7-9663-2d72aba70ad4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:43.966272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6875686f-c4a4-45e7-9663-2d72aba70ad4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:43.973792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6875686f-c4a4-45e7-9663-2d72aba70ad4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:43.974249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6875686f-c4a4-45e7-9663-2d72aba70ad4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:43.975118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6875686f-c4a4-45e7-9663-2d72aba70ad4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:43.975582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6875686f-c4a4-45e7-9663-2d72aba70ad4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:44.116909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6875686f-c4a4-45e7-9663-2d72aba70ad4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:44.126444 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6875686f-c4a4-45e7-9663-2d72aba70ad4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1322 microversion: 2.1 time: 0.165815 Jan 22 21:04:44.127070 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 777/1518] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:43 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:44.403998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b00426f2-d8fe-4b5c-96df-167246fbc52b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:44.404613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b00426f2-d8fe-4b5c-96df-167246fbc52b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:44.411768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b00426f2-d8fe-4b5c-96df-167246fbc52b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:44.412341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b00426f2-d8fe-4b5c-96df-167246fbc52b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:44.413015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b00426f2-d8fe-4b5c-96df-167246fbc52b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:44.413459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b00426f2-d8fe-4b5c-96df-167246fbc52b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:44.451606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-126bb7bb-7146-4305-83ee-ec56916242f4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:44.456531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-126bb7bb-7146-4305-83ee-ec56916242f4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:44.468066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-126bb7bb-7146-4305-83ee-ec56916242f4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:44.468535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-126bb7bb-7146-4305-83ee-ec56916242f4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:44.469350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-126bb7bb-7146-4305-83ee-ec56916242f4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:44.469999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-126bb7bb-7146-4305-83ee-ec56916242f4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:44.527368 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-126bb7bb-7146-4305-83ee-ec56916242f4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.083532 Jan 22 21:04:44.529245 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 778/1519] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:44 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:44.542297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74b8b621-2a9b-4e2d-ac0f-8416e9963e34 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:44.544874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-74b8b621-2a9b-4e2d-ac0f-8416e9963e34 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:44.553831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b8b621-2a9b-4e2d-ac0f-8416e9963e34 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:44.554495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b8b621-2a9b-4e2d-ac0f-8416e9963e34 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:44.555467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b8b621-2a9b-4e2d-ac0f-8416e9963e34 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:44.557804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b8b621-2a9b-4e2d-ac0f-8416e9963e34 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:44.559330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b00426f2-d8fe-4b5c-96df-167246fbc52b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:44.568255 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b00426f2-d8fe-4b5c-96df-167246fbc52b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1508 microversion: 2.1 time: 0.168582 Jan 22 21:04:44.569127 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 742/1520] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:44 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:44.606660 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-74b8b621-2a9b-4e2d-ac0f-8416e9963e34 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.069186 Jan 22 21:04:44.607320 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 779/1521] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:44 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:44.622233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-13a9e1b6-0af4-4292-8417-d1275c5a6946 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:44.623153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-13a9e1b6-0af4-4292-8417-d1275c5a6946 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:44.629146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13a9e1b6-0af4-4292-8417-d1275c5a6946 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:44.629629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13a9e1b6-0af4-4292-8417-d1275c5a6946 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:44.630404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13a9e1b6-0af4-4292-8417-d1275c5a6946 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:44.630841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13a9e1b6-0af4-4292-8417-d1275c5a6946 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:44.670956 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-13a9e1b6-0af4-4292-8417-d1275c5a6946 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.052211 Jan 22 21:04:44.671689 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 743/1522] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:44 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:44.760739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3d0786a8-6d3b-47c2-869c-49101ca09304 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:44.761419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3d0786a8-6d3b-47c2-869c-49101ca09304 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:44.768760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d0786a8-6d3b-47c2-869c-49101ca09304 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:44.769222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d0786a8-6d3b-47c2-869c-49101ca09304 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:44.770054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d0786a8-6d3b-47c2-869c-49101ca09304 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:44.770500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d0786a8-6d3b-47c2-869c-49101ca09304 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:44.913075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3d0786a8-6d3b-47c2-869c-49101ca09304 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:44.921956 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3d0786a8-6d3b-47c2-869c-49101ca09304 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1480 microversion: 2.1 time: 0.165350 Jan 22 21:04:44.922876 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 780/1523] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:44 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1480 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:45.143989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f5b50bda-ef45-4fd5-819c-6ce344bcdc24 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:45.144803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f5b50bda-ef45-4fd5-819c-6ce344bcdc24 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:45.151983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5b50bda-ef45-4fd5-819c-6ce344bcdc24 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:45.152995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5b50bda-ef45-4fd5-819c-6ce344bcdc24 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:45.156380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5b50bda-ef45-4fd5-819c-6ce344bcdc24 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:45.156380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5b50bda-ef45-4fd5-819c-6ce344bcdc24 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:45.304186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f5b50bda-ef45-4fd5-819c-6ce344bcdc24 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:45.312651 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f5b50bda-ef45-4fd5-819c-6ce344bcdc24 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1322 microversion: 2.1 time: 0.172871 Jan 22 21:04:45.313263 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 744/1524] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:45 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:45.447876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-fbe8158d-5881-40e5-b8d9-6a291da19b66 req-671e66a8-b879-4f4b-b98c-f89ca8c3104e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7779535a-c217-4b7c-bd47-d83487d68e73", "name": "network-vif-plugged", "status": "completed", "tag": "74c18d40-5e04-41a9-b5c1-70950f848539"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:45.449472 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:45.449472 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:45.457007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-fbe8158d-5881-40e5-b8d9-6a291da19b66 req-671e66a8-b879-4f4b-b98c-f89ca8c3104e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:45.457600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-fbe8158d-5881-40e5-b8d9-6a291da19b66 req-671e66a8-b879-4f4b-b98c-f89ca8c3104e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:45.469463 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-fbe8158d-5881-40e5-b8d9-6a291da19b66 req-671e66a8-b879-4f4b-b98c-f89ca8c3104e service nova] Creating event network-vif-plugged:74c18d40-5e04-41a9-b5c1-70950f848539 for instance 7779535a-c217-4b7c-bd47-d83487d68e73 on nch2-master-1 Jan 22 21:04:45.474171 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-fbe8158d-5881-40e5-b8d9-6a291da19b66 req-671e66a8-b879-4f4b-b98c-f89ca8c3104e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030042 Jan 22 21:04:45.474769 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 781/1525] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:45.540141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f6a322f8-7d4f-413d-97a6-0af5484ac2a4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:45.541117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f6a322f8-7d4f-413d-97a6-0af5484ac2a4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:45.548861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6a322f8-7d4f-413d-97a6-0af5484ac2a4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:45.549319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6a322f8-7d4f-413d-97a6-0af5484ac2a4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:45.550145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6a322f8-7d4f-413d-97a6-0af5484ac2a4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:45.550602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6a322f8-7d4f-413d-97a6-0af5484ac2a4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:45.588320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c4cff565-167a-4d82-8998-5d1af966ff91 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:45.589121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c4cff565-167a-4d82-8998-5d1af966ff91 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:45.598498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4cff565-167a-4d82-8998-5d1af966ff91 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:45.600158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4cff565-167a-4d82-8998-5d1af966ff91 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:45.602486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4cff565-167a-4d82-8998-5d1af966ff91 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:45.602486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4cff565-167a-4d82-8998-5d1af966ff91 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:45.780865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c4cff565-167a-4d82-8998-5d1af966ff91 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:45.787453 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f6a322f8-7d4f-413d-97a6-0af5484ac2a4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.250774 Jan 22 21:04:45.788999 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c4cff565-167a-4d82-8998-5d1af966ff91 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1503 microversion: 2.1 time: 0.205692 Jan 22 21:04:45.791794 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 782/1526] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:45 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:45.792781 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 745/1527] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:45 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:45.795082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1b671868-1517-4202-aea3-297f8c0c72c9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:45.796073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1b671868-1517-4202-aea3-297f8c0c72c9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:45.799335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b8add19b-a41e-4643-9669-980ec2277241 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:45.800850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b8add19b-a41e-4643-9669-980ec2277241 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:45.802119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b671868-1517-4202-aea3-297f8c0c72c9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:45.802581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b671868-1517-4202-aea3-297f8c0c72c9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:45.803387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b671868-1517-4202-aea3-297f8c0c72c9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:45.803832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b671868-1517-4202-aea3-297f8c0c72c9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:45.808437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8add19b-a41e-4643-9669-980ec2277241 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:45.809598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8add19b-a41e-4643-9669-980ec2277241 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:45.810484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8add19b-a41e-4643-9669-980ec2277241 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:45.811006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8add19b-a41e-4643-9669-980ec2277241 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:45.850180 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1b671868-1517-4202-aea3-297f8c0c72c9 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.059441 Jan 22 21:04:45.850936 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 783/1528] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:45 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:45.863983 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b8add19b-a41e-4643-9669-980ec2277241 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.068861 Jan 22 21:04:45.865033 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 746/1529] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:45 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:45.940279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1bc85b86-be4c-48f3-9dd4-3592e75fc500 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:45.941181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1bc85b86-be4c-48f3-9dd4-3592e75fc500 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:45.948468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bc85b86-be4c-48f3-9dd4-3592e75fc500 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:45.949061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bc85b86-be4c-48f3-9dd4-3592e75fc500 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:45.950913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bc85b86-be4c-48f3-9dd4-3592e75fc500 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:45.951425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bc85b86-be4c-48f3-9dd4-3592e75fc500 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:46.125722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1bc85b86-be4c-48f3-9dd4-3592e75fc500 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:46.133230 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1bc85b86-be4c-48f3-9dd4-3592e75fc500 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1480 microversion: 2.1 time: 0.197352 Jan 22 21:04:46.133835 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 784/1530] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:45 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1480 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:46.331804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d7a39bbc-892f-4e9e-86c1-deaad460b662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:46.332504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d7a39bbc-892f-4e9e-86c1-deaad460b662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:46.339479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7a39bbc-892f-4e9e-86c1-deaad460b662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:46.340468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7a39bbc-892f-4e9e-86c1-deaad460b662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:46.341447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7a39bbc-892f-4e9e-86c1-deaad460b662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:46.341923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7a39bbc-892f-4e9e-86c1-deaad460b662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:46.477093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d7a39bbc-892f-4e9e-86c1-deaad460b662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:46.485237 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d7a39bbc-892f-4e9e-86c1-deaad460b662 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1322 microversion: 2.1 time: 0.157538 Jan 22 21:04:46.485947 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 747/1531] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:46 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:46.800091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-676ddc19-898f-42f3-8697-e24bb551aaa0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:46.801082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-676ddc19-898f-42f3-8697-e24bb551aaa0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:46.806360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b39a9c0a-04bb-41cb-be81-24afbb1f07ef tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:46.806962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b39a9c0a-04bb-41cb-be81-24afbb1f07ef tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:46.808118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-676ddc19-898f-42f3-8697-e24bb551aaa0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:46.808724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-676ddc19-898f-42f3-8697-e24bb551aaa0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:46.810353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-676ddc19-898f-42f3-8697-e24bb551aaa0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:46.810893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-676ddc19-898f-42f3-8697-e24bb551aaa0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:46.816016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b39a9c0a-04bb-41cb-be81-24afbb1f07ef tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:46.819756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b39a9c0a-04bb-41cb-be81-24afbb1f07ef tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:46.819756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b39a9c0a-04bb-41cb-be81-24afbb1f07ef tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:46.819756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b39a9c0a-04bb-41cb-be81-24afbb1f07ef tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:46.853599 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-676ddc19-898f-42f3-8697-e24bb551aaa0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.057553 Jan 22 21:04:46.858014 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 785/1532] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:46 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:46.863152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d4bbb0e3-620d-46e7-a8f6-43ea8d9ea197 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:46.864161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d4bbb0e3-620d-46e7-a8f6-43ea8d9ea197 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:46.871762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4bbb0e3-620d-46e7-a8f6-43ea8d9ea197 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:46.872590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4bbb0e3-620d-46e7-a8f6-43ea8d9ea197 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:46.873403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4bbb0e3-620d-46e7-a8f6-43ea8d9ea197 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:46.873877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4bbb0e3-620d-46e7-a8f6-43ea8d9ea197 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:46.919025 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d4bbb0e3-620d-46e7-a8f6-43ea8d9ea197 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.059681 Jan 22 21:04:46.922973 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 786/1533] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:46 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:46.924611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a509e32-53b0-41f7-9917-76d656f8f425 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:46.925642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a509e32-53b0-41f7-9917-76d656f8f425 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:46.932533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a509e32-53b0-41f7-9917-76d656f8f425 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:46.932993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a509e32-53b0-41f7-9917-76d656f8f425 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:46.933886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a509e32-53b0-41f7-9917-76d656f8f425 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:46.934615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a509e32-53b0-41f7-9917-76d656f8f425 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:46.957647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b39a9c0a-04bb-41cb-be81-24afbb1f07ef tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:46.965717 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b39a9c0a-04bb-41cb-be81-24afbb1f07ef tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1490 microversion: 2.1 time: 0.162443 Jan 22 21:04:46.966255 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 748/1534] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:46 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1490 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:46.974475 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a509e32-53b0-41f7-9917-76d656f8f425 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.053389 Jan 22 21:04:46.975144 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 787/1535] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:46 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:46.982371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d703f979-96a0-49d9-b576-65c8eeff48bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:46.982884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d703f979-96a0-49d9-b576-65c8eeff48bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:46.988735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d703f979-96a0-49d9-b576-65c8eeff48bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:46.989184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d703f979-96a0-49d9-b576-65c8eeff48bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:46.994123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d703f979-96a0-49d9-b576-65c8eeff48bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:46.994123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d703f979-96a0-49d9-b576-65c8eeff48bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:47.016656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d703f979-96a0-49d9-b576-65c8eeff48bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:04:47.150968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ac3362ce-b9c4-4989-9942-be63f0b845eb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:47.151626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ac3362ce-b9c4-4989-9942-be63f0b845eb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:47.159654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac3362ce-b9c4-4989-9942-be63f0b845eb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:47.160111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac3362ce-b9c4-4989-9942-be63f0b845eb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:47.160902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac3362ce-b9c4-4989-9942-be63f0b845eb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:47.161343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac3362ce-b9c4-4989-9942-be63f0b845eb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:47.303274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ac3362ce-b9c4-4989-9942-be63f0b845eb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:47.312186 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ac3362ce-b9c4-4989-9942-be63f0b845eb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1480 microversion: 2.1 time: 0.165351 Jan 22 21:04:47.315623 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 788/1536] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:47 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1480 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:47.489895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-d5dee737-eae2-4ef7-a457-be10de9e0b04 req-a6ebe123-fa33-4c56-bfa4-d18b150df69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28df35b-8a9a-4010-aa14-89cc18350ba9", "name": "network-vif-plugged", "status": "completed", "tag": "e3a1c234-0a19-4371-944f-202cc47a018b"}, {"server_uuid": "479ddfa2-304b-488e-ad75-0f509ecae3aa", "name": "network-vif-plugged", "status": "completed", "tag": "5fb54162-4687-4417-9f29-8c8d96aaa6ce"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:47.491579 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:47.491579 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:47.500832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d5dee737-eae2-4ef7-a457-be10de9e0b04 req-a6ebe123-fa33-4c56-bfa4-d18b150df69b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:47.501293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d5dee737-eae2-4ef7-a457-be10de9e0b04 req-a6ebe123-fa33-4c56-bfa4-d18b150df69b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:47.515225 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d5dee737-eae2-4ef7-a457-be10de9e0b04 req-a6ebe123-fa33-4c56-bfa4-d18b150df69b service nova] Creating event network-vif-plugged:e3a1c234-0a19-4371-944f-202cc47a018b for instance b28df35b-8a9a-4010-aa14-89cc18350ba9 on nch1-master-1 Jan 22 21:04:47.515630 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d5dee737-eae2-4ef7-a457-be10de9e0b04 req-a6ebe123-fa33-4c56-bfa4-d18b150df69b service nova] Creating event network-vif-plugged:5fb54162-4687-4417-9f29-8c8d96aaa6ce for instance 479ddfa2-304b-488e-ad75-0f509ecae3aa on nch2-master-1 Jan 22 21:04:47.516786 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d703f979-96a0-49d9-b576-65c8eeff48bd tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 204 len: 0 microversion: 2.1 time: 0.537518 Jan 22 21:04:47.517867 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 749/1537] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:04:46 2022] DELETE /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:47.525335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1c431601-04f7-445d-a1ce-c5bafa895234 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:47.526126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1c431601-04f7-445d-a1ce-c5bafa895234 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:47.530935 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-d5dee737-eae2-4ef7-a457-be10de9e0b04 req-a6ebe123-fa33-4c56-bfa4-d18b150df69b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044570 Jan 22 21:04:47.531538 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 789/1538] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:47.537776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c431601-04f7-445d-a1ce-c5bafa895234 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:47.538098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e5037c0a-312e-49d0-b653-a8574a1c3f00 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5e0ab80>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:47.539076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c431601-04f7-445d-a1ce-c5bafa895234 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:47.545358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c431601-04f7-445d-a1ce-c5bafa895234 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:47.545980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c431601-04f7-445d-a1ce-c5bafa895234 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:47.575425 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-e5037c0a-312e-49d0-b653-a8574a1c3f00 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] HTTP exception thrown: Image not found. Jan 22 21:04:47.576042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e5037c0a-312e-49d0-b653-a8574a1c3f00 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Returning 404 to user: Image not found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:47.577135 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e5037c0a-312e-49d0-b653-a8574a1c3f00 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/images/d21b11d3-4e8d-4c57-b549-5fd85bf2bb8f" status: 404 len: 62 microversion: 2.1 time: 0.044326 Jan 22 21:04:47.577846 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 790/1539] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:47 2022] DELETE /compute/v2.1/images/d21b11d3-4e8d-4c57-b549-5fd85bf2bb8f => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:04:47.585629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-84d71406-87c6-4b51-978b-16a0a0145141 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:47.586255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-84d71406-87c6-4b51-978b-16a0a0145141 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:47.600163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84d71406-87c6-4b51-978b-16a0a0145141 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:47.607443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84d71406-87c6-4b51-978b-16a0a0145141 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:47.607443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84d71406-87c6-4b51-978b-16a0a0145141 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:47.607443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84d71406-87c6-4b51-978b-16a0a0145141 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:47.646093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-84d71406-87c6-4b51-978b-16a0a0145141 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:04:47.806522 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.compute.api [None req-84d71406-87c6-4b51-978b-16a0a0145141 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Instance is already in deleting state, ignoring this request Jan 22 21:04:47.807642 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-84d71406-87c6-4b51-978b-16a0a0145141 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 204 len: 0 microversion: 2.1 time: 0.225528 Jan 22 21:04:47.808265 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 791/1540] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:04:47 2022] DELETE /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:47.816729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-18b30e1e-d15f-4b83-991d-031b635e8fcc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:47.817378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-18b30e1e-d15f-4b83-991d-031b635e8fcc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:47.825747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1c431601-04f7-445d-a1ce-c5bafa895234 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:47.826377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18b30e1e-d15f-4b83-991d-031b635e8fcc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:47.826377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18b30e1e-d15f-4b83-991d-031b635e8fcc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:47.826377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18b30e1e-d15f-4b83-991d-031b635e8fcc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:47.826377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18b30e1e-d15f-4b83-991d-031b635e8fcc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:47.831666 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1c431601-04f7-445d-a1ce-c5bafa895234 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1322 microversion: 2.1 time: 0.312541 Jan 22 21:04:47.832345 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 750/1541] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:47 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:47.866379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48f24dca-63bd-4c34-9f7d-857927fec689 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:47.867437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48f24dca-63bd-4c34-9f7d-857927fec689 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:47.874267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48f24dca-63bd-4c34-9f7d-857927fec689 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:47.874809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48f24dca-63bd-4c34-9f7d-857927fec689 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:47.875684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48f24dca-63bd-4c34-9f7d-857927fec689 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:47.876362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48f24dca-63bd-4c34-9f7d-857927fec689 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:47.969805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-18b30e1e-d15f-4b83-991d-031b635e8fcc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:47.977240 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-18b30e1e-d15f-4b83-991d-031b635e8fcc tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1496 microversion: 2.1 time: 0.164133 Jan 22 21:04:47.977848 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 792/1542] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:47 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1496 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:47.983324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-31b290ca-d9ac-446e-9d9e-f45b059b16a6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:47.984290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-31b290ca-d9ac-446e-9d9e-f45b059b16a6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:47.989971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31b290ca-d9ac-446e-9d9e-f45b059b16a6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:47.990429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31b290ca-d9ac-446e-9d9e-f45b059b16a6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:47.991303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31b290ca-d9ac-446e-9d9e-f45b059b16a6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:47.991801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31b290ca-d9ac-446e-9d9e-f45b059b16a6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:48.013635 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48f24dca-63bd-4c34-9f7d-857927fec689 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.151329 Jan 22 21:04:48.017719 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 751/1543] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:47 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:48.021985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-def9c098-ba5e-4ab5-ba99-eda7d32efc1d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:48.023109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-def9c098-ba5e-4ab5-ba99-eda7d32efc1d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:48.031182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-def9c098-ba5e-4ab5-ba99-eda7d32efc1d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:48.031725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-def9c098-ba5e-4ab5-ba99-eda7d32efc1d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:48.032589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-def9c098-ba5e-4ab5-ba99-eda7d32efc1d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:48.033145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-def9c098-ba5e-4ab5-ba99-eda7d32efc1d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:48.077531 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-def9c098-ba5e-4ab5-ba99-eda7d32efc1d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.061432 Jan 22 21:04:48.078519 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 752/1544] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:48 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:48.089211 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-31b290ca-d9ac-446e-9d9e-f45b059b16a6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.110079 Jan 22 21:04:48.090539 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 793/1545] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:47 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:48.330615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-86f83505-0438-4c9a-a3be-aa00ed09ea3f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:48.331246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-86f83505-0438-4c9a-a3be-aa00ed09ea3f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:48.338421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86f83505-0438-4c9a-a3be-aa00ed09ea3f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:48.338878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86f83505-0438-4c9a-a3be-aa00ed09ea3f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:48.339813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86f83505-0438-4c9a-a3be-aa00ed09ea3f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:48.341132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86f83505-0438-4c9a-a3be-aa00ed09ea3f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:48.474817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-86f83505-0438-4c9a-a3be-aa00ed09ea3f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:48.482539 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-86f83505-0438-4c9a-a3be-aa00ed09ea3f tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1480 microversion: 2.1 time: 0.156108 Jan 22 21:04:48.483113 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 753/1546] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:48 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1480 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:48.849848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7a487cef-225c-4ef1-8088-8f4325e0beb0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:48.850467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7a487cef-225c-4ef1-8088-8f4325e0beb0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:48.857959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a487cef-225c-4ef1-8088-8f4325e0beb0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:48.858851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a487cef-225c-4ef1-8088-8f4325e0beb0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:48.860011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a487cef-225c-4ef1-8088-8f4325e0beb0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:48.860501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a487cef-225c-4ef1-8088-8f4325e0beb0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:48.996452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2f8c05da-aa6d-431a-930c-033b0387ae2e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:48.998093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2f8c05da-aa6d-431a-930c-033b0387ae2e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:49.002036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7a487cef-225c-4ef1-8088-8f4325e0beb0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:49.005400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f8c05da-aa6d-431a-930c-033b0387ae2e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:49.005983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f8c05da-aa6d-431a-930c-033b0387ae2e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:49.007007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f8c05da-aa6d-431a-930c-033b0387ae2e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:49.007548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f8c05da-aa6d-431a-930c-033b0387ae2e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:49.010288 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7a487cef-225c-4ef1-8088-8f4325e0beb0 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1322 microversion: 2.1 time: 0.165343 Jan 22 21:04:49.011096 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 794/1547] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:48 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:49.025573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2b4ded7e-40d5-4ee4-a7fd-5d657ded4e33 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:49.026535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2b4ded7e-40d5-4ee4-a7fd-5d657ded4e33 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:49.032583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b4ded7e-40d5-4ee4-a7fd-5d657ded4e33 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:49.037023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b4ded7e-40d5-4ee4-a7fd-5d657ded4e33 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:49.037023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b4ded7e-40d5-4ee4-a7fd-5d657ded4e33 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:49.037023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b4ded7e-40d5-4ee4-a7fd-5d657ded4e33 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:49.083644 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2b4ded7e-40d5-4ee4-a7fd-5d657ded4e33 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 24567 microversion: 2.1 time: 0.061556 Jan 22 21:04:49.084314 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 795/1548] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:49 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 24567 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:49.090295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6881109f-0d84-4af8-a68d-43199cfc92a7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:49.091373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6881109f-0d84-4af8-a68d-43199cfc92a7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:49.100916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6881109f-0d84-4af8-a68d-43199cfc92a7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:49.101462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6881109f-0d84-4af8-a68d-43199cfc92a7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:49.102373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6881109f-0d84-4af8-a68d-43199cfc92a7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:49.102993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6881109f-0d84-4af8-a68d-43199cfc92a7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:49.151432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2f8c05da-aa6d-431a-930c-033b0387ae2e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:49.161272 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2f8c05da-aa6d-431a-930c-033b0387ae2e tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1496 microversion: 2.1 time: 0.169364 Jan 22 21:04:49.162386 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 754/1549] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:48 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1496 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:49.167031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f7f8ff69-a721-4e55-aa03-3e30b913c7f0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:49.168665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f7f8ff69-a721-4e55-aa03-3e30b913c7f0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:49.176419 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6881109f-0d84-4af8-a68d-43199cfc92a7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.089881 Jan 22 21:04:49.182979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7f8ff69-a721-4e55-aa03-3e30b913c7f0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:49.182979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7f8ff69-a721-4e55-aa03-3e30b913c7f0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:49.183220 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 796/1550] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:49 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:49.183315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7f8ff69-a721-4e55-aa03-3e30b913c7f0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:49.183315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7f8ff69-a721-4e55-aa03-3e30b913c7f0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:49.229658 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f7f8ff69-a721-4e55-aa03-3e30b913c7f0 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.065758 Jan 22 21:04:49.230894 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 755/1551] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:49 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:49.500087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d57ab1af-99a4-4bf9-a95f-0f1c7fbec519 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:49.500823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d57ab1af-99a4-4bf9-a95f-0f1c7fbec519 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:49.507522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d57ab1af-99a4-4bf9-a95f-0f1c7fbec519 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:49.507981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d57ab1af-99a4-4bf9-a95f-0f1c7fbec519 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:49.508781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d57ab1af-99a4-4bf9-a95f-0f1c7fbec519 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:49.509224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d57ab1af-99a4-4bf9-a95f-0f1c7fbec519 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:49.644374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d57ab1af-99a4-4bf9-a95f-0f1c7fbec519 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:49.651913 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d57ab1af-99a4-4bf9-a95f-0f1c7fbec519 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1466 microversion: 2.1 time: 0.156171 Jan 22 21:04:49.653358 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 797/1552] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:49 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1466 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:49.668861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-832927f6-ab59-4d32-8b39-29d5005c0acc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:49.669600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-832927f6-ab59-4d32-8b39-29d5005c0acc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:49.676419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-832927f6-ab59-4d32-8b39-29d5005c0acc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:49.676867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-832927f6-ab59-4d32-8b39-29d5005c0acc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:49.677682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-832927f6-ab59-4d32-8b39-29d5005c0acc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:49.678122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-832927f6-ab59-4d32-8b39-29d5005c0acc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:49.811957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-832927f6-ab59-4d32-8b39-29d5005c0acc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:49.819607 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-832927f6-ab59-4d32-8b39-29d5005c0acc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1466 microversion: 2.1 time: 0.154734 Jan 22 21:04:49.820180 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 756/1553] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:49 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1466 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:49.836240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:49.837787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:49.844648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:49.845035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:49.845867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:49.846318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:49.929641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:04:49.930307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:04:49.930536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:04:49.930949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:04:49.931368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:04:50.028352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d17fe4b2-7229-45a3-82da-5dfdeac44184 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:50.028961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d17fe4b2-7229-45a3-82da-5dfdeac44184 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:50.038108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d17fe4b2-7229-45a3-82da-5dfdeac44184 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.038570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d17fe4b2-7229-45a3-82da-5dfdeac44184 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.039398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d17fe4b2-7229-45a3-82da-5dfdeac44184 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.039877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d17fe4b2-7229-45a3-82da-5dfdeac44184 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.177457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:50.186200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.186917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.187934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.188551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.227716 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d43c2cb9-f597-455a-9984-c5e2c733fbe4 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "POST /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9/action" status: 202 len: 1070 microversion: 2.1 time: 0.395247 Jan 22 21:04:50.229885 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 798/1554] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:49 2022] POST /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9/action => generated 1070 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 22 21:04:50.235167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6fde61eb-25e4-4f0d-90ce-ef857e75f326 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:50.239990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6fde61eb-25e4-4f0d-90ce-ef857e75f326 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:50.251282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6fde61eb-25e4-4f0d-90ce-ef857e75f326 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.251750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6fde61eb-25e4-4f0d-90ce-ef857e75f326 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.252573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6fde61eb-25e4-4f0d-90ce-ef857e75f326 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.253020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6fde61eb-25e4-4f0d-90ce-ef857e75f326 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.301879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d17fe4b2-7229-45a3-82da-5dfdeac44184 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:50.314201 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d17fe4b2-7229-45a3-82da-5dfdeac44184 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1511 microversion: 2.1 time: 0.288766 Jan 22 21:04:50.314804 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 757/1555] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:50 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1511 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:50.321481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5702e4f3-e2e6-470e-b3f7-3addd3d1c33b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:50.322497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5702e4f3-e2e6-470e-b3f7-3addd3d1c33b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:50.327918 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6fde61eb-25e4-4f0d-90ce-ef857e75f326 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.096981 Jan 22 21:04:50.328806 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 799/1556] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:50 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:50.335275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e12f7a1f-19c5-4c2c-b0dd-fc4000f75353 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:50.341339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e12f7a1f-19c5-4c2c-b0dd-fc4000f75353 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:50.343558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5702e4f3-e2e6-470e-b3f7-3addd3d1c33b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.345844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5702e4f3-e2e6-470e-b3f7-3addd3d1c33b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.347799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5702e4f3-e2e6-470e-b3f7-3addd3d1c33b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.348242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5702e4f3-e2e6-470e-b3f7-3addd3d1c33b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.357914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e12f7a1f-19c5-4c2c-b0dd-fc4000f75353 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.358364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e12f7a1f-19c5-4c2c-b0dd-fc4000f75353 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.359523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e12f7a1f-19c5-4c2c-b0dd-fc4000f75353 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.359969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e12f7a1f-19c5-4c2c-b0dd-fc4000f75353 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.426921 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e12f7a1f-19c5-4c2c-b0dd-fc4000f75353 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.096553 Jan 22 21:04:50.429218 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 800/1557] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:50 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:50.436268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ca4ab146-d696-4a4d-80a6-2fe8d6ea66c6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:50.437397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ca4ab146-d696-4a4d-80a6-2fe8d6ea66c6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:50.446406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca4ab146-d696-4a4d-80a6-2fe8d6ea66c6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.446406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca4ab146-d696-4a4d-80a6-2fe8d6ea66c6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.447657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca4ab146-d696-4a4d-80a6-2fe8d6ea66c6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.448202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca4ab146-d696-4a4d-80a6-2fe8d6ea66c6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.502449 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ca4ab146-d696-4a4d-80a6-2fe8d6ea66c6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.070447 Jan 22 21:04:50.506785 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 801/1558] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:50 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:50.512635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5707bd60-0ad8-4c3a-9447-2f5d9d7d2dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:50.513359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5707bd60-0ad8-4c3a-9447-2f5d9d7d2dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:50.521627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5707bd60-0ad8-4c3a-9447-2f5d9d7d2dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.526996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5707bd60-0ad8-4c3a-9447-2f5d9d7d2dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.526996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5707bd60-0ad8-4c3a-9447-2f5d9d7d2dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.526996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5707bd60-0ad8-4c3a-9447-2f5d9d7d2dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.612341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5702e4f3-e2e6-470e-b3f7-3addd3d1c33b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:50.626885 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5702e4f3-e2e6-470e-b3f7-3addd3d1c33b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1496 microversion: 2.1 time: 0.310046 Jan 22 21:04:50.628254 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 758/1559] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:50 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1496 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:50.633644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-9f6c51b8-e643-4935-a9d3-e956f687889c req-e3a8b175-bcaa-41dc-8bf0-603020d2dce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7779535a-c217-4b7c-bd47-d83487d68e73", "name": "network-vif-unplugged", "status": "completed", "tag": "74c18d40-5e04-41a9-b5c1-70950f848539"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:50.635524 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:50.635524 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:50.643699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9f6c51b8-e643-4935-a9d3-e956f687889c req-e3a8b175-bcaa-41dc-8bf0-603020d2dce4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.644233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9f6c51b8-e643-4935-a9d3-e956f687889c req-e3a8b175-bcaa-41dc-8bf0-603020d2dce4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.657115 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-9f6c51b8-e643-4935-a9d3-e956f687889c req-e3a8b175-bcaa-41dc-8bf0-603020d2dce4 service nova] Creating event network-vif-unplugged:74c18d40-5e04-41a9-b5c1-70950f848539 for instance 7779535a-c217-4b7c-bd47-d83487d68e73 on nch2-master-1 Jan 22 21:04:50.662568 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-9f6c51b8-e643-4935-a9d3-e956f687889c req-e3a8b175-bcaa-41dc-8bf0-603020d2dce4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032626 Jan 22 21:04:50.663425 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 759/1560] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:50.670280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-17301260", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3da6de85-e0d4-4a7c-ad9b-73d085f0c931"}], "block_device_mapping_v2": [{"uuid": "0b17e2f4-e149-4a4b-b525-3d029be2e6f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:50.695215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5707bd60-0ad8-4c3a-9447-2f5d9d7d2dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:50.703224 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5707bd60-0ad8-4c3a-9447-2f5d9d7d2dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.195180 Jan 22 21:04:50.704251 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 802/1561] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:50 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:50.708897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4d82c6d4-003f-460a-bc42-3cf4c992aea1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:50.709565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4d82c6d4-003f-460a-bc42-3cf4c992aea1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:50.716712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d82c6d4-003f-460a-bc42-3cf4c992aea1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.717393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d82c6d4-003f-460a-bc42-3cf4c992aea1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.718647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d82c6d4-003f-460a-bc42-3cf4c992aea1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.719248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d82c6d4-003f-460a-bc42-3cf4c992aea1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.748703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] validate_networks() for [('3da6de85-e0d4-4a7c-ad9b-73d085f0c931', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:04:50.861276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4d82c6d4-003f-460a-bc42-3cf4c992aea1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:50.869807 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4d82c6d4-003f-460a-bc42-3cf4c992aea1 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1511 microversion: 2.1 time: 0.164216 Jan 22 21:04:50.870323 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 803/1562] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:50 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:50.887896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3a123e09-1f42-458b-b219-88a4a5696d2c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:50.892016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3a123e09-1f42-458b-b219-88a4a5696d2c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:50.896796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a123e09-1f42-458b-b219-88a4a5696d2c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.897257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a123e09-1f42-458b-b219-88a4a5696d2c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:50.898116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a123e09-1f42-458b-b219-88a4a5696d2c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:50.898558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a123e09-1f42-458b-b219-88a4a5696d2c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.057883 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3a123e09-1f42-458b-b219-88a4a5696d2c tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "PUT /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1083 microversion: 2.1 time: 0.174621 Jan 22 21:04:51.067748 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 804/1563] 10.222.0.100 () {60 vars in 1260 bytes} [Sat Jan 22 21:04:50 2022] PUT /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1083 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:51.067748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-6a6182b8-eda4-4a70-8cb4-a7d52a16fe2f req-e1f8abb4-3fd3-4f42-883c-f28babffe8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7779535a-c217-4b7c-bd47-d83487d68e73", "name": "network-vif-deleted", "tag": "74c18d40-5e04-41a9-b5c1-70950f848539"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:51.067748 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:51.067748 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:51.071928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6a6182b8-eda4-4a70-8cb4-a7d52a16fe2f req-e1f8abb4-3fd3-4f42-883c-f28babffe8af service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.072388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6a6182b8-eda4-4a70-8cb4-a7d52a16fe2f req-e1f8abb4-3fd3-4f42-883c-f28babffe8af service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.095616 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-6a6182b8-eda4-4a70-8cb4-a7d52a16fe2f req-e1f8abb4-3fd3-4f42-883c-f28babffe8af service nova] Creating event network-vif-deleted:74c18d40-5e04-41a9-b5c1-70950f848539 for instance 7779535a-c217-4b7c-bd47-d83487d68e73 on nch2-master-1 Jan 22 21:04:51.100392 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-6a6182b8-eda4-4a70-8cb4-a7d52a16fe2f req-e1f8abb4-3fd3-4f42-883c-f28babffe8af service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040419 Jan 22 21:04:51.101148 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 805/1564] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:51.113837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5969730a-2cb2-4a9c-ab82-011f5f91ae9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:51.113837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5969730a-2cb2-4a9c-ab82-011f5f91ae9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:51.113837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5969730a-2cb2-4a9c-ab82-011f5f91ae9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.114184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5969730a-2cb2-4a9c-ab82-011f5f91ae9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.115100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5969730a-2cb2-4a9c-ab82-011f5f91ae9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.115442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5969730a-2cb2-4a9c-ab82-011f5f91ae9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.221893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:04:51.222420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:04:51.222862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:04:51.223320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:04:51.223750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:04:51.232883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.233340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.234219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.234661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.252239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Getting quotas for project b277338cf6c4478e8e35cf79b34caaf6. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:51.257447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5969730a-2cb2-4a9c-ab82-011f5f91ae9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:51.257633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Getting quotas for user b07a1bb09ad44501925664aa61ac3e6d and project b277338cf6c4478e8e35cf79b34caaf6. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:51.265348 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5969730a-2cb2-4a9c-ab82-011f5f91ae9f tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1509 microversion: 2.1 time: 0.163017 Jan 22 21:04:51.269652 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 806/1565] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:51 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:51.281770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ae974931-0f51-4421-96d4-fa717c7d6c27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:51.285670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ae974931-0f51-4421-96d4-fa717c7d6c27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:51.288884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae974931-0f51-4421-96d4-fa717c7d6c27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.289405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae974931-0f51-4421-96d4-fa717c7d6c27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.290289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae974931-0f51-4421-96d4-fa717c7d6c27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.290814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae974931-0f51-4421-96d4-fa717c7d6c27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.322589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:04:51.325235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b17e2f4-e149-4a4b-b525-3d029be2e6f6',volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:04:51.429490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ae974931-0f51-4421-96d4-fa717c7d6c27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:51.437207 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ae974931-0f51-4421-96d4-fa717c7d6c27 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1509 microversion: 2.1 time: 0.160001 Jan 22 21:04:51.437819 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 807/1566] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:51 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:51.442124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b8d58ca3-3254-4244-86fe-9c14d44623a5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:51.443072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b8d58ca3-3254-4244-86fe-9c14d44623a5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:51.450348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8d58ca3-3254-4244-86fe-9c14d44623a5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.450800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8d58ca3-3254-4244-86fe-9c14d44623a5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.451916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8d58ca3-3254-4244-86fe-9c14d44623a5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.452365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8d58ca3-3254-4244-86fe-9c14d44623a5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.492667 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b8d58ca3-3254-4244-86fe-9c14d44623a5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.053656 Jan 22 21:04:51.497260 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 808/1567] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:51 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:51.498969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2f1e4b67-e4d0-413c-b151-5ef9cc2e86bd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:51.500584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2f1e4b67-e4d0-413c-b151-5ef9cc2e86bd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:51.506883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f1e4b67-e4d0-413c-b151-5ef9cc2e86bd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.507380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f1e4b67-e4d0-413c-b151-5ef9cc2e86bd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.508187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f1e4b67-e4d0-413c-b151-5ef9cc2e86bd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.508639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f1e4b67-e4d0-413c-b151-5ef9cc2e86bd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.548356 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2f1e4b67-e4d0-413c-b151-5ef9cc2e86bd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.053680 Jan 22 21:04:51.548983 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 809/1568] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:51 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:51.553864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dded80ea-c06b-4ef5-87df-5bebea5953c6 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:51.554983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dded80ea-c06b-4ef5-87df-5bebea5953c6 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:51.562303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dded80ea-c06b-4ef5-87df-5bebea5953c6 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.562756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dded80ea-c06b-4ef5-87df-5bebea5953c6 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.563761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dded80ea-c06b-4ef5-87df-5bebea5953c6 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.563969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dded80ea-c06b-4ef5-87df-5bebea5953c6 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.690044 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dded80ea-c06b-4ef5-87df-5bebea5953c6 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "PUT /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1085 microversion: 2.1 time: 0.139807 Jan 22 21:04:51.690754 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 810/1569] 10.222.0.100 () {60 vars in 1260 bytes} [Sat Jan 22 21:04:51 2022] PUT /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1085 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:51.695240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c3e54ac2-1f14-4ab4-ac04-a43384388f48 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:51.696151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c3e54ac2-1f14-4ab4-ac04-a43384388f48 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:51.702798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3e54ac2-1f14-4ab4-ac04-a43384388f48 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.703257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3e54ac2-1f14-4ab4-ac04-a43384388f48 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.704118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3e54ac2-1f14-4ab4-ac04-a43384388f48 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.704565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3e54ac2-1f14-4ab4-ac04-a43384388f48 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.724346 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c6d7789f-4acb-4550-a015-409a8463dfb2 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.059497 Jan 22 21:04:51.731017 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 760/1570] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:04:50 2022] POST /compute/v2.1/servers => generated 382 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:04:51.737055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ca049bd-4028-41fb-a480-1c94471433f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:51.738116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1ca049bd-4028-41fb-a480-1c94471433f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:51.755378 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c3e54ac2-1f14-4ab4-ac04-a43384388f48 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.057714 Jan 22 21:04:51.755378 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 811/1571] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:51 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:51.756043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ca049bd-4028-41fb-a480-1c94471433f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.756043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ca049bd-4028-41fb-a480-1c94471433f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.756043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ca049bd-4028-41fb-a480-1c94471433f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.756043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ca049bd-4028-41fb-a480-1c94471433f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.756395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f65e826-7f2c-4763-ad12-b2e713c9798b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:51.756395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8f65e826-7f2c-4763-ad12-b2e713c9798b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:51.764104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f65e826-7f2c-4763-ad12-b2e713c9798b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.764565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f65e826-7f2c-4763-ad12-b2e713c9798b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.765612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f65e826-7f2c-4763-ad12-b2e713c9798b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.765912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f65e826-7f2c-4763-ad12-b2e713c9798b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.793945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ca049bd-4028-41fb-a480-1c94471433f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.794844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ca049bd-4028-41fb-a480-1c94471433f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.795498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-1ca049bd-4028-41fb-a480-1c94471433f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lazy-loading 'fault' on Instance uuid 7779535a-c217-4b7c-bd47-d83487d68e73 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:04:51.838284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1ca049bd-4028-41fb-a480-1c94471433f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '946cce9cf6874d60912e69c1169ed379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b1a67e790046629fe2b636fcefd01d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:51.848175 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1ca049bd-4028-41fb-a480-1c94471433f4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 200 len: 1301 microversion: 2.1 time: 0.115736 Jan 22 21:04:51.849066 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 761/1572] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:51 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 1301 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:51.854479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2238e07f-c91e-4666-9fd4-b71888ee5240 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:51.855075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2238e07f-c91e-4666-9fd4-b71888ee5240 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:51.862051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2238e07f-c91e-4666-9fd4-b71888ee5240 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.862520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2238e07f-c91e-4666-9fd4-b71888ee5240 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.863328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2238e07f-c91e-4666-9fd4-b71888ee5240 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:51.863777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2238e07f-c91e-4666-9fd4-b71888ee5240 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:51.938010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8f65e826-7f2c-4763-ad12-b2e713c9798b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:51.946253 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8f65e826-7f2c-4763-ad12-b2e713c9798b tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1511 microversion: 2.1 time: 0.194728 Jan 22 21:04:51.946842 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 812/1573] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:51 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1511 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:51.951957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-87b07308-7de7-4bae-8d1f-ba7c47324baf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:51.952580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-87b07308-7de7-4bae-8d1f-ba7c47324baf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:52.004480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-87b07308-7de7-4bae-8d1f-ba7c47324baf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:52.011731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2238e07f-c91e-4666-9fd4-b71888ee5240 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:52.012473 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-87b07308-7de7-4bae-8d1f-ba7c47324baf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1054 microversion: 2.1 time: 0.064350 Jan 22 21:04:52.013323 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 813/1574] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:51 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1054 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:52.017395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bb870277-f545-48d0-8fbe-17ef1a594b31 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:52.018183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bb870277-f545-48d0-8fbe-17ef1a594b31 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:52.022475 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2238e07f-c91e-4666-9fd4-b71888ee5240 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.172202 Jan 22 21:04:52.023114 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 762/1575] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:51 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:52.028070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb870277-f545-48d0-8fbe-17ef1a594b31 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.028070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb870277-f545-48d0-8fbe-17ef1a594b31 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.028070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb870277-f545-48d0-8fbe-17ef1a594b31 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.028070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb870277-f545-48d0-8fbe-17ef1a594b31 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.159193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bb870277-f545-48d0-8fbe-17ef1a594b31 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:52.166785 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bb870277-f545-48d0-8fbe-17ef1a594b31 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1511 microversion: 2.1 time: 0.152699 Jan 22 21:04:52.167365 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 814/1576] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:52 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:52.182995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-479a2263-f6f5-4a6a-84d3-536f1ed554dc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:52.185257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-479a2263-f6f5-4a6a-84d3-536f1ed554dc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:52.190015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-479a2263-f6f5-4a6a-84d3-536f1ed554dc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.190466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-479a2263-f6f5-4a6a-84d3-536f1ed554dc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.191288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-479a2263-f6f5-4a6a-84d3-536f1ed554dc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.191729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-479a2263-f6f5-4a6a-84d3-536f1ed554dc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.219670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-479a2263-f6f5-4a6a-84d3-536f1ed554dc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:04:52.504238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c3566347-9792-4100-8867-eb23af2c7d21 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:52.505160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c3566347-9792-4100-8867-eb23af2c7d21 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:52.512388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3566347-9792-4100-8867-eb23af2c7d21 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.512865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3566347-9792-4100-8867-eb23af2c7d21 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.513699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3566347-9792-4100-8867-eb23af2c7d21 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.514145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3566347-9792-4100-8867-eb23af2c7d21 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.546785 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-479a2263-f6f5-4a6a-84d3-536f1ed554dc tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "DELETE /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 204 len: 0 microversion: 2.1 time: 0.367171 Jan 22 21:04:52.547481 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 763/1577] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:04:52 2022] DELETE /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:52.562009 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c3566347-9792-4100-8867-eb23af2c7d21 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.054990 Jan 22 21:04:52.562183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-72879a74-2e6b-4ecb-aaf1-4f0733a84c6c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:52.563089 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 815/1578] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:52 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:52.564839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-72879a74-2e6b-4ecb-aaf1-4f0733a84c6c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:52.568368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4dffbe5a-a2c3-4baa-ba1a-b9e2cb37a0a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:52.568946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4dffbe5a-a2c3-4baa-ba1a-b9e2cb37a0a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:52.573642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72879a74-2e6b-4ecb-aaf1-4f0733a84c6c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.574204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72879a74-2e6b-4ecb-aaf1-4f0733a84c6c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.575125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72879a74-2e6b-4ecb-aaf1-4f0733a84c6c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.575547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72879a74-2e6b-4ecb-aaf1-4f0733a84c6c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.576403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dffbe5a-a2c3-4baa-ba1a-b9e2cb37a0a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.576789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dffbe5a-a2c3-4baa-ba1a-b9e2cb37a0a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.577638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dffbe5a-a2c3-4baa-ba1a-b9e2cb37a0a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.578093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dffbe5a-a2c3-4baa-ba1a-b9e2cb37a0a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.607595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4dffbe5a-a2c3-4baa-ba1a-b9e2cb37a0a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:04:52.620554 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-72879a74-2e6b-4ecb-aaf1-4f0733a84c6c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.063526 Jan 22 21:04:52.622884 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 764/1579] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:52 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:52.719516 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.compute.api [None req-4dffbe5a-a2c3-4baa-ba1a-b9e2cb37a0a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Instance is already in deleting state, ignoring this request Jan 22 21:04:52.720336 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4dffbe5a-a2c3-4baa-ba1a-b9e2cb37a0a2 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "DELETE /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 204 len: 0 microversion: 2.1 time: 0.156328 Jan 22 21:04:52.720897 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 816/1580] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:04:52 2022] DELETE /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:52.730070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1f7eaa07-6a4a-4f99-a0ad-5498c766df02 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:52.731299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1f7eaa07-6a4a-4f99-a0ad-5498c766df02 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:52.738547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f7eaa07-6a4a-4f99-a0ad-5498c766df02 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.739003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f7eaa07-6a4a-4f99-a0ad-5498c766df02 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.739842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f7eaa07-6a4a-4f99-a0ad-5498c766df02 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.740293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f7eaa07-6a4a-4f99-a0ad-5498c766df02 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.762943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-158a2256-c19c-449c-857b-1aff09e9e947 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:52.763910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-158a2256-c19c-449c-857b-1aff09e9e947 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:52.769797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-158a2256-c19c-449c-857b-1aff09e9e947 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.770562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-158a2256-c19c-449c-857b-1aff09e9e947 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.771375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-158a2256-c19c-449c-857b-1aff09e9e947 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.771820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-158a2256-c19c-449c-857b-1aff09e9e947 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.814478 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-158a2256-c19c-449c-857b-1aff09e9e947 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.055438 Jan 22 21:04:52.815162 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 817/1581] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:52 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:52.868278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cf9b791f-1e5d-423c-aa86-55f66697e3f2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:52.869011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cf9b791f-1e5d-423c-aa86-55f66697e3f2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 7779535a-c217-4b7c-bd47-d83487d68e73] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:52.877373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf9b791f-1e5d-423c-aa86-55f66697e3f2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.877865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf9b791f-1e5d-423c-aa86-55f66697e3f2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.878669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf9b791f-1e5d-423c-aa86-55f66697e3f2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.879116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf9b791f-1e5d-423c-aa86-55f66697e3f2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.883026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1f7eaa07-6a4a-4f99-a0ad-5498c766df02 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:52.891458 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1f7eaa07-6a4a-4f99-a0ad-5498c766df02 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1517 microversion: 2.1 time: 0.165869 Jan 22 21:04:52.892048 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 765/1582] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:52 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:52.896669 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-cf9b791f-1e5d-423c-aa86-55f66697e3f2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] HTTP exception thrown: Instance 7779535a-c217-4b7c-bd47-d83487d68e73 could not be found. Jan 22 21:04:52.897405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cf9b791f-1e5d-423c-aa86-55f66697e3f2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Returning 404 to user: Instance 7779535a-c217-4b7c-bd47-d83487d68e73 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:52.898199 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cf9b791f-1e5d-423c-aa86-55f66697e3f2 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73" status: 404 len: 111 microversion: 2.1 time: 0.034027 Jan 22 21:04:52.898757 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 818/1583] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:52 2022] GET /compute/v2.1/servers/7779535a-c217-4b7c-bd47-d83487d68e73 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:04:52.907438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6844834b-a1ae-469e-9947-0fd6c23874c9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5d35ee0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:52.928288 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-6844834b-a1ae-469e-9947-0fd6c23874c9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] HTTP exception thrown: Image not found. Jan 22 21:04:52.928882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6844834b-a1ae-469e-9947-0fd6c23874c9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Returning 404 to user: Image not found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:52.929758 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6844834b-a1ae-469e-9947-0fd6c23874c9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905" status: 404 len: 62 microversion: 2.1 time: 0.025954 Jan 22 21:04:52.930432 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 766/1584] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:52 2022] DELETE /compute/v2.1/images/8b4b987c-533b-4ee6-8d0d-098bc8b12905 => generated 62 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 22 21:04:52.938251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0f7891ad-2460-4df3-9280-214083fc3b1b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:52.938690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0f7891ad-2460-4df3-9280-214083fc3b1b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:52.945215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f7891ad-2460-4df3-9280-214083fc3b1b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.945712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f7891ad-2460-4df3-9280-214083fc3b1b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.946508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f7891ad-2460-4df3-9280-214083fc3b1b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.946946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f7891ad-2460-4df3-9280-214083fc3b1b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.961110 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-0f7891ad-2460-4df3-9280-214083fc3b1b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] HTTP exception thrown: Instance 8e95589a-26dd-4aac-bbc5-5abc6d98536f could not be found. Jan 22 21:04:52.961742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0f7891ad-2460-4df3-9280-214083fc3b1b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Returning 404 to user: Instance 8e95589a-26dd-4aac-bbc5-5abc6d98536f could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:52.962602 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0f7891ad-2460-4df3-9280-214083fc3b1b tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 404 len: 111 microversion: 2.1 time: 0.028070 Jan 22 21:04:52.963208 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 819/1585] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:04:52 2022] DELETE /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:04:52.972316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-86ca187a-8b20-4456-b2de-1d1f0463a9ff tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:52.973010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-86ca187a-8b20-4456-b2de-1d1f0463a9ff tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 8e95589a-26dd-4aac-bbc5-5abc6d98536f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:52.979860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86ca187a-8b20-4456-b2de-1d1f0463a9ff tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.981073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86ca187a-8b20-4456-b2de-1d1f0463a9ff tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.981912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86ca187a-8b20-4456-b2de-1d1f0463a9ff tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:52.982353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86ca187a-8b20-4456-b2de-1d1f0463a9ff tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:52.995820 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-86ca187a-8b20-4456-b2de-1d1f0463a9ff tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] HTTP exception thrown: Instance 8e95589a-26dd-4aac-bbc5-5abc6d98536f could not be found. Jan 22 21:04:52.996501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-86ca187a-8b20-4456-b2de-1d1f0463a9ff tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Returning 404 to user: Instance 8e95589a-26dd-4aac-bbc5-5abc6d98536f could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:52.997347 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-86ca187a-8b20-4456-b2de-1d1f0463a9ff tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f" status: 404 len: 111 microversion: 2.1 time: 0.029029 Jan 22 21:04:52.997939 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 767/1586] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:52 2022] GET /compute/v2.1/servers/8e95589a-26dd-4aac-bbc5-5abc6d98536f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:04:53.005960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dbe164ea-d9f2-45bb-8fee-acaf600c56c9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5ef7b80>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:53.027775 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-dbe164ea-d9f2-45bb-8fee-acaf600c56c9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] HTTP exception thrown: Image not found. Jan 22 21:04:53.028705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dbe164ea-d9f2-45bb-8fee-acaf600c56c9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Returning 404 to user: Image not found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:53.029601 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dbe164ea-d9f2-45bb-8fee-acaf600c56c9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80" status: 404 len: 62 microversion: 2.1 time: 0.027514 Jan 22 21:04:53.030159 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 820/1587] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:53 2022] DELETE /compute/v2.1/images/df4cd859-3a9e-4964-b72f-c9c8081e7e80 => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:04:53.030274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-23afc18b-f8a0-4be2-8615-b7977c60514e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:53.030878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-23afc18b-f8a0-4be2-8615-b7977c60514e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:53.038104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d16d43b1-ef0c-44b7-a9e9-153ba39e3cb9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:53.038650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d16d43b1-ef0c-44b7-a9e9-153ba39e3cb9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:53.038780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23afc18b-f8a0-4be2-8615-b7977c60514e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.039185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23afc18b-f8a0-4be2-8615-b7977c60514e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.039978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23afc18b-f8a0-4be2-8615-b7977c60514e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.040417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23afc18b-f8a0-4be2-8615-b7977c60514e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.047225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d16d43b1-ef0c-44b7-a9e9-153ba39e3cb9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.049724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d16d43b1-ef0c-44b7-a9e9-153ba39e3cb9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.049724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d16d43b1-ef0c-44b7-a9e9-153ba39e3cb9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.049724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d16d43b1-ef0c-44b7-a9e9-153ba39e3cb9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.062885 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-d16d43b1-ef0c-44b7-a9e9-153ba39e3cb9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] HTTP exception thrown: Instance 0b179432-605e-4dbc-af14-2e1933a509ec could not be found. Jan 22 21:04:53.063488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d16d43b1-ef0c-44b7-a9e9-153ba39e3cb9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Returning 404 to user: Instance 0b179432-605e-4dbc-af14-2e1933a509ec could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:53.064326 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d16d43b1-ef0c-44b7-a9e9-153ba39e3cb9 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 404 len: 111 microversion: 2.1 time: 0.030129 Jan 22 21:04:53.064884 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 821/1588] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:04:53 2022] DELETE /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:04:53.069664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f5a7de87-e4f3-46fa-bf8f-bd4b07449dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:53.070270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f5a7de87-e4f3-46fa-bf8f-bd4b07449dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:53.076706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5a7de87-e4f3-46fa-bf8f-bd4b07449dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.077167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5a7de87-e4f3-46fa-bf8f-bd4b07449dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.078060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5a7de87-e4f3-46fa-bf8f-bd4b07449dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.078510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5a7de87-e4f3-46fa-bf8f-bd4b07449dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.101630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-23afc18b-f8a0-4be2-8615-b7977c60514e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:53.110142 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-23afc18b-f8a0-4be2-8615-b7977c60514e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1104 microversion: 2.1 time: 0.084597 Jan 22 21:04:53.119302 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 768/1589] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:53 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1104 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:53.119302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ad98c115-8558-48f6-aedb-e7d17961c064 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:53.119302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ad98c115-8558-48f6-aedb-e7d17961c064 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 0b179432-605e-4dbc-af14-2e1933a509ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:53.125872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad98c115-8558-48f6-aedb-e7d17961c064 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.125872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad98c115-8558-48f6-aedb-e7d17961c064 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.125872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad98c115-8558-48f6-aedb-e7d17961c064 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.125872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad98c115-8558-48f6-aedb-e7d17961c064 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.139282 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-ad98c115-8558-48f6-aedb-e7d17961c064 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] HTTP exception thrown: Instance 0b179432-605e-4dbc-af14-2e1933a509ec could not be found. Jan 22 21:04:53.139914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ad98c115-8558-48f6-aedb-e7d17961c064 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Returning 404 to user: Instance 0b179432-605e-4dbc-af14-2e1933a509ec could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:53.140972 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ad98c115-8558-48f6-aedb-e7d17961c064 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec" status: 404 len: 111 microversion: 2.1 time: 0.029234 Jan 22 21:04:53.141804 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 769/1590] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:53 2022] GET /compute/v2.1/servers/0b179432-605e-4dbc-af14-2e1933a509ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:04:53.149446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d05ff0b2-1d3a-448b-b5f8-e0149b1c9918 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '.version_select at 0x7f1ed5d8a550>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:53.171087 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-d05ff0b2-1d3a-448b-b5f8-e0149b1c9918 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] HTTP exception thrown: Image not found. Jan 22 21:04:53.171686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d05ff0b2-1d3a-448b-b5f8-e0149b1c9918 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Returning 404 to user: Image not found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:53.172512 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d05ff0b2-1d3a-448b-b5f8-e0149b1c9918 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5" status: 404 len: 62 microversion: 2.1 time: 0.026853 Jan 22 21:04:53.173058 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 770/1591] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:53 2022] DELETE /compute/v2.1/images/c0465b55-3574-4446-a454-c75ed20c9cf5 => generated 62 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 22 21:04:53.180421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5ddda686-488e-4c7f-b1ff-42923502889f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:53.180934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5ddda686-488e-4c7f-b1ff-42923502889f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:53.189428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ddda686-488e-4c7f-b1ff-42923502889f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.189845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ddda686-488e-4c7f-b1ff-42923502889f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.190632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ddda686-488e-4c7f-b1ff-42923502889f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.191070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ddda686-488e-4c7f-b1ff-42923502889f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.204962 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-5ddda686-488e-4c7f-b1ff-42923502889f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] HTTP exception thrown: Instance 59386c42-117b-4309-9c99-c977fc1cbdef could not be found. Jan 22 21:04:53.205611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5ddda686-488e-4c7f-b1ff-42923502889f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Returning 404 to user: Instance 59386c42-117b-4309-9c99-c977fc1cbdef could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:53.207008 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5ddda686-488e-4c7f-b1ff-42923502889f tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "DELETE /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 404 len: 111 microversion: 2.1 time: 0.029528 Jan 22 21:04:53.207008 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 771/1592] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:04:53 2022] DELETE /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:04:53.214752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cfda0ff7-e59d-45c1-8422-672ba65813c4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:53.215719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cfda0ff7-e59d-45c1-8422-672ba65813c4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] [instance: 59386c42-117b-4309-9c99-c977fc1cbdef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:53.221817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfda0ff7-e59d-45c1-8422-672ba65813c4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.222293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfda0ff7-e59d-45c1-8422-672ba65813c4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.223094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfda0ff7-e59d-45c1-8422-672ba65813c4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.223529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfda0ff7-e59d-45c1-8422-672ba65813c4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.227227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f5a7de87-e4f3-46fa-bf8f-bd4b07449dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:53.235974 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f5a7de87-e4f3-46fa-bf8f-bd4b07449dad tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.170037 Jan 22 21:04:53.236702 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 822/1593] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:53 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:53.238310 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-cfda0ff7-e59d-45c1-8422-672ba65813c4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] HTTP exception thrown: Instance 59386c42-117b-4309-9c99-c977fc1cbdef could not be found. Jan 22 21:04:53.238915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cfda0ff7-e59d-45c1-8422-672ba65813c4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] Returning 404 to user: Instance 59386c42-117b-4309-9c99-c977fc1cbdef could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:53.239773 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cfda0ff7-e59d-45c1-8422-672ba65813c4 tempest-ImagesTestJSON-1038726264 tempest-ImagesTestJSON-1038726264-project] 10.222.0.100 "GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef" status: 404 len: 111 microversion: 2.1 time: 0.028725 Jan 22 21:04:53.240309 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 772/1594] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:53 2022] GET /compute/v2.1/servers/59386c42-117b-4309-9c99-c977fc1cbdef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:04:53.577233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b3533d2b-5107-4b5a-a20b-37390b6f697e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:53.578326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b3533d2b-5107-4b5a-a20b-37390b6f697e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:53.584408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3533d2b-5107-4b5a-a20b-37390b6f697e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.584865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3533d2b-5107-4b5a-a20b-37390b6f697e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.585687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3533d2b-5107-4b5a-a20b-37390b6f697e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.586123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3533d2b-5107-4b5a-a20b-37390b6f697e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.628564 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b3533d2b-5107-4b5a-a20b-37390b6f697e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.055612 Jan 22 21:04:53.629537 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 823/1595] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:53 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:53.632840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3c423294-6896-416a-a0f5-80a7758d8c72 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:53.633937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3c423294-6896-416a-a0f5-80a7758d8c72 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:53.641339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c423294-6896-416a-a0f5-80a7758d8c72 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.641979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c423294-6896-416a-a0f5-80a7758d8c72 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.642882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c423294-6896-416a-a0f5-80a7758d8c72 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.643391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c423294-6896-416a-a0f5-80a7758d8c72 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.683006 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3c423294-6896-416a-a0f5-80a7758d8c72 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.054026 Jan 22 21:04:53.687386 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 773/1596] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:53 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:04:53.730571 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:04:53.730814 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 21:04:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:04:53.827344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-534b7d7a-5a5b-4ed1-8bb3-0bb285bdf91f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:53.828352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-534b7d7a-5a5b-4ed1-8bb3-0bb285bdf91f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:53.835326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-534b7d7a-5a5b-4ed1-8bb3-0bb285bdf91f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.835780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-534b7d7a-5a5b-4ed1-8bb3-0bb285bdf91f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.836574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-534b7d7a-5a5b-4ed1-8bb3-0bb285bdf91f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.837035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-534b7d7a-5a5b-4ed1-8bb3-0bb285bdf91f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.899772 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-534b7d7a-5a5b-4ed1-8bb3-0bb285bdf91f tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.077305 Jan 22 21:04:53.904013 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 824/1597] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:53 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:53.913740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ebfb94bf-055e-4702-9f1a-19230a39a698 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:53.914471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ebfb94bf-055e-4702-9f1a-19230a39a698 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:53.928516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebfb94bf-055e-4702-9f1a-19230a39a698 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.928977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebfb94bf-055e-4702-9f1a-19230a39a698 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:53.929841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebfb94bf-055e-4702-9f1a-19230a39a698 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:53.930260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebfb94bf-055e-4702-9f1a-19230a39a698 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:54.091021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ebfb94bf-055e-4702-9f1a-19230a39a698 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:54.098797 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ebfb94bf-055e-4702-9f1a-19230a39a698 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1517 microversion: 2.1 time: 0.193735 Jan 22 21:04:54.108238 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 774/1598] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:53 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1517 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:54.127192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f406a56f-7f7b-4211-8350-6a10f26d2c0e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:54.127905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f406a56f-7f7b-4211-8350-6a10f26d2c0e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:54.138480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f406a56f-7f7b-4211-8350-6a10f26d2c0e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:54.138961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f406a56f-7f7b-4211-8350-6a10f26d2c0e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:54.139768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f406a56f-7f7b-4211-8350-6a10f26d2c0e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:54.140217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f406a56f-7f7b-4211-8350-6a10f26d2c0e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:54.253718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f7f01fd5-6704-4874-9b9f-637092aa3d5a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:54.254390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f7f01fd5-6704-4874-9b9f-637092aa3d5a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:54.268581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7f01fd5-6704-4874-9b9f-637092aa3d5a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:54.269176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7f01fd5-6704-4874-9b9f-637092aa3d5a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:54.270148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7f01fd5-6704-4874-9b9f-637092aa3d5a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:54.270754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7f01fd5-6704-4874-9b9f-637092aa3d5a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:54.387731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f406a56f-7f7b-4211-8350-6a10f26d2c0e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:54.397266 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f406a56f-7f7b-4211-8350-6a10f26d2c0e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1160 microversion: 2.1 time: 0.274351 Jan 22 21:04:54.400837 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 825/1599] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:54 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1160 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:54.627141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1111289799", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "129e825a-cd9c-4303-b118-ba3cd4ee673c"}], "block_device_mapping_v2": [{"uuid": "77269952-ab3c-402f-ad65-b6254782bbb8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:54.739034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] validate_networks() for [('129e825a-cd9c-4303-b118-ba3cd4ee673c', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:04:54.935779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f7f01fd5-6704-4874-9b9f-637092aa3d5a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:54.943585 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f7f01fd5-6704-4874-9b9f-637092aa3d5a tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.694498 Jan 22 21:04:54.944156 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 775/1600] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:54 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:54.950212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6e1e2fd4-5895-4b6b-a701-2c8c303389a4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:54.951539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6e1e2fd4-5895-4b6b-a701-2c8c303389a4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:54.958359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e1e2fd4-5895-4b6b-a701-2c8c303389a4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:54.958917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e1e2fd4-5895-4b6b-a701-2c8c303389a4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:54.959986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e1e2fd4-5895-4b6b-a701-2c8c303389a4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:54.960707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e1e2fd4-5895-4b6b-a701-2c8c303389a4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:55.028047 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6e1e2fd4-5895-4b6b-a701-2c8c303389a4 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.081667 Jan 22 21:04:55.030803 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 776/1601] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:54 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:55.036808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b02fd925-7b11-4d3a-9de3-9a16b28b29c4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:55.039251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b02fd925-7b11-4d3a-9de3-9a16b28b29c4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:55.051355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b02fd925-7b11-4d3a-9de3-9a16b28b29c4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:55.052056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b02fd925-7b11-4d3a-9de3-9a16b28b29c4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:55.053192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b02fd925-7b11-4d3a-9de3-9a16b28b29c4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:55.054023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b02fd925-7b11-4d3a-9de3-9a16b28b29c4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:55.107590 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b02fd925-7b11-4d3a-9de3-9a16b28b29c4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.075114 Jan 22 21:04:55.115043 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 777/1602] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:55 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:55.122166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cc73c71a-b041-47eb-876f-47f6d29a8d92 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:55.123467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cc73c71a-b041-47eb-876f-47f6d29a8d92 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:55.132853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc73c71a-b041-47eb-876f-47f6d29a8d92 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:55.133608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc73c71a-b041-47eb-876f-47f6d29a8d92 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:55.135030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc73c71a-b041-47eb-876f-47f6d29a8d92 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:55.135686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc73c71a-b041-47eb-876f-47f6d29a8d92 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:55.226029 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cc73c71a-b041-47eb-876f-47f6d29a8d92 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.108665 Jan 22 21:04:55.232095 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 778/1603] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:55 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:55.237916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-78be1156-bf6f-4819-8929-36f037f57904 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:55.239329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-78be1156-bf6f-4819-8929-36f037f57904 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:55.269403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78be1156-bf6f-4819-8929-36f037f57904 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:55.274917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:04:55.276261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:04:55.276940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:04:55.277647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:04:55.278375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:04:55.289778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78be1156-bf6f-4819-8929-36f037f57904 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:55.292403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78be1156-bf6f-4819-8929-36f037f57904 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:55.296023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78be1156-bf6f-4819-8929-36f037f57904 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:55.298180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:55.301961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:55.303131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:55.303753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:55.379225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Getting quotas for project 4aa958f703204cbca5fd08472e45909f. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:55.395005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Getting quotas for user c8fa58b4de634969ba8dcaf054e0b8b8 and project 4aa958f703204cbca5fd08472e45909f. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:55.470015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-78be1156-bf6f-4819-8929-36f037f57904 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4847dd82943e4bbfb54cdd49aed12b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac10456f0ea4fd5b1d2948b4856ca84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:55.472981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:04:55.475696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77269952-ab3c-402f-ad65-b6254782bbb8',volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:04:55.483961 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-78be1156-bf6f-4819-8929-36f037f57904 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 200 len: 1475 microversion: 2.1 time: 0.250549 Jan 22 21:04:55.484662 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 779/1604] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:55 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 1475 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:55.502470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-30e47a20-58cb-4cb3-a268-c823189c04de req-5f29e212-db5e-4749-b980-8e06660009d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "479ddfa2-304b-488e-ad75-0f509ecae3aa", "name": "network-vif-deleted", "tag": "5fb54162-4687-4417-9f29-8c8d96aaa6ce"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:55.505515 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:55.505515 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:04:55.513881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-30e47a20-58cb-4cb3-a268-c823189c04de req-5f29e212-db5e-4749-b980-8e06660009d8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:55.514715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-30e47a20-58cb-4cb3-a268-c823189c04de req-5f29e212-db5e-4749-b980-8e06660009d8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:55.530536 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-30e47a20-58cb-4cb3-a268-c823189c04de req-5f29e212-db5e-4749-b980-8e06660009d8 service nova] Creating event network-vif-deleted:5fb54162-4687-4417-9f29-8c8d96aaa6ce for instance 479ddfa2-304b-488e-ad75-0f509ecae3aa on nch2-master-1 Jan 22 21:04:55.536045 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-30e47a20-58cb-4cb3-a268-c823189c04de req-5f29e212-db5e-4749-b980-8e06660009d8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043843 Jan 22 21:04:55.536825 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 780/1605] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:55.541774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4bfb8d79-877c-4aad-aac7-adf980365f54 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:55.546612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4bfb8d79-877c-4aad-aac7-adf980365f54 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:55.550298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bfb8d79-877c-4aad-aac7-adf980365f54 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:55.550964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bfb8d79-877c-4aad-aac7-adf980365f54 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:55.551954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bfb8d79-877c-4aad-aac7-adf980365f54 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:55.552558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bfb8d79-877c-4aad-aac7-adf980365f54 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:55.780885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4bfb8d79-877c-4aad-aac7-adf980365f54 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:55.789981 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4bfb8d79-877c-4aad-aac7-adf980365f54 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1212 microversion: 2.1 time: 0.251908 Jan 22 21:04:55.790571 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 781/1606] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:55 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1212 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:55.961628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb489724-ff68-48b7-9736-8172981fc6fd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:55.962293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb489724-ff68-48b7-9736-8172981fc6fd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:55.969471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb489724-ff68-48b7-9736-8172981fc6fd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:55.969969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb489724-ff68-48b7-9736-8172981fc6fd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:55.970783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb489724-ff68-48b7-9736-8172981fc6fd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:55.971280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb489724-ff68-48b7-9736-8172981fc6fd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.015874 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eae140b0-bb46-457c-90e3-78793dec45f6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.25 time: 1.395414 Jan 22 21:04:56.016531 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 826/1607] 10.222.0.100 () {62 vars in 1192 bytes} [Sat Jan 22 21:04:54 2022] POST /compute/v2.1/servers => generated 382 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 22 21:04:56.030720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4ce7de9a-9072-42c3-932a-eb4bc5e9e457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:56.036341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4ce7de9a-9072-42c3-932a-eb4bc5e9e457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:56.143818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4ce7de9a-9072-42c3-932a-eb4bc5e9e457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:56.154060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4ce7de9a-9072-42c3-932a-eb4bc5e9e457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:56.155977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4ce7de9a-9072-42c3-932a-eb4bc5e9e457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:56.157492 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4ce7de9a-9072-42c3-932a-eb4bc5e9e457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1107 microversion: 2.25 time: 0.134742 Jan 22 21:04:56.158365 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 827/1608] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:04:56 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1107 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:04:56.170307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5edb648a-363d-48ed-bbe9-ab33d546477e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:56.172299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5edb648a-363d-48ed-bbe9-ab33d546477e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:56.181054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5edb648a-363d-48ed-bbe9-ab33d546477e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.184836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5edb648a-363d-48ed-bbe9-ab33d546477e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.184836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5edb648a-363d-48ed-bbe9-ab33d546477e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.184836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5edb648a-363d-48ed-bbe9-ab33d546477e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.220912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fb489724-ff68-48b7-9736-8172981fc6fd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:56.228518 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb489724-ff68-48b7-9736-8172981fc6fd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.271099 Jan 22 21:04:56.229112 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 782/1609] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:55 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:56.248086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9388daa5-d55a-4047-8d9e-eb94b4bcb7d5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:56.248086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9388daa5-d55a-4047-8d9e-eb94b4bcb7d5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:56.248086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9388daa5-d55a-4047-8d9e-eb94b4bcb7d5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.248086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9388daa5-d55a-4047-8d9e-eb94b4bcb7d5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.248585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9388daa5-d55a-4047-8d9e-eb94b4bcb7d5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.248585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9388daa5-d55a-4047-8d9e-eb94b4bcb7d5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.248767 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5edb648a-363d-48ed-bbe9-ab33d546477e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.085286 Jan 22 21:04:56.248767 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 828/1610] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:56 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:56.256384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3541bd55-9f66-4d99-8253-413cd5ad54ad tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:56.257441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3541bd55-9f66-4d99-8253-413cd5ad54ad tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:56.279487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3541bd55-9f66-4d99-8253-413cd5ad54ad tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.279973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3541bd55-9f66-4d99-8253-413cd5ad54ad tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.280805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3541bd55-9f66-4d99-8253-413cd5ad54ad tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.281433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3541bd55-9f66-4d99-8253-413cd5ad54ad tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.292148 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9388daa5-d55a-4047-8d9e-eb94b4bcb7d5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.061666 Jan 22 21:04:56.294746 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 783/1611] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:56 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:56.334686 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3541bd55-9f66-4d99-8253-413cd5ad54ad tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 32638 microversion: 2.1 time: 0.086720 Jan 22 21:04:56.335729 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 829/1612] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:56 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 32638 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:56.439046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7f5ecc26-9785-46dd-9d50-4be3184de0d1 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Action: 'create', calling method: .version_select at 0x7f1ed5ab21f0>, body: {"keypair": {"name": "tempest-keypair-101243342"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:56.457856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7f5ecc26-9785-46dd-9d50-4be3184de0d1 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:56.468293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7f5ecc26-9785-46dd-9d50-4be3184de0d1 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for user a9290ae266fa42699fa175d6b34ebaf5 and project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:56.503993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bb3b9e83-43c4-46c9-911d-b3c3ae9a76a4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:56.504706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bb3b9e83-43c4-46c9-911d-b3c3ae9a76a4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 479ddfa2-304b-488e-ad75-0f509ecae3aa] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:56.515367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb3b9e83-43c4-46c9-911d-b3c3ae9a76a4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.516186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb3b9e83-43c4-46c9-911d-b3c3ae9a76a4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.517239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb3b9e83-43c4-46c9-911d-b3c3ae9a76a4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.517972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb3b9e83-43c4-46c9-911d-b3c3ae9a76a4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.534823 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-bb3b9e83-43c4-46c9-911d-b3c3ae9a76a4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] HTTP exception thrown: Instance 479ddfa2-304b-488e-ad75-0f509ecae3aa could not be found. Jan 22 21:04:56.535806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bb3b9e83-43c4-46c9-911d-b3c3ae9a76a4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Returning 404 to user: Instance 479ddfa2-304b-488e-ad75-0f509ecae3aa could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:56.536896 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bb3b9e83-43c4-46c9-911d-b3c3ae9a76a4 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa" status: 404 len: 111 microversion: 2.1 time: 0.039797 Jan 22 21:04:56.541757 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 830/1613] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:56 2022] GET /compute/v2.1/servers/479ddfa2-304b-488e-ad75-0f509ecae3aa => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:04:56.553547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-db749b8f-8e9d-45df-82cd-abd87c18a471 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:56.553547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-db749b8f-8e9d-45df-82cd-abd87c18a471 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:56.556680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db749b8f-8e9d-45df-82cd-abd87c18a471 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.557436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db749b8f-8e9d-45df-82cd-abd87c18a471 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.558918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db749b8f-8e9d-45df-82cd-abd87c18a471 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.559487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db749b8f-8e9d-45df-82cd-abd87c18a471 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.575319 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-db749b8f-8e9d-45df-82cd-abd87c18a471 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] HTTP exception thrown: Instance e61d4e4a-a3e5-4329-94b0-bfcd080a47cb could not be found. Jan 22 21:04:56.576074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-db749b8f-8e9d-45df-82cd-abd87c18a471 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Returning 404 to user: Instance e61d4e4a-a3e5-4329-94b0-bfcd080a47cb could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:56.577159 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-db749b8f-8e9d-45df-82cd-abd87c18a471 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "DELETE /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 404 len: 111 microversion: 2.1 time: 0.033152 Jan 22 21:04:56.577826 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 831/1614] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:04:56 2022] DELETE /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:04:56.585657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ce1d5aa-89e4-4fe0-a801-2359ed002e97 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:56.586354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1ce1d5aa-89e4-4fe0-a801-2359ed002e97 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: e61d4e4a-a3e5-4329-94b0-bfcd080a47cb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:56.593959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ce1d5aa-89e4-4fe0-a801-2359ed002e97 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.594420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ce1d5aa-89e4-4fe0-a801-2359ed002e97 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.595388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ce1d5aa-89e4-4fe0-a801-2359ed002e97 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.595839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ce1d5aa-89e4-4fe0-a801-2359ed002e97 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.616577 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-1ce1d5aa-89e4-4fe0-a801-2359ed002e97 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] HTTP exception thrown: Instance e61d4e4a-a3e5-4329-94b0-bfcd080a47cb could not be found. Jan 22 21:04:56.618603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ce1d5aa-89e4-4fe0-a801-2359ed002e97 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Returning 404 to user: Instance e61d4e4a-a3e5-4329-94b0-bfcd080a47cb could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:56.618603 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ce1d5aa-89e4-4fe0-a801-2359ed002e97 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb" status: 404 len: 111 microversion: 2.1 time: 0.036309 Jan 22 21:04:56.618798 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 832/1615] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:56 2022] GET /compute/v2.1/servers/e61d4e4a-a3e5-4329-94b0-bfcd080a47cb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:04:56.627633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-82b4d5e5-ba0d-45cb-9f59-06a5dfe0fe86 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:56.628389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-82b4d5e5-ba0d-45cb-9f59-06a5dfe0fe86 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:56.634767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82b4d5e5-ba0d-45cb-9f59-06a5dfe0fe86 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.635460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82b4d5e5-ba0d-45cb-9f59-06a5dfe0fe86 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.637719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82b4d5e5-ba0d-45cb-9f59-06a5dfe0fe86 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.638193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82b4d5e5-ba0d-45cb-9f59-06a5dfe0fe86 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.651036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7f5ecc26-9785-46dd-9d50-4be3184de0d1 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:56.656555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7f5ecc26-9785-46dd-9d50-4be3184de0d1 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for user a9290ae266fa42699fa175d6b34ebaf5 and project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:56.659226 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-82b4d5e5-ba0d-45cb-9f59-06a5dfe0fe86 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] HTTP exception thrown: Instance 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a could not be found. Jan 22 21:04:56.659860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-82b4d5e5-ba0d-45cb-9f59-06a5dfe0fe86 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Returning 404 to user: Instance 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:56.660725 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-82b4d5e5-ba0d-45cb-9f59-06a5dfe0fe86 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 404 len: 111 microversion: 2.1 time: 0.037072 Jan 22 21:04:56.661301 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 833/1616] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:04:56 2022] DELETE /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:04:56.672534 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7f5ecc26-9785-46dd-9d50-4be3184de0d1 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.2 time: 0.376407 Jan 22 21:04:56.673281 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 784/1617] 10.222.0.100 () {62 vars in 1202 bytes} [Sat Jan 22 21:04:56 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 378 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:56.674914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2a74f48c-f149-4524-8026-2b16a49d2df5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:56.677632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2a74f48c-f149-4524-8026-2b16a49d2df5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] [instance: 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:56.681894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a74f48c-f149-4524-8026-2b16a49d2df5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.682354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a74f48c-f149-4524-8026-2b16a49d2df5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.683215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a74f48c-f149-4524-8026-2b16a49d2df5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.683738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a74f48c-f149-4524-8026-2b16a49d2df5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.684242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ddcf127f-4602-46f4-8cee-d2a366d34574 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Calling method '.version_select at 0x7f1ed5a98f70>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:56.692320 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ddcf127f-4602-46f4-8cee-d2a366d34574 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "GET /compute/v2.1/os-keypairs/tempest-keypair-101243342" status: 200 len: 706 microversion: 2.2 time: 0.011736 Jan 22 21:04:56.692891 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 785/1618] 10.222.0.100 () {60 vars in 1259 bytes} [Sat Jan 22 21:04:56 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-101243342 => generated 706 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:04:56.698559 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-2a74f48c-f149-4524-8026-2b16a49d2df5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] HTTP exception thrown: Instance 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a could not be found. Jan 22 21:04:56.699209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2a74f48c-f149-4524-8026-2b16a49d2df5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] Returning 404 to user: Instance 7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:04:56.704440 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2a74f48c-f149-4524-8026-2b16a49d2df5 tempest-ServerDiskConfigTestJSON-2133663655 tempest-ServerDiskConfigTestJSON-2133663655-project] 10.222.0.100 "GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a" status: 404 len: 111 microversion: 2.1 time: 0.029145 Jan 22 21:04:56.704440 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 834/1619] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:56 2022] GET /compute/v2.1/servers/7dd9b3f6-97c6-4cfe-8d55-d6da26927c3a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:04:56.704843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-54b4675e-3297-4c18-8c86-0da565e18591 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Calling method '.version_select at 0x7f1ed5dabaf0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:56.786442 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-54b4675e-3297-4c18-8c86-0da565e18591 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-101243342" status: 204 len: 0 microversion: 2.2 time: 0.087162 Jan 22 21:04:56.789668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 786/1620] 10.222.0.100 () {60 vars in 1262 bytes} [Sat Jan 22 21:04:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-101243342 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:04:56.798092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e9a65e9a-23a5-4e2c-b8e6-303878c5184b tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Action: 'create', calling method: .version_select at 0x7f1ed5e65310>, body: {"keypair": {"name": "tempest-keypair-264187662"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:56.810648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eb7d4825-f365-4664-a4fd-292ac741aecc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:56.811439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eb7d4825-f365-4664-a4fd-292ac741aecc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:56.813887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e9a65e9a-23a5-4e2c-b8e6-303878c5184b tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:56.818068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb7d4825-f365-4664-a4fd-292ac741aecc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.818589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb7d4825-f365-4664-a4fd-292ac741aecc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:56.826017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e9a65e9a-23a5-4e2c-b8e6-303878c5184b tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for user a9290ae266fa42699fa175d6b34ebaf5 and project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:56.826317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb7d4825-f365-4664-a4fd-292ac741aecc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:56.826317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb7d4825-f365-4664-a4fd-292ac741aecc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:57.075747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eb7d4825-f365-4664-a4fd-292ac741aecc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:57.096244 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eb7d4825-f365-4664-a4fd-292ac741aecc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1200 microversion: 2.1 time: 0.291883 Jan 22 21:04:57.106639 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 787/1621] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:56 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1200 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:57.176133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bb0373ad-8b7c-4a3b-8854-6e0d2245a107 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:57.176756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bb0373ad-8b7c-4a3b-8854-6e0d2245a107 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:57.244447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bb0373ad-8b7c-4a3b-8854-6e0d2245a107 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:57.252529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bb0373ad-8b7c-4a3b-8854-6e0d2245a107 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:57.254247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bb0373ad-8b7c-4a3b-8854-6e0d2245a107 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:57.255389 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bb0373ad-8b7c-4a3b-8854-6e0d2245a107 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1107 microversion: 2.25 time: 0.083072 Jan 22 21:04:57.256348 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 788/1622] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:04:57 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1107 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:04:57.267467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6e00c196-54f4-45a9-b9aa-6f86dcf53606 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:57.268096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6e00c196-54f4-45a9-b9aa-6f86dcf53606 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:57.275273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e00c196-54f4-45a9-b9aa-6f86dcf53606 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:57.280336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e00c196-54f4-45a9-b9aa-6f86dcf53606 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:57.280336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e00c196-54f4-45a9-b9aa-6f86dcf53606 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:57.280336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e00c196-54f4-45a9-b9aa-6f86dcf53606 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:57.311710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e9a65e9a-23a5-4e2c-b8e6-303878c5184b tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:57.317299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e9a65e9a-23a5-4e2c-b8e6-303878c5184b tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for user a9290ae266fa42699fa175d6b34ebaf5 and project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:57.338852 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e9a65e9a-23a5-4e2c-b8e6-303878c5184b tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.538629 Jan 22 21:04:57.338852 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 835/1623] 10.222.0.100 () {62 vars in 1202 bytes} [Sat Jan 22 21:04:56 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 540 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:04:57.343044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c6be03b4-7976-416e-b819-a0f2b6b2e218 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:57.343995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c6be03b4-7976-416e-b819-a0f2b6b2e218 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:57.352007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6be03b4-7976-416e-b819-a0f2b6b2e218 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:57.352465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6be03b4-7976-416e-b819-a0f2b6b2e218 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:57.353287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6be03b4-7976-416e-b819-a0f2b6b2e218 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:57.353818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6be03b4-7976-416e-b819-a0f2b6b2e218 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:57.404619 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c6be03b4-7976-416e-b819-a0f2b6b2e218 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.069230 Jan 22 21:04:57.406993 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 836/1624] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:57 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:57.420607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0f8bcece-dab2-46d3-adbc-36f676b42201 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:57.422031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0f8bcece-dab2-46d3-adbc-36f676b42201 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:57.434171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f8bcece-dab2-46d3-adbc-36f676b42201 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:57.434772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f8bcece-dab2-46d3-adbc-36f676b42201 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:57.435598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f8bcece-dab2-46d3-adbc-36f676b42201 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:57.436037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f8bcece-dab2-46d3-adbc-36f676b42201 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:57.490825 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0f8bcece-dab2-46d3-adbc-36f676b42201 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.082158 Jan 22 21:04:57.494150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6e00c196-54f4-45a9-b9aa-6f86dcf53606 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:57.494757 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 837/1625] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:57 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:57.502056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-28796d33-f51d-4633-a238-3570c23af8b5 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Calling method '.version_select at 0x7f1ed5efedc0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:57.506015 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6e00c196-54f4-45a9-b9aa-6f86dcf53606 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.242185 Jan 22 21:04:57.506854 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 789/1626] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:57 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:57.513039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4dd4c3e1-41ff-49b6-b0ef-59d26b73bba1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:57.514353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4dd4c3e1-41ff-49b6-b0ef-59d26b73bba1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:57.522057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4dd4c3e1-41ff-49b6-b0ef-59d26b73bba1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:57.522558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4dd4c3e1-41ff-49b6-b0ef-59d26b73bba1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:57.523380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4dd4c3e1-41ff-49b6-b0ef-59d26b73bba1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:57.523833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4dd4c3e1-41ff-49b6-b0ef-59d26b73bba1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:57.579904 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-28796d33-f51d-4633-a238-3570c23af8b5 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-264187662" status: 204 len: 0 microversion: 2.2 time: 0.083382 Jan 22 21:04:57.580467 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 838/1627] 10.222.0.100 () {60 vars in 1262 bytes} [Sat Jan 22 21:04:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-264187662 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:57.589832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-0b9dc5c0-ef8c-4262-9238-0262131e8471 req-355daafe-bb41-4ec9-a629-bf6390faeee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030", "tag": "241845a7-45d2-443a-a581-ab21d64d2668"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:57.591422 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:04:57.591422 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:04:57.596277 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4dd4c3e1-41ff-49b6-b0ef-59d26b73bba1 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action" status: 200 len: 40789 microversion: 2.1 time: 0.087948 Jan 22 21:04:57.597096 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 790/1628] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:57 2022] POST /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d/action => generated 40789 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:57.614486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1b77a47f-6226-4a32-99b8-e25206d87755 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Action: 'create', calling method: .version_select at 0x7f1ed5cf9160>, body: {"keypair": {"name": "tempest-keypair-1327081486", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:57.628248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0b9dc5c0-ef8c-4262-9238-0262131e8471 req-355daafe-bb41-4ec9-a629-bf6390faeee3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:57.630097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0b9dc5c0-ef8c-4262-9238-0262131e8471 req-355daafe-bb41-4ec9-a629-bf6390faeee3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:57.632872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-1b77a47f-6226-4a32-99b8-e25206d87755 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:57.638785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-1b77a47f-6226-4a32-99b8-e25206d87755 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for user a9290ae266fa42699fa175d6b34ebaf5 and project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:57.656594 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-0b9dc5c0-ef8c-4262-9238-0262131e8471 req-355daafe-bb41-4ec9-a629-bf6390faeee3 service nova] Creating event network-changed:241845a7-45d2-443a-a581-ab21d64d2668 for instance 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 on nch1-master-1 Jan 22 21:04:57.664281 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-0b9dc5c0-ef8c-4262-9238-0262131e8471 req-355daafe-bb41-4ec9-a629-bf6390faeee3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078474 Jan 22 21:04:57.664986 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 839/1629] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:57.735615 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1b77a47f-6226-4a32-99b8-e25206d87755 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.137057 Jan 22 21:04:57.736534 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 791/1630] 10.222.0.100 () {62 vars in 1203 bytes} [Sat Jan 22 21:04:57 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jan 22 21:04:57.752260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b4472c37-fa94-4c8d-9516-43246247e35b tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Calling method '.version_select at 0x7f1ed5efef70>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:57.860053 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b4472c37-fa94-4c8d-9516-43246247e35b tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327081486" status: 204 len: 0 microversion: 2.2 time: 0.117401 Jan 22 21:04:57.860857 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 840/1631] 10.222.0.100 () {60 vars in 1265 bytes} [Sat Jan 22 21:04:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327081486 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:04:57.872842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a9aef92-97ab-4604-aa5e-e6c0d259efdc tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Action: 'create', calling method: .version_select at 0x7f1ed5a90940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1613396245"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:57.889803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-9a9aef92-97ab-4604-aa5e-e6c0d259efdc tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:57.895168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-9a9aef92-97ab-4604-aa5e-e6c0d259efdc tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for user a9290ae266fa42699fa175d6b34ebaf5 and project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:58.061295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-9a9aef92-97ab-4604-aa5e-e6c0d259efdc tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:58.066227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-9a9aef92-97ab-4604-aa5e-e6c0d259efdc tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for user a9290ae266fa42699fa175d6b34ebaf5 and project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:58.081459 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a9aef92-97ab-4604-aa5e-e6c0d259efdc tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.2 time: 0.213839 Jan 22 21:04:58.082054 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 792/1632] 10.222.0.100 () {62 vars in 1202 bytes} [Sat Jan 22 21:04:57 2022] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 215 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:58.094163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad7b5012-753f-4343-ad83-9f763534b9fa tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Action: 'create', calling method: .version_select at 0x7f1ed5e13280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-107731682"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:58.108491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ad7b5012-753f-4343-ad83-9f763534b9fa tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:58.113779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ad7b5012-753f-4343-ad83-9f763534b9fa tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for user a9290ae266fa42699fa175d6b34ebaf5 and project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:58.120355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-18070051-b8ee-47ac-ab63-016437fdb061 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:58.121618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-18070051-b8ee-47ac-ab63-016437fdb061 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:58.129538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18070051-b8ee-47ac-ab63-016437fdb061 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:58.129757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18070051-b8ee-47ac-ab63-016437fdb061 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:58.130550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18070051-b8ee-47ac-ab63-016437fdb061 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:58.130998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18070051-b8ee-47ac-ab63-016437fdb061 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:58.325368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-18070051-b8ee-47ac-ab63-016437fdb061 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:58.333130 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-18070051-b8ee-47ac-ab63-016437fdb061 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1200 microversion: 2.1 time: 0.217821 Jan 22 21:04:58.333762 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 793/1633] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:58 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1200 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:58.342891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24879f64-7c97-467e-ba9a-75b327d43fe6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:58.343808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-24879f64-7c97-467e-ba9a-75b327d43fe6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:58.349993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24879f64-7c97-467e-ba9a-75b327d43fe6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:58.350554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24879f64-7c97-467e-ba9a-75b327d43fe6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:58.350677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ad7b5012-753f-4343-ad83-9f763534b9fa tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:58.351439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24879f64-7c97-467e-ba9a-75b327d43fe6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:58.351976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24879f64-7c97-467e-ba9a-75b327d43fe6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:58.355919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ad7b5012-753f-4343-ad83-9f763534b9fa tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for user a9290ae266fa42699fa175d6b34ebaf5 and project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:58.372052 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad7b5012-753f-4343-ad83-9f763534b9fa tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.2 time: 0.283866 Jan 22 21:04:58.373427 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 841/1634] 10.222.0.100 () {62 vars in 1202 bytes} [Sat Jan 22 21:04:58 2022] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 286 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:58.382777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a4035405-1f33-420d-bce3-83a29ff7f6d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:58.383991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a4035405-1f33-420d-bce3-83a29ff7f6d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:58.389676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-24879f64-7c97-467e-ba9a-75b327d43fe6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:04:58.396610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4035405-1f33-420d-bce3-83a29ff7f6d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:58.397079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4035405-1f33-420d-bce3-83a29ff7f6d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:58.397928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4035405-1f33-420d-bce3-83a29ff7f6d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:58.398587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4035405-1f33-420d-bce3-83a29ff7f6d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:58.466287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a4035405-1f33-420d-bce3-83a29ff7f6d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:58.474927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a4035405-1f33-420d-bce3-83a29ff7f6d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:58.476459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a4035405-1f33-420d-bce3-83a29ff7f6d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:58.477616 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a4035405-1f33-420d-bce3-83a29ff7f6d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1244 microversion: 2.25 time: 0.103028 Jan 22 21:04:58.481630 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 842/1635] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:04:58 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1244 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:04:58.491438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f7b31925-cab0-4d35-83c7-6a9c3be7f4c6 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Action: 'create', calling method: .version_select at 0x7f1ed5e07940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-410514877"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:58.508151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f7b31925-cab0-4d35-83c7-6a9c3be7f4c6 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:58.516593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f7b31925-cab0-4d35-83c7-6a9c3be7f4c6 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for user a9290ae266fa42699fa175d6b34ebaf5 and project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:58.687198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f7b31925-cab0-4d35-83c7-6a9c3be7f4c6 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:58.694128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f7b31925-cab0-4d35-83c7-6a9c3be7f4c6 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for user a9290ae266fa42699fa175d6b34ebaf5 and project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:58.702798 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-24879f64-7c97-467e-ba9a-75b327d43fe6 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "DELETE /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 204 len: 0 microversion: 2.1 time: 0.367648 Jan 22 21:04:58.703480 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 794/1636] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:04:58 2022] DELETE /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:58.709115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c35f64f1-5424-4845-87c0-dbd230218d51 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:58.710949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c35f64f1-5424-4845-87c0-dbd230218d51 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:58.723308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c35f64f1-5424-4845-87c0-dbd230218d51 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:58.723452 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f7b31925-cab0-4d35-83c7-6a9c3be7f4c6 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.2 time: 0.235946 Jan 22 21:04:58.723892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c35f64f1-5424-4845-87c0-dbd230218d51 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:58.724502 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 843/1637] 10.222.0.100 () {62 vars in 1202 bytes} [Sat Jan 22 21:04:58 2022] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 245 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:58.725040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c35f64f1-5424-4845-87c0-dbd230218d51 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:58.725608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c35f64f1-5424-4845-87c0-dbd230218d51 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:58.731597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e1815b38-6bfe-462f-802c-645b0ca3e925 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:58.732637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e1815b38-6bfe-462f-802c-645b0ca3e925 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:58.741063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1815b38-6bfe-462f-802c-645b0ca3e925 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:58.741673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1815b38-6bfe-462f-802c-645b0ca3e925 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:58.742555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1815b38-6bfe-462f-802c-645b0ca3e925 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:58.743066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1815b38-6bfe-462f-802c-645b0ca3e925 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:58.796579 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c35f64f1-5424-4845-87c0-dbd230218d51 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.090728 Jan 22 21:04:58.797362 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 795/1638] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:58 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:58.803956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-577b4768-d007-4aee-a79d-38cd1feef726 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:58.804503 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e1815b38-6bfe-462f-802c-645b0ca3e925 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.078404 Jan 22 21:04:58.805163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-577b4768-d007-4aee-a79d-38cd1feef726 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:58.805294 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 844/1639] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:58 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:58.814539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-577b4768-d007-4aee-a79d-38cd1feef726 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:58.815311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-577b4768-d007-4aee-a79d-38cd1feef726 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:58.816315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-577b4768-d007-4aee-a79d-38cd1feef726 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:58.816458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7cadfc94-c3af-4284-8b60-33f9370227ce tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:58.817102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-577b4768-d007-4aee-a79d-38cd1feef726 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:58.817239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7cadfc94-c3af-4284-8b60-33f9370227ce tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:58.827882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cadfc94-c3af-4284-8b60-33f9370227ce tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:58.828625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cadfc94-c3af-4284-8b60-33f9370227ce tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:58.829804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cadfc94-c3af-4284-8b60-33f9370227ce tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:58.830414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cadfc94-c3af-4284-8b60-33f9370227ce tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:58.999232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7cadfc94-c3af-4284-8b60-33f9370227ce tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:59.007159 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7cadfc94-c3af-4284-8b60-33f9370227ce tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1670 microversion: 2.1 time: 0.198864 Jan 22 21:04:59.008169 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 845/1640] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:58 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1670 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:59.013791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ac36110c-e7f2-4321-8352-f48ab13e5cb7 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Calling method '.version_select at 0x7f1ed5e079d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:59.017212 ncdv-master-1 devstack@n-api.service[137032]: WARNING oslo_db.sqlalchemy.utils [None req-ac36110c-e7f2-4321-8352-f48ab13e5cb7 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Unique keys not in sort_keys. The sorting order may be unstable. Jan 22 21:04:59.022903 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ac36110c-e7f2-4321-8352-f48ab13e5cb7 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "GET /compute/v2.1/os-keypairs" status: 200 len: 1722 microversion: 2.2 time: 0.013521 Jan 22 21:04:59.029647 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 846/1641] 10.222.0.100 () {60 vars in 1181 bytes} [Sat Jan 22 21:04:59 2022] GET /compute/v2.1/os-keypairs => generated 1722 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:59.039924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9eac93cd-9e5c-4ffe-b689-708d30c77c3a tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Calling method '.version_select at 0x7f1ed602c1f0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:59.094315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-577b4768-d007-4aee-a79d-38cd1feef726 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:59.103255 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-577b4768-d007-4aee-a79d-38cd1feef726 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.304212 Jan 22 21:04:59.104335 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 796/1642] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:58 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:04:59.120397 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9eac93cd-9e5c-4ffe-b689-708d30c77c3a tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-410514877" status: 204 len: 0 microversion: 2.2 time: 0.085335 Jan 22 21:04:59.125165 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 847/1643] 10.222.0.100 () {60 vars in 1322 bytes} [Sat Jan 22 21:04:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-410514877 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:59.130742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-42945062-484c-4155-950d-2a110d701bf9 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Calling method '.version_select at 0x7f1ed5e2d790>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:59.237230 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-42945062-484c-4155-950d-2a110d701bf9 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-107731682" status: 204 len: 0 microversion: 2.2 time: 0.109828 Jan 22 21:04:59.241086 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 797/1644] 10.222.0.100 () {60 vars in 1322 bytes} [Sat Jan 22 21:04:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-107731682 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:59.246736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-05faa975-ce88-4bd4-99f3-1e5a1035126d tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Calling method '.version_select at 0x7f1ed63b9040>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:59.322819 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-05faa975-ce88-4bd4-99f3-1e5a1035126d tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1613396245" status: 204 len: 0 microversion: 2.2 time: 0.080280 Jan 22 21:04:59.324274 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 848/1645] 10.222.0.100 () {60 vars in 1325 bytes} [Sat Jan 22 21:04:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1613396245 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:59.334471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-97d86b39-b650-4504-8472-1ce9185289a9 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Action: 'create', calling method: .version_select at 0x7f1ed5a3d0d0>, body: {"keypair": {"name": "tempest-keypair-1074367809"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:59.351318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a25b41d6-cacb-493d-88f6-8dab4a850485 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:59.352397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a25b41d6-cacb-493d-88f6-8dab4a850485 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:59.354526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-97d86b39-b650-4504-8472-1ce9185289a9 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:59.360126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-97d86b39-b650-4504-8472-1ce9185289a9 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for user a9290ae266fa42699fa175d6b34ebaf5 and project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:59.362532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a25b41d6-cacb-493d-88f6-8dab4a850485 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:59.363052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a25b41d6-cacb-493d-88f6-8dab4a850485 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:59.367716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a25b41d6-cacb-493d-88f6-8dab4a850485 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:59.367716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a25b41d6-cacb-493d-88f6-8dab4a850485 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:59.576311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a25b41d6-cacb-493d-88f6-8dab4a850485 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:59.582041 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a25b41d6-cacb-493d-88f6-8dab4a850485 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1200 microversion: 2.1 time: 0.235258 Jan 22 21:04:59.582829 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 849/1646] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:04:59 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1200 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:04:59.597813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bd8d368e-c15a-4e65-9033-0bef85ea66df tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:59.598449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bd8d368e-c15a-4e65-9033-0bef85ea66df tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:59.604418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd8d368e-c15a-4e65-9033-0bef85ea66df tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:59.604908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd8d368e-c15a-4e65-9033-0bef85ea66df tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:59.606814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd8d368e-c15a-4e65-9033-0bef85ea66df tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:59.607363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd8d368e-c15a-4e65-9033-0bef85ea66df tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:59.761739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bd8d368e-c15a-4e65-9033-0bef85ea66df tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:59.765589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-97d86b39-b650-4504-8472-1ce9185289a9 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:04:59.771294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-97d86b39-b650-4504-8472-1ce9185289a9 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for user a9290ae266fa42699fa175d6b34ebaf5 and project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:04:59.771474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bd8d368e-c15a-4e65-9033-0bef85ea66df tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:59.773610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bd8d368e-c15a-4e65-9033-0bef85ea66df tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:04:59.775202 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bd8d368e-c15a-4e65-9033-0bef85ea66df tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1296 microversion: 2.25 time: 0.180615 Jan 22 21:04:59.775496 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 850/1647] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:04:59 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1296 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:04:59.797825 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-97d86b39-b650-4504-8472-1ce9185289a9 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.2 time: 0.468094 Jan 22 21:04:59.798947 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 798/1648] 10.222.0.100 () {62 vars in 1202 bytes} [Sat Jan 22 21:04:59 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 470 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:04:59.818906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-29e91fea-e510-47a1-aa00-38e85468a561 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Calling method '.version_select at 0x7f1ed5a3d430>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:59.820127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cd49b2cd-ff3f-4950-baf1-46ae897ebdf6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:59.823135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cd49b2cd-ff3f-4950-baf1-46ae897ebdf6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:59.831014 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-29e91fea-e510-47a1-aa00-38e85468a561 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "GET /compute/v2.1/os-keypairs/tempest-keypair-1074367809" status: 200 len: 707 microversion: 2.2 time: 0.025912 Jan 22 21:04:59.831863 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 799/1649] 10.222.0.100 () {60 vars in 1262 bytes} [Sat Jan 22 21:04:59 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1074367809 => generated 707 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:59.834963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd49b2cd-ff3f-4950-baf1-46ae897ebdf6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:59.835432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd49b2cd-ff3f-4950-baf1-46ae897ebdf6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:59.837085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd49b2cd-ff3f-4950-baf1-46ae897ebdf6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:59.837562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd49b2cd-ff3f-4950-baf1-46ae897ebdf6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:59.837869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-60f74a41-1aac-4f99-9599-a5228bb092dd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:04:59.839628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-60f74a41-1aac-4f99-9599-a5228bb092dd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:04:59.864735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60f74a41-1aac-4f99-9599-a5228bb092dd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:59.868707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60f74a41-1aac-4f99-9599-a5228bb092dd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:59.869884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60f74a41-1aac-4f99-9599-a5228bb092dd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:04:59.871826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60f74a41-1aac-4f99-9599-a5228bb092dd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:04:59.899184 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cd49b2cd-ff3f-4950-baf1-46ae897ebdf6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.092181 Jan 22 21:04:59.900703 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 851/1650] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:59 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:04:59.907112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-58c034d7-b3dc-4550-a32a-4e3190a3970f tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Calling method '.version_select at 0x7f1ed61670d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:59.910638 ncdv-master-1 devstack@n-api.service[137032]: WARNING oslo_db.sqlalchemy.utils [None req-58c034d7-b3dc-4550-a32a-4e3190a3970f tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Unique keys not in sort_keys. The sorting order may be unstable. Jan 22 21:04:59.917908 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-58c034d7-b3dc-4550-a32a-4e3190a3970f tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "GET /compute/v2.1/os-keypairs" status: 200 len: 564 microversion: 2.2 time: 0.014253 Jan 22 21:04:59.919298 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 852/1651] 10.222.0.100 () {60 vars in 1181 bytes} [Sat Jan 22 21:04:59 2022] GET /compute/v2.1/os-keypairs => generated 564 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:04:59.928723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-90e41329-b284-4cc2-8f69-9ef86ecd56f2 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Calling method '.version_select at 0x7f1ed5e65f70>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:04:59.930771 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-60f74a41-1aac-4f99-9599-a5228bb092dd tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.097457 Jan 22 21:04:59.932650 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 800/1652] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:04:59 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:00.030361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-498c0458-3eaf-4b2b-86ac-0bf470ddd0da tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:00.032971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-498c0458-3eaf-4b2b-86ac-0bf470ddd0da tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:00.040684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-498c0458-3eaf-4b2b-86ac-0bf470ddd0da tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:00.041466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-498c0458-3eaf-4b2b-86ac-0bf470ddd0da tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:00.043213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-498c0458-3eaf-4b2b-86ac-0bf470ddd0da tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:00.044466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-498c0458-3eaf-4b2b-86ac-0bf470ddd0da tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:00.045358 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-90e41329-b284-4cc2-8f69-9ef86ecd56f2 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1074367809" status: 204 len: 0 microversion: 2.2 time: 0.120399 Jan 22 21:05:00.046181 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 853/1653] 10.222.0.100 () {60 vars in 1265 bytes} [Sat Jan 22 21:04:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1074367809 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:05:00.059476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f6c364f2-20bc-4907-a543-43e1f283a1c3 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Action: 'create', calling method: .version_select at 0x7f1ed63c85e0>, body: {"keypair": {"name": "tempest-keypair-924479504", "type": "x509"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:00.088956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f6c364f2-20bc-4907-a543-43e1f283a1c3 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:00.095137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f6c364f2-20bc-4907-a543-43e1f283a1c3 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for user a9290ae266fa42699fa175d6b34ebaf5 and project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:00.113468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.processutils [None req-f6c364f2-20bc-4907-a543-43e1f283a1c3 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpl_e46sqk/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpl_e46sqk/temp.key -subj /CN=a9290ae266fa42699fa175d6b34ebaf5 -extensions v3_req_client {{(pid=137032) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:05:00.410748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-498c0458-3eaf-4b2b-86ac-0bf470ddd0da tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:00.420634 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-498c0458-3eaf-4b2b-86ac-0bf470ddd0da tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1670 microversion: 2.1 time: 0.398147 Jan 22 21:05:00.421916 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 801/1654] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:00 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1670 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:00.427253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ca0621c-0b68-4888-87ad-b877d64bc17c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:00.428190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ca0621c-0b68-4888-87ad-b877d64bc17c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:00.435192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ca0621c-0b68-4888-87ad-b877d64bc17c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:00.435990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ca0621c-0b68-4888-87ad-b877d64bc17c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:00.437096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ca0621c-0b68-4888-87ad-b877d64bc17c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:00.437853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ca0621c-0b68-4888-87ad-b877d64bc17c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:00.449450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.processutils [None req-f6c364f2-20bc-4907-a543-43e1f283a1c3 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpl_e46sqk/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpl_e46sqk/temp.key -subj /CN=a9290ae266fa42699fa175d6b34ebaf5 -extensions v3_req_client" returned: 0 in 0.335s {{(pid=137032) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:05:00.451324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.processutils [None req-f6c364f2-20bc-4907-a543-43e1f283a1c3 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpl_e46sqk/temp.key -password pass: {{(pid=137032) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jan 22 21:05:00.495313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.processutils [None req-f6c364f2-20bc-4907-a543-43e1f283a1c3 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpl_e46sqk/temp.key -password pass:" returned: 0 in 0.043s {{(pid=137032) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jan 22 21:05:00.694598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f6c364f2-20bc-4907-a543-43e1f283a1c3 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:00.700150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f6c364f2-20bc-4907-a543-43e1f283a1c3 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Getting quotas for user a9290ae266fa42699fa175d6b34ebaf5 and project fc42fd6d1f6d4db2aca15e99259c1780. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:00.704616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8ca0621c-0b68-4888-87ad-b877d64bc17c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:00.715304 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ca0621c-0b68-4888-87ad-b877d64bc17c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.291265 Jan 22 21:05:00.719499 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 802/1655] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:00 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:00.724047 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f6c364f2-20bc-4907-a543-43e1f283a1c3 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.670425 Jan 22 21:05:00.729699 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 854/1656] 10.222.0.100 () {62 vars in 1202 bytes} [Sat Jan 22 21:05:00 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 677 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:05:00.732301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-792bdb1f-4b2a-41f9-a381-98f28abecf50 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:00.734138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-792bdb1f-4b2a-41f9-a381-98f28abecf50 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:00.739607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fc550721-d8d2-46f5-97a6-a077130382b4 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Calling method '.version_select at 0x7f1ed5ec65e0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:00.742807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-792bdb1f-4b2a-41f9-a381-98f28abecf50 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:00.742807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-792bdb1f-4b2a-41f9-a381-98f28abecf50 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:00.742807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-792bdb1f-4b2a-41f9-a381-98f28abecf50 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:00.743175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-792bdb1f-4b2a-41f9-a381-98f28abecf50 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:00.749956 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fc550721-d8d2-46f5-97a6-a077130382b4 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "GET /compute/v2.1/os-keypairs/tempest-keypair-924479504" status: 200 len: 1533 microversion: 2.2 time: 0.015867 Jan 22 21:05:00.750807 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 855/1657] 10.222.0.100 () {60 vars in 1259 bytes} [Sat Jan 22 21:05:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-924479504 => generated 1533 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:00.765330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-79205d4e-582a-4d7c-95e2-0a304cfabc3f tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Calling method '.version_select at 0x7f1ed5e07af0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:00.768523 ncdv-master-1 devstack@n-api.service[137032]: WARNING oslo_db.sqlalchemy.utils [None req-79205d4e-582a-4d7c-95e2-0a304cfabc3f tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Unique keys not in sort_keys. The sorting order may be unstable. Jan 22 21:05:00.774006 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-79205d4e-582a-4d7c-95e2-0a304cfabc3f tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.017035 Jan 22 21:05:00.774813 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 856/1658] 10.222.0.100 () {60 vars in 1181 bytes} [Sat Jan 22 21:05:00 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:00.789123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d2ead801-6608-4e27-bfd3-1b53b206b167 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] Calling method '.version_select at 0x7f1ed5ea0b80>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:00.920783 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d2ead801-6608-4e27-bfd3-1b53b206b167 tempest-KeyPairsV22TestJSON-107621027 tempest-KeyPairsV22TestJSON-107621027-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-924479504" status: 204 len: 0 microversion: 2.2 time: 0.136284 Jan 22 21:05:00.921395 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 857/1659] 10.222.0.100 () {60 vars in 1262 bytes} [Sat Jan 22 21:05:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-924479504 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:00.930318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6fc1761d-ceb9-4ae1-99e1-37b71acd4d5c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:00.931166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6fc1761d-ceb9-4ae1-99e1-37b71acd4d5c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:00.945057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6fc1761d-ceb9-4ae1-99e1-37b71acd4d5c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:00.945057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6fc1761d-ceb9-4ae1-99e1-37b71acd4d5c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:00.945057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6fc1761d-ceb9-4ae1-99e1-37b71acd4d5c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:00.945057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6fc1761d-ceb9-4ae1-99e1-37b71acd4d5c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:01.084697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6fc1761d-ceb9-4ae1-99e1-37b71acd4d5c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:01.094410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6fc1761d-ceb9-4ae1-99e1-37b71acd4d5c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:01.095999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6fc1761d-ceb9-4ae1-99e1-37b71acd4d5c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:01.097100 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6fc1761d-ceb9-4ae1-99e1-37b71acd4d5c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1284 microversion: 2.25 time: 0.170624 Jan 22 21:05:01.097940 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 858/1660] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:00 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:01.102613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-86d2aa33-06a1-4e6b-8918-ae1de5dcd6e5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:01.103578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-86d2aa33-06a1-4e6b-8918-ae1de5dcd6e5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:01.110542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86d2aa33-06a1-4e6b-8918-ae1de5dcd6e5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:01.110721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86d2aa33-06a1-4e6b-8918-ae1de5dcd6e5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:01.111489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86d2aa33-06a1-4e6b-8918-ae1de5dcd6e5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:01.111937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86d2aa33-06a1-4e6b-8918-ae1de5dcd6e5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:01.160260 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-86d2aa33-06a1-4e6b-8918-ae1de5dcd6e5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.061292 Jan 22 21:05:01.161192 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 859/1661] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:01 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:01.166109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4ac46b98-261f-4749-a544-9dd24887d902 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:01.167108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4ac46b98-261f-4749-a544-9dd24887d902 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:01.174418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ac46b98-261f-4749-a544-9dd24887d902 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:01.174877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ac46b98-261f-4749-a544-9dd24887d902 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:01.175673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ac46b98-261f-4749-a544-9dd24887d902 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:01.176146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ac46b98-261f-4749-a544-9dd24887d902 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:01.219110 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4ac46b98-261f-4749-a544-9dd24887d902 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.056669 Jan 22 21:05:01.220375 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 860/1662] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:01 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:01.221363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-792bdb1f-4b2a-41f9-a381-98f28abecf50 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:01.232497 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-792bdb1f-4b2a-41f9-a381-98f28abecf50 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1200 microversion: 2.1 time: 0.510849 Jan 22 21:05:01.233554 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 803/1663] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:00 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1200 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:01.441100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d21f2e14-7399-4a09-93d2-be7c2af2b716 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:01.442197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d21f2e14-7399-4a09-93d2-be7c2af2b716 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:01.451942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d21f2e14-7399-4a09-93d2-be7c2af2b716 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:01.452522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d21f2e14-7399-4a09-93d2-be7c2af2b716 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:01.453423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d21f2e14-7399-4a09-93d2-be7c2af2b716 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:01.453919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d21f2e14-7399-4a09-93d2-be7c2af2b716 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:01.552670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-1478a96f-5483-4334-8c36-c8f2a009c4b3 req-ac9eb8c4-a82b-4281-9856-739c02bd63ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64db607b-9a30-4235-909f-39804df2fbf6", "tag": "6fc53fa7-f259-415f-b5ea-1e505f4d2810"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:01.560457 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:01.560457 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:01.563596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1478a96f-5483-4334-8c36-c8f2a009c4b3 req-ac9eb8c4-a82b-4281-9856-739c02bd63ad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:01.564058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1478a96f-5483-4334-8c36-c8f2a009c4b3 req-ac9eb8c4-a82b-4281-9856-739c02bd63ad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:01.579221 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-1478a96f-5483-4334-8c36-c8f2a009c4b3 req-ac9eb8c4-a82b-4281-9856-739c02bd63ad service nova] Creating event network-changed:6fc53fa7-f259-415f-b5ea-1e505f4d2810 for instance 64db607b-9a30-4235-909f-39804df2fbf6 on nch2-master-1 Jan 22 21:05:01.586245 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-1478a96f-5483-4334-8c36-c8f2a009c4b3 req-ac9eb8c4-a82b-4281-9856-739c02bd63ad service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035556 Jan 22 21:05:01.586245 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 804/1664] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:01.659224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d21f2e14-7399-4a09-93d2-be7c2af2b716 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:01.668084 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d21f2e14-7399-4a09-93d2-be7c2af2b716 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1670 microversion: 2.1 time: 0.231308 Jan 22 21:05:01.668964 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 861/1665] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:01 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1670 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:01.736794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3a967424-6b60-4177-a740-bf3f6d41b5e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:01.737511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3a967424-6b60-4177-a740-bf3f6d41b5e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:01.743730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a967424-6b60-4177-a740-bf3f6d41b5e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:01.744187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a967424-6b60-4177-a740-bf3f6d41b5e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:01.745016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a967424-6b60-4177-a740-bf3f6d41b5e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:01.746192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a967424-6b60-4177-a740-bf3f6d41b5e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:02.118520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c0030790-2386-4827-97b3-4d87925f7a65 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:02.119204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c0030790-2386-4827-97b3-4d87925f7a65 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:02.127495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0030790-2386-4827-97b3-4d87925f7a65 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:02.132073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0030790-2386-4827-97b3-4d87925f7a65 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:02.135564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3a967424-6b60-4177-a740-bf3f6d41b5e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:02.137005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0030790-2386-4827-97b3-4d87925f7a65 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:02.137918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0030790-2386-4827-97b3-4d87925f7a65 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:02.156657 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3a967424-6b60-4177-a740-bf3f6d41b5e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.424669 Jan 22 21:05:02.158394 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 805/1666] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:01 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:02.189371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-300e5b09-6d97-40be-9fde-c3d1914a8cdc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:02.195177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-300e5b09-6d97-40be-9fde-c3d1914a8cdc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:02.222475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-300e5b09-6d97-40be-9fde-c3d1914a8cdc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:02.226293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-300e5b09-6d97-40be-9fde-c3d1914a8cdc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:02.228316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-300e5b09-6d97-40be-9fde-c3d1914a8cdc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:02.231332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-300e5b09-6d97-40be-9fde-c3d1914a8cdc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:02.286586 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-300e5b09-6d97-40be-9fde-c3d1914a8cdc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.118414 Jan 22 21:05:02.293466 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 806/1667] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:02 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:02.300452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e26995ba-77f1-4ddd-855f-6bb1da088589 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:02.301801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e26995ba-77f1-4ddd-855f-6bb1da088589 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:02.312591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e26995ba-77f1-4ddd-855f-6bb1da088589 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:02.312591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e26995ba-77f1-4ddd-855f-6bb1da088589 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:02.312591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e26995ba-77f1-4ddd-855f-6bb1da088589 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:02.313775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e26995ba-77f1-4ddd-855f-6bb1da088589 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:02.371702 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e26995ba-77f1-4ddd-855f-6bb1da088589 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.074886 Jan 22 21:05:02.374033 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 807/1668] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:02 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:02.378835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-735f2427-b2c4-4414-b5cc-47bcc48db88d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:02.380349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-735f2427-b2c4-4414-b5cc-47bcc48db88d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:02.389971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-735f2427-b2c4-4414-b5cc-47bcc48db88d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:02.390786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-735f2427-b2c4-4414-b5cc-47bcc48db88d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:02.392249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-735f2427-b2c4-4414-b5cc-47bcc48db88d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:02.392957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-735f2427-b2c4-4414-b5cc-47bcc48db88d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:02.404708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c0030790-2386-4827-97b3-4d87925f7a65 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:02.418908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c0030790-2386-4827-97b3-4d87925f7a65 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:02.421655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c0030790-2386-4827-97b3-4d87925f7a65 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:02.422847 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c0030790-2386-4827-97b3-4d87925f7a65 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1284 microversion: 2.25 time: 0.310238 Jan 22 21:05:02.435989 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 862/1669] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:02 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:02.687370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e758d2b0-1f1c-4f4a-9551-8b3f79a60ba8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:02.688044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e758d2b0-1f1c-4f4a-9551-8b3f79a60ba8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:02.697455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e758d2b0-1f1c-4f4a-9551-8b3f79a60ba8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:02.700458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e758d2b0-1f1c-4f4a-9551-8b3f79a60ba8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:02.710485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e758d2b0-1f1c-4f4a-9551-8b3f79a60ba8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:02.711251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e758d2b0-1f1c-4f4a-9551-8b3f79a60ba8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:02.724255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-735f2427-b2c4-4414-b5cc-47bcc48db88d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:02.743281 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-735f2427-b2c4-4414-b5cc-47bcc48db88d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1200 microversion: 2.1 time: 0.368416 Jan 22 21:05:02.747691 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 808/1670] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:02 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1200 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:02.806539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e758d2b0-1f1c-4f4a-9551-8b3f79a60ba8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c02f7c20dc884b27958f7611f9abc2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f514a46b97a47b3b928fe1135f8f5e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:02.822198 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e758d2b0-1f1c-4f4a-9551-8b3f79a60ba8 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 200 len: 1315 microversion: 2.1 time: 0.139032 Jan 22 21:05:02.831943 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 863/1671] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:02 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:03.126115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1742613410", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "97517ea1-e8d8-4f19-8a32-c9fe319fb621"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:03.174881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a071bade-a28b-49b1-b4fa-e72f6954d8c6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:03.175595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a071bade-a28b-49b1-b4fa-e72f6954d8c6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:03.182566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a071bade-a28b-49b1-b4fa-e72f6954d8c6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:03.184013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a071bade-a28b-49b1-b4fa-e72f6954d8c6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:03.184391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a071bade-a28b-49b1-b4fa-e72f6954d8c6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:03.184856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a071bade-a28b-49b1-b4fa-e72f6954d8c6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:03.198231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] validate_networks() for [('97517ea1-e8d8-4f19-8a32-c9fe319fb621', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:05:03.358113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a071bade-a28b-49b1-b4fa-e72f6954d8c6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:03.375066 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a071bade-a28b-49b1-b4fa-e72f6954d8c6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.203422 Jan 22 21:05:03.376310 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 864/1672] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:03 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:03.381547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7c809fdb-e182-4816-89f3-8e8cfca32b00 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:03.382890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7c809fdb-e182-4816-89f3-8e8cfca32b00 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:03.391757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c809fdb-e182-4816-89f3-8e8cfca32b00 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:03.392489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c809fdb-e182-4816-89f3-8e8cfca32b00 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:03.393473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c809fdb-e182-4816-89f3-8e8cfca32b00 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:03.394137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c809fdb-e182-4816-89f3-8e8cfca32b00 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:03.449872 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7c809fdb-e182-4816-89f3-8e8cfca32b00 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.071069 Jan 22 21:05:03.451178 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 865/1673] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:03 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:03.457978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-569e8e21-a114-4714-b56c-dfedf9ecafc6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:03.459434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-569e8e21-a114-4714-b56c-dfedf9ecafc6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:03.469889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-569e8e21-a114-4714-b56c-dfedf9ecafc6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:03.470867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-569e8e21-a114-4714-b56c-dfedf9ecafc6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:03.471187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-569e8e21-a114-4714-b56c-dfedf9ecafc6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:03.471693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-569e8e21-a114-4714-b56c-dfedf9ecafc6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:03.530401 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-569e8e21-a114-4714-b56c-dfedf9ecafc6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.077390 Jan 22 21:05:03.534265 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 866/1674] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:03 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:03.536382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c806ba1f-30a9-4ce0-9fdd-89e03a66a457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:03.537244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c806ba1f-30a9-4ce0-9fdd-89e03a66a457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:03.545160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c806ba1f-30a9-4ce0-9fdd-89e03a66a457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:03.545496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c806ba1f-30a9-4ce0-9fdd-89e03a66a457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:03.546331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c806ba1f-30a9-4ce0-9fdd-89e03a66a457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:03.546799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c806ba1f-30a9-4ce0-9fdd-89e03a66a457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:03.703968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c806ba1f-30a9-4ce0-9fdd-89e03a66a457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:03.715056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c806ba1f-30a9-4ce0-9fdd-89e03a66a457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:03.717382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c806ba1f-30a9-4ce0-9fdd-89e03a66a457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:03.718656 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c806ba1f-30a9-4ce0-9fdd-89e03a66a457 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1284 microversion: 2.25 time: 0.186222 Jan 22 21:05:03.719244 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 867/1675] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:03 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:03.889938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c84ecb2e-14b5-4aeb-b3fd-faad742adabe tempest-AbsoluteLimitsNegativeTestJSON-966577780 tempest-AbsoluteLimitsNegativeTestJSON-966577780-project] Calling method '.version_select at 0x7f1ed608f790>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:03.903178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c84ecb2e-14b5-4aeb-b3fd-faad742adabe tempest-AbsoluteLimitsNegativeTestJSON-966577780 tempest-AbsoluteLimitsNegativeTestJSON-966577780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:03.904074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c84ecb2e-14b5-4aeb-b3fd-faad742adabe tempest-AbsoluteLimitsNegativeTestJSON-966577780 tempest-AbsoluteLimitsNegativeTestJSON-966577780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:03.908542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c84ecb2e-14b5-4aeb-b3fd-faad742adabe tempest-AbsoluteLimitsNegativeTestJSON-966577780 tempest-AbsoluteLimitsNegativeTestJSON-966577780-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:03.909291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c84ecb2e-14b5-4aeb-b3fd-faad742adabe tempest-AbsoluteLimitsNegativeTestJSON-966577780 tempest-AbsoluteLimitsNegativeTestJSON-966577780-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:03.932766 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c84ecb2e-14b5-4aeb-b3fd-faad742adabe tempest-AbsoluteLimitsNegativeTestJSON-966577780 tempest-AbsoluteLimitsNegativeTestJSON-966577780-project] 10.222.0.100 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.201346 Jan 22 21:05:03.947966 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 868/1676] 10.222.0.100 () {58 vars in 1126 bytes} [Sat Jan 22 21:05:03 2022] GET /compute/v2.1/limits => generated 511 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:03.947966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b15613b1-5e52-4d3b-9be2-e6b67a65522d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:03.947966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b15613b1-5e52-4d3b-9be2-e6b67a65522d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:03.956159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b15613b1-5e52-4d3b-9be2-e6b67a65522d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:03.956610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b15613b1-5e52-4d3b-9be2-e6b67a65522d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:03.957669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b15613b1-5e52-4d3b-9be2-e6b67a65522d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:03.958123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b15613b1-5e52-4d3b-9be2-e6b67a65522d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:03.997094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:05:03.998152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:05:03.998965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:05:03.999488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:05:03.999962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:05:04.010450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:04.011011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:04.011850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:04.012295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:04.030485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Getting quotas for project edf2656172ff4b63bc8f07781c447293. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:04.035546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Getting quotas for user 053465c1e7ec436e9689cf96b37c0bb6 and project edf2656172ff4b63bc8f07781c447293. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:04.049098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Going to run 3 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:05:04.052106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:05:04.121359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b15613b1-5e52-4d3b-9be2-e6b67a65522d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:04.129128 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b15613b1-5e52-4d3b-9be2-e6b67a65522d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1200 microversion: 2.1 time: 0.190271 Jan 22 21:05:04.129767 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 869/1677] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:03 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1200 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:04.134120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17f5d663-27a6-4d0e-96da-9959dd32a369 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:04.134742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17f5d663-27a6-4d0e-96da-9959dd32a369 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] [instance: 17ff3712-7bf9-4973-8efb-b408f5a7532d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:04.141319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17f5d663-27a6-4d0e-96da-9959dd32a369 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:04.141815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17f5d663-27a6-4d0e-96da-9959dd32a369 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:04.142629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17f5d663-27a6-4d0e-96da-9959dd32a369 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:04.143084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17f5d663-27a6-4d0e-96da-9959dd32a369 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:04.158314 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-17f5d663-27a6-4d0e-96da-9959dd32a369 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] HTTP exception thrown: Instance 17ff3712-7bf9-4973-8efb-b408f5a7532d could not be found. Jan 22 21:05:04.158947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17f5d663-27a6-4d0e-96da-9959dd32a369 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Returning 404 to user: Instance 17ff3712-7bf9-4973-8efb-b408f5a7532d could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:04.159807 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17f5d663-27a6-4d0e-96da-9959dd32a369 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d" status: 404 len: 111 microversion: 2.1 time: 0.029124 Jan 22 21:05:04.160366 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 870/1678] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:04 2022] GET /compute/v2.1/servers/17ff3712-7bf9-4973-8efb-b408f5a7532d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:04.164745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-8c17098b-7ebb-44d2-b438-4b2ec7ff65d1 req-0c522293-ebf9-42f0-b8f0-86bb37ef5332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ff3712-7bf9-4973-8efb-b408f5a7532d", "name": "network-vif-deleted", "tag": "9202e0cf-34b1-446b-8b3e-7b0dbb0b7c94"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:04.166347 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:04.166347 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:04.168173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: f4ae3f7e-0253-473f-8066-2b295fbcbbd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=4f82b6f5-f5c5-4853-9e35-d840e1b7cf89,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:05:04.173640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8c17098b-7ebb-44d2-b438-4b2ec7ff65d1 req-0c522293-ebf9-42f0-b8f0-86bb37ef5332 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:04.174088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8c17098b-7ebb-44d2-b438-4b2ec7ff65d1 req-0c522293-ebf9-42f0-b8f0-86bb37ef5332 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:04.185427 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-8c17098b-7ebb-44d2-b438-4b2ec7ff65d1 req-0c522293-ebf9-42f0-b8f0-86bb37ef5332 service nova] Creating event network-vif-deleted:9202e0cf-34b1-446b-8b3e-7b0dbb0b7c94 for instance 17ff3712-7bf9-4973-8efb-b408f5a7532d on nch1-master-1 Jan 22 21:05:04.190242 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-8c17098b-7ebb-44d2-b438-4b2ec7ff65d1 req-0c522293-ebf9-42f0-b8f0-86bb37ef5332 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028785 Jan 22 21:05:04.190833 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 871/1679] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:04.200318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9b5e8df6-4ff9-491b-b98d-42a7e0fa3333 tempest-AbsoluteLimitsNegativeTestJSON-966577780 tempest-AbsoluteLimitsNegativeTestJSON-966577780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1206265273", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:04.258517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-9b5e8df6-4ff9-491b-b98d-42a7e0fa3333 tempest-AbsoluteLimitsNegativeTestJSON-966577780 tempest-AbsoluteLimitsNegativeTestJSON-966577780-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:05:04.308831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=f4ae3f7e-0253-473f-8066-2b295fbcbbd1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:05:04.449344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-9b5e8df6-4ff9-491b-b98d-42a7e0fa3333 tempest-AbsoluteLimitsNegativeTestJSON-966577780 tempest-AbsoluteLimitsNegativeTestJSON-966577780-project] Getting quotas for project 1e60e097f9fb492bb13198f157b6a1b8. Resources: dict_keys(['metadata_items']) {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:04.454934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-9b5e8df6-4ff9-491b-b98d-42a7e0fa3333 tempest-AbsoluteLimitsNegativeTestJSON-966577780 tempest-AbsoluteLimitsNegativeTestJSON-966577780-project] Getting quotas for user 03276c797f9141c7a135f2e68a176264 and project 1e60e097f9fb492bb13198f157b6a1b8. Resources: dict_keys(['metadata_items']) {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:04.469571 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-9b5e8df6-4ff9-491b-b98d-42a7e0fa3333 tempest-AbsoluteLimitsNegativeTestJSON-966577780 tempest-AbsoluteLimitsNegativeTestJSON-966577780-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jan 22 21:05:04.470186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9b5e8df6-4ff9-491b-b98d-42a7e0fa3333 tempest-AbsoluteLimitsNegativeTestJSON-966577780 tempest-AbsoluteLimitsNegativeTestJSON-966577780-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:04.471066 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9b5e8df6-4ff9-491b-b98d-42a7e0fa3333 tempest-AbsoluteLimitsNegativeTestJSON-966577780 tempest-AbsoluteLimitsNegativeTestJSON-966577780-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.278225 Jan 22 21:05:04.471828 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 872/1680] 10.222.0.100 () {60 vars in 1152 bytes} [Sat Jan 22 21:05:04 2022] POST /compute/v2.1/servers => generated 87 bytes in 280 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:05:04.476073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-af97c673-733f-445d-b0ba-17c0e0de4276 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] Calling method '.version_select at 0x7f1ed5ea0f70>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:04.512177 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-85971869-9722-4484-bb51-c951cdc944f4 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.507714 Jan 22 21:05:04.512991 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 809/1681] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:05:03 2022] POST /compute/v2.1/servers => generated 382 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:05:04.521322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-943b58ee-86eb-4ae6-89c3-a58955f4bf27 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:04.521987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-943b58ee-86eb-4ae6-89c3-a58955f4bf27 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:04.535570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-943b58ee-86eb-4ae6-89c3-a58955f4bf27 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:04.536051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-943b58ee-86eb-4ae6-89c3-a58955f4bf27 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:04.536877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-943b58ee-86eb-4ae6-89c3-a58955f4bf27 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:04.537532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-943b58ee-86eb-4ae6-89c3-a58955f4bf27 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:04.578183 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-af97c673-733f-445d-b0ba-17c0e0de4276 tempest-ServersTestFqdnHostnames-1778218559 tempest-ServersTestFqdnHostnames-1778218559-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655752577" status: 202 len: 0 microversion: 2.1 time: 0.105459 Jan 22 21:05:04.579110 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 873/1682] 10.222.0.100 () {58 vars in 1225 bytes} [Sat Jan 22 21:05:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655752577 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:05:04.589941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-29ba5f07-437b-47dc-8bcc-2c229814ba11 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:04.589941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-29ba5f07-437b-47dc-8bcc-2c229814ba11 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:04.596551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29ba5f07-437b-47dc-8bcc-2c229814ba11 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:04.597166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29ba5f07-437b-47dc-8bcc-2c229814ba11 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:04.598077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29ba5f07-437b-47dc-8bcc-2c229814ba11 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:04.598527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29ba5f07-437b-47dc-8bcc-2c229814ba11 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:04.675366 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-29ba5f07-437b-47dc-8bcc-2c229814ba11 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.094770 Jan 22 21:05:04.679307 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 874/1683] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:04 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:04.686406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2c88a548-fc9a-4897-bfc9-024f2adf89fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:04.691207 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:04.691207 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:04.693843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2c88a548-fc9a-4897-bfc9-024f2adf89fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:04.694929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2c88a548-fc9a-4897-bfc9-024f2adf89fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Searching by: {'deleted': False, 'project_id': 'edf2656172ff4b63bc8f07781c447293'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:05:04.737599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-943b58ee-86eb-4ae6-89c3-a58955f4bf27 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:04.739220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c88a548-fc9a-4897-bfc9-024f2adf89fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:04.739681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c88a548-fc9a-4897-bfc9-024f2adf89fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:04.740498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c88a548-fc9a-4897-bfc9-024f2adf89fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:04.741122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c88a548-fc9a-4897-bfc9-024f2adf89fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:04.751780 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-943b58ee-86eb-4ae6-89c3-a58955f4bf27 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.237207 Jan 22 21:05:04.752764 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 810/1684] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:04 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:04.758968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9b1e6b60-8b60-4929-9bb2-2f4aee54ef0c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:04.760539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9b1e6b60-8b60-4929-9bb2-2f4aee54ef0c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:04.779192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b1e6b60-8b60-4929-9bb2-2f4aee54ef0c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:04.781118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b1e6b60-8b60-4929-9bb2-2f4aee54ef0c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:04.782290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b1e6b60-8b60-4929-9bb2-2f4aee54ef0c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:04.783475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b1e6b60-8b60-4929-9bb2-2f4aee54ef0c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:04.831475 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2c88a548-fc9a-4897-bfc9-024f2adf89fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 1024 microversion: 2.1 time: 0.153891 Jan 22 21:05:04.832952 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 875/1685] 10.222.0.100 () {58 vars in 1129 bytes} [Sat Jan 22 21:05:04 2022] GET /compute/v2.1/servers => generated 1024 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:04.835701 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9b1e6b60-8b60-4929-9bb2-2f4aee54ef0c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.080438 Jan 22 21:05:04.836747 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 811/1686] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:04 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:04.842562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad1789df-fd22-4a14-ba57-25c4ad5d1e1a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:04.843516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad1789df-fd22-4a14-ba57-25c4ad5d1e1a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:04.846661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7f1d8a1f-390a-46c5-a529-f8f402657aa8 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:04.847376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7f1d8a1f-390a-46c5-a529-f8f402657aa8 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:04.849671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad1789df-fd22-4a14-ba57-25c4ad5d1e1a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:04.850129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad1789df-fd22-4a14-ba57-25c4ad5d1e1a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:04.850965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad1789df-fd22-4a14-ba57-25c4ad5d1e1a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:04.851399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad1789df-fd22-4a14-ba57-25c4ad5d1e1a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:04.908789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7f1d8a1f-390a-46c5-a529-f8f402657aa8 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:04.916119 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7f1d8a1f-390a-46c5-a529-f8f402657aa8 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1227 microversion: 2.1 time: 0.074432 Jan 22 21:05:04.916697 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 812/1687] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:04 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1227 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:05.043295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ad1789df-fd22-4a14-ba57-25c4ad5d1e1a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:05.052787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ad1789df-fd22-4a14-ba57-25c4ad5d1e1a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:05.054635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ad1789df-fd22-4a14-ba57-25c4ad5d1e1a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:05.065226 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad1789df-fd22-4a14-ba57-25c4ad5d1e1a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1284 microversion: 2.25 time: 0.228333 Jan 22 21:05:05.065897 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 876/1688] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:04 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:05.146060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-44af361a-68fb-4977-ba67-71cc790dd077 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:05.147244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-44af361a-68fb-4977-ba67-71cc790dd077 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:05.154716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44af361a-68fb-4977-ba67-71cc790dd077 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:05.155163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44af361a-68fb-4977-ba67-71cc790dd077 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:05.156200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44af361a-68fb-4977-ba67-71cc790dd077 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:05.156802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44af361a-68fb-4977-ba67-71cc790dd077 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:05.381574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-44af361a-68fb-4977-ba67-71cc790dd077 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:05.395638 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-44af361a-68fb-4977-ba67-71cc790dd077 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1200 microversion: 2.1 time: 0.253143 Jan 22 21:05:05.396657 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 813/1689] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:05 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1200 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:05.689616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c1f0dadf-14e6-47cd-9726-de57016968bd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:05.689616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c1f0dadf-14e6-47cd-9726-de57016968bd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:05.694769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1f0dadf-14e6-47cd-9726-de57016968bd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:05.695487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1f0dadf-14e6-47cd-9726-de57016968bd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:05.696324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1f0dadf-14e6-47cd-9726-de57016968bd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:05.696793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1f0dadf-14e6-47cd-9726-de57016968bd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:05.750240 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c1f0dadf-14e6-47cd-9726-de57016968bd tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.067567 Jan 22 21:05:05.753097 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 877/1690] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:05 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:05.772585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-560f5c79-fd36-4fae-b063-672bc432f079 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:05.773742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-560f5c79-fd36-4fae-b063-672bc432f079 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:05.783374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-560f5c79-fd36-4fae-b063-672bc432f079 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:05.785439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-560f5c79-fd36-4fae-b063-672bc432f079 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:05.786412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-560f5c79-fd36-4fae-b063-672bc432f079 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:05.786994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-560f5c79-fd36-4fae-b063-672bc432f079 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:05.849373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-32f0080e-f1ad-4b0e-9251-a42f812ef472 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:05.850708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-32f0080e-f1ad-4b0e-9251-a42f812ef472 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:05.859694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32f0080e-f1ad-4b0e-9251-a42f812ef472 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:05.860623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32f0080e-f1ad-4b0e-9251-a42f812ef472 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:05.861609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32f0080e-f1ad-4b0e-9251-a42f812ef472 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:05.862061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32f0080e-f1ad-4b0e-9251-a42f812ef472 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:05.933346 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-32f0080e-f1ad-4b0e-9251-a42f812ef472 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.087488 Jan 22 21:05:05.941730 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 878/1691] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:05 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:05.954445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9f81a3e5-5ae1-4883-817d-c81de2d2a4f7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:05.955223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9f81a3e5-5ae1-4883-817d-c81de2d2a4f7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:06.028665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9f81a3e5-5ae1-4883-817d-c81de2d2a4f7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:06.032659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-560f5c79-fd36-4fae-b063-672bc432f079 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:06.038451 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9f81a3e5-5ae1-4883-817d-c81de2d2a4f7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1227 microversion: 2.1 time: 0.093668 Jan 22 21:05:06.045598 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 879/1692] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:05 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1227 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:06.045924 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-560f5c79-fd36-4fae-b063-672bc432f079 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.273556 Jan 22 21:05:06.045924 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 814/1693] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:05 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:06.046096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-97977d17-5aa5-4b9b-b8b2-6b41461f8c3b req-fb4642b0-59da-433b-bc57-197b06e110ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030", "name": "network-vif-plugged", "status": "completed", "tag": "241845a7-45d2-443a-a581-ab21d64d2668"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:06.046534 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:06.046534 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:06.054968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-97977d17-5aa5-4b9b-b8b2-6b41461f8c3b req-fb4642b0-59da-433b-bc57-197b06e110ad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:06.055638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-97977d17-5aa5-4b9b-b8b2-6b41461f8c3b req-fb4642b0-59da-433b-bc57-197b06e110ad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:06.071927 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-97977d17-5aa5-4b9b-b8b2-6b41461f8c3b req-fb4642b0-59da-433b-bc57-197b06e110ad service nova] Creating event network-vif-plugged:241845a7-45d2-443a-a581-ab21d64d2668 for instance 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 on nch1-master-1 Jan 22 21:05:06.080898 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-97977d17-5aa5-4b9b-b8b2-6b41461f8c3b req-fb4642b0-59da-433b-bc57-197b06e110ad service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037935 Jan 22 21:05:06.081917 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 880/1694] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:06.089444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-817fcc02-2fdf-4e4f-9647-44153529833c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:06.089444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-817fcc02-2fdf-4e4f-9647-44153529833c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:06.093098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-817fcc02-2fdf-4e4f-9647-44153529833c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:06.093590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-817fcc02-2fdf-4e4f-9647-44153529833c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:06.094407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-817fcc02-2fdf-4e4f-9647-44153529833c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:06.094871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-817fcc02-2fdf-4e4f-9647-44153529833c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:06.417960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2f746daf-67c9-4c18-9616-b6a0a1cd73a8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:06.418800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2f746daf-67c9-4c18-9616-b6a0a1cd73a8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:06.427113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f746daf-67c9-4c18-9616-b6a0a1cd73a8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:06.427640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f746daf-67c9-4c18-9616-b6a0a1cd73a8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:06.428384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f746daf-67c9-4c18-9616-b6a0a1cd73a8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:06.428975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f746daf-67c9-4c18-9616-b6a0a1cd73a8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:06.493371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-817fcc02-2fdf-4e4f-9647-44153529833c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:06.506321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-817fcc02-2fdf-4e4f-9647-44153529833c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:06.508634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-817fcc02-2fdf-4e4f-9647-44153529833c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:06.510366 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-817fcc02-2fdf-4e4f-9647-44153529833c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1284 microversion: 2.25 time: 0.428388 Jan 22 21:05:06.522618 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 815/1695] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:06 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1284 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:05:06.583586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2f746daf-67c9-4c18-9616-b6a0a1cd73a8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:06.595463 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2f746daf-67c9-4c18-9616-b6a0a1cd73a8 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1200 microversion: 2.1 time: 0.182008 Jan 22 21:05:06.605561 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 881/1696] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:06 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1200 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:06.761785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-07e6aced-9a09-4d91-a7ff-c84d886750ad tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:06.762775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-07e6aced-9a09-4d91-a7ff-c84d886750ad tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:06.769373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07e6aced-9a09-4d91-a7ff-c84d886750ad tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:06.769858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07e6aced-9a09-4d91-a7ff-c84d886750ad tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:06.770701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07e6aced-9a09-4d91-a7ff-c84d886750ad tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:06.771149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07e6aced-9a09-4d91-a7ff-c84d886750ad tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:06.817437 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-07e6aced-9a09-4d91-a7ff-c84d886750ad tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.059274 Jan 22 21:05:06.818582 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 816/1697] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:06 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:05:06.949878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e503ad26-edbf-4c85-ac28-ada1996c8c02 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:06.950895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e503ad26-edbf-4c85-ac28-ada1996c8c02 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:06.958285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e503ad26-edbf-4c85-ac28-ada1996c8c02 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:06.964837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e503ad26-edbf-4c85-ac28-ada1996c8c02 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:06.964837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e503ad26-edbf-4c85-ac28-ada1996c8c02 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:06.964837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e503ad26-edbf-4c85-ac28-ada1996c8c02 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:07.005213 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e503ad26-edbf-4c85-ac28-ada1996c8c02 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.059252 Jan 22 21:05:07.005914 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 817/1698] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:06 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:05:07.034993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-721efca8-8372-408c-9193-54b1debea600 tempest-AZV2TestJSON-657154220 tempest-AZV2TestJSON-657154220-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:07.036683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-721efca8-8372-408c-9193-54b1debea600 tempest-AZV2TestJSON-657154220 tempest-AZV2TestJSON-657154220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:07.037139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-721efca8-8372-408c-9193-54b1debea600 tempest-AZV2TestJSON-657154220 tempest-AZV2TestJSON-657154220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:07.037995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-721efca8-8372-408c-9193-54b1debea600 tempest-AZV2TestJSON-657154220 tempest-AZV2TestJSON-657154220-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:07.038459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-721efca8-8372-408c-9193-54b1debea600 tempest-AZV2TestJSON-657154220 tempest-AZV2TestJSON-657154220-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:07.058373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a1c1e85c-7cd7-4e32-984d-5bd44ea958fa tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:07.059315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a1c1e85c-7cd7-4e32-984d-5bd44ea958fa tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:07.068683 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-721efca8-8372-408c-9193-54b1debea600 tempest-AZV2TestJSON-657154220 tempest-AZV2TestJSON-657154220-project] 10.222.0.100 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.149812 Jan 22 21:05:07.071137 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 882/1699] 10.222.0.100 () {58 vars in 1168 bytes} [Sat Jan 22 21:05:06 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:05:07.077716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-026bc07d-1229-494e-9f81-77b37c592d47 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:07.078310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-026bc07d-1229-494e-9f81-77b37c592d47 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:07.088460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-026bc07d-1229-494e-9f81-77b37c592d47 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:07.089658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-026bc07d-1229-494e-9f81-77b37c592d47 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:07.090649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-026bc07d-1229-494e-9f81-77b37c592d47 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:07.091109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-026bc07d-1229-494e-9f81-77b37c592d47 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:07.165930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a1c1e85c-7cd7-4e32-984d-5bd44ea958fa tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:07.178428 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a1c1e85c-7cd7-4e32-984d-5bd44ea958fa tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1227 microversion: 2.1 time: 0.124901 Jan 22 21:05:07.179956 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 818/1700] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:07 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1227 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:07.336706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-026bc07d-1229-494e-9f81-77b37c592d47 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:07.345248 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-026bc07d-1229-494e-9f81-77b37c592d47 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.274422 Jan 22 21:05:07.356163 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 883/1701] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:07 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:07.529316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ba74c50-46d1-4eb3-9b7e-941e101ad135 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:07.530347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ba74c50-46d1-4eb3-9b7e-941e101ad135 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:07.537049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ba74c50-46d1-4eb3-9b7e-941e101ad135 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:07.537635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ba74c50-46d1-4eb3-9b7e-941e101ad135 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:07.538440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ba74c50-46d1-4eb3-9b7e-941e101ad135 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:07.538890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ba74c50-46d1-4eb3-9b7e-941e101ad135 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:07.612241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4a6d57a5-2cdd-4c3d-b4f2-db5840d7b04d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:07.613060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4a6d57a5-2cdd-4c3d-b4f2-db5840d7b04d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:07.623083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a6d57a5-2cdd-4c3d-b4f2-db5840d7b04d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:07.627161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a6d57a5-2cdd-4c3d-b4f2-db5840d7b04d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:07.628044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a6d57a5-2cdd-4c3d-b4f2-db5840d7b04d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:07.628503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a6d57a5-2cdd-4c3d-b4f2-db5840d7b04d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:07.850716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8ba74c50-46d1-4eb3-9b7e-941e101ad135 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:07.852100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4a6d57a5-2cdd-4c3d-b4f2-db5840d7b04d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:07.866795 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4a6d57a5-2cdd-4c3d-b4f2-db5840d7b04d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1200 microversion: 2.1 time: 0.258232 Jan 22 21:05:07.878981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8ba74c50-46d1-4eb3-9b7e-941e101ad135 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:07.879560 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 884/1702] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:07 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1200 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:07.887887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8ba74c50-46d1-4eb3-9b7e-941e101ad135 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:07.889319 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ba74c50-46d1-4eb3-9b7e-941e101ad135 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1284 microversion: 2.25 time: 0.364805 Jan 22 21:05:07.891993 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 819/1703] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:07 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1284 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:07.899210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dfdb4f5b-0fa4-41b1-b831-5ff817c1499f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:07.899210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dfdb4f5b-0fa4-41b1-b831-5ff817c1499f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:07.904043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfdb4f5b-0fa4-41b1-b831-5ff817c1499f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:07.904708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfdb4f5b-0fa4-41b1-b831-5ff817c1499f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:07.905851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfdb4f5b-0fa4-41b1-b831-5ff817c1499f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:07.906690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfdb4f5b-0fa4-41b1-b831-5ff817c1499f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:07.977421 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dfdb4f5b-0fa4-41b1-b831-5ff817c1499f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.095583 Jan 22 21:05:07.978240 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 885/1704] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:07 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:08.017156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fc142be4-ec05-4a66-8e75-928ce6da7ca3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:08.018637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fc142be4-ec05-4a66-8e75-928ce6da7ca3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:08.030525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc142be4-ec05-4a66-8e75-928ce6da7ca3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:08.031239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc142be4-ec05-4a66-8e75-928ce6da7ca3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:08.033482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc142be4-ec05-4a66-8e75-928ce6da7ca3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:08.035516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc142be4-ec05-4a66-8e75-928ce6da7ca3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:08.095806 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fc142be4-ec05-4a66-8e75-928ce6da7ca3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.082514 Jan 22 21:05:08.097192 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 820/1705] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:08 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:08.196628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-25fa0f25-46ce-4871-9eeb-b117477a2100 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:08.197333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-25fa0f25-46ce-4871-9eeb-b117477a2100 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:08.212803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25fa0f25-46ce-4871-9eeb-b117477a2100 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:08.213291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25fa0f25-46ce-4871-9eeb-b117477a2100 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:08.214758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25fa0f25-46ce-4871-9eeb-b117477a2100 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:08.215826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25fa0f25-46ce-4871-9eeb-b117477a2100 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:08.289143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-25fa0f25-46ce-4871-9eeb-b117477a2100 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:08.295785 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-25fa0f25-46ce-4871-9eeb-b117477a2100 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1223 microversion: 2.1 time: 0.103147 Jan 22 21:05:08.297025 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 886/1706] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:08 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:08.367307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-372de727-bd9d-4333-b2a7-15c751816591 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:08.368304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-372de727-bd9d-4333-b2a7-15c751816591 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:08.382550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-372de727-bd9d-4333-b2a7-15c751816591 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:08.383446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-372de727-bd9d-4333-b2a7-15c751816591 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:08.383845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-372de727-bd9d-4333-b2a7-15c751816591 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:08.384280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-372de727-bd9d-4333-b2a7-15c751816591 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:08.888375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-14cc9aa2-d77d-4df7-a45f-9642a22a1e1a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:08.889570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-14cc9aa2-d77d-4df7-a45f-9642a22a1e1a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:08.911071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14cc9aa2-d77d-4df7-a45f-9642a22a1e1a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:08.912104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14cc9aa2-d77d-4df7-a45f-9642a22a1e1a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:08.933685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14cc9aa2-d77d-4df7-a45f-9642a22a1e1a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:08.934906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14cc9aa2-d77d-4df7-a45f-9642a22a1e1a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:09.161974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-14cc9aa2-d77d-4df7-a45f-9642a22a1e1a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:09.165869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-372de727-bd9d-4333-b2a7-15c751816591 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:09.171564 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-14cc9aa2-d77d-4df7-a45f-9642a22a1e1a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1383 microversion: 2.1 time: 0.290596 Jan 22 21:05:09.172517 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 887/1707] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:08 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1383 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:09.177358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5bcec034-7e7d-44f5-b1c3-62e38a23b176 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:09.178081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5bcec034-7e7d-44f5-b1c3-62e38a23b176 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:09.178444 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-372de727-bd9d-4333-b2a7-15c751816591 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.812921 Jan 22 21:05:09.179062 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 821/1708] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:08 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:09.184310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bcec034-7e7d-44f5-b1c3-62e38a23b176 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:09.185050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bcec034-7e7d-44f5-b1c3-62e38a23b176 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:09.185263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e473d8bc-4e72-47d6-ad26-7f56ea29d3e2 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:09.186261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e473d8bc-4e72-47d6-ad26-7f56ea29d3e2 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:09.186433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bcec034-7e7d-44f5-b1c3-62e38a23b176 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:09.187281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bcec034-7e7d-44f5-b1c3-62e38a23b176 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:09.207313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e473d8bc-4e72-47d6-ad26-7f56ea29d3e2 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:09.207776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e473d8bc-4e72-47d6-ad26-7f56ea29d3e2 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:09.208588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e473d8bc-4e72-47d6-ad26-7f56ea29d3e2 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:09.209030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e473d8bc-4e72-47d6-ad26-7f56ea29d3e2 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:09.283749 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e473d8bc-4e72-47d6-ad26-7f56ea29d3e2 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.102921 Jan 22 21:05:09.285331 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 822/1709] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:09 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:09.295387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-574e121c-9724-4eca-bb2d-575974ddfcbc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:09.296813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-574e121c-9724-4eca-bb2d-575974ddfcbc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:09.304355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-574e121c-9724-4eca-bb2d-575974ddfcbc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:09.304852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-574e121c-9724-4eca-bb2d-575974ddfcbc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:09.305851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-574e121c-9724-4eca-bb2d-575974ddfcbc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:09.306295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-574e121c-9724-4eca-bb2d-575974ddfcbc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:09.365997 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-574e121c-9724-4eca-bb2d-575974ddfcbc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.078266 Jan 22 21:05:09.372468 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 823/1710] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:09 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:09.396531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c577ea0e-fa6c-4b79-b3db-8f4ed315c916 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:09.397250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c577ea0e-fa6c-4b79-b3db-8f4ed315c916 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:09.412862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c577ea0e-fa6c-4b79-b3db-8f4ed315c916 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:09.419479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c577ea0e-fa6c-4b79-b3db-8f4ed315c916 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:09.420416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c577ea0e-fa6c-4b79-b3db-8f4ed315c916 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:09.420868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c577ea0e-fa6c-4b79-b3db-8f4ed315c916 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:09.503033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5bcec034-7e7d-44f5-b1c3-62e38a23b176 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:09.519401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5bcec034-7e7d-44f5-b1c3-62e38a23b176 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:09.521007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5bcec034-7e7d-44f5-b1c3-62e38a23b176 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:09.522712 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5bcec034-7e7d-44f5-b1c3-62e38a23b176 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1284 microversion: 2.25 time: 0.348962 Jan 22 21:05:09.533186 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 888/1711] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:09 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1284 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:09.538073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-736218ed-33d1-4fa0-af64-ea5533a64922 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:09.538739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-736218ed-33d1-4fa0-af64-ea5533a64922 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:09.548689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736218ed-33d1-4fa0-af64-ea5533a64922 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:09.549148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736218ed-33d1-4fa0-af64-ea5533a64922 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:09.550002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736218ed-33d1-4fa0-af64-ea5533a64922 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:09.550456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736218ed-33d1-4fa0-af64-ea5533a64922 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:09.666584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-736218ed-33d1-4fa0-af64-ea5533a64922 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:09.703030 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-736218ed-33d1-4fa0-af64-ea5533a64922 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1297 microversion: 2.1 time: 0.168482 Jan 22 21:05:09.703662 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 889/1712] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:09 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1297 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:09.999064 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c577ea0e-fa6c-4b79-b3db-8f4ed315c916 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1534 microversion: 2.1 time: 0.624799 Jan 22 21:05:09.999773 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 824/1713] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:09 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1534 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:10.014928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-149b3fba-9d23-49e1-bc1e-7b9634f2f368 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:10.015549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-149b3fba-9d23-49e1-bc1e-7b9634f2f368 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:10.022554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-149b3fba-9d23-49e1-bc1e-7b9634f2f368 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:10.023199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-149b3fba-9d23-49e1-bc1e-7b9634f2f368 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:10.024007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-149b3fba-9d23-49e1-bc1e-7b9634f2f368 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:10.024449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-149b3fba-9d23-49e1-bc1e-7b9634f2f368 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:10.196691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6acb2f85-4c9c-4e1c-a642-d7ecf7ac01b0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:10.197420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6acb2f85-4c9c-4e1c-a642-d7ecf7ac01b0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:10.209191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6acb2f85-4c9c-4e1c-a642-d7ecf7ac01b0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:10.215413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6acb2f85-4c9c-4e1c-a642-d7ecf7ac01b0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:10.216415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6acb2f85-4c9c-4e1c-a642-d7ecf7ac01b0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:10.217313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6acb2f85-4c9c-4e1c-a642-d7ecf7ac01b0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:10.278426 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-149b3fba-9d23-49e1-bc1e-7b9634f2f368 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1534 microversion: 2.1 time: 0.266958 Jan 22 21:05:10.284051 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 890/1714] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:10 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1534 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:10.298602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-23ab9fea-15c3-45a6-9f52-f2a4215f50e9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:10.299561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-23ab9fea-15c3-45a6-9f52-f2a4215f50e9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:10.306075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23ab9fea-15c3-45a6-9f52-f2a4215f50e9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:10.306641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23ab9fea-15c3-45a6-9f52-f2a4215f50e9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:10.312859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23ab9fea-15c3-45a6-9f52-f2a4215f50e9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:10.312859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23ab9fea-15c3-45a6-9f52-f2a4215f50e9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:10.356236 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-23ab9fea-15c3-45a6-9f52-f2a4215f50e9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.061697 Jan 22 21:05:10.358554 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 891/1715] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:10 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:10.370836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d47838b3-fa01-4056-b843-a8442f732f89 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:10.381700 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:10.381700 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:10.389623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d47838b3-fa01-4056-b843-a8442f732f89 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:10.390383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d47838b3-fa01-4056-b843-a8442f732f89 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:10.394461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d47838b3-fa01-4056-b843-a8442f732f89 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:10.395099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d47838b3-fa01-4056-b843-a8442f732f89 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:10.460738 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d47838b3-fa01-4056-b843-a8442f732f89 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.100524 Jan 22 21:05:10.462012 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 892/1716] 10.222.0.100 () {58 vars in 1180 bytes} [Sat Jan 22 21:05:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:10.475512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-752dd444-241a-4821-803a-0ce44cb19d49 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:10.477056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-752dd444-241a-4821-803a-0ce44cb19d49 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:10.488885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-752dd444-241a-4821-803a-0ce44cb19d49 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:10.489632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-752dd444-241a-4821-803a-0ce44cb19d49 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:10.490949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-752dd444-241a-4821-803a-0ce44cb19d49 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:10.491642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-752dd444-241a-4821-803a-0ce44cb19d49 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:10.556252 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-752dd444-241a-4821-803a-0ce44cb19d49 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.084557 Jan 22 21:05:10.558448 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 893/1717] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:10 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:10.565283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17d92b32-f3d8-4a96-975e-0adb389e4366 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:10.567450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17d92b32-f3d8-4a96-975e-0adb389e4366 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:10.578649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17d92b32-f3d8-4a96-975e-0adb389e4366 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:10.579197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17d92b32-f3d8-4a96-975e-0adb389e4366 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:10.580768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17d92b32-f3d8-4a96-975e-0adb389e4366 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:10.581466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17d92b32-f3d8-4a96-975e-0adb389e4366 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:10.611367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-17d92b32-f3d8-4a96-975e-0adb389e4366 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lazy-loading 'flavor' on Instance uuid 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:10.627407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17d92b32-f3d8-4a96-975e-0adb389e4366 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Going to try to live migrate instance to nch2-master-1 {{(pid=137032) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 22 21:05:10.648565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6acb2f85-4c9c-4e1c-a642-d7ecf7ac01b0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:10.657781 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6acb2f85-4c9c-4e1c-a642-d7ecf7ac01b0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.465149 Jan 22 21:05:10.658379 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 825/1718] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:10 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:10.663281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fe23c881-f2be-4d92-a0a7-7b09eab86bea tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:10.663806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fe23c881-f2be-4d92-a0a7-7b09eab86bea tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:10.670187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe23c881-f2be-4d92-a0a7-7b09eab86bea tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:10.670656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe23c881-f2be-4d92-a0a7-7b09eab86bea tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:10.671479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe23c881-f2be-4d92-a0a7-7b09eab86bea tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:10.671931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe23c881-f2be-4d92-a0a7-7b09eab86bea tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:10.997060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fe23c881-f2be-4d92-a0a7-7b09eab86bea tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:11.008259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fe23c881-f2be-4d92-a0a7-7b09eab86bea tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:11.008611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fe23c881-f2be-4d92-a0a7-7b09eab86bea tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:11.009843 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fe23c881-f2be-4d92-a0a7-7b09eab86bea tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1284 microversion: 2.25 time: 0.350316 Jan 22 21:05:11.010477 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 826/1719] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:10 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1284 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:11.017274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-a1b54e9d-679c-41da-a0f3-685e17c8acea req-979fdf7b-d308-463e-9291-62f3dd62d384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64db607b-9a30-4235-909f-39804df2fbf6", "name": "network-vif-plugged", "status": "completed", "tag": "6fc53fa7-f259-415f-b5ea-1e505f4d2810"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:11.018988 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:11.018988 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:11.028591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a1b54e9d-679c-41da-a0f3-685e17c8acea req-979fdf7b-d308-463e-9291-62f3dd62d384 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:11.029056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a1b54e9d-679c-41da-a0f3-685e17c8acea req-979fdf7b-d308-463e-9291-62f3dd62d384 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:11.040798 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-a1b54e9d-679c-41da-a0f3-685e17c8acea req-979fdf7b-d308-463e-9291-62f3dd62d384 service nova] Creating event network-vif-plugged:6fc53fa7-f259-415f-b5ea-1e505f4d2810 for instance 64db607b-9a30-4235-909f-39804df2fbf6 on nch2-master-1 Jan 22 21:05:11.046084 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-a1b54e9d-679c-41da-a0f3-685e17c8acea req-979fdf7b-d308-463e-9291-62f3dd62d384 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033656 Jan 22 21:05:11.048384 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 827/1720] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:11.051871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4f6cfba3-a12d-4a74-84c8-4b6041516146 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:11.052430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4f6cfba3-a12d-4a74-84c8-4b6041516146 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:11.059534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6cfba3-a12d-4a74-84c8-4b6041516146 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:11.060062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6cfba3-a12d-4a74-84c8-4b6041516146 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:11.060878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6cfba3-a12d-4a74-84c8-4b6041516146 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:11.061332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6cfba3-a12d-4a74-84c8-4b6041516146 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:11.241130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4f6cfba3-a12d-4a74-84c8-4b6041516146 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:11.249024 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4f6cfba3-a12d-4a74-84c8-4b6041516146 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1285 microversion: 2.1 time: 0.200986 Jan 22 21:05:11.258978 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 828/1721] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:11 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:11.369300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-329a5c3a-ef62-42ca-92d5-e003978a1702 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:11.370814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-329a5c3a-ef62-42ca-92d5-e003978a1702 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:11.378278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-329a5c3a-ef62-42ca-92d5-e003978a1702 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:11.381114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-329a5c3a-ef62-42ca-92d5-e003978a1702 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:11.385248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-329a5c3a-ef62-42ca-92d5-e003978a1702 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:11.387053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-329a5c3a-ef62-42ca-92d5-e003978a1702 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:11.460806 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-329a5c3a-ef62-42ca-92d5-e003978a1702 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.096190 Jan 22 21:05:11.462398 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 829/1722] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:11 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:11.578182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ec1b4c60-8fd3-4b02-b1b7-63a710a0b945 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:11.587237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ec1b4c60-8fd3-4b02-b1b7-63a710a0b945 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:11.599532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec1b4c60-8fd3-4b02-b1b7-63a710a0b945 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:11.600803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec1b4c60-8fd3-4b02-b1b7-63a710a0b945 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:11.602825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec1b4c60-8fd3-4b02-b1b7-63a710a0b945 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:11.603519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec1b4c60-8fd3-4b02-b1b7-63a710a0b945 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:11.800008 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ec1b4c60-8fd3-4b02-b1b7-63a710a0b945 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.232326 Jan 22 21:05:11.806110 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 830/1723] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:11 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:11.822773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f8c0b4cc-09a4-459b-a6e2-547126d3165d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:11.827010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f8c0b4cc-09a4-459b-a6e2-547126d3165d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:11.853650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8c0b4cc-09a4-459b-a6e2-547126d3165d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:11.854143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8c0b4cc-09a4-459b-a6e2-547126d3165d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:11.855142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8c0b4cc-09a4-459b-a6e2-547126d3165d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:11.855570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8c0b4cc-09a4-459b-a6e2-547126d3165d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:12.190913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f8c0b4cc-09a4-459b-a6e2-547126d3165d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:12.198948 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f8c0b4cc-09a4-459b-a6e2-547126d3165d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.390763 Jan 22 21:05:12.210953 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 831/1724] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:11 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:12.211964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-847aaae8-09cf-42b3-8bd1-04761b3a831c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:12.212585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-847aaae8-09cf-42b3-8bd1-04761b3a831c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:12.220193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-847aaae8-09cf-42b3-8bd1-04761b3a831c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:12.220660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-847aaae8-09cf-42b3-8bd1-04761b3a831c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:12.222169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-847aaae8-09cf-42b3-8bd1-04761b3a831c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:12.222584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-847aaae8-09cf-42b3-8bd1-04761b3a831c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:13.013864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-847aaae8-09cf-42b3-8bd1-04761b3a831c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:13.017356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-847aaae8-09cf-42b3-8bd1-04761b3a831c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:13.018973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-847aaae8-09cf-42b3-8bd1-04761b3a831c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:13.020104 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-847aaae8-09cf-42b3-8bd1-04761b3a831c tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1284 microversion: 2.25 time: 0.819638 Jan 22 21:05:13.020676 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 832/1725] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:12 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1284 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:13.024997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8dd284ad-8b90-4ce2-9c86-d110eb208bd1 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:13.025741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8dd284ad-8b90-4ce2-9c86-d110eb208bd1 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:13.033527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd284ad-8b90-4ce2-9c86-d110eb208bd1 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:13.034094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd284ad-8b90-4ce2-9c86-d110eb208bd1 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:13.034982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd284ad-8b90-4ce2-9c86-d110eb208bd1 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:13.035459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd284ad-8b90-4ce2-9c86-d110eb208bd1 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:13.413235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8dd284ad-8b90-4ce2-9c86-d110eb208bd1 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:13.429259 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8dd284ad-8b90-4ce2-9c86-d110eb208bd1 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1327 microversion: 2.1 time: 0.405973 Jan 22 21:05:13.438743 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 833/1726] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:13 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1327 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:13.451863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c378e008-6bfc-4f5d-b47a-d99b121f19a0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:13.454928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c378e008-6bfc-4f5d-b47a-d99b121f19a0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:13.468098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c378e008-6bfc-4f5d-b47a-d99b121f19a0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:13.468559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c378e008-6bfc-4f5d-b47a-d99b121f19a0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:13.469577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c378e008-6bfc-4f5d-b47a-d99b121f19a0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:13.470027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c378e008-6bfc-4f5d-b47a-d99b121f19a0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:13.520570 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c378e008-6bfc-4f5d-b47a-d99b121f19a0 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.079498 Jan 22 21:05:13.521253 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 834/1727] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:13 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:13.526264 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17d92b32-f3d8-4a96-975e-0adb389e4366 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030/action" status: 202 len: 0 microversion: 2.1 time: 2.960262 Jan 22 21:05:13.527094 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 894/1728] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:10 2022] POST /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030/action => generated 0 bytes in 2968 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:05:13.527280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-320ccc70-9129-4f08-a2a0-8b6500ab4402 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:13.528357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-320ccc70-9129-4f08-a2a0-8b6500ab4402 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:13.538687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-320ccc70-9129-4f08-a2a0-8b6500ab4402 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:13.539092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-320ccc70-9129-4f08-a2a0-8b6500ab4402 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:13.540189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-320ccc70-9129-4f08-a2a0-8b6500ab4402 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:13.540993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-320ccc70-9129-4f08-a2a0-8b6500ab4402 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:13.588326 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-320ccc70-9129-4f08-a2a0-8b6500ab4402 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.065266 Jan 22 21:05:13.598700 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 835/1729] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:13 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:13.599480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dd5324c6-dd73-412b-88d0-2de4a5bd937e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:13.600474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dd5324c6-dd73-412b-88d0-2de4a5bd937e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:13.607783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd5324c6-dd73-412b-88d0-2de4a5bd937e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:13.608554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd5324c6-dd73-412b-88d0-2de4a5bd937e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:13.609630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd5324c6-dd73-412b-88d0-2de4a5bd937e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:13.610294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd5324c6-dd73-412b-88d0-2de4a5bd937e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:13.874181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4e4a8791-8b81-4556-a19f-9c09a5dd9f4a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Action: 'create', calling method: .version_select at 0x7f1ed5f85940>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-213801691", "policies": ["affinity"]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:13.905054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-4e4a8791-8b81-4556-a19f-9c09a5dd9f4a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:13.913138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-4e4a8791-8b81-4556-a19f-9c09a5dd9f4a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for user 7de270798712461aab9499a7353da9e4 and project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:13.956311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dd5324c6-dd73-412b-88d0-2de4a5bd937e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:13.967265 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dd5324c6-dd73-412b-88d0-2de4a5bd937e tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.371933 Jan 22 21:05:13.968430 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 836/1730] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:13 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:14.057022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-112ca1c6-de2d-4d1c-b9bb-0eec929ec978 req-8530598d-1b86-4de7-81d1-f1883e0077aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4ae3f7e-0253-473f-8066-2b295fbcbbd1", "tag": "b36ddfbb-4bf6-415d-b48e-8df34234a5f8"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:14.057816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-4e4a8791-8b81-4556-a19f-9c09a5dd9f4a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:14.059637 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:14.059637 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:14.063682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-4e4a8791-8b81-4556-a19f-9c09a5dd9f4a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for user 7de270798712461aab9499a7353da9e4 and project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:14.068183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-112ca1c6-de2d-4d1c-b9bb-0eec929ec978 req-8530598d-1b86-4de7-81d1-f1883e0077aa service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:14.068648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-112ca1c6-de2d-4d1c-b9bb-0eec929ec978 req-8530598d-1b86-4de7-81d1-f1883e0077aa service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:14.081953 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-112ca1c6-de2d-4d1c-b9bb-0eec929ec978 req-8530598d-1b86-4de7-81d1-f1883e0077aa service nova] Creating event network-changed:b36ddfbb-4bf6-415d-b48e-8df34234a5f8 for instance f4ae3f7e-0253-473f-8066-2b295fbcbbd1 on nch2-master-1 Jan 22 21:05:14.084432 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4e4a8791-8b81-4556-a19f-9c09a5dd9f4a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.553636 Jan 22 21:05:14.084432 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 895/1731] 10.222.0.100 () {60 vars in 1178 bytes} [Sat Jan 22 21:05:13 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:14.087154 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-112ca1c6-de2d-4d1c-b9bb-0eec929ec978 req-8530598d-1b86-4de7-81d1-f1883e0077aa service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117387 Jan 22 21:05:14.087753 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 837/1732] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:14.092186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d019ef62-5b33-4ae9-8988-9c1a440a9b29 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:14.092694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d019ef62-5b33-4ae9-8988-9c1a440a9b29 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:14.096690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-41051f5c-f13f-4ea4-94bf-66d0f8c5f258 req-e3b1897e-a25f-4f30-a441-f3d8b3e40651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f82b6f5-f5c5-4853-9e35-d840e1b7cf89", "tag": "f2203fd1-8bf9-43c0-b401-21bc22469177"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:14.096690 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:14.096690 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:14.103327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-41051f5c-f13f-4ea4-94bf-66d0f8c5f258 req-e3b1897e-a25f-4f30-a441-f3d8b3e40651 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:14.104411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-41051f5c-f13f-4ea4-94bf-66d0f8c5f258 req-e3b1897e-a25f-4f30-a441-f3d8b3e40651 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:14.117067 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-41051f5c-f13f-4ea4-94bf-66d0f8c5f258 req-e3b1897e-a25f-4f30-a441-f3d8b3e40651 service nova] Creating event network-changed:f2203fd1-8bf9-43c0-b401-21bc22469177 for instance 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 on nch2-master-1 Jan 22 21:05:14.125698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d019ef62-5b33-4ae9-8988-9c1a440a9b29 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:14.126156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d019ef62-5b33-4ae9-8988-9c1a440a9b29 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:14.127667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d019ef62-5b33-4ae9-8988-9c1a440a9b29 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:14.128589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d019ef62-5b33-4ae9-8988-9c1a440a9b29 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:14.132560 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-41051f5c-f13f-4ea4-94bf-66d0f8c5f258 req-e3b1897e-a25f-4f30-a441-f3d8b3e40651 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043415 Jan 22 21:05:14.133897 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 838/1733] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:14.139733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6972dbed-65fe-4b66-a8d1-5e1409407b40 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:14.142364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6972dbed-65fe-4b66-a8d1-5e1409407b40 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:14.148724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6972dbed-65fe-4b66-a8d1-5e1409407b40 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:14.149413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6972dbed-65fe-4b66-a8d1-5e1409407b40 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:14.150421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6972dbed-65fe-4b66-a8d1-5e1409407b40 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:14.151050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6972dbed-65fe-4b66-a8d1-5e1409407b40 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:14.432494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d019ef62-5b33-4ae9-8988-9c1a440a9b29 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:14.447122 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d019ef62-5b33-4ae9-8988-9c1a440a9b29 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1393 microversion: 2.1 time: 0.362902 Jan 22 21:05:14.449000 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 896/1734] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:14 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1393 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:14.455186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-075fc5d2-a791-4417-9939-af6d8304ea74 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Action: 'create', calling method: .version_select at 0x7f1ed5dccd30>, body: {"server_group": {"name": "tempest-server-group-1297985025", "policies": ["affinity"]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:14.473807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-075fc5d2-a791-4417-9939-af6d8304ea74 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:14.480465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-075fc5d2-a791-4417-9939-af6d8304ea74 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for user 7de270798712461aab9499a7353da9e4 and project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:14.643485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-075fc5d2-a791-4417-9939-af6d8304ea74 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:14.650950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-075fc5d2-a791-4417-9939-af6d8304ea74 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for user 7de270798712461aab9499a7353da9e4 and project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:14.665243 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-075fc5d2-a791-4417-9939-af6d8304ea74 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.214880 Jan 22 21:05:14.666228 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 897/1735] 10.222.0.100 () {60 vars in 1177 bytes} [Sat Jan 22 21:05:14 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:14.668343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6972dbed-65fe-4b66-a8d1-5e1409407b40 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:14.678248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-099c483a-544e-41c6-afea-64b12f486fc9 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:14.679461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6972dbed-65fe-4b66-a8d1-5e1409407b40 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:14.680481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-099c483a-544e-41c6-afea-64b12f486fc9 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:14.681850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6972dbed-65fe-4b66-a8d1-5e1409407b40 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:14.685473 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6972dbed-65fe-4b66-a8d1-5e1409407b40 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1481 microversion: 2.25 time: 0.550871 Jan 22 21:05:14.686233 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 839/1736] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:14 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1481 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:14.691958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24a43a38-99ee-4b8e-bd41-1a73e3a00808 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:14.692739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-099c483a-544e-41c6-afea-64b12f486fc9 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:14.693076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-24a43a38-99ee-4b8e-bd41-1a73e3a00808 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:14.696919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-099c483a-544e-41c6-afea-64b12f486fc9 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:14.697898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-099c483a-544e-41c6-afea-64b12f486fc9 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:14.698899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-099c483a-544e-41c6-afea-64b12f486fc9 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:14.712881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a43a38-99ee-4b8e-bd41-1a73e3a00808 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:14.714292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a43a38-99ee-4b8e-bd41-1a73e3a00808 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:14.715205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a43a38-99ee-4b8e-bd41-1a73e3a00808 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:14.716051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a43a38-99ee-4b8e-bd41-1a73e3a00808 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:14.768343 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-24a43a38-99ee-4b8e-bd41-1a73e3a00808 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.080807 Jan 22 21:05:14.769122 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 840/1737] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:14 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:14.775735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9b529715-2a73-4217-b03b-33ff3930c6f4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:14.777419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9b529715-2a73-4217-b03b-33ff3930c6f4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:14.784836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b529715-2a73-4217-b03b-33ff3930c6f4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:14.785338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b529715-2a73-4217-b03b-33ff3930c6f4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:14.786345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b529715-2a73-4217-b03b-33ff3930c6f4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:14.786794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b529715-2a73-4217-b03b-33ff3930c6f4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:14.840790 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9b529715-2a73-4217-b03b-33ff3930c6f4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.067873 Jan 22 21:05:14.851711 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 841/1738] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:14 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:14.855753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d5b46f3-e7c5-4242-80a2-46c7dbc6f0a4 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Action: 'create', calling method: .version_select at 0x7f1ed5de5700>, body: {"server_group": {"name": "tempest-server-group-1297985025", "policies": ["affinity"]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:14.881395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-3d5b46f3-e7c5-4242-80a2-46c7dbc6f0a4 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:14.890865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-3d5b46f3-e7c5-4242-80a2-46c7dbc6f0a4 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for user 7de270798712461aab9499a7353da9e4 and project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:14.962172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-099c483a-544e-41c6-afea-64b12f486fc9 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:14.973464 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-099c483a-544e-41c6-afea-64b12f486fc9 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1327 microversion: 2.1 time: 0.305512 Jan 22 21:05:14.982222 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 898/1739] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:14 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1327 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:14.982222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d6c5b4ab-db02-4abc-b849-57262ba62c51 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:14.982222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d6c5b4ab-db02-4abc-b849-57262ba62c51 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:14.987927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6c5b4ab-db02-4abc-b849-57262ba62c51 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:14.988386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6c5b4ab-db02-4abc-b849-57262ba62c51 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:14.989571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6c5b4ab-db02-4abc-b849-57262ba62c51 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:14.989698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6c5b4ab-db02-4abc-b849-57262ba62c51 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:15.053132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-3d5b46f3-e7c5-4242-80a2-46c7dbc6f0a4 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:15.070051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-3d5b46f3-e7c5-4242-80a2-46c7dbc6f0a4 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for user 7de270798712461aab9499a7353da9e4 and project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:15.085807 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d5b46f3-e7c5-4242-80a2-46c7dbc6f0a4 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.238085 Jan 22 21:05:15.087266 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 842/1740] 10.222.0.100 () {60 vars in 1177 bytes} [Sat Jan 22 21:05:14 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:15.116058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-023f1627-602e-4673-8c5a-47e5d1e16ca8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:15.117092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-023f1627-602e-4673-8c5a-47e5d1e16ca8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:15.125496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-023f1627-602e-4673-8c5a-47e5d1e16ca8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:15.126259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-023f1627-602e-4673-8c5a-47e5d1e16ca8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:15.130795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-023f1627-602e-4673-8c5a-47e5d1e16ca8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:15.130795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-023f1627-602e-4673-8c5a-47e5d1e16ca8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:15.234246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-d6c5b4ab-db02-4abc-b849-57262ba62c51 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'services' on Instance uuid 64db607b-9a30-4235-909f-39804df2fbf6 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:15.253054 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d6c5b4ab-db02-4abc-b849-57262ba62c51 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1974 microversion: 2.25 time: 0.277157 Jan 22 21:05:15.253920 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 899/1741] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:14 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1974 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:15.259205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-da82fa8c-193e-4c61-9a94-5afde9537b93 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:15.366324 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-da82fa8c-193e-4c61-9a94-5afde9537b93 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "DELETE /compute/v2.1/os-server-groups/25bf129f-b6da-46a1-9c35-f0f8f5acb2ed" status: 204 len: 0 microversion: 2.1 time: 0.110946 Jan 22 21:05:15.367108 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 900/1742] 10.222.0.100 () {58 vars in 1270 bytes} [Sat Jan 22 21:05:15 2022] DELETE /compute/v2.1/os-server-groups/25bf129f-b6da-46a1-9c35-f0f8f5acb2ed => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:15.372031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f5b83b5c-eafd-48e3-b2f8-eb9f0b7e7aba tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:15.372654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f5b83b5c-eafd-48e3-b2f8-eb9f0b7e7aba tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:15.379848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5b83b5c-eafd-48e3-b2f8-eb9f0b7e7aba tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:15.380318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5b83b5c-eafd-48e3-b2f8-eb9f0b7e7aba tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:15.381130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5b83b5c-eafd-48e3-b2f8-eb9f0b7e7aba tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:15.381677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5b83b5c-eafd-48e3-b2f8-eb9f0b7e7aba tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:15.531686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-f5b83b5c-eafd-48e3-b2f8-eb9f0b7e7aba tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'services' on Instance uuid 64db607b-9a30-4235-909f-39804df2fbf6 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:15.549772 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f5b83b5c-eafd-48e3-b2f8-eb9f0b7e7aba tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1974 microversion: 2.25 time: 0.181385 Jan 22 21:05:15.550466 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 901/1743] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:15 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1974 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:15.555618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e938507a-de1d-409f-8de3-2694018cee79 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:15.575374 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e938507a-de1d-409f-8de3-2694018cee79 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.023770 Jan 22 21:05:15.575958 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 902/1744] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:05:15 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:15.581768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c68e0c1d-a54a-42a0-9ca1-b24b6fe5b125 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:15.585126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c68e0c1d-a54a-42a0-9ca1-b24b6fe5b125 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:15.588749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c68e0c1d-a54a-42a0-9ca1-b24b6fe5b125 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:15.589220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c68e0c1d-a54a-42a0-9ca1-b24b6fe5b125 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:15.590317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c68e0c1d-a54a-42a0-9ca1-b24b6fe5b125 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:15.590662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c68e0c1d-a54a-42a0-9ca1-b24b6fe5b125 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:15.608226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-023f1627-602e-4673-8c5a-47e5d1e16ca8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:15.618384 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-023f1627-602e-4673-8c5a-47e5d1e16ca8 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.529691 Jan 22 21:05:15.619424 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 843/1745] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:15 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:15.625266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-002f9851-c948-4b1c-8bdb-94a86170614e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:15.629114 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:15.629114 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:15.629114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-002f9851-c948-4b1c-8bdb-94a86170614e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:15.629114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-002f9851-c948-4b1c-8bdb-94a86170614e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:15.629981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-002f9851-c948-4b1c-8bdb-94a86170614e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:15.630428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-002f9851-c948-4b1c-8bdb-94a86170614e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:15.654526 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-002f9851-c948-4b1c-8bdb-94a86170614e tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.032850 Jan 22 21:05:15.655156 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 844/1746] 10.222.0.100 () {60 vars in 1221 bytes} [Sat Jan 22 21:05:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:15.659378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ebba5244-33a2-4e7e-9f00-155c83631716 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:15.774250 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ebba5244-33a2-4e7e-9f00-155c83631716 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "DELETE /compute/v2.1/os-server-groups/a844f7c3-bbad-49a7-8896-323005f1d175" status: 204 len: 0 microversion: 2.1 time: 0.118046 Jan 22 21:05:15.775145 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 845/1747] 10.222.0.100 () {58 vars in 1270 bytes} [Sat Jan 22 21:05:15 2022] DELETE /compute/v2.1/os-server-groups/a844f7c3-bbad-49a7-8896-323005f1d175 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:15.780626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f49ea54f-6119-4a3c-bf0b-9286bb78affc tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:15.781757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f49ea54f-6119-4a3c-bf0b-9286bb78affc tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:15.788379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f49ea54f-6119-4a3c-bf0b-9286bb78affc tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:15.788761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c68e0c1d-a54a-42a0-9ca1-b24b6fe5b125 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:15.789256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f49ea54f-6119-4a3c-bf0b-9286bb78affc tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:15.789652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f49ea54f-6119-4a3c-bf0b-9286bb78affc tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:15.790213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f49ea54f-6119-4a3c-bf0b-9286bb78affc tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:15.800012 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c68e0c1d-a54a-42a0-9ca1-b24b6fe5b125 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1393 microversion: 2.1 time: 0.221894 Jan 22 21:05:15.801181 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 903/1748] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:15 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1393 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:15.806060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a3286b54-ec8d-4cc2-85af-7450c4de3323 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:15.817108 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a3286b54-ec8d-4cc2-85af-7450c4de3323 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.014368 Jan 22 21:05:15.818035 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 904/1749] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:05:15 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:15.824696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-f49ea54f-6119-4a3c-bf0b-9286bb78affc tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'flavor' on Instance uuid 64db607b-9a30-4235-909f-39804df2fbf6 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:15.827787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9de96ed8-b714-469a-b294-7c71ec89171f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:15.828736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9de96ed8-b714-469a-b294-7c71ec89171f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:15.834990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9de96ed8-b714-469a-b294-7c71ec89171f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:15.835156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f49ea54f-6119-4a3c-bf0b-9286bb78affc tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Going to try to live migrate instance to nch1-master-1 {{(pid=137033) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 22 21:05:15.835450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9de96ed8-b714-469a-b294-7c71ec89171f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:15.836282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9de96ed8-b714-469a-b294-7c71ec89171f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:15.836736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9de96ed8-b714-469a-b294-7c71ec89171f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:15.878236 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9de96ed8-b714-469a-b294-7c71ec89171f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.055323 Jan 22 21:05:15.878797 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 905/1750] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:15 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:15.883644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-741765e1-2c0c-4de3-8e29-96aa4f6c5561 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Action: 'create', calling method: .version_select at 0x7f1ed5ea0e50>, body: {"server_group": {"name": "tempest-server-group-520812741", "policies": ["affinity"]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:15.900430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-741765e1-2c0c-4de3-8e29-96aa4f6c5561 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:15.907053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-741765e1-2c0c-4de3-8e29-96aa4f6c5561 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for user 7de270798712461aab9499a7353da9e4 and project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:16.028890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-741765e1-2c0c-4de3-8e29-96aa4f6c5561 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:16.034809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-741765e1-2c0c-4de3-8e29-96aa4f6c5561 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for user 7de270798712461aab9499a7353da9e4 and project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:16.050989 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-741765e1-2c0c-4de3-8e29-96aa4f6c5561 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.170959 Jan 22 21:05:16.051778 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 906/1751] 10.222.0.100 () {60 vars in 1177 bytes} [Sat Jan 22 21:05:15 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:16.060923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-56709712-7b25-4acd-8930-c32403b4ef85 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:16.062424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-56709712-7b25-4acd-8930-c32403b4ef85 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:16.069676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56709712-7b25-4acd-8930-c32403b4ef85 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:16.070408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56709712-7b25-4acd-8930-c32403b4ef85 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:16.071415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56709712-7b25-4acd-8930-c32403b4ef85 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:16.071939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56709712-7b25-4acd-8930-c32403b4ef85 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:16.123925 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-56709712-7b25-4acd-8930-c32403b4ef85 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.070517 Jan 22 21:05:16.124975 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 907/1752] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:16 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:16.130852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b140cf04-f3a1-4986-bdac-89b3c7d655fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:16.132043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b140cf04-f3a1-4986-bdac-89b3c7d655fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:16.140416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b140cf04-f3a1-4986-bdac-89b3c7d655fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:16.141287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b140cf04-f3a1-4986-bdac-89b3c7d655fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:16.146207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b140cf04-f3a1-4986-bdac-89b3c7d655fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:16.146207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b140cf04-f3a1-4986-bdac-89b3c7d655fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:16.442250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b140cf04-f3a1-4986-bdac-89b3c7d655fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:16.465200 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b140cf04-f3a1-4986-bdac-89b3c7d655fb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1327 microversion: 2.1 time: 0.338475 Jan 22 21:05:16.467266 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 908/1753] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:16 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1327 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:16.478793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0c01e8dd-6d44-4967-abbe-9d5062e0d573 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:16.568495 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0c01e8dd-6d44-4967-abbe-9d5062e0d573 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "DELETE /compute/v2.1/os-server-groups/fee67fa0-c4b1-4df1-87a0-868c2e256f8a" status: 204 len: 0 microversion: 2.1 time: 0.099938 Jan 22 21:05:16.569681 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 909/1754] 10.222.0.100 () {58 vars in 1270 bytes} [Sat Jan 22 21:05:16 2022] DELETE /compute/v2.1/os-server-groups/fee67fa0-c4b1-4df1-87a0-868c2e256f8a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:16.722175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-0d0a8d2c-5d31-4b9f-8831-d6ef4907c266 req-eb96bda1-16a0-4717-a3de-50053a38603c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa05d9e2-ba22-4fe8-abc7-66b9054b1812", "tag": "031b57a9-ce17-4f21-abb9-0e430b71022e"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:16.723898 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:16.723898 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:16.737311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0d0a8d2c-5d31-4b9f-8831-d6ef4907c266 req-eb96bda1-16a0-4717-a3de-50053a38603c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:16.741394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0d0a8d2c-5d31-4b9f-8831-d6ef4907c266 req-eb96bda1-16a0-4717-a3de-50053a38603c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:16.752950 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-0d0a8d2c-5d31-4b9f-8831-d6ef4907c266 req-eb96bda1-16a0-4717-a3de-50053a38603c service nova] Creating event network-changed:031b57a9-ce17-4f21-abb9-0e430b71022e for instance fa05d9e2-ba22-4fe8-abc7-66b9054b1812 on nch1-master-1 Jan 22 21:05:16.758019 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-0d0a8d2c-5d31-4b9f-8831-d6ef4907c266 req-eb96bda1-16a0-4717-a3de-50053a38603c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187039 Jan 22 21:05:16.758738 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 910/1755] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:16.767078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f6dc6559-ca4f-4bf7-9865-cf47d758ec92 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:16.776994 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f6dc6559-ca4f-4bf7-9865-cf47d758ec92 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.013798 Jan 22 21:05:16.777856 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 911/1756] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:05:16 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:16.788326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dfc73973-8f5f-47c0-ad63-fbfb2772c058 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:16.789103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dfc73973-8f5f-47c0-ad63-fbfb2772c058 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:16.796161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfc73973-8f5f-47c0-ad63-fbfb2772c058 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:16.796905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfc73973-8f5f-47c0-ad63-fbfb2772c058 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:16.798650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfc73973-8f5f-47c0-ad63-fbfb2772c058 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:16.799409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfc73973-8f5f-47c0-ad63-fbfb2772c058 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:16.954424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dfc73973-8f5f-47c0-ad63-fbfb2772c058 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:16.962189 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dfc73973-8f5f-47c0-ad63-fbfb2772c058 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.177545 Jan 22 21:05:16.969561 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 912/1757] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:16 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:16.969561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-31abbef7-0bdd-4708-aaf7-74b8dac2a49d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Action: 'create', calling method: .version_select at 0x7f1ed5ef7790>, body: {"server_group": {"name": "tempest-server-group-1321906448", "policies": ["anti-affinity"]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:16.991424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-31abbef7-0bdd-4708-aaf7-74b8dac2a49d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:16.997846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-31abbef7-0bdd-4708-aaf7-74b8dac2a49d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for user 7de270798712461aab9499a7353da9e4 and project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:17.119933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-31abbef7-0bdd-4708-aaf7-74b8dac2a49d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:17.125190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-31abbef7-0bdd-4708-aaf7-74b8dac2a49d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for user 7de270798712461aab9499a7353da9e4 and project 72a320e9220b4ea186e4266908053484. Resources: {'server_groups'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:17.138884 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-31abbef7-0bdd-4708-aaf7-74b8dac2a49d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.175071 Jan 22 21:05:17.139983 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 913/1758] 10.222.0.100 () {60 vars in 1177 bytes} [Sat Jan 22 21:05:16 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:17.145244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-20df7d1b-0b5e-4472-ae87-1d666f93865c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:17.146783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-20df7d1b-0b5e-4472-ae87-1d666f93865c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:17.154435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20df7d1b-0b5e-4472-ae87-1d666f93865c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:17.154891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20df7d1b-0b5e-4472-ae87-1d666f93865c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:17.155692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20df7d1b-0b5e-4472-ae87-1d666f93865c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:17.157144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20df7d1b-0b5e-4472-ae87-1d666f93865c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:17.331473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-20df7d1b-0b5e-4472-ae87-1d666f93865c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:17.339255 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-20df7d1b-0b5e-4472-ae87-1d666f93865c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1393 microversion: 2.1 time: 0.198057 Jan 22 21:05:17.339821 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 914/1759] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:17 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1393 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:17.344650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fe4c9c1c-edbe-46f5-aec8-8620b613e407 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:17.345749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fe4c9c1c-edbe-46f5-aec8-8620b613e407 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:17.351896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe4c9c1c-edbe-46f5-aec8-8620b613e407 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:17.352261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe4c9c1c-edbe-46f5-aec8-8620b613e407 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:17.353066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe4c9c1c-edbe-46f5-aec8-8620b613e407 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:17.353532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe4c9c1c-edbe-46f5-aec8-8620b613e407 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:17.471282 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fe4c9c1c-edbe-46f5-aec8-8620b613e407 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.116254 Jan 22 21:05:17.472894 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 915/1760] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:17 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:17.481628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aa7a69bd-2b5d-4375-8d6d-6a8cac5b84f6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:17.483509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aa7a69bd-2b5d-4375-8d6d-6a8cac5b84f6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:17.491843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa7a69bd-2b5d-4375-8d6d-6a8cac5b84f6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:17.492427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa7a69bd-2b5d-4375-8d6d-6a8cac5b84f6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:17.493236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa7a69bd-2b5d-4375-8d6d-6a8cac5b84f6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:17.494111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa7a69bd-2b5d-4375-8d6d-6a8cac5b84f6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:17.584249 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aa7a69bd-2b5d-4375-8d6d-6a8cac5b84f6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.110266 Jan 22 21:05:17.588280 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 916/1761] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:17 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:17.591073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4fe93ab1-f30c-4731-b17b-111edf239fe8 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:17.708970 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4fe93ab1-f30c-4731-b17b-111edf239fe8 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "DELETE /compute/v2.1/os-server-groups/948eae61-b516-4a6d-b7c3-ba83b5428d7b" status: 204 len: 0 microversion: 2.1 time: 0.122499 Jan 22 21:05:17.709921 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 917/1762] 10.222.0.100 () {58 vars in 1270 bytes} [Sat Jan 22 21:05:17 2022] DELETE /compute/v2.1/os-server-groups/948eae61-b516-4a6d-b7c3-ba83b5428d7b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:17.715807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-894b88af-ba3e-4fd6-a8b0-4344b1fc4519 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:17.716634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-894b88af-ba3e-4fd6-a8b0-4344b1fc4519 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:17.723253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-894b88af-ba3e-4fd6-a8b0-4344b1fc4519 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:17.724024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-894b88af-ba3e-4fd6-a8b0-4344b1fc4519 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:17.724929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-894b88af-ba3e-4fd6-a8b0-4344b1fc4519 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:17.725451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-894b88af-ba3e-4fd6-a8b0-4344b1fc4519 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:17.908938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-894b88af-ba3e-4fd6-a8b0-4344b1fc4519 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:17.918949 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-894b88af-ba3e-4fd6-a8b0-4344b1fc4519 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1327 microversion: 2.1 time: 0.207810 Jan 22 21:05:17.919870 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 918/1763] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:17 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1327 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:17.925246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a658d1aa-82cc-43a1-b64a-a9c3232e863c tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:17.935967 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a658d1aa-82cc-43a1-b64a-a9c3232e863c tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.014659 Jan 22 21:05:17.936899 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 919/1764] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:05:17 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:17.984680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7b0edca1-8cdb-44ac-be4c-7a9e4035eddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:17.991957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7b0edca1-8cdb-44ac-be4c-7a9e4035eddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:17.991957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b0edca1-8cdb-44ac-be4c-7a9e4035eddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:17.992147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b0edca1-8cdb-44ac-be4c-7a9e4035eddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:17.992865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b0edca1-8cdb-44ac-be4c-7a9e4035eddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:17.993319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b0edca1-8cdb-44ac-be4c-7a9e4035eddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:18.391786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7b0edca1-8cdb-44ac-be4c-7a9e4035eddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:18.403032 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7b0edca1-8cdb-44ac-be4c-7a9e4035eddc tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.421797 Jan 22 21:05:18.412388 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 920/1765] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:17 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:18.416318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-132609287", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "e46ce977-fe94-4607-bbe1-dc92e8ded3ea"}]}, "os:scheduler_hints": {"group": "a6edec4b-d32a-4344-9bb7-34e237833a35"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:18.483847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] validate_networks() for [('e46ce977-fe94-4607-bbe1-dc92e8ded3ea', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:05:18.929149 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f49ea54f-6119-4a3c-bf0b-9286bb78affc tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6/action" status: 202 len: 0 microversion: 2.25 time: 3.152567 Jan 22 21:05:18.935167 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 846/1766] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:05:15 2022] POST /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6/action => generated 0 bytes in 3155 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:18.942655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b3b371ac-12d1-46fa-87d0-2c00fef29430 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:18.943358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b3b371ac-12d1-46fa-87d0-2c00fef29430 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:18.953145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3b371ac-12d1-46fa-87d0-2c00fef29430 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:18.953740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3b371ac-12d1-46fa-87d0-2c00fef29430 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:18.954813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3b371ac-12d1-46fa-87d0-2c00fef29430 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:18.955486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3b371ac-12d1-46fa-87d0-2c00fef29430 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:19.037523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:05:19.038457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:05:19.038956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:05:19.039380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:05:19.039813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:05:19.065426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:19.066410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:19.067497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:19.068185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:19.091883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for project 72a320e9220b4ea186e4266908053484. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:19.102404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for user 7de270798712461aab9499a7353da9e4 and project 72a320e9220b4ea186e4266908053484. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:19.130548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:05:19.133427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:05:19.141961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b3b371ac-12d1-46fa-87d0-2c00fef29430 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:19.145446 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b3b371ac-12d1-46fa-87d0-2c00fef29430 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1393 microversion: 2.1 time: 0.211827 Jan 22 21:05:19.146630 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 847/1767] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:18 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1393 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:19.152454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2f181ba7-a339-468c-9a02-70fb05ea2c68 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:19.153600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2f181ba7-a339-468c-9a02-70fb05ea2c68 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:19.168696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f181ba7-a339-468c-9a02-70fb05ea2c68 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:19.172040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f181ba7-a339-468c-9a02-70fb05ea2c68 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:19.172040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f181ba7-a339-468c-9a02-70fb05ea2c68 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:19.172040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f181ba7-a339-468c-9a02-70fb05ea2c68 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:19.217434 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2f181ba7-a339-468c-9a02-70fb05ea2c68 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.069033 Jan 22 21:05:19.223704 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 848/1768] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:19 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:19.225692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7e141eba-0abf-4e2e-b352-69d8439624ba tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:19.226692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7e141eba-0abf-4e2e-b352-69d8439624ba tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:19.233816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e141eba-0abf-4e2e-b352-69d8439624ba tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:19.234269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e141eba-0abf-4e2e-b352-69d8439624ba tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:19.240602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e141eba-0abf-4e2e-b352-69d8439624ba tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:19.241337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e141eba-0abf-4e2e-b352-69d8439624ba tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:19.267935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=137032) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Jan 22 21:05:19.285254 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7e141eba-0abf-4e2e-b352-69d8439624ba tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.065643 Jan 22 21:05:19.286542 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 849/1769] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:19 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:19.289656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for project 72a320e9220b4ea186e4266908053484. Resources: {'server_group_members'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:19.290864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b85f72a0-2528-492d-93d4-d00c6e5196eb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:19.292788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b85f72a0-2528-492d-93d4-d00c6e5196eb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:19.296536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for user 7de270798712461aab9499a7353da9e4 and project 72a320e9220b4ea186e4266908053484. Resources: {'server_group_members'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:19.304391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b85f72a0-2528-492d-93d4-d00c6e5196eb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:19.304862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b85f72a0-2528-492d-93d4-d00c6e5196eb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:19.305702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b85f72a0-2528-492d-93d4-d00c6e5196eb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:19.306317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b85f72a0-2528-492d-93d4-d00c6e5196eb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:19.460804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for project 72a320e9220b4ea186e4266908053484. Resources: {'server_group_members'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:19.468357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Getting quotas for user 7de270798712461aab9499a7353da9e4 and project 72a320e9220b4ea186e4266908053484. Resources: {'server_group_members'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:19.516222 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b63dbafc-de5d-4c0c-a9a8-c45236fc81d9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.099230 Jan 22 21:05:19.521810 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 921/1770] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:05:18 2022] POST /compute/v2.1/servers => generated 382 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:05:19.530823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2f5f064d-9eff-49c2-9b0d-6485c72cb9e5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:19.532406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2f5f064d-9eff-49c2-9b0d-6485c72cb9e5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:19.548395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f5f064d-9eff-49c2-9b0d-6485c72cb9e5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:19.551658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f5f064d-9eff-49c2-9b0d-6485c72cb9e5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:19.554991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f5f064d-9eff-49c2-9b0d-6485c72cb9e5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:19.558933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f5f064d-9eff-49c2-9b0d-6485c72cb9e5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:19.935020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2f5f064d-9eff-49c2-9b0d-6485c72cb9e5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:19.949771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2f5f064d-9eff-49c2-9b0d-6485c72cb9e5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:19.956996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2f5f064d-9eff-49c2-9b0d-6485c72cb9e5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:19.960402 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2f5f064d-9eff-49c2-9b0d-6485c72cb9e5 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1491 microversion: 2.25 time: 0.439628 Jan 22 21:05:19.970563 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 922/1771] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:19 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1491 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:19.984324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a0159308-0be3-4702-a92d-eaf81de39ab0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:19.988254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a0159308-0be3-4702-a92d-eaf81de39ab0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:20.002081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0159308-0be3-4702-a92d-eaf81de39ab0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:20.003600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0159308-0be3-4702-a92d-eaf81de39ab0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:20.005263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0159308-0be3-4702-a92d-eaf81de39ab0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:20.006356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0159308-0be3-4702-a92d-eaf81de39ab0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:20.042725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b85f72a0-2528-492d-93d4-d00c6e5196eb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:20.051256 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b85f72a0-2528-492d-93d4-d00c6e5196eb tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1327 microversion: 2.1 time: 0.764067 Jan 22 21:05:20.055435 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 850/1772] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:19 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1327 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:20.061073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b530439-efae-4289-a274-76814b9e5bd2 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:20.067442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4b530439-efae-4289-a274-76814b9e5bd2 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:20.182252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4b530439-efae-4289-a274-76814b9e5bd2 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:20.190888 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b530439-efae-4289-a274-76814b9e5bd2 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1216 microversion: 2.1 time: 0.133915 Jan 22 21:05:20.192159 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 851/1773] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:20 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1216 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:20.197278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-94985c26-8f6c-4085-880c-76f8b116b270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:20.198684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-94985c26-8f6c-4085-880c-76f8b116b270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:20.208444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94985c26-8f6c-4085-880c-76f8b116b270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:20.210067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94985c26-8f6c-4085-880c-76f8b116b270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:20.211667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94985c26-8f6c-4085-880c-76f8b116b270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:20.212364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94985c26-8f6c-4085-880c-76f8b116b270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:20.599735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a0159308-0be3-4702-a92d-eaf81de39ab0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:20.610177 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a0159308-0be3-4702-a92d-eaf81de39ab0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.637679 Jan 22 21:05:20.611228 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 923/1774] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:19 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:20.616218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-be83e5af-1980-482c-a7c1-7d1de33e0d35 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:20.617666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-be83e5af-1980-482c-a7c1-7d1de33e0d35 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:20.627881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be83e5af-1980-482c-a7c1-7d1de33e0d35 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:20.628745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be83e5af-1980-482c-a7c1-7d1de33e0d35 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:20.629835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be83e5af-1980-482c-a7c1-7d1de33e0d35 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:20.630588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be83e5af-1980-482c-a7c1-7d1de33e0d35 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:20.694445 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-be83e5af-1980-482c-a7c1-7d1de33e0d35 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.080124 Jan 22 21:05:20.695765 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 924/1775] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:20 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:20.703664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-69ff2fd7-90d2-4867-a367-129cfc196b2d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:20.704702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-69ff2fd7-90d2-4867-a367-129cfc196b2d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:20.712967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-94985c26-8f6c-4085-880c-76f8b116b270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:20.713325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69ff2fd7-90d2-4867-a367-129cfc196b2d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:20.714039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69ff2fd7-90d2-4867-a367-129cfc196b2d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:20.714857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69ff2fd7-90d2-4867-a367-129cfc196b2d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:20.715300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69ff2fd7-90d2-4867-a367-129cfc196b2d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:20.726349 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-94985c26-8f6c-4085-880c-76f8b116b270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1393 microversion: 2.1 time: 0.532817 Jan 22 21:05:20.736622 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 852/1776] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:20 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1393 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:20.778002 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-69ff2fd7-90d2-4867-a367-129cfc196b2d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.078631 Jan 22 21:05:20.783094 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 925/1777] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:20 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:20.982218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4100b1be-5a3e-4595-abfe-90b5cb158204 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:20.983004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4100b1be-5a3e-4595-abfe-90b5cb158204 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:20.996578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4100b1be-5a3e-4595-abfe-90b5cb158204 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:20.997389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4100b1be-5a3e-4595-abfe-90b5cb158204 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:20.998323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4100b1be-5a3e-4595-abfe-90b5cb158204 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:20.998786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4100b1be-5a3e-4595-abfe-90b5cb158204 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:21.052193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-b50281b7-245d-4270-8b35-65e31fa54dc4 req-d9d02b12-229e-42b6-8b37-4412376a1074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030", "name": "network-vif-unplugged", "status": "completed", "tag": "241845a7-45d2-443a-a581-ab21d64d2668"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:21.054832 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:21.054832 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:21.064556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b50281b7-245d-4270-8b35-65e31fa54dc4 req-d9d02b12-229e-42b6-8b37-4412376a1074 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:21.065295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b50281b7-245d-4270-8b35-65e31fa54dc4 req-d9d02b12-229e-42b6-8b37-4412376a1074 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:21.078290 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-b50281b7-245d-4270-8b35-65e31fa54dc4 req-d9d02b12-229e-42b6-8b37-4412376a1074 service nova] Creating event network-vif-unplugged:241845a7-45d2-443a-a581-ab21d64d2668 for instance 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 on nch1-master-1 Jan 22 21:05:21.084001 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-b50281b7-245d-4270-8b35-65e31fa54dc4 req-d9d02b12-229e-42b6-8b37-4412376a1074 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035612 Jan 22 21:05:21.090901 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 926/1778] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:05:21.091286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ea438f92-d0fe-4aba-90b7-15e28efad5fe tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:21.092483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ea438f92-d0fe-4aba-90b7-15e28efad5fe tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:21.114685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea438f92-d0fe-4aba-90b7-15e28efad5fe tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:21.115252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea438f92-d0fe-4aba-90b7-15e28efad5fe tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:21.120383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea438f92-d0fe-4aba-90b7-15e28efad5fe tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:21.120383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea438f92-d0fe-4aba-90b7-15e28efad5fe tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:21.256437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4100b1be-5a3e-4595-abfe-90b5cb158204 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:21.267120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4100b1be-5a3e-4595-abfe-90b5cb158204 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:21.277829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4100b1be-5a3e-4595-abfe-90b5cb158204 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:21.279842 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4100b1be-5a3e-4595-abfe-90b5cb158204 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1491 microversion: 2.25 time: 0.303438 Jan 22 21:05:21.281036 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 853/1779] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:20 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1491 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:05:21.294075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7084c322-8b61-4867-8494-9351d6dffaff tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:21.295909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7084c322-8b61-4867-8494-9351d6dffaff tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:21.312201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7084c322-8b61-4867-8494-9351d6dffaff tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:21.318242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7084c322-8b61-4867-8494-9351d6dffaff tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:21.318242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7084c322-8b61-4867-8494-9351d6dffaff tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:21.318242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7084c322-8b61-4867-8494-9351d6dffaff tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:21.405933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7084c322-8b61-4867-8494-9351d6dffaff tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:21.445089 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7084c322-8b61-4867-8494-9351d6dffaff tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1220 microversion: 2.1 time: 0.161682 Jan 22 21:05:21.462860 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 854/1780] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:21 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1220 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:21.627142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d8635c08-5a5c-4968-9a8d-6ef160e70792 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:21.627985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d8635c08-5a5c-4968-9a8d-6ef160e70792 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:21.650124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8635c08-5a5c-4968-9a8d-6ef160e70792 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:21.651121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8635c08-5a5c-4968-9a8d-6ef160e70792 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:21.652178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8635c08-5a5c-4968-9a8d-6ef160e70792 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:21.652705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8635c08-5a5c-4968-9a8d-6ef160e70792 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:21.691474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ea438f92-d0fe-4aba-90b7-15e28efad5fe tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:21.703895 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ea438f92-d0fe-4aba-90b7-15e28efad5fe tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1327 microversion: 2.1 time: 0.615512 Jan 22 21:05:21.704564 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 927/1781] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:21 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1327 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:21.712455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-35f3244d-29c8-4ee0-90f5-af7f677cec5b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:21.714513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-35f3244d-29c8-4ee0-90f5-af7f677cec5b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:21.732375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-35f3244d-29c8-4ee0-90f5-af7f677cec5b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:21.737084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-35f3244d-29c8-4ee0-90f5-af7f677cec5b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:21.737084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-35f3244d-29c8-4ee0-90f5-af7f677cec5b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:21.737084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-35f3244d-29c8-4ee0-90f5-af7f677cec5b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:21.785313 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-35f3244d-29c8-4ee0-90f5-af7f677cec5b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.075934 Jan 22 21:05:21.786711 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 928/1782] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:21 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:21.801533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7bd15fac-33a6-461e-ad03-8102d891fc0c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:21.804051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7bd15fac-33a6-461e-ad03-8102d891fc0c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:21.826866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7bd15fac-33a6-461e-ad03-8102d891fc0c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:21.828686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7bd15fac-33a6-461e-ad03-8102d891fc0c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:21.830120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7bd15fac-33a6-461e-ad03-8102d891fc0c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:21.832490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7bd15fac-33a6-461e-ad03-8102d891fc0c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:22.071374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d8635c08-5a5c-4968-9a8d-6ef160e70792 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:22.086941 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d8635c08-5a5c-4968-9a8d-6ef160e70792 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1475 microversion: 2.1 time: 0.463263 Jan 22 21:05:22.088902 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 855/1783] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:21 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1475 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:22.100330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dbf0c27a-2f00-4584-b791-d6a84d151285 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:22.101720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dbf0c27a-2f00-4584-b791-d6a84d151285 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:22.103738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7bd15fac-33a6-461e-ad03-8102d891fc0c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:22.112104 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7bd15fac-33a6-461e-ad03-8102d891fc0c tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1393 microversion: 2.1 time: 0.322608 Jan 22 21:05:22.112829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbf0c27a-2f00-4584-b791-d6a84d151285 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:22.114650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbf0c27a-2f00-4584-b791-d6a84d151285 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:22.116086 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 929/1784] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:21 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1393 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:22.121074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbf0c27a-2f00-4584-b791-d6a84d151285 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:22.123838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbf0c27a-2f00-4584-b791-d6a84d151285 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:22.201944 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dbf0c27a-2f00-4584-b791-d6a84d151285 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 24583 microversion: 2.1 time: 0.110919 Jan 22 21:05:22.203341 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 856/1785] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:22 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 24583 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:22.299117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb412bb6-905c-446b-b248-a1c3575e66f8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:22.299885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fb412bb6-905c-446b-b248-a1c3575e66f8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:22.307390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb412bb6-905c-446b-b248-a1c3575e66f8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:22.308018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb412bb6-905c-446b-b248-a1c3575e66f8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:22.308883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb412bb6-905c-446b-b248-a1c3575e66f8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:22.309397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb412bb6-905c-446b-b248-a1c3575e66f8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:22.480754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6f4f239b-8a9a-48a0-b617-c10defa3e48a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:22.481426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6f4f239b-8a9a-48a0-b617-c10defa3e48a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:22.497722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f4f239b-8a9a-48a0-b617-c10defa3e48a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:22.499148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f4f239b-8a9a-48a0-b617-c10defa3e48a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:22.506190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f4f239b-8a9a-48a0-b617-c10defa3e48a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:22.521002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f4f239b-8a9a-48a0-b617-c10defa3e48a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:22.790140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fb412bb6-905c-446b-b248-a1c3575e66f8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:22.806841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fb412bb6-905c-446b-b248-a1c3575e66f8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:22.810150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fb412bb6-905c-446b-b248-a1c3575e66f8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:22.817883 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fb412bb6-905c-446b-b248-a1c3575e66f8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1491 microversion: 2.25 time: 0.522804 Jan 22 21:05:22.825221 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 930/1786] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:22 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1491 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:22.842834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c7448244-5293-450b-9a63-f42e33a78e24 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:22.847760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c7448244-5293-450b-9a63-f42e33a78e24 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:22.867314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7448244-5293-450b-9a63-f42e33a78e24 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:22.880832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7448244-5293-450b-9a63-f42e33a78e24 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:22.886313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7448244-5293-450b-9a63-f42e33a78e24 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:22.887027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7448244-5293-450b-9a63-f42e33a78e24 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:23.018835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6f4f239b-8a9a-48a0-b617-c10defa3e48a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:23.027467 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6f4f239b-8a9a-48a0-b617-c10defa3e48a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1276 microversion: 2.1 time: 0.551747 Jan 22 21:05:23.029109 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 857/1787] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:22 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1276 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:23.037334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eaadf6b7-b2b9-40ba-9dd5-3066950f299c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:23.044945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eaadf6b7-b2b9-40ba-9dd5-3066950f299c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:23.055274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaadf6b7-b2b9-40ba-9dd5-3066950f299c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:23.062083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaadf6b7-b2b9-40ba-9dd5-3066950f299c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:23.062083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaadf6b7-b2b9-40ba-9dd5-3066950f299c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:23.062083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaadf6b7-b2b9-40ba-9dd5-3066950f299c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:23.123235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c7448244-5293-450b-9a63-f42e33a78e24 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:23.136061 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c7448244-5293-450b-9a63-f42e33a78e24 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1327 microversion: 2.1 time: 0.308004 Jan 22 21:05:23.137806 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eaadf6b7-b2b9-40ba-9dd5-3066950f299c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.105142 Jan 22 21:05:23.138710 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 931/1788] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:22 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1327 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:23.148259 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 858/1789] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:23 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:23.148484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f54ade28-e716-4147-9ccf-d68f02deff60 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:23.148484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f54ade28-e716-4147-9ccf-d68f02deff60 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:23.154132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f54ade28-e716-4147-9ccf-d68f02deff60 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:23.155078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f54ade28-e716-4147-9ccf-d68f02deff60 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:23.156379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f54ade28-e716-4147-9ccf-d68f02deff60 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:23.157227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f54ade28-e716-4147-9ccf-d68f02deff60 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:23.170911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-4c69efbc-15e7-49e8-a6f9-f9644a421804 req-3e93c6c5-b520-4280-8c1d-1ba367cb287f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030", "tag": "241845a7-45d2-443a-a581-ab21d64d2668"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:23.176850 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:23.176850 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:23.196119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4c69efbc-15e7-49e8-a6f9-f9644a421804 req-3e93c6c5-b520-4280-8c1d-1ba367cb287f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:23.196632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4c69efbc-15e7-49e8-a6f9-f9644a421804 req-3e93c6c5-b520-4280-8c1d-1ba367cb287f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:23.229879 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-4c69efbc-15e7-49e8-a6f9-f9644a421804 req-3e93c6c5-b520-4280-8c1d-1ba367cb287f service nova] Creating event network-changed:241845a7-45d2-443a-a581-ab21d64d2668 for instance 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 on nch1-master-1 Jan 22 21:05:23.246144 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-4c69efbc-15e7-49e8-a6f9-f9644a421804 req-3e93c6c5-b520-4280-8c1d-1ba367cb287f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104995 Jan 22 21:05:23.247913 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 859/1790] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:23.253819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b72a0130-5446-4174-a33a-bc46737c07d3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:23.254904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b72a0130-5446-4174-a33a-bc46737c07d3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:23.264016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b72a0130-5446-4174-a33a-bc46737c07d3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:23.264853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b72a0130-5446-4174-a33a-bc46737c07d3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:23.266117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b72a0130-5446-4174-a33a-bc46737c07d3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:23.266820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b72a0130-5446-4174-a33a-bc46737c07d3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:23.513338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f54ade28-e716-4147-9ccf-d68f02deff60 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:23.525934 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f54ade28-e716-4147-9ccf-d68f02deff60 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1481 microversion: 2.1 time: 0.385636 Jan 22 21:05:23.527096 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 932/1791] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:23 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1481 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:23.545341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-81e80c45-e7bf-4467-b8a2-265eac0a34f5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:23.547338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-81e80c45-e7bf-4467-b8a2-265eac0a34f5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:23.561643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81e80c45-e7bf-4467-b8a2-265eac0a34f5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:23.566035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81e80c45-e7bf-4467-b8a2-265eac0a34f5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:23.567184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81e80c45-e7bf-4467-b8a2-265eac0a34f5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:23.570967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81e80c45-e7bf-4467-b8a2-265eac0a34f5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:23.664632 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-81e80c45-e7bf-4467-b8a2-265eac0a34f5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.134530 Jan 22 21:05:23.669764 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 933/1792] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:23 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:23.757475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b72a0130-5446-4174-a33a-bc46737c07d3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:23.769353 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b72a0130-5446-4174-a33a-bc46737c07d3 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1393 microversion: 2.1 time: 0.519964 Jan 22 21:05:23.770338 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 860/1793] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:23 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1393 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:23.821047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-b10e5a9f-5cb2-4e7f-a21c-75d3091ace60 req-a33cd45d-ca3d-4b42-8026-f70be295fce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4ae3f7e-0253-473f-8066-2b295fbcbbd1", "name": "network-vif-plugged", "status": "completed", "tag": "b36ddfbb-4bf6-415d-b48e-8df34234a5f8"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:23.821047 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:23.821047 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:23.839325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b10e5a9f-5cb2-4e7f-a21c-75d3091ace60 req-a33cd45d-ca3d-4b42-8026-f70be295fce8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:23.840962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b10e5a9f-5cb2-4e7f-a21c-75d3091ace60 req-a33cd45d-ca3d-4b42-8026-f70be295fce8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:23.844761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4fbdacdd-a38e-4e70-af4f-762ce600fb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:23.845653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4fbdacdd-a38e-4e70-af4f-762ce600fb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:23.859466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fbdacdd-a38e-4e70-af4f-762ce600fb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:23.862370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fbdacdd-a38e-4e70-af4f-762ce600fb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:23.863509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fbdacdd-a38e-4e70-af4f-762ce600fb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:23.869165 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-b10e5a9f-5cb2-4e7f-a21c-75d3091ace60 req-a33cd45d-ca3d-4b42-8026-f70be295fce8 service nova] Creating event network-vif-plugged:b36ddfbb-4bf6-415d-b48e-8df34234a5f8 for instance f4ae3f7e-0253-473f-8066-2b295fbcbbd1 on nch2-master-1 Jan 22 21:05:23.870535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fbdacdd-a38e-4e70-af4f-762ce600fb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:23.883909 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-b10e5a9f-5cb2-4e7f-a21c-75d3091ace60 req-a33cd45d-ca3d-4b42-8026-f70be295fce8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211981 Jan 22 21:05:23.884936 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 934/1794] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:24.056277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b8c0c111-d994-4cb3-bfe0-72917bf81b1b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:24.057673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b8c0c111-d994-4cb3-bfe0-72917bf81b1b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:24.070185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8c0c111-d994-4cb3-bfe0-72917bf81b1b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:24.074485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8c0c111-d994-4cb3-bfe0-72917bf81b1b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:24.076379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8c0c111-d994-4cb3-bfe0-72917bf81b1b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:24.078267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8c0c111-d994-4cb3-bfe0-72917bf81b1b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:24.256702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b8c0c111-d994-4cb3-bfe0-72917bf81b1b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:24.270650 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b8c0c111-d994-4cb3-bfe0-72917bf81b1b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1274 microversion: 2.1 time: 0.218451 Jan 22 21:05:24.271769 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 935/1795] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:24 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1274 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:24.284756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6009ce6e-abb6-4c3e-b444-935b89edad97 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:24.290664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6009ce6e-abb6-4c3e-b444-935b89edad97 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:24.303043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6009ce6e-abb6-4c3e-b444-935b89edad97 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:24.305182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6009ce6e-abb6-4c3e-b444-935b89edad97 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:24.309183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6009ce6e-abb6-4c3e-b444-935b89edad97 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:24.309804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6009ce6e-abb6-4c3e-b444-935b89edad97 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:24.541150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4fbdacdd-a38e-4e70-af4f-762ce600fb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:24.564640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4fbdacdd-a38e-4e70-af4f-762ce600fb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:24.573715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4fbdacdd-a38e-4e70-af4f-762ce600fb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:24.573715 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4fbdacdd-a38e-4e70-af4f-762ce600fb41 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1491 microversion: 2.25 time: 0.728940 Jan 22 21:05:24.586467 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 861/1796] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:23 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1491 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:24.586467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0917a4b3-4919-40f6-8708-2e8c6bb7e4e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:24.586467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0917a4b3-4919-40f6-8708-2e8c6bb7e4e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:24.601357 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6009ce6e-abb6-4c3e-b444-935b89edad97 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.324952 Jan 22 21:05:24.601622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0917a4b3-4919-40f6-8708-2e8c6bb7e4e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:24.602262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0917a4b3-4919-40f6-8708-2e8c6bb7e4e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:24.602882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0917a4b3-4919-40f6-8708-2e8c6bb7e4e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:24.603383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0917a4b3-4919-40f6-8708-2e8c6bb7e4e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:24.608699 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 936/1797] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:24 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:24.629556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0b797ef3-0ba8-4a06-ba54-a74a9eb1871d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:24.650225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0b797ef3-0ba8-4a06-ba54-a74a9eb1871d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:24.673495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b797ef3-0ba8-4a06-ba54-a74a9eb1871d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:24.676816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b797ef3-0ba8-4a06-ba54-a74a9eb1871d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:24.676816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b797ef3-0ba8-4a06-ba54-a74a9eb1871d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:24.677623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b797ef3-0ba8-4a06-ba54-a74a9eb1871d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:24.864624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0b797ef3-0ba8-4a06-ba54-a74a9eb1871d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:24.873044 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0b797ef3-0ba8-4a06-ba54-a74a9eb1871d tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1481 microversion: 2.1 time: 0.261211 Jan 22 21:05:24.874406 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 937/1798] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:24 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1481 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:24.881245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-24cf90e3-7258-48b4-bc01-e2c5d2cfdc3f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:24.882019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-24cf90e3-7258-48b4-bc01-e2c5d2cfdc3f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:24.888691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24cf90e3-7258-48b4-bc01-e2c5d2cfdc3f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:24.889553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24cf90e3-7258-48b4-bc01-e2c5d2cfdc3f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:24.890708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24cf90e3-7258-48b4-bc01-e2c5d2cfdc3f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:24.891310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24cf90e3-7258-48b4-bc01-e2c5d2cfdc3f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:24.939485 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-24cf90e3-7258-48b4-bc01-e2c5d2cfdc3f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.063350 Jan 22 21:05:24.939950 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 938/1799] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:24 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:24.947170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dba708f0-bbc1-4ba6-b385-fabfe0e456f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:24.948125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dba708f0-bbc1-4ba6-b385-fabfe0e456f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:24.960496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dba708f0-bbc1-4ba6-b385-fabfe0e456f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:24.960496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dba708f0-bbc1-4ba6-b385-fabfe0e456f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:24.960496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dba708f0-bbc1-4ba6-b385-fabfe0e456f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:24.960496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dba708f0-bbc1-4ba6-b385-fabfe0e456f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:25.068970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0917a4b3-4919-40f6-8708-2e8c6bb7e4e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:25.077259 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0917a4b3-4919-40f6-8708-2e8c6bb7e4e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1327 microversion: 2.1 time: 0.501490 Jan 22 21:05:25.089813 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 862/1800] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:24 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1327 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:25.177256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dba708f0-bbc1-4ba6-b385-fabfe0e456f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:25.188533 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dba708f0-bbc1-4ba6-b385-fabfe0e456f6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1393 microversion: 2.1 time: 0.246028 Jan 22 21:05:25.189322 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 939/1801] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:24 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1393 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:25.288122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-82455246-e9a0-4d4e-9555-85fb48c119aa tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:25.288887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-82455246-e9a0-4d4e-9555-85fb48c119aa tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:25.296220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82455246-e9a0-4d4e-9555-85fb48c119aa tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:25.296691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82455246-e9a0-4d4e-9555-85fb48c119aa tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:25.297493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82455246-e9a0-4d4e-9555-85fb48c119aa tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:25.297960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82455246-e9a0-4d4e-9555-85fb48c119aa tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:25.481456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-82455246-e9a0-4d4e-9555-85fb48c119aa tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:25.487157 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-82455246-e9a0-4d4e-9555-85fb48c119aa tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1316 microversion: 2.1 time: 0.202673 Jan 22 21:05:25.487735 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 863/1802] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:25 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:25.593071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-64820556-d579-4ce6-a81a-efb2568ac949 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:25.593756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-64820556-d579-4ce6-a81a-efb2568ac949 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:25.601531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64820556-d579-4ce6-a81a-efb2568ac949 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:25.602337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64820556-d579-4ce6-a81a-efb2568ac949 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:25.603415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64820556-d579-4ce6-a81a-efb2568ac949 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:25.604182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64820556-d579-4ce6-a81a-efb2568ac949 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:25.617888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e02a7761-72fd-43b5-b527-bf31a0f99727 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:25.620462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e02a7761-72fd-43b5-b527-bf31a0f99727 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:25.627681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e02a7761-72fd-43b5-b527-bf31a0f99727 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:25.628435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e02a7761-72fd-43b5-b527-bf31a0f99727 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:25.629820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e02a7761-72fd-43b5-b527-bf31a0f99727 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:25.630508 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e02a7761-72fd-43b5-b527-bf31a0f99727 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:25.822555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-64820556-d579-4ce6-a81a-efb2568ac949 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:25.836400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-64820556-d579-4ce6-a81a-efb2568ac949 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:25.838041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-64820556-d579-4ce6-a81a-efb2568ac949 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:25.840509 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-64820556-d579-4ce6-a81a-efb2568ac949 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1491 microversion: 2.25 time: 0.252229 Jan 22 21:05:25.840897 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 940/1803] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:25 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1491 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:25.891416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-51f8774f-2707-4270-93a2-d8148c469171 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:25.893026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-51f8774f-2707-4270-93a2-d8148c469171 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:25.899603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51f8774f-2707-4270-93a2-d8148c469171 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:25.900067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51f8774f-2707-4270-93a2-d8148c469171 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:25.901578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51f8774f-2707-4270-93a2-d8148c469171 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:25.902203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51f8774f-2707-4270-93a2-d8148c469171 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:26.013440 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e02a7761-72fd-43b5-b527-bf31a0f99727 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.399282 Jan 22 21:05:26.018031 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 864/1804] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:25 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:05:26.020743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-02e43e68-563f-4283-944f-3edcb0c56718 req-9bec43a9-c420-45b5-a037-26a2c9bd35d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa05d9e2-ba22-4fe8-abc7-66b9054b1812", "name": "network-vif-plugged", "status": "completed", "tag": "031b57a9-ce17-4f21-abb9-0e430b71022e"}, {"server_uuid": "4f82b6f5-f5c5-4853-9e35-d840e1b7cf89", "name": "network-vif-plugged", "status": "completed", "tag": "f2203fd1-8bf9-43c0-b401-21bc22469177"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:26.023055 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:26.023055 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:26.034449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-02e43e68-563f-4283-944f-3edcb0c56718 req-9bec43a9-c420-45b5-a037-26a2c9bd35d9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:26.035275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-02e43e68-563f-4283-944f-3edcb0c56718 req-9bec43a9-c420-45b5-a037-26a2c9bd35d9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:26.050807 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-02e43e68-563f-4283-944f-3edcb0c56718 req-9bec43a9-c420-45b5-a037-26a2c9bd35d9 service nova] Creating event network-vif-plugged:031b57a9-ce17-4f21-abb9-0e430b71022e for instance fa05d9e2-ba22-4fe8-abc7-66b9054b1812 on nch1-master-1 Jan 22 21:05:26.053793 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-02e43e68-563f-4283-944f-3edcb0c56718 req-9bec43a9-c420-45b5-a037-26a2c9bd35d9 service nova] Creating event network-vif-plugged:f2203fd1-8bf9-43c0-b401-21bc22469177 for instance 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 on nch2-master-1 Jan 22 21:05:26.061883 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-02e43e68-563f-4283-944f-3edcb0c56718 req-9bec43a9-c420-45b5-a037-26a2c9bd35d9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044675 Jan 22 21:05:26.062745 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 865/1805] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:26.067855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c9ea01a7-24d0-4590-865c-32d4b2bdd293 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:26.069867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c9ea01a7-24d0-4590-865c-32d4b2bdd293 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:26.078066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-51f8774f-2707-4270-93a2-d8148c469171 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:26.079349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9ea01a7-24d0-4590-865c-32d4b2bdd293 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:26.080022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9ea01a7-24d0-4590-865c-32d4b2bdd293 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:26.081016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9ea01a7-24d0-4590-865c-32d4b2bdd293 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:26.081819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9ea01a7-24d0-4590-865c-32d4b2bdd293 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:26.099480 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-51f8774f-2707-4270-93a2-d8148c469171 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1481 microversion: 2.1 time: 0.211824 Jan 22 21:05:26.115088 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 941/1806] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:25 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1481 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:26.125416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e6749a9b-ac25-4861-ae9d-1b0b290f5d2f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:26.128531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e6749a9b-ac25-4861-ae9d-1b0b290f5d2f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:26.142284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6749a9b-ac25-4861-ae9d-1b0b290f5d2f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:26.145743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6749a9b-ac25-4861-ae9d-1b0b290f5d2f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:26.147134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6749a9b-ac25-4861-ae9d-1b0b290f5d2f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:26.149964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6749a9b-ac25-4861-ae9d-1b0b290f5d2f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:26.162148 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c9ea01a7-24d0-4590-865c-32d4b2bdd293 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.092211 Jan 22 21:05:26.169114 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 866/1807] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:26 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:26.210431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-047cf426-6f27-4df7-a24e-4cd248b7e90d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:26.214156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-047cf426-6f27-4df7-a24e-4cd248b7e90d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:26.243379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-047cf426-6f27-4df7-a24e-4cd248b7e90d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:26.243379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-047cf426-6f27-4df7-a24e-4cd248b7e90d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:26.245768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-047cf426-6f27-4df7-a24e-4cd248b7e90d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:26.247368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-047cf426-6f27-4df7-a24e-4cd248b7e90d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:26.701262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e6749a9b-ac25-4861-ae9d-1b0b290f5d2f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:26.714660 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e6749a9b-ac25-4861-ae9d-1b0b290f5d2f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1327 microversion: 2.1 time: 0.596578 Jan 22 21:05:26.715868 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 942/1808] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:26 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1327 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:26.722968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b1f65baf-7cb3-4822-a500-b41849b0d459 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:26.723857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b1f65baf-7cb3-4822-a500-b41849b0d459 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:26.733252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1f65baf-7cb3-4822-a500-b41849b0d459 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:26.733763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1f65baf-7cb3-4822-a500-b41849b0d459 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:26.734616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1f65baf-7cb3-4822-a500-b41849b0d459 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:26.735102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1f65baf-7cb3-4822-a500-b41849b0d459 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:26.797122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-047cf426-6f27-4df7-a24e-4cd248b7e90d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:26.811908 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-047cf426-6f27-4df7-a24e-4cd248b7e90d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1383 microversion: 2.1 time: 0.608811 Jan 22 21:05:26.823569 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 867/1809] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:26 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1383 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:26.828990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-523a17c1-85ea-48aa-a7a6-edab28fa0093 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '.version_select at 0x7f1ed6324280>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:26.830836 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:26.830836 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:26.832737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-523a17c1-85ea-48aa-a7a6-edab28fa0093 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:26.833401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-523a17c1-85ea-48aa-a7a6-edab28fa0093 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:26.848268 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-523a17c1-85ea-48aa-a7a6-edab28fa0093 tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/os-migrations" status: 200 len: 3072 microversion: 2.1 time: 0.023105 Jan 22 21:05:26.862433 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 868/1810] 10.222.0.100 () {58 vars in 1147 bytes} [Sat Jan 22 21:05:26 2022] GET /compute/v2.1/os-migrations => generated 3072 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:26.865427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2d919c5c-b33d-43a4-b164-ed6a76872a89 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:26.866322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2d919c5c-b33d-43a4-b164-ed6a76872a89 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:26.873341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d919c5c-b33d-43a4-b164-ed6a76872a89 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:26.874214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d919c5c-b33d-43a4-b164-ed6a76872a89 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:26.875252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d919c5c-b33d-43a4-b164-ed6a76872a89 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:26.875979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d919c5c-b33d-43a4-b164-ed6a76872a89 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:26.925874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b1f65baf-7cb3-4822-a500-b41849b0d459 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:26.940609 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b1f65baf-7cb3-4822-a500-b41849b0d459 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1316 microversion: 2.1 time: 0.223052 Jan 22 21:05:26.941896 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 943/1811] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:26 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:26.955044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bd0de5e3-44e6-4a0b-a912-b5c939af036b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:26.956578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bd0de5e3-44e6-4a0b-a912-b5c939af036b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:26.967205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd0de5e3-44e6-4a0b-a912-b5c939af036b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:26.968182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd0de5e3-44e6-4a0b-a912-b5c939af036b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:26.969643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd0de5e3-44e6-4a0b-a912-b5c939af036b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:26.970481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd0de5e3-44e6-4a0b-a912-b5c939af036b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:27.139252 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bd0de5e3-44e6-4a0b-a912-b5c939af036b tempest-LiveMigrationTest-26529045 tempest-LiveMigrationTest-26529045-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1534 microversion: 2.1 time: 0.195460 Jan 22 21:05:27.140431 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 944/1812] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:26 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1534 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:27.149625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-20dba0bb-b31c-491a-b795-7368bbd2a913 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:27.151591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-20dba0bb-b31c-491a-b795-7368bbd2a913 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:27.179626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20dba0bb-b31c-491a-b795-7368bbd2a913 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:27.180140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20dba0bb-b31c-491a-b795-7368bbd2a913 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:27.181011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20dba0bb-b31c-491a-b795-7368bbd2a913 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:27.181466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20dba0bb-b31c-491a-b795-7368bbd2a913 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:27.385610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2d919c5c-b33d-43a4-b164-ed6a76872a89 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:27.395821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2d919c5c-b33d-43a4-b164-ed6a76872a89 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:27.397546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2d919c5c-b33d-43a4-b164-ed6a76872a89 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:27.398945 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2d919c5c-b33d-43a4-b164-ed6a76872a89 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1491 microversion: 2.25 time: 0.537972 Jan 22 21:05:27.399999 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 869/1813] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:26 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1491 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:27.408861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3f0690ac-8205-43ed-b41c-4e5275248bcb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:27.408861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3f0690ac-8205-43ed-b41c-4e5275248bcb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:27.424483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f0690ac-8205-43ed-b41c-4e5275248bcb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:27.425264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f0690ac-8205-43ed-b41c-4e5275248bcb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:27.425661 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-20dba0bb-b31c-491a-b795-7368bbd2a913 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.283172 Jan 22 21:05:27.426419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f0690ac-8205-43ed-b41c-4e5275248bcb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:27.426942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f0690ac-8205-43ed-b41c-4e5275248bcb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:27.427466 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 945/1814] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:27 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:27.445022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c91b3da3-d34f-48a9-b340-ca90c1d2f45d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:27.450319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c91b3da3-d34f-48a9-b340-ca90c1d2f45d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:27.488574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c91b3da3-d34f-48a9-b340-ca90c1d2f45d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:27.489475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c91b3da3-d34f-48a9-b340-ca90c1d2f45d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:27.495574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c91b3da3-d34f-48a9-b340-ca90c1d2f45d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:27.496600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c91b3da3-d34f-48a9-b340-ca90c1d2f45d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:27.563772 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c91b3da3-d34f-48a9-b340-ca90c1d2f45d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.134353 Jan 22 21:05:27.576128 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 946/1815] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:27 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:27.589622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-abf5c7ad-a21b-4ced-bd73-071445d47f00 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:27.590535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-abf5c7ad-a21b-4ced-bd73-071445d47f00 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:27.602160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abf5c7ad-a21b-4ced-bd73-071445d47f00 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:27.602949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abf5c7ad-a21b-4ced-bd73-071445d47f00 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:27.606725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abf5c7ad-a21b-4ced-bd73-071445d47f00 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:27.606725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abf5c7ad-a21b-4ced-bd73-071445d47f00 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:27.644509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-abf5c7ad-a21b-4ced-bd73-071445d47f00 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:05:27.893911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3f0690ac-8205-43ed-b41c-4e5275248bcb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:27.903773 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3f0690ac-8205-43ed-b41c-4e5275248bcb tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1481 microversion: 2.1 time: 0.502268 Jan 22 21:05:27.904374 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 870/1816] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:27 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1481 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:27.921809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f1685f16-359d-4d48-983a-12c7602dc52e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:27.922439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f1685f16-359d-4d48-983a-12c7602dc52e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:27.930627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1685f16-359d-4d48-983a-12c7602dc52e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:27.931092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1685f16-359d-4d48-983a-12c7602dc52e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:27.932749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1685f16-359d-4d48-983a-12c7602dc52e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:27.933215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1685f16-359d-4d48-983a-12c7602dc52e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:28.018196 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-abf5c7ad-a21b-4ced-bd73-071445d47f00 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "DELETE /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 204 len: 0 microversion: 2.1 time: 0.437941 Jan 22 21:05:28.020082 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 947/1817] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:05:27 2022] DELETE /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:28.030677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9426678c-9a8f-4fa0-a531-baad120ebe01 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:28.031398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9426678c-9a8f-4fa0-a531-baad120ebe01 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:28.055072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9426678c-9a8f-4fa0-a531-baad120ebe01 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:28.055855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9426678c-9a8f-4fa0-a531-baad120ebe01 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:28.056932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9426678c-9a8f-4fa0-a531-baad120ebe01 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:28.057610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9426678c-9a8f-4fa0-a531-baad120ebe01 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:28.310890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f1685f16-359d-4d48-983a-12c7602dc52e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:28.324588 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f1685f16-359d-4d48-983a-12c7602dc52e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1327 microversion: 2.1 time: 0.407396 Jan 22 21:05:28.327615 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 871/1818] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:27 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1327 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:28.350789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-61634fd5-7522-4592-8dcd-549b57299270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:28.352179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-61634fd5-7522-4592-8dcd-549b57299270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:28.372842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61634fd5-7522-4592-8dcd-549b57299270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:28.374277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61634fd5-7522-4592-8dcd-549b57299270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:28.378173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61634fd5-7522-4592-8dcd-549b57299270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:28.378173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61634fd5-7522-4592-8dcd-549b57299270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:28.481404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9426678c-9a8f-4fa0-a531-baad120ebe01 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:28.494349 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9426678c-9a8f-4fa0-a531-baad120ebe01 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1316 microversion: 2.1 time: 0.472878 Jan 22 21:05:28.495944 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 948/1819] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:28 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1316 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:28.507249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7fe13717-0383-42eb-b3c1-8d822d86d71d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:28.508242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7fe13717-0383-42eb-b3c1-8d822d86d71d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:28.523614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fe13717-0383-42eb-b3c1-8d822d86d71d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:28.527929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fe13717-0383-42eb-b3c1-8d822d86d71d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:28.527929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fe13717-0383-42eb-b3c1-8d822d86d71d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:28.527929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fe13717-0383-42eb-b3c1-8d822d86d71d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:28.824672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-61634fd5-7522-4592-8dcd-549b57299270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:28.832636 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-61634fd5-7522-4592-8dcd-549b57299270 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1389 microversion: 2.1 time: 0.494761 Jan 22 21:05:28.833222 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 872/1820] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:28 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1389 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:28.846185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b4072579-74b6-4f11-b1bc-34ea9a55d64c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:28.847159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b4072579-74b6-4f11-b1bc-34ea9a55d64c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:28.871116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4072579-74b6-4f11-b1bc-34ea9a55d64c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:28.871116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4072579-74b6-4f11-b1bc-34ea9a55d64c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:28.871116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4072579-74b6-4f11-b1bc-34ea9a55d64c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:28.871116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4072579-74b6-4f11-b1bc-34ea9a55d64c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:28.927976 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b4072579-74b6-4f11-b1bc-34ea9a55d64c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.093445 Jan 22 21:05:28.928858 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 873/1821] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:28 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:28.934514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-e1a9f867-afd7-4bda-96ad-846c652c8997 req-c111e482-0cfe-4daa-84a8-9928c0bda444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "823cc05f-c81f-4858-a129-0ec31b24b72d", "tag": "013ea813-6494-4b47-920d-46a8e54336d3"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:28.938582 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:28.938582 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:28.944734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7fe13717-0383-42eb-b3c1-8d822d86d71d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:28.951479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e1a9f867-afd7-4bda-96ad-846c652c8997 req-c111e482-0cfe-4daa-84a8-9928c0bda444 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:28.951479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e1a9f867-afd7-4bda-96ad-846c652c8997 req-c111e482-0cfe-4daa-84a8-9928c0bda444 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:28.960513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7fe13717-0383-42eb-b3c1-8d822d86d71d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:28.967135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7fe13717-0383-42eb-b3c1-8d822d86d71d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:28.980980 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-e1a9f867-afd7-4bda-96ad-846c652c8997 req-c111e482-0cfe-4daa-84a8-9928c0bda444 service nova] Creating event network-changed:013ea813-6494-4b47-920d-46a8e54336d3 for instance 823cc05f-c81f-4858-a129-0ec31b24b72d on nch2-master-1 Jan 22 21:05:28.986851 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-e1a9f867-afd7-4bda-96ad-846c652c8997 req-c111e482-0cfe-4daa-84a8-9928c0bda444 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056391 Jan 22 21:05:28.987902 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7fe13717-0383-42eb-b3c1-8d822d86d71d tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1481 microversion: 2.25 time: 0.487803 Jan 22 21:05:28.988920 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 874/1822] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:28.989260 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 949/1823] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:28 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1481 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:28.994115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1776a05f-8504-4a0a-8566-0171868a5635 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:28.995482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1776a05f-8504-4a0a-8566-0171868a5635 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:28.999218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-7ba39533-12c0-4f9e-940b-cd6edce0c518 req-044c5697-4bc2-4e1e-a2f4-e54ea4c97d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28df35b-8a9a-4010-aa14-89cc18350ba9", "name": "network-vif-unplugged", "status": "completed", "tag": "e3a1c234-0a19-4371-944f-202cc47a018b"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:29.003184 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:29.003184 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:29.006564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1776a05f-8504-4a0a-8566-0171868a5635 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:29.007235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1776a05f-8504-4a0a-8566-0171868a5635 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:29.008218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1776a05f-8504-4a0a-8566-0171868a5635 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:29.008831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1776a05f-8504-4a0a-8566-0171868a5635 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:29.022779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7ba39533-12c0-4f9e-940b-cd6edce0c518 req-044c5697-4bc2-4e1e-a2f4-e54ea4c97d81 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:29.023526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7ba39533-12c0-4f9e-940b-cd6edce0c518 req-044c5697-4bc2-4e1e-a2f4-e54ea4c97d81 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:29.051656 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-7ba39533-12c0-4f9e-940b-cd6edce0c518 req-044c5697-4bc2-4e1e-a2f4-e54ea4c97d81 service nova] Creating event network-vif-unplugged:e3a1c234-0a19-4371-944f-202cc47a018b for instance b28df35b-8a9a-4010-aa14-89cc18350ba9 on nch1-master-1 Jan 22 21:05:29.056877 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-7ba39533-12c0-4f9e-940b-cd6edce0c518 req-044c5697-4bc2-4e1e-a2f4-e54ea4c97d81 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065563 Jan 22 21:05:29.058541 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 875/1824] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:29.069143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1b3af4bc-c2d3-4324-9a5c-c2af51f0ce42 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:29.070451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1b3af4bc-c2d3-4324-9a5c-c2af51f0ce42 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:29.078204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b3af4bc-c2d3-4324-9a5c-c2af51f0ce42 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:29.078949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b3af4bc-c2d3-4324-9a5c-c2af51f0ce42 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:29.079795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b3af4bc-c2d3-4324-9a5c-c2af51f0ce42 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:29.080446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b3af4bc-c2d3-4324-9a5c-c2af51f0ce42 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:29.098052 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1776a05f-8504-4a0a-8566-0171868a5635 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.107096 Jan 22 21:05:29.100265 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 950/1825] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:28 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:29.131969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-81d65745-f304-4ae1-a02f-63b560fcc4f1 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '.version_select at 0x7f1ed5cf0ca0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:29.134734 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:29.134734 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:29.137369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81d65745-f304-4ae1-a02f-63b560fcc4f1 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:29.143227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81d65745-f304-4ae1-a02f-63b560fcc4f1 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:29.154699 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-81d65745-f304-4ae1-a02f-63b560fcc4f1 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/os-migrations" status: 200 len: 3361 microversion: 2.25 time: 0.043692 Jan 22 21:05:29.156024 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 951/1826] 10.222.0.100 () {60 vars in 1188 bytes} [Sat Jan 22 21:05:29 2022] GET /compute/v2.1/os-migrations => generated 3361 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:29.171502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9e769901-0ea8-4efd-a019-4b4ec7b61e39 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:29.172529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9e769901-0ea8-4efd-a019-4b4ec7b61e39 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:29.181031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e769901-0ea8-4efd-a019-4b4ec7b61e39 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:29.182083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e769901-0ea8-4efd-a019-4b4ec7b61e39 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:29.183183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e769901-0ea8-4efd-a019-4b4ec7b61e39 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:29.183807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e769901-0ea8-4efd-a019-4b4ec7b61e39 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:29.508985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-9e769901-0ea8-4efd-a019-4b4ec7b61e39 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] Lazy-loading 'services' on Instance uuid 64db607b-9a30-4235-909f-39804df2fbf6 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:29.527886 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9e769901-0ea8-4efd-a019-4b4ec7b61e39 tempest-LiveAutoBlockMigrationV225Test-830537647 tempest-LiveAutoBlockMigrationV225Test-830537647-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1974 microversion: 2.25 time: 0.360429 Jan 22 21:05:29.538552 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 952/1827] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:29 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1974 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:05:29.549828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-8f3ba359-c3f8-4dbc-8177-3620e26ef160 req-08e88aee-7820-4858-ae5c-4a1b1eda38ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030", "tag": "241845a7-45d2-443a-a581-ab21d64d2668"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:29.552249 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:29.552249 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:29.572927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8f3ba359-c3f8-4dbc-8177-3620e26ef160 req-08e88aee-7820-4858-ae5c-4a1b1eda38ad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:29.572927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8f3ba359-c3f8-4dbc-8177-3620e26ef160 req-08e88aee-7820-4858-ae5c-4a1b1eda38ad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:29.590751 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-8f3ba359-c3f8-4dbc-8177-3620e26ef160 req-08e88aee-7820-4858-ae5c-4a1b1eda38ad service nova] Creating event network-changed:241845a7-45d2-443a-a581-ab21d64d2668 for instance 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 on nch1-master-1 Jan 22 21:05:29.601371 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-8f3ba359-c3f8-4dbc-8177-3620e26ef160 req-08e88aee-7820-4858-ae5c-4a1b1eda38ad service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060527 Jan 22 21:05:29.602907 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 953/1828] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:29.607242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1b3af4bc-c2d3-4324-9a5c-c2af51f0ce42 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:29.609759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f3cde6b1-4640-4889-8773-7387d2cbfab3 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:29.610471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f3cde6b1-4640-4889-8773-7387d2cbfab3 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:29.627631 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1b3af4bc-c2d3-4324-9a5c-c2af51f0ce42 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1481 microversion: 2.1 time: 0.567682 Jan 22 21:05:29.628661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3cde6b1-4640-4889-8773-7387d2cbfab3 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:29.629645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3cde6b1-4640-4889-8773-7387d2cbfab3 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:29.630519 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 876/1829] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:29 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1481 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:29.631963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3cde6b1-4640-4889-8773-7387d2cbfab3 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:29.634946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3cde6b1-4640-4889-8773-7387d2cbfab3 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:29.637294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d609ce8e-5863-47d4-8372-818ce26a8732 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:29.638725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d609ce8e-5863-47d4-8372-818ce26a8732 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:29.647122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d609ce8e-5863-47d4-8372-818ce26a8732 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:29.647981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d609ce8e-5863-47d4-8372-818ce26a8732 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:29.649034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d609ce8e-5863-47d4-8372-818ce26a8732 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:29.649753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d609ce8e-5863-47d4-8372-818ce26a8732 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:29.944512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f3cde6b1-4640-4889-8773-7387d2cbfab3 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:29.956343 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f3cde6b1-4640-4889-8773-7387d2cbfab3 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 200 len: 1519 microversion: 2.1 time: 0.348310 Jan 22 21:05:29.956343 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 954/1830] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:29 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 1519 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:29.960136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:29.960703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:29.984465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:29.984715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:29.985436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:29.986063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:30.038644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:05:30.178553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d609ce8e-5863-47d4-8372-818ce26a8732 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:30.198653 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d609ce8e-5863-47d4-8372-818ce26a8732 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1316 microversion: 2.1 time: 0.561264 Jan 22 21:05:30.206363 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 877/1831] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:29 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1316 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:30.207742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7563e7bf-f597-4590-98c8-3837196f0ffc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:30.208684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7563e7bf-f597-4590-98c8-3837196f0ffc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:30.217668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7563e7bf-f597-4590-98c8-3837196f0ffc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:30.218608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7563e7bf-f597-4590-98c8-3837196f0ffc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:30.219629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7563e7bf-f597-4590-98c8-3837196f0ffc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:30.220422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7563e7bf-f597-4590-98c8-3837196f0ffc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:30.474971 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3dfe91d6-589f-4387-8a31-cb7df84ffdf1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "DELETE /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 204 len: 0 microversion: 2.25 time: 0.518551 Jan 22 21:05:30.476230 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 955/1832] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:05:29 2022] DELETE /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:05:30.485942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-58f64828-853d-407b-b8e8-033754b3df73 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:30.487272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-58f64828-853d-407b-b8e8-033754b3df73 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:30.508765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58f64828-853d-407b-b8e8-033754b3df73 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:30.509228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58f64828-853d-407b-b8e8-033754b3df73 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:30.510133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58f64828-853d-407b-b8e8-033754b3df73 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:30.512214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58f64828-853d-407b-b8e8-033754b3df73 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:30.575353 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-58f64828-853d-407b-b8e8-033754b3df73 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.097365 Jan 22 21:05:30.579842 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 956/1833] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:30 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:30.597335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-185e7ddc-b96f-4d99-92a5-0c41964ff3e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:30.598137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-185e7ddc-b96f-4d99-92a5-0c41964ff3e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: f4ae3f7e-0253-473f-8066-2b295fbcbbd1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:30.611919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-185e7ddc-b96f-4d99-92a5-0c41964ff3e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:30.616922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-185e7ddc-b96f-4d99-92a5-0c41964ff3e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:30.616922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-185e7ddc-b96f-4d99-92a5-0c41964ff3e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:30.616922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-185e7ddc-b96f-4d99-92a5-0c41964ff3e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:31.115969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-185e7ddc-b96f-4d99-92a5-0c41964ff3e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:31.163988 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-185e7ddc-b96f-4d99-92a5-0c41964ff3e0 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/f4ae3f7e-0253-473f-8066-2b295fbcbbd1" status: 200 len: 1519 microversion: 2.1 time: 0.553659 Jan 22 21:05:31.165152 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 957/1834] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:30 2022] GET /compute/v2.1/servers/f4ae3f7e-0253-473f-8066-2b295fbcbbd1 => generated 1519 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:31.173300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-20d463f3-5dc4-4d3c-a170-ad0eb6d507c1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:31.174597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-20d463f3-5dc4-4d3c-a170-ad0eb6d507c1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:31.184303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20d463f3-5dc4-4d3c-a170-ad0eb6d507c1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:31.184766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20d463f3-5dc4-4d3c-a170-ad0eb6d507c1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:31.185878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20d463f3-5dc4-4d3c-a170-ad0eb6d507c1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:31.186490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20d463f3-5dc4-4d3c-a170-ad0eb6d507c1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:31.247306 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-20d463f3-5dc4-4d3c-a170-ad0eb6d507c1 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.079626 Jan 22 21:05:31.250801 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 958/1835] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:31 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:31.263582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2a0a8fa4-d7ad-420c-8667-ae51efc167e9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:31.264479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2a0a8fa4-d7ad-420c-8667-ae51efc167e9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:31.288680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a0a8fa4-d7ad-420c-8667-ae51efc167e9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:31.289821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a0a8fa4-d7ad-420c-8667-ae51efc167e9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:31.290905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a0a8fa4-d7ad-420c-8667-ae51efc167e9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:31.292351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a0a8fa4-d7ad-420c-8667-ae51efc167e9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:31.305069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7563e7bf-f597-4590-98c8-3837196f0ffc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:31.318146 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7563e7bf-f597-4590-98c8-3837196f0ffc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1389 microversion: 2.1 time: 1.117315 Jan 22 21:05:31.319092 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 878/1836] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:30 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1389 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:31.324496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3637db2f-06d7-4376-a7b3-aef052738e8b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:31.338601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3637db2f-06d7-4376-a7b3-aef052738e8b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:31.346747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3637db2f-06d7-4376-a7b3-aef052738e8b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:31.348311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3637db2f-06d7-4376-a7b3-aef052738e8b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:31.349803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3637db2f-06d7-4376-a7b3-aef052738e8b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:31.350437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3637db2f-06d7-4376-a7b3-aef052738e8b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:31.520136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2a0a8fa4-d7ad-420c-8667-ae51efc167e9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:31.531015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2a0a8fa4-d7ad-420c-8667-ae51efc167e9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:31.532867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2a0a8fa4-d7ad-420c-8667-ae51efc167e9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:31.534470 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2a0a8fa4-d7ad-420c-8667-ae51efc167e9 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1487 microversion: 2.25 time: 0.281932 Jan 22 21:05:31.545086 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 959/1837] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:31 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1487 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:31.545086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-68eeb0d3-877c-4691-a342-88907231865a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:31.545086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-68eeb0d3-877c-4691-a342-88907231865a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:31.547404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-68eeb0d3-877c-4691-a342-88907231865a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:31.547404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-68eeb0d3-877c-4691-a342-88907231865a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:31.548098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-68eeb0d3-877c-4691-a342-88907231865a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:31.548547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-68eeb0d3-877c-4691-a342-88907231865a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:31.717526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-68eeb0d3-877c-4691-a342-88907231865a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:31.731351 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-68eeb0d3-877c-4691-a342-88907231865a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89" status: 200 len: 1520 microversion: 2.1 time: 0.195182 Jan 22 21:05:31.733681 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 960/1838] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:31 2022] GET /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:31.755085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e79f34a-9f2d-432a-ac72-f97b74d79ee9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:31.755713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e79f34a-9f2d-432a-ac72-f97b74d79ee9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:31.762554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e79f34a-9f2d-432a-ac72-f97b74d79ee9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:31.763019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e79f34a-9f2d-432a-ac72-f97b74d79ee9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:31.763836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e79f34a-9f2d-432a-ac72-f97b74d79ee9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:31.764295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e79f34a-9f2d-432a-ac72-f97b74d79ee9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:31.902433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3637db2f-06d7-4376-a7b3-aef052738e8b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:31.911545 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3637db2f-06d7-4376-a7b3-aef052738e8b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1481 microversion: 2.1 time: 0.591157 Jan 22 21:05:31.925208 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 879/1839] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:31 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1481 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:31.937458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f1d1c082-81b7-4968-8ddd-11638a3f9312 req-ebdd4355-7295-4286-8477-46966f159873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28df35b-8a9a-4010-aa14-89cc18350ba9", "name": "network-vif-plugged", "status": "completed", "tag": "e3a1c234-0a19-4371-944f-202cc47a018b"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:31.939105 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:31.939105 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:31.947301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f1d1c082-81b7-4968-8ddd-11638a3f9312 req-ebdd4355-7295-4286-8477-46966f159873 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:31.948333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f1d1c082-81b7-4968-8ddd-11638a3f9312 req-ebdd4355-7295-4286-8477-46966f159873 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:31.973380 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f1d1c082-81b7-4968-8ddd-11638a3f9312 req-ebdd4355-7295-4286-8477-46966f159873 service nova] Creating event network-vif-plugged:e3a1c234-0a19-4371-944f-202cc47a018b for instance b28df35b-8a9a-4010-aa14-89cc18350ba9 on nch1-master-1 Jan 22 21:05:31.979271 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f1d1c082-81b7-4968-8ddd-11638a3f9312 req-ebdd4355-7295-4286-8477-46966f159873 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049083 Jan 22 21:05:31.980611 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 880/1840] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:31.986285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4633de5f-3f84-4942-b1b0-c325479d00d9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:31.987559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4633de5f-3f84-4942-b1b0-c325479d00d9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:32.003013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5e79f34a-9f2d-432a-ac72-f97b74d79ee9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:32.016693 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e79f34a-9f2d-432a-ac72-f97b74d79ee9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1316 microversion: 2.1 time: 0.283519 Jan 22 21:05:32.021049 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 961/1841] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:31 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:32.021854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4633de5f-3f84-4942-b1b0-c325479d00d9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:32.022406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4633de5f-3f84-4942-b1b0-c325479d00d9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:32.023304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4633de5f-3f84-4942-b1b0-c325479d00d9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:32.023822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4633de5f-3f84-4942-b1b0-c325479d00d9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:32.037765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fe8c51d8-f83b-49d4-9edb-5502dcb43a52 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:32.040859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fe8c51d8-f83b-49d4-9edb-5502dcb43a52 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:32.067133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe8c51d8-f83b-49d4-9edb-5502dcb43a52 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:32.067421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe8c51d8-f83b-49d4-9edb-5502dcb43a52 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:32.068518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe8c51d8-f83b-49d4-9edb-5502dcb43a52 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:32.068965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe8c51d8-f83b-49d4-9edb-5502dcb43a52 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:32.090128 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4633de5f-3f84-4942-b1b0-c325479d00d9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.108033 Jan 22 21:05:32.090818 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 881/1842] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:31 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:32.120750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fe8c51d8-f83b-49d4-9edb-5502dcb43a52 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:05:32.278565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3fac273b-7340-4766-adef-d3104317f229 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:32.283323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3fac273b-7340-4766-adef-d3104317f229 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:32.300374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fac273b-7340-4766-adef-d3104317f229 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:32.301531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fac273b-7340-4766-adef-d3104317f229 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:32.302395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fac273b-7340-4766-adef-d3104317f229 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:32.303022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fac273b-7340-4766-adef-d3104317f229 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:32.354493 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3fac273b-7340-4766-adef-d3104317f229 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.090335 Jan 22 21:05:32.356575 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 882/1843] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:32 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:32.362573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48f5617f-0587-45f0-beeb-8adccab1b28e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:32.366227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48f5617f-0587-45f0-beeb-8adccab1b28e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:32.373268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48f5617f-0587-45f0-beeb-8adccab1b28e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:32.374068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48f5617f-0587-45f0-beeb-8adccab1b28e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:32.375212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48f5617f-0587-45f0-beeb-8adccab1b28e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:32.375882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48f5617f-0587-45f0-beeb-8adccab1b28e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:32.526675 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fe8c51d8-f83b-49d4-9edb-5502dcb43a52 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "DELETE /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89" status: 204 len: 0 microversion: 2.1 time: 0.503743 Jan 22 21:05:32.530757 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 962/1844] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:05:32 2022] DELETE /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:32.536348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-48f5617f-0587-45f0-beeb-8adccab1b28e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:32.557784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-60c9e77f-523b-4428-8395-5fc84814bdb2 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:32.557784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-60c9e77f-523b-4428-8395-5fc84814bdb2 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:32.564716 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48f5617f-0587-45f0-beeb-8adccab1b28e tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1347 microversion: 2.1 time: 0.206637 Jan 22 21:05:32.568699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-60c9e77f-523b-4428-8395-5fc84814bdb2 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:32.570265 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 883/1845] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:32 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1347 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:32.572594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-60c9e77f-523b-4428-8395-5fc84814bdb2 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:32.577551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-60c9e77f-523b-4428-8395-5fc84814bdb2 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:32.579157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-60c9e77f-523b-4428-8395-5fc84814bdb2 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:32.581890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-42c23476-db6e-46db-a412-933ee848a7d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:32.586410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-42c23476-db6e-46db-a412-933ee848a7d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:32.599019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42c23476-db6e-46db-a412-933ee848a7d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:32.599601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42c23476-db6e-46db-a412-933ee848a7d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:32.600686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42c23476-db6e-46db-a412-933ee848a7d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:32.601370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42c23476-db6e-46db-a412-933ee848a7d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:32.780389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-60c9e77f-523b-4428-8395-5fc84814bdb2 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:32.798580 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-60c9e77f-523b-4428-8395-5fc84814bdb2 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89" status: 200 len: 1526 microversion: 2.1 time: 0.266232 Jan 22 21:05:32.799836 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 963/1846] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:32 2022] GET /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 => generated 1526 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:32.818707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-b4d691ab-c59c-43dd-ba84-bbc72ad9561c req-ba181ded-4367-4d60-a2d8-8f7852be49c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030", "name": "network-vif-deleted", "tag": "241845a7-45d2-443a-a581-ab21d64d2668"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:32.820281 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:32.820281 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:32.836402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b4d691ab-c59c-43dd-ba84-bbc72ad9561c req-ba181ded-4367-4d60-a2d8-8f7852be49c0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:32.841126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b4d691ab-c59c-43dd-ba84-bbc72ad9561c req-ba181ded-4367-4d60-a2d8-8f7852be49c0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:32.860388 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-b4d691ab-c59c-43dd-ba84-bbc72ad9561c req-ba181ded-4367-4d60-a2d8-8f7852be49c0 service nova] Creating event network-vif-deleted:241845a7-45d2-443a-a581-ab21d64d2668 for instance 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 on nch1-master-1 Jan 22 21:05:32.871330 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-b4d691ab-c59c-43dd-ba84-bbc72ad9561c req-ba181ded-4367-4d60-a2d8-8f7852be49c0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069874 Jan 22 21:05:32.872255 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 964/1847] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:32.928590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f2da7ff4-8fae-4662-8dbc-c6194dd9f5e6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:32.930041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f2da7ff4-8fae-4662-8dbc-c6194dd9f5e6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:32.937021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2da7ff4-8fae-4662-8dbc-c6194dd9f5e6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:32.938433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2da7ff4-8fae-4662-8dbc-c6194dd9f5e6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:32.939489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2da7ff4-8fae-4662-8dbc-c6194dd9f5e6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:32.940150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2da7ff4-8fae-4662-8dbc-c6194dd9f5e6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:33.130583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-42c23476-db6e-46db-a412-933ee848a7d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:33.143175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-42c23476-db6e-46db-a412-933ee848a7d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:33.149042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-42c23476-db6e-46db-a412-933ee848a7d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:33.151236 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-42c23476-db6e-46db-a412-933ee848a7d1 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1487 microversion: 2.25 time: 0.578693 Jan 22 21:05:33.158554 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 884/1848] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:32 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1487 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:33.165552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7587c9e7-eba2-4e66-8a7f-20c50631d5b6 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:33.166740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7587c9e7-eba2-4e66-8a7f-20c50631d5b6 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:33.177677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7587c9e7-eba2-4e66-8a7f-20c50631d5b6 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:33.177816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f2da7ff4-8fae-4662-8dbc-c6194dd9f5e6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:33.178197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7587c9e7-eba2-4e66-8a7f-20c50631d5b6 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:33.179362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7587c9e7-eba2-4e66-8a7f-20c50631d5b6 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:33.179814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7587c9e7-eba2-4e66-8a7f-20c50631d5b6 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:33.187897 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f2da7ff4-8fae-4662-8dbc-c6194dd9f5e6 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1481 microversion: 2.1 time: 0.262083 Jan 22 21:05:33.189000 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 965/1849] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:32 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1481 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:33.195326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eb555d7b-3d92-4f36-a54b-b2ec61267cad tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:33.196624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eb555d7b-3d92-4f36-a54b-b2ec61267cad tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:33.205970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb555d7b-3d92-4f36-a54b-b2ec61267cad tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:33.206806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb555d7b-3d92-4f36-a54b-b2ec61267cad tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:33.207904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb555d7b-3d92-4f36-a54b-b2ec61267cad tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:33.208546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb555d7b-3d92-4f36-a54b-b2ec61267cad tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:33.269944 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eb555d7b-3d92-4f36-a54b-b2ec61267cad tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.078885 Jan 22 21:05:33.274610 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 966/1850] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:33 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:33.370835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-697010e2-cab8-4c45-b18e-6f8960e633ec tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:33.373642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-697010e2-cab8-4c45-b18e-6f8960e633ec tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:33.380388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-697010e2-cab8-4c45-b18e-6f8960e633ec tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:33.380388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-697010e2-cab8-4c45-b18e-6f8960e633ec tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:33.381283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-697010e2-cab8-4c45-b18e-6f8960e633ec tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:33.381855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-697010e2-cab8-4c45-b18e-6f8960e633ec tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:33.434120 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-697010e2-cab8-4c45-b18e-6f8960e633ec tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.068216 Jan 22 21:05:33.435876 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 967/1851] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:33 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:33.586497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a2375a1c-734d-44ad-8217-31a885cf08cc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:33.587473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a2375a1c-734d-44ad-8217-31a885cf08cc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:33.598557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2375a1c-734d-44ad-8217-31a885cf08cc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:33.599351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2375a1c-734d-44ad-8217-31a885cf08cc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:33.600102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2375a1c-734d-44ad-8217-31a885cf08cc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:33.600470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2375a1c-734d-44ad-8217-31a885cf08cc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:33.636033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7587c9e7-eba2-4e66-8a7f-20c50631d5b6 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:33.644408 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7587c9e7-eba2-4e66-8a7f-20c50631d5b6 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1316 microversion: 2.1 time: 0.484364 Jan 22 21:05:33.645218 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 885/1852] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:33 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:33.649477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2375a1c-734d-44ad-8217-31a885cf08cc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:33.649980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2375a1c-734d-44ad-8217-31a885cf08cc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:33.651094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-a2375a1c-734d-44ad-8217-31a885cf08cc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lazy-loading 'fault' on Instance uuid 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:33.699212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a2375a1c-734d-44ad-8217-31a885cf08cc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:33.709796 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a2375a1c-734d-44ad-8217-31a885cf08cc tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 200 len: 1190 microversion: 2.1 time: 0.127293 Jan 22 21:05:33.710687 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 968/1853] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:33 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 1190 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:33.816318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6d1bfc6d-5c58-4f35-b5bb-6ade28ad3ae6 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:33.816930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6d1bfc6d-5c58-4f35-b5bb-6ade28ad3ae6 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:33.830666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d1bfc6d-5c58-4f35-b5bb-6ade28ad3ae6 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:33.831334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d1bfc6d-5c58-4f35-b5bb-6ade28ad3ae6 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:33.832833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d1bfc6d-5c58-4f35-b5bb-6ade28ad3ae6 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:33.833433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d1bfc6d-5c58-4f35-b5bb-6ade28ad3ae6 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:34.124615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6d1bfc6d-5c58-4f35-b5bb-6ade28ad3ae6 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:34.133458 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6d1bfc6d-5c58-4f35-b5bb-6ade28ad3ae6 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89" status: 200 len: 1526 microversion: 2.1 time: 0.321122 Jan 22 21:05:34.137928 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 886/1854] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:33 2022] GET /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 => generated 1526 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:34.177603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad27505d-bd66-4cea-a2f6-b8407f73b7e2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:34.178716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad27505d-bd66-4cea-a2f6-b8407f73b7e2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:34.187466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad27505d-bd66-4cea-a2f6-b8407f73b7e2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:34.188212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad27505d-bd66-4cea-a2f6-b8407f73b7e2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:34.189060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad27505d-bd66-4cea-a2f6-b8407f73b7e2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:34.189533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad27505d-bd66-4cea-a2f6-b8407f73b7e2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:34.207525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b538b4f2-3656-45aa-a074-f3e8b3a8da7b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:34.209932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b538b4f2-3656-45aa-a074-f3e8b3a8da7b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:34.222068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b538b4f2-3656-45aa-a074-f3e8b3a8da7b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:34.222649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b538b4f2-3656-45aa-a074-f3e8b3a8da7b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:34.226820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b538b4f2-3656-45aa-a074-f3e8b3a8da7b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:34.226820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b538b4f2-3656-45aa-a074-f3e8b3a8da7b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:34.441839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ad27505d-bd66-4cea-a2f6-b8407f73b7e2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:34.454788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ad27505d-bd66-4cea-a2f6-b8407f73b7e2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:34.456388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ad27505d-bd66-4cea-a2f6-b8407f73b7e2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:34.457644 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad27505d-bd66-4cea-a2f6-b8407f73b7e2 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1445 microversion: 2.25 time: 0.284596 Jan 22 21:05:34.469617 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 969/1855] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:34 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1445 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:34.469617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fdc9c31b-9fbf-498b-bc5d-63cf7266fd37 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:34.469617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fdc9c31b-9fbf-498b-bc5d-63cf7266fd37 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:34.492406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdc9c31b-9fbf-498b-bc5d-63cf7266fd37 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:34.493696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdc9c31b-9fbf-498b-bc5d-63cf7266fd37 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:34.498325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdc9c31b-9fbf-498b-bc5d-63cf7266fd37 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:34.499145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdc9c31b-9fbf-498b-bc5d-63cf7266fd37 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:34.556446 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fdc9c31b-9fbf-498b-bc5d-63cf7266fd37 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.091753 Jan 22 21:05:34.557923 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 970/1856] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:34 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:34.578372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f27a049f-5723-4ce4-aed9-6f3eb47c5c97 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:34.580453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f27a049f-5723-4ce4-aed9-6f3eb47c5c97 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:34.590920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f27a049f-5723-4ce4-aed9-6f3eb47c5c97 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:34.591887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f27a049f-5723-4ce4-aed9-6f3eb47c5c97 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:34.592477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f27a049f-5723-4ce4-aed9-6f3eb47c5c97 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:34.593023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f27a049f-5723-4ce4-aed9-6f3eb47c5c97 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:34.668289 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f27a049f-5723-4ce4-aed9-6f3eb47c5c97 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.104259 Jan 22 21:05:34.672325 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 971/1857] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:34 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:34.682245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e8b31e2c-05f2-4ef0-bcf8-cb5e99c82336 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:34.684970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e8b31e2c-05f2-4ef0-bcf8-cb5e99c82336 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:34.701961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8b31e2c-05f2-4ef0-bcf8-cb5e99c82336 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:34.702519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8b31e2c-05f2-4ef0-bcf8-cb5e99c82336 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:34.704828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8b31e2c-05f2-4ef0-bcf8-cb5e99c82336 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:34.704828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8b31e2c-05f2-4ef0-bcf8-cb5e99c82336 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:34.965901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e8b31e2c-05f2-4ef0-bcf8-cb5e99c82336 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:34.978298 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e8b31e2c-05f2-4ef0-bcf8-cb5e99c82336 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1316 microversion: 2.1 time: 0.307433 Jan 22 21:05:34.979661 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 972/1858] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:34 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:34.998052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2ee82214-c086-41f3-8440-f27afb9849e6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:34.998820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2ee82214-c086-41f3-8440-f27afb9849e6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:35.018895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ee82214-c086-41f3-8440-f27afb9849e6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.026114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ee82214-c086-41f3-8440-f27afb9849e6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.034749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ee82214-c086-41f3-8440-f27afb9849e6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.035312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ee82214-c086-41f3-8440-f27afb9849e6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.062699 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-2ee82214-c086-41f3-8440-f27afb9849e6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] HTTP exception thrown: Instance 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 could not be found. Jan 22 21:05:35.063416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2ee82214-c086-41f3-8440-f27afb9849e6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Returning 404 to user: Instance 2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:35.064388 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2ee82214-c086-41f3-8440-f27afb9849e6 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030" status: 404 len: 111 microversion: 2.1 time: 0.083779 Jan 22 21:05:35.069599 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 973/1859] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:34 2022] GET /compute/v2.1/servers/2c5d2be2-d69d-4eb1-b2c6-b926e8eb7030 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:35.077968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-960e11e3-d794-40b0-8053-ae15df91c360 req-eb673e7e-e444-4943-a153-452883b9869e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64db607b-9a30-4235-909f-39804df2fbf6", "name": "network-vif-deleted", "tag": "6fc53fa7-f259-415f-b5ea-1e505f4d2810"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:35.080202 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:35.080202 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:35.098362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b538b4f2-3656-45aa-a074-f3e8b3a8da7b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:35.099125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-960e11e3-d794-40b0-8053-ae15df91c360 req-eb673e7e-e444-4943-a153-452883b9869e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.101325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-960e11e3-d794-40b0-8053-ae15df91c360 req-eb673e7e-e444-4943-a153-452883b9869e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.111808 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b538b4f2-3656-45aa-a074-f3e8b3a8da7b tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1466 microversion: 2.1 time: 0.907241 Jan 22 21:05:35.116579 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 887/1860] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:34 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1466 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:35.140433 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-960e11e3-d794-40b0-8053-ae15df91c360 req-eb673e7e-e444-4943-a153-452883b9869e service nova] Creating event network-vif-deleted:6fc53fa7-f259-415f-b5ea-1e505f4d2810 for instance 64db607b-9a30-4235-909f-39804df2fbf6 on nch2-master-1 Jan 22 21:05:35.142713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d3c7e367-e856-4cca-b88e-10aec5a03d29 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:35.143901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d3c7e367-e856-4cca-b88e-10aec5a03d29 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:35.145463 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-960e11e3-d794-40b0-8053-ae15df91c360 req-eb673e7e-e444-4943-a153-452883b9869e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077816 Jan 22 21:05:35.146815 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 974/1861] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:35.154867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ae6563a-f6c5-4deb-89dd-8f2e4921ee89 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:35.156725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1ae6563a-f6c5-4deb-89dd-8f2e4921ee89 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:35.160036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3c7e367-e856-4cca-b88e-10aec5a03d29 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.162153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3c7e367-e856-4cca-b88e-10aec5a03d29 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.162595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ae6563a-f6c5-4deb-89dd-8f2e4921ee89 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.163052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ae6563a-f6c5-4deb-89dd-8f2e4921ee89 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.163855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ae6563a-f6c5-4deb-89dd-8f2e4921ee89 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.164457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ae6563a-f6c5-4deb-89dd-8f2e4921ee89 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.166543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3c7e367-e856-4cca-b88e-10aec5a03d29 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.168813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3c7e367-e856-4cca-b88e-10aec5a03d29 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.424933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1ae6563a-f6c5-4deb-89dd-8f2e4921ee89 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:35.450070 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ae6563a-f6c5-4deb-89dd-8f2e4921ee89 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89" status: 200 len: 1526 microversion: 2.1 time: 0.299799 Jan 22 21:05:35.459322 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 975/1862] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:35 2022] GET /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 => generated 1526 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:35.477809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e659b41-5f50-4dc7-b5af-63e8ff938e76 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:35.479137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e659b41-5f50-4dc7-b5af-63e8ff938e76 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:35.492842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e659b41-5f50-4dc7-b5af-63e8ff938e76 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.493638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e659b41-5f50-4dc7-b5af-63e8ff938e76 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.499002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e659b41-5f50-4dc7-b5af-63e8ff938e76 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.499729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e659b41-5f50-4dc7-b5af-63e8ff938e76 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.520237 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d3c7e367-e856-4cca-b88e-10aec5a03d29 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9/action" status: 202 len: 0 microversion: 2.1 time: 0.381234 Jan 22 21:05:35.522474 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 888/1863] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:35 2022] POST /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:05:35.537101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4e3739af-8479-4d59-a8c1-b1379726d2a0 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:35.539756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4e3739af-8479-4d59-a8c1-b1379726d2a0 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:35.552085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e3739af-8479-4d59-a8c1-b1379726d2a0 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.555367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e3739af-8479-4d59-a8c1-b1379726d2a0 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.556606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e3739af-8479-4d59-a8c1-b1379726d2a0 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.558892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e3739af-8479-4d59-a8c1-b1379726d2a0 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.569808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e659b41-5f50-4dc7-b5af-63e8ff938e76 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.570069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e659b41-5f50-4dc7-b5af-63e8ff938e76 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.570577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-5e659b41-5f50-4dc7-b5af-63e8ff938e76 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lazy-loading 'fault' on Instance uuid 64db607b-9a30-4235-909f-39804df2fbf6 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:35.660658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e3739af-8479-4d59-a8c1-b1379726d2a0 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.661355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e3739af-8479-4d59-a8c1-b1379726d2a0 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.662087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-4e3739af-8479-4d59-a8c1-b1379726d2a0 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lazy-loading 'fault' on Instance uuid b28df35b-8a9a-4010-aa14-89cc18350ba9 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:35.742676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5e659b41-5f50-4dc7-b5af-63e8ff938e76 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:35.754030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5e659b41-5f50-4dc7-b5af-63e8ff938e76 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:35.756510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5e659b41-5f50-4dc7-b5af-63e8ff938e76 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:35.758446 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e659b41-5f50-4dc7-b5af-63e8ff938e76 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 200 len: 1353 microversion: 2.25 time: 0.284824 Jan 22 21:05:35.761049 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 976/1864] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:35 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 1353 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:35.766490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2e6d25a0-ce12-406e-bd3d-9e7563416d90 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:35.767763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2e6d25a0-ce12-406e-bd3d-9e7563416d90 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:35.777573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e6d25a0-ce12-406e-bd3d-9e7563416d90 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.778187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e6d25a0-ce12-406e-bd3d-9e7563416d90 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.779355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e6d25a0-ce12-406e-bd3d-9e7563416d90 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.779869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e6d25a0-ce12-406e-bd3d-9e7563416d90 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.834442 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4e3739af-8479-4d59-a8c1-b1379726d2a0 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1600 microversion: 2.1 time: 0.302953 Jan 22 21:05:35.835874 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 889/1865] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:35 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1600 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:35.842560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-47753e69-441a-4fc8-9af3-69f512f09e14 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:35.843759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-47753e69-441a-4fc8-9af3-69f512f09e14 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:35.854321 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2e6d25a0-ce12-406e-bd3d-9e7563416d90 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.091152 Jan 22 21:05:35.860148 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 977/1866] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:35 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:35.864096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47753e69-441a-4fc8-9af3-69f512f09e14 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.864799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47753e69-441a-4fc8-9af3-69f512f09e14 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.865856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47753e69-441a-4fc8-9af3-69f512f09e14 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.866419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47753e69-441a-4fc8-9af3-69f512f09e14 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.877791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8962194e-fd37-4b55-9327-ae5131654b67 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:35.878909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8962194e-fd37-4b55-9327-ae5131654b67 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:35.899359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8962194e-fd37-4b55-9327-ae5131654b67 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.901114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8962194e-fd37-4b55-9327-ae5131654b67 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.902193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8962194e-fd37-4b55-9327-ae5131654b67 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:35.902819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8962194e-fd37-4b55-9327-ae5131654b67 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:35.914391 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-47753e69-441a-4fc8-9af3-69f512f09e14 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.076886 Jan 22 21:05:35.916705 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 890/1867] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:35 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:35.999030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-acb102e5-b3b9-4631-9eda-1ca4105680b2 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:36.000051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-acb102e5-b3b9-4631-9eda-1ca4105680b2 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:36.009088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acb102e5-b3b9-4631-9eda-1ca4105680b2 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:36.016734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acb102e5-b3b9-4631-9eda-1ca4105680b2 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:36.016734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acb102e5-b3b9-4631-9eda-1ca4105680b2 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:36.016734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acb102e5-b3b9-4631-9eda-1ca4105680b2 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:36.204729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-acb102e5-b3b9-4631-9eda-1ca4105680b2 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:36.216712 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-acb102e5-b3b9-4631-9eda-1ca4105680b2 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1316 microversion: 2.1 time: 0.223738 Jan 22 21:05:36.217332 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 891/1868] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:35 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:36.352494 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8962194e-fd37-4b55-9327-ae5131654b67 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9/action" status: 202 len: 0 microversion: 2.1 time: 0.489829 Jan 22 21:05:36.353168 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 978/1869] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:35 2022] POST /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:05:36.362258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-94e1e3f0-14eb-4dbe-b9c6-98dc9f514da7 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:36.362883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-94e1e3f0-14eb-4dbe-b9c6-98dc9f514da7 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:36.372136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94e1e3f0-14eb-4dbe-b9c6-98dc9f514da7 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:36.372592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94e1e3f0-14eb-4dbe-b9c6-98dc9f514da7 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:36.373486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94e1e3f0-14eb-4dbe-b9c6-98dc9f514da7 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:36.373978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94e1e3f0-14eb-4dbe-b9c6-98dc9f514da7 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:36.470024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6d07768f-e1cc-472d-90ba-877afe87da88 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:36.470901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6d07768f-e1cc-472d-90ba-877afe87da88 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:36.477807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d07768f-e1cc-472d-90ba-877afe87da88 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:36.479037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d07768f-e1cc-472d-90ba-877afe87da88 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:36.480359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d07768f-e1cc-472d-90ba-877afe87da88 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:36.481053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d07768f-e1cc-472d-90ba-877afe87da88 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:36.522099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d07768f-e1cc-472d-90ba-877afe87da88 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:36.522557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d07768f-e1cc-472d-90ba-877afe87da88 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:36.523014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-6d07768f-e1cc-472d-90ba-877afe87da88 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lazy-loading 'fault' on Instance uuid 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:36.558217 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-94e1e3f0-14eb-4dbe-b9c6-98dc9f514da7 tempest-ServersAdminTestJSON-376662696 tempest-ServersAdminTestJSON-376662696-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1617 microversion: 2.1 time: 0.199803 Jan 22 21:05:36.569825 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 892/1870] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:36 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1617 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:36.580171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-700bea1a-e6cb-48b0-bc21-51fb59bc88c1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:36.580750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-700bea1a-e6cb-48b0-bc21-51fb59bc88c1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:36.587560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6d07768f-e1cc-472d-90ba-877afe87da88 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:36.599922 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6d07768f-e1cc-472d-90ba-877afe87da88 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89" status: 200 len: 1317 microversion: 2.1 time: 0.133093 Jan 22 21:05:36.600421 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 979/1871] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:36 2022] GET /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:36.611161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-700bea1a-e6cb-48b0-bc21-51fb59bc88c1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:36.611630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-700bea1a-e6cb-48b0-bc21-51fb59bc88c1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:36.612461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-700bea1a-e6cb-48b0-bc21-51fb59bc88c1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:36.612916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-700bea1a-e6cb-48b0-bc21-51fb59bc88c1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:36.641643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-700bea1a-e6cb-48b0-bc21-51fb59bc88c1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:05:36.791477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9166eb7f-af05-4039-8f1d-319e664b2ad6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:36.798003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9166eb7f-af05-4039-8f1d-319e664b2ad6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 64db607b-9a30-4235-909f-39804df2fbf6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:36.809903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9166eb7f-af05-4039-8f1d-319e664b2ad6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:36.810530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9166eb7f-af05-4039-8f1d-319e664b2ad6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:36.811441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9166eb7f-af05-4039-8f1d-319e664b2ad6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:36.811993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9166eb7f-af05-4039-8f1d-319e664b2ad6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:36.861821 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-9166eb7f-af05-4039-8f1d-319e664b2ad6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] HTTP exception thrown: Instance 64db607b-9a30-4235-909f-39804df2fbf6 could not be found. Jan 22 21:05:36.863015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9166eb7f-af05-4039-8f1d-319e664b2ad6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Returning 404 to user: Instance 64db607b-9a30-4235-909f-39804df2fbf6 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:36.864252 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9166eb7f-af05-4039-8f1d-319e664b2ad6 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6" status: 404 len: 111 microversion: 2.25 time: 0.088680 Jan 22 21:05:36.865196 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 980/1872] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:36 2022] GET /compute/v2.1/servers/64db607b-9a30-4235-909f-39804df2fbf6 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:05:36.881120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f996384c-c34a-4e38-95d8-4ff736be826d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:36.889601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f996384c-c34a-4e38-95d8-4ff736be826d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:36.897863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f996384c-c34a-4e38-95d8-4ff736be826d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:36.898575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f996384c-c34a-4e38-95d8-4ff736be826d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:36.899589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f996384c-c34a-4e38-95d8-4ff736be826d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:36.901004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f996384c-c34a-4e38-95d8-4ff736be826d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:36.955510 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f996384c-c34a-4e38-95d8-4ff736be826d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.079464 Jan 22 21:05:36.956178 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 981/1873] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:36 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:36.966459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-30fccdc3-1b55-4163-ba4c-957dbd3bf24d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:36.967475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-30fccdc3-1b55-4163-ba4c-957dbd3bf24d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:36.988585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30fccdc3-1b55-4163-ba4c-957dbd3bf24d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:36.991151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30fccdc3-1b55-4163-ba4c-957dbd3bf24d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:36.993900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30fccdc3-1b55-4163-ba4c-957dbd3bf24d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:36.994402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30fccdc3-1b55-4163-ba4c-957dbd3bf24d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:37.050945 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-30fccdc3-1b55-4163-ba4c-957dbd3bf24d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.090537 Jan 22 21:05:37.052088 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 982/1874] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:36 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:37.060584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-eebb9cc5-9d48-4c2d-8135-03b7dace5899 req-51e14736-8360-4935-a296-18a57545c1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823cc05f-c81f-4858-a129-0ec31b24b72d", "name": "network-vif-plugged", "status": "completed", "tag": "013ea813-6494-4b47-920d-46a8e54336d3"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:37.065394 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:37.065394 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:37.075385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-eebb9cc5-9d48-4c2d-8135-03b7dace5899 req-51e14736-8360-4935-a296-18a57545c1d4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:37.075902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-eebb9cc5-9d48-4c2d-8135-03b7dace5899 req-51e14736-8360-4935-a296-18a57545c1d4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:37.097857 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-eebb9cc5-9d48-4c2d-8135-03b7dace5899 req-51e14736-8360-4935-a296-18a57545c1d4 service nova] Creating event network-vif-plugged:013ea813-6494-4b47-920d-46a8e54336d3 for instance 823cc05f-c81f-4858-a129-0ec31b24b72d on nch2-master-1 Jan 22 21:05:37.104441 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-eebb9cc5-9d48-4c2d-8135-03b7dace5899 req-51e14736-8360-4935-a296-18a57545c1d4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050357 Jan 22 21:05:37.110217 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 983/1875] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:37.144264 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-700bea1a-e6cb-48b0-bc21-51fb59bc88c1 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 204 len: 0 microversion: 2.1 time: 0.567528 Jan 22 21:05:37.147552 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 893/1876] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:05:36 2022] DELETE /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:37.175589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-00243470-bb43-4c23-a8e8-4f15bc8c402f req-e0c0857c-7aec-499e-8687-12ba2e90bb01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f82b6f5-f5c5-4853-9e35-d840e1b7cf89", "name": "network-vif-deleted", "tag": "f2203fd1-8bf9-43c0-b401-21bc22469177"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:37.177234 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:37.177234 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:37.185758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-abe6a1e9-6fa0-41fd-b3b7-259c6b092ee9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:37.186598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-abe6a1e9-6fa0-41fd-b3b7-259c6b092ee9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:37.219791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abe6a1e9-6fa0-41fd-b3b7-259c6b092ee9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:37.220261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abe6a1e9-6fa0-41fd-b3b7-259c6b092ee9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:37.221087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abe6a1e9-6fa0-41fd-b3b7-259c6b092ee9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:37.223952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-00243470-bb43-4c23-a8e8-4f15bc8c402f req-e0c0857c-7aec-499e-8687-12ba2e90bb01 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:37.229581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-00243470-bb43-4c23-a8e8-4f15bc8c402f req-e0c0857c-7aec-499e-8687-12ba2e90bb01 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:37.243544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abe6a1e9-6fa0-41fd-b3b7-259c6b092ee9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:37.275719 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-00243470-bb43-4c23-a8e8-4f15bc8c402f req-e0c0857c-7aec-499e-8687-12ba2e90bb01 service nova] Creating event network-vif-deleted:f2203fd1-8bf9-43c0-b401-21bc22469177 for instance 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 on nch2-master-1 Jan 22 21:05:37.296005 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-00243470-bb43-4c23-a8e8-4f15bc8c402f req-e0c0857c-7aec-499e-8687-12ba2e90bb01 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119530 Jan 22 21:05:37.296005 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 894/1877] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:05:37.307999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aaaf7b62-b463-4d6e-af42-dcca05797993 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:37.313555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aaaf7b62-b463-4d6e-af42-dcca05797993 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:37.330492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aaaf7b62-b463-4d6e-af42-dcca05797993 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:37.330492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aaaf7b62-b463-4d6e-af42-dcca05797993 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:37.334710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aaaf7b62-b463-4d6e-af42-dcca05797993 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:37.340311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aaaf7b62-b463-4d6e-af42-dcca05797993 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:37.544252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-abe6a1e9-6fa0-41fd-b3b7-259c6b092ee9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:37.553335 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-abe6a1e9-6fa0-41fd-b3b7-259c6b092ee9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1472 microversion: 2.1 time: 0.396716 Jan 22 21:05:37.554544 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 984/1878] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:37 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1472 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:37.586698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-aaaf7b62-b463-4d6e-af42-dcca05797993 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:37.616871 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aaaf7b62-b463-4d6e-af42-dcca05797993 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1316 microversion: 2.1 time: 0.320005 Jan 22 21:05:37.618389 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 895/1879] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:37 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:37.622218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8970129d-9544-402e-b2e0-cba9985fd3ef tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:37.622855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8970129d-9544-402e-b2e0-cba9985fd3ef tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:37.631227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8970129d-9544-402e-b2e0-cba9985fd3ef tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:37.635570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8970129d-9544-402e-b2e0-cba9985fd3ef tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:37.635570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8970129d-9544-402e-b2e0-cba9985fd3ef tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:37.635570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8970129d-9544-402e-b2e0-cba9985fd3ef tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:37.656571 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-8970129d-9544-402e-b2e0-cba9985fd3ef tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] HTTP exception thrown: Instance 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 could not be found. Jan 22 21:05:37.657436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8970129d-9544-402e-b2e0-cba9985fd3ef tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Returning 404 to user: Instance 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:37.659392 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8970129d-9544-402e-b2e0-cba9985fd3ef tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89" status: 404 len: 111 microversion: 2.1 time: 0.044954 Jan 22 21:05:37.660613 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 985/1880] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:37 2022] GET /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:37.669485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a0234489-3ffd-4340-ac0f-1bc97b9b1149 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:37.673624 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:37.673624 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:37.675246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a0234489-3ffd-4340-ac0f-1bc97b9b1149 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:37.676697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a0234489-3ffd-4340-ac0f-1bc97b9b1149 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'edf2656172ff4b63bc8f07781c447293'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:05:37.683661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0234489-3ffd-4340-ac0f-1bc97b9b1149 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:37.684123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0234489-3ffd-4340-ac0f-1bc97b9b1149 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:37.684954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0234489-3ffd-4340-ac0f-1bc97b9b1149 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:37.685399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0234489-3ffd-4340-ac0f-1bc97b9b1149 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:37.781936 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a0234489-3ffd-4340-ac0f-1bc97b9b1149 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.116351 Jan 22 21:05:37.782818 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 896/1881] 10.222.0.100 () {58 vars in 1234 bytes} [Sat Jan 22 21:05:37 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:05:37.796646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e9e4d224-ba2f-4d14-8005-9461de636a5f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:37.799001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e9e4d224-ba2f-4d14-8005-9461de636a5f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:37.799845 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e9e4d224-ba2f-4d14-8005-9461de636a5f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.010263 Jan 22 21:05:37.800703 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 986/1882] 10.222.0.100 () {58 vars in 1186 bytes} [Sat Jan 22 21:05:37 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:05:37.813063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3b8c36be-1044-4a9f-aa7c-a79be1f91a10 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:37.817869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3b8c36be-1044-4a9f-aa7c-a79be1f91a10 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:37.818664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3b8c36be-1044-4a9f-aa7c-a79be1f91a10 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Searching by: {'deleted': False, 'project_id': 'edf2656172ff4b63bc8f07781c447293'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:05:37.824585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3b8c36be-1044-4a9f-aa7c-a79be1f91a10 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:37.825261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3b8c36be-1044-4a9f-aa7c-a79be1f91a10 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:37.826114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3b8c36be-1044-4a9f-aa7c-a79be1f91a10 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:37.826556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3b8c36be-1044-4a9f-aa7c-a79be1f91a10 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:37.929911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-3b8c36be-1044-4a9f-aa7c-a79be1f91a10 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:05:37.969681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-328ca8cd-76ae-4316-b2a0-d761af59f9d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:37.970590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-328ca8cd-76ae-4316-b2a0-d761af59f9d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:37.990692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-328ca8cd-76ae-4316-b2a0-d761af59f9d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:37.991779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-328ca8cd-76ae-4316-b2a0-d761af59f9d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:37.992605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-328ca8cd-76ae-4316-b2a0-d761af59f9d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:37.993251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-328ca8cd-76ae-4316-b2a0-d761af59f9d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:37.999085 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3b8c36be-1044-4a9f-aa7c-a79be1f91a10 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 687 microversion: 2.1 time: 0.191057 Jan 22 21:05:38.000043 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 897/1883] 10.222.0.100 () {58 vars in 1129 bytes} [Sat Jan 22 21:05:37 2022] GET /compute/v2.1/servers => generated 687 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:38.011721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a104d5bb-1b83-42f8-a338-267e0075399b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:38.016195 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:38.016195 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:38.018015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a104d5bb-1b83-42f8-a338-267e0075399b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:38.018510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.compute.servers [None req-a104d5bb-1b83-42f8-a338-267e0075399b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Removing options 'limit' from query {{(pid=137033) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Jan 22 21:05:38.019206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a104d5bb-1b83-42f8-a338-267e0075399b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Searching by: {'deleted': False, 'project_id': 'edf2656172ff4b63bc8f07781c447293'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:05:38.026778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a104d5bb-1b83-42f8-a338-267e0075399b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:38.027248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a104d5bb-1b83-42f8-a338-267e0075399b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:38.028637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a104d5bb-1b83-42f8-a338-267e0075399b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:38.029014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a104d5bb-1b83-42f8-a338-267e0075399b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:38.048667 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-328ca8cd-76ae-4316-b2a0-d761af59f9d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.083638 Jan 22 21:05:38.053724 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 987/1884] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:37 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:05:38.069787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-536381c2-a983-439d-8dab-1c34ceb84787 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:38.071109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-536381c2-a983-439d-8dab-1c34ceb84787 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:38.079349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-536381c2-a983-439d-8dab-1c34ceb84787 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:38.079809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-536381c2-a983-439d-8dab-1c34ceb84787 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:38.080373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-a104d5bb-1b83-42f8-a338-267e0075399b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:05:38.080678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-536381c2-a983-439d-8dab-1c34ceb84787 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:38.081112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-536381c2-a983-439d-8dab-1c34ceb84787 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:38.125830 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a104d5bb-1b83-42f8-a338-267e0075399b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers?limit=102" status: 200 len: 687 microversion: 2.1 time: 0.118818 Jan 22 21:05:38.127408 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-536381c2-a983-439d-8dab-1c34ceb84787 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.065409 Jan 22 21:05:38.128649 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 988/1886] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:38 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:38.129564 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 898/1886] 10.222.0.100 () {58 vars in 1148 bytes} [Sat Jan 22 21:05:38 2022] GET /compute/v2.1/servers?limit=102 => generated 687 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:38.139588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-845db0dd-0a44-4fe2-9131-1f3a89756e1e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:38.141217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-845db0dd-0a44-4fe2-9131-1f3a89756e1e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:38.142434 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-845db0dd-0a44-4fe2-9131-1f3a89756e1e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.007961 Jan 22 21:05:38.143017 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 989/1887] 10.222.0.100 () {58 vars in 1146 bytes} [Sat Jan 22 21:05:38 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 22 21:05:38.152668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4dc0a163-febd-4291-9dce-6e17701513c2 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:38.154341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4dc0a163-febd-4291-9dce-6e17701513c2 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:38.155502 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4dc0a163-febd-4291-9dce-6e17701513c2 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.007130 Jan 22 21:05:38.156029 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 899/1888] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:05:38 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:05:38.170269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a484faf2-8bcc-42e3-a88e-b60fb9a5f5d7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:38.174060 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:38.174060 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:38.175466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a484faf2-8bcc-42e3-a88e-b60fb9a5f5d7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:38.176448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a484faf2-8bcc-42e3-a88e-b60fb9a5f5d7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'edf2656172ff4b63bc8f07781c447293'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:05:38.186247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.compute.servers [None req-a484faf2-8bcc-42e3-a88e-b60fb9a5f5d7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Flavor 'non_existing_flavor' could not be found {{(pid=137032) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:337}} Jan 22 21:05:38.187571 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a484faf2-8bcc-42e3-a88e-b60fb9a5f5d7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.026412 Jan 22 21:05:38.196311 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 990/1889] 10.222.0.100 () {58 vars in 1182 bytes} [Sat Jan 22 21:05:38 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:05:38.201481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-53acf048-994a-4b9c-96e3-d3d39e77ac01 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:38.206652 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:38.206652 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:38.210190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-53acf048-994a-4b9c-96e3-d3d39e77ac01 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:38.213251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-53acf048-994a-4b9c-96e3-d3d39e77ac01 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'edf2656172ff4b63bc8f07781c447293'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:05:38.221740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53acf048-994a-4b9c-96e3-d3d39e77ac01 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:38.222291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53acf048-994a-4b9c-96e3-d3d39e77ac01 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:38.223356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53acf048-994a-4b9c-96e3-d3d39e77ac01 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:38.224243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53acf048-994a-4b9c-96e3-d3d39e77ac01 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:38.333941 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-53acf048-994a-4b9c-96e3-d3d39e77ac01 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.135314 Jan 22 21:05:38.335461 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 900/1890] 10.222.0.100 () {58 vars in 1178 bytes} [Sat Jan 22 21:05:38 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:05:38.347977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-89987642-5486-4a00-b028-9deb9fab623f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:38.353063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-89987642-5486-4a00-b028-9deb9fab623f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:38.354465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-89987642-5486-4a00-b028-9deb9fab623f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'edf2656172ff4b63bc8f07781c447293'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:05:38.360846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89987642-5486-4a00-b028-9deb9fab623f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:38.361307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89987642-5486-4a00-b028-9deb9fab623f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:38.362452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89987642-5486-4a00-b028-9deb9fab623f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:38.362894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89987642-5486-4a00-b028-9deb9fab623f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:38.499418 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-89987642-5486-4a00-b028-9deb9fab623f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.155813 Jan 22 21:05:38.500022 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 991/1891] 10.222.0.100 () {58 vars in 1188 bytes} [Sat Jan 22 21:05:38 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:05:38.511298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85a7ebec-b7a9-46cd-9fe8-25d5b7359781 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:38.515541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-85a7ebec-b7a9-46cd-9fe8-25d5b7359781 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:38.516350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85a7ebec-b7a9-46cd-9fe8-25d5b7359781 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Searching by: {'deleted': False, 'project_id': 'edf2656172ff4b63bc8f07781c447293'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:05:38.521805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85a7ebec-b7a9-46cd-9fe8-25d5b7359781 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:38.525880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85a7ebec-b7a9-46cd-9fe8-25d5b7359781 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:38.525880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85a7ebec-b7a9-46cd-9fe8-25d5b7359781 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:38.525880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85a7ebec-b7a9-46cd-9fe8-25d5b7359781 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:38.558998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-85a7ebec-b7a9-46cd-9fe8-25d5b7359781 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:05:38.570223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0e2b152c-2334-41ce-82e5-07d6dc7fa2dd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:38.570968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0e2b152c-2334-41ce-82e5-07d6dc7fa2dd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:38.592095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e2b152c-2334-41ce-82e5-07d6dc7fa2dd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:38.592095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e2b152c-2334-41ce-82e5-07d6dc7fa2dd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:38.592685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e2b152c-2334-41ce-82e5-07d6dc7fa2dd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:38.593308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e2b152c-2334-41ce-82e5-07d6dc7fa2dd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:38.653015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-85a7ebec-b7a9-46cd-9fe8-25d5b7359781 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:38.673728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85a7ebec-b7a9-46cd-9fe8-25d5b7359781 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:38.681063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85a7ebec-b7a9-46cd-9fe8-25d5b7359781 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:38.864567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0e2b152c-2334-41ce-82e5-07d6dc7fa2dd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:38.875751 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0e2b152c-2334-41ce-82e5-07d6dc7fa2dd tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1472 microversion: 2.1 time: 0.309152 Jan 22 21:05:38.876950 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 992/1892] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:38 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1472 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:38.883049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-812cefdd-c4d5-4cb5-be76-f6af91883ed9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:38.884158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-812cefdd-c4d5-4cb5-be76-f6af91883ed9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:38.894098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-812cefdd-c4d5-4cb5-be76-f6af91883ed9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:38.894853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-812cefdd-c4d5-4cb5-be76-f6af91883ed9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:38.895846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-812cefdd-c4d5-4cb5-be76-f6af91883ed9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:38.896498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-812cefdd-c4d5-4cb5-be76-f6af91883ed9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.043381 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-85a7ebec-b7a9-46cd-9fe8-25d5b7359781 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/detail" status: 200 len: 3031 microversion: 2.1 time: 0.536235 Jan 22 21:05:39.044666 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 901/1893] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:05:38 2022] GET /compute/v2.1/servers/detail => generated 3031 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:39.064071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c04b33fe-3d0a-4091-88c0-6ebd65d0530d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:39.064432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c04b33fe-3d0a-4091-88c0-6ebd65d0530d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:39.070376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-812cefdd-c4d5-4cb5-be76-f6af91883ed9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:39.071299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c04b33fe-3d0a-4091-88c0-6ebd65d0530d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.072530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c04b33fe-3d0a-4091-88c0-6ebd65d0530d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.073669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c04b33fe-3d0a-4091-88c0-6ebd65d0530d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.074311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c04b33fe-3d0a-4091-88c0-6ebd65d0530d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.081458 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-812cefdd-c4d5-4cb5-be76-f6af91883ed9 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1316 microversion: 2.1 time: 0.203191 Jan 22 21:05:39.083139 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 993/1894] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:38 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:39.090928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0e1d240b-c293-4235-b762-0b49790b5c8f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:39.095746 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:39.095746 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:39.096864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0e1d240b-c293-4235-b762-0b49790b5c8f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:39.097910 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0e1d240b-c293-4235-b762-0b49790b5c8f tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.012480 Jan 22 21:05:39.105532 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 994/1895] 10.222.0.100 () {58 vars in 1182 bytes} [Sat Jan 22 21:05:39 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:05:39.124468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0351d769-039c-4bbe-8e44-84fefef60e3e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:39.124961 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c04b33fe-3d0a-4091-88c0-6ebd65d0530d tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.065624 Jan 22 21:05:39.126866 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 902/1896] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:39 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:39.130017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0351d769-039c-4bbe-8e44-84fefef60e3e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:39.130710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0351d769-039c-4bbe-8e44-84fefef60e3e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Searching by: {'deleted': False, 'project_id': 'edf2656172ff4b63bc8f07781c447293'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:05:39.141871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d0122098-41a3-4788-a82d-07345e7a2096 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:39.146684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d0122098-41a3-4788-a82d-07345e7a2096 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:39.149330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0351d769-039c-4bbe-8e44-84fefef60e3e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.149834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0351d769-039c-4bbe-8e44-84fefef60e3e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.150796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0351d769-039c-4bbe-8e44-84fefef60e3e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.152241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0122098-41a3-4788-a82d-07345e7a2096 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.152964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0122098-41a3-4788-a82d-07345e7a2096 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.153933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0122098-41a3-4788-a82d-07345e7a2096 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.154367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0351d769-039c-4bbe-8e44-84fefef60e3e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.154562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0122098-41a3-4788-a82d-07345e7a2096 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.186547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-0351d769-039c-4bbe-8e44-84fefef60e3e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:05:39.218520 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d0122098-41a3-4788-a82d-07345e7a2096 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.081305 Jan 22 21:05:39.219663 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 903/1897] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:39 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:39.256855 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0351d769-039c-4bbe-8e44-84fefef60e3e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 687 microversion: 2.1 time: 0.136480 Jan 22 21:05:39.257455 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 995/1898] 10.222.0.100 () {58 vars in 1129 bytes} [Sat Jan 22 21:05:39 2022] GET /compute/v2.1/servers => generated 687 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:39.270069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-08e6b4cf-e186-4ed5-b148-c1fc3959a520 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:39.270978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-08e6b4cf-e186-4ed5-b148-c1fc3959a520 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:39.283155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08e6b4cf-e186-4ed5-b148-c1fc3959a520 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.283155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08e6b4cf-e186-4ed5-b148-c1fc3959a520 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.283664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08e6b4cf-e186-4ed5-b148-c1fc3959a520 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.284158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08e6b4cf-e186-4ed5-b148-c1fc3959a520 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.299669 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-08e6b4cf-e186-4ed5-b148-c1fc3959a520 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] HTTP exception thrown: Instance 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 could not be found. Jan 22 21:05:39.305987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-08e6b4cf-e186-4ed5-b148-c1fc3959a520 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Returning 404 to user: Instance 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:39.305987 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-08e6b4cf-e186-4ed5-b148-c1fc3959a520 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "DELETE /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89" status: 404 len: 111 microversion: 2.1 time: 0.035593 Jan 22 21:05:39.305987 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 904/1899] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:05:39 2022] DELETE /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:39.311137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7a06862b-0777-4f7c-abd4-e3d43b5bd607 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:39.312035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7a06862b-0777-4f7c-abd4-e3d43b5bd607 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: f4ae3f7e-0253-473f-8066-2b295fbcbbd1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:39.318326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a06862b-0777-4f7c-abd4-e3d43b5bd607 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.319095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a06862b-0777-4f7c-abd4-e3d43b5bd607 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.320035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a06862b-0777-4f7c-abd4-e3d43b5bd607 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.320491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a06862b-0777-4f7c-abd4-e3d43b5bd607 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.356166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7a06862b-0777-4f7c-abd4-e3d43b5bd607 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: f4ae3f7e-0253-473f-8066-2b295fbcbbd1] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:05:39.498165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-d73a0528-1848-4833-8ba6-c1c268c74e86 req-d8f30918-3547-4b76-999c-c0d3319985bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8199f0ad-6b37-46ca-829a-cee02b1eaf83", "name": "network-vif-deleted", "tag": "b15e2fda-9cee-4a6c-9e04-adc83b8e3620"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:39.500827 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:39.500827 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:39.512255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d73a0528-1848-4833-8ba6-c1c268c74e86 req-d8f30918-3547-4b76-999c-c0d3319985bd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.512777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d73a0528-1848-4833-8ba6-c1c268c74e86 req-d8f30918-3547-4b76-999c-c0d3319985bd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.525373 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-d73a0528-1848-4833-8ba6-c1c268c74e86 req-d8f30918-3547-4b76-999c-c0d3319985bd service nova] Creating event network-vif-deleted:b15e2fda-9cee-4a6c-9e04-adc83b8e3620 for instance 8199f0ad-6b37-46ca-829a-cee02b1eaf83 on nch1-master-1 Jan 22 21:05:39.531928 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-d73a0528-1848-4833-8ba6-c1c268c74e86 req-d8f30918-3547-4b76-999c-c0d3319985bd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040795 Jan 22 21:05:39.532534 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 905/1900] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:39.794073 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7a06862b-0777-4f7c-abd4-e3d43b5bd607 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "DELETE /compute/v2.1/servers/f4ae3f7e-0253-473f-8066-2b295fbcbbd1" status: 204 len: 0 microversion: 2.1 time: 0.473072 Jan 22 21:05:39.794073 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 996/1901] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:05:39 2022] DELETE /compute/v2.1/servers/f4ae3f7e-0253-473f-8066-2b295fbcbbd1 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:05:39.799554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4018f4a9-b349-4267-a8bd-0e2bfaaf9d21 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:39.801448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4018f4a9-b349-4267-a8bd-0e2bfaaf9d21 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:39.812204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4018f4a9-b349-4267-a8bd-0e2bfaaf9d21 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.812674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4018f4a9-b349-4267-a8bd-0e2bfaaf9d21 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.813483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4018f4a9-b349-4267-a8bd-0e2bfaaf9d21 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.813955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4018f4a9-b349-4267-a8bd-0e2bfaaf9d21 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.860570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4018f4a9-b349-4267-a8bd-0e2bfaaf9d21 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:05:39.894849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d989f88-0d64-45e1-bdf9-18807a8f17a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:39.899121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d989f88-0d64-45e1-bdf9-18807a8f17a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:39.911657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d989f88-0d64-45e1-bdf9-18807a8f17a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.913258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d989f88-0d64-45e1-bdf9-18807a8f17a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.914122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d989f88-0d64-45e1-bdf9-18807a8f17a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.915603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d989f88-0d64-45e1-bdf9-18807a8f17a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.976079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d989f88-0d64-45e1-bdf9-18807a8f17a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:39.976608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d989f88-0d64-45e1-bdf9-18807a8f17a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:39.977170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-0d989f88-0d64-45e1-bdf9-18807a8f17a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lazy-loading 'fault' on Instance uuid 8199f0ad-6b37-46ca-829a-cee02b1eaf83 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:40.048123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0d989f88-0d64-45e1-bdf9-18807a8f17a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:40.057902 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d989f88-0d64-45e1-bdf9-18807a8f17a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 200 len: 1307 microversion: 2.1 time: 0.167661 Jan 22 21:05:40.058529 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 997/1902] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:39 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 1307 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:40.100463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7d56d8ad-d2a2-4c3c-aed8-9614bf8c249a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:40.106527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7d56d8ad-d2a2-4c3c-aed8-9614bf8c249a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:40.110415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d56d8ad-d2a2-4c3c-aed8-9614bf8c249a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:40.111821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d56d8ad-d2a2-4c3c-aed8-9614bf8c249a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:40.112879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d56d8ad-d2a2-4c3c-aed8-9614bf8c249a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:40.117364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d56d8ad-d2a2-4c3c-aed8-9614bf8c249a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:40.229798 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4018f4a9-b349-4267-a8bd-0e2bfaaf9d21 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "DELETE /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 204 len: 0 microversion: 2.1 time: 0.433382 Jan 22 21:05:40.237074 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 906/1903] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:05:39 2022] DELETE /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:40.251522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ddb1c593-7ae6-4b03-98e2-39a9ae39a17c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:40.253330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ddb1c593-7ae6-4b03-98e2-39a9ae39a17c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:40.280335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddb1c593-7ae6-4b03-98e2-39a9ae39a17c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:40.280335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddb1c593-7ae6-4b03-98e2-39a9ae39a17c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:40.281848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddb1c593-7ae6-4b03-98e2-39a9ae39a17c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:40.282548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddb1c593-7ae6-4b03-98e2-39a9ae39a17c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:40.288335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7d56d8ad-d2a2-4c3c-aed8-9614bf8c249a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:40.299442 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7d56d8ad-d2a2-4c3c-aed8-9614bf8c249a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1502 microversion: 2.1 time: 0.202675 Jan 22 21:05:40.301180 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 998/1904] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:40 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1502 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:40.307147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1b2ffe8a-d73f-45a9-afd3-68dd30aebd0d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:40.315552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1b2ffe8a-d73f-45a9-afd3-68dd30aebd0d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:40.315552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b2ffe8a-d73f-45a9-afd3-68dd30aebd0d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:40.318511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b2ffe8a-d73f-45a9-afd3-68dd30aebd0d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:40.327709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b2ffe8a-d73f-45a9-afd3-68dd30aebd0d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:40.329924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b2ffe8a-d73f-45a9-afd3-68dd30aebd0d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:40.355209 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ddb1c593-7ae6-4b03-98e2-39a9ae39a17c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.115878 Jan 22 21:05:40.356057 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 907/1905] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:40 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:40.361110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11567d53-cdb4-46c6-8647-186e1be2290b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:40.362024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-11567d53-cdb4-46c6-8647-186e1be2290b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:40.372246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11567d53-cdb4-46c6-8647-186e1be2290b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:40.374353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11567d53-cdb4-46c6-8647-186e1be2290b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:40.374353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11567d53-cdb4-46c6-8647-186e1be2290b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:40.375320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11567d53-cdb4-46c6-8647-186e1be2290b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:40.384860 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1b2ffe8a-d73f-45a9-afd3-68dd30aebd0d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.081800 Jan 22 21:05:40.385822 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 999/1906] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:40 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:40.395373 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-11567d53-cdb4-46c6-8647-186e1be2290b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] HTTP exception thrown: Instance 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 could not be found. Jan 22 21:05:40.395803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c2262dec-b843-4345-9ea9-e4d4b3c22f2d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:40.396503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11567d53-cdb4-46c6-8647-186e1be2290b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Returning 404 to user: Instance 4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:40.398518 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-11567d53-cdb4-46c6-8647-186e1be2290b tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89" status: 404 len: 111 microversion: 2.1 time: 0.040425 Jan 22 21:05:40.399703 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 908/1907] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:40 2022] GET /compute/v2.1/servers/4f82b6f5-f5c5-4853-9e35-d840e1b7cf89 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:40.410338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8a35e585-0b43-4eee-956c-4416ee027f9e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:40.413476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.compute.server_groups [None req-c2262dec-b843-4345-9ea9-e4d4b3c22f2d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Querying cell 52f5c6ef-d4de-4047-a310-d7aef14748aa(cell1) for 1 instances {{(pid=137032) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Jan 22 21:05:40.413763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8a35e585-0b43-4eee-956c-4416ee027f9e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: f4ae3f7e-0253-473f-8066-2b295fbcbbd1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:40.414977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2262dec-b843-4345-9ea9-e4d4b3c22f2d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:40.415469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2262dec-b843-4345-9ea9-e4d4b3c22f2d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:40.425610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a35e585-0b43-4eee-956c-4416ee027f9e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:40.427763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a35e585-0b43-4eee-956c-4416ee027f9e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:40.428891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a35e585-0b43-4eee-956c-4416ee027f9e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:40.429596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a35e585-0b43-4eee-956c-4416ee027f9e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:40.448042 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c2262dec-b843-4345-9ea9-e4d4b3c22f2d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/os-server-groups/a6edec4b-d32a-4344-9bb7-34e237833a35" status: 200 len: 221 microversion: 2.1 time: 0.060982 Jan 22 21:05:40.456573 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1000/1908] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:05:40 2022] GET /compute/v2.1/os-server-groups/a6edec4b-d32a-4344-9bb7-34e237833a35 => generated 221 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:40.463494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-942deaf9-393b-4804-a33d-bebcbeb109f3 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:40.464488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-942deaf9-393b-4804-a33d-bebcbeb109f3 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:40.472280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-942deaf9-393b-4804-a33d-bebcbeb109f3 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:40.473124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-942deaf9-393b-4804-a33d-bebcbeb109f3 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:40.475664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-942deaf9-393b-4804-a33d-bebcbeb109f3 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:40.476379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-942deaf9-393b-4804-a33d-bebcbeb109f3 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:40.523033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-942deaf9-393b-4804-a33d-bebcbeb109f3 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:05:40.609871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8a35e585-0b43-4eee-956c-4416ee027f9e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:40.618455 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8a35e585-0b43-4eee-956c-4416ee027f9e tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/f4ae3f7e-0253-473f-8066-2b295fbcbbd1" status: 200 len: 1525 microversion: 2.1 time: 0.211741 Jan 22 21:05:40.619886 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 909/1909] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:40 2022] GET /compute/v2.1/servers/f4ae3f7e-0253-473f-8066-2b295fbcbbd1 => generated 1525 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:40.982600 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-942deaf9-393b-4804-a33d-bebcbeb109f3 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "DELETE /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 204 len: 0 microversion: 2.1 time: 0.523176 Jan 22 21:05:40.983305 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1001/1910] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:05:40 2022] DELETE /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:40.991513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-57f245fc-ae5b-4e0f-8b40-11dc4b36f530 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:40.992177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-57f245fc-ae5b-4e0f-8b40-11dc4b36f530 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:41.002961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57f245fc-ae5b-4e0f-8b40-11dc4b36f530 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:41.004133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57f245fc-ae5b-4e0f-8b40-11dc4b36f530 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:41.004988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57f245fc-ae5b-4e0f-8b40-11dc4b36f530 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:41.005469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57f245fc-ae5b-4e0f-8b40-11dc4b36f530 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:41.085153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-558002d6-a58a-41c0-a1b7-f74f7667a284 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:41.086252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-558002d6-a58a-41c0-a1b7-f74f7667a284 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 8199f0ad-6b37-46ca-829a-cee02b1eaf83] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:41.095034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-558002d6-a58a-41c0-a1b7-f74f7667a284 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:41.095824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-558002d6-a58a-41c0-a1b7-f74f7667a284 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:41.096845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-558002d6-a58a-41c0-a1b7-f74f7667a284 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:41.098179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-558002d6-a58a-41c0-a1b7-f74f7667a284 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:41.115721 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-558002d6-a58a-41c0-a1b7-f74f7667a284 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] HTTP exception thrown: Instance 8199f0ad-6b37-46ca-829a-cee02b1eaf83 could not be found. Jan 22 21:05:41.116332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-558002d6-a58a-41c0-a1b7-f74f7667a284 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Returning 404 to user: Instance 8199f0ad-6b37-46ca-829a-cee02b1eaf83 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:41.117373 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-558002d6-a58a-41c0-a1b7-f74f7667a284 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83" status: 404 len: 111 microversion: 2.1 time: 0.039920 Jan 22 21:05:41.118248 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1002/1911] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:41 2022] GET /compute/v2.1/servers/8199f0ad-6b37-46ca-829a-cee02b1eaf83 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:41.129787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-12d3c257-e81a-44ab-9213-a39fcb9a1520 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:41.129787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-12d3c257-e81a-44ab-9213-a39fcb9a1520 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:41.134510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12d3c257-e81a-44ab-9213-a39fcb9a1520 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:41.135063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12d3c257-e81a-44ab-9213-a39fcb9a1520 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:41.136019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12d3c257-e81a-44ab-9213-a39fcb9a1520 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:41.136479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12d3c257-e81a-44ab-9213-a39fcb9a1520 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:41.171111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-12d3c257-e81a-44ab-9213-a39fcb9a1520 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:05:41.191847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-57f245fc-ae5b-4e0f-8b40-11dc4b36f530 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:41.202187 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-57f245fc-ae5b-4e0f-8b40-11dc4b36f530 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1508 microversion: 2.1 time: 0.214363 Jan 22 21:05:41.213421 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 910/1912] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:40 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:41.367519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0f50ab59-5290-4542-a0da-a564d0b36718 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:41.368504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0f50ab59-5290-4542-a0da-a564d0b36718 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:41.376072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f50ab59-5290-4542-a0da-a564d0b36718 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:41.376530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f50ab59-5290-4542-a0da-a564d0b36718 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:41.377342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f50ab59-5290-4542-a0da-a564d0b36718 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:41.377810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f50ab59-5290-4542-a0da-a564d0b36718 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:41.426837 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0f50ab59-5290-4542-a0da-a564d0b36718 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.062778 Jan 22 21:05:41.433795 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 911/1913] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:41 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:05:41.442174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-afd760da-5cac-4ea4-aab6-eb5cfef7b115 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:41.445287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-afd760da-5cac-4ea4-aab6-eb5cfef7b115 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:41.452736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afd760da-5cac-4ea4-aab6-eb5cfef7b115 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:41.453735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afd760da-5cac-4ea4-aab6-eb5cfef7b115 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:41.454550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afd760da-5cac-4ea4-aab6-eb5cfef7b115 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:41.454987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afd760da-5cac-4ea4-aab6-eb5cfef7b115 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:41.486754 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-12d3c257-e81a-44ab-9213-a39fcb9a1520 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "DELETE /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 204 len: 0 microversion: 2.1 time: 0.362298 Jan 22 21:05:41.487458 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1003/1914] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:05:41 2022] DELETE /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:41.496540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1bed5c50-9e4e-45b4-8151-381243b741a9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:41.497261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1bed5c50-9e4e-45b4-8151-381243b741a9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:41.505142 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-afd760da-5cac-4ea4-aab6-eb5cfef7b115 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.061944 Jan 22 21:05:41.505142 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 912/1915] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:41 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:41.512627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bed5c50-9e4e-45b4-8151-381243b741a9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:41.513357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bed5c50-9e4e-45b4-8151-381243b741a9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:41.514210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bed5c50-9e4e-45b4-8151-381243b741a9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:41.514663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bed5c50-9e4e-45b4-8151-381243b741a9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:41.638065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8e5f4bdf-0a64-4224-b975-ca28ba396c30 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:41.639101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8e5f4bdf-0a64-4224-b975-ca28ba396c30 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: f4ae3f7e-0253-473f-8066-2b295fbcbbd1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:41.671644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e5f4bdf-0a64-4224-b975-ca28ba396c30 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:41.672388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e5f4bdf-0a64-4224-b975-ca28ba396c30 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:41.673346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e5f4bdf-0a64-4224-b975-ca28ba396c30 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:41.674687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e5f4bdf-0a64-4224-b975-ca28ba396c30 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:41.710358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1bed5c50-9e4e-45b4-8151-381243b741a9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:41.720573 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1bed5c50-9e4e-45b4-8151-381243b741a9 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1474 microversion: 2.1 time: 0.228695 Jan 22 21:05:41.721481 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1004/1916] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:41 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1474 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:42.018016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8e5f4bdf-0a64-4224-b975-ca28ba396c30 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:42.032365 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8e5f4bdf-0a64-4224-b975-ca28ba396c30 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/f4ae3f7e-0253-473f-8066-2b295fbcbbd1" status: 200 len: 1525 microversion: 2.1 time: 0.399639 Jan 22 21:05:42.033001 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 913/1917] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:41 2022] GET /compute/v2.1/servers/f4ae3f7e-0253-473f-8066-2b295fbcbbd1 => generated 1525 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:42.220101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9a169245-2f38-4cd6-8f8f-90bbf06c49af tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:42.220760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9a169245-2f38-4cd6-8f8f-90bbf06c49af tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:42.227381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a169245-2f38-4cd6-8f8f-90bbf06c49af tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:42.227843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a169245-2f38-4cd6-8f8f-90bbf06c49af tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:42.229441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a169245-2f38-4cd6-8f8f-90bbf06c49af tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:42.229910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a169245-2f38-4cd6-8f8f-90bbf06c49af tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:42.375235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9a169245-2f38-4cd6-8f8f-90bbf06c49af tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:42.389663 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9a169245-2f38-4cd6-8f8f-90bbf06c49af tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1508 microversion: 2.1 time: 0.173419 Jan 22 21:05:42.394617 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1005/1918] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:42 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:42.439174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab44f016-93eb-4466-b98b-d7dcff199bd6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:42.440851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab44f016-93eb-4466-b98b-d7dcff199bd6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:42.449691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab44f016-93eb-4466-b98b-d7dcff199bd6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:42.450289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab44f016-93eb-4466-b98b-d7dcff199bd6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:42.451202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab44f016-93eb-4466-b98b-d7dcff199bd6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:42.451750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab44f016-93eb-4466-b98b-d7dcff199bd6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:42.486852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-db7fe3e4-9a81-434c-af42-cd1a9b8635e5 req-2c9d210f-b615-4781-94f4-661a3a291644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4ae3f7e-0253-473f-8066-2b295fbcbbd1", "name": "network-vif-deleted", "tag": "b36ddfbb-4bf6-415d-b48e-8df34234a5f8"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:42.488591 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:42.488591 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:42.499455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-db7fe3e4-9a81-434c-af42-cd1a9b8635e5 req-2c9d210f-b615-4781-94f4-661a3a291644 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:42.500012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-db7fe3e4-9a81-434c-af42-cd1a9b8635e5 req-2c9d210f-b615-4781-94f4-661a3a291644 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:42.501557 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab44f016-93eb-4466-b98b-d7dcff199bd6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.066227 Jan 22 21:05:42.502668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 914/1919] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:42 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:42.516415 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-db7fe3e4-9a81-434c-af42-cd1a9b8635e5 req-2c9d210f-b615-4781-94f4-661a3a291644 service nova] Creating event network-vif-deleted:b36ddfbb-4bf6-415d-b48e-8df34234a5f8 for instance f4ae3f7e-0253-473f-8066-2b295fbcbbd1 on nch2-master-1 Jan 22 21:05:42.517719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b1bd9775-fe81-4df5-b13e-ffe03247661f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:42.519404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b1bd9775-fe81-4df5-b13e-ffe03247661f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:42.522670 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-db7fe3e4-9a81-434c-af42-cd1a9b8635e5 req-2c9d210f-b615-4781-94f4-661a3a291644 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047011 Jan 22 21:05:42.523839 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1006/1920] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:42.530933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1bd9775-fe81-4df5-b13e-ffe03247661f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:42.531387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1bd9775-fe81-4df5-b13e-ffe03247661f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:42.532457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1bd9775-fe81-4df5-b13e-ffe03247661f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:42.533264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1bd9775-fe81-4df5-b13e-ffe03247661f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:42.580679 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b1bd9775-fe81-4df5-b13e-ffe03247661f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.071916 Jan 22 21:05:42.582526 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 915/1921] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:42 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:42.739286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c71000f2-3e08-4547-bf8d-ed0a3c753b39 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:42.739844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c71000f2-3e08-4547-bf8d-ed0a3c753b39 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:42.748653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c71000f2-3e08-4547-bf8d-ed0a3c753b39 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:42.756519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c71000f2-3e08-4547-bf8d-ed0a3c753b39 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:42.757875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c71000f2-3e08-4547-bf8d-ed0a3c753b39 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:42.758592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c71000f2-3e08-4547-bf8d-ed0a3c753b39 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:42.915927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c71000f2-3e08-4547-bf8d-ed0a3c753b39 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:42.924006 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c71000f2-3e08-4547-bf8d-ed0a3c753b39 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1474 microversion: 2.1 time: 0.188809 Jan 22 21:05:42.924795 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1007/1922] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:42 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1474 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:43.050325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f0468620-b7bf-4b3e-8a5c-c32f27db1325 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:43.051028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f0468620-b7bf-4b3e-8a5c-c32f27db1325 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: f4ae3f7e-0253-473f-8066-2b295fbcbbd1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:43.058287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f0468620-b7bf-4b3e-8a5c-c32f27db1325 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:43.058747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f0468620-b7bf-4b3e-8a5c-c32f27db1325 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:43.059545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f0468620-b7bf-4b3e-8a5c-c32f27db1325 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:43.060085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f0468620-b7bf-4b3e-8a5c-c32f27db1325 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:43.097577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f0468620-b7bf-4b3e-8a5c-c32f27db1325 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:43.098369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f0468620-b7bf-4b3e-8a5c-c32f27db1325 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:43.098839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-f0468620-b7bf-4b3e-8a5c-c32f27db1325 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lazy-loading 'fault' on Instance uuid f4ae3f7e-0253-473f-8066-2b295fbcbbd1 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:43.193825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f0468620-b7bf-4b3e-8a5c-c32f27db1325 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053465c1e7ec436e9689cf96b37c0bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf2656172ff4b63bc8f07781c447293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:43.203042 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f0468620-b7bf-4b3e-8a5c-c32f27db1325 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/f4ae3f7e-0253-473f-8066-2b295fbcbbd1" status: 200 len: 1317 microversion: 2.1 time: 0.156816 Jan 22 21:05:43.203664 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 916/1923] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:43 2022] GET /compute/v2.1/servers/f4ae3f7e-0253-473f-8066-2b295fbcbbd1 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:43.406549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a5438c5d-19b5-469a-b850-14bf936c903d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:43.407259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a5438c5d-19b5-469a-b850-14bf936c903d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:43.413797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5438c5d-19b5-469a-b850-14bf936c903d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:43.414249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5438c5d-19b5-469a-b850-14bf936c903d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:43.415040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5438c5d-19b5-469a-b850-14bf936c903d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:43.415984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5438c5d-19b5-469a-b850-14bf936c903d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:43.487326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a5438c5d-19b5-469a-b850-14bf936c903d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de270798712461aab9499a7353da9e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a320e9220b4ea186e4266908053484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:43.504497 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a5438c5d-19b5-469a-b850-14bf936c903d tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 200 len: 1466 microversion: 2.1 time: 0.101573 Jan 22 21:05:43.515526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-041c7a50-786a-4cb7-a0c0-bdf6ade99002 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:43.517552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-041c7a50-786a-4cb7-a0c0-bdf6ade99002 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:43.521112 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1008/1924] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:43 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 1466 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:43.527989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-041c7a50-786a-4cb7-a0c0-bdf6ade99002 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:43.528728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-041c7a50-786a-4cb7-a0c0-bdf6ade99002 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:43.530298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-041c7a50-786a-4cb7-a0c0-bdf6ade99002 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:43.530935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-041c7a50-786a-4cb7-a0c0-bdf6ade99002 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:43.577976 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-041c7a50-786a-4cb7-a0c0-bdf6ade99002 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.066336 Jan 22 21:05:43.582021 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 917/1925] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:43 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:43.594274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f6a0e5ab-bc71-47b6-948c-3636f2a782c5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:43.595335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f6a0e5ab-bc71-47b6-948c-3636f2a782c5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:43.602280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6a0e5ab-bc71-47b6-948c-3636f2a782c5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:43.602731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6a0e5ab-bc71-47b6-948c-3636f2a782c5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:43.603710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6a0e5ab-bc71-47b6-948c-3636f2a782c5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:43.604053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6a0e5ab-bc71-47b6-948c-3636f2a782c5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:43.642662 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f6a0e5ab-bc71-47b6-948c-3636f2a782c5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.052182 Jan 22 21:05:43.643306 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1009/1926] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:43 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:43.941090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b147c1be-f090-4a50-8c89-ee9295e2f204 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:43.941829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b147c1be-f090-4a50-8c89-ee9295e2f204 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:43.949446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b147c1be-f090-4a50-8c89-ee9295e2f204 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:43.949942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b147c1be-f090-4a50-8c89-ee9295e2f204 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:43.950731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b147c1be-f090-4a50-8c89-ee9295e2f204 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:43.951173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b147c1be-f090-4a50-8c89-ee9295e2f204 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.027051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b147c1be-f090-4a50-8c89-ee9295e2f204 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:44.035096 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b147c1be-f090-4a50-8c89-ee9295e2f204 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 200 len: 1432 microversion: 2.1 time: 0.098017 Jan 22 21:05:44.035728 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 918/1927] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:43 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 1432 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:44.221055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ee891207-c951-40f0-b352-7872a5af5c9a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:44.222038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ee891207-c951-40f0-b352-7872a5af5c9a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: f4ae3f7e-0253-473f-8066-2b295fbcbbd1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:44.230293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee891207-c951-40f0-b352-7872a5af5c9a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.230871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee891207-c951-40f0-b352-7872a5af5c9a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.232930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee891207-c951-40f0-b352-7872a5af5c9a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.232930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee891207-c951-40f0-b352-7872a5af5c9a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.248521 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-ee891207-c951-40f0-b352-7872a5af5c9a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] HTTP exception thrown: Instance f4ae3f7e-0253-473f-8066-2b295fbcbbd1 could not be found. Jan 22 21:05:44.249126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ee891207-c951-40f0-b352-7872a5af5c9a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Returning 404 to user: Instance f4ae3f7e-0253-473f-8066-2b295fbcbbd1 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:44.250063 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ee891207-c951-40f0-b352-7872a5af5c9a tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/f4ae3f7e-0253-473f-8066-2b295fbcbbd1" status: 404 len: 111 microversion: 2.1 time: 0.033852 Jan 22 21:05:44.250667 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1010/1928] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:44 2022] GET /compute/v2.1/servers/f4ae3f7e-0253-473f-8066-2b295fbcbbd1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:44.258774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f1802a26-b3bd-46f9-a9d1-5782c5c30fe7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:44.261600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f1802a26-b3bd-46f9-a9d1-5782c5c30fe7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] [instance: fa05d9e2-ba22-4fe8-abc7-66b9054b1812] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:44.267368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1802a26-b3bd-46f9-a9d1-5782c5c30fe7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.267824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1802a26-b3bd-46f9-a9d1-5782c5c30fe7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.268650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1802a26-b3bd-46f9-a9d1-5782c5c30fe7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.269077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1802a26-b3bd-46f9-a9d1-5782c5c30fe7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.285931 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-f1802a26-b3bd-46f9-a9d1-5782c5c30fe7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] HTTP exception thrown: Instance fa05d9e2-ba22-4fe8-abc7-66b9054b1812 could not be found. Jan 22 21:05:44.286494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f1802a26-b3bd-46f9-a9d1-5782c5c30fe7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] Returning 404 to user: Instance fa05d9e2-ba22-4fe8-abc7-66b9054b1812 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:44.287340 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f1802a26-b3bd-46f9-a9d1-5782c5c30fe7 tempest-ListServersNegativeTestJSON-1775136551 tempest-ListServersNegativeTestJSON-1775136551-project] 10.222.0.100 "GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812" status: 404 len: 111 microversion: 2.1 time: 0.032401 Jan 22 21:05:44.287898 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 919/1929] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:44 2022] GET /compute/v2.1/servers/fa05d9e2-ba22-4fe8-abc7-66b9054b1812 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:44.522366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d2e9d03-0719-4daf-acb4-55acd43d14ef tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:44.522982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d2e9d03-0719-4daf-acb4-55acd43d14ef tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:44.532086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d2e9d03-0719-4daf-acb4-55acd43d14ef tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.532738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d2e9d03-0719-4daf-acb4-55acd43d14ef tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.533756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d2e9d03-0719-4daf-acb4-55acd43d14ef tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.534359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d2e9d03-0719-4daf-acb4-55acd43d14ef tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.538240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-5f423e33-e495-4adb-bec5-038186bab648 req-b51fad8f-b704-4d13-88aa-bc57d4259685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa05d9e2-ba22-4fe8-abc7-66b9054b1812", "name": "network-vif-deleted", "tag": "031b57a9-ce17-4f21-abb9-0e430b71022e"}, {"server_uuid": "823cc05f-c81f-4858-a129-0ec31b24b72d", "name": "network-vif-deleted", "tag": "013ea813-6494-4b47-920d-46a8e54336d3"}, {"server_uuid": "898fa5e5-16ac-437f-af78-9a70e358f284", "name": "network-vif-deleted", "tag": "e6c739de-7e2a-4917-90a5-dd2e9abe25aa"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:44.541221 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:44.541221 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:44.550307 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-0d2e9d03-0719-4daf-acb4-55acd43d14ef tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] HTTP exception thrown: Instance 823cc05f-c81f-4858-a129-0ec31b24b72d could not be found. Jan 22 21:05:44.551115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d2e9d03-0719-4daf-acb4-55acd43d14ef tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Returning 404 to user: Instance 823cc05f-c81f-4858-a129-0ec31b24b72d could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:44.551398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5f423e33-e495-4adb-bec5-038186bab648 req-b51fad8f-b704-4d13-88aa-bc57d4259685 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.551743 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d2e9d03-0719-4daf-acb4-55acd43d14ef tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 404 len: 111 microversion: 2.1 time: 0.033235 Jan 22 21:05:44.551861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5f423e33-e495-4adb-bec5-038186bab648 req-b51fad8f-b704-4d13-88aa-bc57d4259685 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.552731 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1011/1930] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:44 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:44.564984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e25dd0b9-cdc2-43c9-aa24-99a14552fdc0 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:44.578524 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-5f423e33-e495-4adb-bec5-038186bab648 req-b51fad8f-b704-4d13-88aa-bc57d4259685 service nova] Creating event network-vif-deleted:031b57a9-ce17-4f21-abb9-0e430b71022e for instance fa05d9e2-ba22-4fe8-abc7-66b9054b1812 on nch1-master-1 Jan 22 21:05:44.579625 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-5f423e33-e495-4adb-bec5-038186bab648 req-b51fad8f-b704-4d13-88aa-bc57d4259685 service nova] Creating event network-vif-deleted:013ea813-6494-4b47-920d-46a8e54336d3 for instance 823cc05f-c81f-4858-a129-0ec31b24b72d on nch2-master-1 Jan 22 21:05:44.580308 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-5f423e33-e495-4adb-bec5-038186bab648 req-b51fad8f-b704-4d13-88aa-bc57d4259685 service nova] Creating event network-vif-deleted:e6c739de-7e2a-4917-90a5-dd2e9abe25aa for instance 898fa5e5-16ac-437f-af78-9a70e358f284 on nch1-master-1 Jan 22 21:05:44.581673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.compute.server_groups [None req-e25dd0b9-cdc2-43c9-aa24-99a14552fdc0 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Querying cell 52f5c6ef-d4de-4047-a310-d7aef14748aa(cell1) for 1 instances {{(pid=137032) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Jan 22 21:05:44.582709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e25dd0b9-cdc2-43c9-aa24-99a14552fdc0 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.583313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e25dd0b9-cdc2-43c9-aa24-99a14552fdc0 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.602359 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-5f423e33-e495-4adb-bec5-038186bab648 req-b51fad8f-b704-4d13-88aa-bc57d4259685 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.059731 Jan 22 21:05:44.602359 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 920/1931] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:05:44.602359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b29c0bfb-c8c4-4bea-92a0-209966cd0b7e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:44.602359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b29c0bfb-c8c4-4bea-92a0-209966cd0b7e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:44.604112 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e25dd0b9-cdc2-43c9-aa24-99a14552fdc0 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.041426 Jan 22 21:05:44.604112 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1012/1932] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:05:44 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:05:44.610039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b29c0bfb-c8c4-4bea-92a0-209966cd0b7e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.610842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b29c0bfb-c8c4-4bea-92a0-209966cd0b7e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.611673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b29c0bfb-c8c4-4bea-92a0-209966cd0b7e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.612120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b29c0bfb-c8c4-4bea-92a0-209966cd0b7e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.614108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f249becb-d014-48cd-bc57-d0d1998bc4fd tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:44.635387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.compute.server_groups [None req-f249becb-d014-48cd-bc57-d0d1998bc4fd tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Querying cell 52f5c6ef-d4de-4047-a310-d7aef14748aa(cell1) for 1 instances {{(pid=137032) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Jan 22 21:05:44.636241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f249becb-d014-48cd-bc57-d0d1998bc4fd tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.636693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f249becb-d014-48cd-bc57-d0d1998bc4fd tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.654244 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f249becb-d014-48cd-bc57-d0d1998bc4fd tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/os-server-groups/a6edec4b-d32a-4344-9bb7-34e237833a35" status: 200 len: 183 microversion: 2.1 time: 0.043566 Jan 22 21:05:44.654984 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1013/1933] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:05:44 2022] GET /compute/v2.1/os-server-groups/a6edec4b-d32a-4344-9bb7-34e237833a35 => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:44.659870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4400d1c7-afd2-4695-86af-ff60c06ce51e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:44.661201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4400d1c7-afd2-4695-86af-ff60c06ce51e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:44.663495 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b29c0bfb-c8c4-4bea-92a0-209966cd0b7e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.068257 Jan 22 21:05:44.664154 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 921/1934] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:44 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:44.669889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b88bb9d6-dea3-437d-bc87-727be347097b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:44.670489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b88bb9d6-dea3-437d-bc87-727be347097b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:44.673534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4400d1c7-afd2-4695-86af-ff60c06ce51e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.674461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4400d1c7-afd2-4695-86af-ff60c06ce51e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.675282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4400d1c7-afd2-4695-86af-ff60c06ce51e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.675737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4400d1c7-afd2-4695-86af-ff60c06ce51e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.677966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b88bb9d6-dea3-437d-bc87-727be347097b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.678481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b88bb9d6-dea3-437d-bc87-727be347097b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.679309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b88bb9d6-dea3-437d-bc87-727be347097b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.680582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b88bb9d6-dea3-437d-bc87-727be347097b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.709784 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-b88bb9d6-dea3-437d-bc87-727be347097b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] HTTP exception thrown: Instance 823cc05f-c81f-4858-a129-0ec31b24b72d could not be found. Jan 22 21:05:44.710673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b88bb9d6-dea3-437d-bc87-727be347097b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Returning 404 to user: Instance 823cc05f-c81f-4858-a129-0ec31b24b72d could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:44.711823 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b88bb9d6-dea3-437d-bc87-727be347097b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "DELETE /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 404 len: 111 microversion: 2.1 time: 0.046179 Jan 22 21:05:44.713444 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 922/1935] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:05:44 2022] DELETE /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:44.721764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ac6f904-d966-4a59-a042-53c510e385ec tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:44.722729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3ac6f904-d966-4a59-a042-53c510e385ec tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] [instance: 823cc05f-c81f-4858-a129-0ec31b24b72d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:44.730677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ac6f904-d966-4a59-a042-53c510e385ec tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.731136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ac6f904-d966-4a59-a042-53c510e385ec tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.731943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ac6f904-d966-4a59-a042-53c510e385ec tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:44.732422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ac6f904-d966-4a59-a042-53c510e385ec tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:44.733948 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4400d1c7-afd2-4695-86af-ff60c06ce51e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.073309 Jan 22 21:05:44.734641 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1014/1936] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:44 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:44.749466 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-3ac6f904-d966-4a59-a042-53c510e385ec tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] HTTP exception thrown: Instance 823cc05f-c81f-4858-a129-0ec31b24b72d could not be found. Jan 22 21:05:44.750066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ac6f904-d966-4a59-a042-53c510e385ec tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Returning 404 to user: Instance 823cc05f-c81f-4858-a129-0ec31b24b72d could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:44.751035 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3ac6f904-d966-4a59-a042-53c510e385ec tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d" status: 404 len: 111 microversion: 2.1 time: 0.033265 Jan 22 21:05:44.751686 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 923/1937] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:44 2022] GET /compute/v2.1/servers/823cc05f-c81f-4858-a129-0ec31b24b72d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:44.766029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-213fd161-381f-41cb-bfdd-f55eb434a6f5 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:44.773384 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-213fd161-381f-41cb-bfdd-f55eb434a6f5 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] HTTP exception thrown: Instance group 948eae61-b516-4a6d-b7c3-ba83b5428d7b could not be found. Jan 22 21:05:44.774632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-213fd161-381f-41cb-bfdd-f55eb434a6f5 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Returning 404 to user: Instance group 948eae61-b516-4a6d-b7c3-ba83b5428d7b could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:44.776282 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-213fd161-381f-41cb-bfdd-f55eb434a6f5 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "DELETE /compute/v2.1/os-server-groups/948eae61-b516-4a6d-b7c3-ba83b5428d7b" status: 404 len: 117 microversion: 2.1 time: 0.014485 Jan 22 21:05:44.776962 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1015/1938] 10.222.0.100 () {58 vars in 1270 bytes} [Sat Jan 22 21:05:44 2022] DELETE /compute/v2.1/os-server-groups/948eae61-b516-4a6d-b7c3-ba83b5428d7b => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:44.789537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-50bc1d8b-f4ad-4ddd-934a-6b5bfe9d3c74 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:44.797470 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-50bc1d8b-f4ad-4ddd-934a-6b5bfe9d3c74 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] HTTP exception thrown: Instance group fee67fa0-c4b1-4df1-87a0-868c2e256f8a could not be found. Jan 22 21:05:44.798095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-50bc1d8b-f4ad-4ddd-934a-6b5bfe9d3c74 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Returning 404 to user: Instance group fee67fa0-c4b1-4df1-87a0-868c2e256f8a could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:44.799232 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-50bc1d8b-f4ad-4ddd-934a-6b5bfe9d3c74 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "DELETE /compute/v2.1/os-server-groups/fee67fa0-c4b1-4df1-87a0-868c2e256f8a" status: 404 len: 117 microversion: 2.1 time: 0.014904 Jan 22 21:05:44.799943 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 924/1939] 10.222.0.100 () {58 vars in 1270 bytes} [Sat Jan 22 21:05:44 2022] DELETE /compute/v2.1/os-server-groups/fee67fa0-c4b1-4df1-87a0-868c2e256f8a => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:44.808550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fde18dc3-44dc-4ff5-8635-d42e166eee5b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:44.816735 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-fde18dc3-44dc-4ff5-8635-d42e166eee5b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] HTTP exception thrown: Instance group a844f7c3-bbad-49a7-8896-323005f1d175 could not be found. Jan 22 21:05:44.817325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fde18dc3-44dc-4ff5-8635-d42e166eee5b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Returning 404 to user: Instance group a844f7c3-bbad-49a7-8896-323005f1d175 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:44.818183 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fde18dc3-44dc-4ff5-8635-d42e166eee5b tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "DELETE /compute/v2.1/os-server-groups/a844f7c3-bbad-49a7-8896-323005f1d175" status: 404 len: 117 microversion: 2.1 time: 0.013694 Jan 22 21:05:44.818931 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1016/1940] 10.222.0.100 () {58 vars in 1270 bytes} [Sat Jan 22 21:05:44 2022] DELETE /compute/v2.1/os-server-groups/a844f7c3-bbad-49a7-8896-323005f1d175 => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:44.831670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc652eac-8f11-488b-a90c-97f9761cfaa1 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:44.839142 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-bc652eac-8f11-488b-a90c-97f9761cfaa1 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] HTTP exception thrown: Instance group 25bf129f-b6da-46a1-9c35-f0f8f5acb2ed could not be found. Jan 22 21:05:44.840014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc652eac-8f11-488b-a90c-97f9761cfaa1 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Returning 404 to user: Instance group 25bf129f-b6da-46a1-9c35-f0f8f5acb2ed could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:44.841113 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bc652eac-8f11-488b-a90c-97f9761cfaa1 tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "DELETE /compute/v2.1/os-server-groups/25bf129f-b6da-46a1-9c35-f0f8f5acb2ed" status: 404 len: 117 microversion: 2.1 time: 0.013219 Jan 22 21:05:44.841886 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 925/1941] 10.222.0.100 () {58 vars in 1270 bytes} [Sat Jan 22 21:05:44 2022] DELETE /compute/v2.1/os-server-groups/25bf129f-b6da-46a1-9c35-f0f8f5acb2ed => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:44.849873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3770f7e-e2b2-4350-bcfa-ff4baa1f637a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:44.968922 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d3770f7e-e2b2-4350-bcfa-ff4baa1f637a tempest-ServerGroupTestJSON-1523297667 tempest-ServerGroupTestJSON-1523297667-project] 10.222.0.100 "DELETE /compute/v2.1/os-server-groups/a6edec4b-d32a-4344-9bb7-34e237833a35" status: 204 len: 0 microversion: 2.1 time: 0.122584 Jan 22 21:05:44.969527 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1017/1942] 10.222.0.100 () {58 vars in 1270 bytes} [Sat Jan 22 21:05:44 2022] DELETE /compute/v2.1/os-server-groups/a6edec4b-d32a-4344-9bb7-34e237833a35 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:45.053353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f20dda9a-560d-4451-80fe-2bb3e302d6e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:45.054261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f20dda9a-560d-4451-80fe-2bb3e302d6e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: 898fa5e5-16ac-437f-af78-9a70e358f284] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:45.061141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f20dda9a-560d-4451-80fe-2bb3e302d6e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:45.061629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f20dda9a-560d-4451-80fe-2bb3e302d6e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:45.062447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f20dda9a-560d-4451-80fe-2bb3e302d6e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:45.063155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f20dda9a-560d-4451-80fe-2bb3e302d6e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:45.078524 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-f20dda9a-560d-4451-80fe-2bb3e302d6e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] HTTP exception thrown: Instance 898fa5e5-16ac-437f-af78-9a70e358f284 could not be found. Jan 22 21:05:45.079132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f20dda9a-560d-4451-80fe-2bb3e302d6e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Returning 404 to user: Instance 898fa5e5-16ac-437f-af78-9a70e358f284 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:45.079978 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f20dda9a-560d-4451-80fe-2bb3e302d6e0 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284" status: 404 len: 111 microversion: 2.1 time: 0.030424 Jan 22 21:05:45.080533 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 926/1943] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:45 2022] GET /compute/v2.1/servers/898fa5e5-16ac-437f-af78-9a70e358f284 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:05:45.088463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0654bc80-aa99-48d1-a5a8-bd6a0311f907 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:45.089091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0654bc80-aa99-48d1-a5a8-bd6a0311f907 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:45.096356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0654bc80-aa99-48d1-a5a8-bd6a0311f907 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:45.098832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0654bc80-aa99-48d1-a5a8-bd6a0311f907 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:45.098832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0654bc80-aa99-48d1-a5a8-bd6a0311f907 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:45.098832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0654bc80-aa99-48d1-a5a8-bd6a0311f907 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:45.132872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0654bc80-aa99-48d1-a5a8-bd6a0311f907 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:05:45.519609 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0654bc80-aa99-48d1-a5a8-bd6a0311f907 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "DELETE /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 204 len: 0 microversion: 2.1 time: 0.434600 Jan 22 21:05:45.525664 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1018/1944] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:05:45 2022] DELETE /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:45.528965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c686fef1-cf07-4930-a5c2-0ea1b3830dfa tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:45.529529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c686fef1-cf07-4930-a5c2-0ea1b3830dfa tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:45.544890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c686fef1-cf07-4930-a5c2-0ea1b3830dfa tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:45.545877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c686fef1-cf07-4930-a5c2-0ea1b3830dfa tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:45.546351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c686fef1-cf07-4930-a5c2-0ea1b3830dfa tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:45.546812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c686fef1-cf07-4930-a5c2-0ea1b3830dfa tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:45.675955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0685d1f9-61bd-4dd4-995e-976f13cb7240 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:45.677098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0685d1f9-61bd-4dd4-995e-976f13cb7240 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:45.684154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0685d1f9-61bd-4dd4-995e-976f13cb7240 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:45.684652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0685d1f9-61bd-4dd4-995e-976f13cb7240 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:45.685539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0685d1f9-61bd-4dd4-995e-976f13cb7240 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:45.685994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0685d1f9-61bd-4dd4-995e-976f13cb7240 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:45.747952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c686fef1-cf07-4930-a5c2-0ea1b3830dfa tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:45.753157 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0685d1f9-61bd-4dd4-995e-976f13cb7240 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.079837 Jan 22 21:05:45.755132 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1019/1945] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:45 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:45.762261 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c686fef1-cf07-4930-a5c2-0ea1b3830dfa tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1472 microversion: 2.1 time: 0.237725 Jan 22 21:05:45.763808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e2878b94-6592-4499-ae70-48bb609525d4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:45.766388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e2878b94-6592-4499-ae70-48bb609525d4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:45.768108 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 927/1946] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:45 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1472 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:45.778293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2878b94-6592-4499-ae70-48bb609525d4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:45.778838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2878b94-6592-4499-ae70-48bb609525d4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:45.779905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2878b94-6592-4499-ae70-48bb609525d4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:45.780561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2878b94-6592-4499-ae70-48bb609525d4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:45.828020 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e2878b94-6592-4499-ae70-48bb609525d4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.070981 Jan 22 21:05:45.828675 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1020/1947] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:45 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:46.768282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3800f028-a991-4435-a2c0-0d581d8805df tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:46.769977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3800f028-a991-4435-a2c0-0d581d8805df tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:46.780886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3800f028-a991-4435-a2c0-0d581d8805df tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:46.781541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3800f028-a991-4435-a2c0-0d581d8805df tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:46.782466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-91ea1b9f-5d9c-49f5-bf6a-a127f39ee32c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:46.783280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3800f028-a991-4435-a2c0-0d581d8805df tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:46.783441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-91ea1b9f-5d9c-49f5-bf6a-a127f39ee32c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:46.783599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3800f028-a991-4435-a2c0-0d581d8805df tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:46.792337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91ea1b9f-5d9c-49f5-bf6a-a127f39ee32c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:46.792790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91ea1b9f-5d9c-49f5-bf6a-a127f39ee32c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:46.793616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91ea1b9f-5d9c-49f5-bf6a-a127f39ee32c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:46.794059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91ea1b9f-5d9c-49f5-bf6a-a127f39ee32c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:46.835928 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3800f028-a991-4435-a2c0-0d581d8805df tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.073982 Jan 22 21:05:46.837058 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 928/1948] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:46 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:46.845318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5f5a3d18-1c6a-4fe2-94a9-f2fe1ff487d3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:46.847065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5f5a3d18-1c6a-4fe2-94a9-f2fe1ff487d3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:46.855377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f5a3d18-1c6a-4fe2-94a9-f2fe1ff487d3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:46.856413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f5a3d18-1c6a-4fe2-94a9-f2fe1ff487d3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:46.861053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f5a3d18-1c6a-4fe2-94a9-f2fe1ff487d3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:46.861053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f5a3d18-1c6a-4fe2-94a9-f2fe1ff487d3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:46.923328 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5f5a3d18-1c6a-4fe2-94a9-f2fe1ff487d3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.083425 Jan 22 21:05:46.924071 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 929/1949] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:46 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:47.001447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-91ea1b9f-5d9c-49f5-bf6a-a127f39ee32c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:47.009928 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-91ea1b9f-5d9c-49f5-bf6a-a127f39ee32c tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1472 microversion: 2.1 time: 0.231524 Jan 22 21:05:47.010621 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1021/1950] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:46 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1472 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:47.863871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-6c3594a9-46e3-4ac7-b2a2-ad8c9bd2a8ca req-c85fb643-b506-496c-8915-931fbfdbd698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28df35b-8a9a-4010-aa14-89cc18350ba9", "name": "network-vif-deleted", "tag": "e3a1c234-0a19-4371-944f-202cc47a018b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:47.869693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f7d2b62d-2a6f-4839-9472-f9a6b3651ca8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:47.874101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f7d2b62d-2a6f-4839-9472-f9a6b3651ca8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:47.884948 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:47.884948 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:47.898205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2b62d-2a6f-4839-9472-f9a6b3651ca8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:47.899605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2b62d-2a6f-4839-9472-f9a6b3651ca8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:47.901925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2b62d-2a6f-4839-9472-f9a6b3651ca8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:47.904254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2b62d-2a6f-4839-9472-f9a6b3651ca8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:47.907352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6c3594a9-46e3-4ac7-b2a2-ad8c9bd2a8ca req-c85fb643-b506-496c-8915-931fbfdbd698 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:47.908290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6c3594a9-46e3-4ac7-b2a2-ad8c9bd2a8ca req-c85fb643-b506-496c-8915-931fbfdbd698 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:47.952349 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-6c3594a9-46e3-4ac7-b2a2-ad8c9bd2a8ca req-c85fb643-b506-496c-8915-931fbfdbd698 service nova] Creating event network-vif-deleted:e3a1c234-0a19-4371-944f-202cc47a018b for instance b28df35b-8a9a-4010-aa14-89cc18350ba9 on nch1-master-1 Jan 22 21:05:47.966037 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-6c3594a9-46e3-4ac7-b2a2-ad8c9bd2a8ca req-c85fb643-b506-496c-8915-931fbfdbd698 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116441 Jan 22 21:05:47.970976 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1022/1951] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:48.006594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-690e7478-b70b-4fb8-af46-2433d837294d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:48.020385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-690e7478-b70b-4fb8-af46-2433d837294d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:48.034369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-690e7478-b70b-4fb8-af46-2433d837294d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:48.035820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-690e7478-b70b-4fb8-af46-2433d837294d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:48.042526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-690e7478-b70b-4fb8-af46-2433d837294d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:48.043675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-690e7478-b70b-4fb8-af46-2433d837294d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:48.046677 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f7d2b62d-2a6f-4839-9472-f9a6b3651ca8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.200982 Jan 22 21:05:48.052412 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 930/1952] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:47 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:48.078813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-526c7212-73d0-4030-b334-54f66bbc2405 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:48.080610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-526c7212-73d0-4030-b334-54f66bbc2405 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:48.127002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-526c7212-73d0-4030-b334-54f66bbc2405 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:48.127430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-526c7212-73d0-4030-b334-54f66bbc2405 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:48.128223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-526c7212-73d0-4030-b334-54f66bbc2405 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:48.133655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-526c7212-73d0-4030-b334-54f66bbc2405 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:48.137390 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-690e7478-b70b-4fb8-af46-2433d837294d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.165700 Jan 22 21:05:48.139217 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1023/1953] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:47 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:48.301209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-526c7212-73d0-4030-b334-54f66bbc2405 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:48.315058 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-526c7212-73d0-4030-b334-54f66bbc2405 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1430 microversion: 2.1 time: 0.258745 Jan 22 21:05:48.316250 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 931/1954] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:48 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1430 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:48.368035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a9f77e32-b744-4dfe-8acc-13a8de0f4a0f tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-54665495", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": "none"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:48.463413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a9f77e32-b744-4dfe-8acc-13a8de0f4a0f tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:05:48.463999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a9f77e32-b744-4dfe-8acc-13a8de0f4a0f tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:05:48.464354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a9f77e32-b744-4dfe-8acc-13a8de0f4a0f tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:05:48.464770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a9f77e32-b744-4dfe-8acc-13a8de0f4a0f tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:05:48.465314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a9f77e32-b744-4dfe-8acc-13a8de0f4a0f tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:05:48.479567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9f77e32-b744-4dfe-8acc-13a8de0f4a0f tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:48.480587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9f77e32-b744-4dfe-8acc-13a8de0f4a0f tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:48.481606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9f77e32-b744-4dfe-8acc-13a8de0f4a0f tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:48.484291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9f77e32-b744-4dfe-8acc-13a8de0f4a0f tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:48.506595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-a9f77e32-b744-4dfe-8acc-13a8de0f4a0f tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Getting quotas for project aa53b2bab5c64af1bb78c31e5a26ca92. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:48.512904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-a9f77e32-b744-4dfe-8acc-13a8de0f4a0f tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Getting quotas for user 1b74ff418e2a4e8882eae509bd43327f and project aa53b2bab5c64af1bb78c31e5a26ca92. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:48.532353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a9f77e32-b744-4dfe-8acc-13a8de0f4a0f tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:05:48.535080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a9f77e32-b744-4dfe-8acc-13a8de0f4a0f tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 1260ec05-fff7-40c2-a069-43c9b36db3ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:05:48.652734 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a9f77e32-b744-4dfe-8acc-13a8de0f4a0f tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.47 time: 0.511249 Jan 22 21:05:48.653614 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1024/1955] 10.222.0.100 () {62 vars in 1192 bytes} [Sat Jan 22 21:05:48 2022] POST /compute/v2.1/servers => generated 382 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 22 21:05:48.663414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-55fe3ddc-cdc1-46a0-9af5-0b63c7772207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:48.664029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-55fe3ddc-cdc1-46a0-9af5-0b63c7772207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 1260ec05-fff7-40c2-a069-43c9b36db3ca] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:48.745921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-55fe3ddc-cdc1-46a0-9af5-0b63c7772207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:48.769094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-55fe3ddc-cdc1-46a0-9af5-0b63c7772207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:48.770654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-55fe3ddc-cdc1-46a0-9af5-0b63c7772207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:48.771952 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-55fe3ddc-cdc1-46a0-9af5-0b63c7772207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/1260ec05-fff7-40c2-a069-43c9b36db3ca" status: 200 len: 1279 microversion: 2.47 time: 0.112358 Jan 22 21:05:48.785527 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 932/1956] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:48 2022] GET /compute/v2.1/servers/1260ec05-fff7-40c2-a069-43c9b36db3ca => generated 1279 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:48.854272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-56c4fc45-343c-465b-92bd-0f2bd4363ba4 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-849280293", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": "none"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:48.938683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-56c4fc45-343c-465b-92bd-0f2bd4363ba4 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:05:48.939281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-56c4fc45-343c-465b-92bd-0f2bd4363ba4 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:05:48.939595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-56c4fc45-343c-465b-92bd-0f2bd4363ba4 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:05:48.940023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-56c4fc45-343c-465b-92bd-0f2bd4363ba4 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:05:48.940711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-56c4fc45-343c-465b-92bd-0f2bd4363ba4 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:05:48.951493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56c4fc45-343c-465b-92bd-0f2bd4363ba4 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:48.951958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56c4fc45-343c-465b-92bd-0f2bd4363ba4 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:48.952812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56c4fc45-343c-465b-92bd-0f2bd4363ba4 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:48.953389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56c4fc45-343c-465b-92bd-0f2bd4363ba4 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:48.971601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-56c4fc45-343c-465b-92bd-0f2bd4363ba4 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Getting quotas for project aa53b2bab5c64af1bb78c31e5a26ca92. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:48.976602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-56c4fc45-343c-465b-92bd-0f2bd4363ba4 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Getting quotas for user 1b74ff418e2a4e8882eae509bd43327f and project aa53b2bab5c64af1bb78c31e5a26ca92. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:48.989856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-56c4fc45-343c-465b-92bd-0f2bd4363ba4 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:05:48.992112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-56c4fc45-343c-465b-92bd-0f2bd4363ba4 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:05:49.065937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96366361-8a9f-4bcb-b08b-a2daea6748d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:49.067136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96366361-8a9f-4bcb-b08b-a2daea6748d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:49.075525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96366361-8a9f-4bcb-b08b-a2daea6748d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:49.076048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96366361-8a9f-4bcb-b08b-a2daea6748d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:49.077071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96366361-8a9f-4bcb-b08b-a2daea6748d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:49.077536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96366361-8a9f-4bcb-b08b-a2daea6748d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:49.165857 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96366361-8a9f-4bcb-b08b-a2daea6748d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.104079 Jan 22 21:05:49.166989 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 933/1957] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:49 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:05:49.173145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-13b9d39f-2e43-45d1-8225-2a9a4ae8fea6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:49.174622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-13b9d39f-2e43-45d1-8225-2a9a4ae8fea6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:49.184100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13b9d39f-2e43-45d1-8225-2a9a4ae8fea6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:49.184623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13b9d39f-2e43-45d1-8225-2a9a4ae8fea6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:49.185594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13b9d39f-2e43-45d1-8225-2a9a4ae8fea6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:49.186184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13b9d39f-2e43-45d1-8225-2a9a4ae8fea6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:49.231677 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-13b9d39f-2e43-45d1-8225-2a9a4ae8fea6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.062701 Jan 22 21:05:49.235594 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 934/1958] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:49 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:49.237251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-54e8d7c5-cdcc-45b9-ab58-267331c2cd06 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:49.237871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-54e8d7c5-cdcc-45b9-ab58-267331c2cd06 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:49.246010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54e8d7c5-cdcc-45b9-ab58-267331c2cd06 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:49.246461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54e8d7c5-cdcc-45b9-ab58-267331c2cd06 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:49.247575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54e8d7c5-cdcc-45b9-ab58-267331c2cd06 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:49.248033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54e8d7c5-cdcc-45b9-ab58-267331c2cd06 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:49.273838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-54e8d7c5-cdcc-45b9-ab58-267331c2cd06 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:05:49.447727 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-56c4fc45-343c-465b-92bd-0f2bd4363ba4 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.47 time: 0.598114 Jan 22 21:05:49.448687 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1025/1959] 10.222.0.100 () {62 vars in 1192 bytes} [Sat Jan 22 21:05:48 2022] POST /compute/v2.1/servers => generated 382 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 22 21:05:49.453577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5547144f-6d54-44bf-803a-4184385da3a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:49.454844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5547144f-6d54-44bf-803a-4184385da3a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:49.461334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5547144f-6d54-44bf-803a-4184385da3a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:49.463481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5547144f-6d54-44bf-803a-4184385da3a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:49.464340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5547144f-6d54-44bf-803a-4184385da3a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:49.465188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5547144f-6d54-44bf-803a-4184385da3a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:49.524364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5547144f-6d54-44bf-803a-4184385da3a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:49.526011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5547144f-6d54-44bf-803a-4184385da3a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:49.526536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-5547144f-6d54-44bf-803a-4184385da3a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lazy-loading 'fault' on Instance uuid b28df35b-8a9a-4010-aa14-89cc18350ba9 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:49.581175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5547144f-6d54-44bf-803a-4184385da3a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e062e80dcda4118963156134c040e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2566e2caf61643f7b603b8ab8f81e193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:49.590557 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5547144f-6d54-44bf-803a-4184385da3a7 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 200 len: 1307 microversion: 2.1 time: 0.140583 Jan 22 21:05:49.591424 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1026/1960] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:49 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 1307 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:49.603980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-649e1771-512d-4059-a652-7b9383b7e6a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:49.604693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-649e1771-512d-4059-a652-7b9383b7e6a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:49.611657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-649e1771-512d-4059-a652-7b9383b7e6a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:49.612118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-649e1771-512d-4059-a652-7b9383b7e6a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:49.612916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-649e1771-512d-4059-a652-7b9383b7e6a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:49.613385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-649e1771-512d-4059-a652-7b9383b7e6a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:49.645651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-649e1771-512d-4059-a652-7b9383b7e6a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:05:49.707992 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-54e8d7c5-cdcc-45b9-ab58-267331c2cd06 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 204 len: 0 microversion: 2.25 time: 0.474253 Jan 22 21:05:49.708589 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 935/1961] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:05:49 2022] DELETE /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:05:49.716373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-472c4266-0fcc-49f5-b2a4-c6ae710dab32 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:49.718071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-472c4266-0fcc-49f5-b2a4-c6ae710dab32 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:49.759934 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-472c4266-0fcc-49f5-b2a4-c6ae710dab32 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "PUT /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 994 microversion: 2.47 time: 0.049119 Jan 22 21:05:49.760833 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 936/1962] 10.222.0.100 () {62 vars in 1301 bytes} [Sat Jan 22 21:05:49 2022] PUT /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 994 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:49.766089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5b23f1ec-6731-4821-a1b0-7506aa07913b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:49.766764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5b23f1ec-6731-4821-a1b0-7506aa07913b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:49.773853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b23f1ec-6731-4821-a1b0-7506aa07913b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:49.780126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b23f1ec-6731-4821-a1b0-7506aa07913b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:49.780126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b23f1ec-6731-4821-a1b0-7506aa07913b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:49.780126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b23f1ec-6731-4821-a1b0-7506aa07913b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:49.937369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5b23f1ec-6731-4821-a1b0-7506aa07913b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:49.945552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5b23f1ec-6731-4821-a1b0-7506aa07913b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:49.947395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5b23f1ec-6731-4821-a1b0-7506aa07913b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:49.948573 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5b23f1ec-6731-4821-a1b0-7506aa07913b tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1568 microversion: 2.25 time: 0.186385 Jan 22 21:05:49.960214 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 937/1963] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:49 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:49.965441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f85b87f-b5dc-47d0-80ce-afa469e8b91b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:49.966349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9f85b87f-b5dc-47d0-80ce-afa469e8b91b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:49.980937 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-649e1771-512d-4059-a652-7b9383b7e6a4 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "DELETE /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 204 len: 0 microversion: 2.1 time: 0.384891 Jan 22 21:05:49.984742 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1027/1964] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:05:49 2022] DELETE /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:49.998054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-434f4059-4e07-448c-bc22-af5141b2fd05 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:49.998951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-434f4059-4e07-448c-bc22-af5141b2fd05 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:50.012357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-434f4059-4e07-448c-bc22-af5141b2fd05 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:50.014165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-434f4059-4e07-448c-bc22-af5141b2fd05 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:50.017775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-434f4059-4e07-448c-bc22-af5141b2fd05 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:50.018343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-434f4059-4e07-448c-bc22-af5141b2fd05 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:50.027313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9f85b87f-b5dc-47d0-80ce-afa469e8b91b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:50.037288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9f85b87f-b5dc-47d0-80ce-afa469e8b91b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:50.038928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9f85b87f-b5dc-47d0-80ce-afa469e8b91b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:50.040400 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9f85b87f-b5dc-47d0-80ce-afa469e8b91b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1280 microversion: 2.47 time: 0.078768 Jan 22 21:05:50.041223 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 938/1965] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:49 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:50.177861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a2b4940-7dcf-4b8d-920f-3b93162071dc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:50.179595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9a2b4940-7dcf-4b8d-920f-3b93162071dc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:50.191067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a2b4940-7dcf-4b8d-920f-3b93162071dc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:50.192768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a2b4940-7dcf-4b8d-920f-3b93162071dc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:50.193808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a2b4940-7dcf-4b8d-920f-3b93162071dc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:50.194414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a2b4940-7dcf-4b8d-920f-3b93162071dc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:50.227116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-434f4059-4e07-448c-bc22-af5141b2fd05 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:50.234760 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-434f4059-4e07-448c-bc22-af5141b2fd05 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1504 microversion: 2.1 time: 0.248054 Jan 22 21:05:50.237835 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1028/1966] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:49 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1504 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:50.243168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7425998f-0abd-4a93-adea-8fdf03c36608 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:50.245002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7425998f-0abd-4a93-adea-8fdf03c36608 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:50.251370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7425998f-0abd-4a93-adea-8fdf03c36608 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:50.251830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7425998f-0abd-4a93-adea-8fdf03c36608 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:50.252656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7425998f-0abd-4a93-adea-8fdf03c36608 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:50.253148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7425998f-0abd-4a93-adea-8fdf03c36608 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:50.267318 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a2b4940-7dcf-4b8d-920f-3b93162071dc tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.092555 Jan 22 21:05:50.270588 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 939/1967] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:50 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:50.299726 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7425998f-0abd-4a93-adea-8fdf03c36608 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.059873 Jan 22 21:05:50.303385 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1029/1968] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:50 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:50.609588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f469c391-1df1-4d8b-a3d5-e75e862c8d29 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:50.610355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f469c391-1df1-4d8b-a3d5-e75e862c8d29 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] [instance: b28df35b-8a9a-4010-aa14-89cc18350ba9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:50.625549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f469c391-1df1-4d8b-a3d5-e75e862c8d29 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:50.626126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f469c391-1df1-4d8b-a3d5-e75e862c8d29 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:50.626987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f469c391-1df1-4d8b-a3d5-e75e862c8d29 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:50.627439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f469c391-1df1-4d8b-a3d5-e75e862c8d29 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:50.668734 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-f469c391-1df1-4d8b-a3d5-e75e862c8d29 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] HTTP exception thrown: Instance b28df35b-8a9a-4010-aa14-89cc18350ba9 could not be found. Jan 22 21:05:50.669344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f469c391-1df1-4d8b-a3d5-e75e862c8d29 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] Returning 404 to user: Instance b28df35b-8a9a-4010-aa14-89cc18350ba9 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:50.670492 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f469c391-1df1-4d8b-a3d5-e75e862c8d29 tempest-ServersAdminTestJSON-410787410 tempest-ServersAdminTestJSON-410787410-project] 10.222.0.100 "GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9" status: 404 len: 111 microversion: 2.1 time: 0.066865 Jan 22 21:05:50.671481 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 940/1969] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:50 2022] GET /compute/v2.1/servers/b28df35b-8a9a-4010-aa14-89cc18350ba9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:50.970026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7deff65c-073b-4053-b55d-566850f22e55 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:50.970846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7deff65c-073b-4053-b55d-566850f22e55 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:50.988579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7deff65c-073b-4053-b55d-566850f22e55 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:50.992784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7deff65c-073b-4053-b55d-566850f22e55 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:50.995966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7deff65c-073b-4053-b55d-566850f22e55 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:50.997792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7deff65c-073b-4053-b55d-566850f22e55 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:51.062031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d1ca034f-6823-4a8c-acbc-8dd3ed961604 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:51.062662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d1ca034f-6823-4a8c-acbc-8dd3ed961604 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:51.074522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1ca034f-6823-4a8c-acbc-8dd3ed961604 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:51.075939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1ca034f-6823-4a8c-acbc-8dd3ed961604 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:51.086121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1ca034f-6823-4a8c-acbc-8dd3ed961604 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:51.087407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1ca034f-6823-4a8c-acbc-8dd3ed961604 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:51.261971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7deff65c-073b-4053-b55d-566850f22e55 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:51.279903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d1ca034f-6823-4a8c-acbc-8dd3ed961604 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:51.284687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7deff65c-073b-4053-b55d-566850f22e55 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:51.290878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d1ca034f-6823-4a8c-acbc-8dd3ed961604 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:51.291520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7deff65c-073b-4053-b55d-566850f22e55 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:51.294138 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7deff65c-073b-4053-b55d-566850f22e55 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1526 microversion: 2.25 time: 0.327946 Jan 22 21:05:51.294437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d1ca034f-6823-4a8c-acbc-8dd3ed961604 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:51.295918 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1030/1970] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:50 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1526 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:51.298070 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d1ca034f-6823-4a8c-acbc-8dd3ed961604 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1276 microversion: 2.47 time: 0.239874 Jan 22 21:05:51.298738 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 941/1971] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:51 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1276 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:51.310183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4057baa5-03b6-46fe-81b7-1566700a75cf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:51.310360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-90dd69ca-36b5-4c65-b6b6-51615a26a501 req-d42879d1-f92a-4070-a69a-b73a9e7d7c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d7803b5-681b-412b-9319-8aaaa574dca7", "name": "network-vif-deleted", "tag": "f8a5d460-d57a-48e0-bcf8-f5891049005c"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:51.311159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4057baa5-03b6-46fe-81b7-1566700a75cf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:51.314528 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:51.314528 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:51.327143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4057baa5-03b6-46fe-81b7-1566700a75cf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:51.335181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4057baa5-03b6-46fe-81b7-1566700a75cf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:51.335181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4057baa5-03b6-46fe-81b7-1566700a75cf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:51.335181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4057baa5-03b6-46fe-81b7-1566700a75cf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:51.346045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-90dd69ca-36b5-4c65-b6b6-51615a26a501 req-d42879d1-f92a-4070-a69a-b73a9e7d7c4d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:51.348566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-90dd69ca-36b5-4c65-b6b6-51615a26a501 req-d42879d1-f92a-4070-a69a-b73a9e7d7c4d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:51.381710 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-90dd69ca-36b5-4c65-b6b6-51615a26a501 req-d42879d1-f92a-4070-a69a-b73a9e7d7c4d service nova] Creating event network-vif-deleted:f8a5d460-d57a-48e0-bcf8-f5891049005c for instance 5d7803b5-681b-412b-9319-8aaaa574dca7 on nch1-master-1 Jan 22 21:05:51.388973 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-90dd69ca-36b5-4c65-b6b6-51615a26a501 req-d42879d1-f92a-4070-a69a-b73a9e7d7c4d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091482 Jan 22 21:05:51.411562 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1031/1972] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:51.422281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-403e3e15-450b-456d-8e3a-21ef154ae6a7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:51.423296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-403e3e15-450b-456d-8e3a-21ef154ae6a7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:51.437616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-403e3e15-450b-456d-8e3a-21ef154ae6a7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:51.438071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-403e3e15-450b-456d-8e3a-21ef154ae6a7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:51.438876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-403e3e15-450b-456d-8e3a-21ef154ae6a7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:51.439311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-403e3e15-450b-456d-8e3a-21ef154ae6a7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:51.532459 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-403e3e15-450b-456d-8e3a-21ef154ae6a7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.116335 Jan 22 21:05:51.541551 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1032/1973] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:51 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:51.549734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fa857341-2a2b-4b94-836c-662d5c52ebe5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:51.550752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fa857341-2a2b-4b94-836c-662d5c52ebe5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:51.556503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4057baa5-03b6-46fe-81b7-1566700a75cf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:51.565267 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4057baa5-03b6-46fe-81b7-1566700a75cf tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1504 microversion: 2.1 time: 0.265495 Jan 22 21:05:51.565965 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 942/1974] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:51 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:51.575359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa857341-2a2b-4b94-836c-662d5c52ebe5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:51.579525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa857341-2a2b-4b94-836c-662d5c52ebe5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:51.579525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa857341-2a2b-4b94-836c-662d5c52ebe5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:51.579525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa857341-2a2b-4b94-836c-662d5c52ebe5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:51.626792 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fa857341-2a2b-4b94-836c-662d5c52ebe5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.086861 Jan 22 21:05:51.636463 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1033/1975] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:51 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:52.046763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-94a2f887-934a-416c-9209-ed18d1dd42fd req-1fd1112b-cc2c-4fb7-9134-002fed95c8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "184726b1-102f-49b3-ae81-7b721c165473", "name": "network-vif-deleted", "tag": "a28676ad-ae18-4da0-ba64-c6c2ec99218f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:52.046763 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:52.046763 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:52.058964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-94a2f887-934a-416c-9209-ed18d1dd42fd req-1fd1112b-cc2c-4fb7-9134-002fed95c8e1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:52.059422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-94a2f887-934a-416c-9209-ed18d1dd42fd req-1fd1112b-cc2c-4fb7-9134-002fed95c8e1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:52.077050 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-94a2f887-934a-416c-9209-ed18d1dd42fd req-1fd1112b-cc2c-4fb7-9134-002fed95c8e1 service nova] Creating event network-vif-deleted:a28676ad-ae18-4da0-ba64-c6c2ec99218f for instance 184726b1-102f-49b3-ae81-7b721c165473 on nch1-master-1 Jan 22 21:05:52.082566 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-94a2f887-934a-416c-9209-ed18d1dd42fd req-1fd1112b-cc2c-4fb7-9134-002fed95c8e1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042818 Jan 22 21:05:52.083195 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 943/1976] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:05:52.313619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a6c8f6e0-7bad-40ea-861f-7fe2d4642d08 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:52.318511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a6c8f6e0-7bad-40ea-861f-7fe2d4642d08 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:52.327706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7244345f-90c7-4ee9-af50-5ecb4296d1cf tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:52.332731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7244345f-90c7-4ee9-af50-5ecb4296d1cf tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:52.350556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7244345f-90c7-4ee9-af50-5ecb4296d1cf tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:52.352129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6c8f6e0-7bad-40ea-861f-7fe2d4642d08 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:52.353565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7244345f-90c7-4ee9-af50-5ecb4296d1cf tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:52.354986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6c8f6e0-7bad-40ea-861f-7fe2d4642d08 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:52.356843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6c8f6e0-7bad-40ea-861f-7fe2d4642d08 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:52.360619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7244345f-90c7-4ee9-af50-5ecb4296d1cf tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:52.361691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6c8f6e0-7bad-40ea-861f-7fe2d4642d08 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:52.362475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7244345f-90c7-4ee9-af50-5ecb4296d1cf tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:52.453421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6c8f6e0-7bad-40ea-861f-7fe2d4642d08 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:52.453752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6c8f6e0-7bad-40ea-861f-7fe2d4642d08 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:52.460333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-a6c8f6e0-7bad-40ea-861f-7fe2d4642d08 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lazy-loading 'fault' on Instance uuid 5d7803b5-681b-412b-9319-8aaaa574dca7 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:52.480147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7244345f-90c7-4ee9-af50-5ecb4296d1cf tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:52.500219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7244345f-90c7-4ee9-af50-5ecb4296d1cf tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:52.503086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7244345f-90c7-4ee9-af50-5ecb4296d1cf tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:52.504271 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7244345f-90c7-4ee9-af50-5ecb4296d1cf tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1350 microversion: 2.47 time: 0.182860 Jan 22 21:05:52.504847 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 944/1977] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:52 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1350 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:05:52.524017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a6c8f6e0-7bad-40ea-861f-7fe2d4642d08 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:52.533455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a6c8f6e0-7bad-40ea-861f-7fe2d4642d08 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:52.534456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a6c8f6e0-7bad-40ea-861f-7fe2d4642d08 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:52.535895 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a6c8f6e0-7bad-40ea-861f-7fe2d4642d08 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 200 len: 1355 microversion: 2.25 time: 0.226336 Jan 22 21:05:52.536465 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1034/1978] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:52 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 1355 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:52.549924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-39eeae20-9727-43fc-b69b-3e1d3451058b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:52.550848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-39eeae20-9727-43fc-b69b-3e1d3451058b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:52.557653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39eeae20-9727-43fc-b69b-3e1d3451058b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:52.568011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39eeae20-9727-43fc-b69b-3e1d3451058b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:52.568011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39eeae20-9727-43fc-b69b-3e1d3451058b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:52.568011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39eeae20-9727-43fc-b69b-3e1d3451058b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:52.582942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1f623cde-a91f-4b84-afea-9fd5361d8132 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:52.583766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1f623cde-a91f-4b84-afea-9fd5361d8132 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:52.591595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f623cde-a91f-4b84-afea-9fd5361d8132 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:52.592370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f623cde-a91f-4b84-afea-9fd5361d8132 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:52.593409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f623cde-a91f-4b84-afea-9fd5361d8132 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:52.595013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f623cde-a91f-4b84-afea-9fd5361d8132 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:52.602186 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-39eeae20-9727-43fc-b69b-3e1d3451058b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.055705 Jan 22 21:05:52.607665 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 945/1979] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:52 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:52.630479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f623cde-a91f-4b84-afea-9fd5361d8132 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:52.631050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f623cde-a91f-4b84-afea-9fd5361d8132 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:52.631582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-1f623cde-a91f-4b84-afea-9fd5361d8132 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lazy-loading 'fault' on Instance uuid 184726b1-102f-49b3-ae81-7b721c165473 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:52.640003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-43330c19-f645-4dcf-b70c-5d0c69826062 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:52.641121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-43330c19-f645-4dcf-b70c-5d0c69826062 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:52.648105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43330c19-f645-4dcf-b70c-5d0c69826062 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:52.648571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43330c19-f645-4dcf-b70c-5d0c69826062 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:52.649371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43330c19-f645-4dcf-b70c-5d0c69826062 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:52.649869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43330c19-f645-4dcf-b70c-5d0c69826062 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:52.677810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1f623cde-a91f-4b84-afea-9fd5361d8132 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:52.687142 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1f623cde-a91f-4b84-afea-9fd5361d8132 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 200 len: 1305 microversion: 2.1 time: 0.107033 Jan 22 21:05:52.687940 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1035/1980] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:52 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:05:52.691369 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-43330c19-f645-4dcf-b70c-5d0c69826062 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.055321 Jan 22 21:05:52.692008 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 946/1981] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:52 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:05:53.525496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-48e09b55-9142-4c0f-9578-025194465bd9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:53.526202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-48e09b55-9142-4c0f-9578-025194465bd9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:53.532673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48e09b55-9142-4c0f-9578-025194465bd9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:53.533131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48e09b55-9142-4c0f-9578-025194465bd9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:53.540331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48e09b55-9142-4c0f-9578-025194465bd9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:53.542114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48e09b55-9142-4c0f-9578-025194465bd9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:53.554823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6c557c11-05f3-4e42-9fcd-31d8e80d6da8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:53.556780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6c557c11-05f3-4e42-9fcd-31d8e80d6da8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 5d7803b5-681b-412b-9319-8aaaa574dca7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:53.570016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c557c11-05f3-4e42-9fcd-31d8e80d6da8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:53.574077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c557c11-05f3-4e42-9fcd-31d8e80d6da8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:53.577747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c557c11-05f3-4e42-9fcd-31d8e80d6da8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:53.578496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c557c11-05f3-4e42-9fcd-31d8e80d6da8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:53.611920 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-6c557c11-05f3-4e42-9fcd-31d8e80d6da8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] HTTP exception thrown: Instance 5d7803b5-681b-412b-9319-8aaaa574dca7 could not be found. Jan 22 21:05:53.612540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6c557c11-05f3-4e42-9fcd-31d8e80d6da8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Returning 404 to user: Instance 5d7803b5-681b-412b-9319-8aaaa574dca7 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:53.615428 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6c557c11-05f3-4e42-9fcd-31d8e80d6da8 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7" status: 404 len: 111 microversion: 2.25 time: 0.065218 Jan 22 21:05:53.616133 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 947/1982] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:53 2022] GET /compute/v2.1/servers/5d7803b5-681b-412b-9319-8aaaa574dca7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 22 21:05:53.625691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-65cfd960-f066-46b9-97b8-6ff0849d0592 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:53.626937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-65cfd960-f066-46b9-97b8-6ff0849d0592 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:53.635431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65cfd960-f066-46b9-97b8-6ff0849d0592 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:53.635814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65cfd960-f066-46b9-97b8-6ff0849d0592 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:53.636626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65cfd960-f066-46b9-97b8-6ff0849d0592 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:53.637110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65cfd960-f066-46b9-97b8-6ff0849d0592 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:53.684569 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-65cfd960-f066-46b9-97b8-6ff0849d0592 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.064322 Jan 22 21:05:53.688591 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 948/1983] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:53 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:53.691579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0156d893-2fb8-4df4-8341-8b0b206bf1fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:53.692174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0156d893-2fb8-4df4-8341-8b0b206bf1fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:53.694741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-48e09b55-9142-4c0f-9578-025194465bd9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:53.703029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0156d893-2fb8-4df4-8341-8b0b206bf1fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:53.703984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0156d893-2fb8-4df4-8341-8b0b206bf1fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:53.704962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0156d893-2fb8-4df4-8341-8b0b206bf1fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:53.705417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0156d893-2fb8-4df4-8341-8b0b206bf1fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:53.713648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-48e09b55-9142-4c0f-9578-025194465bd9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:53.716084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-48e09b55-9142-4c0f-9578-025194465bd9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:53.718682 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-48e09b55-9142-4c0f-9578-025194465bd9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1338 microversion: 2.47 time: 0.196805 Jan 22 21:05:53.720369 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1036/1984] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:53 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1338 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:53.726918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-04c3929e-3fb0-4db7-889c-530e297c4843 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:53.729119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-04c3929e-3fb0-4db7-889c-530e297c4843 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:53.740849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04c3929e-3fb0-4db7-889c-530e297c4843 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:53.741615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04c3929e-3fb0-4db7-889c-530e297c4843 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:53.742685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0156d893-2fb8-4df4-8341-8b0b206bf1fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:05:53.744857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04c3929e-3fb0-4db7-889c-530e297c4843 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:53.745746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04c3929e-3fb0-4db7-889c-530e297c4843 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:53.819241 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-04c3929e-3fb0-4db7-889c-530e297c4843 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.096420 Jan 22 21:05:53.820413 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1037/1985] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:53 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:53.830179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c93e8f2f-0f39-4345-b526-995152d22ab1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:53.831401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c93e8f2f-0f39-4345-b526-995152d22ab1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 184726b1-102f-49b3-ae81-7b721c165473] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:53.844013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c93e8f2f-0f39-4345-b526-995152d22ab1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:53.844800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c93e8f2f-0f39-4345-b526-995152d22ab1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:53.847112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c93e8f2f-0f39-4345-b526-995152d22ab1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:53.848110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c93e8f2f-0f39-4345-b526-995152d22ab1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:53.866357 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-c93e8f2f-0f39-4345-b526-995152d22ab1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] HTTP exception thrown: Instance 184726b1-102f-49b3-ae81-7b721c165473 could not be found. Jan 22 21:05:53.867013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c93e8f2f-0f39-4345-b526-995152d22ab1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Returning 404 to user: Instance 184726b1-102f-49b3-ae81-7b721c165473 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:53.867877 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c93e8f2f-0f39-4345-b526-995152d22ab1 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473" status: 404 len: 111 microversion: 2.1 time: 0.045543 Jan 22 21:05:53.869041 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1038/1986] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:53 2022] GET /compute/v2.1/servers/184726b1-102f-49b3-ae81-7b721c165473 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:53.878459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aee4cf64-583b-4e21-995b-125d216a0c86 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:53.879248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aee4cf64-583b-4e21-995b-125d216a0c86 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:53.887321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aee4cf64-583b-4e21-995b-125d216a0c86 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:53.887745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aee4cf64-583b-4e21-995b-125d216a0c86 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:53.888562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aee4cf64-583b-4e21-995b-125d216a0c86 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:53.889688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aee4cf64-583b-4e21-995b-125d216a0c86 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:53.916147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aee4cf64-583b-4e21-995b-125d216a0c86 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:05:54.124000 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0156d893-2fb8-4df4-8341-8b0b206bf1fc tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "DELETE /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 204 len: 0 microversion: 2.25 time: 0.436775 Jan 22 21:05:54.124824 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 949/1987] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:05:53 2022] DELETE /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:05:54.133532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-61cb8b8b-42ab-45ee-9530-b9c34353d993 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:54.134902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-61cb8b8b-42ab-45ee-9530-b9c34353d993 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:54.142429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61cb8b8b-42ab-45ee-9530-b9c34353d993 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:54.143195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61cb8b8b-42ab-45ee-9530-b9c34353d993 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:54.144237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61cb8b8b-42ab-45ee-9530-b9c34353d993 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:54.145060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61cb8b8b-42ab-45ee-9530-b9c34353d993 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:54.222953 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aee4cf64-583b-4e21-995b-125d216a0c86 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "DELETE /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 204 len: 0 microversion: 2.1 time: 0.349208 Jan 22 21:05:54.223911 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1039/1988] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:05:53 2022] DELETE /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:05:54.232423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-59761c4d-e546-48d3-8c8b-519ffeb8fe18 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:54.233117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-59761c4d-e546-48d3-8c8b-519ffeb8fe18 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:54.247886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59761c4d-e546-48d3-8c8b-519ffeb8fe18 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:54.248456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59761c4d-e546-48d3-8c8b-519ffeb8fe18 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:54.249309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59761c4d-e546-48d3-8c8b-519ffeb8fe18 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:54.249774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59761c4d-e546-48d3-8c8b-519ffeb8fe18 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:54.324694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-61cb8b8b-42ab-45ee-9530-b9c34353d993 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:54.350435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-61cb8b8b-42ab-45ee-9530-b9c34353d993 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:54.357770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-61cb8b8b-42ab-45ee-9530-b9c34353d993 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:54.359844 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-61cb8b8b-42ab-45ee-9530-b9c34353d993 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1552 microversion: 2.25 time: 0.229699 Jan 22 21:05:54.372255 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 950/1989] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:54 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1552 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:54.555827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-59761c4d-e546-48d3-8c8b-519ffeb8fe18 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:54.568935 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-59761c4d-e546-48d3-8c8b-519ffeb8fe18 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1488 microversion: 2.1 time: 0.340888 Jan 22 21:05:54.573559 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1040/1990] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:54 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1488 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:54.697745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0353a00d-bf4d-4823-b223-1287c9598c2f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:54.699323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0353a00d-bf4d-4823-b223-1287c9598c2f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:54.706653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0353a00d-bf4d-4823-b223-1287c9598c2f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:54.707109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0353a00d-bf4d-4823-b223-1287c9598c2f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:54.708099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0353a00d-bf4d-4823-b223-1287c9598c2f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:54.708729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0353a00d-bf4d-4823-b223-1287c9598c2f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:54.738517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3486e71-82ac-48e1-9b9c-843ab4d880b8 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:54.739357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d3486e71-82ac-48e1-9b9c-843ab4d880b8 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:54.747867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3486e71-82ac-48e1-9b9c-843ab4d880b8 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:54.751519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3486e71-82ac-48e1-9b9c-843ab4d880b8 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:54.758426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3486e71-82ac-48e1-9b9c-843ab4d880b8 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:54.759529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3486e71-82ac-48e1-9b9c-843ab4d880b8 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:54.772028 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0353a00d-bf4d-4823-b223-1287c9598c2f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.079067 Jan 22 21:05:54.781563 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 951/1991] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:54 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:05:54.832522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-098d8434-f779-4dbe-a81e-62516aa25ee7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:54.833841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-098d8434-f779-4dbe-a81e-62516aa25ee7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:54.849570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-098d8434-f779-4dbe-a81e-62516aa25ee7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:54.850028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-098d8434-f779-4dbe-a81e-62516aa25ee7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:54.850855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-098d8434-f779-4dbe-a81e-62516aa25ee7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:54.851284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-098d8434-f779-4dbe-a81e-62516aa25ee7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:54.863256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d3486e71-82ac-48e1-9b9c-843ab4d880b8 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:54.874991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d3486e71-82ac-48e1-9b9c-843ab4d880b8 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:54.877038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d3486e71-82ac-48e1-9b9c-843ab4d880b8 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:54.879788 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d3486e71-82ac-48e1-9b9c-843ab4d880b8 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1338 microversion: 2.47 time: 0.144264 Jan 22 21:05:54.880908 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1041/1992] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:54 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1338 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:05:54.915202 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-098d8434-f779-4dbe-a81e-62516aa25ee7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.086359 Jan 22 21:05:54.916748 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 952/1993] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:54 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:55.380308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d9cb08ae-0fdc-47f4-a986-db68a6dabd20 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:55.384698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d9cb08ae-0fdc-47f4-a986-db68a6dabd20 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:55.396871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9cb08ae-0fdc-47f4-a986-db68a6dabd20 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:55.397585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9cb08ae-0fdc-47f4-a986-db68a6dabd20 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:55.401040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9cb08ae-0fdc-47f4-a986-db68a6dabd20 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:55.402458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9cb08ae-0fdc-47f4-a986-db68a6dabd20 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:55.589341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dc32789d-3a44-4f61-a1e1-1cec438f5033 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:55.590277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dc32789d-3a44-4f61-a1e1-1cec438f5033 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:55.604315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc32789d-3a44-4f61-a1e1-1cec438f5033 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:55.604315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc32789d-3a44-4f61-a1e1-1cec438f5033 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:55.604315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc32789d-3a44-4f61-a1e1-1cec438f5033 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:55.604315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc32789d-3a44-4f61-a1e1-1cec438f5033 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:55.763241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d9cb08ae-0fdc-47f4-a986-db68a6dabd20 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:55.778235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d9cb08ae-0fdc-47f4-a986-db68a6dabd20 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:55.780418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d9cb08ae-0fdc-47f4-a986-db68a6dabd20 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:55.783884 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d9cb08ae-0fdc-47f4-a986-db68a6dabd20 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1552 microversion: 2.25 time: 0.408245 Jan 22 21:05:55.785181 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1042/1994] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:55 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1552 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:05:55.791781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e31b89e9-83cf-4d79-bb01-85aca1f2a1c3 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:55.793570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e31b89e9-83cf-4d79-bb01-85aca1f2a1c3 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:55.839964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e31b89e9-83cf-4d79-bb01-85aca1f2a1c3 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:55.839964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e31b89e9-83cf-4d79-bb01-85aca1f2a1c3 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:55.842980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e31b89e9-83cf-4d79-bb01-85aca1f2a1c3 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:55.845980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e31b89e9-83cf-4d79-bb01-85aca1f2a1c3 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:55.866414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dc32789d-3a44-4f61-a1e1-1cec438f5033 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:55.875984 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dc32789d-3a44-4f61-a1e1-1cec438f5033 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1446 microversion: 2.1 time: 0.293688 Jan 22 21:05:55.877152 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 953/1995] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:55 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1446 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:55.951722 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e31b89e9-83cf-4d79-bb01-85aca1f2a1c3 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.164694 Jan 22 21:05:55.952817 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1043/1996] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:55 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:55.963347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ed03e15e-588e-40eb-81d2-96e90f91652c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:55.968160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ed03e15e-588e-40eb-81d2-96e90f91652c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:55.986960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed03e15e-588e-40eb-81d2-96e90f91652c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:55.993859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed03e15e-588e-40eb-81d2-96e90f91652c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:55.995366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed03e15e-588e-40eb-81d2-96e90f91652c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:55.996009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed03e15e-588e-40eb-81d2-96e90f91652c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.062598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6f92c6f8-3d8b-4e2a-a866-7709b7f36659 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed63dc8b0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:56.064278 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:56.064278 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:56.066096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f92c6f8-3d8b-4e2a-a866-7709b7f36659 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.066783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f92c6f8-3d8b-4e2a-a866-7709b7f36659 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.092621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f92c6f8-3d8b-4e2a-a866-7709b7f36659 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.093109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f92c6f8-3d8b-4e2a-a866-7709b7f36659 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.109465 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-6f92c6f8-3d8b-4e2a-a866-7709b7f36659 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] HTTP exception thrown: Service 20ede6f6-2fe9-4c77-922f-ec732158dab7 could not be found. Jan 22 21:05:56.110449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6f92c6f8-3d8b-4e2a-a866-7709b7f36659 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Returning 404 to user: Service 20ede6f6-2fe9-4c77-922f-ec732158dab7 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:56.111883 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6f92c6f8-3d8b-4e2a-a866-7709b7f36659 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-services/20ede6f6-2fe9-4c77-922f-ec732158dab7" status: 404 len: 110 microversion: 2.53 time: 0.233311 Jan 22 21:05:56.112832 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 954/1997] 10.222.0.100 () {62 vars in 1313 bytes} [Sat Jan 22 21:05:55 2022] PUT /compute/v2.1/os-services/20ede6f6-2fe9-4c77-922f-ec732158dab7 => generated 110 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:05:56.125386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ccd308cb-b4ba-4fcc-9e14-ab5ab4670145 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:56.125947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ccd308cb-b4ba-4fcc-9e14-ab5ab4670145 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:56.132990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccd308cb-b4ba-4fcc-9e14-ab5ab4670145 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.133450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccd308cb-b4ba-4fcc-9e14-ab5ab4670145 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.144107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccd308cb-b4ba-4fcc-9e14-ab5ab4670145 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.144107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccd308cb-b4ba-4fcc-9e14-ab5ab4670145 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.192321 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ccd308cb-b4ba-4fcc-9e14-ab5ab4670145 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.072103 Jan 22 21:05:56.197364 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 955/1998] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:56 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:56.200490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-70aebcfe-73b0-448c-9d18-617b72a458ce tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed6110ee0>, body: {"status": "disabled"} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:56.202176 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:56.202176 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:56.204817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70aebcfe-73b0-448c-9d18-617b72a458ce tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.205281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70aebcfe-73b0-448c-9d18-617b72a458ce tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.218852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70aebcfe-73b0-448c-9d18-617b72a458ce tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.219196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70aebcfe-73b0-448c-9d18-617b72a458ce tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.226629 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-70aebcfe-73b0-448c-9d18-617b72a458ce tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] HTTP exception thrown: Service 20ede6f6-2fe9-4c77-922f-ec732158dab7 could not be found. Jan 22 21:05:56.227255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-70aebcfe-73b0-448c-9d18-617b72a458ce tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Returning 404 to user: Service 20ede6f6-2fe9-4c77-922f-ec732158dab7 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:56.228771 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-70aebcfe-73b0-448c-9d18-617b72a458ce tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-services/20ede6f6-2fe9-4c77-922f-ec732158dab7" status: 404 len: 110 microversion: 2.53 time: 0.033994 Jan 22 21:05:56.234591 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 956/1999] 10.222.0.100 () {62 vars in 1313 bytes} [Sat Jan 22 21:05:56 2022] PUT /compute/v2.1/os-services/20ede6f6-2fe9-4c77-922f-ec732158dab7 => generated 110 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:05:56.242632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-83332430-81ec-41f4-b801-4b1950549a1f tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Action: 'update', calling method: .version_select at 0x7f1ed60f0ee0>, body: {"status": "enabled"} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:56.247788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83332430-81ec-41f4-b801-4b1950549a1f tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.248315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83332430-81ec-41f4-b801-4b1950549a1f tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.255367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83332430-81ec-41f4-b801-4b1950549a1f tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.255822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83332430-81ec-41f4-b801-4b1950549a1f tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.261865 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-83332430-81ec-41f4-b801-4b1950549a1f tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] HTTP exception thrown: Service 20ede6f6-2fe9-4c77-922f-ec732158dab7 could not be found. Jan 22 21:05:56.262515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-83332430-81ec-41f4-b801-4b1950549a1f tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Returning 404 to user: Service 20ede6f6-2fe9-4c77-922f-ec732158dab7 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:56.263470 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-83332430-81ec-41f4-b801-4b1950549a1f tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-services/20ede6f6-2fe9-4c77-922f-ec732158dab7" status: 404 len: 110 microversion: 2.53 time: 0.027442 Jan 22 21:05:56.268707 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 957/2000] 10.222.0.100 () {62 vars in 1313 bytes} [Sat Jan 22 21:05:56 2022] PUT /compute/v2.1/os-services/20ede6f6-2fe9-4c77-922f-ec732158dab7 => generated 110 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:05:56.274376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cbea216f-5f07-4d69-886f-af365f447551 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:56.276213 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:56.276213 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:56.277470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbea216f-5f07-4d69-886f-af365f447551 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.277974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbea216f-5f07-4d69-886f-af365f447551 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.279187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbea216f-5f07-4d69-886f-af365f447551 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.280778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbea216f-5f07-4d69-886f-af365f447551 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.309443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed03e15e-588e-40eb-81d2-96e90f91652c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:56.311384 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cbea216f-5f07-4d69-886f-af365f447551 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.041428 Jan 22 21:05:56.311937 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 958/2001] 10.222.0.100 () {60 vars in 1182 bytes} [Sat Jan 22 21:05:56 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:56.322765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed03e15e-588e-40eb-81d2-96e90f91652c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:56.323480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a0632c1b-c868-4958-8d96-0b461b635531 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:56.325018 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:56.325018 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:56.327961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed03e15e-588e-40eb-81d2-96e90f91652c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:56.328614 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ed03e15e-588e-40eb-81d2-96e90f91652c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1338 microversion: 2.47 time: 0.374416 Jan 22 21:05:56.328777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0632c1b-c868-4958-8d96-0b461b635531 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.329597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0632c1b-c868-4958-8d96-0b461b635531 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.330835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0632c1b-c868-4958-8d96-0b461b635531 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.331458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0632c1b-c868-4958-8d96-0b461b635531 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.341539 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1044/2002] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:55 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1338 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:56.380390 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a0632c1b-c868-4958-8d96-0b461b635531 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.061153 Jan 22 21:05:56.388559 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 959/2003] 10.222.0.100 () {60 vars in 1215 bytes} [Sat Jan 22 21:05:56 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:05:56.392739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bf9adc2a-768e-4bc8-aca8-1b863e80f7de tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:56.394061 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:56.394061 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:56.396023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf9adc2a-768e-4bc8-aca8-1b863e80f7de tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.397051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf9adc2a-768e-4bc8-aca8-1b863e80f7de tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.398216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf9adc2a-768e-4bc8-aca8-1b863e80f7de tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.398953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf9adc2a-768e-4bc8-aca8-1b863e80f7de tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.431930 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bf9adc2a-768e-4bc8-aca8-1b863e80f7de tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.042086 Jan 22 21:05:56.433452 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1045/2004] 10.222.0.100 () {60 vars in 1182 bytes} [Sat Jan 22 21:05:56 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:05:56.445066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e0d222ed-2a36-40a8-887a-9a361b3d22ad tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:56.446659 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:56.446659 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:56.449741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0d222ed-2a36-40a8-887a-9a361b3d22ad tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.450208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0d222ed-2a36-40a8-887a-9a361b3d22ad tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.451032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0d222ed-2a36-40a8-887a-9a361b3d22ad tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.451476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0d222ed-2a36-40a8-887a-9a361b3d22ad tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.488185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-7a4a64d7-d97e-40ad-96f4-c0fcc6e784a2 req-129bbb39-5f82-421a-b0bc-150b73dfc91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "664d69ee-34da-42b7-8e5e-7dc8adc0ed77", "name": "network-vif-deleted", "tag": "c24f136c-37da-4fb5-bd76-da0d44ee4299"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:56.490523 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:56.490523 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:56.494475 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e0d222ed-2a36-40a8-887a-9a361b3d22ad tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.051875 Jan 22 21:05:56.500453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7a4a64d7-d97e-40ad-96f4-c0fcc6e784a2 req-129bbb39-5f82-421a-b0bc-150b73dfc91a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.502160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7a4a64d7-d97e-40ad-96f4-c0fcc6e784a2 req-129bbb39-5f82-421a-b0bc-150b73dfc91a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.503913 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 960/2005] 10.222.0.100 () {60 vars in 1241 bytes} [Sat Jan 22 21:05:56 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:56.509802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ea5f92b0-54b8-4536-af09-7224c35bf682 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:56.511007 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:56.511007 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:56.512753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea5f92b0-54b8-4536-af09-7224c35bf682 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.513731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea5f92b0-54b8-4536-af09-7224c35bf682 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.514829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea5f92b0-54b8-4536-af09-7224c35bf682 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.515094 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-7a4a64d7-d97e-40ad-96f4-c0fcc6e784a2 req-129bbb39-5f82-421a-b0bc-150b73dfc91a service nova] Creating event network-vif-deleted:c24f136c-37da-4fb5-bd76-da0d44ee4299 for instance 664d69ee-34da-42b7-8e5e-7dc8adc0ed77 on nch1-master-1 Jan 22 21:05:56.515287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea5f92b0-54b8-4536-af09-7224c35bf682 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.522470 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-7a4a64d7-d97e-40ad-96f4-c0fcc6e784a2 req-129bbb39-5f82-421a-b0bc-150b73dfc91a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044859 Jan 22 21:05:56.529531 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1046/2006] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:05:56.595749 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ea5f92b0-54b8-4536-af09-7224c35bf682 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.087309 Jan 22 21:05:56.602301 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 961/2007] 10.222.0.100 () {60 vars in 1182 bytes} [Sat Jan 22 21:05:56 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:56.609070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d92aa380-26b0-4e63-b1a9-37582b61f813 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:56.610455 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:56.610455 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:05:56.612183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d92aa380-26b0-4e63-b1a9-37582b61f813 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.612646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d92aa380-26b0-4e63-b1a9-37582b61f813 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.613479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d92aa380-26b0-4e63-b1a9-37582b61f813 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.618222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d92aa380-26b0-4e63-b1a9-37582b61f813 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.692172 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d92aa380-26b0-4e63-b1a9-37582b61f813 tempest-ServicesAdminNegativeV253TestJSON-779485156 tempest-ServicesAdminNegativeV253TestJSON-779485156-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.086111 Jan 22 21:05:56.694937 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1047/2008] 10.222.0.100 () {60 vars in 1243 bytes} [Sat Jan 22 21:05:56 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:56.872133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1149393491", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:56.946623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab672c27-f0e1-4d41-8a7d-92b1b0b3ac18 tempest-ServicesAdminNegativeV253TestJSON-380542775 tempest-ServicesAdminNegativeV253TestJSON-380542775-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:56.948122 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:56.948122 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:56.949903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab672c27-f0e1-4d41-8a7d-92b1b0b3ac18 tempest-ServicesAdminNegativeV253TestJSON-380542775 tempest-ServicesAdminNegativeV253TestJSON-380542775-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '407df668f12542079155c7a5432bcba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8602cf9813ba412c930f4c9fac531b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:56.950050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] validate_networks() for [('523a1505-6f74-40bf-9e6e-a18691af5f2e', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:05:56.950791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab672c27-f0e1-4d41-8a7d-92b1b0b3ac18 tempest-ServicesAdminNegativeV253TestJSON-380542775 tempest-ServicesAdminNegativeV253TestJSON-380542775-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:56.951755 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab672c27-f0e1-4d41-8a7d-92b1b0b3ac18 tempest-ServicesAdminNegativeV253TestJSON-380542775 tempest-ServicesAdminNegativeV253TestJSON-380542775-project] 10.222.0.100 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.250172 Jan 22 21:05:56.952808 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 962/2009] 10.222.0.100 () {60 vars in 1182 bytes} [Sat Jan 22 21:05:56 2022] GET /compute/v2.1/os-services => generated 112 bytes in 253 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:05:56.968277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9307f40b-2969-4fbd-b451-5f975cc2cf14 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:56.969219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9307f40b-2969-4fbd-b451-5f975cc2cf14 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:56.985622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9307f40b-2969-4fbd-b451-5f975cc2cf14 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.985963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9307f40b-2969-4fbd-b451-5f975cc2cf14 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:56.990389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9307f40b-2969-4fbd-b451-5f975cc2cf14 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:56.992025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9307f40b-2969-4fbd-b451-5f975cc2cf14 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:57.174580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9307f40b-2969-4fbd-b451-5f975cc2cf14 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:57.189851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9307f40b-2969-4fbd-b451-5f975cc2cf14 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:57.192270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9307f40b-2969-4fbd-b451-5f975cc2cf14 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:57.193879 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9307f40b-2969-4fbd-b451-5f975cc2cf14 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1552 microversion: 2.25 time: 0.239951 Jan 22 21:05:57.195194 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 963/2010] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:56 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1552 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:57.211212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-808c958d-5c84-489d-885f-59a60d62f02a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:57.212924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-808c958d-5c84-489d-885f-59a60d62f02a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:57.224293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-808c958d-5c84-489d-885f-59a60d62f02a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:57.224293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-808c958d-5c84-489d-885f-59a60d62f02a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:57.224293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-808c958d-5c84-489d-885f-59a60d62f02a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:57.224293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-808c958d-5c84-489d-885f-59a60d62f02a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:57.278641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-808c958d-5c84-489d-885f-59a60d62f02a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:57.279847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-808c958d-5c84-489d-885f-59a60d62f02a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:57.280447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-808c958d-5c84-489d-885f-59a60d62f02a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lazy-loading 'fault' on Instance uuid 664d69ee-34da-42b7-8e5e-7dc8adc0ed77 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:57.336493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-808c958d-5c84-489d-885f-59a60d62f02a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:57.347732 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-808c958d-5c84-489d-885f-59a60d62f02a tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 200 len: 1304 microversion: 2.1 time: 0.147551 Jan 22 21:05:57.350447 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 964/2011] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:57 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 1304 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:57.354493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-01febde9-e905-4ead-94f8-d9f21dad11d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:57.355690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-01febde9-e905-4ead-94f8-d9f21dad11d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:57.362076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01febde9-e905-4ead-94f8-d9f21dad11d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:57.362595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01febde9-e905-4ead-94f8-d9f21dad11d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:57.363497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01febde9-e905-4ead-94f8-d9f21dad11d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:57.363951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01febde9-e905-4ead-94f8-d9f21dad11d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:57.433494 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-01febde9-e905-4ead-94f8-d9f21dad11d8 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.082894 Jan 22 21:05:57.434471 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 965/2012] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:57 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:57.441616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5465da5f-49d7-455d-af63-9ce41f6503c9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:57.442639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5465da5f-49d7-455d-af63-9ce41f6503c9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:57.450682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5465da5f-49d7-455d-af63-9ce41f6503c9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:57.451164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5465da5f-49d7-455d-af63-9ce41f6503c9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:57.452469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5465da5f-49d7-455d-af63-9ce41f6503c9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:57.452469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5465da5f-49d7-455d-af63-9ce41f6503c9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:57.499027 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5465da5f-49d7-455d-af63-9ce41f6503c9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.061781 Jan 22 21:05:57.499027 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 966/2013] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:57 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:57.507922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f7041399-c287-45d8-88e8-ba6728ae6eba req-097c8c71-8816-44a0-88cc-fb74af9c014b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9618ff2-a2cc-41d5-9d2f-1fd0c63658df", "name": "network-vif-deleted", "tag": "b50148da-7bff-4e1e-9ed5-bfed58c0e2bf"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:57.510353 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:05:57.510353 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:05:57.523777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f7041399-c287-45d8-88e8-ba6728ae6eba req-097c8c71-8816-44a0-88cc-fb74af9c014b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:57.527656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f7041399-c287-45d8-88e8-ba6728ae6eba req-097c8c71-8816-44a0-88cc-fb74af9c014b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:57.541174 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f7041399-c287-45d8-88e8-ba6728ae6eba req-097c8c71-8816-44a0-88cc-fb74af9c014b service nova] Creating event network-vif-deleted:b50148da-7bff-4e1e-9ed5-bfed58c0e2bf for instance d9618ff2-a2cc-41d5-9d2f-1fd0c63658df on nch1-master-1 Jan 22 21:05:57.546784 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f7041399-c287-45d8-88e8-ba6728ae6eba req-097c8c71-8816-44a0-88cc-fb74af9c014b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043095 Jan 22 21:05:57.549136 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 967/2014] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:05:57.555350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5b6d5331-02b0-4218-a47a-2cd6fc03d0f5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:57.557406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5b6d5331-02b0-4218-a47a-2cd6fc03d0f5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:57.565699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b6d5331-02b0-4218-a47a-2cd6fc03d0f5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:57.566798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b6d5331-02b0-4218-a47a-2cd6fc03d0f5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:57.568509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b6d5331-02b0-4218-a47a-2cd6fc03d0f5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:57.569318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b6d5331-02b0-4218-a47a-2cd6fc03d0f5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:57.658658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5b6d5331-02b0-4218-a47a-2cd6fc03d0f5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:57.671000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5b6d5331-02b0-4218-a47a-2cd6fc03d0f5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:57.672270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5b6d5331-02b0-4218-a47a-2cd6fc03d0f5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:57.673702 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5b6d5331-02b0-4218-a47a-2cd6fc03d0f5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1359 microversion: 2.47 time: 0.123385 Jan 22 21:05:57.674749 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 968/2015] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:57 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1359 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:57.693371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:57.695160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:57.707568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:57.708128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:57.709014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:57.709481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:57.860470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:05:57.860899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:05:57.861627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:05:57.862232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:05:57.862826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:05:57.875227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:05:57.876725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:05:57.878689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:57.879867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:57.880717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:57.888970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:05:57.888970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:05:57.889242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:57.889337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:05:57.911556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Getting quotas for project 9d92b7c0c42e408aa822174817d2819a. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:05:57.917703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Getting quotas for user 697c72b92bac489094799f8969331213 and project 9d92b7c0c42e408aa822174817d2819a. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:05:57.932966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:05:57.935671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:05:58.041823 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9b2c277e-946a-45ce-91c2-e08759eee76e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.292432 Jan 22 21:05:58.042520 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1048/2016] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:05:56 2022] POST /compute/v2.1/servers => generated 385 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:05:58.052559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9da4c2a4-9ab5-493e-a9ce-bb700682c774 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:58.053201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9da4c2a4-9ab5-493e-a9ce-bb700682c774 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:58.077702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:58.094870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.095764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.096139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.096578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.177970 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ed869b4f-b420-4e2e-b4d7-e045e964b283 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "POST /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640/action" status: 202 len: 1081 microversion: 2.47 time: 0.488143 Jan 22 21:05:58.187156 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 969/2017] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:05:57 2022] POST /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640/action => generated 1081 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 455 bytes (2 switches on core 0) Jan 22 21:05:58.204321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cbf98f4f-738e-4f15-a668-4d57f2066570 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:58.204942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cbf98f4f-738e-4f15-a668-4d57f2066570 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:58.211624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbf98f4f-738e-4f15-a668-4d57f2066570 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.212646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbf98f4f-738e-4f15-a668-4d57f2066570 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.213495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbf98f4f-738e-4f15-a668-4d57f2066570 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.213969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbf98f4f-738e-4f15-a668-4d57f2066570 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.329314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9da4c2a4-9ab5-493e-a9ce-bb700682c774 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:58.338248 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9da4c2a4-9ab5-493e-a9ce-bb700682c774 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1227 microversion: 2.1 time: 0.289148 Jan 22 21:05:58.341887 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1049/2018] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:58 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1227 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:58.354204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2dc941af-2ca2-4967-b25f-2601d069d375 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:58.358181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2dc941af-2ca2-4967-b25f-2601d069d375 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:58.358385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cbf98f4f-738e-4f15-a668-4d57f2066570 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:58.368772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dc941af-2ca2-4967-b25f-2601d069d375 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.369856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cbf98f4f-738e-4f15-a668-4d57f2066570 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:58.370993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dc941af-2ca2-4967-b25f-2601d069d375 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.371826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cbf98f4f-738e-4f15-a668-4d57f2066570 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:58.377205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dc941af-2ca2-4967-b25f-2601d069d375 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.378214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dc941af-2ca2-4967-b25f-2601d069d375 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.382754 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cbf98f4f-738e-4f15-a668-4d57f2066570 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.183324 Jan 22 21:05:58.389547 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 970/2019] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:58 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:05:58.404601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ef8fd0ec-972c-4363-9cf7-94ed0058e902 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:58.408118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ef8fd0ec-972c-4363-9cf7-94ed0058e902 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 664d69ee-34da-42b7-8e5e-7dc8adc0ed77] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:58.433331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dc941af-2ca2-4967-b25f-2601d069d375 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.433958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dc941af-2ca2-4967-b25f-2601d069d375 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.434675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-2dc941af-2ca2-4967-b25f-2601d069d375 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lazy-loading 'fault' on Instance uuid d9618ff2-a2cc-41d5-9d2f-1fd0c63658df {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:05:58.441751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef8fd0ec-972c-4363-9cf7-94ed0058e902 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.442223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef8fd0ec-972c-4363-9cf7-94ed0058e902 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.443042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef8fd0ec-972c-4363-9cf7-94ed0058e902 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.443482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef8fd0ec-972c-4363-9cf7-94ed0058e902 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.472938 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-ef8fd0ec-972c-4363-9cf7-94ed0058e902 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] HTTP exception thrown: Instance 664d69ee-34da-42b7-8e5e-7dc8adc0ed77 could not be found. Jan 22 21:05:58.474293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ef8fd0ec-972c-4363-9cf7-94ed0058e902 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Returning 404 to user: Instance 664d69ee-34da-42b7-8e5e-7dc8adc0ed77 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:58.475206 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ef8fd0ec-972c-4363-9cf7-94ed0058e902 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77" status: 404 len: 111 microversion: 2.1 time: 0.079242 Jan 22 21:05:58.476059 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 971/2020] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:58 2022] GET /compute/v2.1/servers/664d69ee-34da-42b7-8e5e-7dc8adc0ed77 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:05:58.483515 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2dc941af-2ca2-4967-b25f-2601d069d375 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:58.488055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7935a0c9-85b3-495f-a372-32e33081436c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:58.490936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7935a0c9-85b3-495f-a372-32e33081436c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:58.496710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2dc941af-2ca2-4967-b25f-2601d069d375 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:58.499320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2dc941af-2ca2-4967-b25f-2601d069d375 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:58.500806 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2dc941af-2ca2-4967-b25f-2601d069d375 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 200 len: 1355 microversion: 2.25 time: 0.157286 Jan 22 21:05:58.501775 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1050/2021] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:58 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 1355 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:58.506925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1165b5b-e897-487e-8a79-95293cdf7aa5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:58.507628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1165b5b-e897-487e-8a79-95293cdf7aa5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:58.516012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7935a0c9-85b3-495f-a372-32e33081436c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.516160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1165b5b-e897-487e-8a79-95293cdf7aa5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.516265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7935a0c9-85b3-495f-a372-32e33081436c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.516436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1165b5b-e897-487e-8a79-95293cdf7aa5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.517523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1165b5b-e897-487e-8a79-95293cdf7aa5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.518159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1165b5b-e897-487e-8a79-95293cdf7aa5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.548165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7935a0c9-85b3-495f-a372-32e33081436c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.548740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7935a0c9-85b3-495f-a372-32e33081436c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.552311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1165b5b-e897-487e-8a79-95293cdf7aa5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:05:58.616003 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7935a0c9-85b3-495f-a372-32e33081436c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.135740 Jan 22 21:05:58.622057 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 972/2022] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:58 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:58.626758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ed52fa6d-4d47-493b-9051-10c3e7d0841b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:58.634625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ed52fa6d-4d47-493b-9051-10c3e7d0841b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:58.658698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed52fa6d-4d47-493b-9051-10c3e7d0841b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.659153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed52fa6d-4d47-493b-9051-10c3e7d0841b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.659965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed52fa6d-4d47-493b-9051-10c3e7d0841b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.660408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed52fa6d-4d47-493b-9051-10c3e7d0841b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.707374 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ed52fa6d-4d47-493b-9051-10c3e7d0841b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.084913 Jan 22 21:05:58.712122 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 973/2023] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:58 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:58.896499 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1165b5b-e897-487e-8a79-95293cdf7aa5 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "DELETE /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 204 len: 0 microversion: 2.1 time: 0.393138 Jan 22 21:05:58.897334 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1051/2024] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:05:58 2022] DELETE /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:05:58.907754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c2775e83-40d7-408c-b11a-37109453f535 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:58.908809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c2775e83-40d7-408c-b11a-37109453f535 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:58.934300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2775e83-40d7-408c-b11a-37109453f535 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.934950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2775e83-40d7-408c-b11a-37109453f535 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:58.935582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2775e83-40d7-408c-b11a-37109453f535 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:58.936375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2775e83-40d7-408c-b11a-37109453f535 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:59.112213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c2775e83-40d7-408c-b11a-37109453f535 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:59.120890 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c2775e83-40d7-408c-b11a-37109453f535 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1503 microversion: 2.1 time: 0.217171 Jan 22 21:05:59.122128 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 974/2025] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:58 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1503 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:59.358728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7e6aa2d1-3a13-44ae-82d2-839ecf534666 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:59.359692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7e6aa2d1-3a13-44ae-82d2-839ecf534666 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:59.404547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-33f568dc-8bf4-4b77-96ef-df08322b8a34 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:59.405168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-33f568dc-8bf4-4b77-96ef-df08322b8a34 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:59.418518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33f568dc-8bf4-4b77-96ef-df08322b8a34 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:59.420755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33f568dc-8bf4-4b77-96ef-df08322b8a34 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:59.422904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33f568dc-8bf4-4b77-96ef-df08322b8a34 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:59.423536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33f568dc-8bf4-4b77-96ef-df08322b8a34 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:59.437429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7e6aa2d1-3a13-44ae-82d2-839ecf534666 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:59.447220 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7e6aa2d1-3a13-44ae-82d2-839ecf534666 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1227 microversion: 2.1 time: 0.091847 Jan 22 21:05:59.448190 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1052/2026] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:05:59 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1227 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:05:59.521265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d121450b-0e24-41e7-8171-da8e8a4a8b0a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:59.522020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d121450b-0e24-41e7-8171-da8e8a4a8b0a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: d9618ff2-a2cc-41d5-9d2f-1fd0c63658df] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:59.529993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d121450b-0e24-41e7-8171-da8e8a4a8b0a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:59.530455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d121450b-0e24-41e7-8171-da8e8a4a8b0a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:59.531838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d121450b-0e24-41e7-8171-da8e8a4a8b0a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:59.532427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d121450b-0e24-41e7-8171-da8e8a4a8b0a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:59.539029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-33f568dc-8bf4-4b77-96ef-df08322b8a34 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:59.550587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-33f568dc-8bf4-4b77-96ef-df08322b8a34 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:59.553113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-33f568dc-8bf4-4b77-96ef-df08322b8a34 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:05:59.554641 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-33f568dc-8bf4-4b77-96ef-df08322b8a34 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.154805 Jan 22 21:05:59.563707 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 975/2027] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:59 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:05:59.568260 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-d121450b-0e24-41e7-8171-da8e8a4a8b0a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] HTTP exception thrown: Instance d9618ff2-a2cc-41d5-9d2f-1fd0c63658df could not be found. Jan 22 21:05:59.568898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d121450b-0e24-41e7-8171-da8e8a4a8b0a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Returning 404 to user: Instance d9618ff2-a2cc-41d5-9d2f-1fd0c63658df could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:05:59.569781 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d121450b-0e24-41e7-8171-da8e8a4a8b0a tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df" status: 404 len: 111 microversion: 2.25 time: 0.052247 Jan 22 21:05:59.570469 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1053/2028] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:05:59 2022] GET /compute/v2.1/servers/d9618ff2-a2cc-41d5-9d2f-1fd0c63658df => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 22 21:05:59.578907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ae8f258b-64cb-45f8-a4e2-636e68badba3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:05:59.584300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ae8f258b-64cb-45f8-a4e2-636e68badba3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:59.586022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae8f258b-64cb-45f8-a4e2-636e68badba3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:59.586552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae8f258b-64cb-45f8-a4e2-636e68badba3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:59.587680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae8f258b-64cb-45f8-a4e2-636e68badba3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:59.588229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae8f258b-64cb-45f8-a4e2-636e68badba3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:59.623529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ae8f258b-64cb-45f8-a4e2-636e68badba3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:05:59.629390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3a996355-08b0-4ea6-ba6a-3bc45fd43600 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:59.630448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3a996355-08b0-4ea6-ba6a-3bc45fd43600 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:59.639566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a996355-08b0-4ea6-ba6a-3bc45fd43600 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:59.640044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a996355-08b0-4ea6-ba6a-3bc45fd43600 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:59.640857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a996355-08b0-4ea6-ba6a-3bc45fd43600 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:59.641295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a996355-08b0-4ea6-ba6a-3bc45fd43600 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:59.688059 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3a996355-08b0-4ea6-ba6a-3bc45fd43600 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.060669 Jan 22 21:05:59.690616 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1054/2029] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:59 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:05:59.726502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-36519fb4-fac1-428b-8fd8-072f7c274cb7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:05:59.728832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-36519fb4-fac1-428b-8fd8-072f7c274cb7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:05:59.746953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36519fb4-fac1-428b-8fd8-072f7c274cb7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:59.747774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36519fb4-fac1-428b-8fd8-072f7c274cb7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:59.749175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36519fb4-fac1-428b-8fd8-072f7c274cb7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:05:59.751319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36519fb4-fac1-428b-8fd8-072f7c274cb7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:05:59.825322 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-36519fb4-fac1-428b-8fd8-072f7c274cb7 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.103674 Jan 22 21:05:59.830430 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1055/2030] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:05:59 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:00.001686 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ae8f258b-64cb-45f8-a4e2-636e68badba3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "DELETE /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 204 len: 0 microversion: 2.25 time: 0.426564 Jan 22 21:06:00.003865 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 976/2031] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:05:59 2022] DELETE /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:06:00.013577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f5bf3cfc-a5b9-481a-be7d-2791029440cf tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:00.014351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f5bf3cfc-a5b9-481a-be7d-2791029440cf tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:00.035534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5bf3cfc-a5b9-481a-be7d-2791029440cf tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:00.036859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5bf3cfc-a5b9-481a-be7d-2791029440cf tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:00.040668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5bf3cfc-a5b9-481a-be7d-2791029440cf tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:00.045219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5bf3cfc-a5b9-481a-be7d-2791029440cf tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:00.153728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e09652e5-42fa-4630-9bcc-ca8bebb0f1a0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:00.156399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e09652e5-42fa-4630-9bcc-ca8bebb0f1a0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:00.185363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e09652e5-42fa-4630-9bcc-ca8bebb0f1a0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:00.185903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e09652e5-42fa-4630-9bcc-ca8bebb0f1a0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:00.187799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e09652e5-42fa-4630-9bcc-ca8bebb0f1a0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:00.189896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e09652e5-42fa-4630-9bcc-ca8bebb0f1a0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:00.396112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f5bf3cfc-a5b9-481a-be7d-2791029440cf tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:00.405158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f5bf3cfc-a5b9-481a-be7d-2791029440cf tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:00.407284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f5bf3cfc-a5b9-481a-be7d-2791029440cf tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:00.408671 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f5bf3cfc-a5b9-481a-be7d-2791029440cf tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1566 microversion: 2.25 time: 0.400322 Jan 22 21:06:00.420317 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1056/2032] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:00 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1566 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:00.467518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4e79e624-c5d5-4247-b780-0631e25682f0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:00.468406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4e79e624-c5d5-4247-b780-0631e25682f0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:00.491439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e09652e5-42fa-4630-9bcc-ca8bebb0f1a0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:00.493007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e79e624-c5d5-4247-b780-0631e25682f0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:00.513773 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e09652e5-42fa-4630-9bcc-ca8bebb0f1a0 tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1503 microversion: 2.1 time: 0.378758 Jan 22 21:06:00.516126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e79e624-c5d5-4247-b780-0631e25682f0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:00.529483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e79e624-c5d5-4247-b780-0631e25682f0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:00.530349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e79e624-c5d5-4247-b780-0631e25682f0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:00.530721 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 977/2033] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:00 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1503 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:00.580942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1eae6a7b-83ec-4d09-be3a-66eb5f5146ff tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:00.581634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1eae6a7b-83ec-4d09-be3a-66eb5f5146ff tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:00.596314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1eae6a7b-83ec-4d09-be3a-66eb5f5146ff tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:00.599148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1eae6a7b-83ec-4d09-be3a-66eb5f5146ff tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:00.599995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1eae6a7b-83ec-4d09-be3a-66eb5f5146ff tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:00.600451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1eae6a7b-83ec-4d09-be3a-66eb5f5146ff tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:00.671292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4e79e624-c5d5-4247-b780-0631e25682f0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:00.679792 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4e79e624-c5d5-4247-b780-0631e25682f0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1279 microversion: 2.1 time: 0.219384 Jan 22 21:06:00.682298 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1057/2034] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:00 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1279 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:00.708425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4e5e3308-3693-4426-ad6a-627b874d0ef9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:00.710761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4e5e3308-3693-4426-ad6a-627b874d0ef9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:00.725040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e5e3308-3693-4426-ad6a-627b874d0ef9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:00.725731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e5e3308-3693-4426-ad6a-627b874d0ef9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:00.726615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e5e3308-3693-4426-ad6a-627b874d0ef9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:00.728470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e5e3308-3693-4426-ad6a-627b874d0ef9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:00.780331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1eae6a7b-83ec-4d09-be3a-66eb5f5146ff tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:00.797352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1eae6a7b-83ec-4d09-be3a-66eb5f5146ff tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:00.800169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1eae6a7b-83ec-4d09-be3a-66eb5f5146ff tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:00.802746 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1eae6a7b-83ec-4d09-be3a-66eb5f5146ff tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.231563 Jan 22 21:06:00.815792 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 978/2035] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:00 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:00.834135 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4e5e3308-3693-4426-ad6a-627b874d0ef9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.135882 Jan 22 21:06:00.834822 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1058/2036] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:00 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:00.843902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f7d2e964-47e4-4491-a03e-83b3c368cd29 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:00.852547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f7d2e964-47e4-4491-a03e-83b3c368cd29 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:00.876090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2e964-47e4-4491-a03e-83b3c368cd29 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:00.876840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2e964-47e4-4491-a03e-83b3c368cd29 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:00.877830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2e964-47e4-4491-a03e-83b3c368cd29 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:00.880401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2e964-47e4-4491-a03e-83b3c368cd29 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:01.000265 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f7d2e964-47e4-4491-a03e-83b3c368cd29 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.165726 Jan 22 21:06:01.005527 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 979/2037] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:00 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:06:01.403978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-9cf33c20-ef00-4396-817d-e60f124f629d req-d22c6bf1-b3a9-44b6-830e-9915f4422aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077c7fdf-b28f-48a5-9c20-4b5b45babfed", "name": "network-vif-deleted", "tag": "4892bd95-44cd-4f32-8d2d-11536ea7b4ee"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:01.410771 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:01.410771 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:06:01.427865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1f62cd78-8e87-4ab9-a245-931e30b5a3a0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:01.431675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1f62cd78-8e87-4ab9-a245-931e30b5a3a0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:01.457967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9cf33c20-ef00-4396-817d-e60f124f629d req-d22c6bf1-b3a9-44b6-830e-9915f4422aba service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:01.459711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f62cd78-8e87-4ab9-a245-931e30b5a3a0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:01.461394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f62cd78-8e87-4ab9-a245-931e30b5a3a0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:01.462410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9cf33c20-ef00-4396-817d-e60f124f629d req-d22c6bf1-b3a9-44b6-830e-9915f4422aba service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:01.463628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f62cd78-8e87-4ab9-a245-931e30b5a3a0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:01.475654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f62cd78-8e87-4ab9-a245-931e30b5a3a0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:01.525908 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-9cf33c20-ef00-4396-817d-e60f124f629d req-d22c6bf1-b3a9-44b6-830e-9915f4422aba service nova] Creating event network-vif-deleted:4892bd95-44cd-4f32-8d2d-11536ea7b4ee for instance 077c7fdf-b28f-48a5-9c20-4b5b45babfed on nch1-master-1 Jan 22 21:06:01.536984 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-9cf33c20-ef00-4396-817d-e60f124f629d req-d22c6bf1-b3a9-44b6-830e-9915f4422aba service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139790 Jan 22 21:06:01.539737 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1059/2038] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:01.547921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e2d4566e-1ae9-4c74-82d7-aca7cfde3efb tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:01.549021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e2d4566e-1ae9-4c74-82d7-aca7cfde3efb tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:01.556790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2d4566e-1ae9-4c74-82d7-aca7cfde3efb tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:01.557675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2d4566e-1ae9-4c74-82d7-aca7cfde3efb tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:01.558703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2d4566e-1ae9-4c74-82d7-aca7cfde3efb tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:01.559320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2d4566e-1ae9-4c74-82d7-aca7cfde3efb tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:01.790806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e2d4566e-1ae9-4c74-82d7-aca7cfde3efb tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07a1bb09ad44501925664aa61ac3e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b277338cf6c4478e8e35cf79b34caaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:01.800758 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e2d4566e-1ae9-4c74-82d7-aca7cfde3efb tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 200 len: 1461 microversion: 2.1 time: 0.258805 Jan 22 21:06:01.802649 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1060/2039] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:01 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 1461 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:01.817612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d8426924-3870-4b5a-a99a-658fad47ee6e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:01.818642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d8426924-3870-4b5a-a99a-658fad47ee6e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:01.826367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8426924-3870-4b5a-a99a-658fad47ee6e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:01.827292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8426924-3870-4b5a-a99a-658fad47ee6e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:01.828548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8426924-3870-4b5a-a99a-658fad47ee6e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:01.829203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8426924-3870-4b5a-a99a-658fad47ee6e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:02.109181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d8426924-3870-4b5a-a99a-658fad47ee6e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:02.125627 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d8426924-3870-4b5a-a99a-658fad47ee6e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1285 microversion: 2.1 time: 0.315678 Jan 22 21:06:02.130202 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1061/2040] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:01 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1285 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:02.137152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f3f069f3-ba1b-499a-b682-8e38c90f049e tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:02.152806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f3f069f3-ba1b-499a-b682-8e38c90f049e tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:02.173042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3f069f3-ba1b-499a-b682-8e38c90f049e tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:02.173881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3f069f3-ba1b-499a-b682-8e38c90f049e tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:02.176438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3f069f3-ba1b-499a-b682-8e38c90f049e tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:02.177919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3f069f3-ba1b-499a-b682-8e38c90f049e tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:02.245645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1f62cd78-8e87-4ab9-a245-931e30b5a3a0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:02.257012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1f62cd78-8e87-4ab9-a245-931e30b5a3a0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:02.259698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1f62cd78-8e87-4ab9-a245-931e30b5a3a0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:02.261110 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1f62cd78-8e87-4ab9-a245-931e30b5a3a0 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1566 microversion: 2.25 time: 0.837630 Jan 22 21:06:02.262780 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 980/2041] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:01 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1566 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:02.267929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-59498aa5-d973-4ba3-8797-eac9651701a6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:02.284751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-59498aa5-d973-4ba3-8797-eac9651701a6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:02.311327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59498aa5-d973-4ba3-8797-eac9651701a6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:02.317184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59498aa5-d973-4ba3-8797-eac9651701a6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:02.317184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59498aa5-d973-4ba3-8797-eac9651701a6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:02.317184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59498aa5-d973-4ba3-8797-eac9651701a6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:02.319459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f3f069f3-ba1b-499a-b682-8e38c90f049e tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:02.336857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f3f069f3-ba1b-499a-b682-8e38c90f049e tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:02.339326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f3f069f3-ba1b-499a-b682-8e38c90f049e tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:02.340976 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f3f069f3-ba1b-499a-b682-8e38c90f049e tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.209798 Jan 22 21:06:02.341737 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1062/2042] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:02 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:02.349074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-835c6178-196a-47b8-af87-bf8a4fd569ec tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:02.354962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-835c6178-196a-47b8-af87-bf8a4fd569ec tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:02.364202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-835c6178-196a-47b8-af87-bf8a4fd569ec tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:02.364944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-835c6178-196a-47b8-af87-bf8a4fd569ec tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:02.365972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-835c6178-196a-47b8-af87-bf8a4fd569ec tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:02.366774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-835c6178-196a-47b8-af87-bf8a4fd569ec tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:02.403426 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-59498aa5-d973-4ba3-8797-eac9651701a6 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.139031 Jan 22 21:06:02.404392 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 981/2043] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:02 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:02.456536 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-835c6178-196a-47b8-af87-bf8a4fd569ec tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.111484 Jan 22 21:06:02.458729 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1063/2044] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:02 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:02.648456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-293bc47a-7282-48f8-bedc-16bd8d8defac tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:02.673846 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-293bc47a-7282-48f8-bedc-16bd8d8defac tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.265701 Jan 22 21:06:02.674623 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 982/2045] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:06:02 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:02.686725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3ed74832-786c-452a-adf6-135e3b0d5344 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:02.720880 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3ed74832-786c-452a-adf6-135e3b0d5344 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors" status: 200 len: 3104 microversion: 2.1 time: 0.038003 Jan 22 21:06:02.735524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d0e0ca56-8e8c-47d2-b968-9a1a5ac78e20 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:02.741638 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1064/2046] 10.222.0.100 () {58 vars in 1129 bytes} [Sat Jan 22 21:06:02 2022] GET /compute/v2.1/flavors => generated 3104 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:02.761732 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d0e0ca56-8e8c-47d2-b968-9a1a5ac78e20 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.029882 Jan 22 21:06:02.775380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-70ebba39-2292-41a5-aa81-97e4a53ab8af tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:02.777069 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 983/2047] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:06:02 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:02.787412 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-70ebba39-2292-41a5-aa81-97e4a53ab8af tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.016279 Jan 22 21:06:02.800247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a91aea38-90da-4f6b-a0e3-08a77f8dc035 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:02.807534 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1065/2048] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:06:02 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:02.820385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9fba310e-6f68-445c-8bec-404f539b2d9d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:02.821847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9fba310e-6f68-445c-8bec-404f539b2d9d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] [instance: 077c7fdf-b28f-48a5-9c20-4b5b45babfed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:02.834591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fba310e-6f68-445c-8bec-404f539b2d9d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:02.838178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fba310e-6f68-445c-8bec-404f539b2d9d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:02.839252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fba310e-6f68-445c-8bec-404f539b2d9d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:02.841960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fba310e-6f68-445c-8bec-404f539b2d9d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:02.858758 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a91aea38-90da-4f6b-a0e3-08a77f8dc035 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3227 microversion: 2.1 time: 0.062109 Jan 22 21:06:02.872225 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 984/2049] 10.222.0.100 () {58 vars in 1169 bytes} [Sat Jan 22 21:06:02 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3227 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:06:02.894399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-78ae19d8-1bc3-4249-b5d0-0a5af75a250b tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:02.896464 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-9fba310e-6f68-445c-8bec-404f539b2d9d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] HTTP exception thrown: Instance 077c7fdf-b28f-48a5-9c20-4b5b45babfed could not be found. Jan 22 21:06:02.901556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9fba310e-6f68-445c-8bec-404f539b2d9d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] Returning 404 to user: Instance 077c7fdf-b28f-48a5-9c20-4b5b45babfed could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:06:02.905619 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9fba310e-6f68-445c-8bec-404f539b2d9d tempest-LiveMigrationTest-256070455 tempest-LiveMigrationTest-256070455-project] 10.222.0.100 "GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed" status: 404 len: 111 microversion: 2.1 time: 0.088620 Jan 22 21:06:02.907550 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1066/2050] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:02 2022] GET /compute/v2.1/servers/077c7fdf-b28f-48a5-9c20-4b5b45babfed => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:06:02.930997 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-78ae19d8-1bc3-4249-b5d0-0a5af75a250b tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.056685 Jan 22 21:06:02.931594 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 985/2051] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:06:02 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:02.942172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-084b8d15-e118-4c10-8a7c-30e4ec6cb753 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:02.975346 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-084b8d15-e118-4c10-8a7c-30e4ec6cb753 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2157 microversion: 2.1 time: 0.036788 Jan 22 21:06:02.990483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e3688b44-c8e5-4ad8-b15e-3362b14eb363 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:02.999946 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1067/2052] 10.222.0.100 () {58 vars in 1173 bytes} [Sat Jan 22 21:06:02 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2157 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:03.005095 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e3688b44-c8e5-4ad8-b15e-3362b14eb363 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 479 microversion: 2.1 time: 0.018734 Jan 22 21:06:03.019333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c253983d-fe4b-407d-a3d6-f6d42651cc5c tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:03.022292 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 986/2053] 10.222.0.100 () {58 vars in 1165 bytes} [Sat Jan 22 21:06:02 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 479 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:03.039046 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c253983d-fe4b-407d-a3d6-f6d42651cc5c tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.023343 Jan 22 21:06:03.042397 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1068/2054] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:06:03 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:03.053777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-84a70cf9-da45-4a58-9a1a-e4b9cad58c80 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:03.141689 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-84a70cf9-da45-4a58-9a1a-e4b9cad58c80 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2514 microversion: 2.1 time: 0.092170 Jan 22 21:06:03.146028 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 987/2055] 10.222.0.100 () {58 vars in 1171 bytes} [Sat Jan 22 21:06:03 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2514 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:03.162687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a89caed4-5de4-43f8-9272-f12313fdbb33 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:03.166111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a89caed4-5de4-43f8-9272-f12313fdbb33 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:03.172707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a8664614-e8b7-40f6-9cb3-2ae021cf6135 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:03.183241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a89caed4-5de4-43f8-9272-f12313fdbb33 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:03.186522 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a8664614-e8b7-40f6-9cb3-2ae021cf6135 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.029632 Jan 22 21:06:03.189942 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 988/2056] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:06:03 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:03.190797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a89caed4-5de4-43f8-9272-f12313fdbb33 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:03.191666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a89caed4-5de4-43f8-9272-f12313fdbb33 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:03.192113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a89caed4-5de4-43f8-9272-f12313fdbb33 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:03.203160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-47671ded-6345-4a55-a435-09282a659290 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:03.248892 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-47671ded-6345-4a55-a435-09282a659290 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1681 microversion: 2.1 time: 0.052468 Jan 22 21:06:03.252227 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 989/2057] 10.222.0.100 () {58 vars in 1148 bytes} [Sat Jan 22 21:06:03 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1681 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:03.274776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e6861a2d-83b4-41fa-8d99-5e39138a4606 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:03.320031 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e6861a2d-83b4-41fa-8d99-5e39138a4606 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.051091 Jan 22 21:06:03.322149 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 990/2058] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:06:03 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:03.333380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b3ee8992-750b-4d15-a702-bc83291d6cb4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:03.338570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b3ee8992-750b-4d15-a702-bc83291d6cb4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:03.346330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3ee8992-750b-4d15-a702-bc83291d6cb4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:03.346800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3ee8992-750b-4d15-a702-bc83291d6cb4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:03.351715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3ee8992-750b-4d15-a702-bc83291d6cb4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:03.351715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3ee8992-750b-4d15-a702-bc83291d6cb4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:03.422174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3ee8992-750b-4d15-a702-bc83291d6cb4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:03.422887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3ee8992-750b-4d15-a702-bc83291d6cb4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:03.426354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-b3ee8992-750b-4d15-a702-bc83291d6cb4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lazy-loading 'fault' on Instance uuid 34c2ce33-a108-4be0-bb41-068138160281 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:06:03.534243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b3ee8992-750b-4d15-a702-bc83291d6cb4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:03.548806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b3ee8992-750b-4d15-a702-bc83291d6cb4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:03.554669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b3ee8992-750b-4d15-a702-bc83291d6cb4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fa58b4de634969ba8dcaf054e0b8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa958f703204cbca5fd08472e45909f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:03.556255 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b3ee8992-750b-4d15-a702-bc83291d6cb4 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 200 len: 1354 microversion: 2.25 time: 0.232582 Jan 22 21:06:03.559608 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 991/2059] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:03 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 1354 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:03.568324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-936b599f-b7f4-4341-844d-fa4e7d383647 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:03.627615 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-936b599f-b7f4-4341-844d-fa4e7d383647 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1123 microversion: 2.1 time: 0.062880 Jan 22 21:06:03.628583 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 992/2060] 10.222.0.100 () {58 vars in 1152 bytes} [Sat Jan 22 21:06:03 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1123 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:03.641744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bcedef99-52c8-4d08-bf04-1f438bdbf101 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:03.642787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bcedef99-52c8-4d08-bf04-1f438bdbf101 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:03.650408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcedef99-52c8-4d08-bf04-1f438bdbf101 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:03.651767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcedef99-52c8-4d08-bf04-1f438bdbf101 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:03.652805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcedef99-52c8-4d08-bf04-1f438bdbf101 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:03.653432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcedef99-52c8-4d08-bf04-1f438bdbf101 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:03.744726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bcedef99-52c8-4d08-bf04-1f438bdbf101 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:03.754582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bcedef99-52c8-4d08-bf04-1f438bdbf101 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:03.756527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bcedef99-52c8-4d08-bf04-1f438bdbf101 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:03.758135 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bcedef99-52c8-4d08-bf04-1f438bdbf101 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.120044 Jan 22 21:06:03.759651 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 993/2061] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:03 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:03.765036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-257ca450-9af7-4a16-85df-9cd78be1096f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:03.766680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-257ca450-9af7-4a16-85df-9cd78be1096f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:03.773250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-257ca450-9af7-4a16-85df-9cd78be1096f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:03.780438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-257ca450-9af7-4a16-85df-9cd78be1096f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:03.780438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-257ca450-9af7-4a16-85df-9cd78be1096f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:03.780438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-257ca450-9af7-4a16-85df-9cd78be1096f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:03.799299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a89caed4-5de4-43f8-9272-f12313fdbb33 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:03.814794 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a89caed4-5de4-43f8-9272-f12313fdbb33 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1327 microversion: 2.1 time: 0.660411 Jan 22 21:06:03.815589 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1069/2062] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:03 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1327 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:06:03.826099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-75176c9d-1fd8-4f8f-9023-b1b47438da76 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:03.828639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-75176c9d-1fd8-4f8f-9023-b1b47438da76 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:03.849179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75176c9d-1fd8-4f8f-9023-b1b47438da76 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:03.851534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75176c9d-1fd8-4f8f-9023-b1b47438da76 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:03.855424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75176c9d-1fd8-4f8f-9023-b1b47438da76 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:03.856409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75176c9d-1fd8-4f8f-9023-b1b47438da76 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:03.870791 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-257ca450-9af7-4a16-85df-9cd78be1096f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.109796 Jan 22 21:06:03.872547 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 994/2063] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:03 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:03.881818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-37c6546b-66bd-4c96-b9b0-81aecc6f6969 req-e58894af-071e-4b8c-80e6-9b1bd1037549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c2ce33-a108-4be0-bb41-068138160281", "name": "network-vif-deleted", "tag": "bd951644-4535-4dbd-b4a8-1c4994056609"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:03.890868 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:03.890868 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:06:03.922628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-37c6546b-66bd-4c96-b9b0-81aecc6f6969 req-e58894af-071e-4b8c-80e6-9b1bd1037549 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:03.923359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-37c6546b-66bd-4c96-b9b0-81aecc6f6969 req-e58894af-071e-4b8c-80e6-9b1bd1037549 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:03.943984 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-75176c9d-1fd8-4f8f-9023-b1b47438da76 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.119819 Jan 22 21:06:03.945102 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1070/2064] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:03 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:03.959995 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-37c6546b-66bd-4c96-b9b0-81aecc6f6969 req-e58894af-071e-4b8c-80e6-9b1bd1037549 service nova] Creating event network-vif-deleted:bd951644-4535-4dbd-b4a8-1c4994056609 for instance 34c2ce33-a108-4be0-bb41-068138160281 on nch1-master-1 Jan 22 21:06:03.961131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-817d1c1a-448a-4230-8228-10c1361d172c tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:03.976854 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-37c6546b-66bd-4c96-b9b0-81aecc6f6969 req-e58894af-071e-4b8c-80e6-9b1bd1037549 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101105 Jan 22 21:06:03.981099 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 995/2065] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:03.992024 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-817d1c1a-448a-4230-8228-10c1361d172c tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 302 microversion: 2.1 time: 0.041029 Jan 22 21:06:03.995280 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1071/2066] 10.222.0.100 () {58 vars in 1144 bytes} [Sat Jan 22 21:06:03 2022] GET /compute/v2.1/flavors?limit=1 => generated 302 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:04.010513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aeadb95f-4555-4255-90e1-213e46b2ff8b tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:04.026237 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aeadb95f-4555-4255-90e1-213e46b2ff8b tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.022708 Jan 22 21:06:04.028568 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 996/2067] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:06:04 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:04.039042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-952d0942-a7fd-4147-a53d-09d0bfaedbf3 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:04.089771 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-952d0942-a7fd-4147-a53d-09d0bfaedbf3 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1314 microversion: 2.1 time: 0.054892 Jan 22 21:06:04.091266 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1072/2068] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:06:04 2022] GET /compute/v2.1/flavors?marker=452 => generated 1314 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:04.104454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1783856a-1c96-428f-a160-e429474cc3c2 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:04.138183 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1783856a-1c96-428f-a160-e429474cc3c2 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5843 microversion: 2.1 time: 0.038547 Jan 22 21:06:04.139583 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 997/2069] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:06:04 2022] GET /compute/v2.1/flavors/detail => generated 5843 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:04.154939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-139a8819-10ce-416f-9b1e-475a33848ca7 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:04.165880 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-139a8819-10ce-416f-9b1e-475a33848ca7 tempest-FlavorsV2TestJSON-1595589630 tempest-FlavorsV2TestJSON-1595589630-project] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.013932 Jan 22 21:06:04.182747 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1073/2070] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:06:04 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:04.515965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9096f2fc-df4e-44ec-b03d-4568becbe699 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'create', calling method: .version_select at 0x7f1edaee3940>, body: {"keypair": {"name": "tempest-keypair-1839206740"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:04.551979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-9096f2fc-df4e-44ec-b03d-4568becbe699 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Getting quotas for project 9e437a5b9bd14e108f01a125645d62b7. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:06:04.568943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-9096f2fc-df4e-44ec-b03d-4568becbe699 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Getting quotas for user f6394c313d9a45a6b6ab718256a7b454 and project 9e437a5b9bd14e108f01a125645d62b7. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:06:04.579578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4197b596-b8a1-4224-9280-2da3184926d3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:04.581028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4197b596-b8a1-4224-9280-2da3184926d3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] [instance: 34c2ce33-a108-4be0-bb41-068138160281] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:04.601427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4197b596-b8a1-4224-9280-2da3184926d3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:04.602520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4197b596-b8a1-4224-9280-2da3184926d3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:04.604849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4197b596-b8a1-4224-9280-2da3184926d3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:04.606442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4197b596-b8a1-4224-9280-2da3184926d3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:04.653872 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-4197b596-b8a1-4224-9280-2da3184926d3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] HTTP exception thrown: Instance 34c2ce33-a108-4be0-bb41-068138160281 could not be found. Jan 22 21:06:04.654489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4197b596-b8a1-4224-9280-2da3184926d3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] Returning 404 to user: Instance 34c2ce33-a108-4be0-bb41-068138160281 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:06:04.661624 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4197b596-b8a1-4224-9280-2da3184926d3 tempest-LiveAutoBlockMigrationV225Test-176555791 tempest-LiveAutoBlockMigrationV225Test-176555791-project] 10.222.0.100 "GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281" status: 404 len: 111 microversion: 2.25 time: 0.083173 Jan 22 21:06:04.662558 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1074/2071] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:04 2022] GET /compute/v2.1/servers/34c2ce33-a108-4be0-bb41-068138160281 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 22 21:06:04.780176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6ae904c7-e24a-4784-b263-77d1e7d36b00 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:04.781209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6ae904c7-e24a-4784-b263-77d1e7d36b00 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:04.792034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ae904c7-e24a-4784-b263-77d1e7d36b00 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:04.794161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ae904c7-e24a-4784-b263-77d1e7d36b00 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:04.797178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ae904c7-e24a-4784-b263-77d1e7d36b00 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:04.801023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ae904c7-e24a-4784-b263-77d1e7d36b00 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:04.901941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6ae904c7-e24a-4784-b263-77d1e7d36b00 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:04.917349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6ae904c7-e24a-4784-b263-77d1e7d36b00 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:04.925153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6ae904c7-e24a-4784-b263-77d1e7d36b00 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:04.927519 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6ae904c7-e24a-4784-b263-77d1e7d36b00 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.153079 Jan 22 21:06:04.931499 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1075/2072] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:04 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:06:04.942123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ff4eed52-62f4-44c0-9617-4b706746fa26 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:04.943935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ff4eed52-62f4-44c0-9617-4b706746fa26 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:04.963301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff4eed52-62f4-44c0-9617-4b706746fa26 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:04.963905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff4eed52-62f4-44c0-9617-4b706746fa26 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:04.964850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff4eed52-62f4-44c0-9617-4b706746fa26 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:04.969101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff4eed52-62f4-44c0-9617-4b706746fa26 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:05.238335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-9096f2fc-df4e-44ec-b03d-4568becbe699 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Getting quotas for project 9e437a5b9bd14e108f01a125645d62b7. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:06:05.249050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-9096f2fc-df4e-44ec-b03d-4568becbe699 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Getting quotas for user f6394c313d9a45a6b6ab718256a7b454 and project 9e437a5b9bd14e108f01a125645d62b7. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:06:05.270218 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9096f2fc-df4e-44ec-b03d-4568becbe699 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.42 time: 0.758361 Jan 22 21:06:05.271641 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 998/2073] 10.222.0.100 () {62 vars in 1203 bytes} [Sat Jan 22 21:06:04 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 760 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:06:05.281114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-39361db6-a089-46b1-8304-e9fd90ecb141 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:05.282414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-39361db6-a089-46b1-8304-e9fd90ecb141 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:05.296093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39361db6-a089-46b1-8304-e9fd90ecb141 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:05.296997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39361db6-a089-46b1-8304-e9fd90ecb141 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:05.298017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39361db6-a089-46b1-8304-e9fd90ecb141 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:05.298468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39361db6-a089-46b1-8304-e9fd90ecb141 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:05.346034 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-39361db6-a089-46b1-8304-e9fd90ecb141 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.072752 Jan 22 21:06:05.348436 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 999/2074] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:05 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:05.356753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b10351e-e299-45d3-afed-9ec7d3d0375d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:05.362685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4b10351e-e299-45d3-afed-9ec7d3d0375d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:05.371525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b10351e-e299-45d3-afed-9ec7d3d0375d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:05.372373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b10351e-e299-45d3-afed-9ec7d3d0375d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:05.373403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b10351e-e299-45d3-afed-9ec7d3d0375d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:05.374072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b10351e-e299-45d3-afed-9ec7d3d0375d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:05.431533 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b10351e-e299-45d3-afed-9ec7d3d0375d tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.080900 Jan 22 21:06:05.433268 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1000/2075] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:05 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:05.439628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-a84d834d-1a9d-4a56-852c-d5fb45cbce62 req-56c0bb5c-fe7c-4e79-a561-2dd8434a861b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4446fe1f-c015-4a1d-800b-b2c6a7911948", "tag": "4be0f157-1389-4003-a0b7-e5ae09ef77f5"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:05.441379 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:05.441379 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:06:05.450207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a84d834d-1a9d-4a56-852c-d5fb45cbce62 req-56c0bb5c-fe7c-4e79-a561-2dd8434a861b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:05.450885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a84d834d-1a9d-4a56-852c-d5fb45cbce62 req-56c0bb5c-fe7c-4e79-a561-2dd8434a861b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:05.463573 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-a84d834d-1a9d-4a56-852c-d5fb45cbce62 req-56c0bb5c-fe7c-4e79-a561-2dd8434a861b service nova] Creating event network-changed:4be0f157-1389-4003-a0b7-e5ae09ef77f5 for instance 4446fe1f-c015-4a1d-800b-b2c6a7911948 on nch1-master-1 Jan 22 21:06:05.470655 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-a84d834d-1a9d-4a56-852c-d5fb45cbce62 req-56c0bb5c-fe7c-4e79-a561-2dd8434a861b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034257 Jan 22 21:06:05.471369 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1001/2076] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:05.625799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ff4eed52-62f4-44c0-9617-4b706746fa26 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:05.635267 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ff4eed52-62f4-44c0-9617-4b706746fa26 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1327 microversion: 2.1 time: 0.702225 Jan 22 21:06:05.646624 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1076/2077] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:04 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1327 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:05.954231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-33ae6d47-012e-4a1a-b088-e938b74b93a9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:05.955081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-33ae6d47-012e-4a1a-b088-e938b74b93a9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:05.964618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33ae6d47-012e-4a1a-b088-e938b74b93a9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:05.964890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33ae6d47-012e-4a1a-b088-e938b74b93a9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:05.966690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33ae6d47-012e-4a1a-b088-e938b74b93a9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:05.967598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33ae6d47-012e-4a1a-b088-e938b74b93a9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:06.053721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-33ae6d47-012e-4a1a-b088-e938b74b93a9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:06.070468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-33ae6d47-012e-4a1a-b088-e938b74b93a9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:06.073536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-33ae6d47-012e-4a1a-b088-e938b74b93a9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:06.077160 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-33ae6d47-012e-4a1a-b088-e938b74b93a9 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.127478 Jan 22 21:06:06.077160 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1002/2078] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:05 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:06.358019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c3e9ee83-8cf2-4e2a-85e7-688a8353af22 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:06.359014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c3e9ee83-8cf2-4e2a-85e7-688a8353af22 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:06.377123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3e9ee83-8cf2-4e2a-85e7-688a8353af22 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:06.377595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3e9ee83-8cf2-4e2a-85e7-688a8353af22 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:06.378400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3e9ee83-8cf2-4e2a-85e7-688a8353af22 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:06.378831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3e9ee83-8cf2-4e2a-85e7-688a8353af22 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:06.444837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-63fb6362-0d78-4b43-a569-207ebbad4c9c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:06.446438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-63fb6362-0d78-4b43-a569-207ebbad4c9c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:06.448827 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c3e9ee83-8cf2-4e2a-85e7-688a8353af22 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.094162 Jan 22 21:06:06.450374 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1077/2079] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:06 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:06.466040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63fb6362-0d78-4b43-a569-207ebbad4c9c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:06.466811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63fb6362-0d78-4b43-a569-207ebbad4c9c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:06.467716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63fb6362-0d78-4b43-a569-207ebbad4c9c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:06.468181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63fb6362-0d78-4b43-a569-207ebbad4c9c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:06.536429 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-63fb6362-0d78-4b43-a569-207ebbad4c9c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.096268 Jan 22 21:06:06.537612 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1003/2080] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:06 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:06:06.653280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8e962097-d1ce-4cba-9b4a-3bb6fa0d8956 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:06.655101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8e962097-d1ce-4cba-9b4a-3bb6fa0d8956 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:06.663572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e962097-d1ce-4cba-9b4a-3bb6fa0d8956 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:06.664280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e962097-d1ce-4cba-9b4a-3bb6fa0d8956 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:06.665812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e962097-d1ce-4cba-9b4a-3bb6fa0d8956 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:06.666363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e962097-d1ce-4cba-9b4a-3bb6fa0d8956 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:06.917291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8e962097-d1ce-4cba-9b4a-3bb6fa0d8956 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:06.926203 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8e962097-d1ce-4cba-9b4a-3bb6fa0d8956 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1327 microversion: 2.1 time: 0.277675 Jan 22 21:06:06.927440 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1078/2081] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:06 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1327 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:07.097342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2309b948-950a-41fa-afc5-858c433a3cbb tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:07.098191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2309b948-950a-41fa-afc5-858c433a3cbb tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:07.107422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2309b948-950a-41fa-afc5-858c433a3cbb tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:07.111180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2309b948-950a-41fa-afc5-858c433a3cbb tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:07.112510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2309b948-950a-41fa-afc5-858c433a3cbb tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:07.113175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2309b948-950a-41fa-afc5-858c433a3cbb tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:07.204825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2309b948-950a-41fa-afc5-858c433a3cbb tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:07.218202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2309b948-950a-41fa-afc5-858c433a3cbb tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:07.219959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2309b948-950a-41fa-afc5-858c433a3cbb tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:07.221193 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2309b948-950a-41fa-afc5-858c433a3cbb tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.128378 Jan 22 21:06:07.221869 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1004/2082] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:07 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:07.277304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2028525715", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:07.337267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:06:07.460723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eea57eb7-a75c-43c1-b2fd-ef06228ff3c9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:07.462085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eea57eb7-a75c-43c1-b2fd-ef06228ff3c9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:07.469795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eea57eb7-a75c-43c1-b2fd-ef06228ff3c9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:07.470473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eea57eb7-a75c-43c1-b2fd-ef06228ff3c9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:07.471674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eea57eb7-a75c-43c1-b2fd-ef06228ff3c9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:07.472543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eea57eb7-a75c-43c1-b2fd-ef06228ff3c9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:07.537039 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eea57eb7-a75c-43c1-b2fd-ef06228ff3c9 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.079012 Jan 22 21:06:07.544360 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1005/2083] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:07 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:06:07.550215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24fa5fcc-2df1-43d8-b5ab-5fa28aeff1c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:07.551413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-24fa5fcc-2df1-43d8-b5ab-5fa28aeff1c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:07.559277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24fa5fcc-2df1-43d8-b5ab-5fa28aeff1c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:07.559724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24fa5fcc-2df1-43d8-b5ab-5fa28aeff1c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:07.560791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24fa5fcc-2df1-43d8-b5ab-5fa28aeff1c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:07.561138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24fa5fcc-2df1-43d8-b5ab-5fa28aeff1c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:07.614338 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-24fa5fcc-2df1-43d8-b5ab-5fa28aeff1c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.068191 Jan 22 21:06:07.616153 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1006/2084] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:07 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:07.644724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:06:07.645231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:06:07.645806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:06:07.646325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:06:07.646797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:06:07.656356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:07.656853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:07.660444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:07.660444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:07.675812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Getting quotas for project 0f284a3408a5405c846c300e8b9b2db1. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:06:07.682226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Getting quotas for user a549e49cc361449bb5564446c4da0781 and project 0f284a3408a5405c846c300e8b9b2db1. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:06:07.695663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:06:07.698863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:06:07.826004 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6069d7b6-8bb2-4876-8a07-0819f4dae1e4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.679607 Jan 22 21:06:07.836713 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1079/2085] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:06:07 2022] POST /compute/v2.1/servers => generated 382 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:06:07.854846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c685b946-e4a4-45ae-970d-77d16affc10b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:07.855572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c685b946-e4a4-45ae-970d-77d16affc10b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:07.948133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a3b17cc7-c9d2-43da-adb7-7efe6028bd6f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:07.949093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a3b17cc7-c9d2-43da-adb7-7efe6028bd6f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:07.958754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b17cc7-c9d2-43da-adb7-7efe6028bd6f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:07.964336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c685b946-e4a4-45ae-970d-77d16affc10b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:07.971816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b17cc7-c9d2-43da-adb7-7efe6028bd6f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:07.974802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b17cc7-c9d2-43da-adb7-7efe6028bd6f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:07.975239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b17cc7-c9d2-43da-adb7-7efe6028bd6f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:07.976401 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c685b946-e4a4-45ae-970d-77d16affc10b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1221 microversion: 2.1 time: 0.131934 Jan 22 21:06:07.981653 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1007/2086] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:07 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1221 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:08.239957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc6ef87d-c015-4699-ab0d-7cfd9605c849 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:08.240572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bc6ef87d-c015-4699-ab0d-7cfd9605c849 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:08.249053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc6ef87d-c015-4699-ab0d-7cfd9605c849 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:08.249572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc6ef87d-c015-4699-ab0d-7cfd9605c849 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:08.250382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc6ef87d-c015-4699-ab0d-7cfd9605c849 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:08.250833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc6ef87d-c015-4699-ab0d-7cfd9605c849 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:08.261385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a3b17cc7-c9d2-43da-adb7-7efe6028bd6f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:08.271436 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a3b17cc7-c9d2-43da-adb7-7efe6028bd6f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1327 microversion: 2.1 time: 0.330426 Jan 22 21:06:08.272701 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1080/2087] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:07 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1327 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:06:08.330060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bc6ef87d-c015-4699-ab0d-7cfd9605c849 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:08.338417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bc6ef87d-c015-4699-ab0d-7cfd9605c849 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:08.341014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bc6ef87d-c015-4699-ab0d-7cfd9605c849 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:08.341767 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bc6ef87d-c015-4699-ab0d-7cfd9605c849 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.105461 Jan 22 21:06:08.342339 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1008/2088] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:08 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:06:08.550714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a49b3b08-819f-4b50-8fc0-3dc2f8710fe7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:08.551742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a49b3b08-819f-4b50-8fc0-3dc2f8710fe7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:08.558496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a49b3b08-819f-4b50-8fc0-3dc2f8710fe7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:08.558896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a49b3b08-819f-4b50-8fc0-3dc2f8710fe7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:08.559707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a49b3b08-819f-4b50-8fc0-3dc2f8710fe7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:08.560110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a49b3b08-819f-4b50-8fc0-3dc2f8710fe7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:08.608853 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a49b3b08-819f-4b50-8fc0-3dc2f8710fe7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.054733 Jan 22 21:06:08.608853 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1081/2089] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:08 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:08.626982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-36711b60-1291-46d0-8ee5-617e50270dcc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:08.628714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-36711b60-1291-46d0-8ee5-617e50270dcc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:08.636434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36711b60-1291-46d0-8ee5-617e50270dcc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:08.637245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36711b60-1291-46d0-8ee5-617e50270dcc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:08.639694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36711b60-1291-46d0-8ee5-617e50270dcc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:08.640355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36711b60-1291-46d0-8ee5-617e50270dcc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:08.684682 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-36711b60-1291-46d0-8ee5-617e50270dcc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.061256 Jan 22 21:06:08.685591 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1009/2090] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:08 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:08.856780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2115833814", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d370d0d2-5701-4fc7-88b3-b716911e05d4"}, {"port": "fd4bbc77-36a6-44fe-a7c8-4f7f72a35d2f", "tag": "port-1"}, {"port": "40974874-966d-4b01-b7e3-7346238b818a", "tag": "port-2"}, {"uuid": "1ae98e4f-ed8a-4e21-8a3d-696c5b1827b1", "tag": "net-1"}, {"uuid": "1ae98e4f-ed8a-4e21-8a3d-696c5b1827b1"}, {"uuid": "2b03a5e6-c760-48ab-bf36-1f3abbcea42b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "2b03a5e6-c760-48ab-bf36-1f3abbcea42b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "7175172a-4e03-45a2-96c6-13d0d8d19ff6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "7ef1c996-ac87-48c1-a8c2-c58eed7d1c14", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "fdf5d208-3baf-45d3-9815-e2f0994a442c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1271778228"}], "key_name": "tempest-keypair-1839206740", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:08.986145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] validate_networks() for [('d370d0d2-5701-4fc7-88b3-b716911e05d4', None, None, None, None, None), (None, None, 'fd4bbc77-36a6-44fe-a7c8-4f7f72a35d2f', None, None, None), (None, None, '40974874-966d-4b01-b7e3-7346238b818a', None, None, None), ('1ae98e4f-ed8a-4e21-8a3d-696c5b1827b1', None, None, None, None, None), ('1ae98e4f-ed8a-4e21-8a3d-696c5b1827b1', None, None, None, None, None), ('2b03a5e6-c760-48ab-bf36-1f3abbcea42b', '10.2.2.100', None, None, None, None), ('2b03a5e6-c760-48ab-bf36-1f3abbcea42b', '10.2.2.200', None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:06:08.995723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-be1ef47b-2ef9-4c42-934a-3f709d3430ee tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:08.996690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-be1ef47b-2ef9-4c42-934a-3f709d3430ee tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:09.004985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be1ef47b-2ef9-4c42-934a-3f709d3430ee tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:09.005736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be1ef47b-2ef9-4c42-934a-3f709d3430ee tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:09.006578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be1ef47b-2ef9-4c42-934a-3f709d3430ee tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:09.007042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be1ef47b-2ef9-4c42-934a-3f709d3430ee tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:09.070222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-be1ef47b-2ef9-4c42-934a-3f709d3430ee tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:09.079519 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-be1ef47b-2ef9-4c42-934a-3f709d3430ee tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1225 microversion: 2.1 time: 0.088706 Jan 22 21:06:09.080125 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1010/2091] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:08 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:06:09.292181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dacc3b72-b7ed-40e1-8c0b-18f37f717194 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:09.292963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dacc3b72-b7ed-40e1-8c0b-18f37f717194 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:09.299827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dacc3b72-b7ed-40e1-8c0b-18f37f717194 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:09.300312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dacc3b72-b7ed-40e1-8c0b-18f37f717194 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:09.301116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dacc3b72-b7ed-40e1-8c0b-18f37f717194 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:09.301600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dacc3b72-b7ed-40e1-8c0b-18f37f717194 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:09.482854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dacc3b72-b7ed-40e1-8c0b-18f37f717194 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:09.494053 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dacc3b72-b7ed-40e1-8c0b-18f37f717194 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1327 microversion: 2.1 time: 0.204657 Jan 22 21:06:09.494660 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1011/2092] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:09 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1327 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:09.510272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e369e749-fa66-4ec0-a629-446796ef1783 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:09.511024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e369e749-fa66-4ec0-a629-446796ef1783 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:09.519980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e369e749-fa66-4ec0-a629-446796ef1783 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:09.520701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e369e749-fa66-4ec0-a629-446796ef1783 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:09.521893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e369e749-fa66-4ec0-a629-446796ef1783 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:09.522622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e369e749-fa66-4ec0-a629-446796ef1783 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:09.632860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e369e749-fa66-4ec0-a629-446796ef1783 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:09.644064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e369e749-fa66-4ec0-a629-446796ef1783 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:09.646285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e369e749-fa66-4ec0-a629-446796ef1783 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:09.647500 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e369e749-fa66-4ec0-a629-446796ef1783 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.151081 Jan 22 21:06:09.648432 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1012/2093] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:09 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:09.655926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f79ed02e-0f9e-46ed-9c5c-9037707abab7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:09.658140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f79ed02e-0f9e-46ed-9c5c-9037707abab7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:09.666671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f79ed02e-0f9e-46ed-9c5c-9037707abab7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:09.667391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f79ed02e-0f9e-46ed-9c5c-9037707abab7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:09.668394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f79ed02e-0f9e-46ed-9c5c-9037707abab7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:09.669086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f79ed02e-0f9e-46ed-9c5c-9037707abab7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:09.728171 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f79ed02e-0f9e-46ed-9c5c-9037707abab7 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.076844 Jan 22 21:06:09.734813 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1013/2094] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:09 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:09.740948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7503bcbf-3b69-4237-8368-f0bbb91cbe6a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:09.746041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7503bcbf-3b69-4237-8368-f0bbb91cbe6a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:09.757667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7503bcbf-3b69-4237-8368-f0bbb91cbe6a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:09.758732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7503bcbf-3b69-4237-8368-f0bbb91cbe6a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:09.759603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7503bcbf-3b69-4237-8368-f0bbb91cbe6a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:09.760037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7503bcbf-3b69-4237-8368-f0bbb91cbe6a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:09.803996 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7503bcbf-3b69-4237-8368-f0bbb91cbe6a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.066389 Jan 22 21:06:09.803996 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1014/2095] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:09 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:10.253030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1638676580", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:10.329529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:06:10.588329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:06:10.588849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:06:10.589351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:06:10.589688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:06:10.596783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:06:10.607093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:10.607900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:10.608956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:10.609610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:10.629732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Getting quotas for project 3e63d05e0fb84113bd23bc9c064ddad8. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:06:10.638171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Getting quotas for user 77ac42e3ea264a9fb8a56bc73caf9f5c and project 3e63d05e0fb84113bd23bc9c064ddad8. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:06:10.655245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:06:10.658266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:06:10.788506 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7a89f029-bed3-419b-8c52-4b5a583f77d3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.728983 Jan 22 21:06:10.789661 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1015/2096] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:06:10 2022] POST /compute/v2.1/servers => generated 382 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:06:10.803383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-464f9d7d-8abb-4999-9a99-c377210d1d2d tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:10.804114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-464f9d7d-8abb-4999-9a99-c377210d1d2d tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:10.813136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-464f9d7d-8abb-4999-9a99-c377210d1d2d tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:10.813626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-464f9d7d-8abb-4999-9a99-c377210d1d2d tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:10.814431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-464f9d7d-8abb-4999-9a99-c377210d1d2d tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:10.814872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-464f9d7d-8abb-4999-9a99-c377210d1d2d tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:10.890793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-464f9d7d-8abb-4999-9a99-c377210d1d2d tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:10.899615 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-464f9d7d-8abb-4999-9a99-c377210d1d2d tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1279 microversion: 2.1 time: 0.103069 Jan 22 21:06:10.900679 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1016/2097] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:10 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1279 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:10.904659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f001ada5-f294-4741-864b-165465f1e46c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:10.905327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f001ada5-f294-4741-864b-165465f1e46c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:10.911457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f001ada5-f294-4741-864b-165465f1e46c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:10.911972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f001ada5-f294-4741-864b-165465f1e46c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:10.912836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f001ada5-f294-4741-864b-165465f1e46c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:10.913343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f001ada5-f294-4741-864b-165465f1e46c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:11.051488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f001ada5-f294-4741-864b-165465f1e46c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:11.059901 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f001ada5-f294-4741-864b-165465f1e46c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1327 microversion: 2.1 time: 0.158651 Jan 22 21:06:11.060477 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1017/2098] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:10 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1327 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:11.075106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-63091f56-b7f7-491b-9010-de85626cf6b1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:11.075798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-63091f56-b7f7-491b-9010-de85626cf6b1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:11.081860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63091f56-b7f7-491b-9010-de85626cf6b1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:11.082294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63091f56-b7f7-491b-9010-de85626cf6b1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:11.083161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63091f56-b7f7-491b-9010-de85626cf6b1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:11.083598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63091f56-b7f7-491b-9010-de85626cf6b1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:11.147588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-63091f56-b7f7-491b-9010-de85626cf6b1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:11.156609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-63091f56-b7f7-491b-9010-de85626cf6b1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:11.158153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-63091f56-b7f7-491b-9010-de85626cf6b1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:11.159297 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-63091f56-b7f7-491b-9010-de85626cf6b1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.089079 Jan 22 21:06:11.159894 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1018/2099] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:11 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:11.164149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f4ac0462-6c34-4a17-9d6f-71202014742b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:11.165221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f4ac0462-6c34-4a17-9d6f-71202014742b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:11.171012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4ac0462-6c34-4a17-9d6f-71202014742b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:11.171488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4ac0462-6c34-4a17-9d6f-71202014742b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:11.172264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4ac0462-6c34-4a17-9d6f-71202014742b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:11.172709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4ac0462-6c34-4a17-9d6f-71202014742b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:11.222181 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f4ac0462-6c34-4a17-9d6f-71202014742b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.060890 Jan 22 21:06:11.226163 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1019/2100] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:11 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:11.228129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7105bda9-5598-49a6-9aee-a9b1d83ca6e3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:11.228827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7105bda9-5598-49a6-9aee-a9b1d83ca6e3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:11.284773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7105bda9-5598-49a6-9aee-a9b1d83ca6e3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:11.292183 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7105bda9-5598-49a6-9aee-a9b1d83ca6e3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1223 microversion: 2.1 time: 0.068139 Jan 22 21:06:11.292989 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1020/2101] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:11 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1223 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:11.297344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-13124c55-111b-47e2-9a24-be8c2b2586ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:11.298584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-13124c55-111b-47e2-9a24-be8c2b2586ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:11.304751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13124c55-111b-47e2-9a24-be8c2b2586ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:11.305794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13124c55-111b-47e2-9a24-be8c2b2586ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:11.306583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13124c55-111b-47e2-9a24-be8c2b2586ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:11.307012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13124c55-111b-47e2-9a24-be8c2b2586ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:11.348986 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-13124c55-111b-47e2-9a24-be8c2b2586ff tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.054709 Jan 22 21:06:11.352803 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1021/2102] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:11 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:11.916792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a77d43f3-ec36-4640-885e-73b234db7d39 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:11.917573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a77d43f3-ec36-4640-885e-73b234db7d39 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:11.924865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a77d43f3-ec36-4640-885e-73b234db7d39 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:11.925323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a77d43f3-ec36-4640-885e-73b234db7d39 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:11.926154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a77d43f3-ec36-4640-885e-73b234db7d39 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:11.926601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a77d43f3-ec36-4640-885e-73b234db7d39 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:11.999303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a77d43f3-ec36-4640-885e-73b234db7d39 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:12.009614 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a77d43f3-ec36-4640-885e-73b234db7d39 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1279 microversion: 2.1 time: 0.096766 Jan 22 21:06:12.019172 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1022/2103] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:11 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1279 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:12.088124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e02e74f6-2a83-402f-9ae1-934570a2b4db tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:12.090107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e02e74f6-2a83-402f-9ae1-934570a2b4db tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:12.120660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e02e74f6-2a83-402f-9ae1-934570a2b4db tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:12.121839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e02e74f6-2a83-402f-9ae1-934570a2b4db tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:12.124177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e02e74f6-2a83-402f-9ae1-934570a2b4db tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:12.126171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e02e74f6-2a83-402f-9ae1-934570a2b4db tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:12.320029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:06:12.333738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:06:12.333738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:06:12.333738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:06:12.333738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:06:12.343418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:12.343940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:12.345733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:12.346191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:12.370076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Getting quotas for project 9e437a5b9bd14e108f01a125645d62b7. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:06:12.393834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Getting quotas for user f6394c313d9a45a6b6ab718256a7b454 and project 9e437a5b9bd14e108f01a125645d62b7. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:06:12.425662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e02e74f6-2a83-402f-9ae1-934570a2b4db tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:12.444514 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e02e74f6-2a83-402f-9ae1-934570a2b4db tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1327 microversion: 2.1 time: 0.368641 Jan 22 21:06:12.445381 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1023/2104] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:12 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1327 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:12.483347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3e65b7a9-52ec-4880-b110-144bce94fac2 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:12.484320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3e65b7a9-52ec-4880-b110-144bce94fac2 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:12.491962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e65b7a9-52ec-4880-b110-144bce94fac2 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:12.492780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e65b7a9-52ec-4880-b110-144bce94fac2 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:12.494835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e65b7a9-52ec-4880-b110-144bce94fac2 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:12.495503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e65b7a9-52ec-4880-b110-144bce94fac2 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:12.569203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3e65b7a9-52ec-4880-b110-144bce94fac2 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:12.583363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3e65b7a9-52ec-4880-b110-144bce94fac2 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:12.585364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3e65b7a9-52ec-4880-b110-144bce94fac2 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:12.588053 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3e65b7a9-52ec-4880-b110-144bce94fac2 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.134479 Jan 22 21:06:12.589148 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1024/2105] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:12 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:12.594624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-eb3e764d-ef27-4324-ae47-1e2802cb3fef req-bdf06954-a797-42c3-b96c-a6d5e39513b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4446fe1f-c015-4a1d-800b-b2c6a7911948", "name": "network-vif-plugged", "status": "completed", "tag": "4be0f157-1389-4003-a0b7-e5ae09ef77f5"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:12.596406 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:12.596406 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:06:12.604529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:06:12.609051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='7175172a-4e03-45a2-96c6-13d0d8d19ff6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='7ef1c996-ac87-48c1-a8c2-c58eed7d1c14',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fdf5d208-3baf-45d3-9815-e2f0994a442c',volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:06:12.623432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-eb3e764d-ef27-4324-ae47-1e2802cb3fef req-bdf06954-a797-42c3-b96c-a6d5e39513b5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:12.623432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-eb3e764d-ef27-4324-ae47-1e2802cb3fef req-bdf06954-a797-42c3-b96c-a6d5e39513b5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:12.628341 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-eb3e764d-ef27-4324-ae47-1e2802cb3fef req-bdf06954-a797-42c3-b96c-a6d5e39513b5 service nova] Creating event network-vif-plugged:4be0f157-1389-4003-a0b7-e5ae09ef77f5 for instance 4446fe1f-c015-4a1d-800b-b2c6a7911948 on nch1-master-1 Jan 22 21:06:12.653560 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-eb3e764d-ef27-4324-ae47-1e2802cb3fef req-bdf06954-a797-42c3-b96c-a6d5e39513b5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058004 Jan 22 21:06:12.654379 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1025/2106] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:12.667906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-62f7ceff-4784-41b7-9539-65aed1e4f489 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:12.670602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-62f7ceff-4784-41b7-9539-65aed1e4f489 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:12.694293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62f7ceff-4784-41b7-9539-65aed1e4f489 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:12.694885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62f7ceff-4784-41b7-9539-65aed1e4f489 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:12.697316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62f7ceff-4784-41b7-9539-65aed1e4f489 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:12.697910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62f7ceff-4784-41b7-9539-65aed1e4f489 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:12.749957 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-62f7ceff-4784-41b7-9539-65aed1e4f489 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.093605 Jan 22 21:06:12.750610 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1026/2107] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:12 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:12.760859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-753c02cb-d5d9-46b7-8068-216d44ea5ac4 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:12.761610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-753c02cb-d5d9-46b7-8068-216d44ea5ac4 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:12.769152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-753c02cb-d5d9-46b7-8068-216d44ea5ac4 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:12.772871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-753c02cb-d5d9-46b7-8068-216d44ea5ac4 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:12.772871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-753c02cb-d5d9-46b7-8068-216d44ea5ac4 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:12.772871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-753c02cb-d5d9-46b7-8068-216d44ea5ac4 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:12.846346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-753c02cb-d5d9-46b7-8068-216d44ea5ac4 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:12.858199 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-753c02cb-d5d9-46b7-8068-216d44ea5ac4 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1275 microversion: 2.1 time: 0.101420 Jan 22 21:06:12.858814 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1027/2108] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:12 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1275 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:12.865435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4d34b3ef-4e28-4f4e-9083-a3388efd407a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:12.866549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4d34b3ef-4e28-4f4e-9083-a3388efd407a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:12.874864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d34b3ef-4e28-4f4e-9083-a3388efd407a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:12.875549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d34b3ef-4e28-4f4e-9083-a3388efd407a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:12.876507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d34b3ef-4e28-4f4e-9083-a3388efd407a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:12.876948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d34b3ef-4e28-4f4e-9083-a3388efd407a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:12.935788 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4d34b3ef-4e28-4f4e-9083-a3388efd407a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.075414 Jan 22 21:06:12.936704 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1028/2109] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:12 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:13.028160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cc47f4a7-0d6b-4161-beb8-579efdfc7b7e tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:13.028862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cc47f4a7-0d6b-4161-beb8-579efdfc7b7e tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:13.038772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc47f4a7-0d6b-4161-beb8-579efdfc7b7e tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:13.040989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc47f4a7-0d6b-4161-beb8-579efdfc7b7e tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:13.041757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc47f4a7-0d6b-4161-beb8-579efdfc7b7e tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:13.042211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc47f4a7-0d6b-4161-beb8-579efdfc7b7e tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:13.281959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cc47f4a7-0d6b-4161-beb8-579efdfc7b7e tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:13.288561 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cc47f4a7-0d6b-4161-beb8-579efdfc7b7e tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1321 microversion: 2.1 time: 0.265418 Jan 22 21:06:13.289150 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1029/2110] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:13 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:06:13.388466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-971cbdf7-8d1b-4c34-b640-fd85de115b85 req-e9c8711d-f91b-4662-8a27-06babaa96867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b31384bb-6cc1-45a4-a067-92ac3713ef55", "tag": "493297bc-3a80-4965-b414-e858560483fb"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:13.390527 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:13.390527 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:06:13.407116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-971cbdf7-8d1b-4c34-b640-fd85de115b85 req-e9c8711d-f91b-4662-8a27-06babaa96867 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:13.412078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-971cbdf7-8d1b-4c34-b640-fd85de115b85 req-e9c8711d-f91b-4662-8a27-06babaa96867 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:13.439054 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-971cbdf7-8d1b-4c34-b640-fd85de115b85 req-e9c8711d-f91b-4662-8a27-06babaa96867 service nova] Creating event network-changed:493297bc-3a80-4965-b414-e858560483fb for instance b31384bb-6cc1-45a4-a067-92ac3713ef55 on nch1-master-1 Jan 22 21:06:13.450369 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-971cbdf7-8d1b-4c34-b640-fd85de115b85 req-e9c8711d-f91b-4662-8a27-06babaa96867 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065449 Jan 22 21:06:13.458625 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1030/2111] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:13.465453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ccbb8324-c868-4022-8d35-ba558a32c7fc tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:13.472476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ccbb8324-c868-4022-8d35-ba558a32c7fc tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:13.490264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccbb8324-c868-4022-8d35-ba558a32c7fc tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:13.490734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccbb8324-c868-4022-8d35-ba558a32c7fc tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:13.491545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccbb8324-c868-4022-8d35-ba558a32c7fc tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:13.491980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccbb8324-c868-4022-8d35-ba558a32c7fc tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:13.889055 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61f17db8-c569-4de4-978d-158d71ae8b98 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.42 time: 5.037182 Jan 22 21:06:13.894781 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1082/2112] 10.222.0.100 () {62 vars in 1193 bytes} [Sat Jan 22 21:06:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 5044 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jan 22 21:06:13.905549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4962d21e-5cf2-4994-987a-ac06d0abf086 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:13.906406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4962d21e-5cf2-4994-987a-ac06d0abf086 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:13.918320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4962d21e-5cf2-4994-987a-ac06d0abf086 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:13.918910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4962d21e-5cf2-4994-987a-ac06d0abf086 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:13.920046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4962d21e-5cf2-4994-987a-ac06d0abf086 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:13.921253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4962d21e-5cf2-4994-987a-ac06d0abf086 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:14.051428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4962d21e-5cf2-4994-987a-ac06d0abf086 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:14.060645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4962d21e-5cf2-4994-987a-ac06d0abf086 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:14.064152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4962d21e-5cf2-4994-987a-ac06d0abf086 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:14.064152 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4962d21e-5cf2-4994-987a-ac06d0abf086 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.167253 Jan 22 21:06:14.064152 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1083/2113] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:13 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:14.086066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ef809eaf-f23d-4532-880a-730fc7364df5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:14.087680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ef809eaf-f23d-4532-880a-730fc7364df5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:14.100658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef809eaf-f23d-4532-880a-730fc7364df5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:14.101387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef809eaf-f23d-4532-880a-730fc7364df5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:14.103227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef809eaf-f23d-4532-880a-730fc7364df5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:14.103926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef809eaf-f23d-4532-880a-730fc7364df5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:14.156275 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ef809eaf-f23d-4532-880a-730fc7364df5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.072987 Jan 22 21:06:14.157294 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1084/2114] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:14 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:14.162467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-668a85b2-a949-4d40-bed3-f3ad231df265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:14.163174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-668a85b2-a949-4d40-bed3-f3ad231df265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:14.177410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-668a85b2-a949-4d40-bed3-f3ad231df265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:14.183420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-668a85b2-a949-4d40-bed3-f3ad231df265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:14.183420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-668a85b2-a949-4d40-bed3-f3ad231df265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:14.183420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-668a85b2-a949-4d40-bed3-f3ad231df265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:14.198593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ccbb8324-c868-4022-8d35-ba558a32c7fc tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:14.216557 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ccbb8324-c868-4022-8d35-ba558a32c7fc tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1327 microversion: 2.1 time: 0.755867 Jan 22 21:06:14.221926 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1031/2115] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:13 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1327 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:14.226535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6b7cdbdc-e63f-44cb-91e4-be86a35252a8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:14.235557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6b7cdbdc-e63f-44cb-91e4-be86a35252a8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:14.322328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-668a85b2-a949-4d40-bed3-f3ad231df265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:14.333803 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-668a85b2-a949-4d40-bed3-f3ad231df265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1293 microversion: 2.1 time: 0.175033 Jan 22 21:06:14.335735 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1085/2116] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:14 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1293 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:14.349167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ee661abe-487a-4ae4-964c-b499b60d760e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:14.350853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ee661abe-487a-4ae4-964c-b499b60d760e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:14.358710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee661abe-487a-4ae4-964c-b499b60d760e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:14.359314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee661abe-487a-4ae4-964c-b499b60d760e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:14.361287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee661abe-487a-4ae4-964c-b499b60d760e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:14.362559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6b7cdbdc-e63f-44cb-91e4-be86a35252a8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:14.363128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee661abe-487a-4ae4-964c-b499b60d760e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:14.376894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6b7cdbdc-e63f-44cb-91e4-be86a35252a8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:14.382713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6b7cdbdc-e63f-44cb-91e4-be86a35252a8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:14.390433 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6b7cdbdc-e63f-44cb-91e4-be86a35252a8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1290 microversion: 2.42 time: 0.167376 Jan 22 21:06:14.391015 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1032/2117] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:14 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1290 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:14.399237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f51b9ec8-e487-4a7f-88e7-b8fa20b72dbc tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:14.399852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f51b9ec8-e487-4a7f-88e7-b8fa20b72dbc tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:14.423241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f51b9ec8-e487-4a7f-88e7-b8fa20b72dbc tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:14.423621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f51b9ec8-e487-4a7f-88e7-b8fa20b72dbc tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:14.433863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f51b9ec8-e487-4a7f-88e7-b8fa20b72dbc tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:14.437722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f51b9ec8-e487-4a7f-88e7-b8fa20b72dbc tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:14.463275 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ee661abe-487a-4ae4-964c-b499b60d760e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.124783 Jan 22 21:06:14.466959 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1086/2118] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:14 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:14.753822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f51b9ec8-e487-4a7f-88e7-b8fa20b72dbc tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:14.768543 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f51b9ec8-e487-4a7f-88e7-b8fa20b72dbc tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1321 microversion: 2.1 time: 0.375844 Jan 22 21:06:14.769475 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1033/2119] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:14 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:15.082706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c3f6c817-f212-4b9e-b02a-a637652cb80b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:15.084172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c3f6c817-f212-4b9e-b02a-a637652cb80b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:15.094567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3f6c817-f212-4b9e-b02a-a637652cb80b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.095266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3f6c817-f212-4b9e-b02a-a637652cb80b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.096266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3f6c817-f212-4b9e-b02a-a637652cb80b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.096866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3f6c817-f212-4b9e-b02a-a637652cb80b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.172608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85e263d3-7de9-424a-89c3-8b962327b04b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:15.173925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85e263d3-7de9-424a-89c3-8b962327b04b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:15.179454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c3f6c817-f212-4b9e-b02a-a637652cb80b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:15.188665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85e263d3-7de9-424a-89c3-8b962327b04b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.188840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c3f6c817-f212-4b9e-b02a-a637652cb80b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:15.190387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c3f6c817-f212-4b9e-b02a-a637652cb80b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:15.197711 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c3f6c817-f212-4b9e-b02a-a637652cb80b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.113294 Jan 22 21:06:15.197711 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1087/2120] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:15 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:15.197913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85e263d3-7de9-424a-89c3-8b962327b04b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.197913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85e263d3-7de9-424a-89c3-8b962327b04b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.197913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85e263d3-7de9-424a-89c3-8b962327b04b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.232993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f065d048-9452-4541-a131-7e578a631cf4 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:15.233659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f065d048-9452-4541-a131-7e578a631cf4 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:15.240087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f065d048-9452-4541-a131-7e578a631cf4 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.241572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f065d048-9452-4541-a131-7e578a631cf4 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.243800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f065d048-9452-4541-a131-7e578a631cf4 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.244431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f065d048-9452-4541-a131-7e578a631cf4 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.267154 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-85e263d3-7de9-424a-89c3-8b962327b04b tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.100477 Jan 22 21:06:15.270393 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1034/2121] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:15 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:15.352513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b13505f5-71e9-4af6-acd5-113b6f7774f5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:15.353645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b13505f5-71e9-4af6-acd5-113b6f7774f5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:15.368062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b13505f5-71e9-4af6-acd5-113b6f7774f5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.368795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b13505f5-71e9-4af6-acd5-113b6f7774f5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.369760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b13505f5-71e9-4af6-acd5-113b6f7774f5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.371503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b13505f5-71e9-4af6-acd5-113b6f7774f5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.449920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f065d048-9452-4541-a131-7e578a631cf4 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:15.459653 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f065d048-9452-4541-a131-7e578a631cf4 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1522 microversion: 2.1 time: 0.228972 Jan 22 21:06:15.460891 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1088/2122] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:15 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:15.466472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0b60d218-aa7e-4a4b-9a22-5efa7d35d9dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:15.467341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0b60d218-aa7e-4a4b-9a22-5efa7d35d9dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:15.474073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b60d218-aa7e-4a4b-9a22-5efa7d35d9dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.474540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b60d218-aa7e-4a4b-9a22-5efa7d35d9dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.475355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b60d218-aa7e-4a4b-9a22-5efa7d35d9dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.475985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b60d218-aa7e-4a4b-9a22-5efa7d35d9dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.516385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b13505f5-71e9-4af6-acd5-113b6f7774f5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:15.525221 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b13505f5-71e9-4af6-acd5-113b6f7774f5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1281 microversion: 2.1 time: 0.176274 Jan 22 21:06:15.525927 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1035/2123] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:15 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1281 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:06:15.540060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2df9bb3d-9950-4248-a233-8dbe7be23459 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:15.541473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2df9bb3d-9950-4248-a233-8dbe7be23459 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:15.545897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0b60d218-aa7e-4a4b-9a22-5efa7d35d9dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:15.551078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2df9bb3d-9950-4248-a233-8dbe7be23459 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.551788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2df9bb3d-9950-4248-a233-8dbe7be23459 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.552905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2df9bb3d-9950-4248-a233-8dbe7be23459 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.553801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2df9bb3d-9950-4248-a233-8dbe7be23459 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.555800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0b60d218-aa7e-4a4b-9a22-5efa7d35d9dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:15.557312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0b60d218-aa7e-4a4b-9a22-5efa7d35d9dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:15.558523 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0b60d218-aa7e-4a4b-9a22-5efa7d35d9dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1532 microversion: 2.42 time: 0.096152 Jan 22 21:06:15.559091 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1089/2124] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:15 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1532 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:15.564450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-261a8753-1e90-4adf-84eb-176d58037688 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:15.565455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-261a8753-1e90-4adf-84eb-176d58037688 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:15.573066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-261a8753-1e90-4adf-84eb-176d58037688 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.573877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-261a8753-1e90-4adf-84eb-176d58037688 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.575752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-261a8753-1e90-4adf-84eb-176d58037688 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.576212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-261a8753-1e90-4adf-84eb-176d58037688 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.609891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-261a8753-1e90-4adf-84eb-176d58037688 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lazy-loading 'flavor' on Instance uuid 4446fe1f-c015-4a1d-800b-b2c6a7911948 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:06:15.618306 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2df9bb3d-9950-4248-a233-8dbe7be23459 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.090280 Jan 22 21:06:15.619331 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1036/2125] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:15 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:15.788120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b960908a-d927-4f47-ac09-65d0c32baa9f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:15.788829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b960908a-d927-4f47-ac09-65d0c32baa9f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:15.798298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b960908a-d927-4f47-ac09-65d0c32baa9f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.799040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b960908a-d927-4f47-ac09-65d0c32baa9f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.799834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b960908a-d927-4f47-ac09-65d0c32baa9f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.800268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b960908a-d927-4f47-ac09-65d0c32baa9f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.907414 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-261a8753-1e90-4adf-84eb-176d58037688 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "POST /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948/action" status: 200 len: 32 microversion: 2.1 time: 0.345812 Jan 22 21:06:15.907414 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1090/2126] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:15 2022] POST /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948/action => generated 32 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:06:15.919223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-428f0f48-c6ab-44ac-a187-8f89ff036e58 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:15.919892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-428f0f48-c6ab-44ac-a187-8f89ff036e58 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:15.926445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-428f0f48-c6ab-44ac-a187-8f89ff036e58 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.926906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-428f0f48-c6ab-44ac-a187-8f89ff036e58 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:15.927765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-428f0f48-c6ab-44ac-a187-8f89ff036e58 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:15.928284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-428f0f48-c6ab-44ac-a187-8f89ff036e58 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:16.148105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-428f0f48-c6ab-44ac-a187-8f89ff036e58 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:16.162804 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-428f0f48-c6ab-44ac-a187-8f89ff036e58 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.249601 Jan 22 21:06:16.163408 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1091/2127] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:15 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:16.173771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b960908a-d927-4f47-ac09-65d0c32baa9f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:16.186021 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b960908a-d927-4f47-ac09-65d0c32baa9f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1321 microversion: 2.1 time: 0.403651 Jan 22 21:06:16.187091 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1037/2128] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:15 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:06:16.211081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7db585a8-21bf-4601-84f3-ca2b63c07c97 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:16.212612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7db585a8-21bf-4601-84f3-ca2b63c07c97 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:16.245940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7db585a8-21bf-4601-84f3-ca2b63c07c97 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:16.247670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7db585a8-21bf-4601-84f3-ca2b63c07c97 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:16.249590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7db585a8-21bf-4601-84f3-ca2b63c07c97 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:16.250213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7db585a8-21bf-4601-84f3-ca2b63c07c97 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:16.281154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8b6c4cf8-46db-4591-a77d-6bc0d412000f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:16.282751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8b6c4cf8-46db-4591-a77d-6bc0d412000f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:16.294236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b6c4cf8-46db-4591-a77d-6bc0d412000f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:16.294898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b6c4cf8-46db-4591-a77d-6bc0d412000f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:16.296020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b6c4cf8-46db-4591-a77d-6bc0d412000f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:16.296632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b6c4cf8-46db-4591-a77d-6bc0d412000f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:16.346016 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8b6c4cf8-46db-4591-a77d-6bc0d412000f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.068669 Jan 22 21:06:16.347311 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1038/2129] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:16 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:16.375172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7db585a8-21bf-4601-84f3-ca2b63c07c97 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:16.402260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7db585a8-21bf-4601-84f3-ca2b63c07c97 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:16.404077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7db585a8-21bf-4601-84f3-ca2b63c07c97 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:16.408639 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7db585a8-21bf-4601-84f3-ca2b63c07c97 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.200872 Jan 22 21:06:16.410116 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1092/2130] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:16 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:16.557282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4984835e-045f-4274-8acd-dd9789394d85 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:16.558281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4984835e-045f-4274-8acd-dd9789394d85 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:16.566592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4984835e-045f-4274-8acd-dd9789394d85 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:16.567038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4984835e-045f-4274-8acd-dd9789394d85 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:16.568010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4984835e-045f-4274-8acd-dd9789394d85 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:16.568608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4984835e-045f-4274-8acd-dd9789394d85 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:16.584995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f073b67-ebd2-4df2-9260-9dc1d06052c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:16.585628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f073b67-ebd2-4df2-9260-9dc1d06052c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:16.595981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f073b67-ebd2-4df2-9260-9dc1d06052c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:16.596747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f073b67-ebd2-4df2-9260-9dc1d06052c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:16.599064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f073b67-ebd2-4df2-9260-9dc1d06052c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:16.599064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f073b67-ebd2-4df2-9260-9dc1d06052c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:16.703247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f073b67-ebd2-4df2-9260-9dc1d06052c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:16.719712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f073b67-ebd2-4df2-9260-9dc1d06052c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:16.721842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f073b67-ebd2-4df2-9260-9dc1d06052c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:16.723502 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f073b67-ebd2-4df2-9260-9dc1d06052c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1588 microversion: 2.42 time: 0.148725 Jan 22 21:06:16.724680 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1093/2131] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:16 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1588 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:16.737247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-998dc244-eb38-4dde-8316-f923eccb548e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:16.738824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-998dc244-eb38-4dde-8316-f923eccb548e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:16.750780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-998dc244-eb38-4dde-8316-f923eccb548e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:16.751325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-998dc244-eb38-4dde-8316-f923eccb548e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:16.752220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-998dc244-eb38-4dde-8316-f923eccb548e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:16.752799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-998dc244-eb38-4dde-8316-f923eccb548e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:16.805772 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-998dc244-eb38-4dde-8316-f923eccb548e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.078523 Jan 22 21:06:16.810410 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1094/2132] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:16 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:16.996742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4984835e-045f-4274-8acd-dd9789394d85 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:17.004263 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4984835e-045f-4274-8acd-dd9789394d85 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1323 microversion: 2.1 time: 0.454897 Jan 22 21:06:17.005072 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1039/2133] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:16 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1323 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:17.182970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c9b748cb-0c82-44f4-abdb-b7276d7a234e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:17.184356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c9b748cb-0c82-44f4-abdb-b7276d7a234e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:17.193350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9b748cb-0c82-44f4-abdb-b7276d7a234e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:17.193841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9b748cb-0c82-44f4-abdb-b7276d7a234e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:17.194720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9b748cb-0c82-44f4-abdb-b7276d7a234e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:17.196012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9b748cb-0c82-44f4-abdb-b7276d7a234e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:17.206876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dbb9fc96-81db-4b81-a7e5-a8069e42ee72 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:17.207495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dbb9fc96-81db-4b81-a7e5-a8069e42ee72 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:17.227847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbb9fc96-81db-4b81-a7e5-a8069e42ee72 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:17.228900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbb9fc96-81db-4b81-a7e5-a8069e42ee72 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:17.230747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbb9fc96-81db-4b81-a7e5-a8069e42ee72 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:17.231439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbb9fc96-81db-4b81-a7e5-a8069e42ee72 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:17.372727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c9b748cb-0c82-44f4-abdb-b7276d7a234e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:17.390332 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c9b748cb-0c82-44f4-abdb-b7276d7a234e tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.212019 Jan 22 21:06:17.391079 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1095/2134] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:17 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:17.400591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-480b2f46-dc0a-49d5-baec-2889aff9197e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:17.401753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-480b2f46-dc0a-49d5-baec-2889aff9197e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:17.408378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-480b2f46-dc0a-49d5-baec-2889aff9197e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:17.408980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-480b2f46-dc0a-49d5-baec-2889aff9197e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:17.410585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-480b2f46-dc0a-49d5-baec-2889aff9197e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:17.411145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-480b2f46-dc0a-49d5-baec-2889aff9197e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:17.462017 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-480b2f46-dc0a-49d5-baec-2889aff9197e tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.065919 Jan 22 21:06:17.462868 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1096/2135] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:17 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:17.469715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2d98bcfc-25c3-4b45-a6ef-7279dd5cf810 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:17.470582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2d98bcfc-25c3-4b45-a6ef-7279dd5cf810 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:17.478404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d98bcfc-25c3-4b45-a6ef-7279dd5cf810 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:17.479016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d98bcfc-25c3-4b45-a6ef-7279dd5cf810 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:17.480048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d98bcfc-25c3-4b45-a6ef-7279dd5cf810 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:17.480608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d98bcfc-25c3-4b45-a6ef-7279dd5cf810 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:17.559448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2d98bcfc-25c3-4b45-a6ef-7279dd5cf810 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:17.575290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2d98bcfc-25c3-4b45-a6ef-7279dd5cf810 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:17.577927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2d98bcfc-25c3-4b45-a6ef-7279dd5cf810 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:17.579250 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2d98bcfc-25c3-4b45-a6ef-7279dd5cf810 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.114936 Jan 22 21:06:17.580209 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1097/2136] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:17 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:17.748661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-906dd443-f2b2-48bd-a8af-0215de509fd7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:17.749646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-906dd443-f2b2-48bd-a8af-0215de509fd7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:17.761861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-906dd443-f2b2-48bd-a8af-0215de509fd7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:17.762613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-906dd443-f2b2-48bd-a8af-0215de509fd7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:17.763621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-906dd443-f2b2-48bd-a8af-0215de509fd7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:17.765632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-906dd443-f2b2-48bd-a8af-0215de509fd7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:17.853684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dbb9fc96-81db-4b81-a7e5-a8069e42ee72 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:17.863933 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dbb9fc96-81db-4b81-a7e5-a8069e42ee72 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1321 microversion: 2.1 time: 0.660089 Jan 22 21:06:17.864536 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1040/2137] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:17 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1321 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:06:17.872790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-75641122-d367-4784-bab3-baff7cc976b8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:17.873743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-75641122-d367-4784-bab3-baff7cc976b8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:17.900141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75641122-d367-4784-bab3-baff7cc976b8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:17.900623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75641122-d367-4784-bab3-baff7cc976b8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:17.901426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75641122-d367-4784-bab3-baff7cc976b8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:17.901893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75641122-d367-4784-bab3-baff7cc976b8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:17.960119 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-75641122-d367-4784-bab3-baff7cc976b8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.090859 Jan 22 21:06:17.960823 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1041/2138] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:17 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:18.022841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e977dc56-a696-48d4-aa30-042b105dceec tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:18.024226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e977dc56-a696-48d4-aa30-042b105dceec tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:18.038267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e977dc56-a696-48d4-aa30-042b105dceec tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:18.046403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e977dc56-a696-48d4-aa30-042b105dceec tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:18.046403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e977dc56-a696-48d4-aa30-042b105dceec tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:18.046911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e977dc56-a696-48d4-aa30-042b105dceec tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:18.101817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-906dd443-f2b2-48bd-a8af-0215de509fd7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:18.110899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-906dd443-f2b2-48bd-a8af-0215de509fd7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:18.112420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-906dd443-f2b2-48bd-a8af-0215de509fd7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:18.113620 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-906dd443-f2b2-48bd-a8af-0215de509fd7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1598 microversion: 2.42 time: 0.374213 Jan 22 21:06:18.114185 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1098/2139] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:17 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1598 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:06:18.214293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-249997af-4b77-4bd3-94a3-8b25bd352ebc req-2b627219-4ec6-473f-af4d-7fca05ce4279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "627b2d09-47c8-46df-8a53-d0f6f01024e1", "tag": "ef887d2b-348f-451e-bedc-83da121efacc"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:18.216129 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:18.216129 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:06:18.230082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-249997af-4b77-4bd3-94a3-8b25bd352ebc req-2b627219-4ec6-473f-af4d-7fca05ce4279 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:18.230545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-249997af-4b77-4bd3-94a3-8b25bd352ebc req-2b627219-4ec6-473f-af4d-7fca05ce4279 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:18.262959 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-249997af-4b77-4bd3-94a3-8b25bd352ebc req-2b627219-4ec6-473f-af4d-7fca05ce4279 service nova] Creating event network-changed:ef887d2b-348f-451e-bedc-83da121efacc for instance 627b2d09-47c8-46df-8a53-d0f6f01024e1 on nch1-master-1 Jan 22 21:06:18.268024 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-249997af-4b77-4bd3-94a3-8b25bd352ebc req-2b627219-4ec6-473f-af4d-7fca05ce4279 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058217 Jan 22 21:06:18.269166 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1099/2140] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:06:18.407794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d2c99d1-7a0c-413e-bddd-ebfbf707fd0d tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:18.408493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d2c99d1-7a0c-413e-bddd-ebfbf707fd0d tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:18.422213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d2c99d1-7a0c-413e-bddd-ebfbf707fd0d tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:18.422681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d2c99d1-7a0c-413e-bddd-ebfbf707fd0d tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:18.424755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d2c99d1-7a0c-413e-bddd-ebfbf707fd0d tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:18.424755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d2c99d1-7a0c-413e-bddd-ebfbf707fd0d tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:18.672637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e977dc56-a696-48d4-aa30-042b105dceec tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:18.683411 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e977dc56-a696-48d4-aa30-042b105dceec tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1323 microversion: 2.1 time: 0.664474 Jan 22 21:06:18.687257 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1042/2141] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:18 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1323 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:06:18.689060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5d2c99d1-7a0c-413e-bddd-ebfbf707fd0d tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:18.700225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-396a8b90-a244-4a7c-84c4-e52fd3fa2359 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:18.701374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-396a8b90-a244-4a7c-84c4-e52fd3fa2359 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:18.708188 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d2c99d1-7a0c-413e-bddd-ebfbf707fd0d tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.304277 Jan 22 21:06:18.714513 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1100/2142] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:18 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:06:18.724061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-396a8b90-a244-4a7c-84c4-e52fd3fa2359 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:18.724061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-396a8b90-a244-4a7c-84c4-e52fd3fa2359 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:18.724061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-396a8b90-a244-4a7c-84c4-e52fd3fa2359 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:18.724061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-396a8b90-a244-4a7c-84c4-e52fd3fa2359 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:18.729253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e749652a-c472-4ad5-9fba-70b998d7d48c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:18.730170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e749652a-c472-4ad5-9fba-70b998d7d48c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:18.741071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e749652a-c472-4ad5-9fba-70b998d7d48c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:18.743387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e749652a-c472-4ad5-9fba-70b998d7d48c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:18.747002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e749652a-c472-4ad5-9fba-70b998d7d48c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:18.747707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e749652a-c472-4ad5-9fba-70b998d7d48c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:18.853993 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-396a8b90-a244-4a7c-84c4-e52fd3fa2359 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.165222 Jan 22 21:06:18.855381 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1043/2143] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:18 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:18.879006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e749652a-c472-4ad5-9fba-70b998d7d48c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:18.885021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c0875aee-e502-4480-9148-bcae184a004a tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:18.886061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c0875aee-e502-4480-9148-bcae184a004a tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:18.893052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e749652a-c472-4ad5-9fba-70b998d7d48c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:18.895029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0875aee-e502-4480-9148-bcae184a004a tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:18.895750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0875aee-e502-4480-9148-bcae184a004a tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:18.896773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0875aee-e502-4480-9148-bcae184a004a tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:18.897437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0875aee-e502-4480-9148-bcae184a004a tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:18.897738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e749652a-c472-4ad5-9fba-70b998d7d48c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:18.900307 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e749652a-c472-4ad5-9fba-70b998d7d48c tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.183072 Jan 22 21:06:18.900910 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1101/2144] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:18 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:19.195168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-76656fd9-90ca-4c76-9e08-f059885385c9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:19.198540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-76656fd9-90ca-4c76-9e08-f059885385c9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:19.204284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76656fd9-90ca-4c76-9e08-f059885385c9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:19.205003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76656fd9-90ca-4c76-9e08-f059885385c9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:19.206422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76656fd9-90ca-4c76-9e08-f059885385c9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:19.212048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76656fd9-90ca-4c76-9e08-f059885385c9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:19.293663 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-76656fd9-90ca-4c76-9e08-f059885385c9 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.324281 Jan 22 21:06:19.298817 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1102/2145] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:18 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:06:19.306223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-873ff4f0-b5bf-495f-89c0-2b5896e19570 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:19.306962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-873ff4f0-b5bf-495f-89c0-2b5896e19570 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:19.324159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-873ff4f0-b5bf-495f-89c0-2b5896e19570 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:19.324680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-873ff4f0-b5bf-495f-89c0-2b5896e19570 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:19.325724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-873ff4f0-b5bf-495f-89c0-2b5896e19570 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:19.326344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-873ff4f0-b5bf-495f-89c0-2b5896e19570 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:19.694194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c0875aee-e502-4480-9148-bcae184a004a tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:19.707176 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c0875aee-e502-4480-9148-bcae184a004a tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1321 microversion: 2.1 time: 0.828403 Jan 22 21:06:19.707776 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1044/2146] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:18 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1321 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:19.732301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-873ff4f0-b5bf-495f-89c0-2b5896e19570 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:19.734642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b8d86ee-9c3e-4467-b27b-fe2b65a83eb3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:19.738491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-873ff4f0-b5bf-495f-89c0-2b5896e19570 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:19.739994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-873ff4f0-b5bf-495f-89c0-2b5896e19570 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:19.741811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4b8d86ee-9c3e-4467-b27b-fe2b65a83eb3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:19.743841 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-873ff4f0-b5bf-495f-89c0-2b5896e19570 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1666 microversion: 2.42 time: 0.443512 Jan 22 21:06:19.744550 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1103/2147] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:19 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1666 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:19.749545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b8d86ee-9c3e-4467-b27b-fe2b65a83eb3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:19.750277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b8d86ee-9c3e-4467-b27b-fe2b65a83eb3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:19.751279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b8d86ee-9c3e-4467-b27b-fe2b65a83eb3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:19.752033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b8d86ee-9c3e-4467-b27b-fe2b65a83eb3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:19.759590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-87730e77-c26a-4435-b013-d21a77d3e5eb tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:19.760583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-87730e77-c26a-4435-b013-d21a77d3e5eb tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:19.773909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87730e77-c26a-4435-b013-d21a77d3e5eb tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:19.774713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87730e77-c26a-4435-b013-d21a77d3e5eb tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:19.775659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87730e77-c26a-4435-b013-d21a77d3e5eb tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:19.776356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87730e77-c26a-4435-b013-d21a77d3e5eb tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:20.079160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-87730e77-c26a-4435-b013-d21a77d3e5eb tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:20.093865 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-87730e77-c26a-4435-b013-d21a77d3e5eb tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.345095 Jan 22 21:06:20.093865 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1104/2148] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:19 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:20.102337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b68f63a-ae14-4973-b9ab-fc8e8009f66f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:20.123953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b68f63a-ae14-4973-b9ab-fc8e8009f66f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:20.123953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b68f63a-ae14-4973-b9ab-fc8e8009f66f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:20.123953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b68f63a-ae14-4973-b9ab-fc8e8009f66f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:20.123953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b68f63a-ae14-4973-b9ab-fc8e8009f66f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:20.123953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b68f63a-ae14-4973-b9ab-fc8e8009f66f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:20.220281 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b68f63a-ae14-4973-b9ab-fc8e8009f66f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.105915 Jan 22 21:06:20.220281 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1105/2149] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:20 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:20.220281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d58c52c-8e90-48b1-b928-2604e6af52a0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:20.220281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d58c52c-8e90-48b1-b928-2604e6af52a0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:20.228325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d58c52c-8e90-48b1-b928-2604e6af52a0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:20.230174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d58c52c-8e90-48b1-b928-2604e6af52a0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:20.231045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d58c52c-8e90-48b1-b928-2604e6af52a0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:20.231673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d58c52c-8e90-48b1-b928-2604e6af52a0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:20.305749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4b8d86ee-9c3e-4467-b27b-fe2b65a83eb3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:20.314285 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b8d86ee-9c3e-4467-b27b-fe2b65a83eb3 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1323 microversion: 2.1 time: 0.597392 Jan 22 21:06:20.321549 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1045/2150] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:19 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1323 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:20.338231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bd3320ce-5ef1-403e-ba91-1a86baf101a3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:20.339490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bd3320ce-5ef1-403e-ba91-1a86baf101a3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:20.348569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd3320ce-5ef1-403e-ba91-1a86baf101a3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:20.351481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd3320ce-5ef1-403e-ba91-1a86baf101a3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:20.352500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd3320ce-5ef1-403e-ba91-1a86baf101a3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:20.352951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd3320ce-5ef1-403e-ba91-1a86baf101a3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:20.416356 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bd3320ce-5ef1-403e-ba91-1a86baf101a3 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.092668 Jan 22 21:06:20.418777 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1046/2151] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:20 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:20.493308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-700eab7b-919f-475f-b2ef-82f46404d11a req-95f430f0-94d1-4248-a4d8-dda96a98be26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31384bb-6cc1-45a4-a067-92ac3713ef55", "name": "network-vif-plugged", "status": "completed", "tag": "493297bc-3a80-4965-b414-e858560483fb"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:20.496965 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:20.496965 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:06:20.514165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-700eab7b-919f-475f-b2ef-82f46404d11a req-95f430f0-94d1-4248-a4d8-dda96a98be26 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:20.520366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-700eab7b-919f-475f-b2ef-82f46404d11a req-95f430f0-94d1-4248-a4d8-dda96a98be26 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:20.528892 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-700eab7b-919f-475f-b2ef-82f46404d11a req-95f430f0-94d1-4248-a4d8-dda96a98be26 service nova] Creating event network-vif-plugged:493297bc-3a80-4965-b414-e858560483fb for instance b31384bb-6cc1-45a4-a067-92ac3713ef55 on nch1-master-1 Jan 22 21:06:20.535467 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-700eab7b-919f-475f-b2ef-82f46404d11a req-95f430f0-94d1-4248-a4d8-dda96a98be26 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048221 Jan 22 21:06:20.536884 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1047/2152] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:06:20.728143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-768de384-445c-4b97-9f31-050daf4b5aa9 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:20.729166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-768de384-445c-4b97-9f31-050daf4b5aa9 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:20.746489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-768de384-445c-4b97-9f31-050daf4b5aa9 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:20.760980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-768de384-445c-4b97-9f31-050daf4b5aa9 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:20.764565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-768de384-445c-4b97-9f31-050daf4b5aa9 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:20.766027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-768de384-445c-4b97-9f31-050daf4b5aa9 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:20.875954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5d58c52c-8e90-48b1-b928-2604e6af52a0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:20.890511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5d58c52c-8e90-48b1-b928-2604e6af52a0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:20.894286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5d58c52c-8e90-48b1-b928-2604e6af52a0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:20.899448 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d58c52c-8e90-48b1-b928-2604e6af52a0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.690027 Jan 22 21:06:20.900350 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1106/2153] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:20 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:20.916634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e7785ea6-77a3-492a-8c6b-a0b0d34a876d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:20.917300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e7785ea6-77a3-492a-8c6b-a0b0d34a876d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:20.931812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7785ea6-77a3-492a-8c6b-a0b0d34a876d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:20.933789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7785ea6-77a3-492a-8c6b-a0b0d34a876d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:20.941258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7785ea6-77a3-492a-8c6b-a0b0d34a876d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:20.941258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7785ea6-77a3-492a-8c6b-a0b0d34a876d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:21.179876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-768de384-445c-4b97-9f31-050daf4b5aa9 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:21.185939 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-768de384-445c-4b97-9f31-050daf4b5aa9 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1321 microversion: 2.1 time: 0.465032 Jan 22 21:06:21.196258 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1048/2154] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:20 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1321 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:21.211471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a37537e7-235e-4217-9249-fb81a7b6248c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:21.214192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a37537e7-235e-4217-9249-fb81a7b6248c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:21.225688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a37537e7-235e-4217-9249-fb81a7b6248c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:21.227516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a37537e7-235e-4217-9249-fb81a7b6248c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:21.228502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a37537e7-235e-4217-9249-fb81a7b6248c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:21.229389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a37537e7-235e-4217-9249-fb81a7b6248c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:21.340869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e7785ea6-77a3-492a-8c6b-a0b0d34a876d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:21.356000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e7785ea6-77a3-492a-8c6b-a0b0d34a876d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:21.359980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e7785ea6-77a3-492a-8c6b-a0b0d34a876d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:21.361186 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e7785ea6-77a3-492a-8c6b-a0b0d34a876d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1666 microversion: 2.42 time: 0.458103 Jan 22 21:06:21.379513 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1107/2155] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:20 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1666 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:21.381074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-27335fc4-d419-46c4-802d-d203b7288688 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:21.394810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-27335fc4-d419-46c4-802d-d203b7288688 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:21.412957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27335fc4-d419-46c4-802d-d203b7288688 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:21.413445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27335fc4-d419-46c4-802d-d203b7288688 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:21.414916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27335fc4-d419-46c4-802d-d203b7288688 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:21.415360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27335fc4-d419-46c4-802d-d203b7288688 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:21.478784 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-27335fc4-d419-46c4-802d-d203b7288688 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 32639 microversion: 2.1 time: 0.101703 Jan 22 21:06:21.480041 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1108/2156] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:21 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 32639 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:21.485875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-913cef64-7c8d-4f95-8e75-12ed2d7dbb0b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:21.486946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-913cef64-7c8d-4f95-8e75-12ed2d7dbb0b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:21.496938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-913cef64-7c8d-4f95-8e75-12ed2d7dbb0b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:21.497939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-913cef64-7c8d-4f95-8e75-12ed2d7dbb0b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:21.503424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-913cef64-7c8d-4f95-8e75-12ed2d7dbb0b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:21.504493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-913cef64-7c8d-4f95-8e75-12ed2d7dbb0b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:21.586434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a37537e7-235e-4217-9249-fb81a7b6248c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:21.598963 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a37537e7-235e-4217-9249-fb81a7b6248c tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.400877 Jan 22 21:06:21.600220 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1049/2157] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:21 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:21.612721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ea9bd372-f8d1-4a42-99ef-7c8bc9150be6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:21.613833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ea9bd372-f8d1-4a42-99ef-7c8bc9150be6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:21.621768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea9bd372-f8d1-4a42-99ef-7c8bc9150be6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:21.626322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea9bd372-f8d1-4a42-99ef-7c8bc9150be6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:21.626322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea9bd372-f8d1-4a42-99ef-7c8bc9150be6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:21.626322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea9bd372-f8d1-4a42-99ef-7c8bc9150be6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:21.685488 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ea9bd372-f8d1-4a42-99ef-7c8bc9150be6 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.083622 Jan 22 21:06:21.686192 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1050/2158] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:21 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:21.748896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-913cef64-7c8d-4f95-8e75-12ed2d7dbb0b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:21.759439 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-913cef64-7c8d-4f95-8e75-12ed2d7dbb0b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1323 microversion: 2.1 time: 0.277863 Jan 22 21:06:21.760304 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1109/2159] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:21 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1323 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:21.769229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5d670b79-8014-4f1a-ba92-8b25f54fa1b3 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] Action: 'create', calling method: .version_select at 0x7f1ed5eb6700>, body: {"pool": null} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:21.921418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e22df64b-606d-4c74-aaf1-ad324cb77a81 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:21.921418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e22df64b-606d-4c74-aaf1-ad324cb77a81 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:21.937051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e22df64b-606d-4c74-aaf1-ad324cb77a81 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:21.938807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e22df64b-606d-4c74-aaf1-ad324cb77a81 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:21.940867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e22df64b-606d-4c74-aaf1-ad324cb77a81 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:21.941591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e22df64b-606d-4c74-aaf1-ad324cb77a81 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:22.031929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e22df64b-606d-4c74-aaf1-ad324cb77a81 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:22.043253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e22df64b-606d-4c74-aaf1-ad324cb77a81 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:22.045864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e22df64b-606d-4c74-aaf1-ad324cb77a81 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:22.048179 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e22df64b-606d-4c74-aaf1-ad324cb77a81 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.131707 Jan 22 21:06:22.067657 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1110/2160] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:21 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:06:22.208670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6e75f263-b5ea-4450-ad89-1131ad1c74ae tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:22.210449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6e75f263-b5ea-4450-ad89-1131ad1c74ae tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:22.225460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e75f263-b5ea-4450-ad89-1131ad1c74ae tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:22.232095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e75f263-b5ea-4450-ad89-1131ad1c74ae tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:22.232095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e75f263-b5ea-4450-ad89-1131ad1c74ae tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:22.232095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e75f263-b5ea-4450-ad89-1131ad1c74ae tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:22.406953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6e75f263-b5ea-4450-ad89-1131ad1c74ae tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:22.416986 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6e75f263-b5ea-4450-ad89-1131ad1c74ae tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1321 microversion: 2.1 time: 0.217944 Jan 22 21:06:22.418153 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1111/2161] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:22 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:06:22.423015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d582a1d3-71b2-45e3-90d2-68fb64a0ecf7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:22.423855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d582a1d3-71b2-45e3-90d2-68fb64a0ecf7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:22.432200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d582a1d3-71b2-45e3-90d2-68fb64a0ecf7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:22.432659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d582a1d3-71b2-45e3-90d2-68fb64a0ecf7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:22.433700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d582a1d3-71b2-45e3-90d2-68fb64a0ecf7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:22.434151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d582a1d3-71b2-45e3-90d2-68fb64a0ecf7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:22.622622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d582a1d3-71b2-45e3-90d2-68fb64a0ecf7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:22.631950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d582a1d3-71b2-45e3-90d2-68fb64a0ecf7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:22.634494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d582a1d3-71b2-45e3-90d2-68fb64a0ecf7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:22.635949 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d582a1d3-71b2-45e3-90d2-68fb64a0ecf7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1713 microversion: 2.42 time: 0.216673 Jan 22 21:06:22.636727 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1112/2162] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:22 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1713 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:22.641673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-24cb5305-b427-4298-b101-34014c49c3f5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:22.644105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-24cb5305-b427-4298-b101-34014c49c3f5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:22.651069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24cb5305-b427-4298-b101-34014c49c3f5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:22.655647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24cb5305-b427-4298-b101-34014c49c3f5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:22.655647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24cb5305-b427-4298-b101-34014c49c3f5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:22.655647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24cb5305-b427-4298-b101-34014c49c3f5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:22.712994 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-24cb5305-b427-4298-b101-34014c49c3f5 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action" status: 200 len: 40795 microversion: 2.1 time: 0.073097 Jan 22 21:06:22.714086 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1113/2163] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:22 2022] POST /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee/action => generated 40795 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:22.720408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-32ca3816-c280-49a2-919b-7a85435daa1b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:22.721582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-32ca3816-c280-49a2-919b-7a85435daa1b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:22.734649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32ca3816-c280-49a2-919b-7a85435daa1b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:22.735417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32ca3816-c280-49a2-919b-7a85435daa1b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:22.736899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32ca3816-c280-49a2-919b-7a85435daa1b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:22.739001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32ca3816-c280-49a2-919b-7a85435daa1b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:22.902561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-32ca3816-c280-49a2-919b-7a85435daa1b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:22.909594 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-32ca3816-c280-49a2-919b-7a85435daa1b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.193795 Jan 22 21:06:22.920825 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1114/2164] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:22 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:22.926949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-77a784dd-b9c5-4bae-849e-68a7aec01775 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:22.937273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-77a784dd-b9c5-4bae-849e-68a7aec01775 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:22.951259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77a784dd-b9c5-4bae-849e-68a7aec01775 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:22.952041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77a784dd-b9c5-4bae-849e-68a7aec01775 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:22.953035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77a784dd-b9c5-4bae-849e-68a7aec01775 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:22.953702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77a784dd-b9c5-4bae-849e-68a7aec01775 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:23.015129 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-77a784dd-b9c5-4bae-849e-68a7aec01775 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.091994 Jan 22 21:06:23.017211 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1115/2165] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:22 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:23.025047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e9af5313-c4fb-4014-b03a-9d35c9137207 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:23.026780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e9af5313-c4fb-4014-b03a-9d35c9137207 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:23.038410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9af5313-c4fb-4014-b03a-9d35c9137207 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:23.043060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9af5313-c4fb-4014-b03a-9d35c9137207 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:23.043060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9af5313-c4fb-4014-b03a-9d35c9137207 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:23.043060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9af5313-c4fb-4014-b03a-9d35c9137207 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:23.253613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e9af5313-c4fb-4014-b03a-9d35c9137207 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:23.266122 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e9af5313-c4fb-4014-b03a-9d35c9137207 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 200 len: 1697 microversion: 2.1 time: 0.242700 Jan 22 21:06:23.266122 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1116/2166] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:23 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 1697 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:23.281827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-11085d0f-86ca-4c43-ad62-f65cd3ea6c5d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:23.282453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-11085d0f-86ca-4c43-ad62-f65cd3ea6c5d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:23.293788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11085d0f-86ca-4c43-ad62-f65cd3ea6c5d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:23.298642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11085d0f-86ca-4c43-ad62-f65cd3ea6c5d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:23.298642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11085d0f-86ca-4c43-ad62-f65cd3ea6c5d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:23.298642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11085d0f-86ca-4c43-ad62-f65cd3ea6c5d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:23.469552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-11085d0f-86ca-4c43-ad62-f65cd3ea6c5d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:23.479526 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-11085d0f-86ca-4c43-ad62-f65cd3ea6c5d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1323 microversion: 2.1 time: 0.215850 Jan 22 21:06:23.481722 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1117/2167] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:23 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1323 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:23.484558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-88de3630-0000-4b81-b513-10f6b0f91986 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:23.485161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-88de3630-0000-4b81-b513-10f6b0f91986 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:23.491408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88de3630-0000-4b81-b513-10f6b0f91986 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:23.491866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88de3630-0000-4b81-b513-10f6b0f91986 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:23.493472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88de3630-0000-4b81-b513-10f6b0f91986 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:23.493938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88de3630-0000-4b81-b513-10f6b0f91986 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:23.573364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-88de3630-0000-4b81-b513-10f6b0f91986 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:23.583246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-88de3630-0000-4b81-b513-10f6b0f91986 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:23.585097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-88de3630-0000-4b81-b513-10f6b0f91986 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:23.586919 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-88de3630-0000-4b81-b513-10f6b0f91986 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.105816 Jan 22 21:06:23.588133 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1118/2168] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:23 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:23.592935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f6a40693-a45e-4c66-aae8-6d60a68da468 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:23.593800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f6a40693-a45e-4c66-aae8-6d60a68da468 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:23.600581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6a40693-a45e-4c66-aae8-6d60a68da468 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:23.601152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6a40693-a45e-4c66-aae8-6d60a68da468 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:23.602660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6a40693-a45e-4c66-aae8-6d60a68da468 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:23.603119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6a40693-a45e-4c66-aae8-6d60a68da468 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:23.749230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f6a40693-a45e-4c66-aae8-6d60a68da468 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:23.757359 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f6a40693-a45e-4c66-aae8-6d60a68da468 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1470 microversion: 2.1 time: 0.167979 Jan 22 21:06:23.759420 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1119/2169] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:23 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:23.764277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b790927b-a833-4a6b-ad67-6c394b402b37 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:23.767625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b790927b-a833-4a6b-ad67-6c394b402b37 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:23.784403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b790927b-a833-4a6b-ad67-6c394b402b37 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:23.785228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b790927b-a833-4a6b-ad67-6c394b402b37 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:23.786335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b790927b-a833-4a6b-ad67-6c394b402b37 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:23.787041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b790927b-a833-4a6b-ad67-6c394b402b37 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:23.968440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b790927b-a833-4a6b-ad67-6c394b402b37 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:23.980433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b790927b-a833-4a6b-ad67-6c394b402b37 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:23.981961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b790927b-a833-4a6b-ad67-6c394b402b37 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:23.983363 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b790927b-a833-4a6b-ad67-6c394b402b37 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1748 microversion: 2.42 time: 0.222844 Jan 22 21:06:23.984116 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1120/2170] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:23 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1748 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:24.000776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f47379a7-ce2e-4d2b-90d7-93b91a60e602 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1079015344", "metadata": {"image_type": "test"}}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:24.002294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f47379a7-ce2e-4d2b-90d7-93b91a60e602 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:24.009836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f47379a7-ce2e-4d2b-90d7-93b91a60e602 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:24.010575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f47379a7-ce2e-4d2b-90d7-93b91a60e602 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:24.011633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f47379a7-ce2e-4d2b-90d7-93b91a60e602 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:24.012267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f47379a7-ce2e-4d2b-90d7-93b91a60e602 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:24.056249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f47379a7-ce2e-4d2b-90d7-93b91a60e602 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Getting quotas for project 0f284a3408a5405c846c300e8b9b2db1. Resources: dict_keys(['metadata_items']) {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:06:24.062081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f47379a7-ce2e-4d2b-90d7-93b91a60e602 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Getting quotas for user a549e49cc361449bb5564446c4da0781 and project 0f284a3408a5405c846c300e8b9b2db1. Resources: dict_keys(['metadata_items']) {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:06:24.594989 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f47379a7-ce2e-4d2b-90d7-93b91a60e602 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "POST /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55/action" status: 202 len: 0 microversion: 2.1 time: 0.608505 Jan 22 21:06:24.596924 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1121/2171] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:23 2022] POST /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 22 21:06:24.607952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-26074073-2c33-4f00-9a8a-dd5721af7d23 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:24.609976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-26074073-2c33-4f00-9a8a-dd5721af7d23 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:24.622089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26074073-2c33-4f00-9a8a-dd5721af7d23 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:24.622698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26074073-2c33-4f00-9a8a-dd5721af7d23 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:24.623810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26074073-2c33-4f00-9a8a-dd5721af7d23 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:24.625033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26074073-2c33-4f00-9a8a-dd5721af7d23 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:24.773924 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5d670b79-8014-4f1a-ba92-8b25f54fa1b3 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] 10.222.0.100 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.085701 Jan 22 21:06:24.774531 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1051/2172] 10.222.0.100 () {60 vars in 1174 bytes} [Sat Jan 22 21:06:21 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:24.779292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-99df70f5-9fb8-45a2-9927-3ca051379a78 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:24.791142 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:24.791142 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:06:24.792723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-99df70f5-9fb8-45a2-9927-3ca051379a78 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:24.793741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-99df70f5-9fb8-45a2-9927-3ca051379a78 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Searching by: {'deleted': False, 'project_id': 'c864966e7b1a471cb496ac2242826ab6'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:06:24.802497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99df70f5-9fb8-45a2-9927-3ca051379a78 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:24.807926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99df70f5-9fb8-45a2-9927-3ca051379a78 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:24.809401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99df70f5-9fb8-45a2-9927-3ca051379a78 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:24.821170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99df70f5-9fb8-45a2-9927-3ca051379a78 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:24.855870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-99df70f5-9fb8-45a2-9927-3ca051379a78 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:06:24.857738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-26074073-2c33-4f00-9a8a-dd5721af7d23 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:24.871714 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-26074073-2c33-4f00-9a8a-dd5721af7d23 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.270114 Jan 22 21:06:24.873405 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1122/2173] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:24 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:24.888170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b4a7bad9-8732-4a00-8273-ed6672f74e14 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:24.889908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b4a7bad9-8732-4a00-8273-ed6672f74e14 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:24.897551 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-99df70f5-9fb8-45a2-9927-3ca051379a78 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 335 microversion: 2.1 time: 0.121914 Jan 22 21:06:24.899107 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1052/2174] 10.222.0.100 () {58 vars in 1129 bytes} [Sat Jan 22 21:06:24 2022] GET /compute/v2.1/servers => generated 335 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:24.904228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11627666-9592-4c6e-93db-4cd6fbb15821 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:24.912315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4a7bad9-8732-4a00-8273-ed6672f74e14 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:24.912651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-11627666-9592-4c6e-93db-4cd6fbb15821 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:24.915277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4a7bad9-8732-4a00-8273-ed6672f74e14 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:24.916732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4a7bad9-8732-4a00-8273-ed6672f74e14 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:24.920524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11627666-9592-4c6e-93db-4cd6fbb15821 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:24.921355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4a7bad9-8732-4a00-8273-ed6672f74e14 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:24.926232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11627666-9592-4c6e-93db-4cd6fbb15821 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:24.927340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11627666-9592-4c6e-93db-4cd6fbb15821 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:24.927790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11627666-9592-4c6e-93db-4cd6fbb15821 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:24.990709 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b4a7bad9-8732-4a00-8273-ed6672f74e14 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.114885 Jan 22 21:06:24.992041 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1123/2175] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:24 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:25.006880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-68a6a4aa-e4b8-420c-9726-10f4e2a55d97 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed58fc160>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:25.069286 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-68a6a4aa-e4b8-420c-9726-10f4e2a55d97 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.073646 Jan 22 21:06:25.070810 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1124/2176] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:24 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:25.081814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cb359fef-2f5c-4200-ac79-101b008da539 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:25.081814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cb359fef-2f5c-4200-ac79-101b008da539 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:25.088175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb359fef-2f5c-4200-ac79-101b008da539 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:25.088669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb359fef-2f5c-4200-ac79-101b008da539 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:25.089900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb359fef-2f5c-4200-ac79-101b008da539 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:25.090370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb359fef-2f5c-4200-ac79-101b008da539 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:25.188224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cb359fef-2f5c-4200-ac79-101b008da539 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:25.198724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cb359fef-2f5c-4200-ac79-101b008da539 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:25.200517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cb359fef-2f5c-4200-ac79-101b008da539 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:25.201891 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cb359fef-2f5c-4200-ac79-101b008da539 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1368 microversion: 2.47 time: 0.129707 Jan 22 21:06:25.215021 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1125/2177] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:25 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1368 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:25.220137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d44883f6-f5d2-433c-badc-65a5c7a7508e tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] Calling method '.version_select at 0x7f1ed58fc430>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:25.243006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-11627666-9592-4c6e-93db-4cd6fbb15821 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:25.251338 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-11627666-9592-4c6e-93db-4cd6fbb15821 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1323 microversion: 2.1 time: 0.350905 Jan 22 21:06:25.261406 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1053/2178] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:24 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1323 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:25.271311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-14d5620b-d5e6-45f6-8737-7dbf606e8064 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:25.271311 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:25.271311 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:06:25.271898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-14d5620b-d5e6-45f6-8737-7dbf606e8064 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:25.273872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-14d5620b-d5e6-45f6-8737-7dbf606e8064 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Searching by: {'deleted': False, 'project_id': 'c864966e7b1a471cb496ac2242826ab6'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:06:25.281307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14d5620b-d5e6-45f6-8737-7dbf606e8064 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:25.282547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14d5620b-d5e6-45f6-8737-7dbf606e8064 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:25.283640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14d5620b-d5e6-45f6-8737-7dbf606e8064 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:25.284224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14d5620b-d5e6-45f6-8737-7dbf606e8064 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:25.325297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-14d5620b-d5e6-45f6-8737-7dbf606e8064 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:06:25.364941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-14d5620b-d5e6-45f6-8737-7dbf606e8064 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:25.373525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14d5620b-d5e6-45f6-8737-7dbf606e8064 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:25.374135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14d5620b-d5e6-45f6-8737-7dbf606e8064 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:25.486742 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d44883f6-f5d2-433c-badc-65a5c7a7508e tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] 10.222.0.100 "GET /compute/v2.1/os-floating-ips/a6bbf9ce-b4cd-483e-a2f1-9c9b9d6270ab" status: 200 len: 141 microversion: 2.1 time: 0.270378 Jan 22 21:06:25.487467 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1126/2179] 10.222.0.100 () {58 vars in 1264 bytes} [Sat Jan 22 21:06:25 2022] GET /compute/v2.1/os-floating-ips/a6bbf9ce-b4cd-483e-a2f1-9c9b9d6270ab => generated 141 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:25.506672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b024caee-d440-4bb4-87ee-6abb8e218eb5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:25.507518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b024caee-d440-4bb4-87ee-6abb8e218eb5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:25.519911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b024caee-d440-4bb4-87ee-6abb8e218eb5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:25.520366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b024caee-d440-4bb4-87ee-6abb8e218eb5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:25.521174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b024caee-d440-4bb4-87ee-6abb8e218eb5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:25.521869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b024caee-d440-4bb4-87ee-6abb8e218eb5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:25.548043 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-14d5620b-d5e6-45f6-8737-7dbf606e8064 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/detail" status: 200 len: 1700 microversion: 2.1 time: 0.294573 Jan 22 21:06:25.548933 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1054/2180] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:06:25 2022] GET /compute/v2.1/servers/detail => generated 1700 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:25.553744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fa4546b9-463f-44da-9889-56c26a69e6f2 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] Calling method '.version_select at 0x7f1ed663aa60>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:25.728003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b024caee-d440-4bb4-87ee-6abb8e218eb5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:25.737726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b024caee-d440-4bb4-87ee-6abb8e218eb5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:25.739302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b024caee-d440-4bb4-87ee-6abb8e218eb5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:25.740588 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b024caee-d440-4bb4-87ee-6abb8e218eb5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1795 microversion: 2.42 time: 0.251964 Jan 22 21:06:25.741326 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1127/2181] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:25 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1795 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:25.746445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8087bd51-b86e-4bf3-807f-1302cf78e6ca tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:25.756070 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8087bd51-b86e-4bf3-807f-1302cf78e6ca tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.012846 Jan 22 21:06:25.756743 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1128/2182] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:06:25 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:25.889600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-04f901c7-a16c-4d8c-a47a-17150acc2227 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:25.890241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-04f901c7-a16c-4d8c-a47a-17150acc2227 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:25.896404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f901c7-a16c-4d8c-a47a-17150acc2227 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:25.896868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f901c7-a16c-4d8c-a47a-17150acc2227 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:25.902536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f901c7-a16c-4d8c-a47a-17150acc2227 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:25.902536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f901c7-a16c-4d8c-a47a-17150acc2227 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:25.926300 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fa4546b9-463f-44da-9889-56c26a69e6f2 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] 10.222.0.100 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.375109 Jan 22 21:06:25.933367 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1055/2183] 10.222.0.100 () {58 vars in 1153 bytes} [Sat Jan 22 21:06:25 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:25.940204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-455de320-5ad7-44ed-8acc-1f31d13d046f tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] Calling method '.version_select at 0x7f1edae18b80>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:26.046573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-04f901c7-a16c-4d8c-a47a-17150acc2227 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:26.055780 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-04f901c7-a16c-4d8c-a47a-17150acc2227 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.169544 Jan 22 21:06:26.056280 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1129/2184] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:25 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:06:26.061716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e5a471d1-bfce-41b3-a232-a99d2c6538d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:26.062943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e5a471d1-bfce-41b3-a232-a99d2c6538d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:26.077306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5a471d1-bfce-41b3-a232-a99d2c6538d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:26.077306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5a471d1-bfce-41b3-a232-a99d2c6538d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:26.077306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5a471d1-bfce-41b3-a232-a99d2c6538d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:26.077306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5a471d1-bfce-41b3-a232-a99d2c6538d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:26.131301 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e5a471d1-bfce-41b3-a232-a99d2c6538d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.072639 Jan 22 21:06:26.132508 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1130/2185] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:26 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:26.137886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f025d526-e8b0-4d60-bcb3-48ff54c0b631 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed594e4c0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:26.202259 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f025d526-e8b0-4d60-bcb3-48ff54c0b631 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.068346 Jan 22 21:06:26.210245 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1131/2186] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:26 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:26.216529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-49af0496-ec56-45e9-89a9-4b8307892779 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:26.217325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-49af0496-ec56-45e9-89a9-4b8307892779 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:26.228874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49af0496-ec56-45e9-89a9-4b8307892779 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:26.229869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49af0496-ec56-45e9-89a9-4b8307892779 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:26.230808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49af0496-ec56-45e9-89a9-4b8307892779 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:26.231400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49af0496-ec56-45e9-89a9-4b8307892779 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:26.261416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-49af0496-ec56-45e9-89a9-4b8307892779 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:06:26.535822 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-49af0496-ec56-45e9-89a9-4b8307892779 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 204 len: 0 microversion: 2.1 time: 0.329157 Jan 22 21:06:26.536536 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1132/2187] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:06:26 2022] DELETE /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:06:26.544339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-862bb667-f0c2-4f7b-ab98-9c42def2ef46 req-b5afabb8-93e9-4d47-ac64-138e0da64bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "627b2d09-47c8-46df-8a53-d0f6f01024e1", "name": "network-vif-plugged", "status": "completed", "tag": "ef887d2b-348f-451e-bedc-83da121efacc"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:26.544339 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:26.544339 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:06:26.550953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-862bb667-f0c2-4f7b-ab98-9c42def2ef46 req-b5afabb8-93e9-4d47-ac64-138e0da64bca service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:26.551421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-862bb667-f0c2-4f7b-ab98-9c42def2ef46 req-b5afabb8-93e9-4d47-ac64-138e0da64bca service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:26.562926 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-862bb667-f0c2-4f7b-ab98-9c42def2ef46 req-b5afabb8-93e9-4d47-ac64-138e0da64bca service nova] Creating event network-vif-plugged:ef887d2b-348f-451e-bedc-83da121efacc for instance 627b2d09-47c8-46df-8a53-d0f6f01024e1 on nch1-master-1 Jan 22 21:06:26.567818 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-862bb667-f0c2-4f7b-ab98-9c42def2ef46 req-b5afabb8-93e9-4d47-ac64-138e0da64bca service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029820 Jan 22 21:06:26.568422 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1133/2188] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:26.574171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9350da9c-5406-4823-a98e-607366c4fa21 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:26.574914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9350da9c-5406-4823-a98e-607366c4fa21 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:26.582296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9350da9c-5406-4823-a98e-607366c4fa21 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:26.582689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9350da9c-5406-4823-a98e-607366c4fa21 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:26.583502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9350da9c-5406-4823-a98e-607366c4fa21 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:26.584481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9350da9c-5406-4823-a98e-607366c4fa21 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:26.683822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9350da9c-5406-4823-a98e-607366c4fa21 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:26.693346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9350da9c-5406-4823-a98e-607366c4fa21 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:26.694320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9350da9c-5406-4823-a98e-607366c4fa21 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:26.695854 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9350da9c-5406-4823-a98e-607366c4fa21 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1374 microversion: 2.47 time: 0.125851 Jan 22 21:06:26.696467 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1134/2189] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:26 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1374 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:26.701187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5a0cb0bd-15e6-413d-88ca-f7172bf02d55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:26.702260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5a0cb0bd-15e6-413d-88ca-f7172bf02d55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:26.711051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a0cb0bd-15e6-413d-88ca-f7172bf02d55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:26.712113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a0cb0bd-15e6-413d-88ca-f7172bf02d55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:26.713100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a0cb0bd-15e6-413d-88ca-f7172bf02d55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:26.713740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a0cb0bd-15e6-413d-88ca-f7172bf02d55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:26.871415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5a0cb0bd-15e6-413d-88ca-f7172bf02d55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:26.886401 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5a0cb0bd-15e6-413d-88ca-f7172bf02d55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1323 microversion: 2.1 time: 0.188663 Jan 22 21:06:26.895714 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1135/2190] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:26 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1323 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:26.900785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bcd95d06-fa33-406a-b02c-5b978a7a1b43 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:26.901408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bcd95d06-fa33-406a-b02c-5b978a7a1b43 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:26.912039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcd95d06-fa33-406a-b02c-5b978a7a1b43 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:26.912528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcd95d06-fa33-406a-b02c-5b978a7a1b43 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:26.913562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcd95d06-fa33-406a-b02c-5b978a7a1b43 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:26.914076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcd95d06-fa33-406a-b02c-5b978a7a1b43 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:27.057511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bcd95d06-fa33-406a-b02c-5b978a7a1b43 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:27.067519 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bcd95d06-fa33-406a-b02c-5b978a7a1b43 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 200 len: 1703 microversion: 2.1 time: 0.169589 Jan 22 21:06:27.067519 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1136/2191] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:26 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 1703 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:27.073433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dc9bc337-47d2-4025-9c30-7712f6963f72 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:27.074062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dc9bc337-47d2-4025-9c30-7712f6963f72 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:27.080250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc9bc337-47d2-4025-9c30-7712f6963f72 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:27.080723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc9bc337-47d2-4025-9c30-7712f6963f72 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:27.081538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc9bc337-47d2-4025-9c30-7712f6963f72 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:27.081992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc9bc337-47d2-4025-9c30-7712f6963f72 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:27.248801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dc9bc337-47d2-4025-9c30-7712f6963f72 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:27.258573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dc9bc337-47d2-4025-9c30-7712f6963f72 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:27.260450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dc9bc337-47d2-4025-9c30-7712f6963f72 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:27.261509 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dc9bc337-47d2-4025-9c30-7712f6963f72 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1842 microversion: 2.42 time: 0.192624 Jan 22 21:06:27.262284 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1137/2192] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:27 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1842 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:27.266577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b86fcbe-170f-4fb2-b58c-14451621b283 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:27.267194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6b86fcbe-170f-4fb2-b58c-14451621b283 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:27.274782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b86fcbe-170f-4fb2-b58c-14451621b283 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:27.275329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b86fcbe-170f-4fb2-b58c-14451621b283 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:27.276221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b86fcbe-170f-4fb2-b58c-14451621b283 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:27.276747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b86fcbe-170f-4fb2-b58c-14451621b283 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:27.280195 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-455de320-5ad7-44ed-8acc-1f31d13d046f tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] 10.222.0.100 "DELETE /compute/v2.1/os-floating-ips/a6bbf9ce-b4cd-483e-a2f1-9c9b9d6270ab" status: 202 len: 0 microversion: 2.1 time: 1.344263 Jan 22 21:06:27.282418 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1056/2193] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:06:25 2022] DELETE /compute/v2.1/os-floating-ips/a6bbf9ce-b4cd-483e-a2f1-9c9b9d6270ab => generated 0 bytes in 1347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:06:27.289288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-df260e00-70b7-4bc8-a146-7c79a21ed74f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:27.290354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-df260e00-70b7-4bc8-a146-7c79a21ed74f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:27.298962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df260e00-70b7-4bc8-a146-7c79a21ed74f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:27.299451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df260e00-70b7-4bc8-a146-7c79a21ed74f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:27.300260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df260e00-70b7-4bc8-a146-7c79a21ed74f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:27.300700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df260e00-70b7-4bc8-a146-7c79a21ed74f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:27.342851 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-df260e00-70b7-4bc8-a146-7c79a21ed74f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.058943 Jan 22 21:06:27.344069 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1057/2194] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:27 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:27.349539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-be1061bd-e774-4a17-b0ab-f1c60b31ffa3 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1edaeaa280>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:27.399901 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-be1061bd-e774-4a17-b0ab-f1c60b31ffa3 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.054185 Jan 22 21:06:27.408045 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1058/2195] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:27 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:27.408045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-181d0720-4692-48a4-baff-7b6901216483 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] Action: 'create', calling method: .version_select at 0x7f1ed551c310>, body: {"pool": null} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:27.435914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6b86fcbe-170f-4fb2-b58c-14451621b283 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:27.444903 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b86fcbe-170f-4fb2-b58c-14451621b283 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.181734 Jan 22 21:06:27.448132 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1138/2196] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:27 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:27.716496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-13849816-2402-4fd8-92d5-29f04ec9d207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:27.717529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-13849816-2402-4fd8-92d5-29f04ec9d207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:27.724208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13849816-2402-4fd8-92d5-29f04ec9d207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:27.724787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13849816-2402-4fd8-92d5-29f04ec9d207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:27.725729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13849816-2402-4fd8-92d5-29f04ec9d207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:27.726921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13849816-2402-4fd8-92d5-29f04ec9d207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:27.808256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13849816-2402-4fd8-92d5-29f04ec9d207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:27.817193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13849816-2402-4fd8-92d5-29f04ec9d207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:27.818748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13849816-2402-4fd8-92d5-29f04ec9d207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:27.829704 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-13849816-2402-4fd8-92d5-29f04ec9d207 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1374 microversion: 2.47 time: 0.107778 Jan 22 21:06:27.829704 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1139/2197] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:27 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1374 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:27.903203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a8b9cc73-252e-460b-a282-414ae1951a54 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:27.904013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a8b9cc73-252e-460b-a282-414ae1951a54 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:27.910217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8b9cc73-252e-460b-a282-414ae1951a54 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:27.910677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8b9cc73-252e-460b-a282-414ae1951a54 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:27.911500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8b9cc73-252e-460b-a282-414ae1951a54 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:27.912337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8b9cc73-252e-460b-a282-414ae1951a54 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:28.112197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a8b9cc73-252e-460b-a282-414ae1951a54 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:28.125631 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a8b9cc73-252e-460b-a282-414ae1951a54 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1323 microversion: 2.1 time: 0.225520 Jan 22 21:06:28.127195 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1140/2198] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:27 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1323 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:06:28.133716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-caca398a-8699-40d6-953e-51ec21a58051 req-87d701ab-e54a-494e-8a17-941cdc4d3b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "tag": "c631b245-837f-4809-9d1f-2d6792f3e2fb"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:28.135755 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:28.135755 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:06:28.143978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-caca398a-8699-40d6-953e-51ec21a58051 req-87d701ab-e54a-494e-8a17-941cdc4d3b45 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:28.147316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-caca398a-8699-40d6-953e-51ec21a58051 req-87d701ab-e54a-494e-8a17-941cdc4d3b45 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:28.168916 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-caca398a-8699-40d6-953e-51ec21a58051 req-87d701ab-e54a-494e-8a17-941cdc4d3b45 service nova] Creating event network-changed:c631b245-837f-4809-9d1f-2d6792f3e2fb for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:06:28.190711 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-caca398a-8699-40d6-953e-51ec21a58051 req-87d701ab-e54a-494e-8a17-941cdc4d3b45 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061902 Jan 22 21:06:28.191579 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1141/2199] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:28.208067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-846523d1-1bf1-4624-ba0d-7a15a242b97a tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:28.208853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-846523d1-1bf1-4624-ba0d-7a15a242b97a tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:28.227705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-846523d1-1bf1-4624-ba0d-7a15a242b97a tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:28.228076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-846523d1-1bf1-4624-ba0d-7a15a242b97a tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:28.228917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-846523d1-1bf1-4624-ba0d-7a15a242b97a tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:28.234227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-846523d1-1bf1-4624-ba0d-7a15a242b97a tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:28.970558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-846523d1-1bf1-4624-ba0d-7a15a242b97a tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:28.979516 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-846523d1-1bf1-4624-ba0d-7a15a242b97a tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 200 len: 1703 microversion: 2.1 time: 0.786731 Jan 22 21:06:28.980100 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1142/2200] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:28 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 1703 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:28.984689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9657da55-30dc-4f91-8fd4-2cd111a5900f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:28.985549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9657da55-30dc-4f91-8fd4-2cd111a5900f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:28.992427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9657da55-30dc-4f91-8fd4-2cd111a5900f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:28.992888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9657da55-30dc-4f91-8fd4-2cd111a5900f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:28.993740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9657da55-30dc-4f91-8fd4-2cd111a5900f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:28.994195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9657da55-30dc-4f91-8fd4-2cd111a5900f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:29.303644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9657da55-30dc-4f91-8fd4-2cd111a5900f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:29.318838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9657da55-30dc-4f91-8fd4-2cd111a5900f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:29.324339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9657da55-30dc-4f91-8fd4-2cd111a5900f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:29.328651 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9657da55-30dc-4f91-8fd4-2cd111a5900f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1863 microversion: 2.42 time: 0.347313 Jan 22 21:06:29.331194 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1143/2201] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:28 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1863 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:29.336470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0df57229-7245-4945-93ad-d977862fd40e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:29.342136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0df57229-7245-4945-93ad-d977862fd40e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:29.355434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0df57229-7245-4945-93ad-d977862fd40e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:29.359577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0df57229-7245-4945-93ad-d977862fd40e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:29.359577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0df57229-7245-4945-93ad-d977862fd40e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:29.364893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0df57229-7245-4945-93ad-d977862fd40e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:29.415909 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0df57229-7245-4945-93ad-d977862fd40e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.082794 Jan 22 21:06:29.422595 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1144/2202] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:29 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:29.428018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-62a62b25-724c-44a7-9608-931c7d94d80c tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed586d160>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:29.489671 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-62a62b25-724c-44a7-9608-931c7d94d80c tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.065490 Jan 22 21:06:29.490822 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1145/2203] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:29 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:29.496598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2e68cd5e-b1b1-45df-8450-e0cd2ca45160 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:29.497591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2e68cd5e-b1b1-45df-8450-e0cd2ca45160 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:29.504395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e68cd5e-b1b1-45df-8450-e0cd2ca45160 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:29.504868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e68cd5e-b1b1-45df-8450-e0cd2ca45160 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:29.505705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e68cd5e-b1b1-45df-8450-e0cd2ca45160 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:29.508933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e68cd5e-b1b1-45df-8450-e0cd2ca45160 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:29.686205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2e68cd5e-b1b1-45df-8450-e0cd2ca45160 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:29.696968 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2e68cd5e-b1b1-45df-8450-e0cd2ca45160 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.204815 Jan 22 21:06:29.707610 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1146/2204] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:29 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:29.713356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7317188c-15ba-43f8-9b7c-8487d222b27b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:29.714886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7317188c-15ba-43f8-9b7c-8487d222b27b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:29.721919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7317188c-15ba-43f8-9b7c-8487d222b27b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:29.722611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7317188c-15ba-43f8-9b7c-8487d222b27b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:29.723606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7317188c-15ba-43f8-9b7c-8487d222b27b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:29.724221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7317188c-15ba-43f8-9b7c-8487d222b27b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:29.837939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7317188c-15ba-43f8-9b7c-8487d222b27b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:29.849696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7317188c-15ba-43f8-9b7c-8487d222b27b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:29.853559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7317188c-15ba-43f8-9b7c-8487d222b27b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:29.854852 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7317188c-15ba-43f8-9b7c-8487d222b27b tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1374 microversion: 2.47 time: 0.146018 Jan 22 21:06:29.865584 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1147/2205] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:29 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1374 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:29.865584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-02f7dc8a-b83a-438d-a078-40a62f693743 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:29.865584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-02f7dc8a-b83a-438d-a078-40a62f693743 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:29.872957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02f7dc8a-b83a-438d-a078-40a62f693743 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:29.874211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02f7dc8a-b83a-438d-a078-40a62f693743 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:29.879313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02f7dc8a-b83a-438d-a078-40a62f693743 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:29.879313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02f7dc8a-b83a-438d-a078-40a62f693743 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:30.109821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-02f7dc8a-b83a-438d-a078-40a62f693743 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:30.119434 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-02f7dc8a-b83a-438d-a078-40a62f693743 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1472 microversion: 2.1 time: 0.262661 Jan 22 21:06:30.120881 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1148/2206] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:29 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1472 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:30.125816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-848d9f92-a2ed-400a-ad75-70f03400720c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:30.126690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-848d9f92-a2ed-400a-ad75-70f03400720c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:30.150894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-848d9f92-a2ed-400a-ad75-70f03400720c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:30.153916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-848d9f92-a2ed-400a-ad75-70f03400720c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:30.155059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-848d9f92-a2ed-400a-ad75-70f03400720c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:30.155970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-848d9f92-a2ed-400a-ad75-70f03400720c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:30.247614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-848d9f92-a2ed-400a-ad75-70f03400720c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:30.268482 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-848d9f92-a2ed-400a-ad75-70f03400720c tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 200 len: 1635 microversion: 2.1 time: 0.141226 Jan 22 21:06:30.268657 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1149/2207] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:30 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 1635 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:30.540047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-42d60329-564f-4be1-bfd5-a848899df9d4 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-595352448", "block_migration": true, "disk_over_commit": false}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:30.543618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-42d60329-564f-4be1-bfd5-a848899df9d4 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:30.557401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42d60329-564f-4be1-bfd5-a848899df9d4 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:30.558614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42d60329-564f-4be1-bfd5-a848899df9d4 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:30.559652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42d60329-564f-4be1-bfd5-a848899df9d4 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:30.560295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42d60329-564f-4be1-bfd5-a848899df9d4 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:30.600099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-42d60329-564f-4be1-bfd5-a848899df9d4 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lazy-loading 'flavor' on Instance uuid 627b2d09-47c8-46df-8a53-d0f6f01024e1 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:06:30.650556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-42d60329-564f-4be1-bfd5-a848899df9d4 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Going to try to live migrate instance to tempest-host-595352448 {{(pid=137032) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 22 21:06:30.665307 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-42d60329-564f-4be1-bfd5-a848899df9d4 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] HTTP exception thrown: Compute host tempest-host-595352448 could not be found. Jan 22 21:06:30.666001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-42d60329-564f-4be1-bfd5-a848899df9d4 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Returning 400 to user: Compute host tempest-host-595352448 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:06:30.667081 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-42d60329-564f-4be1-bfd5-a848899df9d4 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1/action" status: 400 len: 99 microversion: 2.1 time: 0.397251 Jan 22 21:06:30.668279 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1150/2208] 10.222.0.100 () {60 vars in 1283 bytes} [Sat Jan 22 21:06:30 2022] POST /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1/action => generated 99 bytes in 399 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 22 21:06:30.697312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5e01a1f3-bdfb-4dbe-8d92-29cf3cba44c0 req-4b318a58-a75a-4b66-a7a3-abf9dae10371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "tag": "fd4bbc77-36a6-44fe-a7c8-4f7f72a35d2f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:30.706223 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:30.706223 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:06:30.730906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5e01a1f3-bdfb-4dbe-8d92-29cf3cba44c0 req-4b318a58-a75a-4b66-a7a3-abf9dae10371 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:30.731664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5e01a1f3-bdfb-4dbe-8d92-29cf3cba44c0 req-4b318a58-a75a-4b66-a7a3-abf9dae10371 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:30.776873 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5e01a1f3-bdfb-4dbe-8d92-29cf3cba44c0 req-4b318a58-a75a-4b66-a7a3-abf9dae10371 service nova] Creating event network-changed:fd4bbc77-36a6-44fe-a7c8-4f7f72a35d2f for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:06:30.786706 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-5e01a1f3-bdfb-4dbe-8d92-29cf3cba44c0 req-4b318a58-a75a-4b66-a7a3-abf9dae10371 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116999 Jan 22 21:06:30.787967 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1151/2209] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:30.801915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-c9c24049-3921-4291-95d2-5c534c2d525c req-a0740f00-57d8-475f-a83b-d82250f40624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31384bb-6cc1-45a4-a067-92ac3713ef55", "name": "network-vif-plugged", "status": "completed", "tag": "493297bc-3a80-4965-b414-e858560483fb"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:30.810848 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:30.810848 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:06:30.827315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c9c24049-3921-4291-95d2-5c534c2d525c req-a0740f00-57d8-475f-a83b-d82250f40624 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:30.829645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c9c24049-3921-4291-95d2-5c534c2d525c req-a0740f00-57d8-475f-a83b-d82250f40624 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:30.878499 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-c9c24049-3921-4291-95d2-5c534c2d525c req-a0740f00-57d8-475f-a83b-d82250f40624 service nova] Creating event network-vif-plugged:493297bc-3a80-4965-b414-e858560483fb for instance b31384bb-6cc1-45a4-a067-92ac3713ef55 on nch1-master-1 Jan 22 21:06:30.884986 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-c9c24049-3921-4291-95d2-5c534c2d525c req-a0740f00-57d8-475f-a83b-d82250f40624 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093842 Jan 22 21:06:30.886123 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1152/2210] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:30.901251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bf7cde66-9bdc-457c-920c-4c2a3d0efc87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:30.902008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bf7cde66-9bdc-457c-920c-4c2a3d0efc87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:30.919611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf7cde66-9bdc-457c-920c-4c2a3d0efc87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:30.921292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf7cde66-9bdc-457c-920c-4c2a3d0efc87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:30.923038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf7cde66-9bdc-457c-920c-4c2a3d0efc87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:30.923796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf7cde66-9bdc-457c-920c-4c2a3d0efc87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:31.337851 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-181d0720-4692-48a4-baff-7b6901216483 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] 10.222.0.100 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.935628 Jan 22 21:06:31.341924 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1059/2211] 10.222.0.100 () {60 vars in 1174 bytes} [Sat Jan 22 21:06:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:31.354830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e6592e15-f618-4eef-968f-7e1aa53e2528 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:31.356302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e6592e15-f618-4eef-968f-7e1aa53e2528 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:31.385226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bf7cde66-9bdc-457c-920c-4c2a3d0efc87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:31.397681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6592e15-f618-4eef-968f-7e1aa53e2528 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:31.399845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bf7cde66-9bdc-457c-920c-4c2a3d0efc87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:31.401184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6592e15-f618-4eef-968f-7e1aa53e2528 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:31.402959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6592e15-f618-4eef-968f-7e1aa53e2528 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:31.405556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bf7cde66-9bdc-457c-920c-4c2a3d0efc87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:31.406460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6592e15-f618-4eef-968f-7e1aa53e2528 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:31.411189 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bf7cde66-9bdc-457c-920c-4c2a3d0efc87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1863 microversion: 2.42 time: 0.514927 Jan 22 21:06:31.412335 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1153/2212] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:30 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1863 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:31.419575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4bc397e6-5449-4d83-989a-a46740c23244 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5d0ed30>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:31.496879 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4bc397e6-5449-4d83-989a-a46740c23244 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.082373 Jan 22 21:06:31.507590 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e6592e15-f618-4eef-968f-7e1aa53e2528 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.158080 Jan 22 21:06:31.507590 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1060/2213] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:31 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:31.508439 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1154/2214] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:31 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:31.513488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-76d49ce7-4c76-47a0-8272-b77f67d26279 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:31.514525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-76d49ce7-4c76-47a0-8272-b77f67d26279 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:31.521626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-07c9e0f6-6b99-49c1-923e-674a377374da tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:31.523916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76d49ce7-4c76-47a0-8272-b77f67d26279 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:31.524572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76d49ce7-4c76-47a0-8272-b77f67d26279 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:31.525581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76d49ce7-4c76-47a0-8272-b77f67d26279 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:31.526192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76d49ce7-4c76-47a0-8272-b77f67d26279 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:31.527065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-07c9e0f6-6b99-49c1-923e-674a377374da tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:31.541175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07c9e0f6-6b99-49c1-923e-674a377374da tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:31.541670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07c9e0f6-6b99-49c1-923e-674a377374da tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:31.543153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07c9e0f6-6b99-49c1-923e-674a377374da tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:31.544067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07c9e0f6-6b99-49c1-923e-674a377374da tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:31.728428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-76d49ce7-4c76-47a0-8272-b77f67d26279 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:31.737817 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-76d49ce7-4c76-47a0-8272-b77f67d26279 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.228042 Jan 22 21:06:31.743789 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1155/2215] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:31 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:31.757458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a52c18ea-9e64-4819-b5b4-3d678211c2ef tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:31.761842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a52c18ea-9e64-4819-b5b4-3d678211c2ef tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:31.778316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a52c18ea-9e64-4819-b5b4-3d678211c2ef tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:31.779123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a52c18ea-9e64-4819-b5b4-3d678211c2ef tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:31.780127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a52c18ea-9e64-4819-b5b4-3d678211c2ef tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:31.780818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a52c18ea-9e64-4819-b5b4-3d678211c2ef tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:31.892005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a52c18ea-9e64-4819-b5b4-3d678211c2ef tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:31.904789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a52c18ea-9e64-4819-b5b4-3d678211c2ef tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:31.908346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a52c18ea-9e64-4819-b5b4-3d678211c2ef tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:31.909955 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a52c18ea-9e64-4819-b5b4-3d678211c2ef tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1359 microversion: 2.47 time: 0.163599 Jan 22 21:06:31.910982 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1156/2216] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:31 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:31.932989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-689cb054-594e-4b89-8db9-83911191489f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:31.934089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-689cb054-594e-4b89-8db9-83911191489f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:31.951127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-689cb054-594e-4b89-8db9-83911191489f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:31.953961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-689cb054-594e-4b89-8db9-83911191489f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:31.953961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-689cb054-594e-4b89-8db9-83911191489f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:31.955791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-689cb054-594e-4b89-8db9-83911191489f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:31.988462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-07c9e0f6-6b99-49c1-923e-674a377374da tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:31.991384 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-07c9e0f6-6b99-49c1-923e-674a377374da tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1472 microversion: 2.1 time: 0.479899 Jan 22 21:06:31.992555 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1061/2217] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:31 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1472 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:32.017175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3e516e12-e0a1-4702-a6b5-1c8abbfc6825 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] Calling method '.version_select at 0x7f1edaeaaa60>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:32.128690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-689cb054-594e-4b89-8db9-83911191489f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3903d47f1514112b91f2ea281591bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c864966e7b1a471cb496ac2242826ab6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:32.140397 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-689cb054-594e-4b89-8db9-83911191489f tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 200 len: 1635 microversion: 2.1 time: 0.227934 Jan 22 21:06:32.141322 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1157/2218] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:31 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 1635 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:32.146428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6100277a-9b41-41ac-9bc6-cbc49d771250 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:32.152225 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:32.152225 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:06:32.153745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6100277a-9b41-41ac-9bc6-cbc49d771250 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:32.155665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6100277a-9b41-41ac-9bc6-cbc49d771250 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Searching by: {'deleted': False, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:06:32.166323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6100277a-9b41-41ac-9bc6-cbc49d771250 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:32.167844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6100277a-9b41-41ac-9bc6-cbc49d771250 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:32.169830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6100277a-9b41-41ac-9bc6-cbc49d771250 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:32.171015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6100277a-9b41-41ac-9bc6-cbc49d771250 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:32.312754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-6100277a-9b41-41ac-9bc6-cbc49d771250 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:06:32.441889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6100277a-9b41-41ac-9bc6-cbc49d771250 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:32.450303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6100277a-9b41-41ac-9bc6-cbc49d771250 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:32.451225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6100277a-9b41-41ac-9bc6-cbc49d771250 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:32.477705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6100277a-9b41-41ac-9bc6-cbc49d771250 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:32.479258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6100277a-9b41-41ac-9bc6-cbc49d771250 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:32.527073 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6100277a-9b41-41ac-9bc6-cbc49d771250 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/detail" status: 200 len: 2710 microversion: 2.47 time: 0.384418 Jan 22 21:06:32.527863 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1158/2219] 10.222.0.100 () {60 vars in 1191 bytes} [Sat Jan 22 21:06:32 2022] GET /compute/v2.1/servers/detail => generated 2710 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:32.533027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2101325525", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:32.606308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:06:32.945396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:06:32.946200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:06:32.946660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:06:32.947798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:06:32.948240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:06:32.974783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:32.978434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:32.988622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:32.988622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:33.020127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Getting quotas for project 3e63d05e0fb84113bd23bc9c064ddad8. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:06:33.037565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Getting quotas for user 77ac42e3ea264a9fb8a56bc73caf9f5c and project 3e63d05e0fb84113bd23bc9c064ddad8. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:06:33.058179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:06:33.060979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:06:33.246673 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e927667c-feae-4f7e-a2e0-b018c02e3702 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.717502 Jan 22 21:06:33.252535 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1159/2220] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:06:32 2022] POST /compute/v2.1/servers => generated 382 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:06:33.262063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a341bb61-a94b-4b5d-ab69-271cea76189a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:33.263102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a341bb61-a94b-4b5d-ab69-271cea76189a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:33.277230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a341bb61-a94b-4b5d-ab69-271cea76189a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:33.277733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a341bb61-a94b-4b5d-ab69-271cea76189a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:33.279124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a341bb61-a94b-4b5d-ab69-271cea76189a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:33.279590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a341bb61-a94b-4b5d-ab69-271cea76189a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:33.704742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a341bb61-a94b-4b5d-ab69-271cea76189a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:33.716065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a341bb61-a94b-4b5d-ab69-271cea76189a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:33.717783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a341bb61-a94b-4b5d-ab69-271cea76189a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:33.719091 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a341bb61-a94b-4b5d-ab69-271cea76189a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.465375 Jan 22 21:06:33.720409 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1160/2221] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:33 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:33.740902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-628f68de-28d8-4f78-87c7-996b8221fcda tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5dcdaf0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:33.799643 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-628f68de-28d8-4f78-87c7-996b8221fcda tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.078014 Jan 22 21:06:33.809662 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1161/2222] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:33 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:33.817829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1d45ce3-591a-4cb1-98b8-51d1d8611fb4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:33.821361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1d45ce3-591a-4cb1-98b8-51d1d8611fb4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:33.831864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1d45ce3-591a-4cb1-98b8-51d1d8611fb4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:33.832323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1d45ce3-591a-4cb1-98b8-51d1d8611fb4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:33.833137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1d45ce3-591a-4cb1-98b8-51d1d8611fb4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:33.833694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1d45ce3-591a-4cb1-98b8-51d1d8611fb4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:33.879506 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3e516e12-e0a1-4702-a6b5-1c8abbfc6825 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] 10.222.0.100 "DELETE /compute/v2.1/os-floating-ips/a3d3a841-ac01-49c9-9449-c59f2eb5fbcb" status: 202 len: 0 microversion: 2.1 time: 1.873018 Jan 22 21:06:33.898533 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1d45ce3-591a-4cb1-98b8-51d1d8611fb4 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.079796 Jan 22 21:06:33.898533 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1162/2223] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:33 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:33.905121 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1062/2224] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:06:32 2022] DELETE /compute/v2.1/os-floating-ips/a3d3a841-ac01-49c9-9449-c59f2eb5fbcb => generated 0 bytes in 1900 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:06:33.907957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b2a7a3f9-525f-48ad-af01-8b6868331071 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:33.908236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b2a7a3f9-525f-48ad-af01-8b6868331071 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:33.917779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b825fa6a-ef43-4a31-8e4b-b271ddb85f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:33.918917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b825fa6a-ef43-4a31-8e4b-b271ddb85f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:33.925776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b825fa6a-ef43-4a31-8e4b-b271ddb85f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:33.926974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2a7a3f9-525f-48ad-af01-8b6868331071 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:33.927644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2a7a3f9-525f-48ad-af01-8b6868331071 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:33.928238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2a7a3f9-525f-48ad-af01-8b6868331071 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:33.930437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2a7a3f9-525f-48ad-af01-8b6868331071 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:33.930597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b825fa6a-ef43-4a31-8e4b-b271ddb85f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:33.933178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b825fa6a-ef43-4a31-8e4b-b271ddb85f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:33.933736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b825fa6a-ef43-4a31-8e4b-b271ddb85f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:33.999242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b2a7a3f9-525f-48ad-af01-8b6868331071 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:06:34.167473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b825fa6a-ef43-4a31-8e4b-b271ddb85f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:34.181341 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b825fa6a-ef43-4a31-8e4b-b271ddb85f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.267473 Jan 22 21:06:34.181970 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1063/2225] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:33 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:34.187906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-195500b2-2d4d-43e2-a485-54379505a81a req-f2134bee-24f0-403c-a326-bb4b06839a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a24268f7-fe8e-47cc-9ad1-abe07e244bee", "name": "network-vif-deleted", "tag": "b819e488-2853-4e52-bb4c-aa0ca7352bc7"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:34.190504 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:34.190504 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:06:34.197876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-195500b2-2d4d-43e2-a485-54379505a81a req-f2134bee-24f0-403c-a326-bb4b06839a80 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:34.198584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-195500b2-2d4d-43e2-a485-54379505a81a req-f2134bee-24f0-403c-a326-bb4b06839a80 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:34.218013 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-195500b2-2d4d-43e2-a485-54379505a81a req-f2134bee-24f0-403c-a326-bb4b06839a80 service nova] Creating event network-vif-deleted:b819e488-2853-4e52-bb4c-aa0ca7352bc7 for instance a24268f7-fe8e-47cc-9ad1-abe07e244bee on nch2-master-1 Jan 22 21:06:34.228639 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-195500b2-2d4d-43e2-a485-54379505a81a req-f2134bee-24f0-403c-a326-bb4b06839a80 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044340 Jan 22 21:06:34.235884 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1064/2226] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:34.238452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6d7e9fb3-65f0-4533-a70e-7cc05b002e36 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:34.239559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6d7e9fb3-65f0-4533-a70e-7cc05b002e36 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] [instance: a24268f7-fe8e-47cc-9ad1-abe07e244bee] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:34.247310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d7e9fb3-65f0-4533-a70e-7cc05b002e36 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:34.247877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d7e9fb3-65f0-4533-a70e-7cc05b002e36 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:34.248707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d7e9fb3-65f0-4533-a70e-7cc05b002e36 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:34.249186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d7e9fb3-65f0-4533-a70e-7cc05b002e36 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:34.266861 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-6d7e9fb3-65f0-4533-a70e-7cc05b002e36 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] HTTP exception thrown: Instance a24268f7-fe8e-47cc-9ad1-abe07e244bee could not be found. Jan 22 21:06:34.273628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6d7e9fb3-65f0-4533-a70e-7cc05b002e36 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Returning 404 to user: Instance a24268f7-fe8e-47cc-9ad1-abe07e244bee could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:06:34.273628 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6d7e9fb3-65f0-4533-a70e-7cc05b002e36 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee" status: 404 len: 111 microversion: 2.1 time: 0.035802 Jan 22 21:06:34.273628 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1065/2227] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:34 2022] GET /compute/v2.1/servers/a24268f7-fe8e-47cc-9ad1-abe07e244bee => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:06:34.275848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5dadb611-8d63-4d07-8f11-73a92ddc3bd8 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:34.276726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5dadb611-8d63-4d07-8f11-73a92ddc3bd8 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:34.359673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5dadb611-8d63-4d07-8f11-73a92ddc3bd8 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:34.369232 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5dadb611-8d63-4d07-8f11-73a92ddc3bd8 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1223 microversion: 2.1 time: 0.099231 Jan 22 21:06:34.378750 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1066/2228] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:34 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:34.384957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0f890a3c-4020-49bf-98b3-b6ace51b6f01 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] Calling method '.version_select at 0x7f1edae75d30>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:34.454405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG neutronclient.v2_0.client [None req-0f890a3c-4020-49bf-98b3-b6ace51b6f01 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a3d3a841-ac01-49c9-9449-c59f2eb5fbcb could not be found", "detail": ""}} {{(pid=137033) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:06:34.455125 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-0f890a3c-4020-49bf-98b3-b6ace51b6f01 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] HTTP exception thrown: Floating IP not found for ID a3d3a841-ac01-49c9-9449-c59f2eb5fbcb Jan 22 21:06:34.455736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0f890a3c-4020-49bf-98b3-b6ace51b6f01 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] Returning 404 to user: Floating IP not found for ID a3d3a841-ac01-49c9-9449-c59f2eb5fbcb {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:06:34.456752 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0f890a3c-4020-49bf-98b3-b6ace51b6f01 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] 10.222.0.100 "GET /compute/v2.1/os-floating-ips/a3d3a841-ac01-49c9-9449-c59f2eb5fbcb" status: 404 len: 111 microversion: 2.1 time: 0.076520 Jan 22 21:06:34.457528 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1067/2229] 10.222.0.100 () {58 vars in 1264 bytes} [Sat Jan 22 21:06:34 2022] GET /compute/v2.1/os-floating-ips/a3d3a841-ac01-49c9-9449-c59f2eb5fbcb => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:06:34.463923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-adc6e1b2-901e-4695-ae8d-5aafd344d179 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] Calling method '.version_select at 0x7f1ed5f2fdc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:34.717856 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b2a7a3f9-525f-48ad-af01-8b6868331071 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "DELETE /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 204 len: 0 microversion: 2.47 time: 0.819424 Jan 22 21:06:34.718681 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1163/2230] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:06:33 2022] DELETE /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:06:34.723393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d42d86ab-3cc2-4759-a4d2-e4fb46c84633 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] Calling method '.version_select at 0x7f1ed5899af0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:34.759194 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-adc6e1b2-901e-4695-ae8d-5aafd344d179 tempest-ServersTestJSON-980812571 tempest-ServersTestJSON-980812571-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-793673175" status: 202 len: 0 microversion: 2.1 time: 0.300343 Jan 22 21:06:34.763162 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1068/2231] 10.222.0.100 () {58 vars in 1222 bytes} [Sat Jan 22 21:06:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-793673175 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:06:34.769268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e94f3ecb-d0a0-427a-a0df-e73a6caf5e72 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:34.769382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e94f3ecb-d0a0-427a-a0df-e73a6caf5e72 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:34.779747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e94f3ecb-d0a0-427a-a0df-e73a6caf5e72 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:34.784152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e94f3ecb-d0a0-427a-a0df-e73a6caf5e72 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:34.785222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e94f3ecb-d0a0-427a-a0df-e73a6caf5e72 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:34.787882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e94f3ecb-d0a0-427a-a0df-e73a6caf5e72 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:34.824312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG neutronclient.v2_0.client [None req-d42d86ab-3cc2-4759-a4d2-e4fb46c84633 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a3d3a841-ac01-49c9-9449-c59f2eb5fbcb could not be found", "detail": ""}} {{(pid=137032) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:06:34.825235 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-d42d86ab-3cc2-4759-a4d2-e4fb46c84633 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] HTTP exception thrown: Floating IP not found for ID a3d3a841-ac01-49c9-9449-c59f2eb5fbcb Jan 22 21:06:34.826072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d42d86ab-3cc2-4759-a4d2-e4fb46c84633 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] Returning 404 to user: Floating IP not found for ID a3d3a841-ac01-49c9-9449-c59f2eb5fbcb {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:06:34.827083 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d42d86ab-3cc2-4759-a4d2-e4fb46c84633 tempest-FloatingIPsTestJSON-1895339351 tempest-FloatingIPsTestJSON-1895339351-project] 10.222.0.100 "DELETE /compute/v2.1/os-floating-ips/a3d3a841-ac01-49c9-9449-c59f2eb5fbcb" status: 404 len: 111 microversion: 2.1 time: 0.107553 Jan 22 21:06:34.828158 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1164/2232] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:06:34 2022] DELETE /compute/v2.1/os-floating-ips/a3d3a841-ac01-49c9-9449-c59f2eb5fbcb => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:06:34.835423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b727daf-55c9-44db-81c5-d6ee8308fd25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:34.845328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b727daf-55c9-44db-81c5-d6ee8308fd25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:34.859873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b727daf-55c9-44db-81c5-d6ee8308fd25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:34.868572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b727daf-55c9-44db-81c5-d6ee8308fd25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:34.869780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b727daf-55c9-44db-81c5-d6ee8308fd25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:34.870412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b727daf-55c9-44db-81c5-d6ee8308fd25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:34.936550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e94f3ecb-d0a0-427a-a0df-e73a6caf5e72 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:34.951307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e94f3ecb-d0a0-427a-a0df-e73a6caf5e72 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:34.957584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e94f3ecb-d0a0-427a-a0df-e73a6caf5e72 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:34.957584 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e94f3ecb-d0a0-427a-a0df-e73a6caf5e72 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1365 microversion: 2.47 time: 0.190135 Jan 22 21:06:34.957584 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1069/2233] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:34 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:34.974152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-61d7e324-fca6-4d84-a989-7cbdb5fa682d tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed552d8b0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:35.029640 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-61d7e324-fca6-4d84-a989-7cbdb5fa682d tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.071748 Jan 22 21:06:35.035411 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1070/2234] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:34 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:35.053368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-819a0179-390f-4435-bf1d-fdd161ac30c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:35.056140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-819a0179-390f-4435-bf1d-fdd161ac30c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:35.068754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-819a0179-390f-4435-bf1d-fdd161ac30c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:35.069595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-819a0179-390f-4435-bf1d-fdd161ac30c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:35.071614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-819a0179-390f-4435-bf1d-fdd161ac30c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:35.072867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-819a0179-390f-4435-bf1d-fdd161ac30c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:35.135063 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-819a0179-390f-4435-bf1d-fdd161ac30c8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.101242 Jan 22 21:06:35.155024 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1071/2235] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:35 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:35.222162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-057a69df-8c16-48b4-a8a1-74d9fe37cc2b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:35.222891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-057a69df-8c16-48b4-a8a1-74d9fe37cc2b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:35.252512 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-057a69df-8c16-48b4-a8a1-74d9fe37cc2b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:35.253225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-057a69df-8c16-48b4-a8a1-74d9fe37cc2b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:35.269011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-057a69df-8c16-48b4-a8a1-74d9fe37cc2b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:35.270823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-057a69df-8c16-48b4-a8a1-74d9fe37cc2b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:35.613189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-057a69df-8c16-48b4-a8a1-74d9fe37cc2b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:35.624553 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-057a69df-8c16-48b4-a8a1-74d9fe37cc2b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.427655 Jan 22 21:06:35.627925 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1072/2236] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:35 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:35.633122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c83c00d4-79f6-49a2-af3d-f82ad9f57d6d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:35.633853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c83c00d4-79f6-49a2-af3d-f82ad9f57d6d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:35.650598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c83c00d4-79f6-49a2-af3d-f82ad9f57d6d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:35.651080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c83c00d4-79f6-49a2-af3d-f82ad9f57d6d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:35.651956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c83c00d4-79f6-49a2-af3d-f82ad9f57d6d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:35.652407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c83c00d4-79f6-49a2-af3d-f82ad9f57d6d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:35.668270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8b727daf-55c9-44db-81c5-d6ee8308fd25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:35.687812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8b727daf-55c9-44db-81c5-d6ee8308fd25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:35.691331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8b727daf-55c9-44db-81c5-d6ee8308fd25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:35.693797 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b727daf-55c9-44db-81c5-d6ee8308fd25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.864463 Jan 22 21:06:35.695696 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1165/2237] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:34 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:35.780352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c83c00d4-79f6-49a2-af3d-f82ad9f57d6d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:35.798307 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c83c00d4-79f6-49a2-af3d-f82ad9f57d6d tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1275 microversion: 2.1 time: 0.169060 Jan 22 21:06:35.808818 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1073/2238] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:35 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1275 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:35.975788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-940039d8-2ea4-4ff6-abd8-3c85491be228 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:35.979986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-940039d8-2ea4-4ff6-abd8-3c85491be228 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:35.994330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-940039d8-2ea4-4ff6-abd8-3c85491be228 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:35.998395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-940039d8-2ea4-4ff6-abd8-3c85491be228 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:36.000164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-940039d8-2ea4-4ff6-abd8-3c85491be228 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:36.001671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-940039d8-2ea4-4ff6-abd8-3c85491be228 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:36.047108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d33b7742-78c3-4194-8bcd-e5e70bb8a5fa tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1edaeaaca0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:36.160687 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d33b7742-78c3-4194-8bcd-e5e70bb8a5fa tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.120409 Jan 22 21:06:36.161565 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1074/2239] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:36 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:36.166369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f44b8f55-2e7f-4b1e-a240-1a4feca89e67 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:36.176367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f44b8f55-2e7f-4b1e-a240-1a4feca89e67 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:36.198044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f44b8f55-2e7f-4b1e-a240-1a4feca89e67 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:36.198806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f44b8f55-2e7f-4b1e-a240-1a4feca89e67 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:36.199788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f44b8f55-2e7f-4b1e-a240-1a4feca89e67 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:36.200395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f44b8f55-2e7f-4b1e-a240-1a4feca89e67 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:36.273730 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f44b8f55-2e7f-4b1e-a240-1a4feca89e67 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.107953 Jan 22 21:06:36.278110 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1075/2240] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:36 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:36.285967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-116752b3-98dd-4c4d-9c45-5e1b7eb37b97 req-92f1f0bd-cf90-4668-9e59-9a74da9ff97a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "tag": "40974874-966d-4b01-b7e3-7346238b818a"}, {"name": "network-changed", "server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "tag": "d4efec9f-1ce8-4f39-b074-2e15fb38a93f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:36.288036 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:36.288036 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:06:36.301921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-940039d8-2ea4-4ff6-abd8-3c85491be228 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:36.303657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-116752b3-98dd-4c4d-9c45-5e1b7eb37b97 req-92f1f0bd-cf90-4668-9e59-9a74da9ff97a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:36.304899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-116752b3-98dd-4c4d-9c45-5e1b7eb37b97 req-92f1f0bd-cf90-4668-9e59-9a74da9ff97a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:36.314230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-940039d8-2ea4-4ff6-abd8-3c85491be228 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:36.315835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-940039d8-2ea4-4ff6-abd8-3c85491be228 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:36.318964 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-940039d8-2ea4-4ff6-abd8-3c85491be228 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1365 microversion: 2.47 time: 0.348122 Jan 22 21:06:36.324413 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1166/2241] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:35 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1365 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:36.349694 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-116752b3-98dd-4c4d-9c45-5e1b7eb37b97 req-92f1f0bd-cf90-4668-9e59-9a74da9ff97a service nova] Creating event network-changed:40974874-966d-4b01-b7e3-7346238b818a for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:06:36.351525 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-116752b3-98dd-4c4d-9c45-5e1b7eb37b97 req-92f1f0bd-cf90-4668-9e59-9a74da9ff97a service nova] Creating event network-changed:d4efec9f-1ce8-4f39-b074-2e15fb38a93f for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:06:36.357110 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-116752b3-98dd-4c4d-9c45-5e1b7eb37b97 req-92f1f0bd-cf90-4668-9e59-9a74da9ff97a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.076016 Jan 22 21:06:36.358082 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1076/2242] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:36.643195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-57fc2aa0-53c9-4929-be21-4061a02b6606 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:36.644093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-57fc2aa0-53c9-4929-be21-4061a02b6606 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:36.653869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57fc2aa0-53c9-4929-be21-4061a02b6606 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:36.665296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57fc2aa0-53c9-4929-be21-4061a02b6606 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:36.666526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57fc2aa0-53c9-4929-be21-4061a02b6606 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:36.667156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57fc2aa0-53c9-4929-be21-4061a02b6606 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:36.713294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-55ccacc2-838e-451d-9d79-ab6c49341508 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:36.714557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-55ccacc2-838e-451d-9d79-ab6c49341508 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:36.730540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55ccacc2-838e-451d-9d79-ab6c49341508 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:36.731318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55ccacc2-838e-451d-9d79-ab6c49341508 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:36.732307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55ccacc2-838e-451d-9d79-ab6c49341508 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:36.732912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55ccacc2-838e-451d-9d79-ab6c49341508 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:37.124586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-57fc2aa0-53c9-4929-be21-4061a02b6606 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:37.136916 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-57fc2aa0-53c9-4929-be21-4061a02b6606 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.498551 Jan 22 21:06:37.137540 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1167/2243] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:36 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:37.146185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b3b82b19-b4d3-4a6b-8305-b33c38f73f5a tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:37.147598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b3b82b19-b4d3-4a6b-8305-b33c38f73f5a tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:37.155902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3b82b19-b4d3-4a6b-8305-b33c38f73f5a tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:37.156637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3b82b19-b4d3-4a6b-8305-b33c38f73f5a tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:37.157675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3b82b19-b4d3-4a6b-8305-b33c38f73f5a tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:37.158321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3b82b19-b4d3-4a6b-8305-b33c38f73f5a tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:37.291017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b3b82b19-b4d3-4a6b-8305-b33c38f73f5a tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:37.304722 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b3b82b19-b4d3-4a6b-8305-b33c38f73f5a tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1281 microversion: 2.1 time: 0.163309 Jan 22 21:06:37.322614 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1168/2244] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:37 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1281 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:37.327733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-15634dc6-3436-4fda-a0d8-510ed40c0e8a tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5d5b940>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:37.423703 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-15634dc6-3436-4fda-a0d8-510ed40c0e8a tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.099569 Jan 22 21:06:37.429951 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1169/2245] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:37 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:37.430324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a702b49d-a10b-4b6e-beb3-04318856d55b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:37.431509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a702b49d-a10b-4b6e-beb3-04318856d55b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:37.439569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a702b49d-a10b-4b6e-beb3-04318856d55b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:37.447147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a702b49d-a10b-4b6e-beb3-04318856d55b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:37.447147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a702b49d-a10b-4b6e-beb3-04318856d55b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:37.447147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a702b49d-a10b-4b6e-beb3-04318856d55b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:37.517088 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a702b49d-a10b-4b6e-beb3-04318856d55b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.090914 Jan 22 21:06:37.518767 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1170/2246] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:37 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:37.524654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cf5940ee-f974-4e93-8690-212345f69030 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:37.531336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cf5940ee-f974-4e93-8690-212345f69030 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:37.556338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf5940ee-f974-4e93-8690-212345f69030 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:37.556910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf5940ee-f974-4e93-8690-212345f69030 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:37.557866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf5940ee-f974-4e93-8690-212345f69030 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:37.558433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf5940ee-f974-4e93-8690-212345f69030 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:37.631402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf5940ee-f974-4e93-8690-212345f69030 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:37.636162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf5940ee-f974-4e93-8690-212345f69030 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:37.636706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-cf5940ee-f974-4e93-8690-212345f69030 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lazy-loading 'fault' on Instance uuid 50cd6dbd-f155-42d8-a95f-58093d124640 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:06:37.707571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cf5940ee-f974-4e93-8690-212345f69030 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:37.728672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cf5940ee-f974-4e93-8690-212345f69030 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:37.735448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cf5940ee-f974-4e93-8690-212345f69030 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:37.738125 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cf5940ee-f974-4e93-8690-212345f69030 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 200 len: 1370 microversion: 2.47 time: 0.216951 Jan 22 21:06:37.738919 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1171/2247] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:37 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:38.025084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-55ccacc2-838e-451d-9d79-ab6c49341508 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:38.043346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-55ccacc2-838e-451d-9d79-ab6c49341508 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:38.051389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-55ccacc2-838e-451d-9d79-ab6c49341508 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:38.057527 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-55ccacc2-838e-451d-9d79-ab6c49341508 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 1.345299 Jan 22 21:06:38.058172 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1077/2248] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:36 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:38.154431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-77671f4f-7790-42da-a6ba-3aad651c34ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:38.155662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-77671f4f-7790-42da-a6ba-3aad651c34ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:38.172036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77671f4f-7790-42da-a6ba-3aad651c34ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:38.172927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77671f4f-7790-42da-a6ba-3aad651c34ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:38.174155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77671f4f-7790-42da-a6ba-3aad651c34ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:38.177874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77671f4f-7790-42da-a6ba-3aad651c34ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:38.324934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-72b4157f-c0e1-42cc-a7c5-28003a6c24ce tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:38.326015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-72b4157f-c0e1-42cc-a7c5-28003a6c24ce tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:38.344585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72b4157f-c0e1-42cc-a7c5-28003a6c24ce tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:38.345686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72b4157f-c0e1-42cc-a7c5-28003a6c24ce tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:38.347794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72b4157f-c0e1-42cc-a7c5-28003a6c24ce tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:38.348788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72b4157f-c0e1-42cc-a7c5-28003a6c24ce tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:38.491382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-72b4157f-c0e1-42cc-a7c5-28003a6c24ce tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:38.502710 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-72b4157f-c0e1-42cc-a7c5-28003a6c24ce tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1281 microversion: 2.1 time: 0.181412 Jan 22 21:06:38.529889 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1078/2249] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:38 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1281 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:38.539959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-aff6100d-731a-470e-b4d3-917bea4a8830 req-afc9c7e3-adb0-4b16-a97b-a3f99446234e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "tag": "65a17ac8-ab35-4509-a302-dc7bac50087c"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:38.542748 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:38.542748 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:06:38.553118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-aff6100d-731a-470e-b4d3-917bea4a8830 req-afc9c7e3-adb0-4b16-a97b-a3f99446234e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:38.554697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-aff6100d-731a-470e-b4d3-917bea4a8830 req-afc9c7e3-adb0-4b16-a97b-a3f99446234e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:38.574019 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-aff6100d-731a-470e-b4d3-917bea4a8830 req-afc9c7e3-adb0-4b16-a97b-a3f99446234e service nova] Creating event network-changed:65a17ac8-ab35-4509-a302-dc7bac50087c for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:06:38.587143 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-aff6100d-731a-470e-b4d3-917bea4a8830 req-afc9c7e3-adb0-4b16-a97b-a3f99446234e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054526 Jan 22 21:06:38.588031 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1079/2250] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:38.594187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f24842b1-ddc4-4266-b97d-074b66445461 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1edaebaee0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:38.677657 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f24842b1-ddc4-4266-b97d-074b66445461 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.088151 Jan 22 21:06:38.687889 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1080/2251] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:38 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:38.694605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9e380847-ae93-4a20-a53b-61188f5bb90f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:38.696926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9e380847-ae93-4a20-a53b-61188f5bb90f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:38.705966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e380847-ae93-4a20-a53b-61188f5bb90f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:38.707527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e380847-ae93-4a20-a53b-61188f5bb90f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:38.709156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e380847-ae93-4a20-a53b-61188f5bb90f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:38.709870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e380847-ae93-4a20-a53b-61188f5bb90f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:38.763886 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9e380847-ae93-4a20-a53b-61188f5bb90f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.074163 Jan 22 21:06:38.764835 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1081/2252] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:38 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:38.770249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f4deb14-8bbe-4e0b-8c3d-06197c5f83c6 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:38.771249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9f4deb14-8bbe-4e0b-8c3d-06197c5f83c6 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 50cd6dbd-f155-42d8-a95f-58093d124640] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:38.779534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f4deb14-8bbe-4e0b-8c3d-06197c5f83c6 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:38.780326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f4deb14-8bbe-4e0b-8c3d-06197c5f83c6 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:38.781410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f4deb14-8bbe-4e0b-8c3d-06197c5f83c6 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:38.782090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f4deb14-8bbe-4e0b-8c3d-06197c5f83c6 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:38.798518 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-9f4deb14-8bbe-4e0b-8c3d-06197c5f83c6 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] HTTP exception thrown: Instance 50cd6dbd-f155-42d8-a95f-58093d124640 could not be found. Jan 22 21:06:38.799576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f4deb14-8bbe-4e0b-8c3d-06197c5f83c6 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Returning 404 to user: Instance 50cd6dbd-f155-42d8-a95f-58093d124640 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:06:38.801042 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9f4deb14-8bbe-4e0b-8c3d-06197c5f83c6 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640" status: 404 len: 111 microversion: 2.47 time: 0.034684 Jan 22 21:06:38.801896 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1082/2253] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:38 2022] GET /compute/v2.1/servers/50cd6dbd-f155-42d8-a95f-58093d124640 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:06:38.814868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d4875231-23cc-4230-bc37-515ce1f61dba tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:38.816008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d4875231-23cc-4230-bc37-515ce1f61dba tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 1260ec05-fff7-40c2-a069-43c9b36db3ca] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:38.824590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4875231-23cc-4230-bc37-515ce1f61dba tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:38.825559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4875231-23cc-4230-bc37-515ce1f61dba tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:38.826995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4875231-23cc-4230-bc37-515ce1f61dba tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:38.827499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4875231-23cc-4230-bc37-515ce1f61dba tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:38.859231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d4875231-23cc-4230-bc37-515ce1f61dba tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 1260ec05-fff7-40c2-a069-43c9b36db3ca] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:06:38.952251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-77671f4f-7790-42da-a6ba-3aad651c34ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:38.968398 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-77671f4f-7790-42da-a6ba-3aad651c34ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.818104 Jan 22 21:06:38.970544 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1172/2254] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:38 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:39.076568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aac04c18-174f-43a0-8de3-ca45d64797f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:39.078568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aac04c18-174f-43a0-8de3-ca45d64797f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:39.090478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aac04c18-174f-43a0-8de3-ca45d64797f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:39.093268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aac04c18-174f-43a0-8de3-ca45d64797f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:39.095750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aac04c18-174f-43a0-8de3-ca45d64797f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:39.096940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aac04c18-174f-43a0-8de3-ca45d64797f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:39.313332 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d4875231-23cc-4230-bc37-515ce1f61dba tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1260ec05-fff7-40c2-a069-43c9b36db3ca" status: 204 len: 0 microversion: 2.47 time: 0.505228 Jan 22 21:06:39.314632 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1083/2255] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:06:38 2022] DELETE /compute/v2.1/servers/1260ec05-fff7-40c2-a069-43c9b36db3ca => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:06:39.333805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f7d2f82c-7817-4351-859d-e667fdbb53c0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:39.340715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f7d2f82c-7817-4351-859d-e667fdbb53c0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 1260ec05-fff7-40c2-a069-43c9b36db3ca] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:39.353121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2f82c-7817-4351-859d-e667fdbb53c0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:39.353821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2f82c-7817-4351-859d-e667fdbb53c0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:39.355219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2f82c-7817-4351-859d-e667fdbb53c0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:39.355868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2f82c-7817-4351-859d-e667fdbb53c0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:39.533878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f7d2f82c-7817-4351-859d-e667fdbb53c0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:39.553236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f7d2f82c-7817-4351-859d-e667fdbb53c0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:39.558215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f7d2f82c-7817-4351-859d-e667fdbb53c0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:39.559952 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f7d2f82c-7817-4351-859d-e667fdbb53c0 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/1260ec05-fff7-40c2-a069-43c9b36db3ca" status: 200 len: 1364 microversion: 2.47 time: 0.239557 Jan 22 21:06:39.570397 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1084/2256] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:39 2022] GET /compute/v2.1/servers/1260ec05-fff7-40c2-a069-43c9b36db3ca => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:39.573894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2c24bb86-a898-46db-8293-f2f928120254 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:39.576515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2c24bb86-a898-46db-8293-f2f928120254 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:39.589371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c24bb86-a898-46db-8293-f2f928120254 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:39.589857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c24bb86-a898-46db-8293-f2f928120254 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:39.592495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c24bb86-a898-46db-8293-f2f928120254 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:39.592944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c24bb86-a898-46db-8293-f2f928120254 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:39.769261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2c24bb86-a898-46db-8293-f2f928120254 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:39.781864 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2c24bb86-a898-46db-8293-f2f928120254 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1281 microversion: 2.1 time: 0.219166 Jan 22 21:06:39.795040 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1085/2257] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:39 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1281 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:39.800462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2708e13b-bfd3-4e33-8739-148accbbef46 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5eb6550>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:39.861756 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2708e13b-bfd3-4e33-8739-148accbbef46 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.065068 Jan 22 21:06:39.863099 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1086/2258] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:39 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:39.877592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-420f84e7-8723-4a42-a61a-b5f3e01e447a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:39.877592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-420f84e7-8723-4a42-a61a-b5f3e01e447a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:39.886461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-420f84e7-8723-4a42-a61a-b5f3e01e447a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:39.886461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-420f84e7-8723-4a42-a61a-b5f3e01e447a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:39.886461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-420f84e7-8723-4a42-a61a-b5f3e01e447a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:39.886461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-420f84e7-8723-4a42-a61a-b5f3e01e447a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:39.961787 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-420f84e7-8723-4a42-a61a-b5f3e01e447a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.096084 Jan 22 21:06:39.964511 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1087/2259] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:39 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:39.974376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aac04c18-174f-43a0-8de3-ca45d64797f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:39.993233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aac04c18-174f-43a0-8de3-ca45d64797f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:39.996850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aac04c18-174f-43a0-8de3-ca45d64797f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:39.997152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f4d8bec8-895c-40e4-b22d-c59bc9330fcd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:39.997993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f4d8bec8-895c-40e4-b22d-c59bc9330fcd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:39.999979 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aac04c18-174f-43a0-8de3-ca45d64797f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.927066 Jan 22 21:06:40.001942 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1173/2260] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:39 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:06:40.010127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4d8bec8-895c-40e4-b22d-c59bc9330fcd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:40.011096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4d8bec8-895c-40e4-b22d-c59bc9330fcd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:40.012133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4d8bec8-895c-40e4-b22d-c59bc9330fcd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:40.012595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4d8bec8-895c-40e4-b22d-c59bc9330fcd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:40.580522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0f38fc9e-a36c-4341-8e25-36b5434ff638 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:40.581169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0f38fc9e-a36c-4341-8e25-36b5434ff638 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 1260ec05-fff7-40c2-a069-43c9b36db3ca] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:40.597038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f38fc9e-a36c-4341-8e25-36b5434ff638 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:40.597538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f38fc9e-a36c-4341-8e25-36b5434ff638 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:40.598387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f38fc9e-a36c-4341-8e25-36b5434ff638 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:40.598828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f38fc9e-a36c-4341-8e25-36b5434ff638 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:40.862850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f4d8bec8-895c-40e4-b22d-c59bc9330fcd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:40.889398 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f4d8bec8-895c-40e4-b22d-c59bc9330fcd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.902661 Jan 22 21:06:40.892867 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1088/2261] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:39 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:40.906275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-2e80487b-ed03-48e7-9852-55ef7e821011 req-5bdccd1c-9f0b-45df-99cc-26f11190cc43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "tag": "926072cb-8b2b-4fa0-b9dc-cb5c9a1b57cc"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:40.910021 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:40.910021 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:06:40.910559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0f38fc9e-a36c-4341-8e25-36b5434ff638 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:40.936129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0f38fc9e-a36c-4341-8e25-36b5434ff638 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:40.942838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0f38fc9e-a36c-4341-8e25-36b5434ff638 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:40.944446 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0f38fc9e-a36c-4341-8e25-36b5434ff638 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/1260ec05-fff7-40c2-a069-43c9b36db3ca" status: 200 len: 1364 microversion: 2.47 time: 0.368916 Jan 22 21:06:40.951451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2e80487b-ed03-48e7-9852-55ef7e821011 req-5bdccd1c-9f0b-45df-99cc-26f11190cc43 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:40.951918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2e80487b-ed03-48e7-9852-55ef7e821011 req-5bdccd1c-9f0b-45df-99cc-26f11190cc43 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:40.956111 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1174/2262] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:40 2022] GET /compute/v2.1/servers/1260ec05-fff7-40c2-a069-43c9b36db3ca => generated 1364 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:40.965423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d80ee90f-273c-4336-bd5a-0ba7a3e0609c tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:40.966399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d80ee90f-273c-4336-bd5a-0ba7a3e0609c tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:40.982476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d80ee90f-273c-4336-bd5a-0ba7a3e0609c tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:40.983262 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-2e80487b-ed03-48e7-9852-55ef7e821011 req-5bdccd1c-9f0b-45df-99cc-26f11190cc43 service nova] Creating event network-changed:926072cb-8b2b-4fa0-b9dc-cb5c9a1b57cc for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:06:40.985033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d80ee90f-273c-4336-bd5a-0ba7a3e0609c tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:40.986170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d80ee90f-273c-4336-bd5a-0ba7a3e0609c tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:40.987846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d80ee90f-273c-4336-bd5a-0ba7a3e0609c tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:40.994427 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-2e80487b-ed03-48e7-9852-55ef7e821011 req-5bdccd1c-9f0b-45df-99cc-26f11190cc43 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096919 Jan 22 21:06:40.997861 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1089/2263] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:41.013763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ab1ced9-9dac-48db-be29-76e20e57034b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1edaed7dc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:41.105029 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ab1ced9-9dac-48db-be29-76e20e57034b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.105892 Jan 22 21:06:41.110899 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1090/2264] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:40 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:41.114492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0b9ddf4b-51a4-4316-813f-86713746189e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:41.115597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0b9ddf4b-51a4-4316-813f-86713746189e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:41.131164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b9ddf4b-51a4-4316-813f-86713746189e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:41.134391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b9ddf4b-51a4-4316-813f-86713746189e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:41.135466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b9ddf4b-51a4-4316-813f-86713746189e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:41.136118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b9ddf4b-51a4-4316-813f-86713746189e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:41.214629 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0b9ddf4b-51a4-4316-813f-86713746189e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.107187 Jan 22 21:06:41.220100 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1091/2265] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:41 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:41.225222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-242778a0-08fd-4588-a2e0-4170f976febc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:41.230734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-242778a0-08fd-4588-a2e0-4170f976febc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:41.248222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-242778a0-08fd-4588-a2e0-4170f976febc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:41.249284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-242778a0-08fd-4588-a2e0-4170f976febc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:41.250361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-242778a0-08fd-4588-a2e0-4170f976febc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:41.250979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-242778a0-08fd-4588-a2e0-4170f976febc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:41.514639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d80ee90f-273c-4336-bd5a-0ba7a3e0609c tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:41.523998 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d80ee90f-273c-4336-bd5a-0ba7a3e0609c tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1323 microversion: 2.1 time: 0.566335 Jan 22 21:06:41.527103 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1175/2266] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:40 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1323 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:41.907572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d4328bb3-85e5-4fdc-a699-b8574a2a50fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:41.908545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d4328bb3-85e5-4fdc-a699-b8574a2a50fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:41.923417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4328bb3-85e5-4fdc-a699-b8574a2a50fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:41.932801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4328bb3-85e5-4fdc-a699-b8574a2a50fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:41.936028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4328bb3-85e5-4fdc-a699-b8574a2a50fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:41.938854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4328bb3-85e5-4fdc-a699-b8574a2a50fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:42.473059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-242778a0-08fd-4588-a2e0-4170f976febc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:42.489033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-242778a0-08fd-4588-a2e0-4170f976febc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:42.492563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-242778a0-08fd-4588-a2e0-4170f976febc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:42.503637 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-242778a0-08fd-4588-a2e0-4170f976febc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 1.282252 Jan 22 21:06:42.504598 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1092/2267] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:41 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:42.509793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-241c6829-5897-43be-950d-4367a06da7d5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:42.510735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-241c6829-5897-43be-950d-4367a06da7d5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 1260ec05-fff7-40c2-a069-43c9b36db3ca] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:42.536084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-241c6829-5897-43be-950d-4367a06da7d5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:42.536739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-241c6829-5897-43be-950d-4367a06da7d5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:42.537795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-241c6829-5897-43be-950d-4367a06da7d5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:42.538583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-241c6829-5897-43be-950d-4367a06da7d5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:42.604726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-241c6829-5897-43be-950d-4367a06da7d5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:42.605292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-241c6829-5897-43be-950d-4367a06da7d5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:42.606323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-241c6829-5897-43be-950d-4367a06da7d5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lazy-loading 'fault' on Instance uuid 1260ec05-fff7-40c2-a069-43c9b36db3ca {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:06:42.706610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-241c6829-5897-43be-950d-4367a06da7d5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:42.726896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d4328bb3-85e5-4fdc-a699-b8574a2a50fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:42.737332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-241c6829-5897-43be-950d-4367a06da7d5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:42.740092 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d4328bb3-85e5-4fdc-a699-b8574a2a50fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.836144 Jan 22 21:06:42.744366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-241c6829-5897-43be-950d-4367a06da7d5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b74ff418e2a4e8882eae509bd43327f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa53b2bab5c64af1bb78c31e5a26ca92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:42.747564 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1176/2268] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:41 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:42.749962 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-241c6829-5897-43be-950d-4367a06da7d5 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/1260ec05-fff7-40c2-a069-43c9b36db3ca" status: 200 len: 1369 microversion: 2.47 time: 0.242004 Jan 22 21:06:42.756585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cfd55be6-bca5-4ce7-bb66-637075a3aee3 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5f24790>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:42.759485 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1093/2269] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:42 2022] GET /compute/v2.1/servers/1260ec05-fff7-40c2-a069-43c9b36db3ca => generated 1369 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:42.769968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-885f42a3-49c3-448d-8a3c-1e41f79d3c84 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:42.777218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-885f42a3-49c3-448d-8a3c-1e41f79d3c84 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:42.799991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-885f42a3-49c3-448d-8a3c-1e41f79d3c84 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:42.802753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-885f42a3-49c3-448d-8a3c-1e41f79d3c84 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:42.803619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-885f42a3-49c3-448d-8a3c-1e41f79d3c84 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:42.804344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-885f42a3-49c3-448d-8a3c-1e41f79d3c84 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:42.872798 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cfd55be6-bca5-4ce7-bb66-637075a3aee3 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.121018 Jan 22 21:06:42.877774 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1177/2270] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:42 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:42.889664 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-885f42a3-49c3-448d-8a3c-1e41f79d3c84 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.128595 Jan 22 21:06:42.890320 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1094/2271] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:42 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:42.906420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7e3798ee-f9bc-4505-9965-9047882710d1 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:42.913052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7e3798ee-f9bc-4505-9965-9047882710d1 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:42.939652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e3798ee-f9bc-4505-9965-9047882710d1 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:42.940301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e3798ee-f9bc-4505-9965-9047882710d1 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:42.942894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e3798ee-f9bc-4505-9965-9047882710d1 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:42.946808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e3798ee-f9bc-4505-9965-9047882710d1 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:43.205841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7e3798ee-f9bc-4505-9965-9047882710d1 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:43.216433 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7e3798ee-f9bc-4505-9965-9047882710d1 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1323 microversion: 2.1 time: 0.337505 Jan 22 21:06:43.217710 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1178/2272] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:42 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1323 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:43.525251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6caae154-d65a-4a0e-8d81-7638b81ed3bd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:43.526823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6caae154-d65a-4a0e-8d81-7638b81ed3bd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:43.549854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6caae154-d65a-4a0e-8d81-7638b81ed3bd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:43.556009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6caae154-d65a-4a0e-8d81-7638b81ed3bd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:43.559628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6caae154-d65a-4a0e-8d81-7638b81ed3bd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:43.564155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6caae154-d65a-4a0e-8d81-7638b81ed3bd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:43.757999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4b1ca29c-f70e-422e-8488-c91334a70bdf tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:43.759280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4b1ca29c-f70e-422e-8488-c91334a70bdf tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:43.771844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b1ca29c-f70e-422e-8488-c91334a70bdf tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:43.776295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b1ca29c-f70e-422e-8488-c91334a70bdf tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:43.777397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b1ca29c-f70e-422e-8488-c91334a70bdf tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:43.778249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b1ca29c-f70e-422e-8488-c91334a70bdf tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:44.249425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6caae154-d65a-4a0e-8d81-7638b81ed3bd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:44.268148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6caae154-d65a-4a0e-8d81-7638b81ed3bd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:44.276358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6caae154-d65a-4a0e-8d81-7638b81ed3bd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:44.277663 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6caae154-d65a-4a0e-8d81-7638b81ed3bd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.757775 Jan 22 21:06:44.278594 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1095/2273] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:43 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:44.283183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-166a26f3-ce28-4652-8262-3dabd3fbf1e1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:44.283810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-166a26f3-ce28-4652-8262-3dabd3fbf1e1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] [instance: 1260ec05-fff7-40c2-a069-43c9b36db3ca] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:44.299031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-166a26f3-ce28-4652-8262-3dabd3fbf1e1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:44.299501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-166a26f3-ce28-4652-8262-3dabd3fbf1e1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:44.300323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-166a26f3-ce28-4652-8262-3dabd3fbf1e1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:44.314331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-166a26f3-ce28-4652-8262-3dabd3fbf1e1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:44.329782 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-166a26f3-ce28-4652-8262-3dabd3fbf1e1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] HTTP exception thrown: Instance 1260ec05-fff7-40c2-a069-43c9b36db3ca could not be found. Jan 22 21:06:44.330668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-166a26f3-ce28-4652-8262-3dabd3fbf1e1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] Returning 404 to user: Instance 1260ec05-fff7-40c2-a069-43c9b36db3ca could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:06:44.331754 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-166a26f3-ce28-4652-8262-3dabd3fbf1e1 tempest-ServerShowV247Test-2088368762 tempest-ServerShowV247Test-2088368762-project] 10.222.0.100 "GET /compute/v2.1/servers/1260ec05-fff7-40c2-a069-43c9b36db3ca" status: 404 len: 111 microversion: 2.47 time: 0.051998 Jan 22 21:06:44.337244 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1096/2274] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:44 2022] GET /compute/v2.1/servers/1260ec05-fff7-40c2-a069-43c9b36db3ca => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:06:44.346118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-88c7ff75-9121-4c33-955e-773b17bc1e99 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1edae7fb80>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:44.373059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4b1ca29c-f70e-422e-8488-c91334a70bdf tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:44.386745 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4b1ca29c-f70e-422e-8488-c91334a70bdf tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.632357 Jan 22 21:06:44.401340 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1179/2275] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:43 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:44.412209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c20c1a89-8645-4121-a0f1-a7a886a15cac tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:44.416539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c20c1a89-8645-4121-a0f1-a7a886a15cac tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:44.432194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c20c1a89-8645-4121-a0f1-a7a886a15cac tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:44.432849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c20c1a89-8645-4121-a0f1-a7a886a15cac tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:44.433368 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-88c7ff75-9121-4c33-955e-773b17bc1e99 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.094755 Jan 22 21:06:44.434305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c20c1a89-8645-4121-a0f1-a7a886a15cac tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:44.434923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c20c1a89-8645-4121-a0f1-a7a886a15cac tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:44.439957 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1097/2276] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:44 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:44.445269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-74ee2ac6-d95f-4c1d-ac09-026713ef8322 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:44.457801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-74ee2ac6-d95f-4c1d-ac09-026713ef8322 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:44.465086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74ee2ac6-d95f-4c1d-ac09-026713ef8322 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:44.466531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74ee2ac6-d95f-4c1d-ac09-026713ef8322 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:44.472931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74ee2ac6-d95f-4c1d-ac09-026713ef8322 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:44.472931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74ee2ac6-d95f-4c1d-ac09-026713ef8322 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:44.532002 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c20c1a89-8645-4121-a0f1-a7a886a15cac tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.132179 Jan 22 21:06:44.533291 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1180/2277] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:44 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:44.623718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-21725a84-989d-46b2-b3a2-aec3795562a6 req-2aee1554-5ff3-44b6-950d-d9472e76af69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f587acdb-c6e0-43da-a1ba-1c2a7b9a404a", "tag": "9fbef146-4fab-423d-88a7-60a1b3993b9c"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:44.626114 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:44.626114 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:06:44.642925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-21725a84-989d-46b2-b3a2-aec3795562a6 req-2aee1554-5ff3-44b6-950d-d9472e76af69 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:44.663757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-21725a84-989d-46b2-b3a2-aec3795562a6 req-2aee1554-5ff3-44b6-950d-d9472e76af69 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:44.700082 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-21725a84-989d-46b2-b3a2-aec3795562a6 req-2aee1554-5ff3-44b6-950d-d9472e76af69 service nova] Creating event network-changed:9fbef146-4fab-423d-88a7-60a1b3993b9c for instance f587acdb-c6e0-43da-a1ba-1c2a7b9a404a on nch1-master-1 Jan 22 21:06:44.736249 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-21725a84-989d-46b2-b3a2-aec3795562a6 req-2aee1554-5ff3-44b6-950d-d9472e76af69 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115560 Jan 22 21:06:44.737604 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1181/2278] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:06:45.049418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-74ee2ac6-d95f-4c1d-ac09-026713ef8322 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:45.063879 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-74ee2ac6-d95f-4c1d-ac09-026713ef8322 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1323 microversion: 2.1 time: 0.619574 Jan 22 21:06:45.080739 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1098/2279] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:44 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1323 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:45.306210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3384246f-52af-48d9-bd7f-2142bc920c1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:45.307338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3384246f-52af-48d9-bd7f-2142bc920c1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:45.340631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3384246f-52af-48d9-bd7f-2142bc920c1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:45.344693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3384246f-52af-48d9-bd7f-2142bc920c1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:45.346382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3384246f-52af-48d9-bd7f-2142bc920c1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:45.348866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3384246f-52af-48d9-bd7f-2142bc920c1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:45.403864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d20cad3d-3608-4074-a7f6-c06b4d1500f1 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:45.404479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d20cad3d-3608-4074-a7f6-c06b4d1500f1 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:45.413919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d20cad3d-3608-4074-a7f6-c06b4d1500f1 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:45.418142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d20cad3d-3608-4074-a7f6-c06b4d1500f1 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:45.421475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d20cad3d-3608-4074-a7f6-c06b4d1500f1 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:45.422954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d20cad3d-3608-4074-a7f6-c06b4d1500f1 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:46.023602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3384246f-52af-48d9-bd7f-2142bc920c1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:46.041235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3384246f-52af-48d9-bd7f-2142bc920c1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:46.044168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3384246f-52af-48d9-bd7f-2142bc920c1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:46.051345 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3384246f-52af-48d9-bd7f-2142bc920c1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.749834 Jan 22 21:06:46.055992 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1182/2280] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:45 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:46.065890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-71aff3e0-e646-4c8b-988c-33e8662e7ee8 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5cc4dc0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:46.110447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d20cad3d-3608-4074-a7f6-c06b4d1500f1 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:46.120208 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d20cad3d-3608-4074-a7f6-c06b4d1500f1 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.719922 Jan 22 21:06:46.125954 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1099/2281] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:45 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:46.145004 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-71aff3e0-e646-4c8b-988c-33e8662e7ee8 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.087126 Jan 22 21:06:46.145986 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1183/2282] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:46 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:46.150356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4587f0a5-f740-43af-84a5-d45319b7908b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:46.151760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4587f0a5-f740-43af-84a5-d45319b7908b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:46.157681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-12f0cfd2-365d-4728-9a07-09bc77932e0e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:46.158692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-12f0cfd2-365d-4728-9a07-09bc77932e0e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:46.164887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4587f0a5-f740-43af-84a5-d45319b7908b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:46.167081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4587f0a5-f740-43af-84a5-d45319b7908b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:46.168699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4587f0a5-f740-43af-84a5-d45319b7908b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:46.172062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4587f0a5-f740-43af-84a5-d45319b7908b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:46.176729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12f0cfd2-365d-4728-9a07-09bc77932e0e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:46.180752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12f0cfd2-365d-4728-9a07-09bc77932e0e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:46.181884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12f0cfd2-365d-4728-9a07-09bc77932e0e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:46.183382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12f0cfd2-365d-4728-9a07-09bc77932e0e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:46.244403 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4587f0a5-f740-43af-84a5-d45319b7908b tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.115829 Jan 22 21:06:46.246177 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1100/2283] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:46 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:46.872123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-36727559-db8f-49ed-a620-6eb9488aee98 req-e66cb838-f3f7-4130-aff2-0c45f5802177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "tag": "751bac06-ae8b-43dc-bb1e-57283b8cf014"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:46.872123 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:46.872123 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:06:46.873198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-12f0cfd2-365d-4728-9a07-09bc77932e0e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:46.874159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-36727559-db8f-49ed-a620-6eb9488aee98 req-e66cb838-f3f7-4130-aff2-0c45f5802177 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:46.874159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-36727559-db8f-49ed-a620-6eb9488aee98 req-e66cb838-f3f7-4130-aff2-0c45f5802177 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:46.874454 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-12f0cfd2-365d-4728-9a07-09bc77932e0e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1323 microversion: 2.1 time: 0.665331 Jan 22 21:06:46.874454 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1184/2284] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:46 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1323 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:46.874701 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-36727559-db8f-49ed-a620-6eb9488aee98 req-e66cb838-f3f7-4130-aff2-0c45f5802177 service nova] Creating event network-changed:751bac06-ae8b-43dc-bb1e-57283b8cf014 for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:06:46.874701 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-36727559-db8f-49ed-a620-6eb9488aee98 req-e66cb838-f3f7-4130-aff2-0c45f5802177 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051049 Jan 22 21:06:46.874701 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1101/2285] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:06:47.071089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1a9cb109-7a65-459d-9a85-4f21785851ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:47.071757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1a9cb109-7a65-459d-9a85-4f21785851ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:47.078894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a9cb109-7a65-459d-9a85-4f21785851ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:47.079758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a9cb109-7a65-459d-9a85-4f21785851ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:47.080918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a9cb109-7a65-459d-9a85-4f21785851ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:47.081677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a9cb109-7a65-459d-9a85-4f21785851ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:47.141263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1e3b800e-5e7d-4f0f-bf25-c5c3df561551 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:47.143435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1e3b800e-5e7d-4f0f-bf25-c5c3df561551 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:47.166777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e3b800e-5e7d-4f0f-bf25-c5c3df561551 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:47.170264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e3b800e-5e7d-4f0f-bf25-c5c3df561551 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:47.171547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e3b800e-5e7d-4f0f-bf25-c5c3df561551 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:47.175634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e3b800e-5e7d-4f0f-bf25-c5c3df561551 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:47.735139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1a9cb109-7a65-459d-9a85-4f21785851ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:47.750378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1a9cb109-7a65-459d-9a85-4f21785851ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:47.754791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1a9cb109-7a65-459d-9a85-4f21785851ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:47.757117 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1a9cb109-7a65-459d-9a85-4f21785851ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.689967 Jan 22 21:06:47.758888 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1185/2286] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:47 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:47.765885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5480ea78-ea2a-4e0b-9947-0e6159b1480e tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5cc4f70>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:47.837123 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5480ea78-ea2a-4e0b-9947-0e6159b1480e tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1429 microversion: 2.1 time: 0.076799 Jan 22 21:06:47.843131 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1186/2287] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:47 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1429 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:47.901281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9c68cd7c-85d7-4bfe-a49b-a9f3aa63bf21 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:47.902299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9c68cd7c-85d7-4bfe-a49b-a9f3aa63bf21 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:47.934910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c68cd7c-85d7-4bfe-a49b-a9f3aa63bf21 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:47.936650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c68cd7c-85d7-4bfe-a49b-a9f3aa63bf21 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:47.938110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c68cd7c-85d7-4bfe-a49b-a9f3aa63bf21 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:47.939715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c68cd7c-85d7-4bfe-a49b-a9f3aa63bf21 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:48.005053 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9c68cd7c-85d7-4bfe-a49b-a9f3aa63bf21 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.165326 Jan 22 21:06:48.005223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1e3b800e-5e7d-4f0f-bf25-c5c3df561551 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:48.005782 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1187/2288] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:47 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:48.016021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3651ae63-cc75-4f6c-98a9-2d3d22b0638b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:48.017800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3651ae63-cc75-4f6c-98a9-2d3d22b0638b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:48.033282 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1e3b800e-5e7d-4f0f-bf25-c5c3df561551 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.896763 Jan 22 21:06:48.033774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3651ae63-cc75-4f6c-98a9-2d3d22b0638b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:48.034652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3651ae63-cc75-4f6c-98a9-2d3d22b0638b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:48.035876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3651ae63-cc75-4f6c-98a9-2d3d22b0638b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:48.036361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3651ae63-cc75-4f6c-98a9-2d3d22b0638b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:48.039302 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1102/2289] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:47 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:06:48.190694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3651ae63-cc75-4f6c-98a9-2d3d22b0638b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:48.198671 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3651ae63-cc75-4f6c-98a9-2d3d22b0638b tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1323 microversion: 2.1 time: 0.190253 Jan 22 21:06:48.199511 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1188/2290] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:48 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1323 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:48.777213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e777789c-e7bb-4d1b-9930-fb85c11a5221 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:48.784955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e777789c-e7bb-4d1b-9930-fb85c11a5221 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:48.786677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e777789c-e7bb-4d1b-9930-fb85c11a5221 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:48.787143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e777789c-e7bb-4d1b-9930-fb85c11a5221 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:48.788633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e777789c-e7bb-4d1b-9930-fb85c11a5221 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:48.789240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e777789c-e7bb-4d1b-9930-fb85c11a5221 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:48.851856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-91d68974-7636-48b2-9054-f0271a0ab661 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5d4f040>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:48.902444 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-91d68974-7636-48b2-9054-f0271a0ab661 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1438 microversion: 2.1 time: 0.055801 Jan 22 21:06:48.903522 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1189/2291] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:48 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1438 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:48.914199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-275558d1-8132-463b-b96f-0fe94d80af1b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5be6430>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:48.966329 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-275558d1-8132-463b-b96f-0fe94d80af1b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 200 len: 1438 microversion: 2.1 time: 0.055701 Jan 22 21:06:48.967262 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1190/2292] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:48 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 1438 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:06:48.968382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-275558d1-8132-463b-b96f-0fe94d80af1b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:48.969300 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-275558d1-8132-463b-b96f-0fe94d80af1b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute//" status: 200 len: 379 microversion: - time: 0.001112 Jan 22 21:06:48.969903 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1191/2293] 10.222.0.100 () {56 vars in 890 bytes} [Sat Jan 22 21:06:48 2022] GET /compute/ => generated 379 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jan 22 21:06:48.981015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-525c49be-13e6-4d8a-85f1-e57ff7852225 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:48.981984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-525c49be-13e6-4d8a-85f1-e57ff7852225 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:49.006096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-525c49be-13e6-4d8a-85f1-e57ff7852225 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:49.006680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-525c49be-13e6-4d8a-85f1-e57ff7852225 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:49.008091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-525c49be-13e6-4d8a-85f1-e57ff7852225 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:49.010132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-525c49be-13e6-4d8a-85f1-e57ff7852225 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:49.138279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e777789c-e7bb-4d1b-9930-fb85c11a5221 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:49.156533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e777789c-e7bb-4d1b-9930-fb85c11a5221 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:49.158240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e777789c-e7bb-4d1b-9930-fb85c11a5221 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:49.159437 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e777789c-e7bb-4d1b-9930-fb85c11a5221 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.387157 Jan 22 21:06:49.161271 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1103/2294] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:48 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:49.166023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3952b842-da87-448e-8d6b-7ed2798551e8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:49.167167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3952b842-da87-448e-8d6b-7ed2798551e8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:49.174765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3952b842-da87-448e-8d6b-7ed2798551e8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:49.175425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3952b842-da87-448e-8d6b-7ed2798551e8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:49.176418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3952b842-da87-448e-8d6b-7ed2798551e8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:49.177022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3952b842-da87-448e-8d6b-7ed2798551e8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:49.208006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-525c49be-13e6-4d8a-85f1-e57ff7852225 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:49.216272 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-525c49be-13e6-4d8a-85f1-e57ff7852225 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1470 microversion: 2.1 time: 0.241230 Jan 22 21:06:49.217474 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1192/2295] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:48 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1470 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:49.221892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-da056299-7a8c-43f2-98ee-68d7710263a2 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:49.222493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-da056299-7a8c-43f2-98ee-68d7710263a2 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:49.229077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da056299-7a8c-43f2-98ee-68d7710263a2 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:49.229835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da056299-7a8c-43f2-98ee-68d7710263a2 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:49.230636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da056299-7a8c-43f2-98ee-68d7710263a2 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:49.231079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da056299-7a8c-43f2-98ee-68d7710263a2 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:49.242796 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3952b842-da87-448e-8d6b-7ed2798551e8 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.081147 Jan 22 21:06:49.243703 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1104/2296] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:49 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:49.249032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cd3e62b1-da7c-4b0b-8941-b84e3c2aca04 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:49.250027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cd3e62b1-da7c-4b0b-8941-b84e3c2aca04 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:49.258088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd3e62b1-da7c-4b0b-8941-b84e3c2aca04 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:49.259590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd3e62b1-da7c-4b0b-8941-b84e3c2aca04 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:49.260681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd3e62b1-da7c-4b0b-8941-b84e3c2aca04 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:49.261744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd3e62b1-da7c-4b0b-8941-b84e3c2aca04 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:49.425193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-da056299-7a8c-43f2-98ee-68d7710263a2 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:49.438591 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-da056299-7a8c-43f2-98ee-68d7710263a2 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1528 microversion: 2.1 time: 0.219921 Jan 22 21:06:49.446493 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1193/2297] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:49 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1528 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:49.451858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-02c6333a-45c4-4ef8-9db0-dd1eeb3411cc tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5dcd1f0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:49.502808 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-02c6333a-45c4-4ef8-9db0-dd1eeb3411cc tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/373cb480-3bc4-4821-93e2-442b4e852b80" status: 200 len: 787 microversion: 2.1 time: 0.054811 Jan 22 21:06:49.504293 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1194/2298] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:49 2022] GET /compute/v2.1/images/373cb480-3bc4-4821-93e2-442b4e852b80 => generated 787 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:49.515197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3d819020-eed2-4abf-84ee-14003281e139 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:49.524458 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3d819020-eed2-4abf-84ee-14003281e139 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.012974 Jan 22 21:06:49.525684 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1195/2299] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:06:49 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:49.535922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6d99f4d5-f515-421a-8deb-edd42244d062 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5d4faf0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:49.557083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cd3e62b1-da7c-4b0b-8941-b84e3c2aca04 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:49.570130 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cd3e62b1-da7c-4b0b-8941-b84e3c2aca04 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1323 microversion: 2.1 time: 0.323019 Jan 22 21:06:49.570952 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1105/2300] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:49 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1323 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:50.181379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1d6f587b-f837-4897-a666-710e50488154 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:50.181977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1d6f587b-f837-4897-a666-710e50488154 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:50.192610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d6f587b-f837-4897-a666-710e50488154 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:50.193069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d6f587b-f837-4897-a666-710e50488154 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:50.194049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d6f587b-f837-4897-a666-710e50488154 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:50.194381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d6f587b-f837-4897-a666-710e50488154 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:50.526347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1d6f587b-f837-4897-a666-710e50488154 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:50.536482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1d6f587b-f837-4897-a666-710e50488154 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:50.538629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1d6f587b-f837-4897-a666-710e50488154 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:50.539815 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1d6f587b-f837-4897-a666-710e50488154 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.365094 Jan 22 21:06:50.540489 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1106/2301] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:50 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:50.544852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1504f0c5-f64d-4139-b234-facd139d981c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:50.545850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1504f0c5-f64d-4139-b234-facd139d981c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:50.552458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1504f0c5-f64d-4139-b234-facd139d981c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:50.556395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1504f0c5-f64d-4139-b234-facd139d981c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:50.556395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1504f0c5-f64d-4139-b234-facd139d981c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:50.556395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1504f0c5-f64d-4139-b234-facd139d981c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:50.606228 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1504f0c5-f64d-4139-b234-facd139d981c tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.064487 Jan 22 21:06:50.608154 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1107/2302] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:50 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:50.617936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3874ac98-49fc-47d0-912a-beed9d62d5fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:50.619256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3874ac98-49fc-47d0-912a-beed9d62d5fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:50.628295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3874ac98-49fc-47d0-912a-beed9d62d5fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:50.631101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3874ac98-49fc-47d0-912a-beed9d62d5fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:50.631101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3874ac98-49fc-47d0-912a-beed9d62d5fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:50.631101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3874ac98-49fc-47d0-912a-beed9d62d5fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:50.952716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3874ac98-49fc-47d0-912a-beed9d62d5fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:50.970050 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3874ac98-49fc-47d0-912a-beed9d62d5fd tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1508 microversion: 2.1 time: 0.357851 Jan 22 21:06:50.971110 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1108/2303] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:50 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1508 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:50.990536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e2f50cd0-5b95-40ef-8179-b533f59605c8 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:50.991340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e2f50cd0-5b95-40ef-8179-b533f59605c8 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:50.997538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2f50cd0-5b95-40ef-8179-b533f59605c8 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:51.002465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2f50cd0-5b95-40ef-8179-b533f59605c8 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:51.002465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2f50cd0-5b95-40ef-8179-b533f59605c8 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:51.002465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2f50cd0-5b95-40ef-8179-b533f59605c8 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:51.284630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e2f50cd0-5b95-40ef-8179-b533f59605c8 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:51.292952 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e2f50cd0-5b95-40ef-8179-b533f59605c8 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1323 microversion: 2.1 time: 0.320417 Jan 22 21:06:51.293547 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1109/2304] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:50 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:51.298357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-02103fdb-704f-41c1-a501-3d27e3fba4ee tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Action: 'create', calling method: .version_select at 0x7f1ed552dca0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1799702392", "description": "tempest-description-1079462671"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:51.401695 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6d99f4d5-f515-421a-8deb-edd42244d062 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "DELETE /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 204 len: 0 microversion: 2.1 time: 1.866467 Jan 22 21:06:51.401695 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1196/2305] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:49 2022] DELETE /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 0 bytes in 1868 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:06:51.406995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6080bad6-1aca-482d-8b25-ac0563e842b8 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed61df280>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:51.432084 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-6080bad6-1aca-482d-8b25-ac0563e842b8 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] HTTP exception thrown: Image not found. Jan 22 21:06:51.433005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6080bad6-1aca-482d-8b25-ac0563e842b8 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Returning 404 to user: Image not found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:06:51.434095 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6080bad6-1aca-482d-8b25-ac0563e842b8 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 404 len: 62 microversion: 2.1 time: 0.030619 Jan 22 21:06:51.434742 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1197/2306] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:51 2022] GET /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:06:51.447679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d96b6e21-85c0-4ea6-ab3f-9861ef68c5e7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1055558307"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:51.448888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d96b6e21-85c0-4ea6-ab3f-9861ef68c5e7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:51.456710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96b6e21-85c0-4ea6-ab3f-9861ef68c5e7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:51.457419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96b6e21-85c0-4ea6-ab3f-9861ef68c5e7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:51.458487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96b6e21-85c0-4ea6-ab3f-9861ef68c5e7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:51.458913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96b6e21-85c0-4ea6-ab3f-9861ef68c5e7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:51.728602 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-02103fdb-704f-41c1-a501-3d27e3fba4ee tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.432961 Jan 22 21:06:51.730386 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1110/2307] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:06:51 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:51.736759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-80f00c44-f44f-4a0f-b867-0ec44b4ce49e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:51.737868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-80f00c44-f44f-4a0f-b867-0ec44b4ce49e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:51.746782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80f00c44-f44f-4a0f-b867-0ec44b4ce49e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:51.747575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80f00c44-f44f-4a0f-b867-0ec44b4ce49e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:51.748704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80f00c44-f44f-4a0f-b867-0ec44b4ce49e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:51.749408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80f00c44-f44f-4a0f-b867-0ec44b4ce49e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:52.010371 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d96b6e21-85c0-4ea6-ab3f-9861ef68c5e7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "POST /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55/action" status: 202 len: 0 microversion: 2.1 time: 0.566145 Jan 22 21:06:52.011063 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1198/2308] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:51 2022] POST /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 22 21:06:52.023192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c33799f7-a936-4833-bcc5-574626fe9a8e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:52.026446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c33799f7-a936-4833-bcc5-574626fe9a8e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:52.034673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c33799f7-a936-4833-bcc5-574626fe9a8e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:52.042813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c33799f7-a936-4833-bcc5-574626fe9a8e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:52.042813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c33799f7-a936-4833-bcc5-574626fe9a8e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:52.042813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c33799f7-a936-4833-bcc5-574626fe9a8e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:52.056847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-80f00c44-f44f-4a0f-b867-0ec44b4ce49e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:52.072115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-80f00c44-f44f-4a0f-b867-0ec44b4ce49e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:52.074122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-80f00c44-f44f-4a0f-b867-0ec44b4ce49e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:52.076052 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-80f00c44-f44f-4a0f-b867-0ec44b4ce49e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.343673 Jan 22 21:06:52.077594 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1111/2309] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:51 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:52.084201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0ab3b6da-2b20-4fb5-9aa2-295b29e1578b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1799702392"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:52.091346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0ab3b6da-2b20-4fb5-9aa2-295b29e1578b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:52.093534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ab3b6da-2b20-4fb5-9aa2-295b29e1578b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:52.094407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ab3b6da-2b20-4fb5-9aa2-295b29e1578b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:52.094750 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c33799f7-a936-4833-bcc5-574626fe9a8e tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 32663 microversion: 2.1 time: 0.076235 Jan 22 21:06:52.095582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ab3b6da-2b20-4fb5-9aa2-295b29e1578b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:52.096154 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1199/2310] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:52 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 32663 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:52.096936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ab3b6da-2b20-4fb5-9aa2-295b29e1578b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:52.301140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-78d682d8-3681-4826-9a49-bae15f2c747f tempest-ExtensionsTest-375822726 tempest-ExtensionsTest-375822726-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:52.302804 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-78d682d8-3681-4826-9a49-bae15f2c747f tempest-ExtensionsTest-375822726 tempest-ExtensionsTest-375822726-project] 10.222.0.100 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.201505 Jan 22 21:06:52.303878 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1200/2311] 10.222.0.100 () {58 vars in 1174 bytes} [Sat Jan 22 21:06:52 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:52.315968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c9d28daa-c30b-487a-b28d-6afeb0ec6623 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5d5b670>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:52.316141 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.network.security_group_api [None req-0ab3b6da-2b20-4fb5-9aa2-295b29e1578b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Adding security group 16b322eb-9651-4666-a7bd-f2fa68de9e32 to port 4be0f157-1389-4003-a0b7-e5ae09ef77f5 Jan 22 21:06:52.384049 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c9d28daa-c30b-487a-b28d-6afeb0ec6623 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 200 len: 1434 microversion: 2.1 time: 0.078130 Jan 22 21:06:52.385004 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1201/2312] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:52 2022] GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 1434 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:52.392486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-34981d97-ab83-4caa-933c-8e5db4a5daba tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:52.393307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-34981d97-ab83-4caa-933c-8e5db4a5daba tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:52.400655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34981d97-ab83-4caa-933c-8e5db4a5daba tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:52.408517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34981d97-ab83-4caa-933c-8e5db4a5daba tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:52.408517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34981d97-ab83-4caa-933c-8e5db4a5daba tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:52.408517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34981d97-ab83-4caa-933c-8e5db4a5daba tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:52.618424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-34981d97-ab83-4caa-933c-8e5db4a5daba tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:52.627558 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-34981d97-ab83-4caa-933c-8e5db4a5daba tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1323 microversion: 2.1 time: 0.241188 Jan 22 21:06:52.628661 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1202/2313] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:52 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1323 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:52.633874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-85314c07-f551-4e69-a92c-ae4b3bdc5172 tempest-ExtensionsTest-375822726 tempest-ExtensionsTest-375822726-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:52.636359 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-85314c07-f551-4e69-a92c-ae4b3bdc5172 tempest-ExtensionsTest-375822726 tempest-ExtensionsTest-375822726-project] 10.222.0.100 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006236 Jan 22 21:06:52.650671 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1203/2314] 10.222.0.100 () {58 vars in 1138 bytes} [Sat Jan 22 21:06:52 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:52.664214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-9b7241b2-7676-4abf-ad86-0f81bd2b9a5e req-5b5490b3-f1c1-41e5-860d-281a098fa03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f587acdb-c6e0-43da-a1ba-1c2a7b9a404a", "name": "network-vif-plugged", "status": "completed", "tag": "9fbef146-4fab-423d-88a7-60a1b3993b9c"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:52.666717 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:52.666717 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:06:52.674811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9b7241b2-7676-4abf-ad86-0f81bd2b9a5e req-5b5490b3-f1c1-41e5-860d-281a098fa03a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:52.675699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9b7241b2-7676-4abf-ad86-0f81bd2b9a5e req-5b5490b3-f1c1-41e5-860d-281a098fa03a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:52.692137 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-9b7241b2-7676-4abf-ad86-0f81bd2b9a5e req-5b5490b3-f1c1-41e5-860d-281a098fa03a service nova] Creating event network-vif-plugged:9fbef146-4fab-423d-88a7-60a1b3993b9c for instance f587acdb-c6e0-43da-a1ba-1c2a7b9a404a on nch1-master-1 Jan 22 21:06:52.700589 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-9b7241b2-7676-4abf-ad86-0f81bd2b9a5e req-5b5490b3-f1c1-41e5-860d-281a098fa03a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047365 Jan 22 21:06:52.701931 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1204/2315] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:53.046569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7af0a73b-bd43-4ff1-885b-ea9ac2a0f446 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Action: 'create', calling method: .version_select at 0x7f1ed5d5bc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1955514911", "description": "tempest-description-1906090"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:53.128904 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0ab3b6da-2b20-4fb5-9aa2-295b29e1578b tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "POST /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948/action" status: 202 len: 0 microversion: 2.1 time: 1.049894 Jan 22 21:06:53.129546 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1112/2316] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:52 2022] POST /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948/action => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:06:53.135267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d92a61fd-3758-4f9f-8533-7d7dcbfd5511 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:53.136126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d92a61fd-3758-4f9f-8533-7d7dcbfd5511 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:53.148463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d92a61fd-3758-4f9f-8533-7d7dcbfd5511 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:53.158951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d92a61fd-3758-4f9f-8533-7d7dcbfd5511 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:53.158951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d92a61fd-3758-4f9f-8533-7d7dcbfd5511 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:53.158951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d92a61fd-3758-4f9f-8533-7d7dcbfd5511 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:53.442620 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7af0a73b-bd43-4ff1-885b-ea9ac2a0f446 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.456796 Jan 22 21:06:53.449655 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1205/2317] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:06:52 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:53.449655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c5e425c4-e906-41c2-917a-20ebc6673116 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:53.449655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c5e425c4-e906-41c2-917a-20ebc6673116 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:53.456551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5e425c4-e906-41c2-917a-20ebc6673116 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:53.457066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5e425c4-e906-41c2-917a-20ebc6673116 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:53.457962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5e425c4-e906-41c2-917a-20ebc6673116 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:53.458589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5e425c4-e906-41c2-917a-20ebc6673116 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:53.478080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d92a61fd-3758-4f9f-8533-7d7dcbfd5511 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:53.487967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d92a61fd-3758-4f9f-8533-7d7dcbfd5511 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:53.489536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d92a61fd-3758-4f9f-8533-7d7dcbfd5511 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:53.491801 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d92a61fd-3758-4f9f-8533-7d7dcbfd5511 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.360167 Jan 22 21:06:53.493051 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1113/2318] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:53 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:53.497978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e7b2f84d-30a6-4d6a-9c09-19a53f292a77 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1799702392"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:53.498735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e7b2f84d-30a6-4d6a-9c09-19a53f292a77 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:53.504853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7b2f84d-30a6-4d6a-9c09-19a53f292a77 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:53.513088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7b2f84d-30a6-4d6a-9c09-19a53f292a77 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:53.513088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7b2f84d-30a6-4d6a-9c09-19a53f292a77 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:53.513088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7b2f84d-30a6-4d6a-9c09-19a53f292a77 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:53.544589 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c5e425c4-e906-41c2-917a-20ebc6673116 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action" status: 200 len: 40789 microversion: 2.1 time: 0.099988 Jan 22 21:06:53.546084 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1206/2319] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:53 2022] POST /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2/action => generated 40789 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:06:53.555439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-34044a33-08a8-4cd0-86a2-cb8b232ac464 req-787720b7-8f69-4b0c-961d-44aec85da20b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4446fe1f-c015-4a1d-800b-b2c6a7911948", "tag": "4be0f157-1389-4003-a0b7-e5ae09ef77f5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:53.559021 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:53.559021 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:06:53.565741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-34044a33-08a8-4cd0-86a2-cb8b232ac464 req-787720b7-8f69-4b0c-961d-44aec85da20b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:53.566472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-34044a33-08a8-4cd0-86a2-cb8b232ac464 req-787720b7-8f69-4b0c-961d-44aec85da20b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:53.582131 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-34044a33-08a8-4cd0-86a2-cb8b232ac464 req-787720b7-8f69-4b0c-961d-44aec85da20b service nova] Creating event network-changed:4be0f157-1389-4003-a0b7-e5ae09ef77f5 for instance 4446fe1f-c015-4a1d-800b-b2c6a7911948 on nch1-master-1 Jan 22 21:06:53.588971 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-34044a33-08a8-4cd0-86a2-cb8b232ac464 req-787720b7-8f69-4b0c-961d-44aec85da20b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041017 Jan 22 21:06:53.590580 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1207/2320] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:53.596338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-22450ab4-78da-4fcf-8011-234b5ffec2b0 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5d5b8b0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:53.668794 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-22450ab4-78da-4fcf-8011-234b5ffec2b0 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 200 len: 1434 microversion: 2.1 time: 0.076274 Jan 22 21:06:53.669820 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1208/2321] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:53 2022] GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 1434 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:53.717551 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.network.security_group_api [None req-e7b2f84d-30a6-4d6a-9c09-19a53f292a77 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Removing security group 16b322eb-9651-4666-a7bd-f2fa68de9e32 from port 4be0f157-1389-4003-a0b7-e5ae09ef77f5 Jan 22 21:06:53.817691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-205617585", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "3192e282-a407-4577-8d7e-8b97fdbe5219"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:53.883081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] validate_networks() for [('3192e282-a407-4577-8d7e-8b97fdbe5219', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:06:54.354055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:06:54.354804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:06:54.355520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:06:54.356454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:06:54.357466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:06:54.369265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:54.369763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:54.371382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:54.372110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:54.401545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Getting quotas for project c9345c8011494040a8d5815906e5cca1. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:06:54.408060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Getting quotas for user 79cfa58857994c588e2b554abad1689d and project c9345c8011494040a8d5815906e5cca1. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:06:54.432646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:06:54.435675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:06:54.556762 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-10988623-ed9f-4ca1-987d-e1ef9f026c6b tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.885114 Jan 22 21:06:54.558103 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1209/2322] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:06:53 2022] POST /compute/v2.1/servers => generated 382 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:06:54.563794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ce868b6f-9696-4ae0-b4e4-12c49af76eb0 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Action: 'create', calling method: .version_select at 0x7f1ed5cf01f0>, body: {"security_group_rule": {"parent_group_id": "f5062a40-8d7c-4f25-a357-646d6674e8e2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:54.715389 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e7b2f84d-30a6-4d6a-9c09-19a53f292a77 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "POST /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948/action" status: 202 len: 0 microversion: 2.1 time: 1.218099 Jan 22 21:06:54.720457 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1114/2323] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:53 2022] POST /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948/action => generated 0 bytes in 1223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:06:54.723726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4789d081-4252-44f6-8c4d-a56ccafe0ac5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:54.724644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4789d081-4252-44f6-8c4d-a56ccafe0ac5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:54.732289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4789d081-4252-44f6-8c4d-a56ccafe0ac5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:54.732904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4789d081-4252-44f6-8c4d-a56ccafe0ac5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:54.733847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4789d081-4252-44f6-8c4d-a56ccafe0ac5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:54.734701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4789d081-4252-44f6-8c4d-a56ccafe0ac5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:54.921457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4789d081-4252-44f6-8c4d-a56ccafe0ac5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:54.930037 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4789d081-4252-44f6-8c4d-a56ccafe0ac5 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1707 microversion: 2.1 time: 0.210540 Jan 22 21:06:54.935458 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1115/2324] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:54 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1707 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:54.940236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f5510433-c71c-4378-a61f-376b3130f265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:54.941060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f5510433-c71c-4378-a61f-376b3130f265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:54.949092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5510433-c71c-4378-a61f-376b3130f265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:54.954036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5510433-c71c-4378-a61f-376b3130f265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:54.954036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5510433-c71c-4378-a61f-376b3130f265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:54.954036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5510433-c71c-4378-a61f-376b3130f265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:55.058744 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ce868b6f-9696-4ae0-b4e4-12c49af76eb0 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.499222 Jan 22 21:06:55.060315 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1210/2325] 10.222.0.100 () {60 vars in 1199 bytes} [Sat Jan 22 21:06:54 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:55.064816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-31a70ccd-4f77-4e1d-8605-83037c02fc79 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:55.066230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-31a70ccd-4f77-4e1d-8605-83037c02fc79 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:55.075030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31a70ccd-4f77-4e1d-8605-83037c02fc79 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:55.079989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31a70ccd-4f77-4e1d-8605-83037c02fc79 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:55.081159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31a70ccd-4f77-4e1d-8605-83037c02fc79 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:55.081657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31a70ccd-4f77-4e1d-8605-83037c02fc79 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:55.132088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f5510433-c71c-4378-a61f-376b3130f265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:55.138684 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f5510433-c71c-4378-a61f-376b3130f265 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1473 microversion: 2.1 time: 0.201976 Jan 22 21:06:55.139563 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1116/2326] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:54 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1473 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:55.144248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-20d35bee-a7be-4ef7-b80b-bfa508d1cd9d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:55.145212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-20d35bee-a7be-4ef7-b80b-bfa508d1cd9d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:55.203400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-20d35bee-a7be-4ef7-b80b-bfa508d1cd9d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cfa58857994c588e2b554abad1689d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9345c8011494040a8d5815906e5cca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:55.211161 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-20d35bee-a7be-4ef7-b80b-bfa508d1cd9d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f" status: 200 len: 1228 microversion: 2.1 time: 0.070539 Jan 22 21:06:55.217639 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1117/2327] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:55 2022] GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f => generated 1228 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:55.217639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d3cbfa16-29c6-4f41-b6a4-13d608fb9344 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1edaeba9d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:55.268907 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d3cbfa16-29c6-4f41-b6a4-13d608fb9344 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 200 len: 1434 microversion: 2.1 time: 0.050185 Jan 22 21:06:55.268907 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1118/2328] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:55 2022] GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 1434 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:55.268907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8f04ded1-a779-4589-8bec-bd506b0bf6c4 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Action: 'create', calling method: .version_select at 0x7f1ed602ae50>, body: {"pool": null} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:55.314744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-31a70ccd-4f77-4e1d-8605-83037c02fc79 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:55.326492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-31a70ccd-4f77-4e1d-8605-83037c02fc79 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:55.328510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-31a70ccd-4f77-4e1d-8605-83037c02fc79 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:55.329920 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-31a70ccd-4f77-4e1d-8605-83037c02fc79 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.269162 Jan 22 21:06:55.342809 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1211/2329] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:55 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:55.348103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-e867c610-a512-4044-811f-bc3f91029475 req-8e3ffebd-0623-4b1b-b5ac-08eb18af1b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31384bb-6cc1-45a4-a067-92ac3713ef55", "name": "network-vif-unplugged", "status": "completed", "tag": "493297bc-3a80-4965-b414-e858560483fb"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:55.350777 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:55.350777 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:06:55.358483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e867c610-a512-4044-811f-bc3f91029475 req-8e3ffebd-0623-4b1b-b5ac-08eb18af1b51 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:55.359149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e867c610-a512-4044-811f-bc3f91029475 req-8e3ffebd-0623-4b1b-b5ac-08eb18af1b51 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:55.373986 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-e867c610-a512-4044-811f-bc3f91029475 req-8e3ffebd-0623-4b1b-b5ac-08eb18af1b51 service nova] Creating event network-vif-unplugged:493297bc-3a80-4965-b414-e858560483fb for instance b31384bb-6cc1-45a4-a067-92ac3713ef55 on nch1-master-1 Jan 22 21:06:55.380075 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-e867c610-a512-4044-811f-bc3f91029475 req-8e3ffebd-0623-4b1b-b5ac-08eb18af1b51 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035509 Jan 22 21:06:55.380668 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1212/2330] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:55.388715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fa312aef-467d-4cac-a920-128e00a3ba4b tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Action: 'create', calling method: .version_select at 0x7f1ed6177ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1707371059", "description": "tempest-description-1250230318"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:55.675574 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fa312aef-467d-4cac-a920-128e00a3ba4b tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.293247 Jan 22 21:06:55.676235 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1213/2331] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:06:55 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:55.681070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-407a73e5-047e-4aaa-9f12-617bfa3bff6e tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:55.681754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-407a73e5-047e-4aaa-9f12-617bfa3bff6e tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:55.689111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-407a73e5-047e-4aaa-9f12-617bfa3bff6e tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:55.689605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-407a73e5-047e-4aaa-9f12-617bfa3bff6e tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:55.690415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-407a73e5-047e-4aaa-9f12-617bfa3bff6e tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:55.690864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-407a73e5-047e-4aaa-9f12-617bfa3bff6e tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:55.715222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-407a73e5-047e-4aaa-9f12-617bfa3bff6e tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lazy-loading 'flavor' on Instance uuid f587acdb-c6e0-43da-a1ba-1c2a7b9a404a {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:06:56.024142 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-407a73e5-047e-4aaa-9f12-617bfa3bff6e tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a/action" status: 202 len: 0 microversion: 2.1 time: 0.346664 Jan 22 21:06:56.028122 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1214/2332] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:55 2022] POST /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:06:56.169327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c212028b-c37b-4679-a1ee-d508713d1ebf tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] Action: 'create', calling method: .version_select at 0x7f1ed5d608b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1574487392", "metadata": {"Type": "work"}}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:56.797492 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c212028b-c37b-4679-a1ee-d508713d1ebf tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 0.771011 Jan 22 21:06:56.799530 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1215/2333] 10.222.0.100 () {60 vars in 1160 bytes} [Sat Jan 22 21:06:56 2022] POST /compute/v2.1/os-volumes => generated 346 bytes in 773 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jan 22 21:06:56.808825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a4ae80d2-6dae-4e3c-8843-b37a7b9fd1c2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:56.809635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a4ae80d2-6dae-4e3c-8843-b37a7b9fd1c2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:56.819359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4ae80d2-6dae-4e3c-8843-b37a7b9fd1c2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:56.822842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4ae80d2-6dae-4e3c-8843-b37a7b9fd1c2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:56.822842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4ae80d2-6dae-4e3c-8843-b37a7b9fd1c2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:56.822842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4ae80d2-6dae-4e3c-8843-b37a7b9fd1c2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:56.834650 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8f04ded1-a779-4589-8bec-bd506b0bf6c4 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.569910 Jan 22 21:06:56.835381 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1119/2334] 10.222.0.100 () {60 vars in 1174 bytes} [Sat Jan 22 21:06:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:56.850252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-e0abad21-8985-4d9e-9e7e-ced195caa7f7 req-310b7617-c47e-4e94-8902-46b42949a60e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4446fe1f-c015-4a1d-800b-b2c6a7911948", "tag": "4be0f157-1389-4003-a0b7-e5ae09ef77f5"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:56.850510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a4ae80d2-6dae-4e3c-8843-b37a7b9fd1c2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:06:56.852283 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:56.852283 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:06:56.860848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e0abad21-8985-4d9e-9e7e-ced195caa7f7 req-310b7617-c47e-4e94-8902-46b42949a60e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:56.861443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e0abad21-8985-4d9e-9e7e-ced195caa7f7 req-310b7617-c47e-4e94-8902-46b42949a60e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:56.874067 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-e0abad21-8985-4d9e-9e7e-ced195caa7f7 req-310b7617-c47e-4e94-8902-46b42949a60e service nova] Creating event network-changed:4be0f157-1389-4003-a0b7-e5ae09ef77f5 for instance 4446fe1f-c015-4a1d-800b-b2c6a7911948 on nch1-master-1 Jan 22 21:06:56.879661 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-e0abad21-8985-4d9e-9e7e-ced195caa7f7 req-310b7617-c47e-4e94-8902-46b42949a60e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042776 Jan 22 21:06:56.881998 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1120/2335] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:56.888938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a1d1b3f1-1a78-494f-bd69-20f05efc00c2 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Action: 'create', calling method: .version_select at 0x7f1ed5ed84c0>, body: {"security_group_rule": {"parent_group_id": "adb46df7-01d5-4b71-9d48-1cf1c70792ae", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:57.290654 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a4ae80d2-6dae-4e3c-8843-b37a7b9fd1c2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 204 len: 0 microversion: 2.1 time: 0.490598 Jan 22 21:06:57.291685 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1216/2336] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:06:56 2022] DELETE /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:06:57.297327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-56f537f2-acde-450a-89ce-b257d98a19b7 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:57.298074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-56f537f2-acde-450a-89ce-b257d98a19b7 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:57.320015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56f537f2-acde-450a-89ce-b257d98a19b7 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:57.323772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56f537f2-acde-450a-89ce-b257d98a19b7 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:57.323772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56f537f2-acde-450a-89ce-b257d98a19b7 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:57.323772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56f537f2-acde-450a-89ce-b257d98a19b7 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:57.496152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-56f537f2-acde-450a-89ce-b257d98a19b7 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:57.504621 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-56f537f2-acde-450a-89ce-b257d98a19b7 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1464 microversion: 2.1 time: 0.211648 Jan 22 21:06:57.516447 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1217/2337] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:57 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1464 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:57.532607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-219adc68-ba3a-4e6a-b397-1281c869b872 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:57.532607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-219adc68-ba3a-4e6a-b397-1281c869b872 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:57.554755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-219adc68-ba3a-4e6a-b397-1281c869b872 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:57.556523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-219adc68-ba3a-4e6a-b397-1281c869b872 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:57.558140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-219adc68-ba3a-4e6a-b397-1281c869b872 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:57.562216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-219adc68-ba3a-4e6a-b397-1281c869b872 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:57.650897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-219adc68-ba3a-4e6a-b397-1281c869b872 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cfa58857994c588e2b554abad1689d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9345c8011494040a8d5815906e5cca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:57.660602 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-219adc68-ba3a-4e6a-b397-1281c869b872 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f" status: 200 len: 1286 microversion: 2.1 time: 0.142238 Jan 22 21:06:57.661349 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1218/2338] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:57 2022] GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f => generated 1286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:57.666993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e70426da-2875-4d76-a980-4d8115f6035b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed63eb160>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:57.732107 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e70426da-2875-4d76-a980-4d8115f6035b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 200 len: 1434 microversion: 2.1 time: 0.069519 Jan 22 21:06:57.732689 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1219/2339] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:57 2022] GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 1434 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:57.737097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-931fd1e0-1afd-4a7e-97f9-f6b0166009c6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:57.737735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-931fd1e0-1afd-4a7e-97f9-f6b0166009c6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:57.744744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-931fd1e0-1afd-4a7e-97f9-f6b0166009c6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:57.745207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-931fd1e0-1afd-4a7e-97f9-f6b0166009c6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:57.746060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-931fd1e0-1afd-4a7e-97f9-f6b0166009c6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:57.746569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-931fd1e0-1afd-4a7e-97f9-f6b0166009c6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:57.838752 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a1d1b3f1-1a78-494f-bd69-20f05efc00c2 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.955068 Jan 22 21:06:57.840172 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1121/2340] 10.222.0.100 () {60 vars in 1199 bytes} [Sat Jan 22 21:06:56 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:57.845079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-130e7ed1-e68c-44e7-b621-81c46e30379a tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] Calling method '.version_select at 0x7f1ed551c0d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:57.978589 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-130e7ed1-e68c-44e7-b621-81c46e30379a tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/f01372a6-40b8-4270-ae61-0aae8cb983ce" status: 200 len: 346 microversion: 2.1 time: 0.137078 Jan 22 21:06:57.979459 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1122/2341] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:06:57 2022] GET /compute/v2.1/os-volumes/f01372a6-40b8-4270-ae61-0aae8cb983ce => generated 346 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:57.984466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-efa02cbe-9727-479a-ad87-a244363f33d0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.188"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:57.985708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-efa02cbe-9727-479a-ad87-a244363f33d0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:58.000888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efa02cbe-9727-479a-ad87-a244363f33d0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:58.001282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efa02cbe-9727-479a-ad87-a244363f33d0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:58.004314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efa02cbe-9727-479a-ad87-a244363f33d0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:58.004771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efa02cbe-9727-479a-ad87-a244363f33d0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:58.034119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-931fd1e0-1afd-4a7e-97f9-f6b0166009c6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:58.047131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-931fd1e0-1afd-4a7e-97f9-f6b0166009c6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:58.048900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-931fd1e0-1afd-4a7e-97f9-f6b0166009c6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:58.050168 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-931fd1e0-1afd-4a7e-97f9-f6b0166009c6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.316556 Jan 22 21:06:58.051480 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1220/2342] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:57 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:06:58.053717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efa02cbe-9727-479a-ad87-a244363f33d0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Acquired lock "refresh_cache-4446fe1f-c015-4a1d-800b-b2c6a7911948" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 22 21:06:58.056951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1773ee8b-3c49-45f1-9c92-ca7463406527 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:58.057874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1773ee8b-3c49-45f1-9c92-ca7463406527 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:58.067227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1773ee8b-3c49-45f1-9c92-ca7463406527 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:58.068058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1773ee8b-3c49-45f1-9c92-ca7463406527 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:58.070421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1773ee8b-3c49-45f1-9c92-ca7463406527 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:58.071867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1773ee8b-3c49-45f1-9c92-ca7463406527 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:58.269820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1773ee8b-3c49-45f1-9c92-ca7463406527 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:58.281271 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1773ee8b-3c49-45f1-9c92-ca7463406527 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1713 microversion: 2.1 time: 0.228499 Jan 22 21:06:58.282512 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1221/2343] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:58 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1713 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:58.287314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-edadd3e7-8499-4dba-bf58-71a27cf845c5 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:58.288152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-edadd3e7-8499-4dba-bf58-71a27cf845c5 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:58.295288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edadd3e7-8499-4dba-bf58-71a27cf845c5 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:58.299288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edadd3e7-8499-4dba-bf58-71a27cf845c5 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:58.299288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edadd3e7-8499-4dba-bf58-71a27cf845c5 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:58.299288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edadd3e7-8499-4dba-bf58-71a27cf845c5 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:58.707873 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-edadd3e7-8499-4dba-bf58-71a27cf845c5 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1615 microversion: 2.1 time: 0.424083 Jan 22 21:06:58.714641 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1222/2344] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:58 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1615 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:58.723182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8c8e4756-eaea-4e9c-a917-8b4112cebee3 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Action: 'create', calling method: .version_select at 0x7f1ed60485e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-685426460", "description": "tempest-description-1968243855"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:59.201236 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8c8e4756-eaea-4e9c-a917-8b4112cebee3 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.484572 Jan 22 21:06:59.205855 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1223/2345] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:06:58 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:59.218988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-02be0340-0dd3-463a-88bc-7e71a4eaf2bc req-261d206a-ac85-4593-9293-d86ecdff47fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31384bb-6cc1-45a4-a067-92ac3713ef55", "name": "network-vif-plugged", "status": "completed", "tag": "493297bc-3a80-4965-b414-e858560483fb"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:06:59.222067 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:59.222067 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:06:59.239337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-02be0340-0dd3-463a-88bc-7e71a4eaf2bc req-261d206a-ac85-4593-9293-d86ecdff47fb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:59.240171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-02be0340-0dd3-463a-88bc-7e71a4eaf2bc req-261d206a-ac85-4593-9293-d86ecdff47fb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:59.261349 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-02be0340-0dd3-463a-88bc-7e71a4eaf2bc req-261d206a-ac85-4593-9293-d86ecdff47fb service nova] Creating event network-vif-plugged:493297bc-3a80-4965-b414-e858560483fb for instance b31384bb-6cc1-45a4-a067-92ac3713ef55 on nch1-master-1 Jan 22 21:06:59.270623 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-02be0340-0dd3-463a-88bc-7e71a4eaf2bc req-261d206a-ac85-4593-9293-d86ecdff47fb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062002 Jan 22 21:06:59.273200 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1224/2346] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:59.280607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5c17d72a-ac9c-4205-bc22-af8227c3a299 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:59.281786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5c17d72a-ac9c-4205-bc22-af8227c3a299 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:59.300268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c17d72a-ac9c-4205-bc22-af8227c3a299 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:59.300872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c17d72a-ac9c-4205-bc22-af8227c3a299 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:59.301780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c17d72a-ac9c-4205-bc22-af8227c3a299 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:59.302533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c17d72a-ac9c-4205-bc22-af8227c3a299 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:59.516439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5c17d72a-ac9c-4205-bc22-af8227c3a299 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cfa58857994c588e2b554abad1689d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9345c8011494040a8d5815906e5cca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:06:59.527263 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5c17d72a-ac9c-4205-bc22-af8227c3a299 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f" status: 200 len: 1328 microversion: 2.1 time: 0.251873 Jan 22 21:06:59.528906 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1225/2347] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:06:59 2022] GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f => generated 1328 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:59.535099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c6c14963-ab8a-4ec3-912c-b2f47c706e08 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:59.536653 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:06:59.536653 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:06:59.546331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6c14963-ab8a-4ec3-912c-b2f47c706e08 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:59.547191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6c14963-ab8a-4ec3-912c-b2f47c706e08 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:59.549679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6c14963-ab8a-4ec3-912c-b2f47c706e08 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:59.550732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6c14963-ab8a-4ec3-912c-b2f47c706e08 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:59.591471 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c6c14963-ab8a-4ec3-912c-b2f47c706e08 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.061250 Jan 22 21:06:59.592340 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1226/2348] 10.222.0.100 () {58 vars in 1180 bytes} [Sat Jan 22 21:06:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:59.607274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0fd494c6-2160-479c-a030-8074bc799fa7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed61608b0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:59.681026 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0fd494c6-2160-479c-a030-8074bc799fa7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 200 len: 1434 microversion: 2.1 time: 0.087307 Jan 22 21:06:59.682323 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1227/2349] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:06:59 2022] GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 1434 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:06:59.693143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-935b4c0e-02cd-40d9-b9b0-a7ed45109081 tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] Calling method '.version_select at 0x7f1ed5d4f040>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:59.774367 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-935b4c0e-02cd-40d9-b9b0-a7ed45109081 tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/f01372a6-40b8-4270-ae61-0aae8cb983ce" status: 200 len: 347 microversion: 2.1 time: 0.089557 Jan 22 21:06:59.774367 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1228/2350] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:06:59 2022] GET /compute/v2.1/os-volumes/f01372a6-40b8-4270-ae61-0aae8cb983ce => generated 347 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:06:59.778807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5529e115-82b5-4ebc-b1d5-98db63227cc5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:06:59.779523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5529e115-82b5-4ebc-b1d5-98db63227cc5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:06:59.798824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5529e115-82b5-4ebc-b1d5-98db63227cc5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:59.798824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5529e115-82b5-4ebc-b1d5-98db63227cc5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:06:59.799213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5529e115-82b5-4ebc-b1d5-98db63227cc5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:06:59.799597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5529e115-82b5-4ebc-b1d5-98db63227cc5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:00.480428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5529e115-82b5-4ebc-b1d5-98db63227cc5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:00.497628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5529e115-82b5-4ebc-b1d5-98db63227cc5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:00.499715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5529e115-82b5-4ebc-b1d5-98db63227cc5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:00.501192 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5529e115-82b5-4ebc-b1d5-98db63227cc5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.725853 Jan 22 21:07:00.502329 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1229/2351] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:06:59 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:00.508270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b4220da8-74a8-4d6e-9c8e-3150d847c64b tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Action: 'create', calling method: .version_select at 0x7f1ed5cc4670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1889587110", "description": "tempest-description-713979557"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:00.920675 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b4220da8-74a8-4d6e-9c8e-3150d847c64b tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.416889 Jan 22 21:07:00.929697 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1230/2352] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:07:00 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:00.936603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-85bf0475-9518-42bb-ac00-067fe6ad6b45 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:00.937747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-85bf0475-9518-42bb-ac00-067fe6ad6b45 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:00.947032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85bf0475-9518-42bb-ac00-067fe6ad6b45 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:00.947764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85bf0475-9518-42bb-ac00-067fe6ad6b45 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:00.949141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85bf0475-9518-42bb-ac00-067fe6ad6b45 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:00.949849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85bf0475-9518-42bb-ac00-067fe6ad6b45 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:01.130741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-85bf0475-9518-42bb-ac00-067fe6ad6b45 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:01.145594 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-85bf0475-9518-42bb-ac00-067fe6ad6b45 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1713 microversion: 2.1 time: 0.214457 Jan 22 21:07:01.146184 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1231/2353] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:00 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1713 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:01.152005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-43af2e91-4266-4b2c-adad-fab793973fc3 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:01.153753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-43af2e91-4266-4b2c-adad-fab793973fc3 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:01.160691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43af2e91-4266-4b2c-adad-fab793973fc3 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:01.167281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43af2e91-4266-4b2c-adad-fab793973fc3 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:01.167281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43af2e91-4266-4b2c-adad-fab793973fc3 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:01.167281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43af2e91-4266-4b2c-adad-fab793973fc3 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:01.196424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-43af2e91-4266-4b2c-adad-fab793973fc3 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Lazy-loading 'flavor' on Instance uuid f587acdb-c6e0-43da-a1ba-1c2a7b9a404a {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:07:01.211647 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-43af2e91-4266-4b2c-adad-fab793973fc3 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance f587acdb-c6e0-43da-a1ba-1c2a7b9a404a while it is in vm_state suspended Jan 22 21:07:01.212691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-43af2e91-4266-4b2c-adad-fab793973fc3 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance f587acdb-c6e0-43da-a1ba-1c2a7b9a404a while it is in vm_state suspended {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:01.213556 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-43af2e91-4266-4b2c-adad-fab793973fc3 tempest-LiveMigrationNegativeTest-130689575 tempest-LiveMigrationNegativeTest-130689575-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a/action" status: 409 len: 155 microversion: 2.1 time: 0.064889 Jan 22 21:07:01.214425 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1232/2354] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:07:01 2022] POST /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a/action => generated 155 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:07:01.220283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1db5eae5-b20e-4c91-a72d-3889c2264a52 tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] Calling method '.version_select at 0x7f1ed5d9c3a0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:01.273224 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1db5eae5-b20e-4c91-a72d-3889c2264a52 tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/f01372a6-40b8-4270-ae61-0aae8cb983ce" status: 200 len: 347 microversion: 2.1 time: 0.055503 Jan 22 21:07:01.273224 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1233/2355] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:07:01 2022] GET /compute/v2.1/os-volumes/f01372a6-40b8-4270-ae61-0aae8cb983ce => generated 347 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:01.278861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-92d83e7d-75f0-4bec-a95e-298d499beb16 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:01.279403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-92d83e7d-75f0-4bec-a95e-298d499beb16 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:01.288503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92d83e7d-75f0-4bec-a95e-298d499beb16 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:01.289073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92d83e7d-75f0-4bec-a95e-298d499beb16 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:01.289954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92d83e7d-75f0-4bec-a95e-298d499beb16 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:01.290407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92d83e7d-75f0-4bec-a95e-298d499beb16 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:01.417068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-efa02cbe-9727-479a-ad87-a244363f33d0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Building network info cache for instance {{(pid=137033) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 22 21:07:01.507850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-92d83e7d-75f0-4bec-a95e-298d499beb16 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cfa58857994c588e2b554abad1689d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9345c8011494040a8d5815906e5cca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:01.522775 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-92d83e7d-75f0-4bec-a95e-298d499beb16 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f" status: 200 len: 1328 microversion: 2.1 time: 0.247784 Jan 22 21:07:01.533189 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1234/2356] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:01 2022] GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f => generated 1328 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:01.539821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b4c7f098-1c83-49c1-b7e7-d2279afab3da tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5d10ee0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:01.650523 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b4c7f098-1c83-49c1-b7e7-d2279afab3da tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 200 len: 1434 microversion: 2.1 time: 0.115813 Jan 22 21:07:01.651498 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1235/2357] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:07:01 2022] GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 1434 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:01.669682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5902d5c2-0ecd-4191-93e1-27aef33eefb2 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Action: 'create', calling method: .version_select at 0x7f1ed61d8ee0>, body: {"security_group_rule": {"parent_group_id": "1f2be640-25fa-4530-ae16-12b477fa9807", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8a5bbdb1-45e0-43b3-bc5a-3d26ad33d09b"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:02.437163 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5902d5c2-0ecd-4191-93e1-27aef33eefb2 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.784575 Jan 22 21:07:02.443800 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1236/2358] 10.222.0.100 () {60 vars in 1199 bytes} [Sat Jan 22 21:07:01 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:02.454868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1e61e9ff-c499-446f-b22b-007fbc8c4d90 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:02.455596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1e61e9ff-c499-446f-b22b-007fbc8c4d90 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:02.466039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e61e9ff-c499-446f-b22b-007fbc8c4d90 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:02.466785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e61e9ff-c499-446f-b22b-007fbc8c4d90 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:02.467785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e61e9ff-c499-446f-b22b-007fbc8c4d90 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:02.468993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e61e9ff-c499-446f-b22b-007fbc8c4d90 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:02.511514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1e61e9ff-c499-446f-b22b-007fbc8c4d90 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:07:03.179315 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1e61e9ff-c499-446f-b22b-007fbc8c4d90 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "DELETE /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 204 len: 0 microversion: 2.1 time: 0.728263 Jan 22 21:07:03.179315 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1237/2359] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:07:02 2022] DELETE /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 0 bytes in 730 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:07:03.179865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bfdffa65-816c-4883-bc1b-849e011541bb tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] Calling method '.version_select at 0x7f1ed608f0d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:03.344688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-efa02cbe-9727-479a-ad87-a244363f33d0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Updating instance_info_cache with network_info: [{"id": "4be0f157-1389-4003-a0b7-e5ae09ef77f5", "address": "fa:16:3e:d4:82:b7", "network": {"id": "523a1505-6f74-40bf-9e6e-a18691af5f2e", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1688412362-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9d92b7c0c42e408aa822174817d2819a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4be0f157-13", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137033) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 22 21:07:03.472841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efa02cbe-9727-479a-ad87-a244363f33d0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Releasing lock "refresh_cache-4446fe1f-c015-4a1d-800b-b2c6a7911948" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 22 21:07:03.473977 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-efa02cbe-9727-479a-ad87-a244363f33d0 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "POST /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948/action" status: 202 len: 0 microversion: 2.1 time: 5.493344 Jan 22 21:07:03.483337 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bfdffa65-816c-4883-bc1b-849e011541bb tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/f01372a6-40b8-4270-ae61-0aae8cb983ce" status: 202 len: 0 microversion: 2.1 time: 0.307758 Jan 22 21:07:03.484409 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1238/2360] 10.222.0.100 () {58 vars in 1252 bytes} [Sat Jan 22 21:07:03 2022] DELETE /compute/v2.1/os-volumes/f01372a6-40b8-4270-ae61-0aae8cb983ce => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:03.487379 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1123/2361] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:06:57 2022] POST /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948/action => generated 0 bytes in 5507 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 22 21:07:03.494258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a15cbece-862a-4966-8b91-29057c68a578 req-5a3c922a-d4cb-4c03-9a39-49c840cc2b9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4446fe1f-c015-4a1d-800b-b2c6a7911948", "tag": "4be0f157-1389-4003-a0b7-e5ae09ef77f5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:03.495870 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:03.495870 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:03.498868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e7d888d2-ae88-4e74-9bae-f64bbfdde485 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:03.499498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e7d888d2-ae88-4e74-9bae-f64bbfdde485 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:03.522253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a15cbece-862a-4966-8b91-29057c68a578 req-5a3c922a-d4cb-4c03-9a39-49c840cc2b9c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:03.527318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a15cbece-862a-4966-8b91-29057c68a578 req-5a3c922a-d4cb-4c03-9a39-49c840cc2b9c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:03.536253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7d888d2-ae88-4e74-9bae-f64bbfdde485 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:03.537692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7d888d2-ae88-4e74-9bae-f64bbfdde485 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:03.550745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7d888d2-ae88-4e74-9bae-f64bbfdde485 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:03.554020 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a15cbece-862a-4966-8b91-29057c68a578 req-5a3c922a-d4cb-4c03-9a39-49c840cc2b9c service nova] Creating event network-changed:4be0f157-1389-4003-a0b7-e5ae09ef77f5 for instance 4446fe1f-c015-4a1d-800b-b2c6a7911948 on nch1-master-1 Jan 22 21:07:03.555212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7d888d2-ae88-4e74-9bae-f64bbfdde485 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:03.559422 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a15cbece-862a-4966-8b91-29057c68a578 req-5a3c922a-d4cb-4c03-9a39-49c840cc2b9c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073669 Jan 22 21:07:03.560583 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1239/2362] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:03.566495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5606edc3-5701-496d-a484-ff9078b5d8cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:03.567447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5606edc3-5701-496d-a484-ff9078b5d8cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:03.577750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5606edc3-5701-496d-a484-ff9078b5d8cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:03.577750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5606edc3-5701-496d-a484-ff9078b5d8cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:03.577750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5606edc3-5701-496d-a484-ff9078b5d8cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:03.577750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5606edc3-5701-496d-a484-ff9078b5d8cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:03.626331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5606edc3-5701-496d-a484-ff9078b5d8cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:03.633262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5606edc3-5701-496d-a484-ff9078b5d8cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:03.635947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-5606edc3-5701-496d-a484-ff9078b5d8cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lazy-loading 'fault' on Instance uuid 49ab8dcc-d072-4e68-af27-2b4614db4cc2 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:07:03.701496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5606edc3-5701-496d-a484-ff9078b5d8cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b417a76de72c45a899648d658713bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbc7daf2ad2476fb707aab0b887c7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:03.714631 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5606edc3-5701-496d-a484-ff9078b5d8cc tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 200 len: 1355 microversion: 2.1 time: 0.151524 Jan 22 21:07:03.715701 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1240/2363] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:03 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 1355 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:03.722604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3fa5de96-24c3-46a8-be62-02a74675ed05 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Action: 'create', calling method: .version_select at 0x7f1ed6177160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1853752236", "description": "tempest-description-892260769"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:03.971682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e7d888d2-ae88-4e74-9bae-f64bbfdde485 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:03.998755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e7d888d2-ae88-4e74-9bae-f64bbfdde485 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:04.003831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e7d888d2-ae88-4e74-9bae-f64bbfdde485 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:04.006663 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e7d888d2-ae88-4e74-9bae-f64bbfdde485 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.511688 Jan 22 21:07:04.012862 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1124/2364] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:03 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:04.026938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-daef7249-aa7a-46be-bf12-b665069a874d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:04.026938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-daef7249-aa7a-46be-bf12-b665069a874d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:04.041011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daef7249-aa7a-46be-bf12-b665069a874d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:04.042200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daef7249-aa7a-46be-bf12-b665069a874d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:04.042336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daef7249-aa7a-46be-bf12-b665069a874d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:04.042887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daef7249-aa7a-46be-bf12-b665069a874d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:04.248626 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3fa5de96-24c3-46a8-be62-02a74675ed05 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.531658 Jan 22 21:07:04.250693 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1241/2365] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:07:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:04.258074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3fc3913-4ebc-48da-a502-999174a1bcd4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5d10820>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:04.350708 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d3fc3913-4ebc-48da-a502-999174a1bcd4 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 200 len: 1434 microversion: 2.1 time: 0.098628 Jan 22 21:07:04.351706 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1242/2366] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:07:04 2022] GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 1434 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:04.367341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-665c2692-cad7-4d94-9800-969acd962efa req-a19938e0-cdab-4a43-aa37-b4403df51f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-plugged", "status": "completed", "tag": "40974874-966d-4b01-b7e3-7346238b818a"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:04.383165 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:04.383165 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:04.432803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-665c2692-cad7-4d94-9800-969acd962efa req-a19938e0-cdab-4a43-aa37-b4403df51f3a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:04.433267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-665c2692-cad7-4d94-9800-969acd962efa req-a19938e0-cdab-4a43-aa37-b4403df51f3a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:04.470545 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-665c2692-cad7-4d94-9800-969acd962efa req-a19938e0-cdab-4a43-aa37-b4403df51f3a service nova] Creating event network-vif-plugged:40974874-966d-4b01-b7e3-7346238b818a for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:07:04.489799 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-665c2692-cad7-4d94-9800-969acd962efa req-a19938e0-cdab-4a43-aa37-b4403df51f3a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135960 Jan 22 21:07:04.501917 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1243/2367] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:04.507562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-01712607-a6cf-485e-a1da-5731a2e2ecc6 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:04.508341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-01712607-a6cf-485e-a1da-5731a2e2ecc6 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:04.520497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01712607-a6cf-485e-a1da-5731a2e2ecc6 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:04.520955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01712607-a6cf-485e-a1da-5731a2e2ecc6 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:04.527932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01712607-a6cf-485e-a1da-5731a2e2ecc6 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:04.527932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01712607-a6cf-485e-a1da-5731a2e2ecc6 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:04.564133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-daef7249-aa7a-46be-bf12-b665069a874d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cfa58857994c588e2b554abad1689d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9345c8011494040a8d5815906e5cca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:04.576960 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-daef7249-aa7a-46be-bf12-b665069a874d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f" status: 200 len: 1328 microversion: 2.1 time: 0.562215 Jan 22 21:07:04.577617 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1125/2368] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:04 2022] GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f => generated 1328 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:04.583746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ccaaf47-69bc-4e83-bfbc-2d40f1fd91a8 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.188"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:04.876533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-01712607-a6cf-485e-a1da-5731a2e2ecc6 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:04.888090 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-01712607-a6cf-485e-a1da-5731a2e2ecc6 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 200 len: 1470 microversion: 2.1 time: 0.384762 Jan 22 21:07:04.894322 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1244/2369] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:04 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 1470 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:04.908949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1672f1d9-d213-4c4d-a6c3-76c35210b7f9 tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] Calling method '.version_select at 0x7f1ed61d8790>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:04.976157 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1672f1d9-d213-4c4d-a6c3-76c35210b7f9 tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/f01372a6-40b8-4270-ae61-0aae8cb983ce" status: 200 len: 346 microversion: 2.1 time: 0.080213 Jan 22 21:07:04.976889 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1245/2370] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:07:04 2022] GET /compute/v2.1/os-volumes/f01372a6-40b8-4270-ae61-0aae8cb983ce => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:04.981443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-97e1e913-e0e1-4aa1-9e3a-5dbff7ab9c98 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Action: 'create', calling method: .version_select at 0x7f1ed5d419d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1095602461", "description": "tempest-description-1268779149"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:05.343300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ccaaf47-69bc-4e83-bfbc-2d40f1fd91a8 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:05.360916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ccaaf47-69bc-4e83-bfbc-2d40f1fd91a8 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:05.363227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ccaaf47-69bc-4e83-bfbc-2d40f1fd91a8 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:05.365820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ccaaf47-69bc-4e83-bfbc-2d40f1fd91a8 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:05.366572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ccaaf47-69bc-4e83-bfbc-2d40f1fd91a8 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:05.477717 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-97e1e913-e0e1-4aa1-9e3a-5dbff7ab9c98 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.499559 Jan 22 21:07:05.478452 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1246/2371] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:07:04 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:05.486366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b8cfc5a1-ad85-4070-a475-251b9fbd26d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:05.487059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b8cfc5a1-ad85-4070-a475-251b9fbd26d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:05.495418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8cfc5a1-ad85-4070-a475-251b9fbd26d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:05.496387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8cfc5a1-ad85-4070-a475-251b9fbd26d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:05.497948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8cfc5a1-ad85-4070-a475-251b9fbd26d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:05.498674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b8cfc5a1-ad85-4070-a475-251b9fbd26d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:05.532675 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-b8cfc5a1-ad85-4070-a475-251b9fbd26d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] HTTP exception thrown: Instance 49ab8dcc-d072-4e68-af27-2b4614db4cc2 could not be found. Jan 22 21:07:05.540011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b8cfc5a1-ad85-4070-a475-251b9fbd26d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Returning 404 to user: Instance 49ab8dcc-d072-4e68-af27-2b4614db4cc2 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:05.540911 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b8cfc5a1-ad85-4070-a475-251b9fbd26d2 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 404 len: 111 microversion: 2.1 time: 0.058412 Jan 22 21:07:05.544873 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1247/2372] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:05 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:07:05.551489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d1e80577-8d69-418e-8f34-733b1f75b123 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:05.568502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d1e80577-8d69-418e-8f34-733b1f75b123 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:05.574203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1e80577-8d69-418e-8f34-733b1f75b123 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:05.577351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1e80577-8d69-418e-8f34-733b1f75b123 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:05.578436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1e80577-8d69-418e-8f34-733b1f75b123 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:05.579901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1e80577-8d69-418e-8f34-733b1f75b123 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:05.801122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ccaaf47-69bc-4e83-bfbc-2d40f1fd91a8 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Acquired lock "refresh_cache-4446fe1f-c015-4a1d-800b-b2c6a7911948" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 22 21:07:05.933422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d1e80577-8d69-418e-8f34-733b1f75b123 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:05.951335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d1e80577-8d69-418e-8f34-733b1f75b123 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:05.952908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d1e80577-8d69-418e-8f34-733b1f75b123 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:05.954202 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d1e80577-8d69-418e-8f34-733b1f75b123 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.406381 Jan 22 21:07:05.955465 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1248/2373] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:05 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:05.960952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9efdfa8f-8b0f-43df-a7ce-9dbad8cff070 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5f851f0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:06.047410 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9efdfa8f-8b0f-43df-a7ce-9dbad8cff070 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 200 len: 1434 microversion: 2.1 time: 0.090563 Jan 22 21:07:06.049736 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1249/2374] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:07:05 2022] GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 1434 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:06.054002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ce98d341-fed5-4178-8f0c-9c2fb3857910 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Action: 'create', calling method: .version_select at 0x7f1ed5be51f0>, body: {"security_group_rule": {"parent_group_id": "d6a05d0b-e83b-4cf6-8514-c84528cb2988", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d47b66ec-a46d-4f64-b775-2764bb0ebd4c"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:06.730535 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ce98d341-fed5-4178-8f0c-9c2fb3857910 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.680891 Jan 22 21:07:06.732776 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1250/2375] 10.222.0.100 () {60 vars in 1199 bytes} [Sat Jan 22 21:07:06 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:06.741358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f926c535-0429-479a-89bd-b4145b1aabcf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:06.744903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f926c535-0429-479a-89bd-b4145b1aabcf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:06.764459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f926c535-0429-479a-89bd-b4145b1aabcf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:06.764957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f926c535-0429-479a-89bd-b4145b1aabcf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:06.765885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f926c535-0429-479a-89bd-b4145b1aabcf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:06.766337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f926c535-0429-479a-89bd-b4145b1aabcf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:06.793218 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-f926c535-0429-479a-89bd-b4145b1aabcf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] HTTP exception thrown: Instance 94e22853-aa4b-47cb-a69e-0e6fd8af5720 could not be found. Jan 22 21:07:06.794138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f926c535-0429-479a-89bd-b4145b1aabcf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Returning 404 to user: Instance 94e22853-aa4b-47cb-a69e-0e6fd8af5720 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:06.795155 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f926c535-0429-479a-89bd-b4145b1aabcf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 404 len: 111 microversion: 2.1 time: 0.060807 Jan 22 21:07:06.795913 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1251/2376] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:07:06 2022] DELETE /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:07:06.805429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b50d6ae8-06e5-421a-a4f7-ba9184387541 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:06.806328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b50d6ae8-06e5-421a-a4f7-ba9184387541 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:06.812960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b50d6ae8-06e5-421a-a4f7-ba9184387541 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:06.813438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b50d6ae8-06e5-421a-a4f7-ba9184387541 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:06.814558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b50d6ae8-06e5-421a-a4f7-ba9184387541 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:06.814716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b50d6ae8-06e5-421a-a4f7-ba9184387541 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:06.881593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-8ccaaf47-69bc-4e83-bfbc-2d40f1fd91a8 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Building network info cache for instance {{(pid=137033) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 22 21:07:07.013728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b50d6ae8-06e5-421a-a4f7-ba9184387541 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cfa58857994c588e2b554abad1689d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9345c8011494040a8d5815906e5cca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:07.025321 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b50d6ae8-06e5-421a-a4f7-ba9184387541 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f" status: 200 len: 1328 microversion: 2.1 time: 0.224877 Jan 22 21:07:07.027739 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1252/2377] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:06 2022] GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f => generated 1328 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:07.036323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-e83a7d56-4277-404c-8e0d-a2e615a9718d req-c7c0d08c-c1c8-40a3-8fe8-c090584e3b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f", "tag": "4f2a8df5-495a-4540-881e-dd2af46ae79a"}, {"server_uuid": "49ab8dcc-d072-4e68-af27-2b4614db4cc2", "name": "network-vif-deleted", "tag": "a4acdedb-d82e-4307-87e1-a851a52f7726"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:07.038988 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:07.038988 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:07.051706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e83a7d56-4277-404c-8e0d-a2e615a9718d req-c7c0d08c-c1c8-40a3-8fe8-c090584e3b46 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:07.052157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e83a7d56-4277-404c-8e0d-a2e615a9718d req-c7c0d08c-c1c8-40a3-8fe8-c090584e3b46 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:07.077014 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-e83a7d56-4277-404c-8e0d-a2e615a9718d req-c7c0d08c-c1c8-40a3-8fe8-c090584e3b46 service nova] Creating event network-changed:4f2a8df5-495a-4540-881e-dd2af46ae79a for instance 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f on nch2-master-1 Jan 22 21:07:07.078342 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-e83a7d56-4277-404c-8e0d-a2e615a9718d req-c7c0d08c-c1c8-40a3-8fe8-c090584e3b46 service nova] Creating event network-vif-deleted:a4acdedb-d82e-4307-87e1-a851a52f7726 for instance 49ab8dcc-d072-4e68-af27-2b4614db4cc2 on nch2-master-1 Jan 22 21:07:07.100608 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-e83a7d56-4277-404c-8e0d-a2e615a9718d req-c7c0d08c-c1c8-40a3-8fe8-c090584e3b46 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.071413 Jan 22 21:07:07.109387 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1253/2378] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:07.117637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-ec8df71e-b1ce-401d-8bb6-16baee1413a8 req-7732925c-f93d-420a-b1aa-ea6906a5d7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f587acdb-c6e0-43da-a1ba-1c2a7b9a404a", "name": "network-vif-deleted", "tag": "9fbef146-4fab-423d-88a7-60a1b3993b9c"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:07.119488 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:07.119488 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:07.128293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ec8df71e-b1ce-401d-8bb6-16baee1413a8 req-7732925c-f93d-420a-b1aa-ea6906a5d7ce service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:07.129050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ec8df71e-b1ce-401d-8bb6-16baee1413a8 req-7732925c-f93d-420a-b1aa-ea6906a5d7ce service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:07.161125 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-ec8df71e-b1ce-401d-8bb6-16baee1413a8 req-7732925c-f93d-420a-b1aa-ea6906a5d7ce service nova] Creating event network-vif-deleted:9fbef146-4fab-423d-88a7-60a1b3993b9c for instance f587acdb-c6e0-43da-a1ba-1c2a7b9a404a on nch1-master-1 Jan 22 21:07:07.178305 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-ec8df71e-b1ce-401d-8bb6-16baee1413a8 req-7732925c-f93d-420a-b1aa-ea6906a5d7ce service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066389 Jan 22 21:07:07.179402 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1254/2379] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:07.188049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-81fa3dc9-c734-4c1f-a4e3-53ae47fff5a5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:07.195187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-81fa3dc9-c734-4c1f-a4e3-53ae47fff5a5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: f587acdb-c6e0-43da-a1ba-1c2a7b9a404a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:07.203992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81fa3dc9-c734-4c1f-a4e3-53ae47fff5a5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:07.204703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81fa3dc9-c734-4c1f-a4e3-53ae47fff5a5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:07.208571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81fa3dc9-c734-4c1f-a4e3-53ae47fff5a5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:07.208571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81fa3dc9-c734-4c1f-a4e3-53ae47fff5a5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:07.271919 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-81fa3dc9-c734-4c1f-a4e3-53ae47fff5a5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] HTTP exception thrown: Instance f587acdb-c6e0-43da-a1ba-1c2a7b9a404a could not be found. Jan 22 21:07:07.274628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-81fa3dc9-c734-4c1f-a4e3-53ae47fff5a5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Returning 404 to user: Instance f587acdb-c6e0-43da-a1ba-1c2a7b9a404a could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:07.275788 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-81fa3dc9-c734-4c1f-a4e3-53ae47fff5a5 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a" status: 404 len: 111 microversion: 2.1 time: 0.091816 Jan 22 21:07:07.279719 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1255/2380] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:07 2022] GET /compute/v2.1/servers/f587acdb-c6e0-43da-a1ba-1c2a7b9a404a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:07:07.285863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d45b51f2-0827-4019-8675-c573618c03b6 tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] Calling method '.version_select at 0x7f1ed5d41b80>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:07.369145 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d45b51f2-0827-4019-8675-c573618c03b6 tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/f01372a6-40b8-4270-ae61-0aae8cb983ce" status: 200 len: 346 microversion: 2.1 time: 0.087951 Jan 22 21:07:07.370024 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1256/2381] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:07:07 2022] GET /compute/v2.1/os-volumes/f01372a6-40b8-4270-ae61-0aae8cb983ce => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:07.378126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-84ce05a5-f8dc-459f-8073-838918d38053 req-646ccc6a-90d0-47e3-999c-53b50db2d36b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-plugged", "status": "completed", "tag": "fd4bbc77-36a6-44fe-a7c8-4f7f72a35d2f"}, {"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-plugged", "status": "completed", "tag": "c631b245-837f-4809-9d1f-2d6792f3e2fb"}, {"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-plugged", "status": "completed", "tag": "d4efec9f-1ce8-4f39-b074-2e15fb38a93f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:07.378126 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:07.378126 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:07.387469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-84ce05a5-f8dc-459f-8073-838918d38053 req-646ccc6a-90d0-47e3-999c-53b50db2d36b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:07.387983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-84ce05a5-f8dc-459f-8073-838918d38053 req-646ccc6a-90d0-47e3-999c-53b50db2d36b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:07.402918 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-84ce05a5-f8dc-459f-8073-838918d38053 req-646ccc6a-90d0-47e3-999c-53b50db2d36b service nova] Creating event network-vif-plugged:fd4bbc77-36a6-44fe-a7c8-4f7f72a35d2f for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:07:07.403450 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-84ce05a5-f8dc-459f-8073-838918d38053 req-646ccc6a-90d0-47e3-999c-53b50db2d36b service nova] Creating event network-vif-plugged:c631b245-837f-4809-9d1f-2d6792f3e2fb for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:07:07.403961 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-84ce05a5-f8dc-459f-8073-838918d38053 req-646ccc6a-90d0-47e3-999c-53b50db2d36b service nova] Creating event network-vif-plugged:d4efec9f-1ce8-4f39-b074-2e15fb38a93f for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:07:07.411017 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-84ce05a5-f8dc-459f-8073-838918d38053 req-646ccc6a-90d0-47e3-999c-53b50db2d36b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039889 Jan 22 21:07:07.413055 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1257/2382] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:07.419505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-436b6dfb-17a3-4e9a-b0bb-4a757ecb7421 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Calling method '.version_select at 0x7f1ed61d8790>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:07.826940 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-436b6dfb-17a3-4e9a-b0bb-4a757ecb7421 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/d47b66ec-a46d-4f64-b775-2764bb0ebd4c" status: 202 len: 0 microversion: 2.1 time: 0.412561 Jan 22 21:07:07.827521 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1258/2383] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:07:07 2022] DELETE /compute/v2.1/os-security-groups/d47b66ec-a46d-4f64-b775-2764bb0ebd4c => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:07.832646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4ccfb731-acb0-4767-8dad-2b51be47011a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:07.835143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4ccfb731-acb0-4767-8dad-2b51be47011a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:07.859272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ccfb731-acb0-4767-8dad-2b51be47011a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:07.859272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ccfb731-acb0-4767-8dad-2b51be47011a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:07.868639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ccfb731-acb0-4767-8dad-2b51be47011a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:07.869479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ccfb731-acb0-4767-8dad-2b51be47011a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:07.911236 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-4ccfb731-acb0-4767-8dad-2b51be47011a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] HTTP exception thrown: Instance 94e22853-aa4b-47cb-a69e-0e6fd8af5720 could not be found. Jan 22 21:07:07.912303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4ccfb731-acb0-4767-8dad-2b51be47011a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Returning 404 to user: Instance 94e22853-aa4b-47cb-a69e-0e6fd8af5720 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:07.913341 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4ccfb731-acb0-4767-8dad-2b51be47011a tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 404 len: 111 microversion: 2.1 time: 0.084894 Jan 22 21:07:07.914416 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1259/2384] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:07 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:07:07.922809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-98bb21a0-b86d-46e7-909a-cc7cea3b39cf tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:07.925585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-98bb21a0-b86d-46e7-909a-cc7cea3b39cf tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:07.944622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98bb21a0-b86d-46e7-909a-cc7cea3b39cf tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:07.945100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98bb21a0-b86d-46e7-909a-cc7cea3b39cf tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:07.950672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98bb21a0-b86d-46e7-909a-cc7cea3b39cf tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:07.950672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98bb21a0-b86d-46e7-909a-cc7cea3b39cf tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:08.215248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-8ccaaf47-69bc-4e83-bfbc-2d40f1fd91a8 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Updating instance_info_cache with network_info: [{"id": "4be0f157-1389-4003-a0b7-e5ae09ef77f5", "address": "fa:16:3e:d4:82:b7", "network": {"id": "523a1505-6f74-40bf-9e6e-a18691af5f2e", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1688412362-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9d92b7c0c42e408aa822174817d2819a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap4be0f157-13", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137033) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 22 21:07:08.328610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ccaaf47-69bc-4e83-bfbc-2d40f1fd91a8 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Releasing lock "refresh_cache-4446fe1f-c015-4a1d-800b-b2c6a7911948" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 22 21:07:08.329559 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ccaaf47-69bc-4e83-bfbc-2d40f1fd91a8 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "POST /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948/action" status: 202 len: 0 microversion: 2.1 time: 3.750160 Jan 22 21:07:08.330959 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1126/2385] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:07:04 2022] POST /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948/action => generated 0 bytes in 3752 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 22 21:07:08.348386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7a94b4cf-17bc-4ddb-9028-d4399df34b94 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5ed84c0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:08.465412 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7a94b4cf-17bc-4ddb-9028-d4399df34b94 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 200 len: 1434 microversion: 2.1 time: 0.133083 Jan 22 21:07:08.470505 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1127/2386] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:07:08 2022] GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 1434 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:08.486424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9995d242-5e70-405c-ae56-a6cb85603a01 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:08.487788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9995d242-5e70-405c-ae56-a6cb85603a01 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:08.497196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-98bb21a0-b86d-46e7-909a-cc7cea3b39cf tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:08.509108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9995d242-5e70-405c-ae56-a6cb85603a01 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:08.509741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9995d242-5e70-405c-ae56-a6cb85603a01 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:08.510635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9995d242-5e70-405c-ae56-a6cb85603a01 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:08.511228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9995d242-5e70-405c-ae56-a6cb85603a01 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:08.526742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-98bb21a0-b86d-46e7-909a-cc7cea3b39cf tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:08.528619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-98bb21a0-b86d-46e7-909a-cc7cea3b39cf tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:08.533192 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-98bb21a0-b86d-46e7-909a-cc7cea3b39cf tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.616054 Jan 22 21:07:08.548261 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1260/2387] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:07 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:08.561530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6632d3ac-b921-4278-8bf7-bbd094efe387 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Calling method '.version_select at 0x7f1ed5f85700>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:08.589374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9995d242-5e70-405c-ae56-a6cb85603a01 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:07:08.630173 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6632d3ac-b921-4278-8bf7-bbd094efe387 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "GET /compute/v2.1/os-security-groups/d6a05d0b-e83b-4cf6-8514-c84528cb2988" status: 200 len: 247 microversion: 2.1 time: 0.080669 Jan 22 21:07:08.631978 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1261/2388] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 21:07:08 2022] GET /compute/v2.1/os-security-groups/d6a05d0b-e83b-4cf6-8514-c84528cb2988 => generated 247 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:08.636909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-571c55b1-2eb4-42db-bf3d-2886d623c441 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '.version_select at 0x7f1ed636e040>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:08.924590 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-571c55b1-2eb4-42db-bf3d-2886d623c441 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-563767088" status: 202 len: 0 microversion: 2.1 time: 0.291249 Jan 22 21:07:08.930019 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1262/2389] 10.222.0.100 () {58 vars in 1222 bytes} [Sat Jan 22 21:07:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-563767088 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:08.939156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b78b8ed9-59cd-4c36-bed1-dcf0efcead5f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:08.940744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b78b8ed9-59cd-4c36-bed1-dcf0efcead5f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:08.953611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b78b8ed9-59cd-4c36-bed1-dcf0efcead5f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:08.955040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b78b8ed9-59cd-4c36-bed1-dcf0efcead5f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:08.956978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b78b8ed9-59cd-4c36-bed1-dcf0efcead5f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:08.958151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b78b8ed9-59cd-4c36-bed1-dcf0efcead5f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:09.150940 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9995d242-5e70-405c-ae56-a6cb85603a01 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "DELETE /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 204 len: 0 microversion: 2.1 time: 0.680565 Jan 22 21:07:09.151548 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1128/2390] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:07:08 2022] DELETE /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:07:09.157728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-70874e23-4c86-4d5c-9cd1-7ffc77cf30de tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '.version_select at 0x7f1ed687dee0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:09.173718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b78b8ed9-59cd-4c36-bed1-dcf0efcead5f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cfa58857994c588e2b554abad1689d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9345c8011494040a8d5815906e5cca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:09.183168 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b78b8ed9-59cd-4c36-bed1-dcf0efcead5f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f" status: 200 len: 1328 microversion: 2.1 time: 0.250863 Jan 22 21:07:09.184533 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1263/2391] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:08 2022] GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f => generated 1328 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:09.189419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-78f6dc8b-47b6-44d0-ae50-28c742a49144 tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] Calling method '.version_select at 0x7f1ed63eb820>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:09.225267 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-78f6dc8b-47b6-44d0-ae50-28c742a49144 tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] HTTP exception thrown: Volume f01372a6-40b8-4270-ae61-0aae8cb983ce could not be found. Jan 22 21:07:09.226236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-78f6dc8b-47b6-44d0-ae50-28c742a49144 tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] Returning 404 to user: Volume f01372a6-40b8-4270-ae61-0aae8cb983ce could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:09.227579 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-78f6dc8b-47b6-44d0-ae50-28c742a49144 tempest-VolumesGetTestJSON-1722497660 tempest-VolumesGetTestJSON-1722497660-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/f01372a6-40b8-4270-ae61-0aae8cb983ce" status: 404 len: 109 microversion: 2.1 time: 0.041885 Jan 22 21:07:09.228325 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1264/2392] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:07:09 2022] GET /compute/v2.1/os-volumes/f01372a6-40b8-4270-ae61-0aae8cb983ce => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:07:09.251340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-03e60b88-2e39-4e1a-8013-7410ccf2e398 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Action: 'create', calling method: .version_select at 0x7f1ed6177820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-277272768", "description": "tempest-description-2057419337"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:09.820175 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-03e60b88-2e39-4e1a-8013-7410ccf2e398 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.590430 Jan 22 21:07:09.820778 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1265/2393] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:07:09 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:09.825654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a72af46d-99b7-47f5-a6f9-40d28c79de24 req-dda09c03-4b4d-416f-beb7-5984f424a856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4446fe1f-c015-4a1d-800b-b2c6a7911948", "tag": "4be0f157-1389-4003-a0b7-e5ae09ef77f5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:09.827527 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:09.827527 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:09.847025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a72af46d-99b7-47f5-a6f9-40d28c79de24 req-dda09c03-4b4d-416f-beb7-5984f424a856 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:09.847820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a72af46d-99b7-47f5-a6f9-40d28c79de24 req-dda09c03-4b4d-416f-beb7-5984f424a856 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:09.870384 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a72af46d-99b7-47f5-a6f9-40d28c79de24 req-dda09c03-4b4d-416f-beb7-5984f424a856 service nova] Creating event network-changed:4be0f157-1389-4003-a0b7-e5ae09ef77f5 for instance 4446fe1f-c015-4a1d-800b-b2c6a7911948 on nch1-master-1 Jan 22 21:07:09.877002 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a72af46d-99b7-47f5-a6f9-40d28c79de24 req-dda09c03-4b4d-416f-beb7-5984f424a856 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054690 Jan 22 21:07:09.877809 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1266/2394] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:09.886365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-978c43b4-3ac2-4545-9556-ae95ce9ffa55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:09.887259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-978c43b4-3ac2-4545-9556-ae95ce9ffa55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:09.896777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-978c43b4-3ac2-4545-9556-ae95ce9ffa55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:09.897605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-978c43b4-3ac2-4545-9556-ae95ce9ffa55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:09.899154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-978c43b4-3ac2-4545-9556-ae95ce9ffa55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:09.899834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-978c43b4-3ac2-4545-9556-ae95ce9ffa55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:10.198799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-978c43b4-3ac2-4545-9556-ae95ce9ffa55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:10.207604 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-978c43b4-3ac2-4545-9556-ae95ce9ffa55 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1478 microversion: 2.1 time: 0.328169 Jan 22 21:07:10.208184 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1267/2395] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:09 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1478 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:10.224947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-db39e30b-5ca3-4def-aff5-8f6e51513d1d req-ea3e9aaf-a6ae-4ae9-af1d-268be9a320a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-plugged", "status": "completed", "tag": "65a17ac8-ab35-4509-a302-dc7bac50087c"}, {"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-plugged", "status": "completed", "tag": "926072cb-8b2b-4fa0-b9dc-cb5c9a1b57cc"}, {"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-plugged", "status": "completed", "tag": "751bac06-ae8b-43dc-bb1e-57283b8cf014"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:10.227157 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:10.227157 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:10.245095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-db39e30b-5ca3-4def-aff5-8f6e51513d1d req-ea3e9aaf-a6ae-4ae9-af1d-268be9a320a0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:10.246293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-db39e30b-5ca3-4def-aff5-8f6e51513d1d req-ea3e9aaf-a6ae-4ae9-af1d-268be9a320a0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:10.269194 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-db39e30b-5ca3-4def-aff5-8f6e51513d1d req-ea3e9aaf-a6ae-4ae9-af1d-268be9a320a0 service nova] Creating event network-vif-plugged:65a17ac8-ab35-4509-a302-dc7bac50087c for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:07:10.282396 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-db39e30b-5ca3-4def-aff5-8f6e51513d1d req-ea3e9aaf-a6ae-4ae9-af1d-268be9a320a0 service nova] Creating event network-vif-plugged:926072cb-8b2b-4fa0-b9dc-cb5c9a1b57cc for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:07:10.282927 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-db39e30b-5ca3-4def-aff5-8f6e51513d1d req-ea3e9aaf-a6ae-4ae9-af1d-268be9a320a0 service nova] Creating event network-vif-plugged:751bac06-ae8b-43dc-bb1e-57283b8cf014 for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:07:10.293574 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-db39e30b-5ca3-4def-aff5-8f6e51513d1d req-ea3e9aaf-a6ae-4ae9-af1d-268be9a320a0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.080851 Jan 22 21:07:10.294597 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1268/2396] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:10.299857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2fdce23e-c07e-4507-8122-eeabb502a25a tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed602cb80>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:10.398464 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2fdce23e-c07e-4507-8122-eeabb502a25a tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 200 len: 1434 microversion: 2.1 time: 0.102633 Jan 22 21:07:10.399074 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1269/2397] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:07:10 2022] GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 1434 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:10.425407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-93ee51b9-ef77-4742-9fac-9746396afbf1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:10.425407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-93ee51b9-ef77-4742-9fac-9746396afbf1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:10.429027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93ee51b9-ef77-4742-9fac-9746396afbf1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:10.435075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93ee51b9-ef77-4742-9fac-9746396afbf1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:10.436173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93ee51b9-ef77-4742-9fac-9746396afbf1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:10.436799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93ee51b9-ef77-4742-9fac-9746396afbf1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:10.855896 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-70874e23-4c86-4d5c-9cd1-7ffc77cf30de tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "DELETE /compute/v2.1/os-floating-ips/3dd25f99-1803-40f9-a337-0cb0cd0d2ae2" status: 202 len: 0 microversion: 2.1 time: 1.702819 Jan 22 21:07:10.859816 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1129/2398] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:07:09 2022] DELETE /compute/v2.1/os-floating-ips/3dd25f99-1803-40f9-a337-0cb0cd0d2ae2 => generated 0 bytes in 1707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:10.874395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-28acc3fd-9421-4420-af1a-ad1c90b4dcb9 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Action: 'create', calling method: .version_select at 0x7f1ed5490700>, body: {"security_group_rule": {"parent_group_id": "46406d4a-c8e6-4fd3-bc41-3acebbcdbab6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:11.029733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-93ee51b9-ef77-4742-9fac-9746396afbf1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:11.049212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-93ee51b9-ef77-4742-9fac-9746396afbf1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:11.050957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-93ee51b9-ef77-4742-9fac-9746396afbf1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:11.052184 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-93ee51b9-ef77-4742-9fac-9746396afbf1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.652168 Jan 22 21:07:11.052817 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1270/2399] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:10 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:11.063762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f65cd1a-ea07-4d74-9f7e-a148d7dd311c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:11.069640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8f65cd1a-ea07-4d74-9f7e-a148d7dd311c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:11.076720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f65cd1a-ea07-4d74-9f7e-a148d7dd311c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:11.077410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f65cd1a-ea07-4d74-9f7e-a148d7dd311c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:11.078427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f65cd1a-ea07-4d74-9f7e-a148d7dd311c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:11.079049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f65cd1a-ea07-4d74-9f7e-a148d7dd311c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:11.249718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8f65cd1a-ea07-4d74-9f7e-a148d7dd311c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cfa58857994c588e2b554abad1689d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9345c8011494040a8d5815906e5cca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:11.263823 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8f65cd1a-ea07-4d74-9f7e-a148d7dd311c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f" status: 200 len: 1328 microversion: 2.1 time: 0.209084 Jan 22 21:07:11.270013 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1271/2400] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:11 2022] GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f => generated 1328 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:11.514604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-baa58de0-6674-47b6-9d82-49df956f052d tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:11.515791 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:11.515791 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:11.672090 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-baa58de0-6674-47b6-9d82-49df956f052d tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/40083115" status: 202 len: 0 microversion: 2.1 time: 0.398800 Jan 22 21:07:11.678177 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1272/2401] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:07:11 2022] DELETE /compute/v2.1/flavors/40083115 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:11.684736 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-28acc3fd-9421-4420-af1a-ad1c90b4dcb9 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.815961 Jan 22 21:07:11.684736 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1130/2402] 10.222.0.100 () {60 vars in 1199 bytes} [Sat Jan 22 21:07:10 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:11.684976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d4b82c93-bbda-483c-863b-e261a3380725 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '.version_select at 0x7f1ed642c5e0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:11.685980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-03ab48dc-fad0-4ff5-888b-cea326e8aa42 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:11.687078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-03ab48dc-fad0-4ff5-888b-cea326e8aa42 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:11.714302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03ab48dc-fad0-4ff5-888b-cea326e8aa42 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:11.717444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03ab48dc-fad0-4ff5-888b-cea326e8aa42 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:11.733883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03ab48dc-fad0-4ff5-888b-cea326e8aa42 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:11.738136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03ab48dc-fad0-4ff5-888b-cea326e8aa42 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:11.890573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-03ab48dc-fad0-4ff5-888b-cea326e8aa42 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:11.903696 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-03ab48dc-fad0-4ff5-888b-cea326e8aa42 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1436 microversion: 2.1 time: 0.221495 Jan 22 21:07:11.906759 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1131/2403] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:11 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1436 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:11.911474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bbe96178-3f8a-4abc-a633-530d528ab86f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed54901f0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:11.981535 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bbe96178-3f8a-4abc-a633-530d528ab86f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 200 len: 1434 microversion: 2.1 time: 0.073521 Jan 22 21:07:11.986333 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1132/2404] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:07:11 2022] GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 1434 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:11.986931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-32206724-0546-489b-ac89-26dd0f71f1f0 tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:12.008612 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-32206724-0546-489b-ac89-26dd0f71f1f0 tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5433 microversion: 2.1 time: 0.024971 Jan 22 21:07:12.010481 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1133/2405] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:07:11 2022] GET /compute/v2.1/flavors/detail => generated 5433 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:12.013802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d42d7869-18c1-410e-86ab-e1ae354efbef tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Action: 'create', calling method: .version_select at 0x7f1edaebaa60>, body: {"security_group_rule": {"parent_group_id": "46406d4a-c8e6-4fd3-bc41-3acebbcdbab6", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:12.153381 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d4b82c93-bbda-483c-863b-e261a3380725 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/16b322eb-9651-4666-a7bd-f2fa68de9e32" status: 202 len: 0 microversion: 2.1 time: 0.469172 Jan 22 21:07:12.153381 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1273/2406] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:07:11 2022] DELETE /compute/v2.1/os-security-groups/16b322eb-9651-4666-a7bd-f2fa68de9e32 => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:12.154957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-03a61ace-4dd5-49e7-b56a-dbd85913be67 req-3a896e7d-13b3-49da-8600-481c89c976d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "627b2d09-47c8-46df-8a53-d0f6f01024e1", "name": "network-vif-deleted", "tag": "ef887d2b-348f-451e-bedc-83da121efacc"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:12.156570 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:12.156570 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:12.187957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-03a61ace-4dd5-49e7-b56a-dbd85913be67 req-3a896e7d-13b3-49da-8600-481c89c976d6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:12.189829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-03a61ace-4dd5-49e7-b56a-dbd85913be67 req-3a896e7d-13b3-49da-8600-481c89c976d6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:12.207373 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-03a61ace-4dd5-49e7-b56a-dbd85913be67 req-3a896e7d-13b3-49da-8600-481c89c976d6 service nova] Creating event network-vif-deleted:ef887d2b-348f-451e-bedc-83da121efacc for instance 627b2d09-47c8-46df-8a53-d0f6f01024e1 on nch1-master-1 Jan 22 21:07:12.215787 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-03a61ace-4dd5-49e7-b56a-dbd85913be67 req-3a896e7d-13b3-49da-8600-481c89c976d6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065410 Jan 22 21:07:12.216959 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1274/2407] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:12.223284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3bac84df-8106-454c-b488-f14195c62b93 tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:12.224898 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:12.224898 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:12.400038 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3bac84df-8106-454c-b488-f14195c62b93 tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/155056716" status: 202 len: 0 microversion: 2.1 time: 0.178918 Jan 22 21:07:12.400038 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1275/2408] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 21:07:12 2022] DELETE /compute/v2.1/flavors/155056716 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:12.406945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b82c4bb5-f2b3-456a-b050-4bec71e94967 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:12.408024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b82c4bb5-f2b3-456a-b050-4bec71e94967 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:12.417904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b82c4bb5-f2b3-456a-b050-4bec71e94967 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:12.418603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b82c4bb5-f2b3-456a-b050-4bec71e94967 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:12.423459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b82c4bb5-f2b3-456a-b050-4bec71e94967 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:12.423459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b82c4bb5-f2b3-456a-b050-4bec71e94967 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:12.612881 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d42d7869-18c1-410e-86ab-e1ae354efbef tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.601410 Jan 22 21:07:12.613527 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1134/2409] 10.222.0.100 () {60 vars in 1199 bytes} [Sat Jan 22 21:07:12 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:12.624243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2d075d8b-4d36-4ead-8b43-43fec6ef14ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:12.624759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2d075d8b-4d36-4ead-8b43-43fec6ef14ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:12.636512 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d075d8b-4d36-4ead-8b43-43fec6ef14ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:12.636992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d075d8b-4d36-4ead-8b43-43fec6ef14ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:12.638490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d075d8b-4d36-4ead-8b43-43fec6ef14ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:12.640780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d075d8b-4d36-4ead-8b43-43fec6ef14ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:12.690923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2d075d8b-4d36-4ead-8b43-43fec6ef14ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:07:12.714416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b82c4bb5-f2b3-456a-b050-4bec71e94967 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:12.733265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b82c4bb5-f2b3-456a-b050-4bec71e94967 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:12.739480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b82c4bb5-f2b3-456a-b050-4bec71e94967 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:12.743434 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b82c4bb5-f2b3-456a-b050-4bec71e94967 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1884 microversion: 2.42 time: 0.343274 Jan 22 21:07:12.745618 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1276/2410] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:12 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1884 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:12.763831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c36c64a8-c6d7-49a9-887a-9d5a8f3a3a30 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:12.764874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c36c64a8-c6d7-49a9-887a-9d5a8f3a3a30 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:12.773261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c36c64a8-c6d7-49a9-887a-9d5a8f3a3a30 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:12.774762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c36c64a8-c6d7-49a9-887a-9d5a8f3a3a30 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:12.776138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c36c64a8-c6d7-49a9-887a-9d5a8f3a3a30 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:12.776727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c36c64a8-c6d7-49a9-887a-9d5a8f3a3a30 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:12.952408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c36c64a8-c6d7-49a9-887a-9d5a8f3a3a30 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cfa58857994c588e2b554abad1689d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9345c8011494040a8d5815906e5cca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:12.966012 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c36c64a8-c6d7-49a9-887a-9d5a8f3a3a30 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f" status: 200 len: 1328 microversion: 2.1 time: 0.219223 Jan 22 21:07:12.967411 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1277/2411] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:12 2022] GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f => generated 1328 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:12.972380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-2e7e9684-3f8d-41ee-bed3-0ea57e414d6f req-7df97fca-6307-43e4-ba96-1b0852d33224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f", "name": "network-vif-plugged", "status": "completed", "tag": "4f2a8df5-495a-4540-881e-dd2af46ae79a"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:12.974850 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:12.974850 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:12.982959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2e7e9684-3f8d-41ee-bed3-0ea57e414d6f req-7df97fca-6307-43e4-ba96-1b0852d33224 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:12.983709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2e7e9684-3f8d-41ee-bed3-0ea57e414d6f req-7df97fca-6307-43e4-ba96-1b0852d33224 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:13.004131 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-2e7e9684-3f8d-41ee-bed3-0ea57e414d6f req-7df97fca-6307-43e4-ba96-1b0852d33224 service nova] Creating event network-vif-plugged:4f2a8df5-495a-4540-881e-dd2af46ae79a for instance 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f on nch2-master-1 Jan 22 21:07:13.010460 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-2e7e9684-3f8d-41ee-bed3-0ea57e414d6f req-7df97fca-6307-43e4-ba96-1b0852d33224 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041011 Jan 22 21:07:13.011481 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1278/2412] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:13.030376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c6efae17-c955-4c13-8988-b4bd17e2a445 tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:13.066634 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c6efae17-c955-4c13-8988-b4bd17e2a445 tempest-ServersWithSpecificFlavorTestJSON-2089959692 tempest-ServersWithSpecificFlavorTestJSON-2089959692-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.053485 Jan 22 21:07:13.067716 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1279/2413] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:07:13 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:13.082347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4b0cbf73-b0b3-435f-b862-4d2115a391df tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Calling method '.version_select at 0x7f1ed603a700>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:13.155031 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2d075d8b-4d36-4ead-8b43-43fec6ef14ff tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "DELETE /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 204 len: 0 microversion: 2.1 time: 0.538380 Jan 22 21:07:13.157483 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1135/2414] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:07:12 2022] DELETE /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:07:13.174290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-43735776-07d1-4fc5-9568-0b74170ae48e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:13.178989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-43735776-07d1-4fc5-9568-0b74170ae48e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:13.204670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43735776-07d1-4fc5-9568-0b74170ae48e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:13.207914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43735776-07d1-4fc5-9568-0b74170ae48e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:13.214996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43735776-07d1-4fc5-9568-0b74170ae48e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:13.215699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43735776-07d1-4fc5-9568-0b74170ae48e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:13.216665 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4b0cbf73-b0b3-435f-b862-4d2115a391df tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "GET /compute/v2.1/os-security-groups/46406d4a-c8e6-4fd3-bc41-3acebbcdbab6" status: 200 len: 664 microversion: 2.1 time: 0.146690 Jan 22 21:07:13.217653 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1280/2415] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 21:07:13 2022] GET /compute/v2.1/os-security-groups/46406d4a-c8e6-4fd3-bc41-3acebbcdbab6 => generated 664 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:13.228726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-52653f83-3caf-4187-b73a-174df2a1dd62 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed601aee0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:13.295671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43735776-07d1-4fc5-9568-0b74170ae48e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:13.296071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43735776-07d1-4fc5-9568-0b74170ae48e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:13.296587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-43735776-07d1-4fc5-9568-0b74170ae48e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lazy-loading 'fault' on Instance uuid 627b2d09-47c8-46df-8a53-d0f6f01024e1 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:07:13.314799 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-52653f83-3caf-4187-b73a-174df2a1dd62 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 200 len: 1434 microversion: 2.1 time: 0.096061 Jan 22 21:07:13.321565 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1281/2416] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:07:13 2022] GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 1434 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:13.328653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-af673f9a-7a06-48f8-9af5-932b8279d8d7 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:13.334492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-af673f9a-7a06-48f8-9af5-932b8279d8d7 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:13.345959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af673f9a-7a06-48f8-9af5-932b8279d8d7 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:13.347713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af673f9a-7a06-48f8-9af5-932b8279d8d7 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:13.348837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af673f9a-7a06-48f8-9af5-932b8279d8d7 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:13.350644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af673f9a-7a06-48f8-9af5-932b8279d8d7 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:13.358997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-43735776-07d1-4fc5-9568-0b74170ae48e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ac42e3ea264a9fb8a56bc73caf9f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e63d05e0fb84113bd23bc9c064ddad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:13.369250 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-43735776-07d1-4fc5-9568-0b74170ae48e tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 200 len: 1313 microversion: 2.1 time: 0.207723 Jan 22 21:07:13.369250 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1136/2417] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:13 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:13.394177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a5de6738-454a-4e58-95ac-ad000a744814 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:13.394933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a5de6738-454a-4e58-95ac-ad000a744814 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:13.403018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5de6738-454a-4e58-95ac-ad000a744814 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:13.406746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5de6738-454a-4e58-95ac-ad000a744814 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:13.406746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5de6738-454a-4e58-95ac-ad000a744814 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:13.406746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5de6738-454a-4e58-95ac-ad000a744814 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:13.428189 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-a5de6738-454a-4e58-95ac-ad000a744814 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] HTTP exception thrown: Instance 49ab8dcc-d072-4e68-af27-2b4614db4cc2 could not be found. Jan 22 21:07:13.429228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a5de6738-454a-4e58-95ac-ad000a744814 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Returning 404 to user: Instance 49ab8dcc-d072-4e68-af27-2b4614db4cc2 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:13.430821 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a5de6738-454a-4e58-95ac-ad000a744814 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 404 len: 111 microversion: 2.1 time: 0.061387 Jan 22 21:07:13.431430 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1137/2418] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:07:13 2022] DELETE /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:07:13.436570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5b3aca04-ecf6-4179-b72f-6d4fccc5858a tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Calling method '.version_select at 0x7f1edae38b80>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:13.589675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-af673f9a-7a06-48f8-9af5-932b8279d8d7 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:13.598784 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-af673f9a-7a06-48f8-9af5-932b8279d8d7 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1514 microversion: 2.1 time: 0.273893 Jan 22 21:07:13.606706 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1282/2419] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:13 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1514 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:13.612161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6e32c791-6101-4aef-b97a-73b0b299de41 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:13.613007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6e32c791-6101-4aef-b97a-73b0b299de41 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 49ab8dcc-d072-4e68-af27-2b4614db4cc2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:13.620645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e32c791-6101-4aef-b97a-73b0b299de41 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:13.662684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e32c791-6101-4aef-b97a-73b0b299de41 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:13.662684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e32c791-6101-4aef-b97a-73b0b299de41 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:13.662684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e32c791-6101-4aef-b97a-73b0b299de41 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:13.662684 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-6e32c791-6101-4aef-b97a-73b0b299de41 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] HTTP exception thrown: Instance 49ab8dcc-d072-4e68-af27-2b4614db4cc2 could not be found. Jan 22 21:07:13.662684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6e32c791-6101-4aef-b97a-73b0b299de41 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Returning 404 to user: Instance 49ab8dcc-d072-4e68-af27-2b4614db4cc2 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:13.662684 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6e32c791-6101-4aef-b97a-73b0b299de41 tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2" status: 404 len: 111 microversion: 2.1 time: 0.031430 Jan 22 21:07:13.662684 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1283/2420] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:13 2022] GET /compute/v2.1/servers/49ab8dcc-d072-4e68-af27-2b4614db4cc2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:07:13.671825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c4a8b450-52ec-4543-8bcb-31ccd47adb8f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:13.672647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c4a8b450-52ec-4543-8bcb-31ccd47adb8f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:13.681337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4a8b450-52ec-4543-8bcb-31ccd47adb8f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:13.681806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4a8b450-52ec-4543-8bcb-31ccd47adb8f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:13.682799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4a8b450-52ec-4543-8bcb-31ccd47adb8f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:13.683250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4a8b450-52ec-4543-8bcb-31ccd47adb8f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:13.697698 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-c4a8b450-52ec-4543-8bcb-31ccd47adb8f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] HTTP exception thrown: Instance 94e22853-aa4b-47cb-a69e-0e6fd8af5720 could not be found. Jan 22 21:07:13.698297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c4a8b450-52ec-4543-8bcb-31ccd47adb8f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Returning 404 to user: Instance 94e22853-aa4b-47cb-a69e-0e6fd8af5720 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:13.699132 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c4a8b450-52ec-4543-8bcb-31ccd47adb8f tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "DELETE /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 404 len: 111 microversion: 2.1 time: 0.033425 Jan 22 21:07:13.699917 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1284/2421] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:07:13 2022] DELETE /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:07:13.707268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b9cf0bb3-9d87-4fcc-87ad-9ab53f0f97bf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:13.707878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b9cf0bb3-9d87-4fcc-87ad-9ab53f0f97bf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] [instance: 94e22853-aa4b-47cb-a69e-0e6fd8af5720] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:13.714290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9cf0bb3-9d87-4fcc-87ad-9ab53f0f97bf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:13.714746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9cf0bb3-9d87-4fcc-87ad-9ab53f0f97bf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:13.715504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9cf0bb3-9d87-4fcc-87ad-9ab53f0f97bf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:13.715950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9cf0bb3-9d87-4fcc-87ad-9ab53f0f97bf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:13.730460 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-b9cf0bb3-9d87-4fcc-87ad-9ab53f0f97bf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] HTTP exception thrown: Instance 94e22853-aa4b-47cb-a69e-0e6fd8af5720 could not be found. Jan 22 21:07:13.730990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b9cf0bb3-9d87-4fcc-87ad-9ab53f0f97bf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] Returning 404 to user: Instance 94e22853-aa4b-47cb-a69e-0e6fd8af5720 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:13.731811 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b9cf0bb3-9d87-4fcc-87ad-9ab53f0f97bf tempest-ServersWithSpecificFlavorTestJSON-297768223 tempest-ServersWithSpecificFlavorTestJSON-297768223-project] 10.222.0.100 "GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720" status: 404 len: 111 microversion: 2.1 time: 0.027968 Jan 22 21:07:13.732352 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1285/2422] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:13 2022] GET /compute/v2.1/servers/94e22853-aa4b-47cb-a69e-0e6fd8af5720 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:07:13.762663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f542e5f-4327-4abe-b246-db92e1500d60 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:13.763279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f542e5f-4327-4abe-b246-db92e1500d60 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:13.769211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f542e5f-4327-4abe-b246-db92e1500d60 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:13.769703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f542e5f-4327-4abe-b246-db92e1500d60 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:13.770489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f542e5f-4327-4abe-b246-db92e1500d60 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:13.770933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f542e5f-4327-4abe-b246-db92e1500d60 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:14.026702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f542e5f-4327-4abe-b246-db92e1500d60 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:14.036778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f542e5f-4327-4abe-b246-db92e1500d60 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:14.038638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f542e5f-4327-4abe-b246-db92e1500d60 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:14.040020 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f542e5f-4327-4abe-b246-db92e1500d60 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 2841 microversion: 2.42 time: 0.280973 Jan 22 21:07:14.040924 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1286/2423] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:13 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 2841 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:07:14.045520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-de1c516f-0e75-445c-a0e0-33db6d514402 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:14.046152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-de1c516f-0e75-445c-a0e0-33db6d514402 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:14.053983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de1c516f-0e75-445c-a0e0-33db6d514402 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:14.054450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de1c516f-0e75-445c-a0e0-33db6d514402 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:14.056217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de1c516f-0e75-445c-a0e0-33db6d514402 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:14.056217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de1c516f-0e75-445c-a0e0-33db6d514402 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:14.245693 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5b3aca04-ecf6-4179-b72f-6d4fccc5858a tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-group-rules/a463bb7c-6738-4aec-8794-f7f474afb1c7" status: 202 len: 0 microversion: 2.1 time: 0.812501 Jan 22 21:07:14.246941 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1138/2424] 10.222.0.100 () {58 vars in 1291 bytes} [Sat Jan 22 21:07:13 2022] DELETE /compute/v2.1/os-security-group-rules/a463bb7c-6738-4aec-8794-f7f474afb1c7 => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:14.257283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-951ae2ae-ee30-49e4-9ce1-84f875088373 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:14.258056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-951ae2ae-ee30-49e4-9ce1-84f875088373 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:14.265713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-951ae2ae-ee30-49e4-9ce1-84f875088373 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:14.270025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-951ae2ae-ee30-49e4-9ce1-84f875088373 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:14.275462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-951ae2ae-ee30-49e4-9ce1-84f875088373 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:14.275856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-951ae2ae-ee30-49e4-9ce1-84f875088373 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:14.316641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-de1c516f-0e75-445c-a0e0-33db6d514402 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cfa58857994c588e2b554abad1689d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9345c8011494040a8d5815906e5cca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:14.327571 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-de1c516f-0e75-445c-a0e0-33db6d514402 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f" status: 200 len: 1328 microversion: 2.1 time: 0.285411 Jan 22 21:07:14.328668 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1287/2425] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:14 2022] GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f => generated 1328 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:14.333591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ba376483-995b-43ba-ac2c-fcea085a1e93 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Calling method '.version_select at 0x7f1ed6382940>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:14.638831 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-951ae2ae-ee30-49e4-9ce1-84f875088373 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.390353 Jan 22 21:07:14.651568 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1139/2426] 10.222.0.100 () {60 vars in 1320 bytes} [Sat Jan 22 21:07:14 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/os-interface => generated 1831 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:14.658834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5da3baf6-d817-4b52-bb47-3ce6ae4e2b0f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1edae38790>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:14.696403 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ba376483-995b-43ba-ac2c-fcea085a1e93 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/46406d4a-c8e6-4fd3-bc41-3acebbcdbab6" status: 202 len: 0 microversion: 2.1 time: 0.366397 Jan 22 21:07:14.698840 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1288/2427] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:07:14 2022] DELETE /compute/v2.1/os-security-groups/46406d4a-c8e6-4fd3-bc41-3acebbcdbab6 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:14.704039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-123b4eb7-9d5a-425c-9858-18ee44250e76 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:14.704866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-123b4eb7-9d5a-425c-9858-18ee44250e76 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] [instance: 627b2d09-47c8-46df-8a53-d0f6f01024e1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:14.729128 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5da3baf6-d817-4b52-bb47-3ce6ae4e2b0f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 200 len: 1434 microversion: 2.1 time: 0.075818 Jan 22 21:07:14.730044 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1140/2428] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:07:14 2022] GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 1434 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:14.740495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-45f79145-023a-4802-9e0b-8fe4a6f75f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:14.741555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-123b4eb7-9d5a-425c-9858-18ee44250e76 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:14.741967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-45f79145-023a-4802-9e0b-8fe4a6f75f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:14.742589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-123b4eb7-9d5a-425c-9858-18ee44250e76 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:14.744595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-123b4eb7-9d5a-425c-9858-18ee44250e76 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:14.748264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-123b4eb7-9d5a-425c-9858-18ee44250e76 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:14.748930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45f79145-023a-4802-9e0b-8fe4a6f75f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:14.749692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45f79145-023a-4802-9e0b-8fe4a6f75f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:14.750667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45f79145-023a-4802-9e0b-8fe4a6f75f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:14.751278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45f79145-023a-4802-9e0b-8fe4a6f75f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:14.808277 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-123b4eb7-9d5a-425c-9858-18ee44250e76 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] HTTP exception thrown: Instance 627b2d09-47c8-46df-8a53-d0f6f01024e1 could not be found. Jan 22 21:07:14.809016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-123b4eb7-9d5a-425c-9858-18ee44250e76 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] Returning 404 to user: Instance 627b2d09-47c8-46df-8a53-d0f6f01024e1 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:14.810025 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-123b4eb7-9d5a-425c-9858-18ee44250e76 tempest-LiveMigrationNegativeTest-410786640 tempest-LiveMigrationNegativeTest-410786640-project] 10.222.0.100 "GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1" status: 404 len: 111 microversion: 2.1 time: 0.110082 Jan 22 21:07:14.814018 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1289/2429] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:14 2022] GET /compute/v2.1/servers/627b2d09-47c8-46df-8a53-d0f6f01024e1 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:07:14.825244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb29dddd-82a4-4a26-8ee7-6f860c797c79 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Calling method '.version_select at 0x7f1ed66dc280>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:14.976381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG neutronclient.v2_0.client [None req-fb29dddd-82a4-4a26-8ee7-6f860c797c79 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d47b66ec-a46d-4f64-b775-2764bb0ebd4c does not exist", "detail": ""}} {{(pid=137032) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:07:14.978563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.security_group_api [None req-fb29dddd-82a4-4a26-8ee7-6f860c797c79 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Neutron security group d47b66ec-a46d-4f64-b775-2764bb0ebd4c not found {{(pid=137032) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 22 21:07:14.979734 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-fb29dddd-82a4-4a26-8ee7-6f860c797c79 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] HTTP exception thrown: Security group d47b66ec-a46d-4f64-b775-2764bb0ebd4c does not exist Jan 22 21:07:14.979734 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-1fcd1964-1001-433a-82e6-4c4fe364774a'] Jan 22 21:07:14.980716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb29dddd-82a4-4a26-8ee7-6f860c797c79 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Returning 404 to user: Security group d47b66ec-a46d-4f64-b775-2764bb0ebd4c does not exist Jan 22 21:07:14.980716 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-1fcd1964-1001-433a-82e6-4c4fe364774a'] {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:14.982141 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fb29dddd-82a4-4a26-8ee7-6f860c797c79 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/d47b66ec-a46d-4f64-b775-2764bb0ebd4c" status: 404 len: 194 microversion: 2.1 time: 0.166902 Jan 22 21:07:14.982916 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1290/2430] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:07:14 2022] DELETE /compute/v2.1/os-security-groups/d47b66ec-a46d-4f64-b775-2764bb0ebd4c => generated 194 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:07:14.995065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f106aded-f5cd-46f0-961f-aeab2809bcf6 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Calling method '.version_select at 0x7f1ed63825e0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:15.128593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-45f79145-023a-4802-9e0b-8fe4a6f75f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:15.139445 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-45f79145-023a-4802-9e0b-8fe4a6f75f5f tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1514 microversion: 2.1 time: 0.406999 Jan 22 21:07:15.140130 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1141/2431] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:14 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1514 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:15.347744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-421cc476-6b19-4d59-be83-66b5900fd5f7 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:15.350248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-421cc476-6b19-4d59-be83-66b5900fd5f7 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:15.370189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-421cc476-6b19-4d59-be83-66b5900fd5f7 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:15.371092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-421cc476-6b19-4d59-be83-66b5900fd5f7 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:15.374235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-421cc476-6b19-4d59-be83-66b5900fd5f7 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:15.374963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-421cc476-6b19-4d59-be83-66b5900fd5f7 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:15.602793 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f106aded-f5cd-46f0-961f-aeab2809bcf6 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/d6a05d0b-e83b-4cf6-8514-c84528cb2988" status: 202 len: 0 microversion: 2.1 time: 0.615550 Jan 22 21:07:15.603653 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1291/2432] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:07:14 2022] DELETE /compute/v2.1/os-security-groups/d6a05d0b-e83b-4cf6-8514-c84528cb2988 => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:15.611463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2239d29a-003a-4380-aee5-d6399af93f49 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Calling method '.version_select at 0x7f1ed6177b80>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:15.681339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-421cc476-6b19-4d59-be83-66b5900fd5f7 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cfa58857994c588e2b554abad1689d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9345c8011494040a8d5815906e5cca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:15.695317 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-421cc476-6b19-4d59-be83-66b5900fd5f7 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f" status: 200 len: 1524 microversion: 2.1 time: 0.353669 Jan 22 21:07:15.697174 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1142/2433] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:15 2022] GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f => generated 1524 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:15.715984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d41b7b8-9069-4b7d-83c1-55682973f24c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:15.716703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d41b7b8-9069-4b7d-83c1-55682973f24c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:15.723610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d41b7b8-9069-4b7d-83c1-55682973f24c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:15.724484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d41b7b8-9069-4b7d-83c1-55682973f24c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:15.725729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d41b7b8-9069-4b7d-83c1-55682973f24c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:15.726247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d41b7b8-9069-4b7d-83c1-55682973f24c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:15.798581 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-3d41b7b8-9069-4b7d-83c1-55682973f24c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] HTTP exception thrown: Action 999 not found Jan 22 21:07:15.800189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d41b7b8-9069-4b7d-83c1-55682973f24c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Returning 404 to user: Action 999 not found {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:15.803837 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d41b7b8-9069-4b7d-83c1-55682973f24c tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.092609 Jan 22 21:07:15.805860 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1143/2434] 10.222.0.100 () {58 vars in 1312 bytes} [Sat Jan 22 21:07:15 2022] GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f/os-instance-actions/999 => generated 66 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:07:15.814590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8b78b1af-17aa-40cd-adf1-b50a33d517e2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1edae05f70>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:15.871148 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8b78b1af-17aa-40cd-adf1-b50a33d517e2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 200 len: 1443 microversion: 2.1 time: 0.063331 Jan 22 21:07:15.878472 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1144/2435] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:07:15 2022] GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 1443 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:15.884310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-def0e014-1a01-4802-b43d-236441f38f36 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '.version_select at 0x7f1ed602adc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:15.885097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-def0e014-1a01-4802-b43d-236441f38f36 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: e9a852f4-684e-479f-aac3-7db0eb4cb733] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:15.891759 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-def0e014-1a01-4802-b43d-236441f38f36 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] HTTP exception thrown: Instance e9a852f4-684e-479f-aac3-7db0eb4cb733 could not be found. Jan 22 21:07:15.892591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-def0e014-1a01-4802-b43d-236441f38f36 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Returning 404 to user: Instance e9a852f4-684e-479f-aac3-7db0eb4cb733 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:15.893671 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-def0e014-1a01-4802-b43d-236441f38f36 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/e9a852f4-684e-479f-aac3-7db0eb4cb733/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.013834 Jan 22 21:07:15.900351 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1145/2436] 10.222.0.100 () {58 vars in 1300 bytes} [Sat Jan 22 21:07:15 2022] GET /compute/v2.1/servers/e9a852f4-684e-479f-aac3-7db0eb4cb733/os-instance-actions => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:07:15.905949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d256c8a5-6ec9-4067-98dc-091278b6d045 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1edae05940>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:15.958348 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d256c8a5-6ec9-4067-98dc-091278b6d045 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 200 len: 1443 microversion: 2.1 time: 0.056371 Jan 22 21:07:15.969795 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1146/2437] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:07:15 2022] GET /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 1443 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:15.975339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a1610b4b-d405-4589-a494-a99313509a5d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:15.975930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a1610b4b-d405-4589-a494-a99313509a5d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:15.982806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1610b4b-d405-4589-a494-a99313509a5d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:15.988687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1610b4b-d405-4589-a494-a99313509a5d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:15.988687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1610b4b-d405-4589-a494-a99313509a5d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:15.988687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1610b4b-d405-4589-a494-a99313509a5d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:16.036559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a1610b4b-d405-4589-a494-a99313509a5d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:07:16.397023 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a1610b4b-d405-4589-a494-a99313509a5d tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f" status: 204 len: 0 microversion: 2.1 time: 0.425099 Jan 22 21:07:16.401003 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1147/2438] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:07:15 2022] DELETE /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:07:16.402617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-857affb3-f5c0-4d7f-bfaa-d3101b9f56b2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:16.403497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-857affb3-f5c0-4d7f-bfaa-d3101b9f56b2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:16.415759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-857affb3-f5c0-4d7f-bfaa-d3101b9f56b2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:16.416629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-857affb3-f5c0-4d7f-bfaa-d3101b9f56b2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:16.418014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-857affb3-f5c0-4d7f-bfaa-d3101b9f56b2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:16.418682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-857affb3-f5c0-4d7f-bfaa-d3101b9f56b2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:16.611852 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2239d29a-003a-4380-aee5-d6399af93f49 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/8a5bbdb1-45e0-43b3-bc5a-3d26ad33d09b" status: 202 len: 0 microversion: 2.1 time: 1.003634 Jan 22 21:07:16.613809 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1292/2439] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:07:15 2022] DELETE /compute/v2.1/os-security-groups/8a5bbdb1-45e0-43b3-bc5a-3d26ad33d09b => generated 0 bytes in 1007 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:07:16.622597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2d39f04d-7997-47af-8b7e-7d0ee99a0cd3 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:16.623998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2d39f04d-7997-47af-8b7e-7d0ee99a0cd3 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:16.653895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d39f04d-7997-47af-8b7e-7d0ee99a0cd3 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:16.655268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d39f04d-7997-47af-8b7e-7d0ee99a0cd3 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:16.660519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d39f04d-7997-47af-8b7e-7d0ee99a0cd3 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:16.661051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d39f04d-7997-47af-8b7e-7d0ee99a0cd3 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:16.757492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-857affb3-f5c0-4d7f-bfaa-d3101b9f56b2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:16.767996 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-857affb3-f5c0-4d7f-bfaa-d3101b9f56b2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1470 microversion: 2.1 time: 0.368980 Jan 22 21:07:16.769287 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1148/2440] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:16 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1470 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:16.787188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6979c49e-a978-4e9c-a941-9ba3b94ef69f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:16.788526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6979c49e-a978-4e9c-a941-9ba3b94ef69f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:16.803545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6979c49e-a978-4e9c-a941-9ba3b94ef69f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:16.804683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6979c49e-a978-4e9c-a941-9ba3b94ef69f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:16.806337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6979c49e-a978-4e9c-a941-9ba3b94ef69f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:16.807935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6979c49e-a978-4e9c-a941-9ba3b94ef69f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:16.894626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2d39f04d-7997-47af-8b7e-7d0ee99a0cd3 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:16.905281 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2d39f04d-7997-47af-8b7e-7d0ee99a0cd3 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1514 microversion: 2.1 time: 0.287745 Jan 22 21:07:16.906122 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1293/2441] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:16 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1514 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:16.935704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-80902011-3366-4475-bea4-209691e1ae11 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Calling method '.version_select at 0x7f1ed636ea60>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:17.130047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6979c49e-a978-4e9c-a941-9ba3b94ef69f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cfa58857994c588e2b554abad1689d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9345c8011494040a8d5815906e5cca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:17.138956 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6979c49e-a978-4e9c-a941-9ba3b94ef69f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f" status: 200 len: 1530 microversion: 2.1 time: 0.368516 Jan 22 21:07:17.139669 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1149/2442] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:16 2022] GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f => generated 1530 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:17.144350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-faf4ce3e-085d-4f37-888d-db59ea6a1455 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:17.145469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-faf4ce3e-085d-4f37-888d-db59ea6a1455 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:17.153920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-faf4ce3e-085d-4f37-888d-db59ea6a1455 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:17.154451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-faf4ce3e-085d-4f37-888d-db59ea6a1455 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:17.157815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-faf4ce3e-085d-4f37-888d-db59ea6a1455 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:17.157815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-faf4ce3e-085d-4f37-888d-db59ea6a1455 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:17.217278 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-faf4ce3e-085d-4f37-888d-db59ea6a1455 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 14 microversion: 2.42 time: 0.076248 Jan 22 21:07:17.223844 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1150/2443] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:17 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:17.241526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-038de5f5-77df-46bb-bab7-131bded3e011 req-6e36f44f-943e-47c2-8c13-37cc9be2b391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "tag": "c631b245-837f-4809-9d1f-2d6792f3e2fb"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:17.243083 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:17.243083 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:07:17.270084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-038de5f5-77df-46bb-bab7-131bded3e011 req-6e36f44f-943e-47c2-8c13-37cc9be2b391 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:17.278426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-038de5f5-77df-46bb-bab7-131bded3e011 req-6e36f44f-943e-47c2-8c13-37cc9be2b391 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:17.322372 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-038de5f5-77df-46bb-bab7-131bded3e011 req-6e36f44f-943e-47c2-8c13-37cc9be2b391 service nova] Creating event network-changed:c631b245-837f-4809-9d1f-2d6792f3e2fb for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:07:17.339046 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-038de5f5-77df-46bb-bab7-131bded3e011 req-6e36f44f-943e-47c2-8c13-37cc9be2b391 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115264 Jan 22 21:07:17.341794 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1151/2444] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:17.359478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0bb4aa03-aaab-4b5e-9ed6-768607b92eda tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1ed5510e50>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:17.933983 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-80902011-3366-4475-bea4-209691e1ae11 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/1f2be640-25fa-4530-ae16-12b477fa9807" status: 202 len: 0 microversion: 2.1 time: 1.026574 Jan 22 21:07:17.935654 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1294/2445] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:07:16 2022] DELETE /compute/v2.1/os-security-groups/1f2be640-25fa-4530-ae16-12b477fa9807 => generated 0 bytes in 1029 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:17.945494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-dc4f0f10-bc67-4215-a633-cd4eb41b8675 req-794fa792-9979-4516-bb6e-74ced3dc4ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4446fe1f-c015-4a1d-800b-b2c6a7911948", "name": "network-vif-deleted", "tag": "4be0f157-1389-4003-a0b7-e5ae09ef77f5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:17.952775 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:17.952775 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:17.963241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-dc4f0f10-bc67-4215-a633-cd4eb41b8675 req-794fa792-9979-4516-bb6e-74ced3dc4ab8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:17.965097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-dc4f0f10-bc67-4215-a633-cd4eb41b8675 req-794fa792-9979-4516-bb6e-74ced3dc4ab8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:17.984905 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-dc4f0f10-bc67-4215-a633-cd4eb41b8675 req-794fa792-9979-4516-bb6e-74ced3dc4ab8 service nova] Creating event network-vif-deleted:4be0f157-1389-4003-a0b7-e5ae09ef77f5 for instance 4446fe1f-c015-4a1d-800b-b2c6a7911948 on nch1-master-1 Jan 22 21:07:17.992405 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-dc4f0f10-bc67-4215-a633-cd4eb41b8675 req-794fa792-9979-4516-bb6e-74ced3dc4ab8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052998 Jan 22 21:07:17.994237 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1295/2446] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:18.003250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-36add268-288b-4d8e-b36f-b8c6a62d6c35 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:18.004688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-36add268-288b-4d8e-b36f-b8c6a62d6c35 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:18.014781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36add268-288b-4d8e-b36f-b8c6a62d6c35 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:18.015612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36add268-288b-4d8e-b36f-b8c6a62d6c35 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:18.018019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36add268-288b-4d8e-b36f-b8c6a62d6c35 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:18.018705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36add268-288b-4d8e-b36f-b8c6a62d6c35 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:18.086604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36add268-288b-4d8e-b36f-b8c6a62d6c35 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:18.087479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36add268-288b-4d8e-b36f-b8c6a62d6c35 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:18.088433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-36add268-288b-4d8e-b36f-b8c6a62d6c35 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lazy-loading 'fault' on Instance uuid 4446fe1f-c015-4a1d-800b-b2c6a7911948 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:07:18.326811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-36add268-288b-4d8e-b36f-b8c6a62d6c35 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '697c72b92bac489094799f8969331213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d92b7c0c42e408aa822174817d2819a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:18.356392 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-36add268-288b-4d8e-b36f-b8c6a62d6c35 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 200 len: 1317 microversion: 2.1 time: 0.359482 Jan 22 21:07:18.357285 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1296/2447] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:17 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:18.366799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1372d25-46b9-4b65-8be9-f0a76c8e5670 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Calling method '.version_select at 0x7f1ed63b9040>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:19.097451 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1372d25-46b9-4b65-8be9-f0a76c8e5670 tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/adb46df7-01d5-4b71-9d48-1cf1c70792ae" status: 202 len: 0 microversion: 2.1 time: 0.735159 Jan 22 21:07:19.097451 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1297/2448] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:07:18 2022] DELETE /compute/v2.1/os-security-groups/adb46df7-01d5-4b71-9d48-1cf1c70792ae => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:19.099896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eeed25fa-2af5-4df2-9a71-85531c853b90 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:19.100512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eeed25fa-2af5-4df2-9a71-85531c853b90 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:19.109349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eeed25fa-2af5-4df2-9a71-85531c853b90 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:19.109839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eeed25fa-2af5-4df2-9a71-85531c853b90 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:19.121357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eeed25fa-2af5-4df2-9a71-85531c853b90 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:19.121357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eeed25fa-2af5-4df2-9a71-85531c853b90 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:19.289751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-eeed25fa-2af5-4df2-9a71-85531c853b90 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cfa58857994c588e2b554abad1689d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9345c8011494040a8d5815906e5cca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:19.298721 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eeed25fa-2af5-4df2-9a71-85531c853b90 tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f" status: 200 len: 1488 microversion: 2.1 time: 0.202938 Jan 22 21:07:19.300475 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1298/2449] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:19 2022] GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f => generated 1488 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:19.320030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17a28d54-2020-4211-9393-dcb4514472e1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:19.321982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17a28d54-2020-4211-9393-dcb4514472e1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:19.335289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17a28d54-2020-4211-9393-dcb4514472e1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:19.336013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17a28d54-2020-4211-9393-dcb4514472e1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:19.338390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17a28d54-2020-4211-9393-dcb4514472e1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:19.341155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17a28d54-2020-4211-9393-dcb4514472e1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:19.408638 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17a28d54-2020-4211-9393-dcb4514472e1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 14 microversion: 2.42 time: 0.106560 Jan 22 21:07:19.417646 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1299/2450] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:19 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:19.420337 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0bb4aa03-aaab-4b5e-9ed6-768607b92eda tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "DELETE /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c" status: 204 len: 0 microversion: 2.1 time: 2.076325 Jan 22 21:07:19.421446 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1152/2451] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:17 2022] DELETE /compute/v2.1/images/a260eeb6-51d1-49ec-981a-139b58d5215c => generated 0 bytes in 2078 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:07:19.423898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-69a405a1-28a7-4fbe-ba6e-49cebc3d933e tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] Calling method '.version_select at 0x7f1ed5ef7430>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:19.429274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e9a30382-bd98-4c64-985f-6c68c043ee82 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:19.439304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e9a30382-bd98-4c64-985f-6c68c043ee82 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] [instance: 4446fe1f-c015-4a1d-800b-b2c6a7911948] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:19.466270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a30382-bd98-4c64-985f-6c68c043ee82 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:19.467786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a30382-bd98-4c64-985f-6c68c043ee82 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:19.469899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a30382-bd98-4c64-985f-6c68c043ee82 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:19.470554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a30382-bd98-4c64-985f-6c68c043ee82 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:19.496967 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-e9a30382-bd98-4c64-985f-6c68c043ee82 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] HTTP exception thrown: Instance 4446fe1f-c015-4a1d-800b-b2c6a7911948 could not be found. Jan 22 21:07:19.497921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e9a30382-bd98-4c64-985f-6c68c043ee82 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] Returning 404 to user: Instance 4446fe1f-c015-4a1d-800b-b2c6a7911948 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:19.499053 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e9a30382-bd98-4c64-985f-6c68c043ee82 tempest-ServerRescueTestJSONUnderV235-1484582495 tempest-ServerRescueTestJSONUnderV235-1484582495-project] 10.222.0.100 "GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948" status: 404 len: 111 microversion: 2.1 time: 0.076396 Jan 22 21:07:19.500201 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1153/2452] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:19 2022] GET /compute/v2.1/servers/4446fe1f-c015-4a1d-800b-b2c6a7911948 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:07:19.505783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-60f53d3d-9df6-4d7c-9305-feb6525d729f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '.version_select at 0x7f1edae05310>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:19.531662 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-60f53d3d-9df6-4d7c-9305-feb6525d729f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] HTTP exception thrown: Image not found. Jan 22 21:07:19.532771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-60f53d3d-9df6-4d7c-9305-feb6525d729f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Returning 404 to user: Image not found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:19.533855 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-60f53d3d-9df6-4d7c-9305-feb6525d729f tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "DELETE /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4" status: 404 len: 62 microversion: 2.1 time: 0.032412 Jan 22 21:07:19.535267 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1154/2453] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:19 2022] DELETE /compute/v2.1/images/6e8d6fe6-5fe2-4688-bc86-811a2034acf4 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:07:19.546745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-792e3c26-92f2-4641-b5eb-80eb35fc2877 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:19.551603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-792e3c26-92f2-4641-b5eb-80eb35fc2877 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:19.558306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-792e3c26-92f2-4641-b5eb-80eb35fc2877 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:19.558923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-792e3c26-92f2-4641-b5eb-80eb35fc2877 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:19.559911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-792e3c26-92f2-4641-b5eb-80eb35fc2877 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:19.560499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-792e3c26-92f2-4641-b5eb-80eb35fc2877 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:19.598437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-792e3c26-92f2-4641-b5eb-80eb35fc2877 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:07:19.988828 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-69a405a1-28a7-4fbe-ba6e-49cebc3d933e tempest-SecurityGroupRulesTestJSON-1518648575 tempest-SecurityGroupRulesTestJSON-1518648575-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/f5062a40-8d7c-4f25-a357-646d6674e8e2" status: 202 len: 0 microversion: 2.1 time: 0.569556 Jan 22 21:07:19.989604 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1300/2454] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:07:19 2022] DELETE /compute/v2.1/os-security-groups/f5062a40-8d7c-4f25-a357-646d6674e8e2 => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:19.997733 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-792e3c26-92f2-4641-b5eb-80eb35fc2877 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "DELETE /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 204 len: 0 microversion: 2.1 time: 0.457314 Jan 22 21:07:19.999536 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1155/2455] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:07:19 2022] DELETE /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:07:20.008136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4f30ad01-63c5-4bd7-8daf-e86392343400 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:20.008873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4f30ad01-63c5-4bd7-8daf-e86392343400 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:20.019067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f30ad01-63c5-4bd7-8daf-e86392343400 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:20.019882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f30ad01-63c5-4bd7-8daf-e86392343400 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:20.021221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f30ad01-63c5-4bd7-8daf-e86392343400 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:20.025473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f30ad01-63c5-4bd7-8daf-e86392343400 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:20.277021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-01d7ce04-804b-4955-8c09-d91b4e95cd55 req-15b47dc2-dfef-4b60-a450-7f4fa1cb8102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f", "name": "network-vif-deleted", "tag": "4f2a8df5-495a-4540-881e-dd2af46ae79a"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:20.279422 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:20.279422 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:07:20.289235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-01d7ce04-804b-4955-8c09-d91b4e95cd55 req-15b47dc2-dfef-4b60-a450-7f4fa1cb8102 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:20.289796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-01d7ce04-804b-4955-8c09-d91b4e95cd55 req-15b47dc2-dfef-4b60-a450-7f4fa1cb8102 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:20.305162 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-01d7ce04-804b-4955-8c09-d91b4e95cd55 req-15b47dc2-dfef-4b60-a450-7f4fa1cb8102 service nova] Creating event network-vif-deleted:4f2a8df5-495a-4540-881e-dd2af46ae79a for instance 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f on nch2-master-1 Jan 22 21:07:20.311235 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-01d7ce04-804b-4955-8c09-d91b4e95cd55 req-15b47dc2-dfef-4b60-a450-7f4fa1cb8102 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045651 Jan 22 21:07:20.312434 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1156/2456] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:20.322230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-93fbc4fc-d090-4a34-a063-f6cfd2c7987f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:20.323012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-93fbc4fc-d090-4a34-a063-f6cfd2c7987f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] [instance: 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:20.334711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93fbc4fc-d090-4a34-a063-f6cfd2c7987f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:20.335317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93fbc4fc-d090-4a34-a063-f6cfd2c7987f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:20.336792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93fbc4fc-d090-4a34-a063-f6cfd2c7987f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:20.337383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93fbc4fc-d090-4a34-a063-f6cfd2c7987f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:20.375642 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-93fbc4fc-d090-4a34-a063-f6cfd2c7987f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] HTTP exception thrown: Instance 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f could not be found. Jan 22 21:07:20.378246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-93fbc4fc-d090-4a34-a063-f6cfd2c7987f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] Returning 404 to user: Instance 6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:20.382284 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-93fbc4fc-d090-4a34-a063-f6cfd2c7987f tempest-InstanceActionsNegativeTestJSON-961251266 tempest-InstanceActionsNegativeTestJSON-961251266-project] 10.222.0.100 "GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f" status: 404 len: 111 microversion: 2.1 time: 0.066110 Jan 22 21:07:20.387302 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1157/2457] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:20 2022] GET /compute/v2.1/servers/6d5c0c36-dc15-42e5-afd7-1c0ba7dcbe6f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:07:20.423014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-03e216b1-644a-4854-89e6-5ffc0bd20636 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:20.423949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-03e216b1-644a-4854-89e6-5ffc0bd20636 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:20.435706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03e216b1-644a-4854-89e6-5ffc0bd20636 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:20.439742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03e216b1-644a-4854-89e6-5ffc0bd20636 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:20.440698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03e216b1-644a-4854-89e6-5ffc0bd20636 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:20.441692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03e216b1-644a-4854-89e6-5ffc0bd20636 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:20.530126 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-03e216b1-644a-4854-89e6-5ffc0bd20636 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 14 microversion: 2.42 time: 0.112636 Jan 22 21:07:20.533496 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1158/2458] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:20 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:20.543566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-4632804d-aa4d-45e7-bd97-5922020237a0 req-8c7093cc-ebef-47cd-9bfa-582db66c3989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31384bb-6cc1-45a4-a067-92ac3713ef55", "name": "network-vif-unplugged", "status": "completed", "tag": "493297bc-3a80-4965-b414-e858560483fb"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:20.547225 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:20.547225 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:07:20.557218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4632804d-aa4d-45e7-bd97-5922020237a0 req-8c7093cc-ebef-47cd-9bfa-582db66c3989 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:20.558479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4632804d-aa4d-45e7-bd97-5922020237a0 req-8c7093cc-ebef-47cd-9bfa-582db66c3989 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:20.583485 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-4632804d-aa4d-45e7-bd97-5922020237a0 req-8c7093cc-ebef-47cd-9bfa-582db66c3989 service nova] Creating event network-vif-unplugged:493297bc-3a80-4965-b414-e858560483fb for instance b31384bb-6cc1-45a4-a067-92ac3713ef55 on nch1-master-1 Jan 22 21:07:20.592446 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-4632804d-aa4d-45e7-bd97-5922020237a0 req-8c7093cc-ebef-47cd-9bfa-582db66c3989 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057702 Jan 22 21:07:20.593810 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1159/2459] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:20.601051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4f30ad01-63c5-4bd7-8daf-e86392343400 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:20.609939 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4f30ad01-63c5-4bd7-8daf-e86392343400 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1476 microversion: 2.1 time: 0.605366 Jan 22 21:07:20.610506 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1301/2460] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:20 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1476 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:21.542144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7313ecde-4331-4c88-90b3-b12c53231077 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:21.543777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7313ecde-4331-4c88-90b3-b12c53231077 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:21.550444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7313ecde-4331-4c88-90b3-b12c53231077 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:21.551187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7313ecde-4331-4c88-90b3-b12c53231077 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:21.552748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7313ecde-4331-4c88-90b3-b12c53231077 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:21.555001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7313ecde-4331-4c88-90b3-b12c53231077 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:21.603947 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7313ecde-4331-4c88-90b3-b12c53231077 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 14 microversion: 2.42 time: 0.067044 Jan 22 21:07:21.608053 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1160/2461] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:21 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:21.629138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5a4b6aec-2381-4832-9bfe-2c56682d8b6b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:21.629780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5a4b6aec-2381-4832-9bfe-2c56682d8b6b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:21.638723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a4b6aec-2381-4832-9bfe-2c56682d8b6b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:21.639440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a4b6aec-2381-4832-9bfe-2c56682d8b6b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:21.640462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a4b6aec-2381-4832-9bfe-2c56682d8b6b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:21.640908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a4b6aec-2381-4832-9bfe-2c56682d8b6b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:21.883605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5a4b6aec-2381-4832-9bfe-2c56682d8b6b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:21.892087 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5a4b6aec-2381-4832-9bfe-2c56682d8b6b tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1476 microversion: 2.1 time: 0.267283 Jan 22 21:07:21.892676 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1302/2462] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:21 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1476 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:22.616057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ed8d7ffd-4be7-4af7-ab21-2b407e90d168 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:22.616702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ed8d7ffd-4be7-4af7-ab21-2b407e90d168 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:22.634028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed8d7ffd-4be7-4af7-ab21-2b407e90d168 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:22.634491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed8d7ffd-4be7-4af7-ab21-2b407e90d168 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:22.635320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed8d7ffd-4be7-4af7-ab21-2b407e90d168 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:22.635775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed8d7ffd-4be7-4af7-ab21-2b407e90d168 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:22.734175 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ed8d7ffd-4be7-4af7-ab21-2b407e90d168 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 14 microversion: 2.42 time: 0.122505 Jan 22 21:07:22.737941 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1161/2463] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:22 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:22.912636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1dc1d4c6-11af-4e80-9fda-703d08ce1f43 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:22.913856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1dc1d4c6-11af-4e80-9fda-703d08ce1f43 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:22.922971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1dc1d4c6-11af-4e80-9fda-703d08ce1f43 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:22.925350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1dc1d4c6-11af-4e80-9fda-703d08ce1f43 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:22.926435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1dc1d4c6-11af-4e80-9fda-703d08ce1f43 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:22.927676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1dc1d4c6-11af-4e80-9fda-703d08ce1f43 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:23.044348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-650299665", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:23.134654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:07:23.413426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1dc1d4c6-11af-4e80-9fda-703d08ce1f43 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:23.421827 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1dc1d4c6-11af-4e80-9fda-703d08ce1f43 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1476 microversion: 2.1 time: 0.515220 Jan 22 21:07:23.438873 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1162/2464] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:22 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1476 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:23.707123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:07:23.709118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:07:23.709914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:07:23.710610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:07:23.711283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:07:23.728005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:23.731763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:23.732796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:23.733979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:23.746331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e0489b8c-f01c-4488-b1e3-958fdeb27b1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:23.747453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e0489b8c-f01c-4488-b1e3-958fdeb27b1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:23.774016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0489b8c-f01c-4488-b1e3-958fdeb27b1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:23.775015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0489b8c-f01c-4488-b1e3-958fdeb27b1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:23.777998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0489b8c-f01c-4488-b1e3-958fdeb27b1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:23.782302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0489b8c-f01c-4488-b1e3-958fdeb27b1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:23.810418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:23.826095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:23.872415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:07:23.881964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:07:23.897566 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e0489b8c-f01c-4488-b1e3-958fdeb27b1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 14 microversion: 2.42 time: 0.154816 Jan 22 21:07:23.902152 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1163/2465] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:23 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:24.054433 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5af24be0-3856-47fa-a217-70aaaf66b588 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.223661 Jan 22 21:07:24.057777 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1303/2466] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:07:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:07:24.068451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2245471a-42f1-4456-945d-abdf10718b45 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:24.069271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2245471a-42f1-4456-945d-abdf10718b45 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:24.178566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2245471a-42f1-4456-945d-abdf10718b45 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:24.191544 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2245471a-42f1-4456-945d-abdf10718b45 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1220 microversion: 2.1 time: 0.126406 Jan 22 21:07:24.194734 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1164/2467] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:24 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1220 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:24.450503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-103ecbc5-333a-4635-8561-dbee1bf35540 req-9a8c299d-3cc7-4bee-bcd5-90f024daa2cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b31384bb-6cc1-45a4-a067-92ac3713ef55", "name": "network-vif-deleted", "tag": "493297bc-3a80-4965-b414-e858560483fb"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:24.450931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d4b9c255-b7c3-4546-a2a3-445f5f97ffd2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:24.451933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d4b9c255-b7c3-4546-a2a3-445f5f97ffd2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:24.454836 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:24.454836 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:07:24.505096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4b9c255-b7c3-4546-a2a3-445f5f97ffd2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:24.508041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4b9c255-b7c3-4546-a2a3-445f5f97ffd2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:24.511177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-103ecbc5-333a-4635-8561-dbee1bf35540 req-9a8c299d-3cc7-4bee-bcd5-90f024daa2cf service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:24.512290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4b9c255-b7c3-4546-a2a3-445f5f97ffd2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:24.516513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4b9c255-b7c3-4546-a2a3-445f5f97ffd2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:24.517875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-103ecbc5-333a-4635-8561-dbee1bf35540 req-9a8c299d-3cc7-4bee-bcd5-90f024daa2cf service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:24.565827 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-103ecbc5-333a-4635-8561-dbee1bf35540 req-9a8c299d-3cc7-4bee-bcd5-90f024daa2cf service nova] Creating event network-vif-deleted:493297bc-3a80-4965-b414-e858560483fb for instance b31384bb-6cc1-45a4-a067-92ac3713ef55 on nch1-master-1 Jan 22 21:07:24.589575 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-103ecbc5-333a-4635-8561-dbee1bf35540 req-9a8c299d-3cc7-4bee-bcd5-90f024daa2cf service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142836 Jan 22 21:07:24.591850 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1165/2468] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:24.678287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d4b9c255-b7c3-4546-a2a3-445f5f97ffd2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a549e49cc361449bb5564446c4da0781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f284a3408a5405c846c300e8b9b2db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:24.688399 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d4b9c255-b7c3-4546-a2a3-445f5f97ffd2 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 200 len: 1434 microversion: 2.1 time: 0.248354 Jan 22 21:07:24.700466 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1304/2469] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:24 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 1434 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:24.932095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-518a78b0-7b07-47be-a4b5-0ed2edc131de tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:24.934901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-518a78b0-7b07-47be-a4b5-0ed2edc131de tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:24.955927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-518a78b0-7b07-47be-a4b5-0ed2edc131de tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:24.959322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-518a78b0-7b07-47be-a4b5-0ed2edc131de tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:24.961796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-518a78b0-7b07-47be-a4b5-0ed2edc131de tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:24.963462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-518a78b0-7b07-47be-a4b5-0ed2edc131de tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:25.064251 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-518a78b0-7b07-47be-a4b5-0ed2edc131de tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 14 microversion: 2.42 time: 0.151311 Jan 22 21:07:25.065878 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1166/2470] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:24 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:25.211554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-96481780-366a-47fc-8e3c-70c62b7befda tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:25.212185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-96481780-366a-47fc-8e3c-70c62b7befda tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:25.336142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-96481780-366a-47fc-8e3c-70c62b7befda tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:25.348776 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-96481780-366a-47fc-8e3c-70c62b7befda tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1220 microversion: 2.1 time: 0.139202 Jan 22 21:07:25.359201 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1305/2471] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:25 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1220 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:25.707112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a6262280-3a15-435f-a582-cb2e9efbd0f7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:25.708831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a6262280-3a15-435f-a582-cb2e9efbd0f7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] [instance: b31384bb-6cc1-45a4-a067-92ac3713ef55] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:25.719150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6262280-3a15-435f-a582-cb2e9efbd0f7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:25.720591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6262280-3a15-435f-a582-cb2e9efbd0f7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:25.721596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6262280-3a15-435f-a582-cb2e9efbd0f7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:25.722294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6262280-3a15-435f-a582-cb2e9efbd0f7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:25.746458 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-a6262280-3a15-435f-a582-cb2e9efbd0f7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] HTTP exception thrown: Instance b31384bb-6cc1-45a4-a067-92ac3713ef55 could not be found. Jan 22 21:07:25.747703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a6262280-3a15-435f-a582-cb2e9efbd0f7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] Returning 404 to user: Instance b31384bb-6cc1-45a4-a067-92ac3713ef55 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:25.749325 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a6262280-3a15-435f-a582-cb2e9efbd0f7 tempest-ImagesOneServerTestJSON-2084182901 tempest-ImagesOneServerTestJSON-2084182901-project] 10.222.0.100 "GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55" status: 404 len: 111 microversion: 2.1 time: 0.046278 Jan 22 21:07:25.753328 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1167/2472] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:25 2022] GET /compute/v2.1/servers/b31384bb-6cc1-45a4-a067-92ac3713ef55 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:07:26.077227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aefefadd-de8c-4c2f-9ed3-f1c713cba117 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:26.078619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aefefadd-de8c-4c2f-9ed3-f1c713cba117 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:26.090851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aefefadd-de8c-4c2f-9ed3-f1c713cba117 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:26.091669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aefefadd-de8c-4c2f-9ed3-f1c713cba117 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:26.092690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aefefadd-de8c-4c2f-9ed3-f1c713cba117 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:26.093333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aefefadd-de8c-4c2f-9ed3-f1c713cba117 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:26.215515 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aefefadd-de8c-4c2f-9ed3-f1c713cba117 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 14 microversion: 2.42 time: 0.142383 Jan 22 21:07:26.222369 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1306/2473] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:26 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:26.366887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bcb3c56e-6eb8-4d05-99ec-36dd56f24fde tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:26.367608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bcb3c56e-6eb8-4d05-99ec-36dd56f24fde tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:26.378145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcb3c56e-6eb8-4d05-99ec-36dd56f24fde tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:26.380211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcb3c56e-6eb8-4d05-99ec-36dd56f24fde tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:26.383420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcb3c56e-6eb8-4d05-99ec-36dd56f24fde tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:26.384756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcb3c56e-6eb8-4d05-99ec-36dd56f24fde tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:26.485627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bcb3c56e-6eb8-4d05-99ec-36dd56f24fde tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:26.494914 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bcb3c56e-6eb8-4d05-99ec-36dd56f24fde tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1272 microversion: 2.1 time: 0.132896 Jan 22 21:07:26.496930 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1168/2474] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:26 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:27.238639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5def1036-eabc-40e1-9ab8-f51c9021e6d1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:27.238639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5def1036-eabc-40e1-9ab8-f51c9021e6d1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:27.240689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5def1036-eabc-40e1-9ab8-f51c9021e6d1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:27.240689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5def1036-eabc-40e1-9ab8-f51c9021e6d1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:27.241423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5def1036-eabc-40e1-9ab8-f51c9021e6d1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:27.241909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5def1036-eabc-40e1-9ab8-f51c9021e6d1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:27.294970 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5def1036-eabc-40e1-9ab8-f51c9021e6d1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 8205 microversion: 2.42 time: 0.067818 Jan 22 21:07:27.296300 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1307/2475] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:27 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 8205 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:27.512198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ee437cc-fb3b-4729-b49a-f1731debf971 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:27.512749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3ee437cc-fb3b-4729-b49a-f1731debf971 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:27.524201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ee437cc-fb3b-4729-b49a-f1731debf971 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:27.524682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ee437cc-fb3b-4729-b49a-f1731debf971 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:27.527300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ee437cc-fb3b-4729-b49a-f1731debf971 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:27.529457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ee437cc-fb3b-4729-b49a-f1731debf971 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:27.653600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3ee437cc-fb3b-4729-b49a-f1731debf971 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:27.663670 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3ee437cc-fb3b-4729-b49a-f1731debf971 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1290 microversion: 2.1 time: 0.154041 Jan 22 21:07:27.664905 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1169/2476] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:27 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1290 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:28.307411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dfd804c9-47e3-4973-942c-c65d7bd3cd23 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:28.314487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dfd804c9-47e3-4973-942c-c65d7bd3cd23 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:28.315545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfd804c9-47e3-4973-942c-c65d7bd3cd23 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:28.315998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfd804c9-47e3-4973-942c-c65d7bd3cd23 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:28.327497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfd804c9-47e3-4973-942c-c65d7bd3cd23 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:28.328128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfd804c9-47e3-4973-942c-c65d7bd3cd23 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:28.425787 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dfd804c9-47e3-4973-942c-c65d7bd3cd23 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 16389 microversion: 2.42 time: 0.122231 Jan 22 21:07:28.428080 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1308/2477] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:28 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 16389 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:28.680122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4100d184-9435-4a22-a239-f40bc753290b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:28.680834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4100d184-9435-4a22-a239-f40bc753290b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:28.703785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4100d184-9435-4a22-a239-f40bc753290b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:28.703785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4100d184-9435-4a22-a239-f40bc753290b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:28.703785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4100d184-9435-4a22-a239-f40bc753290b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:28.703785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4100d184-9435-4a22-a239-f40bc753290b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:28.843975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4100d184-9435-4a22-a239-f40bc753290b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:28.855343 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4100d184-9435-4a22-a239-f40bc753290b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1278 microversion: 2.1 time: 0.178685 Jan 22 21:07:28.859733 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1170/2478] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:28 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:29.438830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ced698a0-4be9-415a-9b03-388819e5b7f7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:29.440045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ced698a0-4be9-415a-9b03-388819e5b7f7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:29.453590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ced698a0-4be9-415a-9b03-388819e5b7f7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:29.455170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ced698a0-4be9-415a-9b03-388819e5b7f7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:29.456107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ced698a0-4be9-415a-9b03-388819e5b7f7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:29.456560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ced698a0-4be9-415a-9b03-388819e5b7f7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:29.509752 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ced698a0-4be9-415a-9b03-388819e5b7f7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 16389 microversion: 2.42 time: 0.073820 Jan 22 21:07:29.512219 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1309/2479] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:29 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 16389 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:29.877932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4f6e0ab7-7123-44f8-9250-841e09e6a235 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:29.878792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4f6e0ab7-7123-44f8-9250-841e09e6a235 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:29.894622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6e0ab7-7123-44f8-9250-841e09e6a235 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:29.901607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6e0ab7-7123-44f8-9250-841e09e6a235 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:29.901607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6e0ab7-7123-44f8-9250-841e09e6a235 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:29.901607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6e0ab7-7123-44f8-9250-841e09e6a235 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:30.438673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4f6e0ab7-7123-44f8-9250-841e09e6a235 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:30.455613 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4f6e0ab7-7123-44f8-9250-841e09e6a235 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1320 microversion: 2.1 time: 0.580180 Jan 22 21:07:30.458395 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1171/2480] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:29 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1320 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:30.533077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c47b0885-de49-4027-a521-77e6f66d02c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:30.538065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c47b0885-de49-4027-a521-77e6f66d02c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:30.551371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c47b0885-de49-4027-a521-77e6f66d02c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:30.552965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c47b0885-de49-4027-a521-77e6f66d02c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:30.555830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c47b0885-de49-4027-a521-77e6f66d02c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:30.561484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c47b0885-de49-4027-a521-77e6f66d02c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:30.618366 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c47b0885-de49-4027-a521-77e6f66d02c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 16389 microversion: 2.42 time: 0.098206 Jan 22 21:07:30.619098 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1172/2481] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:30 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 16389 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:30.696576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2105427942", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "d59ba9cb-222f-46f0-b48e-da0ecf00b69a"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:30.806325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] validate_networks() for [('d59ba9cb-222f-46f0-b48e-da0ecf00b69a', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:07:31.346480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-181529df-e018-441e-9508-03b8a14d263e req-dbd08d10-5082-46c2-bd03-feeeef44cdb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eef2b3f-a335-4858-b070-58323035fc67", "tag": "25c44702-051d-45ed-8fe0-3080819d71a3"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:31.346480 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:31.346480 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:07:31.357836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-181529df-e018-441e-9508-03b8a14d263e req-dbd08d10-5082-46c2-bd03-feeeef44cdb1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:31.358581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-181529df-e018-441e-9508-03b8a14d263e req-dbd08d10-5082-46c2-bd03-feeeef44cdb1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:31.384017 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-181529df-e018-441e-9508-03b8a14d263e req-dbd08d10-5082-46c2-bd03-feeeef44cdb1 service nova] Creating event network-changed:25c44702-051d-45ed-8fe0-3080819d71a3 for instance 7eef2b3f-a335-4858-b070-58323035fc67 on nch1-master-1 Jan 22 21:07:31.396788 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-181529df-e018-441e-9508-03b8a14d263e req-dbd08d10-5082-46c2-bd03-feeeef44cdb1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063561 Jan 22 21:07:31.399648 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1173/2482] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:31.478441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c58399ca-1758-4d20-bd25-046aee64685d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:31.479491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c58399ca-1758-4d20-bd25-046aee64685d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:31.500381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c58399ca-1758-4d20-bd25-046aee64685d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:31.501115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c58399ca-1758-4d20-bd25-046aee64685d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:31.502859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c58399ca-1758-4d20-bd25-046aee64685d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:31.503488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c58399ca-1758-4d20-bd25-046aee64685d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:31.619517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:07:31.620295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:07:31.621877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:07:31.622471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:07:31.623278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:07:31.654617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:31.655334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:31.657196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:31.658819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:31.707716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Getting quotas for project 6cf62f435d904da7baa190b53458bb60. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:31.733282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Getting quotas for user a6768bb5c11a4bbd85871d812925174f and project 6cf62f435d904da7baa190b53458bb60. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:31.776057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Going to run 2 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:07:31.778518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: b59794d9-d980-4e57-b3c4-d72dbad2792f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:07:31.985982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=b59794d9-d980-4e57-b3c4-d72dbad2792f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:07:32.182135 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a51e6af2-254a-4e30-a72c-5416e39c56e1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.957948 Jan 22 21:07:32.183155 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1310/2483] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:07:30 2022] POST /compute/v2.1/servers => generated 382 bytes in 1960 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:07:32.189913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8ad4d63a-8422-4568-b9c5-f7a7c97e3eb2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:32.191150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8ad4d63a-8422-4568-b9c5-f7a7c97e3eb2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:32.216797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ad4d63a-8422-4568-b9c5-f7a7c97e3eb2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:32.218642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ad4d63a-8422-4568-b9c5-f7a7c97e3eb2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:32.225238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ad4d63a-8422-4568-b9c5-f7a7c97e3eb2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:32.226002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ad4d63a-8422-4568-b9c5-f7a7c97e3eb2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:32.328151 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8ad4d63a-8422-4568-b9c5-f7a7c97e3eb2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 16389 microversion: 2.42 time: 0.143706 Jan 22 21:07:32.331534 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1311/2484] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:32 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 16389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:32.342684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e609fa58-c61f-4cf5-a493-8ea8e0439305 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:32.359738 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:32.359738 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:32.361583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e609fa58-c61f-4cf5-a493-8ea8e0439305 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:32.363617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e609fa58-c61f-4cf5-a493-8ea8e0439305 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Searching by: {'deleted': False, 'project_id': '6cf62f435d904da7baa190b53458bb60'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:07:32.433553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e609fa58-c61f-4cf5-a493-8ea8e0439305 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:32.434320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e609fa58-c61f-4cf5-a493-8ea8e0439305 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:32.435433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e609fa58-c61f-4cf5-a493-8ea8e0439305 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:32.435907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e609fa58-c61f-4cf5-a493-8ea8e0439305 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:32.484437 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e609fa58-c61f-4cf5-a493-8ea8e0439305 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.146501 Jan 22 21:07:32.487011 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1312/2485] 10.222.0.100 () {58 vars in 1129 bytes} [Sat Jan 22 21:07:32 2022] GET /compute/v2.1/servers => generated 681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:32.585732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c58399ca-1758-4d20-bd25-046aee64685d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:32.600852 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c58399ca-1758-4d20-bd25-046aee64685d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1320 microversion: 2.1 time: 1.127193 Jan 22 21:07:32.606579 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1174/2486] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:31 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1320 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:32.620795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-486d5086-ca73-4cbf-af8e-1932981724cd tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:32.622691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-486d5086-ca73-4cbf-af8e-1932981724cd tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:32.708217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1c09791c-3015-4bda-9848-1a9714928b4c tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-2031949344", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": "none"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:32.809458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-486d5086-ca73-4cbf-af8e-1932981724cd tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:32.820645 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-486d5086-ca73-4cbf-af8e-1932981724cd tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1224 microversion: 2.1 time: 0.212274 Jan 22 21:07:32.821990 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1175/2487] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:32 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1224 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:32.885205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-1c09791c-3015-4bda-9848-1a9714928b4c tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:07:32.887370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-1c09791c-3015-4bda-9848-1a9714928b4c tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:07:32.888189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-1c09791c-3015-4bda-9848-1a9714928b4c tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:07:32.888720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-1c09791c-3015-4bda-9848-1a9714928b4c tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:07:32.889249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-1c09791c-3015-4bda-9848-1a9714928b4c tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:07:32.933452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c09791c-3015-4bda-9848-1a9714928b4c tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:32.937215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c09791c-3015-4bda-9848-1a9714928b4c tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:32.938723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c09791c-3015-4bda-9848-1a9714928b4c tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:32.939486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c09791c-3015-4bda-9848-1a9714928b4c tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:32.999214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-1c09791c-3015-4bda-9848-1a9714928b4c tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Getting quotas for project 89785746f8d04eea85fd092ad4a9566f. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:33.013890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-1c09791c-3015-4bda-9848-1a9714928b4c tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Getting quotas for user 614513123ab2499fa3fcc1401edaf272 and project 89785746f8d04eea85fd092ad4a9566f. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:33.058988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1c09791c-3015-4bda-9848-1a9714928b4c tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:07:33.066842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1c09791c-3015-4bda-9848-1a9714928b4c tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:07:33.296328 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1c09791c-3015-4bda-9848-1a9714928b4c tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.57 time: 0.803501 Jan 22 21:07:33.318194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff30fd0c-1839-42db-bbaf-ce3acaff8c4a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:33.319342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ff30fd0c-1839-42db-bbaf-ce3acaff8c4a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:33.325474 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1313/2488] 10.222.0.100 () {62 vars in 1192 bytes} [Sat Jan 22 21:07:32 2022] POST /compute/v2.1/servers => generated 382 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 22 21:07:33.350096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cdc3ed1c-5e88-44d4-95b6-d3317504e95d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:33.354288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cdc3ed1c-5e88-44d4-95b6-d3317504e95d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:33.376049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cdc3ed1c-5e88-44d4-95b6-d3317504e95d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:33.380633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cdc3ed1c-5e88-44d4-95b6-d3317504e95d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:33.383579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cdc3ed1c-5e88-44d4-95b6-d3317504e95d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:33.387284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cdc3ed1c-5e88-44d4-95b6-d3317504e95d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:33.491540 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cdc3ed1c-5e88-44d4-95b6-d3317504e95d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.152202 Jan 22 21:07:33.496419 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1314/2489] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:33 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:07:33.625279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ffd69c6b-550e-4d5a-ab70-23040b375af4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:33.626168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ffd69c6b-550e-4d5a-ab70-23040b375af4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:33.643996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffd69c6b-550e-4d5a-ab70-23040b375af4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:33.646528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffd69c6b-550e-4d5a-ab70-23040b375af4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:33.650306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffd69c6b-550e-4d5a-ab70-23040b375af4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:33.651350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffd69c6b-550e-4d5a-ab70-23040b375af4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:33.767606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ff30fd0c-1839-42db-bbaf-ce3acaff8c4a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:33.784544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ff30fd0c-1839-42db-bbaf-ce3acaff8c4a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:33.788784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ff30fd0c-1839-42db-bbaf-ce3acaff8c4a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:33.791767 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff30fd0c-1839-42db-bbaf-ce3acaff8c4a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1281 microversion: 2.57 time: 0.481011 Jan 22 21:07:33.795266 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1176/2490] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:33 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1281 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:33.980136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ffd69c6b-550e-4d5a-ab70-23040b375af4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:33.991091 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ffd69c6b-550e-4d5a-ab70-23040b375af4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1320 microversion: 2.1 time: 0.370955 Jan 22 21:07:33.991884 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1315/2491] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:33 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:33.998501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4dcc5e92-208d-4e59-8b24-a638f24ad140 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:33.999141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4dcc5e92-208d-4e59-8b24-a638f24ad140 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:34.098855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4dcc5e92-208d-4e59-8b24-a638f24ad140 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:34.105022 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4dcc5e92-208d-4e59-8b24-a638f24ad140 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1224 microversion: 2.1 time: 0.110022 Jan 22 21:07:34.105630 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1316/2492] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:33 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:34.113690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2949278", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "7ce76187-2d78-4b40-aca9-2d20e9d4107b"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:34.209375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] validate_networks() for [('7ce76187-2d78-4b40-aca9-2d20e9d4107b', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:07:34.505996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c2ee1956-bde6-40f6-913a-533e1a403f25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:34.510381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c2ee1956-bde6-40f6-913a-533e1a403f25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:34.522746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2ee1956-bde6-40f6-913a-533e1a403f25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:34.524424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2ee1956-bde6-40f6-913a-533e1a403f25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:34.525710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2ee1956-bde6-40f6-913a-533e1a403f25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:34.526984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2ee1956-bde6-40f6-913a-533e1a403f25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:34.602655 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c2ee1956-bde6-40f6-913a-533e1a403f25 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.102394 Jan 22 21:07:34.603521 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1317/2493] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:34 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:07:34.836604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0143c9cf-fede-4f1b-9a75-78deeaecdf8f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:34.836604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0143c9cf-fede-4f1b-9a75-78deeaecdf8f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:34.859322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0143c9cf-fede-4f1b-9a75-78deeaecdf8f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:34.862077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0143c9cf-fede-4f1b-9a75-78deeaecdf8f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:34.863454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0143c9cf-fede-4f1b-9a75-78deeaecdf8f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:34.864137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0143c9cf-fede-4f1b-9a75-78deeaecdf8f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:34.885663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:07:34.886293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:07:34.886574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:07:34.887152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:07:34.887593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:07:34.901496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:34.902143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:34.903006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:34.903944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:34.929332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Getting quotas for project bfedf205c9e44aa1989b307d2b400b50. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:34.935486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Getting quotas for user e63df9a38aaf47338df65d3bf0d5aa81 and project bfedf205c9e44aa1989b307d2b400b50. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:34.953278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:07:34.956660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:07:34.964676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0143c9cf-fede-4f1b-9a75-78deeaecdf8f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:34.976470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0143c9cf-fede-4f1b-9a75-78deeaecdf8f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:34.979734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0143c9cf-fede-4f1b-9a75-78deeaecdf8f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:34.981438 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0143c9cf-fede-4f1b-9a75-78deeaecdf8f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1285 microversion: 2.57 time: 0.167949 Jan 22 21:07:34.986112 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1318/2494] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:34 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:35.008901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fc1d99a5-b05f-4b6a-abdf-b7cb02a14d99 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:35.010018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fc1d99a5-b05f-4b6a-abdf-b7cb02a14d99 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:35.022659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc1d99a5-b05f-4b6a-abdf-b7cb02a14d99 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:35.024099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc1d99a5-b05f-4b6a-abdf-b7cb02a14d99 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:35.025579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc1d99a5-b05f-4b6a-abdf-b7cb02a14d99 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:35.026598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc1d99a5-b05f-4b6a-abdf-b7cb02a14d99 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:35.159610 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-514a03cd-30c6-45a9-a3de-d072eb28be0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.361359 Jan 22 21:07:35.161831 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1177/2495] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:07:33 2022] POST /compute/v2.1/servers => generated 382 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:07:35.172489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f39e04db-cb28-43a8-882e-892d7d141fab tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:35.173608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f39e04db-cb28-43a8-882e-892d7d141fab tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:35.182739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f39e04db-cb28-43a8-882e-892d7d141fab tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:35.183848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f39e04db-cb28-43a8-882e-892d7d141fab tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:35.187371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f39e04db-cb28-43a8-882e-892d7d141fab tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:35.187371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f39e04db-cb28-43a8-882e-892d7d141fab tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:35.278482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f39e04db-cb28-43a8-882e-892d7d141fab tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:35.292518 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f39e04db-cb28-43a8-882e-892d7d141fab tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1228 microversion: 2.1 time: 0.123397 Jan 22 21:07:35.294797 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1178/2496] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:35 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1228 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:35.303510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-670c77a1-50d1-42e2-9381-06a8bfddd4ac tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:35.306942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-670c77a1-50d1-42e2-9381-06a8bfddd4ac tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:35.424856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-670c77a1-50d1-42e2-9381-06a8bfddd4ac tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:35.437081 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-670c77a1-50d1-42e2-9381-06a8bfddd4ac tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1226 microversion: 2.1 time: 0.136858 Jan 22 21:07:35.437081 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1179/2497] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:35 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1226 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:35.591939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fc1d99a5-b05f-4b6a-abdf-b7cb02a14d99 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:35.601918 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fc1d99a5-b05f-4b6a-abdf-b7cb02a14d99 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1320 microversion: 2.1 time: 0.597636 Jan 22 21:07:35.610006 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1319/2498] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:35 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1320 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:07:35.617273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c3e149ae-e5dc-443a-a30e-2ed7c753156f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:35.618419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c3e149ae-e5dc-443a-a30e-2ed7c753156f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:35.634088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3e149ae-e5dc-443a-a30e-2ed7c753156f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:35.636345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3e149ae-e5dc-443a-a30e-2ed7c753156f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:35.637480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3e149ae-e5dc-443a-a30e-2ed7c753156f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:35.642086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3e149ae-e5dc-443a-a30e-2ed7c753156f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:35.706370 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c3e149ae-e5dc-443a-a30e-2ed7c753156f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.094185 Jan 22 21:07:35.709038 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1180/2499] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:35 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:36.001388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-49379366-9fb9-43ac-9c54-65db71e6d214 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:36.002186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-49379366-9fb9-43ac-9c54-65db71e6d214 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:36.011463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49379366-9fb9-43ac-9c54-65db71e6d214 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:36.011926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49379366-9fb9-43ac-9c54-65db71e6d214 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:36.012789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49379366-9fb9-43ac-9c54-65db71e6d214 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:36.013246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49379366-9fb9-43ac-9c54-65db71e6d214 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:36.138387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-49379366-9fb9-43ac-9c54-65db71e6d214 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:36.164646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-49379366-9fb9-43ac-9c54-65db71e6d214 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:36.167801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-49379366-9fb9-43ac-9c54-65db71e6d214 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:36.169580 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-49379366-9fb9-43ac-9c54-65db71e6d214 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1333 microversion: 2.57 time: 0.172684 Jan 22 21:07:36.170732 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1320/2500] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:35 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1333 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:36.313235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7b44a45b-c72a-4d58-8efc-07d4afc6da9e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:36.314823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7b44a45b-c72a-4d58-8efc-07d4afc6da9e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:36.325763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b44a45b-c72a-4d58-8efc-07d4afc6da9e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:36.326594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b44a45b-c72a-4d58-8efc-07d4afc6da9e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:36.328059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b44a45b-c72a-4d58-8efc-07d4afc6da9e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:36.328744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b44a45b-c72a-4d58-8efc-07d4afc6da9e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:36.451789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-51014091-181a-4b0c-b7ff-b265a67a524b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:36.452523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-51014091-181a-4b0c-b7ff-b265a67a524b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:36.462494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7b44a45b-c72a-4d58-8efc-07d4afc6da9e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:36.477116 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7b44a45b-c72a-4d58-8efc-07d4afc6da9e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1276 microversion: 2.1 time: 0.169114 Jan 22 21:07:36.481418 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1181/2501] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:36 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:36.546647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-51014091-181a-4b0c-b7ff-b265a67a524b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:36.562021 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-51014091-181a-4b0c-b7ff-b265a67a524b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1226 microversion: 2.1 time: 0.114087 Jan 22 21:07:36.575691 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1321/2502] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:36 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1226 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:07:36.627462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-22de5114-b439-4df5-a19e-47c3c2632c95 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:36.630949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-22de5114-b439-4df5-a19e-47c3c2632c95 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:36.651385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22de5114-b439-4df5-a19e-47c3c2632c95 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:36.653767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22de5114-b439-4df5-a19e-47c3c2632c95 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:36.654257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22de5114-b439-4df5-a19e-47c3c2632c95 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:36.654732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22de5114-b439-4df5-a19e-47c3c2632c95 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:36.699714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-51014091-181a-4b0c-b7ff-b265a67a524b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:36.700771 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-51014091-181a-4b0c-b7ff-b265a67a524b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute//" status: 200 len: 379 microversion: - time: 0.001418 Jan 22 21:07:36.701180 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1322/2503] 10.222.0.100 () {56 vars in 890 bytes} [Sat Jan 22 21:07:36 2022] GET /compute/ => generated 379 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jan 22 21:07:36.719837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-52589cef-e7f8-4a60-a18e-3ae96fbef08f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:36.720907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-52589cef-e7f8-4a60-a18e-3ae96fbef08f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:36.742143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52589cef-e7f8-4a60-a18e-3ae96fbef08f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:36.755796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52589cef-e7f8-4a60-a18e-3ae96fbef08f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:36.757262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52589cef-e7f8-4a60-a18e-3ae96fbef08f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:36.757521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52589cef-e7f8-4a60-a18e-3ae96fbef08f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:36.858552 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-52589cef-e7f8-4a60-a18e-3ae96fbef08f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.142283 Jan 22 21:07:36.865155 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1323/2504] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:36 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:07:37.060964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-22de5114-b439-4df5-a19e-47c3c2632c95 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:37.069618 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-22de5114-b439-4df5-a19e-47c3c2632c95 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1320 microversion: 2.1 time: 0.451471 Jan 22 21:07:37.073937 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1182/2505] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:36 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1320 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:37.189768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3fe883a9-7aab-4ff7-9f36-016ca04c10d3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:37.198004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3fe883a9-7aab-4ff7-9f36-016ca04c10d3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:37.199369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fe883a9-7aab-4ff7-9f36-016ca04c10d3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:37.199892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fe883a9-7aab-4ff7-9f36-016ca04c10d3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:37.200945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fe883a9-7aab-4ff7-9f36-016ca04c10d3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:37.201658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fe883a9-7aab-4ff7-9f36-016ca04c10d3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:37.382924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3fe883a9-7aab-4ff7-9f36-016ca04c10d3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:37.407539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3fe883a9-7aab-4ff7-9f36-016ca04c10d3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:37.411398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3fe883a9-7aab-4ff7-9f36-016ca04c10d3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:37.413760 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3fe883a9-7aab-4ff7-9f36-016ca04c10d3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1351 microversion: 2.57 time: 0.227393 Jan 22 21:07:37.414545 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1324/2506] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:37 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1351 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:37.497204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7eeb29b2-143a-40f9-94e2-ef0b4ada2fd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:37.499394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7eeb29b2-143a-40f9-94e2-ef0b4ada2fd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:37.520677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7eeb29b2-143a-40f9-94e2-ef0b4ada2fd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:37.523597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7eeb29b2-143a-40f9-94e2-ef0b4ada2fd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:37.527292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7eeb29b2-143a-40f9-94e2-ef0b4ada2fd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:37.529294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7eeb29b2-143a-40f9-94e2-ef0b4ada2fd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:37.591987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-00cab3c4-bcda-4ed4-a389-6cd2aa851310 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:37.592882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-00cab3c4-bcda-4ed4-a389-6cd2aa851310 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:37.604853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00cab3c4-bcda-4ed4-a389-6cd2aa851310 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:37.605319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00cab3c4-bcda-4ed4-a389-6cd2aa851310 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:37.607424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00cab3c4-bcda-4ed4-a389-6cd2aa851310 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:37.616857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00cab3c4-bcda-4ed4-a389-6cd2aa851310 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:37.749842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-00cab3c4-bcda-4ed4-a389-6cd2aa851310 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:37.764477 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-00cab3c4-bcda-4ed4-a389-6cd2aa851310 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1278 microversion: 2.1 time: 0.176060 Jan 22 21:07:37.766497 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1325/2507] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:37 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:37.779561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7eeb29b2-143a-40f9-94e2-ef0b4ada2fd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:37.789101 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7eeb29b2-143a-40f9-94e2-ef0b4ada2fd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1294 microversion: 2.1 time: 0.296489 Jan 22 21:07:37.800041 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1183/2508] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:37 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1294 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:37.874043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d291afb9-0e0e-441a-90e9-da3e76bfa39e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:37.875375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d291afb9-0e0e-441a-90e9-da3e76bfa39e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:37.885426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d291afb9-0e0e-441a-90e9-da3e76bfa39e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:37.886233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d291afb9-0e0e-441a-90e9-da3e76bfa39e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:37.887426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d291afb9-0e0e-441a-90e9-da3e76bfa39e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:37.888413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d291afb9-0e0e-441a-90e9-da3e76bfa39e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:37.948607 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d291afb9-0e0e-441a-90e9-da3e76bfa39e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.079618 Jan 22 21:07:37.954848 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1326/2509] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:37 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:38.095200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-631a2a21-e8e9-4616-80e6-1b79738c5c07 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:38.098532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-631a2a21-e8e9-4616-80e6-1b79738c5c07 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:38.120154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-631a2a21-e8e9-4616-80e6-1b79738c5c07 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:38.123103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-631a2a21-e8e9-4616-80e6-1b79738c5c07 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:38.127743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-631a2a21-e8e9-4616-80e6-1b79738c5c07 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:38.128890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-631a2a21-e8e9-4616-80e6-1b79738c5c07 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:38.435686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cb565f0b-a758-4f4f-9393-2be431a8f3f3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:38.437196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cb565f0b-a758-4f4f-9393-2be431a8f3f3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:38.462168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb565f0b-a758-4f4f-9393-2be431a8f3f3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:38.462663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb565f0b-a758-4f4f-9393-2be431a8f3f3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:38.471498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb565f0b-a758-4f4f-9393-2be431a8f3f3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:38.472538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb565f0b-a758-4f4f-9393-2be431a8f3f3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:38.648839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cb565f0b-a758-4f4f-9393-2be431a8f3f3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:38.667099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cb565f0b-a758-4f4f-9393-2be431a8f3f3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:38.669111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cb565f0b-a758-4f4f-9393-2be431a8f3f3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:38.670565 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cb565f0b-a758-4f4f-9393-2be431a8f3f3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1339 microversion: 2.57 time: 0.240769 Jan 22 21:07:38.685183 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1327/2510] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:38 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1339 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:38.782559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d8ae768f-d1b0-4156-85fc-a136d229dca3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:38.783129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d8ae768f-d1b0-4156-85fc-a136d229dca3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:38.795607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8ae768f-d1b0-4156-85fc-a136d229dca3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:38.796354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8ae768f-d1b0-4156-85fc-a136d229dca3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:38.797358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8ae768f-d1b0-4156-85fc-a136d229dca3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:38.798384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8ae768f-d1b0-4156-85fc-a136d229dca3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:38.979692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d8ae768f-d1b0-4156-85fc-a136d229dca3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:38.999142 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d8ae768f-d1b0-4156-85fc-a136d229dca3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1296 microversion: 2.1 time: 0.221086 Jan 22 21:07:39.009911 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1328/2511] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:38 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1296 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:07:39.015422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-702c1fb4-4e5f-43a6-9242-f673eed35fd9 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:39.019462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-702c1fb4-4e5f-43a6-9242-f673eed35fd9 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:39.025032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-702c1fb4-4e5f-43a6-9242-f673eed35fd9 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:39.025794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-702c1fb4-4e5f-43a6-9242-f673eed35fd9 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:39.027926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-702c1fb4-4e5f-43a6-9242-f673eed35fd9 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:39.028573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-702c1fb4-4e5f-43a6-9242-f673eed35fd9 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:39.153490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-631a2a21-e8e9-4616-80e6-1b79738c5c07 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:39.165649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-702c1fb4-4e5f-43a6-9242-f673eed35fd9 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:39.175151 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-631a2a21-e8e9-4616-80e6-1b79738c5c07 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1320 microversion: 2.1 time: 1.087395 Jan 22 21:07:39.175865 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-702c1fb4-4e5f-43a6-9242-f673eed35fd9 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1282 microversion: 2.1 time: 0.163765 Jan 22 21:07:39.177838 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1184/2512] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:38 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1320 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:39.190786 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1329/2513] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:39 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1282 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:39.225260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc2de6be-0493-4671-8ab1-7fe686ba3df8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:39.225260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bc2de6be-0493-4671-8ab1-7fe686ba3df8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:39.249749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc2de6be-0493-4671-8ab1-7fe686ba3df8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:39.250446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc2de6be-0493-4671-8ab1-7fe686ba3df8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:39.251276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc2de6be-0493-4671-8ab1-7fe686ba3df8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:39.251721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc2de6be-0493-4671-8ab1-7fe686ba3df8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:39.327352 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bc2de6be-0493-4671-8ab1-7fe686ba3df8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.135890 Jan 22 21:07:39.328732 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1185/2514] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:39 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:39.695250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-35b51137-9242-41fd-848f-709c81918a68 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:39.698302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-35b51137-9242-41fd-848f-709c81918a68 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:39.718262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35b51137-9242-41fd-848f-709c81918a68 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:39.718763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35b51137-9242-41fd-848f-709c81918a68 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:39.720041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35b51137-9242-41fd-848f-709c81918a68 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:39.720496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35b51137-9242-41fd-848f-709c81918a68 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:39.779806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f9ffa1d8-f385-401a-895b-907d97f55b2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'create', calling method: .version_select at 0x7f1ed601aee0>, body: {"keypair": {"name": "tempest-keypair-644373818"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:39.800516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f9ffa1d8-f385-401a-895b-907d97f55b2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Getting quotas for project 56d86f3305fd4f6a89443ba40bf2778e. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:39.809130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f9ffa1d8-f385-401a-895b-907d97f55b2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Getting quotas for user cb0f4bdcf5b6411aae7daba6bb727313 and project 56d86f3305fd4f6a89443ba40bf2778e. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:40.034945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f9ffa1d8-f385-401a-895b-907d97f55b2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Getting quotas for project 56d86f3305fd4f6a89443ba40bf2778e. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:40.056450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f9ffa1d8-f385-401a-895b-907d97f55b2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Getting quotas for user cb0f4bdcf5b6411aae7daba6bb727313 and project 56d86f3305fd4f6a89443ba40bf2778e. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:40.085274 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f9ffa1d8-f385-401a-895b-907d97f55b2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.653015 Jan 22 21:07:40.092345 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1330/2515] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:07:39 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:40.097843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4bf9feb3-8d98-4afe-8be6-ec8fc30cf1cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:40.099552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4bf9feb3-8d98-4afe-8be6-ec8fc30cf1cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:40.108009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bf9feb3-8d98-4afe-8be6-ec8fc30cf1cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:40.108736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bf9feb3-8d98-4afe-8be6-ec8fc30cf1cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:40.110048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bf9feb3-8d98-4afe-8be6-ec8fc30cf1cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:40.110808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bf9feb3-8d98-4afe-8be6-ec8fc30cf1cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:40.209192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4bf9feb3-8d98-4afe-8be6-ec8fc30cf1cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:40.220789 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4bf9feb3-8d98-4afe-8be6-ec8fc30cf1cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1284 microversion: 2.1 time: 0.126809 Jan 22 21:07:40.231130 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1331/2516] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:40 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:40.231130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-674cdba5-37c1-4efc-8ba9-7e21a07b6bca tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:40.231730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-674cdba5-37c1-4efc-8ba9-7e21a07b6bca tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:40.256346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-674cdba5-37c1-4efc-8ba9-7e21a07b6bca tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:40.256812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-674cdba5-37c1-4efc-8ba9-7e21a07b6bca tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:40.257685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-674cdba5-37c1-4efc-8ba9-7e21a07b6bca tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:40.259115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-674cdba5-37c1-4efc-8ba9-7e21a07b6bca tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:40.325963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-35b51137-9242-41fd-848f-709c81918a68 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:40.339034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-35b51137-9242-41fd-848f-709c81918a68 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:40.340359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-35b51137-9242-41fd-848f-709c81918a68 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:40.341849 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-35b51137-9242-41fd-848f-709c81918a68 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1339 microversion: 2.57 time: 0.655021 Jan 22 21:07:40.356214 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1186/2517] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:39 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1339 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:40.362251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0982d058-19df-4e02-99fa-16da2f73c9cc tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:40.363088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0982d058-19df-4e02-99fa-16da2f73c9cc tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:40.371178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0982d058-19df-4e02-99fa-16da2f73c9cc tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:40.372127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0982d058-19df-4e02-99fa-16da2f73c9cc tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:40.373115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0982d058-19df-4e02-99fa-16da2f73c9cc tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:40.374012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0982d058-19df-4e02-99fa-16da2f73c9cc tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:40.719147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-674cdba5-37c1-4efc-8ba9-7e21a07b6bca tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:40.732628 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-674cdba5-37c1-4efc-8ba9-7e21a07b6bca tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1320 microversion: 2.1 time: 0.507060 Jan 22 21:07:40.735509 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1332/2518] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:40 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1320 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:40.742275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-212ff3f3-b266-4655-80a4-b1467fb8ed5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:40.743547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-212ff3f3-b266-4655-80a4-b1467fb8ed5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:40.772680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-212ff3f3-b266-4655-80a4-b1467fb8ed5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:40.773161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-212ff3f3-b266-4655-80a4-b1467fb8ed5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:40.778325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-212ff3f3-b266-4655-80a4-b1467fb8ed5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:40.778797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-212ff3f3-b266-4655-80a4-b1467fb8ed5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:40.954725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0982d058-19df-4e02-99fa-16da2f73c9cc tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:40.958736 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-212ff3f3-b266-4655-80a4-b1467fb8ed5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.220252 Jan 22 21:07:40.970994 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1333/2519] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:40 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:40.971340 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0982d058-19df-4e02-99fa-16da2f73c9cc tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1324 microversion: 2.1 time: 0.608999 Jan 22 21:07:40.971608 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1187/2520] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:40 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1324 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:40.988279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-2cfc98e7-4c40-488b-a4cd-3b4e61959b1c req-b75e2e8c-291f-4bf9-b8fe-04971d858028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eef2b3f-a335-4858-b070-58323035fc67", "name": "network-vif-plugged", "status": "completed", "tag": "25c44702-051d-45ed-8fe0-3080819d71a3"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:40.996050 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:40.996050 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:41.016966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2cfc98e7-4c40-488b-a4cd-3b4e61959b1c req-b75e2e8c-291f-4bf9-b8fe-04971d858028 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:41.016966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2cfc98e7-4c40-488b-a4cd-3b4e61959b1c req-b75e2e8c-291f-4bf9-b8fe-04971d858028 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:41.029878 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-2cfc98e7-4c40-488b-a4cd-3b4e61959b1c req-b75e2e8c-291f-4bf9-b8fe-04971d858028 service nova] Creating event network-vif-plugged:25c44702-051d-45ed-8fe0-3080819d71a3 for instance 7eef2b3f-a335-4858-b070-58323035fc67 on nch1-master-1 Jan 22 21:07:41.037156 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-2cfc98e7-4c40-488b-a4cd-3b4e61959b1c req-b75e2e8c-291f-4bf9-b8fe-04971d858028 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068959 Jan 22 21:07:41.038458 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1334/2521] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:41.239507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-89ae7ba6-cb2f-4b09-97df-fe322c4ae222 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:41.240379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-89ae7ba6-cb2f-4b09-97df-fe322c4ae222 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:41.248851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89ae7ba6-cb2f-4b09-97df-fe322c4ae222 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:41.251336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89ae7ba6-cb2f-4b09-97df-fe322c4ae222 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:41.252421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89ae7ba6-cb2f-4b09-97df-fe322c4ae222 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:41.253908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89ae7ba6-cb2f-4b09-97df-fe322c4ae222 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:41.365485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1f68882c-cd13-4a12-876a-80de749a3ec1 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:41.366303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1f68882c-cd13-4a12-876a-80de749a3ec1 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:41.376192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-89ae7ba6-cb2f-4b09-97df-fe322c4ae222 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:41.384023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f68882c-cd13-4a12-876a-80de749a3ec1 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:41.384507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f68882c-cd13-4a12-876a-80de749a3ec1 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:41.389044 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-89ae7ba6-cb2f-4b09-97df-fe322c4ae222 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1284 microversion: 2.1 time: 0.152392 Jan 22 21:07:41.390311 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1188/2522] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:41 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:41.401000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f68882c-cd13-4a12-876a-80de749a3ec1 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:41.401000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f68882c-cd13-4a12-876a-80de749a3ec1 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:41.505247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1f68882c-cd13-4a12-876a-80de749a3ec1 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:41.522790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1f68882c-cd13-4a12-876a-80de749a3ec1 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:41.525468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1f68882c-cd13-4a12-876a-80de749a3ec1 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:41.527641 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1f68882c-cd13-4a12-876a-80de749a3ec1 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1360 microversion: 2.57 time: 0.167159 Jan 22 21:07:41.529411 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1335/2523] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:41 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1360 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:07:41.561016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:41.563059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:41.588264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:41.589141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:41.590252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:41.591408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:41.712698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:07:41.713526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:07:41.714679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:07:41.715964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:07:41.717763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:07:41.753255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb7726a8-41f1-4bae-b258-2a6279f7bac0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:41.754287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fb7726a8-41f1-4bae-b258-2a6279f7bac0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:41.765386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb7726a8-41f1-4bae-b258-2a6279f7bac0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:41.768459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb7726a8-41f1-4bae-b258-2a6279f7bac0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:41.773466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb7726a8-41f1-4bae-b258-2a6279f7bac0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:41.775156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb7726a8-41f1-4bae-b258-2a6279f7bac0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:42.063379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:42.072703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:42.074628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:42.075824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:42.077407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:42.134216 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d9ffc731-1db4-4550-a497-e26cd28d6e6d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "POST /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74/action" status: 202 len: 1141 microversion: 2.57 time: 0.586273 Jan 22 21:07:42.148733 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1189/2524] 10.222.0.100 () {62 vars in 1324 bytes} [Sat Jan 22 21:07:41 2022] POST /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74/action => generated 1141 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 455 bytes (1 switches on core 0) Jan 22 21:07:42.176978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-609000c9-a440-4285-8407-31de11cf7913 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:42.178115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-609000c9-a440-4285-8407-31de11cf7913 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:42.188293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-609000c9-a440-4285-8407-31de11cf7913 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:42.188986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-609000c9-a440-4285-8407-31de11cf7913 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:42.190189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-609000c9-a440-4285-8407-31de11cf7913 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:42.190917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-609000c9-a440-4285-8407-31de11cf7913 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:42.298707 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-609000c9-a440-4285-8407-31de11cf7913 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.141604 Jan 22 21:07:42.309489 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1190/2525] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:42 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:42.347302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5ce2a74a-88d0-49ff-834c-d250a074d7a6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:42.351625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5ce2a74a-88d0-49ff-834c-d250a074d7a6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:42.388432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ce2a74a-88d0-49ff-834c-d250a074d7a6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:42.390123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ce2a74a-88d0-49ff-834c-d250a074d7a6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:42.391137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ce2a74a-88d0-49ff-834c-d250a074d7a6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:42.396698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ce2a74a-88d0-49ff-834c-d250a074d7a6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:42.533831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fb7726a8-41f1-4bae-b258-2a6279f7bac0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:42.547826 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fb7726a8-41f1-4bae-b258-2a6279f7bac0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1320 microversion: 2.1 time: 0.796675 Jan 22 21:07:42.564309 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1336/2526] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:41 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1320 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:42.588527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-50131c3a-112c-4788-a583-cf08f72a0801 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:42.599172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-50131c3a-112c-4788-a583-cf08f72a0801 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:42.612008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50131c3a-112c-4788-a583-cf08f72a0801 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:42.618661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50131c3a-112c-4788-a583-cf08f72a0801 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:42.619795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50131c3a-112c-4788-a583-cf08f72a0801 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:42.621836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50131c3a-112c-4788-a583-cf08f72a0801 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:42.772493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-50131c3a-112c-4788-a583-cf08f72a0801 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:42.795965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-50131c3a-112c-4788-a583-cf08f72a0801 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:42.799948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-50131c3a-112c-4788-a583-cf08f72a0801 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:42.808743 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-50131c3a-112c-4788-a583-cf08f72a0801 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.241720 Jan 22 21:07:42.810115 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1337/2527] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:42 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:42.825094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ca0ad1f-8382-43fb-b7ff-33d33dd88667 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:42.826016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1ca0ad1f-8382-43fb-b7ff-33d33dd88667 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:42.834612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ca0ad1f-8382-43fb-b7ff-33d33dd88667 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:42.835937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ca0ad1f-8382-43fb-b7ff-33d33dd88667 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:42.837902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ca0ad1f-8382-43fb-b7ff-33d33dd88667 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:42.842140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ca0ad1f-8382-43fb-b7ff-33d33dd88667 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:43.101579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5ce2a74a-88d0-49ff-834c-d250a074d7a6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:43.125852 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5ce2a74a-88d0-49ff-834c-d250a074d7a6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1324 microversion: 2.1 time: 0.814835 Jan 22 21:07:43.131048 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1191/2528] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:42 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1324 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:43.146914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-1100af3c-c311-407b-894c-438d5dfe4a3c req-a23ccefc-253d-4580-a88d-747f56c8dc8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b59794d9-d980-4e57-b3c4-d72dbad2792f", "tag": "f3702ef8-de22-4f30-aa89-9d637d404962"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:43.148675 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:43.148675 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:07:43.185823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1100af3c-c311-407b-894c-438d5dfe4a3c req-a23ccefc-253d-4580-a88d-747f56c8dc8a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:43.186287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1100af3c-c311-407b-894c-438d5dfe4a3c req-a23ccefc-253d-4580-a88d-747f56c8dc8a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:43.218963 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-1100af3c-c311-407b-894c-438d5dfe4a3c req-a23ccefc-253d-4580-a88d-747f56c8dc8a service nova] Creating event network-changed:f3702ef8-de22-4f30-aa89-9d637d404962 for instance b59794d9-d980-4e57-b3c4-d72dbad2792f on nch2-master-1 Jan 22 21:07:43.244796 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-1100af3c-c311-407b-894c-438d5dfe4a3c req-a23ccefc-253d-4580-a88d-747f56c8dc8a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109462 Jan 22 21:07:43.245771 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1192/2529] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:43.315213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1f068586-5c69-47e2-8039-bca374eba36b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:43.316335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1f068586-5c69-47e2-8039-bca374eba36b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:43.327522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1ca0ad1f-8382-43fb-b7ff-33d33dd88667 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:43.333191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f068586-5c69-47e2-8039-bca374eba36b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:43.335468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f068586-5c69-47e2-8039-bca374eba36b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:43.339267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f068586-5c69-47e2-8039-bca374eba36b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:43.340019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f068586-5c69-47e2-8039-bca374eba36b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:43.341361 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ca0ad1f-8382-43fb-b7ff-33d33dd88667 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1326 microversion: 2.1 time: 0.529831 Jan 22 21:07:43.345588 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1338/2530] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:42 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1326 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:43.426791 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1f068586-5c69-47e2-8039-bca374eba36b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.117721 Jan 22 21:07:43.434772 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1193/2531] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:43 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:43.584910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-470825f3-896c-423e-97d9-d51b9e9f7c6f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:43.586615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-470825f3-896c-423e-97d9-d51b9e9f7c6f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:43.595415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-470825f3-896c-423e-97d9-d51b9e9f7c6f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:43.596709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-470825f3-896c-423e-97d9-d51b9e9f7c6f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:43.598735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-470825f3-896c-423e-97d9-d51b9e9f7c6f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:43.599847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-470825f3-896c-423e-97d9-d51b9e9f7c6f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:43.828899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ac033bb4-b94d-4138-9e55-f1d8ba2817e2 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:43.829713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ac033bb4-b94d-4138-9e55-f1d8ba2817e2 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:43.852284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac033bb4-b94d-4138-9e55-f1d8ba2817e2 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:43.852748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac033bb4-b94d-4138-9e55-f1d8ba2817e2 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:43.853612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac033bb4-b94d-4138-9e55-f1d8ba2817e2 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:43.854063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac033bb4-b94d-4138-9e55-f1d8ba2817e2 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:43.871689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-470825f3-896c-423e-97d9-d51b9e9f7c6f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:43.892785 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-470825f3-896c-423e-97d9-d51b9e9f7c6f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1470 microversion: 2.1 time: 0.314906 Jan 22 21:07:43.893396 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1339/2532] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:43 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1470 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:44.006851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ac033bb4-b94d-4138-9e55-f1d8ba2817e2 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:44.023364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ac033bb4-b94d-4138-9e55-f1d8ba2817e2 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:44.028729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ac033bb4-b94d-4138-9e55-f1d8ba2817e2 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:44.037801 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ac033bb4-b94d-4138-9e55-f1d8ba2817e2 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.207666 Jan 22 21:07:44.047484 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1194/2533] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:43 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:07:44.150504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a0057a3d-4ac8-43d5-9c57-d351280c6ef3 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:44.150504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a0057a3d-4ac8-43d5-9c57-d351280c6ef3 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:44.159924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0057a3d-4ac8-43d5-9c57-d351280c6ef3 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:44.161032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0057a3d-4ac8-43d5-9c57-d351280c6ef3 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:44.169692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0057a3d-4ac8-43d5-9c57-d351280c6ef3 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:44.170611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0057a3d-4ac8-43d5-9c57-d351280c6ef3 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:44.378705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-208fa0fa-87bd-4f81-9285-cd08482adf30 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:44.384394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-208fa0fa-87bd-4f81-9285-cd08482adf30 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:44.392354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-208fa0fa-87bd-4f81-9285-cd08482adf30 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:44.394199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-208fa0fa-87bd-4f81-9285-cd08482adf30 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:44.395798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-208fa0fa-87bd-4f81-9285-cd08482adf30 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:44.396427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-208fa0fa-87bd-4f81-9285-cd08482adf30 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:44.646413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a0057a3d-4ac8-43d5-9c57-d351280c6ef3 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:44.668110 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a0057a3d-4ac8-43d5-9c57-d351280c6ef3 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1324 microversion: 2.1 time: 0.519281 Jan 22 21:07:44.668850 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1195/2534] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:44 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1324 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:44.688098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fce21a3a-44da-444b-9f39-779b56163580 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:44.689249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fce21a3a-44da-444b-9f39-779b56163580 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:44.697163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fce21a3a-44da-444b-9f39-779b56163580 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:44.697914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fce21a3a-44da-444b-9f39-779b56163580 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:44.698992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fce21a3a-44da-444b-9f39-779b56163580 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:44.700839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fce21a3a-44da-444b-9f39-779b56163580 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.082803 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-208fa0fa-87bd-4f81-9285-cd08482adf30 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1621 microversion: 2.1 time: 1.110106 Jan 22 21:07:45.095805 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1340/2535] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:43 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1621 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:45.104117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1a117a22-d1cc-4fcb-a0d2-bbbcc2971c4a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:45.106804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1a117a22-d1cc-4fcb-a0d2-bbbcc2971c4a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:45.117759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a117a22-d1cc-4fcb-a0d2-bbbcc2971c4a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.122806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a117a22-d1cc-4fcb-a0d2-bbbcc2971c4a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.122806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a117a22-d1cc-4fcb-a0d2-bbbcc2971c4a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.122806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a117a22-d1cc-4fcb-a0d2-bbbcc2971c4a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.182223 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1a117a22-d1cc-4fcb-a0d2-bbbcc2971c4a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.084436 Jan 22 21:07:45.191408 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1341/2536] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:45 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:45.451997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c95f962b-3275-4f95-9db8-b78176db8ecb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Calling method '.version_select at 0x7f1ed5e8c4c0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:45.453435 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:45.453435 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:45.455255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c95f962b-3275-4f95-9db8-b78176db8ecb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.455717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c95f962b-3275-4f95-9db8-b78176db8ecb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.480447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c95f962b-3275-4f95-9db8-b78176db8ecb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.481065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c95f962b-3275-4f95-9db8-b78176db8ecb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.498452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c95f962b-3275-4f95-9db8-b78176db8ecb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.498452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c95f962b-3275-4f95-9db8-b78176db8ecb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.504027 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c95f962b-3275-4f95-9db8-b78176db8ecb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.310307 Jan 22 21:07:45.504877 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1342/2537] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:07:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:45.510141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2aa13dcb-04a1-44c6-88db-d4b2eb7c67c4 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:45.510887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2aa13dcb-04a1-44c6-88db-d4b2eb7c67c4 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:45.526160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aa13dcb-04a1-44c6-88db-d4b2eb7c67c4 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.526849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aa13dcb-04a1-44c6-88db-d4b2eb7c67c4 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.527843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aa13dcb-04a1-44c6-88db-d4b2eb7c67c4 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.528457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aa13dcb-04a1-44c6-88db-d4b2eb7c67c4 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.543180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fce21a3a-44da-444b-9f39-779b56163580 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:45.561361 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fce21a3a-44da-444b-9f39-779b56163580 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1326 microversion: 2.1 time: 0.878448 Jan 22 21:07:45.564866 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1196/2538] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:44 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1326 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:45.581692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-55feb543-03fe-4763-84c4-1b8a67b697ba tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Action: 'create', calling method: .version_select at 0x7f1ed61a8af0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-154013484", "policies": ["affinity"]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:45.611572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-55feb543-03fe-4763-84c4-1b8a67b697ba tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_groups'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:45.635427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-55feb543-03fe-4763-84c4-1b8a67b697ba tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_groups'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:45.674924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2aa13dcb-04a1-44c6-88db-d4b2eb7c67c4 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:45.686386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2aa13dcb-04a1-44c6-88db-d4b2eb7c67c4 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:45.688575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2aa13dcb-04a1-44c6-88db-d4b2eb7c67c4 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:45.690925 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2aa13dcb-04a1-44c6-88db-d4b2eb7c67c4 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.184830 Jan 22 21:07:45.703288 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1343/2539] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:45 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:45.709637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-7c6bf163-3bc4-422d-b17c-4d31d4c69fbe req-d4908d87-fd0d-4994-86da-99d89897f028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c94a0781-6adf-4a29-87a9-1eba0417d8ed", "tag": "b11d33d7-8719-4698-b0dc-60a15da88a88"}, {"name": "network-changed", "server_uuid": "9dd17fd5-afdd-4c9d-b3f4-37e074b52164", "tag": "6ccde979-75d5-4cd2-a24c-44e19ed1cd1d"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:45.711530 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:45.711530 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:45.721225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7c6bf163-3bc4-422d-b17c-4d31d4c69fbe req-d4908d87-fd0d-4994-86da-99d89897f028 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.725432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7c6bf163-3bc4-422d-b17c-4d31d4c69fbe req-d4908d87-fd0d-4994-86da-99d89897f028 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.737169 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-7c6bf163-3bc4-422d-b17c-4d31d4c69fbe req-d4908d87-fd0d-4994-86da-99d89897f028 service nova] Creating event network-changed:b11d33d7-8719-4698-b0dc-60a15da88a88 for instance c94a0781-6adf-4a29-87a9-1eba0417d8ed on nch1-master-1 Jan 22 21:07:45.737720 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-7c6bf163-3bc4-422d-b17c-4d31d4c69fbe req-d4908d87-fd0d-4994-86da-99d89897f028 service nova] Creating event network-changed:6ccde979-75d5-4cd2-a24c-44e19ed1cd1d for instance 9dd17fd5-afdd-4c9d-b3f4-37e074b52164 on nch2-master-1 Jan 22 21:07:45.748089 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-7c6bf163-3bc4-422d-b17c-4d31d4c69fbe req-d4908d87-fd0d-4994-86da-99d89897f028 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042858 Jan 22 21:07:45.757622 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1344/2540] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:45.768786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-623fec89-6fb6-49e8-95ad-996c997f1fcb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Calling method '.version_select at 0x7f1ed586d820>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:45.772171 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:45.772171 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:45.779430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-623fec89-6fb6-49e8-95ad-996c997f1fcb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.781970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-623fec89-6fb6-49e8-95ad-996c997f1fcb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.789165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-55feb543-03fe-4763-84c4-1b8a67b697ba tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_groups'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:45.796620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-55feb543-03fe-4763-84c4-1b8a67b697ba tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_groups'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:45.810642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-623fec89-6fb6-49e8-95ad-996c997f1fcb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.811114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-623fec89-6fb6-49e8-95ad-996c997f1fcb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.811425 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-55feb543-03fe-4763-84c4-1b8a67b697ba tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.244398 Jan 22 21:07:45.812578 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1197/2541] 10.222.0.100 () {60 vars in 1178 bytes} [Sat Jan 22 21:07:45 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:45.818209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8c5c22db-ec0b-438d-a09a-e8563e431872 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:45.819145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8c5c22db-ec0b-438d-a09a-e8563e431872 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:45.835522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c5c22db-ec0b-438d-a09a-e8563e431872 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.836287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c5c22db-ec0b-438d-a09a-e8563e431872 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.837383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c5c22db-ec0b-438d-a09a-e8563e431872 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.838327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c5c22db-ec0b-438d-a09a-e8563e431872 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.853561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-623fec89-6fb6-49e8-95ad-996c997f1fcb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.854033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-623fec89-6fb6-49e8-95ad-996c997f1fcb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.861075 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-623fec89-6fb6-49e8-95ad-996c997f1fcb tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 275 microversion: 2.1 time: 0.100941 Jan 22 21:07:45.861695 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1345/2542] 10.222.0.100 () {58 vars in 1216 bytes} [Sat Jan 22 21:07:45 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 275 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:45.872479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e24d4b5e-e44f-4edd-9802-a4809a17bdd8 tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Calling method '.version_select at 0x7f1ed5ea0c10>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:45.874057 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:45.874057 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:45.875972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e24d4b5e-e44f-4edd-9802-a4809a17bdd8 tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.876811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e24d4b5e-e44f-4edd-9802-a4809a17bdd8 tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.898279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e24d4b5e-e44f-4edd-9802-a4809a17bdd8 tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.899021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e24d4b5e-e44f-4edd-9802-a4809a17bdd8 tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.912188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e24d4b5e-e44f-4edd-9802-a4809a17bdd8 tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.913132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e24d4b5e-e44f-4edd-9802-a4809a17bdd8 tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.920046 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e24d4b5e-e44f-4edd-9802-a4809a17bdd8 tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050930 Jan 22 21:07:45.921283 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1346/2543] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:07:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:45.932119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5c672409-7000-4585-9e9a-a3a83831652e tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Calling method '.version_select at 0x7f1ed5ec6d30>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:45.933534 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:45.933534 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:45.935431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c672409-7000-4585-9e9a-a3a83831652e tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.935895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c672409-7000-4585-9e9a-a3a83831652e tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.949320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c672409-7000-4585-9e9a-a3a83831652e tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:45.949814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c672409-7000-4585-9e9a-a3a83831652e tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:45.955645 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5c672409-7000-4585-9e9a-a3a83831652e tempest-HypervisorAdminUnderV252Test-43353079 tempest-HypervisorAdminUnderV252Test-43353079-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.028412 Jan 22 21:07:45.956242 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1347/2544] 10.222.0.100 () {58 vars in 1213 bytes} [Sat Jan 22 21:07:45 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:07:45.962120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2146383173", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a5a78ded-cf35-4e83-b5f2-4d2c612c91f2"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:46.027597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:07:46.273330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:07:46.275243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:07:46.275925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:07:46.276436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:07:46.276926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:07:46.294570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:46.295041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:46.296007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:46.296961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:46.317718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:46.323428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:46.341291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Going to run 2 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:07:46.344237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 89e0044a-73e1-4d70-b612-3798d98ecc1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:07:46.372136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8c5c22db-ec0b-438d-a09a-e8563e431872 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:46.382471 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8c5c22db-ec0b-438d-a09a-e8563e431872 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1324 microversion: 2.1 time: 0.568422 Jan 22 21:07:46.383212 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1198/2545] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:45 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1324 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:46.417080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0e265f2b-93cb-4cde-91ea-52742c04b22a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:46.418661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0e265f2b-93cb-4cde-91ea-52742c04b22a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:46.434322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e265f2b-93cb-4cde-91ea-52742c04b22a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:46.434942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e265f2b-93cb-4cde-91ea-52742c04b22a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:46.436187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e265f2b-93cb-4cde-91ea-52742c04b22a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:46.438074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e265f2b-93cb-4cde-91ea-52742c04b22a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:46.518035 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0e265f2b-93cb-4cde-91ea-52742c04b22a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.133425 Jan 22 21:07:46.521213 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1199/2546] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:46 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:46.569221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:46.577235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:46.585296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1d77a1ec-8b6b-4c18-9111-eb6dcc851a91 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:46.586103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1d77a1ec-8b6b-4c18-9111-eb6dcc851a91 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:46.601400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d77a1ec-8b6b-4c18-9111-eb6dcc851a91 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:46.602375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d77a1ec-8b6b-4c18-9111-eb6dcc851a91 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:46.603439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d77a1ec-8b6b-4c18-9111-eb6dcc851a91 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:46.604079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d77a1ec-8b6b-4c18-9111-eb6dcc851a91 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:46.736268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:46.748426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:46.787998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=89e0044a-73e1-4d70-b612-3798d98ecc1f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:07:46.912528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:46.920729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:47.138435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:47.149659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:47.153451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1d77a1ec-8b6b-4c18-9111-eb6dcc851a91 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:47.171384 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1d77a1ec-8b6b-4c18-9111-eb6dcc851a91 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1326 microversion: 2.1 time: 0.588492 Jan 22 21:07:47.172434 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1200/2547] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:46 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1326 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:07:47.182625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-34d66ee9-dc70-4587-935e-5ef3df919723 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:47.185086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-34d66ee9-dc70-4587-935e-5ef3df919723 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:47.199912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34d66ee9-dc70-4587-935e-5ef3df919723 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:47.203236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34d66ee9-dc70-4587-935e-5ef3df919723 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:47.203236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34d66ee9-dc70-4587-935e-5ef3df919723 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:47.205353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34d66ee9-dc70-4587-935e-5ef3df919723 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:47.238102 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-db48810f-307b-4aba-a5c9-292ae7d091e8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.280575 Jan 22 21:07:47.242375 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1348/2548] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:07:45 2022] POST /compute/v2.1/servers => generated 32 bytes in 1284 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jan 22 21:07:47.251587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-90f4ec58-83d5-4cb2-9a07-4d01415a00e5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:47.262865 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:47.262865 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:47.266748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-90f4ec58-83d5-4cb2-9a07-4d01415a00e5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:47.270269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-90f4ec58-83d5-4cb2-9a07-4d01415a00e5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Searching by: {'deleted': False, 'project_id': '1e6094793b214ae7af6611b1571cac3d'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:07:47.299768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90f4ec58-83d5-4cb2-9a07-4d01415a00e5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:47.302098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90f4ec58-83d5-4cb2-9a07-4d01415a00e5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:47.303380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90f4ec58-83d5-4cb2-9a07-4d01415a00e5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:47.303829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90f4ec58-83d5-4cb2-9a07-4d01415a00e5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:47.339242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-90f4ec58-83d5-4cb2-9a07-4d01415a00e5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:07:47.411734 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-90f4ec58-83d5-4cb2-9a07-4d01415a00e5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.164836 Jan 22 21:07:47.414351 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1349/2549] 10.222.0.100 () {58 vars in 1129 bytes} [Sat Jan 22 21:07:47 2022] GET /compute/v2.1/servers => generated 1009 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:47.432608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-10e095b9-0521-4eb3-9d92-5c78ff9dc30d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:47.433265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-10e095b9-0521-4eb3-9d92-5c78ff9dc30d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:47.445868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10e095b9-0521-4eb3-9d92-5c78ff9dc30d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:47.446337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10e095b9-0521-4eb3-9d92-5c78ff9dc30d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:47.450882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10e095b9-0521-4eb3-9d92-5c78ff9dc30d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:47.451389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10e095b9-0521-4eb3-9d92-5c78ff9dc30d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:47.523155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-34d66ee9-dc70-4587-935e-5ef3df919723 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:47.525714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-34d66ee9-dc70-4587-935e-5ef3df919723 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:47.538871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-34d66ee9-dc70-4587-935e-5ef3df919723 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:47.540914 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-34d66ee9-dc70-4587-935e-5ef3df919723 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.366810 Jan 22 21:07:47.560754 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1201/2550] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:47 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:47.566205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96a93f30-af65-4877-a060-f5eed1577c7a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:47.566897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96a93f30-af65-4877-a060-f5eed1577c7a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:47.704344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-96a93f30-af65-4877-a060-f5eed1577c7a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:47.713572 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96a93f30-af65-4877-a060-f5eed1577c7a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 200 len: 1223 microversion: 2.1 time: 0.156726 Jan 22 21:07:47.715701 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1202/2551] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:47 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 1223 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:47.721482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-268e109b-9e7a-4d33-ac23-a03ea8ca3675 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:47.724348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-268e109b-9e7a-4d33-ac23-a03ea8ca3675 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:47.735791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-268e109b-9e7a-4d33-ac23-a03ea8ca3675 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:47.740311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-268e109b-9e7a-4d33-ac23-a03ea8ca3675 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:47.742182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-268e109b-9e7a-4d33-ac23-a03ea8ca3675 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:47.742879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-268e109b-9e7a-4d33-ac23-a03ea8ca3675 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:47.781021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-10e095b9-0521-4eb3-9d92-5c78ff9dc30d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:47.788832 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-268e109b-9e7a-4d33-ac23-a03ea8ca3675 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.071566 Jan 22 21:07:47.793374 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-10e095b9-0521-4eb3-9d92-5c78ff9dc30d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1324 microversion: 2.1 time: 0.374457 Jan 22 21:07:47.793593 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1203/2552] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:47 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:47.801248 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1350/2553] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:47 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1324 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:48.189798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7d98a4d8-2ca4-4052-af81-94eec86d7367 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:48.191164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7d98a4d8-2ca4-4052-af81-94eec86d7367 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:48.200129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d98a4d8-2ca4-4052-af81-94eec86d7367 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:48.200591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d98a4d8-2ca4-4052-af81-94eec86d7367 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:48.201405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d98a4d8-2ca4-4052-af81-94eec86d7367 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:48.201881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d98a4d8-2ca4-4052-af81-94eec86d7367 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:48.453132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7d98a4d8-2ca4-4052-af81-94eec86d7367 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:48.463833 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7d98a4d8-2ca4-4052-af81-94eec86d7367 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1326 microversion: 2.1 time: 0.278109 Jan 22 21:07:48.475473 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1204/2554] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:48 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1326 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:48.563278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab081f2e-164f-48e1-ad83-df0aa338573d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:48.564502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ab081f2e-164f-48e1-ad83-df0aa338573d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:48.576941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab081f2e-164f-48e1-ad83-df0aa338573d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:48.577422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab081f2e-164f-48e1-ad83-df0aa338573d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:48.583454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab081f2e-164f-48e1-ad83-df0aa338573d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:48.584039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab081f2e-164f-48e1-ad83-df0aa338573d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:48.653828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ab081f2e-164f-48e1-ad83-df0aa338573d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:48.666128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ab081f2e-164f-48e1-ad83-df0aa338573d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:48.668202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ab081f2e-164f-48e1-ad83-df0aa338573d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:48.669868 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab081f2e-164f-48e1-ad83-df0aa338573d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.110953 Jan 22 21:07:48.671362 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1351/2555] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:48 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:48.746474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-98d5180d-5e23-4ca5-b948-aab611879653 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:48.748666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-98d5180d-5e23-4ca5-b948-aab611879653 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:48.803781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-020aa8e7-b75e-4345-bf5a-fd4da3fa1625 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:48.805038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-020aa8e7-b75e-4345-bf5a-fd4da3fa1625 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:48.812627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-020aa8e7-b75e-4345-bf5a-fd4da3fa1625 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:48.813242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-020aa8e7-b75e-4345-bf5a-fd4da3fa1625 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:48.814113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-020aa8e7-b75e-4345-bf5a-fd4da3fa1625 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:48.814558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-020aa8e7-b75e-4345-bf5a-fd4da3fa1625 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:48.820737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-98d5180d-5e23-4ca5-b948-aab611879653 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:48.831186 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-98d5180d-5e23-4ca5-b948-aab611879653 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 200 len: 1223 microversion: 2.1 time: 0.095458 Jan 22 21:07:48.831778 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1205/2556] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:48 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:48.837757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-39e8962c-d122-4db6-a314-2e2fec08ccd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:48.838505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-39e8962c-d122-4db6-a314-2e2fec08ccd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:48.856466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39e8962c-d122-4db6-a314-2e2fec08ccd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:48.856980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39e8962c-d122-4db6-a314-2e2fec08ccd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:48.859721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39e8962c-d122-4db6-a314-2e2fec08ccd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:48.860383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39e8962c-d122-4db6-a314-2e2fec08ccd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:48.895442 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-020aa8e7-b75e-4345-bf5a-fd4da3fa1625 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.097878 Jan 22 21:07:48.896227 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1352/2557] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:48 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:07:49.091917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-39e8962c-d122-4db6-a314-2e2fec08ccd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:49.106735 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-39e8962c-d122-4db6-a314-2e2fec08ccd0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1324 microversion: 2.1 time: 0.272952 Jan 22 21:07:49.107872 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1206/2558] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:48 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1324 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:49.265334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-849e35e7-fdd0-461c-8eb2-abe8148e02f1 req-2e344dcf-b547-4d2a-9a4f-b393ddbae7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59794d9-d980-4e57-b3c4-d72dbad2792f", "name": "network-vif-plugged", "status": "completed", "tag": "f3702ef8-de22-4f30-aa89-9d637d404962"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:49.266950 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:49.266950 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:49.279312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-849e35e7-fdd0-461c-8eb2-abe8148e02f1 req-2e344dcf-b547-4d2a-9a4f-b393ddbae7fb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:49.279569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-849e35e7-fdd0-461c-8eb2-abe8148e02f1 req-2e344dcf-b547-4d2a-9a4f-b393ddbae7fb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:49.292281 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-849e35e7-fdd0-461c-8eb2-abe8148e02f1 req-2e344dcf-b547-4d2a-9a4f-b393ddbae7fb service nova] Creating event network-vif-plugged:f3702ef8-de22-4f30-aa89-9d637d404962 for instance b59794d9-d980-4e57-b3c4-d72dbad2792f on nch2-master-1 Jan 22 21:07:49.298110 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-849e35e7-fdd0-461c-8eb2-abe8148e02f1 req-2e344dcf-b547-4d2a-9a4f-b393ddbae7fb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038485 Jan 22 21:07:49.298709 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1353/2559] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:49.483646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6981258c-db3b-4ca1-8799-a8a0d6546f41 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:49.485084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6981258c-db3b-4ca1-8799-a8a0d6546f41 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:49.492998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6981258c-db3b-4ca1-8799-a8a0d6546f41 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:49.493450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6981258c-db3b-4ca1-8799-a8a0d6546f41 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:49.495962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6981258c-db3b-4ca1-8799-a8a0d6546f41 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:49.495962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6981258c-db3b-4ca1-8799-a8a0d6546f41 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:49.695482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bcc23bbf-8d3c-485e-9c2a-900bedd77fa8 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:49.696484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bcc23bbf-8d3c-485e-9c2a-900bedd77fa8 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:49.708986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcc23bbf-8d3c-485e-9c2a-900bedd77fa8 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:49.709645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcc23bbf-8d3c-485e-9c2a-900bedd77fa8 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:49.711067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcc23bbf-8d3c-485e-9c2a-900bedd77fa8 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:49.711795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcc23bbf-8d3c-485e-9c2a-900bedd77fa8 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:49.751018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6981258c-db3b-4ca1-8799-a8a0d6546f41 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:49.759041 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6981258c-db3b-4ca1-8799-a8a0d6546f41 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1326 microversion: 2.1 time: 0.280550 Jan 22 21:07:49.759725 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1207/2560] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:49 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1326 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:49.787184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bcc23bbf-8d3c-485e-9c2a-900bedd77fa8 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:49.795352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bcc23bbf-8d3c-485e-9c2a-900bedd77fa8 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:49.796873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bcc23bbf-8d3c-485e-9c2a-900bedd77fa8 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:49.798116 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bcc23bbf-8d3c-485e-9c2a-900bedd77fa8 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.111851 Jan 22 21:07:49.798710 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1354/2561] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:49 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:49.848949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-25d452c0-d28b-4972-a87d-9681fa4bf92c tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:49.849811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-25d452c0-d28b-4972-a87d-9681fa4bf92c tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:49.856494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25d452c0-d28b-4972-a87d-9681fa4bf92c tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:49.856896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25d452c0-d28b-4972-a87d-9681fa4bf92c tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:49.857904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25d452c0-d28b-4972-a87d-9681fa4bf92c tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:49.858528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25d452c0-d28b-4972-a87d-9681fa4bf92c tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:49.907156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9b9338fd-ec96-4c7f-9e7b-3326260a4fd9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:49.908089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9b9338fd-ec96-4c7f-9e7b-3326260a4fd9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:49.917659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b9338fd-ec96-4c7f-9e7b-3326260a4fd9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:49.918225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b9338fd-ec96-4c7f-9e7b-3326260a4fd9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:49.919610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b9338fd-ec96-4c7f-9e7b-3326260a4fd9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:49.920065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b9338fd-ec96-4c7f-9e7b-3326260a4fd9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:49.928908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-25d452c0-d28b-4972-a87d-9681fa4bf92c tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:49.939548 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-25d452c0-d28b-4972-a87d-9681fa4bf92c tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 200 len: 1227 microversion: 2.1 time: 0.094631 Jan 22 21:07:49.945058 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1208/2562] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:49 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 1227 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:49.976669 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9b9338fd-ec96-4c7f-9e7b-3326260a4fd9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.073356 Jan 22 21:07:49.981022 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1355/2563] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:49 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:07:50.123889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-da8c233f-3f97-4861-9a75-7b86d740c435 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:50.124686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-da8c233f-3f97-4861-9a75-7b86d740c435 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:50.131326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da8c233f-3f97-4861-9a75-7b86d740c435 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:50.132052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da8c233f-3f97-4861-9a75-7b86d740c435 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:50.132905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da8c233f-3f97-4861-9a75-7b86d740c435 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:50.133354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da8c233f-3f97-4861-9a75-7b86d740c435 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:50.719238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-da8c233f-3f97-4861-9a75-7b86d740c435 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:50.739060 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-da8c233f-3f97-4861-9a75-7b86d740c435 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1324 microversion: 2.1 time: 0.612603 Jan 22 21:07:50.739060 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1209/2564] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:50 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1324 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:50.780483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-347654a1-2b26-444d-bf59-772fc4647034 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:50.782212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-347654a1-2b26-444d-bf59-772fc4647034 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:50.817534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-347654a1-2b26-444d-bf59-772fc4647034 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:50.818637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c1a16bfe-fbab-4e7d-821d-99fa73062089 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:50.820116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c1a16bfe-fbab-4e7d-821d-99fa73062089 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:50.824517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-347654a1-2b26-444d-bf59-772fc4647034 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:50.828284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-347654a1-2b26-444d-bf59-772fc4647034 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:50.831069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1a16bfe-fbab-4e7d-821d-99fa73062089 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:50.832377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1a16bfe-fbab-4e7d-821d-99fa73062089 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:50.836166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1a16bfe-fbab-4e7d-821d-99fa73062089 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:50.836166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1a16bfe-fbab-4e7d-821d-99fa73062089 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:50.836690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-347654a1-2b26-444d-bf59-772fc4647034 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:51.007752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c1a16bfe-fbab-4e7d-821d-99fa73062089 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:51.036368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c1a16bfe-fbab-4e7d-821d-99fa73062089 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:51.036368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c1a16bfe-fbab-4e7d-821d-99fa73062089 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:51.036368 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c1a16bfe-fbab-4e7d-821d-99fa73062089 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.215746 Jan 22 21:07:51.036368 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1210/2565] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:50 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:51.044187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-20fbe45d-97cf-458d-b651-2cff4b911274 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:51.045082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-20fbe45d-97cf-458d-b651-2cff4b911274 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:51.058703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20fbe45d-97cf-458d-b651-2cff4b911274 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:51.060094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20fbe45d-97cf-458d-b651-2cff4b911274 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:51.060950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20fbe45d-97cf-458d-b651-2cff4b911274 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:51.062488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20fbe45d-97cf-458d-b651-2cff4b911274 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:51.217032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-20fbe45d-97cf-458d-b651-2cff4b911274 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:51.225686 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-20fbe45d-97cf-458d-b651-2cff4b911274 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 200 len: 1275 microversion: 2.1 time: 0.192679 Jan 22 21:07:51.226283 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1211/2566] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:51 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:51.230816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-71c1bf20-8f48-4201-a854-4bc1cec9152e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:51.231805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-71c1bf20-8f48-4201-a854-4bc1cec9152e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:51.241774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-347654a1-2b26-444d-bf59-772fc4647034 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:51.251653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71c1bf20-8f48-4201-a854-4bc1cec9152e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:51.252121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71c1bf20-8f48-4201-a854-4bc1cec9152e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:51.252705 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-347654a1-2b26-444d-bf59-772fc4647034 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1326 microversion: 2.1 time: 0.477567 Jan 22 21:07:51.252939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71c1bf20-8f48-4201-a854-4bc1cec9152e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:51.253389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71c1bf20-8f48-4201-a854-4bc1cec9152e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:51.256115 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1356/2567] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:50 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1326 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:51.295409 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-71c1bf20-8f48-4201-a854-4bc1cec9152e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.067859 Jan 22 21:07:51.299242 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1212/2568] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:51 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:51.471377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-20158974-91f7-4374-9df6-a407619200d0 req-6be4e7fa-50a5-4f8e-9981-22d03569dc56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c94a0781-6adf-4a29-87a9-1eba0417d8ed", "name": "network-vif-plugged", "status": "completed", "tag": "b11d33d7-8719-4698-b0dc-60a15da88a88"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:51.474128 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:51.474128 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:51.484970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-20158974-91f7-4374-9df6-a407619200d0 req-6be4e7fa-50a5-4f8e-9981-22d03569dc56 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:51.485769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-20158974-91f7-4374-9df6-a407619200d0 req-6be4e7fa-50a5-4f8e-9981-22d03569dc56 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:51.530900 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-20158974-91f7-4374-9df6-a407619200d0 req-6be4e7fa-50a5-4f8e-9981-22d03569dc56 service nova] Creating event network-vif-plugged:b11d33d7-8719-4698-b0dc-60a15da88a88 for instance c94a0781-6adf-4a29-87a9-1eba0417d8ed on nch1-master-1 Jan 22 21:07:51.539740 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-20158974-91f7-4374-9df6-a407619200d0 req-6be4e7fa-50a5-4f8e-9981-22d03569dc56 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073166 Jan 22 21:07:51.545612 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1357/2569] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:07:51.751128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c6940bcb-479f-4e61-b739-68ef5d6f4392 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:51.752451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c6940bcb-479f-4e61-b739-68ef5d6f4392 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:51.761009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6940bcb-479f-4e61-b739-68ef5d6f4392 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:51.761468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6940bcb-479f-4e61-b739-68ef5d6f4392 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:51.762317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6940bcb-479f-4e61-b739-68ef5d6f4392 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:51.764535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6940bcb-479f-4e61-b739-68ef5d6f4392 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:52.052984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9c37fbf2-4197-49c4-965e-5a1cccbabb26 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:52.053791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9c37fbf2-4197-49c4-965e-5a1cccbabb26 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:52.064900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c37fbf2-4197-49c4-965e-5a1cccbabb26 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:52.065765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c37fbf2-4197-49c4-965e-5a1cccbabb26 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:52.067879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c37fbf2-4197-49c4-965e-5a1cccbabb26 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:52.072676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c37fbf2-4197-49c4-965e-5a1cccbabb26 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:52.213475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9c37fbf2-4197-49c4-965e-5a1cccbabb26 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:52.229108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9c37fbf2-4197-49c4-965e-5a1cccbabb26 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:52.245124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9c37fbf2-4197-49c4-965e-5a1cccbabb26 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:52.245124 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9c37fbf2-4197-49c4-965e-5a1cccbabb26 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.197798 Jan 22 21:07:52.246391 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1358/2570] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:52 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:52.271438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ca5fadce-ce5d-44a2-9bf5-5b1207a1dd10 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:52.272900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ca5fadce-ce5d-44a2-9bf5-5b1207a1dd10 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:52.288259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca5fadce-ce5d-44a2-9bf5-5b1207a1dd10 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:52.288720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca5fadce-ce5d-44a2-9bf5-5b1207a1dd10 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:52.289608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca5fadce-ce5d-44a2-9bf5-5b1207a1dd10 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:52.292619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c6940bcb-479f-4e61-b739-68ef5d6f4392 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:52.295352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca5fadce-ce5d-44a2-9bf5-5b1207a1dd10 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:52.300242 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c6940bcb-479f-4e61-b739-68ef5d6f4392 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1324 microversion: 2.1 time: 0.553201 Jan 22 21:07:52.303536 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1213/2571] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:51 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1324 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:52.316803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-89c63355-a9eb-47fd-b28f-b18e60d67e11 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:52.317808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-89c63355-a9eb-47fd-b28f-b18e60d67e11 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:52.336925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89c63355-a9eb-47fd-b28f-b18e60d67e11 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:52.337824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89c63355-a9eb-47fd-b28f-b18e60d67e11 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:52.338811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89c63355-a9eb-47fd-b28f-b18e60d67e11 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:52.339432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89c63355-a9eb-47fd-b28f-b18e60d67e11 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:52.450752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ca5fadce-ce5d-44a2-9bf5-5b1207a1dd10 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:52.463293 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ca5fadce-ce5d-44a2-9bf5-5b1207a1dd10 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 200 len: 1281 microversion: 2.1 time: 0.213573 Jan 22 21:07:52.478046 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1359/2572] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:52 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 1281 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:52.483216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0aa04bdc-af26-4db0-85b2-1ea722b75e3a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:52.485309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0aa04bdc-af26-4db0-85b2-1ea722b75e3a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:52.492903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0aa04bdc-af26-4db0-85b2-1ea722b75e3a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:52.493376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0aa04bdc-af26-4db0-85b2-1ea722b75e3a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:52.495859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0aa04bdc-af26-4db0-85b2-1ea722b75e3a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:52.496321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0aa04bdc-af26-4db0-85b2-1ea722b75e3a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:52.558027 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0aa04bdc-af26-4db0-85b2-1ea722b75e3a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.078504 Jan 22 21:07:52.558961 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1360/2573] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:52 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:52.732319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-22157575", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:52.817149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:07:52.887934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-89c63355-a9eb-47fd-b28f-b18e60d67e11 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:52.915304 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-89c63355-a9eb-47fd-b28f-b18e60d67e11 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1326 microversion: 2.1 time: 0.609958 Jan 22 21:07:52.919429 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1214/2574] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:52 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1326 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:53.073072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:07:53.073706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:07:53.074005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:07:53.074452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:07:53.074869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:07:53.088210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:53.089153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:53.090497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:53.091746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:53.122514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Getting quotas for project 80dba854f5414025a0cbf8b5d6571c42. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:53.129816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Getting quotas for user 7f8e9e562bd740e782568f539dac4744 and project 80dba854f5414025a0cbf8b5d6571c42. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:53.147065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:07:53.150872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:07:53.271241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-35ed292f-3ad1-4b43-904d-9d2b00bbbd0e tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:53.271845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-35ed292f-3ad1-4b43-904d-9d2b00bbbd0e tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:53.278061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35ed292f-3ad1-4b43-904d-9d2b00bbbd0e tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:53.278507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35ed292f-3ad1-4b43-904d-9d2b00bbbd0e tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:53.279296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35ed292f-3ad1-4b43-904d-9d2b00bbbd0e tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:53.279734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35ed292f-3ad1-4b43-904d-9d2b00bbbd0e tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:53.352900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-35ed292f-3ad1-4b43-904d-9d2b00bbbd0e tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:53.361625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-35ed292f-3ad1-4b43-904d-9d2b00bbbd0e tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:53.364057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-35ed292f-3ad1-4b43-904d-9d2b00bbbd0e tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:53.364964 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-35ed292f-3ad1-4b43-904d-9d2b00bbbd0e tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.097703 Jan 22 21:07:53.365714 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1215/2575] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:53 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:07:53.369980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9e523631-cd72-4cc4-8994-3e1dd589707f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:53.370681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9e523631-cd72-4cc4-8994-3e1dd589707f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:53.376636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e523631-cd72-4cc4-8994-3e1dd589707f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:53.377107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e523631-cd72-4cc4-8994-3e1dd589707f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:53.377927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e523631-cd72-4cc4-8994-3e1dd589707f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:53.378552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e523631-cd72-4cc4-8994-3e1dd589707f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:53.425047 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5b91148f-7057-43fe-912d-884887705ad5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.864691 Jan 22 21:07:53.429894 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1361/2576] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:07:52 2022] POST /compute/v2.1/servers => generated 382 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:07:53.439823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8af3df16-3716-44a7-a426-8b618804f11d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:53.445984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8af3df16-3716-44a7-a426-8b618804f11d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:53.571404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8af3df16-3716-44a7-a426-8b618804f11d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:53.583013 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8af3df16-3716-44a7-a426-8b618804f11d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1215 microversion: 2.1 time: 0.144790 Jan 22 21:07:53.583857 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1362/2577] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:53 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:53.625223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb41d496-c1e7-4cfe-908a-feb122f93514 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:53.625983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fb41d496-c1e7-4cfe-908a-feb122f93514 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:53.647629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb41d496-c1e7-4cfe-908a-feb122f93514 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:53.650195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb41d496-c1e7-4cfe-908a-feb122f93514 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:53.652230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb41d496-c1e7-4cfe-908a-feb122f93514 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:53.652683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb41d496-c1e7-4cfe-908a-feb122f93514 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:53.768812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9e523631-cd72-4cc4-8994-3e1dd589707f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:53.778975 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9e523631-cd72-4cc4-8994-3e1dd589707f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1324 microversion: 2.1 time: 0.412195 Jan 22 21:07:53.787283 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1216/2578] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:53 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1324 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:53.792545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1e5cd67d-4701-493f-9ef9-a07218f1da8a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:53.800267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1e5cd67d-4701-493f-9ef9-a07218f1da8a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:53.826776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e5cd67d-4701-493f-9ef9-a07218f1da8a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:53.837405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e5cd67d-4701-493f-9ef9-a07218f1da8a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:53.842384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e5cd67d-4701-493f-9ef9-a07218f1da8a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:53.842871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e5cd67d-4701-493f-9ef9-a07218f1da8a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:53.908060 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1e5cd67d-4701-493f-9ef9-a07218f1da8a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.120908 Jan 22 21:07:53.913714 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1217/2579] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:53 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:53.928767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-25deb8cd-90b1-462e-b9ec-c77c31efb71b req-75d7d421-a101-41b5-9ce2-34dbe7df0874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dd17fd5-afdd-4c9d-b3f4-37e074b52164", "name": "network-vif-plugged", "status": "completed", "tag": "6ccde979-75d5-4cd2-a24c-44e19ed1cd1d"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:53.933201 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:53.933201 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:07:53.962377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-25deb8cd-90b1-462e-b9ec-c77c31efb71b req-75d7d421-a101-41b5-9ce2-34dbe7df0874 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:53.963066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-25deb8cd-90b1-462e-b9ec-c77c31efb71b req-75d7d421-a101-41b5-9ce2-34dbe7df0874 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:53.986907 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-25deb8cd-90b1-462e-b9ec-c77c31efb71b req-75d7d421-a101-41b5-9ce2-34dbe7df0874 service nova] Creating event network-vif-plugged:6ccde979-75d5-4cd2-a24c-44e19ed1cd1d for instance 9dd17fd5-afdd-4c9d-b3f4-37e074b52164 on nch2-master-1 Jan 22 21:07:53.992157 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-25deb8cd-90b1-462e-b9ec-c77c31efb71b req-75d7d421-a101-41b5-9ce2-34dbe7df0874 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074367 Jan 22 21:07:53.992754 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1218/2580] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:54.001444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cc6a75d9-576c-4ba1-a111-3508f530f7d0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:54.002257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cc6a75d9-576c-4ba1-a111-3508f530f7d0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:54.023844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc6a75d9-576c-4ba1-a111-3508f530f7d0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:54.023844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc6a75d9-576c-4ba1-a111-3508f530f7d0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:54.025330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc6a75d9-576c-4ba1-a111-3508f530f7d0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:54.026907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc6a75d9-576c-4ba1-a111-3508f530f7d0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:54.080490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fb41d496-c1e7-4cfe-908a-feb122f93514 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:54.092625 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fb41d496-c1e7-4cfe-908a-feb122f93514 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 200 len: 1323 microversion: 2.1 time: 0.491722 Jan 22 21:07:54.098764 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1363/2581] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:53 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 1323 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:54.388509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-93186d5f-18a4-45b5-a105-352313a546c5 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:54.390116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-93186d5f-18a4-45b5-a105-352313a546c5 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:54.399047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93186d5f-18a4-45b5-a105-352313a546c5 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:54.399902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93186d5f-18a4-45b5-a105-352313a546c5 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:54.400845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93186d5f-18a4-45b5-a105-352313a546c5 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:54.401530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93186d5f-18a4-45b5-a105-352313a546c5 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:54.438924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cc6a75d9-576c-4ba1-a111-3508f530f7d0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:54.449479 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cc6a75d9-576c-4ba1-a111-3508f530f7d0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1326 microversion: 2.1 time: 0.452199 Jan 22 21:07:54.450713 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1219/2582] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:53 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1326 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:54.524598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-727f96ca-7281-4f9d-890c-95e45edb985a req-ae5b40c2-69cb-44ce-b95d-8bc58259d04d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e0044a-73e1-4d70-b612-3798d98ecc1f", "tag": "9730300d-1fec-45c1-ba67-15c29a530da5"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:54.530741 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:54.530741 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:07:54.535568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-93186d5f-18a4-45b5-a105-352313a546c5 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:54.541636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-727f96ca-7281-4f9d-890c-95e45edb985a req-ae5b40c2-69cb-44ce-b95d-8bc58259d04d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:54.547682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-727f96ca-7281-4f9d-890c-95e45edb985a req-ae5b40c2-69cb-44ce-b95d-8bc58259d04d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:54.547852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-93186d5f-18a4-45b5-a105-352313a546c5 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:54.547852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-93186d5f-18a4-45b5-a105-352313a546c5 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:54.548827 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-93186d5f-18a4-45b5-a105-352313a546c5 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.164277 Jan 22 21:07:54.560733 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-727f96ca-7281-4f9d-890c-95e45edb985a req-ae5b40c2-69cb-44ce-b95d-8bc58259d04d service nova] Creating event network-changed:9730300d-1fec-45c1-ba67-15c29a530da5 for instance 89e0044a-73e1-4d70-b612-3798d98ecc1f on nch1-master-1 Jan 22 21:07:54.561713 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1364/2583] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:54 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:54.562373 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-727f96ca-7281-4f9d-890c-95e45edb985a req-ae5b40c2-69cb-44ce-b95d-8bc58259d04d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041860 Jan 22 21:07:54.562986 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1220/2584] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:54.600606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4fbc601d-81d4-42b1-952b-4ceb42b7fc9c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:54.601241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4fbc601d-81d4-42b1-952b-4ceb42b7fc9c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:54.666144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4fbc601d-81d4-42b1-952b-4ceb42b7fc9c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:54.677416 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4fbc601d-81d4-42b1-952b-4ceb42b7fc9c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1215 microversion: 2.1 time: 0.080657 Jan 22 21:07:54.685742 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1365/2585] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:54 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:54.811682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-431392c8-0a43-48bc-8b86-6db3f1c86b91 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:54.812719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-431392c8-0a43-48bc-8b86-6db3f1c86b91 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:54.830313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-431392c8-0a43-48bc-8b86-6db3f1c86b91 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:54.830313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-431392c8-0a43-48bc-8b86-6db3f1c86b91 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:54.830313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-431392c8-0a43-48bc-8b86-6db3f1c86b91 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:54.830313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-431392c8-0a43-48bc-8b86-6db3f1c86b91 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:54.920563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e563bcb5-35b7-4869-a111-85654ebc6d9d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:54.921652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e563bcb5-35b7-4869-a111-85654ebc6d9d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:54.931288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e563bcb5-35b7-4869-a111-85654ebc6d9d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:54.931870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e563bcb5-35b7-4869-a111-85654ebc6d9d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:54.938556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e563bcb5-35b7-4869-a111-85654ebc6d9d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:54.939124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e563bcb5-35b7-4869-a111-85654ebc6d9d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:55.016300 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e563bcb5-35b7-4869-a111-85654ebc6d9d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.097996 Jan 22 21:07:55.017739 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1366/2586] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:54 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:07:55.112594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c8d6b40f-1188-419a-9115-1c8fdea11764 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:55.125882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c8d6b40f-1188-419a-9115-1c8fdea11764 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:55.148066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8d6b40f-1188-419a-9115-1c8fdea11764 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:55.148563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8d6b40f-1188-419a-9115-1c8fdea11764 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:55.150202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8d6b40f-1188-419a-9115-1c8fdea11764 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:55.150523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8d6b40f-1188-419a-9115-1c8fdea11764 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:55.177174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-431392c8-0a43-48bc-8b86-6db3f1c86b91 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:55.186021 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-431392c8-0a43-48bc-8b86-6db3f1c86b91 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 200 len: 1513 microversion: 2.1 time: 0.386225 Jan 22 21:07:55.187227 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1221/2587] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:54 2022] GET /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 1513 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:55.206358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4f58e489-aa87-45d1-a648-051384c5ab4c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:55.206790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4f58e489-aa87-45d1-a648-051384c5ab4c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: b59794d9-d980-4e57-b3c4-d72dbad2792f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:55.214227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f58e489-aa87-45d1-a648-051384c5ab4c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:55.215042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f58e489-aa87-45d1-a648-051384c5ab4c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:55.216083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f58e489-aa87-45d1-a648-051384c5ab4c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:55.216628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f58e489-aa87-45d1-a648-051384c5ab4c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:55.551144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4f58e489-aa87-45d1-a648-051384c5ab4c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:55.564524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c8d6b40f-1188-419a-9115-1c8fdea11764 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:55.564735 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4f58e489-aa87-45d1-a648-051384c5ab4c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/b59794d9-d980-4e57-b3c4-d72dbad2792f" status: 200 len: 1512 microversion: 2.1 time: 0.361322 Jan 22 21:07:55.565175 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1222/2588] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:55 2022] GET /compute/v2.1/servers/b59794d9-d980-4e57-b3c4-d72dbad2792f => generated 1512 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:55.582490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-609514400", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a0217fa6-f244-42b0-9404-9dd10c72f200"}], "security_groups": [{"name": "tempest-securitygroup--1200846506"}], "key_name": "tempest-keypair-644373818", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "6b81486c-e9f9-4b20-965d-ed0bac18454b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:55.582667 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c8d6b40f-1188-419a-9115-1c8fdea11764 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 200 len: 1323 microversion: 2.1 time: 0.468887 Jan 22 21:07:55.582667 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1367/2589] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:55 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 1323 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:07:55.584359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-f9c31616-a444-428e-b6be-75a54cdd4e3a req-9ef90f21-5de4-464e-8ea9-703698779009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb452c77-f8d2-463f-ba0e-5c9825b70c07", "tag": "6a53adf0-69a2-44de-806e-dfae48dea5f0"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:55.586672 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:55.586672 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:55.600978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f9c31616-a444-428e-b6be-75a54cdd4e3a req-9ef90f21-5de4-464e-8ea9-703698779009 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:55.606632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f9c31616-a444-428e-b6be-75a54cdd4e3a req-9ef90f21-5de4-464e-8ea9-703698779009 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:55.652327 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f9c31616-a444-428e-b6be-75a54cdd4e3a req-9ef90f21-5de4-464e-8ea9-703698779009 service nova] Creating event network-changed:6a53adf0-69a2-44de-806e-dfae48dea5f0 for instance eb452c77-f8d2-463f-ba0e-5c9825b70c07 on nch1-master-1 Jan 22 21:07:55.657547 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-f9c31616-a444-428e-b6be-75a54cdd4e3a req-9ef90f21-5de4-464e-8ea9-703698779009 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077805 Jan 22 21:07:55.666484 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1368/2590] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:55.666484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2a93f9dd-cba4-41f7-b238-d23ecc56abbe tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:55.666484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2a93f9dd-cba4-41f7-b238-d23ecc56abbe tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:55.684103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a93f9dd-cba4-41f7-b238-d23ecc56abbe tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:55.686125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a93f9dd-cba4-41f7-b238-d23ecc56abbe tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:55.687202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a93f9dd-cba4-41f7-b238-d23ecc56abbe tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:55.687923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a93f9dd-cba4-41f7-b238-d23ecc56abbe tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:55.750457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] validate_networks() for [('a0217fa6-f244-42b0-9404-9dd10c72f200', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:07:55.880223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2a93f9dd-cba4-41f7-b238-d23ecc56abbe tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:55.888708 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2a93f9dd-cba4-41f7-b238-d23ecc56abbe tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1326 microversion: 2.1 time: 0.229359 Jan 22 21:07:55.892923 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1369/2591] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:55 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1326 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:55.893594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9b70c35e-b861-4966-91ec-f05f349600ee tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:55.895244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9b70c35e-b861-4966-91ec-f05f349600ee tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:55.901365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b70c35e-b861-4966-91ec-f05f349600ee tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:55.902134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b70c35e-b861-4966-91ec-f05f349600ee tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:55.902923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b70c35e-b861-4966-91ec-f05f349600ee tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:55.903375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b70c35e-b861-4966-91ec-f05f349600ee tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:55.986711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9b70c35e-b861-4966-91ec-f05f349600ee tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:55.995417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9b70c35e-b861-4966-91ec-f05f349600ee tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:55.996977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9b70c35e-b861-4966-91ec-f05f349600ee tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:55.998220 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9b70c35e-b861-4966-91ec-f05f349600ee tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.107958 Jan 22 21:07:55.998808 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1370/2592] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:55 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:56.014259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d2e894e-c012-4570-8df7-7bbdafa85081 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:56.014778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d2e894e-c012-4570-8df7-7bbdafa85081 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: b59794d9-d980-4e57-b3c4-d72dbad2792f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:56.021715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d2e894e-c012-4570-8df7-7bbdafa85081 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:56.022183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d2e894e-c012-4570-8df7-7bbdafa85081 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:56.022998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d2e894e-c012-4570-8df7-7bbdafa85081 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:56.023451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d2e894e-c012-4570-8df7-7bbdafa85081 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:56.051567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d2e894e-c012-4570-8df7-7bbdafa85081 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: b59794d9-d980-4e57-b3c4-d72dbad2792f] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:07:56.355240 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d2e894e-c012-4570-8df7-7bbdafa85081 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "DELETE /compute/v2.1/servers/b59794d9-d980-4e57-b3c4-d72dbad2792f" status: 204 len: 0 microversion: 2.1 time: 0.344342 Jan 22 21:07:56.356037 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1371/2593] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:07:55 2022] DELETE /compute/v2.1/servers/b59794d9-d980-4e57-b3c4-d72dbad2792f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:07:56.362270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dd742372-76ab-42ef-ac44-f202e1e75f7e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:56.363388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dd742372-76ab-42ef-ac44-f202e1e75f7e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:56.369874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd742372-76ab-42ef-ac44-f202e1e75f7e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:56.370340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd742372-76ab-42ef-ac44-f202e1e75f7e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:56.371996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd742372-76ab-42ef-ac44-f202e1e75f7e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:56.371996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd742372-76ab-42ef-ac44-f202e1e75f7e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:56.444880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dd742372-76ab-42ef-ac44-f202e1e75f7e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:56.452573 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dd742372-76ab-42ef-ac44-f202e1e75f7e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1267 microversion: 2.1 time: 0.095170 Jan 22 21:07:56.453307 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1372/2594] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:56 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:56.458788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e44ee6d9-72ac-49aa-b784-daecfba97120 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:56.460262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e44ee6d9-72ac-49aa-b784-daecfba97120 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:56.467135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e44ee6d9-72ac-49aa-b784-daecfba97120 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:56.469646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e44ee6d9-72ac-49aa-b784-daecfba97120 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:56.469646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e44ee6d9-72ac-49aa-b784-daecfba97120 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:56.469646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e44ee6d9-72ac-49aa-b784-daecfba97120 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:56.515285 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e44ee6d9-72ac-49aa-b784-daecfba97120 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.060580 Jan 22 21:07:56.516532 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1373/2595] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:56 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:56.521150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08aba7de-ff37-4241-bb6d-dfab391b6092 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:56.521836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-08aba7de-ff37-4241-bb6d-dfab391b6092 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:56.529577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08aba7de-ff37-4241-bb6d-dfab391b6092 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:56.530071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08aba7de-ff37-4241-bb6d-dfab391b6092 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:56.530894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08aba7de-ff37-4241-bb6d-dfab391b6092 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:56.531380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08aba7de-ff37-4241-bb6d-dfab391b6092 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:56.559582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-08aba7de-ff37-4241-bb6d-dfab391b6092 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c94a0781-6adf-4a29-87a9-1eba0417d8ed] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:07:56.796267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Getting quotas for project 56d86f3305fd4f6a89443ba40bf2778e. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:56.805789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Getting quotas for user cb0f4bdcf5b6411aae7daba6bb727313 and project 56d86f3305fd4f6a89443ba40bf2778e. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:56.825841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:07:56.826577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:07:56.827252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:07:56.827861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:07:56.828460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:07:56.844177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:56.853465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:56.853465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:56.853465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:56.867501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Getting quotas for project 56d86f3305fd4f6a89443ba40bf2778e. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:56.873442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Getting quotas for user cb0f4bdcf5b6411aae7daba6bb727313 and project 56d86f3305fd4f6a89443ba40bf2778e. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:56.920705 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-08aba7de-ff37-4241-bb6d-dfab391b6092 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed" status: 204 len: 0 microversion: 2.1 time: 0.403368 Jan 22 21:07:56.933706 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1374/2596] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:07:56 2022] DELETE /compute/v2.1/servers/c94a0781-6adf-4a29-87a9-1eba0417d8ed => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:07:56.939248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9fad9086-920c-4fa5-9d04-e61e345de6bb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:56.940342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9fad9086-920c-4fa5-9d04-e61e345de6bb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:56.947360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:07:56.950343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b81486c-e9f9-4b20-965d-ed0bac18454b',volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:07:56.953393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fad9086-920c-4fa5-9d04-e61e345de6bb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:56.954196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fad9086-920c-4fa5-9d04-e61e345de6bb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:56.955027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fad9086-920c-4fa5-9d04-e61e345de6bb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:56.955483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fad9086-920c-4fa5-9d04-e61e345de6bb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:57.223774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9fad9086-920c-4fa5-9d04-e61e345de6bb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:57.231391 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9fad9086-920c-4fa5-9d04-e61e345de6bb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 200 len: 1323 microversion: 2.1 time: 0.307134 Jan 22 21:07:57.232275 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1375/2597] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:56 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 1323 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:57.237019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f27689bd-244b-4053-8258-b06582ac3c2f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:57.237979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f27689bd-244b-4053-8258-b06582ac3c2f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:57.244461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f27689bd-244b-4053-8258-b06582ac3c2f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:57.244926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f27689bd-244b-4053-8258-b06582ac3c2f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:57.245791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f27689bd-244b-4053-8258-b06582ac3c2f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:57.246246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f27689bd-244b-4053-8258-b06582ac3c2f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:57.397051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f27689bd-244b-4053-8258-b06582ac3c2f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:57.404727 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f27689bd-244b-4053-8258-b06582ac3c2f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1523 microversion: 2.1 time: 0.171338 Jan 22 21:07:57.405543 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1376/2598] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:57 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:57.410969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ed4666b2-6399-4ed6-aa5b-10adf4a4cc82 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:57.411657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ed4666b2-6399-4ed6-aa5b-10adf4a4cc82 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:57.417996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed4666b2-6399-4ed6-aa5b-10adf4a4cc82 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:57.418463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed4666b2-6399-4ed6-aa5b-10adf4a4cc82 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:57.419301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed4666b2-6399-4ed6-aa5b-10adf4a4cc82 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:57.419751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed4666b2-6399-4ed6-aa5b-10adf4a4cc82 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:57.439983 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d1864ba9-bd10-4c5a-9caf-838e9a3c8bc6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.872882 Jan 22 21:07:57.441143 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1223/2599] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:07:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 1875 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:07:57.449711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-147434267", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "d59ba9cb-222f-46f0-b48e-da0ecf00b69a"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:57.492132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed4666b2-6399-4ed6-aa5b-10adf4a4cc82 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:57.500113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed4666b2-6399-4ed6-aa5b-10adf4a4cc82 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:57.503044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed4666b2-6399-4ed6-aa5b-10adf4a4cc82 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:57.505222 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ed4666b2-6399-4ed6-aa5b-10adf4a4cc82 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.098078 Jan 22 21:07:57.517833 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1377/2600] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:57 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:57.517935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] validate_networks() for [('d59ba9cb-222f-46f0-b48e-da0ecf00b69a', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:07:57.518026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-64947080-60d7-42ef-a0ee-943578849107 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:57.518402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-64947080-60d7-42ef-a0ee-943578849107 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:57.526948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64947080-60d7-42ef-a0ee-943578849107 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:57.529970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64947080-60d7-42ef-a0ee-943578849107 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:57.529970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64947080-60d7-42ef-a0ee-943578849107 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:57.529970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64947080-60d7-42ef-a0ee-943578849107 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:57.993473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-64947080-60d7-42ef-a0ee-943578849107 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:58.008177 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-64947080-60d7-42ef-a0ee-943578849107 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1523 microversion: 2.1 time: 0.499862 Jan 22 21:07:58.013559 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1378/2601] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:57 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1523 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:58.027361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4f473da6-50d1-47c8-bcc9-52900a52f8ce tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:58.035446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4f473da6-50d1-47c8-bcc9-52900a52f8ce tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:58.087803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4f473da6-50d1-47c8-bcc9-52900a52f8ce tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:58.094962 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4f473da6-50d1-47c8-bcc9-52900a52f8ce tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1123 microversion: 2.1 time: 0.079800 Jan 22 21:07:58.096309 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1379/2602] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:58 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1123 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:58.102427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d89e4df6-c433-4645-b819-303f0966cdaa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:58.103323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d89e4df6-c433-4645-b819-303f0966cdaa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:58.110267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d89e4df6-c433-4645-b819-303f0966cdaa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:58.111349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d89e4df6-c433-4645-b819-303f0966cdaa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:58.112186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d89e4df6-c433-4645-b819-303f0966cdaa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:58.112622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d89e4df6-c433-4645-b819-303f0966cdaa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:58.146798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:07:58.147391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:07:58.147668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:07:58.148282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:07:58.148888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:07:58.168131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:58.168730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:58.169754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:58.176226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:58.201753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Getting quotas for project 6cf62f435d904da7baa190b53458bb60. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:07:58.210070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Getting quotas for user a6768bb5c11a4bbd85871d812925174f and project 6cf62f435d904da7baa190b53458bb60. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:07:58.225680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Going to run 2 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:07:58.228072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: 6f691860-b62d-4d4b-a911-bf76987874b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:07:58.278498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d89e4df6-c433-4645-b819-303f0966cdaa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:58.288264 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d89e4df6-c433-4645-b819-303f0966cdaa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1315 microversion: 2.1 time: 0.189624 Jan 22 21:07:58.288857 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1380/2603] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:58 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:58.300058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-894a8d8e-1b62-418a-a3bd-dc7216cde078 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:58.302195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-894a8d8e-1b62-418a-a3bd-dc7216cde078 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:58.315666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-894a8d8e-1b62-418a-a3bd-dc7216cde078 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:58.317312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-894a8d8e-1b62-418a-a3bd-dc7216cde078 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:58.318343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-894a8d8e-1b62-418a-a3bd-dc7216cde078 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:58.319465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-894a8d8e-1b62-418a-a3bd-dc7216cde078 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:58.365369 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-894a8d8e-1b62-418a-a3bd-dc7216cde078 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.075217 Jan 22 21:07:58.366819 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1381/2604] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:58 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:58.372752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-52e34b26-2fa8-4c7b-b593-7610416ec6a3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1020337791", "metadata": {"": ""}}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:58.374445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-52e34b26-2fa8-4c7b-b593-7610416ec6a3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:58.375276 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-52e34b26-2fa8-4c7b-b593-7610416ec6a3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "POST /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164/action" status: 400 len: 170 microversion: 2.1 time: 0.007204 Jan 22 21:07:58.375795 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1382/2605] 10.222.0.100 () {60 vars in 1283 bytes} [Sat Jan 22 21:07:58 2022] POST /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164/action => generated 170 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:07:58.387545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-28a75216-0522-4f6c-b6fa-ff029794028f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:58.388704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-28a75216-0522-4f6c-b6fa-ff029794028f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:58.398585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28a75216-0522-4f6c-b6fa-ff029794028f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:58.399645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28a75216-0522-4f6c-b6fa-ff029794028f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:58.400664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28a75216-0522-4f6c-b6fa-ff029794028f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:58.401304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28a75216-0522-4f6c-b6fa-ff029794028f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:58.414362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=6f691860-b62d-4d4b-a911-bf76987874b0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:07:58.656829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-28a75216-0522-4f6c-b6fa-ff029794028f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:58.668821 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-28a75216-0522-4f6c-b6fa-ff029794028f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 200 len: 1323 microversion: 2.1 time: 0.287855 Jan 22 21:07:58.669408 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1383/2606] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:58 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 1323 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:58.679997 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fd102cdc-f4bb-4e7c-a6a0-32235af2560d tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.237384 Jan 22 21:07:58.680625 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1224/2607] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:07:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 1239 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jan 22 21:07:58.684778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-df38891e-b896-4367-b34a-eeafe8fe0b57 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:58.684778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-df38891e-b896-4367-b34a-eeafe8fe0b57 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:58.695730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-12a0e2c9-a60f-44fa-87cb-d2d16acc6963 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:58.696562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-12a0e2c9-a60f-44fa-87cb-d2d16acc6963 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:58.697675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df38891e-b896-4367-b34a-eeafe8fe0b57 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:58.698134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df38891e-b896-4367-b34a-eeafe8fe0b57 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:58.698933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df38891e-b896-4367-b34a-eeafe8fe0b57 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:58.699374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df38891e-b896-4367-b34a-eeafe8fe0b57 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:58.719867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12a0e2c9-a60f-44fa-87cb-d2d16acc6963 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:58.722745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12a0e2c9-a60f-44fa-87cb-d2d16acc6963 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:58.724186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12a0e2c9-a60f-44fa-87cb-d2d16acc6963 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:58.725298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12a0e2c9-a60f-44fa-87cb-d2d16acc6963 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:58.830702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-12a0e2c9-a60f-44fa-87cb-d2d16acc6963 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:58.850253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-12a0e2c9-a60f-44fa-87cb-d2d16acc6963 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:58.856965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-12a0e2c9-a60f-44fa-87cb-d2d16acc6963 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:58.859387 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-12a0e2c9-a60f-44fa-87cb-d2d16acc6963 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.175303 Jan 22 21:07:58.859983 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1225/2608] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:58 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:07:58.877119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a60df3c6-e13c-4bb9-81d6-3c4cb128e6d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:58.884609 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:58.884609 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:07:58.897109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a60df3c6-e13c-4bb9-81d6-3c4cb128e6d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:58.899025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a60df3c6-e13c-4bb9-81d6-3c4cb128e6d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Searching by: {'deleted': False, 'project_id': '6cf62f435d904da7baa190b53458bb60'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:07:58.925809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a60df3c6-e13c-4bb9-81d6-3c4cb128e6d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:58.925809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a60df3c6-e13c-4bb9-81d6-3c4cb128e6d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:58.926421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a60df3c6-e13c-4bb9-81d6-3c4cb128e6d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:58.926862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a60df3c6-e13c-4bb9-81d6-3c4cb128e6d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:58.954563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-a60df3c6-e13c-4bb9-81d6-3c4cb128e6d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:07:58.981748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-df38891e-b896-4367-b34a-eeafe8fe0b57 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:58.986617 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-df38891e-b896-4367-b34a-eeafe8fe0b57 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1523 microversion: 2.1 time: 0.308541 Jan 22 21:07:58.997545 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a60df3c6-e13c-4bb9-81d6-3c4cb128e6d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 1343 microversion: 2.1 time: 0.119399 Jan 22 21:07:58.997545 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1226/2609] 10.222.0.100 () {58 vars in 1129 bytes} [Sat Jan 22 21:07:58 2022] GET /compute/v2.1/servers => generated 1343 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:58.997886 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1384/2610] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:58 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:59.002635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-75605379-0a58-4352-b0a7-900ec78e43fe tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:59.003266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-75605379-0a58-4352-b0a7-900ec78e43fe tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:59.011431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-96dc5e2d-f088-448a-9410-f70d6929def0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:59.012106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-96dc5e2d-f088-448a-9410-f70d6929def0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:59.018894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96dc5e2d-f088-448a-9410-f70d6929def0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.021582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96dc5e2d-f088-448a-9410-f70d6929def0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.021582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96dc5e2d-f088-448a-9410-f70d6929def0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.021582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96dc5e2d-f088-448a-9410-f70d6929def0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.138169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-75605379-0a58-4352-b0a7-900ec78e43fe tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:59.152314 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-75605379-0a58-4352-b0a7-900ec78e43fe tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1221 microversion: 2.1 time: 0.148889 Jan 22 21:07:59.152314 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1227/2611] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:58 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1221 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:59.180051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-94d275c3-1c3d-4358-bd06-2b801ecec23e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:59.181209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-94d275c3-1c3d-4358-bd06-2b801ecec23e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:59.192902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94d275c3-1c3d-4358-bd06-2b801ecec23e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.195062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94d275c3-1c3d-4358-bd06-2b801ecec23e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.196010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94d275c3-1c3d-4358-bd06-2b801ecec23e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.197587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94d275c3-1c3d-4358-bd06-2b801ecec23e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.312737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-96dc5e2d-f088-448a-9410-f70d6929def0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:59.329982 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-96dc5e2d-f088-448a-9410-f70d6929def0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1523 microversion: 2.1 time: 0.323660 Jan 22 21:07:59.330939 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1385/2612] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:59 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:59.341284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-22edcfc4-dbfc-4bfa-8785-e4d353bf1452 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:59.346799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-22edcfc4-dbfc-4bfa-8785-e4d353bf1452 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:59.356705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22edcfc4-dbfc-4bfa-8785-e4d353bf1452 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.357183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22edcfc4-dbfc-4bfa-8785-e4d353bf1452 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.358867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22edcfc4-dbfc-4bfa-8785-e4d353bf1452 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.359526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22edcfc4-dbfc-4bfa-8785-e4d353bf1452 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.443150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-94d275c3-1c3d-4358-bd06-2b801ecec23e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:59.454244 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-94d275c3-1c3d-4358-bd06-2b801ecec23e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1173 microversion: 2.1 time: 0.294887 Jan 22 21:07:59.461677 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1228/2613] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:59 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1173 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:59.477638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-12d0f427-ebc8-4507-a87f-12e5b8dc0feb req-4bac8220-67b0-4c8f-aafa-4681067a373f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59794d9-d980-4e57-b3c4-d72dbad2792f", "name": "network-vif-deleted", "tag": "f3702ef8-de22-4f30-aa89-9d637d404962"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:59.479153 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:59.479153 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:07:59.491745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-12d0f427-ebc8-4507-a87f-12e5b8dc0feb req-4bac8220-67b0-4c8f-aafa-4681067a373f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.492346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-12d0f427-ebc8-4507-a87f-12e5b8dc0feb req-4bac8220-67b0-4c8f-aafa-4681067a373f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.529369 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-12d0f427-ebc8-4507-a87f-12e5b8dc0feb req-4bac8220-67b0-4c8f-aafa-4681067a373f service nova] Creating event network-vif-deleted:f3702ef8-de22-4f30-aa89-9d637d404962 for instance b59794d9-d980-4e57-b3c4-d72dbad2792f on nch2-master-1 Jan 22 21:07:59.540538 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-12d0f427-ebc8-4507-a87f-12e5b8dc0feb req-4bac8220-67b0-4c8f-aafa-4681067a373f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076536 Jan 22 21:07:59.546031 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1229/2614] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:59.560102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96e8e5ee-92e6-40ca-a109-4f666e309920 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-437657418", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:59.565143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96e8e5ee-92e6-40ca-a109-4f666e309920 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:07:59.565143 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96e8e5ee-92e6-40ca-a109-4f666e309920 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "POST /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164/action" status: 400 len: 938 microversion: 2.1 time: 0.014693 Jan 22 21:07:59.569843 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1230/2615] 10.222.0.100 () {60 vars in 1283 bytes} [Sat Jan 22 21:07:59 2022] POST /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164/action => generated 938 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:07:59.575060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-240f4e08-6e6c-49fe-864a-cae1b840fd1b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:59.576110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-240f4e08-6e6c-49fe-864a-cae1b840fd1b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:59.583941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-240f4e08-6e6c-49fe-864a-cae1b840fd1b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.584400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-240f4e08-6e6c-49fe-864a-cae1b840fd1b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.585201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-240f4e08-6e6c-49fe-864a-cae1b840fd1b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.585897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-240f4e08-6e6c-49fe-864a-cae1b840fd1b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.633198 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-240f4e08-6e6c-49fe-864a-cae1b840fd1b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.061678 Jan 22 21:07:59.634122 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1231/2616] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:07:59 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:07:59.639283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4a9efa4-c3e6-4a49-9ab7-643c2648dd00 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:59.640006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c4a9efa4-c3e6-4a49-9ab7-643c2648dd00 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:59.647719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4a9efa4-c3e6-4a49-9ab7-643c2648dd00 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.648183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4a9efa4-c3e6-4a49-9ab7-643c2648dd00 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.648991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4a9efa4-c3e6-4a49-9ab7-643c2648dd00 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.649534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4a9efa4-c3e6-4a49-9ab7-643c2648dd00 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.672712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-22edcfc4-dbfc-4bfa-8785-e4d353bf1452 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:59.689274 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-22edcfc4-dbfc-4bfa-8785-e4d353bf1452 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1315 microversion: 2.1 time: 0.351303 Jan 22 21:07:59.690332 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1386/2617] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:59 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:59.700421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-ed104068-999d-427d-96aa-b5bf09ab8b88 req-e14903df-8523-494c-8a95-bd975bdeb4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c94a0781-6adf-4a29-87a9-1eba0417d8ed", "name": "network-vif-deleted", "tag": "b11d33d7-8719-4698-b0dc-60a15da88a88"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:07:59.702108 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:07:59.702108 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:07:59.719619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ed104068-999d-427d-96aa-b5bf09ab8b88 req-e14903df-8523-494c-8a95-bd975bdeb4e7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.719619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ed104068-999d-427d-96aa-b5bf09ab8b88 req-e14903df-8523-494c-8a95-bd975bdeb4e7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.726678 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-ed104068-999d-427d-96aa-b5bf09ab8b88 req-e14903df-8523-494c-8a95-bd975bdeb4e7 service nova] Creating event network-vif-deleted:b11d33d7-8719-4698-b0dc-60a15da88a88 for instance c94a0781-6adf-4a29-87a9-1eba0417d8ed on nch1-master-1 Jan 22 21:07:59.734541 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-ed104068-999d-427d-96aa-b5bf09ab8b88 req-e14903df-8523-494c-8a95-bd975bdeb4e7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041530 Jan 22 21:07:59.735857 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1387/2618] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:07:59.743398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dc8cef14-063a-4135-aca5-6e6369d00d73 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:59.745309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dc8cef14-063a-4135-aca5-6e6369d00d73 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:59.752004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc8cef14-063a-4135-aca5-6e6369d00d73 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.753266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc8cef14-063a-4135-aca5-6e6369d00d73 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.755223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc8cef14-063a-4135-aca5-6e6369d00d73 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.755852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc8cef14-063a-4135-aca5-6e6369d00d73 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.922364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c4a9efa4-c3e6-4a49-9ab7-643c2648dd00 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:59.933524 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c4a9efa4-c3e6-4a49-9ab7-643c2648dd00 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1523 microversion: 2.1 time: 0.298292 Jan 22 21:07:59.936895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dc8cef14-063a-4135-aca5-6e6369d00d73 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:07:59.937211 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1232/2619] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:59 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:59.941964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c8966766-9be3-4d9b-99b2-d1a2ed20f34d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:59.942782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c8966766-9be3-4d9b-99b2-d1a2ed20f34d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:59.942922 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dc8cef14-063a-4135-aca5-6e6369d00d73 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 200 len: 1323 microversion: 2.1 time: 0.205400 Jan 22 21:07:59.943577 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1388/2620] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:59 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 1323 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:07:59.952424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8966766-9be3-4d9b-99b2-d1a2ed20f34d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.960584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8966766-9be3-4d9b-99b2-d1a2ed20f34d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.960738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-edcce32d-168d-4df1-afde-d92812489426 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:07:59.960946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8966766-9be3-4d9b-99b2-d1a2ed20f34d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.961053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-edcce32d-168d-4df1-afde-d92812489426 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:07:59.961412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8966766-9be3-4d9b-99b2-d1a2ed20f34d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.963143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edcce32d-168d-4df1-afde-d92812489426 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.963606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edcce32d-168d-4df1-afde-d92812489426 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:07:59.964430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edcce32d-168d-4df1-afde-d92812489426 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:07:59.965028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edcce32d-168d-4df1-afde-d92812489426 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:00.043994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c8966766-9be3-4d9b-99b2-d1a2ed20f34d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:00.057830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c8966766-9be3-4d9b-99b2-d1a2ed20f34d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:00.057830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c8966766-9be3-4d9b-99b2-d1a2ed20f34d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:00.057830 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c8966766-9be3-4d9b-99b2-d1a2ed20f34d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.122306 Jan 22 21:08:00.069388 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1233/2621] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:07:59 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:00.116749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-edcce32d-168d-4df1-afde-d92812489426 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:00.124418 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-edcce32d-168d-4df1-afde-d92812489426 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1523 microversion: 2.1 time: 0.174532 Jan 22 21:08:00.125004 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1389/2622] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:07:59 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:00.146855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24f54316-cbd5-4d0d-b8ae-202b2f3f5249 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:00.148512 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24f54316-cbd5-4d0d-b8ae-202b2f3f5249 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:08:00.149363 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-24f54316-cbd5-4d0d-b8ae-202b2f3f5249 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "POST /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164/action" status: 400 len: 619 microversion: 2.1 time: 0.008611 Jan 22 21:08:00.150499 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1234/2623] 10.222.0.100 () {60 vars in 1283 bytes} [Sat Jan 22 21:08:00 2022] POST /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164/action => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:08:00.166126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3788ef74-bb77-431d-bd69-b0efea9fa3d5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:00.166909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3788ef74-bb77-431d-bd69-b0efea9fa3d5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:00.175061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3788ef74-bb77-431d-bd69-b0efea9fa3d5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:00.176233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3788ef74-bb77-431d-bd69-b0efea9fa3d5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:00.177275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3788ef74-bb77-431d-bd69-b0efea9fa3d5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:00.177776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3788ef74-bb77-431d-bd69-b0efea9fa3d5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:00.180482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1dd20aab-80ed-4f83-819d-6a9dead6314f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:00.181105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1dd20aab-80ed-4f83-819d-6a9dead6314f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:00.255890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1dd20aab-80ed-4f83-819d-6a9dead6314f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:00.265078 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1dd20aab-80ed-4f83-819d-6a9dead6314f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1221 microversion: 2.1 time: 0.088972 Jan 22 21:08:00.266188 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1235/2624] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:00 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:00.337912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3788ef74-bb77-431d-bd69-b0efea9fa3d5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:00.345770 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3788ef74-bb77-431d-bd69-b0efea9fa3d5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1523 microversion: 2.1 time: 0.191447 Jan 22 21:08:00.346354 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1390/2625] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:00 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:00.374071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ce42e1b1-556b-4980-9658-105666c737cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:00.374843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ce42e1b1-556b-4980-9658-105666c737cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:00.400454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce42e1b1-556b-4980-9658-105666c737cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:00.406315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce42e1b1-556b-4980-9658-105666c737cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:00.406315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce42e1b1-556b-4980-9658-105666c737cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:00.406315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce42e1b1-556b-4980-9658-105666c737cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:00.472792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a63f47c7-58a7-4842-9172-07807541ad70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:00.473463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a63f47c7-58a7-4842-9172-07807541ad70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:00.483810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a63f47c7-58a7-4842-9172-07807541ad70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:00.490438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a63f47c7-58a7-4842-9172-07807541ad70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:00.490438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a63f47c7-58a7-4842-9172-07807541ad70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:00.490438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a63f47c7-58a7-4842-9172-07807541ad70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:00.572826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a63f47c7-58a7-4842-9172-07807541ad70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:00.582144 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a63f47c7-58a7-4842-9172-07807541ad70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1221 microversion: 2.1 time: 0.112972 Jan 22 21:08:00.592592 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1391/2626] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:00 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:00.640840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ce42e1b1-556b-4980-9658-105666c737cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:00.651057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-830ec06d-5b07-4d75-82d1-5f421d6cd73d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:00.651057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-830ec06d-5b07-4d75-82d1-5f421d6cd73d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:00.651294 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ce42e1b1-556b-4980-9658-105666c737cf tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1523 microversion: 2.1 time: 0.290640 Jan 22 21:08:00.652202 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1236/2627] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:00 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:00.663400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-830ec06d-5b07-4d75-82d1-5f421d6cd73d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:00.663400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-830ec06d-5b07-4d75-82d1-5f421d6cd73d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:00.663400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-830ec06d-5b07-4d75-82d1-5f421d6cd73d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:00.663400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-830ec06d-5b07-4d75-82d1-5f421d6cd73d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:00.669002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-88e5844c-e789-407f-81f8-07362892adb1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-561355220"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:00.670043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-88e5844c-e789-407f-81f8-07362892adb1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:00.683870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88e5844c-e789-407f-81f8-07362892adb1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:00.684330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88e5844c-e789-407f-81f8-07362892adb1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:00.685341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88e5844c-e789-407f-81f8-07362892adb1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:00.685969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88e5844c-e789-407f-81f8-07362892adb1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:00.718748 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-830ec06d-5b07-4d75-82d1-5f421d6cd73d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.076764 Jan 22 21:08:00.719639 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1392/2628] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:00 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:00.730321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e870219a-fffe-4f89-8b87-c95e0a2d8d5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:00.731035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e870219a-fffe-4f89-8b87-c95e0a2d8d5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:00.743754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e870219a-fffe-4f89-8b87-c95e0a2d8d5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:00.744724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e870219a-fffe-4f89-8b87-c95e0a2d8d5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:00.745625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e870219a-fffe-4f89-8b87-c95e0a2d8d5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:00.746180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e870219a-fffe-4f89-8b87-c95e0a2d8d5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.024432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e870219a-fffe-4f89-8b87-c95e0a2d8d5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:01.033482 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e870219a-fffe-4f89-8b87-c95e0a2d8d5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1315 microversion: 2.1 time: 0.308938 Jan 22 21:08:01.043346 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1393/2629] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:00 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:01.043346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-e8e43961-d253-4272-abe8-252ec2449991 req-125e0c95-6a17-4906-8894-0a9644c3e6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e0044a-73e1-4d70-b612-3798d98ecc1f", "name": "network-vif-plugged", "status": "completed", "tag": "9730300d-1fec-45c1-ba67-15c29a530da5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:01.043346 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:01.043346 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:01.049097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e8e43961-d253-4272-abe8-252ec2449991 req-125e0c95-6a17-4906-8894-0a9644c3e6da service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.049740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e8e43961-d253-4272-abe8-252ec2449991 req-125e0c95-6a17-4906-8894-0a9644c3e6da service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.064631 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-e8e43961-d253-4272-abe8-252ec2449991 req-125e0c95-6a17-4906-8894-0a9644c3e6da service nova] Creating event network-vif-plugged:9730300d-1fec-45c1-ba67-15c29a530da5 for instance 89e0044a-73e1-4d70-b612-3798d98ecc1f on nch1-master-1 Jan 22 21:08:01.071195 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-e8e43961-d253-4272-abe8-252ec2449991 req-125e0c95-6a17-4906-8894-0a9644c3e6da service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035065 Jan 22 21:08:01.072529 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1394/2630] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:01.077761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eed2d5cb-ac43-4209-a577-3dd5751dd5d3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:01.078800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eed2d5cb-ac43-4209-a577-3dd5751dd5d3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:01.087142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eed2d5cb-ac43-4209-a577-3dd5751dd5d3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.087982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eed2d5cb-ac43-4209-a577-3dd5751dd5d3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.089028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eed2d5cb-ac43-4209-a577-3dd5751dd5d3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.090290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eed2d5cb-ac43-4209-a577-3dd5751dd5d3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.282964 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-88e5844c-e789-407f-81f8-07362892adb1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "POST /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164/action" status: 202 len: 0 microversion: 2.1 time: 0.618103 Jan 22 21:08:01.284445 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1237/2631] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:00 2022] POST /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164/action => generated 0 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 22 21:08:01.298038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6ca13fd5-94cc-49d6-baa6-bd1dee4bbdfc tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:01.301643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6ca13fd5-94cc-49d6-baa6-bd1dee4bbdfc tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:01.311275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ca13fd5-94cc-49d6-baa6-bd1dee4bbdfc tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.312073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ca13fd5-94cc-49d6-baa6-bd1dee4bbdfc tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.313163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ca13fd5-94cc-49d6-baa6-bd1dee4bbdfc tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.313838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ca13fd5-94cc-49d6-baa6-bd1dee4bbdfc tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.333716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-eed2d5cb-ac43-4209-a577-3dd5751dd5d3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:01.343562 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eed2d5cb-ac43-4209-a577-3dd5751dd5d3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 200 len: 1323 microversion: 2.1 time: 0.269611 Jan 22 21:08:01.353669 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1395/2632] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:01 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 1323 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:01.358983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c54eb73d-8496-4107-abdd-eecdfaa9b16c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:01.359847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c54eb73d-8496-4107-abdd-eecdfaa9b16c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:01.368229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c54eb73d-8496-4107-abdd-eecdfaa9b16c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.368835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c54eb73d-8496-4107-abdd-eecdfaa9b16c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.369850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c54eb73d-8496-4107-abdd-eecdfaa9b16c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.370368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c54eb73d-8496-4107-abdd-eecdfaa9b16c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.419005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6ca13fd5-94cc-49d6-baa6-bd1dee4bbdfc tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:01.429030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6ca13fd5-94cc-49d6-baa6-bd1dee4bbdfc tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:01.435947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6ca13fd5-94cc-49d6-baa6-bd1dee4bbdfc tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:01.437313 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6ca13fd5-94cc-49d6-baa6-bd1dee4bbdfc tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.150237 Jan 22 21:08:01.438000 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1238/2633] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:01 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:01.447043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4f274b8e-427e-4279-9e6c-25cde42e0962 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1553518673"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:01.448497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4f274b8e-427e-4279-9e6c-25cde42e0962 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:01.457901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f274b8e-427e-4279-9e6c-25cde42e0962 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.459891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f274b8e-427e-4279-9e6c-25cde42e0962 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.462032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f274b8e-427e-4279-9e6c-25cde42e0962 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.462674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f274b8e-427e-4279-9e6c-25cde42e0962 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.463504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c54eb73d-8496-4107-abdd-eecdfaa9b16c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:01.481622 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c54eb73d-8496-4107-abdd-eecdfaa9b16c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1225 microversion: 2.1 time: 0.124179 Jan 22 21:08:01.486709 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1396/2634] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:01 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:01.517571 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-4f274b8e-427e-4279-9e6c-25cde42e0962 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] HTTP exception thrown: Cannot 'createImage' instance 9dd17fd5-afdd-4c9d-b3f4-37e074b52164 while it is in task_state image_snapshot_pending Jan 22 21:08:01.523685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4f274b8e-427e-4279-9e6c-25cde42e0962 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Returning 409 to user: Cannot 'createImage' instance 9dd17fd5-afdd-4c9d-b3f4-37e074b52164 while it is in task_state image_snapshot_pending {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:08:01.523685 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4f274b8e-427e-4279-9e6c-25cde42e0962 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "POST /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164/action" status: 409 len: 167 microversion: 2.1 time: 0.080187 Jan 22 21:08:01.529097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0488d9f7-7d22-4f8c-aa1c-688689293fe8 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '.version_select at 0x7f1ed5f53e50>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:01.534063 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1239/2635] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:01 2022] POST /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164/action => generated 167 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:08:01.559612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-a8596ab1-77f1-4cca-a76f-1edcfeb83dd1 req-4d29ba7d-4f8c-47f2-bfad-25d33c37b5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd923b09-9a4a-4371-8e4e-044fd3787b72", "tag": "b5da264d-bc7c-4452-b54d-69a739e13c9f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:01.561765 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:01.561765 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:01.572093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a8596ab1-77f1-4cca-a76f-1edcfeb83dd1 req-4d29ba7d-4f8c-47f2-bfad-25d33c37b5f5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.572490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a8596ab1-77f1-4cca-a76f-1edcfeb83dd1 req-4d29ba7d-4f8c-47f2-bfad-25d33c37b5f5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.592331 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-a8596ab1-77f1-4cca-a76f-1edcfeb83dd1 req-4d29ba7d-4f8c-47f2-bfad-25d33c37b5f5 service nova] Creating event network-changed:b5da264d-bc7c-4452-b54d-69a739e13c9f for instance dd923b09-9a4a-4371-8e4e-044fd3787b72 on nch1-master-1 Jan 22 21:08:01.598499 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-a8596ab1-77f1-4cca-a76f-1edcfeb83dd1 req-4d29ba7d-4f8c-47f2-bfad-25d33c37b5f5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044711 Jan 22 21:08:01.599458 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1240/2636] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:08:01.617441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f0dde3b-cebd-44b0-8fa7-ca4cef7e869a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:01.618830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9f0dde3b-cebd-44b0-8fa7-ca4cef7e869a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:01.626315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f0dde3b-cebd-44b0-8fa7-ca4cef7e869a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.626836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f0dde3b-cebd-44b0-8fa7-ca4cef7e869a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.627648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f0dde3b-cebd-44b0-8fa7-ca4cef7e869a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.628790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f0dde3b-cebd-44b0-8fa7-ca4cef7e869a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.751544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9f0dde3b-cebd-44b0-8fa7-ca4cef7e869a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:01.761557 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9f0dde3b-cebd-44b0-8fa7-ca4cef7e869a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1239 microversion: 2.1 time: 0.160393 Jan 22 21:08:01.762641 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1241/2637] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:01 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1239 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:01.777265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a4382ef-fe68-4ff9-85e2-61d777c493e5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:01.778393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9a4382ef-fe68-4ff9-85e2-61d777c493e5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:01.789048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a4382ef-fe68-4ff9-85e2-61d777c493e5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.789602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a4382ef-fe68-4ff9-85e2-61d777c493e5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.791281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a4382ef-fe68-4ff9-85e2-61d777c493e5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.791742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a4382ef-fe68-4ff9-85e2-61d777c493e5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.840205 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a4382ef-fe68-4ff9-85e2-61d777c493e5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.076100 Jan 22 21:08:01.841051 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1242/2638] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:01 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:01.852190 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0488d9f7-7d22-4f8c-aa1c-688689293fe8 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "DELETE /compute/v2.1/images/fac0639a-8270-45a7-af74-9fcede4b27e0" status: 204 len: 0 microversion: 2.1 time: 0.326555 Jan 22 21:08:01.859576 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1397/2639] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:01 2022] DELETE /compute/v2.1/images/fac0639a-8270-45a7-af74-9fcede4b27e0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:08:01.866225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4a36b421-8cd7-4962-a4bc-ef39e96309db tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:01.867285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4a36b421-8cd7-4962-a4bc-ef39e96309db tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:01.875979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a36b421-8cd7-4962-a4bc-ef39e96309db tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.876732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a36b421-8cd7-4962-a4bc-ef39e96309db tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:01.877806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a36b421-8cd7-4962-a4bc-ef39e96309db tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:01.879505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a36b421-8cd7-4962-a4bc-ef39e96309db tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:02.054570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-863dbcc6-dbeb-4d83-805c-92821d515a5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:02.055615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-863dbcc6-dbeb-4d83-805c-92821d515a5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:02.063492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-863dbcc6-dbeb-4d83-805c-92821d515a5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:02.064125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-863dbcc6-dbeb-4d83-805c-92821d515a5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:02.065040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-863dbcc6-dbeb-4d83-805c-92821d515a5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:02.065493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-863dbcc6-dbeb-4d83-805c-92821d515a5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:02.189922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4a36b421-8cd7-4962-a4bc-ef39e96309db tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:02.198326 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4a36b421-8cd7-4962-a4bc-ef39e96309db tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1535 microversion: 2.1 time: 0.338916 Jan 22 21:08:02.198919 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1243/2640] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:01 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1535 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:02.224032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-863dbcc6-dbeb-4d83-805c-92821d515a5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:02.243437 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-863dbcc6-dbeb-4d83-805c-92821d515a5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1315 microversion: 2.1 time: 0.195285 Jan 22 21:08:02.244228 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1398/2641] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:02 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:02.361072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7f7aee87-249b-4257-aa89-a343b2e2e167 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:02.361708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7f7aee87-249b-4257-aa89-a343b2e2e167 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:02.368902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f7aee87-249b-4257-aa89-a343b2e2e167 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:02.369459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f7aee87-249b-4257-aa89-a343b2e2e167 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:02.370634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f7aee87-249b-4257-aa89-a343b2e2e167 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:02.371177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f7aee87-249b-4257-aa89-a343b2e2e167 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:02.456192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e81cc9da-38f1-4a5e-9848-5da98f551cdf tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:02.457286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e81cc9da-38f1-4a5e-9848-5da98f551cdf tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:02.464644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e81cc9da-38f1-4a5e-9848-5da98f551cdf tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:02.469178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e81cc9da-38f1-4a5e-9848-5da98f551cdf tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:02.469178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e81cc9da-38f1-4a5e-9848-5da98f551cdf tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:02.469178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e81cc9da-38f1-4a5e-9848-5da98f551cdf tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:02.641709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e81cc9da-38f1-4a5e-9848-5da98f551cdf tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:02.651144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e81cc9da-38f1-4a5e-9848-5da98f551cdf tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:02.659125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e81cc9da-38f1-4a5e-9848-5da98f551cdf tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:02.662549 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e81cc9da-38f1-4a5e-9848-5da98f551cdf tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.210134 Jan 22 21:08:02.664953 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1399/2642] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:02 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:08:02.672763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b2d99b83-f099-4ac1-b016-0961405a04fe tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:02.673388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b2d99b83-f099-4ac1-b016-0961405a04fe tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:02.686519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2d99b83-f099-4ac1-b016-0961405a04fe tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:02.686986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2d99b83-f099-4ac1-b016-0961405a04fe tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:02.689226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2d99b83-f099-4ac1-b016-0961405a04fe tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:02.689763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2d99b83-f099-4ac1-b016-0961405a04fe tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:02.777105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b2d99b83-f099-4ac1-b016-0961405a04fe tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:02.788564 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b2d99b83-f099-4ac1-b016-0961405a04fe tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1281 microversion: 2.1 time: 0.122462 Jan 22 21:08:02.789381 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1400/2643] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:02 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1281 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:02.804701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-32050115-a081-4d13-95cf-33195133d2f0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:02.810565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-32050115-a081-4d13-95cf-33195133d2f0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:02.814153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32050115-a081-4d13-95cf-33195133d2f0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:02.814810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32050115-a081-4d13-95cf-33195133d2f0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:02.816483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32050115-a081-4d13-95cf-33195133d2f0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:02.817474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32050115-a081-4d13-95cf-33195133d2f0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:03.075293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-32050115-a081-4d13-95cf-33195133d2f0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:03.092743 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-32050115-a081-4d13-95cf-33195133d2f0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1307 microversion: 2.1 time: 0.292933 Jan 22 21:08:03.093349 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1401/2644] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:02 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1307 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:03.109588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d8febe2-b87f-4f9e-88a3-a1f4bac4b827 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:03.112050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d8febe2-b87f-4f9e-88a3-a1f4bac4b827 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:03.123094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d8febe2-b87f-4f9e-88a3-a1f4bac4b827 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:03.124464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d8febe2-b87f-4f9e-88a3-a1f4bac4b827 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:03.125311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d8febe2-b87f-4f9e-88a3-a1f4bac4b827 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:03.125861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d8febe2-b87f-4f9e-88a3-a1f4bac4b827 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:03.160552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7f7aee87-249b-4257-aa89-a343b2e2e167 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:03.168165 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7f7aee87-249b-4257-aa89-a343b2e2e167 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 200 len: 1323 microversion: 2.1 time: 0.810886 Jan 22 21:08:03.168744 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1244/2645] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:02 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 1323 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:03.173361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-27cc6ca5-3568-4275-9e64-fd8439a20710 req-61d02a27-c3ed-4311-8e34-e1e411c66c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb452c77-f8d2-463f-ba0e-5c9825b70c07", "name": "network-vif-plugged", "status": "completed", "tag": "6a53adf0-69a2-44de-806e-dfae48dea5f0"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:03.174970 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:03.174970 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:03.182801 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d8febe2-b87f-4f9e-88a3-a1f4bac4b827 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.087083 Jan 22 21:08:03.184040 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1402/2646] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:03 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:03.187231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-27cc6ca5-3568-4275-9e64-fd8439a20710 req-61d02a27-c3ed-4311-8e34-e1e411c66c20 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:03.187731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-27cc6ca5-3568-4275-9e64-fd8439a20710 req-61d02a27-c3ed-4311-8e34-e1e411c66c20 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:03.200899 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-27cc6ca5-3568-4275-9e64-fd8439a20710 req-61d02a27-c3ed-4311-8e34-e1e411c66c20 service nova] Creating event network-vif-plugged:6a53adf0-69a2-44de-806e-dfae48dea5f0 for instance eb452c77-f8d2-463f-ba0e-5c9825b70c07 on nch1-master-1 Jan 22 21:08:03.207210 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-27cc6ca5-3568-4275-9e64-fd8439a20710 req-61d02a27-c3ed-4311-8e34-e1e411c66c20 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036643 Jan 22 21:08:03.209113 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1245/2647] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:03.217566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-27cb4da7-221a-49a2-85dd-948e9a86b358 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:03.219444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-27cb4da7-221a-49a2-85dd-948e9a86b358 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:03.229730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27cb4da7-221a-49a2-85dd-948e9a86b358 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:03.230823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27cb4da7-221a-49a2-85dd-948e9a86b358 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:03.231993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27cb4da7-221a-49a2-85dd-948e9a86b358 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:03.233233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27cb4da7-221a-49a2-85dd-948e9a86b358 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:03.263157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b26ef143-c28c-45b9-9c23-790db5bfa7cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:03.263992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b26ef143-c28c-45b9-9c23-790db5bfa7cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:03.274971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b26ef143-c28c-45b9-9c23-790db5bfa7cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:03.275808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b26ef143-c28c-45b9-9c23-790db5bfa7cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:03.277981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b26ef143-c28c-45b9-9c23-790db5bfa7cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:03.279640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b26ef143-c28c-45b9-9c23-790db5bfa7cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:03.539885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-27cb4da7-221a-49a2-85dd-948e9a86b358 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:03.554583 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-27cb4da7-221a-49a2-85dd-948e9a86b358 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1535 microversion: 2.1 time: 0.341869 Jan 22 21:08:03.562786 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1403/2648] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:03 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1535 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:03.672648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b26ef143-c28c-45b9-9c23-790db5bfa7cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:03.680131 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b26ef143-c28c-45b9-9c23-790db5bfa7cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1315 microversion: 2.1 time: 0.422737 Jan 22 21:08:03.680703 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1246/2649] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:03 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:03.689657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-24fe7a91-bcf4-4fd7-887b-9c643f014f37 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:03.690186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-24fe7a91-bcf4-4fd7-887b-9c643f014f37 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:03.698888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24fe7a91-bcf4-4fd7-887b-9c643f014f37 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:03.699346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24fe7a91-bcf4-4fd7-887b-9c643f014f37 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:03.700363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24fe7a91-bcf4-4fd7-887b-9c643f014f37 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:03.700807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24fe7a91-bcf4-4fd7-887b-9c643f014f37 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:03.806551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-30d91b3a-3178-4470-bc7b-e9582c05ec07 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:03.807569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-30d91b3a-3178-4470-bc7b-e9582c05ec07 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:03.813151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-24fe7a91-bcf4-4fd7-887b-9c643f014f37 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:03.820225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30d91b3a-3178-4470-bc7b-e9582c05ec07 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:03.821386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30d91b3a-3178-4470-bc7b-e9582c05ec07 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:03.822524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30d91b3a-3178-4470-bc7b-e9582c05ec07 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:03.823345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30d91b3a-3178-4470-bc7b-e9582c05ec07 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:03.828865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-24fe7a91-bcf4-4fd7-887b-9c643f014f37 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:03.832977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-24fe7a91-bcf4-4fd7-887b-9c643f014f37 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:03.835068 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-24fe7a91-bcf4-4fd7-887b-9c643f014f37 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.149311 Jan 22 21:08:03.835923 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1404/2650] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:03 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:08:04.111373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a0f375f3-cb50-4e15-8177-6e125946a5c3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:04.112182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a0f375f3-cb50-4e15-8177-6e125946a5c3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:04.118802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0f375f3-cb50-4e15-8177-6e125946a5c3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:04.119270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0f375f3-cb50-4e15-8177-6e125946a5c3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:04.123420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0f375f3-cb50-4e15-8177-6e125946a5c3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:04.123420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0f375f3-cb50-4e15-8177-6e125946a5c3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:04.183014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-30d91b3a-3178-4470-bc7b-e9582c05ec07 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:04.193797 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-30d91b3a-3178-4470-bc7b-e9582c05ec07 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.391131 Jan 22 21:08:04.194795 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1247/2651] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:03 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:04.201139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b8363996-5a17-487f-95b5-72d603a31ba1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:04.201789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b8363996-5a17-487f-95b5-72d603a31ba1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:04.208805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8363996-5a17-487f-95b5-72d603a31ba1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:04.209548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8363996-5a17-487f-95b5-72d603a31ba1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:04.210364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8363996-5a17-487f-95b5-72d603a31ba1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:04.211259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8363996-5a17-487f-95b5-72d603a31ba1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:04.272332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a0f375f3-cb50-4e15-8177-6e125946a5c3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:04.280148 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a0f375f3-cb50-4e15-8177-6e125946a5c3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.172590 Jan 22 21:08:04.280728 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1405/2652] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:04 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:04.285761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c6afa155-41d1-4f07-89c2-feaddc8f3675 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:04.292954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c6afa155-41d1-4f07-89c2-feaddc8f3675 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:04.294345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6afa155-41d1-4f07-89c2-feaddc8f3675 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:04.294810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6afa155-41d1-4f07-89c2-feaddc8f3675 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:04.295613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6afa155-41d1-4f07-89c2-feaddc8f3675 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:04.296061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6afa155-41d1-4f07-89c2-feaddc8f3675 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:04.340270 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c6afa155-41d1-4f07-89c2-feaddc8f3675 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.058307 Jan 22 21:08:04.340929 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1406/2653] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:04 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:04.427539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b8363996-5a17-487f-95b5-72d603a31ba1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:04.444945 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b8363996-5a17-487f-95b5-72d603a31ba1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 200 len: 1323 microversion: 2.1 time: 0.248992 Jan 22 21:08:04.447429 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1248/2654] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:04 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 1323 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:04.576863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ba72fa80-9537-4752-a38a-980651fff741 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:04.579418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ba72fa80-9537-4752-a38a-980651fff741 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:04.600412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba72fa80-9537-4752-a38a-980651fff741 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:04.601000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba72fa80-9537-4752-a38a-980651fff741 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:04.601854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba72fa80-9537-4752-a38a-980651fff741 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:04.602479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba72fa80-9537-4752-a38a-980651fff741 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:04.697832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-58d394c4-0993-452d-848e-53bfe375da96 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:04.698385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-58d394c4-0993-452d-848e-53bfe375da96 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:04.707043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58d394c4-0993-452d-848e-53bfe375da96 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:04.712687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58d394c4-0993-452d-848e-53bfe375da96 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:04.712687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58d394c4-0993-452d-848e-53bfe375da96 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:04.712687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58d394c4-0993-452d-848e-53bfe375da96 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:04.882765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ba72fa80-9537-4752-a38a-980651fff741 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:04.891554 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ba72fa80-9537-4752-a38a-980651fff741 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1541 microversion: 2.1 time: 0.321025 Jan 22 21:08:04.892138 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1407/2655] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:04 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1541 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:04.897027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a8e4fef5-d095-4adc-b4ff-3056eb439bd3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:04.897770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a8e4fef5-d095-4adc-b4ff-3056eb439bd3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:04.905284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8e4fef5-d095-4adc-b4ff-3056eb439bd3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:04.905846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8e4fef5-d095-4adc-b4ff-3056eb439bd3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:04.906885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8e4fef5-d095-4adc-b4ff-3056eb439bd3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:04.907771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8e4fef5-d095-4adc-b4ff-3056eb439bd3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:05.028535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-58d394c4-0993-452d-848e-53bfe375da96 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:05.043780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a8e4fef5-d095-4adc-b4ff-3056eb439bd3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:05.054274 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-58d394c4-0993-452d-848e-53bfe375da96 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1315 microversion: 2.1 time: 0.360404 Jan 22 21:08:05.068455 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1249/2656] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:04 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:05.086894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a8e4fef5-d095-4adc-b4ff-3056eb439bd3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:05.094218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a8e4fef5-d095-4adc-b4ff-3056eb439bd3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:05.095418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-3c4384b5-b843-4d17-86c5-a2c5d112f7e0 req-1f550d34-10b4-442e-a031-44393c938a4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6275dd89-0924-4941-a1ab-1b37c7020f37", "tag": "5daf99eb-9bf9-4785-80a9-5e188da8fabd"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:05.099875 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a8e4fef5-d095-4adc-b4ff-3056eb439bd3 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.204224 Jan 22 21:08:05.100532 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1408/2657] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:04 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:05.117811 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:05.117811 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:05.117811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3c4384b5-b843-4d17-86c5-a2c5d112f7e0 req-1f550d34-10b4-442e-a031-44393c938a4c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:05.117811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3c4384b5-b843-4d17-86c5-a2c5d112f7e0 req-1f550d34-10b4-442e-a031-44393c938a4c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:05.124979 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-3c4384b5-b843-4d17-86c5-a2c5d112f7e0 req-1f550d34-10b4-442e-a031-44393c938a4c service nova] Creating event network-changed:5daf99eb-9bf9-4785-80a9-5e188da8fabd for instance 6275dd89-0924-4941-a1ab-1b37c7020f37 on nch2-master-1 Jan 22 21:08:05.132414 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-3c4384b5-b843-4d17-86c5-a2c5d112f7e0 req-1f550d34-10b4-442e-a031-44393c938a4c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066745 Jan 22 21:08:05.133875 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1250/2658] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:05.212323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cc6a66df-1703-490c-98c6-c002e78458c4 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:05.213815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cc6a66df-1703-490c-98c6-c002e78458c4 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:05.221691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc6a66df-1703-490c-98c6-c002e78458c4 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:05.223166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc6a66df-1703-490c-98c6-c002e78458c4 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:05.224229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc6a66df-1703-490c-98c6-c002e78458c4 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:05.224931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc6a66df-1703-490c-98c6-c002e78458c4 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:05.302834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-247a3a82-af4d-444d-bdba-9563467e259d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:05.303822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-247a3a82-af4d-444d-bdba-9563467e259d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:05.311661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-247a3a82-af4d-444d-bdba-9563467e259d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:05.312619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-247a3a82-af4d-444d-bdba-9563467e259d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:05.313733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-247a3a82-af4d-444d-bdba-9563467e259d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:05.314381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-247a3a82-af4d-444d-bdba-9563467e259d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:05.518766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cc6a66df-1703-490c-98c6-c002e78458c4 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:05.528129 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cc6a66df-1703-490c-98c6-c002e78458c4 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.319848 Jan 22 21:08:05.529663 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1409/2659] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:05 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:05.546395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-31aebfe4-a16d-4e00-8c69-ce89c746946b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:05.547832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-31aebfe4-a16d-4e00-8c69-ce89c746946b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:05.555117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31aebfe4-a16d-4e00-8c69-ce89c746946b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:05.556093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31aebfe4-a16d-4e00-8c69-ce89c746946b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:05.557001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31aebfe4-a16d-4e00-8c69-ce89c746946b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:05.557694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31aebfe4-a16d-4e00-8c69-ce89c746946b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:05.605101 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-31aebfe4-a16d-4e00-8c69-ce89c746946b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.062326 Jan 22 21:08:05.610244 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1410/2660] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:05 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:05.622619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-7b125ace-1263-4ec2-adb8-eb7e9518c839 req-7d6183c1-4552-4ca3-a1fc-19268a13a367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c330ed65-02f3-4e67-854d-a29cee920d71", "tag": "7f783146-f266-4f84-af14-dce2807816b9"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:05.622619 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:05.622619 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:05.632704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7b125ace-1263-4ec2-adb8-eb7e9518c839 req-7d6183c1-4552-4ca3-a1fc-19268a13a367 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:05.633454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7b125ace-1263-4ec2-adb8-eb7e9518c839 req-7d6183c1-4552-4ca3-a1fc-19268a13a367 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:05.653349 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-7b125ace-1263-4ec2-adb8-eb7e9518c839 req-7d6183c1-4552-4ca3-a1fc-19268a13a367 service nova] Creating event network-changed:7f783146-f266-4f84-af14-dce2807816b9 for instance c330ed65-02f3-4e67-854d-a29cee920d71 on nch2-master-1 Jan 22 21:08:05.658645 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-7b125ace-1263-4ec2-adb8-eb7e9518c839 req-7d6183c1-4552-4ca3-a1fc-19268a13a367 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046522 Jan 22 21:08:05.660507 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1411/2661] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:05.666883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-029438fb-81d6-46b8-b9cc-031c4ae2f7cf tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:05.667872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-029438fb-81d6-46b8-b9cc-031c4ae2f7cf tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:05.679190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-029438fb-81d6-46b8-b9cc-031c4ae2f7cf tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:05.679859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-029438fb-81d6-46b8-b9cc-031c4ae2f7cf tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:05.681451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-029438fb-81d6-46b8-b9cc-031c4ae2f7cf tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:05.682276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-029438fb-81d6-46b8-b9cc-031c4ae2f7cf tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:05.687857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-247a3a82-af4d-444d-bdba-9563467e259d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:05.702119 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-247a3a82-af4d-444d-bdba-9563467e259d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.401946 Jan 22 21:08:05.702119 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1251/2662] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:05 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:05.914808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a58086cd-51fd-441d-b2b4-cf38abeeb3ad tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:05.917644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a58086cd-51fd-441d-b2b4-cf38abeeb3ad tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:05.929673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a58086cd-51fd-441d-b2b4-cf38abeeb3ad tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:05.930651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a58086cd-51fd-441d-b2b4-cf38abeeb3ad tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:05.931897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a58086cd-51fd-441d-b2b4-cf38abeeb3ad tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:05.932679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a58086cd-51fd-441d-b2b4-cf38abeeb3ad tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:05.976084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-029438fb-81d6-46b8-b9cc-031c4ae2f7cf tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:05.984059 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-029438fb-81d6-46b8-b9cc-031c4ae2f7cf tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 200 len: 1471 microversion: 2.1 time: 0.321999 Jan 22 21:08:05.984887 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1412/2663] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:05 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 1471 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:06.001832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0157f834-9c8f-4dc7-8a2f-3400d65b375f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:06.002459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0157f834-9c8f-4dc7-8a2f-3400d65b375f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 89e0044a-73e1-4d70-b612-3798d98ecc1f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:06.008954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0157f834-9c8f-4dc7-8a2f-3400d65b375f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.009730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0157f834-9c8f-4dc7-8a2f-3400d65b375f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.010442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0157f834-9c8f-4dc7-8a2f-3400d65b375f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.010898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0157f834-9c8f-4dc7-8a2f-3400d65b375f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.161561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0157f834-9c8f-4dc7-8a2f-3400d65b375f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:06.169174 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0157f834-9c8f-4dc7-8a2f-3400d65b375f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/89e0044a-73e1-4d70-b612-3798d98ecc1f" status: 200 len: 1472 microversion: 2.1 time: 0.170894 Jan 22 21:08:06.169797 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1413/2664] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:05 2022] GET /compute/v2.1/servers/89e0044a-73e1-4d70-b612-3798d98ecc1f => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:06.185046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-507d75af-bc19-4601-81bd-49288f7f591c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:06.185983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-507d75af-bc19-4601-81bd-49288f7f591c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:06.194496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-507d75af-bc19-4601-81bd-49288f7f591c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.194961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-507d75af-bc19-4601-81bd-49288f7f591c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.195832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-507d75af-bc19-4601-81bd-49288f7f591c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.196487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-507d75af-bc19-4601-81bd-49288f7f591c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.211233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a58086cd-51fd-441d-b2b4-cf38abeeb3ad tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:06.222122 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a58086cd-51fd-441d-b2b4-cf38abeeb3ad tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1541 microversion: 2.1 time: 0.315001 Jan 22 21:08:06.232839 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1252/2665] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:05 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1541 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:06.238169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85a7a183-6e34-427e-a89e-d730f5e2a7f0 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:06.238813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85a7a183-6e34-427e-a89e-d730f5e2a7f0 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:06.245216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85a7a183-6e34-427e-a89e-d730f5e2a7f0 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.245712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85a7a183-6e34-427e-a89e-d730f5e2a7f0 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.246575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85a7a183-6e34-427e-a89e-d730f5e2a7f0 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.247082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85a7a183-6e34-427e-a89e-d730f5e2a7f0 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.336652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-85a7a183-6e34-427e-a89e-d730f5e2a7f0 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:06.345047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-85a7a183-6e34-427e-a89e-d730f5e2a7f0 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:06.347598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-85a7a183-6e34-427e-a89e-d730f5e2a7f0 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:06.348863 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-85a7a183-6e34-427e-a89e-d730f5e2a7f0 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.114894 Jan 22 21:08:06.349434 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1253/2666] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:06 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:06.354391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb7ace3c-26e5-4ca1-9cc2-5f69003b83f3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:06.358597 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:06.358597 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:06.359595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fb7ace3c-26e5-4ca1-9cc2-5f69003b83f3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:06.360607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb7ace3c-26e5-4ca1-9cc2-5f69003b83f3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Searching by: {'reservation_id': 'r-jqjgq4b6', 'deleted': False, 'project_id': '1e6094793b214ae7af6611b1571cac3d'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:08:06.367127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb7ace3c-26e5-4ca1-9cc2-5f69003b83f3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.367585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb7ace3c-26e5-4ca1-9cc2-5f69003b83f3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.368393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb7ace3c-26e5-4ca1-9cc2-5f69003b83f3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.369008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb7ace3c-26e5-4ca1-9cc2-5f69003b83f3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.436111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-507d75af-bc19-4601-81bd-49288f7f591c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:06.449307 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-507d75af-bc19-4601-81bd-49288f7f591c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1315 microversion: 2.1 time: 0.265833 Jan 22 21:08:06.460130 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1414/2667] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:06 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:06.502779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-fb7ace3c-26e5-4ca1-9cc2-5f69003b83f3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:08:06.547569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3667dadd-2b75-4a95-a3d3-736cf5398edf tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:06.548607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3667dadd-2b75-4a95-a3d3-736cf5398edf tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:06.556053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3667dadd-2b75-4a95-a3d3-736cf5398edf tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.556639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3667dadd-2b75-4a95-a3d3-736cf5398edf tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.557563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3667dadd-2b75-4a95-a3d3-736cf5398edf tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.558212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3667dadd-2b75-4a95-a3d3-736cf5398edf tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.587405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fb7ace3c-26e5-4ca1-9cc2-5f69003b83f3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:06.597139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb7ace3c-26e5-4ca1-9cc2-5f69003b83f3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.597938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb7ace3c-26e5-4ca1-9cc2-5f69003b83f3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.796609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3667dadd-2b75-4a95-a3d3-736cf5398edf tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:06.806399 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3667dadd-2b75-4a95-a3d3-736cf5398edf tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.262473 Jan 22 21:08:06.807060 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1415/2668] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:06 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:06.811950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-98d02f54-84a6-48b4-8fae-2d0d59480801 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:06.812948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-98d02f54-84a6-48b4-8fae-2d0d59480801 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:06.819537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98d02f54-84a6-48b4-8fae-2d0d59480801 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.820195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98d02f54-84a6-48b4-8fae-2d0d59480801 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.826490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98d02f54-84a6-48b4-8fae-2d0d59480801 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.830127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98d02f54-84a6-48b4-8fae-2d0d59480801 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.848125 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb7ace3c-26e5-4ca1-9cc2-5f69003b83f3 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/detail?reservation_id=r-jqjgq4b6" status: 200 len: 2936 microversion: 2.1 time: 0.497168 Jan 22 21:08:06.849321 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1254/2669] 10.222.0.100 () {58 vars in 1201 bytes} [Sat Jan 22 21:08:06 2022] GET /compute/v2.1/servers/detail?reservation_id=r-jqjgq4b6 => generated 2936 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:06.854032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab2b1758-6120-4475-878a-091bed7140fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:06.854588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab2b1758-6120-4475-878a-091bed7140fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:06.865064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab2b1758-6120-4475-878a-091bed7140fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.865542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab2b1758-6120-4475-878a-091bed7140fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.866346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab2b1758-6120-4475-878a-091bed7140fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.866788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab2b1758-6120-4475-878a-091bed7140fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.894683 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-98d02f54-84a6-48b4-8fae-2d0d59480801 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.085648 Jan 22 21:08:06.901004 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1416/2670] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:06 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:06.905594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-8e916c3a-d63c-4b29-903f-b151305fa48c req-1b2a5ec7-7536-49b3-b37b-0a9869e60c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd923b09-9a4a-4371-8e4e-044fd3787b72", "name": "network-vif-plugged", "status": "completed", "tag": "b5da264d-bc7c-4452-b54d-69a739e13c9f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:06.907047 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:06.907047 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:06.916158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8e916c3a-d63c-4b29-903f-b151305fa48c req-1b2a5ec7-7536-49b3-b37b-0a9869e60c0c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.916620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8e916c3a-d63c-4b29-903f-b151305fa48c req-1b2a5ec7-7536-49b3-b37b-0a9869e60c0c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.929448 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-8e916c3a-d63c-4b29-903f-b151305fa48c req-1b2a5ec7-7536-49b3-b37b-0a9869e60c0c service nova] Creating event network-vif-plugged:b5da264d-bc7c-4452-b54d-69a739e13c9f for instance dd923b09-9a4a-4371-8e4e-044fd3787b72 on nch1-master-1 Jan 22 21:08:06.934688 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-8e916c3a-d63c-4b29-903f-b151305fa48c req-1b2a5ec7-7536-49b3-b37b-0a9869e60c0c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033638 Jan 22 21:08:06.935375 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1417/2671] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:06.943864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-db48dfad-3813-4243-ab67-13a4d5eef720 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:06.962056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.compute.server_groups [None req-db48dfad-3813-4243-ab67-13a4d5eef720 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Querying cell 52f5c6ef-d4de-4047-a310-d7aef14748aa(cell1) for 2 instances {{(pid=137032) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Jan 22 21:08:06.963076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db48dfad-3813-4243-ab67-13a4d5eef720 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:06.963600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db48dfad-3813-4243-ab67-13a4d5eef720 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:06.992748 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-db48dfad-3813-4243-ab67-13a4d5eef720 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/os-server-groups/a5a78ded-cf35-4e83-b5f2-4d2c612c91f2" status: 200 len: 265 microversion: 2.1 time: 0.053168 Jan 22 21:08:06.999085 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1418/2672] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:08:06 2022] GET /compute/v2.1/os-server-groups/a5a78ded-cf35-4e83-b5f2-4d2c612c91f2 => generated 265 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:07.005223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dc1581ab-fbf5-4124-b0dc-a6b90cb38bd8 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:07.006675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dc1581ab-fbf5-4124-b0dc-a6b90cb38bd8 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] [instance: 89e0044a-73e1-4d70-b612-3798d98ecc1f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:07.013935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc1581ab-fbf5-4124-b0dc-a6b90cb38bd8 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:07.014465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc1581ab-fbf5-4124-b0dc-a6b90cb38bd8 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:07.015628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc1581ab-fbf5-4124-b0dc-a6b90cb38bd8 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:07.016079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc1581ab-fbf5-4124-b0dc-a6b90cb38bd8 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:07.172184 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dc1581ab-fbf5-4124-b0dc-a6b90cb38bd8 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/89e0044a-73e1-4d70-b612-3798d98ecc1f" status: 200 len: 1623 microversion: 2.1 time: 0.171714 Jan 22 21:08:07.172891 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1419/2673] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:06 2022] GET /compute/v2.1/servers/89e0044a-73e1-4d70-b612-3798d98ecc1f => generated 1623 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:07.178827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5286dee1-f1c7-4a7d-a023-6b939dbdfcec req-1b70fd54-b17e-4183-ab9e-3fb70b5ab453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f691860-b62d-4d4b-a911-bf76987874b0", "tag": "168fb68b-c059-45fb-821e-7ae312f3e8a6"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:07.182251 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:07.182251 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:07.188604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5286dee1-f1c7-4a7d-a023-6b939dbdfcec req-1b70fd54-b17e-4183-ab9e-3fb70b5ab453 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:07.189190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5286dee1-f1c7-4a7d-a023-6b939dbdfcec req-1b70fd54-b17e-4183-ab9e-3fb70b5ab453 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:07.200804 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5286dee1-f1c7-4a7d-a023-6b939dbdfcec req-1b70fd54-b17e-4183-ab9e-3fb70b5ab453 service nova] Creating event network-changed:168fb68b-c059-45fb-821e-7ae312f3e8a6 for instance 6f691860-b62d-4d4b-a911-bf76987874b0 on nch2-master-1 Jan 22 21:08:07.206018 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-5286dee1-f1c7-4a7d-a023-6b939dbdfcec req-1b70fd54-b17e-4183-ab9e-3fb70b5ab453 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031523 Jan 22 21:08:07.211278 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1420/2674] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:07.212594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c4dce20e-2f1f-4f86-acdc-ca7b20361ed4 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:07.213305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c4dce20e-2f1f-4f86-acdc-ca7b20361ed4 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:07.219726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4dce20e-2f1f-4f86-acdc-ca7b20361ed4 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:07.220184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4dce20e-2f1f-4f86-acdc-ca7b20361ed4 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:07.220975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4dce20e-2f1f-4f86-acdc-ca7b20361ed4 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:07.221419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4dce20e-2f1f-4f86-acdc-ca7b20361ed4 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:07.227796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab2b1758-6120-4475-878a-091bed7140fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:07.238543 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab2b1758-6120-4475-878a-091bed7140fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.386966 Jan 22 21:08:07.245540 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1255/2675] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:06 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:07.265014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5128eadc-c9c4-4d5f-84ca-d71a87e0d54b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:07.266112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5128eadc-c9c4-4d5f-84ca-d71a87e0d54b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:07.276424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5128eadc-c9c4-4d5f-84ca-d71a87e0d54b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:07.277191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5128eadc-c9c4-4d5f-84ca-d71a87e0d54b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:07.278556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5128eadc-c9c4-4d5f-84ca-d71a87e0d54b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:07.279020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5128eadc-c9c4-4d5f-84ca-d71a87e0d54b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:07.368624 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c4dce20e-2f1f-4f86-acdc-ca7b20361ed4 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 200 len: 1622 microversion: 2.1 time: 0.160198 Jan 22 21:08:07.369243 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1421/2676] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:07 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 1622 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:07.388009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-89716773-555e-42f2-9460-bbfcdfa51230 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:07.388009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-89716773-555e-42f2-9460-bbfcdfa51230 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:07.388009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89716773-555e-42f2-9460-bbfcdfa51230 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:07.388009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89716773-555e-42f2-9460-bbfcdfa51230 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:07.388009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89716773-555e-42f2-9460-bbfcdfa51230 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:07.388009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89716773-555e-42f2-9460-bbfcdfa51230 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:07.432886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5128eadc-c9c4-4d5f-84ca-d71a87e0d54b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:07.442352 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5128eadc-c9c4-4d5f-84ca-d71a87e0d54b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1541 microversion: 2.1 time: 0.183481 Jan 22 21:08:07.443217 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1256/2677] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:07 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1541 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:07.448154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0273376f-dc98-40ba-82bb-379646e03db0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Action: 'create', calling method: .version_select at 0x7f1ed6002430>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2084287156", "policies": ["anti-affinity"]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:07.457067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-89716773-555e-42f2-9460-bbfcdfa51230 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:07.465646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0273376f-dc98-40ba-82bb-379646e03db0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_groups'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:07.467792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-89716773-555e-42f2-9460-bbfcdfa51230 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:07.469354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-89716773-555e-42f2-9460-bbfcdfa51230 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:07.470584 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-89716773-555e-42f2-9460-bbfcdfa51230 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.100359 Jan 22 21:08:07.471150 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1422/2678] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:07 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:07.471426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0273376f-dc98-40ba-82bb-379646e03db0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_groups'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:07.476306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-33c2de81-2c3d-405b-8004-13450b12d25a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:07.477756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-33c2de81-2c3d-405b-8004-13450b12d25a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:07.484300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33c2de81-2c3d-405b-8004-13450b12d25a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:07.484811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33c2de81-2c3d-405b-8004-13450b12d25a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:07.485875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33c2de81-2c3d-405b-8004-13450b12d25a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:07.486326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33c2de81-2c3d-405b-8004-13450b12d25a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:07.582311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0273376f-dc98-40ba-82bb-379646e03db0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_groups'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:07.587760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0273376f-dc98-40ba-82bb-379646e03db0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_groups'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:07.602244 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0273376f-dc98-40ba-82bb-379646e03db0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.157512 Jan 22 21:08:07.603136 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1257/2679] 10.222.0.100 () {60 vars in 1178 bytes} [Sat Jan 22 21:08:07 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:07.632476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-33c2de81-2c3d-405b-8004-13450b12d25a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:07.640867 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-33c2de81-2c3d-405b-8004-13450b12d25a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1315 microversion: 2.1 time: 0.168086 Jan 22 21:08:07.641575 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1423/2680] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:07 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:07.704236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1629246112", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "2b9bc7c4-2464-4ade-9a4b-ea55c009c46d"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:07.755042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:08:07.825790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-258b90d3-5f1b-4188-9558-b04510aa0744 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:07.826471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-258b90d3-5f1b-4188-9558-b04510aa0744 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:07.834757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-258b90d3-5f1b-4188-9558-b04510aa0744 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:07.835209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-258b90d3-5f1b-4188-9558-b04510aa0744 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:07.838028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-258b90d3-5f1b-4188-9558-b04510aa0744 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:07.838684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-258b90d3-5f1b-4188-9558-b04510aa0744 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:07.983500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-258b90d3-5f1b-4188-9558-b04510aa0744 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:07.993975 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-258b90d3-5f1b-4188-9558-b04510aa0744 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.173305 Jan 22 21:08:07.994577 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1424/2681] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:07 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:08.002260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-223d4352-66aa-4e49-9b9a-05dd0776eb83 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:08.006402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-223d4352-66aa-4e49-9b9a-05dd0776eb83 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:08.010917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-223d4352-66aa-4e49-9b9a-05dd0776eb83 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:08.011384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-223d4352-66aa-4e49-9b9a-05dd0776eb83 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:08.012204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-223d4352-66aa-4e49-9b9a-05dd0776eb83 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:08.012662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-223d4352-66aa-4e49-9b9a-05dd0776eb83 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:08.056525 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-223d4352-66aa-4e49-9b9a-05dd0776eb83 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.060486 Jan 22 21:08:08.060080 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1425/2682] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:07 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:08.263057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8daf03a2-4a89-40e6-993c-40371ac5ac1b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:08.264324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8daf03a2-4a89-40e6-993c-40371ac5ac1b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:08.272796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8daf03a2-4a89-40e6-993c-40371ac5ac1b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:08.273340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8daf03a2-4a89-40e6-993c-40371ac5ac1b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:08.274289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8daf03a2-4a89-40e6-993c-40371ac5ac1b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:08.274737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8daf03a2-4a89-40e6-993c-40371ac5ac1b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:08.419500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:08:08.420088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:08:08.420670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:08:08.421372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:08:08.421894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:08:08.440094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:08.441240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:08.442200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:08.442728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:08.461754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:08.467050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:08.475159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8daf03a2-4a89-40e6-993c-40371ac5ac1b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:08.480476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Going to run 2 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:08:08.482962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 79886df2-2261-4152-ac59-f8406a583423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:08:08.483111 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8daf03a2-4a89-40e6-993c-40371ac5ac1b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.224140 Jan 22 21:08:08.483950 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1426/2683] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:08 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:08.489234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e6ab5199-a57c-4c8a-8a2e-531a4c04bd2d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:08.489864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e6ab5199-a57c-4c8a-8a2e-531a4c04bd2d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:08.495880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6ab5199-a57c-4c8a-8a2e-531a4c04bd2d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:08.496335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6ab5199-a57c-4c8a-8a2e-531a4c04bd2d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:08.497113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6ab5199-a57c-4c8a-8a2e-531a4c04bd2d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:08.497585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6ab5199-a57c-4c8a-8a2e-531a4c04bd2d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:08.628520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=137033) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Jan 22 21:08:08.635199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e6ab5199-a57c-4c8a-8a2e-531a4c04bd2d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:08.642871 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e6ab5199-a57c-4c8a-8a2e-531a4c04bd2d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1541 microversion: 2.1 time: 0.157568 Jan 22 21:08:08.643445 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1427/2684] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:08 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1541 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:08.648082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:08.648284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7bc9e934-7c3e-454b-b311-6e76778a3343 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:08.648882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7bc9e934-7c3e-454b-b311-6e76778a3343 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:08.658769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:08.663041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7bc9e934-7c3e-454b-b311-6e76778a3343 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:08.663497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7bc9e934-7c3e-454b-b311-6e76778a3343 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:08.664319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7bc9e934-7c3e-454b-b311-6e76778a3343 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:08.664760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7bc9e934-7c3e-454b-b311-6e76778a3343 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:08.730347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7bc9e934-7c3e-454b-b311-6e76778a3343 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:08.738384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7bc9e934-7c3e-454b-b311-6e76778a3343 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:08.739907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7bc9e934-7c3e-454b-b311-6e76778a3343 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:08.742105 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7bc9e934-7c3e-454b-b311-6e76778a3343 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.096496 Jan 22 21:08:08.742105 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1428/2685] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:08 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:08.746080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-72968178-b62b-4de2-8b9f-f5922a05c9b3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:08.746695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-72968178-b62b-4de2-8b9f-f5922a05c9b3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:08.752583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72968178-b62b-4de2-8b9f-f5922a05c9b3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:08.753043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72968178-b62b-4de2-8b9f-f5922a05c9b3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:08.753867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72968178-b62b-4de2-8b9f-f5922a05c9b3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:08.754313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72968178-b62b-4de2-8b9f-f5922a05c9b3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:08.765604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:08.772075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:08.788608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=79886df2-2261-4152-ac59-f8406a583423,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:08:08.890543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-72968178-b62b-4de2-8b9f-f5922a05c9b3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:08.898649 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-72968178-b62b-4de2-8b9f-f5922a05c9b3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1465 microversion: 2.1 time: 0.156007 Jan 22 21:08:08.899227 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1429/2686] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:08 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:08.903741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:08.908619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:08.969440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7e85163f-6f91-454a-8df4-6b52440fa99f tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:08.970174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7e85163f-6f91-454a-8df4-6b52440fa99f tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:08.977818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e85163f-6f91-454a-8df4-6b52440fa99f tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:08.978202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e85163f-6f91-454a-8df4-6b52440fa99f tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:08.979004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e85163f-6f91-454a-8df4-6b52440fa99f tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:08.979452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e85163f-6f91-454a-8df4-6b52440fa99f tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.000040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:09.007193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'server_group_members'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:09.045176 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d23778b3-7458-413f-8eed-878f2a8d0e3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.344668 Jan 22 21:08:09.049172 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1258/2687] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:08:07 2022] POST /compute/v2.1/servers => generated 32 bytes in 1347 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jan 22 21:08:09.052991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-23f0aa9a-ad5f-4d5a-9637-16f080953088 req-71efa485-d7ab-4a16-ae63-baae64a69355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dd17fd5-afdd-4c9d-b3f4-37e074b52164", "name": "network-vif-plugged", "status": "completed", "tag": "6ccde979-75d5-4cd2-a24c-44e19ed1cd1d"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:09.054610 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:09.054610 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:09.081895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-23f0aa9a-ad5f-4d5a-9637-16f080953088 req-71efa485-d7ab-4a16-ae63-baae64a69355 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:09.081895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-23f0aa9a-ad5f-4d5a-9637-16f080953088 req-71efa485-d7ab-4a16-ae63-baae64a69355 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.081895 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-23f0aa9a-ad5f-4d5a-9637-16f080953088 req-71efa485-d7ab-4a16-ae63-baae64a69355 service nova] Creating event network-vif-plugged:6ccde979-75d5-4cd2-a24c-44e19ed1cd1d for instance 9dd17fd5-afdd-4c9d-b3f4-37e074b52164 on nch2-master-1 Jan 22 21:08:09.084952 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-23f0aa9a-ad5f-4d5a-9637-16f080953088 req-71efa485-d7ab-4a16-ae63-baae64a69355 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037232 Jan 22 21:08:09.089222 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1259/2688] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:09.113855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-67e53a39-6b40-44a7-a5de-35c7a0b902ce tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:09.113855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-67e53a39-6b40-44a7-a5de-35c7a0b902ce tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:09.113855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67e53a39-6b40-44a7-a5de-35c7a0b902ce tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:09.113855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67e53a39-6b40-44a7-a5de-35c7a0b902ce tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.113855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67e53a39-6b40-44a7-a5de-35c7a0b902ce tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:09.113855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67e53a39-6b40-44a7-a5de-35c7a0b902ce tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.274003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-67e53a39-6b40-44a7-a5de-35c7a0b902ce tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:09.281448 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-67e53a39-6b40-44a7-a5de-35c7a0b902ce tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.190937 Jan 22 21:08:09.282055 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1260/2689] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:09 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:09.287131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bdac8f09-677a-425d-ae25-14e7ff5d8d58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:09.290440 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:09.290440 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:09.291434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bdac8f09-677a-425d-ae25-14e7ff5d8d58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:09.292192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bdac8f09-677a-425d-ae25-14e7ff5d8d58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Searching by: {'deleted': False, 'project_id': '1e6094793b214ae7af6611b1571cac3d'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:08:09.308023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdac8f09-677a-425d-ae25-14e7ff5d8d58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:09.308426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdac8f09-677a-425d-ae25-14e7ff5d8d58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.309255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdac8f09-677a-425d-ae25-14e7ff5d8d58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:09.309743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdac8f09-677a-425d-ae25-14e7ff5d8d58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.339225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-bdac8f09-677a-425d-ae25-14e7ff5d8d58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:08:09.373011 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bdac8f09-677a-425d-ae25-14e7ff5d8d58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 1675 microversion: 2.1 time: 0.087245 Jan 22 21:08:09.373213 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7e85163f-6f91-454a-8df4-6b52440fa99f tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1616 microversion: 2.1 time: 0.458566 Jan 22 21:08:09.373341 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1261/2690] 10.222.0.100 () {58 vars in 1129 bytes} [Sat Jan 22 21:08:09 2022] GET /compute/v2.1/servers => generated 1675 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:09.388635 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1430/2691] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:08 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1616 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:09.388831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a31b509e-1f92-41b2-84c8-79d880e2691e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:09.388831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a31b509e-1f92-41b2-84c8-79d880e2691e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:09.389319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a31b509e-1f92-41b2-84c8-79d880e2691e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:09.390025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a31b509e-1f92-41b2-84c8-79d880e2691e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.390138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-40558116-79a1-45e2-aebc-766815358770 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:09.390776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-40558116-79a1-45e2-aebc-766815358770 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:09.391112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a31b509e-1f92-41b2-84c8-79d880e2691e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:09.391479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a31b509e-1f92-41b2-84c8-79d880e2691e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.448395 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a31b509e-1f92-41b2-84c8-79d880e2691e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.075406 Jan 22 21:08:09.449817 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1262/2692] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:09 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:09.454907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-825bd8fb-fa24-4dd5-a6b4-1deb0837335b tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:09.457581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-825bd8fb-fa24-4dd5-a6b4-1deb0837335b tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:09.467370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-40558116-79a1-45e2-aebc-766815358770 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:09.467761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-825bd8fb-fa24-4dd5-a6b4-1deb0837335b tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:09.468463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-825bd8fb-fa24-4dd5-a6b4-1deb0837335b tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.469440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-825bd8fb-fa24-4dd5-a6b4-1deb0837335b tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:09.470297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-825bd8fb-fa24-4dd5-a6b4-1deb0837335b tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.478132 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-40558116-79a1-45e2-aebc-766815358770 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1223 microversion: 2.1 time: 0.098174 Jan 22 21:08:09.482392 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1431/2693] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:09 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:09.499865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cb97ca84-8fa1-4d5b-afd2-2d3c6fefea5b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:09.500810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cb97ca84-8fa1-4d5b-afd2-2d3c6fefea5b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:09.511645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb97ca84-8fa1-4d5b-afd2-2d3c6fefea5b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:09.511645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb97ca84-8fa1-4d5b-afd2-2d3c6fefea5b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.511645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb97ca84-8fa1-4d5b-afd2-2d3c6fefea5b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:09.511645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb97ca84-8fa1-4d5b-afd2-2d3c6fefea5b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.572942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-825bd8fb-fa24-4dd5-a6b4-1deb0837335b tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c7fd06952c8247ef899e0196dc3f306c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8244a23d9b3f475080dbd45567f6d11b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:09.573828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-825bd8fb-fa24-4dd5-a6b4-1deb0837335b tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] flavor_id is None. Assuming migration. {{(pid=137033) resize /opt/stack/nova/nova/compute/api.py:4073}} Jan 22 21:08:09.574282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-825bd8fb-fa24-4dd5-a6b4-1deb0837335b tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137033) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 21:08:09.655932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cb97ca84-8fa1-4d5b-afd2-2d3c6fefea5b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:09.665711 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cb97ca84-8fa1-4d5b-afd2-2d3c6fefea5b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.169686 Jan 22 21:08:09.666357 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1432/2694] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:09 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:09.671178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-13ba4aca-c489-44f3-9aa7-df85d91760b3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:09.672805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-13ba4aca-c489-44f3-9aa7-df85d91760b3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:09.681095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13ba4aca-c489-44f3-9aa7-df85d91760b3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:09.682064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13ba4aca-c489-44f3-9aa7-df85d91760b3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.683137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13ba4aca-c489-44f3-9aa7-df85d91760b3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:09.683635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13ba4aca-c489-44f3-9aa7-df85d91760b3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.848004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13ba4aca-c489-44f3-9aa7-df85d91760b3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:09.856967 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-13ba4aca-c489-44f3-9aa7-df85d91760b3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1536 microversion: 2.1 time: 0.189255 Jan 22 21:08:09.857580 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1433/2695] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:09 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1536 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:09.862952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6a00c1d-ca38-44ff-a16e-323481c20d45 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:09.863561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b6a00c1d-ca38-44ff-a16e-323481c20d45 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:09.869748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6a00c1d-ca38-44ff-a16e-323481c20d45 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:09.870242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6a00c1d-ca38-44ff-a16e-323481c20d45 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.871055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6a00c1d-ca38-44ff-a16e-323481c20d45 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:09.871500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6a00c1d-ca38-44ff-a16e-323481c20d45 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:09.940015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b6a00c1d-ca38-44ff-a16e-323481c20d45 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:09.949041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b6a00c1d-ca38-44ff-a16e-323481c20d45 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:09.952504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b6a00c1d-ca38-44ff-a16e-323481c20d45 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:09.952504 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b6a00c1d-ca38-44ff-a16e-323481c20d45 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.093109 Jan 22 21:08:09.952504 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1434/2696] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:09 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:10.048882 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-825bd8fb-fa24-4dd5-a6b4-1deb0837335b tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72/action" status: 202 len: 0 microversion: 2.1 time: 0.597428 Jan 22 21:08:10.052381 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1263/2697] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:09 2022] POST /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:10.057368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08a86388-26de-47b0-b5c1-06705eb68355 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:10.058040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-08a86388-26de-47b0-b5c1-06705eb68355 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:10.066228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08a86388-26de-47b0-b5c1-06705eb68355 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:10.066483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08a86388-26de-47b0-b5c1-06705eb68355 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:10.067450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08a86388-26de-47b0-b5c1-06705eb68355 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:10.068057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08a86388-26de-47b0-b5c1-06705eb68355 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:10.211832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-08a86388-26de-47b0-b5c1-06705eb68355 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:10.219549 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-08a86388-26de-47b0-b5c1-06705eb68355 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1474 microversion: 2.1 time: 0.165935 Jan 22 21:08:10.220117 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1435/2698] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:10 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1474 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:10.299651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7fa853df-6150-49e3-8106-f8e3fe36b5f7 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:10.301443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7fa853df-6150-49e3-8106-f8e3fe36b5f7 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:10.308218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7fa853df-6150-49e3-8106-f8e3fe36b5f7 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:10.308675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7fa853df-6150-49e3-8106-f8e3fe36b5f7 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:10.309474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7fa853df-6150-49e3-8106-f8e3fe36b5f7 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:10.309939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7fa853df-6150-49e3-8106-f8e3fe36b5f7 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:10.461148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e796705-a9fd-42a4-8d05-840e85ab4f0f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:10.462240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e796705-a9fd-42a4-8d05-840e85ab4f0f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:10.466993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7fa853df-6150-49e3-8106-f8e3fe36b5f7 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:10.469153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e796705-a9fd-42a4-8d05-840e85ab4f0f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:10.469640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e796705-a9fd-42a4-8d05-840e85ab4f0f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:10.470740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e796705-a9fd-42a4-8d05-840e85ab4f0f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:10.471180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e796705-a9fd-42a4-8d05-840e85ab4f0f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:10.475449 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7fa853df-6150-49e3-8106-f8e3fe36b5f7 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.180398 Jan 22 21:08:10.476027 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1264/2699] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:10 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:10.497676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2a8ef70a-37aa-4676-9033-b902cf5e6ed4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:10.498904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2a8ef70a-37aa-4676-9033-b902cf5e6ed4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:10.517407 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e796705-a9fd-42a4-8d05-840e85ab4f0f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.060102 Jan 22 21:08:10.520868 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1436/2700] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:10 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:08:10.556935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2a8ef70a-37aa-4676-9033-b902cf5e6ed4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:10.560599 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2a8ef70a-37aa-4676-9033-b902cf5e6ed4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1223 microversion: 2.1 time: 0.066530 Jan 22 21:08:10.561282 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1265/2701] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:10 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1223 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:10.682510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f5df1bdb-4c8e-44f0-b7b0-6603173e01b8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:10.683217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f5df1bdb-4c8e-44f0-b7b0-6603173e01b8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:10.691128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5df1bdb-4c8e-44f0-b7b0-6603173e01b8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:10.692361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5df1bdb-4c8e-44f0-b7b0-6603173e01b8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:10.693123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5df1bdb-4c8e-44f0-b7b0-6603173e01b8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:10.693698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5df1bdb-4c8e-44f0-b7b0-6603173e01b8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:10.854214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f5df1bdb-4c8e-44f0-b7b0-6603173e01b8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:10.861793 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f5df1bdb-4c8e-44f0-b7b0-6603173e01b8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.183404 Jan 22 21:08:10.862386 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1437/2702] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:10 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:10.874981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c03e21ea-38f1-4b88-92f8-863e103572b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:10.877492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c03e21ea-38f1-4b88-92f8-863e103572b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:10.883396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c03e21ea-38f1-4b88-92f8-863e103572b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:10.883952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c03e21ea-38f1-4b88-92f8-863e103572b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:10.884797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c03e21ea-38f1-4b88-92f8-863e103572b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:10.885253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c03e21ea-38f1-4b88-92f8-863e103572b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:10.972643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-169f2af6-21b5-4399-8c1f-1324bdc289ec tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:10.973386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-169f2af6-21b5-4399-8c1f-1324bdc289ec tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:10.979977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-169f2af6-21b5-4399-8c1f-1324bdc289ec tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:10.980500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-169f2af6-21b5-4399-8c1f-1324bdc289ec tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:10.981401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-169f2af6-21b5-4399-8c1f-1324bdc289ec tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:10.981878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-169f2af6-21b5-4399-8c1f-1324bdc289ec tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:11.036695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c03e21ea-38f1-4b88-92f8-863e103572b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:11.045591 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c03e21ea-38f1-4b88-92f8-863e103572b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1523 microversion: 2.1 time: 0.174273 Jan 22 21:08:11.046379 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1266/2703] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:10 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:11.049202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-169f2af6-21b5-4399-8c1f-1324bdc289ec tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:11.058194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-169f2af6-21b5-4399-8c1f-1324bdc289ec tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:11.059728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-169f2af6-21b5-4399-8c1f-1324bdc289ec tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:11.061046 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-169f2af6-21b5-4399-8c1f-1324bdc289ec tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.092111 Jan 22 21:08:11.061837 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1438/2704] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:10 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:08:11.065009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f6f5d0fb-60eb-4f15-bf1d-47a954ee7265 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:11.067697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f6f5d0fb-60eb-4f15-bf1d-47a954ee7265 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:11.076262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6f5d0fb-60eb-4f15-bf1d-47a954ee7265 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:11.077203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6f5d0fb-60eb-4f15-bf1d-47a954ee7265 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:11.078817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6f5d0fb-60eb-4f15-bf1d-47a954ee7265 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:11.079734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6f5d0fb-60eb-4f15-bf1d-47a954ee7265 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:11.114735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f6f5d0fb-60eb-4f15-bf1d-47a954ee7265 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:08:11.239065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-11429b97-783c-49e2-af0f-454acf3d5850 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:11.239783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-11429b97-783c-49e2-af0f-454acf3d5850 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:11.247231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11429b97-783c-49e2-af0f-454acf3d5850 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:11.248012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11429b97-783c-49e2-af0f-454acf3d5850 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:11.249256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11429b97-783c-49e2-af0f-454acf3d5850 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:11.250156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11429b97-783c-49e2-af0f-454acf3d5850 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:11.389244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-11429b97-783c-49e2-af0f-454acf3d5850 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:11.397399 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-11429b97-783c-49e2-af0f-454acf3d5850 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1474 microversion: 2.1 time: 0.165045 Jan 22 21:08:11.398026 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1439/2705] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:11 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1474 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:11.474078 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f6f5d0fb-60eb-4f15-bf1d-47a954ee7265 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "DELETE /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 204 len: 0 microversion: 2.1 time: 0.412501 Jan 22 21:08:11.474721 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1267/2706] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:08:11 2022] DELETE /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:08:11.482661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eb8abacb-d02e-45ac-b7b8-38acb576ea93 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:11.483283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eb8abacb-d02e-45ac-b7b8-38acb576ea93 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:11.490883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb8abacb-d02e-45ac-b7b8-38acb576ea93 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:11.491348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb8abacb-d02e-45ac-b7b8-38acb576ea93 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:11.492154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb8abacb-d02e-45ac-b7b8-38acb576ea93 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:11.492605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb8abacb-d02e-45ac-b7b8-38acb576ea93 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:11.493241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8e83e940-7075-4731-abba-242e7015247b tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:11.502052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8e83e940-7075-4731-abba-242e7015247b tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:11.508799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e83e940-7075-4731-abba-242e7015247b tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:11.509251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e83e940-7075-4731-abba-242e7015247b tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:11.510082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e83e940-7075-4731-abba-242e7015247b tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:11.510525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e83e940-7075-4731-abba-242e7015247b tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:11.672766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-eb8abacb-d02e-45ac-b7b8-38acb576ea93 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:11.682367 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eb8abacb-d02e-45ac-b7b8-38acb576ea93 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1529 microversion: 2.1 time: 0.203289 Jan 22 21:08:11.683217 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1440/2707] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:11 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1529 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:11.688177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-72d824e4-dbe0-498d-94bb-63be962094c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:11.689584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8e83e940-7075-4731-abba-242e7015247b tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:11.694809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-72d824e4-dbe0-498d-94bb-63be962094c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:11.696548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72d824e4-dbe0-498d-94bb-63be962094c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:11.697004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72d824e4-dbe0-498d-94bb-63be962094c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:11.697530 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8e83e940-7075-4731-abba-242e7015247b tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.208160 Jan 22 21:08:11.697833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72d824e4-dbe0-498d-94bb-63be962094c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:11.698111 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1268/2708] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:11 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:11.705565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72d824e4-dbe0-498d-94bb-63be962094c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:11.708759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee65a92e-b716-4327-aec2-631f85f0e4cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:11.709382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ee65a92e-b716-4327-aec2-631f85f0e4cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:11.718365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee65a92e-b716-4327-aec2-631f85f0e4cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:11.719148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee65a92e-b716-4327-aec2-631f85f0e4cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:11.720242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee65a92e-b716-4327-aec2-631f85f0e4cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:11.720956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee65a92e-b716-4327-aec2-631f85f0e4cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:11.748733 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-72d824e4-dbe0-498d-94bb-63be962094c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.064117 Jan 22 21:08:11.749402 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1441/2709] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:11 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:11.783249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ee65a92e-b716-4327-aec2-631f85f0e4cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:11.790602 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee65a92e-b716-4327-aec2-631f85f0e4cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1219 microversion: 2.1 time: 0.091516 Jan 22 21:08:11.791241 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1269/2710] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:11 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:11.880185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb987365-01b2-4347-bf59-a4cecc417aff tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:11.880924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fb987365-01b2-4347-bf59-a4cecc417aff tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:11.888644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb987365-01b2-4347-bf59-a4cecc417aff tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:11.889119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb987365-01b2-4347-bf59-a4cecc417aff tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:11.889942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb987365-01b2-4347-bf59-a4cecc417aff tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:11.890381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb987365-01b2-4347-bf59-a4cecc417aff tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:12.026420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fb987365-01b2-4347-bf59-a4cecc417aff tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:12.033803 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fb987365-01b2-4347-bf59-a4cecc417aff tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.158540 Jan 22 21:08:12.038486 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1442/2711] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:11 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:12.084800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c44f3e90-6cbb-4a01-9fda-be396d1efe90 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:12.085445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c44f3e90-6cbb-4a01-9fda-be396d1efe90 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:12.092896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c44f3e90-6cbb-4a01-9fda-be396d1efe90 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:12.093372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c44f3e90-6cbb-4a01-9fda-be396d1efe90 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:12.094242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c44f3e90-6cbb-4a01-9fda-be396d1efe90 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:12.094694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c44f3e90-6cbb-4a01-9fda-be396d1efe90 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:12.177706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c44f3e90-6cbb-4a01-9fda-be396d1efe90 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:12.188879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c44f3e90-6cbb-4a01-9fda-be396d1efe90 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:12.192304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c44f3e90-6cbb-4a01-9fda-be396d1efe90 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:12.193916 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c44f3e90-6cbb-4a01-9fda-be396d1efe90 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.113591 Jan 22 21:08:12.203642 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1270/2712] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:12 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:12.415225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-72ce5442-5afc-473e-aa4e-02d3157dc8ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:12.415839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-72ce5442-5afc-473e-aa4e-02d3157dc8ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:12.423067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72ce5442-5afc-473e-aa4e-02d3157dc8ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:12.423598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72ce5442-5afc-473e-aa4e-02d3157dc8ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:12.424463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72ce5442-5afc-473e-aa4e-02d3157dc8ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:12.427639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72ce5442-5afc-473e-aa4e-02d3157dc8ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:12.572141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-72ce5442-5afc-473e-aa4e-02d3157dc8ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:12.582992 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-72ce5442-5afc-473e-aa4e-02d3157dc8ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1474 microversion: 2.1 time: 0.171366 Jan 22 21:08:12.583619 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1443/2713] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:12 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1474 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:12.699522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-33eae93d-e6c8-4f61-92b5-050186498543 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:12.700760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-33eae93d-e6c8-4f61-92b5-050186498543 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:12.707894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33eae93d-e6c8-4f61-92b5-050186498543 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:12.708358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33eae93d-e6c8-4f61-92b5-050186498543 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:12.709150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33eae93d-e6c8-4f61-92b5-050186498543 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:12.709621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33eae93d-e6c8-4f61-92b5-050186498543 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:12.716755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3482e436-03b4-4129-afb7-9bf20fa80d2e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:12.718033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3482e436-03b4-4129-afb7-9bf20fa80d2e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:12.726615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3482e436-03b4-4129-afb7-9bf20fa80d2e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:12.727883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3482e436-03b4-4129-afb7-9bf20fa80d2e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:12.729264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3482e436-03b4-4129-afb7-9bf20fa80d2e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:12.729625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3482e436-03b4-4129-afb7-9bf20fa80d2e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:13.015698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-33eae93d-e6c8-4f61-92b5-050186498543 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:13.024094 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-33eae93d-e6c8-4f61-92b5-050186498543 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1529 microversion: 2.1 time: 0.328441 Jan 22 21:08:13.024697 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1271/2714] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:12 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1529 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:13.033302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-41b61d31-e9c9-491e-a04f-7e22af6e1750 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:13.035002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-41b61d31-e9c9-491e-a04f-7e22af6e1750 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:13.041983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41b61d31-e9c9-491e-a04f-7e22af6e1750 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:13.042494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41b61d31-e9c9-491e-a04f-7e22af6e1750 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:13.045081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41b61d31-e9c9-491e-a04f-7e22af6e1750 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:13.045081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41b61d31-e9c9-491e-a04f-7e22af6e1750 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:13.095444 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-41b61d31-e9c9-491e-a04f-7e22af6e1750 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.069458 Jan 22 21:08:13.097487 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1272/2715] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:13 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:13.104361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1c72db48-91fa-4ba6-889a-e60aece7369b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:13.105718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1c72db48-91fa-4ba6-889a-e60aece7369b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:13.115990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c72db48-91fa-4ba6-889a-e60aece7369b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:13.116808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c72db48-91fa-4ba6-889a-e60aece7369b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:13.118320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c72db48-91fa-4ba6-889a-e60aece7369b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:13.137352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c72db48-91fa-4ba6-889a-e60aece7369b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:13.233490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3482e436-03b4-4129-afb7-9bf20fa80d2e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:13.246909 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3482e436-03b4-4129-afb7-9bf20fa80d2e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.535695 Jan 22 21:08:13.248434 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1444/2716] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:12 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:13.264665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-38b33fa7-797e-4ff5-9749-0382075acce4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:13.265279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-38b33fa7-797e-4ff5-9749-0382075acce4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:13.280590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38b33fa7-797e-4ff5-9749-0382075acce4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:13.281334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38b33fa7-797e-4ff5-9749-0382075acce4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:13.283879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38b33fa7-797e-4ff5-9749-0382075acce4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:13.289548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38b33fa7-797e-4ff5-9749-0382075acce4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:13.309879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1c72db48-91fa-4ba6-889a-e60aece7369b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:13.316427 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1c72db48-91fa-4ba6-889a-e60aece7369b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1281 microversion: 2.1 time: 0.216822 Jan 22 21:08:13.319897 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1273/2717] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:13 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1281 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:13.338229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-484ac408-efb9-47f7-a383-2b7399235169 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:13.357063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-484ac408-efb9-47f7-a383-2b7399235169 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:13.398278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-484ac408-efb9-47f7-a383-2b7399235169 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:13.402522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-484ac408-efb9-47f7-a383-2b7399235169 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:13.403407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-484ac408-efb9-47f7-a383-2b7399235169 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:13.406414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-484ac408-efb9-47f7-a383-2b7399235169 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:13.588434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-38b33fa7-797e-4ff5-9749-0382075acce4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:13.591448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-484ac408-efb9-47f7-a383-2b7399235169 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:13.599323 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-38b33fa7-797e-4ff5-9749-0382075acce4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.349461 Jan 22 21:08:13.608798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-484ac408-efb9-47f7-a383-2b7399235169 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:13.608798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-484ac408-efb9-47f7-a383-2b7399235169 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:13.608798 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-484ac408-efb9-47f7-a383-2b7399235169 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.281139 Jan 22 21:08:13.608798 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1274/2718] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:13 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:13.620505 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1445/2719] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:13 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:13.636345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7912d164-e848-415d-a2dc-cd1efffb596d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:13.638262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7912d164-e848-415d-a2dc-cd1efffb596d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:13.658324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7912d164-e848-415d-a2dc-cd1efffb596d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:13.659479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7912d164-e848-415d-a2dc-cd1efffb596d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:13.662541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7912d164-e848-415d-a2dc-cd1efffb596d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:13.665041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7912d164-e848-415d-a2dc-cd1efffb596d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:14.031174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7912d164-e848-415d-a2dc-cd1efffb596d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:14.040534 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7912d164-e848-415d-a2dc-cd1efffb596d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1474 microversion: 2.1 time: 0.435296 Jan 22 21:08:14.042261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3d9246f8-93f9-406c-aa6f-1bbaefa6dfc4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:14.042261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3d9246f8-93f9-406c-aa6f-1bbaefa6dfc4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:14.050588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d9246f8-93f9-406c-aa6f-1bbaefa6dfc4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:14.051046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d9246f8-93f9-406c-aa6f-1bbaefa6dfc4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:14.051853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d9246f8-93f9-406c-aa6f-1bbaefa6dfc4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:14.052296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d9246f8-93f9-406c-aa6f-1bbaefa6dfc4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:14.061579 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1275/2720] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:13 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1474 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:14.108784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7acbbe79-2bdb-4dc5-ada4-1ecb225e3f1a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:14.109882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7acbbe79-2bdb-4dc5-ada4-1ecb225e3f1a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:14.116630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7acbbe79-2bdb-4dc5-ada4-1ecb225e3f1a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:14.117375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7acbbe79-2bdb-4dc5-ada4-1ecb225e3f1a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:14.118410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7acbbe79-2bdb-4dc5-ada4-1ecb225e3f1a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:14.119164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7acbbe79-2bdb-4dc5-ada4-1ecb225e3f1a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:14.181717 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7acbbe79-2bdb-4dc5-ada4-1ecb225e3f1a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.076823 Jan 22 21:08:14.186222 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1276/2721] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:14 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:08:14.265302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a7fc2504-dcb7-493e-a3ca-768f32c82457 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:14.266231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a7fc2504-dcb7-493e-a3ca-768f32c82457 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:14.275890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7fc2504-dcb7-493e-a3ca-768f32c82457 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:14.276848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7fc2504-dcb7-493e-a3ca-768f32c82457 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:14.277703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7fc2504-dcb7-493e-a3ca-768f32c82457 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:14.278519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7fc2504-dcb7-493e-a3ca-768f32c82457 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:14.404850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3d9246f8-93f9-406c-aa6f-1bbaefa6dfc4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:14.414926 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3d9246f8-93f9-406c-aa6f-1bbaefa6dfc4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1529 microversion: 2.1 time: 0.377220 Jan 22 21:08:14.417646 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1446/2722] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:14 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1529 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:14.423250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9528b98e-9278-4113-ada7-8feb9d811d2f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:14.423897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9528b98e-9278-4113-ada7-8feb9d811d2f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:14.438429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9528b98e-9278-4113-ada7-8feb9d811d2f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:14.438570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9528b98e-9278-4113-ada7-8feb9d811d2f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:14.439475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9528b98e-9278-4113-ada7-8feb9d811d2f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:14.439785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9528b98e-9278-4113-ada7-8feb9d811d2f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:14.691064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9528b98e-9278-4113-ada7-8feb9d811d2f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:14.703647 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9528b98e-9278-4113-ada7-8feb9d811d2f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1323 microversion: 2.1 time: 0.284782 Jan 22 21:08:14.705372 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1447/2723] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:14 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1323 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:14.711445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-489b5e40-41a5-46ba-ab55-da57c0be8576 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:14.712294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-489b5e40-41a5-46ba-ab55-da57c0be8576 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:14.720212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-489b5e40-41a5-46ba-ab55-da57c0be8576 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:14.720878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-489b5e40-41a5-46ba-ab55-da57c0be8576 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:14.722495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-489b5e40-41a5-46ba-ab55-da57c0be8576 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:14.723901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-489b5e40-41a5-46ba-ab55-da57c0be8576 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:14.778690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a7fc2504-dcb7-493e-a3ca-768f32c82457 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:14.797534 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a7fc2504-dcb7-493e-a3ca-768f32c82457 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.535649 Jan 22 21:08:14.798160 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1277/2724] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:14 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:14.817813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d2f1b772-5016-484d-8eb3-b4c9a647a21d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:14.818701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d2f1b772-5016-484d-8eb3-b4c9a647a21d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:14.838563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2f1b772-5016-484d-8eb3-b4c9a647a21d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:14.839006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2f1b772-5016-484d-8eb3-b4c9a647a21d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:14.840950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2f1b772-5016-484d-8eb3-b4c9a647a21d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:14.841683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2f1b772-5016-484d-8eb3-b4c9a647a21d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:14.945293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d2f1b772-5016-484d-8eb3-b4c9a647a21d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:14.954436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d2f1b772-5016-484d-8eb3-b4c9a647a21d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:14.956543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d2f1b772-5016-484d-8eb3-b4c9a647a21d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:14.957844 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d2f1b772-5016-484d-8eb3-b4c9a647a21d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1369 microversion: 2.57 time: 0.156420 Jan 22 21:08:14.959794 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1278/2725] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:14 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:14.964888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-3d7e72f7-3e01-4d7d-913a-ec9c69cbc11c req-f0815d28-7737-4892-afdd-90aeb72e0d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dd17fd5-afdd-4c9d-b3f4-37e074b52164", "name": "network-vif-deleted", "tag": "6ccde979-75d5-4cd2-a24c-44e19ed1cd1d"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:14.966454 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:14.966454 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:14.988442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3d7e72f7-3e01-4d7d-913a-ec9c69cbc11c req-f0815d28-7737-4892-afdd-90aeb72e0d2e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:14.988915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3d7e72f7-3e01-4d7d-913a-ec9c69cbc11c req-f0815d28-7737-4892-afdd-90aeb72e0d2e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:15.003203 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-3d7e72f7-3e01-4d7d-913a-ec9c69cbc11c req-f0815d28-7737-4892-afdd-90aeb72e0d2e service nova] Creating event network-vif-deleted:6ccde979-75d5-4cd2-a24c-44e19ed1cd1d for instance 9dd17fd5-afdd-4c9d-b3f4-37e074b52164 on nch2-master-1 Jan 22 21:08:15.005383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-489b5e40-41a5-46ba-ab55-da57c0be8576 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:15.008647 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-3d7e72f7-3e01-4d7d-913a-ec9c69cbc11c req-f0815d28-7737-4892-afdd-90aeb72e0d2e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047152 Jan 22 21:08:15.009788 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1279/2726] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:15.015097 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-489b5e40-41a5-46ba-ab55-da57c0be8576 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.309123 Jan 22 21:08:15.016054 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1448/2727] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:14 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:15.058824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-553f7a18-7648-4326-b9ca-91eca6c3fd46 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:15.060228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-553f7a18-7648-4326-b9ca-91eca6c3fd46 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:15.067469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-553f7a18-7648-4326-b9ca-91eca6c3fd46 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:15.068143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-553f7a18-7648-4326-b9ca-91eca6c3fd46 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:15.068929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-553f7a18-7648-4326-b9ca-91eca6c3fd46 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:15.074947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-553f7a18-7648-4326-b9ca-91eca6c3fd46 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:15.193528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7fe0888e-6cf6-47d8-a4d7-e6ed1cce510b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:15.195489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7fe0888e-6cf6-47d8-a4d7-e6ed1cce510b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:15.201952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fe0888e-6cf6-47d8-a4d7-e6ed1cce510b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:15.203437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fe0888e-6cf6-47d8-a4d7-e6ed1cce510b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:15.204905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fe0888e-6cf6-47d8-a4d7-e6ed1cce510b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:15.207287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fe0888e-6cf6-47d8-a4d7-e6ed1cce510b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:15.260243 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7fe0888e-6cf6-47d8-a4d7-e6ed1cce510b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.071077 Jan 22 21:08:15.265843 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1449/2728] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:15 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:08:15.435077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e03147c-483a-416d-b566-8ea1230b8e66 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:15.437097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e03147c-483a-416d-b566-8ea1230b8e66 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:15.446935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e03147c-483a-416d-b566-8ea1230b8e66 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:15.447705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e03147c-483a-416d-b566-8ea1230b8e66 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:15.448908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e03147c-483a-416d-b566-8ea1230b8e66 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:15.449421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e03147c-483a-416d-b566-8ea1230b8e66 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:15.489120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e03147c-483a-416d-b566-8ea1230b8e66 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:15.489879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e03147c-483a-416d-b566-8ea1230b8e66 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:15.490614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-5e03147c-483a-416d-b566-8ea1230b8e66 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lazy-loading 'fault' on Instance uuid 9dd17fd5-afdd-4c9d-b3f4-37e074b52164 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:08:15.531833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-553f7a18-7648-4326-b9ca-91eca6c3fd46 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:15.547642 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-553f7a18-7648-4326-b9ca-91eca6c3fd46 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.493395 Jan 22 21:08:15.558826 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1280/2729] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:15 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:15.569051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5e03147c-483a-416d-b566-8ea1230b8e66 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:15.582382 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e03147c-483a-416d-b566-8ea1230b8e66 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 200 len: 1316 microversion: 2.1 time: 0.151637 Jan 22 21:08:15.585084 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1450/2730] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:15 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:15.721116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eff254d2-4c03-44c1-8eeb-676eb7e9237a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:15.729437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eff254d2-4c03-44c1-8eeb-676eb7e9237a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:15.736198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eff254d2-4c03-44c1-8eeb-676eb7e9237a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:15.736911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eff254d2-4c03-44c1-8eeb-676eb7e9237a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:15.738305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eff254d2-4c03-44c1-8eeb-676eb7e9237a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:15.738935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eff254d2-4c03-44c1-8eeb-676eb7e9237a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:15.822564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a801ed64-ba8d-4de5-a47c-358542533ef1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:15.823139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a801ed64-ba8d-4de5-a47c-358542533ef1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:15.835147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a801ed64-ba8d-4de5-a47c-358542533ef1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:15.837687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a801ed64-ba8d-4de5-a47c-358542533ef1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:15.840111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a801ed64-ba8d-4de5-a47c-358542533ef1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:15.840775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a801ed64-ba8d-4de5-a47c-358542533ef1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:16.092871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a801ed64-ba8d-4de5-a47c-358542533ef1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:16.102829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eff254d2-4c03-44c1-8eeb-676eb7e9237a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:16.105938 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a801ed64-ba8d-4de5-a47c-358542533ef1 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.287084 Jan 22 21:08:16.107141 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1451/2731] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:15 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:16.114733 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eff254d2-4c03-44c1-8eeb-676eb7e9237a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1323 microversion: 2.1 time: 0.397226 Jan 22 21:08:16.115965 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1281/2732] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:15 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1323 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:16.121724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5b5f572f-1504-4938-a936-4ea451444bbb req-d90efce5-7fae-4de2-8f22-30416eb094ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79886df2-2261-4152-ac59-f8406a583423", "tag": "3041c656-c48c-42e3-9761-4ac45e757781"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:16.125933 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:16.125933 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:16.133298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-52e8fcf6-9766-4cfa-ab7f-8bac3cb6cd41 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:16.133962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-52e8fcf6-9766-4cfa-ab7f-8bac3cb6cd41 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:16.139966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5b5f572f-1504-4938-a936-4ea451444bbb req-d90efce5-7fae-4de2-8f22-30416eb094ab service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:16.140425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5b5f572f-1504-4938-a936-4ea451444bbb req-d90efce5-7fae-4de2-8f22-30416eb094ab service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:16.142705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52e8fcf6-9766-4cfa-ab7f-8bac3cb6cd41 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:16.143169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52e8fcf6-9766-4cfa-ab7f-8bac3cb6cd41 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:16.144420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52e8fcf6-9766-4cfa-ab7f-8bac3cb6cd41 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:16.150162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52e8fcf6-9766-4cfa-ab7f-8bac3cb6cd41 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:16.162774 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5b5f572f-1504-4938-a936-4ea451444bbb req-d90efce5-7fae-4de2-8f22-30416eb094ab service nova] Creating event network-changed:3041c656-c48c-42e3-9761-4ac45e757781 for instance 79886df2-2261-4152-ac59-f8406a583423 on nch1-master-1 Jan 22 21:08:16.174291 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-5b5f572f-1504-4938-a936-4ea451444bbb req-d90efce5-7fae-4de2-8f22-30416eb094ab service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064236 Jan 22 21:08:16.179821 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1452/2733] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:16.190144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8c6d1478-e5db-4e3c-bdae-0917783b1390 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:16.206454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8c6d1478-e5db-4e3c-bdae-0917783b1390 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:16.218554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c6d1478-e5db-4e3c-bdae-0917783b1390 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:16.219286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c6d1478-e5db-4e3c-bdae-0917783b1390 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:16.220333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c6d1478-e5db-4e3c-bdae-0917783b1390 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:16.221019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c6d1478-e5db-4e3c-bdae-0917783b1390 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:16.321754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-52e8fcf6-9766-4cfa-ab7f-8bac3cb6cd41 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:16.357719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-52e8fcf6-9766-4cfa-ab7f-8bac3cb6cd41 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:16.359704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-52e8fcf6-9766-4cfa-ab7f-8bac3cb6cd41 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:16.361142 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-52e8fcf6-9766-4cfa-ab7f-8bac3cb6cd41 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1375 microversion: 2.57 time: 0.244033 Jan 22 21:08:16.362451 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1282/2734] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:16 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1375 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:16.367934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5319e846-c43d-4ad4-ae08-e6aa34c2dfa4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:16.369674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5319e846-c43d-4ad4-ae08-e6aa34c2dfa4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:16.394747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5319e846-c43d-4ad4-ae08-e6aa34c2dfa4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:16.395486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5319e846-c43d-4ad4-ae08-e6aa34c2dfa4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:16.398487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5319e846-c43d-4ad4-ae08-e6aa34c2dfa4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:16.399122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5319e846-c43d-4ad4-ae08-e6aa34c2dfa4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:16.427250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8c6d1478-e5db-4e3c-bdae-0917783b1390 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:16.437082 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8c6d1478-e5db-4e3c-bdae-0917783b1390 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.255546 Jan 22 21:08:16.437940 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1453/2735] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:16 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:16.468197 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5319e846-c43d-4ad4-ae08-e6aa34c2dfa4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.103693 Jan 22 21:08:16.469757 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1283/2736] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:16 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:16.568110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-59d9648b-4252-4f28-aa97-a428241160bb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:16.571984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-59d9648b-4252-4f28-aa97-a428241160bb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:16.574508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59d9648b-4252-4f28-aa97-a428241160bb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:16.574971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59d9648b-4252-4f28-aa97-a428241160bb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:16.575782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59d9648b-4252-4f28-aa97-a428241160bb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:16.579164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59d9648b-4252-4f28-aa97-a428241160bb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:16.606654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-60328803-53e0-4ced-95a1-58324b429289 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:16.607441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-60328803-53e0-4ced-95a1-58324b429289 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:16.618160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60328803-53e0-4ced-95a1-58324b429289 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:16.623651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60328803-53e0-4ced-95a1-58324b429289 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:16.623651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60328803-53e0-4ced-95a1-58324b429289 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:16.623651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60328803-53e0-4ced-95a1-58324b429289 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:16.660334 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-60328803-53e0-4ced-95a1-58324b429289 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] HTTP exception thrown: Instance 9dd17fd5-afdd-4c9d-b3f4-37e074b52164 could not be found. Jan 22 21:08:16.664029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-60328803-53e0-4ced-95a1-58324b429289 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Returning 404 to user: Instance 9dd17fd5-afdd-4c9d-b3f4-37e074b52164 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:08:16.665934 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-60328803-53e0-4ced-95a1-58324b429289 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 404 len: 111 microversion: 2.1 time: 0.069394 Jan 22 21:08:16.668906 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1284/2737] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:16 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:08:16.682360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1a6210b5-19d3-427e-ae45-c05a05ad0718 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Action: 'create', calling method: .version_select at 0x7f1edae05b80>, body: {"keypair": {"name": "tempest-keypair-485820886"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:16.712184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-1a6210b5-19d3-427e-ae45-c05a05ad0718 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Getting quotas for project bfedf205c9e44aa1989b307d2b400b50. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:16.723583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-1a6210b5-19d3-427e-ae45-c05a05ad0718 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Getting quotas for user e63df9a38aaf47338df65d3bf0d5aa81 and project bfedf205c9e44aa1989b307d2b400b50. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:16.833850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-59d9648b-4252-4f28-aa97-a428241160bb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:16.843293 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-59d9648b-4252-4f28-aa97-a428241160bb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.280999 Jan 22 21:08:16.844418 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1454/2738] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:16 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:17.088289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-1a6210b5-19d3-427e-ae45-c05a05ad0718 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Getting quotas for project bfedf205c9e44aa1989b307d2b400b50. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:17.094534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-1a6210b5-19d3-427e-ae45-c05a05ad0718 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Getting quotas for user e63df9a38aaf47338df65d3bf0d5aa81 and project bfedf205c9e44aa1989b307d2b400b50. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:17.112838 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1a6210b5-19d3-427e-ae45-c05a05ad0718 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.436708 Jan 22 21:08:17.114682 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1285/2739] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:08:16 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:17.123890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0ea96878-9108-4afe-9664-87ac19d84f69 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:17.125109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0ea96878-9108-4afe-9664-87ac19d84f69 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:17.133246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ea96878-9108-4afe-9664-87ac19d84f69 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:17.134033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ea96878-9108-4afe-9664-87ac19d84f69 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:17.135352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ea96878-9108-4afe-9664-87ac19d84f69 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:17.135970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ea96878-9108-4afe-9664-87ac19d84f69 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:17.136103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b1d6813e-5cca-4f1a-9efa-2edca5354dbd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:17.136800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b1d6813e-5cca-4f1a-9efa-2edca5354dbd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:17.145757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1d6813e-5cca-4f1a-9efa-2edca5354dbd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:17.146370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1d6813e-5cca-4f1a-9efa-2edca5354dbd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:17.148551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1d6813e-5cca-4f1a-9efa-2edca5354dbd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:17.149032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1d6813e-5cca-4f1a-9efa-2edca5354dbd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:17.315511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0ea96878-9108-4afe-9664-87ac19d84f69 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:17.330785 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0ea96878-9108-4afe-9664-87ac19d84f69 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.210865 Jan 22 21:08:17.331948 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1455/2740] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:17 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:17.387673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-99782724-d889-4a67-9dc7-9fd02fc76b5a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:17.387673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-99782724-d889-4a67-9dc7-9fd02fc76b5a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:17.392153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99782724-d889-4a67-9dc7-9fd02fc76b5a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:17.392799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99782724-d889-4a67-9dc7-9fd02fc76b5a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:17.394038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99782724-d889-4a67-9dc7-9fd02fc76b5a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:17.394662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99782724-d889-4a67-9dc7-9fd02fc76b5a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:17.469236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b1d6813e-5cca-4f1a-9efa-2edca5354dbd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:17.481728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-99782724-d889-4a67-9dc7-9fd02fc76b5a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:17.483733 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b1d6813e-5cca-4f1a-9efa-2edca5354dbd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1323 microversion: 2.1 time: 0.354820 Jan 22 21:08:17.484532 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1286/2741] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:17 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1323 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:17.492560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3f90ad96-3c90-4197-bdd2-23db97260cda tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:17.493722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3f90ad96-3c90-4197-bdd2-23db97260cda tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:17.501086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f90ad96-3c90-4197-bdd2-23db97260cda tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:17.501252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-99782724-d889-4a67-9dc7-9fd02fc76b5a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:17.501853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f90ad96-3c90-4197-bdd2-23db97260cda tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:17.502820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f90ad96-3c90-4197-bdd2-23db97260cda tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:17.503082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-99782724-d889-4a67-9dc7-9fd02fc76b5a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:17.503580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f90ad96-3c90-4197-bdd2-23db97260cda tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:17.504189 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-99782724-d889-4a67-9dc7-9fd02fc76b5a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1375 microversion: 2.57 time: 0.127753 Jan 22 21:08:17.505170 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1456/2742] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:17 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1375 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:17.509939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d0cfd07a-4acb-4e2e-a502-bf04e47215a6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:17.511262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d0cfd07a-4acb-4e2e-a502-bf04e47215a6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:17.518006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0cfd07a-4acb-4e2e-a502-bf04e47215a6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:17.518628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0cfd07a-4acb-4e2e-a502-bf04e47215a6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:17.519502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0cfd07a-4acb-4e2e-a502-bf04e47215a6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:17.520023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0cfd07a-4acb-4e2e-a502-bf04e47215a6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:17.567170 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d0cfd07a-4acb-4e2e-a502-bf04e47215a6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.060246 Jan 22 21:08:17.568258 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1457/2743] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:17 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:17.860648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d60848ca-1f3e-42f2-8580-d71ec38671bd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:17.861626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d60848ca-1f3e-42f2-8580-d71ec38671bd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:17.876916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d60848ca-1f3e-42f2-8580-d71ec38671bd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:17.877420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d60848ca-1f3e-42f2-8580-d71ec38671bd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:17.879024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d60848ca-1f3e-42f2-8580-d71ec38671bd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:17.879484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d60848ca-1f3e-42f2-8580-d71ec38671bd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:18.060623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d60848ca-1f3e-42f2-8580-d71ec38671bd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:18.066335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3f90ad96-3c90-4197-bdd2-23db97260cda tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:18.071364 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d60848ca-1f3e-42f2-8580-d71ec38671bd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.214391 Jan 22 21:08:18.073543 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1458/2744] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:17 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:18.074288 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3f90ad96-3c90-4197-bdd2-23db97260cda tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.587737 Jan 22 21:08:18.081626 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1287/2745] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:17 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:18.197636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-d5532b35-a70e-4652-96fb-1e6742420311 req-36bdb97c-599d-48ac-8407-85b5767428f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bc292b6-fff2-4016-ae88-5af6f9e6d202", "tag": "d47f6f59-aa85-46db-a173-064b56c1462a"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:18.199445 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:18.199445 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:18.207636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d5532b35-a70e-4652-96fb-1e6742420311 req-36bdb97c-599d-48ac-8407-85b5767428f3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:18.208158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d5532b35-a70e-4652-96fb-1e6742420311 req-36bdb97c-599d-48ac-8407-85b5767428f3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:18.219400 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d5532b35-a70e-4652-96fb-1e6742420311 req-36bdb97c-599d-48ac-8407-85b5767428f3 service nova] Creating event network-changed:d47f6f59-aa85-46db-a173-064b56c1462a for instance 3bc292b6-fff2-4016-ae88-5af6f9e6d202 on nch2-master-1 Jan 22 21:08:18.224285 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-d5532b35-a70e-4652-96fb-1e6742420311 req-36bdb97c-599d-48ac-8407-85b5767428f3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031228 Jan 22 21:08:18.224879 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1459/2746] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:18.350006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2ff86a80-3ee7-4d6d-943d-6f20a8238561 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:18.350646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2ff86a80-3ee7-4d6d-943d-6f20a8238561 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:18.367715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ff86a80-3ee7-4d6d-943d-6f20a8238561 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:18.368465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ff86a80-3ee7-4d6d-943d-6f20a8238561 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:18.369447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ff86a80-3ee7-4d6d-943d-6f20a8238561 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:18.370083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ff86a80-3ee7-4d6d-943d-6f20a8238561 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:18.504196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-54c41d7b-b54a-431f-bb21-3030c7457ec6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:18.504976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-54c41d7b-b54a-431f-bb21-3030c7457ec6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:18.511187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54c41d7b-b54a-431f-bb21-3030c7457ec6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:18.511809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54c41d7b-b54a-431f-bb21-3030c7457ec6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:18.512595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54c41d7b-b54a-431f-bb21-3030c7457ec6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:18.513036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54c41d7b-b54a-431f-bb21-3030c7457ec6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:18.624875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2ff86a80-3ee7-4d6d-943d-6f20a8238561 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:18.633543 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2ff86a80-3ee7-4d6d-943d-6f20a8238561 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.289236 Jan 22 21:08:18.634510 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1288/2747] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:18 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:18.648578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-09a1df4d-65b5-40b2-914e-8ceb83817d80 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:18.649194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-09a1df4d-65b5-40b2-914e-8ceb83817d80 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:18.655434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09a1df4d-65b5-40b2-914e-8ceb83817d80 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:18.655882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09a1df4d-65b5-40b2-914e-8ceb83817d80 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:18.659312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09a1df4d-65b5-40b2-914e-8ceb83817d80 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:18.659312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09a1df4d-65b5-40b2-914e-8ceb83817d80 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:18.708316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-54c41d7b-b54a-431f-bb21-3030c7457ec6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:18.716851 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-54c41d7b-b54a-431f-bb21-3030c7457ec6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1323 microversion: 2.1 time: 0.218635 Jan 22 21:08:18.726570 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1460/2748] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:18 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1323 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:18.732539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9e2dd494-cbf1-4261-9bc9-de2b25830bca tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:18.734036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9e2dd494-cbf1-4261-9bc9-de2b25830bca tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:18.742512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e2dd494-cbf1-4261-9bc9-de2b25830bca tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:18.743238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e2dd494-cbf1-4261-9bc9-de2b25830bca tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:18.744226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e2dd494-cbf1-4261-9bc9-de2b25830bca tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:18.744835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e2dd494-cbf1-4261-9bc9-de2b25830bca tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:18.762755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-09a1df4d-65b5-40b2-914e-8ceb83817d80 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:18.777001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-09a1df4d-65b5-40b2-914e-8ceb83817d80 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:18.781100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-09a1df4d-65b5-40b2-914e-8ceb83817d80 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:18.793745 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-09a1df4d-65b5-40b2-914e-8ceb83817d80 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1375 microversion: 2.57 time: 0.150039 Jan 22 21:08:18.794604 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1289/2749] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:18 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:18.809037 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9e2dd494-cbf1-4261-9bc9-de2b25830bca tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.080778 Jan 22 21:08:18.810011 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1461/2750] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:18 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:18.995051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-4f0286e9-c22e-4f6d-9694-7f2a2df91d13 req-ad0da7d4-24a3-4195-bf54-adc3ee35eee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f691860-b62d-4d4b-a911-bf76987874b0", "name": "network-vif-plugged", "status": "completed", "tag": "168fb68b-c059-45fb-821e-7ae312f3e8a6"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:18.996710 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:18.996710 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:19.007658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4f0286e9-c22e-4f6d-9694-7f2a2df91d13 req-ad0da7d4-24a3-4195-bf54-adc3ee35eee5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:19.008517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4f0286e9-c22e-4f6d-9694-7f2a2df91d13 req-ad0da7d4-24a3-4195-bf54-adc3ee35eee5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:19.021457 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-4f0286e9-c22e-4f6d-9694-7f2a2df91d13 req-ad0da7d4-24a3-4195-bf54-adc3ee35eee5 service nova] Creating event network-vif-plugged:168fb68b-c059-45fb-821e-7ae312f3e8a6 for instance 6f691860-b62d-4d4b-a911-bf76987874b0 on nch2-master-1 Jan 22 21:08:19.028706 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-4f0286e9-c22e-4f6d-9694-7f2a2df91d13 req-ad0da7d4-24a3-4195-bf54-adc3ee35eee5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039505 Jan 22 21:08:19.029265 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1290/2751] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:19.090675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e87430bd-3276-47e2-9624-535b83f3c7c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:19.091639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e87430bd-3276-47e2-9624-535b83f3c7c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:19.096102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-36f3d599-727b-41c9-920d-9c8418958e6a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:19.097183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-36f3d599-727b-41c9-920d-9c8418958e6a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:19.099206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e87430bd-3276-47e2-9624-535b83f3c7c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:19.099981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e87430bd-3276-47e2-9624-535b83f3c7c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:19.100986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e87430bd-3276-47e2-9624-535b83f3c7c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:19.101639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e87430bd-3276-47e2-9624-535b83f3c7c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:19.103983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36f3d599-727b-41c9-920d-9c8418958e6a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:19.104521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36f3d599-727b-41c9-920d-9c8418958e6a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:19.105393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36f3d599-727b-41c9-920d-9c8418958e6a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:19.106072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36f3d599-727b-41c9-920d-9c8418958e6a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:19.309208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-36f3d599-727b-41c9-920d-9c8418958e6a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:19.320949 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-36f3d599-727b-41c9-920d-9c8418958e6a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.233093 Jan 22 21:08:19.321701 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1291/2752] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:19 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:19.421400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e87430bd-3276-47e2-9624-535b83f3c7c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:19.429769 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e87430bd-3276-47e2-9624-535b83f3c7c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.344015 Jan 22 21:08:19.430354 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1462/2753] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:19 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:19.650493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fe7fa17b-e7ef-45f2-a198-3a60c0385e38 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:19.651142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fe7fa17b-e7ef-45f2-a198-3a60c0385e38 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:19.657097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe7fa17b-e7ef-45f2-a198-3a60c0385e38 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:19.657578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe7fa17b-e7ef-45f2-a198-3a60c0385e38 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:19.658380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe7fa17b-e7ef-45f2-a198-3a60c0385e38 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:19.659507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe7fa17b-e7ef-45f2-a198-3a60c0385e38 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:19.736377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8268fa1d-0af4-4272-a57e-ef4f25dfe168 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:19.738604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8268fa1d-0af4-4272-a57e-ef4f25dfe168 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:19.746564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8268fa1d-0af4-4272-a57e-ef4f25dfe168 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:19.747175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8268fa1d-0af4-4272-a57e-ef4f25dfe168 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:19.748021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8268fa1d-0af4-4272-a57e-ef4f25dfe168 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:19.748675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8268fa1d-0af4-4272-a57e-ef4f25dfe168 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:19.813355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fe7fa17b-e7ef-45f2-a198-3a60c0385e38 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:19.833311 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fe7fa17b-e7ef-45f2-a198-3a60c0385e38 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.186056 Jan 22 21:08:19.834586 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1292/2754] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:19 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:19.841040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7a19b792-867b-401d-9049-d9bb8fbb2f57 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:19.842086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7a19b792-867b-401d-9049-d9bb8fbb2f57 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:19.873265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a19b792-867b-401d-9049-d9bb8fbb2f57 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:19.874144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a19b792-867b-401d-9049-d9bb8fbb2f57 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:19.875610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a19b792-867b-401d-9049-d9bb8fbb2f57 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:19.884462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a19b792-867b-401d-9049-d9bb8fbb2f57 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:19.964125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7a19b792-867b-401d-9049-d9bb8fbb2f57 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:19.986439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7a19b792-867b-401d-9049-d9bb8fbb2f57 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:19.995632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7a19b792-867b-401d-9049-d9bb8fbb2f57 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:19.995632 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7a19b792-867b-401d-9049-d9bb8fbb2f57 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1360 microversion: 2.57 time: 0.154002 Jan 22 21:08:19.995632 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1293/2755] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:19 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:19.995632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5c0cfb41-d19f-4444-aaf1-839cfab7a37e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:19.997089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5c0cfb41-d19f-4444-aaf1-839cfab7a37e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:20.004025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c0cfb41-d19f-4444-aaf1-839cfab7a37e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:20.004828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c0cfb41-d19f-4444-aaf1-839cfab7a37e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:20.005831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c0cfb41-d19f-4444-aaf1-839cfab7a37e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:20.006434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c0cfb41-d19f-4444-aaf1-839cfab7a37e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:20.059336 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5c0cfb41-d19f-4444-aaf1-839cfab7a37e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.067446 Jan 22 21:08:20.060902 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1294/2756] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:19 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:20.061177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8268fa1d-0af4-4272-a57e-ef4f25dfe168 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:20.065331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f473c4e5-ed4a-4d51-9ece-beec78c00cba tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:20.065964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f473c4e5-ed4a-4d51-9ece-beec78c00cba tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:20.069553 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8268fa1d-0af4-4272-a57e-ef4f25dfe168 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1323 microversion: 2.1 time: 0.337130 Jan 22 21:08:20.070168 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1463/2757] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:19 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1323 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:20.072780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f473c4e5-ed4a-4d51-9ece-beec78c00cba tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:20.073240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f473c4e5-ed4a-4d51-9ece-beec78c00cba tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:20.074072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f473c4e5-ed4a-4d51-9ece-beec78c00cba tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:20.074520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f473c4e5-ed4a-4d51-9ece-beec78c00cba tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:20.102740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f473c4e5-ed4a-4d51-9ece-beec78c00cba tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:08:20.255073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-226295361", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:20.310415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] validate_networks() for [('7ce76187-2d78-4b40-aca9-2d20e9d4107b', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:08:20.444633 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f473c4e5-ed4a-4d51-9ece-beec78c00cba tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 204 len: 0 microversion: 2.57 time: 0.383010 Jan 22 21:08:20.453733 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1295/2758] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:08:20 2022] DELETE /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:08:20.456837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5a75affa-54bb-428e-97bb-b5a4147882f2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:20.457836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5a75affa-54bb-428e-97bb-b5a4147882f2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:20.466450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a75affa-54bb-428e-97bb-b5a4147882f2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:20.467515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a75affa-54bb-428e-97bb-b5a4147882f2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:20.468514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a75affa-54bb-428e-97bb-b5a4147882f2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:20.469925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a75affa-54bb-428e-97bb-b5a4147882f2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:20.723018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:08:20.727239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:08:20.727239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:08:20.727239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:08:20.727239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:08:20.735097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:20.735824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:20.737393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:20.738497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:20.759176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Getting quotas for project bfedf205c9e44aa1989b307d2b400b50. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:20.764823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Getting quotas for user e63df9a38aaf47338df65d3bf0d5aa81 and project bfedf205c9e44aa1989b307d2b400b50. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:20.765002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5a75affa-54bb-428e-97bb-b5a4147882f2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:20.774940 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5a75affa-54bb-428e-97bb-b5a4147882f2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.324965 Jan 22 21:08:20.775746 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1296/2759] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:20 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:20.779461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:08:20.780536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-deddc5cd-7da7-406b-b2a9-63a4acbfdf25 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:20.781488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-deddc5cd-7da7-406b-b2a9-63a4acbfdf25 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:20.782376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:08:20.789062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-deddc5cd-7da7-406b-b2a9-63a4acbfdf25 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:20.789790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-deddc5cd-7da7-406b-b2a9-63a4acbfdf25 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:20.790846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-deddc5cd-7da7-406b-b2a9-63a4acbfdf25 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:20.791643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-deddc5cd-7da7-406b-b2a9-63a4acbfdf25 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:20.860749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-deddc5cd-7da7-406b-b2a9-63a4acbfdf25 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:20.870065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-deddc5cd-7da7-406b-b2a9-63a4acbfdf25 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:20.871703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-deddc5cd-7da7-406b-b2a9-63a4acbfdf25 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:20.873477 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-deddc5cd-7da7-406b-b2a9-63a4acbfdf25 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1366 microversion: 2.57 time: 0.096657 Jan 22 21:08:20.874068 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1297/2760] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:20 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:20.879227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6e3d4f30-84d2-4c09-ad0b-127516e6633f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:20.879831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6e3d4f30-84d2-4c09-ad0b-127516e6633f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:20.885834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e3d4f30-84d2-4c09-ad0b-127516e6633f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:20.886273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e3d4f30-84d2-4c09-ad0b-127516e6633f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:20.887071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e3d4f30-84d2-4c09-ad0b-127516e6633f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:20.887536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e3d4f30-84d2-4c09-ad0b-127516e6633f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:21.026527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6e3d4f30-84d2-4c09-ad0b-127516e6633f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:21.035217 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6e3d4f30-84d2-4c09-ad0b-127516e6633f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.160155 Jan 22 21:08:21.035905 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1298/2761] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:20 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:21.040619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6b217448-2ada-4491-9906-d55ee4c9416f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:21.041218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6b217448-2ada-4491-9906-d55ee4c9416f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:21.047956 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d45c4eeb-89c3-4587-aaef-b2d69ed406b6 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 0.797571 Jan 22 21:08:21.049019 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1464/2762] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:08:20 2022] POST /compute/v2.1/servers => generated 385 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:08:21.054114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-eb5c27bc-f070-4a21-90e8-96f54a75cd6a req-075fcffc-4ce7-424f-b93f-ae6d6334c8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c330ed65-02f3-4e67-854d-a29cee920d71", "name": "network-vif-plugged", "status": "completed", "tag": "7f783146-f266-4f84-af14-dce2807816b9"}, {"server_uuid": "6275dd89-0924-4941-a1ab-1b37c7020f37", "name": "network-vif-plugged", "status": "completed", "tag": "5daf99eb-9bf9-4785-80a9-5e188da8fabd"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:21.056380 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:21.056380 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:21.057312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b217448-2ada-4491-9906-d55ee4c9416f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:21.057796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b217448-2ada-4491-9906-d55ee4c9416f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:21.058600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b217448-2ada-4491-9906-d55ee4c9416f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:21.059039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b217448-2ada-4491-9906-d55ee4c9416f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:21.075432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-eb5c27bc-f070-4a21-90e8-96f54a75cd6a req-075fcffc-4ce7-424f-b93f-ae6d6334c8d4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:21.075923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-eb5c27bc-f070-4a21-90e8-96f54a75cd6a req-075fcffc-4ce7-424f-b93f-ae6d6334c8d4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:21.092299 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-eb5c27bc-f070-4a21-90e8-96f54a75cd6a req-075fcffc-4ce7-424f-b93f-ae6d6334c8d4 service nova] Creating event network-vif-plugged:7f783146-f266-4f84-af14-dce2807816b9 for instance c330ed65-02f3-4e67-854d-a29cee920d71 on nch2-master-1 Jan 22 21:08:21.092299 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-eb5c27bc-f070-4a21-90e8-96f54a75cd6a req-075fcffc-4ce7-424f-b93f-ae6d6334c8d4 service nova] Creating event network-vif-plugged:5daf99eb-9bf9-4785-80a9-5e188da8fabd for instance 6275dd89-0924-4941-a1ab-1b37c7020f37 on nch2-master-1 Jan 22 21:08:21.104140 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-eb5c27bc-f070-4a21-90e8-96f54a75cd6a req-075fcffc-4ce7-424f-b93f-ae6d6334c8d4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048933 Jan 22 21:08:21.104140 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1465/2763] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:21.107852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-759f1268-ff66-455d-8db3-6fc38d2b9632 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:21.110126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-759f1268-ff66-455d-8db3-6fc38d2b9632 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:21.201731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-759f1268-ff66-455d-8db3-6fc38d2b9632 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:21.214009 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-759f1268-ff66-455d-8db3-6fc38d2b9632 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1228 microversion: 2.1 time: 0.111431 Jan 22 21:08:21.215729 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1466/2764] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:21 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1228 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:21.228742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-472fe6c1-171e-4c89-ae7d-aefc4acddb88 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:21.232602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-472fe6c1-171e-4c89-ae7d-aefc4acddb88 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:21.245892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-472fe6c1-171e-4c89-ae7d-aefc4acddb88 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:21.246530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-472fe6c1-171e-4c89-ae7d-aefc4acddb88 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:21.247814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-472fe6c1-171e-4c89-ae7d-aefc4acddb88 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:21.249088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-472fe6c1-171e-4c89-ae7d-aefc4acddb88 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:21.325223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6b217448-2ada-4491-9906-d55ee4c9416f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:21.332705 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6b217448-2ada-4491-9906-d55ee4c9416f tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.295420 Jan 22 21:08:21.337226 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1299/2765] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:21 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:21.343337 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-472fe6c1-171e-4c89-ae7d-aefc4acddb88 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.125292 Jan 22 21:08:21.345012 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1467/2766] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:21 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:21.346039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-493b5b81-3d28-4ebc-acd3-331134dbe0ac tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:21.347482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-493b5b81-3d28-4ebc-acd3-331134dbe0ac tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:21.361130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-493b5b81-3d28-4ebc-acd3-331134dbe0ac tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:21.361530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-493b5b81-3d28-4ebc-acd3-331134dbe0ac tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:21.362967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-493b5b81-3d28-4ebc-acd3-331134dbe0ac tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:21.363426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-493b5b81-3d28-4ebc-acd3-331134dbe0ac tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:21.521058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-493b5b81-3d28-4ebc-acd3-331134dbe0ac tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:21.528389 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-493b5b81-3d28-4ebc-acd3-331134dbe0ac tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1323 microversion: 2.1 time: 0.189316 Jan 22 21:08:21.528958 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1300/2767] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:21 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1323 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:21.793160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bd61439d-210a-4bd2-8aac-e47b5e12f20b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:21.793967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bd61439d-210a-4bd2-8aac-e47b5e12f20b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:21.802267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd61439d-210a-4bd2-8aac-e47b5e12f20b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:21.802724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd61439d-210a-4bd2-8aac-e47b5e12f20b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:21.803511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd61439d-210a-4bd2-8aac-e47b5e12f20b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:21.803952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd61439d-210a-4bd2-8aac-e47b5e12f20b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:21.892268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dca6931c-7498-4a31-be7d-9eda564b521f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:21.894148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dca6931c-7498-4a31-be7d-9eda564b521f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:21.904810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dca6931c-7498-4a31-be7d-9eda564b521f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:21.906441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dca6931c-7498-4a31-be7d-9eda564b521f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:21.907253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dca6931c-7498-4a31-be7d-9eda564b521f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:21.907709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dca6931c-7498-4a31-be7d-9eda564b521f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:21.975529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dca6931c-7498-4a31-be7d-9eda564b521f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:21.984233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dca6931c-7498-4a31-be7d-9eda564b521f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:21.985808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dca6931c-7498-4a31-be7d-9eda564b521f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:21.987020 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dca6931c-7498-4a31-be7d-9eda564b521f tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1366 microversion: 2.57 time: 0.098790 Jan 22 21:08:21.987586 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1301/2768] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:21 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:08:21.989457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bd61439d-210a-4bd2-8aac-e47b5e12f20b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:21.997688 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bd61439d-210a-4bd2-8aac-e47b5e12f20b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.208652 Jan 22 21:08:21.998414 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1468/2769] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:21 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:22.051997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dcb80d5c-fd1a-49e8-b7d0-34ff8a7d4b76 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:22.052746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dcb80d5c-fd1a-49e8-b7d0-34ff8a7d4b76 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:22.058584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcb80d5c-fd1a-49e8-b7d0-34ff8a7d4b76 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:22.059042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcb80d5c-fd1a-49e8-b7d0-34ff8a7d4b76 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:22.059835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcb80d5c-fd1a-49e8-b7d0-34ff8a7d4b76 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:22.060283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcb80d5c-fd1a-49e8-b7d0-34ff8a7d4b76 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:22.206345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dcb80d5c-fd1a-49e8-b7d0-34ff8a7d4b76 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:22.214304 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dcb80d5c-fd1a-49e8-b7d0-34ff8a7d4b76 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.166007 Jan 22 21:08:22.214905 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1302/2770] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:22 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:22.232222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ebbd57e-2f9c-4ba5-8bdc-e8c011eda06d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:22.232893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1ebbd57e-2f9c-4ba5-8bdc-e8c011eda06d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:22.240206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ebbd57e-2f9c-4ba5-8bdc-e8c011eda06d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:22.240658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ebbd57e-2f9c-4ba5-8bdc-e8c011eda06d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:22.241440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ebbd57e-2f9c-4ba5-8bdc-e8c011eda06d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:22.241911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ebbd57e-2f9c-4ba5-8bdc-e8c011eda06d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:22.305034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1ebbd57e-2f9c-4ba5-8bdc-e8c011eda06d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:22.312605 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ebbd57e-2f9c-4ba5-8bdc-e8c011eda06d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1232 microversion: 2.1 time: 0.084084 Jan 22 21:08:22.322838 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1469/2771] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:22 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1232 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:22.355989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bbe74aca-a17d-4490-b1cc-43d17b3be0f6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:22.358953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bbe74aca-a17d-4490-b1cc-43d17b3be0f6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:22.359636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a44124b4-e83b-4e84-aa78-9dc0e661a749 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:22.360453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a44124b4-e83b-4e84-aa78-9dc0e661a749 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:22.363928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbe74aca-a17d-4490-b1cc-43d17b3be0f6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:22.364614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbe74aca-a17d-4490-b1cc-43d17b3be0f6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:22.365927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbe74aca-a17d-4490-b1cc-43d17b3be0f6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:22.366547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbe74aca-a17d-4490-b1cc-43d17b3be0f6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:22.369080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a44124b4-e83b-4e84-aa78-9dc0e661a749 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:22.370478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a44124b4-e83b-4e84-aa78-9dc0e661a749 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:22.371371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a44124b4-e83b-4e84-aa78-9dc0e661a749 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:22.371844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a44124b4-e83b-4e84-aa78-9dc0e661a749 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:22.417292 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bbe74aca-a17d-4490-b1cc-43d17b3be0f6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.064873 Jan 22 21:08:22.418041 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1303/2772] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:22 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:22.525425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a44124b4-e83b-4e84-aa78-9dc0e661a749 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:22.535435 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a44124b4-e83b-4e84-aa78-9dc0e661a749 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.182538 Jan 22 21:08:22.536926 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1470/2773] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:22 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:22.547384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-147b8382-958f-4e91-9d37-03e784def43d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:22.548086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-147b8382-958f-4e91-9d37-03e784def43d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:22.555191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-147b8382-958f-4e91-9d37-03e784def43d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:22.555826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-147b8382-958f-4e91-9d37-03e784def43d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:22.556623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-147b8382-958f-4e91-9d37-03e784def43d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:22.557179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-147b8382-958f-4e91-9d37-03e784def43d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:22.728318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-147b8382-958f-4e91-9d37-03e784def43d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:22.736181 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-147b8382-958f-4e91-9d37-03e784def43d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1323 microversion: 2.1 time: 0.193059 Jan 22 21:08:22.738030 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1304/2774] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:22 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1323 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:23.007138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4455dd3d-b3f5-467a-8b70-ea1be00b994d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:23.007738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4455dd3d-b3f5-467a-8b70-ea1be00b994d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:23.015259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e1fcc33a-35de-40d4-9b06-2e73db4e1ff5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:23.016590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4455dd3d-b3f5-467a-8b70-ea1be00b994d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.016773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e1fcc33a-35de-40d4-9b06-2e73db4e1ff5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:23.017464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4455dd3d-b3f5-467a-8b70-ea1be00b994d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.019255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4455dd3d-b3f5-467a-8b70-ea1be00b994d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.020043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4455dd3d-b3f5-467a-8b70-ea1be00b994d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.027444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1fcc33a-35de-40d4-9b06-2e73db4e1ff5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.032618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1fcc33a-35de-40d4-9b06-2e73db4e1ff5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.034443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1fcc33a-35de-40d4-9b06-2e73db4e1ff5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.035233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1fcc33a-35de-40d4-9b06-2e73db4e1ff5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.073827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4455dd3d-b3f5-467a-8b70-ea1be00b994d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.074289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4455dd3d-b3f5-467a-8b70-ea1be00b994d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.074752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-4455dd3d-b3f5-467a-8b70-ea1be00b994d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lazy-loading 'fault' on Instance uuid 5358b09f-757e-4b6a-9c91-f8f237b37d74 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:08:23.137570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4455dd3d-b3f5-467a-8b70-ea1be00b994d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:23.145692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4455dd3d-b3f5-467a-8b70-ea1be00b994d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:23.147430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4455dd3d-b3f5-467a-8b70-ea1be00b994d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:23.148488 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4455dd3d-b3f5-467a-8b70-ea1be00b994d tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1371 microversion: 2.57 time: 0.146035 Jan 22 21:08:23.158472 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1471/2775] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:23 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:23.166467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-c3781ade-343d-458e-b270-8a65921fe101 req-c54c6254-c0ec-4a80-a640-2d323f28ec97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79886df2-2261-4152-ac59-f8406a583423", "name": "network-vif-plugged", "status": "completed", "tag": "3041c656-c48c-42e3-9761-4ac45e757781"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:23.168866 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:23.168866 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:23.177693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c3781ade-343d-458e-b270-8a65921fe101 req-c54c6254-c0ec-4a80-a640-2d323f28ec97 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.178725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c3781ade-343d-458e-b270-8a65921fe101 req-c54c6254-c0ec-4a80-a640-2d323f28ec97 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.191049 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-c3781ade-343d-458e-b270-8a65921fe101 req-c54c6254-c0ec-4a80-a640-2d323f28ec97 service nova] Creating event network-vif-plugged:3041c656-c48c-42e3-9761-4ac45e757781 for instance 79886df2-2261-4152-ac59-f8406a583423 on nch1-master-1 Jan 22 21:08:23.196455 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-c3781ade-343d-458e-b270-8a65921fe101 req-c54c6254-c0ec-4a80-a640-2d323f28ec97 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034913 Jan 22 21:08:23.197478 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1472/2776] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:23.214222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e1fcc33a-35de-40d4-9b06-2e73db4e1ff5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:23.221653 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e1fcc33a-35de-40d4-9b06-2e73db4e1ff5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.209521 Jan 22 21:08:23.222807 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1305/2777] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:23 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:23.239627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9442f0c0-757b-4b2d-bae5-d78d0a644513 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:23.240357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9442f0c0-757b-4b2d-bae5-d78d0a644513 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:23.247259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9442f0c0-757b-4b2d-bae5-d78d0a644513 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.247752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9442f0c0-757b-4b2d-bae5-d78d0a644513 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.248580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9442f0c0-757b-4b2d-bae5-d78d0a644513 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.249027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9442f0c0-757b-4b2d-bae5-d78d0a644513 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.329561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5149f056-2cc4-4480-956b-3e3d9fed5acd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:23.330705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5149f056-2cc4-4480-956b-3e3d9fed5acd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:23.338657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5149f056-2cc4-4480-956b-3e3d9fed5acd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.339486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5149f056-2cc4-4480-956b-3e3d9fed5acd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.340941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5149f056-2cc4-4480-956b-3e3d9fed5acd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.342045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5149f056-2cc4-4480-956b-3e3d9fed5acd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.421564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9442f0c0-757b-4b2d-bae5-d78d0a644513 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:23.430710 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9442f0c0-757b-4b2d-bae5-d78d0a644513 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.199190 Jan 22 21:08:23.431567 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1473/2778] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:23 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:23.442020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-497fee0d-493b-45bd-b3cd-fdc8bdc8626d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:23.443336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-497fee0d-493b-45bd-b3cd-fdc8bdc8626d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:23.447722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5149f056-2cc4-4480-956b-3e3d9fed5acd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:23.452891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-497fee0d-493b-45bd-b3cd-fdc8bdc8626d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.453400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-497fee0d-493b-45bd-b3cd-fdc8bdc8626d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.454233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-497fee0d-493b-45bd-b3cd-fdc8bdc8626d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.454677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-497fee0d-493b-45bd-b3cd-fdc8bdc8626d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.458463 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5149f056-2cc4-4480-956b-3e3d9fed5acd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1280 microversion: 2.1 time: 0.133076 Jan 22 21:08:23.459485 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1306/2779] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:23 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1280 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:23.505770 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-497fee0d-493b-45bd-b3cd-fdc8bdc8626d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.070651 Jan 22 21:08:23.506485 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1474/2780] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:23 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:23.553415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-20ac01eb-13ea-4434-af7a-1356a43ff894 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:23.554142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-20ac01eb-13ea-4434-af7a-1356a43ff894 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:23.560125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20ac01eb-13ea-4434-af7a-1356a43ff894 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.560578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20ac01eb-13ea-4434-af7a-1356a43ff894 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.561360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20ac01eb-13ea-4434-af7a-1356a43ff894 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.561824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20ac01eb-13ea-4434-af7a-1356a43ff894 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.717074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-20ac01eb-13ea-4434-af7a-1356a43ff894 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:23.726332 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-20ac01eb-13ea-4434-af7a-1356a43ff894 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1321 microversion: 2.1 time: 0.177029 Jan 22 21:08:23.736503 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1307/2781] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:23 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:23.756221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-badc625b-71b8-41de-8b65-4be74e6b0eb6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:23.757096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-badc625b-71b8-41de-8b65-4be74e6b0eb6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:23.771840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-badc625b-71b8-41de-8b65-4be74e6b0eb6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.772665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-badc625b-71b8-41de-8b65-4be74e6b0eb6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.773787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-badc625b-71b8-41de-8b65-4be74e6b0eb6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:23.774456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-badc625b-71b8-41de-8b65-4be74e6b0eb6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:23.929230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-badc625b-71b8-41de-8b65-4be74e6b0eb6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:23.944850 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-badc625b-71b8-41de-8b65-4be74e6b0eb6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1323 microversion: 2.1 time: 0.186510 Jan 22 21:08:23.944850 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1475/2782] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:23 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1323 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:24.168027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-adc86de1-52e9-4036-8291-4ddb2c08b96a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:24.168715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-adc86de1-52e9-4036-8291-4ddb2c08b96a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:24.176488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adc86de1-52e9-4036-8291-4ddb2c08b96a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.185713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adc86de1-52e9-4036-8291-4ddb2c08b96a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.185713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adc86de1-52e9-4036-8291-4ddb2c08b96a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.185713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adc86de1-52e9-4036-8291-4ddb2c08b96a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.219083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adc86de1-52e9-4036-8291-4ddb2c08b96a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.219545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adc86de1-52e9-4036-8291-4ddb2c08b96a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.220237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-adc86de1-52e9-4036-8291-4ddb2c08b96a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lazy-loading 'fault' on Instance uuid 5358b09f-757e-4b6a-9c91-f8f237b37d74 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:08:24.238761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-93f42ab2-4bf0-4f66-b5b5-bda78b8eae89 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:24.242859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-93f42ab2-4bf0-4f66-b5b5-bda78b8eae89 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:24.248853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93f42ab2-4bf0-4f66-b5b5-bda78b8eae89 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.249817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93f42ab2-4bf0-4f66-b5b5-bda78b8eae89 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.250898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93f42ab2-4bf0-4f66-b5b5-bda78b8eae89 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.251436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93f42ab2-4bf0-4f66-b5b5-bda78b8eae89 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.279438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-adc86de1-52e9-4036-8291-4ddb2c08b96a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:24.288813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-adc86de1-52e9-4036-8291-4ddb2c08b96a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:24.291681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-adc86de1-52e9-4036-8291-4ddb2c08b96a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '614513123ab2499fa3fcc1401edaf272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89785746f8d04eea85fd092ad4a9566f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:24.293702 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-adc86de1-52e9-4036-8291-4ddb2c08b96a tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 200 len: 1371 microversion: 2.57 time: 0.129020 Jan 22 21:08:24.303487 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1308/2783] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:24 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 1371 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:08:24.436033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-93f42ab2-4bf0-4f66-b5b5-bda78b8eae89 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:24.448502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b4cbbe8c-b3d4-4d0f-a9a3-61af4adad0c6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:24.449403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b4cbbe8c-b3d4-4d0f-a9a3-61af4adad0c6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:24.454284 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-93f42ab2-4bf0-4f66-b5b5-bda78b8eae89 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1295 microversion: 2.1 time: 0.220331 Jan 22 21:08:24.465147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4cbbe8c-b3d4-4d0f-a9a3-61af4adad0c6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.465147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4cbbe8c-b3d4-4d0f-a9a3-61af4adad0c6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.466231 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1476/2784] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:24 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1295 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:24.466347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4cbbe8c-b3d4-4d0f-a9a3-61af4adad0c6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.466770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4cbbe8c-b3d4-4d0f-a9a3-61af4adad0c6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.484851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d0cff390-126f-43f0-85a0-f4f4758d1b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:24.489026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d0cff390-126f-43f0-85a0-f4f4758d1b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:24.493526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0cff390-126f-43f0-85a0-f4f4758d1b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.494036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0cff390-126f-43f0-85a0-f4f4758d1b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.495006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0cff390-126f-43f0-85a0-f4f4758d1b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.495391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0cff390-126f-43f0-85a0-f4f4758d1b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.559525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d0cff390-126f-43f0-85a0-f4f4758d1b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:24.568275 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d0cff390-126f-43f0-85a0-f4f4758d1b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1298 microversion: 2.1 time: 0.087771 Jan 22 21:08:24.569003 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1477/2785] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:24 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:24.573742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e06e954b-4fda-487c-8723-ddfb14a53b3e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:24.578288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e06e954b-4fda-487c-8723-ddfb14a53b3e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:24.581357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e06e954b-4fda-487c-8723-ddfb14a53b3e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.581921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e06e954b-4fda-487c-8723-ddfb14a53b3e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.582712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e06e954b-4fda-487c-8723-ddfb14a53b3e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.583153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e06e954b-4fda-487c-8723-ddfb14a53b3e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.632196 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e06e954b-4fda-487c-8723-ddfb14a53b3e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.061729 Jan 22 21:08:24.633549 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1478/2786] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:24 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:24.719344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b4cbbe8c-b3d4-4d0f-a9a3-61af4adad0c6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:24.727862 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b4cbbe8c-b3d4-4d0f-a9a3-61af4adad0c6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.283343 Jan 22 21:08:24.728457 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1309/2787] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:24 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:24.743689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b87d7c4d-e0bb-4260-811e-cff7631ebb0c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:24.744450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b87d7c4d-e0bb-4260-811e-cff7631ebb0c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:24.751483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b87d7c4d-e0bb-4260-811e-cff7631ebb0c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.751938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b87d7c4d-e0bb-4260-811e-cff7631ebb0c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.752747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b87d7c4d-e0bb-4260-811e-cff7631ebb0c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.753183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b87d7c4d-e0bb-4260-811e-cff7631ebb0c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.933206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b87d7c4d-e0bb-4260-811e-cff7631ebb0c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:24.949329 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b87d7c4d-e0bb-4260-811e-cff7631ebb0c tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1509 microversion: 2.1 time: 0.203512 Jan 22 21:08:24.949329 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1479/2788] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:24 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:24.954299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b0cf407-6a40-4d66-baf1-b462921f11f5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:24.955054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4b0cf407-6a40-4d66-baf1-b462921f11f5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:24.962432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b0cf407-6a40-4d66-baf1-b462921f11f5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.963063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b0cf407-6a40-4d66-baf1-b462921f11f5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.963433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d03b4702-d3d0-4d88-bf86-096913483f2a tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:24.964060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b0cf407-6a40-4d66-baf1-b462921f11f5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.964188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d03b4702-d3d0-4d88-bf86-096913483f2a tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: 6f691860-b62d-4d4b-a911-bf76987874b0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:24.964688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b0cf407-6a40-4d66-baf1-b462921f11f5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.977724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d03b4702-d3d0-4d88-bf86-096913483f2a tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.977724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d03b4702-d3d0-4d88-bf86-096913483f2a tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:24.977724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d03b4702-d3d0-4d88-bf86-096913483f2a tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:24.977724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d03b4702-d3d0-4d88-bf86-096913483f2a tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.197885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4b0cf407-6a40-4d66-baf1-b462921f11f5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:25.211756 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b0cf407-6a40-4d66-baf1-b462921f11f5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1323 microversion: 2.1 time: 0.261084 Jan 22 21:08:25.212649 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1310/2789] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:24 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1323 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:25.225239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-bcc9fd32-557d-42fc-9588-d28ad6c17a61 req-54c8c562-c3a1-46c9-b450-694196c423cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc292b6-fff2-4016-ae88-5af6f9e6d202", "name": "network-vif-plugged", "status": "completed", "tag": "d47f6f59-aa85-46db-a173-064b56c1462a"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:25.227388 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:25.227388 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:25.235836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bcc9fd32-557d-42fc-9588-d28ad6c17a61 req-54c8c562-c3a1-46c9-b450-694196c423cb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.236588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bcc9fd32-557d-42fc-9588-d28ad6c17a61 req-54c8c562-c3a1-46c9-b450-694196c423cb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.251954 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-bcc9fd32-557d-42fc-9588-d28ad6c17a61 req-54c8c562-c3a1-46c9-b450-694196c423cb service nova] Creating event network-vif-plugged:d47f6f59-aa85-46db-a173-064b56c1462a for instance 3bc292b6-fff2-4016-ae88-5af6f9e6d202 on nch2-master-1 Jan 22 21:08:25.261367 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-bcc9fd32-557d-42fc-9588-d28ad6c17a61 req-54c8c562-c3a1-46c9-b450-694196c423cb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042261 Jan 22 21:08:25.265668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1311/2790] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:25.284862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d03b4702-d3d0-4d88-bf86-096913483f2a tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:25.294207 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d03b4702-d3d0-4d88-bf86-096913483f2a tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/6f691860-b62d-4d4b-a911-bf76987874b0" status: 200 len: 1509 microversion: 2.1 time: 0.335906 Jan 22 21:08:25.295240 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1480/2791] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:24 2022] GET /compute/v2.1/servers/6f691860-b62d-4d4b-a911-bf76987874b0 => generated 1509 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:25.322079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85322d2b-ac22-43df-b5a9-183d94138874 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:25.322904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85322d2b-ac22-43df-b5a9-183d94138874 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] [instance: 5358b09f-757e-4b6a-9c91-f8f237b37d74] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:25.328877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3d6012b1-cef5-4d96-8ca2-10080658375e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:25.329481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3d6012b1-cef5-4d96-8ca2-10080658375e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: 6f691860-b62d-4d4b-a911-bf76987874b0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:25.329660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85322d2b-ac22-43df-b5a9-183d94138874 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.330177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85322d2b-ac22-43df-b5a9-183d94138874 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.331387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85322d2b-ac22-43df-b5a9-183d94138874 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.331942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85322d2b-ac22-43df-b5a9-183d94138874 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.336695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d6012b1-cef5-4d96-8ca2-10080658375e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.351247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d6012b1-cef5-4d96-8ca2-10080658375e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.351247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d6012b1-cef5-4d96-8ca2-10080658375e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.351247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d6012b1-cef5-4d96-8ca2-10080658375e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.352611 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-85322d2b-ac22-43df-b5a9-183d94138874 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] HTTP exception thrown: Instance 5358b09f-757e-4b6a-9c91-f8f237b37d74 could not be found. Jan 22 21:08:25.353838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85322d2b-ac22-43df-b5a9-183d94138874 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] Returning 404 to user: Instance 5358b09f-757e-4b6a-9c91-f8f237b37d74 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:08:25.354798 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-85322d2b-ac22-43df-b5a9-183d94138874 tempest-ServerShowV257Test-303166807 tempest-ServerShowV257Test-303166807-project] 10.222.0.100 "GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74" status: 404 len: 111 microversion: 2.57 time: 0.043447 Jan 22 21:08:25.355967 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1312/2792] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:08:25 2022] GET /compute/v2.1/servers/5358b09f-757e-4b6a-9c91-f8f237b37d74 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:08:25.366377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3d6012b1-cef5-4d96-8ca2-10080658375e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: 6f691860-b62d-4d4b-a911-bf76987874b0] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:08:25.474463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24c75664-7aa2-4d04-af86-d18711d8da81 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:25.475303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-24c75664-7aa2-4d04-af86-d18711d8da81 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:25.481626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24c75664-7aa2-4d04-af86-d18711d8da81 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.482135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24c75664-7aa2-4d04-af86-d18711d8da81 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.491214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24c75664-7aa2-4d04-af86-d18711d8da81 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.491866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24c75664-7aa2-4d04-af86-d18711d8da81 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.672299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-24c75664-7aa2-4d04-af86-d18711d8da81 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:25.680663 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-24c75664-7aa2-4d04-af86-d18711d8da81 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1487 microversion: 2.1 time: 0.212115 Jan 22 21:08:25.681234 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1313/2793] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:25 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1487 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:25.685410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bf8c98e9-c9b6-4425-bab7-4b37e295dc5c tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:25.686052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bf8c98e9-c9b6-4425-bab7-4b37e295dc5c tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:25.692700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf8c98e9-c9b6-4425-bab7-4b37e295dc5c tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.694054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf8c98e9-c9b6-4425-bab7-4b37e295dc5c tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.694197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf8c98e9-c9b6-4425-bab7-4b37e295dc5c tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.694533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf8c98e9-c9b6-4425-bab7-4b37e295dc5c tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.717333 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3d6012b1-cef5-4d96-8ca2-10080658375e tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6f691860-b62d-4d4b-a911-bf76987874b0" status: 204 len: 0 microversion: 2.1 time: 0.394009 Jan 22 21:08:25.717333 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1481/2794] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:08:25 2022] DELETE /compute/v2.1/servers/6f691860-b62d-4d4b-a911-bf76987874b0 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:08:25.727342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-40c10d67-a403-4f2a-b533-8f97ab703a83 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:25.728200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-40c10d67-a403-4f2a-b533-8f97ab703a83 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:25.735125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40c10d67-a403-4f2a-b533-8f97ab703a83 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.735661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40c10d67-a403-4f2a-b533-8f97ab703a83 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.737390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40c10d67-a403-4f2a-b533-8f97ab703a83 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.737886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40c10d67-a403-4f2a-b533-8f97ab703a83 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.794449 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-40c10d67-a403-4f2a-b533-8f97ab703a83 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.077405 Jan 22 21:08:25.796101 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1482/2795] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:25 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:25.804195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab343e84-fc40-4c1b-87ae-14c151af86a3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:25.805181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ab343e84-fc40-4c1b-87ae-14c151af86a3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:25.816046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab343e84-fc40-4c1b-87ae-14c151af86a3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.817703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab343e84-fc40-4c1b-87ae-14c151af86a3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.819208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab343e84-fc40-4c1b-87ae-14c151af86a3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.819884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab343e84-fc40-4c1b-87ae-14c151af86a3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.910858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bf8c98e9-c9b6-4425-bab7-4b37e295dc5c tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:25.925557 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bf8c98e9-c9b6-4425-bab7-4b37e295dc5c tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1328 microversion: 2.1 time: 0.237619 Jan 22 21:08:25.925557 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1314/2796] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:25 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1328 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:25.939046 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab343e84-fc40-4c1b-87ae-14c151af86a3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141446 Jan 22 21:08:25.939252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2d6d560b-03b6-456d-9d1b-d1951ba92792 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:25.940444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2d6d560b-03b6-456d-9d1b-d1951ba92792 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:25.942089 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1483/2797] 10.222.0.100 () {58 vars in 1279 bytes} [Sat Jan 22 21:08:25 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:25.946972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d6d560b-03b6-456d-9d1b-d1951ba92792 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.947587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d6d560b-03b6-456d-9d1b-d1951ba92792 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.948501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d6d560b-03b6-456d-9d1b-d1951ba92792 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.948801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-33758214-5f87-4778-b184-022a916c06c8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:25.949178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d6d560b-03b6-456d-9d1b-d1951ba92792 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.950017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-33758214-5f87-4778-b184-022a916c06c8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:25.961389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33758214-5f87-4778-b184-022a916c06c8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.961389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33758214-5f87-4778-b184-022a916c06c8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:25.961729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33758214-5f87-4778-b184-022a916c06c8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:25.962336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33758214-5f87-4778-b184-022a916c06c8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:26.015815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2d6d560b-03b6-456d-9d1b-d1951ba92792 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:08:26.333719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-33758214-5f87-4778-b184-022a916c06c8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:26.348020 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-33758214-5f87-4778-b184-022a916c06c8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.404257 Jan 22 21:08:26.350723 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1484/2798] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:25 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:26.359364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e7447638-8a5a-4e3c-88fd-60b7d6587efb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:26.363650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e7447638-8a5a-4e3c-88fd-60b7d6587efb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:26.367191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7447638-8a5a-4e3c-88fd-60b7d6587efb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:26.367719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7447638-8a5a-4e3c-88fd-60b7d6587efb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:26.368604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7447638-8a5a-4e3c-88fd-60b7d6587efb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:26.369197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7447638-8a5a-4e3c-88fd-60b7d6587efb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:26.412224 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2d6d560b-03b6-456d-9d1b-d1951ba92792 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 204 len: 0 microversion: 2.1 time: 0.489255 Jan 22 21:08:26.412852 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1315/2799] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:08:25 2022] DELETE /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:08:26.418447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-387e14e9-26f0-4b72-b3ae-f96cb4518ee4 req-2b0a4969-589d-4c32-ad3d-9791f2cf7e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e", "tag": "f2b7b652-2610-49b6-a2c0-0b3e6c51fd86"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:26.424863 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:26.424863 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:26.427827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-387e14e9-26f0-4b72-b3ae-f96cb4518ee4 req-2b0a4969-589d-4c32-ad3d-9791f2cf7e63 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:26.428272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-387e14e9-26f0-4b72-b3ae-f96cb4518ee4 req-2b0a4969-589d-4c32-ad3d-9791f2cf7e63 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:26.440110 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-387e14e9-26f0-4b72-b3ae-f96cb4518ee4 req-2b0a4969-589d-4c32-ad3d-9791f2cf7e63 service nova] Creating event network-changed:f2b7b652-2610-49b6-a2c0-0b3e6c51fd86 for instance c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e on nch1-master-1 Jan 22 21:08:26.447633 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-387e14e9-26f0-4b72-b3ae-f96cb4518ee4 req-2b0a4969-589d-4c32-ad3d-9791f2cf7e63 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032991 Jan 22 21:08:26.448247 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1316/2800] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:26.453814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-654bed88-0e09-4605-9c9a-ff86ae6913d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:26.454185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-654bed88-0e09-4605-9c9a-ff86ae6913d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: 6f691860-b62d-4d4b-a911-bf76987874b0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:26.460903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-654bed88-0e09-4605-9c9a-ff86ae6913d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:26.461411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-654bed88-0e09-4605-9c9a-ff86ae6913d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:26.462415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-654bed88-0e09-4605-9c9a-ff86ae6913d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:26.463022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-654bed88-0e09-4605-9c9a-ff86ae6913d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:26.662215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e7447638-8a5a-4e3c-88fd-60b7d6587efb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:26.675627 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e7447638-8a5a-4e3c-88fd-60b7d6587efb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1323 microversion: 2.1 time: 0.319234 Jan 22 21:08:26.675627 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1485/2801] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:26 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1323 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:26.808477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-22a0fb0a-384c-470f-b598-405d84b79f6d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:26.809429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-22a0fb0a-384c-470f-b598-405d84b79f6d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:26.821128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22a0fb0a-384c-470f-b598-405d84b79f6d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:26.822175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22a0fb0a-384c-470f-b598-405d84b79f6d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:26.829614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22a0fb0a-384c-470f-b598-405d84b79f6d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:26.829614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22a0fb0a-384c-470f-b598-405d84b79f6d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:26.829907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-654bed88-0e09-4605-9c9a-ff86ae6913d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:26.840274 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-654bed88-0e09-4605-9c9a-ff86ae6913d0 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/6f691860-b62d-4d4b-a911-bf76987874b0" status: 200 len: 1515 microversion: 2.1 time: 0.390602 Jan 22 21:08:26.844399 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1317/2802] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:26 2022] GET /compute/v2.1/servers/6f691860-b62d-4d4b-a911-bf76987874b0 => generated 1515 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:26.881914 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-22a0fb0a-384c-470f-b598-405d84b79f6d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.078615 Jan 22 21:08:26.882978 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1486/2803] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:26 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:08:26.938980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-72c7d478-cef1-45a9-85a9-195e95c2ce77 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:26.939876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-72c7d478-cef1-45a9-85a9-195e95c2ce77 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:26.946293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72c7d478-cef1-45a9-85a9-195e95c2ce77 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:26.949659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72c7d478-cef1-45a9-85a9-195e95c2ce77 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:26.949659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72c7d478-cef1-45a9-85a9-195e95c2ce77 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:26.949659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72c7d478-cef1-45a9-85a9-195e95c2ce77 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:27.167963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-72c7d478-cef1-45a9-85a9-195e95c2ce77 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:27.185569 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-72c7d478-cef1-45a9-85a9-195e95c2ce77 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1328 microversion: 2.1 time: 0.250644 Jan 22 21:08:27.187363 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1318/2804] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:26 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1328 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:27.367982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-725553c6-f3b1-4adb-bb42-fdfbc40f66f7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:27.369429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-725553c6-f3b1-4adb-bb42-fdfbc40f66f7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:27.386910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-725553c6-f3b1-4adb-bb42-fdfbc40f66f7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:27.392635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-725553c6-f3b1-4adb-bb42-fdfbc40f66f7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:27.392635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-725553c6-f3b1-4adb-bb42-fdfbc40f66f7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:27.392635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-725553c6-f3b1-4adb-bb42-fdfbc40f66f7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:27.548545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3a3d43e7-9a64-48bd-9485-33e45b0bf14d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:27.550665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3a3d43e7-9a64-48bd-9485-33e45b0bf14d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:27.563082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a3d43e7-9a64-48bd-9485-33e45b0bf14d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:27.564326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a3d43e7-9a64-48bd-9485-33e45b0bf14d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:27.565996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a3d43e7-9a64-48bd-9485-33e45b0bf14d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:27.570672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a3d43e7-9a64-48bd-9485-33e45b0bf14d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:27.648954 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3a3d43e7-9a64-48bd-9485-33e45b0bf14d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 14 microversion: 2.1 time: 0.101025 Jan 22 21:08:27.648954 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1319/2805] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:27 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:08:27.692149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b54aefc4-05bf-4bb2-8081-304af8aec82d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:27.692837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b54aefc4-05bf-4bb2-8081-304af8aec82d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:27.706525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b54aefc4-05bf-4bb2-8081-304af8aec82d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:27.707403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b54aefc4-05bf-4bb2-8081-304af8aec82d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:27.708409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b54aefc4-05bf-4bb2-8081-304af8aec82d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:27.714332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b54aefc4-05bf-4bb2-8081-304af8aec82d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:28.042145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b54aefc4-05bf-4bb2-8081-304af8aec82d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:28.047010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-725553c6-f3b1-4adb-bb42-fdfbc40f66f7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:28.053801 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b54aefc4-05bf-4bb2-8081-304af8aec82d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1473 microversion: 2.1 time: 0.364562 Jan 22 21:08:28.055950 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1320/2806] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:27 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1473 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:28.057219 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-725553c6-f3b1-4adb-bb42-fdfbc40f66f7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.693708 Jan 22 21:08:28.060404 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1487/2807] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:27 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:28.062397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4f64c8ce-51d2-4576-a13b-15c427293551 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:28.063231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4f64c8ce-51d2-4576-a13b-15c427293551 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: 6f691860-b62d-4d4b-a911-bf76987874b0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:28.070678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-39d6bf7a-117e-40e1-9c15-fe3890f6355c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:28.071743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-39d6bf7a-117e-40e1-9c15-fe3890f6355c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:28.090650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39d6bf7a-117e-40e1-9c15-fe3890f6355c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:28.091113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39d6bf7a-117e-40e1-9c15-fe3890f6355c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:28.092143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39d6bf7a-117e-40e1-9c15-fe3890f6355c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:28.092594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39d6bf7a-117e-40e1-9c15-fe3890f6355c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:28.097861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f64c8ce-51d2-4576-a13b-15c427293551 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:28.098358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f64c8ce-51d2-4576-a13b-15c427293551 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:28.099171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f64c8ce-51d2-4576-a13b-15c427293551 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:28.100375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f64c8ce-51d2-4576-a13b-15c427293551 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:28.162709 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-39d6bf7a-117e-40e1-9c15-fe3890f6355c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.101028 Jan 22 21:08:28.163447 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1488/2808] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:28 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:28.169797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-c14054f9-d5f7-45f4-9ccc-300d9f55f6f2 req-cf3622aa-db08-4a56-a4fd-943cafeafc5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6275dd89-0924-4941-a1ab-1b37c7020f37", "tag": "5daf99eb-9bf9-4785-80a9-5e188da8fabd"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:28.175688 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:28.175688 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:28.193916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c14054f9-d5f7-45f4-9ccc-300d9f55f6f2 req-cf3622aa-db08-4a56-a4fd-943cafeafc5b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:28.197819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c14054f9-d5f7-45f4-9ccc-300d9f55f6f2 req-cf3622aa-db08-4a56-a4fd-943cafeafc5b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:28.224134 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-c14054f9-d5f7-45f4-9ccc-300d9f55f6f2 req-cf3622aa-db08-4a56-a4fd-943cafeafc5b service nova] Creating event network-changed:5daf99eb-9bf9-4785-80a9-5e188da8fabd for instance 6275dd89-0924-4941-a1ab-1b37c7020f37 on nch2-master-1 Jan 22 21:08:28.232780 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-c14054f9-d5f7-45f4-9ccc-300d9f55f6f2 req-cf3622aa-db08-4a56-a4fd-943cafeafc5b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067500 Jan 22 21:08:28.237902 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1489/2809] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:28.249414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ce30a5e2-27da-427c-a9b4-24f7e095dd5b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:28.252483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ce30a5e2-27da-427c-a9b4-24f7e095dd5b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 79886df2-2261-4152-ac59-f8406a583423] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:28.268866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce30a5e2-27da-427c-a9b4-24f7e095dd5b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:28.269775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce30a5e2-27da-427c-a9b4-24f7e095dd5b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:28.270816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce30a5e2-27da-427c-a9b4-24f7e095dd5b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:28.271458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce30a5e2-27da-427c-a9b4-24f7e095dd5b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:28.525213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ce30a5e2-27da-427c-a9b4-24f7e095dd5b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:28.535366 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ce30a5e2-27da-427c-a9b4-24f7e095dd5b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/79886df2-2261-4152-ac59-f8406a583423" status: 200 len: 1472 microversion: 2.1 time: 0.293891 Jan 22 21:08:28.540014 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1490/2810] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:28 2022] GET /compute/v2.1/servers/79886df2-2261-4152-ac59-f8406a583423 => generated 1472 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:28.548657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e0e2e8fd-2a8a-4a19-b9c8-60221c5ae2ef tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:28.553652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e0e2e8fd-2a8a-4a19-b9c8-60221c5ae2ef tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:28.567475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0e2e8fd-2a8a-4a19-b9c8-60221c5ae2ef tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:28.568852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0e2e8fd-2a8a-4a19-b9c8-60221c5ae2ef tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:28.572887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0e2e8fd-2a8a-4a19-b9c8-60221c5ae2ef tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:28.575095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0e2e8fd-2a8a-4a19-b9c8-60221c5ae2ef tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:28.668906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4f64c8ce-51d2-4576-a13b-15c427293551 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:28.687266 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4f64c8ce-51d2-4576-a13b-15c427293551 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/6f691860-b62d-4d4b-a911-bf76987874b0" status: 200 len: 1515 microversion: 2.1 time: 0.629775 Jan 22 21:08:28.688996 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1321/2811] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:28 2022] GET /compute/v2.1/servers/6f691860-b62d-4d4b-a911-bf76987874b0 => generated 1515 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:28.697337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c3914ffb-08ad-4de3-993e-15c46794c941 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:28.710343 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:28.710343 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:28.711745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c3914ffb-08ad-4de3-993e-15c46794c941 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:28.715726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c3914ffb-08ad-4de3-993e-15c46794c941 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Searching by: {'reservation_id': 'r-13x649qn', 'deleted': False, 'project_id': '1e6094793b214ae7af6611b1571cac3d'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:08:28.731375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3914ffb-08ad-4de3-993e-15c46794c941 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:28.731906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3914ffb-08ad-4de3-993e-15c46794c941 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:28.733010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3914ffb-08ad-4de3-993e-15c46794c941 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:28.733635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3914ffb-08ad-4de3-993e-15c46794c941 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:28.931808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-c3914ffb-08ad-4de3-993e-15c46794c941 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:08:29.037315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e0e2e8fd-2a8a-4a19-b9c8-60221c5ae2ef tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:29.037315 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e0e2e8fd-2a8a-4a19-b9c8-60221c5ae2ef tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1328 microversion: 2.1 time: 0.493111 Jan 22 21:08:29.037709 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1491/2812] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:28 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1328 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:29.043414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-662658cb-43ef-4af1-bc02-22b023a6a124 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:29.044391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-662658cb-43ef-4af1-bc02-22b023a6a124 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:29.057073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c3914ffb-08ad-4de3-993e-15c46794c941 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:29.064114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-662658cb-43ef-4af1-bc02-22b023a6a124 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:29.064465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3914ffb-08ad-4de3-993e-15c46794c941 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:29.064702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-662658cb-43ef-4af1-bc02-22b023a6a124 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:29.065206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3914ffb-08ad-4de3-993e-15c46794c941 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:29.067234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-662658cb-43ef-4af1-bc02-22b023a6a124 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:29.067691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-662658cb-43ef-4af1-bc02-22b023a6a124 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:29.138185 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-662658cb-43ef-4af1-bc02-22b023a6a124 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 14 microversion: 2.1 time: 0.099279 Jan 22 21:08:29.139927 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1492/2813] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:29 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:08:29.157211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-547fc528-05a5-4657-95e3-6fb6c8a3ebe1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:29.158322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-547fc528-05a5-4657-95e3-6fb6c8a3ebe1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:29.166182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-547fc528-05a5-4657-95e3-6fb6c8a3ebe1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:29.168817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-547fc528-05a5-4657-95e3-6fb6c8a3ebe1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:29.171147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-547fc528-05a5-4657-95e3-6fb6c8a3ebe1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:29.174137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-547fc528-05a5-4657-95e3-6fb6c8a3ebe1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:29.399068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-547fc528-05a5-4657-95e3-6fb6c8a3ebe1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:29.407424 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-547fc528-05a5-4657-95e3-6fb6c8a3ebe1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.265468 Jan 22 21:08:29.407994 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1493/2814] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:29 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:29.413478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-07faa79c-e040-4592-8ac1-77ea4270d649 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:29.414729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-07faa79c-e040-4592-8ac1-77ea4270d649 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:29.425453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07faa79c-e040-4592-8ac1-77ea4270d649 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:29.426039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07faa79c-e040-4592-8ac1-77ea4270d649 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:29.427018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07faa79c-e040-4592-8ac1-77ea4270d649 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:29.427471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07faa79c-e040-4592-8ac1-77ea4270d649 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:29.481540 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-07faa79c-e040-4592-8ac1-77ea4270d649 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.071130 Jan 22 21:08:29.482367 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1494/2815] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:29 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:29.706280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c66a944b-af64-4f50-ab46-359a6ae3a683 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:29.707062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c66a944b-af64-4f50-ab46-359a6ae3a683 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: 6f691860-b62d-4d4b-a911-bf76987874b0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:29.714750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c66a944b-af64-4f50-ab46-359a6ae3a683 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:29.715299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c66a944b-af64-4f50-ab46-359a6ae3a683 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:29.716186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c66a944b-af64-4f50-ab46-359a6ae3a683 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:29.716712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c66a944b-af64-4f50-ab46-359a6ae3a683 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:29.751609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c66a944b-af64-4f50-ab46-359a6ae3a683 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:29.752067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c66a944b-af64-4f50-ab46-359a6ae3a683 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:29.753823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-c66a944b-af64-4f50-ab46-359a6ae3a683 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lazy-loading 'fault' on Instance uuid 6f691860-b62d-4d4b-a911-bf76987874b0 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:08:29.772067 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c3914ffb-08ad-4de3-993e-15c46794c941 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/detail?reservation_id=r-13x649qn" status: 200 len: 2938 microversion: 2.1 time: 1.078417 Jan 22 21:08:29.790638 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1322/2816] 10.222.0.100 () {58 vars in 1201 bytes} [Sat Jan 22 21:08:28 2022] GET /compute/v2.1/servers/detail?reservation_id=r-13x649qn => generated 2938 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:29.796415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3dbf3f54-4225-408b-bfd3-462766ae3609 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:29.836985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.compute.server_groups [None req-3dbf3f54-4225-408b-bfd3-462766ae3609 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Querying cell 52f5c6ef-d4de-4047-a310-d7aef14748aa(cell1) for 2 instances {{(pid=137033) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Jan 22 21:08:29.838466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3dbf3f54-4225-408b-bfd3-462766ae3609 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:29.839285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3dbf3f54-4225-408b-bfd3-462766ae3609 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:29.868203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c66a944b-af64-4f50-ab46-359a6ae3a683 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:29.876965 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c66a944b-af64-4f50-ab46-359a6ae3a683 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/6f691860-b62d-4d4b-a911-bf76987874b0" status: 200 len: 1311 microversion: 2.1 time: 0.174961 Jan 22 21:08:29.878824 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1495/2817] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:29 2022] GET /compute/v2.1/servers/6f691860-b62d-4d4b-a911-bf76987874b0 => generated 1311 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:29.880719 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3dbf3f54-4225-408b-bfd3-462766ae3609 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/os-server-groups/2b9bc7c4-2464-4ade-9a4b-ea55c009c46d" status: 200 len: 271 microversion: 2.1 time: 0.088578 Jan 22 21:08:29.881309 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1323/2818] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:08:29 2022] GET /compute/v2.1/os-server-groups/2b9bc7c4-2464-4ade-9a4b-ea55c009c46d => generated 271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:29.897223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-01cf1f2c-4283-4f5d-ad12-b16c390e8ff5 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:29.897890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-01cf1f2c-4283-4f5d-ad12-b16c390e8ff5 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:29.904290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01cf1f2c-4283-4f5d-ad12-b16c390e8ff5 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:29.904900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01cf1f2c-4283-4f5d-ad12-b16c390e8ff5 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:29.914328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01cf1f2c-4283-4f5d-ad12-b16c390e8ff5 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:29.914328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01cf1f2c-4283-4f5d-ad12-b16c390e8ff5 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.053382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-15fbeaa7-57ae-47fb-a5fa-f2044115df56 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:30.054348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-15fbeaa7-57ae-47fb-a5fa-f2044115df56 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:30.063776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15fbeaa7-57ae-47fb-a5fa-f2044115df56 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.064473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15fbeaa7-57ae-47fb-a5fa-f2044115df56 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.067081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15fbeaa7-57ae-47fb-a5fa-f2044115df56 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.067759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15fbeaa7-57ae-47fb-a5fa-f2044115df56 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.125055 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-01cf1f2c-4283-4f5d-ad12-b16c390e8ff5 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 200 len: 1624 microversion: 2.1 time: 0.232749 Jan 22 21:08:30.129864 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1496/2819] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:29 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 1624 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:30.146102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b611ac57-9946-4874-9818-74926e5163e4 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:30.146102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b611ac57-9946-4874-9818-74926e5163e4 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] [instance: 79886df2-2261-4152-ac59-f8406a583423] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:30.156725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b611ac57-9946-4874-9818-74926e5163e4 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.157201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b611ac57-9946-4874-9818-74926e5163e4 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.158056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b611ac57-9946-4874-9818-74926e5163e4 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.158625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b611ac57-9946-4874-9818-74926e5163e4 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.315439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-15fbeaa7-57ae-47fb-a5fa-f2044115df56 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:30.323327 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-15fbeaa7-57ae-47fb-a5fa-f2044115df56 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1328 microversion: 2.1 time: 0.275286 Jan 22 21:08:30.324007 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1324/2820] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:30 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1328 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:30.338211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-667b2c46-b768-4885-a05e-349e38356844 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:30.345872 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b611ac57-9946-4874-9818-74926e5163e4 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/79886df2-2261-4152-ac59-f8406a583423" status: 200 len: 1623 microversion: 2.1 time: 0.206370 Jan 22 21:08:30.345872 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1497/2821] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:30 2022] GET /compute/v2.1/servers/79886df2-2261-4152-ac59-f8406a583423 => generated 1623 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:30.346460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-667b2c46-b768-4885-a05e-349e38356844 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:30.359554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-667b2c46-b768-4885-a05e-349e38356844 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.359554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-667b2c46-b768-4885-a05e-349e38356844 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.359554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-667b2c46-b768-4885-a05e-349e38356844 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.359554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-667b2c46-b768-4885-a05e-349e38356844 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.372927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-85e40f1e-8982-47e5-b0cb-127c9203590e req-63be7e34-500f-42b8-a43a-cd48309e2ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c330ed65-02f3-4e67-854d-a29cee920d71", "name": "network-vif-deleted", "tag": "7f783146-f266-4f84-af14-dce2807816b9"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:30.376187 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:30.376187 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:30.408125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-85e40f1e-8982-47e5-b0cb-127c9203590e req-63be7e34-500f-42b8-a43a-cd48309e2ace service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.408125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-85e40f1e-8982-47e5-b0cb-127c9203590e req-63be7e34-500f-42b8-a43a-cd48309e2ace service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.439719 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-85e40f1e-8982-47e5-b0cb-127c9203590e req-63be7e34-500f-42b8-a43a-cd48309e2ace service nova] Creating event network-vif-deleted:7f783146-f266-4f84-af14-dce2807816b9 for instance c330ed65-02f3-4e67-854d-a29cee920d71 on nch2-master-1 Jan 22 21:08:30.444729 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-85e40f1e-8982-47e5-b0cb-127c9203590e req-63be7e34-500f-42b8-a43a-cd48309e2ace service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098646 Jan 22 21:08:30.445335 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1498/2822] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:30.450602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-92e96da8-4fc3-4da6-8e5b-f0e9af314b99 req-73c633c5-1ff4-4ef7-bd2c-98a95e44d3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f691860-b62d-4d4b-a911-bf76987874b0", "name": "network-vif-deleted", "tag": "168fb68b-c059-45fb-821e-7ae312f3e8a6"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:30.456099 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:30.456099 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:30.456636 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-667b2c46-b768-4885-a05e-349e38356844 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 14 microversion: 2.1 time: 0.121957 Jan 22 21:08:30.457296 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1325/2823] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:30 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:08:30.466596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-14d3ad32-6b9c-4bcc-9367-608aee48caad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:30.466827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-92e96da8-4fc3-4da6-8e5b-f0e9af314b99 req-73c633c5-1ff4-4ef7-bd2c-98a95e44d3d9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.467291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-14d3ad32-6b9c-4bcc-9367-608aee48caad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:30.467591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-92e96da8-4fc3-4da6-8e5b-f0e9af314b99 req-73c633c5-1ff4-4ef7-bd2c-98a95e44d3d9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.475387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14d3ad32-6b9c-4bcc-9367-608aee48caad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.475849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14d3ad32-6b9c-4bcc-9367-608aee48caad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.476644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14d3ad32-6b9c-4bcc-9367-608aee48caad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.477077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14d3ad32-6b9c-4bcc-9367-608aee48caad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.480485 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-92e96da8-4fc3-4da6-8e5b-f0e9af314b99 req-73c633c5-1ff4-4ef7-bd2c-98a95e44d3d9 service nova] Creating event network-vif-deleted:168fb68b-c059-45fb-821e-7ae312f3e8a6 for instance 6f691860-b62d-4d4b-a911-bf76987874b0 on nch2-master-1 Jan 22 21:08:30.485450 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-92e96da8-4fc3-4da6-8e5b-f0e9af314b99 req-73c633c5-1ff4-4ef7-bd2c-98a95e44d3d9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038647 Jan 22 21:08:30.486084 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1499/2824] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:30.494406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-31211af4-82be-472f-99aa-598c928e3fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:30.495611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-31211af4-82be-472f-99aa-598c928e3fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:30.502577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31211af4-82be-472f-99aa-598c928e3fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.503289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31211af4-82be-472f-99aa-598c928e3fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.504610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31211af4-82be-472f-99aa-598c928e3fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.505067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31211af4-82be-472f-99aa-598c928e3fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.575261 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-31211af4-82be-472f-99aa-598c928e3fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.084532 Jan 22 21:08:30.578438 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1500/2825] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:30 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:30.590451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1968671885", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "7eef2b3f-a335-4858-b070-58323035fc67"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:30.650943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:08:30.677879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-14d3ad32-6b9c-4bcc-9367-608aee48caad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:30.687314 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-14d3ad32-6b9c-4bcc-9367-608aee48caad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.226886 Jan 22 21:08:30.688281 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1326/2826] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:30 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:30.898259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a563eb1f-a206-4ae8-8391-016a1528a826 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:30.900064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a563eb1f-a206-4ae8-8391-016a1528a826 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: 6f691860-b62d-4d4b-a911-bf76987874b0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:30.916310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a563eb1f-a206-4ae8-8391-016a1528a826 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.919564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a563eb1f-a206-4ae8-8391-016a1528a826 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.921256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a563eb1f-a206-4ae8-8391-016a1528a826 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.921921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a563eb1f-a206-4ae8-8391-016a1528a826 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.946972 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-a563eb1f-a206-4ae8-8391-016a1528a826 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] HTTP exception thrown: Instance 6f691860-b62d-4d4b-a911-bf76987874b0 could not be found. Jan 22 21:08:30.948572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a563eb1f-a206-4ae8-8391-016a1528a826 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Returning 404 to user: Instance 6f691860-b62d-4d4b-a911-bf76987874b0 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:08:30.949158 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a563eb1f-a206-4ae8-8391-016a1528a826 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/6f691860-b62d-4d4b-a911-bf76987874b0" status: 404 len: 111 microversion: 2.1 time: 0.057834 Jan 22 21:08:30.951341 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1327/2827] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:30 2022] GET /compute/v2.1/servers/6f691860-b62d-4d4b-a911-bf76987874b0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:08:30.959905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2905a95d-896a-4caa-8f01-21f7df9348fd tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:30.961305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2905a95d-896a-4caa-8f01-21f7df9348fd tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:30.968091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2905a95d-896a-4caa-8f01-21f7df9348fd tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.968821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2905a95d-896a-4caa-8f01-21f7df9348fd tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.969861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2905a95d-896a-4caa-8f01-21f7df9348fd tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:30.970778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2905a95d-896a-4caa-8f01-21f7df9348fd tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:30.990133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:08:30.990710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:08:30.991022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:08:30.991439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:08:30.991920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:08:31.006041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:31.008428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:31.011368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:31.012381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:31.021101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2905a95d-896a-4caa-8f01-21f7df9348fd tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:31.021908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2905a95d-896a-4caa-8f01-21f7df9348fd tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:31.022670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-2905a95d-896a-4caa-8f01-21f7df9348fd tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lazy-loading 'fault' on Instance uuid c330ed65-02f3-4e67-854d-a29cee920d71 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:08:31.047328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:31.058981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:31.071306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2905a95d-896a-4caa-8f01-21f7df9348fd tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6768bb5c11a4bbd85871d812925174f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf62f435d904da7baa190b53458bb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:31.080968 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2905a95d-896a-4caa-8f01-21f7df9348fd tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 200 len: 1311 microversion: 2.1 time: 0.124909 Jan 22 21:08:31.084040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:08:31.091857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:08:31.092025 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1328/2828] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:30 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 1311 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:31.253408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-17910497", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "a982ac8c-3d1e-405d-b754-a70452696d1b"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:31.299885 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-be7f23f9-2007-4927-b427-8067ea1e8362 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.718290 Jan 22 21:08:31.300687 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1501/2829] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:08:30 2022] POST /compute/v2.1/servers => generated 382 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:08:31.308763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] validate_networks() for [('a982ac8c-3d1e-405d-b754-a70452696d1b', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:08:31.311198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9142eb2f-75ac-4201-b017-91d69d7ebfe9 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:31.312137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9142eb2f-75ac-4201-b017-91d69d7ebfe9 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:31.386382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9142eb2f-75ac-4201-b017-91d69d7ebfe9 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:31.396004 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9142eb2f-75ac-4201-b017-91d69d7ebfe9 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1221 microversion: 2.1 time: 0.088601 Jan 22 21:08:31.396598 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1502/2830] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:31 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:31.421957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8ce85ac1-049d-4b25-b6e1-067edba4ec45 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:31.425129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8ce85ac1-049d-4b25-b6e1-067edba4ec45 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:31.443926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ce85ac1-049d-4b25-b6e1-067edba4ec45 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:31.444392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ce85ac1-049d-4b25-b6e1-067edba4ec45 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:31.445207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ce85ac1-049d-4b25-b6e1-067edba4ec45 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:31.446160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ce85ac1-049d-4b25-b6e1-067edba4ec45 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:31.651020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8ce85ac1-049d-4b25-b6e1-067edba4ec45 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:31.660409 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8ce85ac1-049d-4b25-b6e1-067edba4ec45 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1328 microversion: 2.1 time: 0.262469 Jan 22 21:08:31.670497 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1503/2831] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:31 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1328 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:31.676460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f0e48334-5dc0-4986-9c54-674608c0301f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:31.677444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f0e48334-5dc0-4986-9c54-674608c0301f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:31.684975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0e48334-5dc0-4986-9c54-674608c0301f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:31.685470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0e48334-5dc0-4986-9c54-674608c0301f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:31.686556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0e48334-5dc0-4986-9c54-674608c0301f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:31.687010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0e48334-5dc0-4986-9c54-674608c0301f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:31.732682 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f0e48334-5dc0-4986-9c54-674608c0301f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 14 microversion: 2.1 time: 0.057957 Jan 22 21:08:31.732682 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1504/2832] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:31 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:08:31.743145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:08:31.743914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:08:31.744596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:08:31.745241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:08:31.745906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:08:31.747552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-860a9adf-4e86-4d74-96aa-d28404d3bc8c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:31.749863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-860a9adf-4e86-4d74-96aa-d28404d3bc8c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:31.756032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:31.756486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:31.757301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:31.757423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-860a9adf-4e86-4d74-96aa-d28404d3bc8c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:31.757764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:31.757904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-860a9adf-4e86-4d74-96aa-d28404d3bc8c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:31.758752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-860a9adf-4e86-4d74-96aa-d28404d3bc8c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:31.759496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-860a9adf-4e86-4d74-96aa-d28404d3bc8c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:31.775477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Getting quotas for project f96634e81cc246f1ae4438f83a03ed79. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:31.780719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Getting quotas for user 2391e0ef53e044aabb95c2563c931028 and project f96634e81cc246f1ae4438f83a03ed79. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:31.795041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:08:31.797637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:08:31.804100 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-860a9adf-4e86-4d74-96aa-d28404d3bc8c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.069960 Jan 22 21:08:31.804968 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1505/2833] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:31 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:31.812393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-92101a6b-e74c-484c-95f8-19d3eea5dda0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:31.813123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-92101a6b-e74c-484c-95f8-19d3eea5dda0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:31.820770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92101a6b-e74c-484c-95f8-19d3eea5dda0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:31.829841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92101a6b-e74c-484c-95f8-19d3eea5dda0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:31.829841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92101a6b-e74c-484c-95f8-19d3eea5dda0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:31.829841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92101a6b-e74c-484c-95f8-19d3eea5dda0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:31.954322 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3929cd05-8019-4e05-8f32-6e719183004d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.862137 Jan 22 21:08:31.956600 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1329/2834] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:08:31 2022] POST /compute/v2.1/servers => generated 382 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:08:31.967029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ba672fa0-0c10-4c0e-933c-e7e30dbf2fc7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:31.967644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ba672fa0-0c10-4c0e-933c-e7e30dbf2fc7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:32.010259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-92101a6b-e74c-484c-95f8-19d3eea5dda0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:32.018803 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-92101a6b-e74c-484c-95f8-19d3eea5dda0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.212405 Jan 22 21:08:32.019586 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1506/2835] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:31 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:32.028923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ba672fa0-0c10-4c0e-933c-e7e30dbf2fc7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:32.036851 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ba672fa0-0c10-4c0e-933c-e7e30dbf2fc7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1219 microversion: 2.1 time: 0.073829 Jan 22 21:08:32.038095 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1330/2836] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:31 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:32.099664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-edd70007-5a4d-4c03-bf6e-94b04c3880e6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:32.100359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-edd70007-5a4d-4c03-bf6e-94b04c3880e6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] [instance: c330ed65-02f3-4e67-854d-a29cee920d71] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:32.108257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edd70007-5a4d-4c03-bf6e-94b04c3880e6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:32.108926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edd70007-5a4d-4c03-bf6e-94b04c3880e6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:32.110229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edd70007-5a4d-4c03-bf6e-94b04c3880e6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:32.110686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edd70007-5a4d-4c03-bf6e-94b04c3880e6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:32.128748 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-edd70007-5a4d-4c03-bf6e-94b04c3880e6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] HTTP exception thrown: Instance c330ed65-02f3-4e67-854d-a29cee920d71 could not be found. Jan 22 21:08:32.128748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-edd70007-5a4d-4c03-bf6e-94b04c3880e6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] Returning 404 to user: Instance c330ed65-02f3-4e67-854d-a29cee920d71 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:08:32.128748 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-edd70007-5a4d-4c03-bf6e-94b04c3880e6 tempest-MultipleCreateTestJSON-533892211 tempest-MultipleCreateTestJSON-533892211-project] 10.222.0.100 "GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71" status: 404 len: 111 microversion: 2.1 time: 0.033238 Jan 22 21:08:32.129732 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1507/2837] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:32 2022] GET /compute/v2.1/servers/c330ed65-02f3-4e67-854d-a29cee920d71 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:08:32.414585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-33ed6ac5-6841-44b7-a971-c8fb713df60e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:32.415725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-33ed6ac5-6841-44b7-a971-c8fb713df60e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:32.424763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33ed6ac5-6841-44b7-a971-c8fb713df60e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:32.430533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33ed6ac5-6841-44b7-a971-c8fb713df60e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:32.430533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33ed6ac5-6841-44b7-a971-c8fb713df60e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:32.430533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33ed6ac5-6841-44b7-a971-c8fb713df60e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:32.503298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-33ed6ac5-6841-44b7-a971-c8fb713df60e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:32.510909 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-33ed6ac5-6841-44b7-a971-c8fb713df60e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1225 microversion: 2.1 time: 0.100129 Jan 22 21:08:32.511388 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1331/2838] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:32 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:32.679441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-69a2ca11-15d3-42ce-ba66-8b366f4ebff3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:32.680377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-69a2ca11-15d3-42ce-ba66-8b366f4ebff3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:32.688274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69a2ca11-15d3-42ce-ba66-8b366f4ebff3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:32.688852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69a2ca11-15d3-42ce-ba66-8b366f4ebff3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:32.690214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69a2ca11-15d3-42ce-ba66-8b366f4ebff3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:32.690953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69a2ca11-15d3-42ce-ba66-8b366f4ebff3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:32.746539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-32da609d-d775-4f3c-a73b-f8ecf5b62953 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:32.746539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-32da609d-d775-4f3c-a73b-f8ecf5b62953 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:32.776027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32da609d-d775-4f3c-a73b-f8ecf5b62953 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:32.781680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32da609d-d775-4f3c-a73b-f8ecf5b62953 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:32.781680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32da609d-d775-4f3c-a73b-f8ecf5b62953 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:32.781680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32da609d-d775-4f3c-a73b-f8ecf5b62953 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:32.852160 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-32da609d-d775-4f3c-a73b-f8ecf5b62953 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 14 microversion: 2.1 time: 0.112101 Jan 22 21:08:32.855464 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1332/2839] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:32 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:08:32.861106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fd058abf-befb-4922-af37-a5e2d06ac5ec tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:32.863141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fd058abf-befb-4922-af37-a5e2d06ac5ec tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:32.873784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd058abf-befb-4922-af37-a5e2d06ac5ec tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:32.874370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd058abf-befb-4922-af37-a5e2d06ac5ec tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:32.875477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd058abf-befb-4922-af37-a5e2d06ac5ec tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:32.875997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd058abf-befb-4922-af37-a5e2d06ac5ec tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:32.950219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-69a2ca11-15d3-42ce-ba66-8b366f4ebff3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:32.959409 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-69a2ca11-15d3-42ce-ba66-8b366f4ebff3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1328 microversion: 2.1 time: 0.284020 Jan 22 21:08:32.961914 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fd058abf-befb-4922-af37-a5e2d06ac5ec tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.106232 Jan 22 21:08:32.962817 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1333/2840] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:32 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:32.972778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-e10a5317-c944-447a-b4cf-e10365f32393 req-e696cea8-73ea-484a-8447-7458429e4fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e", "name": "network-vif-plugged", "status": "completed", "tag": "f2b7b652-2610-49b6-a2c0-0b3e6c51fd86"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:32.972926 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1508/2841] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:32 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1328 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:32.977382 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:32.977382 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:32.988098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e10a5317-c944-447a-b4cf-e10365f32393 req-e696cea8-73ea-484a-8447-7458429e4fe5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:32.988557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e10a5317-c944-447a-b4cf-e10365f32393 req-e696cea8-73ea-484a-8447-7458429e4fe5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:33.011400 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-e10a5317-c944-447a-b4cf-e10365f32393 req-e696cea8-73ea-484a-8447-7458429e4fe5 service nova] Creating event network-vif-plugged:f2b7b652-2610-49b6-a2c0-0b3e6c51fd86 for instance c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e on nch1-master-1 Jan 22 21:08:33.016133 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-e10a5317-c944-447a-b4cf-e10365f32393 req-e696cea8-73ea-484a-8447-7458429e4fe5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051908 Jan 22 21:08:33.016868 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1334/2842] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:33.036827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-892b3fe2-c13f-453a-bb61-cb384d8d8460 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:33.037720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-892b3fe2-c13f-453a-bb61-cb384d8d8460 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:33.044419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-892b3fe2-c13f-453a-bb61-cb384d8d8460 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:33.044877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-892b3fe2-c13f-453a-bb61-cb384d8d8460 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:33.045702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-892b3fe2-c13f-453a-bb61-cb384d8d8460 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:33.046154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-892b3fe2-c13f-453a-bb61-cb384d8d8460 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:33.056049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f4d0f748-cd63-49ab-a0d9-31c3c0504bb4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:33.056765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f4d0f748-cd63-49ab-a0d9-31c3c0504bb4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:33.131455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f4d0f748-cd63-49ab-a0d9-31c3c0504bb4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:33.141943 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f4d0f748-cd63-49ab-a0d9-31c3c0504bb4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1219 microversion: 2.1 time: 0.090792 Jan 22 21:08:33.142841 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1335/2843] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:33 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:33.217536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-892b3fe2-c13f-453a-bb61-cb384d8d8460 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:33.226908 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-892b3fe2-c13f-453a-bb61-cb384d8d8460 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.194528 Jan 22 21:08:33.227493 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1509/2844] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:33 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:33.528767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8462d579-2763-4dc2-9e9d-b61416e5f3fb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:33.529695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8462d579-2763-4dc2-9e9d-b61416e5f3fb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:33.542747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8462d579-2763-4dc2-9e9d-b61416e5f3fb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:33.543456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8462d579-2763-4dc2-9e9d-b61416e5f3fb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:33.544884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8462d579-2763-4dc2-9e9d-b61416e5f3fb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:33.545556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8462d579-2763-4dc2-9e9d-b61416e5f3fb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:33.645318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8462d579-2763-4dc2-9e9d-b61416e5f3fb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:33.654620 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8462d579-2763-4dc2-9e9d-b61416e5f3fb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1273 microversion: 2.1 time: 0.130076 Jan 22 21:08:33.656053 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1336/2845] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:33 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1273 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:33.865532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cc5c0f5b-c2de-4a29-93a1-9d840769f392 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:33.868371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cc5c0f5b-c2de-4a29-93a1-9d840769f392 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:33.877646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc5c0f5b-c2de-4a29-93a1-9d840769f392 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:33.878066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc5c0f5b-c2de-4a29-93a1-9d840769f392 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:33.878878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc5c0f5b-c2de-4a29-93a1-9d840769f392 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:33.883406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc5c0f5b-c2de-4a29-93a1-9d840769f392 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:33.943611 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cc5c0f5b-c2de-4a29-93a1-9d840769f392 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 14 microversion: 2.1 time: 0.083354 Jan 22 21:08:33.944849 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1510/2846] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:33 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:08:33.979730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f5e95040-f592-41e1-9c8f-0aaf4319095a tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:33.981729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f5e95040-f592-41e1-9c8f-0aaf4319095a tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:33.985940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-649d42b5-e9ec-4939-86a3-aa081e3b5942 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:33.987971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-649d42b5-e9ec-4939-86a3-aa081e3b5942 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:33.994774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5e95040-f592-41e1-9c8f-0aaf4319095a tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:33.995936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5e95040-f592-41e1-9c8f-0aaf4319095a tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:33.997158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5e95040-f592-41e1-9c8f-0aaf4319095a tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:33.997770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5e95040-f592-41e1-9c8f-0aaf4319095a tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:33.998378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-649d42b5-e9ec-4939-86a3-aa081e3b5942 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:33.999313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-649d42b5-e9ec-4939-86a3-aa081e3b5942 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:34.000556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-649d42b5-e9ec-4939-86a3-aa081e3b5942 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:34.001665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-649d42b5-e9ec-4939-86a3-aa081e3b5942 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:34.061752 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-649d42b5-e9ec-4939-86a3-aa081e3b5942 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.081301 Jan 22 21:08:34.067402 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1511/2847] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:33 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:34.160811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-781d3789-7d73-44e9-bdeb-bf4be296ae4c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:34.161759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-781d3789-7d73-44e9-bdeb-bf4be296ae4c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:34.184793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-781d3789-7d73-44e9-bdeb-bf4be296ae4c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:34.186005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-781d3789-7d73-44e9-bdeb-bf4be296ae4c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:34.191367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-781d3789-7d73-44e9-bdeb-bf4be296ae4c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:34.191367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-781d3789-7d73-44e9-bdeb-bf4be296ae4c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:34.222015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f5e95040-f592-41e1-9c8f-0aaf4319095a tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:34.232622 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f5e95040-f592-41e1-9c8f-0aaf4319095a tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1328 microversion: 2.1 time: 0.257898 Jan 22 21:08:34.233323 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1337/2848] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:33 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1328 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:34.249639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb93fb0e-c8c9-418b-b697-30a8db052332 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:34.251281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb93fb0e-c8c9-418b-b697-30a8db052332 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:34.261184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb93fb0e-c8c9-418b-b697-30a8db052332 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:34.261848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb93fb0e-c8c9-418b-b697-30a8db052332 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:34.262825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb93fb0e-c8c9-418b-b697-30a8db052332 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:34.263295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb93fb0e-c8c9-418b-b697-30a8db052332 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:34.287203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-781d3789-7d73-44e9-bdeb-bf4be296ae4c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:34.296115 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-781d3789-7d73-44e9-bdeb-bf4be296ae4c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1271 microversion: 2.1 time: 0.139999 Jan 22 21:08:34.298122 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1512/2849] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:34 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1271 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:34.602049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fb93fb0e-c8c9-418b-b697-30a8db052332 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:34.614611 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb93fb0e-c8c9-418b-b697-30a8db052332 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.369708 Jan 22 21:08:34.616020 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1338/2850] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:34 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:34.676348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4858f245-9228-4d2b-a151-f37438ba40f1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:34.677060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4858f245-9228-4d2b-a151-f37438ba40f1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:34.688153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4858f245-9228-4d2b-a151-f37438ba40f1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:34.695102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4858f245-9228-4d2b-a151-f37438ba40f1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:34.697632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4858f245-9228-4d2b-a151-f37438ba40f1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:34.702895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4858f245-9228-4d2b-a151-f37438ba40f1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:34.801406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4858f245-9228-4d2b-a151-f37438ba40f1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:34.812270 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4858f245-9228-4d2b-a151-f37438ba40f1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1279 microversion: 2.1 time: 0.140876 Jan 22 21:08:34.823088 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1513/2851] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:34 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1279 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:34.956182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d44912ed-744a-4478-80f6-d75fe6970c31 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:34.957310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d44912ed-744a-4478-80f6-d75fe6970c31 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:34.968135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d44912ed-744a-4478-80f6-d75fe6970c31 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:34.968135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d44912ed-744a-4478-80f6-d75fe6970c31 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:34.968135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d44912ed-744a-4478-80f6-d75fe6970c31 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:34.969607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d44912ed-744a-4478-80f6-d75fe6970c31 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:35.037016 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d44912ed-744a-4478-80f6-d75fe6970c31 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 14 microversion: 2.1 time: 0.085109 Jan 22 21:08:35.040143 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1339/2852] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:34 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:08:35.081325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b237ebe-842e-4468-81a8-f6699789ea6d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:35.082321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6b237ebe-842e-4468-81a8-f6699789ea6d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:35.089448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b237ebe-842e-4468-81a8-f6699789ea6d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:35.089943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b237ebe-842e-4468-81a8-f6699789ea6d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:35.090738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b237ebe-842e-4468-81a8-f6699789ea6d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:35.091354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b237ebe-842e-4468-81a8-f6699789ea6d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:35.144274 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b237ebe-842e-4468-81a8-f6699789ea6d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.067678 Jan 22 21:08:35.149770 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1514/2853] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:35 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:35.261738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2aa15469-6402-408f-87fa-0f0e83767340 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:35.264986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2aa15469-6402-408f-87fa-0f0e83767340 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:35.292003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2aa15469-6402-408f-87fa-0f0e83767340 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:35.292766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2aa15469-6402-408f-87fa-0f0e83767340 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:35.294372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2aa15469-6402-408f-87fa-0f0e83767340 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:35.295749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2aa15469-6402-408f-87fa-0f0e83767340 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:35.318905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5501cc16-534b-4680-ac2e-5b80a0faa2fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:35.319668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5501cc16-534b-4680-ac2e-5b80a0faa2fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:35.338680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5501cc16-534b-4680-ac2e-5b80a0faa2fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:35.344129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5501cc16-534b-4680-ac2e-5b80a0faa2fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:35.347128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5501cc16-534b-4680-ac2e-5b80a0faa2fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:35.348468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5501cc16-534b-4680-ac2e-5b80a0faa2fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:35.518472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5501cc16-534b-4680-ac2e-5b80a0faa2fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:35.534997 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5501cc16-534b-4680-ac2e-5b80a0faa2fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1277 microversion: 2.1 time: 0.218763 Jan 22 21:08:35.535953 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1515/2854] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:35 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1277 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:35.636076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b586119-67b1-46c6-87dd-4f60adc3856e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:35.638044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b586119-67b1-46c6-87dd-4f60adc3856e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:35.684605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b586119-67b1-46c6-87dd-4f60adc3856e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:35.685298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b586119-67b1-46c6-87dd-4f60adc3856e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:35.686972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b586119-67b1-46c6-87dd-4f60adc3856e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:35.688859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b586119-67b1-46c6-87dd-4f60adc3856e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:35.697640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2aa15469-6402-408f-87fa-0f0e83767340 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:35.709706 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2aa15469-6402-408f-87fa-0f0e83767340 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1525 microversion: 2.1 time: 0.452685 Jan 22 21:08:35.712115 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1340/2855] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:35 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1525 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:35.741931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e1ee558c-4ae0-45fb-b1ea-72ddee141565 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:35.742929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e1ee558c-4ae0-45fb-b1ea-72ddee141565 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:35.749994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1ee558c-4ae0-45fb-b1ea-72ddee141565 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:35.750863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1ee558c-4ae0-45fb-b1ea-72ddee141565 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:35.752732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1ee558c-4ae0-45fb-b1ea-72ddee141565 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:35.753370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1ee558c-4ae0-45fb-b1ea-72ddee141565 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:35.935367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8b586119-67b1-46c6-87dd-4f60adc3856e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:35.951064 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b586119-67b1-46c6-87dd-4f60adc3856e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.320887 Jan 22 21:08:35.964092 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1516/2856] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:35 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:35.969351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f47aff60-9cc4-4807-9b44-7eeb795d902a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:35.970012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f47aff60-9cc4-4807-9b44-7eeb795d902a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:35.978776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f47aff60-9cc4-4807-9b44-7eeb795d902a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:35.984226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f47aff60-9cc4-4807-9b44-7eeb795d902a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:35.984226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f47aff60-9cc4-4807-9b44-7eeb795d902a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:35.984226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f47aff60-9cc4-4807-9b44-7eeb795d902a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:36.090033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e1ee558c-4ae0-45fb-b1ea-72ddee141565 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:36.098610 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e1ee558c-4ae0-45fb-b1ea-72ddee141565 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1525 microversion: 2.1 time: 0.360819 Jan 22 21:08:36.099794 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1341/2857] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:35 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1525 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:36.105827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aeeda8c0-7ec2-4a87-9135-d443eee56c01 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:36.107200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aeeda8c0-7ec2-4a87-9135-d443eee56c01 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:36.117085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aeeda8c0-7ec2-4a87-9135-d443eee56c01 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:36.133368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aeeda8c0-7ec2-4a87-9135-d443eee56c01 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:36.135332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aeeda8c0-7ec2-4a87-9135-d443eee56c01 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:36.137234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aeeda8c0-7ec2-4a87-9135-d443eee56c01 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:36.200435 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aeeda8c0-7ec2-4a87-9135-d443eee56c01 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 14 microversion: 2.1 time: 0.099024 Jan 22 21:08:36.206011 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1342/2858] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:36 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:08:36.231153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4a2b378d-2d82-43c4-88df-0d7556e336a1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2011343419"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:36.232679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4a2b378d-2d82-43c4-88df-0d7556e336a1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:36.236821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f47aff60-9cc4-4807-9b44-7eeb795d902a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:36.247503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a2b378d-2d82-43c4-88df-0d7556e336a1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:36.247503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a2b378d-2d82-43c4-88df-0d7556e336a1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:36.247503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a2b378d-2d82-43c4-88df-0d7556e336a1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:36.247880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a2b378d-2d82-43c4-88df-0d7556e336a1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:36.249372 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f47aff60-9cc4-4807-9b44-7eeb795d902a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1321 microversion: 2.1 time: 0.280600 Jan 22 21:08:36.250036 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1517/2859] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:35 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:36.255351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-58477a25-6286-4fc1-878c-d063a02fa974 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:36.268068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-58477a25-6286-4fc1-878c-d063a02fa974 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:36.285261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58477a25-6286-4fc1-878c-d063a02fa974 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:36.285999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58477a25-6286-4fc1-878c-d063a02fa974 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:36.287005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58477a25-6286-4fc1-878c-d063a02fa974 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:36.287446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58477a25-6286-4fc1-878c-d063a02fa974 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:36.335564 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-58477a25-6286-4fc1-878c-d063a02fa974 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.083756 Jan 22 21:08:36.339403 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1518/2860] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:36 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:36.556466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7fd53687-43dc-4882-8ca9-46d91e8b1c6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:36.557532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7fd53687-43dc-4882-8ca9-46d91e8b1c6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:36.580753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fd53687-43dc-4882-8ca9-46d91e8b1c6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:36.581691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fd53687-43dc-4882-8ca9-46d91e8b1c6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:36.582689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fd53687-43dc-4882-8ca9-46d91e8b1c6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:36.583138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fd53687-43dc-4882-8ca9-46d91e8b1c6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:36.859582 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4a2b378d-2d82-43c4-88df-0d7556e336a1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "POST /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e/action" status: 202 len: 0 microversion: 2.1 time: 0.648220 Jan 22 21:08:36.860826 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1343/2861] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:36 2022] POST /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 22 21:08:36.872499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85e91f47-ed9d-4df7-a23b-913b4f5ff5fc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '.version_select at 0x7f1ed5cffe50>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:36.961009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7fd53687-43dc-4882-8ca9-46d91e8b1c6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:36.973675 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7fd53687-43dc-4882-8ca9-46d91e8b1c6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1319 microversion: 2.1 time: 0.419999 Jan 22 21:08:36.974249 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1519/2862] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:36 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:36.992025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e2e28da5-1d22-45b8-98dc-24bfcca1bfed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:36.992974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e2e28da5-1d22-45b8-98dc-24bfcca1bfed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:36.999701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2e28da5-1d22-45b8-98dc-24bfcca1bfed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:37.001300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2e28da5-1d22-45b8-98dc-24bfcca1bfed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:37.001300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2e28da5-1d22-45b8-98dc-24bfcca1bfed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:37.001711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2e28da5-1d22-45b8-98dc-24bfcca1bfed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:37.261035 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-85e91f47-ed9d-4df7-a23b-913b4f5ff5fc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "DELETE /compute/v2.1/images/dcf534f1-d01a-49a8-ba9e-b5892a1dcf6c" status: 204 len: 0 microversion: 2.1 time: 0.392774 Jan 22 21:08:37.263987 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1344/2863] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:36 2022] DELETE /compute/v2.1/images/dcf534f1-d01a-49a8-ba9e-b5892a1dcf6c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:08:37.275158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-00234757-9872-4c58-9ce2-1f616a6866bf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:37.277942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-00234757-9872-4c58-9ce2-1f616a6866bf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:37.292302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00234757-9872-4c58-9ce2-1f616a6866bf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:37.293845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00234757-9872-4c58-9ce2-1f616a6866bf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:37.296279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00234757-9872-4c58-9ce2-1f616a6866bf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:37.297178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00234757-9872-4c58-9ce2-1f616a6866bf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:37.368849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e2e28da5-1d22-45b8-98dc-24bfcca1bfed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:37.382401 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-00234757-9872-4c58-9ce2-1f616a6866bf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 14 microversion: 2.1 time: 0.115615 Jan 22 21:08:37.383350 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1345/2864] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:37 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:08:37.390336 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e2e28da5-1d22-45b8-98dc-24bfcca1bfed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.403049 Jan 22 21:08:37.390481 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1520/2865] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:36 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:37.395283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff5ed3b2-4b7a-450f-b7e0-90d9804b9ea1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:37.396411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ff5ed3b2-4b7a-450f-b7e0-90d9804b9ea1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:37.406048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff5ed3b2-4b7a-450f-b7e0-90d9804b9ea1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:37.408907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff5ed3b2-4b7a-450f-b7e0-90d9804b9ea1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:37.409042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8edd328a-2574-4672-9515-03a6bedb7d76 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '.version_select at 0x7f1ed5d8fb80>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:37.409143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff5ed3b2-4b7a-450f-b7e0-90d9804b9ea1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:37.409143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff5ed3b2-4b7a-450f-b7e0-90d9804b9ea1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:37.451795 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-8edd328a-2574-4672-9515-03a6bedb7d76 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] HTTP exception thrown: Image not found. Jan 22 21:08:37.452442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8edd328a-2574-4672-9515-03a6bedb7d76 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Returning 404 to user: Image not found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:08:37.453308 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8edd328a-2574-4672-9515-03a6bedb7d76 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/images/dcf534f1-d01a-49a8-ba9e-b5892a1dcf6c" status: 404 len: 62 microversion: 2.1 time: 0.061961 Jan 22 21:08:37.457276 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1521/2866] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:08:37 2022] GET /compute/v2.1/images/dcf534f1-d01a-49a8-ba9e-b5892a1dcf6c => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:08:37.464493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6334e43-ee2e-437f-88aa-00235f0a5f1a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:37.466114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b6334e43-ee2e-437f-88aa-00235f0a5f1a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:37.475476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6334e43-ee2e-437f-88aa-00235f0a5f1a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:37.475946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6334e43-ee2e-437f-88aa-00235f0a5f1a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:37.477106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6334e43-ee2e-437f-88aa-00235f0a5f1a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:37.477605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6334e43-ee2e-437f-88aa-00235f0a5f1a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:37.560258 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b6334e43-ee2e-437f-88aa-00235f0a5f1a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.098975 Jan 22 21:08:37.560258 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1522/2867] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:37 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:37.567266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-6c4e16ad-2838-4671-bb92-dc3cb15b2811 req-b88db6e2-d594-4726-931b-b985ea6f702a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7699c318-de81-4990-8d4a-526d1c46b578", "tag": "8e6c07ec-a3ec-44ca-92fa-3cf11dda20f2"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:37.569480 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:37.569480 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:37.580982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6c4e16ad-2838-4671-bb92-dc3cb15b2811 req-b88db6e2-d594-4726-931b-b985ea6f702a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:37.581713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6c4e16ad-2838-4671-bb92-dc3cb15b2811 req-b88db6e2-d594-4726-931b-b985ea6f702a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:37.605720 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-6c4e16ad-2838-4671-bb92-dc3cb15b2811 req-b88db6e2-d594-4726-931b-b985ea6f702a service nova] Creating event network-changed:8e6c07ec-a3ec-44ca-92fa-3cf11dda20f2 for instance 7699c318-de81-4990-8d4a-526d1c46b578 on nch2-master-1 Jan 22 21:08:37.618913 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-6c4e16ad-2838-4671-bb92-dc3cb15b2811 req-b88db6e2-d594-4726-931b-b985ea6f702a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055547 Jan 22 21:08:37.619550 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1523/2868] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:37.625056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-546a85fd-1fd3-4b91-be97-df6e38be32d8 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:37.626144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-546a85fd-1fd3-4b91-be97-df6e38be32d8 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:37.634563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-546a85fd-1fd3-4b91-be97-df6e38be32d8 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:37.635450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-546a85fd-1fd3-4b91-be97-df6e38be32d8 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:37.636523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-546a85fd-1fd3-4b91-be97-df6e38be32d8 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:37.636971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-546a85fd-1fd3-4b91-be97-df6e38be32d8 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:37.759331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ff5ed3b2-4b7a-450f-b7e0-90d9804b9ea1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:37.768865 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff5ed3b2-4b7a-450f-b7e0-90d9804b9ea1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1321 microversion: 2.1 time: 0.383601 Jan 22 21:08:37.779331 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1346/2869] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:37 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:37.880477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-546a85fd-1fd3-4b91-be97-df6e38be32d8 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:37.893571 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-546a85fd-1fd3-4b91-be97-df6e38be32d8 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1537 microversion: 2.1 time: 0.272161 Jan 22 21:08:37.894939 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1524/2870] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:37 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1537 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:37.991339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f90e3efa-12f0-415d-b87b-e5586ba30f31 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:37.991996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f90e3efa-12f0-415d-b87b-e5586ba30f31 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:38.010829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f90e3efa-12f0-415d-b87b-e5586ba30f31 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:38.012566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f90e3efa-12f0-415d-b87b-e5586ba30f31 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:38.014357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f90e3efa-12f0-415d-b87b-e5586ba30f31 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:38.014996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f90e3efa-12f0-415d-b87b-e5586ba30f31 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:38.327859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-581034062", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "ab49ab48-066e-4b21-9cb5-bee63c0067a9"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:38.620317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] validate_networks() for [('ab49ab48-066e-4b21-9cb5-bee63c0067a9', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:08:38.621776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f90e3efa-12f0-415d-b87b-e5586ba30f31 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:38.621776 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f90e3efa-12f0-415d-b87b-e5586ba30f31 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1319 microversion: 2.1 time: 0.425197 Jan 22 21:08:38.621776 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1347/2871] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:37 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1319 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:38.621776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-abe389fa-dd12-4089-bee0-b3a489a41a25 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:38.621776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-abe389fa-dd12-4089-bee0-b3a489a41a25 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:38.621776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abe389fa-dd12-4089-bee0-b3a489a41a25 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:38.621776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abe389fa-dd12-4089-bee0-b3a489a41a25 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:38.621776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abe389fa-dd12-4089-bee0-b3a489a41a25 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:38.621776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abe389fa-dd12-4089-bee0-b3a489a41a25 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:38.621776 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-abe389fa-dd12-4089-bee0-b3a489a41a25 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 14 microversion: 2.1 time: 0.065291 Jan 22 21:08:38.621776 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1348/2872] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:38 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:08:38.621776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5daffa6c-96a2-4899-b2b8-afbd8009c2ed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:38.621776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5daffa6c-96a2-4899-b2b8-afbd8009c2ed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:38.623814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5daffa6c-96a2-4899-b2b8-afbd8009c2ed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:38.623814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5daffa6c-96a2-4899-b2b8-afbd8009c2ed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:38.623814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5daffa6c-96a2-4899-b2b8-afbd8009c2ed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:38.623814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5daffa6c-96a2-4899-b2b8-afbd8009c2ed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:38.777189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5daffa6c-96a2-4899-b2b8-afbd8009c2ed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:38.786009 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5daffa6c-96a2-4899-b2b8-afbd8009c2ed tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.302696 Jan 22 21:08:38.796918 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1349/2873] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:38 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:38.796918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0ac3bff2-aa2a-460f-b28b-0edaafe4a394 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:38.796918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0ac3bff2-aa2a-460f-b28b-0edaafe4a394 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:38.799874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ac3bff2-aa2a-460f-b28b-0edaafe4a394 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:38.800341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ac3bff2-aa2a-460f-b28b-0edaafe4a394 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:38.801126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ac3bff2-aa2a-460f-b28b-0edaafe4a394 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:38.801591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ac3bff2-aa2a-460f-b28b-0edaafe4a394 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:38.857975 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0ac3bff2-aa2a-460f-b28b-0edaafe4a394 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.070071 Jan 22 21:08:38.858760 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1350/2874] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:38 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:38.865340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-504b9dfc-3baa-4efb-89f0-01a89b754b3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:38.866126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-504b9dfc-3baa-4efb-89f0-01a89b754b3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:38.873021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-504b9dfc-3baa-4efb-89f0-01a89b754b3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:38.873413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-504b9dfc-3baa-4efb-89f0-01a89b754b3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:38.874256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-504b9dfc-3baa-4efb-89f0-01a89b754b3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:38.874701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-504b9dfc-3baa-4efb-89f0-01a89b754b3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:38.931749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:08:38.931749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:08:38.931749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:08:38.931749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:08:38.931749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:08:38.937735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:38.938430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:38.939465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:38.939929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:38.957807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:38.963303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for user 75befd3272db4de48c7b4586adf6f849 and project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:38.976897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:08:38.982100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:08:39.128762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-504b9dfc-3baa-4efb-89f0-01a89b754b3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:39.133851 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-504b9dfc-3baa-4efb-89f0-01a89b754b3f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1321 microversion: 2.1 time: 0.273660 Jan 22 21:08:39.143750 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1351/2875] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:38 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:39.143750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ac05d9bd-303c-4705-9dab-00af6d81793d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:39.143750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ac05d9bd-303c-4705-9dab-00af6d81793d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:39.146596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac05d9bd-303c-4705-9dab-00af6d81793d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:39.147191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac05d9bd-303c-4705-9dab-00af6d81793d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:39.148055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac05d9bd-303c-4705-9dab-00af6d81793d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:39.148504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac05d9bd-303c-4705-9dab-00af6d81793d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:39.170523 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7ff6a770-42cf-4100-b066-ffb514e47f82 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.008914 Jan 22 21:08:39.172640 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1525/2876] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:08:38 2022] POST /compute/v2.1/servers => generated 382 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:08:39.190867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-deb2ccc6-6493-4d44-971e-665c4859e828 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:39.194054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-deb2ccc6-6493-4d44-971e-665c4859e828 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:39.298305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-deb2ccc6-6493-4d44-971e-665c4859e828 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:39.306651 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-deb2ccc6-6493-4d44-971e-665c4859e828 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1196 microversion: 2.1 time: 0.127252 Jan 22 21:08:39.307418 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1526/2877] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:39 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1196 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:39.432295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fbabce6f-0201-488c-b8b0-161e4fefc372 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:39.432763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fbabce6f-0201-488c-b8b0-161e4fefc372 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:39.440181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fbabce6f-0201-488c-b8b0-161e4fefc372 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:39.441180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fbabce6f-0201-488c-b8b0-161e4fefc372 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:39.441964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fbabce6f-0201-488c-b8b0-161e4fefc372 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:39.442648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fbabce6f-0201-488c-b8b0-161e4fefc372 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:39.660594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fbabce6f-0201-488c-b8b0-161e4fefc372 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:39.675207 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fbabce6f-0201-488c-b8b0-161e4fefc372 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1319 microversion: 2.1 time: 0.247086 Jan 22 21:08:39.678441 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1527/2878] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:39 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:39.697931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9602990d-fc94-44b2-bb25-bc6a4bd5efb1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:39.699599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9602990d-fc94-44b2-bb25-bc6a4bd5efb1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:39.708643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9602990d-fc94-44b2-bb25-bc6a4bd5efb1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:39.709300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9602990d-fc94-44b2-bb25-bc6a4bd5efb1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:39.710732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9602990d-fc94-44b2-bb25-bc6a4bd5efb1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:39.711350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9602990d-fc94-44b2-bb25-bc6a4bd5efb1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:39.744529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ac05d9bd-303c-4705-9dab-00af6d81793d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:39.754155 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ac05d9bd-303c-4705-9dab-00af6d81793d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1543 microversion: 2.1 time: 0.618673 Jan 22 21:08:39.754720 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1352/2879] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:39 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1543 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:39.759322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-973cc9a7-7e2a-4ce2-8a4b-8fe74104f15e req-04e200f8-3b4f-4585-9a90-4dbf9ece0d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49b2aed8-f03f-4c04-b508-cc9a7e172dd6", "tag": "99dd6838-12b2-4c2b-b219-2af5c1a44a74"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:39.760863 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:39.760863 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:39.768997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-973cc9a7-7e2a-4ce2-8a4b-8fe74104f15e req-04e200f8-3b4f-4585-9a90-4dbf9ece0d9a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:39.769711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-973cc9a7-7e2a-4ce2-8a4b-8fe74104f15e req-04e200f8-3b4f-4585-9a90-4dbf9ece0d9a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:39.780702 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9602990d-fc94-44b2-bb25-bc6a4bd5efb1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 8206 microversion: 2.1 time: 0.089130 Jan 22 21:08:39.780702 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1528/2880] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:39 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 8206 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:39.783400 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-973cc9a7-7e2a-4ce2-8a4b-8fe74104f15e req-04e200f8-3b4f-4585-9a90-4dbf9ece0d9a service nova] Creating event network-changed:99dd6838-12b2-4c2b-b219-2af5c1a44a74 for instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 on nch2-master-1 Jan 22 21:08:39.789724 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-973cc9a7-7e2a-4ce2-8a4b-8fe74104f15e req-04e200f8-3b4f-4585-9a90-4dbf9ece0d9a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032550 Jan 22 21:08:39.790379 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1353/2881] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:39.804698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-30af2cae-b482-4f2b-b8d4-483a8b26385b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:39.805798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-30af2cae-b482-4f2b-b8d4-483a8b26385b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:39.816983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30af2cae-b482-4f2b-b8d4-483a8b26385b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:39.817674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30af2cae-b482-4f2b-b8d4-483a8b26385b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:39.819552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30af2cae-b482-4f2b-b8d4-483a8b26385b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:39.820174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30af2cae-b482-4f2b-b8d4-483a8b26385b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:39.871312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ccdefc0d-5e9f-41c5-b271-50b67f5d66f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:39.872662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ccdefc0d-5e9f-41c5-b271-50b67f5d66f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:39.882271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccdefc0d-5e9f-41c5-b271-50b67f5d66f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:39.883031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccdefc0d-5e9f-41c5-b271-50b67f5d66f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:39.884098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccdefc0d-5e9f-41c5-b271-50b67f5d66f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:39.884714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccdefc0d-5e9f-41c5-b271-50b67f5d66f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:39.937997 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ccdefc0d-5e9f-41c5-b271-50b67f5d66f8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.069680 Jan 22 21:08:39.940065 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1354/2882] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:39 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:08:40.064776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-30af2cae-b482-4f2b-b8d4-483a8b26385b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:40.071826 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-30af2cae-b482-4f2b-b8d4-483a8b26385b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.271666 Jan 22 21:08:40.072407 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1529/2883] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:39 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:40.151119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-649aa385-56de-40d2-97d0-64be25405d40 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:40.152444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-649aa385-56de-40d2-97d0-64be25405d40 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:40.160138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-649aa385-56de-40d2-97d0-64be25405d40 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:40.162194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-649aa385-56de-40d2-97d0-64be25405d40 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:40.162194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-649aa385-56de-40d2-97d0-64be25405d40 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:40.162194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-649aa385-56de-40d2-97d0-64be25405d40 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:40.324155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ba839ac1-1b2f-4849-9e31-313a8d773039 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:40.328506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ba839ac1-1b2f-4849-9e31-313a8d773039 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:40.390726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ba839ac1-1b2f-4849-9e31-313a8d773039 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:40.408836 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ba839ac1-1b2f-4849-9e31-313a8d773039 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1196 microversion: 2.1 time: 0.087264 Jan 22 21:08:40.410375 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1530/2884] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:40 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1196 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:40.419759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-649aa385-56de-40d2-97d0-64be25405d40 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:40.431395 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-649aa385-56de-40d2-97d0-64be25405d40 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1321 microversion: 2.1 time: 0.284102 Jan 22 21:08:40.432600 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1355/2885] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:40 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:40.695215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-331957f9-5de8-48b8-a3e1-33d620864eb6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:40.695822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-331957f9-5de8-48b8-a3e1-33d620864eb6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:40.702388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-331957f9-5de8-48b8-a3e1-33d620864eb6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:40.703192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-331957f9-5de8-48b8-a3e1-33d620864eb6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:40.703655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-331957f9-5de8-48b8-a3e1-33d620864eb6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:40.704104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-331957f9-5de8-48b8-a3e1-33d620864eb6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:40.771438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f24fc1b4-13cc-4f8d-af36-909844b8e41b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:40.772123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f24fc1b4-13cc-4f8d-af36-909844b8e41b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:40.778918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f24fc1b4-13cc-4f8d-af36-909844b8e41b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:40.779621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f24fc1b4-13cc-4f8d-af36-909844b8e41b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:40.780616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f24fc1b4-13cc-4f8d-af36-909844b8e41b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:40.781063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f24fc1b4-13cc-4f8d-af36-909844b8e41b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:40.895703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-331957f9-5de8-48b8-a3e1-33d620864eb6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:40.905343 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-331957f9-5de8-48b8-a3e1-33d620864eb6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1319 microversion: 2.1 time: 0.213834 Jan 22 21:08:40.906063 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1531/2886] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:40 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:40.911468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-864ee31f-0d04-4f9e-aab4-113b736d6231 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:40.912888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-864ee31f-0d04-4f9e-aab4-113b736d6231 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:40.919559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-864ee31f-0d04-4f9e-aab4-113b736d6231 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:40.920312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-864ee31f-0d04-4f9e-aab4-113b736d6231 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:40.921630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-864ee31f-0d04-4f9e-aab4-113b736d6231 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:40.922467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-864ee31f-0d04-4f9e-aab4-113b736d6231 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:40.969540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f24fc1b4-13cc-4f8d-af36-909844b8e41b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:40.979952 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f24fc1b4-13cc-4f8d-af36-909844b8e41b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1543 microversion: 2.1 time: 0.212439 Jan 22 21:08:40.981884 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1356/2887] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:40 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1543 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:40.987944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e9a8d7db-91c4-4771-8161-a46e0f86683a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:40.989566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e9a8d7db-91c4-4771-8161-a46e0f86683a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:40.998734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a8d7db-91c4-4771-8161-a46e0f86683a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:41.000555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a8d7db-91c4-4771-8161-a46e0f86683a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:41.000690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a8d7db-91c4-4771-8161-a46e0f86683a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:41.001252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a8d7db-91c4-4771-8161-a46e0f86683a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:41.015376 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-864ee31f-0d04-4f9e-aab4-113b736d6231 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 16320 microversion: 2.1 time: 0.107606 Jan 22 21:08:41.020215 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1532/2888] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:40 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 16320 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:08:41.070295 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e9a8d7db-91c4-4771-8161-a46e0f86683a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.086832 Jan 22 21:08:41.072007 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1357/2889] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:40 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:41.090566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5a27b556-861b-4a4a-bc07-dfee8e65a282 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:41.091458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5a27b556-861b-4a4a-bc07-dfee8e65a282 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:41.100185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a27b556-861b-4a4a-bc07-dfee8e65a282 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:41.100803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a27b556-861b-4a4a-bc07-dfee8e65a282 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:41.101740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a27b556-861b-4a4a-bc07-dfee8e65a282 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:41.102258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a27b556-861b-4a4a-bc07-dfee8e65a282 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:41.428086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fef96708-f062-41db-a3f5-325c7d3f0ec8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:41.428783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fef96708-f062-41db-a3f5-325c7d3f0ec8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:41.436171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fef96708-f062-41db-a3f5-325c7d3f0ec8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:41.436624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fef96708-f062-41db-a3f5-325c7d3f0ec8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:41.437415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fef96708-f062-41db-a3f5-325c7d3f0ec8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:41.438013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fef96708-f062-41db-a3f5-325c7d3f0ec8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:41.470033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5a27b556-861b-4a4a-bc07-dfee8e65a282 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:41.478368 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5a27b556-861b-4a4a-bc07-dfee8e65a282 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.391851 Jan 22 21:08:41.488701 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1533/2890] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:41 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:41.488701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3adbd477-fd6d-42f1-8ccb-36b9248000ab tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:41.488701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3adbd477-fd6d-42f1-8ccb-36b9248000ab tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:41.495272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3adbd477-fd6d-42f1-8ccb-36b9248000ab tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:41.495997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3adbd477-fd6d-42f1-8ccb-36b9248000ab tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:41.497206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3adbd477-fd6d-42f1-8ccb-36b9248000ab tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:41.498417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3adbd477-fd6d-42f1-8ccb-36b9248000ab tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:41.521986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fef96708-f062-41db-a3f5-325c7d3f0ec8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:41.530682 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fef96708-f062-41db-a3f5-325c7d3f0ec8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1248 microversion: 2.1 time: 0.106770 Jan 22 21:08:41.531271 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1358/2891] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:41 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1248 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:41.670600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3adbd477-fd6d-42f1-8ccb-36b9248000ab tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:41.679402 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3adbd477-fd6d-42f1-8ccb-36b9248000ab tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1321 microversion: 2.1 time: 0.197765 Jan 22 21:08:41.680214 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1534/2892] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:41 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:41.923399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-227e3c70-fa00-4c24-9cfe-32e967a05e28 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:41.924200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-227e3c70-fa00-4c24-9cfe-32e967a05e28 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:41.931164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-227e3c70-fa00-4c24-9cfe-32e967a05e28 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:41.935794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-227e3c70-fa00-4c24-9cfe-32e967a05e28 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:41.935794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-227e3c70-fa00-4c24-9cfe-32e967a05e28 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:41.935794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-227e3c70-fa00-4c24-9cfe-32e967a05e28 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:41.997584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-238b1b36-982f-4845-9a5f-e72d0ab9fdc1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:41.998917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-238b1b36-982f-4845-9a5f-e72d0ab9fdc1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:42.005291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-238b1b36-982f-4845-9a5f-e72d0ab9fdc1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.005823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-238b1b36-982f-4845-9a5f-e72d0ab9fdc1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:42.006626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-238b1b36-982f-4845-9a5f-e72d0ab9fdc1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.007132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-238b1b36-982f-4845-9a5f-e72d0ab9fdc1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:42.153833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-227e3c70-fa00-4c24-9cfe-32e967a05e28 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:42.161915 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-227e3c70-fa00-4c24-9cfe-32e967a05e28 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1319 microversion: 2.1 time: 0.242160 Jan 22 21:08:42.162422 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1359/2893] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:41 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:42.166762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-52e30c51-ce8c-4f18-8e36-15b073ccdf24 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:42.170879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-52e30c51-ce8c-4f18-8e36-15b073ccdf24 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:42.175751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52e30c51-ce8c-4f18-8e36-15b073ccdf24 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.176211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52e30c51-ce8c-4f18-8e36-15b073ccdf24 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:42.177007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52e30c51-ce8c-4f18-8e36-15b073ccdf24 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.177449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52e30c51-ce8c-4f18-8e36-15b073ccdf24 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:42.193731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-238b1b36-982f-4845-9a5f-e72d0ab9fdc1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:42.203864 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-238b1b36-982f-4845-9a5f-e72d0ab9fdc1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1525 microversion: 2.1 time: 0.210120 Jan 22 21:08:42.205351 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1535/2894] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:41 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1525 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:42.210779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f4e52220-1429-4460-9cf5-6a34fa5b5afd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:42.212137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f4e52220-1429-4460-9cf5-6a34fa5b5afd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:42.217734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4e52220-1429-4460-9cf5-6a34fa5b5afd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.218379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4e52220-1429-4460-9cf5-6a34fa5b5afd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:42.219363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4e52220-1429-4460-9cf5-6a34fa5b5afd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.219816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4e52220-1429-4460-9cf5-6a34fa5b5afd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:42.226927 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-52e30c51-ce8c-4f18-8e36-15b073ccdf24 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 16320 microversion: 2.1 time: 0.063226 Jan 22 21:08:42.228282 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1360/2895] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:42 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 16320 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:08:42.233249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-589f74a6-7e00-4fcc-906e-baded3d6b390 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:42.234022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-589f74a6-7e00-4fcc-906e-baded3d6b390 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:42.242112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-589f74a6-7e00-4fcc-906e-baded3d6b390 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.242903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-589f74a6-7e00-4fcc-906e-baded3d6b390 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:42.243502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-589f74a6-7e00-4fcc-906e-baded3d6b390 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.244128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-589f74a6-7e00-4fcc-906e-baded3d6b390 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:42.265691 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f4e52220-1429-4460-9cf5-6a34fa5b5afd tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.057738 Jan 22 21:08:42.266406 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1536/2896] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:42 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:42.278384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-589f74a6-7e00-4fcc-906e-baded3d6b390 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:08:42.496789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7e8518a4-b815-48c1-be55-944cfaeac602 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:42.497602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7e8518a4-b815-48c1-be55-944cfaeac602 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:42.507153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e8518a4-b815-48c1-be55-944cfaeac602 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.507684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e8518a4-b815-48c1-be55-944cfaeac602 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:42.510934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e8518a4-b815-48c1-be55-944cfaeac602 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.510934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e8518a4-b815-48c1-be55-944cfaeac602 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:42.597008 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-589f74a6-7e00-4fcc-906e-baded3d6b390 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 204 len: 0 microversion: 2.1 time: 0.367438 Jan 22 21:08:42.597861 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1361/2897] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:08:42 2022] DELETE /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:08:42.602708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2f0a5541-8ab3-4ad4-840b-08489d629574 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:42.603413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2f0a5541-8ab3-4ad4-840b-08489d629574 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:42.609565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0a5541-8ab3-4ad4-840b-08489d629574 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.610062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0a5541-8ab3-4ad4-840b-08489d629574 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:42.611641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0a5541-8ab3-4ad4-840b-08489d629574 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.611641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0a5541-8ab3-4ad4-840b-08489d629574 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:42.820795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7e8518a4-b815-48c1-be55-944cfaeac602 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:42.830178 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7e8518a4-b815-48c1-be55-944cfaeac602 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.337488 Jan 22 21:08:42.833721 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1537/2898] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:42 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:42.841063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f3f50115-7b5e-4418-8d22-daf6bbf9ae83 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:42.842012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f3f50115-7b5e-4418-8d22-daf6bbf9ae83 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:42.859211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3f50115-7b5e-4418-8d22-daf6bbf9ae83 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.861087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3f50115-7b5e-4418-8d22-daf6bbf9ae83 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:42.863816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3f50115-7b5e-4418-8d22-daf6bbf9ae83 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.866537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3f50115-7b5e-4418-8d22-daf6bbf9ae83 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:42.886066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2f0a5541-8ab3-4ad4-840b-08489d629574 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:42.895623 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2f0a5541-8ab3-4ad4-840b-08489d629574 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1296 microversion: 2.1 time: 0.296775 Jan 22 21:08:42.896560 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1362/2899] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:42 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1296 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:42.911161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-65720631-6e4d-4f84-a326-b5b89dc362cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:42.912069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-65720631-6e4d-4f84-a326-b5b89dc362cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:42.921475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65720631-6e4d-4f84-a326-b5b89dc362cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.921966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65720631-6e4d-4f84-a326-b5b89dc362cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:42.922837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65720631-6e4d-4f84-a326-b5b89dc362cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:42.923380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65720631-6e4d-4f84-a326-b5b89dc362cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:43.193687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f3f50115-7b5e-4418-8d22-daf6bbf9ae83 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:43.202273 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f3f50115-7b5e-4418-8d22-daf6bbf9ae83 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1531 microversion: 2.1 time: 0.367340 Jan 22 21:08:43.203192 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1538/2900] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:42 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1531 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:43.220182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0ed2e9c2-4079-4e5e-ab72-ef38652ec81b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:43.224961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0ed2e9c2-4079-4e5e-ab72-ef38652ec81b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:43.228858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ed2e9c2-4079-4e5e-ab72-ef38652ec81b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:43.229532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ed2e9c2-4079-4e5e-ab72-ef38652ec81b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:43.230153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ed2e9c2-4079-4e5e-ab72-ef38652ec81b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:43.230603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ed2e9c2-4079-4e5e-ab72-ef38652ec81b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:43.265167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-65720631-6e4d-4f84-a326-b5b89dc362cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:43.276517 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-65720631-6e4d-4f84-a326-b5b89dc362cd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1321 microversion: 2.1 time: 0.378681 Jan 22 21:08:43.277249 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1363/2901] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:42 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:43.286837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5af268fe-a8af-4813-8a63-24af87d5a81e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:43.286837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5af268fe-a8af-4813-8a63-24af87d5a81e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:43.289439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5af268fe-a8af-4813-8a63-24af87d5a81e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:43.289929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5af268fe-a8af-4813-8a63-24af87d5a81e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:43.290724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5af268fe-a8af-4813-8a63-24af87d5a81e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:43.291159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5af268fe-a8af-4813-8a63-24af87d5a81e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:43.335113 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5af268fe-a8af-4813-8a63-24af87d5a81e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 16320 microversion: 2.1 time: 0.056229 Jan 22 21:08:43.335966 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1364/2902] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:43 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 16320 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:08:43.340854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6248855a-8b79-41a2-bfe7-ea1ac1c0ce9a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:43.341895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6248855a-8b79-41a2-bfe7-ea1ac1c0ce9a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:43.354685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6248855a-8b79-41a2-bfe7-ea1ac1c0ce9a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:43.355101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6248855a-8b79-41a2-bfe7-ea1ac1c0ce9a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:43.356603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6248855a-8b79-41a2-bfe7-ea1ac1c0ce9a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:43.357100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6248855a-8b79-41a2-bfe7-ea1ac1c0ce9a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:43.410078 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6248855a-8b79-41a2-bfe7-ea1ac1c0ce9a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.072391 Jan 22 21:08:43.411830 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1365/2903] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:43 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:43.428454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0ed2e9c2-4079-4e5e-ab72-ef38652ec81b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:43.440218 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0ed2e9c2-4079-4e5e-ab72-ef38652ec81b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1319 microversion: 2.1 time: 0.224784 Jan 22 21:08:43.440218 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1539/2904] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:43 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:43.851969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-728c87f3-d790-4e09-b570-f8e810acb5ce tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:43.852813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-728c87f3-d790-4e09-b570-f8e810acb5ce tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:43.861515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-728c87f3-d790-4e09-b570-f8e810acb5ce tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:43.862712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-728c87f3-d790-4e09-b570-f8e810acb5ce tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:43.863652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-728c87f3-d790-4e09-b570-f8e810acb5ce tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:43.864208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-728c87f3-d790-4e09-b570-f8e810acb5ce tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:43.919796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3810c09e-93e0-43e8-ae4a-a978603b1b9e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:43.920824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3810c09e-93e0-43e8-ae4a-a978603b1b9e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:43.928945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3810c09e-93e0-43e8-ae4a-a978603b1b9e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:43.934821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3810c09e-93e0-43e8-ae4a-a978603b1b9e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:43.934821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3810c09e-93e0-43e8-ae4a-a978603b1b9e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:43.934821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3810c09e-93e0-43e8-ae4a-a978603b1b9e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:44.088861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3810c09e-93e0-43e8-ae4a-a978603b1b9e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:44.091408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-728c87f3-d790-4e09-b570-f8e810acb5ce tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:44.099180 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3810c09e-93e0-43e8-ae4a-a978603b1b9e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1296 microversion: 2.1 time: 0.183252 Jan 22 21:08:44.104408 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-728c87f3-d790-4e09-b570-f8e810acb5ce tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.252637 Jan 22 21:08:44.104408 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1366/2905] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:43 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:44.105270 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1540/2906] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:43 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1296 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:44.226524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-219bc062-494a-4648-a657-a0f5f80c35c8 req-8c294ff4-109f-459d-88fc-19e2c60f9865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39f36bf0-d956-467f-9f13-4efbcae13cad", "tag": "cb951044-bc3b-42bb-b7fc-24d5993fe2a9"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:44.228941 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:44.228941 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:44.243382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3a975a4f-0d1e-4893-8373-49e966d95e3d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:44.243981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3a975a4f-0d1e-4893-8373-49e966d95e3d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:44.246143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-219bc062-494a-4648-a657-a0f5f80c35c8 req-8c294ff4-109f-459d-88fc-19e2c60f9865 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:44.247818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-219bc062-494a-4648-a657-a0f5f80c35c8 req-8c294ff4-109f-459d-88fc-19e2c60f9865 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:44.257676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a975a4f-0d1e-4893-8373-49e966d95e3d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:44.259172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a975a4f-0d1e-4893-8373-49e966d95e3d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:44.261588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a975a4f-0d1e-4893-8373-49e966d95e3d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:44.262077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a975a4f-0d1e-4893-8373-49e966d95e3d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:44.272260 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-219bc062-494a-4648-a657-a0f5f80c35c8 req-8c294ff4-109f-459d-88fc-19e2c60f9865 service nova] Creating event network-changed:cb951044-bc3b-42bb-b7fc-24d5993fe2a9 for instance 39f36bf0-d956-467f-9f13-4efbcae13cad on nch2-master-1 Jan 22 21:08:44.284437 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-219bc062-494a-4648-a657-a0f5f80c35c8 req-8c294ff4-109f-459d-88fc-19e2c60f9865 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063877 Jan 22 21:08:44.285229 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1541/2907] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:44.295666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c1294eaa-0aa1-45b1-936c-08a7979b3f41 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:44.298727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c1294eaa-0aa1-45b1-936c-08a7979b3f41 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:44.306096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1294eaa-0aa1-45b1-936c-08a7979b3f41 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:44.306829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1294eaa-0aa1-45b1-936c-08a7979b3f41 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:44.307959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1294eaa-0aa1-45b1-936c-08a7979b3f41 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:44.308569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1294eaa-0aa1-45b1-936c-08a7979b3f41 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:44.480886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c1294eaa-0aa1-45b1-936c-08a7979b3f41 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:44.489359 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c1294eaa-0aa1-45b1-936c-08a7979b3f41 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1321 microversion: 2.1 time: 0.198076 Jan 22 21:08:44.500377 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1542/2908] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:44 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:44.506745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e788b60-daa0-4014-9519-4476a454dc42 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:44.508028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e788b60-daa0-4014-9519-4476a454dc42 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:44.515018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e788b60-daa0-4014-9519-4476a454dc42 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:44.515714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e788b60-daa0-4014-9519-4476a454dc42 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:44.516847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e788b60-daa0-4014-9519-4476a454dc42 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:44.518232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e788b60-daa0-4014-9519-4476a454dc42 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:44.573832 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e788b60-daa0-4014-9519-4476a454dc42 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 16320 microversion: 2.1 time: 0.071383 Jan 22 21:08:44.582953 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1543/2909] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:44 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 16320 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:08:44.590803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d4a26e45-1970-4d2b-a4c8-b6cb501afcbe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:44.596499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d4a26e45-1970-4d2b-a4c8-b6cb501afcbe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:44.603760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4a26e45-1970-4d2b-a4c8-b6cb501afcbe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:44.605721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4a26e45-1970-4d2b-a4c8-b6cb501afcbe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:44.605721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4a26e45-1970-4d2b-a4c8-b6cb501afcbe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:44.605721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4a26e45-1970-4d2b-a4c8-b6cb501afcbe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:44.613350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3a975a4f-0d1e-4893-8373-49e966d95e3d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:44.622568 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3a975a4f-0d1e-4893-8373-49e966d95e3d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1531 microversion: 2.1 time: 0.405170 Jan 22 21:08:44.626189 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1367/2910] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:44 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1531 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:44.639276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab1b5daa-f19b-4cf9-bbf5-a841fc4fe2e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:44.640171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab1b5daa-f19b-4cf9-bbf5-a841fc4fe2e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:44.649969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab1b5daa-f19b-4cf9-bbf5-a841fc4fe2e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:44.651319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab1b5daa-f19b-4cf9-bbf5-a841fc4fe2e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:44.659309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab1b5daa-f19b-4cf9-bbf5-a841fc4fe2e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:44.659817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab1b5daa-f19b-4cf9-bbf5-a841fc4fe2e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:44.684711 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d4a26e45-1970-4d2b-a4c8-b6cb501afcbe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.100153 Jan 22 21:08:44.685786 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1544/2911] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:44 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:45.117946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-871de607-d20c-4095-ae07-ef42f2404496 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:45.119088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-871de607-d20c-4095-ae07-ef42f2404496 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:45.129935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-871de607-d20c-4095-ae07-ef42f2404496 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:45.133537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-871de607-d20c-4095-ae07-ef42f2404496 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:45.133537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-871de607-d20c-4095-ae07-ef42f2404496 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:45.133537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-871de607-d20c-4095-ae07-ef42f2404496 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:45.315252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-871de607-d20c-4095-ae07-ef42f2404496 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:45.324111 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-871de607-d20c-4095-ae07-ef42f2404496 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1296 microversion: 2.1 time: 0.210783 Jan 22 21:08:45.326777 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1545/2912] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:45 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1296 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:45.332524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-139b2ab2-7125-4b70-8b7a-8ce931cb4b4f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:45.333227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-139b2ab2-7125-4b70-8b7a-8ce931cb4b4f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:45.343344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-139b2ab2-7125-4b70-8b7a-8ce931cb4b4f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:45.343344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-139b2ab2-7125-4b70-8b7a-8ce931cb4b4f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:45.343344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-139b2ab2-7125-4b70-8b7a-8ce931cb4b4f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:45.343344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-139b2ab2-7125-4b70-8b7a-8ce931cb4b4f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:45.442588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab1b5daa-f19b-4cf9-bbf5-a841fc4fe2e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:45.451902 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab1b5daa-f19b-4cf9-bbf5-a841fc4fe2e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1319 microversion: 2.1 time: 0.823472 Jan 22 21:08:45.463888 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1368/2913] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:44 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1319 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:45.516690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dfdc60f2-2c3c-4545-98a7-a0d7786a054f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:45.518026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dfdc60f2-2c3c-4545-98a7-a0d7786a054f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:45.524678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfdc60f2-2c3c-4545-98a7-a0d7786a054f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:45.525330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-139b2ab2-7125-4b70-8b7a-8ce931cb4b4f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:45.525492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfdc60f2-2c3c-4545-98a7-a0d7786a054f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:45.526986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfdc60f2-2c3c-4545-98a7-a0d7786a054f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:45.527615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfdc60f2-2c3c-4545-98a7-a0d7786a054f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:45.536653 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-139b2ab2-7125-4b70-8b7a-8ce931cb4b4f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.208399 Jan 22 21:08:45.537376 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1546/2914] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:45 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:45.586121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e5216f8-061c-4339-a975-b558a0e05f6f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:45.587029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e5216f8-061c-4339-a975-b558a0e05f6f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:45.593220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e5216f8-061c-4339-a975-b558a0e05f6f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:45.593829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e5216f8-061c-4339-a975-b558a0e05f6f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:45.594636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e5216f8-061c-4339-a975-b558a0e05f6f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:45.595217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e5216f8-061c-4339-a975-b558a0e05f6f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:45.644743 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e5216f8-061c-4339-a975-b558a0e05f6f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 16320 microversion: 2.1 time: 0.062748 Jan 22 21:08:45.648174 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1547/2915] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:45 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 16320 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:08:45.650450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a954bab9-f581-4c56-9404-974e2b9fbaa7 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:45.651135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a954bab9-f581-4c56-9404-974e2b9fbaa7 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:45.658412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a954bab9-f581-4c56-9404-974e2b9fbaa7 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:45.658864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a954bab9-f581-4c56-9404-974e2b9fbaa7 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:45.659701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a954bab9-f581-4c56-9404-974e2b9fbaa7 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:45.660181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a954bab9-f581-4c56-9404-974e2b9fbaa7 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:45.796687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a954bab9-f581-4c56-9404-974e2b9fbaa7 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:45.806790 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a954bab9-f581-4c56-9404-974e2b9fbaa7 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1531 microversion: 2.1 time: 0.160000 Jan 22 21:08:45.807581 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1548/2916] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:45 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1531 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:45.812178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-026527b0-b080-4c8e-8395-d06e847d1b90 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:45.813543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-026527b0-b080-4c8e-8395-d06e847d1b90 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:45.819752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-026527b0-b080-4c8e-8395-d06e847d1b90 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:45.825903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-026527b0-b080-4c8e-8395-d06e847d1b90 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:45.825903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-026527b0-b080-4c8e-8395-d06e847d1b90 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:45.825903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-026527b0-b080-4c8e-8395-d06e847d1b90 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:45.871719 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-026527b0-b080-4c8e-8395-d06e847d1b90 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.062726 Jan 22 21:08:45.876117 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1549/2917] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:45 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:46.099641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dfdc60f2-2c3c-4545-98a7-a0d7786a054f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:46.109292 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dfdc60f2-2c3c-4545-98a7-a0d7786a054f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1321 microversion: 2.1 time: 0.596684 Jan 22 21:08:46.125047 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1369/2918] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:45 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1321 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:46.344334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fd21044c-4c76-4e59-ab03-856684723f70 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:46.346081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fd21044c-4c76-4e59-ab03-856684723f70 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:46.353319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd21044c-4c76-4e59-ab03-856684723f70 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:46.353736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd21044c-4c76-4e59-ab03-856684723f70 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:46.354552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd21044c-4c76-4e59-ab03-856684723f70 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:46.354995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd21044c-4c76-4e59-ab03-856684723f70 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:46.467342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-e40b36b1-6ef9-4365-80c6-9b342065c925 req-c0832f76-28cf-4d3c-ae52-f00ce74d0449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e", "name": "network-vif-deleted", "tag": "f2b7b652-2610-49b6-a2c0-0b3e6c51fd86"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:46.469263 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:46.469263 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:46.478940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e40b36b1-6ef9-4365-80c6-9b342065c925 req-c0832f76-28cf-4d3c-ae52-f00ce74d0449 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:46.487956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e40b36b1-6ef9-4365-80c6-9b342065c925 req-c0832f76-28cf-4d3c-ae52-f00ce74d0449 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:46.490849 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-e40b36b1-6ef9-4365-80c6-9b342065c925 req-c0832f76-28cf-4d3c-ae52-f00ce74d0449 service nova] Creating event network-vif-deleted:f2b7b652-2610-49b6-a2c0-0b3e6c51fd86 for instance c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e on nch1-master-1 Jan 22 21:08:46.495694 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-e40b36b1-6ef9-4365-80c6-9b342065c925 req-c0832f76-28cf-4d3c-ae52-f00ce74d0449 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032229 Jan 22 21:08:46.496359 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1370/2919] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:08:46.501208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b1cbd43c-fb03-4135-b4a0-7bb167c1a2ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:46.501939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b1cbd43c-fb03-4135-b4a0-7bb167c1a2ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:46.508135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1cbd43c-fb03-4135-b4a0-7bb167c1a2ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:46.508531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1cbd43c-fb03-4135-b4a0-7bb167c1a2ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:46.509322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1cbd43c-fb03-4135-b4a0-7bb167c1a2ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:46.509786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1cbd43c-fb03-4135-b4a0-7bb167c1a2ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:46.642570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fd21044c-4c76-4e59-ab03-856684723f70 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:46.650420 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fd21044c-4c76-4e59-ab03-856684723f70 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1296 microversion: 2.1 time: 0.310079 Jan 22 21:08:46.652542 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1550/2920] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:46 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1296 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:46.657477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a8ad7b57-6d41-4f1b-b2c0-7d8338817423 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:46.658450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a8ad7b57-6d41-4f1b-b2c0-7d8338817423 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:46.664821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8ad7b57-6d41-4f1b-b2c0-7d8338817423 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:46.666051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8ad7b57-6d41-4f1b-b2c0-7d8338817423 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:46.667271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8ad7b57-6d41-4f1b-b2c0-7d8338817423 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:46.667921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8ad7b57-6d41-4f1b-b2c0-7d8338817423 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:46.671491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b1cbd43c-fb03-4135-b4a0-7bb167c1a2ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:46.684501 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b1cbd43c-fb03-4135-b4a0-7bb167c1a2ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1319 microversion: 2.1 time: 0.186941 Jan 22 21:08:46.685221 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1371/2921] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:46 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:46.690289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2a9a8fa6-1d5f-42cc-bd05-5aaceb0533d9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:46.691456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2a9a8fa6-1d5f-42cc-bd05-5aaceb0533d9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:46.698313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a9a8fa6-1d5f-42cc-bd05-5aaceb0533d9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:46.699089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a9a8fa6-1d5f-42cc-bd05-5aaceb0533d9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:46.700249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a9a8fa6-1d5f-42cc-bd05-5aaceb0533d9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:46.700696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a9a8fa6-1d5f-42cc-bd05-5aaceb0533d9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:46.759292 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2a9a8fa6-1d5f-42cc-bd05-5aaceb0533d9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.072886 Jan 22 21:08:46.761631 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1372/2922] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:46 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:08:46.827758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-018e451f-f6b1-4baf-9c34-eb7ba26c5f0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:46.829069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-018e451f-f6b1-4baf-9c34-eb7ba26c5f0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:46.837361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-018e451f-f6b1-4baf-9c34-eb7ba26c5f0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:46.837923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-018e451f-f6b1-4baf-9c34-eb7ba26c5f0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:46.838727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-018e451f-f6b1-4baf-9c34-eb7ba26c5f0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:46.839235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-018e451f-f6b1-4baf-9c34-eb7ba26c5f0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:46.880819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-018e451f-f6b1-4baf-9c34-eb7ba26c5f0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:46.881581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-018e451f-f6b1-4baf-9c34-eb7ba26c5f0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:46.882068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-018e451f-f6b1-4baf-9c34-eb7ba26c5f0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lazy-loading 'fault' on Instance uuid c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:08:46.892626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a8ad7b57-6d41-4f1b-b2c0-7d8338817423 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:46.901277 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a8ad7b57-6d41-4f1b-b2c0-7d8338817423 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1479 microversion: 2.1 time: 0.247407 Jan 22 21:08:46.903126 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1551/2923] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:46 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1479 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:46.909148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5eb7a10d-612a-42c9-a560-32360d596872 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:46.912855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5eb7a10d-612a-42c9-a560-32360d596872 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:46.916938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eb7a10d-612a-42c9-a560-32360d596872 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:46.917339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eb7a10d-612a-42c9-a560-32360d596872 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:46.918376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eb7a10d-612a-42c9-a560-32360d596872 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:46.919454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eb7a10d-612a-42c9-a560-32360d596872 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:46.940785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-018e451f-f6b1-4baf-9c34-eb7ba26c5f0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:46.955489 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-018e451f-f6b1-4baf-9c34-eb7ba26c5f0f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 200 len: 1318 microversion: 2.1 time: 0.131541 Jan 22 21:08:46.961191 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1373/2924] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:46 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:46.999232 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5eb7a10d-612a-42c9-a560-32360d596872 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.094573 Jan 22 21:08:47.004746 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1552/2925] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:46 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:47.127258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c0439a54-bfc8-49dc-8fee-45a276f9cc04 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:47.127854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c0439a54-bfc8-49dc-8fee-45a276f9cc04 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:47.135505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0439a54-bfc8-49dc-8fee-45a276f9cc04 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:47.135964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0439a54-bfc8-49dc-8fee-45a276f9cc04 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:47.136716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0439a54-bfc8-49dc-8fee-45a276f9cc04 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:47.137349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0439a54-bfc8-49dc-8fee-45a276f9cc04 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:47.338220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c0439a54-bfc8-49dc-8fee-45a276f9cc04 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:47.346655 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c0439a54-bfc8-49dc-8fee-45a276f9cc04 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1321 microversion: 2.1 time: 0.223319 Jan 22 21:08:47.347541 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1374/2926] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:47 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:47.669555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8d53b32e-c727-45d3-a912-a36b3e0ab602 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:47.670916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8d53b32e-c727-45d3-a912-a36b3e0ab602 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:47.684393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d53b32e-c727-45d3-a912-a36b3e0ab602 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:47.684867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d53b32e-c727-45d3-a912-a36b3e0ab602 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:47.685720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d53b32e-c727-45d3-a912-a36b3e0ab602 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:47.686166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d53b32e-c727-45d3-a912-a36b3e0ab602 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:47.694854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-8a01dc87-f1c7-4b0d-8408-c6004688583c req-9732ebad-efc4-4c1c-aeca-0dcb6543cf89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7699c318-de81-4990-8d4a-526d1c46b578", "name": "network-vif-plugged", "status": "completed", "tag": "8e6c07ec-a3ec-44ca-92fa-3cf11dda20f2"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:47.697494 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:47.697494 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:47.707164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8a01dc87-f1c7-4b0d-8408-c6004688583c req-9732ebad-efc4-4c1c-aeca-0dcb6543cf89 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:47.707681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8a01dc87-f1c7-4b0d-8408-c6004688583c req-9732ebad-efc4-4c1c-aeca-0dcb6543cf89 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:47.722200 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8a01dc87-f1c7-4b0d-8408-c6004688583c req-9732ebad-efc4-4c1c-aeca-0dcb6543cf89 service nova] Creating event network-vif-plugged:8e6c07ec-a3ec-44ca-92fa-3cf11dda20f2 for instance 7699c318-de81-4990-8d4a-526d1c46b578 on nch2-master-1 Jan 22 21:08:47.727432 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-8a01dc87-f1c7-4b0d-8408-c6004688583c req-9732ebad-efc4-4c1c-aeca-0dcb6543cf89 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037591 Jan 22 21:08:47.728375 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1375/2927] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:47.734571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc7f44bb-9f41-4a5a-8fef-165ad2e12a4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:47.738370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bc7f44bb-9f41-4a5a-8fef-165ad2e12a4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:47.742944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc7f44bb-9f41-4a5a-8fef-165ad2e12a4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:47.743482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc7f44bb-9f41-4a5a-8fef-165ad2e12a4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:47.744584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc7f44bb-9f41-4a5a-8fef-165ad2e12a4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:47.745087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc7f44bb-9f41-4a5a-8fef-165ad2e12a4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:48.009720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bc7f44bb-9f41-4a5a-8fef-165ad2e12a4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:48.018803 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bc7f44bb-9f41-4a5a-8fef-165ad2e12a4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1319 microversion: 2.1 time: 0.288888 Jan 22 21:08:48.029693 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1376/2928] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:47 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:48.029693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-abf8fecc-5ffe-4ae2-a3ff-d7992accfd70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:48.029693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-abf8fecc-5ffe-4ae2-a3ff-d7992accfd70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:48.032453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abf8fecc-5ffe-4ae2-a3ff-d7992accfd70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:48.033191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abf8fecc-5ffe-4ae2-a3ff-d7992accfd70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:48.034272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abf8fecc-5ffe-4ae2-a3ff-d7992accfd70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:48.034790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abf8fecc-5ffe-4ae2-a3ff-d7992accfd70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:48.085988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8d53b32e-c727-45d3-a912-a36b3e0ab602 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:48.094086 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8d53b32e-c727-45d3-a912-a36b3e0ab602 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1296 microversion: 2.1 time: 0.428709 Jan 22 21:08:48.094749 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1553/2929] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:47 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1296 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:48.099691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d5d11b13-8b5b-422e-86c4-1d9039cfe6c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:48.100558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d5d11b13-8b5b-422e-86c4-1d9039cfe6c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:48.106870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5d11b13-8b5b-422e-86c4-1d9039cfe6c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:48.107421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5d11b13-8b5b-422e-86c4-1d9039cfe6c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:48.108216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5d11b13-8b5b-422e-86c4-1d9039cfe6c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:48.108658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5d11b13-8b5b-422e-86c4-1d9039cfe6c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:48.257253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d5d11b13-8b5b-422e-86c4-1d9039cfe6c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:48.265720 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d5d11b13-8b5b-422e-86c4-1d9039cfe6c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1478 microversion: 2.1 time: 0.169265 Jan 22 21:08:48.266389 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1554/2930] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:48 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1478 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:48.272739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6fcc644-a524-4c51-aaa9-ae6c351187bc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:48.273907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b6fcc644-a524-4c51-aaa9-ae6c351187bc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:48.279149 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-abf8fecc-5ffe-4ae2-a3ff-d7992accfd70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.257383 Jan 22 21:08:48.280201 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1377/2931] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:48 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:08:48.285397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6fcc644-a524-4c51-aaa9-ae6c351187bc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:48.285962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6fcc644-a524-4c51-aaa9-ae6c351187bc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:48.286843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6fcc644-a524-4c51-aaa9-ae6c351187bc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:48.287366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6fcc644-a524-4c51-aaa9-ae6c351187bc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:48.287483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a99b8a5a-fdb4-4269-bd29-50dbe47e23f3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:48.288642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a99b8a5a-fdb4-4269-bd29-50dbe47e23f3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:48.295669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a99b8a5a-fdb4-4269-bd29-50dbe47e23f3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:48.296639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a99b8a5a-fdb4-4269-bd29-50dbe47e23f3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:48.297816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a99b8a5a-fdb4-4269-bd29-50dbe47e23f3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:48.299047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a99b8a5a-fdb4-4269-bd29-50dbe47e23f3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:48.303860 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-b6fcc644-a524-4c51-aaa9-ae6c351187bc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] HTTP exception thrown: Instance c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e could not be found. Jan 22 21:08:48.304561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6fcc644-a524-4c51-aaa9-ae6c351187bc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Returning 404 to user: Instance c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:08:48.305483 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b6fcc644-a524-4c51-aaa9-ae6c351187bc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 404 len: 111 microversion: 2.1 time: 0.036754 Jan 22 21:08:48.306467 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1555/2932] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:48 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:08:48.353688 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a99b8a5a-fdb4-4269-bd29-50dbe47e23f3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.071730 Jan 22 21:08:48.354441 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1378/2933] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:48 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:48.365369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cb60d995-f8c1-4482-b0f0-85e7d378282e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:48.366042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cb60d995-f8c1-4482-b0f0-85e7d378282e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:48.381821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb60d995-f8c1-4482-b0f0-85e7d378282e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:48.382731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb60d995-f8c1-4482-b0f0-85e7d378282e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:48.383599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb60d995-f8c1-4482-b0f0-85e7d378282e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:48.392549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb60d995-f8c1-4482-b0f0-85e7d378282e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:48.439870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1409380262", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:48.518167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] validate_networks() for [('7ce76187-2d78-4b40-aca9-2d20e9d4107b', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:08:48.574245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cb60d995-f8c1-4482-b0f0-85e7d378282e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:48.582931 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cb60d995-f8c1-4482-b0f0-85e7d378282e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1321 microversion: 2.1 time: 0.222221 Jan 22 21:08:48.583706 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1556/2934] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:48 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:48.953769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-d33f54f6-c676-4ddf-a8a4-57e199f683a1 req-ba7d1c93-d51c-4395-a4c1-5179cc2dd584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd923b09-9a4a-4371-8e4e-044fd3787b72", "name": "network-vif-unplugged", "status": "completed", "tag": "b5da264d-bc7c-4452-b54d-69a739e13c9f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:48.956735 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:48.956735 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:48.967191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d33f54f6-c676-4ddf-a8a4-57e199f683a1 req-ba7d1c93-d51c-4395-a4c1-5179cc2dd584 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:48.967652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d33f54f6-c676-4ddf-a8a4-57e199f683a1 req-ba7d1c93-d51c-4395-a4c1-5179cc2dd584 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:48.982822 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d33f54f6-c676-4ddf-a8a4-57e199f683a1 req-ba7d1c93-d51c-4395-a4c1-5179cc2dd584 service nova] Creating event network-vif-unplugged:b5da264d-bc7c-4452-b54d-69a739e13c9f for instance dd923b09-9a4a-4371-8e4e-044fd3787b72 on nch2-master-1 Jan 22 21:08:48.993809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-d33f54f6-c676-4ddf-a8a4-57e199f683a1 req-ba7d1c93-d51c-4395-a4c1-5179cc2dd584 service nova] Instance dd923b09-9a4a-4371-8e4e-044fd3787b72 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:08:49.009724 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-d33f54f6-c676-4ddf-a8a4-57e199f683a1 req-ba7d1c93-d51c-4395-a4c1-5179cc2dd584 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067088 Jan 22 21:08:49.009724 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1557/2935] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:08:49.037559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-55bd896b-1440-4ce3-9910-3d834ff1fc11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:49.038270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-55bd896b-1440-4ce3-9910-3d834ff1fc11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:49.044487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55bd896b-1440-4ce3-9910-3d834ff1fc11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:49.044950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55bd896b-1440-4ce3-9910-3d834ff1fc11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:49.045849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55bd896b-1440-4ce3-9910-3d834ff1fc11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:49.046296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55bd896b-1440-4ce3-9910-3d834ff1fc11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:49.169862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:08:49.170963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:08:49.171692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:08:49.172217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:08:49.172751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:08:49.185407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:49.186037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:49.187218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:49.187773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:49.211277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Getting quotas for project bfedf205c9e44aa1989b307d2b400b50. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:49.217149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Getting quotas for user e63df9a38aaf47338df65d3bf0d5aa81 and project bfedf205c9e44aa1989b307d2b400b50. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:49.235134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:08:49.239388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:08:49.387974 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-53bd3db3-36ed-49de-b3a7-b2cf57563b48 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 0.952652 Jan 22 21:08:49.404803 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1379/2936] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:08:48 2022] POST /compute/v2.1/servers => generated 385 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:08:49.425973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-93e9b022-c52f-4910-a003-9a97ba9f519d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:49.430585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-93e9b022-c52f-4910-a003-9a97ba9f519d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:49.467820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93e9b022-c52f-4910-a003-9a97ba9f519d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:49.476673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93e9b022-c52f-4910-a003-9a97ba9f519d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:49.483393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93e9b022-c52f-4910-a003-9a97ba9f519d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:49.488536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93e9b022-c52f-4910-a003-9a97ba9f519d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:49.687308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-55bd896b-1440-4ce3-9910-3d834ff1fc11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:49.703333 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-55bd896b-1440-4ce3-9910-3d834ff1fc11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1319 microversion: 2.1 time: 0.670588 Jan 22 21:08:49.705270 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1558/2937] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:49 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1319 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:49.711941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-46ae8a72-a906-4abf-9b7b-a617b5a49b39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:49.713064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-46ae8a72-a906-4abf-9b7b-a617b5a49b39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:49.738327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46ae8a72-a906-4abf-9b7b-a617b5a49b39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:49.738922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46ae8a72-a906-4abf-9b7b-a617b5a49b39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:49.739786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46ae8a72-a906-4abf-9b7b-a617b5a49b39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:49.740244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46ae8a72-a906-4abf-9b7b-a617b5a49b39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:49.865557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-93e9b022-c52f-4910-a003-9a97ba9f519d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:49.879990 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-93e9b022-c52f-4910-a003-9a97ba9f519d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1296 microversion: 2.1 time: 0.465148 Jan 22 21:08:49.880601 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1380/2938] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:49 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1296 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:49.893572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-678b3c57-68e9-4981-ba7b-d8c7502f66f6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:49.896114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-678b3c57-68e9-4981-ba7b-d8c7502f66f6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:49.904532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-678b3c57-68e9-4981-ba7b-d8c7502f66f6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:49.906089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-678b3c57-68e9-4981-ba7b-d8c7502f66f6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:49.907138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-678b3c57-68e9-4981-ba7b-d8c7502f66f6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:49.907761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-678b3c57-68e9-4981-ba7b-d8c7502f66f6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:49.963575 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-678b3c57-68e9-4981-ba7b-d8c7502f66f6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.080636 Jan 22 21:08:49.967505 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1381/2939] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:49 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:08:49.976983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-333691a3-be36-4c16-a46b-4b6b01d45c96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:49.978263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-333691a3-be36-4c16-a46b-4b6b01d45c96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:49.990304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-333691a3-be36-4c16-a46b-4b6b01d45c96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:49.991058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-333691a3-be36-4c16-a46b-4b6b01d45c96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:49.992053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-333691a3-be36-4c16-a46b-4b6b01d45c96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:49.992770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-333691a3-be36-4c16-a46b-4b6b01d45c96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:50.034360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-46ae8a72-a906-4abf-9b7b-a617b5a49b39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:50.042170 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-46ae8a72-a906-4abf-9b7b-a617b5a49b39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1478 microversion: 2.1 time: 0.335518 Jan 22 21:08:50.042751 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1559/2940] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:49 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1478 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:50.048588 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-333691a3-be36-4c16-a46b-4b6b01d45c96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.076968 Jan 22 21:08:50.049231 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1382/2941] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:49 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:50.054660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a1ca726e-fb91-46bc-b087-aa87b9931f13 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:50.055287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a1ca726e-fb91-46bc-b087-aa87b9931f13 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:50.060453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c32b62a9-504b-43fd-ad62-f8ba92018aa6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:50.061485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c32b62a9-504b-43fd-ad62-f8ba92018aa6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:50.072913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c32b62a9-504b-43fd-ad62-f8ba92018aa6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:50.073683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c32b62a9-504b-43fd-ad62-f8ba92018aa6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:50.074978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c32b62a9-504b-43fd-ad62-f8ba92018aa6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:50.075595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c32b62a9-504b-43fd-ad62-f8ba92018aa6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:50.128684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a1ca726e-fb91-46bc-b087-aa87b9931f13 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:50.138209 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a1ca726e-fb91-46bc-b087-aa87b9931f13 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1229 microversion: 2.1 time: 0.093210 Jan 22 21:08:50.150485 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1560/2942] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:50 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:50.156870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-c17e7ade-7a0c-46a6-a6de-9c6a8c372d9d req-a5d449ed-c610-4486-b0fb-6d8a53024058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b2aed8-f03f-4c04-b508-cc9a7e172dd6", "name": "network-vif-plugged", "status": "completed", "tag": "99dd6838-12b2-4c2b-b219-2af5c1a44a74"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:50.159916 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:50.159916 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:50.170014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c17e7ade-7a0c-46a6-a6de-9c6a8c372d9d req-a5d449ed-c610-4486-b0fb-6d8a53024058 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:50.170534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c17e7ade-7a0c-46a6-a6de-9c6a8c372d9d req-a5d449ed-c610-4486-b0fb-6d8a53024058 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:50.183497 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-c17e7ade-7a0c-46a6-a6de-9c6a8c372d9d req-a5d449ed-c610-4486-b0fb-6d8a53024058 service nova] Creating event network-vif-plugged:99dd6838-12b2-4c2b-b219-2af5c1a44a74 for instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 on nch2-master-1 Jan 22 21:08:50.189238 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-c17e7ade-7a0c-46a6-a6de-9c6a8c372d9d req-a5d449ed-c610-4486-b0fb-6d8a53024058 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037121 Jan 22 21:08:50.190628 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1561/2943] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:50.406202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c32b62a9-504b-43fd-ad62-f8ba92018aa6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:50.415162 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c32b62a9-504b-43fd-ad62-f8ba92018aa6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1471 microversion: 2.1 time: 0.364732 Jan 22 21:08:50.416329 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1383/2944] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:50 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1471 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:50.433717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-44d5f37a-3a6c-46c1-96b3-0640904099ba tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:50.434526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-44d5f37a-3a6c-46c1-96b3-0640904099ba tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:50.443254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44d5f37a-3a6c-46c1-96b3-0640904099ba tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:50.444188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44d5f37a-3a6c-46c1-96b3-0640904099ba tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:50.444538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44d5f37a-3a6c-46c1-96b3-0640904099ba tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:50.444989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44d5f37a-3a6c-46c1-96b3-0640904099ba tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:50.722509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-443162f9-1272-4612-930b-19501a30387b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:50.723044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-443162f9-1272-4612-930b-19501a30387b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:50.729659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-443162f9-1272-4612-930b-19501a30387b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:50.730118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-443162f9-1272-4612-930b-19501a30387b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:50.730911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-443162f9-1272-4612-930b-19501a30387b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:50.731358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-443162f9-1272-4612-930b-19501a30387b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:50.758884 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-44d5f37a-3a6c-46c1-96b3-0640904099ba tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1622 microversion: 2.1 time: 0.330048 Jan 22 21:08:50.759888 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1562/2945] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:50 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1622 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:50.894524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2029221182", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["7eef2b3f-a335-4858-b070-58323035fc67"]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:50.905995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-443162f9-1272-4612-930b-19501a30387b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:50.914969 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-443162f9-1272-4612-930b-19501a30387b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1319 microversion: 2.1 time: 0.197012 Jan 22 21:08:50.924684 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1384/2946] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:50 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:50.929533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-12a2431b-b614-4b6d-a4bc-03615054d3e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:50.930336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-12a2431b-b614-4b6d-a4bc-03615054d3e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:50.938035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12a2431b-b614-4b6d-a4bc-03615054d3e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:50.938695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12a2431b-b614-4b6d-a4bc-03615054d3e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:50.940263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12a2431b-b614-4b6d-a4bc-03615054d3e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:50.941367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12a2431b-b614-4b6d-a4bc-03615054d3e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:50.959801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:08:51.097882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-12a2431b-b614-4b6d-a4bc-03615054d3e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:51.102077 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-12a2431b-b614-4b6d-a4bc-03615054d3e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1296 microversion: 2.1 time: 0.176122 Jan 22 21:08:51.102649 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1385/2947] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:50 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1296 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:51.107472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4bf3e050-fc92-4619-ab5b-701cfee152ca tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:51.108437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4bf3e050-fc92-4619-ab5b-701cfee152ca tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:51.115216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bf3e050-fc92-4619-ab5b-701cfee152ca tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:51.115671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bf3e050-fc92-4619-ab5b-701cfee152ca tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:51.116537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bf3e050-fc92-4619-ab5b-701cfee152ca tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:51.116981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bf3e050-fc92-4619-ab5b-701cfee152ca tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:51.160279 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4bf3e050-fc92-4619-ab5b-701cfee152ca tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.056400 Jan 22 21:08:51.163973 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1386/2948] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:51 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:08:51.165924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-bfc61d90-ebbe-4f52-8237-071a16ef8e65 req-f5e23fd0-b940-43c9-b60e-806dbd3278c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd923b09-9a4a-4371-8e4e-044fd3787b72", "tag": "b5da264d-bc7c-4452-b54d-69a739e13c9f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:51.167386 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:51.167386 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:51.175665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bfc61d90-ebbe-4f52-8237-071a16ef8e65 req-f5e23fd0-b940-43c9-b60e-806dbd3278c6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:51.176118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bfc61d90-ebbe-4f52-8237-071a16ef8e65 req-f5e23fd0-b940-43c9-b60e-806dbd3278c6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:51.188231 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-bfc61d90-ebbe-4f52-8237-071a16ef8e65 req-f5e23fd0-b940-43c9-b60e-806dbd3278c6 service nova] Creating event network-changed:b5da264d-bc7c-4452-b54d-69a739e13c9f for instance dd923b09-9a4a-4371-8e4e-044fd3787b72 on nch2-master-1 Jan 22 21:08:51.196864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-bfc61d90-ebbe-4f52-8237-071a16ef8e65 req-f5e23fd0-b940-43c9-b60e-806dbd3278c6 service nova] Instance dd923b09-9a4a-4371-8e4e-044fd3787b72 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:08:51.208020 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-bfc61d90-ebbe-4f52-8237-071a16ef8e65 req-f5e23fd0-b940-43c9-b60e-806dbd3278c6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045619 Jan 22 21:08:51.208621 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1387/2949] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:51.216626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ff9e09e-10a2-4b2b-b25b-ba79528ac98f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:51.218344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ff9e09e-10a2-4b2b-b25b-ba79528ac98f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:51.225593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ff9e09e-10a2-4b2b-b25b-ba79528ac98f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:51.226024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ff9e09e-10a2-4b2b-b25b-ba79528ac98f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:51.226840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ff9e09e-10a2-4b2b-b25b-ba79528ac98f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:51.227302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ff9e09e-10a2-4b2b-b25b-ba79528ac98f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:51.430478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:08:51.437378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:08:51.437378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:08:51.437378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:08:51.437378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:08:51.471442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:51.479996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:51.486412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:51.488692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:51.534031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:51.552339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:51.576446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:08:51.581097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:08:51.612509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8ff9e09e-10a2-4b2b-b25b-ba79528ac98f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:51.624824 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ff9e09e-10a2-4b2b-b25b-ba79528ac98f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1476 microversion: 2.1 time: 0.413375 Jan 22 21:08:51.639588 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1388/2950] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:51 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1476 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:51.654726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2288e4dd-389a-470c-9871-765c388892d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:51.654726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2288e4dd-389a-470c-9871-765c388892d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:51.659273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2288e4dd-389a-470c-9871-765c388892d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:51.659967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2288e4dd-389a-470c-9871-765c388892d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:51.660883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2288e4dd-389a-470c-9871-765c388892d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:51.661618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2288e4dd-389a-470c-9871-765c388892d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:51.716462 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2288e4dd-389a-470c-9871-765c388892d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.075120 Jan 22 21:08:51.717208 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1389/2951] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:51 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:51.722996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e0ab4f55-7486-439d-8b83-7bec93dbd434 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:51.723891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e0ab4f55-7486-439d-8b83-7bec93dbd434 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:51.731872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0ab4f55-7486-439d-8b83-7bec93dbd434 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:51.732490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0ab4f55-7486-439d-8b83-7bec93dbd434 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:51.733300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0ab4f55-7486-439d-8b83-7bec93dbd434 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:51.733947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0ab4f55-7486-439d-8b83-7bec93dbd434 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:51.781535 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ec55ea6b-7ce1-4fcb-ad13-ac75fe1ae434 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.892735 Jan 22 21:08:51.782232 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1563/2952] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:08:50 2022] POST /compute/v2.1/servers => generated 382 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:08:51.793054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-33421a7d-cca2-4c2e-8062-e445534bb3d0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:51.793959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-33421a7d-cca2-4c2e-8062-e445534bb3d0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:51.904051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-33421a7d-cca2-4c2e-8062-e445534bb3d0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:51.911893 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-33421a7d-cca2-4c2e-8062-e445534bb3d0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1221 microversion: 2.1 time: 0.123041 Jan 22 21:08:51.922667 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1564/2953] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:51 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1221 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:51.937727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2388df37-ebea-451a-b877-175635a97fed tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:51.937727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2388df37-ebea-451a-b877-175635a97fed tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:51.942585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2388df37-ebea-451a-b877-175635a97fed tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:51.943178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2388df37-ebea-451a-b877-175635a97fed tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:51.945020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2388df37-ebea-451a-b877-175635a97fed tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:51.945538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2388df37-ebea-451a-b877-175635a97fed tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:51.967799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e0ab4f55-7486-439d-8b83-7bec93dbd434 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:51.991880 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e0ab4f55-7486-439d-8b83-7bec93dbd434 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1281 microversion: 2.1 time: 0.272892 Jan 22 21:08:52.001255 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1390/2954] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:51 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1281 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:52.119002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1d256789-034e-4e0d-b757-24f8a322e9c2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:52.119787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1d256789-034e-4e0d-b757-24f8a322e9c2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:52.127965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d256789-034e-4e0d-b757-24f8a322e9c2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:52.134510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d256789-034e-4e0d-b757-24f8a322e9c2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:52.134510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d256789-034e-4e0d-b757-24f8a322e9c2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:52.134510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d256789-034e-4e0d-b757-24f8a322e9c2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:52.286166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2388df37-ebea-451a-b877-175635a97fed tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:52.297030 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2388df37-ebea-451a-b877-175635a97fed tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1319 microversion: 2.1 time: 0.368501 Jan 22 21:08:52.307349 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1565/2955] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:51 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:52.314604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ecb37d83-5820-464c-b5ce-951087291368 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:52.316415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ecb37d83-5820-464c-b5ce-951087291368 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:52.323223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ecb37d83-5820-464c-b5ce-951087291368 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:52.323760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ecb37d83-5820-464c-b5ce-951087291368 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:52.325244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ecb37d83-5820-464c-b5ce-951087291368 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:52.325244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ecb37d83-5820-464c-b5ce-951087291368 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:52.407954 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ecb37d83-5820-464c-b5ce-951087291368 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.098081 Jan 22 21:08:52.412145 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1566/2956] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:52 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:08:52.652766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-77986db3-8c2c-47a8-b7d4-4345b1af1f71 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:52.655338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-77986db3-8c2c-47a8-b7d4-4345b1af1f71 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:52.665856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77986db3-8c2c-47a8-b7d4-4345b1af1f71 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:52.666729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77986db3-8c2c-47a8-b7d4-4345b1af1f71 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:52.668066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77986db3-8c2c-47a8-b7d4-4345b1af1f71 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:52.668802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77986db3-8c2c-47a8-b7d4-4345b1af1f71 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:52.780396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1d256789-034e-4e0d-b757-24f8a322e9c2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:52.789609 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1d256789-034e-4e0d-b757-24f8a322e9c2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1296 microversion: 2.1 time: 0.674313 Jan 22 21:08:52.790876 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1391/2957] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:52 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1296 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:52.796146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-43fde5af-7a9b-4ec6-8680-2af4cf695ee5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:52.797639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-43fde5af-7a9b-4ec6-8680-2af4cf695ee5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:52.805296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43fde5af-7a9b-4ec6-8680-2af4cf695ee5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:52.805836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43fde5af-7a9b-4ec6-8680-2af4cf695ee5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:52.806893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43fde5af-7a9b-4ec6-8680-2af4cf695ee5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:52.807335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43fde5af-7a9b-4ec6-8680-2af4cf695ee5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:52.856489 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-43fde5af-7a9b-4ec6-8680-2af4cf695ee5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.061894 Jan 22 21:08:52.856489 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1392/2958] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:52 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:52.932554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-639dad3c-3421-4adf-ae2d-ae174ec431d8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:52.933352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-639dad3c-3421-4adf-ae2d-ae174ec431d8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:52.945268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-639dad3c-3421-4adf-ae2d-ae174ec431d8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:52.946047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-639dad3c-3421-4adf-ae2d-ae174ec431d8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:52.947222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-639dad3c-3421-4adf-ae2d-ae174ec431d8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:52.947680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-639dad3c-3421-4adf-ae2d-ae174ec431d8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:53.042428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-639dad3c-3421-4adf-ae2d-ae174ec431d8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:53.056855 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-639dad3c-3421-4adf-ae2d-ae174ec431d8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1225 microversion: 2.1 time: 0.130069 Jan 22 21:08:53.057879 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1393/2959] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:52 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:53.063753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a615c6ed-1327-477c-9523-f1ce18891597 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:53.064615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a615c6ed-1327-477c-9523-f1ce18891597 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:53.071882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a615c6ed-1327-477c-9523-f1ce18891597 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:53.072341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a615c6ed-1327-477c-9523-f1ce18891597 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:53.073147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a615c6ed-1327-477c-9523-f1ce18891597 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:53.073672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a615c6ed-1327-477c-9523-f1ce18891597 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:53.188349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-77986db3-8c2c-47a8-b7d4-4345b1af1f71 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:53.198505 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-77986db3-8c2c-47a8-b7d4-4345b1af1f71 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1476 microversion: 2.1 time: 0.553226 Jan 22 21:08:53.199362 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1567/2960] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:52 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1476 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:53.257302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a615c6ed-1327-477c-9523-f1ce18891597 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:53.264520 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a615c6ed-1327-477c-9523-f1ce18891597 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1287 microversion: 2.1 time: 0.205359 Jan 22 21:08:53.265099 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1394/2961] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:53 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1287 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:53.314887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5b2c3e28-c28c-4e7d-b85d-69471061db47 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:53.315497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5b2c3e28-c28c-4e7d-b85d-69471061db47 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:53.322723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b2c3e28-c28c-4e7d-b85d-69471061db47 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:53.330895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b2c3e28-c28c-4e7d-b85d-69471061db47 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:53.330895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b2c3e28-c28c-4e7d-b85d-69471061db47 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:53.330895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b2c3e28-c28c-4e7d-b85d-69471061db47 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:53.423293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1540461a-5a7e-41cc-aeb9-e1c2b8157f85 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:53.424423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1540461a-5a7e-41cc-aeb9-e1c2b8157f85 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:53.432228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1540461a-5a7e-41cc-aeb9-e1c2b8157f85 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:53.432688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1540461a-5a7e-41cc-aeb9-e1c2b8157f85 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:53.433568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1540461a-5a7e-41cc-aeb9-e1c2b8157f85 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:53.433961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1540461a-5a7e-41cc-aeb9-e1c2b8157f85 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:53.476512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5b2c3e28-c28c-4e7d-b85d-69471061db47 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:53.479305 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1540461a-5a7e-41cc-aeb9-e1c2b8157f85 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.061966 Jan 22 21:08:53.483972 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1395/2962] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:53 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:08:53.486039 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5b2c3e28-c28c-4e7d-b85d-69471061db47 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.175267 Jan 22 21:08:53.486742 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1568/2963] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:53 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:53.598263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-59486744", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "a982ac8c-3d1e-405d-b754-a70452696d1b"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:53.656039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] validate_networks() for [('a982ac8c-3d1e-405d-b754-a70452696d1b', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:08:53.807817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0b681cbf-1ec5-4760-a3c1-a21e1894710d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:53.808780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0b681cbf-1ec5-4760-a3c1-a21e1894710d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:53.815671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b681cbf-1ec5-4760-a3c1-a21e1894710d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:53.816333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b681cbf-1ec5-4760-a3c1-a21e1894710d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:53.817229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b681cbf-1ec5-4760-a3c1-a21e1894710d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:53.817827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b681cbf-1ec5-4760-a3c1-a21e1894710d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:53.957097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0b681cbf-1ec5-4760-a3c1-a21e1894710d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:53.966267 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0b681cbf-1ec5-4760-a3c1-a21e1894710d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1296 microversion: 2.1 time: 0.162091 Jan 22 21:08:53.976200 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1569/2964] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:53 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1296 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:53.981644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8c398d4e-717d-46b2-b696-fa8c8a95cd67 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:53.982638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8c398d4e-717d-46b2-b696-fa8c8a95cd67 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:53.991399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c398d4e-717d-46b2-b696-fa8c8a95cd67 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:53.992464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c398d4e-717d-46b2-b696-fa8c8a95cd67 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:53.993267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c398d4e-717d-46b2-b696-fa8c8a95cd67 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:53.993733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c398d4e-717d-46b2-b696-fa8c8a95cd67 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:54.045220 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8c398d4e-717d-46b2-b696-fa8c8a95cd67 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.066465 Jan 22 21:08:54.047116 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1570/2965] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:53 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:54.075825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-01731928-cf14-4683-82c9-b78fc5379272 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:54.077976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-01731928-cf14-4683-82c9-b78fc5379272 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:54.085211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01731928-cf14-4683-82c9-b78fc5379272 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:54.085703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01731928-cf14-4683-82c9-b78fc5379272 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:54.086508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01731928-cf14-4683-82c9-b78fc5379272 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:54.086957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01731928-cf14-4683-82c9-b78fc5379272 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:54.151167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-01731928-cf14-4683-82c9-b78fc5379272 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:54.161719 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-01731928-cf14-4683-82c9-b78fc5379272 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1273 microversion: 2.1 time: 0.090019 Jan 22 21:08:54.162313 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1571/2966] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:54 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:54.216230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1c972e7-d7a6-435b-a53a-2dfa3c5c3b6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:54.216903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1c972e7-d7a6-435b-a53a-2dfa3c5c3b6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:54.223560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1c972e7-d7a6-435b-a53a-2dfa3c5c3b6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:54.224026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1c972e7-d7a6-435b-a53a-2dfa3c5c3b6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:54.224834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1c972e7-d7a6-435b-a53a-2dfa3c5c3b6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:54.225450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1c972e7-d7a6-435b-a53a-2dfa3c5c3b6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:54.392387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1c972e7-d7a6-435b-a53a-2dfa3c5c3b6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:54.401733 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1c972e7-d7a6-435b-a53a-2dfa3c5c3b6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1476 microversion: 2.1 time: 0.189165 Jan 22 21:08:54.402542 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1572/2967] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:54 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1476 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:54.417450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f9d3003b-1e95-4eb7-a857-164fd069a95d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:54.418233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f9d3003b-1e95-4eb7-a857-164fd069a95d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:54.426433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9d3003b-1e95-4eb7-a857-164fd069a95d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:54.427010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9d3003b-1e95-4eb7-a857-164fd069a95d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:54.427877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9d3003b-1e95-4eb7-a857-164fd069a95d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:54.428385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9d3003b-1e95-4eb7-a857-164fd069a95d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:54.595397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f9d3003b-1e95-4eb7-a857-164fd069a95d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:54.603873 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f9d3003b-1e95-4eb7-a857-164fd069a95d tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1329 microversion: 2.1 time: 0.195276 Jan 22 21:08:54.604198 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1573/2968] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:54 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1329 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:54.612195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-d67bf239-2275-49e1-a283-bd89d6feeb08 req-ab037bca-d83e-46f6-b991-8d0176023a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f36bf0-d956-467f-9f13-4efbcae13cad", "name": "network-vif-plugged", "status": "completed", "tag": "cb951044-bc3b-42bb-b7fc-24d5993fe2a9"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:54.613922 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:54.613922 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:54.621192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d67bf239-2275-49e1-a283-bd89d6feeb08 req-ab037bca-d83e-46f6-b991-8d0176023a17 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:54.621777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d67bf239-2275-49e1-a283-bd89d6feeb08 req-ab037bca-d83e-46f6-b991-8d0176023a17 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:54.633572 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d67bf239-2275-49e1-a283-bd89d6feeb08 req-ab037bca-d83e-46f6-b991-8d0176023a17 service nova] Creating event network-vif-plugged:cb951044-bc3b-42bb-b7fc-24d5993fe2a9 for instance 39f36bf0-d956-467f-9f13-4efbcae13cad on nch2-master-1 Jan 22 21:08:54.638764 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-d67bf239-2275-49e1-a283-bd89d6feeb08 req-ab037bca-d83e-46f6-b991-8d0176023a17 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033439 Jan 22 21:08:54.639666 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1574/2969] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:54.645566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-48bd41bf-ac28-46a1-bd7e-f04a6be45a81 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:54.646079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-48bd41bf-ac28-46a1-bd7e-f04a6be45a81 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:54.652415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48bd41bf-ac28-46a1-bd7e-f04a6be45a81 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:54.652882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48bd41bf-ac28-46a1-bd7e-f04a6be45a81 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:54.653715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48bd41bf-ac28-46a1-bd7e-f04a6be45a81 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:54.654169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48bd41bf-ac28-46a1-bd7e-f04a6be45a81 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:54.654636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:08:54.661874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:08:54.662455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:08:54.663239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:08:54.663639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:08:54.687945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:54.689066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:54.690909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:54.691420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:54.703832 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-48bd41bf-ac28-46a1-bd7e-f04a6be45a81 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.062740 Jan 22 21:08:54.708893 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1575/2970] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:54 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:08:54.721238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Getting quotas for project f96634e81cc246f1ae4438f83a03ed79. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:08:54.727071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Getting quotas for user 2391e0ef53e044aabb95c2563c931028 and project f96634e81cc246f1ae4438f83a03ed79. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:08:54.740760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:08:54.743451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:08:54.859309 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0fa98018-2441-4eef-9e8b-faddb01c2f0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.265416 Jan 22 21:08:54.860041 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1396/2971] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:08:53 2022] POST /compute/v2.1/servers => generated 382 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:08:54.870988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-27a57ecd-0e46-40d7-993e-2c476e02dd17 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:54.871746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-27a57ecd-0e46-40d7-993e-2c476e02dd17 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:54.932626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-27a57ecd-0e46-40d7-993e-2c476e02dd17 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:54.942940 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-27a57ecd-0e46-40d7-993e-2c476e02dd17 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1219 microversion: 2.1 time: 0.076073 Jan 22 21:08:54.945248 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1576/2972] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:54 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:54.984665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9fae2aa3-678f-49bd-b4e6-781e721f86ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:54.986236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9fae2aa3-678f-49bd-b4e6-781e721f86ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:54.994817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9fae2aa3-678f-49bd-b4e6-781e721f86ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:54.995679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9fae2aa3-678f-49bd-b4e6-781e721f86ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:54.997341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9fae2aa3-678f-49bd-b4e6-781e721f86ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:54.998284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9fae2aa3-678f-49bd-b4e6-781e721f86ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:55.059212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f7330e04-8ca3-44e8-b92c-cbce4dd24052 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:55.060134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f7330e04-8ca3-44e8-b92c-cbce4dd24052 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:55.069049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7330e04-8ca3-44e8-b92c-cbce4dd24052 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:55.069605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7330e04-8ca3-44e8-b92c-cbce4dd24052 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:55.070318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7330e04-8ca3-44e8-b92c-cbce4dd24052 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:55.070757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7330e04-8ca3-44e8-b92c-cbce4dd24052 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:55.115385 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f7330e04-8ca3-44e8-b92c-cbce4dd24052 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.059802 Jan 22 21:08:55.116079 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1577/2973] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:55 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:08:55.179463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-505632c9-7dcf-4ce5-bfd4-bef238e8e774 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:55.180115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-505632c9-7dcf-4ce5-bfd4-bef238e8e774 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:55.187086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-505632c9-7dcf-4ce5-bfd4-bef238e8e774 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:55.187550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-505632c9-7dcf-4ce5-bfd4-bef238e8e774 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:55.188392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-505632c9-7dcf-4ce5-bfd4-bef238e8e774 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:55.189566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-505632c9-7dcf-4ce5-bfd4-bef238e8e774 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:55.260486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-505632c9-7dcf-4ce5-bfd4-bef238e8e774 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:55.269547 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-505632c9-7dcf-4ce5-bfd4-bef238e8e774 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1279 microversion: 2.1 time: 0.093599 Jan 22 21:08:55.270232 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1578/2974] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:55 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:55.420360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17327d1b-d3c6-4b8a-801a-437b5b4bc196 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:55.421535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17327d1b-d3c6-4b8a-801a-437b5b4bc196 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:55.434355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17327d1b-d3c6-4b8a-801a-437b5b4bc196 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:55.434829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17327d1b-d3c6-4b8a-801a-437b5b4bc196 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:55.435649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17327d1b-d3c6-4b8a-801a-437b5b4bc196 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:55.436097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17327d1b-d3c6-4b8a-801a-437b5b4bc196 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:55.627232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-17327d1b-d3c6-4b8a-801a-437b5b4bc196 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:55.634960 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17327d1b-d3c6-4b8a-801a-437b5b4bc196 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1476 microversion: 2.1 time: 0.218438 Jan 22 21:08:55.640586 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1579/2975] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:55 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1476 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:55.645466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9fae2aa3-678f-49bd-b4e6-781e721f86ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:55.650876 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9fae2aa3-678f-49bd-b4e6-781e721f86ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1296 microversion: 2.1 time: 0.670808 Jan 22 21:08:55.651747 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1397/2976] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:54 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1296 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:55.661695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7b4f188e-a58d-44fe-bb0e-dc772f5eabf4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:55.661695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7b4f188e-a58d-44fe-bb0e-dc772f5eabf4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:55.664520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b4f188e-a58d-44fe-bb0e-dc772f5eabf4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:55.664975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b4f188e-a58d-44fe-bb0e-dc772f5eabf4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:55.672466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b4f188e-a58d-44fe-bb0e-dc772f5eabf4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:55.674316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b4f188e-a58d-44fe-bb0e-dc772f5eabf4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:55.718546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d1a29d46-8e2c-4eeb-b276-2c43bda72b50 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:55.723274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d1a29d46-8e2c-4eeb-b276-2c43bda72b50 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:55.727980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1a29d46-8e2c-4eeb-b276-2c43bda72b50 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:55.728515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1a29d46-8e2c-4eeb-b276-2c43bda72b50 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:55.729670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1a29d46-8e2c-4eeb-b276-2c43bda72b50 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:55.730273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1a29d46-8e2c-4eeb-b276-2c43bda72b50 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:55.822932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7b4f188e-a58d-44fe-bb0e-dc772f5eabf4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:55.833242 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7b4f188e-a58d-44fe-bb0e-dc772f5eabf4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1329 microversion: 2.1 time: 0.196192 Jan 22 21:08:55.834450 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1580/2977] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:55 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1329 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:55.858081 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d1a29d46-8e2c-4eeb-b276-2c43bda72b50 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.142995 Jan 22 21:08:55.859546 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1398/2978] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:55 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:08:55.983547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b713337b-8805-490c-95b5-f1738f3acd7e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:55.984235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b713337b-8805-490c-95b5-f1738f3acd7e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:56.042391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b713337b-8805-490c-95b5-f1738f3acd7e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:56.049603 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b713337b-8805-490c-95b5-f1738f3acd7e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1219 microversion: 2.1 time: 0.069796 Jan 22 21:08:56.051431 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1581/2979] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:55 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:56.132352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7aaebfc9-c1a9-4ffd-ad7f-1256d7978183 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:56.134110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7aaebfc9-c1a9-4ffd-ad7f-1256d7978183 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:56.146505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7aaebfc9-c1a9-4ffd-ad7f-1256d7978183 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:56.148156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7aaebfc9-c1a9-4ffd-ad7f-1256d7978183 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:56.149159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7aaebfc9-c1a9-4ffd-ad7f-1256d7978183 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:56.149802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7aaebfc9-c1a9-4ffd-ad7f-1256d7978183 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:56.232124 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7aaebfc9-c1a9-4ffd-ad7f-1256d7978183 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.107649 Jan 22 21:08:56.236027 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1399/2980] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:56 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:56.292098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ddbc2d81-0051-4b7c-b476-a94443b26a7b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:56.292985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ddbc2d81-0051-4b7c-b476-a94443b26a7b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:56.300624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddbc2d81-0051-4b7c-b476-a94443b26a7b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:56.301063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddbc2d81-0051-4b7c-b476-a94443b26a7b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:56.302710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddbc2d81-0051-4b7c-b476-a94443b26a7b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:56.303300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddbc2d81-0051-4b7c-b476-a94443b26a7b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:56.491014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-000564a3-d7a6-4f17-a868-6eea4b462df3 req-d645841f-4f0f-46c9-939b-8772d6536b5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c59a6dad-848f-4c14-8c58-79bfe47dfa7f", "tag": "b0679c08-5a5d-44c4-b58c-f45e0cdbd6a2"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:56.493308 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:56.493308 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:08:56.509321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-000564a3-d7a6-4f17-a868-6eea4b462df3 req-d645841f-4f0f-46c9-939b-8772d6536b5d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:56.510974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-000564a3-d7a6-4f17-a868-6eea4b462df3 req-d645841f-4f0f-46c9-939b-8772d6536b5d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:56.536874 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-000564a3-d7a6-4f17-a868-6eea4b462df3 req-d645841f-4f0f-46c9-939b-8772d6536b5d service nova] Creating event network-changed:b0679c08-5a5d-44c4-b58c-f45e0cdbd6a2 for instance c59a6dad-848f-4c14-8c58-79bfe47dfa7f on nch1-master-1 Jan 22 21:08:56.546248 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-000564a3-d7a6-4f17-a868-6eea4b462df3 req-d645841f-4f0f-46c9-939b-8772d6536b5d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059432 Jan 22 21:08:56.551935 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1400/2981] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:56.618740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ddbc2d81-0051-4b7c-b476-a94443b26a7b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:56.631786 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ddbc2d81-0051-4b7c-b476-a94443b26a7b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1321 microversion: 2.1 time: 0.343397 Jan 22 21:08:56.637119 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1582/2982] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:56 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:56.653913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a164b2b4-c40b-4044-8ca6-c647ea7c7f0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:56.654913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a164b2b4-c40b-4044-8ca6-c647ea7c7f0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:56.668084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a164b2b4-c40b-4044-8ca6-c647ea7c7f0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:56.668545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a164b2b4-c40b-4044-8ca6-c647ea7c7f0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:56.669571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a164b2b4-c40b-4044-8ca6-c647ea7c7f0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:56.670179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a164b2b4-c40b-4044-8ca6-c647ea7c7f0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:56.674942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9653d686-ab19-4780-a66c-91cdac10da40 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:56.676199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9653d686-ab19-4780-a66c-91cdac10da40 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:56.693755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9653d686-ab19-4780-a66c-91cdac10da40 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:56.694272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9653d686-ab19-4780-a66c-91cdac10da40 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:56.695074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9653d686-ab19-4780-a66c-91cdac10da40 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:56.695530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9653d686-ab19-4780-a66c-91cdac10da40 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:57.012295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9653d686-ab19-4780-a66c-91cdac10da40 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:57.026610 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9653d686-ab19-4780-a66c-91cdac10da40 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1296 microversion: 2.1 time: 0.358744 Jan 22 21:08:57.027231 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1583/2983] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:56 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1296 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:57.039746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e5ad9085-27c9-436d-9caa-3c0bd2bbdad0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:57.045704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e5ad9085-27c9-436d-9caa-3c0bd2bbdad0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:57.072137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5ad9085-27c9-436d-9caa-3c0bd2bbdad0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:57.075596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5ad9085-27c9-436d-9caa-3c0bd2bbdad0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:57.077711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5ad9085-27c9-436d-9caa-3c0bd2bbdad0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:57.078416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5ad9085-27c9-436d-9caa-3c0bd2bbdad0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:57.093622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a164b2b4-c40b-4044-8ca6-c647ea7c7f0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:57.103074 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a164b2b4-c40b-4044-8ca6-c647ea7c7f0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1473 microversion: 2.1 time: 0.453808 Jan 22 21:08:57.114288 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1401/2984] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:56 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1473 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:57.119427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-df53f696-002d-4cae-b09e-8d33bb9481ac tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:57.120591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-df53f696-002d-4cae-b09e-8d33bb9481ac tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:57.134056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df53f696-002d-4cae-b09e-8d33bb9481ac tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:57.146286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df53f696-002d-4cae-b09e-8d33bb9481ac tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:57.147464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df53f696-002d-4cae-b09e-8d33bb9481ac tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:57.148093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df53f696-002d-4cae-b09e-8d33bb9481ac tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:57.215215 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-df53f696-002d-4cae-b09e-8d33bb9481ac tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.099218 Jan 22 21:08:57.217299 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1402/2985] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:57 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:08:57.227194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a475140e-2391-4293-948a-140ae7d793ac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:57.228461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a475140e-2391-4293-948a-140ae7d793ac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:57.244037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a475140e-2391-4293-948a-140ae7d793ac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:57.244650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a475140e-2391-4293-948a-140ae7d793ac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:57.246395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a475140e-2391-4293-948a-140ae7d793ac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:57.247173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a475140e-2391-4293-948a-140ae7d793ac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:57.348310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a475140e-2391-4293-948a-140ae7d793ac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:57.359848 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a475140e-2391-4293-948a-140ae7d793ac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1271 microversion: 2.1 time: 0.140517 Jan 22 21:08:57.363623 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1403/2986] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:57 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1271 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:57.381070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5a3b9f74-3ecc-4ea0-8d34-412e3faa9078 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:57.384348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5a3b9f74-3ecc-4ea0-8d34-412e3faa9078 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:57.404202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a3b9f74-3ecc-4ea0-8d34-412e3faa9078 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:57.404202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a3b9f74-3ecc-4ea0-8d34-412e3faa9078 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:57.404202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a3b9f74-3ecc-4ea0-8d34-412e3faa9078 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:57.405863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a3b9f74-3ecc-4ea0-8d34-412e3faa9078 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:57.420928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e5ad9085-27c9-436d-9caa-3c0bd2bbdad0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:57.429966 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e5ad9085-27c9-436d-9caa-3c0bd2bbdad0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1329 microversion: 2.1 time: 0.401628 Jan 22 21:08:57.434319 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1584/2987] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:57 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1329 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:57.449020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b979879d-d223-4804-913c-cc6006c99e78 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:57.451771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b979879d-d223-4804-913c-cc6006c99e78 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:57.472721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b979879d-d223-4804-913c-cc6006c99e78 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:57.477813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b979879d-d223-4804-913c-cc6006c99e78 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:57.489692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b979879d-d223-4804-913c-cc6006c99e78 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:57.489692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b979879d-d223-4804-913c-cc6006c99e78 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:57.564948 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b979879d-d223-4804-913c-cc6006c99e78 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.128764 Jan 22 21:08:57.565845 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1585/2988] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:57 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:57.653211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ccc249ac-a2f8-4cad-889c-f71f97341b30 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:57.654270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ccc249ac-a2f8-4cad-889c-f71f97341b30 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:57.662920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccc249ac-a2f8-4cad-889c-f71f97341b30 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:57.663383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccc249ac-a2f8-4cad-889c-f71f97341b30 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:57.664182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccc249ac-a2f8-4cad-889c-f71f97341b30 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:57.664624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccc249ac-a2f8-4cad-889c-f71f97341b30 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:57.748132 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5a3b9f74-3ecc-4ea0-8d34-412e3faa9078 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "POST /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72/action" status: 204 len: 0 microversion: 2.1 time: 0.384218 Jan 22 21:08:57.749211 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1404/2989] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:57 2022] POST /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72/action => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:08:57.772566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96cca234-41e9-4c4f-8014-0bec4c563980 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:57.773596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96cca234-41e9-4c4f-8014-0bec4c563980 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:57.781430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96cca234-41e9-4c4f-8014-0bec4c563980 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:57.782636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96cca234-41e9-4c4f-8014-0bec4c563980 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:57.784116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96cca234-41e9-4c4f-8014-0bec4c563980 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:57.784574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96cca234-41e9-4c4f-8014-0bec4c563980 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:58.179204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ccc249ac-a2f8-4cad-889c-f71f97341b30 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:58.189063 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ccc249ac-a2f8-4cad-889c-f71f97341b30 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1321 microversion: 2.1 time: 0.540006 Jan 22 21:08:58.193709 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1586/2990] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:57 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1321 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:08:58.195278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6e322ecf-c307-433c-b875-0c06ce8004b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:58.196156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6e322ecf-c307-433c-b875-0c06ce8004b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:58.206435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e322ecf-c307-433c-b875-0c06ce8004b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:58.206982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e322ecf-c307-433c-b875-0c06ce8004b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:58.208037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e322ecf-c307-433c-b875-0c06ce8004b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:58.208559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e322ecf-c307-433c-b875-0c06ce8004b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:58.272990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-96cca234-41e9-4c4f-8014-0bec4c563980 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:58.281195 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96cca234-41e9-4c4f-8014-0bec4c563980 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1473 microversion: 2.1 time: 0.515543 Jan 22 21:08:58.281894 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1405/2991] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:57 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1473 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:58.295489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-42f358c3-c0ea-4718-9206-10144efaabfc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:58.296667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-42f358c3-c0ea-4718-9206-10144efaabfc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:58.304007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42f358c3-c0ea-4718-9206-10144efaabfc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:58.304563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42f358c3-c0ea-4718-9206-10144efaabfc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:58.305449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42f358c3-c0ea-4718-9206-10144efaabfc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:58.306092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42f358c3-c0ea-4718-9206-10144efaabfc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:58.362378 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-42f358c3-c0ea-4718-9206-10144efaabfc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.078120 Jan 22 21:08:58.363637 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1406/2992] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:08:58 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:08:58.378849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e21aa2bf-c1e6-423b-98f6-cbbd436c2bb4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:58.379805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e21aa2bf-c1e6-423b-98f6-cbbd436c2bb4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:58.387702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e21aa2bf-c1e6-423b-98f6-cbbd436c2bb4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:58.388454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e21aa2bf-c1e6-423b-98f6-cbbd436c2bb4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:58.398648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e21aa2bf-c1e6-423b-98f6-cbbd436c2bb4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:58.399127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e21aa2bf-c1e6-423b-98f6-cbbd436c2bb4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:58.473603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e21aa2bf-c1e6-423b-98f6-cbbd436c2bb4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:58.482025 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e21aa2bf-c1e6-423b-98f6-cbbd436c2bb4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1277 microversion: 2.1 time: 0.107566 Jan 22 21:08:58.489972 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1407/2993] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:58 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:58.497754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4aa7861a-d9e5-4299-b485-b50be12b0ef4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:58.498475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4aa7861a-d9e5-4299-b485-b50be12b0ef4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:58.505816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4aa7861a-d9e5-4299-b485-b50be12b0ef4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:58.508407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4aa7861a-d9e5-4299-b485-b50be12b0ef4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:58.508407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4aa7861a-d9e5-4299-b485-b50be12b0ef4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:58.508407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4aa7861a-d9e5-4299-b485-b50be12b0ef4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:58.577829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6e322ecf-c307-433c-b875-0c06ce8004b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:58.589206 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6e322ecf-c307-433c-b875-0c06ce8004b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1475 microversion: 2.1 time: 0.397803 Jan 22 21:08:58.590079 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1587/2994] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:58 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1475 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:58.596821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-63192dca-13e2-48c8-9902-4e1063094166 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:58.597777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-63192dca-13e2-48c8-9902-4e1063094166 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:58.613286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63192dca-13e2-48c8-9902-4e1063094166 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:58.613286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63192dca-13e2-48c8-9902-4e1063094166 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:58.613762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63192dca-13e2-48c8-9902-4e1063094166 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:58.614132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63192dca-13e2-48c8-9902-4e1063094166 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:58.702570 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-63192dca-13e2-48c8-9902-4e1063094166 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.110386 Jan 22 21:08:58.703692 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1588/2995] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:08:58 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:08:58.711364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-eb74af37-f26b-4672-bb89-260799801cfa req-c1b0b49b-5ee1-4e16-b46a-00681116a819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4357d420-1aed-4d31-a61b-e95f4be3e303", "tag": "73e1e6c8-4fa4-4d3d-83b2-279e5b30b45e"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:58.713058 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:08:58.713058 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:08:58.732435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-eb74af37-f26b-4672-bb89-260799801cfa req-c1b0b49b-5ee1-4e16-b46a-00681116a819 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:58.733829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-eb74af37-f26b-4672-bb89-260799801cfa req-c1b0b49b-5ee1-4e16-b46a-00681116a819 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:58.764012 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-eb74af37-f26b-4672-bb89-260799801cfa req-c1b0b49b-5ee1-4e16-b46a-00681116a819 service nova] Creating event network-changed:73e1e6c8-4fa4-4d3d-83b2-279e5b30b45e for instance 4357d420-1aed-4d31-a61b-e95f4be3e303 on nch2-master-1 Jan 22 21:08:58.771454 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-eb74af37-f26b-4672-bb89-260799801cfa req-c1b0b49b-5ee1-4e16-b46a-00681116a819 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065199 Jan 22 21:08:58.773184 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1589/2996] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:08:58.796040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1058724467", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:08:58.876336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] validate_networks() for [('ab49ab48-066e-4b21-9cb5-bee63c0067a9', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:08:58.996046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4aa7861a-d9e5-4299-b485-b50be12b0ef4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:59.004550 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4aa7861a-d9e5-4299-b485-b50be12b0ef4 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1329 microversion: 2.1 time: 0.513127 Jan 22 21:08:59.005134 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1408/2997] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:58 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1329 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:59.206179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a8e2c016-fca8-4422-ba8e-0d7c561d70ec tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:59.206983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a8e2c016-fca8-4422-ba8e-0d7c561d70ec tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:59.214589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8e2c016-fca8-4422-ba8e-0d7c561d70ec tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:59.215174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8e2c016-fca8-4422-ba8e-0d7c561d70ec tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:59.216263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8e2c016-fca8-4422-ba8e-0d7c561d70ec tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:59.216801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8e2c016-fca8-4422-ba8e-0d7c561d70ec tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:59.871276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a8e2c016-fca8-4422-ba8e-0d7c561d70ec tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:08:59.902470 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a8e2c016-fca8-4422-ba8e-0d7c561d70ec tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1321 microversion: 2.1 time: 0.698940 Jan 22 21:08:59.913067 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1409/2998] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:59 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1321 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:08:59.925576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-493a62be-c25e-45bd-b296-030a2e8148ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:08:59.930494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-493a62be-c25e-45bd-b296-030a2e8148ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:08:59.942588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-493a62be-c25e-45bd-b296-030a2e8148ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:59.945484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-493a62be-c25e-45bd-b296-030a2e8148ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:59.949401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-493a62be-c25e-45bd-b296-030a2e8148ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:08:59.950982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-493a62be-c25e-45bd-b296-030a2e8148ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:08:59.997872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:08:59.998481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:08:59.998779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:08:59.999201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:08:59.999638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:09:00.010369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:00.013033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:00.013033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:00.013033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:00.033573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:09:00.039386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for user 75befd3272db4de48c7b4586adf6f849 and project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:09:00.053094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:09:00.055616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:09:00.140181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-493a62be-c25e-45bd-b296-030a2e8148ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:00.149651 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-493a62be-c25e-45bd-b296-030a2e8148ea tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1473 microversion: 2.1 time: 0.233459 Jan 22 21:09:00.170976 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1410/2999] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:08:59 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1473 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:00.176913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-30120b11-5793-4988-b3d5-c25768c968cd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:00.177940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-30120b11-5793-4988-b3d5-c25768c968cd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:00.184165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30120b11-5793-4988-b3d5-c25768c968cd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:00.187298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30120b11-5793-4988-b3d5-c25768c968cd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:00.187298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30120b11-5793-4988-b3d5-c25768c968cd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:00.187298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30120b11-5793-4988-b3d5-c25768c968cd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:00.231996 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-18b7c261-2d23-4bcc-a341-d8d50ee7fa50 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.440783 Jan 22 21:09:00.238059 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1590/3000] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:08:58 2022] POST /compute/v2.1/servers => generated 382 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:09:00.242922 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-30120b11-5793-4988-b3d5-c25768c968cd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.069889 Jan 22 21:09:00.246554 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1411/3001] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:00 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:00.252435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-65bb8baf-9bab-4c6d-99cb-7e0d312d363a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:00.253071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-65bb8baf-9bab-4c6d-99cb-7e0d312d363a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:00.257538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e0284412-0067-49c3-818a-ae197077b020 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:00.257812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e0284412-0067-49c3-818a-ae197077b020 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:00.269631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65bb8baf-9bab-4c6d-99cb-7e0d312d363a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:00.272392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65bb8baf-9bab-4c6d-99cb-7e0d312d363a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:00.273244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65bb8baf-9bab-4c6d-99cb-7e0d312d363a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:00.273923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65bb8baf-9bab-4c6d-99cb-7e0d312d363a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:00.276248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0284412-0067-49c3-818a-ae197077b020 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:00.277296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0284412-0067-49c3-818a-ae197077b020 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:00.278446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0284412-0067-49c3-818a-ae197077b020 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:00.279449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0284412-0067-49c3-818a-ae197077b020 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:00.344897 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e0284412-0067-49c3-818a-ae197077b020 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.099248 Jan 22 21:09:00.346417 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1412/3002] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:00 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:00.359221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-43cb05fc-c639-4b6d-b958-25c5df841c5a req-68dacc5f-066e-4131-bba0-b6e298d24943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd923b09-9a4a-4371-8e4e-044fd3787b72", "name": "network-vif-plugged", "status": "completed", "tag": "b5da264d-bc7c-4452-b54d-69a739e13c9f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:00.362946 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:00.362946 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:00.398323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-43cb05fc-c639-4b6d-b958-25c5df841c5a req-68dacc5f-066e-4131-bba0-b6e298d24943 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:00.399289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-43cb05fc-c639-4b6d-b958-25c5df841c5a req-68dacc5f-066e-4131-bba0-b6e298d24943 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:00.431332 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-43cb05fc-c639-4b6d-b958-25c5df841c5a req-68dacc5f-066e-4131-bba0-b6e298d24943 service nova] Creating event network-vif-plugged:b5da264d-bc7c-4452-b54d-69a739e13c9f for instance dd923b09-9a4a-4371-8e4e-044fd3787b72 on nch2-master-1 Jan 22 21:09:00.443894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-43cb05fc-c639-4b6d-b958-25c5df841c5a req-68dacc5f-066e-4131-bba0-b6e298d24943 service nova] Instance dd923b09-9a4a-4371-8e4e-044fd3787b72 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:09:00.464176 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-43cb05fc-c639-4b6d-b958-25c5df841c5a req-68dacc5f-066e-4131-bba0-b6e298d24943 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114746 Jan 22 21:09:00.464978 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1413/3003] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:00.471606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c5a57cb2-26a0-45ea-a2cf-5eb5b05aacfd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:00.472603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c5a57cb2-26a0-45ea-a2cf-5eb5b05aacfd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:00.480083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5a57cb2-26a0-45ea-a2cf-5eb5b05aacfd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:00.480644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5a57cb2-26a0-45ea-a2cf-5eb5b05aacfd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:00.481617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5a57cb2-26a0-45ea-a2cf-5eb5b05aacfd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:00.482272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5a57cb2-26a0-45ea-a2cf-5eb5b05aacfd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:00.723894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-65bb8baf-9bab-4c6d-99cb-7e0d312d363a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:00.731409 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-65bb8baf-9bab-4c6d-99cb-7e0d312d363a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1319 microversion: 2.1 time: 0.497093 Jan 22 21:09:00.735609 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1591/3004] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:00 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:00.746191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3aeebb29-906a-4c83-bf0a-72a7f6e2573a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:00.746191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3aeebb29-906a-4c83-bf0a-72a7f6e2573a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:00.758151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c5a57cb2-26a0-45ea-a2cf-5eb5b05aacfd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:00.778509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3aeebb29-906a-4c83-bf0a-72a7f6e2573a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:09:00.792201 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c5a57cb2-26a0-45ea-a2cf-5eb5b05aacfd tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1329 microversion: 2.1 time: 0.322648 Jan 22 21:09:00.801869 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1414/3005] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:00 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1329 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:00.929495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4bf751cf-35b4-47db-8a4c-600544f83716 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:00.930208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4bf751cf-35b4-47db-8a4c-600544f83716 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:00.947250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bf751cf-35b4-47db-8a4c-600544f83716 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:00.949711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bf751cf-35b4-47db-8a4c-600544f83716 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:00.952007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bf751cf-35b4-47db-8a4c-600544f83716 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:00.955066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bf751cf-35b4-47db-8a4c-600544f83716 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:01.270524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4bf751cf-35b4-47db-8a4c-600544f83716 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:01.285024 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4bf751cf-35b4-47db-8a4c-600544f83716 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1321 microversion: 2.1 time: 0.359046 Jan 22 21:09:01.298670 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1415/3006] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:00 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:01.306073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bafc2a32-d098-4ab8-88bf-3df31a7b71f9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:01.307146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bafc2a32-d098-4ab8-88bf-3df31a7b71f9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:01.318668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bafc2a32-d098-4ab8-88bf-3df31a7b71f9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:01.320247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bafc2a32-d098-4ab8-88bf-3df31a7b71f9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:01.321847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bafc2a32-d098-4ab8-88bf-3df31a7b71f9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:01.322553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bafc2a32-d098-4ab8-88bf-3df31a7b71f9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:01.430839 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.compute.api [None req-3aeebb29-906a-4c83-bf0a-72a7f6e2573a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024] Instance Mapping does not exist while attempting local delete cleanup. Jan 22 21:09:01.433303 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3aeebb29-906a-4c83-bf0a-72a7f6e2573a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024" status: 204 len: 0 microversion: 2.1 time: 0.695559 Jan 22 21:09:01.435999 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1592/3007] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:00 2022] DELETE /compute/v2.1/servers/7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:09:01.450492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-94ba9365-c0ee-4bc5-95a1-eb7dc218c77d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:01.451534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-94ba9365-c0ee-4bc5-95a1-eb7dc218c77d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:01.468675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94ba9365-c0ee-4bc5-95a1-eb7dc218c77d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:01.468891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94ba9365-c0ee-4bc5-95a1-eb7dc218c77d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:01.470501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94ba9365-c0ee-4bc5-95a1-eb7dc218c77d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:01.471623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94ba9365-c0ee-4bc5-95a1-eb7dc218c77d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:01.520831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bafc2a32-d098-4ab8-88bf-3df31a7b71f9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:01.529191 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bafc2a32-d098-4ab8-88bf-3df31a7b71f9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1465 microversion: 2.1 time: 0.228616 Jan 22 21:09:01.541378 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1416/3008] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:01 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1465 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:01.543236 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-94ba9365-c0ee-4bc5-95a1-eb7dc218c77d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.105573 Jan 22 21:09:01.544411 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1593/3009] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:01 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:01.555298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4154c19c-5531-46fa-998c-6bf80e432bb8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:01.556315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4154c19c-5531-46fa-998c-6bf80e432bb8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:01.556449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a6bdc550-05f9-4247-8fab-b4606c039d76 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:01.557922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a6bdc550-05f9-4247-8fab-b4606c039d76 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:01.572495 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-a6bdc550-05f9-4247-8fab-b4606c039d76 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance 7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024 could not be found. Jan 22 21:09:01.574745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a6bdc550-05f9-4247-8fab-b4606c039d76 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance 7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:01.574745 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a6bdc550-05f9-4247-8fab-b4606c039d76 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024" status: 404 len: 111 microversion: 2.1 time: 0.027486 Jan 22 21:09:01.575530 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1594/3010] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:01 2022] GET /compute/v2.1/servers/7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:01.583172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2f932422-8f3a-48fa-97c0-e67014602077 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:01.584205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2f932422-8f3a-48fa-97c0-e67014602077 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:01.595939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4154c19c-5531-46fa-998c-6bf80e432bb8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:01.595939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4154c19c-5531-46fa-998c-6bf80e432bb8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:01.595939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4154c19c-5531-46fa-998c-6bf80e432bb8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:01.595939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4154c19c-5531-46fa-998c-6bf80e432bb8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:01.618084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f932422-8f3a-48fa-97c0-e67014602077 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:01.620163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f932422-8f3a-48fa-97c0-e67014602077 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:01.621011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f932422-8f3a-48fa-97c0-e67014602077 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:01.624774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f932422-8f3a-48fa-97c0-e67014602077 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:01.670403 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4154c19c-5531-46fa-998c-6bf80e432bb8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.125791 Jan 22 21:09:01.674609 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1417/3011] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:01 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:01.686878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2079230420", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "ab49ab48-066e-4b21-9cb5-bee63c0067a9"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:01.765640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] validate_networks() for [('ab49ab48-066e-4b21-9cb5-bee63c0067a9', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:09:01.975093 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2f932422-8f3a-48fa-97c0-e67014602077 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1616 microversion: 2.1 time: 0.398387 Jan 22 21:09:01.988815 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1595/3012] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:01 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1616 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:01.996958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-56d4bd7b-c8fc-47da-bea5-6574c2dfcc46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:01.998072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-56d4bd7b-c8fc-47da-bea5-6574c2dfcc46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:02.021708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56d4bd7b-c8fc-47da-bea5-6574c2dfcc46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:02.021708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56d4bd7b-c8fc-47da-bea5-6574c2dfcc46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:02.021708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56d4bd7b-c8fc-47da-bea5-6574c2dfcc46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:02.021708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56d4bd7b-c8fc-47da-bea5-6574c2dfcc46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:02.240614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:09:02.242874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:09:02.243378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:09:02.243925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:09:02.244521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:09:02.259813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:02.260310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:02.261926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:02.262375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:02.281454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:09:02.291745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for user 75befd3272db4de48c7b4586adf6f849 and project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:09:02.310658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:09:02.313576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:09:02.330409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-56d4bd7b-c8fc-47da-bea5-6574c2dfcc46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:02.339638 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-56d4bd7b-c8fc-47da-bea5-6574c2dfcc46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1319 microversion: 2.1 time: 0.348178 Jan 22 21:09:02.340579 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1596/3013] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:01 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:02.346252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-643e48eb-9bb1-40b7-a176-f8bd4bddccf0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:02.346935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-643e48eb-9bb1-40b7-a176-f8bd4bddccf0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:02.353156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-643e48eb-9bb1-40b7-a176-f8bd4bddccf0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:02.354224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-643e48eb-9bb1-40b7-a176-f8bd4bddccf0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:02.355064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-643e48eb-9bb1-40b7-a176-f8bd4bddccf0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:02.355531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-643e48eb-9bb1-40b7-a176-f8bd4bddccf0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:02.501809 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-37faeb43-d06e-4fcc-86a3-8fbaa3a1cb0b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.827792 Jan 22 21:09:02.503052 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1418/3014] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:01 2022] POST /compute/v2.1/servers => generated 382 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:09:02.513842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-02f29e6c-94ed-42f3-9d2c-8e20165bcc53 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Calling method '.version_select at 0x7f1ed8b49c10>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:02.515322 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:02.515322 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:02.517335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-02f29e6c-94ed-42f3-9d2c-8e20165bcc53 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:02.517942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-02f29e6c-94ed-42f3-9d2c-8e20165bcc53 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:02.526610 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-02f29e6c-94ed-42f3-9d2c-8e20165bcc53 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] 10.222.0.100 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.022083 Jan 22 21:09:02.545193 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1419/3015] 10.222.0.100 () {58 vars in 1147 bytes} [Sat Jan 22 21:09:02 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:02.577396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-5829c21a-df93-4ed4-9e57-200850962e4a req-90a0b967-e9da-496b-a55d-4fb9c7bc736c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afd13882-2a28-4355-a3d1-606aa99e9971", "tag": "6c7f397f-1413-4f0f-9bd8-3cf8f17c8961"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:02.580972 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:02.580972 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:02.593675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5829c21a-df93-4ed4-9e57-200850962e4a req-90a0b967-e9da-496b-a55d-4fb9c7bc736c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:02.595154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5829c21a-df93-4ed4-9e57-200850962e4a req-90a0b967-e9da-496b-a55d-4fb9c7bc736c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:02.608184 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-5829c21a-df93-4ed4-9e57-200850962e4a req-90a0b967-e9da-496b-a55d-4fb9c7bc736c service nova] Creating event network-changed:6c7f397f-1413-4f0f-9bd8-3cf8f17c8961 for instance afd13882-2a28-4355-a3d1-606aa99e9971 on nch1-master-1 Jan 22 21:09:02.616418 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-5829c21a-df93-4ed4-9e57-200850962e4a req-90a0b967-e9da-496b-a55d-4fb9c7bc736c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070538 Jan 22 21:09:02.622653 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1420/3016] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:02.624493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-acc76732-ef0f-4e84-b0fc-a6a692c5e159 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:02.625358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-acc76732-ef0f-4e84-b0fc-a6a692c5e159 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:02.634205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acc76732-ef0f-4e84-b0fc-a6a692c5e159 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:02.635894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acc76732-ef0f-4e84-b0fc-a6a692c5e159 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:02.636555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acc76732-ef0f-4e84-b0fc-a6a692c5e159 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:02.636948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acc76732-ef0f-4e84-b0fc-a6a692c5e159 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:02.842061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-acc76732-ef0f-4e84-b0fc-a6a692c5e159 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:02.851353 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-acc76732-ef0f-4e84-b0fc-a6a692c5e159 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1321 microversion: 2.1 time: 0.231230 Jan 22 21:09:02.852667 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1421/3017] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:02 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:02.857342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-18fc5a0b-1ac2-4d46-a374-3c4a6e339eb3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:02.858443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-18fc5a0b-1ac2-4d46-a374-3c4a6e339eb3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:02.923770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-18fc5a0b-1ac2-4d46-a374-3c4a6e339eb3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:02.933217 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-18fc5a0b-1ac2-4d46-a374-3c4a6e339eb3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1225 microversion: 2.1 time: 0.079248 Jan 22 21:09:02.933848 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1422/3018] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:02 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:02.938783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-643e48eb-9bb1-40b7-a176-f8bd4bddccf0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:02.945946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-71d42fad-38d6-4369-9cd6-2867ae3bb597 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:02.946945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-71d42fad-38d6-4369-9cd6-2867ae3bb597 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:02.958182 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-643e48eb-9bb1-40b7-a176-f8bd4bddccf0 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1329 microversion: 2.1 time: 0.608193 Jan 22 21:09:02.962299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71d42fad-38d6-4369-9cd6-2867ae3bb597 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:02.964769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71d42fad-38d6-4369-9cd6-2867ae3bb597 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:02.964769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71d42fad-38d6-4369-9cd6-2867ae3bb597 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:02.965099 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1597/3019] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:02 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1329 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:02.965248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71d42fad-38d6-4369-9cd6-2867ae3bb597 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:02.994972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-acbb9b34-d069-4b5a-85a3-82ae04382040 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:02.998979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-acbb9b34-d069-4b5a-85a3-82ae04382040 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:03.022086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acbb9b34-d069-4b5a-85a3-82ae04382040 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:03.023224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acbb9b34-d069-4b5a-85a3-82ae04382040 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:03.026246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acbb9b34-d069-4b5a-85a3-82ae04382040 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:03.026952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acbb9b34-d069-4b5a-85a3-82ae04382040 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:03.076574 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-71d42fad-38d6-4369-9cd6-2867ae3bb597 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.141425 Jan 22 21:09:03.077272 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1423/3020] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:02 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:03.085403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-676009210", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:03.103005 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-acbb9b34-d069-4b5a-85a3-82ae04382040 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.126087 Jan 22 21:09:03.105838 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1598/3021] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:02 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:03.178695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:09:03.357556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-532416a8-2fb6-4e80-a494-6a01fa672269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:03.361557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-532416a8-2fb6-4e80-a494-6a01fa672269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:03.371488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-532416a8-2fb6-4e80-a494-6a01fa672269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:03.372407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-532416a8-2fb6-4e80-a494-6a01fa672269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:03.392773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-532416a8-2fb6-4e80-a494-6a01fa672269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:03.393451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-532416a8-2fb6-4e80-a494-6a01fa672269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:03.502829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:09:03.502829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:09:03.502829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:09:03.502829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:09:03.502829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:09:03.513281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:03.513791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:03.514770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:03.515215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:03.547147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Getting quotas for project 80dba854f5414025a0cbf8b5d6571c42. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:09:03.566702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Getting quotas for user 7f8e9e562bd740e782568f539dac4744 and project 80dba854f5414025a0cbf8b5d6571c42. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:09:03.596983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:09:03.601377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:09:03.738774 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-41fb3b99-eb9c-4c3d-a228-0e12edfdcf17 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.660236 Jan 22 21:09:03.744508 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1424/3022] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:03 2022] POST /compute/v2.1/servers => generated 382 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:09:03.749559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-018dd05f-1a80-43b4-a30c-dd7e9795c328 req-d985dc6d-5e2b-45a6-9910-e9017694b21c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c59a6dad-848f-4c14-8c58-79bfe47dfa7f", "name": "network-vif-plugged", "status": "completed", "tag": "b0679c08-5a5d-44c4-b58c-f45e0cdbd6a2"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:03.753012 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:03.753012 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:03.761736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-018dd05f-1a80-43b4-a30c-dd7e9795c328 req-d985dc6d-5e2b-45a6-9910-e9017694b21c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:03.761971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-018dd05f-1a80-43b4-a30c-dd7e9795c328 req-d985dc6d-5e2b-45a6-9910-e9017694b21c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:03.774091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-532416a8-2fb6-4e80-a494-6a01fa672269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:03.775775 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-018dd05f-1a80-43b4-a30c-dd7e9795c328 req-d985dc6d-5e2b-45a6-9910-e9017694b21c service nova] Creating event network-vif-plugged:b0679c08-5a5d-44c4-b58c-f45e0cdbd6a2 for instance c59a6dad-848f-4c14-8c58-79bfe47dfa7f on nch1-master-1 Jan 22 21:09:03.782340 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-018dd05f-1a80-43b4-a30c-dd7e9795c328 req-d985dc6d-5e2b-45a6-9910-e9017694b21c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035865 Jan 22 21:09:03.786012 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1425/3023] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:03.791455 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-532416a8-2fb6-4e80-a494-6a01fa672269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1319 microversion: 2.1 time: 0.438517 Jan 22 21:09:03.793209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-76e496e9-800a-42e6-82e4-3507fa4c02cd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:03.793933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-76e496e9-800a-42e6-82e4-3507fa4c02cd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:03.809342 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1599/3024] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:03 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:03.869307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2056bdfd-a32d-4211-a59e-3f5331309ba7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:03.870374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2056bdfd-a32d-4211-a59e-3f5331309ba7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:03.879070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2056bdfd-a32d-4211-a59e-3f5331309ba7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:03.879612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2056bdfd-a32d-4211-a59e-3f5331309ba7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:03.880315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-76e496e9-800a-42e6-82e4-3507fa4c02cd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:03.880574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2056bdfd-a32d-4211-a59e-3f5331309ba7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:03.881097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2056bdfd-a32d-4211-a59e-3f5331309ba7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:03.893656 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-76e496e9-800a-42e6-82e4-3507fa4c02cd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1216 microversion: 2.1 time: 0.108443 Jan 22 21:09:03.895742 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1426/3025] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:03 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1216 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:03.950669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3efb2189-944d-4c87-94fb-29a442d3733f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:03.951482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3efb2189-944d-4c87-94fb-29a442d3733f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:03.971229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3efb2189-944d-4c87-94fb-29a442d3733f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:03.971987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3efb2189-944d-4c87-94fb-29a442d3733f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:03.973034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3efb2189-944d-4c87-94fb-29a442d3733f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:03.976323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3efb2189-944d-4c87-94fb-29a442d3733f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:04.053855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3efb2189-944d-4c87-94fb-29a442d3733f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:04.067992 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3efb2189-944d-4c87-94fb-29a442d3733f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1229 microversion: 2.1 time: 0.121154 Jan 22 21:09:04.069928 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1427/3026] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:03 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1229 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:04.077794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-90b380c3-f771-43b9-a56a-68078984648e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:04.077794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-90b380c3-f771-43b9-a56a-68078984648e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:04.091616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90b380c3-f771-43b9-a56a-68078984648e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:04.091616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90b380c3-f771-43b9-a56a-68078984648e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:04.091616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90b380c3-f771-43b9-a56a-68078984648e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:04.091616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90b380c3-f771-43b9-a56a-68078984648e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:04.224875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2056bdfd-a32d-4211-a59e-3f5331309ba7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:04.239112 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2056bdfd-a32d-4211-a59e-3f5331309ba7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1321 microversion: 2.1 time: 0.373786 Jan 22 21:09:04.248486 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1600/3027] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:03 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:04.255322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7af21e7e-5996-4fb3-92db-11a40fd3a4a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:04.256303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7af21e7e-5996-4fb3-92db-11a40fd3a4a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:04.269093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-90b380c3-f771-43b9-a56a-68078984648e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:04.269646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7af21e7e-5996-4fb3-92db-11a40fd3a4a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:04.270126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7af21e7e-5996-4fb3-92db-11a40fd3a4a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:04.271080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7af21e7e-5996-4fb3-92db-11a40fd3a4a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:04.271535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7af21e7e-5996-4fb3-92db-11a40fd3a4a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:04.279188 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-90b380c3-f771-43b9-a56a-68078984648e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1329 microversion: 2.1 time: 0.207511 Jan 22 21:09:04.290742 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1428/3028] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:04 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1329 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:04.301641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-178a0c59-110e-4a59-99d1-d217c10418a9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:04.304348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-178a0c59-110e-4a59-99d1-d217c10418a9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:04.314475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178a0c59-110e-4a59-99d1-d217c10418a9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:04.314475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178a0c59-110e-4a59-99d1-d217c10418a9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:04.314806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178a0c59-110e-4a59-99d1-d217c10418a9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:04.314959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178a0c59-110e-4a59-99d1-d217c10418a9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:04.332708 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7af21e7e-5996-4fb3-92db-11a40fd3a4a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.089823 Jan 22 21:09:04.333389 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1601/3029] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:04 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:04.361163 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-178a0c59-110e-4a59-99d1-d217c10418a9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.067509 Jan 22 21:09:04.362453 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1429/3030] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:04 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:04.810673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8466bd6e-6d4f-4b0a-9434-05b29b865844 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:04.812454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8466bd6e-6d4f-4b0a-9434-05b29b865844 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:04.820328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8466bd6e-6d4f-4b0a-9434-05b29b865844 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:04.820999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8466bd6e-6d4f-4b0a-9434-05b29b865844 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:04.821950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8466bd6e-6d4f-4b0a-9434-05b29b865844 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:04.822469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8466bd6e-6d4f-4b0a-9434-05b29b865844 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:04.912640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2c97045d-1f80-4406-80c9-f9517e0fc6f2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:04.913958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2c97045d-1f80-4406-80c9-f9517e0fc6f2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:04.921456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c97045d-1f80-4406-80c9-f9517e0fc6f2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:04.922288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c97045d-1f80-4406-80c9-f9517e0fc6f2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:04.928102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c97045d-1f80-4406-80c9-f9517e0fc6f2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:04.928842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c97045d-1f80-4406-80c9-f9517e0fc6f2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:05.025535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2c97045d-1f80-4406-80c9-f9517e0fc6f2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:05.050866 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2c97045d-1f80-4406-80c9-f9517e0fc6f2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1220 microversion: 2.1 time: 0.141190 Jan 22 21:09:05.052956 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1430/3031] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:04 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1220 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:05.066497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8466bd6e-6d4f-4b0a-9434-05b29b865844 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:05.082519 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8466bd6e-6d4f-4b0a-9434-05b29b865844 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1319 microversion: 2.1 time: 0.276846 Jan 22 21:09:05.083379 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1602/3032] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:04 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:05.092047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9eebad67-1e2c-4614-8845-f03682ca9dca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:05.096554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9eebad67-1e2c-4614-8845-f03682ca9dca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:05.109246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9eebad67-1e2c-4614-8845-f03682ca9dca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:05.111333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9eebad67-1e2c-4614-8845-f03682ca9dca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:05.113205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9eebad67-1e2c-4614-8845-f03682ca9dca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:05.114383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9eebad67-1e2c-4614-8845-f03682ca9dca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:05.256519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8863fdf6-dc35-4808-b689-074c12ab3e87 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:05.257588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8863fdf6-dc35-4808-b689-074c12ab3e87 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:05.269310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8863fdf6-dc35-4808-b689-074c12ab3e87 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:05.270157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8863fdf6-dc35-4808-b689-074c12ab3e87 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:05.270635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9eebad67-1e2c-4614-8845-f03682ca9dca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:05.271455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8863fdf6-dc35-4808-b689-074c12ab3e87 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:05.272108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8863fdf6-dc35-4808-b689-074c12ab3e87 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:05.279435 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9eebad67-1e2c-4614-8845-f03682ca9dca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1277 microversion: 2.1 time: 0.194557 Jan 22 21:09:05.288584 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1431/3033] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:05 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:05.296393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3e0d7272-674e-405f-b07b-e96970dacc32 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:05.297459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3e0d7272-674e-405f-b07b-e96970dacc32 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:05.304432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e0d7272-674e-405f-b07b-e96970dacc32 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:05.305551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e0d7272-674e-405f-b07b-e96970dacc32 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:05.307099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e0d7272-674e-405f-b07b-e96970dacc32 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:05.307848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e0d7272-674e-405f-b07b-e96970dacc32 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:05.549896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3e0d7272-674e-405f-b07b-e96970dacc32 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:05.577787 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3e0d7272-674e-405f-b07b-e96970dacc32 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1329 microversion: 2.1 time: 0.277888 Jan 22 21:09:05.581931 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1432/3034] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:05 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1329 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:05.588473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4410f134-318c-4bad-945e-4b3cd18d5f2d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:05.591419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4410f134-318c-4bad-945e-4b3cd18d5f2d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:05.599882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4410f134-318c-4bad-945e-4b3cd18d5f2d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:05.600705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4410f134-318c-4bad-945e-4b3cd18d5f2d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:05.601540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4410f134-318c-4bad-945e-4b3cd18d5f2d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:05.603394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4410f134-318c-4bad-945e-4b3cd18d5f2d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:05.662786 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4410f134-318c-4bad-945e-4b3cd18d5f2d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.077914 Jan 22 21:09:05.666873 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1433/3035] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:05 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:05.671167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d2dc9507-2990-4840-a3e1-fb5044af532c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:05.673492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d2dc9507-2990-4840-a3e1-fb5044af532c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:05.690122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2dc9507-2990-4840-a3e1-fb5044af532c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:05.690699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2dc9507-2990-4840-a3e1-fb5044af532c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:05.692888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2dc9507-2990-4840-a3e1-fb5044af532c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:05.693662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2dc9507-2990-4840-a3e1-fb5044af532c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:05.747251 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d2dc9507-2990-4840-a3e1-fb5044af532c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.079987 Jan 22 21:09:05.748070 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1434/3036] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:05 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:05.920186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8863fdf6-dc35-4808-b689-074c12ab3e87 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:05.928590 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8863fdf6-dc35-4808-b689-074c12ab3e87 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1321 microversion: 2.1 time: 0.675762 Jan 22 21:09:05.929417 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1603/3037] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:05 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1321 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:06.079330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6fb45e73-0123-4fc0-9ad8-96b06f9bd434 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:06.080419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6fb45e73-0123-4fc0-9ad8-96b06f9bd434 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:06.089611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6fb45e73-0123-4fc0-9ad8-96b06f9bd434 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.090077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6fb45e73-0123-4fc0-9ad8-96b06f9bd434 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:06.090876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6fb45e73-0123-4fc0-9ad8-96b06f9bd434 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.091558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6fb45e73-0123-4fc0-9ad8-96b06f9bd434 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:06.099984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74c2032b-f490-4edb-a501-d9027a8a8264 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:06.100636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-74c2032b-f490-4edb-a501-d9027a8a8264 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:06.108118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74c2032b-f490-4edb-a501-d9027a8a8264 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.108582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74c2032b-f490-4edb-a501-d9027a8a8264 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:06.109387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74c2032b-f490-4edb-a501-d9027a8a8264 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.110540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74c2032b-f490-4edb-a501-d9027a8a8264 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:06.174591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6fb45e73-0123-4fc0-9ad8-96b06f9bd434 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:06.182147 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6fb45e73-0123-4fc0-9ad8-96b06f9bd434 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1268 microversion: 2.1 time: 0.110599 Jan 22 21:09:06.182729 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1435/3038] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:06 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1268 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:06.319638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7449753e-e005-4a59-b91c-761fb6bd522c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:06.325892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7449753e-e005-4a59-b91c-761fb6bd522c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:06.337312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7449753e-e005-4a59-b91c-761fb6bd522c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.338079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7449753e-e005-4a59-b91c-761fb6bd522c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:06.339255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7449753e-e005-4a59-b91c-761fb6bd522c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.340046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7449753e-e005-4a59-b91c-761fb6bd522c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:06.465743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-74c2032b-f490-4edb-a501-d9027a8a8264 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:06.483337 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-74c2032b-f490-4edb-a501-d9027a8a8264 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1319 microversion: 2.1 time: 0.386860 Jan 22 21:09:06.484233 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1604/3039] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:06 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:06.498353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7449753e-e005-4a59-b91c-761fb6bd522c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:06.518803 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7449753e-e005-4a59-b91c-761fb6bd522c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1283 microversion: 2.1 time: 0.214490 Jan 22 21:09:06.521518 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1436/3040] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:06 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1283 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:06.596029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-91d6b435-80a4-4ea4-9a9c-d4af8b46ebca tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:06.596645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-91d6b435-80a4-4ea4-9a9c-d4af8b46ebca tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:06.603980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91d6b435-80a4-4ea4-9a9c-d4af8b46ebca tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.604765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91d6b435-80a4-4ea4-9a9c-d4af8b46ebca tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:06.605823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91d6b435-80a4-4ea4-9a9c-d4af8b46ebca tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.606560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91d6b435-80a4-4ea4-9a9c-d4af8b46ebca tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:06.676188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8d9bc27d-0586-48d2-965e-63fc3dbd81b6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:06.676870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8d9bc27d-0586-48d2-965e-63fc3dbd81b6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:06.684905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d9bc27d-0586-48d2-965e-63fc3dbd81b6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.685486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d9bc27d-0586-48d2-965e-63fc3dbd81b6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:06.686421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d9bc27d-0586-48d2-965e-63fc3dbd81b6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.686971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d9bc27d-0586-48d2-965e-63fc3dbd81b6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:06.739160 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8d9bc27d-0586-48d2-965e-63fc3dbd81b6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.068048 Jan 22 21:09:06.747748 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1437/3041] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:06 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:06.760702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-08bc1550-13b5-4a0d-91b5-7cc64bec2ae1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:06.761762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-08bc1550-13b5-4a0d-91b5-7cc64bec2ae1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:06.769447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08bc1550-13b5-4a0d-91b5-7cc64bec2ae1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.769946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08bc1550-13b5-4a0d-91b5-7cc64bec2ae1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:06.770746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08bc1550-13b5-4a0d-91b5-7cc64bec2ae1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.771195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08bc1550-13b5-4a0d-91b5-7cc64bec2ae1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:06.833052 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-08bc1550-13b5-4a0d-91b5-7cc64bec2ae1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.076704 Jan 22 21:09:06.844571 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1438/3042] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:06 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:09:06.935903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-91d6b435-80a4-4ea4-9a9c-d4af8b46ebca tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:06.944883 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-91d6b435-80a4-4ea4-9a9c-d4af8b46ebca tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1526 microversion: 2.1 time: 0.352541 Jan 22 21:09:06.945819 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1605/3043] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:06 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1526 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:06.957643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d812a6c0-cad0-4968-aa52-20c8f7cd5dbc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:06.957643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d812a6c0-cad0-4968-aa52-20c8f7cd5dbc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:06.959676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d812a6c0-cad0-4968-aa52-20c8f7cd5dbc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.960201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d812a6c0-cad0-4968-aa52-20c8f7cd5dbc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:06.961052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d812a6c0-cad0-4968-aa52-20c8f7cd5dbc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.961528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d812a6c0-cad0-4968-aa52-20c8f7cd5dbc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:06.965018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7239f878-f0e0-49fb-ab59-f80e2086a54f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:06.972533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7239f878-f0e0-49fb-ab59-f80e2086a54f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:06.973286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7239f878-f0e0-49fb-ab59-f80e2086a54f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.973957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7239f878-f0e0-49fb-ab59-f80e2086a54f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:06.975554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7239f878-f0e0-49fb-ab59-f80e2086a54f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:06.976174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7239f878-f0e0-49fb-ab59-f80e2086a54f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:07.002670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7239f878-f0e0-49fb-ab59-f80e2086a54f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:09:07.200133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d812a6c0-cad0-4968-aa52-20c8f7cd5dbc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:07.222065 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d812a6c0-cad0-4968-aa52-20c8f7cd5dbc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1321 microversion: 2.1 time: 0.279366 Jan 22 21:09:07.223830 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1439/3044] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:06 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:07.228867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a471258b-1f25-457e-8038-9b543d9ee64c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:07.229869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a471258b-1f25-457e-8038-9b543d9ee64c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:07.242504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a471258b-1f25-457e-8038-9b543d9ee64c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:07.245482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a471258b-1f25-457e-8038-9b543d9ee64c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:07.245482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a471258b-1f25-457e-8038-9b543d9ee64c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:07.245482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a471258b-1f25-457e-8038-9b543d9ee64c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:07.343211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a471258b-1f25-457e-8038-9b543d9ee64c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:07.355696 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a471258b-1f25-457e-8038-9b543d9ee64c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1274 microversion: 2.1 time: 0.130064 Jan 22 21:09:07.356643 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1440/3045] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:07 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1274 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:07.380750 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7239f878-f0e0-49fb-ab59-f80e2086a54f tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 204 len: 0 microversion: 2.1 time: 0.419493 Jan 22 21:09:07.384775 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1606/3046] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:06 2022] DELETE /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:09:07.390264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f69b404b-1490-4582-90cf-44345e84edf5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:07.391470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f69b404b-1490-4582-90cf-44345e84edf5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:07.397877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f69b404b-1490-4582-90cf-44345e84edf5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:07.398506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f69b404b-1490-4582-90cf-44345e84edf5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:07.406593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f69b404b-1490-4582-90cf-44345e84edf5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:07.406593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f69b404b-1490-4582-90cf-44345e84edf5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:07.505189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3d8da93-61d5-4e4d-8099-051f28217ec2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:07.506521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d3d8da93-61d5-4e4d-8099-051f28217ec2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:07.512893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3d8da93-61d5-4e4d-8099-051f28217ec2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:07.513356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3d8da93-61d5-4e4d-8099-051f28217ec2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:07.514201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3d8da93-61d5-4e4d-8099-051f28217ec2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:07.514650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3d8da93-61d5-4e4d-8099-051f28217ec2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:07.647795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f69b404b-1490-4582-90cf-44345e84edf5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:07.663359 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f69b404b-1490-4582-90cf-44345e84edf5 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1532 microversion: 2.1 time: 0.272181 Jan 22 21:09:07.664739 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1441/3047] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:07 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1532 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:07.670622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ef0025dc-2fd5-45a8-a88f-0561bdcaa2d1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:07.671499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ef0025dc-2fd5-45a8-a88f-0561bdcaa2d1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:07.694928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef0025dc-2fd5-45a8-a88f-0561bdcaa2d1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:07.694928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef0025dc-2fd5-45a8-a88f-0561bdcaa2d1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:07.694928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef0025dc-2fd5-45a8-a88f-0561bdcaa2d1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:07.694928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef0025dc-2fd5-45a8-a88f-0561bdcaa2d1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:08.038034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ef0025dc-2fd5-45a8-a88f-0561bdcaa2d1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:08.047831 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ef0025dc-2fd5-45a8-a88f-0561bdcaa2d1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1325 microversion: 2.1 time: 0.381473 Jan 22 21:09:08.053679 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1442/3048] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:07 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:08.058413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-319f6989-6b1e-4014-8f24-b7fa5e13af74 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:08.060233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-319f6989-6b1e-4014-8f24-b7fa5e13af74 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:08.067472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-319f6989-6b1e-4014-8f24-b7fa5e13af74 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:08.067936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-319f6989-6b1e-4014-8f24-b7fa5e13af74 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:08.068734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-319f6989-6b1e-4014-8f24-b7fa5e13af74 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:08.069177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-319f6989-6b1e-4014-8f24-b7fa5e13af74 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:08.072310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d3d8da93-61d5-4e4d-8099-051f28217ec2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:08.081044 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d3d8da93-61d5-4e4d-8099-051f28217ec2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1319 microversion: 2.1 time: 0.580060 Jan 22 21:09:08.081685 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1607/3049] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:07 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1319 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:08.102076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c023f5c6-742a-4104-80d2-5e2e44eb3807 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:08.103140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c023f5c6-742a-4104-80d2-5e2e44eb3807 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:08.114536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c023f5c6-742a-4104-80d2-5e2e44eb3807 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:08.115899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c023f5c6-742a-4104-80d2-5e2e44eb3807 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:08.117208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c023f5c6-742a-4104-80d2-5e2e44eb3807 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:08.117873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c023f5c6-742a-4104-80d2-5e2e44eb3807 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:08.145995 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-319f6989-6b1e-4014-8f24-b7fa5e13af74 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.095720 Jan 22 21:09:08.153546 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1443/3050] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:08 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:08.177608 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c023f5c6-742a-4104-80d2-5e2e44eb3807 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.086898 Jan 22 21:09:08.179694 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1608/3051] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:08 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:08.240840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a833ace2-7093-4085-a43c-8344663fc33d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:08.241449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a833ace2-7093-4085-a43c-8344663fc33d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:08.248218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a833ace2-7093-4085-a43c-8344663fc33d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:08.248956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a833ace2-7093-4085-a43c-8344663fc33d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:08.249823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a833ace2-7093-4085-a43c-8344663fc33d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:08.251055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a833ace2-7093-4085-a43c-8344663fc33d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:08.375282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-730e76a1-705a-44e1-b659-b15019e3054d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:08.376730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-730e76a1-705a-44e1-b659-b15019e3054d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:08.392654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-730e76a1-705a-44e1-b659-b15019e3054d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:08.393165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-730e76a1-705a-44e1-b659-b15019e3054d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:08.394568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-730e76a1-705a-44e1-b659-b15019e3054d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:08.395220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-730e76a1-705a-44e1-b659-b15019e3054d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:08.446974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a833ace2-7093-4085-a43c-8344663fc33d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:08.455433 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a833ace2-7093-4085-a43c-8344663fc33d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1321 microversion: 2.1 time: 0.218645 Jan 22 21:09:08.456277 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1444/3052] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:08 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:08.640244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-1b3e0063-92d2-43b8-944a-f2cd03fc9e41 req-e49e331a-843d-4f2e-b582-98a424c41607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4357d420-1aed-4d31-a61b-e95f4be3e303", "name": "network-vif-plugged", "status": "completed", "tag": "73e1e6c8-4fa4-4d3d-83b2-279e5b30b45e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:08.643925 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:08.643925 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:08.653123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1b3e0063-92d2-43b8-944a-f2cd03fc9e41 req-e49e331a-843d-4f2e-b582-98a424c41607 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:08.654030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1b3e0063-92d2-43b8-944a-f2cd03fc9e41 req-e49e331a-843d-4f2e-b582-98a424c41607 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:08.677351 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-1b3e0063-92d2-43b8-944a-f2cd03fc9e41 req-e49e331a-843d-4f2e-b582-98a424c41607 service nova] Creating event network-vif-plugged:73e1e6c8-4fa4-4d3d-83b2-279e5b30b45e for instance 4357d420-1aed-4d31-a61b-e95f4be3e303 on nch2-master-1 Jan 22 21:09:08.682838 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-1b3e0063-92d2-43b8-944a-f2cd03fc9e41 req-e49e331a-843d-4f2e-b582-98a424c41607 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059744 Jan 22 21:09:08.683798 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1445/3053] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:08.690700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-67ad873b-0990-48f7-8efa-9930264cdc21 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:08.695507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-67ad873b-0990-48f7-8efa-9930264cdc21 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:08.704128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67ad873b-0990-48f7-8efa-9930264cdc21 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:08.709069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67ad873b-0990-48f7-8efa-9930264cdc21 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:08.710324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67ad873b-0990-48f7-8efa-9930264cdc21 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:08.713932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67ad873b-0990-48f7-8efa-9930264cdc21 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:09.077142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-67ad873b-0990-48f7-8efa-9930264cdc21 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:09.086070 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-67ad873b-0990-48f7-8efa-9930264cdc21 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1532 microversion: 2.1 time: 0.400925 Jan 22 21:09:09.086680 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1446/3054] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:08 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1532 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:09.096772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7075840d-8756-4cb5-8cfe-c349cb307a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:09.097656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7075840d-8756-4cb5-8cfe-c349cb307a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:09.106310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7075840d-8756-4cb5-8cfe-c349cb307a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:09.107378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7075840d-8756-4cb5-8cfe-c349cb307a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:09.108453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7075840d-8756-4cb5-8cfe-c349cb307a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:09.109689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7075840d-8756-4cb5-8cfe-c349cb307a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:09.166772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-730e76a1-705a-44e1-b659-b15019e3054d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:09.188996 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-730e76a1-705a-44e1-b659-b15019e3054d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1316 microversion: 2.1 time: 0.811693 Jan 22 21:09:09.188996 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1609/3055] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:08 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1316 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:09.192412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f6ec2da7-3711-4e0d-b2ec-c354d73c92f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:09.194011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f6ec2da7-3711-4e0d-b2ec-c354d73c92f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:09.200698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6ec2da7-3711-4e0d-b2ec-c354d73c92f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:09.201735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6ec2da7-3711-4e0d-b2ec-c354d73c92f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:09.202868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6ec2da7-3711-4e0d-b2ec-c354d73c92f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:09.204134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6ec2da7-3711-4e0d-b2ec-c354d73c92f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:09.533600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f6ec2da7-3711-4e0d-b2ec-c354d73c92f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:09.544857 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f6ec2da7-3711-4e0d-b2ec-c354d73c92f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1319 microversion: 2.1 time: 0.359429 Jan 22 21:09:09.545439 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1610/3056] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:09 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:09.551307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bbc8855c-06f0-4b10-986d-695752accd98 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:09.552951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bbc8855c-06f0-4b10-986d-695752accd98 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:09.559661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbc8855c-06f0-4b10-986d-695752accd98 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:09.560406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbc8855c-06f0-4b10-986d-695752accd98 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:09.561356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbc8855c-06f0-4b10-986d-695752accd98 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:09.562083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbc8855c-06f0-4b10-986d-695752accd98 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:09.612840 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bbc8855c-06f0-4b10-986d-695752accd98 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.065905 Jan 22 21:09:09.614256 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1611/3057] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:09 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:09.630904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-631cc3ce-2e39-424e-97f0-96b91c6860ab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:09.632449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-631cc3ce-2e39-424e-97f0-96b91c6860ab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:09.649447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-631cc3ce-2e39-424e-97f0-96b91c6860ab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:09.651693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-631cc3ce-2e39-424e-97f0-96b91c6860ab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:09.651693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-631cc3ce-2e39-424e-97f0-96b91c6860ab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:09.652286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-631cc3ce-2e39-424e-97f0-96b91c6860ab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:09.739984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7075840d-8756-4cb5-8cfe-c349cb307a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:09.756018 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-631cc3ce-2e39-424e-97f0-96b91c6860ab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.134367 Jan 22 21:09:09.756289 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7075840d-8756-4cb5-8cfe-c349cb307a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1325 microversion: 2.1 time: 0.668250 Jan 22 21:09:09.757615 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1447/3058] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:09 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1325 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:09.758914 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1612/3059] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:09 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:09.763801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-d3b17c66-9af9-4d3a-928e-730b23c0895b req-51ede8a4-67ee-454a-9ced-f6aa509d526f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "928ef427-4b8d-4fb6-b1ff-9b99172cf1b8", "tag": "185dedd3-23dc-46aa-9214-659f5ce5e4f5"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:09.768535 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:09.768535 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:09.777599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d3b17c66-9af9-4d3a-928e-730b23c0895b req-51ede8a4-67ee-454a-9ced-f6aa509d526f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:09.778265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d3b17c66-9af9-4d3a-928e-730b23c0895b req-51ede8a4-67ee-454a-9ced-f6aa509d526f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:09.779145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3178bec-b554-4689-98e4-a3d713bf6f26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:09.780611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d3178bec-b554-4689-98e4-a3d713bf6f26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:09.791989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3178bec-b554-4689-98e4-a3d713bf6f26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:09.792883 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-d3b17c66-9af9-4d3a-928e-730b23c0895b req-51ede8a4-67ee-454a-9ced-f6aa509d526f service nova] Creating event network-changed:185dedd3-23dc-46aa-9214-659f5ce5e4f5 for instance 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 on nch1-master-1 Jan 22 21:09:09.793420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3178bec-b554-4689-98e4-a3d713bf6f26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:09.794522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3178bec-b554-4689-98e4-a3d713bf6f26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:09.796939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3178bec-b554-4689-98e4-a3d713bf6f26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:09.803142 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-d3b17c66-9af9-4d3a-928e-730b23c0895b req-51ede8a4-67ee-454a-9ced-f6aa509d526f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044046 Jan 22 21:09:09.804020 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1448/3060] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:09.816976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-709863ae-83e4-4a81-b105-0c2fdb732c61 req-f3976fcf-03a5-4fbf-911b-73649bf81ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b41b91ef-4d7d-4284-b923-7a1d415871eb", "tag": "445f9668-45bb-49e9-84e8-85d18de7750d"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:09.818995 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:09.818995 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:09.830760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-709863ae-83e4-4a81-b105-0c2fdb732c61 req-f3976fcf-03a5-4fbf-911b-73649bf81ce3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:09.831690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-709863ae-83e4-4a81-b105-0c2fdb732c61 req-f3976fcf-03a5-4fbf-911b-73649bf81ce3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:09.852748 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-709863ae-83e4-4a81-b105-0c2fdb732c61 req-f3976fcf-03a5-4fbf-911b-73649bf81ce3 service nova] Creating event network-changed:445f9668-45bb-49e9-84e8-85d18de7750d for instance b41b91ef-4d7d-4284-b923-7a1d415871eb on nch1-master-1 Jan 22 21:09:09.857662 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-709863ae-83e4-4a81-b105-0c2fdb732c61 req-f3976fcf-03a5-4fbf-911b-73649bf81ce3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052102 Jan 22 21:09:09.858262 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1449/3061] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:10.111364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d5a58759-de85-4c77-869f-b03abf6bc587 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:10.111364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d5a58759-de85-4c77-869f-b03abf6bc587 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:10.114967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5a58759-de85-4c77-869f-b03abf6bc587 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:10.115663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5a58759-de85-4c77-869f-b03abf6bc587 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:10.116711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5a58759-de85-4c77-869f-b03abf6bc587 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:10.117465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5a58759-de85-4c77-869f-b03abf6bc587 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:10.154298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d3178bec-b554-4689-98e4-a3d713bf6f26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:10.172698 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d3178bec-b554-4689-98e4-a3d713bf6f26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1321 microversion: 2.1 time: 0.405301 Jan 22 21:09:10.180502 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1613/3062] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:09 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:10.200926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f8c25bb9-33af-429c-a567-73c622f4b9d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:10.201183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f8c25bb9-33af-429c-a567-73c622f4b9d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:10.214203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f8c25bb9-33af-429c-a567-73c622f4b9d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:10.214771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f8c25bb9-33af-429c-a567-73c622f4b9d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:10.215712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f8c25bb9-33af-429c-a567-73c622f4b9d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:10.216364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f8c25bb9-33af-429c-a567-73c622f4b9d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:10.497149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d5a58759-de85-4c77-869f-b03abf6bc587 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:10.505110 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d5a58759-de85-4c77-869f-b03abf6bc587 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1532 microversion: 2.1 time: 0.405020 Jan 22 21:09:10.505725 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1450/3063] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:10 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1532 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:10.517452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f8c25bb9-33af-429c-a567-73c622f4b9d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:10.525132 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f8c25bb9-33af-429c-a567-73c622f4b9d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1316 microversion: 2.1 time: 0.328656 Jan 22 21:09:10.525738 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1614/3064] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:10 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:10.563679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6e0d4e59-c3bc-4939-8e54-5d942763e60c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:10.564476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6e0d4e59-c3bc-4939-8e54-5d942763e60c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:10.570817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e0d4e59-c3bc-4939-8e54-5d942763e60c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:10.571284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e0d4e59-c3bc-4939-8e54-5d942763e60c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:10.572084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e0d4e59-c3bc-4939-8e54-5d942763e60c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:10.572526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e0d4e59-c3bc-4939-8e54-5d942763e60c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:10.634860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4605dc9e-43b1-4125-9bba-fb4118530ae8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:10.636689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4605dc9e-43b1-4125-9bba-fb4118530ae8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:10.644297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4605dc9e-43b1-4125-9bba-fb4118530ae8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:10.645017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4605dc9e-43b1-4125-9bba-fb4118530ae8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:10.646139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4605dc9e-43b1-4125-9bba-fb4118530ae8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:10.646757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4605dc9e-43b1-4125-9bba-fb4118530ae8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:10.698502 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4605dc9e-43b1-4125-9bba-fb4118530ae8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.076399 Jan 22 21:09:10.700554 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1615/3065] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:10 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:10.710258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-93e8ed99-eb0e-4d21-8a9a-86d8fa1bb4b7 req-57e4898e-4220-4fb9-9b07-065919cf9dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd13882-2a28-4355-a3d1-606aa99e9971", "name": "network-vif-plugged", "status": "completed", "tag": "6c7f397f-1413-4f0f-9bd8-3cf8f17c8961"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:10.712127 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:10.712127 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:09:10.722684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-93e8ed99-eb0e-4d21-8a9a-86d8fa1bb4b7 req-57e4898e-4220-4fb9-9b07-065919cf9dde service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:10.723410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-93e8ed99-eb0e-4d21-8a9a-86d8fa1bb4b7 req-57e4898e-4220-4fb9-9b07-065919cf9dde service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:10.738985 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-93e8ed99-eb0e-4d21-8a9a-86d8fa1bb4b7 req-57e4898e-4220-4fb9-9b07-065919cf9dde service nova] Creating event network-vif-plugged:6c7f397f-1413-4f0f-9bd8-3cf8f17c8961 for instance afd13882-2a28-4355-a3d1-606aa99e9971 on nch1-master-1 Jan 22 21:09:10.744160 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-93e8ed99-eb0e-4d21-8a9a-86d8fa1bb4b7 req-57e4898e-4220-4fb9-9b07-065919cf9dde service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042035 Jan 22 21:09:10.751827 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1616/3066] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:10.771068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fa7576c0-a1e3-4506-9df3-62fb77c5cba4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:10.775151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fa7576c0-a1e3-4506-9df3-62fb77c5cba4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:10.779580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6e0d4e59-c3bc-4939-8e54-5d942763e60c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:10.784522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa7576c0-a1e3-4506-9df3-62fb77c5cba4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:10.785216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa7576c0-a1e3-4506-9df3-62fb77c5cba4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:10.786293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa7576c0-a1e3-4506-9df3-62fb77c5cba4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:10.787126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa7576c0-a1e3-4506-9df3-62fb77c5cba4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:10.788666 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6e0d4e59-c3bc-4939-8e54-5d942763e60c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1319 microversion: 2.1 time: 0.229429 Jan 22 21:09:10.794084 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1451/3067] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:10 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:10.804487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e009e07b-3f31-4c29-b7ce-8d5a4d11afa5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:10.810047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e009e07b-3f31-4c29-b7ce-8d5a4d11afa5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:10.838003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e009e07b-3f31-4c29-b7ce-8d5a4d11afa5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:10.840797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e009e07b-3f31-4c29-b7ce-8d5a4d11afa5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:10.841720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e009e07b-3f31-4c29-b7ce-8d5a4d11afa5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:10.844436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e009e07b-3f31-4c29-b7ce-8d5a4d11afa5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:10.868680 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fa7576c0-a1e3-4506-9df3-62fb77c5cba4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.103224 Jan 22 21:09:10.871233 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1617/3068] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:10 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:09:11.200778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-13f3cabd-4e21-4584-ac4b-d4ff95c26b56 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:11.202984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-13f3cabd-4e21-4584-ac4b-d4ff95c26b56 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:11.213445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13f3cabd-4e21-4584-ac4b-d4ff95c26b56 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:11.214024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13f3cabd-4e21-4584-ac4b-d4ff95c26b56 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:11.214929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13f3cabd-4e21-4584-ac4b-d4ff95c26b56 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:11.215618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13f3cabd-4e21-4584-ac4b-d4ff95c26b56 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:11.226623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e009e07b-3f31-4c29-b7ce-8d5a4d11afa5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:11.234104 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e009e07b-3f31-4c29-b7ce-8d5a4d11afa5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1325 microversion: 2.1 time: 0.437064 Jan 22 21:09:11.234809 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1452/3069] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:10 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1325 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:11.522515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-858cc356-2f66-4681-aaa1-c49868da580b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:11.523586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-858cc356-2f66-4681-aaa1-c49868da580b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:11.530440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-858cc356-2f66-4681-aaa1-c49868da580b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:11.530988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-858cc356-2f66-4681-aaa1-c49868da580b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:11.532896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-858cc356-2f66-4681-aaa1-c49868da580b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:11.533550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-858cc356-2f66-4681-aaa1-c49868da580b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:11.545773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13f3cabd-4e21-4584-ac4b-d4ff95c26b56 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:11.558512 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-13f3cabd-4e21-4584-ac4b-d4ff95c26b56 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1471 microversion: 2.1 time: 0.365442 Jan 22 21:09:11.575056 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1618/3070] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:11 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1471 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:11.583945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7e26c074-de34-4055-ab82-77e1c2cebe40 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:11.584551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7e26c074-de34-4055-ab82-77e1c2cebe40 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:11.599467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e26c074-de34-4055-ab82-77e1c2cebe40 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:11.600020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e26c074-de34-4055-ab82-77e1c2cebe40 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:11.602944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e26c074-de34-4055-ab82-77e1c2cebe40 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:11.603459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e26c074-de34-4055-ab82-77e1c2cebe40 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:11.625424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-858cc356-2f66-4681-aaa1-c49868da580b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:11.625918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-858cc356-2f66-4681-aaa1-c49868da580b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:11.626390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-858cc356-2f66-4681-aaa1-c49868da580b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lazy-loading 'fault' on Instance uuid c59a6dad-848f-4c14-8c58-79bfe47dfa7f {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:09:11.684694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-858cc356-2f66-4681-aaa1-c49868da580b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e63df9a38aaf47338df65d3bf0d5aa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfedf205c9e44aa1989b307d2b400b50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:11.696833 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-858cc356-2f66-4681-aaa1-c49868da580b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 200 len: 1319 microversion: 2.1 time: 0.178811 Jan 22 21:09:11.697426 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1453/3071] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:11 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:11.702523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-10da9ff2-223c-4ddd-8355-c06fb3d637db tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:11.703877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-10da9ff2-223c-4ddd-8355-c06fb3d637db tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:11.714144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10da9ff2-223c-4ddd-8355-c06fb3d637db tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:11.714699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10da9ff2-223c-4ddd-8355-c06fb3d637db tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:11.715648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10da9ff2-223c-4ddd-8355-c06fb3d637db tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:11.716172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10da9ff2-223c-4ddd-8355-c06fb3d637db tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:11.874815 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-10da9ff2-223c-4ddd-8355-c06fb3d637db tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1622 microversion: 2.1 time: 0.176122 Jan 22 21:09:11.877829 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1454/3072] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:11 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1622 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:11.889908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff2c7016-53b8-44d2-97cd-fa4c55b64d9b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:11.889908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ff2c7016-53b8-44d2-97cd-fa4c55b64d9b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:11.889908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff2c7016-53b8-44d2-97cd-fa4c55b64d9b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:11.889908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff2c7016-53b8-44d2-97cd-fa4c55b64d9b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:11.890576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff2c7016-53b8-44d2-97cd-fa4c55b64d9b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:11.891377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff2c7016-53b8-44d2-97cd-fa4c55b64d9b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:11.895614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7e26c074-de34-4055-ab82-77e1c2cebe40 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:11.908438 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7e26c074-de34-4055-ab82-77e1c2cebe40 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1316 microversion: 2.1 time: 0.332532 Jan 22 21:09:11.909588 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1619/3073] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:11 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:11.916883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-13c2b399-d3e5-4708-b76a-352d10038b65 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:11.918155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-13c2b399-d3e5-4708-b76a-352d10038b65 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:11.930117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13c2b399-d3e5-4708-b76a-352d10038b65 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:11.930766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13c2b399-d3e5-4708-b76a-352d10038b65 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:11.934308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13c2b399-d3e5-4708-b76a-352d10038b65 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:11.934308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13c2b399-d3e5-4708-b76a-352d10038b65 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:11.962874 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff2c7016-53b8-44d2-97cd-fa4c55b64d9b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.083719 Jan 22 21:09:11.967515 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1455/3074] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:11 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:11.973914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-7d7da975-1af1-4de3-8a29-a3698afb42d0 req-6dc45c7d-2be7-423a-b39f-c858fcf8cb65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c59a6dad-848f-4c14-8c58-79bfe47dfa7f", "name": "network-vif-deleted", "tag": "b0679c08-5a5d-44c4-b58c-f45e0cdbd6a2"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:11.975379 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:11.975379 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:11.983541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7d7da975-1af1-4de3-8a29-a3698afb42d0 req-6dc45c7d-2be7-423a-b39f-c858fcf8cb65 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:11.983993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7d7da975-1af1-4de3-8a29-a3698afb42d0 req-6dc45c7d-2be7-423a-b39f-c858fcf8cb65 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:11.995344 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-7d7da975-1af1-4de3-8a29-a3698afb42d0 req-6dc45c7d-2be7-423a-b39f-c858fcf8cb65 service nova] Creating event network-vif-deleted:b0679c08-5a5d-44c4-b58c-f45e0cdbd6a2 for instance c59a6dad-848f-4c14-8c58-79bfe47dfa7f on nch1-master-1 Jan 22 21:09:12.002434 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-7d7da975-1af1-4de3-8a29-a3698afb42d0 req-6dc45c7d-2be7-423a-b39f-c858fcf8cb65 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033415 Jan 22 21:09:12.003039 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1456/3075] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:12.008008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-164254b6-68cd-4a41-89f7-7c29182d26c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:12.009004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-164254b6-68cd-4a41-89f7-7c29182d26c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:12.015155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-164254b6-68cd-4a41-89f7-7c29182d26c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:12.015605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-164254b6-68cd-4a41-89f7-7c29182d26c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:12.016959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-164254b6-68cd-4a41-89f7-7c29182d26c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:12.017402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-164254b6-68cd-4a41-89f7-7c29182d26c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:12.072222 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-164254b6-68cd-4a41-89f7-7c29182d26c2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.067764 Jan 22 21:09:12.076601 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1457/3076] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:12 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:12.079379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1851558006", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "7eef2b3f-a335-4858-b070-58323035fc67"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:12.132266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:09:12.249015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13c2b399-d3e5-4708-b76a-352d10038b65 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:12.258170 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-13c2b399-d3e5-4708-b76a-352d10038b65 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1319 microversion: 2.1 time: 0.347215 Jan 22 21:09:12.258750 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1620/3077] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:11 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:12.269721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-58880b14-fb07-4f43-9fde-a27b310f1861 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:12.269721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-58880b14-fb07-4f43-9fde-a27b310f1861 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:12.270853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58880b14-fb07-4f43-9fde-a27b310f1861 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:12.271454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58880b14-fb07-4f43-9fde-a27b310f1861 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:12.272257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58880b14-fb07-4f43-9fde-a27b310f1861 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:12.272705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58880b14-fb07-4f43-9fde-a27b310f1861 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:12.362581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:09:12.363266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:09:12.363858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:09:12.364939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:09:12.365566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:09:12.376036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:12.378680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:12.378680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:12.378680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:12.396355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for project 1e6094793b214ae7af6611b1571cac3d. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:09:12.401697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Getting quotas for user 9563c1341fd64da5855a2f0e72086d41 and project 1e6094793b214ae7af6611b1571cac3d. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:09:12.414688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:09:12.417128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:09:12.529420 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-94888457-3633-4ebc-a24c-59a0e6139670 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.455058 Jan 22 21:09:12.530396 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1458/3078] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:12 2022] POST /compute/v2.1/servers => generated 382 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:09:12.541423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ae67538d-4316-40b0-8fc1-035a5baf204b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:12.542785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ae67538d-4316-40b0-8fc1-035a5baf204b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:12.565786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-58880b14-fb07-4f43-9fde-a27b310f1861 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:12.578624 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-58880b14-fb07-4f43-9fde-a27b310f1861 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1325 microversion: 2.1 time: 0.318711 Jan 22 21:09:12.580168 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1621/3079] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:12 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1325 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:12.599446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ae67538d-4316-40b0-8fc1-035a5baf204b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:12.606073 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ae67538d-4316-40b0-8fc1-035a5baf204b tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1221 microversion: 2.1 time: 0.068762 Jan 22 21:09:12.607043 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1459/3080] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:12 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1221 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:12.722091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bcbf952f-7aed-47eb-826b-5caa30a8af8b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:12.722759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bcbf952f-7aed-47eb-826b-5caa30a8af8b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c59a6dad-848f-4c14-8c58-79bfe47dfa7f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:12.731188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcbf952f-7aed-47eb-826b-5caa30a8af8b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:12.731627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcbf952f-7aed-47eb-826b-5caa30a8af8b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:12.732428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcbf952f-7aed-47eb-826b-5caa30a8af8b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:12.732871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcbf952f-7aed-47eb-826b-5caa30a8af8b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:12.747523 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-bcbf952f-7aed-47eb-826b-5caa30a8af8b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] HTTP exception thrown: Instance c59a6dad-848f-4c14-8c58-79bfe47dfa7f could not be found. Jan 22 21:09:12.748147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bcbf952f-7aed-47eb-826b-5caa30a8af8b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Returning 404 to user: Instance c59a6dad-848f-4c14-8c58-79bfe47dfa7f could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:12.751643 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bcbf952f-7aed-47eb-826b-5caa30a8af8b tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f" status: 404 len: 111 microversion: 2.1 time: 0.031262 Jan 22 21:09:12.751643 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1622/3081] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:12 2022] GET /compute/v2.1/servers/c59a6dad-848f-4c14-8c58-79bfe47dfa7f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:12.758137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-53fff13c-4587-4232-bb9a-a029c2a1ccd1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '.version_select at 0x7f1edae05b80>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:12.779432 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-53fff13c-4587-4232-bb9a-a029c2a1ccd1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] HTTP exception thrown: Image not found. Jan 22 21:09:12.780378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-53fff13c-4587-4232-bb9a-a029c2a1ccd1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Returning 404 to user: Image not found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:12.782441 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-53fff13c-4587-4232-bb9a-a029c2a1ccd1 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "DELETE /compute/v2.1/images/dcf534f1-d01a-49a8-ba9e-b5892a1dcf6c" status: 404 len: 62 microversion: 2.1 time: 0.027246 Jan 22 21:09:12.783320 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1460/3082] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:12 2022] DELETE /compute/v2.1/images/dcf534f1-d01a-49a8-ba9e-b5892a1dcf6c => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:09:12.791185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-39039345-e72f-4101-a963-aaca7d647dfc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:12.791775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-39039345-e72f-4101-a963-aaca7d647dfc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:12.799468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39039345-e72f-4101-a963-aaca7d647dfc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:12.799966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39039345-e72f-4101-a963-aaca7d647dfc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:12.800854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39039345-e72f-4101-a963-aaca7d647dfc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:12.801418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39039345-e72f-4101-a963-aaca7d647dfc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:12.817452 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-39039345-e72f-4101-a963-aaca7d647dfc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] HTTP exception thrown: Instance c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e could not be found. Jan 22 21:09:12.818087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-39039345-e72f-4101-a963-aaca7d647dfc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Returning 404 to user: Instance c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:12.818938 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-39039345-e72f-4101-a963-aaca7d647dfc tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 404 len: 111 microversion: 2.1 time: 0.031555 Jan 22 21:09:12.819831 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1623/3083] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:12 2022] DELETE /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:12.827468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-04909cca-2fb1-442a-9875-6e9d4f5f191e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:12.828321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-04909cca-2fb1-442a-9875-6e9d4f5f191e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:12.844867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04909cca-2fb1-442a-9875-6e9d4f5f191e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:12.845704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04909cca-2fb1-442a-9875-6e9d4f5f191e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:12.846591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04909cca-2fb1-442a-9875-6e9d4f5f191e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:12.847350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04909cca-2fb1-442a-9875-6e9d4f5f191e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:12.864628 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-04909cca-2fb1-442a-9875-6e9d4f5f191e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] HTTP exception thrown: Instance c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e could not be found. Jan 22 21:09:12.868149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-04909cca-2fb1-442a-9875-6e9d4f5f191e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Returning 404 to user: Instance c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:12.868149 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-04909cca-2fb1-442a-9875-6e9d4f5f191e tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e" status: 404 len: 111 microversion: 2.1 time: 0.042287 Jan 22 21:09:12.868149 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1461/3084] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:12 2022] GET /compute/v2.1/servers/c6e6ccce-7e4f-4672-b80d-bf0b3a6eca7e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:12.875023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e0e726a4-0628-4996-9ce3-ea2c025ac630 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '.version_select at 0x7f1edaf38670>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:12.926578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c191c3b7-9665-4b7c-bebe-7740e0afef3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:12.927308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c191c3b7-9665-4b7c-bebe-7740e0afef3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:12.934089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c191c3b7-9665-4b7c-bebe-7740e0afef3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:12.934629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c191c3b7-9665-4b7c-bebe-7740e0afef3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:12.935503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c191c3b7-9665-4b7c-bebe-7740e0afef3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:12.936032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c191c3b7-9665-4b7c-bebe-7740e0afef3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:13.011279 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e0e726a4-0628-4996-9ce3-ea2c025ac630 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-485820886" status: 202 len: 0 microversion: 2.1 time: 0.139551 Jan 22 21:09:13.018160 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1624/3085] 10.222.0.100 () {58 vars in 1222 bytes} [Sat Jan 22 21:09:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-485820886 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:13.019630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3079d985-e147-4791-99c8-453492739778 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:13.020848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3079d985-e147-4791-99c8-453492739778 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:13.030697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3079d985-e147-4791-99c8-453492739778 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:13.032406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3079d985-e147-4791-99c8-453492739778 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:13.033781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3079d985-e147-4791-99c8-453492739778 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:13.034771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3079d985-e147-4791-99c8-453492739778 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:13.089895 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3079d985-e147-4791-99c8-453492739778 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.075246 Jan 22 21:09:13.091403 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1625/3086] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:13 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:13.098722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-450714fc-c076-4037-8f01-0b085cbb5dc4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:13.100647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-450714fc-c076-4037-8f01-0b085cbb5dc4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:13.114094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-450714fc-c076-4037-8f01-0b085cbb5dc4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:13.115692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-450714fc-c076-4037-8f01-0b085cbb5dc4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:13.118020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-450714fc-c076-4037-8f01-0b085cbb5dc4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:13.121968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-450714fc-c076-4037-8f01-0b085cbb5dc4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:13.151943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c191c3b7-9665-4b7c-bebe-7740e0afef3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:13.161600 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c191c3b7-9665-4b7c-bebe-7740e0afef3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1316 microversion: 2.1 time: 0.239552 Jan 22 21:09:13.162207 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1462/3087] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:12 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:13.185037 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-450714fc-c076-4037-8f01-0b085cbb5dc4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.091351 Jan 22 21:09:13.186144 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1626/3088] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:13 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:13.275616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5fda1676-0243-4fca-b3ec-677709bfc720 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:13.276248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5fda1676-0243-4fca-b3ec-677709bfc720 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:13.284421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fda1676-0243-4fca-b3ec-677709bfc720 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:13.284885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fda1676-0243-4fca-b3ec-677709bfc720 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:13.285915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fda1676-0243-4fca-b3ec-677709bfc720 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:13.286415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fda1676-0243-4fca-b3ec-677709bfc720 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:13.595160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5fda1676-0243-4fca-b3ec-677709bfc720 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:13.608073 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5fda1676-0243-4fca-b3ec-677709bfc720 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1508 microversion: 2.1 time: 0.336139 Jan 22 21:09:13.609005 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1463/3089] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:13 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1508 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:13.613891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cc132cda-bdc8-468b-a9fe-fdf6a04d5ef1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:13.614635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cc132cda-bdc8-468b-a9fe-fdf6a04d5ef1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:13.629801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc132cda-bdc8-468b-a9fe-fdf6a04d5ef1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:13.630269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc132cda-bdc8-468b-a9fe-fdf6a04d5ef1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:13.631171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc132cda-bdc8-468b-a9fe-fdf6a04d5ef1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:13.631610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc132cda-bdc8-468b-a9fe-fdf6a04d5ef1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:13.634403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-489e0c42-02e7-477b-b870-3a28e8ffa4c6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:13.637559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-489e0c42-02e7-477b-b870-3a28e8ffa4c6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:13.657064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-489e0c42-02e7-477b-b870-3a28e8ffa4c6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:13.658136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-489e0c42-02e7-477b-b870-3a28e8ffa4c6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:13.659030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-489e0c42-02e7-477b-b870-3a28e8ffa4c6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:13.659736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-489e0c42-02e7-477b-b870-3a28e8ffa4c6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:13.754610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-489e0c42-02e7-477b-b870-3a28e8ffa4c6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:13.766757 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-489e0c42-02e7-477b-b870-3a28e8ffa4c6 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1225 microversion: 2.1 time: 0.143668 Jan 22 21:09:13.768800 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1464/3090] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:13 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1225 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:13.774988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d33b43fd-d925-4b17-9dd1-af82435c04da tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:13.777104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d33b43fd-d925-4b17-9dd1-af82435c04da tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:13.790124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d33b43fd-d925-4b17-9dd1-af82435c04da tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:13.791004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d33b43fd-d925-4b17-9dd1-af82435c04da tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:13.792307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d33b43fd-d925-4b17-9dd1-af82435c04da tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:13.803947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d33b43fd-d925-4b17-9dd1-af82435c04da tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:13.837478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d33b43fd-d925-4b17-9dd1-af82435c04da tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:09:13.892050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cc132cda-bdc8-468b-a9fe-fdf6a04d5ef1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:13.900819 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cc132cda-bdc8-468b-a9fe-fdf6a04d5ef1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1325 microversion: 2.1 time: 0.307153 Jan 22 21:09:13.913978 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1627/3091] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:13 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1325 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:14.103145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ec82a6eb-50fb-46da-8bf8-45d317ded151 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:14.104421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ec82a6eb-50fb-46da-8bf8-45d317ded151 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:14.120105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec82a6eb-50fb-46da-8bf8-45d317ded151 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.120970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec82a6eb-50fb-46da-8bf8-45d317ded151 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:14.123184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec82a6eb-50fb-46da-8bf8-45d317ded151 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.124400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec82a6eb-50fb-46da-8bf8-45d317ded151 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:14.211248 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ec82a6eb-50fb-46da-8bf8-45d317ded151 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.113082 Jan 22 21:09:14.212492 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1628/3092] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:14 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:14.219779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b17b42d-5659-469a-93b1-484ff53b18e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:14.220506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6b17b42d-5659-469a-93b1-484ff53b18e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:14.228043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b17b42d-5659-469a-93b1-484ff53b18e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.232420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b17b42d-5659-469a-93b1-484ff53b18e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:14.232420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b17b42d-5659-469a-93b1-484ff53b18e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.232420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b17b42d-5659-469a-93b1-484ff53b18e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:14.379612 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d33b43fd-d925-4b17-9dd1-af82435c04da tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "DELETE /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 204 len: 0 microversion: 2.1 time: 0.605793 Jan 22 21:09:14.380576 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1465/3093] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:13 2022] DELETE /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:09:14.386754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f16f9756-ed6a-4d56-a5c1-99147cc02e21 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:14.388122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f16f9756-ed6a-4d56-a5c1-99147cc02e21 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:14.397675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f16f9756-ed6a-4d56-a5c1-99147cc02e21 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.398248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f16f9756-ed6a-4d56-a5c1-99147cc02e21 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:14.399248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f16f9756-ed6a-4d56-a5c1-99147cc02e21 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.399794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f16f9756-ed6a-4d56-a5c1-99147cc02e21 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:14.447549 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f16f9756-ed6a-4d56-a5c1-99147cc02e21 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.065262 Jan 22 21:09:14.451563 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1466/3094] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:14 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:14.453434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-72f108ec-19a8-49a5-9336-284c9a7cd0d7 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '.version_select at 0x7f1ed5449af0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:14.477744 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-72f108ec-19a8-49a5-9336-284c9a7cd0d7 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] HTTP exception thrown: Image not found. Jan 22 21:09:14.478354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-72f108ec-19a8-49a5-9336-284c9a7cd0d7 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Returning 404 to user: Image not found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:14.479230 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-72f108ec-19a8-49a5-9336-284c9a7cd0d7 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "DELETE /compute/v2.1/images/fac0639a-8270-45a7-af74-9fcede4b27e0" status: 404 len: 62 microversion: 2.1 time: 0.029668 Jan 22 21:09:14.479792 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1467/3095] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:14 2022] DELETE /compute/v2.1/images/fac0639a-8270-45a7-af74-9fcede4b27e0 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:09:14.486823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-acda8933-e09d-4fa2-ac02-b66ae2756f4a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:14.487561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-acda8933-e09d-4fa2-ac02-b66ae2756f4a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:14.488753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6b17b42d-5659-469a-93b1-484ff53b18e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:14.494206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acda8933-e09d-4fa2-ac02-b66ae2756f4a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.494670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acda8933-e09d-4fa2-ac02-b66ae2756f4a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:14.495474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acda8933-e09d-4fa2-ac02-b66ae2756f4a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.495921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acda8933-e09d-4fa2-ac02-b66ae2756f4a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:14.498183 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b17b42d-5659-469a-93b1-484ff53b18e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1316 microversion: 2.1 time: 0.284500 Jan 22 21:09:14.503446 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1629/3096] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:14 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:14.505406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74b57b1d-00af-434d-9260-9737a40b18d3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:14.505959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-74b57b1d-00af-434d-9260-9737a40b18d3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:14.512252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b57b1d-00af-434d-9260-9737a40b18d3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.512966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b57b1d-00af-434d-9260-9737a40b18d3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:14.514003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b57b1d-00af-434d-9260-9737a40b18d3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.520892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b57b1d-00af-434d-9260-9737a40b18d3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:14.540665 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-74b57b1d-00af-434d-9260-9737a40b18d3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] HTTP exception thrown: Instance 9dd17fd5-afdd-4c9d-b3f4-37e074b52164 could not be found. Jan 22 21:09:14.541268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74b57b1d-00af-434d-9260-9737a40b18d3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Returning 404 to user: Instance 9dd17fd5-afdd-4c9d-b3f4-37e074b52164 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:14.542433 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-74b57b1d-00af-434d-9260-9737a40b18d3 tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "DELETE /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 404 len: 111 microversion: 2.1 time: 0.042064 Jan 22 21:09:14.543342 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1630/3097] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:14 2022] DELETE /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:14.552012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c89f0290-545c-4c6e-a571-2b9c7d0f04bb tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:14.552641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c89f0290-545c-4c6e-a571-2b9c7d0f04bb tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] [instance: 9dd17fd5-afdd-4c9d-b3f4-37e074b52164] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:14.559804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c89f0290-545c-4c6e-a571-2b9c7d0f04bb tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.559804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c89f0290-545c-4c6e-a571-2b9c7d0f04bb tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:14.560655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c89f0290-545c-4c6e-a571-2b9c7d0f04bb tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.560966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c89f0290-545c-4c6e-a571-2b9c7d0f04bb tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:14.576665 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-c89f0290-545c-4c6e-a571-2b9c7d0f04bb tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] HTTP exception thrown: Instance 9dd17fd5-afdd-4c9d-b3f4-37e074b52164 could not be found. Jan 22 21:09:14.577272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c89f0290-545c-4c6e-a571-2b9c7d0f04bb tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] Returning 404 to user: Instance 9dd17fd5-afdd-4c9d-b3f4-37e074b52164 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:14.578703 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c89f0290-545c-4c6e-a571-2b9c7d0f04bb tempest-ImagesOneServerNegativeTestJSON-1351312241 tempest-ImagesOneServerNegativeTestJSON-1351312241-project] 10.222.0.100 "GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164" status: 404 len: 111 microversion: 2.1 time: 0.030861 Jan 22 21:09:14.579772 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1631/3098] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:14 2022] GET /compute/v2.1/servers/9dd17fd5-afdd-4c9d-b3f4-37e074b52164 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:14.770331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-acda8933-e09d-4fa2-ac02-b66ae2756f4a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:14.784506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-29d8a77f-b2e1-4a57-b221-54c67239f018 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:14.785548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-29d8a77f-b2e1-4a57-b221-54c67239f018 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:14.792448 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-acda8933-e09d-4fa2-ac02-b66ae2756f4a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1514 microversion: 2.1 time: 0.311554 Jan 22 21:09:14.796183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29d8a77f-b2e1-4a57-b221-54c67239f018 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.796651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29d8a77f-b2e1-4a57-b221-54c67239f018 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:14.797809 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1468/3099] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:14 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1514 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:14.808943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29d8a77f-b2e1-4a57-b221-54c67239f018 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.809731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29d8a77f-b2e1-4a57-b221-54c67239f018 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:14.916545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-29d8a77f-b2e1-4a57-b221-54c67239f018 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:14.919790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8118ec6f-3d7e-423b-a143-5283c13a9b80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:14.922256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8118ec6f-3d7e-423b-a143-5283c13a9b80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:14.930362 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-29d8a77f-b2e1-4a57-b221-54c67239f018 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1273 microversion: 2.1 time: 0.149839 Jan 22 21:09:14.930689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8118ec6f-3d7e-423b-a143-5283c13a9b80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.930953 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1632/3100] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:14 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:14.942290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8118ec6f-3d7e-423b-a143-5283c13a9b80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:14.943165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8118ec6f-3d7e-423b-a143-5283c13a9b80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:14.943612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8118ec6f-3d7e-423b-a143-5283c13a9b80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:15.224208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4bcb0578-6acb-4254-bfba-3a4879f53322 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:15.225733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4bcb0578-6acb-4254-bfba-3a4879f53322 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:15.233541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bcb0578-6acb-4254-bfba-3a4879f53322 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:15.234062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bcb0578-6acb-4254-bfba-3a4879f53322 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:15.235513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bcb0578-6acb-4254-bfba-3a4879f53322 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:15.235961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bcb0578-6acb-4254-bfba-3a4879f53322 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:15.286877 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4bcb0578-6acb-4254-bfba-3a4879f53322 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.066942 Jan 22 21:09:15.288332 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1633/3101] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:15 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:15.407606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8118ec6f-3d7e-423b-a143-5283c13a9b80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:15.415237 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8118ec6f-3d7e-423b-a143-5283c13a9b80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1325 microversion: 2.1 time: 0.500041 Jan 22 21:09:15.415820 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1469/3102] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:14 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1325 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:15.461805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-44cb394a-12c9-4e79-980a-fed0391dcee3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:15.463043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-44cb394a-12c9-4e79-980a-fed0391dcee3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:15.471222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44cb394a-12c9-4e79-980a-fed0391dcee3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:15.471755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44cb394a-12c9-4e79-980a-fed0391dcee3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:15.472653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44cb394a-12c9-4e79-980a-fed0391dcee3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:15.473163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44cb394a-12c9-4e79-980a-fed0391dcee3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:15.519095 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-44cb394a-12c9-4e79-980a-fed0391dcee3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.061874 Jan 22 21:09:15.520162 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1634/3103] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:15 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:15.526921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-beb25554-83d2-4795-9358-3d7686faef6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:15.527377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-beb25554-83d2-4795-9358-3d7686faef6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:15.539722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-beb25554-83d2-4795-9358-3d7686faef6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:15.539722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-beb25554-83d2-4795-9358-3d7686faef6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:15.543317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-beb25554-83d2-4795-9358-3d7686faef6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:15.543317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-beb25554-83d2-4795-9358-3d7686faef6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:15.716795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-beb25554-83d2-4795-9358-3d7686faef6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:15.737928 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-beb25554-83d2-4795-9358-3d7686faef6f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1316 microversion: 2.1 time: 0.221729 Jan 22 21:09:15.739994 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1470/3104] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:15 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:15.815745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b9612b2f-e96e-445f-bc2f-68094c1f6e25 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:15.817288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b9612b2f-e96e-445f-bc2f-68094c1f6e25 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:15.824537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9612b2f-e96e-445f-bc2f-68094c1f6e25 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:15.825216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9612b2f-e96e-445f-bc2f-68094c1f6e25 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:15.826075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9612b2f-e96e-445f-bc2f-68094c1f6e25 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:15.826515 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9612b2f-e96e-445f-bc2f-68094c1f6e25 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:15.949055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d8294713-6773-4d81-a97b-813feae581f2 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:15.950206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d8294713-6773-4d81-a97b-813feae581f2 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:15.961139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8294713-6773-4d81-a97b-813feae581f2 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:15.967646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8294713-6773-4d81-a97b-813feae581f2 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:15.967646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8294713-6773-4d81-a97b-813feae581f2 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:15.967646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8294713-6773-4d81-a97b-813feae581f2 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:16.028787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b9612b2f-e96e-445f-bc2f-68094c1f6e25 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:16.037452 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b9612b2f-e96e-445f-bc2f-68094c1f6e25 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1514 microversion: 2.1 time: 0.226382 Jan 22 21:09:16.044913 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1635/3105] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:15 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:16.052027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d8294713-6773-4d81-a97b-813feae581f2 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:16.060861 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d8294713-6773-4d81-a97b-813feae581f2 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1279 microversion: 2.1 time: 0.116435 Jan 22 21:09:16.061437 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1471/3106] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:15 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1279 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:16.301309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-18ce2165-7ff4-4cd1-85c9-7dc7a4dd1e27 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:16.302650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-18ce2165-7ff4-4cd1-85c9-7dc7a4dd1e27 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:16.313456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18ce2165-7ff4-4cd1-85c9-7dc7a4dd1e27 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:16.314868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18ce2165-7ff4-4cd1-85c9-7dc7a4dd1e27 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:16.316232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18ce2165-7ff4-4cd1-85c9-7dc7a4dd1e27 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:16.317287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18ce2165-7ff4-4cd1-85c9-7dc7a4dd1e27 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:16.384888 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-18ce2165-7ff4-4cd1-85c9-7dc7a4dd1e27 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.088047 Jan 22 21:09:16.394830 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1636/3107] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:16 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:16.448381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ef2ca7f1-aa2b-4eff-af1a-99840559bd5e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:16.449265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ef2ca7f1-aa2b-4eff-af1a-99840559bd5e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:16.461953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef2ca7f1-aa2b-4eff-af1a-99840559bd5e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:16.462612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef2ca7f1-aa2b-4eff-af1a-99840559bd5e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:16.464163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef2ca7f1-aa2b-4eff-af1a-99840559bd5e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:16.466071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef2ca7f1-aa2b-4eff-af1a-99840559bd5e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:16.532452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2b1f3867-9e36-4716-9250-a333fe4ada20 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:16.533443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2b1f3867-9e36-4716-9250-a333fe4ada20 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:16.548808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b1f3867-9e36-4716-9250-a333fe4ada20 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:16.549273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b1f3867-9e36-4716-9250-a333fe4ada20 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:16.551234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b1f3867-9e36-4716-9250-a333fe4ada20 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:16.552761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b1f3867-9e36-4716-9250-a333fe4ada20 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:16.603473 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2b1f3867-9e36-4716-9250-a333fe4ada20 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.074685 Jan 22 21:09:16.604474 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1637/3108] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:16 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:16.758044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-033d61f8-1b5e-40c7-a73c-0d4e27d11823 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:16.759091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-033d61f8-1b5e-40c7-a73c-0d4e27d11823 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:16.773649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-033d61f8-1b5e-40c7-a73c-0d4e27d11823 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:16.778148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-033d61f8-1b5e-40c7-a73c-0d4e27d11823 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:16.778688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-033d61f8-1b5e-40c7-a73c-0d4e27d11823 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:16.779392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-033d61f8-1b5e-40c7-a73c-0d4e27d11823 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:16.815868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ef2ca7f1-aa2b-4eff-af1a-99840559bd5e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:16.837574 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ef2ca7f1-aa2b-4eff-af1a-99840559bd5e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1325 microversion: 2.1 time: 0.395553 Jan 22 21:09:16.838498 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1472/3109] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:16 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1325 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:16.909168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-77c4431c-b5f1-474a-b90a-78afbb52b4b3 req-01c9fbfe-6d3f-4357-b8fa-cbe72f90d9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928ef427-4b8d-4fb6-b1ff-9b99172cf1b8", "name": "network-vif-plugged", "status": "completed", "tag": "185dedd3-23dc-46aa-9214-659f5ce5e4f5"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:16.910993 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:16.910993 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:16.927847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-77c4431c-b5f1-474a-b90a-78afbb52b4b3 req-01c9fbfe-6d3f-4357-b8fa-cbe72f90d9ca service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:16.927847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-77c4431c-b5f1-474a-b90a-78afbb52b4b3 req-01c9fbfe-6d3f-4357-b8fa-cbe72f90d9ca service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:16.955062 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-77c4431c-b5f1-474a-b90a-78afbb52b4b3 req-01c9fbfe-6d3f-4357-b8fa-cbe72f90d9ca service nova] Creating event network-vif-plugged:185dedd3-23dc-46aa-9214-659f5ce5e4f5 for instance 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 on nch1-master-1 Jan 22 21:09:16.965986 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-77c4431c-b5f1-474a-b90a-78afbb52b4b3 req-01c9fbfe-6d3f-4357-b8fa-cbe72f90d9ca service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060802 Jan 22 21:09:16.967301 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1473/3110] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:09:16.973638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-151d91f4-3238-4138-bdc1-890c33fe2075 req-1af509f0-1edd-47d7-88dd-80e5bca60ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd13882-2a28-4355-a3d1-606aa99e9971", "name": "network-vif-deleted", "tag": "6c7f397f-1413-4f0f-9bd8-3cf8f17c8961"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:16.975161 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:16.975161 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:17.035245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-151d91f4-3238-4138-bdc1-890c33fe2075 req-1af509f0-1edd-47d7-88dd-80e5bca60ab5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:17.035998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-151d91f4-3238-4138-bdc1-890c33fe2075 req-1af509f0-1edd-47d7-88dd-80e5bca60ab5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:17.056282 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-151d91f4-3238-4138-bdc1-890c33fe2075 req-1af509f0-1edd-47d7-88dd-80e5bca60ab5 service nova] Creating event network-vif-deleted:6c7f397f-1413-4f0f-9bd8-3cf8f17c8961 for instance afd13882-2a28-4355-a3d1-606aa99e9971 on nch1-master-1 Jan 22 21:09:17.062144 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-151d91f4-3238-4138-bdc1-890c33fe2075 req-1af509f0-1edd-47d7-88dd-80e5bca60ab5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093273 Jan 22 21:09:17.064108 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1474/3111] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:17.069410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8247d08a-ab72-4b6d-ab86-c87e3074ae76 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:17.070266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8247d08a-ab72-4b6d-ab86-c87e3074ae76 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:17.087317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8247d08a-ab72-4b6d-ab86-c87e3074ae76 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:17.088020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8247d08a-ab72-4b6d-ab86-c87e3074ae76 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:17.089603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8247d08a-ab72-4b6d-ab86-c87e3074ae76 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:17.090236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8247d08a-ab72-4b6d-ab86-c87e3074ae76 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:17.146043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-033d61f8-1b5e-40c7-a73c-0d4e27d11823 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:17.158909 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-033d61f8-1b5e-40c7-a73c-0d4e27d11823 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1316 microversion: 2.1 time: 0.405803 Jan 22 21:09:17.161983 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1638/3112] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:16 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:17.166906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-167e8737-8cfe-4ec2-913a-c6c3a32cfbb8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:17.167793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-167e8737-8cfe-4ec2-913a-c6c3a32cfbb8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:17.179502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-167e8737-8cfe-4ec2-913a-c6c3a32cfbb8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:17.180309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-167e8737-8cfe-4ec2-913a-c6c3a32cfbb8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:17.181835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-167e8737-8cfe-4ec2-913a-c6c3a32cfbb8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:17.182751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-167e8737-8cfe-4ec2-913a-c6c3a32cfbb8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:17.245160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8247d08a-ab72-4b6d-ab86-c87e3074ae76 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:17.256082 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8247d08a-ab72-4b6d-ab86-c87e3074ae76 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1472 microversion: 2.1 time: 0.190519 Jan 22 21:09:17.257847 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1475/3113] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:17 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:17.401631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bfd2f332-fb26-49c4-b049-d7c40aca4f09 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:17.402612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bfd2f332-fb26-49c4-b049-d7c40aca4f09 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:17.420598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfd2f332-fb26-49c4-b049-d7c40aca4f09 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:17.422941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfd2f332-fb26-49c4-b049-d7c40aca4f09 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:17.428187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfd2f332-fb26-49c4-b049-d7c40aca4f09 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:17.429911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfd2f332-fb26-49c4-b049-d7c40aca4f09 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:17.552629 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bfd2f332-fb26-49c4-b049-d7c40aca4f09 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.148049 Jan 22 21:09:17.552629 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1476/3114] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:17 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:17.616864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aa8d90a2-3922-4101-beb3-aecf3c55c344 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:17.618634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aa8d90a2-3922-4101-beb3-aecf3c55c344 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:17.631310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa8d90a2-3922-4101-beb3-aecf3c55c344 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:17.631793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa8d90a2-3922-4101-beb3-aecf3c55c344 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:17.634572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa8d90a2-3922-4101-beb3-aecf3c55c344 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:17.635101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa8d90a2-3922-4101-beb3-aecf3c55c344 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:17.679859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-167e8737-8cfe-4ec2-913a-c6c3a32cfbb8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:17.688727 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-167e8737-8cfe-4ec2-913a-c6c3a32cfbb8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1321 microversion: 2.1 time: 0.525304 Jan 22 21:09:17.695116 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1639/3115] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:17 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1321 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:17.697419 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aa8d90a2-3922-4101-beb3-aecf3c55c344 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.083702 Jan 22 21:09:17.698923 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1477/3116] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:17 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:09:17.857276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c1e988f0-ba14-437e-ac70-dec867d65772 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:17.857849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c1e988f0-ba14-437e-ac70-dec867d65772 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:17.867624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1e988f0-ba14-437e-ac70-dec867d65772 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:17.868169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1e988f0-ba14-437e-ac70-dec867d65772 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:17.869204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1e988f0-ba14-437e-ac70-dec867d65772 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:17.869909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1e988f0-ba14-437e-ac70-dec867d65772 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:17.995157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-856cd9b6-ddba-4e38-8c0f-3e8795e6ce9e req-667e077f-8c69-4206-8031-bcc4fac037aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e4b095-ba7a-4d1f-842f-12002cd122a0", "tag": "fbf8f684-dcea-48ad-b4b0-e120ae7ec38a"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:17.996718 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:17.996718 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:18.009654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-856cd9b6-ddba-4e38-8c0f-3e8795e6ce9e req-667e077f-8c69-4206-8031-bcc4fac037aa service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:18.010109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-856cd9b6-ddba-4e38-8c0f-3e8795e6ce9e req-667e077f-8c69-4206-8031-bcc4fac037aa service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:18.049923 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-856cd9b6-ddba-4e38-8c0f-3e8795e6ce9e req-667e077f-8c69-4206-8031-bcc4fac037aa service nova] Creating event network-changed:fbf8f684-dcea-48ad-b4b0-e120ae7ec38a for instance 39e4b095-ba7a-4d1f-842f-12002cd122a0 on nch1-master-1 Jan 22 21:09:18.055835 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-856cd9b6-ddba-4e38-8c0f-3e8795e6ce9e req-667e077f-8c69-4206-8031-bcc4fac037aa service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064990 Jan 22 21:09:18.056742 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1478/3117] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:18.128886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c1e988f0-ba14-437e-ac70-dec867d65772 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:18.141341 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c1e988f0-ba14-437e-ac70-dec867d65772 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1325 microversion: 2.1 time: 0.287077 Jan 22 21:09:18.153840 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1640/3118] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:17 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1325 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:18.177848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a7434431-acfc-4ef2-be5e-c429e18e1ed2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:18.178609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a7434431-acfc-4ef2-be5e-c429e18e1ed2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:18.185655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7434431-acfc-4ef2-be5e-c429e18e1ed2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:18.186465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7434431-acfc-4ef2-be5e-c429e18e1ed2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:18.188472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7434431-acfc-4ef2-be5e-c429e18e1ed2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:18.189024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7434431-acfc-4ef2-be5e-c429e18e1ed2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:18.275180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-618399d2-e7bb-4324-8342-699f4d02e937 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:18.277555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-618399d2-e7bb-4324-8342-699f4d02e937 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:18.291511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-618399d2-e7bb-4324-8342-699f4d02e937 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:18.292007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-618399d2-e7bb-4324-8342-699f4d02e937 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:18.292873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-618399d2-e7bb-4324-8342-699f4d02e937 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:18.295314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-618399d2-e7bb-4324-8342-699f4d02e937 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:18.347872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-618399d2-e7bb-4324-8342-699f4d02e937 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:18.348507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-618399d2-e7bb-4324-8342-699f4d02e937 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:18.348981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-618399d2-e7bb-4324-8342-699f4d02e937 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lazy-loading 'fault' on Instance uuid afd13882-2a28-4355-a3d1-606aa99e9971 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:09:18.554488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a7434431-acfc-4ef2-be5e-c429e18e1ed2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:18.570427 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a7434431-acfc-4ef2-be5e-c429e18e1ed2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1316 microversion: 2.1 time: 0.397595 Jan 22 21:09:18.577772 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1479/3119] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:18 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1316 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:18.577772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-336dbb10-bab8-4d61-bc9e-fe55223436ba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:18.578795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-336dbb10-bab8-4d61-bc9e-fe55223436ba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:18.586341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-336dbb10-bab8-4d61-bc9e-fe55223436ba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:18.592797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-336dbb10-bab8-4d61-bc9e-fe55223436ba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:18.592797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-336dbb10-bab8-4d61-bc9e-fe55223436ba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:18.592797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-336dbb10-bab8-4d61-bc9e-fe55223436ba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:18.645531 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-336dbb10-bab8-4d61-bc9e-fe55223436ba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.072618 Jan 22 21:09:18.649551 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1480/3120] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:18 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:18.714342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-21853a4e-c25e-4d76-83df-c2ae706192fc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:18.715027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-21853a4e-c25e-4d76-83df-c2ae706192fc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:18.723037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21853a4e-c25e-4d76-83df-c2ae706192fc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:18.723491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21853a4e-c25e-4d76-83df-c2ae706192fc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:18.724681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21853a4e-c25e-4d76-83df-c2ae706192fc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:18.724791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21853a4e-c25e-4d76-83df-c2ae706192fc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:18.728169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-618399d2-e7bb-4324-8342-699f4d02e937 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:18.737494 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-618399d2-e7bb-4324-8342-699f4d02e937 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 200 len: 1309 microversion: 2.1 time: 0.467025 Jan 22 21:09:18.738695 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1641/3121] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:18 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 1309 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:18.754851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b4c0a773-0933-4aab-a38d-1c70fd976e59 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:18.756421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b4c0a773-0933-4aab-a38d-1c70fd976e59 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:18.764379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4c0a773-0933-4aab-a38d-1c70fd976e59 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:18.766551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4c0a773-0933-4aab-a38d-1c70fd976e59 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:18.767608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4c0a773-0933-4aab-a38d-1c70fd976e59 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:18.777009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4c0a773-0933-4aab-a38d-1c70fd976e59 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:19.068374 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b4c0a773-0933-4aab-a38d-1c70fd976e59 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.327894 Jan 22 21:09:19.069266 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1642/3122] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:18 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:19.077184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a65caab5-145c-44b2-b987-3587cd82b9b0 req-92000cda-b690-4bfb-a9c1-6011ac734483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41b91ef-4d7d-4284-b923-7a1d415871eb", "name": "network-vif-plugged", "status": "completed", "tag": "445f9668-45bb-49e9-84e8-85d18de7750d"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:19.079947 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:19.079947 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:09:19.088350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a65caab5-145c-44b2-b987-3587cd82b9b0 req-92000cda-b690-4bfb-a9c1-6011ac734483 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:19.088810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a65caab5-145c-44b2-b987-3587cd82b9b0 req-92000cda-b690-4bfb-a9c1-6011ac734483 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:19.102054 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a65caab5-145c-44b2-b987-3587cd82b9b0 req-92000cda-b690-4bfb-a9c1-6011ac734483 service nova] Creating event network-vif-plugged:445f9668-45bb-49e9-84e8-85d18de7750d for instance b41b91ef-4d7d-4284-b923-7a1d415871eb on nch1-master-1 Jan 22 21:09:19.107750 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a65caab5-145c-44b2-b987-3587cd82b9b0 req-92000cda-b690-4bfb-a9c1-6011ac734483 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036397 Jan 22 21:09:19.108706 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1643/3123] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:19.164294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1a6d7b8c-61eb-43c8-87f5-77160631600f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:19.166844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1a6d7b8c-61eb-43c8-87f5-77160631600f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:19.180133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a6d7b8c-61eb-43c8-87f5-77160631600f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:19.180908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a6d7b8c-61eb-43c8-87f5-77160631600f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:19.181779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a6d7b8c-61eb-43c8-87f5-77160631600f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:19.182414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a6d7b8c-61eb-43c8-87f5-77160631600f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:19.362556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1a6d7b8c-61eb-43c8-87f5-77160631600f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:19.369389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-21853a4e-c25e-4d76-83df-c2ae706192fc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:19.377287 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1a6d7b8c-61eb-43c8-87f5-77160631600f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1325 microversion: 2.1 time: 0.221865 Jan 22 21:09:19.377894 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1644/3124] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:19 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1325 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:19.390142 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-21853a4e-c25e-4d76-83df-c2ae706192fc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1321 microversion: 2.1 time: 0.682151 Jan 22 21:09:19.391981 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1481/3125] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:18 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1321 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:19.587958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b9af331-2b8d-42dd-9156-227e6dbc2d36 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:19.588622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6b9af331-2b8d-42dd-9156-227e6dbc2d36 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:19.595904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b9af331-2b8d-42dd-9156-227e6dbc2d36 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:19.596374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b9af331-2b8d-42dd-9156-227e6dbc2d36 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:19.597192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b9af331-2b8d-42dd-9156-227e6dbc2d36 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:19.597681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b9af331-2b8d-42dd-9156-227e6dbc2d36 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:19.660663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-64b4b103-b50f-426b-acfa-541fe1daf34a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:19.661671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-64b4b103-b50f-426b-acfa-541fe1daf34a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:19.670757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64b4b103-b50f-426b-acfa-541fe1daf34a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:19.671383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64b4b103-b50f-426b-acfa-541fe1daf34a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:19.673175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64b4b103-b50f-426b-acfa-541fe1daf34a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:19.673947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64b4b103-b50f-426b-acfa-541fe1daf34a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:19.720012 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-64b4b103-b50f-426b-acfa-541fe1daf34a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.061837 Jan 22 21:09:19.721484 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1482/3126] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:19 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:19.736196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6b9af331-2b8d-42dd-9156-227e6dbc2d36 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:19.743976 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b9af331-2b8d-42dd-9156-227e6dbc2d36 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1466 microversion: 2.1 time: 0.159961 Jan 22 21:09:19.744546 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1645/3127] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:19 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1466 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:19.757396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2357c28c-6327-46c1-a28d-50cca5810237 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:19.758314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2357c28c-6327-46c1-a28d-50cca5810237 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:19.762089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2236d001-e868-4f12-a701-c9d3f187da02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:19.763192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2236d001-e868-4f12-a701-c9d3f187da02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:19.767594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2357c28c-6327-46c1-a28d-50cca5810237 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:19.768329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2357c28c-6327-46c1-a28d-50cca5810237 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:19.769420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2357c28c-6327-46c1-a28d-50cca5810237 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:19.769602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2236d001-e868-4f12-a701-c9d3f187da02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:19.770070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2236d001-e868-4f12-a701-c9d3f187da02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:19.770392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2357c28c-6327-46c1-a28d-50cca5810237 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:19.770858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2236d001-e868-4f12-a701-c9d3f187da02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:19.771308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2236d001-e868-4f12-a701-c9d3f187da02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:19.787593 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-2357c28c-6327-46c1-a28d-50cca5810237 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance afd13882-2a28-4355-a3d1-606aa99e9971 could not be found. Jan 22 21:09:19.788440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2357c28c-6327-46c1-a28d-50cca5810237 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance afd13882-2a28-4355-a3d1-606aa99e9971 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:19.789456 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2357c28c-6327-46c1-a28d-50cca5810237 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 404 len: 111 microversion: 2.1 time: 0.038071 Jan 22 21:09:19.790741 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1483/3128] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:19 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:19.810918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aa6eec0a-fb94-4f95-bb42-85a76223cb89 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:19.811655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aa6eec0a-fb94-4f95-bb42-85a76223cb89 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:19.820434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa6eec0a-fb94-4f95-bb42-85a76223cb89 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:19.821018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa6eec0a-fb94-4f95-bb42-85a76223cb89 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:19.821937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa6eec0a-fb94-4f95-bb42-85a76223cb89 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:19.822457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa6eec0a-fb94-4f95-bb42-85a76223cb89 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:19.886635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2236d001-e868-4f12-a701-c9d3f187da02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:19.901559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2236d001-e868-4f12-a701-c9d3f187da02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Old instance type m1.heat2, new instance type m1.heat {{(pid=137032) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 21:09:19.909132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-2236d001-e868-4f12-a701-c9d3f187da02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:09:19.909585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-2236d001-e868-4f12-a701-c9d3f187da02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:09:19.910944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-2236d001-e868-4f12-a701-c9d3f187da02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:09:19.910944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-2236d001-e868-4f12-a701-c9d3f187da02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:09:19.910944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-2236d001-e868-4f12-a701-c9d3f187da02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:09:20.061732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-aa6eec0a-fb94-4f95-bb42-85a76223cb89 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:20.069615 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aa6eec0a-fb94-4f95-bb42-85a76223cb89 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.274241 Jan 22 21:09:20.070191 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1484/3129] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:19 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:20.085594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-041d27ca-37d0-4b0d-9d28-774a8a7ffc56 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:20.086570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-041d27ca-37d0-4b0d-9d28-774a8a7ffc56 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:20.098310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-041d27ca-37d0-4b0d-9d28-774a8a7ffc56 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:20.099171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-041d27ca-37d0-4b0d-9d28-774a8a7ffc56 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:20.100167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-041d27ca-37d0-4b0d-9d28-774a8a7ffc56 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:20.100800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-041d27ca-37d0-4b0d-9d28-774a8a7ffc56 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:20.147809 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-041d27ca-37d0-4b0d-9d28-774a8a7ffc56 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.069904 Jan 22 21:09:20.148889 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1485/3130] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:20 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:20.186846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-89e4bed7-06eb-4d9e-8a7d-88e5c5a7ee9d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "a982ac8c-3d1e-405d-b754-a70452696d1b"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:20.188389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-89e4bed7-06eb-4d9e-8a7d-88e5c5a7ee9d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:20.189234 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-89e4bed7-06eb-4d9e-8a7d-88e5c5a7ee9d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.006840 Jan 22 21:09:20.189809 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1486/3131] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:20 2022] POST /compute/v2.1/servers => generated 127 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 22 21:09:20.197869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4054e0fb-83ae-4e97-b529-ad8c2ad7d1c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:20.198748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4054e0fb-83ae-4e97-b529-ad8c2ad7d1c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:20.207286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4054e0fb-83ae-4e97-b529-ad8c2ad7d1c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:20.207783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4054e0fb-83ae-4e97-b529-ad8c2ad7d1c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:20.208860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4054e0fb-83ae-4e97-b529-ad8c2ad7d1c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:20.209303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4054e0fb-83ae-4e97-b529-ad8c2ad7d1c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:20.292093 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2236d001-e868-4f12-a701-c9d3f187da02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "POST /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8/action" status: 202 len: 0 microversion: 2.1 time: 0.533558 Jan 22 21:09:20.295727 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1646/3132] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:19 2022] POST /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:20.301183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-15d7fddb-4731-47db-9c47-3bcb2e4c4e7d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:20.301379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-15d7fddb-4731-47db-9c47-3bcb2e4c4e7d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:20.309250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15d7fddb-4731-47db-9c47-3bcb2e4c4e7d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:20.309932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15d7fddb-4731-47db-9c47-3bcb2e4c4e7d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:20.311021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15d7fddb-4731-47db-9c47-3bcb2e4c4e7d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:20.311682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15d7fddb-4731-47db-9c47-3bcb2e4c4e7d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:20.487128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4054e0fb-83ae-4e97-b529-ad8c2ad7d1c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:20.497732 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4054e0fb-83ae-4e97-b529-ad8c2ad7d1c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.303591 Jan 22 21:09:20.509958 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1487/3133] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:20 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:20.515266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3850ae03-0e7c-4810-a3c6-4076bd2de567 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:20.520369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3850ae03-0e7c-4810-a3c6-4076bd2de567 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:20.522307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3850ae03-0e7c-4810-a3c6-4076bd2de567 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:20.522763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3850ae03-0e7c-4810-a3c6-4076bd2de567 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:20.523559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3850ae03-0e7c-4810-a3c6-4076bd2de567 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:20.524136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3850ae03-0e7c-4810-a3c6-4076bd2de567 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:20.529244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-15d7fddb-4731-47db-9c47-3bcb2e4c4e7d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:20.552742 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-15d7fddb-4731-47db-9c47-3bcb2e4c4e7d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1475 microversion: 2.1 time: 0.255753 Jan 22 21:09:20.554567 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1647/3134] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:20 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1475 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:20.560791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0354c82a-f00c-403c-8390-7b1039249963 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:20.565252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0354c82a-f00c-403c-8390-7b1039249963 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:20.571718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0354c82a-f00c-403c-8390-7b1039249963 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:20.572294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0354c82a-f00c-403c-8390-7b1039249963 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:20.573180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0354c82a-f00c-403c-8390-7b1039249963 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:20.573894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0354c82a-f00c-403c-8390-7b1039249963 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:20.736230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0354c82a-f00c-403c-8390-7b1039249963 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:20.753015 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0354c82a-f00c-403c-8390-7b1039249963 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1321 microversion: 2.1 time: 0.194389 Jan 22 21:09:20.763120 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1648/3135] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:20 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:20.777931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3850ae03-0e7c-4810-a3c6-4076bd2de567 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:20.785330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a339c3ff-8e7c-4f0d-88ce-895115be7c77 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:20.785330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a339c3ff-8e7c-4f0d-88ce-895115be7c77 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:20.788598 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3850ae03-0e7c-4810-a3c6-4076bd2de567 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1325 microversion: 2.1 time: 0.277351 Jan 22 21:09:20.793792 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1488/3136] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:20 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1325 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:20.794048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-de766b16-5202-4e95-ad7a-bf30547d8967 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:20.794900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-de766b16-5202-4e95-ad7a-bf30547d8967 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:20.802399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de766b16-5202-4e95-ad7a-bf30547d8967 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:20.802908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de766b16-5202-4e95-ad7a-bf30547d8967 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:20.803655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de766b16-5202-4e95-ad7a-bf30547d8967 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:20.804204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de766b16-5202-4e95-ad7a-bf30547d8967 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:20.816047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a339c3ff-8e7c-4f0d-88ce-895115be7c77 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:20.816593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a339c3ff-8e7c-4f0d-88ce-895115be7c77 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:20.817482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a339c3ff-8e7c-4f0d-88ce-895115be7c77 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:20.818024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a339c3ff-8e7c-4f0d-88ce-895115be7c77 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:20.866334 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-de766b16-5202-4e95-ad7a-bf30547d8967 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.063940 Jan 22 21:09:20.869907 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1489/3137] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:20 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:21.087843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a339c3ff-8e7c-4f0d-88ce-895115be7c77 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:21.098155 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a339c3ff-8e7c-4f0d-88ce-895115be7c77 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.336957 Jan 22 21:09:21.099483 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1649/3138] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:20 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:21.161327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cb87e52c-a111-4fa1-b16c-c1875f61136f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:21.167533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cb87e52c-a111-4fa1-b16c-c1875f61136f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:21.169144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb87e52c-a111-4fa1-b16c-c1875f61136f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:21.169718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb87e52c-a111-4fa1-b16c-c1875f61136f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:21.170605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb87e52c-a111-4fa1-b16c-c1875f61136f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:21.171545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb87e52c-a111-4fa1-b16c-c1875f61136f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:21.241742 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cb87e52c-a111-4fa1-b16c-c1875f61136f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.085757 Jan 22 21:09:21.247146 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1650/3139] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:21 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:09:21.292266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c8ba2755-6ea0-4dfd-9b18-a437d7505e5f tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Action: 'create', calling method: .version_select at 0x7f1ed51c2a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-336823747", "description": "tempest-description-713699309"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:21.575009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-25950abc-a547-4854-80ec-9c1ffabfec87 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:21.575009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-25950abc-a547-4854-80ec-9c1ffabfec87 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:21.580611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25950abc-a547-4854-80ec-9c1ffabfec87 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:21.581726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25950abc-a547-4854-80ec-9c1ffabfec87 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:21.582541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25950abc-a547-4854-80ec-9c1ffabfec87 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:21.583449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25950abc-a547-4854-80ec-9c1ffabfec87 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:21.750798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-25950abc-a547-4854-80ec-9c1ffabfec87 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:21.758866 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-25950abc-a547-4854-80ec-9c1ffabfec87 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1475 microversion: 2.1 time: 0.190852 Jan 22 21:09:21.759560 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1651/3140] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:21 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1475 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:21.772884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7ccd9d69-3595-462e-a5c7-170717d6cd15 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:21.773601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7ccd9d69-3595-462e-a5c7-170717d6cd15 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:21.781992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ccd9d69-3595-462e-a5c7-170717d6cd15 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:21.782460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ccd9d69-3595-462e-a5c7-170717d6cd15 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:21.783362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ccd9d69-3595-462e-a5c7-170717d6cd15 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:21.783818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ccd9d69-3595-462e-a5c7-170717d6cd15 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:21.845121 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c8ba2755-6ea0-4dfd-9b18-a437d7505e5f tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.786901 Jan 22 21:09:21.845791 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1490/3141] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:09:21 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:21.850768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bbbd60bf-4365-447d-a3f1-4dd657dfb0bf tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:21.851894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bbbd60bf-4365-447d-a3f1-4dd657dfb0bf tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:21.860093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbbd60bf-4365-447d-a3f1-4dd657dfb0bf tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:21.860561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbbd60bf-4365-447d-a3f1-4dd657dfb0bf tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:21.861581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbbd60bf-4365-447d-a3f1-4dd657dfb0bf tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:21.862037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbbd60bf-4365-447d-a3f1-4dd657dfb0bf tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:21.952543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7ccd9d69-3595-462e-a5c7-170717d6cd15 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:21.969355 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7ccd9d69-3595-462e-a5c7-170717d6cd15 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1321 microversion: 2.1 time: 0.202029 Jan 22 21:09:21.971026 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1652/3142] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:21 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:21.979175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c4409649-9844-4571-a704-f0465e8eebe5 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Action: 'create', calling method: .version_select at 0x7f1ed5e0a550>, body: {"security_group_rule": {"parent_group_id": "2bca42a6-2fe4-4ed3-acff-6981c78ca5b9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:22.136984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bbbd60bf-4365-447d-a3f1-4dd657dfb0bf tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:22.146417 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bbbd60bf-4365-447d-a3f1-4dd657dfb0bf tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1504 microversion: 2.1 time: 0.299617 Jan 22 21:09:22.147720 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1491/3143] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:21 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:22.152602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48c77118-ca92-4a83-8ce9-480437ab0e76 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:22.153878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48c77118-ca92-4a83-8ce9-480437ab0e76 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:22.162211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48c77118-ca92-4a83-8ce9-480437ab0e76 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:22.162970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48c77118-ca92-4a83-8ce9-480437ab0e76 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:22.163976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48c77118-ca92-4a83-8ce9-480437ab0e76 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:22.164314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48c77118-ca92-4a83-8ce9-480437ab0e76 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:22.205867 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48c77118-ca92-4a83-8ce9-480437ab0e76 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.056502 Jan 22 21:09:22.206491 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1492/3144] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:22 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:22.211484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-178aeeae-f262-48e8-8a44-ab3f0079ac5a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:22.212169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-178aeeae-f262-48e8-8a44-ab3f0079ac5a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:22.219047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178aeeae-f262-48e8-8a44-ab3f0079ac5a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:22.228065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178aeeae-f262-48e8-8a44-ab3f0079ac5a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:22.228065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178aeeae-f262-48e8-8a44-ab3f0079ac5a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:22.228065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178aeeae-f262-48e8-8a44-ab3f0079ac5a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:22.362982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-178aeeae-f262-48e8-8a44-ab3f0079ac5a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:22.378961 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-178aeeae-f262-48e8-8a44-ab3f0079ac5a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1504 microversion: 2.1 time: 0.171186 Jan 22 21:09:22.401009 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1493/3145] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:22 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:22.418700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-936e1dc5-109a-4110-aa01-a260997da207 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:22.419652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-936e1dc5-109a-4110-aa01-a260997da207 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:22.428940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-936e1dc5-109a-4110-aa01-a260997da207 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:22.429389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-936e1dc5-109a-4110-aa01-a260997da207 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:22.430249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-936e1dc5-109a-4110-aa01-a260997da207 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:22.430688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-936e1dc5-109a-4110-aa01-a260997da207 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:22.477068 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-936e1dc5-109a-4110-aa01-a260997da207 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.074262 Jan 22 21:09:22.478345 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1494/3146] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:22 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:22.485664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-addbd08a-e8ef-48cb-93d3-a744ed9e34ff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:22.486613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-addbd08a-e8ef-48cb-93d3-a744ed9e34ff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:22.500477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-addbd08a-e8ef-48cb-93d3-a744ed9e34ff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:22.501227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-addbd08a-e8ef-48cb-93d3-a744ed9e34ff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:22.502599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-addbd08a-e8ef-48cb-93d3-a744ed9e34ff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:22.503605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-addbd08a-e8ef-48cb-93d3-a744ed9e34ff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:22.535226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-addbd08a-e8ef-48cb-93d3-a744ed9e34ff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:09:22.557381 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c4409649-9844-4571-a704-f0465e8eebe5 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.584936 Jan 22 21:09:22.558809 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1653/3147] 10.222.0.100 () {60 vars in 1199 bytes} [Sat Jan 22 21:09:21 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:22.569378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c6389571-4ac9-4421-99ae-b80b5e76a23f tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Action: 'create', calling method: .version_select at 0x7f1edaf46310>, body: {"security_group_rule": {"parent_group_id": "2bca42a6-2fe4-4ed3-acff-6981c78ca5b9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:22.621355 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-c6389571-4ac9-4421-99ae-b80b5e76a23f tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] HTTP exception thrown: This rule already exists in group 2bca42a6-2fe4-4ed3-acff-6981c78ca5b9 Jan 22 21:09:22.622603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c6389571-4ac9-4421-99ae-b80b5e76a23f tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Returning 400 to user: This rule already exists in group 2bca42a6-2fe4-4ed3-acff-6981c78ca5b9 {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:22.623407 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c6389571-4ac9-4421-99ae-b80b5e76a23f tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.057918 Jan 22 21:09:22.633855 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1654/3148] 10.222.0.100 () {60 vars in 1199 bytes} [Sat Jan 22 21:09:22 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 22 21:09:22.646343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b0a1837a-b959-45cb-b116-ab532e93ebc5 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Calling method '.version_select at 0x7f1ed5debee0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:22.908116 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-addbd08a-e8ef-48cb-93d3-a744ed9e34ff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 204 len: 0 microversion: 2.1 time: 0.428232 Jan 22 21:09:22.908774 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1495/3149] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:22 2022] DELETE /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:09:22.914439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6cc2340c-5ce4-4ba2-b04d-a68a0c275cbe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:22.915336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6cc2340c-5ce4-4ba2-b04d-a68a0c275cbe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:22.915465 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b0a1837a-b959-45cb-b116-ab532e93ebc5 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-group-rules/587665dd-700f-4ae3-a792-e0184f238d6c" status: 202 len: 0 microversion: 2.1 time: 0.280365 Jan 22 21:09:22.920413 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1655/3150] 10.222.0.100 () {58 vars in 1291 bytes} [Sat Jan 22 21:09:22 2022] DELETE /compute/v2.1/os-security-group-rules/587665dd-700f-4ae3-a792-e0184f238d6c => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:22.924065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6cc2340c-5ce4-4ba2-b04d-a68a0c275cbe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:22.924237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6cc2340c-5ce4-4ba2-b04d-a68a0c275cbe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:22.927366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-58e50c3c-3067-4570-929d-5cb183aad6d7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:22.927366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-58e50c3c-3067-4570-929d-5cb183aad6d7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:22.927604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6cc2340c-5ce4-4ba2-b04d-a68a0c275cbe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:22.927604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6cc2340c-5ce4-4ba2-b04d-a68a0c275cbe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:22.931528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58e50c3c-3067-4570-929d-5cb183aad6d7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:22.931988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58e50c3c-3067-4570-929d-5cb183aad6d7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:22.933007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58e50c3c-3067-4570-929d-5cb183aad6d7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:22.933652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58e50c3c-3067-4570-929d-5cb183aad6d7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:23.073984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6cc2340c-5ce4-4ba2-b04d-a68a0c275cbe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:23.083329 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6cc2340c-5ce4-4ba2-b04d-a68a0c275cbe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1475 microversion: 2.1 time: 0.172900 Jan 22 21:09:23.083916 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1496/3151] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:22 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1475 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:23.088811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4e43dcc9-6d04-4f1e-80af-22ef9ecd36a2 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Action: 'create', calling method: .version_select at 0x7f1ed619e820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-763855790", "description": "tempest-description-535864771"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:23.106981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-58e50c3c-3067-4570-929d-5cb183aad6d7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:23.114696 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-58e50c3c-3067-4570-929d-5cb183aad6d7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1510 microversion: 2.1 time: 0.197442 Jan 22 21:09:23.115268 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1656/3152] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:22 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:23.120526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-38b57465-0048-453b-a44b-77ff7c7d1ff5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:23.121129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-38b57465-0048-453b-a44b-77ff7c7d1ff5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:23.126918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38b57465-0048-453b-a44b-77ff7c7d1ff5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:23.127374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38b57465-0048-453b-a44b-77ff7c7d1ff5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:23.128160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38b57465-0048-453b-a44b-77ff7c7d1ff5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:23.128605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38b57465-0048-453b-a44b-77ff7c7d1ff5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:23.274135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-38b57465-0048-453b-a44b-77ff7c7d1ff5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:23.283546 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-38b57465-0048-453b-a44b-77ff7c7d1ff5 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1321 microversion: 2.1 time: 0.166332 Jan 22 21:09:23.284152 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1657/3153] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:23 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:23.293990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3361d549-a09f-4d3c-aab9-83cfdf7f0141 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:23.295047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3361d549-a09f-4d3c-aab9-83cfdf7f0141 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:23.301631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3361d549-a09f-4d3c-aab9-83cfdf7f0141 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:23.305960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3361d549-a09f-4d3c-aab9-83cfdf7f0141 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:23.305960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3361d549-a09f-4d3c-aab9-83cfdf7f0141 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:23.305960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3361d549-a09f-4d3c-aab9-83cfdf7f0141 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:23.347836 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3361d549-a09f-4d3c-aab9-83cfdf7f0141 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.062403 Jan 22 21:09:23.349291 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1658/3154] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:23 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:23.492729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-65385e92-3871-4216-a6eb-19a5cd843b51 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:23.494165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-65385e92-3871-4216-a6eb-19a5cd843b51 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:23.503428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65385e92-3871-4216-a6eb-19a5cd843b51 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:23.503941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65385e92-3871-4216-a6eb-19a5cd843b51 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:23.504942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65385e92-3871-4216-a6eb-19a5cd843b51 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:23.505596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65385e92-3871-4216-a6eb-19a5cd843b51 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:23.560940 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-65385e92-3871-4216-a6eb-19a5cd843b51 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.074717 Jan 22 21:09:23.565938 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1659/3155] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:23 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:09:24.007358 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4e43dcc9-6d04-4f1e-80af-22ef9ecd36a2 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.922291 Jan 22 21:09:24.018473 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1497/3156] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:09:23 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:24.020776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1104e92f-f369-4b27-b0bb-e45b9fd37a3d tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Action: 'create', calling method: .version_select at 0x7f1edaf46d30>, body: {"security_group_rule": {"parent_group_id": "ba5f690a-eb7d-4254-9fbb-c588f6872a09", "ip_protocol": "tcp", "from_port": 994816047, "to_port": 22}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:24.079817 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-1104e92f-f369-4b27-b0bb-e45b9fd37a3d tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] HTTP exception thrown: Invalid port range 994816047:22. Former value cannot be greater than the later Jan 22 21:09:24.080717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1104e92f-f369-4b27-b0bb-e45b9fd37a3d tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Returning 400 to user: Invalid port range 994816047:22. Former value cannot be greater than the later {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:24.081869 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1104e92f-f369-4b27-b0bb-e45b9fd37a3d tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.066403 Jan 22 21:09:24.083538 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1660/3157] 10.222.0.100 () {60 vars in 1199 bytes} [Sat Jan 22 21:09:24 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 22 21:09:24.095003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-65eac199-e2bf-4b6e-90d1-d3bf5d504178 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Action: 'create', calling method: .version_select at 0x7f1ed51d0dc0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2062469711", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:24.100353 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-65eac199-e2bf-4b6e-90d1-d3bf5d504178 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] HTTP exception thrown: Security group id should be uuid Jan 22 21:09:24.102189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-65eac199-e2bf-4b6e-90d1-d3bf5d504178 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Returning 400 to user: Security group id should be uuid {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:24.105450 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-65eac199-e2bf-4b6e-90d1-d3bf5d504178 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.016855 Jan 22 21:09:24.107741 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1498/3158] 10.222.0.100 () {60 vars in 1199 bytes} [Sat Jan 22 21:09:24 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 22 21:09:24.108051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d0d5f5f3-cf24-420c-b10a-a33b4cca2cc9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:24.110319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d0d5f5f3-cf24-420c-b10a-a33b4cca2cc9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:24.121917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e76672ee-fc6e-461b-a06d-6408afa76084 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Action: 'create', calling method: .version_select at 0x7f1ed522e9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-157568559", "description": "tempest-description-1009002147"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:24.130864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0d5f5f3-cf24-420c-b10a-a33b4cca2cc9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:24.146907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0d5f5f3-cf24-420c-b10a-a33b4cca2cc9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:24.146907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0d5f5f3-cf24-420c-b10a-a33b4cca2cc9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:24.146907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0d5f5f3-cf24-420c-b10a-a33b4cca2cc9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:24.315084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d0d5f5f3-cf24-420c-b10a-a33b4cca2cc9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:24.323144 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d0d5f5f3-cf24-420c-b10a-a33b4cca2cc9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1475 microversion: 2.1 time: 0.225771 Jan 22 21:09:24.323711 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1661/3159] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:24 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1475 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:24.328964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4e885050-3e33-4ac3-9297-b50f22c94925 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:24.329800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4e885050-3e33-4ac3-9297-b50f22c94925 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:24.336795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e885050-3e33-4ac3-9297-b50f22c94925 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:24.337278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e885050-3e33-4ac3-9297-b50f22c94925 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:24.338103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e885050-3e33-4ac3-9297-b50f22c94925 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:24.338549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e885050-3e33-4ac3-9297-b50f22c94925 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:24.480283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4e885050-3e33-4ac3-9297-b50f22c94925 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:24.489477 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4e885050-3e33-4ac3-9297-b50f22c94925 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1510 microversion: 2.1 time: 0.164361 Jan 22 21:09:24.500345 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1662/3160] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:24 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:24.505880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d2a6a1a4-d324-4003-88be-390574c32319 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:24.506164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d2a6a1a4-d324-4003-88be-390574c32319 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:24.512492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2a6a1a4-d324-4003-88be-390574c32319 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:24.512963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2a6a1a4-d324-4003-88be-390574c32319 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:24.513813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2a6a1a4-d324-4003-88be-390574c32319 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:24.514264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2a6a1a4-d324-4003-88be-390574c32319 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:24.746029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d2a6a1a4-d324-4003-88be-390574c32319 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:24.757000 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d2a6a1a4-d324-4003-88be-390574c32319 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1321 microversion: 2.1 time: 0.255122 Jan 22 21:09:24.757609 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1663/3161] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:24 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:24.762168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d1ea7c1-ec68-407b-a403-ad3467137ca1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-344897762", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ed088a16-ed34-4067-87b2-bf64b154bbbc", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a982ac8c-3d1e-405d-b754-a70452696d1b"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:24.820124 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-5d1ea7c1-ec68-407b-a403-ad3467137ca1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Block Device ed088a16-ed34-4067-87b2-bf64b154bbbc is not bootable. Jan 22 21:09:24.820803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d1ea7c1-ec68-407b-a403-ad3467137ca1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 400 to user: Block Device ed088a16-ed34-4067-87b2-bf64b154bbbc is not bootable. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:24.821936 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d1ea7c1-ec68-407b-a403-ad3467137ca1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.063255 Jan 22 21:09:24.826002 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1664/3162] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:24 2022] POST /compute/v2.1/servers => generated 110 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:09:24.830558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ff420237-e251-4716-a0f4-dafbae38d646 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:24.835199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ff420237-e251-4716-a0f4-dafbae38d646 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:24.835471 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e76672ee-fc6e-461b-a06d-6408afa76084 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.719262 Jan 22 21:09:24.835471 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1499/3163] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:09:24 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:24.839651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff420237-e251-4716-a0f4-dafbae38d646 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:24.840172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff420237-e251-4716-a0f4-dafbae38d646 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:24.840742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-580c5688-a45b-46e6-8573-93e20baf5f18 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:24.840986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff420237-e251-4716-a0f4-dafbae38d646 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:24.841436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff420237-e251-4716-a0f4-dafbae38d646 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:24.842361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-580c5688-a45b-46e6-8573-93e20baf5f18 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:24.849627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-580c5688-a45b-46e6-8573-93e20baf5f18 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:24.850348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-580c5688-a45b-46e6-8573-93e20baf5f18 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:24.851148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-580c5688-a45b-46e6-8573-93e20baf5f18 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:24.851769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-580c5688-a45b-46e6-8573-93e20baf5f18 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:24.899716 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-580c5688-a45b-46e6-8573-93e20baf5f18 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.064109 Jan 22 21:09:24.906165 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1500/3164] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:24 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:24.906314 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ff420237-e251-4716-a0f4-dafbae38d646 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.080559 Jan 22 21:09:24.906314 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1665/3165] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:24 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:24.907129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-098d678b-fd75-4d36-bfbc-dcbec6e377b2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:24.908153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-098d678b-fd75-4d36-bfbc-dcbec6e377b2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:24.913614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f694e2b8-59f9-4b73-8bdd-6d38dbe28407 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Action: 'create', calling method: .version_select at 0x7f1edaf1f790>, body: {"security_group_rule": {"parent_group_id": "8fa474b3-d756-4dad-88a1-7b8a520d3de6", "ip_protocol": "tempest-999-1205933433", "from_port": 22, "to_port": 22}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:24.915675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-098d678b-fd75-4d36-bfbc-dcbec6e377b2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:24.916345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-098d678b-fd75-4d36-bfbc-dcbec6e377b2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:24.917350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-098d678b-fd75-4d36-bfbc-dcbec6e377b2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:24.918016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-098d678b-fd75-4d36-bfbc-dcbec6e377b2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:25.026017 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-f694e2b8-59f9-4b73-8bdd-6d38dbe28407 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] HTTP exception thrown: Invalid IP protocol tempest-999-1205933433. Jan 22 21:09:25.027305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f694e2b8-59f9-4b73-8bdd-6d38dbe28407 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Returning 400 to user: Invalid IP protocol tempest-999-1205933433. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:25.028222 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f694e2b8-59f9-4b73-8bdd-6d38dbe28407 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.122015 Jan 22 21:09:25.028801 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1666/3166] 10.222.0.100 () {60 vars in 1199 bytes} [Sat Jan 22 21:09:24 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 22 21:09:25.039719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab1be2ab-1c0a-4180-bf32-e8a81e2361e9 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Action: 'create', calling method: .version_select at 0x7f1edafde5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-83587109", "description": "tempest-description-521055565"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:25.204833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-098d678b-fd75-4d36-bfbc-dcbec6e377b2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:25.230987 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-098d678b-fd75-4d36-bfbc-dcbec6e377b2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.327877 Jan 22 21:09:25.249195 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1501/3167] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:24 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:25.256160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f36d5ab8-14c6-4ef2-913b-5ee78b527d4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:25.258478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f36d5ab8-14c6-4ef2-913b-5ee78b527d4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:25.269169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f36d5ab8-14c6-4ef2-913b-5ee78b527d4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:25.270028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f36d5ab8-14c6-4ef2-913b-5ee78b527d4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:25.271105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f36d5ab8-14c6-4ef2-913b-5ee78b527d4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:25.271748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f36d5ab8-14c6-4ef2-913b-5ee78b527d4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:25.474160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f36d5ab8-14c6-4ef2-913b-5ee78b527d4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:25.481904 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f36d5ab8-14c6-4ef2-913b-5ee78b527d4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.230424 Jan 22 21:09:25.482483 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1502/3168] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:25 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:25.487178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-62c208e4-0c02-4d83-a91f-cef807ea156e req-a309de94-0566-49bd-beb9-b148b506b0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41b91ef-4d7d-4284-b923-7a1d415871eb", "name": "network-vif-deleted", "tag": "445f9668-45bb-49e9-84e8-85d18de7750d"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:25.488717 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:25.488717 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:25.503575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-62c208e4-0c02-4d83-a91f-cef807ea156e req-a309de94-0566-49bd-beb9-b148b506b0e4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:25.503575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-62c208e4-0c02-4d83-a91f-cef807ea156e req-a309de94-0566-49bd-beb9-b148b506b0e4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:25.510554 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-62c208e4-0c02-4d83-a91f-cef807ea156e req-a309de94-0566-49bd-beb9-b148b506b0e4 service nova] Creating event network-vif-deleted:445f9668-45bb-49e9-84e8-85d18de7750d for instance b41b91ef-4d7d-4284-b923-7a1d415871eb on nch1-master-1 Jan 22 21:09:25.517841 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-62c208e4-0c02-4d83-a91f-cef807ea156e req-a309de94-0566-49bd-beb9-b148b506b0e4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033749 Jan 22 21:09:25.519030 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1503/3169] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:25.535557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6fc188c3-b1fe-4591-8f1a-1eb5a0971972 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:25.535870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6fc188c3-b1fe-4591-8f1a-1eb5a0971972 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:25.542260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6fc188c3-b1fe-4591-8f1a-1eb5a0971972 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:25.542724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6fc188c3-b1fe-4591-8f1a-1eb5a0971972 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:25.544407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6fc188c3-b1fe-4591-8f1a-1eb5a0971972 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:25.544936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6fc188c3-b1fe-4591-8f1a-1eb5a0971972 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:25.652034 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab1be2ab-1c0a-4180-bf32-e8a81e2361e9 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.616846 Jan 22 21:09:25.652690 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1667/3170] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:09:25 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:09:25.657470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-99d90249-fa96-4b23-99a1-be869a564067 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:25.658246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-99d90249-fa96-4b23-99a1-be869a564067 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:25.665166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99d90249-fa96-4b23-99a1-be869a564067 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:25.665851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99d90249-fa96-4b23-99a1-be869a564067 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:25.666670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99d90249-fa96-4b23-99a1-be869a564067 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:25.667148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99d90249-fa96-4b23-99a1-be869a564067 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:25.710249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99d90249-fa96-4b23-99a1-be869a564067 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:25.710766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99d90249-fa96-4b23-99a1-be869a564067 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:25.713967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-99d90249-fa96-4b23-99a1-be869a564067 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lazy-loading 'fault' on Instance uuid b41b91ef-4d7d-4284-b923-7a1d415871eb {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:09:25.767830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-99d90249-fa96-4b23-99a1-be869a564067 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:25.777894 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-99d90249-fa96-4b23-99a1-be869a564067 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1315 microversion: 2.1 time: 0.124032 Jan 22 21:09:25.782130 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1668/3171] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:25 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1315 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:25.796403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74a46f8c-5381-4467-bcd3-57ab81c87ff0 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Action: 'create', calling method: .version_select at 0x7f1edaf94280>, body: {"security_group_rule": {"parent_group_id": "aa875222-3b3d-4a47-9efc-506f297b5ade", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:25.807041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6fc188c3-b1fe-4591-8f1a-1eb5a0971972 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:25.825490 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6fc188c3-b1fe-4591-8f1a-1eb5a0971972 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.304944 Jan 22 21:09:25.826119 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1504/3172] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:25 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:25.850668 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-74a46f8c-5381-4467-bcd3-57ab81c87ff0 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jan 22 21:09:25.851299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74a46f8c-5381-4467-bcd3-57ab81c87ff0 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:25.851427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0d97bb6f-6eaf-4666-9647-9fb6bfc84cef tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:25.852055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0d97bb6f-6eaf-4666-9647-9fb6bfc84cef tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:25.852206 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-74a46f8c-5381-4467-bcd3-57ab81c87ff0 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.068267 Jan 22 21:09:25.852719 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1669/3173] 10.222.0.100 () {60 vars in 1199 bytes} [Sat Jan 22 21:09:25 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:09:25.857627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-4c91d037-7831-4dfd-9480-4277abf5a110 req-97549450-a546-4b9a-841e-1b64f6859f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e4b095-ba7a-4d1f-842f-12002cd122a0", "name": "network-vif-plugged", "status": "completed", "tag": "fbf8f684-dcea-48ad-b4b0-e120ae7ec38a"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:25.859867 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:25.859867 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:09:25.861463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d97bb6f-6eaf-4666-9647-9fb6bfc84cef tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:25.862003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d97bb6f-6eaf-4666-9647-9fb6bfc84cef tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:25.862770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d97bb6f-6eaf-4666-9647-9fb6bfc84cef tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:25.863574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d97bb6f-6eaf-4666-9647-9fb6bfc84cef tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:25.876126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4c91d037-7831-4dfd-9480-4277abf5a110 req-97549450-a546-4b9a-841e-1b64f6859f8b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:25.877214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4c91d037-7831-4dfd-9480-4277abf5a110 req-97549450-a546-4b9a-841e-1b64f6859f8b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:25.900788 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-4c91d037-7831-4dfd-9480-4277abf5a110 req-97549450-a546-4b9a-841e-1b64f6859f8b service nova] Creating event network-vif-plugged:fbf8f684-dcea-48ad-b4b0-e120ae7ec38a for instance 39e4b095-ba7a-4d1f-842f-12002cd122a0 on nch1-master-1 Jan 22 21:09:25.908697 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-4c91d037-7831-4dfd-9480-4277abf5a110 req-97549450-a546-4b9a-841e-1b64f6859f8b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053886 Jan 22 21:09:25.909464 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1670/3174] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:25.939168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d80d7f1d-719b-46ee-9d12-ce6de7c332a1 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Action: 'create', calling method: .version_select at 0x7f1edaf46f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-983909154", "description": "tempest-description-587477098"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:26.075876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0d97bb6f-6eaf-4666-9647-9fb6bfc84cef tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:26.084735 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0d97bb6f-6eaf-4666-9647-9fb6bfc84cef tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1321 microversion: 2.1 time: 0.244861 Jan 22 21:09:26.085486 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1505/3175] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:25 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:26.090836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d9de4f9b-fed9-4d18-af6d-7aa90ddc6d46 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:26.092074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d9de4f9b-fed9-4d18-af6d-7aa90ddc6d46 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:26.105103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9de4f9b-fed9-4d18-af6d-7aa90ddc6d46 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:26.105103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9de4f9b-fed9-4d18-af6d-7aa90ddc6d46 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:26.105103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9de4f9b-fed9-4d18-af6d-7aa90ddc6d46 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:26.105103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9de4f9b-fed9-4d18-af6d-7aa90ddc6d46 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:26.153135 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d9de4f9b-fed9-4d18-af6d-7aa90ddc6d46 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.066344 Jan 22 21:09:26.153832 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1506/3176] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:26 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:26.160726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-603cbf70-036c-4af6-a1b0-126bc744dae9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:26.161752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-603cbf70-036c-4af6-a1b0-126bc744dae9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:26.168213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-603cbf70-036c-4af6-a1b0-126bc744dae9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:26.168680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-603cbf70-036c-4af6-a1b0-126bc744dae9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:26.169466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-603cbf70-036c-4af6-a1b0-126bc744dae9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:26.170004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-603cbf70-036c-4af6-a1b0-126bc744dae9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:26.221258 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-603cbf70-036c-4af6-a1b0-126bc744dae9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.064635 Jan 22 21:09:26.223305 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1507/3177] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:26 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:26.510732 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d80d7f1d-719b-46ee-9d12-ce6de7c332a1 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.595594 Jan 22 21:09:26.510732 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1671/3178] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:09:25 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:26.521626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-54513ef8-a7d2-43ea-a5dd-7be92070627b tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Action: 'create', calling method: .version_select at 0x7f1ed51f0a60>, body: {"security_group_rule": {"parent_group_id": "930f0646-4463-46c5-9f4d-b1e7bc9a0665", "ip_protocol": "tcp", "from_port": 22, "to_port": 714207941}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:26.693013 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-54513ef8-a7d2-43ea-a5dd-7be92070627b tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] HTTP exception thrown: Invalid port range 22:714207941. Valid TCP ports should be between 1-65535 Jan 22 21:09:26.693918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-54513ef8-a7d2-43ea-a5dd-7be92070627b tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Returning 400 to user: Invalid port range 22:714207941. Valid TCP ports should be between 1-65535 {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:26.694868 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-54513ef8-a7d2-43ea-a5dd-7be92070627b tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.178582 Jan 22 21:09:26.695546 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1508/3179] 10.222.0.100 () {60 vars in 1199 bytes} [Sat Jan 22 21:09:26 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:09:26.705623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-584ec06c-2e69-4e55-bff4-63c9265c016b tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Action: 'create', calling method: .version_select at 0x7f1edaf94af0>, body: {"security_group_rule": {"parent_group_id": "87666b31-3e9c-4fae-ac6f-7c2d6bbfca67", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:26.734847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG neutronclient.v2_0.client [None req-584ec06c-2e69-4e55-bff4-63c9265c016b tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 87666b31-3e9c-4fae-ac6f-7c2d6bbfca67 does not exist", "detail": ""}} {{(pid=137032) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:09:26.734847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.security_group_api [None req-584ec06c-2e69-4e55-bff4-63c9265c016b tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Neutron security group 87666b31-3e9c-4fae-ac6f-7c2d6bbfca67 not found {{(pid=137032) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 22 21:09:26.734847 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-584ec06c-2e69-4e55-bff4-63c9265c016b tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] HTTP exception thrown: Security group 87666b31-3e9c-4fae-ac6f-7c2d6bbfca67 does not exist Jan 22 21:09:26.734847 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-3ee4c16c-706e-4180-8280-f96a69e39f64'] Jan 22 21:09:26.734847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-584ec06c-2e69-4e55-bff4-63c9265c016b tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Returning 404 to user: Security group 87666b31-3e9c-4fae-ac6f-7c2d6bbfca67 does not exist Jan 22 21:09:26.734847 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-3ee4c16c-706e-4180-8280-f96a69e39f64'] {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:26.734847 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-584ec06c-2e69-4e55-bff4-63c9265c016b tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.031054 Jan 22 21:09:26.734847 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1672/3180] 10.222.0.100 () {60 vars in 1199 bytes} [Sat Jan 22 21:09:26 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:09:26.742686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7aa7c410-cd0c-457c-bf3e-8a917597a267 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Calling method '.version_select at 0x7f1ed51d03a0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:26.771746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG neutronclient.v2_0.client [None req-7aa7c410-cd0c-457c-bf3e-8a917597a267 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 1fe56fdb-ad8b-4b4e-af89-1c02263563f9 does not exist", "detail": ""}} {{(pid=137033) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:09:26.771746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.security_group_api [None req-7aa7c410-cd0c-457c-bf3e-8a917597a267 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Neutron security group rule 1fe56fdb-ad8b-4b4e-af89-1c02263563f9 not found {{(pid=137033) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jan 22 21:09:26.771746 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-7aa7c410-cd0c-457c-bf3e-8a917597a267 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] HTTP exception thrown: Security group rule 1fe56fdb-ad8b-4b4e-af89-1c02263563f9 does not exist Jan 22 21:09:26.771746 ncdv-master-1 devstack@n-api.service[137033]: Neutron server returns request_ids: ['req-ddebb1b3-0547-463b-b69e-64e4cb034715'] Jan 22 21:09:26.771746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7aa7c410-cd0c-457c-bf3e-8a917597a267 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Returning 404 to user: Security group rule 1fe56fdb-ad8b-4b4e-af89-1c02263563f9 does not exist Jan 22 21:09:26.771746 ncdv-master-1 devstack@n-api.service[137033]: Neutron server returns request_ids: ['req-ddebb1b3-0547-463b-b69e-64e4cb034715'] {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:26.771746 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7aa7c410-cd0c-457c-bf3e-8a917597a267 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-group-rules/1fe56fdb-ad8b-4b4e-af89-1c02263563f9" status: 404 len: 199 microversion: 2.1 time: 0.032203 Jan 22 21:09:26.772445 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1509/3181] 10.222.0.100 () {58 vars in 1291 bytes} [Sat Jan 22 21:09:26 2022] DELETE /compute/v2.1/os-security-group-rules/1fe56fdb-ad8b-4b4e-af89-1c02263563f9 => generated 199 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:26.782103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bf2e91b8-fdac-4dda-adb0-427b53812b31 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Calling method '.version_select at 0x7f1edafae820>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:26.796927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a2a01eab-3b38-4a4c-8397-aa296371761f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:26.798403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a2a01eab-3b38-4a4c-8397-aa296371761f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:26.804693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2a01eab-3b38-4a4c-8397-aa296371761f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:26.805157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2a01eab-3b38-4a4c-8397-aa296371761f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:26.806057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2a01eab-3b38-4a4c-8397-aa296371761f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:26.806504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2a01eab-3b38-4a4c-8397-aa296371761f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:26.839201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2a01eab-3b38-4a4c-8397-aa296371761f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:26.840725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2a01eab-3b38-4a4c-8397-aa296371761f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:26.840725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-a2a01eab-3b38-4a4c-8397-aa296371761f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lazy-loading 'fault' on Instance uuid b41b91ef-4d7d-4284-b923-7a1d415871eb {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:09:26.887258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a2a01eab-3b38-4a4c-8397-aa296371761f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:26.903202 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a2a01eab-3b38-4a4c-8397-aa296371761f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 200 len: 1315 microversion: 2.1 time: 0.110760 Jan 22 21:09:26.904419 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1510/3182] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:26 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 1315 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:26.916955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1f368ed1-134d-4f43-aeb2-17e6288310fb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:26.917628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1f368ed1-134d-4f43-aeb2-17e6288310fb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:26.925180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f368ed1-134d-4f43-aeb2-17e6288310fb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:26.925674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f368ed1-134d-4f43-aeb2-17e6288310fb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:26.926489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f368ed1-134d-4f43-aeb2-17e6288310fb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:26.927079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f368ed1-134d-4f43-aeb2-17e6288310fb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:27.054415 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bf2e91b8-fdac-4dda-adb0-427b53812b31 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/930f0646-4463-46c5-9f4d-b1e7bc9a0665" status: 202 len: 0 microversion: 2.1 time: 0.277285 Jan 22 21:09:27.055311 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1673/3183] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:09:26 2022] DELETE /compute/v2.1/os-security-groups/930f0646-4463-46c5-9f4d-b1e7bc9a0665 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:27.066108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b869c388-06b5-4e2a-a26a-650cb7fa1964 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Calling method '.version_select at 0x7f1edaf46ca0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:27.174059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1f368ed1-134d-4f43-aeb2-17e6288310fb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:27.183068 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1f368ed1-134d-4f43-aeb2-17e6288310fb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.277758 Jan 22 21:09:27.183672 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1511/3184] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:26 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:27.189267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f4d38fab-6912-457a-a508-9474ef54f1d1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:27.189907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f4d38fab-6912-457a-a508-9474ef54f1d1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:27.196037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4d38fab-6912-457a-a508-9474ef54f1d1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:27.196493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4d38fab-6912-457a-a508-9474ef54f1d1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:27.197319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4d38fab-6912-457a-a508-9474ef54f1d1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:27.197988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4d38fab-6912-457a-a508-9474ef54f1d1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:27.366228 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b869c388-06b5-4e2a-a26a-650cb7fa1964 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/aa875222-3b3d-4a47-9efc-506f297b5ade" status: 202 len: 0 microversion: 2.1 time: 0.306963 Jan 22 21:09:27.371493 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1674/3185] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:09:27 2022] DELETE /compute/v2.1/os-security-groups/aa875222-3b3d-4a47-9efc-506f297b5ade => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:09:27.372335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3238fb84-8658-450f-ab01-d10ee0fc4fbc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:27.373579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3238fb84-8658-450f-ab01-d10ee0fc4fbc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:27.380597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f4d38fab-6912-457a-a508-9474ef54f1d1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:27.387168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3238fb84-8658-450f-ab01-d10ee0fc4fbc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:27.388716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3238fb84-8658-450f-ab01-d10ee0fc4fbc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:27.390049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3238fb84-8658-450f-ab01-d10ee0fc4fbc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:27.391588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3238fb84-8658-450f-ab01-d10ee0fc4fbc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:27.403179 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f4d38fab-6912-457a-a508-9474ef54f1d1 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1321 microversion: 2.1 time: 0.211690 Jan 22 21:09:27.403179 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1512/3186] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:27 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:27.409379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ecb787f2-5cd4-432d-a85c-1328fa849383 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:27.410398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ecb787f2-5cd4-432d-a85c-1328fa849383 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:27.424513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecb787f2-5cd4-432d-a85c-1328fa849383 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:27.426831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecb787f2-5cd4-432d-a85c-1328fa849383 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:27.429644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecb787f2-5cd4-432d-a85c-1328fa849383 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:27.430345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecb787f2-5cd4-432d-a85c-1328fa849383 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:27.462761 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3238fb84-8658-450f-ab01-d10ee0fc4fbc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.094303 Jan 22 21:09:27.467043 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1675/3187] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:27 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:27.469402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2db4299d-55c2-4cea-ba68-24459cc3a2ea tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Calling method '.version_select at 0x7f1edaf46dc0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:27.490390 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ecb787f2-5cd4-432d-a85c-1328fa849383 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.087213 Jan 22 21:09:27.494004 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1513/3188] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:27 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:27.737935 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2db4299d-55c2-4cea-ba68-24459cc3a2ea tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/8fa474b3-d756-4dad-88a1-7b8a520d3de6" status: 202 len: 0 microversion: 2.1 time: 0.272830 Jan 22 21:09:27.738526 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1676/3189] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:09:27 2022] DELETE /compute/v2.1/os-security-groups/8fa474b3-d756-4dad-88a1-7b8a520d3de6 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:27.746950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-55fe3ff5-6b0c-4620-ac44-b56abf5f72b9 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Calling method '.version_select at 0x7f1ed51d0dc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:27.921291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08dde2f9-aba4-4bd9-8476-874372e3cddb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:27.922750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-08dde2f9-aba4-4bd9-8476-874372e3cddb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:27.929821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08dde2f9-aba4-4bd9-8476-874372e3cddb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:27.930385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08dde2f9-aba4-4bd9-8476-874372e3cddb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:27.931557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08dde2f9-aba4-4bd9-8476-874372e3cddb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:27.932006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08dde2f9-aba4-4bd9-8476-874372e3cddb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:27.946410 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-08dde2f9-aba4-4bd9-8476-874372e3cddb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance b41b91ef-4d7d-4284-b923-7a1d415871eb could not be found. Jan 22 21:09:27.947004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08dde2f9-aba4-4bd9-8476-874372e3cddb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance b41b91ef-4d7d-4284-b923-7a1d415871eb could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:27.947877 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-08dde2f9-aba4-4bd9-8476-874372e3cddb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 404 len: 111 microversion: 2.1 time: 0.031455 Jan 22 21:09:27.948502 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1677/3190] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:27 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:09:27.961290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-80322032-7cc3-40cf-a070-59a8ea73ae39 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Action: 'create', calling method: .version_select at 0x7f1edaf1f5e0>, body: {"keypair": {"name": "tempest-key-122366025"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:27.975826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-80322032-7cc3-40cf-a070-59a8ea73ae39 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:09:27.980905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-80322032-7cc3-40cf-a070-59a8ea73ae39 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for user 75befd3272db4de48c7b4586adf6f849 and project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:09:28.010781 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-55fe3ff5-6b0c-4620-ac44-b56abf5f72b9 tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/ba5f690a-eb7d-4254-9fbb-c588f6872a09" status: 202 len: 0 microversion: 2.1 time: 0.264545 Jan 22 21:09:28.010781 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1514/3191] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:09:27 2022] DELETE /compute/v2.1/os-security-groups/ba5f690a-eb7d-4254-9fbb-c588f6872a09 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:28.016302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-50b284b8-ebd4-4282-bb4d-6d7005e1be1c tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] Calling method '.version_select at 0x7f1ed51f0b80>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:28.287373 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-50b284b8-ebd4-4282-bb4d-6d7005e1be1c tempest-SecurityGroupRulesNegativeTestJSON-925507571 tempest-SecurityGroupRulesNegativeTestJSON-925507571-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/2bca42a6-2fe4-4ed3-acff-6981c78ca5b9" status: 202 len: 0 microversion: 2.1 time: 0.274998 Jan 22 21:09:28.291648 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1515/3192] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:09:28 2022] DELETE /compute/v2.1/os-security-groups/2bca42a6-2fe4-4ed3-acff-6981c78ca5b9 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:09:28.297748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2ba67498-da78-4076-94fe-d6455aa73fb1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:28.298686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2ba67498-da78-4076-94fe-d6455aa73fb1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:28.305574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ba67498-da78-4076-94fe-d6455aa73fb1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:28.306260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ba67498-da78-4076-94fe-d6455aa73fb1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:28.307494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ba67498-da78-4076-94fe-d6455aa73fb1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:28.320843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ba67498-da78-4076-94fe-d6455aa73fb1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:28.363237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-80322032-7cc3-40cf-a070-59a8ea73ae39 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:09:28.369172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-80322032-7cc3-40cf-a070-59a8ea73ae39 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for user 75befd3272db4de48c7b4586adf6f849 and project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:09:28.397024 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-80322032-7cc3-40cf-a070-59a8ea73ae39 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.439663 Jan 22 21:09:28.397755 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1678/3193] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:09:27 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:28.408048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-42cd97b2-34e3-45e3-9f54-748ffe08b7a1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '.version_select at 0x7f1edafaee50>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:28.412587 ncdv-master-1 devstack@n-api.service[137032]: WARNING oslo_db.sqlalchemy.utils [None req-42cd97b2-34e3-45e3-9f54-748ffe08b7a1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Unique keys not in sort_keys. The sorting order may be unstable. Jan 22 21:09:28.416733 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-42cd97b2-34e3-45e3-9f54-748ffe08b7a1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/os-keypairs" status: 200 len: 544 microversion: 2.1 time: 0.013172 Jan 22 21:09:28.417401 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1679/3194] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:09:28 2022] GET /compute/v2.1/os-keypairs => generated 544 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:28.432736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-acfa102a-4f71-44d3-af30-5f12ed23a5f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:28.434109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-acfa102a-4f71-44d3-af30-5f12ed23a5f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:28.444989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acfa102a-4f71-44d3-af30-5f12ed23a5f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:28.447060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acfa102a-4f71-44d3-af30-5f12ed23a5f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:28.449365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acfa102a-4f71-44d3-af30-5f12ed23a5f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:28.450044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acfa102a-4f71-44d3-af30-5f12ed23a5f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:28.595961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2ba67498-da78-4076-94fe-d6455aa73fb1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:28.604414 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2ba67498-da78-4076-94fe-d6455aa73fb1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.311496 Jan 22 21:09:28.604989 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1516/3195] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:28 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:28.610153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-16cc332e-dc0b-4ea0-8072-81c17cfdd34d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:28.611147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-16cc332e-dc0b-4ea0-8072-81c17cfdd34d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:28.617045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16cc332e-dc0b-4ea0-8072-81c17cfdd34d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:28.621896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16cc332e-dc0b-4ea0-8072-81c17cfdd34d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:28.621896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16cc332e-dc0b-4ea0-8072-81c17cfdd34d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:28.621896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16cc332e-dc0b-4ea0-8072-81c17cfdd34d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:28.660794 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-16cc332e-dc0b-4ea0-8072-81c17cfdd34d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.054570 Jan 22 21:09:28.661706 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1517/3196] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:28 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:28.666591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a483599b-a5f9-41df-be61-ac9d40ee15b4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:28.667568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a483599b-a5f9-41df-be61-ac9d40ee15b4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:28.675754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a483599b-a5f9-41df-be61-ac9d40ee15b4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:28.676204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a483599b-a5f9-41df-be61-ac9d40ee15b4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:28.676989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a483599b-a5f9-41df-be61-ac9d40ee15b4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:28.677428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a483599b-a5f9-41df-be61-ac9d40ee15b4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:28.722391 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a483599b-a5f9-41df-be61-ac9d40ee15b4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.059407 Jan 22 21:09:28.723804 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1518/3197] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:28 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:28.729020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-304850333", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "key_name": "tempest-key-122366025", "networks": [{"uuid": "ab49ab48-066e-4b21-9cb5-bee63c0067a9"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:28.779669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-acfa102a-4f71-44d3-af30-5f12ed23a5f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:28.800776 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-acfa102a-4f71-44d3-af30-5f12ed23a5f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1471 microversion: 2.1 time: 0.382048 Jan 22 21:09:28.801299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] validate_networks() for [('ab49ab48-066e-4b21-9cb5-bee63c0067a9', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:09:28.802703 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1680/3198] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:28 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1471 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:28.808465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-96d6065e-df90-4f38-bad6-6e8d003fd7ca tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-625402494", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "373cb480-3bc4-4821-93e2-442b4e852b80", "destination_type": "local"}, {"source_type": "volume", "uuid": "aa78ebda-5565-4d2f-8b29-26d1a3a00b33", "destination_type": "invalid"}], "networks": [{"uuid": "a982ac8c-3d1e-405d-b754-a70452696d1b"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:28.810634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-96d6065e-df90-4f38-bad6-6e8d003fd7ca tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:28.811559 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-96d6065e-df90-4f38-bad6-6e8d003fd7ca tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.007381 Jan 22 21:09:28.812502 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1681/3199] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:28 2022] POST /compute/v2.1/servers => generated 155 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:09:28.819274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-33ead6b4-3a61-4035-af49-05878b5feb21 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:28.821769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-33ead6b4-3a61-4035-af49-05878b5feb21 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:28.827025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33ead6b4-3a61-4035-af49-05878b5feb21 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:28.827589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33ead6b4-3a61-4035-af49-05878b5feb21 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:28.828430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33ead6b4-3a61-4035-af49-05878b5feb21 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:28.829165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33ead6b4-3a61-4035-af49-05878b5feb21 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:29.059922 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-33ead6b4-3a61-4035-af49-05878b5feb21 tempest-ServersOnMultiNodesTest-1514722839 tempest-ServersOnMultiNodesTest-1514722839-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1622 microversion: 2.1 time: 0.245095 Jan 22 21:09:29.060720 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1682/3200] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:28 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1622 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:29.083485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab82e316-3b93-48ed-b0d5-21c40271b544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:29.084105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ab82e316-3b93-48ed-b0d5-21c40271b544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:29.090304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab82e316-3b93-48ed-b0d5-21c40271b544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:29.090762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab82e316-3b93-48ed-b0d5-21c40271b544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:29.091691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab82e316-3b93-48ed-b0d5-21c40271b544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:29.092138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab82e316-3b93-48ed-b0d5-21c40271b544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:29.229282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ab82e316-3b93-48ed-b0d5-21c40271b544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:29.236954 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab82e316-3b93-48ed-b0d5-21c40271b544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.157423 Jan 22 21:09:29.237547 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1683/3201] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:29 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:29.242092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9a210124-8a84-433e-9cbd-ca221fe0820e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:29.242587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9a210124-8a84-433e-9cbd-ca221fe0820e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:29.248432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a210124-8a84-433e-9cbd-ca221fe0820e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:29.248944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a210124-8a84-433e-9cbd-ca221fe0820e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:29.250297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a210124-8a84-433e-9cbd-ca221fe0820e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:29.250746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a210124-8a84-433e-9cbd-ca221fe0820e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:29.277632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9a210124-8a84-433e-9cbd-ca221fe0820e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:09:29.441449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:09:29.441944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:09:29.442557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:09:29.443132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:09:29.443555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:09:29.452388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:29.452962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:29.453809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:29.454249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:29.473892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:09:29.479139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for user 75befd3272db4de48c7b4586adf6f849 and project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:09:29.491095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:09:29.493534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:09:29.620771 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b25482b0-16de-4c88-82e6-30d889982274 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.895735 Jan 22 21:09:29.627332 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1519/3202] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:28 2022] POST /compute/v2.1/servers => generated 382 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:09:29.633215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-173a4203-12a1-46bf-b9c9-d3eb60040114 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:29.634204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-173a4203-12a1-46bf-b9c9-d3eb60040114 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:29.643263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-173a4203-12a1-46bf-b9c9-d3eb60040114 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:29.645990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-173a4203-12a1-46bf-b9c9-d3eb60040114 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:29.645990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-173a4203-12a1-46bf-b9c9-d3eb60040114 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:29.645990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-173a4203-12a1-46bf-b9c9-d3eb60040114 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:29.688696 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9a210124-8a84-433e-9cbd-ca221fe0820e tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "DELETE /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 204 len: 0 microversion: 2.1 time: 0.449763 Jan 22 21:09:29.689979 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1684/3203] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:29 2022] DELETE /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:09:29.695486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2632b22b-b215-47ca-bea0-402a85856bb3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:29.696450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2632b22b-b215-47ca-bea0-402a85856bb3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:29.703977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2632b22b-b215-47ca-bea0-402a85856bb3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:29.704785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2632b22b-b215-47ca-bea0-402a85856bb3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:29.705815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2632b22b-b215-47ca-bea0-402a85856bb3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:29.706447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2632b22b-b215-47ca-bea0-402a85856bb3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:29.840375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-173a4203-12a1-46bf-b9c9-d3eb60040114 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:29.848090 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-173a4203-12a1-46bf-b9c9-d3eb60040114 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.219430 Jan 22 21:09:29.848905 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1520/3204] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:29 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:29.853450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-97d1da8e-b851-439c-8765-b54d14d70e95 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:29.859357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-97d1da8e-b851-439c-8765-b54d14d70e95 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:29.916024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-97d1da8e-b851-439c-8765-b54d14d70e95 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:29.923097 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-97d1da8e-b851-439c-8765-b54d14d70e95 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1231 microversion: 2.1 time: 0.073305 Jan 22 21:09:29.923671 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1521/3205] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:29 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1231 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:29.927187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2632b22b-b215-47ca-bea0-402a85856bb3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:29.928625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6de03e18-446a-4d89-a976-45c7e807447c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:29.929631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6de03e18-446a-4d89-a976-45c7e807447c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:29.940146 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2632b22b-b215-47ca-bea0-402a85856bb3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.244963 Jan 22 21:09:29.940146 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1685/3206] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:29 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:29.942091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-edc1cbc0-18c3-4587-b57b-edc6d323c7a0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:29.942945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-edc1cbc0-18c3-4587-b57b-edc6d323c7a0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:29.945023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6de03e18-446a-4d89-a976-45c7e807447c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:29.945689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6de03e18-446a-4d89-a976-45c7e807447c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:29.946867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6de03e18-446a-4d89-a976-45c7e807447c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:29.947454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6de03e18-446a-4d89-a976-45c7e807447c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:29.958072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edc1cbc0-18c3-4587-b57b-edc6d323c7a0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:29.958552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edc1cbc0-18c3-4587-b57b-edc6d323c7a0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:29.959408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edc1cbc0-18c3-4587-b57b-edc6d323c7a0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:29.959866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edc1cbc0-18c3-4587-b57b-edc6d323c7a0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:29.996475 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6de03e18-446a-4d89-a976-45c7e807447c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.071020 Jan 22 21:09:30.000643 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1522/3207] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:29 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:30.002404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cbcabd91-aac1-4263-8cfa-035167e43c44 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:30.003389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cbcabd91-aac1-4263-8cfa-035167e43c44 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:30.010503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbcabd91-aac1-4263-8cfa-035167e43c44 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:30.010950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbcabd91-aac1-4263-8cfa-035167e43c44 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:30.011733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbcabd91-aac1-4263-8cfa-035167e43c44 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:30.012167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbcabd91-aac1-4263-8cfa-035167e43c44 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:30.053001 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cbcabd91-aac1-4263-8cfa-035167e43c44 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.054031 Jan 22 21:09:30.053979 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1523/3208] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:29 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:30.061531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5df1540b-b680-48b4-bd7b-a492f4b324a4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-745463372", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "a982ac8c-3d1e-405d-b754-a70452696d1b"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:30.063650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5df1540b-b680-48b4-bd7b-a492f4b324a4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:30.064417 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5df1540b-b680-48b4-bd7b-a492f4b324a4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.008523 Jan 22 21:09:30.065090 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1524/3209] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:30 2022] POST /compute/v2.1/servers => generated 624 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:09:30.079033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f7d2011f-f254-439e-9b81-c99488820506 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:30.079798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f7d2011f-f254-439e-9b81-c99488820506 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:30.088880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2011f-f254-439e-9b81-c99488820506 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:30.090201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2011f-f254-439e-9b81-c99488820506 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:30.091178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2011f-f254-439e-9b81-c99488820506 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:30.091763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7d2011f-f254-439e-9b81-c99488820506 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:30.254946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-edc1cbc0-18c3-4587-b57b-edc6d323c7a0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:30.262359 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-edc1cbc0-18c3-4587-b57b-edc6d323c7a0 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1477 microversion: 2.1 time: 0.324054 Jan 22 21:09:30.262936 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1686/3210] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:29 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1477 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:30.319613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f7d2011f-f254-439e-9b81-c99488820506 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:30.328064 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f7d2011f-f254-439e-9b81-c99488820506 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.253231 Jan 22 21:09:30.332039 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1525/3211] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:30 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:30.346149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4af13a15-4d3b-4d10-a286-3423ef38d73b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:30.346779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4af13a15-4d3b-4d10-a286-3423ef38d73b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:30.358126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4af13a15-4d3b-4d10-a286-3423ef38d73b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:30.360804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4af13a15-4d3b-4d10-a286-3423ef38d73b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:30.360804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4af13a15-4d3b-4d10-a286-3423ef38d73b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:30.360804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4af13a15-4d3b-4d10-a286-3423ef38d73b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:30.590485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4af13a15-4d3b-4d10-a286-3423ef38d73b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:30.598192 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4af13a15-4d3b-4d10-a286-3423ef38d73b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.256047 Jan 22 21:09:30.598774 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1687/3212] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:30 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:30.708055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-af21b5d6-82b1-4808-9c7b-d165230568c2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "a982ac8c-3d1e-405d-b754-a70452696d1b"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:30.709429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-af21b5d6-82b1-4808-9c7b-d165230568c2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:30.710345 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-af21b5d6-82b1-4808-9c7b-d165230568c2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.006470 Jan 22 21:09:30.710861 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1526/3213] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:30 2022] POST /compute/v2.1/servers => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 22 21:09:30.718885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e116ea90-aa7c-458e-9d88-59c0307c5815 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:30.719496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e116ea90-aa7c-458e-9d88-59c0307c5815 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:30.725850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e116ea90-aa7c-458e-9d88-59c0307c5815 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:30.726320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e116ea90-aa7c-458e-9d88-59c0307c5815 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:30.727130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e116ea90-aa7c-458e-9d88-59c0307c5815 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:30.727589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e116ea90-aa7c-458e-9d88-59c0307c5815 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:30.945248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48787e95-843a-43e0-805f-276cade862de tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:30.946281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48787e95-843a-43e0-805f-276cade862de tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:30.967753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48787e95-843a-43e0-805f-276cade862de tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:30.975366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48787e95-843a-43e0-805f-276cade862de tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:30.978944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48787e95-843a-43e0-805f-276cade862de tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:30.981634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48787e95-843a-43e0-805f-276cade862de tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:31.081831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-48787e95-843a-43e0-805f-276cade862de tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:31.095145 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48787e95-843a-43e0-805f-276cade862de tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1235 microversion: 2.1 time: 0.159120 Jan 22 21:09:31.107575 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1527/3214] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:30 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1235 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:31.119458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8756ed1c-c2cd-4a30-9b22-19ab1a15b526 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:31.120333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8756ed1c-c2cd-4a30-9b22-19ab1a15b526 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:31.128256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8756ed1c-c2cd-4a30-9b22-19ab1a15b526 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:31.131759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8756ed1c-c2cd-4a30-9b22-19ab1a15b526 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:31.131759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8756ed1c-c2cd-4a30-9b22-19ab1a15b526 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:31.131759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8756ed1c-c2cd-4a30-9b22-19ab1a15b526 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:31.369220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e116ea90-aa7c-458e-9d88-59c0307c5815 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:31.397253 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e116ea90-aa7c-458e-9d88-59c0307c5815 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.682272 Jan 22 21:09:31.410335 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1688/3215] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:30 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:31.410335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d2111ccf-51b2-48fd-8ef0-d93aae82170c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:31.410335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d2111ccf-51b2-48fd-8ef0-d93aae82170c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:31.415988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2111ccf-51b2-48fd-8ef0-d93aae82170c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:31.416453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2111ccf-51b2-48fd-8ef0-d93aae82170c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:31.417379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2111ccf-51b2-48fd-8ef0-d93aae82170c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:31.417862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2111ccf-51b2-48fd-8ef0-d93aae82170c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:31.442933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8756ed1c-c2cd-4a30-9b22-19ab1a15b526 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:31.464437 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8756ed1c-c2cd-4a30-9b22-19ab1a15b526 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.344998 Jan 22 21:09:31.469553 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1528/3216] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:31 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:31.471095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d7933e6-bf25-45c9-92f3-3008c9f6f993 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:31.472108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d7933e6-bf25-45c9-92f3-3008c9f6f993 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:31.478572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d7933e6-bf25-45c9-92f3-3008c9f6f993 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:31.479403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d7933e6-bf25-45c9-92f3-3008c9f6f993 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:31.479536 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d2111ccf-51b2-48fd-8ef0-d93aae82170c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.080181 Jan 22 21:09:31.481079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d7933e6-bf25-45c9-92f3-3008c9f6f993 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:31.481835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d7933e6-bf25-45c9-92f3-3008c9f6f993 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:31.484552 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1689/3217] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:31 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:31.490894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e381e16e-8454-4e5d-ad2d-fd15cf28cf06 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:31.491851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e381e16e-8454-4e5d-ad2d-fd15cf28cf06 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:31.499973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e381e16e-8454-4e5d-ad2d-fd15cf28cf06 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:31.501076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e381e16e-8454-4e5d-ad2d-fd15cf28cf06 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:31.502262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e381e16e-8454-4e5d-ad2d-fd15cf28cf06 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:31.502928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e381e16e-8454-4e5d-ad2d-fd15cf28cf06 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:31.528120 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d7933e6-bf25-45c9-92f3-3008c9f6f993 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.061148 Jan 22 21:09:31.528858 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1529/3218] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:31 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:31.536570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-51463e8f-a1f3-43ad-9a3e-53982c494012 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:31.538259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-51463e8f-a1f3-43ad-9a3e-53982c494012 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:31.556169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51463e8f-a1f3-43ad-9a3e-53982c494012 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:31.556169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51463e8f-a1f3-43ad-9a3e-53982c494012 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:31.556169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51463e8f-a1f3-43ad-9a3e-53982c494012 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:31.556169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51463e8f-a1f3-43ad-9a3e-53982c494012 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:31.784778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e381e16e-8454-4e5d-ad2d-fd15cf28cf06 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:31.798607 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e381e16e-8454-4e5d-ad2d-fd15cf28cf06 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1477 microversion: 2.1 time: 0.312149 Jan 22 21:09:31.799592 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1690/3219] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:31 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1477 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:31.804666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-51463e8f-a1f3-43ad-9a3e-53982c494012 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:31.814898 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-51463e8f-a1f3-43ad-9a3e-53982c494012 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.284510 Jan 22 21:09:31.815872 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1530/3220] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:31 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:31.929319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1d70ea53-d956-4adf-9c7f-d5af1fcd4955 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-908264389", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": -1, "networks": [{"uuid": "a982ac8c-3d1e-405d-b754-a70452696d1b"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:31.942399 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-1d70ea53-d956-4adf-9c7f-d5af1fcd4955 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Flavor -1 could not be found. Jan 22 21:09:31.943007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1d70ea53-d956-4adf-9c7f-d5af1fcd4955 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:31.944269 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1d70ea53-d956-4adf-9c7f-d5af1fcd4955 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.019662 Jan 22 21:09:31.944844 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1691/3221] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:31 2022] POST /compute/v2.1/servers => generated 73 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 22 21:09:31.954254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dfe21dec-b144-4c51-8a10-24f521ee28a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:31.954904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dfe21dec-b144-4c51-8a10-24f521ee28a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:31.961874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfe21dec-b144-4c51-8a10-24f521ee28a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:31.962337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfe21dec-b144-4c51-8a10-24f521ee28a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:31.963141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfe21dec-b144-4c51-8a10-24f521ee28a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:31.963586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfe21dec-b144-4c51-8a10-24f521ee28a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:32.107259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-1068c30f-3c87-4292-b817-404fce5a968f req-726388db-223c-4d97-a899-b56b53ca90a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e4b095-ba7a-4d1f-842f-12002cd122a0", "name": "network-vif-deleted", "tag": "fbf8f684-dcea-48ad-b4b0-e120ae7ec38a"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:32.108097 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:32.108097 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:09:32.118279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1068c30f-3c87-4292-b817-404fce5a968f req-726388db-223c-4d97-a899-b56b53ca90a8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:32.118594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1068c30f-3c87-4292-b817-404fce5a968f req-726388db-223c-4d97-a899-b56b53ca90a8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:32.152698 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-1068c30f-3c87-4292-b817-404fce5a968f req-726388db-223c-4d97-a899-b56b53ca90a8 service nova] Creating event network-vif-deleted:fbf8f684-dcea-48ad-b4b0-e120ae7ec38a for instance 39e4b095-ba7a-4d1f-842f-12002cd122a0 on nch1-master-1 Jan 22 21:09:32.166852 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-1068c30f-3c87-4292-b817-404fce5a968f req-726388db-223c-4d97-a899-b56b53ca90a8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065125 Jan 22 21:09:32.167741 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1692/3222] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:32.188158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a66bc89f-b6c9-4a56-a5d7-6cedcaaa2d2e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:32.189436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a66bc89f-b6c9-4a56-a5d7-6cedcaaa2d2e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:32.208598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a66bc89f-b6c9-4a56-a5d7-6cedcaaa2d2e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:32.209722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a66bc89f-b6c9-4a56-a5d7-6cedcaaa2d2e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:32.210867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a66bc89f-b6c9-4a56-a5d7-6cedcaaa2d2e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:32.211914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a66bc89f-b6c9-4a56-a5d7-6cedcaaa2d2e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:32.359396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a66bc89f-b6c9-4a56-a5d7-6cedcaaa2d2e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:32.388900 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a66bc89f-b6c9-4a56-a5d7-6cedcaaa2d2e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1291 microversion: 2.1 time: 0.211524 Jan 22 21:09:32.391173 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1693/3223] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:32 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1291 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:32.482279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2ad18b88-dc6c-4a23-9137-b87f59241e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:32.483854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2ad18b88-dc6c-4a23-9137-b87f59241e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:32.501286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ad18b88-dc6c-4a23-9137-b87f59241e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:32.502089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ad18b88-dc6c-4a23-9137-b87f59241e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:32.503120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ad18b88-dc6c-4a23-9137-b87f59241e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:32.503803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ad18b88-dc6c-4a23-9137-b87f59241e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:32.612656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dfe21dec-b144-4c51-8a10-24f521ee28a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:32.621771 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dfe21dec-b144-4c51-8a10-24f521ee28a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.671217 Jan 22 21:09:32.626115 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1531/3224] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:31 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:32.641385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ae94661-e438-4428-8e26-38315b80f5c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:32.642373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1ae94661-e438-4428-8e26-38315b80f5c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:32.649307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ae94661-e438-4428-8e26-38315b80f5c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:32.649790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ae94661-e438-4428-8e26-38315b80f5c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:32.650792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ae94661-e438-4428-8e26-38315b80f5c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:32.651486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ae94661-e438-4428-8e26-38315b80f5c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:32.711148 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1ae94661-e438-4428-8e26-38315b80f5c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.082618 Jan 22 21:09:32.720012 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1532/3225] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:32 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:32.720012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bd7fcb7a-6834-4e90-bbf6-6a93ad18eeb9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:32.720826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bd7fcb7a-6834-4e90-bbf6-6a93ad18eeb9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:32.729074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd7fcb7a-6834-4e90-bbf6-6a93ad18eeb9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:32.742688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd7fcb7a-6834-4e90-bbf6-6a93ad18eeb9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:32.743932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd7fcb7a-6834-4e90-bbf6-6a93ad18eeb9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:32.744598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd7fcb7a-6834-4e90-bbf6-6a93ad18eeb9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:32.788726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2ad18b88-dc6c-4a23-9137-b87f59241e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:32.798358 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2ad18b88-dc6c-4a23-9137-b87f59241e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.319835 Jan 22 21:09:32.799642 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1694/3226] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:32 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:32.800255 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bd7fcb7a-6834-4e90-bbf6-6a93ad18eeb9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.085780 Jan 22 21:09:32.800822 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1533/3227] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:32 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:32.805452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-53ad0e8c-ac92-4e9e-8578-6a3947cbddd6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:32.806336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-53ad0e8c-ac92-4e9e-8578-6a3947cbddd6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:32.813751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53ad0e8c-ac92-4e9e-8578-6a3947cbddd6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:32.814519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53ad0e8c-ac92-4e9e-8578-6a3947cbddd6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:32.815916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53ad0e8c-ac92-4e9e-8578-6a3947cbddd6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:32.816592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53ad0e8c-ac92-4e9e-8578-6a3947cbddd6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:32.820779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb945777-8646-4d20-a7e0-709f2ad4c268 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:32.829321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb945777-8646-4d20-a7e0-709f2ad4c268 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:32.830361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb945777-8646-4d20-a7e0-709f2ad4c268 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:32.831003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb945777-8646-4d20-a7e0-709f2ad4c268 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:32.832062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb945777-8646-4d20-a7e0-709f2ad4c268 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:32.832674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb945777-8646-4d20-a7e0-709f2ad4c268 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:32.872245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb945777-8646-4d20-a7e0-709f2ad4c268 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:32.873028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb945777-8646-4d20-a7e0-709f2ad4c268 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:32.873519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-fb945777-8646-4d20-a7e0-709f2ad4c268 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lazy-loading 'fault' on Instance uuid 39e4b095-ba7a-4d1f-842f-12002cd122a0 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:09:32.937261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fb945777-8646-4d20-a7e0-709f2ad4c268 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:32.950255 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb945777-8646-4d20-a7e0-709f2ad4c268 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 200 len: 1311 microversion: 2.1 time: 0.138392 Jan 22 21:09:32.962273 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1534/3228] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:32 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 1311 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:33.114638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-53ad0e8c-ac92-4e9e-8578-6a3947cbddd6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:33.122496 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-53ad0e8c-ac92-4e9e-8578-6a3947cbddd6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.320771 Jan 22 21:09:33.123669 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1695/3229] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:32 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:33.208328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-085ca322-bc5c-408b-8b0e-3be87971cf92 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1322579649", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "a982ac8c-3d1e-405d-b754-a70452696d1b"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:33.220003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-085ca322-bc5c-408b-8b0e-3be87971cf92 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:33.220003 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-085ca322-bc5c-408b-8b0e-3be87971cf92 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.008114 Jan 22 21:09:33.220003 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1535/3230] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:33 2022] POST /compute/v2.1/servers => generated 145 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:09:33.224972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bbe3e2fa-22d9-410e-81a6-4ad8ab36499d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:33.225631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bbe3e2fa-22d9-410e-81a6-4ad8ab36499d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:33.235854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbe3e2fa-22d9-410e-81a6-4ad8ab36499d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:33.236339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbe3e2fa-22d9-410e-81a6-4ad8ab36499d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:33.239340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbe3e2fa-22d9-410e-81a6-4ad8ab36499d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:33.239340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbe3e2fa-22d9-410e-81a6-4ad8ab36499d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:33.410475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee638cbd-d0bb-47c9-9d2a-3c9f9878fd84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:33.411095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ee638cbd-d0bb-47c9-9d2a-3c9f9878fd84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:33.426658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee638cbd-d0bb-47c9-9d2a-3c9f9878fd84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:33.433282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee638cbd-d0bb-47c9-9d2a-3c9f9878fd84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:33.434491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee638cbd-d0bb-47c9-9d2a-3c9f9878fd84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:33.436095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee638cbd-d0bb-47c9-9d2a-3c9f9878fd84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:33.452018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bbe3e2fa-22d9-410e-81a6-4ad8ab36499d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:33.464376 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bbe3e2fa-22d9-410e-81a6-4ad8ab36499d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.243047 Jan 22 21:09:33.465088 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1696/3231] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:33 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:33.485555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f885b8e6-68e9-498f-a159-48b9b7cb9c88 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:33.486177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f885b8e6-68e9-498f-a159-48b9b7cb9c88 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:33.492404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f885b8e6-68e9-498f-a159-48b9b7cb9c88 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:33.492859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f885b8e6-68e9-498f-a159-48b9b7cb9c88 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:33.493699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f885b8e6-68e9-498f-a159-48b9b7cb9c88 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:33.494146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f885b8e6-68e9-498f-a159-48b9b7cb9c88 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:33.526867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ee638cbd-d0bb-47c9-9d2a-3c9f9878fd84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:33.539954 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee638cbd-d0bb-47c9-9d2a-3c9f9878fd84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1289 microversion: 2.1 time: 0.135865 Jan 22 21:09:33.540840 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1536/3232] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:33 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1289 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:33.723966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e4625540-ae65-42a9-80bd-1f4cb43d75b4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:33.724892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e4625540-ae65-42a9-80bd-1f4cb43d75b4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:33.731329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4625540-ae65-42a9-80bd-1f4cb43d75b4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:33.731910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4625540-ae65-42a9-80bd-1f4cb43d75b4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:33.732736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4625540-ae65-42a9-80bd-1f4cb43d75b4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:33.733181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4625540-ae65-42a9-80bd-1f4cb43d75b4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:33.846540 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e4625540-ae65-42a9-80bd-1f4cb43d75b4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.126773 Jan 22 21:09:33.853393 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1537/3233] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:33 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:33.860143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-476d7f1b-fe58-43a0-95de-46149cc03136 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:33.861317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-476d7f1b-fe58-43a0-95de-46149cc03136 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:33.869688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-476d7f1b-fe58-43a0-95de-46149cc03136 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:33.870142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-476d7f1b-fe58-43a0-95de-46149cc03136 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:33.871979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-476d7f1b-fe58-43a0-95de-46149cc03136 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:33.871979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-476d7f1b-fe58-43a0-95de-46149cc03136 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:33.873459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f885b8e6-68e9-498f-a159-48b9b7cb9c88 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:33.891780 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f885b8e6-68e9-498f-a159-48b9b7cb9c88 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.409865 Jan 22 21:09:33.909544 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1697/3234] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:33 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:33.919144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5718cd09-6af2-4c04-9f85-d68680853aec tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:33.924189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5718cd09-6af2-4c04-9f85-d68680853aec tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:33.933971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5718cd09-6af2-4c04-9f85-d68680853aec tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:33.934209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5718cd09-6af2-4c04-9f85-d68680853aec tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:33.935203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5718cd09-6af2-4c04-9f85-d68680853aec tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:33.935670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5718cd09-6af2-4c04-9f85-d68680853aec tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:33.996260 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5718cd09-6af2-4c04-9f85-d68680853aec tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.091553 Jan 22 21:09:34.001599 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1698/3235] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:33 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:34.003552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bec4cb2c-76f6-4203-be4d-3c9e3055ad26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:34.004284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bec4cb2c-76f6-4203-be4d-3c9e3055ad26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 39e4b095-ba7a-4d1f-842f-12002cd122a0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:34.012605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bec4cb2c-76f6-4203-be4d-3c9e3055ad26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:34.014047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bec4cb2c-76f6-4203-be4d-3c9e3055ad26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:34.015655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bec4cb2c-76f6-4203-be4d-3c9e3055ad26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:34.016143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bec4cb2c-76f6-4203-be4d-3c9e3055ad26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:34.032635 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-bec4cb2c-76f6-4203-be4d-3c9e3055ad26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] HTTP exception thrown: Instance 39e4b095-ba7a-4d1f-842f-12002cd122a0 could not be found. Jan 22 21:09:34.033236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bec4cb2c-76f6-4203-be4d-3c9e3055ad26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Returning 404 to user: Instance 39e4b095-ba7a-4d1f-842f-12002cd122a0 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:34.034119 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bec4cb2c-76f6-4203-be4d-3c9e3055ad26 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0" status: 404 len: 111 microversion: 2.1 time: 0.036133 Jan 22 21:09:34.034710 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1699/3236] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:33 2022] GET /compute/v2.1/servers/39e4b095-ba7a-4d1f-842f-12002cd122a0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:34.039276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-53474ccd-ecee-4e77-b5ae-ad87a14ade6d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1507216529", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:34.046645 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-53474ccd-ecee-4e77-b5ae-ad87a14ade6d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jan 22 21:09:34.056495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-53474ccd-ecee-4e77-b5ae-ad87a14ade6d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:34.056495 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-53474ccd-ecee-4e77-b5ae-ad87a14ade6d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.013373 Jan 22 21:09:34.056495 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1700/3237] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:34 2022] POST /compute/v2.1/servers => generated 123 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:09:34.059564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1610c501-2fac-4477-9521-81ba453830ee tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:34.060522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1610c501-2fac-4477-9521-81ba453830ee tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:34.068830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1610c501-2fac-4477-9521-81ba453830ee tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:34.069296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1610c501-2fac-4477-9521-81ba453830ee tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:34.070137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1610c501-2fac-4477-9521-81ba453830ee tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:34.070586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1610c501-2fac-4477-9521-81ba453830ee tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:34.099825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1610c501-2fac-4477-9521-81ba453830ee tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:09:34.155191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-476d7f1b-fe58-43a0-95de-46149cc03136 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:34.166290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-476d7f1b-fe58-43a0-95de-46149cc03136 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.310919 Jan 22 21:09:34.167275 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1538/3238] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:33 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:34.178132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5d7321ae-cf1c-4c30-b1b8-2bdaf65e9c23 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:34.178132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5d7321ae-cf1c-4c30-b1b8-2bdaf65e9c23 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:34.184050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d7321ae-cf1c-4c30-b1b8-2bdaf65e9c23 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:34.184763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d7321ae-cf1c-4c30-b1b8-2bdaf65e9c23 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:34.185616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d7321ae-cf1c-4c30-b1b8-2bdaf65e9c23 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:34.186081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d7321ae-cf1c-4c30-b1b8-2bdaf65e9c23 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:34.601566 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1610c501-2fac-4477-9521-81ba453830ee tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "DELETE /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 204 len: 0 microversion: 2.1 time: 0.549343 Jan 22 21:09:34.609385 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1701/3239] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:34 2022] DELETE /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:09:34.610974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-27df373b-317d-4b7d-ad9f-335969f0acc0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:34.611732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-27df373b-317d-4b7d-ad9f-335969f0acc0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:34.619496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27df373b-317d-4b7d-ad9f-335969f0acc0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:34.620494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27df373b-317d-4b7d-ad9f-335969f0acc0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:34.621347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27df373b-317d-4b7d-ad9f-335969f0acc0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:34.621863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27df373b-317d-4b7d-ad9f-335969f0acc0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:34.665162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5d7321ae-cf1c-4c30-b1b8-2bdaf65e9c23 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:34.676843 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5d7321ae-cf1c-4c30-b1b8-2bdaf65e9c23 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.507849 Jan 22 21:09:34.677446 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1539/3240] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:34 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:34.690609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ca87160-941c-4b67-959e-ecaf1976ad5f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:34.691736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ca87160-941c-4b67-959e-ecaf1976ad5f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:34.709742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ca87160-941c-4b67-959e-ecaf1976ad5f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:34.710334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ca87160-941c-4b67-959e-ecaf1976ad5f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:34.711227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ca87160-941c-4b67-959e-ecaf1976ad5f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:34.711687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ca87160-941c-4b67-959e-ecaf1976ad5f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:34.937485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8ca87160-941c-4b67-959e-ecaf1976ad5f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:34.942378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-27df373b-317d-4b7d-ad9f-335969f0acc0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:34.948438 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ca87160-941c-4b67-959e-ecaf1976ad5f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1477 microversion: 2.1 time: 0.269233 Jan 22 21:09:34.949746 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1540/3241] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:34 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1477 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:34.953442 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-27df373b-317d-4b7d-ad9f-335969f0acc0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1331 microversion: 2.1 time: 0.349868 Jan 22 21:09:34.956023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3c63a1ae-0c06-4464-89ba-38d6c90c806d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:34.956722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3c63a1ae-0c06-4464-89ba-38d6c90c806d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:34.963024 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1702/3242] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:34 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1331 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:34.963221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c63a1ae-0c06-4464-89ba-38d6c90c806d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:34.963736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c63a1ae-0c06-4464-89ba-38d6c90c806d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:34.965114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c63a1ae-0c06-4464-89ba-38d6c90c806d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:34.965841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c63a1ae-0c06-4464-89ba-38d6c90c806d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:34.978401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f883c67f-a785-46ad-9d3b-caa11391dc6a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:34.979723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f883c67f-a785-46ad-9d3b-caa11391dc6a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:34.987358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f883c67f-a785-46ad-9d3b-caa11391dc6a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:34.987822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f883c67f-a785-46ad-9d3b-caa11391dc6a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:34.988684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f883c67f-a785-46ad-9d3b-caa11391dc6a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:34.989387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f883c67f-a785-46ad-9d3b-caa11391dc6a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:35.065622 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f883c67f-a785-46ad-9d3b-caa11391dc6a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.091054 Jan 22 21:09:35.066285 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1703/3243] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:34 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:35.071816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9e9a812c-0505-429a-8f0c-4beb4fd21454 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:35.072832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9e9a812c-0505-429a-8f0c-4beb4fd21454 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:35.080771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e9a812c-0505-429a-8f0c-4beb4fd21454 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:35.081228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e9a812c-0505-429a-8f0c-4beb4fd21454 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:35.082168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e9a812c-0505-429a-8f0c-4beb4fd21454 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:35.082869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e9a812c-0505-429a-8f0c-4beb4fd21454 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:35.126022 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9e9a812c-0505-429a-8f0c-4beb4fd21454 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.057664 Jan 22 21:09:35.135430 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1704/3244] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:35 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:35.266594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1701210731", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "e8b85ba2-3beb-4f6f-a9a7-49eff671e25e"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:35.294086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3c63a1ae-0c06-4464-89ba-38d6c90c806d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:35.306626 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3c63a1ae-0c06-4464-89ba-38d6c90c806d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.355306 Jan 22 21:09:35.307745 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1541/3245] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:34 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:35.314870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eb1411cf-5b99-481a-81b9-6b80d76c9aa8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:35.315677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eb1411cf-5b99-481a-81b9-6b80d76c9aa8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:35.326448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] validate_networks() for [('e8b85ba2-3beb-4f6f-a9a7-49eff671e25e', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:09:35.336939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb1411cf-5b99-481a-81b9-6b80d76c9aa8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:35.337404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb1411cf-5b99-481a-81b9-6b80d76c9aa8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:35.338422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb1411cf-5b99-481a-81b9-6b80d76c9aa8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:35.339008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb1411cf-5b99-481a-81b9-6b80d76c9aa8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:35.626875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eb1411cf-5b99-481a-81b9-6b80d76c9aa8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:35.634355 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eb1411cf-5b99-481a-81b9-6b80d76c9aa8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.325264 Jan 22 21:09:35.644666 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1542/3246] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:35 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:35.644666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-544ea3a6-b96b-4719-bd21-109748aa2b9b req-f04fb98a-d4de-4c4e-8188-6a1dade3d258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea383184-f9d7-42bf-ae0b-91ef44de1864", "tag": "ab07f53f-fd0b-42cc-b6cb-02cd1e69e148"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:35.644666 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:35.644666 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:35.648631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-544ea3a6-b96b-4719-bd21-109748aa2b9b req-f04fb98a-d4de-4c4e-8188-6a1dade3d258 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:35.649621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-544ea3a6-b96b-4719-bd21-109748aa2b9b req-f04fb98a-d4de-4c4e-8188-6a1dade3d258 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:35.662773 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-544ea3a6-b96b-4719-bd21-109748aa2b9b req-f04fb98a-d4de-4c4e-8188-6a1dade3d258 service nova] Creating event network-changed:ab07f53f-fd0b-42cc-b6cb-02cd1e69e148 for instance ea383184-f9d7-42bf-ae0b-91ef44de1864 on nch1-master-1 Jan 22 21:09:35.668183 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-544ea3a6-b96b-4719-bd21-109748aa2b9b req-f04fb98a-d4de-4c4e-8188-6a1dade3d258 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032120 Jan 22 21:09:35.672009 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1543/3247] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:35.675118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c30bdd0e-f348-4ebd-a45a-ef6d9cc185ec tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-686905796", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "key_name": "tempest-key-1076700509", "networks": [{"uuid": "a982ac8c-3d1e-405d-b754-a70452696d1b"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:35.729666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-c30bdd0e-f348-4ebd-a45a-ef6d9cc185ec tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] validate_networks() for [('a982ac8c-3d1e-405d-b754-a70452696d1b', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:09:35.925654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:09:35.926190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:09:35.926778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:09:35.927346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:09:35.928014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:09:35.939722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:35.943616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:35.943616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:35.943616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:35.960980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Getting quotas for project 8245987c837d47bab828f0b05c94a019. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:09:35.969831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Getting quotas for user dd0d103dfe6a41d9bb2fae68523fc2bd and project 8245987c837d47bab828f0b05c94a019. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:09:35.986872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:09:35.989364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:09:36.042078 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-c30bdd0e-f348-4ebd-a45a-ef6d9cc185ec tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Invalid key_name provided. Jan 22 21:09:36.043785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c30bdd0e-f348-4ebd-a45a-ef6d9cc185ec tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 400 to user: Invalid key_name provided. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:36.044997 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c30bdd0e-f348-4ebd-a45a-ef6d9cc185ec tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.374900 Jan 22 21:09:36.045617 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1544/3248] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:35 2022] POST /compute/v2.1/servers => generated 70 bytes in 376 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 22 21:09:36.050793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aa06e5cb-a73d-402a-9e99-cf72aea570bc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:36.051753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aa06e5cb-a73d-402a-9e99-cf72aea570bc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:36.058765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa06e5cb-a73d-402a-9e99-cf72aea570bc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:36.059221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa06e5cb-a73d-402a-9e99-cf72aea570bc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:36.060428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa06e5cb-a73d-402a-9e99-cf72aea570bc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:36.061088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa06e5cb-a73d-402a-9e99-cf72aea570bc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:36.255757 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-009d69e4-7fb8-4b3c-ac3a-76d65ffb2d7b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.127748 Jan 22 21:09:36.258660 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1705/3249] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:35 2022] POST /compute/v2.1/servers => generated 382 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:09:36.295725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3a077a86-7e3c-4740-9c6f-bdd95837af91 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:36.298625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3a077a86-7e3c-4740-9c6f-bdd95837af91 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:36.310886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a077a86-7e3c-4740-9c6f-bdd95837af91 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:36.311900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a077a86-7e3c-4740-9c6f-bdd95837af91 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:36.312922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a077a86-7e3c-4740-9c6f-bdd95837af91 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:36.313613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a077a86-7e3c-4740-9c6f-bdd95837af91 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:36.574931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-aa06e5cb-a73d-402a-9e99-cf72aea570bc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:36.578590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3a077a86-7e3c-4740-9c6f-bdd95837af91 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:36.588545 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3a077a86-7e3c-4740-9c6f-bdd95837af91 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1331 microversion: 2.1 time: 0.306070 Jan 22 21:09:36.589963 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1706/3250] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:36 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1331 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:36.590094 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aa06e5cb-a73d-402a-9e99-cf72aea570bc tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1477 microversion: 2.1 time: 0.543333 Jan 22 21:09:36.590740 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1545/3251] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:36 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1477 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:36.595942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-359df6ce-7f34-4bfc-a854-fd5d830a6df7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:36.597322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-359df6ce-7f34-4bfc-a854-fd5d830a6df7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:36.599168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6ccbb7fe-ae2c-404a-9f1b-cb0a80748038 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:36.600495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6ccbb7fe-ae2c-404a-9f1b-cb0a80748038 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:36.618009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-359df6ce-7f34-4bfc-a854-fd5d830a6df7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:36.618009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-359df6ce-7f34-4bfc-a854-fd5d830a6df7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:36.618242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ccbb7fe-ae2c-404a-9f1b-cb0a80748038 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:36.618363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-359df6ce-7f34-4bfc-a854-fd5d830a6df7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:36.618468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ccbb7fe-ae2c-404a-9f1b-cb0a80748038 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:36.618566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-359df6ce-7f34-4bfc-a854-fd5d830a6df7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:36.618665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ccbb7fe-ae2c-404a-9f1b-cb0a80748038 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:36.618665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ccbb7fe-ae2c-404a-9f1b-cb0a80748038 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:36.666256 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6ccbb7fe-ae2c-404a-9f1b-cb0a80748038 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.074186 Jan 22 21:09:36.670261 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1546/3252] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:36 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:36.677215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d6f2dec3-0618-42f0-8b70-20f94754f1e5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:36.678277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d6f2dec3-0618-42f0-8b70-20f94754f1e5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:36.685631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6f2dec3-0618-42f0-8b70-20f94754f1e5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:36.686096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6f2dec3-0618-42f0-8b70-20f94754f1e5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:36.689044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6f2dec3-0618-42f0-8b70-20f94754f1e5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:36.689565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6f2dec3-0618-42f0-8b70-20f94754f1e5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:36.748117 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d6f2dec3-0618-42f0-8b70-20f94754f1e5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.079592 Jan 22 21:09:36.757135 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1547/3253] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:36 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:36.771364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b85faee5-0970-48e1-afb6-efe4daf36a3b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:36.772151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b85faee5-0970-48e1-afb6-efe4daf36a3b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:36.794473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-359df6ce-7f34-4bfc-a854-fd5d830a6df7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:36.803052 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-359df6ce-7f34-4bfc-a854-fd5d830a6df7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.211126 Jan 22 21:09:36.803651 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1707/3254] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:36 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:36.808934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ee9c828-52e6-40c2-87f4-dd418b06d22e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:36.809787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1ee9c828-52e6-40c2-87f4-dd418b06d22e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:36.820073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ee9c828-52e6-40c2-87f4-dd418b06d22e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:36.820514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ee9c828-52e6-40c2-87f4-dd418b06d22e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:36.821879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ee9c828-52e6-40c2-87f4-dd418b06d22e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:36.822331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ee9c828-52e6-40c2-87f4-dd418b06d22e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:36.874984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b85faee5-0970-48e1-afb6-efe4daf36a3b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:36.885717 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b85faee5-0970-48e1-afb6-efe4daf36a3b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1221 microversion: 2.1 time: 0.126522 Jan 22 21:09:36.896390 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1548/3255] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:36 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1221 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:36.901269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2b93ebf9-7b23-4424-a620-286c104d953b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:36.904208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2b93ebf9-7b23-4424-a620-286c104d953b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:36.911573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b93ebf9-7b23-4424-a620-286c104d953b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:36.912034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b93ebf9-7b23-4424-a620-286c104d953b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:36.913100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b93ebf9-7b23-4424-a620-286c104d953b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:36.913583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b93ebf9-7b23-4424-a620-286c104d953b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:37.116125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1ee9c828-52e6-40c2-87f4-dd418b06d22e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:37.127752 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ee9c828-52e6-40c2-87f4-dd418b06d22e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.322903 Jan 22 21:09:37.128694 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1708/3256] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:36 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:37.137966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2b93ebf9-7b23-4424-a620-286c104d953b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:37.145247 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2b93ebf9-7b23-4424-a620-286c104d953b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.257155 Jan 22 21:09:37.146179 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1549/3257] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:36 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:37.202280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-72365a68-2635-446d-b758-4ef7e3ec2ae0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-527770910", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "a982ac8c-3d1e-405d-b754-a70452696d1b"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:37.292981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.security_group_api [None req-72365a68-2635-446d-b758-4ef7e3ec2ae0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Neutron security group does_not_exist not found {{(pid=137032) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jan 22 21:09:37.293614 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-72365a68-2635-446d-b758-4ef7e3ec2ae0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jan 22 21:09:37.294266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-72365a68-2635-446d-b758-4ef7e3ec2ae0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:37.295124 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-72365a68-2635-446d-b758-4ef7e3ec2ae0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.096705 Jan 22 21:09:37.296267 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1709/3258] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:37 2022] POST /compute/v2.1/servers => generated 106 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:09:37.307400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1941b76f-8d8f-44d6-af85-4bba79ca885e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:37.308320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1941b76f-8d8f-44d6-af85-4bba79ca885e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:37.325938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1941b76f-8d8f-44d6-af85-4bba79ca885e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:37.326485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1941b76f-8d8f-44d6-af85-4bba79ca885e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:37.327486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1941b76f-8d8f-44d6-af85-4bba79ca885e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:37.328043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1941b76f-8d8f-44d6-af85-4bba79ca885e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:37.404707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-31429082-ae04-4479-8ba5-9198c2b87035 req-cb53ec9e-c970-4cd0-b199-57f589cbbd94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4357d420-1aed-4d31-a61b-e95f4be3e303", "name": "network-vif-deleted", "tag": "73e1e6c8-4fa4-4d3d-83b2-279e5b30b45e"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:37.407287 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:37.407287 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:09:37.418067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-31429082-ae04-4479-8ba5-9198c2b87035 req-cb53ec9e-c970-4cd0-b199-57f589cbbd94 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:37.418849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-31429082-ae04-4479-8ba5-9198c2b87035 req-cb53ec9e-c970-4cd0-b199-57f589cbbd94 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:37.436317 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-31429082-ae04-4479-8ba5-9198c2b87035 req-cb53ec9e-c970-4cd0-b199-57f589cbbd94 service nova] Creating event network-vif-deleted:73e1e6c8-4fa4-4d3d-83b2-279e5b30b45e for instance 4357d420-1aed-4d31-a61b-e95f4be3e303 on nch2-master-1 Jan 22 21:09:37.442644 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-31429082-ae04-4479-8ba5-9198c2b87035 req-cb53ec9e-c970-4cd0-b199-57f589cbbd94 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042966 Jan 22 21:09:37.443816 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1710/3259] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:09:37.538118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1941b76f-8d8f-44d6-af85-4bba79ca885e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:37.561301 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1941b76f-8d8f-44d6-af85-4bba79ca885e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.257670 Jan 22 21:09:37.562752 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1550/3260] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:37 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:37.590483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-be829546-8812-4e6b-8687-02d79fefa25f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:37.592535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-be829546-8812-4e6b-8687-02d79fefa25f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:37.608364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5b0ba489-c7ee-42c1-9b01-9bda3c61738b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:37.609301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5b0ba489-c7ee-42c1-9b01-9bda3c61738b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:37.628748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b0ba489-c7ee-42c1-9b01-9bda3c61738b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:37.632484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b0ba489-c7ee-42c1-9b01-9bda3c61738b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:37.647206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be829546-8812-4e6b-8687-02d79fefa25f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:37.647206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be829546-8812-4e6b-8687-02d79fefa25f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:37.647206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be829546-8812-4e6b-8687-02d79fefa25f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:37.647206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be829546-8812-4e6b-8687-02d79fefa25f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:37.647696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b0ba489-c7ee-42c1-9b01-9bda3c61738b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:37.647696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b0ba489-c7ee-42c1-9b01-9bda3c61738b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:37.832166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5b0ba489-c7ee-42c1-9b01-9bda3c61738b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:37.841399 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5b0ba489-c7ee-42c1-9b01-9bda3c61738b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1331 microversion: 2.1 time: 0.238516 Jan 22 21:09:37.851782 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1551/3261] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:37 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1331 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:37.857185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6f97f67f-a885-48cd-bdf4-a55512e01882 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:37.858250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6f97f67f-a885-48cd-bdf4-a55512e01882 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:37.865811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f97f67f-a885-48cd-bdf4-a55512e01882 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:37.866387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f97f67f-a885-48cd-bdf4-a55512e01882 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:37.867466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f97f67f-a885-48cd-bdf4-a55512e01882 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:37.868005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f97f67f-a885-48cd-bdf4-a55512e01882 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:37.903851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f97f67f-a885-48cd-bdf4-a55512e01882 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:37.904548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f97f67f-a885-48cd-bdf4-a55512e01882 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:37.904847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-6f97f67f-a885-48cd-bdf4-a55512e01882 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lazy-loading 'fault' on Instance uuid 4357d420-1aed-4d31-a61b-e95f4be3e303 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:09:37.942614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-be829546-8812-4e6b-8687-02d79fefa25f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:37.950296 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-be829546-8812-4e6b-8687-02d79fefa25f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.371407 Jan 22 21:09:37.950910 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1711/3262] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:37 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:37.958747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0fc583c4-cb38-4195-acf8-944da51157eb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:37.961106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0fc583c4-cb38-4195-acf8-944da51157eb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:37.969565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6f97f67f-a885-48cd-bdf4-a55512e01882 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:37.969916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0fc583c4-cb38-4195-acf8-944da51157eb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:37.970886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0fc583c4-cb38-4195-acf8-944da51157eb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:37.971711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0fc583c4-cb38-4195-acf8-944da51157eb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:37.972163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0fc583c4-cb38-4195-acf8-944da51157eb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:37.979237 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6f97f67f-a885-48cd-bdf4-a55512e01882 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 200 len: 1311 microversion: 2.1 time: 0.125942 Jan 22 21:09:37.980079 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1552/3263] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:37 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 1311 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:37.984684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1614ba50-2abf-43f0-a0fd-e3dd40506205 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:37.985957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1614ba50-2abf-43f0-a0fd-e3dd40506205 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:37.995493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1614ba50-2abf-43f0-a0fd-e3dd40506205 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.007205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1614ba50-2abf-43f0-a0fd-e3dd40506205 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.007205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1614ba50-2abf-43f0-a0fd-e3dd40506205 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.007205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1614ba50-2abf-43f0-a0fd-e3dd40506205 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.036759 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0fc583c4-cb38-4195-acf8-944da51157eb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.083438 Jan 22 21:09:38.040287 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1712/3264] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:37 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:38.042683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f9964b9a-2fb1-437d-a1c3-6f4efccde8e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:38.043386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f9964b9a-2fb1-437d-a1c3-6f4efccde8e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:38.050942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9964b9a-2fb1-437d-a1c3-6f4efccde8e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.051409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9964b9a-2fb1-437d-a1c3-6f4efccde8e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.052243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9964b9a-2fb1-437d-a1c3-6f4efccde8e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.052689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9964b9a-2fb1-437d-a1c3-6f4efccde8e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.063963 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1614ba50-2abf-43f0-a0fd-e3dd40506205 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.082482 Jan 22 21:09:38.064619 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1553/3265] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:37 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:38.070100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dc1fe299-d6e1-4e80-9dde-da851b1793d9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:38.076247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dc1fe299-d6e1-4e80-9dde-da851b1793d9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: a747fa43-d483-4284-9342-c158235036d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:38.076420 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-dc1fe299-d6e1-4e80-9dde-da851b1793d9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance a747fa43-d483-4284-9342-c158235036d6 could not be found. Jan 22 21:09:38.076944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dc1fe299-d6e1-4e80-9dde-da851b1793d9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance a747fa43-d483-4284-9342-c158235036d6 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:38.078537 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dc1fe299-d6e1-4e80-9dde-da851b1793d9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a747fa43-d483-4284-9342-c158235036d6" status: 404 len: 111 microversion: 2.1 time: 0.012409 Jan 22 21:09:38.079108 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1554/3266] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:38 2022] DELETE /compute/v2.1/servers/a747fa43-d483-4284-9342-c158235036d6 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:38.090584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c656562b-387e-48ce-a02d-134720236b2b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:38.091508 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c656562b-387e-48ce-a02d-134720236b2b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:38.103440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c656562b-387e-48ce-a02d-134720236b2b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.104115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c656562b-387e-48ce-a02d-134720236b2b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.105300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c656562b-387e-48ce-a02d-134720236b2b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.106137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c656562b-387e-48ce-a02d-134720236b2b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.128668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f9964b9a-2fb1-437d-a1c3-6f4efccde8e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:38.145184 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f9964b9a-2fb1-437d-a1c3-6f4efccde8e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1225 microversion: 2.1 time: 0.106009 Jan 22 21:09:38.146145 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1713/3267] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:38 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:38.152742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e438ad6c-3045-488f-9d04-427e267961b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:38.153809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e438ad6c-3045-488f-9d04-427e267961b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:38.169365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e438ad6c-3045-488f-9d04-427e267961b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.169365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e438ad6c-3045-488f-9d04-427e267961b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.169365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e438ad6c-3045-488f-9d04-427e267961b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.169365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e438ad6c-3045-488f-9d04-427e267961b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.303725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c656562b-387e-48ce-a02d-134720236b2b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:38.312645 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c656562b-387e-48ce-a02d-134720236b2b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.227560 Jan 22 21:09:38.313299 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1555/3268] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:38 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:38.332130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8b45bb22-bf1e-472f-be51-b65c8791eaa6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:38.333127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8b45bb22-bf1e-472f-be51-b65c8791eaa6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:38.339425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b45bb22-bf1e-472f-be51-b65c8791eaa6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.339907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b45bb22-bf1e-472f-be51-b65c8791eaa6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.340685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b45bb22-bf1e-472f-be51-b65c8791eaa6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.341139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b45bb22-bf1e-472f-be51-b65c8791eaa6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.494416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8b45bb22-bf1e-472f-be51-b65c8791eaa6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:38.503375 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8b45bb22-bf1e-472f-be51-b65c8791eaa6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.174900 Jan 22 21:09:38.503976 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1556/3269] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:38 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:38.520501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c2a1685a-bf00-42f3-b68b-e4726d707b0a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:38.521590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c2a1685a-bf00-42f3-b68b-e4726d707b0a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Failed to fetch instance by id 9223372036854775808 {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2871}} Jan 22 21:09:38.521874 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-c2a1685a-bf00-42f3-b68b-e4726d707b0a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jan 22 21:09:38.522992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c2a1685a-bf00-42f3-b68b-e4726d707b0a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:38.523898 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c2a1685a-bf00-42f3-b68b-e4726d707b0a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.007438 Jan 22 21:09:38.524908 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1557/3270] 10.222.0.100 () {58 vars in 1192 bytes} [Sat Jan 22 21:09:38 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:09:38.535009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e4595735-1976-45e7-a7c1-4016dc278476 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:38.539151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e4595735-1976-45e7-a7c1-4016dc278476 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:38.542902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4595735-1976-45e7-a7c1-4016dc278476 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.543470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4595735-1976-45e7-a7c1-4016dc278476 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.544405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4595735-1976-45e7-a7c1-4016dc278476 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.544924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4595735-1976-45e7-a7c1-4016dc278476 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.693943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e4595735-1976-45e7-a7c1-4016dc278476 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:38.701665 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e4595735-1976-45e7-a7c1-4016dc278476 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.172542 Jan 22 21:09:38.702844 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1558/3271] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:38 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:38.721244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cf279356-d158-498d-8964-ae11efa8e157 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:38.721945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cf279356-d158-498d-8964-ae11efa8e157 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:38.727966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf279356-d158-498d-8964-ae11efa8e157 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.728432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf279356-d158-498d-8964-ae11efa8e157 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.729287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf279356-d158-498d-8964-ae11efa8e157 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.729895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf279356-d158-498d-8964-ae11efa8e157 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.823852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e438ad6c-3045-488f-9d04-427e267961b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:38.831655 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e438ad6c-3045-488f-9d04-427e267961b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.684188 Jan 22 21:09:38.837754 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1714/3272] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:38 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:38.869710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-48a0388b-9909-47fc-8286-b1233e855e3d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:38.871392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-48a0388b-9909-47fc-8286-b1233e855e3d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:38.885483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cf279356-d158-498d-8964-ae11efa8e157 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:38.887983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48a0388b-9909-47fc-8286-b1233e855e3d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.888451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48a0388b-9909-47fc-8286-b1233e855e3d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.889269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48a0388b-9909-47fc-8286-b1233e855e3d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.890746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48a0388b-9909-47fc-8286-b1233e855e3d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.899496 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cf279356-d158-498d-8964-ae11efa8e157 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.183485 Jan 22 21:09:38.900171 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1559/3273] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:38 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:38.916325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aa428d5b-9a54-4537-a34f-d07cdaf54c66 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:38.916885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aa428d5b-9a54-4537-a34f-d07cdaf54c66 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Failed to fetch instance by id -1 {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2871}} Jan 22 21:09:38.921538 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-aa428d5b-9a54-4537-a34f-d07cdaf54c66 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance -1 could not be found. Jan 22 21:09:38.921538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aa428d5b-9a54-4537-a34f-d07cdaf54c66 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance -1 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:38.921538 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aa428d5b-9a54-4537-a34f-d07cdaf54c66 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.006877 Jan 22 21:09:38.921538 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1560/3274] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:09:38 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 22 21:09:38.928349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24302534-6a7e-4baf-8780-0dfaf407d0e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:38.929000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-24302534-6a7e-4baf-8780-0dfaf407d0e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:38.936280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24302534-6a7e-4baf-8780-0dfaf407d0e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.937305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24302534-6a7e-4baf-8780-0dfaf407d0e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:38.938189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24302534-6a7e-4baf-8780-0dfaf407d0e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:38.938635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24302534-6a7e-4baf-8780-0dfaf407d0e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.079232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-24302534-6a7e-4baf-8780-0dfaf407d0e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:39.087361 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-24302534-6a7e-4baf-8780-0dfaf407d0e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.162644 Jan 22 21:09:39.100221 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1561/3275] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:38 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:39.100221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-63271ca0-338a-4f33-9b90-e9f5e5f6d2c8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:39.100221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-63271ca0-338a-4f33-9b90-e9f5e5f6d2c8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 4357d420-1aed-4d31-a61b-e95f4be3e303] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:39.101239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63271ca0-338a-4f33-9b90-e9f5e5f6d2c8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.101738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63271ca0-338a-4f33-9b90-e9f5e5f6d2c8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.102546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63271ca0-338a-4f33-9b90-e9f5e5f6d2c8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.102989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63271ca0-338a-4f33-9b90-e9f5e5f6d2c8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.117206 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-63271ca0-338a-4f33-9b90-e9f5e5f6d2c8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] HTTP exception thrown: Instance 4357d420-1aed-4d31-a61b-e95f4be3e303 could not be found. Jan 22 21:09:39.117991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-63271ca0-338a-4f33-9b90-e9f5e5f6d2c8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Returning 404 to user: Instance 4357d420-1aed-4d31-a61b-e95f4be3e303 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:39.121263 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-63271ca0-338a-4f33-9b90-e9f5e5f6d2c8 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303" status: 404 len: 111 microversion: 2.1 time: 0.029719 Jan 22 21:09:39.121263 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1562/3276] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:39 2022] GET /compute/v2.1/servers/4357d420-1aed-4d31-a61b-e95f4be3e303 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:39.124629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a2f54b8-e979-40a5-a012-6891ea83a294 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:39.125695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9a2f54b8-e979-40a5-a012-6891ea83a294 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:39.131796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a2f54b8-e979-40a5-a012-6891ea83a294 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.132258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a2f54b8-e979-40a5-a012-6891ea83a294 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.133054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a2f54b8-e979-40a5-a012-6891ea83a294 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.133517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a2f54b8-e979-40a5-a012-6891ea83a294 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.180068 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a2f54b8-e979-40a5-a012-6891ea83a294 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.059350 Jan 22 21:09:39.183865 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1563/3277] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:39 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:39.188466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3a5198e8-199e-4fe5-ab01-dbb50754a1e7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:39.189513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3a5198e8-199e-4fe5-ab01-dbb50754a1e7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:39.196501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a5198e8-199e-4fe5-ab01-dbb50754a1e7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.197282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a5198e8-199e-4fe5-ab01-dbb50754a1e7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.197926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a5198e8-199e-4fe5-ab01-dbb50754a1e7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.198546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a5198e8-199e-4fe5-ab01-dbb50754a1e7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.245427 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3a5198e8-199e-4fe5-ab01-dbb50754a1e7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.062587 Jan 22 21:09:39.246787 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1564/3278] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:39 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:39.248352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-48a0388b-9909-47fc-8286-b1233e855e3d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:39.257551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b918104a-f0c6-4699-b76b-d000252615be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:39.258512 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b918104a-f0c6-4699-b76b-d000252615be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:39.260998 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-48a0388b-9909-47fc-8286-b1233e855e3d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1331 microversion: 2.1 time: 0.402451 Jan 22 21:09:39.263202 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1715/3279] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:38 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1331 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:39.268307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b918104a-f0c6-4699-b76b-d000252615be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.268307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b918104a-f0c6-4699-b76b-d000252615be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.268307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b918104a-f0c6-4699-b76b-d000252615be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.268307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b918104a-f0c6-4699-b76b-d000252615be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.272257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fcf363c6-59de-4998-a4f2-5511aaf1a1ba tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:39.282248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fcf363c6-59de-4998-a4f2-5511aaf1a1ba tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:39.288941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcf363c6-59de-4998-a4f2-5511aaf1a1ba tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.289676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcf363c6-59de-4998-a4f2-5511aaf1a1ba tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.291146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcf363c6-59de-4998-a4f2-5511aaf1a1ba tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.298214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcf363c6-59de-4998-a4f2-5511aaf1a1ba tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.347413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fcf363c6-59de-4998-a4f2-5511aaf1a1ba tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:09:39.552231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b918104a-f0c6-4699-b76b-d000252615be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:39.560704 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b918104a-f0c6-4699-b76b-d000252615be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.312630 Jan 22 21:09:39.561538 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1565/3280] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:39 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:39.566423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-199adcee-6fc6-4625-9ea7-bffc6060eff9 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:39.567034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-199adcee-6fc6-4625-9ea7-bffc6060eff9 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:39.572932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-199adcee-6fc6-4625-9ea7-bffc6060eff9 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.573390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-199adcee-6fc6-4625-9ea7-bffc6060eff9 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.574226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-199adcee-6fc6-4625-9ea7-bffc6060eff9 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.574670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-199adcee-6fc6-4625-9ea7-bffc6060eff9 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.656782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-199adcee-6fc6-4625-9ea7-bffc6060eff9 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:39.664715 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-199adcee-6fc6-4625-9ea7-bffc6060eff9 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1279 microversion: 2.1 time: 0.101838 Jan 22 21:09:39.669288 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1566/3281] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:39 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1279 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:39.676566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5c016a18-b880-4b83-afcf-20b53ab0c356 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:39.677234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5c016a18-b880-4b83-afcf-20b53ab0c356 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: f422ca20-1d82-4155-9817-50f20be4ac54] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:39.682651 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-5c016a18-b880-4b83-afcf-20b53ab0c356 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance f422ca20-1d82-4155-9817-50f20be4ac54 could not be found. Jan 22 21:09:39.683233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5c016a18-b880-4b83-afcf-20b53ab0c356 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance f422ca20-1d82-4155-9817-50f20be4ac54 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:39.684046 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5c016a18-b880-4b83-afcf-20b53ab0c356 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/f422ca20-1d82-4155-9817-50f20be4ac54/action" status: 404 len: 111 microversion: 2.1 time: 0.017769 Jan 22 21:09:39.684591 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1567/3282] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:39 2022] POST /compute/v2.1/servers/f422ca20-1d82-4155-9817-50f20be4ac54/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:39.690469 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fcf363c6-59de-4998-a4f2-5511aaf1a1ba tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 204 len: 0 microversion: 2.1 time: 0.425822 Jan 22 21:09:39.692313 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1716/3283] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:39 2022] DELETE /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:09:39.696380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-964564ae-bb4b-4cf9-a611-d4dcfd2accde tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:39.697008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-964564ae-bb4b-4cf9-a611-d4dcfd2accde tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:39.703271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-964564ae-bb4b-4cf9-a611-d4dcfd2accde tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.703763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-964564ae-bb4b-4cf9-a611-d4dcfd2accde tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.704506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-964564ae-bb4b-4cf9-a611-d4dcfd2accde tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.704948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-964564ae-bb4b-4cf9-a611-d4dcfd2accde tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.706080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d8d27736-7391-415e-9263-43757ae93c0d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:39.706898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d8d27736-7391-415e-9263-43757ae93c0d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:39.713740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8d27736-7391-415e-9263-43757ae93c0d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.714476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8d27736-7391-415e-9263-43757ae93c0d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.715390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8d27736-7391-415e-9263-43757ae93c0d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.715954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8d27736-7391-415e-9263-43757ae93c0d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.845446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-964564ae-bb4b-4cf9-a611-d4dcfd2accde tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:39.854201 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-964564ae-bb4b-4cf9-a611-d4dcfd2accde tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.164432 Jan 22 21:09:39.854777 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1568/3284] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:39 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:39.870613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-af33f7e3-f0fb-4123-b3fd-e5a41766c983 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:39.871368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-af33f7e3-f0fb-4123-b3fd-e5a41766c983 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:39.877548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af33f7e3-f0fb-4123-b3fd-e5a41766c983 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.879107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af33f7e3-f0fb-4123-b3fd-e5a41766c983 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:39.879107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af33f7e3-f0fb-4123-b3fd-e5a41766c983 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:39.879330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af33f7e3-f0fb-4123-b3fd-e5a41766c983 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.022106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d8d27736-7391-415e-9263-43757ae93c0d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:40.033756 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d8d27736-7391-415e-9263-43757ae93c0d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1477 microversion: 2.1 time: 0.334868 Jan 22 21:09:40.045818 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1717/3285] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:39 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1477 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:40.049455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2de8e487-fa17-4ea0-95f1-ed5038516d00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:40.050290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2de8e487-fa17-4ea0-95f1-ed5038516d00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:40.059810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2de8e487-fa17-4ea0-95f1-ed5038516d00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.061044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2de8e487-fa17-4ea0-95f1-ed5038516d00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.062536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2de8e487-fa17-4ea0-95f1-ed5038516d00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.063089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2de8e487-fa17-4ea0-95f1-ed5038516d00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.094129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-af33f7e3-f0fb-4123-b3fd-e5a41766c983 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:40.102157 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-af33f7e3-f0fb-4123-b3fd-e5a41766c983 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.243580 Jan 22 21:09:40.103062 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1569/3286] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:39 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:40.194231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7ef6f49a-d638-4b62-b00d-9e06c5330c6b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:40.195277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7ef6f49a-d638-4b62-b00d-9e06c5330c6b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:40.204881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ef6f49a-d638-4b62-b00d-9e06c5330c6b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.204881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ef6f49a-d638-4b62-b00d-9e06c5330c6b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.204881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ef6f49a-d638-4b62-b00d-9e06c5330c6b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.204881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ef6f49a-d638-4b62-b00d-9e06c5330c6b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.254141 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7ef6f49a-d638-4b62-b00d-9e06c5330c6b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.064943 Jan 22 21:09:40.258457 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1570/3287] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:40 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:40.261261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-069af5a3-f6df-445e-a4e1-43a2c7ad0906 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:40.262372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-069af5a3-f6df-445e-a4e1-43a2c7ad0906 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:40.273298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-069af5a3-f6df-445e-a4e1-43a2c7ad0906 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.273578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2de8e487-fa17-4ea0-95f1-ed5038516d00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:40.274096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-069af5a3-f6df-445e-a4e1-43a2c7ad0906 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.274583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-069af5a3-f6df-445e-a4e1-43a2c7ad0906 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.275029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-069af5a3-f6df-445e-a4e1-43a2c7ad0906 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.283572 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2de8e487-fa17-4ea0-95f1-ed5038516d00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.247071 Jan 22 21:09:40.284154 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1718/3288] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:40 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:40.288909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6c93569a-0bb8-4584-aa4b-60b77ce9f73f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:40.290680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6c93569a-0bb8-4584-aa4b-60b77ce9f73f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:40.299010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c93569a-0bb8-4584-aa4b-60b77ce9f73f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.299816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c93569a-0bb8-4584-aa4b-60b77ce9f73f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.300698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c93569a-0bb8-4584-aa4b-60b77ce9f73f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.301265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c93569a-0bb8-4584-aa4b-60b77ce9f73f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.318979 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-069af5a3-f6df-445e-a4e1-43a2c7ad0906 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.061431 Jan 22 21:09:40.320291 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1571/3289] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:40 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:40.325185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e717bdd2-1c3a-447c-922c-9627c224e180 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:40.329842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e717bdd2-1c3a-447c-922c-9627c224e180 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 5791c29d-cb3c-4297-8845-cb3e19203e02] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:40.333794 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-e717bdd2-1c3a-447c-922c-9627c224e180 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance 5791c29d-cb3c-4297-8845-cb3e19203e02 could not be found. Jan 22 21:09:40.334396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e717bdd2-1c3a-447c-922c-9627c224e180 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance 5791c29d-cb3c-4297-8845-cb3e19203e02 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:40.335232 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e717bdd2-1c3a-447c-922c-9627c224e180 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/5791c29d-cb3c-4297-8845-cb3e19203e02/action" status: 404 len: 111 microversion: 2.1 time: 0.013891 Jan 22 21:09:40.336833 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1572/3290] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:40 2022] POST /compute/v2.1/servers/5791c29d-cb3c-4297-8845-cb3e19203e02/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:40.349203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-46ef2aec-01df-4c12-90c2-87a5e40ed921 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:40.349980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-46ef2aec-01df-4c12-90c2-87a5e40ed921 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:40.357558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-46ef2aec-01df-4c12-90c2-87a5e40ed921 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.359564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-46ef2aec-01df-4c12-90c2-87a5e40ed921 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.359916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-46ef2aec-01df-4c12-90c2-87a5e40ed921 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.360372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-46ef2aec-01df-4c12-90c2-87a5e40ed921 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.596481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-46ef2aec-01df-4c12-90c2-87a5e40ed921 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:40.605744 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-46ef2aec-01df-4c12-90c2-87a5e40ed921 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.260324 Jan 22 21:09:40.606322 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1573/3291] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:40 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:40.607867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6c93569a-0bb8-4584-aa4b-60b77ce9f73f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:40.615702 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6c93569a-0bb8-4584-aa4b-60b77ce9f73f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1331 microversion: 2.1 time: 0.330315 Jan 22 21:09:40.616477 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1719/3292] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:40 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1331 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:40.622681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2a0e1c29-4aa4-4746-9cd2-84e991cb2d0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:40.623306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2a0e1c29-4aa4-4746-9cd2-84e991cb2d0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:40.630329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a0e1c29-4aa4-4746-9cd2-84e991cb2d0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.630793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a0e1c29-4aa4-4746-9cd2-84e991cb2d0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.631593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a0e1c29-4aa4-4746-9cd2-84e991cb2d0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.632037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a0e1c29-4aa4-4746-9cd2-84e991cb2d0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.682216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-098569f4-40ea-46c1-83c6-ff407afc6496 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:40.682827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-098569f4-40ea-46c1-83c6-ff407afc6496 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:40.692100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-098569f4-40ea-46c1-83c6-ff407afc6496 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.694717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-098569f4-40ea-46c1-83c6-ff407afc6496 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.695261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-098569f4-40ea-46c1-83c6-ff407afc6496 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.695927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-098569f4-40ea-46c1-83c6-ff407afc6496 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.777117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2a0e1c29-4aa4-4746-9cd2-84e991cb2d0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:40.785636 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2a0e1c29-4aa4-4746-9cd2-84e991cb2d0e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.166532 Jan 22 21:09:40.786210 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1574/3293] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:40 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:40.801903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4489ae8d-e4ed-4558-965c-54c4011f1b38 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:40.802559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4489ae8d-e4ed-4558-965c-54c4011f1b38 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: aefe49c1-a272-436b-aacb-3499d334ebf8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:40.807982 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-4489ae8d-e4ed-4558-965c-54c4011f1b38 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance aefe49c1-a272-436b-aacb-3499d334ebf8 could not be found. Jan 22 21:09:40.808502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4489ae8d-e4ed-4558-965c-54c4011f1b38 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance aefe49c1-a272-436b-aacb-3499d334ebf8 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:40.809339 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4489ae8d-e4ed-4558-965c-54c4011f1b38 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/aefe49c1-a272-436b-aacb-3499d334ebf8" status: 404 len: 111 microversion: 2.1 time: 0.011353 Jan 22 21:09:40.809917 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1575/3294] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:40 2022] GET /compute/v2.1/servers/aefe49c1-a272-436b-aacb-3499d334ebf8 => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:09:40.818699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c6d4dc2a-dd1e-4878-80d5-9986768e80e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:40.821171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c6d4dc2a-dd1e-4878-80d5-9986768e80e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:40.829776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6d4dc2a-dd1e-4878-80d5-9986768e80e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.830233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6d4dc2a-dd1e-4878-80d5-9986768e80e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.831052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6d4dc2a-dd1e-4878-80d5-9986768e80e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:40.831504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6d4dc2a-dd1e-4878-80d5-9986768e80e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:40.972065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-098569f4-40ea-46c1-83c6-ff407afc6496 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:40.980895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c6d4dc2a-dd1e-4878-80d5-9986768e80e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:40.996712 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-098569f4-40ea-46c1-83c6-ff407afc6496 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1321 microversion: 2.1 time: 0.318112 Jan 22 21:09:40.998582 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c6d4dc2a-dd1e-4878-80d5-9986768e80e3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.183578 Jan 22 21:09:40.999998 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1720/3295] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:40 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:41.001119 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1576/3296] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:40 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:41.020371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d11a8603-f5be-4230-b5ba-3e2fad8c3dc3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:41.021306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d11a8603-f5be-4230-b5ba-3e2fad8c3dc3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:41.028110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d11a8603-f5be-4230-b5ba-3e2fad8c3dc3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.028802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d11a8603-f5be-4230-b5ba-3e2fad8c3dc3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.029900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d11a8603-f5be-4230-b5ba-3e2fad8c3dc3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.030617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d11a8603-f5be-4230-b5ba-3e2fad8c3dc3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.052034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-db13892c-0828-43d2-923e-4a3110c31a36 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:41.052803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-db13892c-0828-43d2-923e-4a3110c31a36 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:41.061463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db13892c-0828-43d2-923e-4a3110c31a36 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.062305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db13892c-0828-43d2-923e-4a3110c31a36 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.065336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db13892c-0828-43d2-923e-4a3110c31a36 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.065898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db13892c-0828-43d2-923e-4a3110c31a36 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.255987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-db13892c-0828-43d2-923e-4a3110c31a36 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:41.268064 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-db13892c-0828-43d2-923e-4a3110c31a36 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1477 microversion: 2.1 time: 0.219776 Jan 22 21:09:41.269555 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1577/3297] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:41 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1477 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:41.271196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d11a8603-f5be-4230-b5ba-3e2fad8c3dc3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:41.274227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fef432b4-ee10-4ae6-bebc-2a3d271aa1cf tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:41.274848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fef432b4-ee10-4ae6-bebc-2a3d271aa1cf tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:41.281670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fef432b4-ee10-4ae6-bebc-2a3d271aa1cf tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.282128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fef432b4-ee10-4ae6-bebc-2a3d271aa1cf tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.283000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fef432b4-ee10-4ae6-bebc-2a3d271aa1cf tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.283387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fef432b4-ee10-4ae6-bebc-2a3d271aa1cf tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.285729 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d11a8603-f5be-4230-b5ba-3e2fad8c3dc3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.271932 Jan 22 21:09:41.287912 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1721/3298] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:41 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:41.293117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d6fcb8ee-481e-4706-90ae-a2aaaa726bb2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:41.294803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d6fcb8ee-481e-4706-90ae-a2aaaa726bb2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:41.303367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6fcb8ee-481e-4706-90ae-a2aaaa726bb2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.304343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6fcb8ee-481e-4706-90ae-a2aaaa726bb2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.305411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6fcb8ee-481e-4706-90ae-a2aaaa726bb2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.306393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6fcb8ee-481e-4706-90ae-a2aaaa726bb2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.359255 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d6fcb8ee-481e-4706-90ae-a2aaaa726bb2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.069546 Jan 22 21:09:41.371410 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1722/3299] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:41 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:41.371410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8a71207f-a516-42ef-9907-c1cb72ed49ee tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:41.371410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8a71207f-a516-42ef-9907-c1cb72ed49ee tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:41.376576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a71207f-a516-42ef-9907-c1cb72ed49ee tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.377368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a71207f-a516-42ef-9907-c1cb72ed49ee tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.378617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a71207f-a516-42ef-9907-c1cb72ed49ee tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.379248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a71207f-a516-42ef-9907-c1cb72ed49ee tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.433154 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8a71207f-a516-42ef-9907-c1cb72ed49ee tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.070994 Jan 22 21:09:41.438211 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1723/3300] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:41 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:41.452414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d8a02c3-8397-46a9-a4ed-74314506cd42 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1457378904", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "a982ac8c-3d1e-405d-b754-a70452696d1b"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:41.454877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d8a02c3-8397-46a9-a4ed-74314506cd42 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:41.457345 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d8a02c3-8397-46a9-a4ed-74314506cd42 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010860 Jan 22 21:09:41.464215 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1724/3301] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:09:41.470754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ae8f5676-a3cd-4e3a-bfe3-7f30081b7b98 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:41.471908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ae8f5676-a3cd-4e3a-bfe3-7f30081b7b98 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:41.481468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae8f5676-a3cd-4e3a-bfe3-7f30081b7b98 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.481974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae8f5676-a3cd-4e3a-bfe3-7f30081b7b98 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.482789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae8f5676-a3cd-4e3a-bfe3-7f30081b7b98 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.483874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae8f5676-a3cd-4e3a-bfe3-7f30081b7b98 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.502939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fef432b4-ee10-4ae6-bebc-2a3d271aa1cf tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:41.511317 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fef432b4-ee10-4ae6-bebc-2a3d271aa1cf tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.241423 Jan 22 21:09:41.511988 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1578/3302] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:41 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:41.635521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-db61ff1e-2360-4b66-bafc-2d7261b1c0b7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:41.636257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-db61ff1e-2360-4b66-bafc-2d7261b1c0b7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:41.644017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db61ff1e-2360-4b66-bafc-2d7261b1c0b7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.644997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db61ff1e-2360-4b66-bafc-2d7261b1c0b7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.646516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db61ff1e-2360-4b66-bafc-2d7261b1c0b7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.647275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db61ff1e-2360-4b66-bafc-2d7261b1c0b7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.698102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ae8f5676-a3cd-4e3a-bfe3-7f30081b7b98 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:41.708290 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ae8f5676-a3cd-4e3a-bfe3-7f30081b7b98 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.241405 Jan 22 21:09:41.708290 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1725/3303] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:41 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:41.726479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b505826b-cf35-4268-b36e-6f364c6c8b68 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:41.727321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b505826b-cf35-4268-b36e-6f364c6c8b68 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:41.737641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b505826b-cf35-4268-b36e-6f364c6c8b68 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.742031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b505826b-cf35-4268-b36e-6f364c6c8b68 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.743005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b505826b-cf35-4268-b36e-6f364c6c8b68 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.749682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b505826b-cf35-4268-b36e-6f364c6c8b68 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.922224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-db61ff1e-2360-4b66-bafc-2d7261b1c0b7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:41.931616 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-db61ff1e-2360-4b66-bafc-2d7261b1c0b7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1331 microversion: 2.1 time: 0.302162 Jan 22 21:09:41.932673 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1579/3304] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:41 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1331 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:41.938542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f37347f5-a48d-416a-b10b-df7f37231d35 req-cb954aff-ea7e-4b92-b8da-b80a8fe4dfad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c84a8ac-7a1b-4081-bc57-ab560dc077f1", "tag": "b58670f9-67aa-4e2a-9a1f-06471ae23041"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:41.940506 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:41.940506 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:41.948072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f37347f5-a48d-416a-b10b-df7f37231d35 req-cb954aff-ea7e-4b92-b8da-b80a8fe4dfad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:41.953829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f37347f5-a48d-416a-b10b-df7f37231d35 req-cb954aff-ea7e-4b92-b8da-b80a8fe4dfad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:41.963618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b505826b-cf35-4268-b36e-6f364c6c8b68 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:41.965875 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f37347f5-a48d-416a-b10b-df7f37231d35 req-cb954aff-ea7e-4b92-b8da-b80a8fe4dfad service nova] Creating event network-changed:b58670f9-67aa-4e2a-9a1f-06471ae23041 for instance 5c84a8ac-7a1b-4081-bc57-ab560dc077f1 on nch1-master-1 Jan 22 21:09:41.971702 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f37347f5-a48d-416a-b10b-df7f37231d35 req-cb954aff-ea7e-4b92-b8da-b80a8fe4dfad service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037279 Jan 22 21:09:41.972421 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1580/3305] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:41.978769 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b505826b-cf35-4268-b36e-6f364c6c8b68 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.255942 Jan 22 21:09:41.983981 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1726/3306] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:41 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:42.018514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-940e608f-dd8d-4c2f-82b5-ddf7f4c768ef tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:42.024829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-940e608f-dd8d-4c2f-82b5-ddf7f4c768ef tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:42.050800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-940e608f-dd8d-4c2f-82b5-ddf7f4c768ef tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.055114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-940e608f-dd8d-4c2f-82b5-ddf7f4c768ef tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.055114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-940e608f-dd8d-4c2f-82b5-ddf7f4c768ef tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.056075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-940e608f-dd8d-4c2f-82b5-ddf7f4c768ef tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.084116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-97520746-343d-44fe-8424-0f7d5ca9c644 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-906138605", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "a982ac8c-3d1e-405d-b754-a70452696d1b"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:42.085616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-97520746-343d-44fe-8424-0f7d5ca9c644 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:42.086432 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-97520746-343d-44fe-8424-0f7d5ca9c644 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.007017 Jan 22 21:09:42.086985 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1727/3307] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:42 2022] POST /compute/v2.1/servers => generated 133 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:09:42.096028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-10f9b4af-1372-4bb4-9716-82601e885c05 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:42.096558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-10f9b4af-1372-4bb4-9716-82601e885c05 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:42.106051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10f9b4af-1372-4bb4-9716-82601e885c05 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.106804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10f9b4af-1372-4bb4-9716-82601e885c05 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.109324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10f9b4af-1372-4bb4-9716-82601e885c05 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.109824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10f9b4af-1372-4bb4-9716-82601e885c05 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.288957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-940e608f-dd8d-4c2f-82b5-ddf7f4c768ef tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:42.298605 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-940e608f-dd8d-4c2f-82b5-ddf7f4c768ef tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1321 microversion: 2.1 time: 0.286531 Jan 22 21:09:42.308626 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1581/3308] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:42 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:42.314376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8a9de6d6-1342-44a1-bb45-588768ab8252 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:42.317526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8a9de6d6-1342-44a1-bb45-588768ab8252 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:42.321006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a9de6d6-1342-44a1-bb45-588768ab8252 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.321470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a9de6d6-1342-44a1-bb45-588768ab8252 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.322292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a9de6d6-1342-44a1-bb45-588768ab8252 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.322925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a9de6d6-1342-44a1-bb45-588768ab8252 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.372318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-10f9b4af-1372-4bb4-9716-82601e885c05 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:42.384315 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-10f9b4af-1372-4bb4-9716-82601e885c05 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.292981 Jan 22 21:09:42.385910 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1728/3309] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:42 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:42.394103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fc065e36-d796-46af-a0bd-11d9b81de8c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:42.395885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fc065e36-d796-46af-a0bd-11d9b81de8c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:42.413349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc065e36-d796-46af-a0bd-11d9b81de8c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.413349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc065e36-d796-46af-a0bd-11d9b81de8c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.413349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc065e36-d796-46af-a0bd-11d9b81de8c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.413800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc065e36-d796-46af-a0bd-11d9b81de8c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.478860 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fc065e36-d796-46af-a0bd-11d9b81de8c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.082164 Jan 22 21:09:42.479618 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1729/3310] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:42 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:42.490826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3e865226-4af0-4aab-aed6-9be56a70d47c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:42.491795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3e865226-4af0-4aab-aed6-9be56a70d47c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:42.500789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e865226-4af0-4aab-aed6-9be56a70d47c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.501726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e865226-4af0-4aab-aed6-9be56a70d47c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.502886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e865226-4af0-4aab-aed6-9be56a70d47c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.503523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e865226-4af0-4aab-aed6-9be56a70d47c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.575516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8a9de6d6-1342-44a1-bb45-588768ab8252 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:42.585238 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8a9de6d6-1342-44a1-bb45-588768ab8252 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 200 len: 1477 microversion: 2.1 time: 0.275103 Jan 22 21:09:42.586472 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1582/3311] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:42 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 1477 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:42.593763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ea16f865-62ec-418d-9593-4697ede43e6f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:42.596878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ea16f865-62ec-418d-9593-4697ede43e6f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:42.604913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea16f865-62ec-418d-9593-4697ede43e6f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.605778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea16f865-62ec-418d-9593-4697ede43e6f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.606849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea16f865-62ec-418d-9593-4697ede43e6f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.607377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea16f865-62ec-418d-9593-4697ede43e6f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.658184 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ea16f865-62ec-418d-9593-4697ede43e6f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.069648 Jan 22 21:09:42.662774 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1583/3312] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:42 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:42.668200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4924559c-43e0-42a1-90b7-45a9d5e55f39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:42.669151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4924559c-43e0-42a1-90b7-45a9d5e55f39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:42.677290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4924559c-43e0-42a1-90b7-45a9d5e55f39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.677801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4924559c-43e0-42a1-90b7-45a9d5e55f39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.679202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4924559c-43e0-42a1-90b7-45a9d5e55f39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.679895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4924559c-43e0-42a1-90b7-45a9d5e55f39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.821977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3e865226-4af0-4aab-aed6-9be56a70d47c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:42.835527 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3e865226-4af0-4aab-aed6-9be56a70d47c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.345232 Jan 22 21:09:42.841651 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1730/3313] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:42 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:42.852397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-879fd1cc-e85f-4d52-a5ee-9a5e57ee8ed2 req-006dfa24-dcae-42e0-8f3d-3400a440f1ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7699c318-de81-4990-8d4a-526d1c46b578", "name": "network-vif-deleted", "tag": "8e6c07ec-a3ec-44ca-92fa-3cf11dda20f2"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:42.863657 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:42.863657 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:09:42.871196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-879fd1cc-e85f-4d52-a5ee-9a5e57ee8ed2 req-006dfa24-dcae-42e0-8f3d-3400a440f1ae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.872038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-879fd1cc-e85f-4d52-a5ee-9a5e57ee8ed2 req-006dfa24-dcae-42e0-8f3d-3400a440f1ae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.898948 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-879fd1cc-e85f-4d52-a5ee-9a5e57ee8ed2 req-006dfa24-dcae-42e0-8f3d-3400a440f1ae service nova] Creating event network-vif-deleted:8e6c07ec-a3ec-44ca-92fa-3cf11dda20f2 for instance 7699c318-de81-4990-8d4a-526d1c46b578 on nch2-master-1 Jan 22 21:09:42.906035 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-879fd1cc-e85f-4d52-a5ee-9a5e57ee8ed2 req-006dfa24-dcae-42e0-8f3d-3400a440f1ae service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062728 Jan 22 21:09:42.907043 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1731/3314] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:42.914763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a19f2b59-f3b0-41e9-9773-0aa2158e2162 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:42.915584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a19f2b59-f3b0-41e9-9773-0aa2158e2162 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: bb28a1ab-fac5-4ad3-a71d-2a3dd6eadcd9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:42.922401 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-a19f2b59-f3b0-41e9-9773-0aa2158e2162 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance bb28a1ab-fac5-4ad3-a71d-2a3dd6eadcd9 could not be found. Jan 22 21:09:42.923244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a19f2b59-f3b0-41e9-9773-0aa2158e2162 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance bb28a1ab-fac5-4ad3-a71d-2a3dd6eadcd9 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:42.924154 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a19f2b59-f3b0-41e9-9773-0aa2158e2162 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/bb28a1ab-fac5-4ad3-a71d-2a3dd6eadcd9/action" status: 404 len: 111 microversion: 2.1 time: 0.015627 Jan 22 21:09:42.924965 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1732/3315] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:42 2022] POST /compute/v2.1/servers/bb28a1ab-fac5-4ad3-a71d-2a3dd6eadcd9/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:42.935906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0173d579-8c25-4b70-be5e-b91587e2bb1d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:42.937154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0173d579-8c25-4b70-be5e-b91587e2bb1d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:42.945709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0173d579-8c25-4b70-be5e-b91587e2bb1d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.949306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0173d579-8c25-4b70-be5e-b91587e2bb1d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.949306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0173d579-8c25-4b70-be5e-b91587e2bb1d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:42.949306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0173d579-8c25-4b70-be5e-b91587e2bb1d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:42.972176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4924559c-43e0-42a1-90b7-45a9d5e55f39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:42.983131 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4924559c-43e0-42a1-90b7-45a9d5e55f39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.318724 Jan 22 21:09:42.985774 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1584/3316] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:42 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:42.998233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e1d4d053-2054-45ec-8067-b52f4c0fb32a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:42.999603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e1d4d053-2054-45ec-8067-b52f4c0fb32a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:43.020500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1d4d053-2054-45ec-8067-b52f4c0fb32a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.021822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1d4d053-2054-45ec-8067-b52f4c0fb32a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.024203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1d4d053-2054-45ec-8067-b52f4c0fb32a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.024866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1d4d053-2054-45ec-8067-b52f4c0fb32a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.289115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0173d579-8c25-4b70-be5e-b91587e2bb1d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:43.297564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e1d4d053-2054-45ec-8067-b52f4c0fb32a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:43.300433 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0173d579-8c25-4b70-be5e-b91587e2bb1d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.369487 Jan 22 21:09:43.306243 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e1d4d053-2054-45ec-8067-b52f4c0fb32a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1331 microversion: 2.1 time: 0.317600 Jan 22 21:09:43.316670 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1585/3317] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:42 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1331 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:43.316876 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1733/3318] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:42 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:43.316997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c62e4586-ed82-4e43-bda5-842d69df3780 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:43.316997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c62e4586-ed82-4e43-bda5-842d69df3780 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:43.326603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-00796bf6-9ba7-4391-a92b-1b58bc936269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:43.327325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-00796bf6-9ba7-4391-a92b-1b58bc936269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:43.328148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c62e4586-ed82-4e43-bda5-842d69df3780 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.329324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c62e4586-ed82-4e43-bda5-842d69df3780 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.330723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c62e4586-ed82-4e43-bda5-842d69df3780 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.331443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c62e4586-ed82-4e43-bda5-842d69df3780 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.344291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00796bf6-9ba7-4391-a92b-1b58bc936269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.344779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00796bf6-9ba7-4391-a92b-1b58bc936269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.345586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00796bf6-9ba7-4391-a92b-1b58bc936269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.346052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00796bf6-9ba7-4391-a92b-1b58bc936269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.610910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-00796bf6-9ba7-4391-a92b-1b58bc936269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:43.617878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c62e4586-ed82-4e43-bda5-842d69df3780 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:43.619330 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-00796bf6-9ba7-4391-a92b-1b58bc936269 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.300259 Jan 22 21:09:43.626171 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1734/3319] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:43 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:43.630652 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c62e4586-ed82-4e43-bda5-842d69df3780 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1321 microversion: 2.1 time: 0.317990 Jan 22 21:09:43.631009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a9fec5b9-f3a7-44c3-ac65-2ed5de3f7069 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:43.631691 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1586/3320] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:43 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:43.631943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a9fec5b9-f3a7-44c3-ac65-2ed5de3f7069 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:43.636571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f8fffbff-4f92-4d93-85e1-5dfff95354e5 req-17c510e4-f404-4f75-a90e-ddd33c403ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea383184-f9d7-42bf-ae0b-91ef44de1864", "name": "network-vif-plugged", "status": "completed", "tag": "ab07f53f-fd0b-42cc-b6cb-02cd1e69e148"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:43.638284 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:43.638284 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:43.644918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9fec5b9-f3a7-44c3-ac65-2ed5de3f7069 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.644918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9fec5b9-f3a7-44c3-ac65-2ed5de3f7069 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.645223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9fec5b9-f3a7-44c3-ac65-2ed5de3f7069 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.645456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9fec5b9-f3a7-44c3-ac65-2ed5de3f7069 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.646478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f8fffbff-4f92-4d93-85e1-5dfff95354e5 req-17c510e4-f404-4f75-a90e-ddd33c403ec5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.647172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f8fffbff-4f92-4d93-85e1-5dfff95354e5 req-17c510e4-f404-4f75-a90e-ddd33c403ec5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.659787 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f8fffbff-4f92-4d93-85e1-5dfff95354e5 req-17c510e4-f404-4f75-a90e-ddd33c403ec5 service nova] Creating event network-vif-plugged:ab07f53f-fd0b-42cc-b6cb-02cd1e69e148 for instance ea383184-f9d7-42bf-ae0b-91ef44de1864 on nch1-master-1 Jan 22 21:09:43.666863 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f8fffbff-4f92-4d93-85e1-5dfff95354e5 req-17c510e4-f404-4f75-a90e-ddd33c403ec5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033803 Jan 22 21:09:43.667850 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1587/3321] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:43.674358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6d23ea9e-9559-4f2c-8e21-6fa7874c8486 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:43.675143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6d23ea9e-9559-4f2c-8e21-6fa7874c8486 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7699c318-de81-4990-8d4a-526d1c46b578] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:43.682353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d23ea9e-9559-4f2c-8e21-6fa7874c8486 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.684630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d23ea9e-9559-4f2c-8e21-6fa7874c8486 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.684630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d23ea9e-9559-4f2c-8e21-6fa7874c8486 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.684867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d23ea9e-9559-4f2c-8e21-6fa7874c8486 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.690595 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a9fec5b9-f3a7-44c3-ac65-2ed5de3f7069 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.068914 Jan 22 21:09:43.698635 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1735/3322] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:43 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:43.704530 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-6d23ea9e-9559-4f2c-8e21-6fa7874c8486 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] HTTP exception thrown: Instance 7699c318-de81-4990-8d4a-526d1c46b578 could not be found. Jan 22 21:09:43.705149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6d23ea9e-9559-4f2c-8e21-6fa7874c8486 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Returning 404 to user: Instance 7699c318-de81-4990-8d4a-526d1c46b578 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:43.705893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f2ecd659-7c59-4388-ab4f-7ba7b2626431 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:43.706071 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6d23ea9e-9559-4f2c-8e21-6fa7874c8486 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578" status: 404 len: 111 microversion: 2.1 time: 0.036972 Jan 22 21:09:43.706758 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1588/3323] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:43 2022] GET /compute/v2.1/servers/7699c318-de81-4990-8d4a-526d1c46b578 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:43.707689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f2ecd659-7c59-4388-ab4f-7ba7b2626431 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:43.713834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f2019f16-d5dd-49cb-b8a1-3604a8a33186 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:43.715001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f2019f16-d5dd-49cb-b8a1-3604a8a33186 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:43.724034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2ecd659-7c59-4388-ab4f-7ba7b2626431 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.724034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2ecd659-7c59-4388-ab4f-7ba7b2626431 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.724336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2019f16-d5dd-49cb-b8a1-3604a8a33186 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.724336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2019f16-d5dd-49cb-b8a1-3604a8a33186 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.724549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2ecd659-7c59-4388-ab4f-7ba7b2626431 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.724549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2ecd659-7c59-4388-ab4f-7ba7b2626431 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.724749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2019f16-d5dd-49cb-b8a1-3604a8a33186 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.726385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2019f16-d5dd-49cb-b8a1-3604a8a33186 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.773988 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f2019f16-d5dd-49cb-b8a1-3604a8a33186 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.064534 Jan 22 21:09:43.778276 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1589/3324] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:43 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:43.781209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d9c549df-393f-49d1-bee7-194ca9c874fd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:43.782045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d9c549df-393f-49d1-bee7-194ca9c874fd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 79886df2-2261-4152-ac59-f8406a583423] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:43.790209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9c549df-393f-49d1-bee7-194ca9c874fd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.790677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9c549df-393f-49d1-bee7-194ca9c874fd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.791778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9c549df-393f-49d1-bee7-194ca9c874fd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.791939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9c549df-393f-49d1-bee7-194ca9c874fd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.821851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d9c549df-393f-49d1-bee7-194ca9c874fd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 79886df2-2261-4152-ac59-f8406a583423] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:09:43.959339 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f2ecd659-7c59-4388-ab4f-7ba7b2626431 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action" status: 202 len: 0 microversion: 2.1 time: 0.258802 Jan 22 21:09:43.960014 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1736/3325] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:43 2022] POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:43.969090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-092efd3d-02b2-4e23-8a55-3216fec3969c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:43.970006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-092efd3d-02b2-4e23-8a55-3216fec3969c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:43.976173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-092efd3d-02b2-4e23-8a55-3216fec3969c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.976636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-092efd3d-02b2-4e23-8a55-3216fec3969c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:43.977472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-092efd3d-02b2-4e23-8a55-3216fec3969c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:43.977947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-092efd3d-02b2-4e23-8a55-3216fec3969c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:44.127700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-092efd3d-02b2-4e23-8a55-3216fec3969c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:44.135350 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-092efd3d-02b2-4e23-8a55-3216fec3969c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1514 microversion: 2.1 time: 0.170777 Jan 22 21:09:44.135813 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1737/3326] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:43 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:44.145844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8a410182-75d6-4bb4-8990-4094803e1c6d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:44.145844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8a410182-75d6-4bb4-8990-4094803e1c6d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:44.155941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a410182-75d6-4bb4-8990-4094803e1c6d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:44.155941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a410182-75d6-4bb4-8990-4094803e1c6d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:44.155941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a410182-75d6-4bb4-8990-4094803e1c6d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:44.155941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a410182-75d6-4bb4-8990-4094803e1c6d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:44.221417 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d9c549df-393f-49d1-bee7-194ca9c874fd tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "DELETE /compute/v2.1/servers/79886df2-2261-4152-ac59-f8406a583423" status: 204 len: 0 microversion: 2.1 time: 0.445026 Jan 22 21:09:44.222046 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1590/3327] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:43 2022] DELETE /compute/v2.1/servers/79886df2-2261-4152-ac59-f8406a583423 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:09:44.230303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-81be1f9b-78ed-4fe3-9602-c9c221f9dd58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:44.230888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-81be1f9b-78ed-4fe3-9602-c9c221f9dd58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:44.237924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81be1f9b-78ed-4fe3-9602-c9c221f9dd58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:44.238773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81be1f9b-78ed-4fe3-9602-c9c221f9dd58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:44.239584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81be1f9b-78ed-4fe3-9602-c9c221f9dd58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:44.240027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81be1f9b-78ed-4fe3-9602-c9c221f9dd58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:44.269408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-81be1f9b-78ed-4fe3-9602-c9c221f9dd58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:09:44.306579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8a410182-75d6-4bb4-8990-4094803e1c6d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:44.315325 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8a410182-75d6-4bb4-8990-4094803e1c6d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.178503 Jan 22 21:09:44.316299 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1738/3328] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:44 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:44.324443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad1105d6-8738-49fa-9563-43f8d600067d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:44.327381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad1105d6-8738-49fa-9563-43f8d600067d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:44.331878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad1105d6-8738-49fa-9563-43f8d600067d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:44.335648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad1105d6-8738-49fa-9563-43f8d600067d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:44.335648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad1105d6-8738-49fa-9563-43f8d600067d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:44.335648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad1105d6-8738-49fa-9563-43f8d600067d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:44.472024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ad1105d6-8738-49fa-9563-43f8d600067d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:44.479760 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad1105d6-8738-49fa-9563-43f8d600067d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1331 microversion: 2.1 time: 0.158784 Jan 22 21:09:44.480329 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1739/3329] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:44 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1331 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:44.595229 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-81be1f9b-78ed-4fe3-9602-c9c221f9dd58 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "DELETE /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 204 len: 0 microversion: 2.1 time: 0.368611 Jan 22 21:09:44.595811 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1591/3330] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:44 2022] DELETE /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:09:44.603707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1019549e-115e-4271-8fd8-f75b81a49c4a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:44.604477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1019549e-115e-4271-8fd8-f75b81a49c4a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 79886df2-2261-4152-ac59-f8406a583423] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:44.610640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1019549e-115e-4271-8fd8-f75b81a49c4a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:44.611105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1019549e-115e-4271-8fd8-f75b81a49c4a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:44.611907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1019549e-115e-4271-8fd8-f75b81a49c4a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:44.612363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1019549e-115e-4271-8fd8-f75b81a49c4a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:44.648092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b7080711-5524-46c5-801a-53105306593a tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:44.648871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b7080711-5524-46c5-801a-53105306593a tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:44.655924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7080711-5524-46c5-801a-53105306593a tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:44.656429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7080711-5524-46c5-801a-53105306593a tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:44.657183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7080711-5524-46c5-801a-53105306593a tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:44.657657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7080711-5524-46c5-801a-53105306593a tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:44.752405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1019549e-115e-4271-8fd8-f75b81a49c4a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:44.760435 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1019549e-115e-4271-8fd8-f75b81a49c4a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/79886df2-2261-4152-ac59-f8406a583423" status: 200 len: 1478 microversion: 2.1 time: 0.160411 Jan 22 21:09:44.761029 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1740/3331] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:44 2022] GET /compute/v2.1/servers/79886df2-2261-4152-ac59-f8406a583423 => generated 1478 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:44.765873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9126dc18-96d3-4f32-8995-f1659ddb9fa2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:44.767091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9126dc18-96d3-4f32-8995-f1659ddb9fa2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:44.773477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9126dc18-96d3-4f32-8995-f1659ddb9fa2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:44.773956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9126dc18-96d3-4f32-8995-f1659ddb9fa2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:44.774750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9126dc18-96d3-4f32-8995-f1659ddb9fa2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:44.775200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9126dc18-96d3-4f32-8995-f1659ddb9fa2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:44.817730 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9126dc18-96d3-4f32-8995-f1659ddb9fa2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.055411 Jan 22 21:09:44.819112 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1741/3332] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:44 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:44.824670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-34d7b810-00ac-496a-942a-ca37dbb2f327 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:44.825745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-34d7b810-00ac-496a-942a-ca37dbb2f327 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:44.833487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34d7b810-00ac-496a-942a-ca37dbb2f327 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:44.833986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34d7b810-00ac-496a-942a-ca37dbb2f327 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:44.835195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34d7b810-00ac-496a-942a-ca37dbb2f327 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:44.835654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34d7b810-00ac-496a-942a-ca37dbb2f327 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:44.840911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b7080711-5524-46c5-801a-53105306593a tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:44.849774 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b7080711-5524-46c5-801a-53105306593a tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1321 microversion: 2.1 time: 0.206002 Jan 22 21:09:44.850341 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1592/3333] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:44 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:44.878932 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-34d7b810-00ac-496a-942a-ca37dbb2f327 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.058424 Jan 22 21:09:44.882840 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1742/3334] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:44 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:45.153289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b7a60a94-4227-41aa-ac8a-9b301bd3021e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:45.153950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b7a60a94-4227-41aa-ac8a-9b301bd3021e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:45.160049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7a60a94-4227-41aa-ac8a-9b301bd3021e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:45.160512 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7a60a94-4227-41aa-ac8a-9b301bd3021e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:45.161336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7a60a94-4227-41aa-ac8a-9b301bd3021e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:45.161805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7a60a94-4227-41aa-ac8a-9b301bd3021e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:45.340593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1dd3e18d-5866-4622-977b-79369629a157 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:45.342502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1dd3e18d-5866-4622-977b-79369629a157 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:45.357668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1dd3e18d-5866-4622-977b-79369629a157 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:45.358182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1dd3e18d-5866-4622-977b-79369629a157 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:45.359519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1dd3e18d-5866-4622-977b-79369629a157 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:45.360702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1dd3e18d-5866-4622-977b-79369629a157 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:45.411241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b7a60a94-4227-41aa-ac8a-9b301bd3021e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:45.428720 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b7a60a94-4227-41aa-ac8a-9b301bd3021e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1494 microversion: 2.1 time: 0.278601 Jan 22 21:09:45.429815 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1593/3335] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:45 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1494 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:45.450975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ce5dffa9-c743-4741-abf6-7ac4d899b694 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:45.451781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ce5dffa9-c743-4741-abf6-7ac4d899b694 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:45.459614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce5dffa9-c743-4741-abf6-7ac4d899b694 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:45.460079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce5dffa9-c743-4741-abf6-7ac4d899b694 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:45.460879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce5dffa9-c743-4741-abf6-7ac4d899b694 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:45.461323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce5dffa9-c743-4741-abf6-7ac4d899b694 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:45.488455 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-ce5dffa9-c743-4741-abf6-7ac4d899b694 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Cannot 'pause' instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 while it is in vm_state paused Jan 22 21:09:45.489195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ce5dffa9-c743-4741-abf6-7ac4d899b694 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 409 to user: Cannot 'pause' instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 while it is in vm_state paused {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:45.490238 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ce5dffa9-c743-4741-abf6-7ac4d899b694 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action" status: 409 len: 143 microversion: 2.1 time: 0.043103 Jan 22 21:09:45.491007 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1594/3336] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:45 2022] POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action => generated 143 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 22 21:09:45.498081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bfb5df25-2e69-48d4-ad60-c16e84fee4a9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:45.498701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bfb5df25-2e69-48d4-ad60-c16e84fee4a9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:45.505248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfb5df25-2e69-48d4-ad60-c16e84fee4a9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:45.505982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfb5df25-2e69-48d4-ad60-c16e84fee4a9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:45.507067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfb5df25-2e69-48d4-ad60-c16e84fee4a9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:45.507632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfb5df25-2e69-48d4-ad60-c16e84fee4a9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:45.590912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1dd3e18d-5866-4622-977b-79369629a157 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:45.598782 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1dd3e18d-5866-4622-977b-79369629a157 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.266548 Jan 22 21:09:45.599368 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1743/3337] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:45 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:45.604297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f09a8fab-3d2f-4598-96b6-a33fa115aede tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:45.604843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f09a8fab-3d2f-4598-96b6-a33fa115aede tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:45.612140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f09a8fab-3d2f-4598-96b6-a33fa115aede tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:45.612866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f09a8fab-3d2f-4598-96b6-a33fa115aede tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:45.613411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f09a8fab-3d2f-4598-96b6-a33fa115aede tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:45.613913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f09a8fab-3d2f-4598-96b6-a33fa115aede tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:45.893789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bfb5df25-2e69-48d4-ad60-c16e84fee4a9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:45.901727 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bfb5df25-2e69-48d4-ad60-c16e84fee4a9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1510 microversion: 2.1 time: 0.407095 Jan 22 21:09:45.902297 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1595/3338] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:45 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1510 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:45.907605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-345d1aed-789e-48e8-a54d-535f8c5661f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:45.908494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-345d1aed-789e-48e8-a54d-535f8c5661f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 79886df2-2261-4152-ac59-f8406a583423] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:45.916963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-345d1aed-789e-48e8-a54d-535f8c5661f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:45.916963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-345d1aed-789e-48e8-a54d-535f8c5661f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:45.916963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-345d1aed-789e-48e8-a54d-535f8c5661f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:45.917266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-345d1aed-789e-48e8-a54d-535f8c5661f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:45.941515 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f09a8fab-3d2f-4598-96b6-a33fa115aede tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action" status: 202 len: 0 microversion: 2.1 time: 0.340566 Jan 22 21:09:45.942354 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1744/3339] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:45 2022] POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:45.950750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-62ff8118-ba66-4687-95e4-c1881acc39e6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:45.952351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-62ff8118-ba66-4687-95e4-c1881acc39e6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:45.960921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62ff8118-ba66-4687-95e4-c1881acc39e6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:45.961739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62ff8118-ba66-4687-95e4-c1881acc39e6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:45.962717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62ff8118-ba66-4687-95e4-c1881acc39e6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:45.963174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62ff8118-ba66-4687-95e4-c1881acc39e6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:46.013022 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-62ff8118-ba66-4687-95e4-c1881acc39e6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.069010 Jan 22 21:09:46.017605 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1745/3340] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:45 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:46.023861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5705a562-0d2f-45c8-8850-da9d9d254c40 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:46.025282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5705a562-0d2f-45c8-8850-da9d9d254c40 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:46.034110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5705a562-0d2f-45c8-8850-da9d9d254c40 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:46.034708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5705a562-0d2f-45c8-8850-da9d9d254c40 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:46.036933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5705a562-0d2f-45c8-8850-da9d9d254c40 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:46.036933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5705a562-0d2f-45c8-8850-da9d9d254c40 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:46.081220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-345d1aed-789e-48e8-a54d-535f8c5661f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:46.089683 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-345d1aed-789e-48e8-a54d-535f8c5661f7 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/79886df2-2261-4152-ac59-f8406a583423" status: 200 len: 1478 microversion: 2.1 time: 0.185704 Jan 22 21:09:46.090031 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1596/3341] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:45 2022] GET /compute/v2.1/servers/79886df2-2261-4152-ac59-f8406a583423 => generated 1478 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:46.104514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-052b62f7-de03-4997-9a0b-7eea7e208dec tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:46.107387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-052b62f7-de03-4997-9a0b-7eea7e208dec tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:46.113732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-052b62f7-de03-4997-9a0b-7eea7e208dec tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:46.114205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-052b62f7-de03-4997-9a0b-7eea7e208dec tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:46.115646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-052b62f7-de03-4997-9a0b-7eea7e208dec tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:46.115646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-052b62f7-de03-4997-9a0b-7eea7e208dec tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:46.161153 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-052b62f7-de03-4997-9a0b-7eea7e208dec tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.060846 Jan 22 21:09:46.162023 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1597/3342] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:46 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:46.167404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d894a746-69af-42d4-930d-f42a61973685 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:46.168212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d894a746-69af-42d4-930d-f42a61973685 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:46.175875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d894a746-69af-42d4-930d-f42a61973685 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:46.176338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d894a746-69af-42d4-930d-f42a61973685 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:46.177141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d894a746-69af-42d4-930d-f42a61973685 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:46.177616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d894a746-69af-42d4-930d-f42a61973685 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:46.323918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d894a746-69af-42d4-930d-f42a61973685 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:46.334759 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d894a746-69af-42d4-930d-f42a61973685 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1510 microversion: 2.1 time: 0.171232 Jan 22 21:09:46.335978 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1598/3343] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:46 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:46.341071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-176310ec-feb1-4c84-b804-709a12153e93 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:46.342095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-176310ec-feb1-4c84-b804-709a12153e93 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:46.351742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-176310ec-feb1-4c84-b804-709a12153e93 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:46.352193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-176310ec-feb1-4c84-b804-709a12153e93 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:46.353241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-176310ec-feb1-4c84-b804-709a12153e93 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:46.353723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-176310ec-feb1-4c84-b804-709a12153e93 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:46.358347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5705a562-0d2f-45c8-8850-da9d9d254c40 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:46.379925 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5705a562-0d2f-45c8-8850-da9d9d254c40 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1321 microversion: 2.1 time: 0.363954 Jan 22 21:09:46.392767 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1746/3344] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:46 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:46.401747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f0d24299-c719-4dee-95ee-0263ed3708c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:46.406969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f0d24299-c719-4dee-95ee-0263ed3708c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:46.419003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0d24299-c719-4dee-95ee-0263ed3708c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:46.422043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0d24299-c719-4dee-95ee-0263ed3708c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:46.424249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0d24299-c719-4dee-95ee-0263ed3708c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:46.425935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0d24299-c719-4dee-95ee-0263ed3708c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:46.482617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f0d24299-c719-4dee-95ee-0263ed3708c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:09:46.669789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-176310ec-feb1-4c84-b804-709a12153e93 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:46.681147 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-176310ec-feb1-4c84-b804-709a12153e93 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1501 microversion: 2.1 time: 0.341300 Jan 22 21:09:46.692474 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1599/3345] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:46 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1501 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:46.695101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8b38775a-34f3-49ca-ba46-bae459f46c12 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:46.701033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8b38775a-34f3-49ca-ba46-bae459f46c12 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:46.711182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b38775a-34f3-49ca-ba46-bae459f46c12 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:46.715332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b38775a-34f3-49ca-ba46-bae459f46c12 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:46.720009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b38775a-34f3-49ca-ba46-bae459f46c12 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:46.721817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b38775a-34f3-49ca-ba46-bae459f46c12 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:46.973207 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f0d24299-c719-4dee-95ee-0263ed3708c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 204 len: 0 microversion: 2.1 time: 0.578544 Jan 22 21:09:46.976966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8b38775a-34f3-49ca-ba46-bae459f46c12 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:46.979306 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1747/3346] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:46 2022] DELETE /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:09:46.987618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a032aea6-f041-4e7d-b9aa-90720cddc813 req-06c5ba7b-3815-4979-8196-329e60e9df08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79886df2-2261-4152-ac59-f8406a583423", "name": "network-vif-deleted", "tag": "3041c656-c48c-42e3-9761-4ac45e757781"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:46.991076 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:46.991076 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:09:46.994207 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8b38775a-34f3-49ca-ba46-bae459f46c12 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.310894 Jan 22 21:09:46.997648 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1600/3347] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:46 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:47.012184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a032aea6-f041-4e7d-b9aa-90720cddc813 req-06c5ba7b-3815-4979-8196-329e60e9df08 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:47.013668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a032aea6-f041-4e7d-b9aa-90720cddc813 req-06c5ba7b-3815-4979-8196-329e60e9df08 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:47.014352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b368c948-b15a-441f-b8b4-11375b7ca882 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:47.016557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b368c948-b15a-441f-b8b4-11375b7ca882 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:47.025396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b368c948-b15a-441f-b8b4-11375b7ca882 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:47.041347 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a032aea6-f041-4e7d-b9aa-90720cddc813 req-06c5ba7b-3815-4979-8196-329e60e9df08 service nova] Creating event network-vif-deleted:3041c656-c48c-42e3-9761-4ac45e757781 for instance 79886df2-2261-4152-ac59-f8406a583423 on nch1-master-1 Jan 22 21:09:47.042357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b368c948-b15a-441f-b8b4-11375b7ca882 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:47.043346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b368c948-b15a-441f-b8b4-11375b7ca882 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:47.047722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b368c948-b15a-441f-b8b4-11375b7ca882 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:47.053679 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a032aea6-f041-4e7d-b9aa-90720cddc813 req-06c5ba7b-3815-4979-8196-329e60e9df08 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071161 Jan 22 21:09:47.055528 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1748/3348] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:47.065540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3f2e97a3-ee46-4ca1-a095-3d703802352f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:47.067806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3f2e97a3-ee46-4ca1-a095-3d703802352f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:47.075585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f2e97a3-ee46-4ca1-a095-3d703802352f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:47.076411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f2e97a3-ee46-4ca1-a095-3d703802352f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:47.078147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f2e97a3-ee46-4ca1-a095-3d703802352f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:47.078837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f2e97a3-ee46-4ca1-a095-3d703802352f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:47.129419 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3f2e97a3-ee46-4ca1-a095-3d703802352f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.072087 Jan 22 21:09:47.134409 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1749/3349] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:47 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:47.146510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-201c2789-daf3-431e-9758-91d9b84dc63a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:47.147660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-201c2789-daf3-431e-9758-91d9b84dc63a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 79886df2-2261-4152-ac59-f8406a583423] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:47.156531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-201c2789-daf3-431e-9758-91d9b84dc63a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:47.158414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-201c2789-daf3-431e-9758-91d9b84dc63a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:47.159445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-201c2789-daf3-431e-9758-91d9b84dc63a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:47.159905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-201c2789-daf3-431e-9758-91d9b84dc63a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:47.410380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b368c948-b15a-441f-b8b4-11375b7ca882 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:47.423454 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b368c948-b15a-441f-b8b4-11375b7ca882 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1516 microversion: 2.1 time: 0.422219 Jan 22 21:09:47.425069 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1601/3350] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:46 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1516 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:47.430496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8a02932e-330a-4619-9145-f0c1aada963d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:47.433091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8a02932e-330a-4619-9145-f0c1aada963d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:47.440742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a02932e-330a-4619-9145-f0c1aada963d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:47.442740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a02932e-330a-4619-9145-f0c1aada963d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:47.446244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a02932e-330a-4619-9145-f0c1aada963d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:47.446244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a02932e-330a-4619-9145-f0c1aada963d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:47.493774 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8a02932e-330a-4619-9145-f0c1aada963d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.066730 Jan 22 21:09:47.494731 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1602/3351] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:47 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:47.502028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-d0f4a51d-4b57-4583-8a7d-1c8bbbe4dda4 req-6d930cf4-d4bf-4f92-9965-cf092e57815b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc292b6-fff2-4016-ae88-5af6f9e6d202", "name": "network-vif-deleted", "tag": "d47f6f59-aa85-46db-a173-064b56c1462a"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:47.504825 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:47.504825 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:47.514948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d0f4a51d-4b57-4583-8a7d-1c8bbbe4dda4 req-6d930cf4-d4bf-4f92-9965-cf092e57815b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:47.515854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d0f4a51d-4b57-4583-8a7d-1c8bbbe4dda4 req-6d930cf4-d4bf-4f92-9965-cf092e57815b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:47.539733 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-d0f4a51d-4b57-4583-8a7d-1c8bbbe4dda4 req-6d930cf4-d4bf-4f92-9965-cf092e57815b service nova] Creating event network-vif-deleted:d47f6f59-aa85-46db-a173-064b56c1462a for instance 3bc292b6-fff2-4016-ae88-5af6f9e6d202 on nch2-master-1 Jan 22 21:09:47.560324 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-d0f4a51d-4b57-4583-8a7d-1c8bbbe4dda4 req-6d930cf4-d4bf-4f92-9965-cf092e57815b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057634 Jan 22 21:09:47.566114 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1603/3352] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:47.568331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-203808d1-e024-4394-9140-81786c80d8ac tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:47.575640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-203808d1-e024-4394-9140-81786c80d8ac tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:47.587718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203808d1-e024-4394-9140-81786c80d8ac tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:47.588182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203808d1-e024-4394-9140-81786c80d8ac tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:47.589578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203808d1-e024-4394-9140-81786c80d8ac tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:47.590032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203808d1-e024-4394-9140-81786c80d8ac tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:47.658166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-201c2789-daf3-431e-9758-91d9b84dc63a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:47.663593 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-201c2789-daf3-431e-9758-91d9b84dc63a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/79886df2-2261-4152-ac59-f8406a583423" status: 200 len: 1308 microversion: 2.1 time: 0.531749 Jan 22 21:09:47.664179 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1750/3353] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:47 2022] GET /compute/v2.1/servers/79886df2-2261-4152-ac59-f8406a583423 => generated 1308 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:47.698836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5bda1069-490a-48f6-9075-318e348cf19c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:47.699844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5bda1069-490a-48f6-9075-318e348cf19c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:47.707941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bda1069-490a-48f6-9075-318e348cf19c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:47.708747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bda1069-490a-48f6-9075-318e348cf19c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:47.709847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bda1069-490a-48f6-9075-318e348cf19c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:47.710555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bda1069-490a-48f6-9075-318e348cf19c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:47.791823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-203808d1-e024-4394-9140-81786c80d8ac tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:47.805453 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-203808d1-e024-4394-9140-81786c80d8ac tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1321 microversion: 2.1 time: 0.240284 Jan 22 21:09:47.806833 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1604/3354] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:47 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:48.024277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fda1dca5-9043-4d35-9d7c-81c6e5787075 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:48.025977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fda1dca5-9043-4d35-9d7c-81c6e5787075 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:48.040099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fda1dca5-9043-4d35-9d7c-81c6e5787075 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.040099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fda1dca5-9043-4d35-9d7c-81c6e5787075 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.040099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fda1dca5-9043-4d35-9d7c-81c6e5787075 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.040099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fda1dca5-9043-4d35-9d7c-81c6e5787075 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.126663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5bda1069-490a-48f6-9075-318e348cf19c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:48.147758 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5bda1069-490a-48f6-9075-318e348cf19c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.452019 Jan 22 21:09:48.161138 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1751/3355] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:47 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:48.167744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e14693e4-750d-4ba5-950a-de3f9c7895f1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:48.169049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e14693e4-750d-4ba5-950a-de3f9c7895f1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:48.190138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e14693e4-750d-4ba5-950a-de3f9c7895f1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.191064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e14693e4-750d-4ba5-950a-de3f9c7895f1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.196208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e14693e4-750d-4ba5-950a-de3f9c7895f1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.199652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e14693e4-750d-4ba5-950a-de3f9c7895f1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.223385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fda1dca5-9043-4d35-9d7c-81c6e5787075 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:48.236764 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fda1dca5-9043-4d35-9d7c-81c6e5787075 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.222230 Jan 22 21:09:48.239309 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1605/3356] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:48 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:48.253059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f3f8e740-5511-4ef4-ada8-00e05b4ac67a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:48.254497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f3f8e740-5511-4ef4-ada8-00e05b4ac67a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:48.264471 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e14693e4-750d-4ba5-950a-de3f9c7895f1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.101535 Jan 22 21:09:48.266097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3f8e740-5511-4ef4-ada8-00e05b4ac67a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.266097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3f8e740-5511-4ef4-ada8-00e05b4ac67a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.266558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3f8e740-5511-4ef4-ada8-00e05b4ac67a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.267089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3f8e740-5511-4ef4-ada8-00e05b4ac67a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.268668 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1752/3357] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:48 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:48.442378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f22cd98a-d2e4-4cf0-ab10-ea756c9758f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:48.443341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f22cd98a-d2e4-4cf0-ab10-ea756c9758f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:48.461749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f22cd98a-d2e4-4cf0-ab10-ea756c9758f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.464278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f22cd98a-d2e4-4cf0-ab10-ea756c9758f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.464894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f22cd98a-d2e4-4cf0-ab10-ea756c9758f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.466525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f22cd98a-d2e4-4cf0-ab10-ea756c9758f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.529473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f3f8e740-5511-4ef4-ada8-00e05b4ac67a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:48.555673 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f3f8e740-5511-4ef4-ada8-00e05b4ac67a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.300618 Jan 22 21:09:48.555673 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1606/3358] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:48 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:48.599082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d2cbbca3-615b-4ea4-8869-29ceea4fe215 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:48.603427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d2cbbca3-615b-4ea4-8869-29ceea4fe215 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:48.614300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2cbbca3-615b-4ea4-8869-29ceea4fe215 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.615056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2cbbca3-615b-4ea4-8869-29ceea4fe215 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.616042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2cbbca3-615b-4ea4-8869-29ceea4fe215 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.621627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2cbbca3-615b-4ea4-8869-29ceea4fe215 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.677751 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d2cbbca3-615b-4ea4-8869-29ceea4fe215 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.127798 Jan 22 21:09:48.677751 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1607/3359] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:48 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:48.679912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fdde833f-ce8d-45cf-9987-e46c885e6f9d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:48.680965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fdde833f-ce8d-45cf-9987-e46c885e6f9d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:48.692164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fdde833f-ce8d-45cf-9987-e46c885e6f9d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.692625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fdde833f-ce8d-45cf-9987-e46c885e6f9d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.693618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fdde833f-ce8d-45cf-9987-e46c885e6f9d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.694068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fdde833f-ce8d-45cf-9987-e46c885e6f9d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.716931 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-fdde833f-ce8d-45cf-9987-e46c885e6f9d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance afd13882-2a28-4355-a3d1-606aa99e9971 could not be found. Jan 22 21:09:48.719118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fdde833f-ce8d-45cf-9987-e46c885e6f9d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance afd13882-2a28-4355-a3d1-606aa99e9971 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:48.720587 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fdde833f-ce8d-45cf-9987-e46c885e6f9d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971/action" status: 404 len: 111 microversion: 2.1 time: 0.045335 Jan 22 21:09:48.723596 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1608/3360] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:48 2022] POST /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:48.729427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b5dae7e3-851e-4d96-afa9-ccebebb78d79 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:48.730323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b5dae7e3-851e-4d96-afa9-ccebebb78d79 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 79886df2-2261-4152-ac59-f8406a583423] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:48.737485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5dae7e3-851e-4d96-afa9-ccebebb78d79 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.738003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5dae7e3-851e-4d96-afa9-ccebebb78d79 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.738852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5dae7e3-851e-4d96-afa9-ccebebb78d79 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.739279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5dae7e3-851e-4d96-afa9-ccebebb78d79 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.757185 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-b5dae7e3-851e-4d96-afa9-ccebebb78d79 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] HTTP exception thrown: Instance 79886df2-2261-4152-ac59-f8406a583423 could not be found. Jan 22 21:09:48.757892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b5dae7e3-851e-4d96-afa9-ccebebb78d79 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Returning 404 to user: Instance 79886df2-2261-4152-ac59-f8406a583423 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:48.759146 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b5dae7e3-851e-4d96-afa9-ccebebb78d79 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/79886df2-2261-4152-ac59-f8406a583423" status: 404 len: 111 microversion: 2.1 time: 0.033799 Jan 22 21:09:48.762397 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1609/3361] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:48 2022] GET /compute/v2.1/servers/79886df2-2261-4152-ac59-f8406a583423 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:48.766565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-970ce95e-94a9-483f-8b0a-de50c2623339 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:48.767170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-970ce95e-94a9-483f-8b0a-de50c2623339 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:48.774162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-970ce95e-94a9-483f-8b0a-de50c2623339 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.774630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-970ce95e-94a9-483f-8b0a-de50c2623339 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.775447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-970ce95e-94a9-483f-8b0a-de50c2623339 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.775894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-970ce95e-94a9-483f-8b0a-de50c2623339 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.823518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f22cd98a-d2e4-4cf0-ab10-ea756c9758f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:48.835836 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f22cd98a-d2e4-4cf0-ab10-ea756c9758f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1516 microversion: 2.1 time: 0.398386 Jan 22 21:09:48.836726 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1753/3362] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:48 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1516 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:48.841559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-78d2c099-41bf-431a-8724-16dc4993b931 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:48.842548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-78d2c099-41bf-431a-8724-16dc4993b931 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 3bc292b6-fff2-4016-ae88-5af6f9e6d202] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:48.849269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78d2c099-41bf-431a-8724-16dc4993b931 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.850231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78d2c099-41bf-431a-8724-16dc4993b931 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.851047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78d2c099-41bf-431a-8724-16dc4993b931 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.851488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78d2c099-41bf-431a-8724-16dc4993b931 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.867966 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-78d2c099-41bf-431a-8724-16dc4993b931 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] HTTP exception thrown: Instance 3bc292b6-fff2-4016-ae88-5af6f9e6d202 could not be found. Jan 22 21:09:48.868636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-78d2c099-41bf-431a-8724-16dc4993b931 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Returning 404 to user: Instance 3bc292b6-fff2-4016-ae88-5af6f9e6d202 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:48.869743 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-78d2c099-41bf-431a-8724-16dc4993b931 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202" status: 404 len: 111 microversion: 2.1 time: 0.031657 Jan 22 21:09:48.880378 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1754/3363] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:48 2022] GET /compute/v2.1/servers/3bc292b6-fff2-4016-ae88-5af6f9e6d202 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:48.888465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ddc77d10-bb66-4512-8696-4311fb4442e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:48.889093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ddc77d10-bb66-4512-8696-4311fb4442e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:48.906789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddc77d10-bb66-4512-8696-4311fb4442e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.907480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddc77d10-bb66-4512-8696-4311fb4442e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.908811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddc77d10-bb66-4512-8696-4311fb4442e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:48.909417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddc77d10-bb66-4512-8696-4311fb4442e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:48.935324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-970ce95e-94a9-483f-8b0a-de50c2623339 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:48.944829 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-970ce95e-94a9-483f-8b0a-de50c2623339 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.183202 Jan 22 21:09:48.945484 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1610/3364] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:48 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:48.969052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3618675b-812b-4df1-bda0-62a935846458 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:49.098545 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3618675b-812b-4df1-bda0-62a935846458 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "DELETE /compute/v2.1/os-server-groups/2b9bc7c4-2464-4ade-9a4b-ea55c009c46d" status: 204 len: 0 microversion: 2.1 time: 0.141287 Jan 22 21:09:49.099447 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1611/3365] 10.222.0.100 () {58 vars in 1270 bytes} [Sat Jan 22 21:09:48 2022] DELETE /compute/v2.1/os-server-groups/2b9bc7c4-2464-4ade-9a4b-ea55c009c46d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:09:49.104671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d2ac7792-de9b-48e5-b4d2-a49932cadfaa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:49.111410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d2ac7792-de9b-48e5-b4d2-a49932cadfaa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:49.129817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2ac7792-de9b-48e5-b4d2-a49932cadfaa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:49.130310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2ac7792-de9b-48e5-b4d2-a49932cadfaa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:49.131112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2ac7792-de9b-48e5-b4d2-a49932cadfaa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:49.131560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2ac7792-de9b-48e5-b4d2-a49932cadfaa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:49.362203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ddc77d10-bb66-4512-8696-4311fb4442e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:49.388850 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ddc77d10-bb66-4512-8696-4311fb4442e8 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1321 microversion: 2.1 time: 0.505509 Jan 22 21:09:49.399090 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1755/3366] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:48 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1321 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:49.407385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1c84a937-ea58-4337-8f67-8250ae11b630 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:49.408048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1c84a937-ea58-4337-8f67-8250ae11b630 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 89e0044a-73e1-4d70-b612-3798d98ecc1f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:49.422033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c84a937-ea58-4337-8f67-8250ae11b630 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:49.422033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c84a937-ea58-4337-8f67-8250ae11b630 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:49.422033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c84a937-ea58-4337-8f67-8250ae11b630 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:49.422033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c84a937-ea58-4337-8f67-8250ae11b630 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:49.453172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1c84a937-ea58-4337-8f67-8250ae11b630 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 89e0044a-73e1-4d70-b612-3798d98ecc1f] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:09:49.458381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d2ac7792-de9b-48e5-b4d2-a49932cadfaa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:49.467205 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d2ac7792-de9b-48e5-b4d2-a49932cadfaa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.366293 Jan 22 21:09:49.471083 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1612/3367] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:49 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:49.475981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b30fcf44-9878-46e6-93f9-1f5b4f8e75c1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:49.476600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b30fcf44-9878-46e6-93f9-1f5b4f8e75c1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:49.484951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b30fcf44-9878-46e6-93f9-1f5b4f8e75c1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:49.486042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b30fcf44-9878-46e6-93f9-1f5b4f8e75c1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:49.487066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b30fcf44-9878-46e6-93f9-1f5b4f8e75c1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:49.487699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b30fcf44-9878-46e6-93f9-1f5b4f8e75c1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:49.845220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b30fcf44-9878-46e6-93f9-1f5b4f8e75c1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:49.888377 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1c84a937-ea58-4337-8f67-8250ae11b630 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "DELETE /compute/v2.1/servers/89e0044a-73e1-4d70-b612-3798d98ecc1f" status: 204 len: 0 microversion: 2.1 time: 0.495150 Jan 22 21:09:49.889654 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1756/3368] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:49 2022] DELETE /compute/v2.1/servers/89e0044a-73e1-4d70-b612-3798d98ecc1f => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:09:49.901772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6e72331c-e832-48b7-961a-256ac71cb78f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:49.908477 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b30fcf44-9878-46e6-93f9-1f5b4f8e75c1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.435709 Jan 22 21:09:49.910100 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1613/3369] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:49 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:49.921839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-61ef4d12-3fa7-41c4-bf29-fd79591b3121 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:49.921839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-61ef4d12-3fa7-41c4-bf29-fd79591b3121 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: a69434e2-47a1-4a5c-a22c-b5fa627962b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:49.923356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6e72331c-e832-48b7-961a-256ac71cb78f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:49.927061 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-61ef4d12-3fa7-41c4-bf29-fd79591b3121 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance a69434e2-47a1-4a5c-a22c-b5fa627962b7 could not be found. Jan 22 21:09:49.928149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-61ef4d12-3fa7-41c4-bf29-fd79591b3121 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance a69434e2-47a1-4a5c-a22c-b5fa627962b7 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:49.929182 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-61ef4d12-3fa7-41c4-bf29-fd79591b3121 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/a69434e2-47a1-4a5c-a22c-b5fa627962b7/action" status: 404 len: 111 microversion: 2.1 time: 0.015326 Jan 22 21:09:49.930331 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1614/3370] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:49 2022] POST /compute/v2.1/servers/a69434e2-47a1-4a5c-a22c-b5fa627962b7/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:49.941493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4a843b01-36a0-47c9-94f6-5b0a95b1a6c8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:49.941493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4a843b01-36a0-47c9-94f6-5b0a95b1a6c8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:49.947659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e72331c-e832-48b7-961a-256ac71cb78f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:49.949481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e72331c-e832-48b7-961a-256ac71cb78f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:49.950116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a843b01-36a0-47c9-94f6-5b0a95b1a6c8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:49.950769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a843b01-36a0-47c9-94f6-5b0a95b1a6c8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:49.951493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e72331c-e832-48b7-961a-256ac71cb78f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:49.951951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a843b01-36a0-47c9-94f6-5b0a95b1a6c8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:49.952137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e72331c-e832-48b7-961a-256ac71cb78f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:49.953288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a843b01-36a0-47c9-94f6-5b0a95b1a6c8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:50.035884 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6e72331c-e832-48b7-961a-256ac71cb78f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.139060 Jan 22 21:09:50.038319 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1757/3371] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:49 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:50.048151 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4a843b01-36a0-47c9-94f6-5b0a95b1a6c8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.115973 Jan 22 21:09:50.052640 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1615/3372] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:49 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:50.060928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-20c113dd-d423-4187-89d7-99d603a9899a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:50.063614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-20c113dd-d423-4187-89d7-99d603a9899a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:50.063790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-67b624a3-9c5c-44f9-93ec-0d5a8f186900 req-77b9516b-5f38-4072-a8e4-406dc7d53c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea383184-f9d7-42bf-ae0b-91ef44de1864", "name": "network-vif-deleted", "tag": "ab07f53f-fd0b-42cc-b6cb-02cd1e69e148"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:50.065244 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:50.065244 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:09:50.082916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20c113dd-d423-4187-89d7-99d603a9899a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:50.082916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20c113dd-d423-4187-89d7-99d603a9899a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:50.082916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20c113dd-d423-4187-89d7-99d603a9899a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:50.082916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20c113dd-d423-4187-89d7-99d603a9899a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:50.090857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-67b624a3-9c5c-44f9-93ec-0d5a8f186900 req-77b9516b-5f38-4072-a8e4-406dc7d53c31 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:50.091527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-67b624a3-9c5c-44f9-93ec-0d5a8f186900 req-77b9516b-5f38-4072-a8e4-406dc7d53c31 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:50.116783 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-67b624a3-9c5c-44f9-93ec-0d5a8f186900 req-77b9516b-5f38-4072-a8e4-406dc7d53c31 service nova] Creating event network-vif-deleted:ab07f53f-fd0b-42cc-b6cb-02cd1e69e148 for instance ea383184-f9d7-42bf-ae0b-91ef44de1864 on nch1-master-1 Jan 22 21:09:50.130835 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-67b624a3-9c5c-44f9-93ec-0d5a8f186900 req-77b9516b-5f38-4072-a8e4-406dc7d53c31 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072113 Jan 22 21:09:50.132013 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1758/3373] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:50.143750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3d7d6486-b414-4a91-88cf-3ca5d5956982 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:50.144649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3d7d6486-b414-4a91-88cf-3ca5d5956982 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:50.157114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d7d6486-b414-4a91-88cf-3ca5d5956982 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:50.169362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d7d6486-b414-4a91-88cf-3ca5d5956982 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:50.169362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d7d6486-b414-4a91-88cf-3ca5d5956982 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:50.169362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d7d6486-b414-4a91-88cf-3ca5d5956982 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:50.219794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-20c113dd-d423-4187-89d7-99d603a9899a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:50.237695 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-20c113dd-d423-4187-89d7-99d603a9899a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1316 microversion: 2.1 time: 0.182022 Jan 22 21:09:50.240232 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1616/3374] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:50 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:50.245836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3d7d6486-b414-4a91-88cf-3ca5d5956982 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:09:50.248310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-beff15bc-d15d-4e87-a88a-2e68fb966f19 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:50.253169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-beff15bc-d15d-4e87-a88a-2e68fb966f19 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:50.268690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-beff15bc-d15d-4e87-a88a-2e68fb966f19 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:50.269268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-beff15bc-d15d-4e87-a88a-2e68fb966f19 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:50.270198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-beff15bc-d15d-4e87-a88a-2e68fb966f19 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:50.273918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-beff15bc-d15d-4e87-a88a-2e68fb966f19 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:50.602925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-beff15bc-d15d-4e87-a88a-2e68fb966f19 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:50.615412 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3d7d6486-b414-4a91-88cf-3ca5d5956982 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "DELETE /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 204 len: 0 microversion: 2.1 time: 0.481788 Jan 22 21:09:50.616106 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1759/3375] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:50 2022] DELETE /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:09:50.618998 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-beff15bc-d15d-4e87-a88a-2e68fb966f19 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.377291 Jan 22 21:09:50.623389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a91b6ede-59d2-4db3-9ae1-be8d72d937e2 req-e084a7b3-c169-40cb-bb29-b4818927dfd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c84a8ac-7a1b-4081-bc57-ab560dc077f1", "name": "network-vif-plugged", "status": "completed", "tag": "b58670f9-67aa-4e2a-9a1f-06471ae23041"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:50.625069 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:50.625069 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:09:50.630290 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1617/3376] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:50 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:50.639202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e6a9794d-0d40-4a6d-81f4-8544a0da4011 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:50.640692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e6a9794d-0d40-4a6d-81f4-8544a0da4011 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:50.659073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a91b6ede-59d2-4db3-9ae1-be8d72d937e2 req-e084a7b3-c169-40cb-bb29-b4818927dfd6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:50.669044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a91b6ede-59d2-4db3-9ae1-be8d72d937e2 req-e084a7b3-c169-40cb-bb29-b4818927dfd6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:50.670347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6a9794d-0d40-4a6d-81f4-8544a0da4011 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:50.670347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6a9794d-0d40-4a6d-81f4-8544a0da4011 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:50.670347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6a9794d-0d40-4a6d-81f4-8544a0da4011 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:50.673437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6a9794d-0d40-4a6d-81f4-8544a0da4011 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:50.686700 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a91b6ede-59d2-4db3-9ae1-be8d72d937e2 req-e084a7b3-c169-40cb-bb29-b4818927dfd6 service nova] Creating event network-vif-plugged:b58670f9-67aa-4e2a-9a1f-06471ae23041 for instance 5c84a8ac-7a1b-4081-bc57-ab560dc077f1 on nch1-master-1 Jan 22 21:09:50.692841 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a91b6ede-59d2-4db3-9ae1-be8d72d937e2 req-e084a7b3-c169-40cb-bb29-b4818927dfd6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075303 Jan 22 21:09:50.693986 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1760/3377] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:50.700586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b66eadd4-00d7-4941-8992-1f8bdd7dc07d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:50.701621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b66eadd4-00d7-4941-8992-1f8bdd7dc07d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 89e0044a-73e1-4d70-b612-3798d98ecc1f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:50.709658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b66eadd4-00d7-4941-8992-1f8bdd7dc07d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:50.710247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b66eadd4-00d7-4941-8992-1f8bdd7dc07d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:50.711176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b66eadd4-00d7-4941-8992-1f8bdd7dc07d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:50.711776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b66eadd4-00d7-4941-8992-1f8bdd7dc07d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:50.989259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b66eadd4-00d7-4941-8992-1f8bdd7dc07d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:51.007442 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b66eadd4-00d7-4941-8992-1f8bdd7dc07d tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/89e0044a-73e1-4d70-b612-3798d98ecc1f" status: 200 len: 1478 microversion: 2.1 time: 0.312170 Jan 22 21:09:51.008055 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1761/3378] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:50 2022] GET /compute/v2.1/servers/89e0044a-73e1-4d70-b612-3798d98ecc1f => generated 1478 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:51.026020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f9834859-34d3-49ac-973a-aa6cbc86b713 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:51.026640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f9834859-34d3-49ac-973a-aa6cbc86b713 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:51.035048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9834859-34d3-49ac-973a-aa6cbc86b713 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.035731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9834859-34d3-49ac-973a-aa6cbc86b713 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.037598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9834859-34d3-49ac-973a-aa6cbc86b713 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.038272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9834859-34d3-49ac-973a-aa6cbc86b713 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.138438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e6a9794d-0d40-4a6d-81f4-8544a0da4011 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:51.146963 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e6a9794d-0d40-4a6d-81f4-8544a0da4011 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1321 microversion: 2.1 time: 0.514992 Jan 22 21:09:51.147805 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1618/3379] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:50 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1321 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:51.163245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-afc554af-5b8c-4b7c-bc43-ac50315cf9ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:51.164051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-afc554af-5b8c-4b7c-bc43-ac50315cf9ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:51.171436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afc554af-5b8c-4b7c-bc43-ac50315cf9ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.171900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afc554af-5b8c-4b7c-bc43-ac50315cf9ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.172707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afc554af-5b8c-4b7c-bc43-ac50315cf9ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.173168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afc554af-5b8c-4b7c-bc43-ac50315cf9ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.234312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f9834859-34d3-49ac-973a-aa6cbc86b713 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:51.244994 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f9834859-34d3-49ac-973a-aa6cbc86b713 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.223310 Jan 22 21:09:51.245782 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1762/3380] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:51 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:51.263183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-afa21b65-aac5-4ab1-8cd5-85c25e60d3e0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:51.264464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-afa21b65-aac5-4ab1-8cd5-85c25e60d3e0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:51.272533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afa21b65-aac5-4ab1-8cd5-85c25e60d3e0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.272958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afa21b65-aac5-4ab1-8cd5-85c25e60d3e0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.277200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afa21b65-aac5-4ab1-8cd5-85c25e60d3e0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.277692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afa21b65-aac5-4ab1-8cd5-85c25e60d3e0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.325016 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-afa21b65-aac5-4ab1-8cd5-85c25e60d3e0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.065244 Jan 22 21:09:51.326531 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1763/3381] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:51 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:51.340471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b14ee4d4-4625-4865-a769-da4a20297ed7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:51.341922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b14ee4d4-4625-4865-a769-da4a20297ed7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:51.352506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b14ee4d4-4625-4865-a769-da4a20297ed7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.357527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b14ee4d4-4625-4865-a769-da4a20297ed7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.357527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b14ee4d4-4625-4865-a769-da4a20297ed7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.357527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b14ee4d4-4625-4865-a769-da4a20297ed7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.402213 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b14ee4d4-4625-4865-a769-da4a20297ed7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.074958 Jan 22 21:09:51.402891 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1764/3382] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:51 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:51.407846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a4a40bfd-678d-4656-b33d-b30ae683c8d6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:51.408553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a4a40bfd-678d-4656-b33d-b30ae683c8d6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:51.415810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4a40bfd-678d-4656-b33d-b30ae683c8d6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.416276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4a40bfd-678d-4656-b33d-b30ae683c8d6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.417096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4a40bfd-678d-4656-b33d-b30ae683c8d6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.417571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4a40bfd-678d-4656-b33d-b30ae683c8d6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.454275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4a40bfd-678d-4656-b33d-b30ae683c8d6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.454744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4a40bfd-678d-4656-b33d-b30ae683c8d6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.455225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-a4a40bfd-678d-4656-b33d-b30ae683c8d6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lazy-loading 'fault' on Instance uuid ea383184-f9d7-42bf-ae0b-91ef44de1864 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:09:51.502705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a4a40bfd-678d-4656-b33d-b30ae683c8d6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:51.511684 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a4a40bfd-678d-4656-b33d-b30ae683c8d6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 200 len: 1321 microversion: 2.1 time: 0.107616 Jan 22 21:09:51.512351 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1765/3383] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:51 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 1321 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:51.518233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-25f3229e-44f7-4142-8ada-63c416a3d180 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:51.520373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-25f3229e-44f7-4142-8ada-63c416a3d180 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:51.527747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25f3229e-44f7-4142-8ada-63c416a3d180 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.528309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25f3229e-44f7-4142-8ada-63c416a3d180 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.529139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25f3229e-44f7-4142-8ada-63c416a3d180 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.529845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25f3229e-44f7-4142-8ada-63c416a3d180 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.532776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-afc554af-5b8c-4b7c-bc43-ac50315cf9ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:51.540926 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-afc554af-5b8c-4b7c-bc43-ac50315cf9ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.382763 Jan 22 21:09:51.545316 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-25f3229e-44f7-4142-8ada-63c416a3d180 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance afd13882-2a28-4355-a3d1-606aa99e9971 could not be found. Jan 22 21:09:51.546639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-25f3229e-44f7-4142-8ada-63c416a3d180 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance afd13882-2a28-4355-a3d1-606aa99e9971 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:51.548099 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-25f3229e-44f7-4142-8ada-63c416a3d180 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971/action" status: 404 len: 111 microversion: 2.1 time: 0.034558 Jan 22 21:09:51.548848 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1766/3384] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:51 2022] POST /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:51.554870 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1619/3385] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:51 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:51.558373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e0679f4e-dc37-41e8-84ce-daaaafe75df8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:51.559002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e0679f4e-dc37-41e8-84ce-daaaafe75df8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:51.565340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0679f4e-dc37-41e8-84ce-daaaafe75df8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.565848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0679f4e-dc37-41e8-84ce-daaaafe75df8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.566648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0679f4e-dc37-41e8-84ce-daaaafe75df8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.567097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0679f4e-dc37-41e8-84ce-daaaafe75df8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.714327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e0679f4e-dc37-41e8-84ce-daaaafe75df8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:51.723452 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e0679f4e-dc37-41e8-84ce-daaaafe75df8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.169830 Jan 22 21:09:51.724303 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1767/3386] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:51 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:51.740718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-282872fa-5775-4247-8f27-2fbceec85ce9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:51.741373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-282872fa-5775-4247-8f27-2fbceec85ce9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:51.748751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-282872fa-5775-4247-8f27-2fbceec85ce9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.750405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-282872fa-5775-4247-8f27-2fbceec85ce9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:51.751365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-282872fa-5775-4247-8f27-2fbceec85ce9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:51.751814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-282872fa-5775-4247-8f27-2fbceec85ce9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:52.025451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f0e852d4-1d3d-4c09-8131-1c178d375dfa tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:52.026101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f0e852d4-1d3d-4c09-8131-1c178d375dfa tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 89e0044a-73e1-4d70-b612-3798d98ecc1f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:52.034677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0e852d4-1d3d-4c09-8131-1c178d375dfa tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:52.035141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0e852d4-1d3d-4c09-8131-1c178d375dfa tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:52.036222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0e852d4-1d3d-4c09-8131-1c178d375dfa tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:52.036861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0e852d4-1d3d-4c09-8131-1c178d375dfa tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:52.212371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f0e852d4-1d3d-4c09-8131-1c178d375dfa tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:52.223229 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f0e852d4-1d3d-4c09-8131-1c178d375dfa tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/89e0044a-73e1-4d70-b612-3798d98ecc1f" status: 200 len: 1478 microversion: 2.1 time: 0.201557 Jan 22 21:09:52.234976 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1768/3387] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:52 2022] GET /compute/v2.1/servers/89e0044a-73e1-4d70-b612-3798d98ecc1f => generated 1478 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:52.242000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f41a3d43-2a06-4a6f-b58b-b605eaf9291d tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:52.242834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f41a3d43-2a06-4a6f-b58b-b605eaf9291d tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:52.248967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f41a3d43-2a06-4a6f-b58b-b605eaf9291d tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:52.250562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f41a3d43-2a06-4a6f-b58b-b605eaf9291d tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:52.251059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f41a3d43-2a06-4a6f-b58b-b605eaf9291d tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:52.251581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f41a3d43-2a06-4a6f-b58b-b605eaf9291d tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:52.286299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-282872fa-5775-4247-8f27-2fbceec85ce9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:52.288630 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-282872fa-5775-4247-8f27-2fbceec85ce9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.551768 Jan 22 21:09:52.289921 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1620/3388] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:51 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:52.311311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff1f18cf-40db-49f8-85b1-404866697c60 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:52.314137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ff1f18cf-40db-49f8-85b1-404866697c60 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 09d21a89-62ea-4545-bbf7-9e375cb5fd6b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:52.325533 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-ff1f18cf-40db-49f8-85b1-404866697c60 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance 09d21a89-62ea-4545-bbf7-9e375cb5fd6b could not be found. Jan 22 21:09:52.326821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff1f18cf-40db-49f8-85b1-404866697c60 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance 09d21a89-62ea-4545-bbf7-9e375cb5fd6b could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:52.328825 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff1f18cf-40db-49f8-85b1-404866697c60 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/09d21a89-62ea-4545-bbf7-9e375cb5fd6b/action" status: 404 len: 111 microversion: 2.1 time: 0.025241 Jan 22 21:09:52.332274 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1621/3389] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:52 2022] POST /compute/v2.1/servers/09d21a89-62ea-4545-bbf7-9e375cb5fd6b/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:52.340146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-18da419c-cb6a-4c5d-b058-a635d0541db2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:52.342587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-18da419c-cb6a-4c5d-b058-a635d0541db2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:52.352118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18da419c-cb6a-4c5d-b058-a635d0541db2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:52.352791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18da419c-cb6a-4c5d-b058-a635d0541db2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:52.354074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18da419c-cb6a-4c5d-b058-a635d0541db2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:52.355335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18da419c-cb6a-4c5d-b058-a635d0541db2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:52.427683 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-18da419c-cb6a-4c5d-b058-a635d0541db2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.093650 Jan 22 21:09:52.428928 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1622/3390] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:52 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:52.436438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f2715d1-a930-4436-9515-d4fb8cb9d1fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:52.438210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9f2715d1-a930-4436-9515-d4fb8cb9d1fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:52.466262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f2715d1-a930-4436-9515-d4fb8cb9d1fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:52.467280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f2715d1-a930-4436-9515-d4fb8cb9d1fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:52.469031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f2715d1-a930-4436-9515-d4fb8cb9d1fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:52.474492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f2715d1-a930-4436-9515-d4fb8cb9d1fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:52.642810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f41a3d43-2a06-4a6f-b58b-b605eaf9291d tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:52.652689 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f41a3d43-2a06-4a6f-b58b-b605eaf9291d tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1321 microversion: 2.1 time: 0.415964 Jan 22 21:09:52.656830 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1769/3391] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:52 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:52.664316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-f08c8c49-aa2e-4a65-b979-314755b7c48e req-d7b693dc-fafe-4018-940e-fc0eae07f5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e0044a-73e1-4d70-b612-3798d98ecc1f", "name": "network-vif-deleted", "tag": "9730300d-1fec-45c1-ba67-15c29a530da5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:52.678133 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:52.678133 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:09:52.694988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f08c8c49-aa2e-4a65-b979-314755b7c48e req-d7b693dc-fafe-4018-940e-fc0eae07f5c0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:52.694988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f08c8c49-aa2e-4a65-b979-314755b7c48e req-d7b693dc-fafe-4018-940e-fc0eae07f5c0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:52.719492 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f08c8c49-aa2e-4a65-b979-314755b7c48e req-d7b693dc-fafe-4018-940e-fc0eae07f5c0 service nova] Creating event network-vif-deleted:9730300d-1fec-45c1-ba67-15c29a530da5 for instance 89e0044a-73e1-4d70-b612-3798d98ecc1f on nch1-master-1 Jan 22 21:09:52.735387 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-f08c8c49-aa2e-4a65-b979-314755b7c48e req-d7b693dc-fafe-4018-940e-fc0eae07f5c0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076187 Jan 22 21:09:52.736864 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1770/3392] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:52.743785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bbcd549e-683d-4336-801c-f70870fd4a5d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:52.745051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bbcd549e-683d-4336-801c-f70870fd4a5d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:52.753722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbcd549e-683d-4336-801c-f70870fd4a5d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:52.754192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbcd549e-683d-4336-801c-f70870fd4a5d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:52.755340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbcd549e-683d-4336-801c-f70870fd4a5d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:52.755899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbcd549e-683d-4336-801c-f70870fd4a5d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:53.063150 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bbcd549e-683d-4336-801c-f70870fd4a5d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.089387 Jan 22 21:09:53.063150 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1771/3393] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:52 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:53.063150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-829fbb90-b7b2-44db-bbc1-ddd5a4263364 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:53.063150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-829fbb90-b7b2-44db-bbc1-ddd5a4263364 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:53.063150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-829fbb90-b7b2-44db-bbc1-ddd5a4263364 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:53.063150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-829fbb90-b7b2-44db-bbc1-ddd5a4263364 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:53.063150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-829fbb90-b7b2-44db-bbc1-ddd5a4263364 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:53.063150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-829fbb90-b7b2-44db-bbc1-ddd5a4263364 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:53.063150 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-829fbb90-b7b2-44db-bbc1-ddd5a4263364 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance ea383184-f9d7-42bf-ae0b-91ef44de1864 could not be found. Jan 22 21:09:53.064906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9f2715d1-a930-4436-9515-d4fb8cb9d1fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:53.065373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-829fbb90-b7b2-44db-bbc1-ddd5a4263364 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance ea383184-f9d7-42bf-ae0b-91ef44de1864 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:53.065373 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-829fbb90-b7b2-44db-bbc1-ddd5a4263364 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 404 len: 111 microversion: 2.1 time: 0.075958 Jan 22 21:09:53.065373 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1772/3394] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:52 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:53.065373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7141153e-2f9d-4003-846d-d6384fc37b4d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:53.065373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7141153e-2f9d-4003-846d-d6384fc37b4d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:53.065844 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9f2715d1-a930-4436-9515-d4fb8cb9d1fa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.491442 Jan 22 21:09:53.065844 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1623/3395] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:52 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:53.066040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7141153e-2f9d-4003-846d-d6384fc37b4d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:53.066040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7141153e-2f9d-4003-846d-d6384fc37b4d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:53.066040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7141153e-2f9d-4003-846d-d6384fc37b4d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:53.066040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7141153e-2f9d-4003-846d-d6384fc37b4d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:53.066360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-05e75047-9480-4f65-9ac0-b541ed8f30d4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '.version_select at 0x7f1ed514ddc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:53.256815 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-05e75047-9480-4f65-9ac0-b541ed8f30d4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-key-122366025" status: 202 len: 0 microversion: 2.1 time: 0.310379 Jan 22 21:09:53.258554 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1624/3396] 10.222.0.100 () {58 vars in 1210 bytes} [Sat Jan 22 21:09:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-122366025 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:53.271683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d802fd61-1959-4000-a328-099ee83f4a03 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:53.272310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d802fd61-1959-4000-a328-099ee83f4a03 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:53.276367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7141153e-2f9d-4003-846d-d6384fc37b4d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:53.288902 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7141153e-2f9d-4003-846d-d6384fc37b4d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.377464 Jan 22 21:09:53.289528 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1773/3397] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:52 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:53.301327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d802fd61-1959-4000-a328-099ee83f4a03 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:53.301841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d802fd61-1959-4000-a328-099ee83f4a03 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:53.302693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d802fd61-1959-4000-a328-099ee83f4a03 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:53.303151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d802fd61-1959-4000-a328-099ee83f4a03 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:53.303957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-29d6a576-7ea6-4114-9e25-c5578e9f57e4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:53.304650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-29d6a576-7ea6-4114-9e25-c5578e9f57e4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 89e0044a-73e1-4d70-b612-3798d98ecc1f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:53.317555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29d6a576-7ea6-4114-9e25-c5578e9f57e4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:53.323543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29d6a576-7ea6-4114-9e25-c5578e9f57e4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:53.324450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29d6a576-7ea6-4114-9e25-c5578e9f57e4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:53.324973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29d6a576-7ea6-4114-9e25-c5578e9f57e4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:53.376504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29d6a576-7ea6-4114-9e25-c5578e9f57e4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:53.377117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29d6a576-7ea6-4114-9e25-c5578e9f57e4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:53.377748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-29d6a576-7ea6-4114-9e25-c5578e9f57e4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lazy-loading 'fault' on Instance uuid 89e0044a-73e1-4d70-b612-3798d98ecc1f {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:09:53.474653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-29d6a576-7ea6-4114-9e25-c5578e9f57e4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:53.485438 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-29d6a576-7ea6-4114-9e25-c5578e9f57e4 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/89e0044a-73e1-4d70-b612-3798d98ecc1f" status: 200 len: 1313 microversion: 2.1 time: 0.194684 Jan 22 21:09:53.486341 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1774/3398] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:53 2022] GET /compute/v2.1/servers/89e0044a-73e1-4d70-b612-3798d98ecc1f => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:53.492023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8aaad4e8-dc70-4711-9595-a212e5e4d951 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:53.493618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8aaad4e8-dc70-4711-9595-a212e5e4d951 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:53.500748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8aaad4e8-dc70-4711-9595-a212e5e4d951 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:53.501305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8aaad4e8-dc70-4711-9595-a212e5e4d951 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:53.502366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8aaad4e8-dc70-4711-9595-a212e5e4d951 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:53.502897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8aaad4e8-dc70-4711-9595-a212e5e4d951 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:53.566685 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8aaad4e8-dc70-4711-9595-a212e5e4d951 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.079044 Jan 22 21:09:53.571587 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1775/3399] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:53 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:53.577766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1035625075", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "ab49ab48-066e-4b21-9cb5-bee63c0067a9"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:53.646623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] validate_networks() for [('ab49ab48-066e-4b21-9cb5-bee63c0067a9', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:09:53.691218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d802fd61-1959-4000-a328-099ee83f4a03 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:53.699194 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d802fd61-1959-4000-a328-099ee83f4a03 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.440725 Jan 22 21:09:53.699783 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1625/3400] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:53 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:53.706368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-688acdbe-a10a-457d-b9c3-aa2e86205338 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:53.707465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-688acdbe-a10a-457d-b9c3-aa2e86205338 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:53.713818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-688acdbe-a10a-457d-b9c3-aa2e86205338 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:53.721479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-688acdbe-a10a-457d-b9c3-aa2e86205338 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:53.721479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-688acdbe-a10a-457d-b9c3-aa2e86205338 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:53.721479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-688acdbe-a10a-457d-b9c3-aa2e86205338 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.017179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-688acdbe-a10a-457d-b9c3-aa2e86205338 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:54.028992 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-688acdbe-a10a-457d-b9c3-aa2e86205338 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1510 microversion: 2.1 time: 0.327310 Jan 22 21:09:54.030253 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1626/3401] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:53 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1510 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:54.038427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f9256fc7-5152-4d39-8a03-b51fea37c493 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:54.039342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f9256fc7-5152-4d39-8a03-b51fea37c493 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 7a074218-d721-4062-9658-3af4706d79e3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:54.046781 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-f9256fc7-5152-4d39-8a03-b51fea37c493 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance 7a074218-d721-4062-9658-3af4706d79e3 could not be found. Jan 22 21:09:54.047836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f9256fc7-5152-4d39-8a03-b51fea37c493 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance 7a074218-d721-4062-9658-3af4706d79e3 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:54.048864 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f9256fc7-5152-4d39-8a03-b51fea37c493 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/7a074218-d721-4062-9658-3af4706d79e3/action" status: 404 len: 111 microversion: 2.1 time: 0.016141 Jan 22 21:09:54.056215 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1627/3402] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:54 2022] POST /compute/v2.1/servers/7a074218-d721-4062-9658-3af4706d79e3/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:54.061337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9699b0b0-f587-4218-8592-3edbeccf6221 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:54.063068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9699b0b0-f587-4218-8592-3edbeccf6221 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:54.072790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9699b0b0-f587-4218-8592-3edbeccf6221 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.073338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9699b0b0-f587-4218-8592-3edbeccf6221 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.074166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9699b0b0-f587-4218-8592-3edbeccf6221 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.074699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9699b0b0-f587-4218-8592-3edbeccf6221 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.119246 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9699b0b0-f587-4218-8592-3edbeccf6221 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.061393 Jan 22 21:09:54.119896 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1628/3403] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:54 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:54.125323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-93072608-427c-4a61-8ab3-0a4f6c2778a7 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:54.125991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-93072608-427c-4a61-8ab3-0a4f6c2778a7 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:54.133466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93072608-427c-4a61-8ab3-0a4f6c2778a7 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.133957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93072608-427c-4a61-8ab3-0a4f6c2778a7 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.134929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93072608-427c-4a61-8ab3-0a4f6c2778a7 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.139927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93072608-427c-4a61-8ab3-0a4f6c2778a7 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.172573 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-93072608-427c-4a61-8ab3-0a4f6c2778a7 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1/ips" status: 200 len: 109 microversion: 2.1 time: 0.051303 Jan 22 21:09:54.175702 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1629/3404] 10.222.0.100 () {58 vars in 1252 bytes} [Sat Jan 22 21:09:54 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1/ips => generated 109 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:54.180296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-215c9273-6644-4223-aa3b-404d57f1233f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:54.180917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-215c9273-6644-4223-aa3b-404d57f1233f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:54.187312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-215c9273-6644-4223-aa3b-404d57f1233f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.187820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-215c9273-6644-4223-aa3b-404d57f1233f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.188627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-215c9273-6644-4223-aa3b-404d57f1233f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.189075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-215c9273-6644-4223-aa3b-404d57f1233f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.457661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-215c9273-6644-4223-aa3b-404d57f1233f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:54.465731 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-215c9273-6644-4223-aa3b-404d57f1233f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.290957 Jan 22 21:09:54.479595 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1630/3405] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:54 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:54.485159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-adb5fbf0-58d5-4e8f-b483-6eab99814cb2 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:54.485959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-adb5fbf0-58d5-4e8f-b483-6eab99814cb2 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:54.492183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adb5fbf0-58d5-4e8f-b483-6eab99814cb2 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.492707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adb5fbf0-58d5-4e8f-b483-6eab99814cb2 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.493743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adb5fbf0-58d5-4e8f-b483-6eab99814cb2 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.494275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adb5fbf0-58d5-4e8f-b483-6eab99814cb2 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.543682 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-adb5fbf0-58d5-4e8f-b483-6eab99814cb2 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1/ips" status: 200 len: 109 microversion: 2.1 time: 0.062286 Jan 22 21:09:54.545434 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1631/3406] 10.222.0.100 () {58 vars in 1252 bytes} [Sat Jan 22 21:09:54 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1/ips => generated 109 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:54.554615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9e409a6e-2891-4bbd-b452-8206aabe306f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:54.556038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9e409a6e-2891-4bbd-b452-8206aabe306f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:54.568487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e409a6e-2891-4bbd-b452-8206aabe306f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.569740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e409a6e-2891-4bbd-b452-8206aabe306f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.574270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e409a6e-2891-4bbd-b452-8206aabe306f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.574270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e409a6e-2891-4bbd-b452-8206aabe306f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.720199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:09:54.721246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:09:54.721945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:09:54.722586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:09:54.723195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:09:54.732991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.733610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.734554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.735128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.752858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:09:54.758544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for user 75befd3272db4de48c7b4586adf6f849 and project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:09:54.773686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:09:54.776863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:09:54.904858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9e409a6e-2891-4bbd-b452-8206aabe306f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:54.909474 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1d1410b6-e82c-4209-95f4-7b5db324e7d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.336035 Jan 22 21:09:54.916010 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1776/3407] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:53 2022] POST /compute/v2.1/servers => generated 382 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:09:54.922310 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9e409a6e-2891-4bbd-b452-8206aabe306f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.373525 Jan 22 21:09:54.922593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0e4bcea4-fdde-4d84-8e5e-3bcb24e50e00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:54.923357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0e4bcea4-fdde-4d84-8e5e-3bcb24e50e00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:54.931925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e4bcea4-fdde-4d84-8e5e-3bcb24e50e00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.932511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e4bcea4-fdde-4d84-8e5e-3bcb24e50e00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.933974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e4bcea4-fdde-4d84-8e5e-3bcb24e50e00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.934563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e4bcea4-fdde-4d84-8e5e-3bcb24e50e00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.934731 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1632/3408] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:54 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:54.943639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a2420fa-d83a-43c7-869f-03f8c4e80695 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:54.944981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9a2420fa-d83a-43c7-869f-03f8c4e80695 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 89e0044a-73e1-4d70-b612-3798d98ecc1f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:54.955343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a2420fa-d83a-43c7-869f-03f8c4e80695 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.956105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a2420fa-d83a-43c7-869f-03f8c4e80695 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.957403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a2420fa-d83a-43c7-869f-03f8c4e80695 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:54.958099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a2420fa-d83a-43c7-869f-03f8c4e80695 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:54.976637 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-9a2420fa-d83a-43c7-869f-03f8c4e80695 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] HTTP exception thrown: Instance 89e0044a-73e1-4d70-b612-3798d98ecc1f could not be found. Jan 22 21:09:54.977341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a2420fa-d83a-43c7-869f-03f8c4e80695 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Returning 404 to user: Instance 89e0044a-73e1-4d70-b612-3798d98ecc1f could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:54.978228 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a2420fa-d83a-43c7-869f-03f8c4e80695 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/89e0044a-73e1-4d70-b612-3798d98ecc1f" status: 404 len: 111 microversion: 2.1 time: 0.042139 Jan 22 21:09:54.978915 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1633/3409] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:54 2022] GET /compute/v2.1/servers/89e0044a-73e1-4d70-b612-3798d98ecc1f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:54.994672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-78668340-486f-4ff1-a39f-f6d19e69bdcd tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:54.996047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-78668340-486f-4ff1-a39f-f6d19e69bdcd tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:55.002910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78668340-486f-4ff1-a39f-f6d19e69bdcd tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.003365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78668340-486f-4ff1-a39f-f6d19e69bdcd tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.004206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78668340-486f-4ff1-a39f-f6d19e69bdcd tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.004640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78668340-486f-4ff1-a39f-f6d19e69bdcd tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.033002 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-78668340-486f-4ff1-a39f-f6d19e69bdcd tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1/ips/tempest-ServerAddressesTestJSON-1184389960-network" status: 200 len: 94 microversion: 2.1 time: 0.042616 Jan 22 21:09:55.034121 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1634/3410] 10.222.0.100 () {58 vars in 1405 bytes} [Sat Jan 22 21:09:54 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1/ips/tempest-ServerAddressesTestJSON-1184389960-network => generated 94 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:09:55.038963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f39da2e2-f320-4a50-a572-3382eeabb2ee tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:55.039938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f39da2e2-f320-4a50-a572-3382eeabb2ee tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:55.047514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f39da2e2-f320-4a50-a572-3382eeabb2ee tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.047903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f39da2e2-f320-4a50-a572-3382eeabb2ee tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.048703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f39da2e2-f320-4a50-a572-3382eeabb2ee tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.052376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f39da2e2-f320-4a50-a572-3382eeabb2ee tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.102655 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f39da2e2-f320-4a50-a572-3382eeabb2ee tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.062318 Jan 22 21:09:55.102655 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1635/3411] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:55 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:55.104958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f33c4623-7d98-47bd-ab86-ddc60f9eb1bb req-2851104b-b540-412f-bd8f-9b58ddec3c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb452c77-f8d2-463f-ba0e-5c9825b70c07", "name": "network-vif-deleted", "tag": "6a53adf0-69a2-44de-806e-dfae48dea5f0"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:55.108220 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:55.108220 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:55.117711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f33c4623-7d98-47bd-ab86-ddc60f9eb1bb req-2851104b-b540-412f-bd8f-9b58ddec3c02 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.118104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f33c4623-7d98-47bd-ab86-ddc60f9eb1bb req-2851104b-b540-412f-bd8f-9b58ddec3c02 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.132744 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f33c4623-7d98-47bd-ab86-ddc60f9eb1bb req-2851104b-b540-412f-bd8f-9b58ddec3c02 service nova] Creating event network-vif-deleted:6a53adf0-69a2-44de-806e-dfae48dea5f0 for instance eb452c77-f8d2-463f-ba0e-5c9825b70c07 on nch1-master-1 Jan 22 21:09:55.138017 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f33c4623-7d98-47bd-ab86-ddc60f9eb1bb req-2851104b-b540-412f-bd8f-9b58ddec3c02 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037940 Jan 22 21:09:55.138908 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1636/3412] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:55.144783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a6043403-7ba5-4441-a166-20ccb22072cd tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:55.148344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a6043403-7ba5-4441-a166-20ccb22072cd tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:55.199345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a6043403-7ba5-4441-a166-20ccb22072cd tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:55.207746 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a6043403-7ba5-4441-a166-20ccb22072cd tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1213 microversion: 2.1 time: 0.067650 Jan 22 21:09:55.215358 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1637/3413] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:55 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:55.219558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ddfa62bd-4bc7-44e5-80b3-2bf2ffcdef49 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:55.220180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ddfa62bd-4bc7-44e5-80b3-2bf2ffcdef49 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: eb452c77-f8d2-463f-ba0e-5c9825b70c07] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:55.230769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddfa62bd-4bc7-44e5-80b3-2bf2ffcdef49 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.237277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddfa62bd-4bc7-44e5-80b3-2bf2ffcdef49 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.237277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddfa62bd-4bc7-44e5-80b3-2bf2ffcdef49 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.237277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddfa62bd-4bc7-44e5-80b3-2bf2ffcdef49 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.247827 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-ddfa62bd-4bc7-44e5-80b3-2bf2ffcdef49 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] HTTP exception thrown: Instance eb452c77-f8d2-463f-ba0e-5c9825b70c07 could not be found. Jan 22 21:09:55.248526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ddfa62bd-4bc7-44e5-80b3-2bf2ffcdef49 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Returning 404 to user: Instance eb452c77-f8d2-463f-ba0e-5c9825b70c07 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:55.249825 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ddfa62bd-4bc7-44e5-80b3-2bf2ffcdef49 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07" status: 404 len: 111 microversion: 2.1 time: 0.040542 Jan 22 21:09:55.250725 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1638/3414] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:55 2022] GET /compute/v2.1/servers/eb452c77-f8d2-463f-ba0e-5c9825b70c07 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:55.254455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0e4bcea4-fdde-4d84-8e5e-3bcb24e50e00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:55.257562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2f28d7f5-b7d8-4648-943f-464800207b64 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:55.258079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2f28d7f5-b7d8-4648-943f-464800207b64 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:55.263477 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0e4bcea4-fdde-4d84-8e5e-3bcb24e50e00 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.345716 Jan 22 21:09:55.264202 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1777/3415] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:54 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:55.270050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ac793e81-2d21-4b2a-9b4e-106956aeda40 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:55.271026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ac793e81-2d21-4b2a-9b4e-106956aeda40 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:55.277121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f28d7f5-b7d8-4648-943f-464800207b64 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.278060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac793e81-2d21-4b2a-9b4e-106956aeda40 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.278521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac793e81-2d21-4b2a-9b4e-106956aeda40 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.279363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac793e81-2d21-4b2a-9b4e-106956aeda40 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.279806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac793e81-2d21-4b2a-9b4e-106956aeda40 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.280370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f28d7f5-b7d8-4648-943f-464800207b64 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.286881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f28d7f5-b7d8-4648-943f-464800207b64 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.287373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f28d7f5-b7d8-4648-943f-464800207b64 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.316788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2f28d7f5-b7d8-4648-943f-464800207b64 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:09:55.321673 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ac793e81-2d21-4b2a-9b4e-106956aeda40 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.055420 Jan 22 21:09:55.322971 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1778/3416] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:55 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:55.328878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9ac023f9-39ba-4b46-a2c7-7d832fb982b9 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:55.433897 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9ac023f9-39ba-4b46-a2c7-7d832fb982b9 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "DELETE /compute/v2.1/os-server-groups/a5a78ded-cf35-4e83-b5f2-4d2c612c91f2" status: 204 len: 0 microversion: 2.1 time: 0.110310 Jan 22 21:09:55.434889 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1779/3417] 10.222.0.100 () {58 vars in 1270 bytes} [Sat Jan 22 21:09:55 2022] DELETE /compute/v2.1/os-server-groups/a5a78ded-cf35-4e83-b5f2-4d2c612c91f2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:09:55.439701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a0ebbee3-4ac7-43fc-ae9a-1157777ae7fe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:55.440375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a0ebbee3-4ac7-43fc-ae9a-1157777ae7fe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:55.447787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0ebbee3-4ac7-43fc-ae9a-1157777ae7fe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.448643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0ebbee3-4ac7-43fc-ae9a-1157777ae7fe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.450099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0ebbee3-4ac7-43fc-ae9a-1157777ae7fe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.450904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0ebbee3-4ac7-43fc-ae9a-1157777ae7fe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.476437 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-a0ebbee3-4ac7-43fc-ae9a-1157777ae7fe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Cannot 'restore' instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 while it is in vm_state active Jan 22 21:09:55.477050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a0ebbee3-4ac7-43fc-ae9a-1157777ae7fe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 409 to user: Cannot 'restore' instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 while it is in vm_state active {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:55.477956 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a0ebbee3-4ac7-43fc-ae9a-1157777ae7fe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action" status: 409 len: 145 microversion: 2.1 time: 0.042143 Jan 22 21:09:55.478517 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1780/3418] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:55 2022] POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action => generated 145 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:09:55.483931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5104310f-0181-4264-acfb-dee8695e768f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:55.484470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5104310f-0181-4264-acfb-dee8695e768f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:55.490937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5104310f-0181-4264-acfb-dee8695e768f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.491400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5104310f-0181-4264-acfb-dee8695e768f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.492202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5104310f-0181-4264-acfb-dee8695e768f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.492656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5104310f-0181-4264-acfb-dee8695e768f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.522452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5104310f-0181-4264-acfb-dee8695e768f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:09:55.701731 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2f28d7f5-b7d8-4648-943f-464800207b64 tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 204 len: 0 microversion: 2.1 time: 0.449830 Jan 22 21:09:55.703103 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1639/3419] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:55 2022] DELETE /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:09:55.709122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3a82406c-9d22-47ed-9639-8a1d6a56a57c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:55.710217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3a82406c-9d22-47ed-9639-8a1d6a56a57c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:55.717051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a82406c-9d22-47ed-9639-8a1d6a56a57c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.722949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a82406c-9d22-47ed-9639-8a1d6a56a57c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.723964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a82406c-9d22-47ed-9639-8a1d6a56a57c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.724551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a82406c-9d22-47ed-9639-8a1d6a56a57c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.800318 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5104310f-0181-4264-acfb-dee8695e768f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 204 len: 0 microversion: 2.1 time: 0.320544 Jan 22 21:09:55.800908 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1781/3420] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:09:55 2022] DELETE /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:09:55.806259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e19242aa-8403-42e1-9771-54b201e76e8b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:55.806969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e19242aa-8403-42e1-9771-54b201e76e8b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:55.813899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e19242aa-8403-42e1-9771-54b201e76e8b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.814358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e19242aa-8403-42e1-9771-54b201e76e8b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.815166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e19242aa-8403-42e1-9771-54b201e76e8b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.815610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e19242aa-8403-42e1-9771-54b201e76e8b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.920585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3a82406c-9d22-47ed-9639-8a1d6a56a57c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:55.929045 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3a82406c-9d22-47ed-9639-8a1d6a56a57c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.224661 Jan 22 21:09:55.929697 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1640/3421] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:55 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:55.949856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c2d73146-52c0-4ab0-90e7-8cd4d08a499a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:55.950488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c2d73146-52c0-4ab0-90e7-8cd4d08a499a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:55.957691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2d73146-52c0-4ab0-90e7-8cd4d08a499a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.958156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2d73146-52c0-4ab0-90e7-8cd4d08a499a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.958970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2d73146-52c0-4ab0-90e7-8cd4d08a499a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.959415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2d73146-52c0-4ab0-90e7-8cd4d08a499a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.965664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e19242aa-8403-42e1-9771-54b201e76e8b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:55.976341 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e19242aa-8403-42e1-9771-54b201e76e8b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1516 microversion: 2.1 time: 0.174042 Jan 22 21:09:55.976967 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1782/3422] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:55 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:55.981539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0729bd24-5902-4720-8ac9-f7f559fbdce3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:55.982370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0729bd24-5902-4720-8ac9-f7f559fbdce3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:55.991385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0729bd24-5902-4720-8ac9-f7f559fbdce3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.992013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0729bd24-5902-4720-8ac9-f7f559fbdce3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:55.996235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0729bd24-5902-4720-8ac9-f7f559fbdce3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:55.996755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0729bd24-5902-4720-8ac9-f7f559fbdce3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.143256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0729bd24-5902-4720-8ac9-f7f559fbdce3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:56.152312 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0729bd24-5902-4720-8ac9-f7f559fbdce3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1480 microversion: 2.1 time: 0.174211 Jan 22 21:09:56.152907 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1783/3423] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:55 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1480 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:56.158482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-36fc99e1-73cc-4b84-9f6e-0e5967c9076d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:56.159103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-36fc99e1-73cc-4b84-9f6e-0e5967c9076d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:56.165310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36fc99e1-73cc-4b84-9f6e-0e5967c9076d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.165833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36fc99e1-73cc-4b84-9f6e-0e5967c9076d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.167630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36fc99e1-73cc-4b84-9f6e-0e5967c9076d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.167630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36fc99e1-73cc-4b84-9f6e-0e5967c9076d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.180706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c2d73146-52c0-4ab0-90e7-8cd4d08a499a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:56.193160 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c2d73146-52c0-4ab0-90e7-8cd4d08a499a tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1476 microversion: 2.1 time: 0.261383 Jan 22 21:09:56.196504 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1641/3424] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:55 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1476 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:56.207651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eeb8dd8f-45f0-4a0f-9aae-a82f82b7e31d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:56.208992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eeb8dd8f-45f0-4a0f-9aae-a82f82b7e31d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:56.219656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eeb8dd8f-45f0-4a0f-9aae-a82f82b7e31d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.220488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eeb8dd8f-45f0-4a0f-9aae-a82f82b7e31d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.222656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eeb8dd8f-45f0-4a0f-9aae-a82f82b7e31d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.225668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eeb8dd8f-45f0-4a0f-9aae-a82f82b7e31d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.270503 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eeb8dd8f-45f0-4a0f-9aae-a82f82b7e31d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.068704 Jan 22 21:09:56.273549 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1642/3425] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:56 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:56.276271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-36897933-2e6a-44d7-bd2b-b2649c8f8faa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:56.276942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-36897933-2e6a-44d7-bd2b-b2649c8f8faa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:56.284630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36897933-2e6a-44d7-bd2b-b2649c8f8faa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.285077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36897933-2e6a-44d7-bd2b-b2649c8f8faa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.289421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36897933-2e6a-44d7-bd2b-b2649c8f8faa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.289421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36897933-2e6a-44d7-bd2b-b2649c8f8faa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.354785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-36fc99e1-73cc-4b84-9f6e-0e5967c9076d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:56.364003 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-36fc99e1-73cc-4b84-9f6e-0e5967c9076d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.210058 Jan 22 21:09:56.365049 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1784/3426] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:56 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:56.365651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-36897933-2e6a-44d7-bd2b-b2649c8f8faa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:56.374645 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-36897933-2e6a-44d7-bd2b-b2649c8f8faa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1217 microversion: 2.1 time: 0.101764 Jan 22 21:09:56.376669 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1643/3427] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:56 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:56.379459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-59be9633-a40b-470e-8bb1-97f32a2b44eb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:56.380444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-59be9633-a40b-470e-8bb1-97f32a2b44eb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:56.390618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2cad231d-fcef-4003-a1f6-b44912a8f8b8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:56.391173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2cad231d-fcef-4003-a1f6-b44912a8f8b8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 8a5e47f2-d97b-4900-b317-25ea04e8bf64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:56.397444 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-2cad231d-fcef-4003-a1f6-b44912a8f8b8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance 8a5e47f2-d97b-4900-b317-25ea04e8bf64 could not be found. Jan 22 21:09:56.397892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59be9633-a40b-470e-8bb1-97f32a2b44eb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.398153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2cad231d-fcef-4003-a1f6-b44912a8f8b8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance 8a5e47f2-d97b-4900-b317-25ea04e8bf64 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:56.402889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59be9633-a40b-470e-8bb1-97f32a2b44eb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.402998 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2cad231d-fcef-4003-a1f6-b44912a8f8b8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/8a5e47f2-d97b-4900-b317-25ea04e8bf64/action" status: 404 len: 111 microversion: 2.1 time: 0.012285 Jan 22 21:09:56.403070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59be9633-a40b-470e-8bb1-97f32a2b44eb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.403070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59be9633-a40b-470e-8bb1-97f32a2b44eb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.403186 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1644/3428] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:56 2022] POST /compute/v2.1/servers/8a5e47f2-d97b-4900-b317-25ea04e8bf64/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:56.409129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5c0e9079-b470-464b-bbd9-fe6f8e3cc029 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:56.409978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5c0e9079-b470-464b-bbd9-fe6f8e3cc029 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:56.418100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c0e9079-b470-464b-bbd9-fe6f8e3cc029 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.419065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c0e9079-b470-464b-bbd9-fe6f8e3cc029 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.419912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c0e9079-b470-464b-bbd9-fe6f8e3cc029 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.422811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c0e9079-b470-464b-bbd9-fe6f8e3cc029 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.448182 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-59be9633-a40b-470e-8bb1-97f32a2b44eb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.076720 Jan 22 21:09:56.448459 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1785/3429] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:56 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:56.585797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5c0e9079-b470-464b-bbd9-fe6f8e3cc029 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:56.594101 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5c0e9079-b470-464b-bbd9-fe6f8e3cc029 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.189880 Jan 22 21:09:56.594673 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1645/3430] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:56 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:56.613032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0c11a37e-45ad-4256-84ea-5df8d16c5b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:56.613772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0c11a37e-45ad-4256-84ea-5df8d16c5b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:56.621296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c11a37e-45ad-4256-84ea-5df8d16c5b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.621788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c11a37e-45ad-4256-84ea-5df8d16c5b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.622593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c11a37e-45ad-4256-84ea-5df8d16c5b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.623046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c11a37e-45ad-4256-84ea-5df8d16c5b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.767944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0c11a37e-45ad-4256-84ea-5df8d16c5b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:56.776272 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0c11a37e-45ad-4256-84ea-5df8d16c5b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.168314 Jan 22 21:09:56.777111 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1786/3431] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:56 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:56.793760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b4e43acc-9628-4c1a-bac0-61ce3fcc409a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:56.794441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b4e43acc-9628-4c1a-bac0-61ce3fcc409a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:56.800478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4e43acc-9628-4c1a-bac0-61ce3fcc409a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.800928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4e43acc-9628-4c1a-bac0-61ce3fcc409a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.801752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4e43acc-9628-4c1a-bac0-61ce3fcc409a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.802189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4e43acc-9628-4c1a-bac0-61ce3fcc409a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.826907 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-b4e43acc-9628-4c1a-bac0-61ce3fcc409a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Cannot 'resume' instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 while it is in vm_state active Jan 22 21:09:56.828063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b4e43acc-9628-4c1a-bac0-61ce3fcc409a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 409 to user: Cannot 'resume' instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 while it is in vm_state active {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:56.828893 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b4e43acc-9628-4c1a-bac0-61ce3fcc409a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action" status: 409 len: 144 microversion: 2.1 time: 0.039207 Jan 22 21:09:56.829443 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1646/3432] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:56 2022] POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action => generated 144 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:09:56.838206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6c1b03f4-25ac-428a-b6a4-640f1c0adf0a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:56.839437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6c1b03f4-25ac-428a-b6a4-640f1c0adf0a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:56.846630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c1b03f4-25ac-428a-b6a4-640f1c0adf0a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.847247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c1b03f4-25ac-428a-b6a4-640f1c0adf0a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.848092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c1b03f4-25ac-428a-b6a4-640f1c0adf0a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:56.848558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c1b03f4-25ac-428a-b6a4-640f1c0adf0a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:56.993882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-403efea1-bd0e-48ee-8231-8bbfb87f2f1f tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:56.994526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-403efea1-bd0e-48ee-8231-8bbfb87f2f1f tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:57.003505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-403efea1-bd0e-48ee-8231-8bbfb87f2f1f tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:57.003993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-403efea1-bd0e-48ee-8231-8bbfb87f2f1f tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:57.004790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-403efea1-bd0e-48ee-8231-8bbfb87f2f1f tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:57.005234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-403efea1-bd0e-48ee-8231-8bbfb87f2f1f tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:57.095463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6c1b03f4-25ac-428a-b6a4-640f1c0adf0a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:57.103028 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6c1b03f4-25ac-428a-b6a4-640f1c0adf0a tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.268718 Jan 22 21:09:57.103848 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1787/3433] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:56 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:57.120599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f47e61e-9673-48dc-9a42-c8407c47769b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:57.121221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f47e61e-9673-48dc-9a42-c8407c47769b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:57.128615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f47e61e-9673-48dc-9a42-c8407c47769b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:57.129142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f47e61e-9673-48dc-9a42-c8407c47769b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:57.129916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f47e61e-9673-48dc-9a42-c8407c47769b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:57.130419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f47e61e-9673-48dc-9a42-c8407c47769b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:57.160939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-403efea1-bd0e-48ee-8231-8bbfb87f2f1f tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:57.169244 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-403efea1-bd0e-48ee-8231-8bbfb87f2f1f tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1516 microversion: 2.1 time: 0.179161 Jan 22 21:09:57.179642 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1647/3434] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:56 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:57.185291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b3717bd6-836e-46ff-9d76-93acb39fcfbd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:57.187157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b3717bd6-836e-46ff-9d76-93acb39fcfbd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:57.193200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3717bd6-836e-46ff-9d76-93acb39fcfbd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:57.193704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3717bd6-836e-46ff-9d76-93acb39fcfbd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:57.194510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3717bd6-836e-46ff-9d76-93acb39fcfbd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:57.194959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3717bd6-836e-46ff-9d76-93acb39fcfbd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:57.447882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f47e61e-9673-48dc-9a42-c8407c47769b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:57.470766 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f47e61e-9673-48dc-9a42-c8407c47769b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.354046 Jan 22 21:09:57.471490 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1788/3435] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:57 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:57.476135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-929f4da3-b97e-4598-bfa8-b3db6f56877f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:57.476989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-929f4da3-b97e-4598-bfa8-b3db6f56877f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:57.492284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-929f4da3-b97e-4598-bfa8-b3db6f56877f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:57.492954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-929f4da3-b97e-4598-bfa8-b3db6f56877f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:57.494788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-929f4da3-b97e-4598-bfa8-b3db6f56877f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:57.495254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-929f4da3-b97e-4598-bfa8-b3db6f56877f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:57.907324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-929f4da3-b97e-4598-bfa8-b3db6f56877f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:57.916757 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-929f4da3-b97e-4598-bfa8-b3db6f56877f tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1476 microversion: 2.1 time: 0.444112 Jan 22 21:09:57.917651 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1789/3436] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:57 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1476 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:57.932957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-691667fc-29bf-44a5-808b-34b446d22052 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:57.933934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-691667fc-29bf-44a5-808b-34b446d22052 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:57.940552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-691667fc-29bf-44a5-808b-34b446d22052 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:57.941012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-691667fc-29bf-44a5-808b-34b446d22052 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:57.941854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-691667fc-29bf-44a5-808b-34b446d22052 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:57.942654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-691667fc-29bf-44a5-808b-34b446d22052 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:57.989038 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-691667fc-29bf-44a5-808b-34b446d22052 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.059711 Jan 22 21:09:57.992199 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1790/3437] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:57 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:57.997115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6d5d7c5e-98e0-4947-b168-f49edae32f31 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:57.997850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6d5d7c5e-98e0-4947-b168-f49edae32f31 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:58.007477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d5d7c5e-98e0-4947-b168-f49edae32f31 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:58.007813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d5d7c5e-98e0-4947-b168-f49edae32f31 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:58.008675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d5d7c5e-98e0-4947-b168-f49edae32f31 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:58.009055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d5d7c5e-98e0-4947-b168-f49edae32f31 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:58.081221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6d5d7c5e-98e0-4947-b168-f49edae32f31 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:58.091899 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6d5d7c5e-98e0-4947-b168-f49edae32f31 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1271 microversion: 2.1 time: 0.100443 Jan 22 21:09:58.092669 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1791/3438] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:57 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:58.097199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19991251-c50c-4259-ae05-de53d853c60d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:58.098574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-19991251-c50c-4259-ae05-de53d853c60d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:58.104534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19991251-c50c-4259-ae05-de53d853c60d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:58.105432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19991251-c50c-4259-ae05-de53d853c60d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:58.105806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19991251-c50c-4259-ae05-de53d853c60d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:58.106244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19991251-c50c-4259-ae05-de53d853c60d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:58.148392 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19991251-c50c-4259-ae05-de53d853c60d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.054322 Jan 22 21:09:58.149084 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1792/3439] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:58 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:58.156606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f5c4172-3bdf-4e70-818c-dadf5eadf6c0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "a982ac8c-3d1e-405d-b754-a70452696d1b"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:58.159674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f5c4172-3bdf-4e70-818c-dadf5eadf6c0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:58.160524 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f5c4172-3bdf-4e70-818c-dadf5eadf6c0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.008229 Jan 22 21:09:58.164994 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1793/3440] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:09:58 2022] POST /compute/v2.1/servers => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:09:58.169825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-751be29c-185e-4b95-b12b-db0f65376238 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:58.170562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-751be29c-185e-4b95-b12b-db0f65376238 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:58.180119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-751be29c-185e-4b95-b12b-db0f65376238 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:58.180594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-751be29c-185e-4b95-b12b-db0f65376238 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:58.181489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-751be29c-185e-4b95-b12b-db0f65376238 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:58.182019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-751be29c-185e-4b95-b12b-db0f65376238 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:58.205903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b3717bd6-836e-46ff-9d76-93acb39fcfbd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:58.224261 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b3717bd6-836e-46ff-9d76-93acb39fcfbd tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1479 microversion: 2.1 time: 1.043162 Jan 22 21:09:58.225050 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1648/3441] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:57 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1479 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:58.230181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ade3610-8de9-45bf-8fe0-932a99b3aa6b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:58.231064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1ade3610-8de9-45bf-8fe0-932a99b3aa6b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:58.239134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ade3610-8de9-45bf-8fe0-932a99b3aa6b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:58.239597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ade3610-8de9-45bf-8fe0-932a99b3aa6b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:58.240701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ade3610-8de9-45bf-8fe0-932a99b3aa6b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:58.241150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ade3610-8de9-45bf-8fe0-932a99b3aa6b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:58.522442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-751be29c-185e-4b95-b12b-db0f65376238 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:58.527255 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-751be29c-185e-4b95-b12b-db0f65376238 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.361149 Jan 22 21:09:58.529555 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1794/3442] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:58 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:58.533196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-9abe149d-1842-48b8-826b-bb5ed8972f6f req-83c94d95-5b22-4881-b8f4-aa6f5468bc94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c84a8ac-7a1b-4081-bc57-ab560dc077f1", "name": "network-vif-deleted", "tag": "b58670f9-67aa-4e2a-9a1f-06471ae23041"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:58.534747 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:58.534747 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:09:58.543989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9abe149d-1842-48b8-826b-bb5ed8972f6f req-83c94d95-5b22-4881-b8f4-aa6f5468bc94 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:58.544617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9abe149d-1842-48b8-826b-bb5ed8972f6f req-83c94d95-5b22-4881-b8f4-aa6f5468bc94 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:58.556017 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-9abe149d-1842-48b8-826b-bb5ed8972f6f req-83c94d95-5b22-4881-b8f4-aa6f5468bc94 service nova] Creating event network-vif-deleted:b58670f9-67aa-4e2a-9a1f-06471ae23041 for instance 5c84a8ac-7a1b-4081-bc57-ab560dc077f1 on nch1-master-1 Jan 22 21:09:58.562650 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-9abe149d-1842-48b8-826b-bb5ed8972f6f req-83c94d95-5b22-4881-b8f4-aa6f5468bc94 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032556 Jan 22 21:09:58.563340 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1795/3443] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:58.568216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2712f27b-8bc0-475d-b3b8-1eaded4a6dfa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:58.568962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2712f27b-8bc0-475d-b3b8-1eaded4a6dfa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:58.578317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2712f27b-8bc0-475d-b3b8-1eaded4a6dfa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:58.582146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2712f27b-8bc0-475d-b3b8-1eaded4a6dfa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:58.582146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2712f27b-8bc0-475d-b3b8-1eaded4a6dfa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:58.582146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2712f27b-8bc0-475d-b3b8-1eaded4a6dfa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:58.638717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1ade3610-8de9-45bf-8fe0-932a99b3aa6b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd0d103dfe6a41d9bb2fae68523fc2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8245987c837d47bab828f0b05c94a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:58.647513 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1ade3610-8de9-45bf-8fe0-932a99b3aa6b tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 200 len: 1516 microversion: 2.1 time: 0.421130 Jan 22 21:09:58.648278 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1649/3444] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:58 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 1516 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:58.823490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2712f27b-8bc0-475d-b3b8-1eaded4a6dfa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:58.833835 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2712f27b-8bc0-475d-b3b8-1eaded4a6dfa tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.269261 Jan 22 21:09:58.834638 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1796/3445] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:58 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:58.850363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f08b1bd8-dd30-4a41-a2e6-a0f712459db5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:58.850896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f08b1bd8-dd30-4a41-a2e6-a0f712459db5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: d20abeed-b483-4be2-a529-ee4396d842e4] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:58.856511 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-f08b1bd8-dd30-4a41-a2e6-a0f712459db5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance d20abeed-b483-4be2-a529-ee4396d842e4 could not be found. Jan 22 21:09:58.857295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f08b1bd8-dd30-4a41-a2e6-a0f712459db5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance d20abeed-b483-4be2-a529-ee4396d842e4 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:58.858639 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f08b1bd8-dd30-4a41-a2e6-a0f712459db5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/d20abeed-b483-4be2-a529-ee4396d842e4/action" status: 404 len: 111 microversion: 2.1 time: 0.011716 Jan 22 21:09:58.860937 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1650/3446] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:58 2022] POST /compute/v2.1/servers/d20abeed-b483-4be2-a529-ee4396d842e4/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:58.870911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dbcab30f-4bb8-425d-9b5d-bd36ac6433f4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:58.872272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dbcab30f-4bb8-425d-9b5d-bd36ac6433f4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:58.878862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbcab30f-4bb8-425d-9b5d-bd36ac6433f4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:58.879411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbcab30f-4bb8-425d-9b5d-bd36ac6433f4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:58.880373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbcab30f-4bb8-425d-9b5d-bd36ac6433f4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:58.881042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbcab30f-4bb8-425d-9b5d-bd36ac6433f4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:58.935562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9d2ea73e-c214-4860-b291-5f5ad0af6cfb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:58.938385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9d2ea73e-c214-4860-b291-5f5ad0af6cfb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:58.945324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d2ea73e-c214-4860-b291-5f5ad0af6cfb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:58.946315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d2ea73e-c214-4860-b291-5f5ad0af6cfb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:58.947459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d2ea73e-c214-4860-b291-5f5ad0af6cfb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:58.948091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d2ea73e-c214-4860-b291-5f5ad0af6cfb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.142972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dbcab30f-4bb8-425d-9b5d-bd36ac6433f4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:59.152219 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dbcab30f-4bb8-425d-9b5d-bd36ac6433f4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.285188 Jan 22 21:09:59.157287 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1797/3447] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:58 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:59.175310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6259db4a-88e0-4a55-b7aa-5250ca1bfa52 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:59.180215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6259db4a-88e0-4a55-b7aa-5250ca1bfa52 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:59.186665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6259db4a-88e0-4a55-b7aa-5250ca1bfa52 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.187635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6259db4a-88e0-4a55-b7aa-5250ca1bfa52 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.188400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6259db4a-88e0-4a55-b7aa-5250ca1bfa52 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.188851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6259db4a-88e0-4a55-b7aa-5250ca1bfa52 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.242736 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6259db4a-88e0-4a55-b7aa-5250ca1bfa52 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.075751 Jan 22 21:09:59.244155 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1798/3448] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:09:59 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:09:59.267800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-26f53e5e-87d5-4d10-afe0-d80dbf0c5eb9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:59.268393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-26f53e5e-87d5-4d10-afe0-d80dbf0c5eb9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:59.284476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26f53e5e-87d5-4d10-afe0-d80dbf0c5eb9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.285103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26f53e5e-87d5-4d10-afe0-d80dbf0c5eb9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.289861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26f53e5e-87d5-4d10-afe0-d80dbf0c5eb9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.290397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26f53e5e-87d5-4d10-afe0-d80dbf0c5eb9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.292175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9d2ea73e-c214-4860-b291-5f5ad0af6cfb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:59.303988 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9d2ea73e-c214-4860-b291-5f5ad0af6cfb tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1476 microversion: 2.1 time: 0.372830 Jan 22 21:09:59.306454 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1651/3449] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:58 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1476 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:09:59.314378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-082aec4a-3bcf-4f36-8bea-ebf43c052436 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:59.315367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-082aec4a-3bcf-4f36-8bea-ebf43c052436 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:59.322953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-082aec4a-3bcf-4f36-8bea-ebf43c052436 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.323468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-082aec4a-3bcf-4f36-8bea-ebf43c052436 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.324508 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-082aec4a-3bcf-4f36-8bea-ebf43c052436 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.324956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-082aec4a-3bcf-4f36-8bea-ebf43c052436 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.392675 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-082aec4a-3bcf-4f36-8bea-ebf43c052436 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.081597 Jan 22 21:09:59.393154 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1652/3450] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:59 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:09:59.400951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f5552d68-2350-4948-9e4e-b2cb5ee8a0c5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:59.401693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f5552d68-2350-4948-9e4e-b2cb5ee8a0c5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:59.409941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5552d68-2350-4948-9e4e-b2cb5ee8a0c5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.409941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5552d68-2350-4948-9e4e-b2cb5ee8a0c5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.410477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5552d68-2350-4948-9e4e-b2cb5ee8a0c5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.410923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5552d68-2350-4948-9e4e-b2cb5ee8a0c5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.435649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-26f53e5e-87d5-4d10-afe0-d80dbf0c5eb9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:59.455105 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-26f53e5e-87d5-4d10-afe0-d80dbf0c5eb9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1271 microversion: 2.1 time: 0.210437 Jan 22 21:09:59.466634 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1799/3451] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:59 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:59.472170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-237c1b3f-31b6-4e45-a063-cd4d0349a7cc req-1dd453aa-9c72-4af0-8723-1d9ae515d908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eef2b3f-a335-4858-b070-58323035fc67", "name": "network-vif-deleted", "tag": "25c44702-051d-45ed-8fe0-3080819d71a3"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:59.482328 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:59.482328 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:09:59.509059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-237c1b3f-31b6-4e45-a063-cd4d0349a7cc req-1dd453aa-9c72-4af0-8723-1d9ae515d908 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.509611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-237c1b3f-31b6-4e45-a063-cd4d0349a7cc req-1dd453aa-9c72-4af0-8723-1d9ae515d908 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.532575 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-237c1b3f-31b6-4e45-a063-cd4d0349a7cc req-1dd453aa-9c72-4af0-8723-1d9ae515d908 service nova] Creating event network-vif-deleted:25c44702-051d-45ed-8fe0-3080819d71a3 for instance 7eef2b3f-a335-4858-b070-58323035fc67 on nch1-master-1 Jan 22 21:09:59.557478 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-237c1b3f-31b6-4e45-a063-cd4d0349a7cc req-1dd453aa-9c72-4af0-8723-1d9ae515d908 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088411 Jan 22 21:09:59.560738 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1800/3452] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:59.569716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-43c57ca2-f762-4385-badb-fbb47ed7a746 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:59.570675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-43c57ca2-f762-4385-badb-fbb47ed7a746 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:59.584990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43c57ca2-f762-4385-badb-fbb47ed7a746 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.585458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43c57ca2-f762-4385-badb-fbb47ed7a746 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.586708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43c57ca2-f762-4385-badb-fbb47ed7a746 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.587642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43c57ca2-f762-4385-badb-fbb47ed7a746 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.801576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f5552d68-2350-4948-9e4e-b2cb5ee8a0c5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:09:59.810422 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f5552d68-2350-4948-9e4e-b2cb5ee8a0c5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.415977 Jan 22 21:09:59.811018 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1653/3453] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:59 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:09:59.845938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-bd5e0ebf-da6e-4ac9-900b-a4fe8e946122 req-ca69dc66-150d-46b7-9afc-b5f4d8e1df2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928ef427-4b8d-4fb6-b1ff-9b99172cf1b8", "name": "network-vif-unplugged", "status": "completed", "tag": "185dedd3-23dc-46aa-9214-659f5ce5e4f5"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:59.850261 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:09:59.850261 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:09:59.862526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bd5e0ebf-da6e-4ac9-900b-a4fe8e946122 req-ca69dc66-150d-46b7-9afc-b5f4d8e1df2a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.865042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bd5e0ebf-da6e-4ac9-900b-a4fe8e946122 req-ca69dc66-150d-46b7-9afc-b5f4d8e1df2a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.880776 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-bd5e0ebf-da6e-4ac9-900b-a4fe8e946122 req-ca69dc66-150d-46b7-9afc-b5f4d8e1df2a service nova] Creating event network-vif-unplugged:185dedd3-23dc-46aa-9214-659f5ce5e4f5 for instance 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 on nch1-master-1 Jan 22 21:09:59.891570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-bd5e0ebf-da6e-4ac9-900b-a4fe8e946122 req-ca69dc66-150d-46b7-9afc-b5f4d8e1df2a service nova] Instance 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:09:59.903224 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-bd5e0ebf-da6e-4ac9-900b-a4fe8e946122 req-ca69dc66-150d-46b7-9afc-b5f4d8e1df2a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088153 Jan 22 21:09:59.905138 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1654/3454] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:09:59.912134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-78833bc6-39af-467e-9c02-9e81d845d55e tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:09:59.914205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-78833bc6-39af-467e-9c02-9e81d845d55e tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] [instance: 5c84a8ac-7a1b-4081-bc57-ab560dc077f1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:59.927788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78833bc6-39af-467e-9c02-9e81d845d55e tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.928748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78833bc6-39af-467e-9c02-9e81d845d55e tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.929981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78833bc6-39af-467e-9c02-9e81d845d55e tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.930645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78833bc6-39af-467e-9c02-9e81d845d55e tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.951244 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-78833bc6-39af-467e-9c02-9e81d845d55e tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] HTTP exception thrown: Instance 5c84a8ac-7a1b-4081-bc57-ab560dc077f1 could not be found. Jan 22 21:09:59.952000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-78833bc6-39af-467e-9c02-9e81d845d55e tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] Returning 404 to user: Instance 5c84a8ac-7a1b-4081-bc57-ab560dc077f1 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:09:59.954079 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-78833bc6-39af-467e-9c02-9e81d845d55e tempest-ServerAddressesTestJSON-383611778 tempest-ServerAddressesTestJSON-383611778-project] 10.222.0.100 "GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1" status: 404 len: 111 microversion: 2.1 time: 0.046783 Jan 22 21:09:59.955069 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1655/3455] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:59 2022] GET /compute/v2.1/servers/5c84a8ac-7a1b-4081-bc57-ab560dc077f1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:09:59.962216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-203e3ec0-b174-4ea7-8cdf-d35c75f446db tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:09:59.962868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-203e3ec0-b174-4ea7-8cdf-d35c75f446db tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:09:59.972171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203e3ec0-b174-4ea7-8cdf-d35c75f446db tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.972171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203e3ec0-b174-4ea7-8cdf-d35c75f446db tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:09:59.974789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203e3ec0-b174-4ea7-8cdf-d35c75f446db tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:09:59.975696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203e3ec0-b174-4ea7-8cdf-d35c75f446db tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:00.005552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-203e3ec0-b174-4ea7-8cdf-d35c75f446db tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lazy-loading 'flavor' on Instance uuid 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:10:00.023374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-43c57ca2-f762-4385-badb-fbb47ed7a746 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:00.029717 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-43c57ca2-f762-4385-badb-fbb47ed7a746 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1477 microversion: 2.1 time: 0.466853 Jan 22 21:10:00.042184 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1801/3456] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:09:59 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1477 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:00.255247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2605fc5f-be99-48c9-87b3-dd6b77a5b4fb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:00.256313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2605fc5f-be99-48c9-87b3-dd6b77a5b4fb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:00.262421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2605fc5f-be99-48c9-87b3-dd6b77a5b4fb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:00.262887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2605fc5f-be99-48c9-87b3-dd6b77a5b4fb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:00.263693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2605fc5f-be99-48c9-87b3-dd6b77a5b4fb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:00.264145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2605fc5f-be99-48c9-87b3-dd6b77a5b4fb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:00.307644 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2605fc5f-be99-48c9-87b3-dd6b77a5b4fb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.056062 Jan 22 21:10:00.308310 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1802/3457] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:00 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:00.322808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-76205b0e-705c-4598-9792-14a79606fa22 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:00.327728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-76205b0e-705c-4598-9792-14a79606fa22 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:00.338416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76205b0e-705c-4598-9792-14a79606fa22 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:00.339249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76205b0e-705c-4598-9792-14a79606fa22 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:00.340283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76205b0e-705c-4598-9792-14a79606fa22 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:00.340812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76205b0e-705c-4598-9792-14a79606fa22 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:00.387353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76205b0e-705c-4598-9792-14a79606fa22 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:00.388119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76205b0e-705c-4598-9792-14a79606fa22 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:00.388824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-76205b0e-705c-4598-9792-14a79606fa22 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lazy-loading 'fault' on Instance uuid 7eef2b3f-a335-4858-b070-58323035fc67 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:10:00.476943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-76205b0e-705c-4598-9792-14a79606fa22 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9563c1341fd64da5855a2f0e72086d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e6094793b214ae7af6611b1571cac3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:00.490058 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-76205b0e-705c-4598-9792-14a79606fa22 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 200 len: 1310 microversion: 2.1 time: 0.171098 Jan 22 21:10:00.490855 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1803/3458] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:00 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 1310 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:00.507566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e51f73fa-6a5c-4391-8ecc-eb346221597f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:00.508562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e51f73fa-6a5c-4391-8ecc-eb346221597f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:00.515905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51f73fa-6a5c-4391-8ecc-eb346221597f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:00.516369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51f73fa-6a5c-4391-8ecc-eb346221597f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:00.517186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51f73fa-6a5c-4391-8ecc-eb346221597f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:00.517738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51f73fa-6a5c-4391-8ecc-eb346221597f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:00.600001 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e51f73fa-6a5c-4391-8ecc-eb346221597f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.095559 Jan 22 21:10:00.606402 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1804/3459] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:00 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:00.616740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-600134d2-093a-4200-9540-07101f86bdca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:00.616740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-600134d2-093a-4200-9540-07101f86bdca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:00.622227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-600134d2-093a-4200-9540-07101f86bdca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:00.622883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-600134d2-093a-4200-9540-07101f86bdca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:00.624729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-600134d2-093a-4200-9540-07101f86bdca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:00.625588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-600134d2-093a-4200-9540-07101f86bdca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:00.801565 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-203e3ec0-b174-4ea7-8cdf-d35c75f446db tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action" status: 202 len: 0 microversion: 2.1 time: 0.842150 Jan 22 21:10:00.801565 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1656/3460] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:09:59 2022] POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action => generated 0 bytes in 845 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:00.823604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-52652138-8954-4b6f-b5a0-2984c39dbf11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:00.823793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-52652138-8954-4b6f-b5a0-2984c39dbf11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:00.830716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52652138-8954-4b6f-b5a0-2984c39dbf11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:00.831178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52652138-8954-4b6f-b5a0-2984c39dbf11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:00.832554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52652138-8954-4b6f-b5a0-2984c39dbf11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:00.832736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52652138-8954-4b6f-b5a0-2984c39dbf11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:00.883642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-600134d2-093a-4200-9540-07101f86bdca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:00.893141 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-600134d2-093a-4200-9540-07101f86bdca tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1313 microversion: 2.1 time: 0.285278 Jan 22 21:10:00.894423 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1805/3461] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:00 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:01.050563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dff61403-7026-42e9-84e3-8e638bcd905f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:01.051801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dff61403-7026-42e9-84e3-8e638bcd905f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:01.058504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dff61403-7026-42e9-84e3-8e638bcd905f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:01.058970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dff61403-7026-42e9-84e3-8e638bcd905f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:01.059750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dff61403-7026-42e9-84e3-8e638bcd905f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:01.060199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dff61403-7026-42e9-84e3-8e638bcd905f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:01.163730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-52652138-8954-4b6f-b5a0-2984c39dbf11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:01.172184 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-52652138-8954-4b6f-b5a0-2984c39dbf11 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1515 microversion: 2.1 time: 0.366360 Jan 22 21:10:01.175295 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1657/3462] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:00 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1515 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:01.259909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dff61403-7026-42e9-84e3-8e638bcd905f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:01.270968 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dff61403-7026-42e9-84e3-8e638bcd905f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1477 microversion: 2.1 time: 0.226254 Jan 22 21:10:01.281175 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1806/3463] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:01 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1477 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:01.320710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-557f87c8-1bf7-4c10-bb6d-9d3d5912fdc3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:01.322364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-557f87c8-1bf7-4c10-bb6d-9d3d5912fdc3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:01.333757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-557f87c8-1bf7-4c10-bb6d-9d3d5912fdc3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:01.334561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-557f87c8-1bf7-4c10-bb6d-9d3d5912fdc3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:01.335521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-557f87c8-1bf7-4c10-bb6d-9d3d5912fdc3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:01.336135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-557f87c8-1bf7-4c10-bb6d-9d3d5912fdc3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:01.382434 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-557f87c8-1bf7-4c10-bb6d-9d3d5912fdc3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.066100 Jan 22 21:10:01.384335 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1658/3464] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:01 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:10:01.508096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9bfe82f3-ecf1-4744-a0e5-7102bb47d7e9 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:01.508717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9bfe82f3-ecf1-4744-a0e5-7102bb47d7e9 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] [instance: 7eef2b3f-a335-4858-b070-58323035fc67] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:01.515939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bfe82f3-ecf1-4744-a0e5-7102bb47d7e9 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:01.516493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bfe82f3-ecf1-4744-a0e5-7102bb47d7e9 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:01.517357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bfe82f3-ecf1-4744-a0e5-7102bb47d7e9 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:01.518079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bfe82f3-ecf1-4744-a0e5-7102bb47d7e9 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:01.533003 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-9bfe82f3-ecf1-4744-a0e5-7102bb47d7e9 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] HTTP exception thrown: Instance 7eef2b3f-a335-4858-b070-58323035fc67 could not be found. Jan 22 21:10:01.533766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9bfe82f3-ecf1-4744-a0e5-7102bb47d7e9 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] Returning 404 to user: Instance 7eef2b3f-a335-4858-b070-58323035fc67 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:10:01.534974 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9bfe82f3-ecf1-4744-a0e5-7102bb47d7e9 tempest-ServersOnMultiNodesTest-1460334098 tempest-ServersOnMultiNodesTest-1460334098-project] 10.222.0.100 "GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67" status: 404 len: 111 microversion: 2.1 time: 0.030622 Jan 22 21:10:01.535759 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1807/3465] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:01 2022] GET /compute/v2.1/servers/7eef2b3f-a335-4858-b070-58323035fc67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:10:01.603449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-6bba7476-5f69-41a5-948f-e88fb8939bfe req-3cb7ca32-ecfd-4d5e-8d24-23b8e007a922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b638a02-13d3-4b01-bd61-47787c7db9dc", "tag": "59474f75-ffd6-4371-a954-34c04724b3c0"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:01.603449 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:01.603449 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:10:01.610323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6bba7476-5f69-41a5-948f-e88fb8939bfe req-3cb7ca32-ecfd-4d5e-8d24-23b8e007a922 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:01.610975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6bba7476-5f69-41a5-948f-e88fb8939bfe req-3cb7ca32-ecfd-4d5e-8d24-23b8e007a922 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:01.616200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab6faa0f-42c9-4419-b490-dbdd2a922685 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:01.617163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ab6faa0f-42c9-4419-b490-dbdd2a922685 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:01.624462 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-6bba7476-5f69-41a5-948f-e88fb8939bfe req-3cb7ca32-ecfd-4d5e-8d24-23b8e007a922 service nova] Creating event network-changed:59474f75-ffd6-4371-a954-34c04724b3c0 for instance 8b638a02-13d3-4b01-bd61-47787c7db9dc on nch1-master-1 Jan 22 21:10:01.626728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab6faa0f-42c9-4419-b490-dbdd2a922685 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:01.627200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab6faa0f-42c9-4419-b490-dbdd2a922685 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:01.628771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab6faa0f-42c9-4419-b490-dbdd2a922685 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:01.629411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab6faa0f-42c9-4419-b490-dbdd2a922685 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:01.630159 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-6bba7476-5f69-41a5-948f-e88fb8939bfe req-3cb7ca32-ecfd-4d5e-8d24-23b8e007a922 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034720 Jan 22 21:10:01.630901 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1659/3466] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:10:01.677296 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab6faa0f-42c9-4419-b490-dbdd2a922685 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.068742 Jan 22 21:10:01.678390 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1808/3467] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:01 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:10:01.919431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d7d7d53b-7c0b-43fb-9a89-a665904e5ae1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:01.920249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d7d7d53b-7c0b-43fb-9a89-a665904e5ae1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:01.939167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7d7d53b-7c0b-43fb-9a89-a665904e5ae1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:01.940948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7d7d53b-7c0b-43fb-9a89-a665904e5ae1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:01.942292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7d7d53b-7c0b-43fb-9a89-a665904e5ae1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:01.944066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7d7d53b-7c0b-43fb-9a89-a665904e5ae1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:02.192212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-99bb8497-652c-414f-afa5-e9fab670358f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:02.193308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-99bb8497-652c-414f-afa5-e9fab670358f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:02.200478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99bb8497-652c-414f-afa5-e9fab670358f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:02.201437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99bb8497-652c-414f-afa5-e9fab670358f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:02.210494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99bb8497-652c-414f-afa5-e9fab670358f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:02.210994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99bb8497-652c-414f-afa5-e9fab670358f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:02.445102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-99bb8497-652c-414f-afa5-e9fab670358f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:02.454860 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-99bb8497-652c-414f-afa5-e9fab670358f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1515 microversion: 2.1 time: 0.266782 Jan 22 21:10:02.456075 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1809/3468] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:02 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1515 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:02.460593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-890f50cd-dc08-4fd9-8603-c5509860560b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:02.461208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-890f50cd-dc08-4fd9-8603-c5509860560b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:02.467281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-890f50cd-dc08-4fd9-8603-c5509860560b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:02.468557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-890f50cd-dc08-4fd9-8603-c5509860560b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:02.469597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-890f50cd-dc08-4fd9-8603-c5509860560b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:02.470055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-890f50cd-dc08-4fd9-8603-c5509860560b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:02.630634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d7d7d53b-7c0b-43fb-9a89-a665904e5ae1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:02.643516 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d7d7d53b-7c0b-43fb-9a89-a665904e5ae1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1313 microversion: 2.1 time: 0.734357 Jan 22 21:10:02.645661 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1660/3469] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:01 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1313 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:02.651859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-49cd4d0f-4808-4d00-8d38-d8455bb996c4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:02.652973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-49cd4d0f-4808-4d00-8d38-d8455bb996c4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:02.670462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49cd4d0f-4808-4d00-8d38-d8455bb996c4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:02.671616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49cd4d0f-4808-4d00-8d38-d8455bb996c4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:02.672795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49cd4d0f-4808-4d00-8d38-d8455bb996c4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:02.673427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49cd4d0f-4808-4d00-8d38-d8455bb996c4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:02.678235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-890f50cd-dc08-4fd9-8603-c5509860560b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:02.688933 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-890f50cd-dc08-4fd9-8603-c5509860560b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1474 microversion: 2.1 time: 0.231972 Jan 22 21:10:02.689873 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1810/3470] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:02 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1474 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:02.707146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f876c291-2fc9-4edb-9c7b-6ad50a44b84f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:02.708198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f876c291-2fc9-4edb-9c7b-6ad50a44b84f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:02.714548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f876c291-2fc9-4edb-9c7b-6ad50a44b84f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:02.715009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f876c291-2fc9-4edb-9c7b-6ad50a44b84f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:02.715818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f876c291-2fc9-4edb-9c7b-6ad50a44b84f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:02.716478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f876c291-2fc9-4edb-9c7b-6ad50a44b84f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:02.722794 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-49cd4d0f-4808-4d00-8d38-d8455bb996c4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.074982 Jan 22 21:10:02.725907 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1661/3471] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:02 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:02.731857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-21a04f16-2ea1-4141-8e0a-ba2136142156 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:02.734003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-21a04f16-2ea1-4141-8e0a-ba2136142156 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:02.742364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21a04f16-2ea1-4141-8e0a-ba2136142156 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:02.742902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21a04f16-2ea1-4141-8e0a-ba2136142156 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:02.743800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21a04f16-2ea1-4141-8e0a-ba2136142156 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:02.744601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21a04f16-2ea1-4141-8e0a-ba2136142156 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:02.771121 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f876c291-2fc9-4edb-9c7b-6ad50a44b84f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.069988 Jan 22 21:10:02.771872 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1811/3472] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:02 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:02.987957 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-21a04f16-2ea1-4141-8e0a-ba2136142156 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "POST /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8/action" status: 204 len: 0 microversion: 2.1 time: 0.259988 Jan 22 21:10:02.989656 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1662/3473] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:02 2022] POST /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8/action => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:10:03.009652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ee4fdd98-e2a5-4a23-8cc4-798e74121c50 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:03.014062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ee4fdd98-e2a5-4a23-8cc4-798e74121c50 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:03.029810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee4fdd98-e2a5-4a23-8cc4-798e74121c50 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:03.030505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee4fdd98-e2a5-4a23-8cc4-798e74121c50 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:03.033292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee4fdd98-e2a5-4a23-8cc4-798e74121c50 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:03.033919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee4fdd98-e2a5-4a23-8cc4-798e74121c50 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:03.253628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ee4fdd98-e2a5-4a23-8cc4-798e74121c50 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:03.266507 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ee4fdd98-e2a5-4a23-8cc4-798e74121c50 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1474 microversion: 2.1 time: 0.272438 Jan 22 21:10:03.277043 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1812/3474] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:02 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1474 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:03.474841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f6f6c7c6-a5f1-41c5-b501-b3fc75b52103 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:03.475800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f6f6c7c6-a5f1-41c5-b501-b3fc75b52103 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:03.489852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6f6c7c6-a5f1-41c5-b501-b3fc75b52103 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:03.490498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6f6c7c6-a5f1-41c5-b501-b3fc75b52103 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:03.495449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6f6c7c6-a5f1-41c5-b501-b3fc75b52103 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:03.495962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6f6c7c6-a5f1-41c5-b501-b3fc75b52103 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:03.660980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c82819a3-258c-47dc-856b-689b4f0cb935 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:03.662614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c82819a3-258c-47dc-856b-689b4f0cb935 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:03.681626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c82819a3-258c-47dc-856b-689b4f0cb935 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:03.682402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c82819a3-258c-47dc-856b-689b4f0cb935 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:03.683657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c82819a3-258c-47dc-856b-689b4f0cb935 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:03.685005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c82819a3-258c-47dc-856b-689b4f0cb935 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:03.886733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f6f6c7c6-a5f1-41c5-b501-b3fc75b52103 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:03.900426 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f6f6c7c6-a5f1-41c5-b501-b3fc75b52103 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1515 microversion: 2.1 time: 0.430080 Jan 22 21:10:03.901398 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1663/3475] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:03 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1515 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:03.909318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e37c3bda-e73c-4b7f-9717-2a9bd4b04319 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:03.911535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e37c3bda-e73c-4b7f-9717-2a9bd4b04319 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:03.923018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e37c3bda-e73c-4b7f-9717-2a9bd4b04319 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:03.923701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e37c3bda-e73c-4b7f-9717-2a9bd4b04319 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:03.925638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e37c3bda-e73c-4b7f-9717-2a9bd4b04319 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:03.929064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e37c3bda-e73c-4b7f-9717-2a9bd4b04319 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:03.975868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c82819a3-258c-47dc-856b-689b4f0cb935 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:03.993351 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c82819a3-258c-47dc-856b-689b4f0cb935 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1313 microversion: 2.1 time: 0.336781 Jan 22 21:10:03.997846 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1813/3476] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:03 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:04.004437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-845a1c2e-b5a4-406e-9112-0579ea5f5293 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:04.005880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-845a1c2e-b5a4-406e-9112-0579ea5f5293 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:04.024304 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e37c3bda-e73c-4b7f-9717-2a9bd4b04319 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.120678 Jan 22 21:10:04.026032 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1664/3477] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:03 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:04.033025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-845a1c2e-b5a4-406e-9112-0579ea5f5293 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:04.033994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-845a1c2e-b5a4-406e-9112-0579ea5f5293 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:04.034977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-845a1c2e-b5a4-406e-9112-0579ea5f5293 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:04.036001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-845a1c2e-b5a4-406e-9112-0579ea5f5293 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:04.094925 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-845a1c2e-b5a4-406e-9112-0579ea5f5293 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.094729 Jan 22 21:10:04.096076 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1814/3478] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:03 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:04.285256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-00e9b340-2c0e-4884-9a1e-9f02429c0632 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:04.286003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-00e9b340-2c0e-4884-9a1e-9f02429c0632 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:04.302499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00e9b340-2c0e-4884-9a1e-9f02429c0632 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:04.303265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00e9b340-2c0e-4884-9a1e-9f02429c0632 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:04.304079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00e9b340-2c0e-4884-9a1e-9f02429c0632 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:04.304528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00e9b340-2c0e-4884-9a1e-9f02429c0632 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:04.624328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-00e9b340-2c0e-4884-9a1e-9f02429c0632 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:04.634205 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-00e9b340-2c0e-4884-9a1e-9f02429c0632 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1474 microversion: 2.1 time: 0.350892 Jan 22 21:10:04.643194 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1665/3479] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:04 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1474 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:04.918514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8902f874-bbb9-4cc6-8c39-b8524f6f7446 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:04.919420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8902f874-bbb9-4cc6-8c39-b8524f6f7446 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:04.927886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8902f874-bbb9-4cc6-8c39-b8524f6f7446 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:04.928458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8902f874-bbb9-4cc6-8c39-b8524f6f7446 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:04.935777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8902f874-bbb9-4cc6-8c39-b8524f6f7446 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:04.938685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8902f874-bbb9-4cc6-8c39-b8524f6f7446 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:05.014041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-981aff72-cf83-46bc-b8f5-668e0908480b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:05.016874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-981aff72-cf83-46bc-b8f5-668e0908480b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:05.028985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-981aff72-cf83-46bc-b8f5-668e0908480b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:05.030698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-981aff72-cf83-46bc-b8f5-668e0908480b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:05.031950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-981aff72-cf83-46bc-b8f5-668e0908480b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:05.032547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-981aff72-cf83-46bc-b8f5-668e0908480b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:05.168054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8902f874-bbb9-4cc6-8c39-b8524f6f7446 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:05.176011 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8902f874-bbb9-4cc6-8c39-b8524f6f7446 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1515 microversion: 2.1 time: 0.261475 Jan 22 21:10:05.177003 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1815/3480] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:04 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1515 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:05.179357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-981aff72-cf83-46bc-b8f5-668e0908480b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:05.181742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6f31a2b-f012-4eb1-ab89-ca51d4d46133 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:05.182801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b6f31a2b-f012-4eb1-ab89-ca51d4d46133 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:05.187813 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-981aff72-cf83-46bc-b8f5-668e0908480b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1313 microversion: 2.1 time: 0.177384 Jan 22 21:10:05.188468 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1666/3481] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:05 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:05.189652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6f31a2b-f012-4eb1-ab89-ca51d4d46133 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:05.190200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6f31a2b-f012-4eb1-ab89-ca51d4d46133 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:05.191098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6f31a2b-f012-4eb1-ab89-ca51d4d46133 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:05.191620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6f31a2b-f012-4eb1-ab89-ca51d4d46133 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:05.193411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-726324cb-d61c-4eb6-8281-d0860fbe1494 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:05.194605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-726324cb-d61c-4eb6-8281-d0860fbe1494 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:05.200352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-726324cb-d61c-4eb6-8281-d0860fbe1494 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:05.200806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-726324cb-d61c-4eb6-8281-d0860fbe1494 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:05.201611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-726324cb-d61c-4eb6-8281-d0860fbe1494 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:05.202603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-726324cb-d61c-4eb6-8281-d0860fbe1494 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:05.236828 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b6f31a2b-f012-4eb1-ab89-ca51d4d46133 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.058484 Jan 22 21:10:05.237515 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1816/3482] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:05 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:05.247610 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-726324cb-d61c-4eb6-8281-d0860fbe1494 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.057817 Jan 22 21:10:05.248269 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1667/3483] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:05 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:05.586584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5bfc4ea6-155e-454c-88f0-0730687cc838 req-b15d5833-4ad3-4992-9e7a-b5a61bdb1986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928ef427-4b8d-4fb6-b1ff-9b99172cf1b8", "name": "network-vif-plugged", "status": "completed", "tag": "185dedd3-23dc-46aa-9214-659f5ce5e4f5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:05.588107 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:05.588107 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:10:05.597179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5bfc4ea6-155e-454c-88f0-0730687cc838 req-b15d5833-4ad3-4992-9e7a-b5a61bdb1986 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:05.597673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5bfc4ea6-155e-454c-88f0-0730687cc838 req-b15d5833-4ad3-4992-9e7a-b5a61bdb1986 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:05.610151 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5bfc4ea6-155e-454c-88f0-0730687cc838 req-b15d5833-4ad3-4992-9e7a-b5a61bdb1986 service nova] Creating event network-vif-plugged:185dedd3-23dc-46aa-9214-659f5ce5e4f5 for instance 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 on nch1-master-1 Jan 22 21:10:05.615565 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-5bfc4ea6-155e-454c-88f0-0730687cc838 req-b15d5833-4ad3-4992-9e7a-b5a61bdb1986 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034646 Jan 22 21:10:05.616539 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1817/3484] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:10:05.650386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-68b627dd-2eb0-4609-bb15-900192625187 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:05.651374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-68b627dd-2eb0-4609-bb15-900192625187 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:05.665006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68b627dd-2eb0-4609-bb15-900192625187 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:05.667672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68b627dd-2eb0-4609-bb15-900192625187 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:05.669995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68b627dd-2eb0-4609-bb15-900192625187 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:05.670807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68b627dd-2eb0-4609-bb15-900192625187 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:05.884407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-68b627dd-2eb0-4609-bb15-900192625187 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:05.892765 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-68b627dd-2eb0-4609-bb15-900192625187 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1466 microversion: 2.1 time: 0.246290 Jan 22 21:10:05.893355 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1668/3485] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:05 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1466 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:05.911278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1459b15e-e33d-4328-958f-52e2e6d72ffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:05.912185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1459b15e-e33d-4328-958f-52e2e6d72ffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:05.919478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1459b15e-e33d-4328-958f-52e2e6d72ffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:05.920140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1459b15e-e33d-4328-958f-52e2e6d72ffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:05.921048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1459b15e-e33d-4328-958f-52e2e6d72ffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:05.921695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1459b15e-e33d-4328-958f-52e2e6d72ffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:06.192595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8372e708-6ff4-42ed-bd79-13a36f1078eb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:06.193216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8372e708-6ff4-42ed-bd79-13a36f1078eb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:06.200498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8372e708-6ff4-42ed-bd79-13a36f1078eb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:06.201165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8372e708-6ff4-42ed-bd79-13a36f1078eb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:06.202757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8372e708-6ff4-42ed-bd79-13a36f1078eb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:06.203382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8372e708-6ff4-42ed-bd79-13a36f1078eb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:06.401075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1459b15e-e33d-4328-958f-52e2e6d72ffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:06.410408 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1459b15e-e33d-4328-958f-52e2e6d72ffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1466 microversion: 2.1 time: 0.503901 Jan 22 21:10:06.413558 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1818/3486] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:05 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1466 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:06.419598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3dc0d754-5ca9-47c8-817f-1e05aa434210 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:06.421946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3dc0d754-5ca9-47c8-817f-1e05aa434210 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:06.429450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dc0d754-5ca9-47c8-817f-1e05aa434210 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:06.430062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dc0d754-5ca9-47c8-817f-1e05aa434210 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:06.431019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dc0d754-5ca9-47c8-817f-1e05aa434210 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:06.431571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dc0d754-5ca9-47c8-817f-1e05aa434210 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:06.432985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8372e708-6ff4-42ed-bd79-13a36f1078eb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:06.445648 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8372e708-6ff4-42ed-bd79-13a36f1078eb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1515 microversion: 2.1 time: 0.255071 Jan 22 21:10:06.446841 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1669/3487] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:06 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1515 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:06.453578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eed8f922-acc8-40ad-8ef0-78f5888fd13d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:06.460270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eed8f922-acc8-40ad-8ef0-78f5888fd13d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:06.467279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eed8f922-acc8-40ad-8ef0-78f5888fd13d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:06.467922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eed8f922-acc8-40ad-8ef0-78f5888fd13d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:06.468958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eed8f922-acc8-40ad-8ef0-78f5888fd13d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:06.469589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eed8f922-acc8-40ad-8ef0-78f5888fd13d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:06.515905 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eed8f922-acc8-40ad-8ef0-78f5888fd13d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.067181 Jan 22 21:10:06.516558 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1670/3488] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:06 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:06.521586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2135f582-eac1-43b8-a3fb-7ba157466ff7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:06.522594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2135f582-eac1-43b8-a3fb-7ba157466ff7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:06.529523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2135f582-eac1-43b8-a3fb-7ba157466ff7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:06.530616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2135f582-eac1-43b8-a3fb-7ba157466ff7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:06.531662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2135f582-eac1-43b8-a3fb-7ba157466ff7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:06.532185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2135f582-eac1-43b8-a3fb-7ba157466ff7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:06.571634 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2135f582-eac1-43b8-a3fb-7ba157466ff7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.053639 Jan 22 21:10:06.572285 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1671/3489] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:06 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:06.577774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ffb98d5b-8a68-433f-9288-0928b7aabf30 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Calling method '.version_select at 0x7f1edae7fee0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:06.579030 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:06.579030 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:10:06.580445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffb98d5b-8a68-433f-9288-0928b7aabf30 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:06.580919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffb98d5b-8a68-433f-9288-0928b7aabf30 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:06.589263 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ffb98d5b-8a68-433f-9288-0928b7aabf30 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] 10.222.0.100 "GET /compute/v2.1/os-migrations" status: 200 len: 804 microversion: 2.1 time: 0.015855 Jan 22 21:10:06.590186 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1672/3490] 10.222.0.100 () {58 vars in 1147 bytes} [Sat Jan 22 21:10:06 2022] GET /compute/v2.1/os-migrations => generated 804 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:10:06.612111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-526920fa-d7b3-4437-9dbe-5aa8eb797c76 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:06.621379 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-526920fa-d7b3-4437-9dbe-5aa8eb797c76 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.013108 Jan 22 21:10:06.622313 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1673/3491] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:10:06 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:10:06.638469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-77e2b1f5-fe71-4699-8500-1273f206d32b tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-832722169", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:06.640745 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:06.640745 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:10:06.685000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3dc0d754-5ca9-47c8-817f-1e05aa434210 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:06.694294 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3dc0d754-5ca9-47c8-817f-1e05aa434210 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1313 microversion: 2.1 time: 0.278409 Jan 22 21:10:06.695156 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1819/3492] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:06 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:06.835808 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-77e2b1f5-fe71-4699-8500-1273f206d32b tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 500 microversion: 2.1 time: 0.206739 Jan 22 21:10:06.836255 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1674/3493] 10.222.0.100 () {60 vars in 1150 bytes} [Sat Jan 22 21:10:06 2022] POST /compute/v2.1/flavors => generated 500 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:10:06.847089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-34b4b599-4137-479a-9421-199632fe36e4 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:06.856460 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-34b4b599-4137-479a-9421-199632fe36e4 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013873 Jan 22 21:10:06.857864 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1820/3494] 10.222.0.100 () {58 vars in 1186 bytes} [Sat Jan 22 21:10:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:10:06.992011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-514870570", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "2531b960-168c-4722-ae27-7b97abf976c9"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:07.046104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:10:07.291533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:10:07.292128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:10:07.292509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:10:07.292947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:10:07.293600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:10:07.304367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:07.304960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:07.305851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:07.308458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:07.330482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Getting quotas for project 80dba854f5414025a0cbf8b5d6571c42. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:10:07.336596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Getting quotas for user 7f8e9e562bd740e782568f539dac4744 and project 80dba854f5414025a0cbf8b5d6571c42. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:10:07.350506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:10:07.356245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:10:07.463643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d24543f1-ee3e-46a5-b231-9dc21bc86726 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:07.464432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d24543f1-ee3e-46a5-b231-9dc21bc86726 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:07.472506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d24543f1-ee3e-46a5-b231-9dc21bc86726 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:07.473079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d24543f1-ee3e-46a5-b231-9dc21bc86726 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:07.474014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d24543f1-ee3e-46a5-b231-9dc21bc86726 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:07.474564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d24543f1-ee3e-46a5-b231-9dc21bc86726 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:07.539372 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ce505310-9fe9-4b48-a4b3-0f62f8d80685 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.551553 Jan 22 21:10:07.541423 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1675/3495] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:10:06 2022] POST /compute/v2.1/servers => generated 382 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:10:07.549477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-36cd0ad8-797d-4375-be59-99ad1a331b29 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:07.549477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-36cd0ad8-797d-4375-be59-99ad1a331b29 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:07.583513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36cd0ad8-797d-4375-be59-99ad1a331b29 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:07.583983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36cd0ad8-797d-4375-be59-99ad1a331b29 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:07.584806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36cd0ad8-797d-4375-be59-99ad1a331b29 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:07.585247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36cd0ad8-797d-4375-be59-99ad1a331b29 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:07.658478 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-36cd0ad8-797d-4375-be59-99ad1a331b29 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.112423 Jan 22 21:10:07.659178 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1676/3496] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:07 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:07.666527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-067c7ac6-6fa0-4934-8588-931a1a34578d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:07.668805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-067c7ac6-6fa0-4934-8588-931a1a34578d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:07.752492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-067c7ac6-6fa0-4934-8588-931a1a34578d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:07.759727 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-067c7ac6-6fa0-4934-8588-931a1a34578d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1282 microversion: 2.1 time: 0.099367 Jan 22 21:10:07.770809 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1677/3497] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:07 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1282 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:07.775743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b4548ff6-437c-40ce-8f03-a0e9527fd739 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:07.776666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b4548ff6-437c-40ce-8f03-a0e9527fd739 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:07.785185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4548ff6-437c-40ce-8f03-a0e9527fd739 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:07.785688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4548ff6-437c-40ce-8f03-a0e9527fd739 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:07.786490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4548ff6-437c-40ce-8f03-a0e9527fd739 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:07.786930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4548ff6-437c-40ce-8f03-a0e9527fd739 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:07.838494 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b4548ff6-437c-40ce-8f03-a0e9527fd739 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.060325 Jan 22 21:10:07.838494 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1678/3498] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:07 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:07.851262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ba536696-d5ff-4b53-a025-aca74c68703f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:07.851871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ba536696-d5ff-4b53-a025-aca74c68703f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:07.886818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba536696-d5ff-4b53-a025-aca74c68703f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:07.886904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba536696-d5ff-4b53-a025-aca74c68703f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:07.890986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba536696-d5ff-4b53-a025-aca74c68703f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:07.890986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba536696-d5ff-4b53-a025-aca74c68703f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:07.955235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d24543f1-ee3e-46a5-b231-9dc21bc86726 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:07.964678 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d24543f1-ee3e-46a5-b231-9dc21bc86726 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1515 microversion: 2.1 time: 0.505024 Jan 22 21:10:07.978568 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1821/3499] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:07 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1515 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:07.994222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a9482ea7-8025-469f-94c7-247692a7f6ca req-c90046c8-4257-4134-9ba9-98b1cbb5b32b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b638a02-13d3-4b01-bd61-47787c7db9dc", "name": "network-vif-plugged", "status": "completed", "tag": "59474f75-ffd6-4371-a954-34c04724b3c0"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:07.994670 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:07.994670 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:10:08.005481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a9482ea7-8025-469f-94c7-247692a7f6ca req-c90046c8-4257-4134-9ba9-98b1cbb5b32b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:08.006391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a9482ea7-8025-469f-94c7-247692a7f6ca req-c90046c8-4257-4134-9ba9-98b1cbb5b32b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:08.030321 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a9482ea7-8025-469f-94c7-247692a7f6ca req-c90046c8-4257-4134-9ba9-98b1cbb5b32b service nova] Creating event network-vif-plugged:59474f75-ffd6-4371-a954-34c04724b3c0 for instance 8b638a02-13d3-4b01-bd61-47787c7db9dc on nch1-master-1 Jan 22 21:10:08.036989 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a9482ea7-8025-469f-94c7-247692a7f6ca req-c90046c8-4257-4134-9ba9-98b1cbb5b32b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056275 Jan 22 21:10:08.040491 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1822/3500] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:10:08.074365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ba536696-d5ff-4b53-a025-aca74c68703f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:08.084808 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ba536696-d5ff-4b53-a025-aca74c68703f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1313 microversion: 2.1 time: 0.246392 Jan 22 21:10:08.085820 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1679/3501] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:07 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:08.680940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e09d7938-b1d8-46e7-bba0-a5a8d0f4082a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:08.686751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e09d7938-b1d8-46e7-bba0-a5a8d0f4082a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:08.700304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e09d7938-b1d8-46e7-bba0-a5a8d0f4082a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:08.701066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e09d7938-b1d8-46e7-bba0-a5a8d0f4082a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:08.702678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e09d7938-b1d8-46e7-bba0-a5a8d0f4082a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:08.703296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e09d7938-b1d8-46e7-bba0-a5a8d0f4082a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:08.782425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee513d6a-cade-4013-b9cf-31687a0cca99 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:08.783718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ee513d6a-cade-4013-b9cf-31687a0cca99 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:08.788785 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e09d7938-b1d8-46e7-bba0-a5a8d0f4082a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.104294 Jan 22 21:10:08.790295 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1823/3502] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:08 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:08.847543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-874f74d6-5bd1-403a-a6b1-fdb6671601ad tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:08.849036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-874f74d6-5bd1-403a-a6b1-fdb6671601ad tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:08.858555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-874f74d6-5bd1-403a-a6b1-fdb6671601ad tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:08.861817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-874f74d6-5bd1-403a-a6b1-fdb6671601ad tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:08.861817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-874f74d6-5bd1-403a-a6b1-fdb6671601ad tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:08.861817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-874f74d6-5bd1-403a-a6b1-fdb6671601ad tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:08.942401 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-874f74d6-5bd1-403a-a6b1-fdb6671601ad tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.100326 Jan 22 21:10:08.943988 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1824/3503] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:08 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:08.976130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ee513d6a-cade-4013-b9cf-31687a0cca99 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:08.986347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-835bf801-6b68-42b0-9785-f6680b2d6ba5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:08.987677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-835bf801-6b68-42b0-9785-f6680b2d6ba5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:08.996169 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee513d6a-cade-4013-b9cf-31687a0cca99 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1282 microversion: 2.1 time: 0.219640 Jan 22 21:10:08.997023 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1680/3504] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:08 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1282 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:09.003858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-835bf801-6b68-42b0-9785-f6680b2d6ba5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:09.004604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-835bf801-6b68-42b0-9785-f6680b2d6ba5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:09.005443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-835bf801-6b68-42b0-9785-f6680b2d6ba5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:09.005918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-835bf801-6b68-42b0-9785-f6680b2d6ba5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:09.102995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1561fb8c-61c6-4409-b5f7-377a6e90bb2d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:09.104281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1561fb8c-61c6-4409-b5f7-377a6e90bb2d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:09.111363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1561fb8c-61c6-4409-b5f7-377a6e90bb2d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:09.112044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1561fb8c-61c6-4409-b5f7-377a6e90bb2d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:09.113203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1561fb8c-61c6-4409-b5f7-377a6e90bb2d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:09.114070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1561fb8c-61c6-4409-b5f7-377a6e90bb2d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:09.323329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1561fb8c-61c6-4409-b5f7-377a6e90bb2d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:09.337676 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1561fb8c-61c6-4409-b5f7-377a6e90bb2d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1313 microversion: 2.1 time: 0.235272 Jan 22 21:10:09.340280 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1681/3505] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:09 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:09.446321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-835bf801-6b68-42b0-9785-f6680b2d6ba5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:09.470357 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-835bf801-6b68-42b0-9785-f6680b2d6ba5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1515 microversion: 2.1 time: 0.474470 Jan 22 21:10:09.471799 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1825/3506] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:08 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1515 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:09.812742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ce5ea962-d8bb-4d5d-a5da-b935e1be0429 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:09.815301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ce5ea962-d8bb-4d5d-a5da-b935e1be0429 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:09.853219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce5ea962-d8bb-4d5d-a5da-b935e1be0429 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:09.854052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce5ea962-d8bb-4d5d-a5da-b935e1be0429 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:09.855078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce5ea962-d8bb-4d5d-a5da-b935e1be0429 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:09.857017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce5ea962-d8bb-4d5d-a5da-b935e1be0429 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:09.958223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0e2fe177-8d9f-41fe-8300-386c928e5578 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:09.960365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0e2fe177-8d9f-41fe-8300-386c928e5578 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:09.979463 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ce5ea962-d8bb-4d5d-a5da-b935e1be0429 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.178809 Jan 22 21:10:09.982432 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1682/3507] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:09 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:09.984606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e2fe177-8d9f-41fe-8300-386c928e5578 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:09.985555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e2fe177-8d9f-41fe-8300-386c928e5578 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:09.986942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e2fe177-8d9f-41fe-8300-386c928e5578 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:09.990925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e2fe177-8d9f-41fe-8300-386c928e5578 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:10.015689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c24cb4e5-2686-486d-9f62-a6ee986c27cb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:10.017106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c24cb4e5-2686-486d-9f62-a6ee986c27cb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:10.043330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c24cb4e5-2686-486d-9f62-a6ee986c27cb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:10.052742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c24cb4e5-2686-486d-9f62-a6ee986c27cb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:10.054386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c24cb4e5-2686-486d-9f62-a6ee986c27cb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:10.055016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c24cb4e5-2686-486d-9f62-a6ee986c27cb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:10.088278 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0e2fe177-8d9f-41fe-8300-386c928e5578 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.136890 Jan 22 21:10:10.089306 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1826/3508] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:09 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:10:10.229295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c24cb4e5-2686-486d-9f62-a6ee986c27cb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:10.247927 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c24cb4e5-2686-486d-9f62-a6ee986c27cb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1334 microversion: 2.1 time: 0.235732 Jan 22 21:10:10.257535 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1683/3509] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:10 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1334 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:10.367465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f099748f-056f-4af0-ae28-306decd3d55b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:10.368504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f099748f-056f-4af0-ae28-306decd3d55b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:10.381027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f099748f-056f-4af0-ae28-306decd3d55b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:10.381751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f099748f-056f-4af0-ae28-306decd3d55b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:10.392014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f099748f-056f-4af0-ae28-306decd3d55b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:10.393533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f099748f-056f-4af0-ae28-306decd3d55b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:10.490968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b785e706-7c99-4801-91dd-a3a5c25510ef tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:10.491606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b785e706-7c99-4801-91dd-a3a5c25510ef tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:10.515863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b785e706-7c99-4801-91dd-a3a5c25510ef tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:10.516327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b785e706-7c99-4801-91dd-a3a5c25510ef tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:10.517293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b785e706-7c99-4801-91dd-a3a5c25510ef tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:10.517835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b785e706-7c99-4801-91dd-a3a5c25510ef tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:11.339569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f099748f-056f-4af0-ae28-306decd3d55b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:11.355348 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f099748f-056f-4af0-ae28-306decd3d55b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1492 microversion: 2.1 time: 0.992639 Jan 22 21:10:11.356679 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1827/3510] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:10 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1492 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:11.369580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dc5e5ef6-301d-45c4-9090-a7c7cb3e2ec0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:11.371331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dc5e5ef6-301d-45c4-9090-a7c7cb3e2ec0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:11.383893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc5e5ef6-301d-45c4-9090-a7c7cb3e2ec0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:11.387992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc5e5ef6-301d-45c4-9090-a7c7cb3e2ec0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:11.395861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc5e5ef6-301d-45c4-9090-a7c7cb3e2ec0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:11.397829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc5e5ef6-301d-45c4-9090-a7c7cb3e2ec0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:11.479900 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dc5e5ef6-301d-45c4-9090-a7c7cb3e2ec0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.120470 Jan 22 21:10:11.480651 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1828/3511] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:11 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:11.488962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-be134f43-45c3-4005-830d-ce9953b08fd3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:11.490498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-be134f43-45c3-4005-830d-ce9953b08fd3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:11.509682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be134f43-45c3-4005-830d-ce9953b08fd3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:11.510355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be134f43-45c3-4005-830d-ce9953b08fd3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:11.511367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be134f43-45c3-4005-830d-ce9953b08fd3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:11.512244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be134f43-45c3-4005-830d-ce9953b08fd3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:11.564368 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-be134f43-45c3-4005-830d-ce9953b08fd3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.082108 Jan 22 21:10:11.565603 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1829/3512] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:11 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:11.571489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c17ee906-7636-4c59-8a28-62ee8dd8673c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:11.572325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c17ee906-7636-4c59-8a28-62ee8dd8673c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:11.580090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c17ee906-7636-4c59-8a28-62ee8dd8673c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:11.580626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c17ee906-7636-4c59-8a28-62ee8dd8673c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:11.581929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c17ee906-7636-4c59-8a28-62ee8dd8673c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:11.582379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c17ee906-7636-4c59-8a28-62ee8dd8673c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:11.655479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c17ee906-7636-4c59-8a28-62ee8dd8673c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:11.664103 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c17ee906-7636-4c59-8a28-62ee8dd8673c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1340 microversion: 2.1 time: 0.097250 Jan 22 21:10:11.664717 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1830/3513] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:11 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1340 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:11.679409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1035625075", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "ab49ab48-066e-4b21-9cb5-bee63c0067a9"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:11.766793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] validate_networks() for [('ab49ab48-066e-4b21-9cb5-bee63c0067a9', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:10:11.928541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b785e706-7c99-4801-91dd-a3a5c25510ef tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:11.987488 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b785e706-7c99-4801-91dd-a3a5c25510ef tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1515 microversion: 2.1 time: 1.500346 Jan 22 21:10:11.990240 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1684/3514] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:10 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1515 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:12.496356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-117b4a19-4697-4cb2-ab30-5bfd5a67cac4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:12.497725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-117b4a19-4697-4cb2-ab30-5bfd5a67cac4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:12.507933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-117b4a19-4697-4cb2-ab30-5bfd5a67cac4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:12.508379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-117b4a19-4697-4cb2-ab30-5bfd5a67cac4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:12.509354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-117b4a19-4697-4cb2-ab30-5bfd5a67cac4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:12.509963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-117b4a19-4697-4cb2-ab30-5bfd5a67cac4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:12.574154 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-117b4a19-4697-4cb2-ab30-5bfd5a67cac4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.083428 Jan 22 21:10:12.579831 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1685/3515] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:12 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:12.590439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eca132e1-db02-436c-998f-3ddb82ca820e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:12.594263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eca132e1-db02-436c-998f-3ddb82ca820e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:12.616639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eca132e1-db02-436c-998f-3ddb82ca820e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:12.617302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eca132e1-db02-436c-998f-3ddb82ca820e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:12.618372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eca132e1-db02-436c-998f-3ddb82ca820e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:12.619441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eca132e1-db02-436c-998f-3ddb82ca820e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:12.676152 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eca132e1-db02-436c-998f-3ddb82ca820e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.094150 Jan 22 21:10:12.682755 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1686/3516] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:12 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:12.698912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8990558d-c7a3-4888-af65-428f7f24e9a8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:12.700451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8990558d-c7a3-4888-af65-428f7f24e9a8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:12.712044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8990558d-c7a3-4888-af65-428f7f24e9a8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:12.712685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8990558d-c7a3-4888-af65-428f7f24e9a8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:12.713872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8990558d-c7a3-4888-af65-428f7f24e9a8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:12.714380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8990558d-c7a3-4888-af65-428f7f24e9a8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:12.772815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:10:12.773355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:10:12.773747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:10:12.774168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:10:12.774587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:10:12.792143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:12.792612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:12.793445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:12.793935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:12.847409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:10:12.854664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for user 75befd3272db4de48c7b4586adf6f849 and project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:10:12.871577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8990558d-c7a3-4888-af65-428f7f24e9a8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:12.887877 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8990558d-c7a3-4888-af65-428f7f24e9a8 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1340 microversion: 2.1 time: 0.202114 Jan 22 21:10:12.898883 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1687/3517] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:12 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1340 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:12.899395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:10:12.899395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:10:13.015078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dcda51a0-afaf-469d-bd84-f9be2d3cb1be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:13.015872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dcda51a0-afaf-469d-bd84-f9be2d3cb1be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:13.034221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcda51a0-afaf-469d-bd84-f9be2d3cb1be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:13.035172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcda51a0-afaf-469d-bd84-f9be2d3cb1be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:13.037724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcda51a0-afaf-469d-bd84-f9be2d3cb1be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:13.039218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcda51a0-afaf-469d-bd84-f9be2d3cb1be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:13.159135 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-60b8dfeb-89c4-4838-bced-c53e1f82dfbe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.488520 Jan 22 21:10:13.159802 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1831/3518] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:10:11 2022] POST /compute/v2.1/servers => generated 382 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:10:13.175824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-35a41006-6d94-4bf0-921f-c4641be362e1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:13.177932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-35a41006-6d94-4bf0-921f-c4641be362e1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:13.326811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-35a41006-6d94-4bf0-921f-c4641be362e1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:13.332559 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-35a41006-6d94-4bf0-921f-c4641be362e1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1213 microversion: 2.1 time: 0.166098 Jan 22 21:10:13.333930 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1832/3519] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:13 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1213 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:13.588254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ac650fc2-f515-44b9-8b8f-1b79af67f7f2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:13.589742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ac650fc2-f515-44b9-8b8f-1b79af67f7f2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:13.600058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac650fc2-f515-44b9-8b8f-1b79af67f7f2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:13.604699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac650fc2-f515-44b9-8b8f-1b79af67f7f2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:13.606263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac650fc2-f515-44b9-8b8f-1b79af67f7f2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:13.606263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac650fc2-f515-44b9-8b8f-1b79af67f7f2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:13.692873 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ac650fc2-f515-44b9-8b8f-1b79af67f7f2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.109140 Jan 22 21:10:13.697757 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1833/3520] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:13 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:13.705566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d4ec809d-7b0e-493e-9be5-d669c061fceb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:13.707444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d4ec809d-7b0e-493e-9be5-d669c061fceb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:13.730973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4ec809d-7b0e-493e-9be5-d669c061fceb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:13.736212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4ec809d-7b0e-493e-9be5-d669c061fceb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:13.736212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4ec809d-7b0e-493e-9be5-d669c061fceb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:13.736212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4ec809d-7b0e-493e-9be5-d669c061fceb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:13.809694 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d4ec809d-7b0e-493e-9be5-d669c061fceb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.110512 Jan 22 21:10:13.813439 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1834/3521] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:13 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:13.907001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-47b3c5d5-f1b5-49f2-b058-0bca7b64ca7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:13.908617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-47b3c5d5-f1b5-49f2-b058-0bca7b64ca7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:13.933861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47b3c5d5-f1b5-49f2-b058-0bca7b64ca7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:13.934333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47b3c5d5-f1b5-49f2-b058-0bca7b64ca7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:13.935324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47b3c5d5-f1b5-49f2-b058-0bca7b64ca7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:13.936426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47b3c5d5-f1b5-49f2-b058-0bca7b64ca7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:13.964114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dcda51a0-afaf-469d-bd84-f9be2d3cb1be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:13.979249 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dcda51a0-afaf-469d-bd84-f9be2d3cb1be tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1536 microversion: 2.1 time: 0.968400 Jan 22 21:10:13.982903 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1688/3522] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:13 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1536 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:14.246167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-47b3c5d5-f1b5-49f2-b058-0bca7b64ca7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:14.254745 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-47b3c5d5-f1b5-49f2-b058-0bca7b64ca7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1382 microversion: 2.1 time: 0.352828 Jan 22 21:10:14.255350 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1835/3523] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:13 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1382 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:14.350813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-62720bf9-2801-495d-bab3-312ad4002e12 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:14.351450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-62720bf9-2801-495d-bab3-312ad4002e12 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:14.512586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-62720bf9-2801-495d-bab3-312ad4002e12 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:14.526904 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-62720bf9-2801-495d-bab3-312ad4002e12 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1213 microversion: 2.1 time: 0.179991 Jan 22 21:10:14.529953 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1689/3524] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:14 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1213 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:14.727563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e84a5e52-96a8-4fd7-8886-ecc298c1c278 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:14.731802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e84a5e52-96a8-4fd7-8886-ecc298c1c278 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:14.767497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e84a5e52-96a8-4fd7-8886-ecc298c1c278 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:14.775152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e84a5e52-96a8-4fd7-8886-ecc298c1c278 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:14.778031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e84a5e52-96a8-4fd7-8886-ecc298c1c278 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:14.781592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e84a5e52-96a8-4fd7-8886-ecc298c1c278 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:14.829026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6b2a7f5e-8857-4eca-b4f8-1a34a4fad148 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:14.834662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6b2a7f5e-8857-4eca-b4f8-1a34a4fad148 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:14.852860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b2a7f5e-8857-4eca-b4f8-1a34a4fad148 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:14.864685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b2a7f5e-8857-4eca-b4f8-1a34a4fad148 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:14.866174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b2a7f5e-8857-4eca-b4f8-1a34a4fad148 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:14.866846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b2a7f5e-8857-4eca-b4f8-1a34a4fad148 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:14.931576 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e84a5e52-96a8-4fd7-8886-ecc298c1c278 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.230706 Jan 22 21:10:14.933377 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1836/3525] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:14 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:14.966277 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6b2a7f5e-8857-4eca-b4f8-1a34a4fad148 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.145434 Jan 22 21:10:14.967746 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1690/3526] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:14 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:15.000169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0eef1351-43ef-49a7-a84f-d85c3af86549 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:15.000937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0eef1351-43ef-49a7-a84f-d85c3af86549 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:15.026963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0eef1351-43ef-49a7-a84f-d85c3af86549 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:15.028129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0eef1351-43ef-49a7-a84f-d85c3af86549 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:15.030214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0eef1351-43ef-49a7-a84f-d85c3af86549 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:15.031741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0eef1351-43ef-49a7-a84f-d85c3af86549 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:15.276748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3bb37074-4911-459e-9a51-f4cf494688ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:15.277760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3bb37074-4911-459e-9a51-f4cf494688ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:15.299414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3bb37074-4911-459e-9a51-f4cf494688ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:15.300113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3bb37074-4911-459e-9a51-f4cf494688ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:15.308949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3bb37074-4911-459e-9a51-f4cf494688ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:15.308949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3bb37074-4911-459e-9a51-f4cf494688ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:15.322484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0eef1351-43ef-49a7-a84f-d85c3af86549 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:15.333111 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0eef1351-43ef-49a7-a84f-d85c3af86549 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1536 microversion: 2.1 time: 0.338475 Jan 22 21:10:15.342594 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1837/3527] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:14 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1536 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:15.547094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-18e6b22a-855f-4f6c-b199-e5c27cdfb412 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:15.547727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-18e6b22a-855f-4f6c-b199-e5c27cdfb412 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:15.557379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18e6b22a-855f-4f6c-b199-e5c27cdfb412 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:15.558192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18e6b22a-855f-4f6c-b199-e5c27cdfb412 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:15.566399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18e6b22a-855f-4f6c-b199-e5c27cdfb412 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:15.567043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18e6b22a-855f-4f6c-b199-e5c27cdfb412 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:15.952681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-18e6b22a-855f-4f6c-b199-e5c27cdfb412 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:15.962192 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-18e6b22a-855f-4f6c-b199-e5c27cdfb412 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1265 microversion: 2.1 time: 0.419535 Jan 22 21:10:15.966219 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1838/3528] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:15 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1265 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:15.985351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bc0e05be-badd-4f34-babf-c8e876e8206f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:15.990194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bc0e05be-badd-4f34-babf-c8e876e8206f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:16.004095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc0e05be-badd-4f34-babf-c8e876e8206f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:16.009651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc0e05be-badd-4f34-babf-c8e876e8206f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:16.012630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc0e05be-badd-4f34-babf-c8e876e8206f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:16.012630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc0e05be-badd-4f34-babf-c8e876e8206f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:16.109972 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bc0e05be-badd-4f34-babf-c8e876e8206f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.128392 Jan 22 21:10:16.111171 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1839/3529] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:15 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:16.131384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-83bd17f4-7f91-4fca-9f85-51b01e0ce9bb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:16.132838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-83bd17f4-7f91-4fca-9f85-51b01e0ce9bb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:16.157562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83bd17f4-7f91-4fca-9f85-51b01e0ce9bb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:16.158252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83bd17f4-7f91-4fca-9f85-51b01e0ce9bb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:16.159480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83bd17f4-7f91-4fca-9f85-51b01e0ce9bb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:16.163371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83bd17f4-7f91-4fca-9f85-51b01e0ce9bb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:16.275831 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-83bd17f4-7f91-4fca-9f85-51b01e0ce9bb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.157918 Jan 22 21:10:16.281716 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1840/3530] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:16 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:16.444994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3bb37074-4911-459e-9a51-f4cf494688ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:16.460731 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3bb37074-4911-459e-9a51-f4cf494688ba tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1382 microversion: 2.1 time: 1.188638 Jan 22 21:10:16.470033 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1691/3531] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:15 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1382 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:16.483108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-54f6a7c5-1ec0-48f3-a389-58c0f1ce1f6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:16.490189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-54f6a7c5-1ec0-48f3-a389-58c0f1ce1f6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:16.512179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54f6a7c5-1ec0-48f3-a389-58c0f1ce1f6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:16.514894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54f6a7c5-1ec0-48f3-a389-58c0f1ce1f6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:16.519645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54f6a7c5-1ec0-48f3-a389-58c0f1ce1f6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:16.522140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54f6a7c5-1ec0-48f3-a389-58c0f1ce1f6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:16.675005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-905813705", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:16.738643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] validate_networks() for [('d49971f9-7c3a-4e50-bbcb-a6de45d7e148', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:10:17.450132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-54f6a7c5-1ec0-48f3-a389-58c0f1ce1f6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:17.468028 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-54f6a7c5-1ec0-48f3-a389-58c0f1ce1f6f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1536 microversion: 2.1 time: 0.995915 Jan 22 21:10:17.478014 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1692/3532] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:16 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1536 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:17.719432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:10:17.719892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:10:17.720326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:10:17.721924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:10:17.722043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:10:17.761618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:17.762192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:17.768193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:17.768762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:17.788189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-91baec55-7690-48d9-bb79-09e3f3d1c77c req-9ad4fa2d-5583-41fe-88e3-a4c6da0d6164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a40cd339-38cd-40f4-a4e5-0b220e363df8", "tag": "8c94703f-c59c-42e5-b507-01dab2c8cb70"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:17.791284 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:17.791284 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:10:17.813692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-91baec55-7690-48d9-bb79-09e3f3d1c77c req-9ad4fa2d-5583-41fe-88e3-a4c6da0d6164 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:17.814260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-91baec55-7690-48d9-bb79-09e3f3d1c77c req-9ad4fa2d-5583-41fe-88e3-a4c6da0d6164 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:17.826490 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-91baec55-7690-48d9-bb79-09e3f3d1c77c req-9ad4fa2d-5583-41fe-88e3-a4c6da0d6164 service nova] Creating event network-changed:8c94703f-c59c-42e5-b507-01dab2c8cb70 for instance a40cd339-38cd-40f4-a4e5-0b220e363df8 on nch2-master-1 Jan 22 21:10:17.832022 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-91baec55-7690-48d9-bb79-09e3f3d1c77c req-9ad4fa2d-5583-41fe-88e3-a4c6da0d6164 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.348108 Jan 22 21:10:17.833297 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1693/3533] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:10:17.844462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-90632f25-0a7b-4fde-a450-cce47c045ea7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:17.845208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-90632f25-0a7b-4fde-a450-cce47c045ea7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:17.863553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Getting quotas for project db6acf2143024ccf9ce1f7a2c8369626. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:10:17.871193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90632f25-0a7b-4fde-a450-cce47c045ea7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:17.871660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90632f25-0a7b-4fde-a450-cce47c045ea7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:17.872498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90632f25-0a7b-4fde-a450-cce47c045ea7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:17.872950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90632f25-0a7b-4fde-a450-cce47c045ea7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:17.880551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Getting quotas for user f783581ba8ca49b79a7d7cf7589b5b8e and project db6acf2143024ccf9ce1f7a2c8369626. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:10:17.922307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:10:17.929662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:10:18.062691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-90632f25-0a7b-4fde-a450-cce47c045ea7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:18.075298 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-90632f25-0a7b-4fde-a450-cce47c045ea7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1271 microversion: 2.1 time: 0.237031 Jan 22 21:10:18.085857 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1694/3534] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:17 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:18.091474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8b8eb8f6-4820-45df-91d3-36243cd20f50 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:18.092757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8b8eb8f6-4820-45df-91d3-36243cd20f50 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:18.110412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b8eb8f6-4820-45df-91d3-36243cd20f50 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:18.110994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b8eb8f6-4820-45df-91d3-36243cd20f50 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:18.111860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b8eb8f6-4820-45df-91d3-36243cd20f50 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:18.112314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b8eb8f6-4820-45df-91d3-36243cd20f50 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:18.213032 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4b71b4bd-b7e7-4c40-a3ac-0c11d451753e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.929686 Jan 22 21:10:18.214534 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1841/3535] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:10:16 2022] POST /compute/v2.1/servers => generated 385 bytes in 1932 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:10:18.228222 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8b8eb8f6-4820-45df-91d3-36243cd20f50 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.149172 Jan 22 21:10:18.229336 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1695/3536] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:18 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:18.241378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-33f2042d-c08f-46cf-aeac-8931358b08e6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:18.245161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85c00561-c506-4f83-8d29-6d84f55a3be4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:18.246986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-33f2042d-c08f-46cf-aeac-8931358b08e6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:18.249579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85c00561-c506-4f83-8d29-6d84f55a3be4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:18.275440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33f2042d-c08f-46cf-aeac-8931358b08e6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:18.276147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33f2042d-c08f-46cf-aeac-8931358b08e6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:18.278665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33f2042d-c08f-46cf-aeac-8931358b08e6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:18.281229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33f2042d-c08f-46cf-aeac-8931358b08e6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:18.289118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85c00561-c506-4f83-8d29-6d84f55a3be4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:18.292913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85c00561-c506-4f83-8d29-6d84f55a3be4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:18.294099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85c00561-c506-4f83-8d29-6d84f55a3be4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:18.294712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85c00561-c506-4f83-8d29-6d84f55a3be4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:18.461766 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-33f2042d-c08f-46cf-aeac-8931358b08e6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.245521 Jan 22 21:10:18.462456 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1842/3537] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:18 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:18.479912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-870c4f93-989f-4dc4-8b98-e50f9f81ea66 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:18.481529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-870c4f93-989f-4dc4-8b98-e50f9f81ea66 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:18.615593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-870c4f93-989f-4dc4-8b98-e50f9f81ea66 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:18.625087 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-870c4f93-989f-4dc4-8b98-e50f9f81ea66 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1217 microversion: 2.1 time: 0.152808 Jan 22 21:10:18.626085 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1843/3538] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:18 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:18.640080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-36eea82d-880a-4e93-8e3e-e0e5ddfb62d6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:18.641018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-36eea82d-880a-4e93-8e3e-e0e5ddfb62d6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:18.660857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36eea82d-880a-4e93-8e3e-e0e5ddfb62d6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:18.671667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36eea82d-880a-4e93-8e3e-e0e5ddfb62d6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:18.679607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36eea82d-880a-4e93-8e3e-e0e5ddfb62d6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:18.679607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36eea82d-880a-4e93-8e3e-e0e5ddfb62d6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:18.684151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-85c00561-c506-4f83-8d29-6d84f55a3be4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:18.702710 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-85c00561-c506-4f83-8d29-6d84f55a3be4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1382 microversion: 2.1 time: 0.468514 Jan 22 21:10:18.704678 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1696/3539] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:18 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1382 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:18.719078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-1d19155b-d8cf-4334-bb84-7aadde4ceb7f req-5ad66d61-2d69-4360-97ff-0276454207f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b2aed8-f03f-4c04-b508-cc9a7e172dd6", "name": "network-vif-plugged", "status": "completed", "tag": "99dd6838-12b2-4c2b-b219-2af5c1a44a74"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:18.721692 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:18.721692 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:10:18.741094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1d19155b-d8cf-4334-bb84-7aadde4ceb7f req-5ad66d61-2d69-4360-97ff-0276454207f9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:18.741753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1d19155b-d8cf-4334-bb84-7aadde4ceb7f req-5ad66d61-2d69-4360-97ff-0276454207f9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:18.771534 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-1d19155b-d8cf-4334-bb84-7aadde4ceb7f req-5ad66d61-2d69-4360-97ff-0276454207f9 service nova] Creating event network-vif-plugged:99dd6838-12b2-4c2b-b219-2af5c1a44a74 for instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 on nch2-master-1 Jan 22 21:10:18.786169 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-1d19155b-d8cf-4334-bb84-7aadde4ceb7f req-5ad66d61-2d69-4360-97ff-0276454207f9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073983 Jan 22 21:10:18.789022 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1697/3540] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:10:19.108229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dfcf5b73-66a1-48cc-bb73-4eb8a42c4538 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:19.109788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dfcf5b73-66a1-48cc-bb73-4eb8a42c4538 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:19.134304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfcf5b73-66a1-48cc-bb73-4eb8a42c4538 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:19.134304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfcf5b73-66a1-48cc-bb73-4eb8a42c4538 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:19.134304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfcf5b73-66a1-48cc-bb73-4eb8a42c4538 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:19.134304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfcf5b73-66a1-48cc-bb73-4eb8a42c4538 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:19.184441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-36eea82d-880a-4e93-8e3e-e0e5ddfb62d6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:19.195951 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-36eea82d-880a-4e93-8e3e-e0e5ddfb62d6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1536 microversion: 2.1 time: 0.568167 Jan 22 21:10:19.199602 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1844/3541] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:18 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1536 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:19.240452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6a4c2d9-0be5-44e4-b031-d1993d333720 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:19.241454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b6a4c2d9-0be5-44e4-b031-d1993d333720 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:19.250662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6a4c2d9-0be5-44e4-b031-d1993d333720 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:19.253115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6a4c2d9-0be5-44e4-b031-d1993d333720 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:19.253115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6a4c2d9-0be5-44e4-b031-d1993d333720 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:19.253412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6a4c2d9-0be5-44e4-b031-d1993d333720 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:19.370797 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b6a4c2d9-0be5-44e4-b031-d1993d333720 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.134116 Jan 22 21:10:19.376999 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1845/3542] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:19 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:19.475407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8bea2df3-1056-4428-bbf0-6efac29222e7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:19.476505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8bea2df3-1056-4428-bbf0-6efac29222e7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:19.494581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bea2df3-1056-4428-bbf0-6efac29222e7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:19.495049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bea2df3-1056-4428-bbf0-6efac29222e7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:19.496169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bea2df3-1056-4428-bbf0-6efac29222e7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:19.500863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bea2df3-1056-4428-bbf0-6efac29222e7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:19.550148 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8bea2df3-1056-4428-bbf0-6efac29222e7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.078894 Jan 22 21:10:19.553022 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1846/3543] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:19 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:19.619422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dfcf5b73-66a1-48cc-bb73-4eb8a42c4538 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:19.636711 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dfcf5b73-66a1-48cc-bb73-4eb8a42c4538 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1313 microversion: 2.1 time: 0.539728 Jan 22 21:10:19.643498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-edbc5502-6601-41a9-b5cd-9cd8964ef587 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:19.644479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-edbc5502-6601-41a9-b5cd-9cd8964ef587 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:19.653006 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1698/3544] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:19 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1313 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:19.723050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-691a1258-2053-4380-b80b-ab876997db80 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:19.723903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-691a1258-2053-4380-b80b-ab876997db80 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:19.730970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-691a1258-2053-4380-b80b-ab876997db80 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:19.732101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-691a1258-2053-4380-b80b-ab876997db80 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:19.733776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-691a1258-2053-4380-b80b-ab876997db80 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:19.734426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-691a1258-2053-4380-b80b-ab876997db80 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:19.927930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-edbc5502-6601-41a9-b5cd-9cd8964ef587 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:19.935229 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-edbc5502-6601-41a9-b5cd-9cd8964ef587 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1217 microversion: 2.1 time: 0.296430 Jan 22 21:10:19.941180 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1847/3545] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:19 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1217 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:20.214107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b8443b9-ca5d-4031-9d23-e7edd1aafb52 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:20.214755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6b8443b9-ca5d-4031-9d23-e7edd1aafb52 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:20.231818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b8443b9-ca5d-4031-9d23-e7edd1aafb52 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:20.232307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b8443b9-ca5d-4031-9d23-e7edd1aafb52 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:20.233547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b8443b9-ca5d-4031-9d23-e7edd1aafb52 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:20.234174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b8443b9-ca5d-4031-9d23-e7edd1aafb52 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:20.249695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-691a1258-2053-4380-b80b-ab876997db80 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:20.261233 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-691a1258-2053-4380-b80b-ab876997db80 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1382 microversion: 2.1 time: 0.542455 Jan 22 21:10:20.275189 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1699/3546] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:19 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1382 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:20.386393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ead0a98b-daae-4bf1-b932-3f784631ef29 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:20.388108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ead0a98b-daae-4bf1-b932-3f784631ef29 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:20.407276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ead0a98b-daae-4bf1-b932-3f784631ef29 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:20.408647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ead0a98b-daae-4bf1-b932-3f784631ef29 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:20.411338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ead0a98b-daae-4bf1-b932-3f784631ef29 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:20.412666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ead0a98b-daae-4bf1-b932-3f784631ef29 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:20.493363 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ead0a98b-daae-4bf1-b932-3f784631ef29 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.113462 Jan 22 21:10:20.499399 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1700/3547] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:20 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:20.575107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2b749671-92cd-48e8-9297-2b48787cd8e9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:20.575107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2b749671-92cd-48e8-9297-2b48787cd8e9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:20.581598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b749671-92cd-48e8-9297-2b48787cd8e9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:20.582684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b749671-92cd-48e8-9297-2b48787cd8e9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:20.583695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b749671-92cd-48e8-9297-2b48787cd8e9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:20.584341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b749671-92cd-48e8-9297-2b48787cd8e9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:20.659278 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2b749671-92cd-48e8-9297-2b48787cd8e9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.098063 Jan 22 21:10:20.660928 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1701/3548] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:20 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:20.668150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a0e2a43b-9118-46ee-a757-3f89ff6db19a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:20.669456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a0e2a43b-9118-46ee-a757-3f89ff6db19a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:20.679801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0e2a43b-9118-46ee-a757-3f89ff6db19a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:20.681091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0e2a43b-9118-46ee-a757-3f89ff6db19a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:20.683519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0e2a43b-9118-46ee-a757-3f89ff6db19a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:20.684161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0e2a43b-9118-46ee-a757-3f89ff6db19a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:20.743118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6b8443b9-ca5d-4031-9d23-e7edd1aafb52 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:20.775226 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b8443b9-ca5d-4031-9d23-e7edd1aafb52 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.563622 Jan 22 21:10:20.779279 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1848/3549] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:20 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:20.960783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-167c3506-d9de-4aa2-ad87-92600d7c4f68 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:20.961331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-167c3506-d9de-4aa2-ad87-92600d7c4f68 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:20.980589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-167c3506-d9de-4aa2-ad87-92600d7c4f68 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:20.981408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-167c3506-d9de-4aa2-ad87-92600d7c4f68 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:20.985287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-167c3506-d9de-4aa2-ad87-92600d7c4f68 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:20.993922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-167c3506-d9de-4aa2-ad87-92600d7c4f68 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:21.120872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a0e2a43b-9118-46ee-a757-3f89ff6db19a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:21.132518 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a0e2a43b-9118-46ee-a757-3f89ff6db19a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1313 microversion: 2.1 time: 0.469692 Jan 22 21:10:21.135778 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1702/3550] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:20 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:21.152623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-167c3506-d9de-4aa2-ad87-92600d7c4f68 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:21.167771 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-167c3506-d9de-4aa2-ad87-92600d7c4f68 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1213 microversion: 2.1 time: 0.208211 Jan 22 21:10:21.173323 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1849/3551] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:20 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1213 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:21.278611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7eaa3a6c-5742-415d-856e-61be64e7a6ff tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:21.280037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7eaa3a6c-5742-415d-856e-61be64e7a6ff tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:21.297680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7eaa3a6c-5742-415d-856e-61be64e7a6ff tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:21.298867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7eaa3a6c-5742-415d-856e-61be64e7a6ff tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:21.300288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7eaa3a6c-5742-415d-856e-61be64e7a6ff tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:21.300982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7eaa3a6c-5742-415d-856e-61be64e7a6ff tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:21.506719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-993dfbc5-4740-4c50-9188-d0db529242b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:21.516601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-993dfbc5-4740-4c50-9188-d0db529242b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:21.525775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-993dfbc5-4740-4c50-9188-d0db529242b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:21.526511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-993dfbc5-4740-4c50-9188-d0db529242b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:21.527523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-993dfbc5-4740-4c50-9188-d0db529242b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:21.528148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-993dfbc5-4740-4c50-9188-d0db529242b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:21.634287 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-993dfbc5-4740-4c50-9188-d0db529242b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.131053 Jan 22 21:10:21.635122 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1850/3552] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:21 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:21.653185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-66d50ebd-3980-4925-8005-244fd2ed4e8c req-243ae718-b8b5-4213-8c45-d59afd0c2f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e4b1a45-6907-44b8-9395-4d44ffeb22b7", "tag": "5a16f93a-5ed1-47ab-8e02-3cb97602034e"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:21.660440 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:21.660440 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:10:21.684538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-66d50ebd-3980-4925-8005-244fd2ed4e8c req-243ae718-b8b5-4213-8c45-d59afd0c2f95 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:21.686748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-66d50ebd-3980-4925-8005-244fd2ed4e8c req-243ae718-b8b5-4213-8c45-d59afd0c2f95 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:21.744816 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-66d50ebd-3980-4925-8005-244fd2ed4e8c req-243ae718-b8b5-4213-8c45-d59afd0c2f95 service nova] Creating event network-changed:5a16f93a-5ed1-47ab-8e02-3cb97602034e for instance 0e4b1a45-6907-44b8-9395-4d44ffeb22b7 on nch2-master-1 Jan 22 21:10:21.776373 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-66d50ebd-3980-4925-8005-244fd2ed4e8c req-243ae718-b8b5-4213-8c45-d59afd0c2f95 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139513 Jan 22 21:10:21.781742 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1851/3553] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:10:21.821056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4bd79319-0b89-4f06-a1ed-a910ba628d1e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:21.829979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4bd79319-0b89-4f06-a1ed-a910ba628d1e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:21.853316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7eaa3a6c-5742-415d-856e-61be64e7a6ff tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:21.872613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bd79319-0b89-4f06-a1ed-a910ba628d1e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:21.875762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bd79319-0b89-4f06-a1ed-a910ba628d1e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:21.878762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bd79319-0b89-4f06-a1ed-a910ba628d1e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:21.879373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bd79319-0b89-4f06-a1ed-a910ba628d1e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:21.882524 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7eaa3a6c-5742-415d-856e-61be64e7a6ff tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1382 microversion: 2.1 time: 0.600343 Jan 22 21:10:21.883443 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1703/3554] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:21 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1382 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:21.890492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-56ee09d6-3612-4db7-a544-ac1a5b6675a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:21.891408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-56ee09d6-3612-4db7-a544-ac1a5b6675a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:21.904173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56ee09d6-3612-4db7-a544-ac1a5b6675a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:21.915719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56ee09d6-3612-4db7-a544-ac1a5b6675a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:21.921417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56ee09d6-3612-4db7-a544-ac1a5b6675a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:21.922233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56ee09d6-3612-4db7-a544-ac1a5b6675a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:21.964548 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4bd79319-0b89-4f06-a1ed-a910ba628d1e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.181089 Jan 22 21:10:21.968530 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1852/3555] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:21 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:22.163417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e1a17557-7df4-4b5c-8ca2-cb3197996c05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:22.172574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e1a17557-7df4-4b5c-8ca2-cb3197996c05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:22.195160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1a17557-7df4-4b5c-8ca2-cb3197996c05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:22.195920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1a17557-7df4-4b5c-8ca2-cb3197996c05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:22.197655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1a17557-7df4-4b5c-8ca2-cb3197996c05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:22.199378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1a17557-7df4-4b5c-8ca2-cb3197996c05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:22.514391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-56ee09d6-3612-4db7-a544-ac1a5b6675a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:22.523291 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-56ee09d6-3612-4db7-a544-ac1a5b6675a5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.637496 Jan 22 21:10:22.528518 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1704/3556] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:21 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:22.539476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0ecebc15-31f1-44a5-89f4-d5d2968b783a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:22.545799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e1a17557-7df4-4b5c-8ca2-cb3197996c05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:22.555564 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e1a17557-7df4-4b5c-8ca2-cb3197996c05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1313 microversion: 2.1 time: 0.403890 Jan 22 21:10:22.561051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0ecebc15-31f1-44a5-89f4-d5d2968b783a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:22.570878 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1853/3557] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:22 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:22.599691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ecebc15-31f1-44a5-89f4-d5d2968b783a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:22.605397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ecebc15-31f1-44a5-89f4-d5d2968b783a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:22.607008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ecebc15-31f1-44a5-89f4-d5d2968b783a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:22.607668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ecebc15-31f1-44a5-89f4-d5d2968b783a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:22.647932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c9b9544a-d980-4823-b21e-903fbfd54ab0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:22.649816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c9b9544a-d980-4823-b21e-903fbfd54ab0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:22.663040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9b9544a-d980-4823-b21e-903fbfd54ab0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:22.663750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9b9544a-d980-4823-b21e-903fbfd54ab0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:22.664557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9b9544a-d980-4823-b21e-903fbfd54ab0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:22.664991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9b9544a-d980-4823-b21e-903fbfd54ab0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:22.754989 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c9b9544a-d980-4823-b21e-903fbfd54ab0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.110974 Jan 22 21:10:22.760293 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1854/3558] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:22 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:22.837616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0ecebc15-31f1-44a5-89f4-d5d2968b783a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:22.845836 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0ecebc15-31f1-44a5-89f4-d5d2968b783a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1275 microversion: 2.1 time: 0.312565 Jan 22 21:10:22.855271 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1705/3559] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:22 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1275 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:22.902149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-218e81d2-336c-4ce5-bf1e-a7b02b9963a9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:22.907227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-218e81d2-336c-4ce5-bf1e-a7b02b9963a9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:22.930126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-218e81d2-336c-4ce5-bf1e-a7b02b9963a9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:22.930126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-218e81d2-336c-4ce5-bf1e-a7b02b9963a9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:22.941391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-218e81d2-336c-4ce5-bf1e-a7b02b9963a9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:22.945886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-218e81d2-336c-4ce5-bf1e-a7b02b9963a9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:22.976255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ad5d0c18-fad2-4d6c-8cbf-cb4fec2b567b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:22.979469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ad5d0c18-fad2-4d6c-8cbf-cb4fec2b567b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:22.992346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad5d0c18-fad2-4d6c-8cbf-cb4fec2b567b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:22.993135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad5d0c18-fad2-4d6c-8cbf-cb4fec2b567b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:22.994131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad5d0c18-fad2-4d6c-8cbf-cb4fec2b567b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:22.994789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad5d0c18-fad2-4d6c-8cbf-cb4fec2b567b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:23.067701 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ad5d0c18-fad2-4d6c-8cbf-cb4fec2b567b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.094979 Jan 22 21:10:23.069097 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1706/3560] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:22 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:23.432170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-218e81d2-336c-4ce5-bf1e-a7b02b9963a9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:23.442881 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-218e81d2-336c-4ce5-bf1e-a7b02b9963a9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1382 microversion: 2.1 time: 0.546085 Jan 22 21:10:23.453085 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1855/3561] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:22 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1382 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:23.547917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-678262b3-759b-4f53-9024-8c9aa1b990f3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:23.549397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-678262b3-759b-4f53-9024-8c9aa1b990f3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:23.563424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-678262b3-759b-4f53-9024-8c9aa1b990f3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:23.569762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-678262b3-759b-4f53-9024-8c9aa1b990f3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:23.575152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-322ab2e3-e823-4ab0-915f-e115cc00b375 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:23.576615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-322ab2e3-e823-4ab0-915f-e115cc00b375 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:23.582712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-678262b3-759b-4f53-9024-8c9aa1b990f3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:23.582712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-678262b3-759b-4f53-9024-8c9aa1b990f3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:23.589052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-322ab2e3-e823-4ab0-915f-e115cc00b375 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:23.596646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-322ab2e3-e823-4ab0-915f-e115cc00b375 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:23.601220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-322ab2e3-e823-4ab0-915f-e115cc00b375 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:23.601719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-322ab2e3-e823-4ab0-915f-e115cc00b375 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:23.903143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-322ab2e3-e823-4ab0-915f-e115cc00b375 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:23.913155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-678262b3-759b-4f53-9024-8c9aa1b990f3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:23.914993 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-322ab2e3-e823-4ab0-915f-e115cc00b375 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1313 microversion: 2.1 time: 0.343502 Jan 22 21:10:23.916158 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1856/3562] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:23 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:23.924995 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-678262b3-759b-4f53-9024-8c9aa1b990f3 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.382383 Jan 22 21:10:23.930081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f0e88fc1-4db8-447b-aace-83d7209c113d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:23.931350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f0e88fc1-4db8-447b-aace-83d7209c113d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:23.934689 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1707/3563] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:23 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:23.944547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8dddc7d1-7528-417a-8033-ee4fc3362ebf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:23.945212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8dddc7d1-7528-417a-8033-ee4fc3362ebf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:23.951812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0e88fc1-4db8-447b-aace-83d7209c113d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:23.954972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dddc7d1-7528-417a-8033-ee4fc3362ebf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:23.955451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dddc7d1-7528-417a-8033-ee4fc3362ebf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:23.956086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0e88fc1-4db8-447b-aace-83d7209c113d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:23.957118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dddc7d1-7528-417a-8033-ee4fc3362ebf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:23.957663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dddc7d1-7528-417a-8033-ee4fc3362ebf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:23.961098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0e88fc1-4db8-447b-aace-83d7209c113d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:23.962126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0e88fc1-4db8-447b-aace-83d7209c113d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:24.072026 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f0e88fc1-4db8-447b-aace-83d7209c113d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.154220 Jan 22 21:10:24.074946 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1857/3564] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:23 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:24.093109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5a0e1636-1770-4a1b-954c-6d657ea56bf4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:24.098179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5a0e1636-1770-4a1b-954c-6d657ea56bf4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:24.119457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a0e1636-1770-4a1b-954c-6d657ea56bf4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:24.121253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a0e1636-1770-4a1b-954c-6d657ea56bf4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:24.123342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a0e1636-1770-4a1b-954c-6d657ea56bf4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:24.125941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a0e1636-1770-4a1b-954c-6d657ea56bf4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:24.237711 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5a0e1636-1770-4a1b-954c-6d657ea56bf4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.160541 Jan 22 21:10:24.246240 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1858/3565] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:24 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:24.454208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8dddc7d1-7528-417a-8033-ee4fc3362ebf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:24.468249 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8dddc7d1-7528-417a-8033-ee4fc3362ebf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1317 microversion: 2.1 time: 0.530380 Jan 22 21:10:24.470352 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1708/3566] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:23 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:24.473725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bc2721b9-f310-48a6-82e3-5823ea80a6e3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:24.478688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bc2721b9-f310-48a6-82e3-5823ea80a6e3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:24.489271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc2721b9-f310-48a6-82e3-5823ea80a6e3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:24.489764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc2721b9-f310-48a6-82e3-5823ea80a6e3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:24.492949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc2721b9-f310-48a6-82e3-5823ea80a6e3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:24.493433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc2721b9-f310-48a6-82e3-5823ea80a6e3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:24.812752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bc2721b9-f310-48a6-82e3-5823ea80a6e3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:24.821654 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bc2721b9-f310-48a6-82e3-5823ea80a6e3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1382 microversion: 2.1 time: 0.354698 Jan 22 21:10:24.822562 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1859/3567] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:24 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1382 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:24.934472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0e24fab1-f44a-431e-96ba-06d6c889ca7a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:24.935393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0e24fab1-f44a-431e-96ba-06d6c889ca7a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:24.944031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4b20af4f-9bd8-4e62-a8d6-eb72b43289e8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:24.944661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4b20af4f-9bd8-4e62-a8d6-eb72b43289e8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:24.947633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e24fab1-f44a-431e-96ba-06d6c889ca7a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:24.948694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e24fab1-f44a-431e-96ba-06d6c889ca7a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:24.953639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e24fab1-f44a-431e-96ba-06d6c889ca7a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:24.957151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e24fab1-f44a-431e-96ba-06d6c889ca7a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:24.958898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b20af4f-9bd8-4e62-a8d6-eb72b43289e8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:24.963410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b20af4f-9bd8-4e62-a8d6-eb72b43289e8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:24.966280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b20af4f-9bd8-4e62-a8d6-eb72b43289e8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:24.967372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b20af4f-9bd8-4e62-a8d6-eb72b43289e8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:25.432548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0e24fab1-f44a-431e-96ba-06d6c889ca7a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:25.443430 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0e24fab1-f44a-431e-96ba-06d6c889ca7a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1313 microversion: 2.1 time: 0.511118 Jan 22 21:10:25.444194 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1709/3568] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:24 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:25.456171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c8c56c36-0396-4c43-a93c-bbfe7e6aad9b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:25.456171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c8c56c36-0396-4c43-a93c-bbfe7e6aad9b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:25.475365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8c56c36-0396-4c43-a93c-bbfe7e6aad9b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:25.477927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8c56c36-0396-4c43-a93c-bbfe7e6aad9b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:25.495166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8c56c36-0396-4c43-a93c-bbfe7e6aad9b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:25.495166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8c56c36-0396-4c43-a93c-bbfe7e6aad9b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:25.588967 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c8c56c36-0396-4c43-a93c-bbfe7e6aad9b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.140284 Jan 22 21:10:25.613151 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1710/3569] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:25 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:25.622777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ce9e13e-68aa-48d8-bb06-a7a607382b0c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:25.627681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3ce9e13e-68aa-48d8-bb06-a7a607382b0c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:25.635843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ce9e13e-68aa-48d8-bb06-a7a607382b0c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:25.637686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ce9e13e-68aa-48d8-bb06-a7a607382b0c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:25.639584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ce9e13e-68aa-48d8-bb06-a7a607382b0c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:25.640046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ce9e13e-68aa-48d8-bb06-a7a607382b0c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:25.723740 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3ce9e13e-68aa-48d8-bb06-a7a607382b0c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.108802 Jan 22 21:10:25.729286 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1711/3570] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:25 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:25.739693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-40e796ac-870f-4e01-8d4f-2c51d99bac6c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:25.742740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-40e796ac-870f-4e01-8d4f-2c51d99bac6c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:25.761878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40e796ac-870f-4e01-8d4f-2c51d99bac6c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:25.775365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40e796ac-870f-4e01-8d4f-2c51d99bac6c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:25.777737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40e796ac-870f-4e01-8d4f-2c51d99bac6c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:25.783747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40e796ac-870f-4e01-8d4f-2c51d99bac6c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:26.031655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4b20af4f-9bd8-4e62-a8d6-eb72b43289e8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:26.047930 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4b20af4f-9bd8-4e62-a8d6-eb72b43289e8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 1.107638 Jan 22 21:10:26.077016 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1860/3571] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:24 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:26.095428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1f499e48-7c57-44bd-a428-89fc66136efc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:26.101193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1f499e48-7c57-44bd-a428-89fc66136efc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:26.113845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f499e48-7c57-44bd-a428-89fc66136efc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:26.116879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f499e48-7c57-44bd-a428-89fc66136efc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:26.117992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f499e48-7c57-44bd-a428-89fc66136efc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:26.122098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f499e48-7c57-44bd-a428-89fc66136efc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:26.364035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-40e796ac-870f-4e01-8d4f-2c51d99bac6c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:26.397979 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-40e796ac-870f-4e01-8d4f-2c51d99bac6c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1317 microversion: 2.1 time: 0.666477 Jan 22 21:10:26.406700 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1712/3572] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:25 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1317 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:26.478109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e10f8fc0-e2cd-4ef1-9643-8ff0cc46d579 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:26.481632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e10f8fc0-e2cd-4ef1-9643-8ff0cc46d579 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:26.508982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e10f8fc0-e2cd-4ef1-9643-8ff0cc46d579 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:26.512472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e10f8fc0-e2cd-4ef1-9643-8ff0cc46d579 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:26.517914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e10f8fc0-e2cd-4ef1-9643-8ff0cc46d579 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:26.521717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e10f8fc0-e2cd-4ef1-9643-8ff0cc46d579 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:26.523399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1f499e48-7c57-44bd-a428-89fc66136efc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:26.535374 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1f499e48-7c57-44bd-a428-89fc66136efc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1382 microversion: 2.1 time: 0.456165 Jan 22 21:10:26.537555 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1861/3573] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:26 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1382 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:26.628443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-283797b5-ab5c-4113-84f6-6df6fccc129e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:26.641008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-283797b5-ab5c-4113-84f6-6df6fccc129e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:26.691607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-283797b5-ab5c-4113-84f6-6df6fccc129e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:26.692441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-283797b5-ab5c-4113-84f6-6df6fccc129e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:26.701024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-283797b5-ab5c-4113-84f6-6df6fccc129e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:26.701994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-283797b5-ab5c-4113-84f6-6df6fccc129e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:26.784809 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-283797b5-ab5c-4113-84f6-6df6fccc129e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.165951 Jan 22 21:10:26.786020 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1862/3574] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:26 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:10:26.791480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5fa83737-2e82-4755-9671-c41cafc0399a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:26.795448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5fa83737-2e82-4755-9671-c41cafc0399a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:26.817704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5fa83737-2e82-4755-9671-c41cafc0399a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:26.821455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5fa83737-2e82-4755-9671-c41cafc0399a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:26.822562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5fa83737-2e82-4755-9671-c41cafc0399a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:26.823227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5fa83737-2e82-4755-9671-c41cafc0399a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:26.911417 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5fa83737-2e82-4755-9671-c41cafc0399a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.123096 Jan 22 21:10:26.911417 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1863/3575] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:26 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:26.988966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-2ef000d4-406c-4305-a45a-a6cc34e29e95 req-ff6edbf9-a582-49e7-8ce3-2387a5815d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da69aec5-3978-4803-b644-988cc15608db", "tag": "af2f4a08-c004-4922-8159-98b9ae008e00"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:26.990614 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:26.990614 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:10:27.006698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2ef000d4-406c-4305-a45a-a6cc34e29e95 req-ff6edbf9-a582-49e7-8ce3-2387a5815d51 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:27.008526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2ef000d4-406c-4305-a45a-a6cc34e29e95 req-ff6edbf9-a582-49e7-8ce3-2387a5815d51 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:27.020673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e10f8fc0-e2cd-4ef1-9643-8ff0cc46d579 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:27.029238 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-2ef000d4-406c-4305-a45a-a6cc34e29e95 req-ff6edbf9-a582-49e7-8ce3-2387a5815d51 service nova] Creating event network-changed:af2f4a08-c004-4922-8159-98b9ae008e00 for instance da69aec5-3978-4803-b644-988cc15608db on nch1-master-1 Jan 22 21:10:27.045894 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e10f8fc0-e2cd-4ef1-9643-8ff0cc46d579 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1313 microversion: 2.1 time: 0.581085 Jan 22 21:10:27.048812 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-2ef000d4-406c-4305-a45a-a6cc34e29e95 req-ff6edbf9-a582-49e7-8ce3-2387a5815d51 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064507 Jan 22 21:10:27.049731 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1864/3576] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:10:27.050667 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1713/3577] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:26 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1313 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:27.078772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f0776f5-ed44-4f9c-8d94-533462c562c7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:27.079778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f0776f5-ed44-4f9c-8d94-533462c562c7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:27.099752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f0776f5-ed44-4f9c-8d94-533462c562c7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:27.108402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f0776f5-ed44-4f9c-8d94-533462c562c7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:27.108402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f0776f5-ed44-4f9c-8d94-533462c562c7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:27.108402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f0776f5-ed44-4f9c-8d94-533462c562c7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:27.435010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-325c4e4d-80ac-4de1-aadd-e531a7d83be9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:27.436390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-325c4e4d-80ac-4de1-aadd-e531a7d83be9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:27.447809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-325c4e4d-80ac-4de1-aadd-e531a7d83be9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:27.451437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-325c4e4d-80ac-4de1-aadd-e531a7d83be9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:27.456928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-325c4e4d-80ac-4de1-aadd-e531a7d83be9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:27.461009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-325c4e4d-80ac-4de1-aadd-e531a7d83be9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:27.630604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f0776f5-ed44-4f9c-8d94-533462c562c7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:27.643307 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f0776f5-ed44-4f9c-8d94-533462c562c7 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.572936 Jan 22 21:10:27.645489 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1865/3578] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:27 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:27.661329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f17a5d8f-2086-4a4f-a12a-2dfeabad380b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:27.677822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f17a5d8f-2086-4a4f-a12a-2dfeabad380b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:27.700541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f17a5d8f-2086-4a4f-a12a-2dfeabad380b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:27.707015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f17a5d8f-2086-4a4f-a12a-2dfeabad380b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:27.708100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-325c4e4d-80ac-4de1-aadd-e531a7d83be9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:27.711207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f17a5d8f-2086-4a4f-a12a-2dfeabad380b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:27.712000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f17a5d8f-2086-4a4f-a12a-2dfeabad380b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:27.749706 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-325c4e4d-80ac-4de1-aadd-e531a7d83be9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1317 microversion: 2.1 time: 0.289932 Jan 22 21:10:27.749706 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1714/3579] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:27 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:28.080210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-8dc353b5-19dc-4228-acd8-6f89ea7ded74 req-43269c6e-d845-4de4-9ce7-105deabc1c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40cd339-38cd-40f4-a4e5-0b220e363df8", "name": "network-vif-plugged", "status": "completed", "tag": "8c94703f-c59c-42e5-b507-01dab2c8cb70"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:28.082309 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:28.082309 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:10:28.094336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f17a5d8f-2086-4a4f-a12a-2dfeabad380b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:28.103240 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f17a5d8f-2086-4a4f-a12a-2dfeabad380b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1382 microversion: 2.1 time: 0.454830 Jan 22 21:10:28.115374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8dc353b5-19dc-4228-acd8-6f89ea7ded74 req-43269c6e-d845-4de4-9ce7-105deabc1c35 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:28.115374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8dc353b5-19dc-4228-acd8-6f89ea7ded74 req-43269c6e-d845-4de4-9ce7-105deabc1c35 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:28.118654 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1866/3580] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:27 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1382 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:28.129815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-df568343-b70b-4185-82a8-39b72c39df96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:28.138848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-df568343-b70b-4185-82a8-39b72c39df96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:28.139064 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8dc353b5-19dc-4228-acd8-6f89ea7ded74 req-43269c6e-d845-4de4-9ce7-105deabc1c35 service nova] Creating event network-vif-plugged:8c94703f-c59c-42e5-b507-01dab2c8cb70 for instance a40cd339-38cd-40f4-a4e5-0b220e363df8 on nch2-master-1 Jan 22 21:10:28.150423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df568343-b70b-4185-82a8-39b72c39df96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:28.152800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df568343-b70b-4185-82a8-39b72c39df96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:28.155119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df568343-b70b-4185-82a8-39b72c39df96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:28.158136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df568343-b70b-4185-82a8-39b72c39df96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:28.160918 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-8dc353b5-19dc-4228-acd8-6f89ea7ded74 req-43269c6e-d845-4de4-9ce7-105deabc1c35 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.406723 Jan 22 21:10:28.160918 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1715/3581] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:10:28.169297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-51a3c818-7c84-45d5-b94e-970c7f808794 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:28.170796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-51a3c818-7c84-45d5-b94e-970c7f808794 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:28.187801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51a3c818-7c84-45d5-b94e-970c7f808794 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:28.188313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51a3c818-7c84-45d5-b94e-970c7f808794 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:28.189458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51a3c818-7c84-45d5-b94e-970c7f808794 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:28.189947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51a3c818-7c84-45d5-b94e-970c7f808794 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:28.246242 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-df568343-b70b-4185-82a8-39b72c39df96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.125523 Jan 22 21:10:28.255557 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1867/3582] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:28 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:28.266875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d5eec8e-3bdf-454b-b798-146eeaa67adc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:28.268271 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-51a3c818-7c84-45d5-b94e-970c7f808794 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.106094 Jan 22 21:10:28.268942 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1716/3583] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:28 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:28.273109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d5eec8e-3bdf-454b-b798-146eeaa67adc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:28.281470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d5eec8e-3bdf-454b-b798-146eeaa67adc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:28.282253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d5eec8e-3bdf-454b-b798-146eeaa67adc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:28.284902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d5eec8e-3bdf-454b-b798-146eeaa67adc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:28.285585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d5eec8e-3bdf-454b-b798-146eeaa67adc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:28.697077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-40443d21-69f5-4ff8-9c4b-fe659f67a40d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:28.697077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-40443d21-69f5-4ff8-9c4b-fe659f67a40d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:28.697077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40443d21-69f5-4ff8-9c4b-fe659f67a40d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:28.718777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40443d21-69f5-4ff8-9c4b-fe659f67a40d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:28.721983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40443d21-69f5-4ff8-9c4b-fe659f67a40d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:28.722549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40443d21-69f5-4ff8-9c4b-fe659f67a40d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:29.016350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-40443d21-69f5-4ff8-9c4b-fe659f67a40d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:29.024472 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-40443d21-69f5-4ff8-9c4b-fe659f67a40d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.363187 Jan 22 21:10:29.025390 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1717/3584] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:28 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:29.029948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a7c6af4b-7014-46fb-9d54-a20d40318a51 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:29.030572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a7c6af4b-7014-46fb-9d54-a20d40318a51 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:29.039664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7c6af4b-7014-46fb-9d54-a20d40318a51 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:29.040137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7c6af4b-7014-46fb-9d54-a20d40318a51 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:29.040963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7c6af4b-7014-46fb-9d54-a20d40318a51 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:29.041415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7c6af4b-7014-46fb-9d54-a20d40318a51 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:29.251309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a7c6af4b-7014-46fb-9d54-a20d40318a51 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:29.261489 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a7c6af4b-7014-46fb-9d54-a20d40318a51 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1317 microversion: 2.1 time: 0.234898 Jan 22 21:10:29.266186 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1718/3585] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:29 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:29.273659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d770646f-9874-4450-a3aa-dc74b8f5f024 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:29.274287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d770646f-9874-4450-a3aa-dc74b8f5f024 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:29.282112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d770646f-9874-4450-a3aa-dc74b8f5f024 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:29.282563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d770646f-9874-4450-a3aa-dc74b8f5f024 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:29.283390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d770646f-9874-4450-a3aa-dc74b8f5f024 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:29.283820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d770646f-9874-4450-a3aa-dc74b8f5f024 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:29.584946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0d5eec8e-3bdf-454b-b798-146eeaa67adc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:29.594029 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d5eec8e-3bdf-454b-b798-146eeaa67adc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1313 microversion: 2.1 time: 1.338077 Jan 22 21:10:29.601708 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1868/3586] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:28 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1313 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:29.619608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-45c475a9-ec8a-4235-9d17-7341ed9323d8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:29.619942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-45c475a9-ec8a-4235-9d17-7341ed9323d8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:29.643031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45c475a9-ec8a-4235-9d17-7341ed9323d8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:29.646673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45c475a9-ec8a-4235-9d17-7341ed9323d8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:29.653972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45c475a9-ec8a-4235-9d17-7341ed9323d8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:29.653972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45c475a9-ec8a-4235-9d17-7341ed9323d8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:29.775628 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-45c475a9-ec8a-4235-9d17-7341ed9323d8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.171431 Jan 22 21:10:29.778361 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1869/3587] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:29 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:29.803444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-004cff0e-ac1c-4a15-af28-3c814fd4864d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:29.803444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-004cff0e-ac1c-4a15-af28-3c814fd4864d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:29.820964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-004cff0e-ac1c-4a15-af28-3c814fd4864d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:29.821619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-004cff0e-ac1c-4a15-af28-3c814fd4864d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:29.822579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-004cff0e-ac1c-4a15-af28-3c814fd4864d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:29.826206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-004cff0e-ac1c-4a15-af28-3c814fd4864d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:29.910830 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-004cff0e-ac1c-4a15-af28-3c814fd4864d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.129542 Jan 22 21:10:29.915069 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1870/3588] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:29 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:30.018518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d770646f-9874-4450-a3aa-dc74b8f5f024 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:30.027427 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d770646f-9874-4450-a3aa-dc74b8f5f024 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1382 microversion: 2.1 time: 0.759694 Jan 22 21:10:30.040414 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1719/3589] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:29 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1382 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:30.044858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-580a3f08-544e-4743-8c2a-a78fcd214b3f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:30.046378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-580a3f08-544e-4743-8c2a-a78fcd214b3f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:30.063378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-580a3f08-544e-4743-8c2a-a78fcd214b3f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:30.069776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-580a3f08-544e-4743-8c2a-a78fcd214b3f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:30.075066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-580a3f08-544e-4743-8c2a-a78fcd214b3f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:30.075066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-580a3f08-544e-4743-8c2a-a78fcd214b3f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:30.278551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-269f9290-ed03-45e8-bdc7-45d09234ad3b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:30.281405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-269f9290-ed03-45e8-bdc7-45d09234ad3b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:30.298716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-269f9290-ed03-45e8-bdc7-45d09234ad3b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:30.302101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-269f9290-ed03-45e8-bdc7-45d09234ad3b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:30.303123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-269f9290-ed03-45e8-bdc7-45d09234ad3b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:30.308972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-269f9290-ed03-45e8-bdc7-45d09234ad3b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:30.807062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-269f9290-ed03-45e8-bdc7-45d09234ad3b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:30.819833 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-269f9290-ed03-45e8-bdc7-45d09234ad3b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1317 microversion: 2.1 time: 0.544926 Jan 22 21:10:30.823941 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1720/3590] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:30 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:30.853878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a9badc2-4319-44ad-b46d-e0286b9129f0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:30.854610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9a9badc2-4319-44ad-b46d-e0286b9129f0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:30.864137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a9badc2-4319-44ad-b46d-e0286b9129f0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:30.864595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a9badc2-4319-44ad-b46d-e0286b9129f0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:30.865411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a9badc2-4319-44ad-b46d-e0286b9129f0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:30.867571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a9badc2-4319-44ad-b46d-e0286b9129f0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:30.960386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-580a3f08-544e-4743-8c2a-a78fcd214b3f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:30.984957 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-580a3f08-544e-4743-8c2a-a78fcd214b3f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.945668 Jan 22 21:10:31.008110 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1871/3591] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:30 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:31.013743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-42f4330e-4bd8-4397-96a4-1697043005f4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:31.014795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-42f4330e-4bd8-4397-96a4-1697043005f4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:31.056561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42f4330e-4bd8-4397-96a4-1697043005f4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:31.057036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42f4330e-4bd8-4397-96a4-1697043005f4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:31.057930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42f4330e-4bd8-4397-96a4-1697043005f4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:31.058388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42f4330e-4bd8-4397-96a4-1697043005f4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:31.219368 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-42f4330e-4bd8-4397-96a4-1697043005f4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.209770 Jan 22 21:10:31.225907 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1872/3592] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:31 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:31.245889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-39f4d4d0-6a39-4545-b175-9925cbdfee62 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:31.245889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-39f4d4d0-6a39-4545-b175-9925cbdfee62 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:31.251611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39f4d4d0-6a39-4545-b175-9925cbdfee62 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:31.252407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39f4d4d0-6a39-4545-b175-9925cbdfee62 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:31.256538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39f4d4d0-6a39-4545-b175-9925cbdfee62 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:31.257387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39f4d4d0-6a39-4545-b175-9925cbdfee62 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:31.323303 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-39f4d4d0-6a39-4545-b175-9925cbdfee62 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.092262 Jan 22 21:10:31.324678 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1873/3593] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:31 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:31.338134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b4a8390e-dca9-42a2-a40c-4414fefb1aca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:31.339377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b4a8390e-dca9-42a2-a40c-4414fefb1aca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:31.362183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4a8390e-dca9-42a2-a40c-4414fefb1aca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:31.364710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4a8390e-dca9-42a2-a40c-4414fefb1aca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:31.365869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4a8390e-dca9-42a2-a40c-4414fefb1aca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:31.366473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4a8390e-dca9-42a2-a40c-4414fefb1aca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:31.537941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9a9badc2-4319-44ad-b46d-e0286b9129f0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:31.556791 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a9badc2-4319-44ad-b46d-e0286b9129f0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1313 microversion: 2.1 time: 0.707196 Jan 22 21:10:31.557928 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1721/3594] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:30 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1313 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:31.838995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c8d866c8-ac6a-46af-bd93-d7ebd4105f14 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:31.844490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c8d866c8-ac6a-46af-bd93-d7ebd4105f14 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:31.855227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8d866c8-ac6a-46af-bd93-d7ebd4105f14 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:31.856329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8d866c8-ac6a-46af-bd93-d7ebd4105f14 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:31.859117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8d866c8-ac6a-46af-bd93-d7ebd4105f14 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:31.860982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8d866c8-ac6a-46af-bd93-d7ebd4105f14 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:32.205226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c8d866c8-ac6a-46af-bd93-d7ebd4105f14 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:32.216718 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c8d866c8-ac6a-46af-bd93-d7ebd4105f14 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1317 microversion: 2.1 time: 0.382249 Jan 22 21:10:32.228309 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1722/3595] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:31 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:32.234655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6aab827a-0dba-4089-9c30-0e5da887ccb9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:32.236425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6aab827a-0dba-4089-9c30-0e5da887ccb9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:32.260129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aab827a-0dba-4089-9c30-0e5da887ccb9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:32.260597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aab827a-0dba-4089-9c30-0e5da887ccb9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:32.270993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aab827a-0dba-4089-9c30-0e5da887ccb9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:32.271708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aab827a-0dba-4089-9c30-0e5da887ccb9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:32.305945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b4a8390e-dca9-42a2-a40c-4414fefb1aca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:32.319852 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b4a8390e-dca9-42a2-a40c-4414fefb1aca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1531 microversion: 2.1 time: 0.991742 Jan 22 21:10:32.340382 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1874/3596] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:31 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1531 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:32.355849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b002af2a-d7ad-41f1-a884-c34e410e01a0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:32.361206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b002af2a-d7ad-41f1-a884-c34e410e01a0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:32.389244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b002af2a-d7ad-41f1-a884-c34e410e01a0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:32.389244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b002af2a-d7ad-41f1-a884-c34e410e01a0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:32.389244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b002af2a-d7ad-41f1-a884-c34e410e01a0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:32.396675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b002af2a-d7ad-41f1-a884-c34e410e01a0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:32.485973 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b002af2a-d7ad-41f1-a884-c34e410e01a0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.137479 Jan 22 21:10:32.487087 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1875/3597] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:32 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:32.495689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a897bfc1-e7dd-469f-9c41-18a82ebcf0ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:32.497359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a897bfc1-e7dd-469f-9c41-18a82ebcf0ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:32.510036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a897bfc1-e7dd-469f-9c41-18a82ebcf0ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:32.511459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a897bfc1-e7dd-469f-9c41-18a82ebcf0ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:32.512475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a897bfc1-e7dd-469f-9c41-18a82ebcf0ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:32.513090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a897bfc1-e7dd-469f-9c41-18a82ebcf0ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:32.610146 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a897bfc1-e7dd-469f-9c41-18a82ebcf0ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.121371 Jan 22 21:10:32.611370 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1876/3598] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:32 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:32.623602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a7b90be4-f228-4d9a-ba50-0a08e820c07f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:32.624729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a7b90be4-f228-4d9a-ba50-0a08e820c07f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:32.639599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7b90be4-f228-4d9a-ba50-0a08e820c07f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:32.642828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7b90be4-f228-4d9a-ba50-0a08e820c07f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:32.645180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7b90be4-f228-4d9a-ba50-0a08e820c07f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:32.649797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7b90be4-f228-4d9a-ba50-0a08e820c07f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:32.725068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6aab827a-0dba-4089-9c30-0e5da887ccb9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:32.746768 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6aab827a-0dba-4089-9c30-0e5da887ccb9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.523180 Jan 22 21:10:32.747965 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1723/3599] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:32 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:32.754743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-86fc6743-eb19-410f-8229-377e612771a5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:32.755883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-86fc6743-eb19-410f-8229-377e612771a5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:32.764272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86fc6743-eb19-410f-8229-377e612771a5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:32.765749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86fc6743-eb19-410f-8229-377e612771a5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:32.768290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86fc6743-eb19-410f-8229-377e612771a5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:32.768988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86fc6743-eb19-410f-8229-377e612771a5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:33.069169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a7b90be4-f228-4d9a-ba50-0a08e820c07f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:33.088503 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a7b90be4-f228-4d9a-ba50-0a08e820c07f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1531 microversion: 2.1 time: 0.472994 Jan 22 21:10:33.100452 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1877/3600] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:32 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1531 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:33.112376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2d7034fe-7dc7-445f-9a74-13fbd3f78fac tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:33.121030 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:33.121030 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:10:33.237304 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2d7034fe-7dc7-445f-9a74-13fbd3f78fac tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/2531b960-168c-4722-ae27-7b97abf976c9" status: 202 len: 0 microversion: 2.1 time: 0.134521 Jan 22 21:10:33.238388 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1878/3601] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:10:33 2022] DELETE /compute/v2.1/flavors/2531b960-168c-4722-ae27-7b97abf976c9 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:33.243430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0bc9a166-0bb4-4861-b9c1-7f6f10aa3884 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:33.244156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0bc9a166-0bb4-4861-b9c1-7f6f10aa3884 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:33.246549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-86fc6743-eb19-410f-8229-377e612771a5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:33.260259 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-86fc6743-eb19-410f-8229-377e612771a5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1313 microversion: 2.1 time: 0.510845 Jan 22 21:10:33.269801 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1724/3602] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:32 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:33.277265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bc9a166-0bb4-4861-b9c1-7f6f10aa3884 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:33.277265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bc9a166-0bb4-4861-b9c1-7f6f10aa3884 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:33.277265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bc9a166-0bb4-4861-b9c1-7f6f10aa3884 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:33.277265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bc9a166-0bb4-4861-b9c1-7f6f10aa3884 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:33.307394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9cb1d225-76b7-4180-80a2-2b7cc79532d9 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:33.376631 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9cb1d225-76b7-4180-80a2-2b7cc79532d9 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.108039 Jan 22 21:10:33.391216 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1725/3603] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:10:33 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:33.408485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bf466d06-e857-451c-9634-f569078ba71e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:33.419744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bf466d06-e857-451c-9634-f569078ba71e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:33.439020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf466d06-e857-451c-9634-f569078ba71e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:33.443253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf466d06-e857-451c-9634-f569078ba71e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:33.444820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf466d06-e857-451c-9634-f569078ba71e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:33.445473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf466d06-e857-451c-9634-f569078ba71e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:33.584825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0bc9a166-0bb4-4861-b9c1-7f6f10aa3884 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:33.595916 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0bc9a166-0bb4-4861-b9c1-7f6f10aa3884 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1317 microversion: 2.1 time: 0.356369 Jan 22 21:10:33.611724 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1879/3604] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:33 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:33.618621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c15d520a-9bb9-430e-8911-aedc2eacaa0b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:33.623258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c15d520a-9bb9-430e-8911-aedc2eacaa0b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:33.636725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bf466d06-e857-451c-9634-f569078ba71e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:33.640644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c15d520a-9bb9-430e-8911-aedc2eacaa0b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:33.641186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c15d520a-9bb9-430e-8911-aedc2eacaa0b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:33.642206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c15d520a-9bb9-430e-8911-aedc2eacaa0b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:33.643263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c15d520a-9bb9-430e-8911-aedc2eacaa0b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:33.649020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bf466d06-e857-451c-9634-f569078ba71e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Old instance type tempest-test_resize_flavor_-832722169, new instance type m1.heat {{(pid=137033) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 21:10:33.667523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bf466d06-e857-451c-9634-f569078ba71e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:10:33.668198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bf466d06-e857-451c-9634-f569078ba71e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:10:33.669971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bf466d06-e857-451c-9634-f569078ba71e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:10:33.673950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bf466d06-e857-451c-9634-f569078ba71e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:10:33.674641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bf466d06-e857-451c-9634-f569078ba71e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:10:33.728083 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c15d520a-9bb9-430e-8911-aedc2eacaa0b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.118327 Jan 22 21:10:33.732456 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1880/3605] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:33 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:33.738177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5110fd6b-f626-4c4b-8ea3-e3380a627476 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:33.740556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5110fd6b-f626-4c4b-8ea3-e3380a627476 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:33.758049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5110fd6b-f626-4c4b-8ea3-e3380a627476 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:33.761577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5110fd6b-f626-4c4b-8ea3-e3380a627476 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:33.764816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5110fd6b-f626-4c4b-8ea3-e3380a627476 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:33.765358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5110fd6b-f626-4c4b-8ea3-e3380a627476 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:33.845669 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5110fd6b-f626-4c4b-8ea3-e3380a627476 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.114743 Jan 22 21:10:33.846736 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1881/3606] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:33 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:33.853131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f3cc6afc-bf41-4aa3-986b-3edcc5b5a47b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:33.855793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f3cc6afc-bf41-4aa3-986b-3edcc5b5a47b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:33.873765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3cc6afc-bf41-4aa3-986b-3edcc5b5a47b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:33.874497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3cc6afc-bf41-4aa3-986b-3edcc5b5a47b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:33.875461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3cc6afc-bf41-4aa3-986b-3edcc5b5a47b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:33.877077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3cc6afc-bf41-4aa3-986b-3edcc5b5a47b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:34.133902 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bf466d06-e857-451c-9634-f569078ba71e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "POST /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8/action" status: 202 len: 0 microversion: 2.1 time: 0.739513 Jan 22 21:10:34.142649 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1726/3607] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:33 2022] POST /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8/action => generated 0 bytes in 745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:34.164158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-82e7930a-9d7b-4131-92e0-affeb7522cd0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:34.166920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-82e7930a-9d7b-4131-92e0-affeb7522cd0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:34.196907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82e7930a-9d7b-4131-92e0-affeb7522cd0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:34.198815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82e7930a-9d7b-4131-92e0-affeb7522cd0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:34.202881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82e7930a-9d7b-4131-92e0-affeb7522cd0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:34.206107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82e7930a-9d7b-4131-92e0-affeb7522cd0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:34.336871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f3cc6afc-bf41-4aa3-986b-3edcc5b5a47b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:34.349418 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f3cc6afc-bf41-4aa3-986b-3edcc5b5a47b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.501170 Jan 22 21:10:34.350136 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1882/3608] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:33 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:34.357452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bae080d3-fdbd-4b63-9b02-e9b1f5afbcb7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:34.358490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bae080d3-fdbd-4b63-9b02-e9b1f5afbcb7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:34.366851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bae080d3-fdbd-4b63-9b02-e9b1f5afbcb7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:34.367554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bae080d3-fdbd-4b63-9b02-e9b1f5afbcb7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:34.369050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bae080d3-fdbd-4b63-9b02-e9b1f5afbcb7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:34.370018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bae080d3-fdbd-4b63-9b02-e9b1f5afbcb7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:34.636470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bae080d3-fdbd-4b63-9b02-e9b1f5afbcb7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:34.656427 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bae080d3-fdbd-4b63-9b02-e9b1f5afbcb7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1313 microversion: 2.1 time: 0.304819 Jan 22 21:10:34.658203 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1883/3609] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:34 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:34.673125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3b052320-dffc-4d4a-9ba6-ed69d7db7caf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:34.674313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3b052320-dffc-4d4a-9ba6-ed69d7db7caf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:34.702954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b052320-dffc-4d4a-9ba6-ed69d7db7caf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:34.704834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b052320-dffc-4d4a-9ba6-ed69d7db7caf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:34.708877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b052320-dffc-4d4a-9ba6-ed69d7db7caf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:34.711122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b052320-dffc-4d4a-9ba6-ed69d7db7caf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:34.947971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3b052320-dffc-4d4a-9ba6-ed69d7db7caf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:34.957818 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3b052320-dffc-4d4a-9ba6-ed69d7db7caf tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1317 microversion: 2.1 time: 0.297979 Jan 22 21:10:34.967264 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1884/3610] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:34 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:34.980961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-28acc12a-7948-44df-8c8d-3a16f351ef48 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:34.984067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-28acc12a-7948-44df-8c8d-3a16f351ef48 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:34.996855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28acc12a-7948-44df-8c8d-3a16f351ef48 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:34.998067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28acc12a-7948-44df-8c8d-3a16f351ef48 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:34.998994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28acc12a-7948-44df-8c8d-3a16f351ef48 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:34.999448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28acc12a-7948-44df-8c8d-3a16f351ef48 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:35.001025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-82e7930a-9d7b-4131-92e0-affeb7522cd0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:35.010486 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-82e7930a-9d7b-4131-92e0-affeb7522cd0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1540 microversion: 2.1 time: 0.865616 Jan 22 21:10:35.012046 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1727/3611] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:34 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1540 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:35.017899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b21e57bf-7f26-4fb6-8312-612cb3706960 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:35.019120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b21e57bf-7f26-4fb6-8312-612cb3706960 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:35.026000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b21e57bf-7f26-4fb6-8312-612cb3706960 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:35.034209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b21e57bf-7f26-4fb6-8312-612cb3706960 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:35.034209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b21e57bf-7f26-4fb6-8312-612cb3706960 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:35.034209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b21e57bf-7f26-4fb6-8312-612cb3706960 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:35.133798 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b21e57bf-7f26-4fb6-8312-612cb3706960 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.120233 Jan 22 21:10:35.134840 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1728/3612] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:35 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:35.294094 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-28acc12a-7948-44df-8c8d-3a16f351ef48 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.325189 Jan 22 21:10:35.296948 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1885/3613] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:34 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:35.370762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1f3de51b-eb1d-415c-95f5-362753d7c847 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:35.371480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1f3de51b-eb1d-415c-95f5-362753d7c847 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:35.442757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f3de51b-eb1d-415c-95f5-362753d7c847 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:35.443252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f3de51b-eb1d-415c-95f5-362753d7c847 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:35.444203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f3de51b-eb1d-415c-95f5-362753d7c847 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:35.444740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f3de51b-eb1d-415c-95f5-362753d7c847 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:35.676811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fcb7b81c-b85e-4d27-b166-727483d5db8f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:35.678137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fcb7b81c-b85e-4d27-b166-727483d5db8f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:35.721667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcb7b81c-b85e-4d27-b166-727483d5db8f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:35.733861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcb7b81c-b85e-4d27-b166-727483d5db8f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:35.735246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcb7b81c-b85e-4d27-b166-727483d5db8f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:35.735906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcb7b81c-b85e-4d27-b166-727483d5db8f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:36.009390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1f3de51b-eb1d-415c-95f5-362753d7c847 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:36.027917 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1f3de51b-eb1d-415c-95f5-362753d7c847 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.663085 Jan 22 21:10:36.031934 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1729/3614] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:35 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:36.048795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-452268c8-2a85-43d7-8e1f-e91cad561f08 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:36.054061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-452268c8-2a85-43d7-8e1f-e91cad561f08 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:36.079727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-452268c8-2a85-43d7-8e1f-e91cad561f08 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:36.084748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-452268c8-2a85-43d7-8e1f-e91cad561f08 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:36.095559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-452268c8-2a85-43d7-8e1f-e91cad561f08 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:36.096281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-452268c8-2a85-43d7-8e1f-e91cad561f08 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:36.171326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fcb7b81c-b85e-4d27-b166-727483d5db8f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:36.194726 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fcb7b81c-b85e-4d27-b166-727483d5db8f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1313 microversion: 2.1 time: 0.521940 Jan 22 21:10:36.214389 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1886/3615] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:35 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:36.230884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-df4172b8-5559-4b04-a0e0-422e1ca8748f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:36.235892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-df4172b8-5559-4b04-a0e0-422e1ca8748f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:36.259450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df4172b8-5559-4b04-a0e0-422e1ca8748f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:36.260273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df4172b8-5559-4b04-a0e0-422e1ca8748f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:36.264511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df4172b8-5559-4b04-a0e0-422e1ca8748f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:36.269865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df4172b8-5559-4b04-a0e0-422e1ca8748f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:36.692849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-df4172b8-5559-4b04-a0e0-422e1ca8748f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:36.709403 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-df4172b8-5559-4b04-a0e0-422e1ca8748f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1540 microversion: 2.1 time: 0.490296 Jan 22 21:10:36.720889 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1887/3616] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:36 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1540 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:36.735073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7618327f-b444-4e4c-aa03-e341c9deccab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:36.737633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7618327f-b444-4e4c-aa03-e341c9deccab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:36.755631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7618327f-b444-4e4c-aa03-e341c9deccab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:36.758231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7618327f-b444-4e4c-aa03-e341c9deccab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:36.759289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7618327f-b444-4e4c-aa03-e341c9deccab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:36.763543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7618327f-b444-4e4c-aa03-e341c9deccab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:36.877970 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7618327f-b444-4e4c-aa03-e341c9deccab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.154250 Jan 22 21:10:36.879044 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1888/3617] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:36 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:37.174534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e3c6cf7e-1237-4eb8-83ad-7a21fbb85f3b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:37.175535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e3c6cf7e-1237-4eb8-83ad-7a21fbb85f3b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:37.199836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3c6cf7e-1237-4eb8-83ad-7a21fbb85f3b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:37.200905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3c6cf7e-1237-4eb8-83ad-7a21fbb85f3b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:37.202455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3c6cf7e-1237-4eb8-83ad-7a21fbb85f3b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:37.202911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3c6cf7e-1237-4eb8-83ad-7a21fbb85f3b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:37.301785 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e3c6cf7e-1237-4eb8-83ad-7a21fbb85f3b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.419928 Jan 22 21:10:37.302514 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1889/3618] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:36 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:37.308237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c37e0eba-3d03-41c5-80ee-c93a4cef937b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:37.309030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c37e0eba-3d03-41c5-80ee-c93a4cef937b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:37.318720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c37e0eba-3d03-41c5-80ee-c93a4cef937b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:37.319281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c37e0eba-3d03-41c5-80ee-c93a4cef937b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:37.320607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c37e0eba-3d03-41c5-80ee-c93a4cef937b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:37.323077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c37e0eba-3d03-41c5-80ee-c93a4cef937b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:37.477033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-452268c8-2a85-43d7-8e1f-e91cad561f08 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:37.488459 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-452268c8-2a85-43d7-8e1f-e91cad561f08 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1317 microversion: 2.1 time: 1.450084 Jan 22 21:10:37.489345 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1730/3619] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:36 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1317 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:37.500368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-16c77f88-9915-41e8-be8b-4bdfb7e722c7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:37.502164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-16c77f88-9915-41e8-be8b-4bdfb7e722c7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:37.530370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16c77f88-9915-41e8-be8b-4bdfb7e722c7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:37.531050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16c77f88-9915-41e8-be8b-4bdfb7e722c7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:37.532025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16c77f88-9915-41e8-be8b-4bdfb7e722c7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:37.532661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16c77f88-9915-41e8-be8b-4bdfb7e722c7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:37.625960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c37e0eba-3d03-41c5-80ee-c93a4cef937b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:37.638926 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c37e0eba-3d03-41c5-80ee-c93a4cef937b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.332075 Jan 22 21:10:37.639966 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1890/3620] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:37 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:37.730050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f39b1cf-b487-4134-a539-3f9d71da9c90 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:37.732169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f39b1cf-b487-4134-a539-3f9d71da9c90 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:37.745124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f39b1cf-b487-4134-a539-3f9d71da9c90 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:37.745124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f39b1cf-b487-4134-a539-3f9d71da9c90 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:37.746157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f39b1cf-b487-4134-a539-3f9d71da9c90 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:37.746808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f39b1cf-b487-4134-a539-3f9d71da9c90 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:38.006950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-16c77f88-9915-41e8-be8b-4bdfb7e722c7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:38.022176 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-16c77f88-9915-41e8-be8b-4bdfb7e722c7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1313 microversion: 2.1 time: 0.530039 Jan 22 21:10:38.034527 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1731/3621] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:37 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:38.040972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-7c20c8c5-1d1f-4adf-b3ea-a3ea891414a6 req-f684ccb2-4708-492c-8af4-93c5b6270631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e4b1a45-6907-44b8-9395-4d44ffeb22b7", "name": "network-vif-plugged", "status": "completed", "tag": "5a16f93a-5ed1-47ab-8e02-3cb97602034e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:38.065810 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:38.065810 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:10:38.078765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7c20c8c5-1d1f-4adf-b3ea-a3ea891414a6 req-f684ccb2-4708-492c-8af4-93c5b6270631 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:38.081130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7c20c8c5-1d1f-4adf-b3ea-a3ea891414a6 req-f684ccb2-4708-492c-8af4-93c5b6270631 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:38.132397 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-7c20c8c5-1d1f-4adf-b3ea-a3ea891414a6 req-f684ccb2-4708-492c-8af4-93c5b6270631 service nova] Creating event network-vif-plugged:5a16f93a-5ed1-47ab-8e02-3cb97602034e for instance 0e4b1a45-6907-44b8-9395-4d44ffeb22b7 on nch2-master-1 Jan 22 21:10:38.160334 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-7c20c8c5-1d1f-4adf-b3ea-a3ea891414a6 req-f684ccb2-4708-492c-8af4-93c5b6270631 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124190 Jan 22 21:10:38.161133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f39b1cf-b487-4134-a539-3f9d71da9c90 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:38.161972 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1732/3622] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:10:38.176018 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f39b1cf-b487-4134-a539-3f9d71da9c90 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1540 microversion: 2.1 time: 0.451131 Jan 22 21:10:38.187581 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1891/3623] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:37 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1540 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:38.194162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-04532615-cc8d-40be-8aaa-6d7a4424afef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:38.197222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-04532615-cc8d-40be-8aaa-6d7a4424afef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:38.220812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04532615-cc8d-40be-8aaa-6d7a4424afef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:38.229427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04532615-cc8d-40be-8aaa-6d7a4424afef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:38.229427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04532615-cc8d-40be-8aaa-6d7a4424afef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:38.229427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04532615-cc8d-40be-8aaa-6d7a4424afef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:38.314953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-63f8a54d-0da3-4ed5-9608-36788dcef0e3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:38.316371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-63f8a54d-0da3-4ed5-9608-36788dcef0e3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:38.324245 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-04532615-cc8d-40be-8aaa-6d7a4424afef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.145031 Jan 22 21:10:38.333104 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1733/3624] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:38 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:38.336923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63f8a54d-0da3-4ed5-9608-36788dcef0e3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:38.338159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63f8a54d-0da3-4ed5-9608-36788dcef0e3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:38.342455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63f8a54d-0da3-4ed5-9608-36788dcef0e3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:38.343355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63f8a54d-0da3-4ed5-9608-36788dcef0e3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:38.410474 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-63f8a54d-0da3-4ed5-9608-36788dcef0e3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.100311 Jan 22 21:10:38.411722 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1892/3625] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:38 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:38.511505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-83a3dc50-b76d-4b49-9e98-378401b3261e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:38.513170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-83a3dc50-b76d-4b49-9e98-378401b3261e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:38.524341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83a3dc50-b76d-4b49-9e98-378401b3261e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:38.526546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83a3dc50-b76d-4b49-9e98-378401b3261e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:38.527666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83a3dc50-b76d-4b49-9e98-378401b3261e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:38.528420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83a3dc50-b76d-4b49-9e98-378401b3261e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:38.656765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a5f260c-1768-48fc-982c-f4488c0b0ccc tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:38.658153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a5f260c-1768-48fc-982c-f4488c0b0ccc tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:38.673653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a5f260c-1768-48fc-982c-f4488c0b0ccc tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:38.675707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a5f260c-1768-48fc-982c-f4488c0b0ccc tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:38.688708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a5f260c-1768-48fc-982c-f4488c0b0ccc tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:38.689841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a5f260c-1768-48fc-982c-f4488c0b0ccc tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:38.907871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-83a3dc50-b76d-4b49-9e98-378401b3261e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:38.914954 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-83a3dc50-b76d-4b49-9e98-378401b3261e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1317 microversion: 2.1 time: 0.410793 Jan 22 21:10:38.921946 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1734/3626] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:38 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:39.041098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-968c268e-9f1b-466f-a993-60c8731ae94e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:39.042152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-968c268e-9f1b-466f-a993-60c8731ae94e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:39.055638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-968c268e-9f1b-466f-a993-60c8731ae94e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:39.056087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-968c268e-9f1b-466f-a993-60c8731ae94e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:39.056907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-968c268e-9f1b-466f-a993-60c8731ae94e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:39.057354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-968c268e-9f1b-466f-a993-60c8731ae94e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:39.071243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6a5f260c-1768-48fc-982c-f4488c0b0ccc tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:39.081269 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a5f260c-1768-48fc-982c-f4488c0b0ccc tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.428095 Jan 22 21:10:39.092652 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1893/3627] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:38 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:39.196987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f9006bed-34e9-4415-a781-1bbc4e7ed7e2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:39.198017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f9006bed-34e9-4415-a781-1bbc4e7ed7e2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:39.219696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9006bed-34e9-4415-a781-1bbc4e7ed7e2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:39.229168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9006bed-34e9-4415-a781-1bbc4e7ed7e2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:39.234971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9006bed-34e9-4415-a781-1bbc4e7ed7e2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:39.241943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9006bed-34e9-4415-a781-1bbc4e7ed7e2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:39.632080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-968c268e-9f1b-466f-a993-60c8731ae94e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:39.655350 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-968c268e-9f1b-466f-a993-60c8731ae94e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1313 microversion: 2.1 time: 0.618014 Jan 22 21:10:39.665992 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1735/3628] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:39 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1313 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:39.670899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f9006bed-34e9-4415-a781-1bbc4e7ed7e2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:39.679185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fd7ac4e0-d904-4c02-8866-b738ecea9848 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:39.682722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fd7ac4e0-d904-4c02-8866-b738ecea9848 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:39.693427 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f9006bed-34e9-4415-a781-1bbc4e7ed7e2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1540 microversion: 2.1 time: 0.499313 Jan 22 21:10:39.694975 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1894/3629] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:39 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1540 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:39.696947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd7ac4e0-d904-4c02-8866-b738ecea9848 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:39.699191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd7ac4e0-d904-4c02-8866-b738ecea9848 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:39.700306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd7ac4e0-d904-4c02-8866-b738ecea9848 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:39.702353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd7ac4e0-d904-4c02-8866-b738ecea9848 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:39.715379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-99339760-dd9f-4902-96d9-3422ab2617f7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:39.722532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-99339760-dd9f-4902-96d9-3422ab2617f7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:39.749174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99339760-dd9f-4902-96d9-3422ab2617f7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:39.750053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99339760-dd9f-4902-96d9-3422ab2617f7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:39.752336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99339760-dd9f-4902-96d9-3422ab2617f7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:39.752949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99339760-dd9f-4902-96d9-3422ab2617f7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:39.829783 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fd7ac4e0-d904-4c02-8866-b738ecea9848 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.161669 Jan 22 21:10:39.831751 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1736/3630] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:39 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:39.874954 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-99339760-dd9f-4902-96d9-3422ab2617f7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.178543 Jan 22 21:10:39.877630 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1895/3631] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:39 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:39.939155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1a291449-f751-4d03-8757-c5d867dcf3ad tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:39.939155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1a291449-f751-4d03-8757-c5d867dcf3ad tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:39.962363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a291449-f751-4d03-8757-c5d867dcf3ad tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:39.962845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a291449-f751-4d03-8757-c5d867dcf3ad tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:39.963670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a291449-f751-4d03-8757-c5d867dcf3ad tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:39.964117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a291449-f751-4d03-8757-c5d867dcf3ad tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:40.099985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-59edb71f-40d6-443a-8025-557b2c993b30 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:40.101741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-59edb71f-40d6-443a-8025-557b2c993b30 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:40.136939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59edb71f-40d6-443a-8025-557b2c993b30 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:40.142055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59edb71f-40d6-443a-8025-557b2c993b30 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:40.149944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59edb71f-40d6-443a-8025-557b2c993b30 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:40.151678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59edb71f-40d6-443a-8025-557b2c993b30 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:40.481543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1a291449-f751-4d03-8757-c5d867dcf3ad tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:40.503646 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1a291449-f751-4d03-8757-c5d867dcf3ad tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1317 microversion: 2.1 time: 0.569812 Jan 22 21:10:40.518537 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1737/3632] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:39 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:40.530752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-8687bb6b-e319-41c3-b491-ebca19552f8b req-43a2827d-2935-4075-96dc-ad6c8c7d2c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da69aec5-3978-4803-b644-988cc15608db", "name": "network-vif-plugged", "status": "completed", "tag": "af2f4a08-c004-4922-8159-98b9ae008e00"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:40.533315 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:40.533315 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:10:40.571785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8687bb6b-e319-41c3-b491-ebca19552f8b req-43a2827d-2935-4075-96dc-ad6c8c7d2c98 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:40.572569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8687bb6b-e319-41c3-b491-ebca19552f8b req-43a2827d-2935-4075-96dc-ad6c8c7d2c98 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:40.605259 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8687bb6b-e319-41c3-b491-ebca19552f8b req-43a2827d-2935-4075-96dc-ad6c8c7d2c98 service nova] Creating event network-vif-plugged:af2f4a08-c004-4922-8159-98b9ae008e00 for instance da69aec5-3978-4803-b644-988cc15608db on nch1-master-1 Jan 22 21:10:40.617183 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-8687bb6b-e319-41c3-b491-ebca19552f8b req-43a2827d-2935-4075-96dc-ad6c8c7d2c98 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096717 Jan 22 21:10:40.620088 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1738/3633] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:10:40.680534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e26b821c-922d-48e0-a739-993f538bcff9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:40.682222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e26b821c-922d-48e0-a739-993f538bcff9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:40.696533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e26b821c-922d-48e0-a739-993f538bcff9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:40.700860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e26b821c-922d-48e0-a739-993f538bcff9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:40.703102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e26b821c-922d-48e0-a739-993f538bcff9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:40.706073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e26b821c-922d-48e0-a739-993f538bcff9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:41.006196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-59edb71f-40d6-443a-8025-557b2c993b30 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:41.017537 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-59edb71f-40d6-443a-8025-557b2c993b30 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.922300 Jan 22 21:10:41.019347 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1896/3634] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:40 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:41.025880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-806ccc8f-82e3-4e2d-be6e-892f979313cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:41.026739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-806ccc8f-82e3-4e2d-be6e-892f979313cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:41.038729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-806ccc8f-82e3-4e2d-be6e-892f979313cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:41.046788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-806ccc8f-82e3-4e2d-be6e-892f979313cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:41.046788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-806ccc8f-82e3-4e2d-be6e-892f979313cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:41.046788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-806ccc8f-82e3-4e2d-be6e-892f979313cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:41.339145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-806ccc8f-82e3-4e2d-be6e-892f979313cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:41.346716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e26b821c-922d-48e0-a739-993f538bcff9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:41.347850 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-806ccc8f-82e3-4e2d-be6e-892f979313cc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1540 microversion: 2.1 time: 0.326462 Jan 22 21:10:41.360973 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e26b821c-922d-48e0-a739-993f538bcff9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1492 microversion: 2.1 time: 0.681561 Jan 22 21:10:41.362198 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1897/3635] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:41 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1540 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:41.365846 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1739/3636] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:40 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1492 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:41.386745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5ef99ad7-4572-48ff-9e53-52d7c02d942b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:41.396265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e4a5ebc0-fd28-4084-9d04-e6636319f19d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:41.399922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5ef99ad7-4572-48ff-9e53-52d7c02d942b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:41.400489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e4a5ebc0-fd28-4084-9d04-e6636319f19d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:41.415645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4a5ebc0-fd28-4084-9d04-e6636319f19d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:41.417621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4a5ebc0-fd28-4084-9d04-e6636319f19d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:41.419640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4a5ebc0-fd28-4084-9d04-e6636319f19d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:41.420536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ef99ad7-4572-48ff-9e53-52d7c02d942b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:41.421005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ef99ad7-4572-48ff-9e53-52d7c02d942b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:41.425148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4a5ebc0-fd28-4084-9d04-e6636319f19d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:41.427610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ef99ad7-4572-48ff-9e53-52d7c02d942b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:41.429892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ef99ad7-4572-48ff-9e53-52d7c02d942b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:41.519859 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5ef99ad7-4572-48ff-9e53-52d7c02d942b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.154824 Jan 22 21:10:41.521180 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1898/3637] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:41 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:41.531424 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e4a5ebc0-fd28-4084-9d04-e6636319f19d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.159706 Jan 22 21:10:41.532179 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1740/3638] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:41 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:41.537542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-882aed79-43e3-4875-8ff2-19bf2e05b3fb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:41.542632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-882aed79-43e3-4875-8ff2-19bf2e05b3fb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:41.548665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2746f9eb-37ad-4288-99f6-83e8e9dc2f6d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:41.551690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2746f9eb-37ad-4288-99f6-83e8e9dc2f6d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:41.560069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-882aed79-43e3-4875-8ff2-19bf2e05b3fb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:41.561748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-882aed79-43e3-4875-8ff2-19bf2e05b3fb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:41.564069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-882aed79-43e3-4875-8ff2-19bf2e05b3fb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:41.564592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-882aed79-43e3-4875-8ff2-19bf2e05b3fb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:41.568289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2746f9eb-37ad-4288-99f6-83e8e9dc2f6d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:41.568614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2746f9eb-37ad-4288-99f6-83e8e9dc2f6d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:41.569434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2746f9eb-37ad-4288-99f6-83e8e9dc2f6d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:41.569927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2746f9eb-37ad-4288-99f6-83e8e9dc2f6d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:41.820760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2746f9eb-37ad-4288-99f6-83e8e9dc2f6d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:41.829018 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2746f9eb-37ad-4288-99f6-83e8e9dc2f6d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1317 microversion: 2.1 time: 0.293827 Jan 22 21:10:41.848522 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1741/3639] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:41 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:42.043047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8fc843c3-235a-4700-baf0-cf909baf598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:42.044803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8fc843c3-235a-4700-baf0-cf909baf598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:42.065158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fc843c3-235a-4700-baf0-cf909baf598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:42.065852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fc843c3-235a-4700-baf0-cf909baf598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:42.067918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fc843c3-235a-4700-baf0-cf909baf598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:42.070409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fc843c3-235a-4700-baf0-cf909baf598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:42.252185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-882aed79-43e3-4875-8ff2-19bf2e05b3fb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:42.275518 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-882aed79-43e3-4875-8ff2-19bf2e05b3fb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1492 microversion: 2.1 time: 0.753401 Jan 22 21:10:42.280235 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1899/3640] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:41 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1492 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:42.321135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fa6cfd7b-bb81-405d-baa0-831d54900da7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:42.324525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fa6cfd7b-bb81-405d-baa0-831d54900da7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:42.381496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa6cfd7b-bb81-405d-baa0-831d54900da7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:42.402956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa6cfd7b-bb81-405d-baa0-831d54900da7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:42.412089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa6cfd7b-bb81-405d-baa0-831d54900da7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:42.414408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa6cfd7b-bb81-405d-baa0-831d54900da7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:42.507032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8fc843c3-235a-4700-baf0-cf909baf598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:42.515972 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8fc843c3-235a-4700-baf0-cf909baf598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.478647 Jan 22 21:10:42.516571 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1742/3641] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:42 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:42.539740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ae7e8d5-cd84-428e-a790-4d645259f973 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:42.541764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ae7e8d5-cd84-428e-a790-4d645259f973 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:42.564740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ae7e8d5-cd84-428e-a790-4d645259f973 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:42.564740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ae7e8d5-cd84-428e-a790-4d645259f973 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:42.564740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ae7e8d5-cd84-428e-a790-4d645259f973 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:42.571244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ae7e8d5-cd84-428e-a790-4d645259f973 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:42.921724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8ae7e8d5-cd84-428e-a790-4d645259f973 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:42.935471 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ae7e8d5-cd84-428e-a790-4d645259f973 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1545 microversion: 2.1 time: 0.400805 Jan 22 21:10:42.939418 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1743/3642] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:42 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1545 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:42.944352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a8825d86-7867-44b0-89d6-6f70a249bcc5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:42.946176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a8825d86-7867-44b0-89d6-6f70a249bcc5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:42.946302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fa6cfd7b-bb81-405d-baa0-831d54900da7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:42.958938 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fa6cfd7b-bb81-405d-baa0-831d54900da7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1492 microversion: 2.1 time: 0.664979 Jan 22 21:10:42.960130 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1900/3643] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:42 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1492 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:42.965298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-402e51ac-cf75-495c-89f8-4945b5f3db61 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:42.967376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-402e51ac-cf75-495c-89f8-4945b5f3db61 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:42.974152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-402e51ac-cf75-495c-89f8-4945b5f3db61 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:42.974919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-402e51ac-cf75-495c-89f8-4945b5f3db61 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:42.976024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-402e51ac-cf75-495c-89f8-4945b5f3db61 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:42.976690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-402e51ac-cf75-495c-89f8-4945b5f3db61 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:42.979879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8825d86-7867-44b0-89d6-6f70a249bcc5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:42.980353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8825d86-7867-44b0-89d6-6f70a249bcc5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:42.981172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8825d86-7867-44b0-89d6-6f70a249bcc5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:42.981719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8825d86-7867-44b0-89d6-6f70a249bcc5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:43.043416 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-402e51ac-cf75-495c-89f8-4945b5f3db61 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.081795 Jan 22 21:10:43.055202 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1901/3644] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:42 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:43.063287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d77bb638-032b-4d81-a126-48b913687c46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:43.067363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d77bb638-032b-4d81-a126-48b913687c46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:43.068084 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a8825d86-7867-44b0-89d6-6f70a249bcc5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.124175 Jan 22 21:10:43.073404 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1744/3645] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:42 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:43.079406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-498e3b4b-86ec-4bed-b477-f23e5e7bc3ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:43.082075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d77bb638-032b-4d81-a126-48b913687c46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:43.084714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d77bb638-032b-4d81-a126-48b913687c46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:43.084963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-498e3b4b-86ec-4bed-b477-f23e5e7bc3ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:43.087245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d77bb638-032b-4d81-a126-48b913687c46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:43.088092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d77bb638-032b-4d81-a126-48b913687c46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:43.102657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-498e3b4b-86ec-4bed-b477-f23e5e7bc3ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:43.104480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-498e3b4b-86ec-4bed-b477-f23e5e7bc3ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:43.108778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-498e3b4b-86ec-4bed-b477-f23e5e7bc3ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:43.109454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-498e3b4b-86ec-4bed-b477-f23e5e7bc3ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:43.181768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-498e3b4b-86ec-4bed-b477-f23e5e7bc3ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:10:43.441183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d77bb638-032b-4d81-a126-48b913687c46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:43.487764 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d77bb638-032b-4d81-a126-48b913687c46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1503 microversion: 2.1 time: 0.400311 Jan 22 21:10:43.487764 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1902/3646] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:43 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1503 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:43.507060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b4994908-e81f-4403-ad0a-f0ccfe0205e5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:43.507060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b4994908-e81f-4403-ad0a-f0ccfe0205e5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:43.514880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4994908-e81f-4403-ad0a-f0ccfe0205e5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:43.516140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4994908-e81f-4403-ad0a-f0ccfe0205e5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:43.517032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4994908-e81f-4403-ad0a-f0ccfe0205e5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:43.518058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4994908-e81f-4403-ad0a-f0ccfe0205e5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:43.583022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-b4994908-e81f-4403-ad0a-f0ccfe0205e5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lazy-loading 'flavor' on Instance uuid da69aec5-3978-4803-b644-988cc15608db {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:10:43.820308 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-498e3b4b-86ec-4bed-b477-f23e5e7bc3ab tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 204 len: 0 microversion: 2.1 time: 0.745302 Jan 22 21:10:43.825535 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1745/3647] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:10:43 2022] DELETE /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:10:43.831777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2ca9b8ae-1907-4911-9132-6f21ee37890e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:43.838281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2ca9b8ae-1907-4911-9132-6f21ee37890e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:43.862185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ca9b8ae-1907-4911-9132-6f21ee37890e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:43.866984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ca9b8ae-1907-4911-9132-6f21ee37890e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:43.866984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ca9b8ae-1907-4911-9132-6f21ee37890e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:43.866984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ca9b8ae-1907-4911-9132-6f21ee37890e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:44.088683 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b4994908-e81f-4403-ad0a-f0ccfe0205e5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "POST /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db/action" status: 200 len: 32 microversion: 2.1 time: 0.592932 Jan 22 21:10:44.089666 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1903/3648] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:43 2022] POST /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db/action => generated 32 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:10:44.128027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fd8d04a4-2faa-4760-858e-5a3bfa30fdbb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:44.130044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fd8d04a4-2faa-4760-858e-5a3bfa30fdbb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:44.194162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd8d04a4-2faa-4760-858e-5a3bfa30fdbb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:44.194934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd8d04a4-2faa-4760-858e-5a3bfa30fdbb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:44.198047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd8d04a4-2faa-4760-858e-5a3bfa30fdbb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:44.200722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd8d04a4-2faa-4760-858e-5a3bfa30fdbb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:44.588675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fd8d04a4-2faa-4760-858e-5a3bfa30fdbb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:44.626908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2ca9b8ae-1907-4911-9132-6f21ee37890e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:44.646931 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2ca9b8ae-1907-4911-9132-6f21ee37890e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.813144 Jan 22 21:10:44.646931 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1746/3649] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:43 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:44.648394 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fd8d04a4-2faa-4760-858e-5a3bfa30fdbb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1498 microversion: 2.1 time: 0.545915 Jan 22 21:10:44.650933 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1904/3650] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:44 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1498 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:44.677844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-056b06dd-528d-4303-aa5a-dc9c81bbfb02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:44.677844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-056b06dd-528d-4303-aa5a-dc9c81bbfb02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:44.686323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fd375339-59f2-4c9f-895b-598369aafcec tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:44.688074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fd375339-59f2-4c9f-895b-598369aafcec tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:44.697085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd375339-59f2-4c9f-895b-598369aafcec tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:44.700738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-056b06dd-528d-4303-aa5a-dc9c81bbfb02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:44.701718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd375339-59f2-4c9f-895b-598369aafcec tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:44.702760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd375339-59f2-4c9f-895b-598369aafcec tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:44.703421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-056b06dd-528d-4303-aa5a-dc9c81bbfb02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:44.704631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-056b06dd-528d-4303-aa5a-dc9c81bbfb02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:44.706235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd375339-59f2-4c9f-895b-598369aafcec tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:44.706804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-056b06dd-528d-4303-aa5a-dc9c81bbfb02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:44.810797 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fd375339-59f2-4c9f-895b-598369aafcec tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.152458 Jan 22 21:10:44.816834 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1905/3651] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:44 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:44.830834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-350046f3-febc-49ac-9c8f-3bc530b12e11 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:44.832711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-350046f3-febc-49ac-9c8f-3bc530b12e11 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:44.850245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-350046f3-febc-49ac-9c8f-3bc530b12e11 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:44.853586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-350046f3-febc-49ac-9c8f-3bc530b12e11 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:44.855035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-350046f3-febc-49ac-9c8f-3bc530b12e11 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:44.857198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-350046f3-febc-49ac-9c8f-3bc530b12e11 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:44.931003 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-350046f3-febc-49ac-9c8f-3bc530b12e11 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.112737 Jan 22 21:10:44.935026 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1906/3652] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:44 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:44.940041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-65cbd0f5-d660-49d8-b26e-b6ad31287e34 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:44.941200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-65cbd0f5-d660-49d8-b26e-b6ad31287e34 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:44.950828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65cbd0f5-d660-49d8-b26e-b6ad31287e34 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:44.951787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65cbd0f5-d660-49d8-b26e-b6ad31287e34 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:44.953872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65cbd0f5-d660-49d8-b26e-b6ad31287e34 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:44.954833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65cbd0f5-d660-49d8-b26e-b6ad31287e34 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:45.265543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-65cbd0f5-d660-49d8-b26e-b6ad31287e34 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:45.280628 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-65cbd0f5-d660-49d8-b26e-b6ad31287e34 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.346317 Jan 22 21:10:45.289869 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1907/3653] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:44 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:45.342611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-056b06dd-528d-4303-aa5a-dc9c81bbfb02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:45.353443 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-056b06dd-528d-4303-aa5a-dc9c81bbfb02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1545 microversion: 2.1 time: 0.706071 Jan 22 21:10:45.363499 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1747/3654] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:44 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1545 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:45.660970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bfd09b8c-9255-4930-9c5c-00ac8a1aeca4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:45.662375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bfd09b8c-9255-4930-9c5c-00ac8a1aeca4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:45.676156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f55e3e39-7658-469b-8a25-f4c1ac047a48 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:45.677421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f55e3e39-7658-469b-8a25-f4c1ac047a48 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:45.692240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bfd09b8c-9255-4930-9c5c-00ac8a1aeca4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:45.694578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bfd09b8c-9255-4930-9c5c-00ac8a1aeca4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:45.698070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bfd09b8c-9255-4930-9c5c-00ac8a1aeca4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:45.699089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bfd09b8c-9255-4930-9c5c-00ac8a1aeca4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:45.703157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f55e3e39-7658-469b-8a25-f4c1ac047a48 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:45.703630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f55e3e39-7658-469b-8a25-f4c1ac047a48 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:45.718589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f55e3e39-7658-469b-8a25-f4c1ac047a48 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:45.719206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f55e3e39-7658-469b-8a25-f4c1ac047a48 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:46.467689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f55e3e39-7658-469b-8a25-f4c1ac047a48 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:46.477298 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f55e3e39-7658-469b-8a25-f4c1ac047a48 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1498 microversion: 2.1 time: 0.807768 Jan 22 21:10:46.486518 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1748/3655] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:45 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1498 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:46.499317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c58451f3-9818-4749-90b7-9b8c95d56a07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:46.500622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c58451f3-9818-4749-90b7-9b8c95d56a07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:46.523170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c58451f3-9818-4749-90b7-9b8c95d56a07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:46.523825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c58451f3-9818-4749-90b7-9b8c95d56a07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:46.524811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c58451f3-9818-4749-90b7-9b8c95d56a07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:46.530023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c58451f3-9818-4749-90b7-9b8c95d56a07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:46.657323 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c58451f3-9818-4749-90b7-9b8c95d56a07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.163273 Jan 22 21:10:46.664980 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1749/3656] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:46 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:46.683146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bfd09b8c-9255-4930-9c5c-00ac8a1aeca4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:46.684257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f3540209-9fa4-47ff-a84f-34e09d93b41b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:46.686189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f3540209-9fa4-47ff-a84f-34e09d93b41b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:46.699223 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bfd09b8c-9255-4930-9c5c-00ac8a1aeca4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 1.042499 Jan 22 21:10:46.703819 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1908/3657] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:45 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:46.720510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4f860c2c-e9ee-4ac5-8932-61e4bca337ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:46.721318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4f860c2c-e9ee-4ac5-8932-61e4bca337ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:46.736433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3540209-9fa4-47ff-a84f-34e09d93b41b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:46.738290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3540209-9fa4-47ff-a84f-34e09d93b41b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:46.739413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3540209-9fa4-47ff-a84f-34e09d93b41b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:46.743394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3540209-9fa4-47ff-a84f-34e09d93b41b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:46.745915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f860c2c-e9ee-4ac5-8932-61e4bca337ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:46.748675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f860c2c-e9ee-4ac5-8932-61e4bca337ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:46.752814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f860c2c-e9ee-4ac5-8932-61e4bca337ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:46.757596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f860c2c-e9ee-4ac5-8932-61e4bca337ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:46.900825 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f3540209-9fa4-47ff-a84f-34e09d93b41b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.233063 Jan 22 21:10:46.906998 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1750/3658] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:46 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:46.913221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fea85830-d9b1-4e01-a923-ddb39439dc3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:46.926252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fea85830-d9b1-4e01-a923-ddb39439dc3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:46.940470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fea85830-d9b1-4e01-a923-ddb39439dc3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:46.943789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fea85830-d9b1-4e01-a923-ddb39439dc3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:46.944878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fea85830-d9b1-4e01-a923-ddb39439dc3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:46.947369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fea85830-d9b1-4e01-a923-ddb39439dc3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:47.501859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fea85830-d9b1-4e01-a923-ddb39439dc3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:47.515290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fea85830-d9b1-4e01-a923-ddb39439dc3b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1545 microversion: 2.1 time: 0.606222 Jan 22 21:10:47.517896 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1751/3659] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:46 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1545 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:47.525716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dacfa47f-2f96-413e-a442-041f4079b98d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:47.529703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dacfa47f-2f96-413e-a442-041f4079b98d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:47.547548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dacfa47f-2f96-413e-a442-041f4079b98d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:47.548018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dacfa47f-2f96-413e-a442-041f4079b98d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:47.550195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dacfa47f-2f96-413e-a442-041f4079b98d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:47.550628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dacfa47f-2f96-413e-a442-041f4079b98d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:47.959666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4f860c2c-e9ee-4ac5-8932-61e4bca337ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:47.971898 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4f860c2c-e9ee-4ac5-8932-61e4bca337ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 1.264088 Jan 22 21:10:47.982546 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1909/3660] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:46 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:47.982546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cd7c9a4b-f6c1-41b2-9220-ac799f7fb112 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:47.982546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cd7c9a4b-f6c1-41b2-9220-ac799f7fb112 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:47.986171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd7c9a4b-f6c1-41b2-9220-ac799f7fb112 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:47.986901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd7c9a4b-f6c1-41b2-9220-ac799f7fb112 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:47.987969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd7c9a4b-f6c1-41b2-9220-ac799f7fb112 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:47.988418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd7c9a4b-f6c1-41b2-9220-ac799f7fb112 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:48.045694 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cd7c9a4b-f6c1-41b2-9220-ac799f7fb112 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.070765 Jan 22 21:10:48.059210 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1910/3661] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:47 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:48.080408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-21c422fd-f73e-49e9-8b5b-f705aee868e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:48.081142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-21c422fd-f73e-49e9-8b5b-f705aee868e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:48.114806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21c422fd-f73e-49e9-8b5b-f705aee868e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:48.115199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21c422fd-f73e-49e9-8b5b-f705aee868e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:48.116040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21c422fd-f73e-49e9-8b5b-f705aee868e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:48.116493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21c422fd-f73e-49e9-8b5b-f705aee868e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:48.192272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dacfa47f-2f96-413e-a442-041f4079b98d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:48.213650 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dacfa47f-2f96-413e-a442-041f4079b98d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1498 microversion: 2.1 time: 0.692604 Jan 22 21:10:48.226942 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1752/3662] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:47 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1498 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:48.243909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0683068b-bcbd-4a18-913c-d0691a4a45d1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:48.254663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0683068b-bcbd-4a18-913c-d0691a4a45d1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:48.280031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0683068b-bcbd-4a18-913c-d0691a4a45d1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:48.281802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0683068b-bcbd-4a18-913c-d0691a4a45d1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:48.281802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0683068b-bcbd-4a18-913c-d0691a4a45d1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:48.285881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0683068b-bcbd-4a18-913c-d0691a4a45d1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:48.378579 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0683068b-bcbd-4a18-913c-d0691a4a45d1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.148382 Jan 22 21:10:48.384325 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1753/3663] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:48 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:48.393069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-ccc6f40c-ed6e-4317-9a94-a9d1b5c8ace9 req-1b2547c3-801d-4853-82f0-cb7906e5f837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e4b1a45-6907-44b8-9395-4d44ffeb22b7", "name": "network-vif-deleted", "tag": "5a16f93a-5ed1-47ab-8e02-3cb97602034e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:48.399939 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:48.399939 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:10:48.429806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-ccc6f40c-ed6e-4317-9a94-a9d1b5c8ace9 req-1b2547c3-801d-4853-82f0-cb7906e5f837 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:48.430536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-ccc6f40c-ed6e-4317-9a94-a9d1b5c8ace9 req-1b2547c3-801d-4853-82f0-cb7906e5f837 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:48.457394 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-ccc6f40c-ed6e-4317-9a94-a9d1b5c8ace9 req-1b2547c3-801d-4853-82f0-cb7906e5f837 service nova] Creating event network-vif-deleted:5a16f93a-5ed1-47ab-8e02-3cb97602034e for instance 0e4b1a45-6907-44b8-9395-4d44ffeb22b7 on nch2-master-1 Jan 22 21:10:48.467931 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-ccc6f40c-ed6e-4317-9a94-a9d1b5c8ace9 req-1b2547c3-801d-4853-82f0-cb7906e5f837 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082076 Jan 22 21:10:48.475310 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1754/3664] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:10:48.534299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-78e9ed64-dc0e-4dc0-908b-1f609c7cd034 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:48.536247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-78e9ed64-dc0e-4dc0-908b-1f609c7cd034 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:48.548822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78e9ed64-dc0e-4dc0-908b-1f609c7cd034 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:48.550865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78e9ed64-dc0e-4dc0-908b-1f609c7cd034 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:48.551879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78e9ed64-dc0e-4dc0-908b-1f609c7cd034 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:48.552523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78e9ed64-dc0e-4dc0-908b-1f609c7cd034 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:48.576509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-21c422fd-f73e-49e9-8b5b-f705aee868e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:48.586701 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-21c422fd-f73e-49e9-8b5b-f705aee868e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.525628 Jan 22 21:10:48.588047 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1911/3665] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:48 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:48.727848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-78e9ed64-dc0e-4dc0-908b-1f609c7cd034 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:48.752707 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-78e9ed64-dc0e-4dc0-908b-1f609c7cd034 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1545 microversion: 2.1 time: 0.213498 Jan 22 21:10:48.754786 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1755/3666] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:48 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1545 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:48.988650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b9a4054c-c574-4afc-8417-efefc73d347f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:48.989280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b9a4054c-c574-4afc-8417-efefc73d347f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:48.998364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9a4054c-c574-4afc-8417-efefc73d347f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:48.999145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9a4054c-c574-4afc-8417-efefc73d347f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:49.000231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9a4054c-c574-4afc-8417-efefc73d347f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:49.000745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9a4054c-c574-4afc-8417-efefc73d347f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:49.058820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f07ded76-4df8-4be2-9f78-575ccad2b7ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:49.060483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f07ded76-4df8-4be2-9f78-575ccad2b7ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:49.067360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f07ded76-4df8-4be2-9f78-575ccad2b7ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:49.067824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f07ded76-4df8-4be2-9f78-575ccad2b7ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:49.068674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f07ded76-4df8-4be2-9f78-575ccad2b7ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:49.069120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f07ded76-4df8-4be2-9f78-575ccad2b7ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:49.112860 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f07ded76-4df8-4be2-9f78-575ccad2b7ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.059498 Jan 22 21:10:49.113903 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1756/3667] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:49 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:10:49.152500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b9a4054c-c574-4afc-8417-efefc73d347f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:49.160837 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b9a4054c-c574-4afc-8417-efefc73d347f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.176134 Jan 22 21:10:49.161428 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1912/3668] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:48 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:49.234720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96e1cf6f-7e55-443d-88bd-3751ae2e842e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:49.235470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96e1cf6f-7e55-443d-88bd-3751ae2e842e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:49.243255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96e1cf6f-7e55-443d-88bd-3751ae2e842e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:49.243814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96e1cf6f-7e55-443d-88bd-3751ae2e842e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:49.244686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96e1cf6f-7e55-443d-88bd-3751ae2e842e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:49.245211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96e1cf6f-7e55-443d-88bd-3751ae2e842e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:49.289195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96e1cf6f-7e55-443d-88bd-3751ae2e842e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:49.290155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96e1cf6f-7e55-443d-88bd-3751ae2e842e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:49.290633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-96e1cf6f-7e55-443d-88bd-3751ae2e842e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lazy-loading 'fault' on Instance uuid 0e4b1a45-6907-44b8-9395-4d44ffeb22b7 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:10:49.370887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-96e1cf6f-7e55-443d-88bd-3751ae2e842e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:49.380749 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96e1cf6f-7e55-443d-88bd-3751ae2e842e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 200 len: 1303 microversion: 2.1 time: 0.151244 Jan 22 21:10:49.392328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aad83d36-d6f5-4b48-9b56-52859d24b950 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:49.395395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aad83d36-d6f5-4b48-9b56-52859d24b950 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:49.395570 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1757/3669] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:49 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 1303 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:49.412343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aad83d36-d6f5-4b48-9b56-52859d24b950 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:49.414018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aad83d36-d6f5-4b48-9b56-52859d24b950 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:49.418008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aad83d36-d6f5-4b48-9b56-52859d24b950 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:49.418008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aad83d36-d6f5-4b48-9b56-52859d24b950 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:49.506503 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aad83d36-d6f5-4b48-9b56-52859d24b950 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.118854 Jan 22 21:10:49.510119 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1913/3670] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:49 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:10:49.604194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fd8091ab-834e-4a90-959b-d9fd970a8064 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:49.608241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fd8091ab-834e-4a90-959b-d9fd970a8064 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:49.620993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd8091ab-834e-4a90-959b-d9fd970a8064 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:49.621463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd8091ab-834e-4a90-959b-d9fd970a8064 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:49.623600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd8091ab-834e-4a90-959b-d9fd970a8064 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:49.624028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd8091ab-834e-4a90-959b-d9fd970a8064 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:49.772808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e679b973-25d8-43e4-bf14-47628e92b05b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:49.774252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e679b973-25d8-43e4-bf14-47628e92b05b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:49.790890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e679b973-25d8-43e4-bf14-47628e92b05b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:49.796925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e679b973-25d8-43e4-bf14-47628e92b05b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:49.796925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e679b973-25d8-43e4-bf14-47628e92b05b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:49.796925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e679b973-25d8-43e4-bf14-47628e92b05b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:49.859405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fd8091ab-834e-4a90-959b-d9fd970a8064 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:49.874948 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fd8091ab-834e-4a90-959b-d9fd970a8064 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.274535 Jan 22 21:10:49.878495 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1758/3671] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:49 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:50.105796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e679b973-25d8-43e4-bf14-47628e92b05b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:50.121244 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e679b973-25d8-43e4-bf14-47628e92b05b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1545 microversion: 2.1 time: 0.353159 Jan 22 21:10:50.124908 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1914/3672] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:49 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1545 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:50.148356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-abfabb11-e7c1-4601-8bb6-ecb3d1ffbe17 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:50.150805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-abfabb11-e7c1-4601-8bb6-ecb3d1ffbe17 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:50.179431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eeacd7db-c6df-46f1-acad-882e29ceb106 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:50.182092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abfabb11-e7c1-4601-8bb6-ecb3d1ffbe17 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:50.182092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abfabb11-e7c1-4601-8bb6-ecb3d1ffbe17 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:50.183669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eeacd7db-c6df-46f1-acad-882e29ceb106 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:50.186429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abfabb11-e7c1-4601-8bb6-ecb3d1ffbe17 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:50.193302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abfabb11-e7c1-4601-8bb6-ecb3d1ffbe17 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:50.208479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eeacd7db-c6df-46f1-acad-882e29ceb106 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:50.213986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eeacd7db-c6df-46f1-acad-882e29ceb106 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:50.217998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eeacd7db-c6df-46f1-acad-882e29ceb106 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:50.219776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eeacd7db-c6df-46f1-acad-882e29ceb106 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:50.305663 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-abfabb11-e7c1-4601-8bb6-ecb3d1ffbe17 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.182094 Jan 22 21:10:50.309695 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1759/3673] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:50 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:50.404741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5d484a86-dbe7-4b57-8362-8bb84b9b5ffd tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:50.405713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5d484a86-dbe7-4b57-8362-8bb84b9b5ffd tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:50.434937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d484a86-dbe7-4b57-8362-8bb84b9b5ffd tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:50.434937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d484a86-dbe7-4b57-8362-8bb84b9b5ffd tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:50.434937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d484a86-dbe7-4b57-8362-8bb84b9b5ffd tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:50.434937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d484a86-dbe7-4b57-8362-8bb84b9b5ffd tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:50.481545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-eeacd7db-c6df-46f1-acad-882e29ceb106 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:50.491872 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eeacd7db-c6df-46f1-acad-882e29ceb106 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.317351 Jan 22 21:10:50.500192 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-5d484a86-dbe7-4b57-8362-8bb84b9b5ffd tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance 0e4b1a45-6907-44b8-9395-4d44ffeb22b7 could not be found. Jan 22 21:10:50.500956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5d484a86-dbe7-4b57-8362-8bb84b9b5ffd tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance 0e4b1a45-6907-44b8-9395-4d44ffeb22b7 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:10:50.503344 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1915/3674] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:50 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:50.504095 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5d484a86-dbe7-4b57-8362-8bb84b9b5ffd tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 404 len: 111 microversion: 2.1 time: 0.102766 Jan 22 21:10:50.508758 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1760/3675] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:50 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:10:50.519886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a80deb76-3b5f-49da-b8ea-ce1bb5ef9a2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:50.521197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a80deb76-3b5f-49da-b8ea-ce1bb5ef9a2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:50.526908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cf7fa35d-75bc-4555-8a99-60e299053a99 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:50.526908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cf7fa35d-75bc-4555-8a99-60e299053a99 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:50.530421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a80deb76-3b5f-49da-b8ea-ce1bb5ef9a2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:50.531477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a80deb76-3b5f-49da-b8ea-ce1bb5ef9a2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:50.532522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a80deb76-3b5f-49da-b8ea-ce1bb5ef9a2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:50.533102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a80deb76-3b5f-49da-b8ea-ce1bb5ef9a2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:50.539501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf7fa35d-75bc-4555-8a99-60e299053a99 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:50.539947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf7fa35d-75bc-4555-8a99-60e299053a99 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:50.540794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf7fa35d-75bc-4555-8a99-60e299053a99 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:50.541251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf7fa35d-75bc-4555-8a99-60e299053a99 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:50.582556 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a80deb76-3b5f-49da-b8ea-ce1bb5ef9a2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.066914 Jan 22 21:10:50.584159 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1761/3676] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:50 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:50.600554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cf7fa35d-75bc-4555-8a99-60e299053a99 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:10:50.904513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8fa4cdbb-c333-42da-a0eb-8823755bf2fb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:50.905599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8fa4cdbb-c333-42da-a0eb-8823755bf2fb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:50.914488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fa4cdbb-c333-42da-a0eb-8823755bf2fb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:50.915527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fa4cdbb-c333-42da-a0eb-8823755bf2fb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:50.916513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fa4cdbb-c333-42da-a0eb-8823755bf2fb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:50.917366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fa4cdbb-c333-42da-a0eb-8823755bf2fb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:51.050187 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cf7fa35d-75bc-4555-8a99-60e299053a99 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 204 len: 0 microversion: 2.1 time: 0.538657 Jan 22 21:10:51.052041 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1916/3677] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:10:50 2022] DELETE /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:10:51.061533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b24b706-42f4-4cb2-b154-4489a4ff0cda tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:51.062370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b24b706-42f4-4cb2-b154-4489a4ff0cda tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:51.083499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b24b706-42f4-4cb2-b154-4489a4ff0cda tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:51.084017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b24b706-42f4-4cb2-b154-4489a4ff0cda tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:51.084893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b24b706-42f4-4cb2-b154-4489a4ff0cda tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:51.085340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b24b706-42f4-4cb2-b154-4489a4ff0cda tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:51.224538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8fa4cdbb-c333-42da-a0eb-8823755bf2fb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:51.238032 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8fa4cdbb-c333-42da-a0eb-8823755bf2fb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1531 microversion: 2.1 time: 0.340791 Jan 22 21:10:51.249488 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1762/3678] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:50 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1531 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:51.260326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f2c6b320-543c-4a04-aaff-4c51920d86df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:51.266156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f2c6b320-543c-4a04-aaff-4c51920d86df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:51.282034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2c6b320-543c-4a04-aaff-4c51920d86df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:51.282501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2c6b320-543c-4a04-aaff-4c51920d86df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:51.283452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2c6b320-543c-4a04-aaff-4c51920d86df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:51.283903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2c6b320-543c-4a04-aaff-4c51920d86df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:51.457073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8b24b706-42f4-4cb2-b154-4489a4ff0cda tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:51.466826 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b24b706-42f4-4cb2-b154-4489a4ff0cda tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1498 microversion: 2.1 time: 0.410247 Jan 22 21:10:51.476550 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1917/3679] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:51 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1498 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:51.476550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2d4e1a06-7473-4247-93b6-b689181e23b9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:51.476550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2d4e1a06-7473-4247-93b6-b689181e23b9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:51.487107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d4e1a06-7473-4247-93b6-b689181e23b9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:51.492878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d4e1a06-7473-4247-93b6-b689181e23b9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:51.492878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d4e1a06-7473-4247-93b6-b689181e23b9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:51.493571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d4e1a06-7473-4247-93b6-b689181e23b9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:51.554402 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2d4e1a06-7473-4247-93b6-b689181e23b9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.085719 Jan 22 21:10:51.564260 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1918/3680] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:51 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:51.564260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a949cf1a-424c-46ab-9488-e5a805312b2a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:51.570462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a949cf1a-424c-46ab-9488-e5a805312b2a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:51.584869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a949cf1a-424c-46ab-9488-e5a805312b2a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:51.585634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a949cf1a-424c-46ab-9488-e5a805312b2a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:51.586671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a949cf1a-424c-46ab-9488-e5a805312b2a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:51.587225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a949cf1a-424c-46ab-9488-e5a805312b2a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:51.694778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f2c6b320-543c-4a04-aaff-4c51920d86df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:51.704584 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f2c6b320-543c-4a04-aaff-4c51920d86df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1545 microversion: 2.1 time: 0.453594 Jan 22 21:10:51.709684 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1763/3681] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:51 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1545 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:51.728194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-27d20895-07f7-4b8a-8968-7ac2e4c8df02 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:51.729611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-27d20895-07f7-4b8a-8968-7ac2e4c8df02 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:51.742870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27d20895-07f7-4b8a-8968-7ac2e4c8df02 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:51.743333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27d20895-07f7-4b8a-8968-7ac2e4c8df02 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:51.744245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27d20895-07f7-4b8a-8968-7ac2e4c8df02 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:51.744691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27d20895-07f7-4b8a-8968-7ac2e4c8df02 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:51.799358 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-27d20895-07f7-4b8a-8968-7ac2e4c8df02 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.088226 Jan 22 21:10:51.800480 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1764/3682] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:51 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:51.929543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a949cf1a-424c-46ab-9488-e5a805312b2a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:51.933265 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a949cf1a-424c-46ab-9488-e5a805312b2a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.373648 Jan 22 21:10:51.934067 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1919/3683] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:51 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:52.255740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a21a9f88-4074-4e95-a2bb-3c405441fbba tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:52.256449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a21a9f88-4074-4e95-a2bb-3c405441fbba tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:52.269932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a21a9f88-4074-4e95-a2bb-3c405441fbba tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:52.272552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a21a9f88-4074-4e95-a2bb-3c405441fbba tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:52.273412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a21a9f88-4074-4e95-a2bb-3c405441fbba tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:52.273888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a21a9f88-4074-4e95-a2bb-3c405441fbba tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:52.486094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ed54b088-6d63-466d-9d76-3703c9f9115d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:52.487357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ed54b088-6d63-466d-9d76-3703c9f9115d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:52.500811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed54b088-6d63-466d-9d76-3703c9f9115d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:52.501444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed54b088-6d63-466d-9d76-3703c9f9115d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:52.504414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed54b088-6d63-466d-9d76-3703c9f9115d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:52.504778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed54b088-6d63-466d-9d76-3703c9f9115d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:52.758425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a21a9f88-4074-4e95-a2bb-3c405441fbba tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:52.772166 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a21a9f88-4074-4e95-a2bb-3c405441fbba tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1513 microversion: 2.1 time: 0.521075 Jan 22 21:10:52.773144 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1765/3684] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:52 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1513 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:52.784451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3421f480-f668-4045-b91f-b7fcf3acd823 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:52.786176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3421f480-f668-4045-b91f-b7fcf3acd823 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:52.800352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3421f480-f668-4045-b91f-b7fcf3acd823 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:52.801209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3421f480-f668-4045-b91f-b7fcf3acd823 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:52.806550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed54b088-6d63-466d-9d76-3703c9f9115d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:52.807186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3421f480-f668-4045-b91f-b7fcf3acd823 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:52.807186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3421f480-f668-4045-b91f-b7fcf3acd823 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:52.815902 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ed54b088-6d63-466d-9d76-3703c9f9115d tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1498 microversion: 2.1 time: 0.333894 Jan 22 21:10:52.829943 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1920/3685] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:52 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1498 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:52.840255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4a3fe16c-2efe-4ecf-8c9a-af8e4d58200f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:52.840894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4a3fe16c-2efe-4ecf-8c9a-af8e4d58200f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:52.850709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a3fe16c-2efe-4ecf-8c9a-af8e4d58200f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:52.851194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a3fe16c-2efe-4ecf-8c9a-af8e4d58200f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:52.851977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a3fe16c-2efe-4ecf-8c9a-af8e4d58200f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:52.852515 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a3fe16c-2efe-4ecf-8c9a-af8e4d58200f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:52.896409 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3421f480-f668-4045-b91f-b7fcf3acd823 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.121754 Jan 22 21:10:52.897860 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1766/3686] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:52 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:52.903700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fd80d3c7-db50-48c3-b218-e9c1ba3f10b4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:52.911026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fd80d3c7-db50-48c3-b218-e9c1ba3f10b4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:52.930730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd80d3c7-db50-48c3-b218-e9c1ba3f10b4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:52.931529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd80d3c7-db50-48c3-b218-e9c1ba3f10b4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:52.932702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd80d3c7-db50-48c3-b218-e9c1ba3f10b4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:52.933357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd80d3c7-db50-48c3-b218-e9c1ba3f10b4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:53.020051 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fd80d3c7-db50-48c3-b218-e9c1ba3f10b4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.120582 Jan 22 21:10:53.024594 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1767/3687] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:52 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:53.033626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6b8c21ce-4a6d-49b5-a2b5-2105e53888cb tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:53.041570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6b8c21ce-4a6d-49b5-a2b5-2105e53888cb tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:53.052948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b8c21ce-4a6d-49b5-a2b5-2105e53888cb tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:53.055378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b8c21ce-4a6d-49b5-a2b5-2105e53888cb tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:53.056314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b8c21ce-4a6d-49b5-a2b5-2105e53888cb tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:53.057351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b8c21ce-4a6d-49b5-a2b5-2105e53888cb tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:53.115814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4a3fe16c-2efe-4ecf-8c9a-af8e4d58200f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:53.130087 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4a3fe16c-2efe-4ecf-8c9a-af8e4d58200f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1545 microversion: 2.1 time: 0.296077 Jan 22 21:10:53.130956 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1921/3688] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:52 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1545 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:53.795515 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dbe47203-bbd7-419a-a130-9d08980b2f46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:53.796636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dbe47203-bbd7-419a-a130-9d08980b2f46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:53.811422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbe47203-bbd7-419a-a130-9d08980b2f46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:53.812644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbe47203-bbd7-419a-a130-9d08980b2f46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:53.816606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbe47203-bbd7-419a-a130-9d08980b2f46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:53.817453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbe47203-bbd7-419a-a130-9d08980b2f46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:53.837713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6b8c21ce-4a6d-49b5-a2b5-2105e53888cb tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:53.852177 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6b8c21ce-4a6d-49b5-a2b5-2105e53888cb tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.826138 Jan 22 21:10:53.853380 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1768/3689] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:53 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:53.858228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9fd1ba75-57b5-4caf-8f0d-77ccebb37b25 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:53.862362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9fd1ba75-57b5-4caf-8f0d-77ccebb37b25 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:53.884531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9fd1ba75-57b5-4caf-8f0d-77ccebb37b25 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:53.885234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9fd1ba75-57b5-4caf-8f0d-77ccebb37b25 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:53.886274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9fd1ba75-57b5-4caf-8f0d-77ccebb37b25 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:53.887583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9fd1ba75-57b5-4caf-8f0d-77ccebb37b25 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:54.216389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dbe47203-bbd7-419a-a130-9d08980b2f46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:54.225895 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dbe47203-bbd7-419a-a130-9d08980b2f46 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1513 microversion: 2.1 time: 0.437454 Jan 22 21:10:54.238213 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1922/3690] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:53 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1513 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:54.244141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-07d2081a-e1ee-46c6-a0c5-e085f42ca54e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:54.245713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-07d2081a-e1ee-46c6-a0c5-e085f42ca54e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:54.270692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07d2081a-e1ee-46c6-a0c5-e085f42ca54e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:54.280437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07d2081a-e1ee-46c6-a0c5-e085f42ca54e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:54.281638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07d2081a-e1ee-46c6-a0c5-e085f42ca54e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:54.282246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07d2081a-e1ee-46c6-a0c5-e085f42ca54e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:54.313649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9fd1ba75-57b5-4caf-8f0d-77ccebb37b25 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:54.334801 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9fd1ba75-57b5-4caf-8f0d-77ccebb37b25 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1498 microversion: 2.1 time: 0.479963 Jan 22 21:10:54.342008 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1769/3691] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:53 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1498 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:54.347048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bbf8c7ec-ad0a-4f81-8ccb-9a2551cd8283 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:54.357895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bbf8c7ec-ad0a-4f81-8ccb-9a2551cd8283 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:54.365790 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-07d2081a-e1ee-46c6-a0c5-e085f42ca54e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.125924 Jan 22 21:10:54.372195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbf8c7ec-ad0a-4f81-8ccb-9a2551cd8283 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:54.373584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbf8c7ec-ad0a-4f81-8ccb-9a2551cd8283 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:54.376180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbf8c7ec-ad0a-4f81-8ccb-9a2551cd8283 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:54.376906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbf8c7ec-ad0a-4f81-8ccb-9a2551cd8283 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:54.380716 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1923/3692] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:54 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:54.407799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ddc51ed8-6808-45b9-b4b8-4d7148464a0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:54.410675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ddc51ed8-6808-45b9-b4b8-4d7148464a0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:54.420425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddc51ed8-6808-45b9-b4b8-4d7148464a0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:54.421080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddc51ed8-6808-45b9-b4b8-4d7148464a0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:54.422043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddc51ed8-6808-45b9-b4b8-4d7148464a0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:54.422507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddc51ed8-6808-45b9-b4b8-4d7148464a0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:54.473678 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bbf8c7ec-ad0a-4f81-8ccb-9a2551cd8283 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.130153 Jan 22 21:10:54.474689 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1770/3693] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:54 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:54.699735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ddc51ed8-6808-45b9-b4b8-4d7148464a0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:54.713131 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ddc51ed8-6808-45b9-b4b8-4d7148464a0c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1545 microversion: 2.1 time: 0.330683 Jan 22 21:10:54.713908 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1924/3694] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:54 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1545 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:54.732960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-0492e129-b6f4-4399-a8a9-d0f80e21ff20 req-b2acf2c9-3dd2-4173-8ea5-09defeaaaf33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b2aed8-f03f-4c04-b508-cc9a7e172dd6", "name": "network-vif-unplugged", "status": "completed", "tag": "99dd6838-12b2-4c2b-b219-2af5c1a44a74"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:54.734847 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:54.734847 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:10:54.743653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-0492e129-b6f4-4399-a8a9-d0f80e21ff20 req-b2acf2c9-3dd2-4173-8ea5-09defeaaaf33 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:54.744368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-0492e129-b6f4-4399-a8a9-d0f80e21ff20 req-b2acf2c9-3dd2-4173-8ea5-09defeaaaf33 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:54.758369 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-0492e129-b6f4-4399-a8a9-d0f80e21ff20 req-b2acf2c9-3dd2-4173-8ea5-09defeaaaf33 service nova] Creating event network-vif-unplugged:99dd6838-12b2-4c2b-b219-2af5c1a44a74 for instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 on nch2-master-1 Jan 22 21:10:54.763976 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-0492e129-b6f4-4399-a8a9-d0f80e21ff20 req-b2acf2c9-3dd2-4173-8ea5-09defeaaaf33 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035977 Jan 22 21:10:54.764865 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1771/3695] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:10:54.869122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4ea091c6-5bc9-4744-9b20-77926cf9063a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:54.870139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4ea091c6-5bc9-4744-9b20-77926cf9063a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:54.887443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ea091c6-5bc9-4744-9b20-77926cf9063a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:54.892096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ea091c6-5bc9-4744-9b20-77926cf9063a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:54.892096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ea091c6-5bc9-4744-9b20-77926cf9063a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:54.892096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ea091c6-5bc9-4744-9b20-77926cf9063a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:54.967075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-02b1be26-8fb6-428b-9e02-74ab38616d06 req-aac56bd5-be48-4bd4-a08d-81de01fa5ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b638a02-13d3-4b01-bd61-47787c7db9dc", "name": "network-vif-deleted", "tag": "59474f75-ffd6-4371-a954-34c04724b3c0"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:54.968587 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:10:54.968587 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:10:54.978156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-02b1be26-8fb6-428b-9e02-74ab38616d06 req-aac56bd5-be48-4bd4-a08d-81de01fa5ba7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:54.978434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-02b1be26-8fb6-428b-9e02-74ab38616d06 req-aac56bd5-be48-4bd4-a08d-81de01fa5ba7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:55.025711 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-02b1be26-8fb6-428b-9e02-74ab38616d06 req-aac56bd5-be48-4bd4-a08d-81de01fa5ba7 service nova] Creating event network-vif-deleted:59474f75-ffd6-4371-a954-34c04724b3c0 for instance 8b638a02-13d3-4b01-bd61-47787c7db9dc on nch1-master-1 Jan 22 21:10:55.043487 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-02b1be26-8fb6-428b-9e02-74ab38616d06 req-aac56bd5-be48-4bd4-a08d-81de01fa5ba7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083146 Jan 22 21:10:55.046980 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1772/3696] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:10:55.245082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7f1c0ad1-7157-446a-aa4f-dcc3f8dd7317 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:55.246226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7f1c0ad1-7157-446a-aa4f-dcc3f8dd7317 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:55.267175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f1c0ad1-7157-446a-aa4f-dcc3f8dd7317 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:55.267648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f1c0ad1-7157-446a-aa4f-dcc3f8dd7317 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:55.269099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f1c0ad1-7157-446a-aa4f-dcc3f8dd7317 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:55.269609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f1c0ad1-7157-446a-aa4f-dcc3f8dd7317 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:55.320906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4ea091c6-5bc9-4744-9b20-77926cf9063a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:55.330969 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4ea091c6-5bc9-4744-9b20-77926cf9063a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.465487 Jan 22 21:10:55.343856 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1925/3697] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:54 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:55.364692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad2da77c-9d76-422b-8d43-a9580ccea291 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:55.367029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad2da77c-9d76-422b-8d43-a9580ccea291 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:55.380093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad2da77c-9d76-422b-8d43-a9580ccea291 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:55.380660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad2da77c-9d76-422b-8d43-a9580ccea291 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:55.382515 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad2da77c-9d76-422b-8d43-a9580ccea291 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:55.385450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad2da77c-9d76-422b-8d43-a9580ccea291 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:55.427572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad2da77c-9d76-422b-8d43-a9580ccea291 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:55.428589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad2da77c-9d76-422b-8d43-a9580ccea291 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:55.429358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-ad2da77c-9d76-422b-8d43-a9580ccea291 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lazy-loading 'fault' on Instance uuid 8b638a02-13d3-4b01-bd61-47787c7db9dc {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:10:55.538284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ad2da77c-9d76-422b-8d43-a9580ccea291 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:55.550285 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad2da77c-9d76-422b-8d43-a9580ccea291 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 200 len: 1303 microversion: 2.1 time: 0.193037 Jan 22 21:10:55.551524 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1926/3698] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:55 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 1303 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:55.567733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-83c7d47e-12a5-4594-b0b7-61db99dea11d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:55.568427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7f1c0ad1-7157-446a-aa4f-dcc3f8dd7317 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:55.568744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-83c7d47e-12a5-4594-b0b7-61db99dea11d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:55.578377 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7f1c0ad1-7157-446a-aa4f-dcc3f8dd7317 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1513 microversion: 2.1 time: 0.337802 Jan 22 21:10:55.579369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83c7d47e-12a5-4594-b0b7-61db99dea11d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:55.580009 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1773/3699] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:55 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1513 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:55.587495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7978d0b4-a9cd-4293-b49f-618898aba8bc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:55.588837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7978d0b4-a9cd-4293-b49f-618898aba8bc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:55.591544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83c7d47e-12a5-4594-b0b7-61db99dea11d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:55.592423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83c7d47e-12a5-4594-b0b7-61db99dea11d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:55.592938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83c7d47e-12a5-4594-b0b7-61db99dea11d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:55.599835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7978d0b4-a9cd-4293-b49f-618898aba8bc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:55.600611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7978d0b4-a9cd-4293-b49f-618898aba8bc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:55.602165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7978d0b4-a9cd-4293-b49f-618898aba8bc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:55.602848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7978d0b4-a9cd-4293-b49f-618898aba8bc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:55.664401 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7978d0b4-a9cd-4293-b49f-618898aba8bc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.082421 Jan 22 21:10:55.665677 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1774/3700] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:55 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:55.679725 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-83c7d47e-12a5-4594-b0b7-61db99dea11d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.117808 Jan 22 21:10:55.683634 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1927/3701] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:55 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:55.735110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff75e3ab-85f2-411a-a050-c5a82fadbbd7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:55.736197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ff75e3ab-85f2-411a-a050-c5a82fadbbd7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:55.745699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff75e3ab-85f2-411a-a050-c5a82fadbbd7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:55.747263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff75e3ab-85f2-411a-a050-c5a82fadbbd7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:55.748861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff75e3ab-85f2-411a-a050-c5a82fadbbd7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:55.749576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff75e3ab-85f2-411a-a050-c5a82fadbbd7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:55.941362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ff75e3ab-85f2-411a-a050-c5a82fadbbd7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:55.950859 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff75e3ab-85f2-411a-a050-c5a82fadbbd7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1545 microversion: 2.1 time: 0.221615 Jan 22 21:10:55.964091 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1775/3702] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:55 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1545 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:56.351343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d5549f8b-3c63-4126-a6a2-6c9a80ebe3ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:56.352784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d5549f8b-3c63-4126-a6a2-6c9a80ebe3ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:56.369536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5549f8b-3c63-4126-a6a2-6c9a80ebe3ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:56.370007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5549f8b-3c63-4126-a6a2-6c9a80ebe3ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:56.370833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5549f8b-3c63-4126-a6a2-6c9a80ebe3ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:56.384032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5549f8b-3c63-4126-a6a2-6c9a80ebe3ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:56.575112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-62cc1082-f8f3-4894-82c6-422c42bfdeb8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:56.576874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-62cc1082-f8f3-4894-82c6-422c42bfdeb8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:56.586443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62cc1082-f8f3-4894-82c6-422c42bfdeb8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:56.587894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62cc1082-f8f3-4894-82c6-422c42bfdeb8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:56.590341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62cc1082-f8f3-4894-82c6-422c42bfdeb8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:56.591371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62cc1082-f8f3-4894-82c6-422c42bfdeb8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:56.620577 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-62cc1082-f8f3-4894-82c6-422c42bfdeb8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance 8b638a02-13d3-4b01-bd61-47787c7db9dc could not be found. Jan 22 21:10:56.622488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-62cc1082-f8f3-4894-82c6-422c42bfdeb8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance 8b638a02-13d3-4b01-bd61-47787c7db9dc could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:10:56.623709 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-62cc1082-f8f3-4894-82c6-422c42bfdeb8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 404 len: 111 microversion: 2.1 time: 0.054210 Jan 22 21:10:56.625561 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1776/3703] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:56 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:10:56.647958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9e547389-3084-4ced-9c9c-4f24abfcfe01 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:56.652956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9e547389-3084-4ced-9c9c-4f24abfcfe01 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:56.660170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e547389-3084-4ced-9c9c-4f24abfcfe01 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:56.660966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e547389-3084-4ced-9c9c-4f24abfcfe01 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:56.661979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e547389-3084-4ced-9c9c-4f24abfcfe01 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:56.662605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e547389-3084-4ced-9c9c-4f24abfcfe01 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:56.877600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9e547389-3084-4ced-9c9c-4f24abfcfe01 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:56.885838 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9e547389-3084-4ced-9c9c-4f24abfcfe01 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1516 microversion: 2.1 time: 0.258781 Jan 22 21:10:56.889418 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1777/3704] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:56 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1516 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:56.901703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f23f2048-223e-42c6-b5a5-18a143be1c83 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:56.904513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f23f2048-223e-42c6-b5a5-18a143be1c83 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:56.912079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f23f2048-223e-42c6-b5a5-18a143be1c83 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:56.912914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f23f2048-223e-42c6-b5a5-18a143be1c83 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:56.914102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f23f2048-223e-42c6-b5a5-18a143be1c83 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:56.914850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f23f2048-223e-42c6-b5a5-18a143be1c83 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:56.971759 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f23f2048-223e-42c6-b5a5-18a143be1c83 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.080435 Jan 22 21:10:56.975945 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1778/3705] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:56 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:56.982669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7dcb0634-c6f2-4a38-950d-4817df5085ba tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:56.987277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7dcb0634-c6f2-4a38-950d-4817df5085ba tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:56.992255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7dcb0634-c6f2-4a38-950d-4817df5085ba tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:56.992925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7dcb0634-c6f2-4a38-950d-4817df5085ba tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:56.994152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7dcb0634-c6f2-4a38-950d-4817df5085ba tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:56.994704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7dcb0634-c6f2-4a38-950d-4817df5085ba tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:57.018759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d5549f8b-3c63-4126-a6a2-6c9a80ebe3ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:57.033557 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d5549f8b-3c63-4126-a6a2-6c9a80ebe3ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.685216 Jan 22 21:10:57.047575 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1928/3706] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:56 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:57.062193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1074612696", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "ab49ab48-066e-4b21-9cb5-bee63c0067a9"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:57.066203 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7dcb0634-c6f2-4a38-950d-4817df5085ba tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.090663 Jan 22 21:10:57.067157 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1779/3707] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:56 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:57.072582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-150e6130-5d7c-4415-9542-2489b01a0383 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:57.076968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-150e6130-5d7c-4415-9542-2489b01a0383 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:57.092656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-150e6130-5d7c-4415-9542-2489b01a0383 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:57.097974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-150e6130-5d7c-4415-9542-2489b01a0383 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:57.099037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-150e6130-5d7c-4415-9542-2489b01a0383 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:57.099679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-150e6130-5d7c-4415-9542-2489b01a0383 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:57.145133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] validate_networks() for [('ab49ab48-066e-4b21-9cb5-bee63c0067a9', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:10:57.312798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-150e6130-5d7c-4415-9542-2489b01a0383 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:57.321883 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-150e6130-5d7c-4415-9542-2489b01a0383 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1516 microversion: 2.1 time: 0.253223 Jan 22 21:10:57.333720 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1780/3708] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:57 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1516 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:57.338676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e70e361c-3b9e-4f08-95e2-66c90e58dbe5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:57.339157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e70e361c-3b9e-4f08-95e2-66c90e58dbe5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:57.345614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e70e361c-3b9e-4f08-95e2-66c90e58dbe5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:57.346123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e70e361c-3b9e-4f08-95e2-66c90e58dbe5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:57.347127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e70e361c-3b9e-4f08-95e2-66c90e58dbe5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:57.347587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e70e361c-3b9e-4f08-95e2-66c90e58dbe5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:57.546147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e70e361c-3b9e-4f08-95e2-66c90e58dbe5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:57.555754 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e70e361c-3b9e-4f08-95e2-66c90e58dbe5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1545 microversion: 2.1 time: 0.220821 Jan 22 21:10:57.573753 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1781/3709] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:57 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1545 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:57.573753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bbc57358-ec3c-4e22-89f1-a135268df809 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:57.574117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bbc57358-ec3c-4e22-89f1-a135268df809 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:57.584395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbc57358-ec3c-4e22-89f1-a135268df809 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:57.585494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbc57358-ec3c-4e22-89f1-a135268df809 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:57.586585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbc57358-ec3c-4e22-89f1-a135268df809 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:57.587190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbc57358-ec3c-4e22-89f1-a135268df809 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:57.618125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-bbc57358-ec3c-4e22-89f1-a135268df809 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lazy-loading 'flavor' on Instance uuid 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:10:57.635008 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-bbc57358-ec3c-4e22-89f1-a135268df809 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Cannot 'shelve' instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 while it is in vm_state shelved_offloaded Jan 22 21:10:57.635802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bbc57358-ec3c-4e22-89f1-a135268df809 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 409 to user: Cannot 'shelve' instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 while it is in vm_state shelved_offloaded {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:10:57.636842 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bbc57358-ec3c-4e22-89f1-a135268df809 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action" status: 409 len: 155 microversion: 2.1 time: 0.069230 Jan 22 21:10:57.638799 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1782/3710] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:57 2022] POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action => generated 155 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:10:57.647346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1e8f25dc-9b15-4aac-be1e-aca9d2a23534 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:57.648018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1e8f25dc-9b15-4aac-be1e-aca9d2a23534 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:57.655873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e8f25dc-9b15-4aac-be1e-aca9d2a23534 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:57.656411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e8f25dc-9b15-4aac-be1e-aca9d2a23534 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:57.661950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e8f25dc-9b15-4aac-be1e-aca9d2a23534 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:57.661950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e8f25dc-9b15-4aac-be1e-aca9d2a23534 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:57.871404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:10:57.873189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:10:57.873784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:10:57.874433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:10:57.875072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:10:57.885270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:57.885492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:57.891710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:57.892262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:57.923076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:10:57.932017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for user 75befd3272db4de48c7b4586adf6f849 and project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:10:57.962732 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1e8f25dc-9b15-4aac-be1e-aca9d2a23534 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action" status: 202 len: 0 microversion: 2.1 time: 0.319036 Jan 22 21:10:57.969245 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1783/3711] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:57 2022] POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:57.978926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a9cab1b4-2e7e-474f-9deb-fe3ca93f83f5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:57.979750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a9cab1b4-2e7e-474f-9deb-fe3ca93f83f5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:57.989108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:10:57.989254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9cab1b4-2e7e-474f-9deb-fe3ca93f83f5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:57.989254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9cab1b4-2e7e-474f-9deb-fe3ca93f83f5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:57.989254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9cab1b4-2e7e-474f-9deb-fe3ca93f83f5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:57.989477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9cab1b4-2e7e-474f-9deb-fe3ca93f83f5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:57.991231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:10:58.156579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a9cab1b4-2e7e-474f-9deb-fe3ca93f83f5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:58.168761 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a9cab1b4-2e7e-474f-9deb-fe3ca93f83f5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1464 microversion: 2.1 time: 0.198021 Jan 22 21:10:58.180226 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1784/3712] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:57 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1464 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:58.186777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-71afd4e2-8cdf-4b56-afd2-65e00f1af8b6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:58.187939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-71afd4e2-8cdf-4b56-afd2-65e00f1af8b6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:58.195877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71afd4e2-8cdf-4b56-afd2-65e00f1af8b6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:58.196413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71afd4e2-8cdf-4b56-afd2-65e00f1af8b6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:58.197303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71afd4e2-8cdf-4b56-afd2-65e00f1af8b6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:58.197841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71afd4e2-8cdf-4b56-afd2-65e00f1af8b6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:58.231534 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2c2a882c-523d-4c76-a2fe-988494598570 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.181451 Jan 22 21:10:58.235500 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1929/3713] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:10:57 2022] POST /compute/v2.1/servers => generated 382 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:10:58.243586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-70e287af-81b5-48d4-95ad-0a81917cb094 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:58.244280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-70e287af-81b5-48d4-95ad-0a81917cb094 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:58.254106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70e287af-81b5-48d4-95ad-0a81917cb094 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:58.254605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70e287af-81b5-48d4-95ad-0a81917cb094 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:58.271141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70e287af-81b5-48d4-95ad-0a81917cb094 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:58.271618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70e287af-81b5-48d4-95ad-0a81917cb094 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:58.280908 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-71afd4e2-8cdf-4b56-afd2-65e00f1af8b6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.098953 Jan 22 21:10:58.282219 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1785/3714] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:58 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:58.295611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d6c170d9-9994-4a13-98ce-ceafc85a2e35 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:58.298894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d6c170d9-9994-4a13-98ce-ceafc85a2e35 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:58.317104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6c170d9-9994-4a13-98ce-ceafc85a2e35 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:58.321040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6c170d9-9994-4a13-98ce-ceafc85a2e35 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:58.321040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6c170d9-9994-4a13-98ce-ceafc85a2e35 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:58.321489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6c170d9-9994-4a13-98ce-ceafc85a2e35 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:58.393621 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d6c170d9-9994-4a13-98ce-ceafc85a2e35 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.099267 Jan 22 21:10:58.394904 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1786/3715] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:58 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:58.399717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f98f695b-0dfd-40c9-a72b-335fe62d0519 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:58.401297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f98f695b-0dfd-40c9-a72b-335fe62d0519 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:58.466974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f98f695b-0dfd-40c9-a72b-335fe62d0519 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:58.476517 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f98f695b-0dfd-40c9-a72b-335fe62d0519 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1213 microversion: 2.1 time: 0.080308 Jan 22 21:10:58.476517 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1787/3716] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:58 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:58.569465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-70e287af-81b5-48d4-95ad-0a81917cb094 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:58.573883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f90493c7-53a3-47e2-aeb4-ba2a75a87045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:58.575063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f90493c7-53a3-47e2-aeb4-ba2a75a87045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:58.582465 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-70e287af-81b5-48d4-95ad-0a81917cb094 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.345106 Jan 22 21:10:58.593165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f90493c7-53a3-47e2-aeb4-ba2a75a87045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:58.593165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f90493c7-53a3-47e2-aeb4-ba2a75a87045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:58.593165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f90493c7-53a3-47e2-aeb4-ba2a75a87045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:58.593165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f90493c7-53a3-47e2-aeb4-ba2a75a87045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:58.594485 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1930/3717] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:58 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:58.842635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f90493c7-53a3-47e2-aeb4-ba2a75a87045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:58.874518 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f90493c7-53a3-47e2-aeb4-ba2a75a87045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1545 microversion: 2.1 time: 0.304004 Jan 22 21:10:58.875143 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1788/3718] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:58 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1545 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:59.187565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b7fd1527-7009-4761-8428-e608c83a0424 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:59.188191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b7fd1527-7009-4761-8428-e608c83a0424 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:59.195167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7fd1527-7009-4761-8428-e608c83a0424 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:59.196403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7fd1527-7009-4761-8428-e608c83a0424 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:59.198024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7fd1527-7009-4761-8428-e608c83a0424 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:59.198696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7fd1527-7009-4761-8428-e608c83a0424 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:59.292511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-feab64bd-9f3f-49ac-b5b3-71d3bf0f2009 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:59.295547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-feab64bd-9f3f-49ac-b5b3-71d3bf0f2009 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:59.311246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-feab64bd-9f3f-49ac-b5b3-71d3bf0f2009 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:59.314873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-feab64bd-9f3f-49ac-b5b3-71d3bf0f2009 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:59.316589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-feab64bd-9f3f-49ac-b5b3-71d3bf0f2009 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:59.319570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-feab64bd-9f3f-49ac-b5b3-71d3bf0f2009 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:59.397015 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-feab64bd-9f3f-49ac-b5b3-71d3bf0f2009 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.106111 Jan 22 21:10:59.400311 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1789/3719] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:10:59 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:10:59.410087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b7fd1527-7009-4761-8428-e608c83a0424 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:59.417574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-707b9858-ebb7-45a5-b010-2984a0fc256b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:10:59.417574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-707b9858-ebb7-45a5-b010-2984a0fc256b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:59.420588 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b7fd1527-7009-4761-8428-e608c83a0424 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1464 microversion: 2.1 time: 0.237340 Jan 22 21:10:59.421276 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1931/3720] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:59 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1464 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:10:59.433268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-707b9858-ebb7-45a5-b010-2984a0fc256b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:59.433268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-707b9858-ebb7-45a5-b010-2984a0fc256b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:59.433268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-707b9858-ebb7-45a5-b010-2984a0fc256b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:59.433268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-707b9858-ebb7-45a5-b010-2984a0fc256b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:59.492720 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-707b9858-ebb7-45a5-b010-2984a0fc256b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.088474 Jan 22 21:10:59.493910 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1790/3721] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:10:59 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:10:59.496408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-66e40c17-7ec1-4093-a2e3-28f39d99ebff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:59.497130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-66e40c17-7ec1-4093-a2e3-28f39d99ebff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:59.519638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66e40c17-7ec1-4093-a2e3-28f39d99ebff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:59.520418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66e40c17-7ec1-4093-a2e3-28f39d99ebff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:59.521459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66e40c17-7ec1-4093-a2e3-28f39d99ebff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:59.522130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66e40c17-7ec1-4093-a2e3-28f39d99ebff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:59.618967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dc58bc1c-a2bb-47b2-94a7-50d8029ec181 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:59.619782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dc58bc1c-a2bb-47b2-94a7-50d8029ec181 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:59.633792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc58bc1c-a2bb-47b2-94a7-50d8029ec181 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:59.636208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc58bc1c-a2bb-47b2-94a7-50d8029ec181 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:59.645440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc58bc1c-a2bb-47b2-94a7-50d8029ec181 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:59.645440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc58bc1c-a2bb-47b2-94a7-50d8029ec181 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:59.689272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-66e40c17-7ec1-4093-a2e3-28f39d99ebff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:59.699925 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-66e40c17-7ec1-4093-a2e3-28f39d99ebff tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1217 microversion: 2.1 time: 0.206232 Jan 22 21:10:59.699925 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1932/3722] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:59 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1217 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:59.879483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dc58bc1c-a2bb-47b2-94a7-50d8029ec181 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:10:59.889332 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dc58bc1c-a2bb-47b2-94a7-50d8029ec181 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.288626 Jan 22 21:10:59.892167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-40d76f10-c3c0-4a5d-ab43-422754806ff3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:10:59.892852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-40d76f10-c3c0-4a5d-ab43-422754806ff3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:10:59.899104 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1791/3723] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:59 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:10:59.899589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40d76f10-c3c0-4a5d-ab43-422754806ff3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:59.900051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40d76f10-c3c0-4a5d-ab43-422754806ff3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:10:59.900848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40d76f10-c3c0-4a5d-ab43-422754806ff3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:10:59.901408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40d76f10-c3c0-4a5d-ab43-422754806ff3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:00.156652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-40d76f10-c3c0-4a5d-ab43-422754806ff3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:00.164321 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-40d76f10-c3c0-4a5d-ab43-422754806ff3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1545 microversion: 2.1 time: 0.276557 Jan 22 21:11:00.175906 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1933/3724] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:10:59 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1545 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:00.412790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d1a03ac6-0581-4c7d-b9e5-dbe07feef8d3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:00.413767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d1a03ac6-0581-4c7d-b9e5-dbe07feef8d3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:00.420697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1a03ac6-0581-4c7d-b9e5-dbe07feef8d3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:00.421153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1a03ac6-0581-4c7d-b9e5-dbe07feef8d3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:00.421991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1a03ac6-0581-4c7d-b9e5-dbe07feef8d3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:00.422503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1a03ac6-0581-4c7d-b9e5-dbe07feef8d3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:00.438525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d287780-c596-4659-9d67-606b82a3f231 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:00.439839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d287780-c596-4659-9d67-606b82a3f231 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:00.446564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d287780-c596-4659-9d67-606b82a3f231 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:00.456010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d287780-c596-4659-9d67-606b82a3f231 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:00.457219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d287780-c596-4659-9d67-606b82a3f231 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:00.458819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d287780-c596-4659-9d67-606b82a3f231 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:00.506059 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d1a03ac6-0581-4c7d-b9e5-dbe07feef8d3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.097736 Jan 22 21:11:00.507161 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1792/3725] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:00 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:00.513002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e9a9f4ce-62bd-4d1d-a9db-90ce6e1ad20c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:00.514013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e9a9f4ce-62bd-4d1d-a9db-90ce6e1ad20c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:00.526310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a9f4ce-62bd-4d1d-a9db-90ce6e1ad20c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:00.526768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a9f4ce-62bd-4d1d-a9db-90ce6e1ad20c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:00.536305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a9f4ce-62bd-4d1d-a9db-90ce6e1ad20c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:00.536305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9a9f4ce-62bd-4d1d-a9db-90ce6e1ad20c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:00.599079 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e9a9f4ce-62bd-4d1d-a9db-90ce6e1ad20c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.085945 Jan 22 21:11:00.601650 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1793/3726] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:00 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:00.703985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0d287780-c596-4659-9d67-606b82a3f231 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:00.712345 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d287780-c596-4659-9d67-606b82a3f231 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1466 microversion: 2.1 time: 0.278323 Jan 22 21:11:00.717960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-25a63aed-a339-404f-b803-d2b6fd198f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:00.719932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-25a63aed-a339-404f-b803-d2b6fd198f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:00.720236 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1934/3727] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:00 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1466 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:00.739134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25a63aed-a339-404f-b803-d2b6fd198f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:00.740575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25a63aed-a339-404f-b803-d2b6fd198f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:00.742203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25a63aed-a339-404f-b803-d2b6fd198f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:00.742853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25a63aed-a339-404f-b803-d2b6fd198f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:00.909215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-139f43e8-5f5d-4d0c-bc24-8dd25547de2f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:00.909883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-139f43e8-5f5d-4d0c-bc24-8dd25547de2f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:00.921357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-139f43e8-5f5d-4d0c-bc24-8dd25547de2f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:00.921737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-25a63aed-a339-404f-b803-d2b6fd198f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:00.922382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-139f43e8-5f5d-4d0c-bc24-8dd25547de2f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:00.923422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-139f43e8-5f5d-4d0c-bc24-8dd25547de2f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:00.924883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-139f43e8-5f5d-4d0c-bc24-8dd25547de2f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:00.955468 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-25a63aed-a339-404f-b803-d2b6fd198f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1265 microversion: 2.1 time: 0.242059 Jan 22 21:11:00.956102 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1794/3728] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:00 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:01.144926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-139f43e8-5f5d-4d0c-bc24-8dd25547de2f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:01.153612 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-139f43e8-5f5d-4d0c-bc24-8dd25547de2f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.248387 Jan 22 21:11:01.157806 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1935/3729] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:00 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:01.184131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f1507140-c93b-4797-9486-404a0cedd4a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:01.185235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f1507140-c93b-4797-9486-404a0cedd4a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:01.199307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1507140-c93b-4797-9486-404a0cedd4a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:01.200939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1507140-c93b-4797-9486-404a0cedd4a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:01.201964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1507140-c93b-4797-9486-404a0cedd4a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:01.204065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1507140-c93b-4797-9486-404a0cedd4a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:01.516983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-07c50a5a-6a22-4d88-a745-6806174e485d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:01.518013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-07c50a5a-6a22-4d88-a745-6806174e485d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:01.536009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07c50a5a-6a22-4d88-a745-6806174e485d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:01.536461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07c50a5a-6a22-4d88-a745-6806174e485d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:01.537274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07c50a5a-6a22-4d88-a745-6806174e485d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:01.537776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07c50a5a-6a22-4d88-a745-6806174e485d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:01.579965 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-07c50a5a-6a22-4d88-a745-6806174e485d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.066398 Jan 22 21:11:01.580937 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1936/3730] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:01 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:11:01.612680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-48df51d7-da81-402a-aee7-00bc682b0e77 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:01.614013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-48df51d7-da81-402a-aee7-00bc682b0e77 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:01.620922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48df51d7-da81-402a-aee7-00bc682b0e77 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:01.622182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48df51d7-da81-402a-aee7-00bc682b0e77 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:01.623123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48df51d7-da81-402a-aee7-00bc682b0e77 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:01.623755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48df51d7-da81-402a-aee7-00bc682b0e77 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:01.673008 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-48df51d7-da81-402a-aee7-00bc682b0e77 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.064174 Jan 22 21:11:01.673690 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1937/3731] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:01 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:11:01.731079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8361ac17-d52b-4fcb-ac3f-58b01042e477 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:01.732318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8361ac17-d52b-4fcb-ac3f-58b01042e477 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:01.742515 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8361ac17-d52b-4fcb-ac3f-58b01042e477 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:01.743509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8361ac17-d52b-4fcb-ac3f-58b01042e477 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:01.744479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8361ac17-d52b-4fcb-ac3f-58b01042e477 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:01.745088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8361ac17-d52b-4fcb-ac3f-58b01042e477 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:01.745756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f1507140-c93b-4797-9486-404a0cedd4a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:01.758978 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f1507140-c93b-4797-9486-404a0cedd4a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1545 microversion: 2.1 time: 0.579161 Jan 22 21:11:01.761494 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1795/3732] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:01 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1545 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:01.946808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8361ac17-d52b-4fcb-ac3f-58b01042e477 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:01.956877 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8361ac17-d52b-4fcb-ac3f-58b01042e477 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.230365 Jan 22 21:11:01.958829 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1938/3733] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:01 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:01.984615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-55642bc1-53a4-4fb5-b299-0337a0628cd7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:01.985483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-55642bc1-53a4-4fb5-b299-0337a0628cd7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:01.993890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55642bc1-53a4-4fb5-b299-0337a0628cd7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:01.994349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55642bc1-53a4-4fb5-b299-0337a0628cd7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:01.995547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55642bc1-53a4-4fb5-b299-0337a0628cd7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:01.995646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55642bc1-53a4-4fb5-b299-0337a0628cd7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:02.126654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-55642bc1-53a4-4fb5-b299-0337a0628cd7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:02.137258 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-55642bc1-53a4-4fb5-b299-0337a0628cd7 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1271 microversion: 2.1 time: 0.156245 Jan 22 21:11:02.140324 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1796/3734] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:01 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:02.174303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-26be4f6a-8544-4fb2-bcf0-52a69cfe1365 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:02.174955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-26be4f6a-8544-4fb2-bcf0-52a69cfe1365 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:02.185523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26be4f6a-8544-4fb2-bcf0-52a69cfe1365 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:02.185990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26be4f6a-8544-4fb2-bcf0-52a69cfe1365 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:02.186798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26be4f6a-8544-4fb2-bcf0-52a69cfe1365 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:02.189772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26be4f6a-8544-4fb2-bcf0-52a69cfe1365 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:02.429523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-26be4f6a-8544-4fb2-bcf0-52a69cfe1365 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:02.444035 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-26be4f6a-8544-4fb2-bcf0-52a69cfe1365 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.271431 Jan 22 21:11:02.446100 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1939/3735] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:02 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:02.591755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b673ab25-a8da-45f4-ae7a-f163eaf2833e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:02.592697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b673ab25-a8da-45f4-ae7a-f163eaf2833e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:02.604249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b673ab25-a8da-45f4-ae7a-f163eaf2833e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:02.604717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b673ab25-a8da-45f4-ae7a-f163eaf2833e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:02.606790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b673ab25-a8da-45f4-ae7a-f163eaf2833e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:02.608183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b673ab25-a8da-45f4-ae7a-f163eaf2833e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:02.671094 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b673ab25-a8da-45f4-ae7a-f163eaf2833e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.082856 Jan 22 21:11:02.674862 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1797/3736] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:02 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:02.686599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-916b5492-a268-4bea-b07e-7b268f8c055c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:02.688479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-916b5492-a268-4bea-b07e-7b268f8c055c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:02.705750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-4c387beb-b27f-4d43-9ea1-fd52cdfd73fd req-649ca6c4-340d-439f-a36c-12f7c7f19d13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49b2aed8-f03f-4c04-b508-cc9a7e172dd6", "tag": "99dd6838-12b2-4c2b-b219-2af5c1a44a74"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:02.706603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-916b5492-a268-4bea-b07e-7b268f8c055c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:02.706975 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:02.706975 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:11:02.707187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-916b5492-a268-4bea-b07e-7b268f8c055c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:02.708000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-916b5492-a268-4bea-b07e-7b268f8c055c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:02.711658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-916b5492-a268-4bea-b07e-7b268f8c055c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:02.723884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4c387beb-b27f-4d43-9ea1-fd52cdfd73fd req-649ca6c4-340d-439f-a36c-12f7c7f19d13 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:02.724321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4c387beb-b27f-4d43-9ea1-fd52cdfd73fd req-649ca6c4-340d-439f-a36c-12f7c7f19d13 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:02.760556 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-4c387beb-b27f-4d43-9ea1-fd52cdfd73fd req-649ca6c4-340d-439f-a36c-12f7c7f19d13 service nova] Creating event network-changed:99dd6838-12b2-4c2b-b219-2af5c1a44a74 for instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 on nch1-master-1 Jan 22 21:11:02.775015 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-4c387beb-b27f-4d43-9ea1-fd52cdfd73fd req-649ca6c4-340d-439f-a36c-12f7c7f19d13 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075016 Jan 22 21:11:02.775917 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1798/3737] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:02.786003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cfb60855-c8d4-4fba-a35c-2902f73d6d8d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:02.790725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cfb60855-c8d4-4fba-a35c-2902f73d6d8d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:02.806239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfb60855-c8d4-4fba-a35c-2902f73d6d8d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:02.808070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfb60855-c8d4-4fba-a35c-2902f73d6d8d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:02.810343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfb60855-c8d4-4fba-a35c-2902f73d6d8d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:02.814073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfb60855-c8d4-4fba-a35c-2902f73d6d8d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:02.829187 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-916b5492-a268-4bea-b07e-7b268f8c055c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.148035 Jan 22 21:11:02.830801 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1940/3738] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:02 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:02.981596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-14858f88-cb38-43d0-9c98-dea86f4aebbe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:02.982545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-14858f88-cb38-43d0-9c98-dea86f4aebbe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:02.999029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14858f88-cb38-43d0-9c98-dea86f4aebbe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:03.000834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14858f88-cb38-43d0-9c98-dea86f4aebbe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:03.003991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14858f88-cb38-43d0-9c98-dea86f4aebbe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:03.004714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14858f88-cb38-43d0-9c98-dea86f4aebbe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:03.143899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cfb60855-c8d4-4fba-a35c-2902f73d6d8d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:03.153348 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cfb60855-c8d4-4fba-a35c-2902f73d6d8d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1545 microversion: 2.1 time: 0.375382 Jan 22 21:11:03.154568 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1799/3739] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:02 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1545 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:03.159327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1fe198b7-a546-437b-8799-c473f9622f6f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:03.160141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1fe198b7-a546-437b-8799-c473f9622f6f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:03.166408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fe198b7-a546-437b-8799-c473f9622f6f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:03.167273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fe198b7-a546-437b-8799-c473f9622f6f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:03.168279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fe198b7-a546-437b-8799-c473f9622f6f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:03.168931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fe198b7-a546-437b-8799-c473f9622f6f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:03.349765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-14858f88-cb38-43d0-9c98-dea86f4aebbe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:03.350612 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-14858f88-cb38-43d0-9c98-dea86f4aebbe tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.375499 Jan 22 21:11:03.354345 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1941/3740] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:02 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:03.463507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1062c486-d9db-4ad3-85c6-d31382a0e20b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:03.464224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1062c486-d9db-4ad3-85c6-d31382a0e20b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:03.474486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1062c486-d9db-4ad3-85c6-d31382a0e20b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:03.475109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1062c486-d9db-4ad3-85c6-d31382a0e20b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:03.476065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1062c486-d9db-4ad3-85c6-d31382a0e20b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:03.476592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1062c486-d9db-4ad3-85c6-d31382a0e20b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:03.629448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1fe198b7-a546-437b-8799-c473f9622f6f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:03.646820 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1fe198b7-a546-437b-8799-c473f9622f6f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1313 microversion: 2.1 time: 0.491000 Jan 22 21:11:03.649640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1062c486-d9db-4ad3-85c6-d31382a0e20b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:03.650834 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1800/3741] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:03 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:03.658553 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1062c486-d9db-4ad3-85c6-d31382a0e20b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.199132 Jan 22 21:11:03.668031 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1942/3742] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:03 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:03.684805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7cf540ed-c7d6-4b82-8de1-2d382d764fa6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:03.687088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7cf540ed-c7d6-4b82-8de1-2d382d764fa6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:03.697557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cf540ed-c7d6-4b82-8de1-2d382d764fa6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:03.698492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cf540ed-c7d6-4b82-8de1-2d382d764fa6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:03.701878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cf540ed-c7d6-4b82-8de1-2d382d764fa6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:03.702512 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cf540ed-c7d6-4b82-8de1-2d382d764fa6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:03.776540 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7cf540ed-c7d6-4b82-8de1-2d382d764fa6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.096549 Jan 22 21:11:03.777704 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1801/3743] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:03 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:03.844567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-28066889-31fc-4a44-b13c-b094ed96f8b6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:03.846823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-28066889-31fc-4a44-b13c-b094ed96f8b6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:03.859727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28066889-31fc-4a44-b13c-b094ed96f8b6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:03.860547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28066889-31fc-4a44-b13c-b094ed96f8b6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:03.865087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28066889-31fc-4a44-b13c-b094ed96f8b6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:03.867873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28066889-31fc-4a44-b13c-b094ed96f8b6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:03.939718 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-28066889-31fc-4a44-b13c-b094ed96f8b6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.101745 Jan 22 21:11:03.941595 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1943/3744] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:03 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:04.171869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6502cc0b-8f94-4cc9-9b54-377f5701af72 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:04.172578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6502cc0b-8f94-4cc9-9b54-377f5701af72 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:04.181478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6502cc0b-8f94-4cc9-9b54-377f5701af72 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:04.182142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6502cc0b-8f94-4cc9-9b54-377f5701af72 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:04.183279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6502cc0b-8f94-4cc9-9b54-377f5701af72 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:04.184419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6502cc0b-8f94-4cc9-9b54-377f5701af72 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:04.389267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9165ff2b-ec1c-4090-97c4-bdf97ba79521 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:04.389267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9165ff2b-ec1c-4090-97c4-bdf97ba79521 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:04.391602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9165ff2b-ec1c-4090-97c4-bdf97ba79521 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:04.392179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9165ff2b-ec1c-4090-97c4-bdf97ba79521 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:04.393289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9165ff2b-ec1c-4090-97c4-bdf97ba79521 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:04.400233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9165ff2b-ec1c-4090-97c4-bdf97ba79521 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:04.591726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9165ff2b-ec1c-4090-97c4-bdf97ba79521 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:04.600165 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9165ff2b-ec1c-4090-97c4-bdf97ba79521 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.232045 Jan 22 21:11:04.600975 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1944/3745] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:04 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:04.667197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-925f5dff-434c-4ec0-9a22-96d2802d5efe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:04.668327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-925f5dff-434c-4ec0-9a22-96d2802d5efe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:04.675374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-925f5dff-434c-4ec0-9a22-96d2802d5efe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:04.675919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-925f5dff-434c-4ec0-9a22-96d2802d5efe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:04.676794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-925f5dff-434c-4ec0-9a22-96d2802d5efe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:04.677315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-925f5dff-434c-4ec0-9a22-96d2802d5efe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:04.823833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-925f5dff-434c-4ec0-9a22-96d2802d5efe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:04.833373 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-925f5dff-434c-4ec0-9a22-96d2802d5efe tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1313 microversion: 2.1 time: 0.170005 Jan 22 21:11:04.834177 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1945/3746] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:04 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:04.838791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c39fa7e0-be89-4474-8a5b-e04aac77f88c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:04.840266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c39fa7e0-be89-4474-8a5b-e04aac77f88c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:04.846710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c39fa7e0-be89-4474-8a5b-e04aac77f88c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:04.847336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c39fa7e0-be89-4474-8a5b-e04aac77f88c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:04.847969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c39fa7e0-be89-4474-8a5b-e04aac77f88c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:04.848428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c39fa7e0-be89-4474-8a5b-e04aac77f88c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:04.987736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c39fa7e0-be89-4474-8a5b-e04aac77f88c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:05.024816 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c39fa7e0-be89-4474-8a5b-e04aac77f88c tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.165811 Jan 22 21:11:05.024816 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1946/3747] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:04 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:05.024816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8bd1a2ba-7af6-4af0-a9de-f470b74592ce tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:05.025619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8bd1a2ba-7af6-4af0-a9de-f470b74592ce tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:05.035156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bd1a2ba-7af6-4af0-a9de-f470b74592ce tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:05.035841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bd1a2ba-7af6-4af0-a9de-f470b74592ce tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:05.036655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bd1a2ba-7af6-4af0-a9de-f470b74592ce tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:05.037106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bd1a2ba-7af6-4af0-a9de-f470b74592ce tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:05.080450 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8bd1a2ba-7af6-4af0-a9de-f470b74592ce tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.076344 Jan 22 21:11:05.081423 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1947/3748] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:05 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:05.087933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-952a3105-f017-4895-919c-0afe7e911d05 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:05.089190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-952a3105-f017-4895-919c-0afe7e911d05 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:05.097371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-952a3105-f017-4895-919c-0afe7e911d05 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:05.097857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-952a3105-f017-4895-919c-0afe7e911d05 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:05.098684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-952a3105-f017-4895-919c-0afe7e911d05 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:05.099129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-952a3105-f017-4895-919c-0afe7e911d05 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:05.102681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6502cc0b-8f94-4cc9-9b54-377f5701af72 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:05.112814 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6502cc0b-8f94-4cc9-9b54-377f5701af72 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1545 microversion: 2.1 time: 0.945421 Jan 22 21:11:05.113984 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1802/3749] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:04 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1545 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:05.149824 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-952a3105-f017-4895-919c-0afe7e911d05 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.065236 Jan 22 21:11:05.150509 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1948/3750] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:05 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:05.623162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dc08d3c1-75d3-44ef-885c-0677287d8ad9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:05.626419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dc08d3c1-75d3-44ef-885c-0677287d8ad9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:05.648429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc08d3c1-75d3-44ef-885c-0677287d8ad9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:05.649222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc08d3c1-75d3-44ef-885c-0677287d8ad9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:05.654029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc08d3c1-75d3-44ef-885c-0677287d8ad9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:05.654739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc08d3c1-75d3-44ef-885c-0677287d8ad9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:05.695703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-12b99ae5-bf1b-4b92-abab-6a15b37e2831 req-5d283aa8-84cd-4a99-8167-b223a4088c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5503c80-72b0-4a0b-b82f-333ae4fdd2d8", "tag": "c87fc1c2-c18f-4e31-aa6b-1a0b3f73a309"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:05.697339 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:05.697339 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:11:05.717619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-12b99ae5-bf1b-4b92-abab-6a15b37e2831 req-5d283aa8-84cd-4a99-8167-b223a4088c4f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:05.718087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-12b99ae5-bf1b-4b92-abab-6a15b37e2831 req-5d283aa8-84cd-4a99-8167-b223a4088c4f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:05.745242 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-12b99ae5-bf1b-4b92-abab-6a15b37e2831 req-5d283aa8-84cd-4a99-8167-b223a4088c4f service nova] Creating event network-changed:c87fc1c2-c18f-4e31-aa6b-1a0b3f73a309 for instance d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 on nch1-master-1 Jan 22 21:11:05.751248 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-12b99ae5-bf1b-4b92-abab-6a15b37e2831 req-5d283aa8-84cd-4a99-8167-b223a4088c4f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060761 Jan 22 21:11:05.762216 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1949/3751] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:05.852146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19222800-fd29-48b0-a3d7-8ab098038fe9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:05.853592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-19222800-fd29-48b0-a3d7-8ab098038fe9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:05.866131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19222800-fd29-48b0-a3d7-8ab098038fe9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:05.870435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19222800-fd29-48b0-a3d7-8ab098038fe9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:05.872178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19222800-fd29-48b0-a3d7-8ab098038fe9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:05.876435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19222800-fd29-48b0-a3d7-8ab098038fe9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:06.202092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-19222800-fd29-48b0-a3d7-8ab098038fe9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:06.212910 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19222800-fd29-48b0-a3d7-8ab098038fe9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1313 microversion: 2.1 time: 0.365133 Jan 22 21:11:06.227016 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1950/3752] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:05 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:06.239368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dd3d9466-4a52-427f-894b-593872c8d00e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:06.240314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dd3d9466-4a52-427f-894b-593872c8d00e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:06.252523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd3d9466-4a52-427f-894b-593872c8d00e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:06.253264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd3d9466-4a52-427f-894b-593872c8d00e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:06.256216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd3d9466-4a52-427f-894b-593872c8d00e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:06.256216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd3d9466-4a52-427f-894b-593872c8d00e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:06.287546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dc08d3c1-75d3-44ef-885c-0677287d8ad9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:06.314894 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dc08d3c1-75d3-44ef-885c-0677287d8ad9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.696362 Jan 22 21:11:06.319311 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1803/3753] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:05 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:06.344791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aeb22edc-2bf5-49b8-9328-f6181f3590ae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:06.352280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aeb22edc-2bf5-49b8-9328-f6181f3590ae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:06.375484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aeb22edc-2bf5-49b8-9328-f6181f3590ae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:06.379022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aeb22edc-2bf5-49b8-9328-f6181f3590ae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:06.381727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aeb22edc-2bf5-49b8-9328-f6181f3590ae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:06.384050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aeb22edc-2bf5-49b8-9328-f6181f3590ae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:06.479900 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aeb22edc-2bf5-49b8-9328-f6181f3590ae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.146433 Jan 22 21:11:06.487593 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1804/3754] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:06 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:06.494671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-909d75b8-bc93-4346-a6d4-412ed782a718 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:06.501397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-909d75b8-bc93-4346-a6d4-412ed782a718 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:06.521161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-909d75b8-bc93-4346-a6d4-412ed782a718 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:06.521936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-909d75b8-bc93-4346-a6d4-412ed782a718 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:06.523063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-909d75b8-bc93-4346-a6d4-412ed782a718 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:06.523491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-909d75b8-bc93-4346-a6d4-412ed782a718 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:06.888803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-909d75b8-bc93-4346-a6d4-412ed782a718 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:06.905609 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-909d75b8-bc93-4346-a6d4-412ed782a718 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1544 microversion: 2.1 time: 0.415343 Jan 22 21:11:06.906360 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1805/3755] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:06 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1544 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:06.934176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-339f2392-93af-40e0-a021-34f9960d8204 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:06.935149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-339f2392-93af-40e0-a021-34f9960d8204 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:06.964175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-339f2392-93af-40e0-a021-34f9960d8204 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:06.965775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-339f2392-93af-40e0-a021-34f9960d8204 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:06.969556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-339f2392-93af-40e0-a021-34f9960d8204 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:06.974614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-339f2392-93af-40e0-a021-34f9960d8204 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:07.088926 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-339f2392-93af-40e0-a021-34f9960d8204 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.169200 Jan 22 21:11:07.093088 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1806/3756] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:06 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:07.232736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-677f7555-e413-46e5-aedd-39866a391e45 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:07.233469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-677f7555-e413-46e5-aedd-39866a391e45 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:07.270293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-677f7555-e413-46e5-aedd-39866a391e45 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:07.270678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-677f7555-e413-46e5-aedd-39866a391e45 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:07.275988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-677f7555-e413-46e5-aedd-39866a391e45 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:07.276471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-677f7555-e413-46e5-aedd-39866a391e45 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:07.409620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dd3d9466-4a52-427f-894b-593872c8d00e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:07.426342 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dd3d9466-4a52-427f-894b-593872c8d00e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 1.197199 Jan 22 21:11:07.427603 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1951/3757] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:06 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:07.433713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b539e4a9-50d2-4c14-858b-b666765967e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:07.447298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b539e4a9-50d2-4c14-858b-b666765967e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:07.456720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b539e4a9-50d2-4c14-858b-b666765967e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:07.457362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b539e4a9-50d2-4c14-858b-b666765967e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:07.458373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b539e4a9-50d2-4c14-858b-b666765967e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:07.460229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b539e4a9-50d2-4c14-858b-b666765967e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:07.798700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-677f7555-e413-46e5-aedd-39866a391e45 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:07.807646 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-677f7555-e413-46e5-aedd-39866a391e45 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1313 microversion: 2.1 time: 0.580424 Jan 22 21:11:07.808614 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1807/3758] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:07 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:07.813799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bf28030c-2ae1-42e8-a2d6-1bd00494f3ed tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:07.814720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bf28030c-2ae1-42e8-a2d6-1bd00494f3ed tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:07.821284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf28030c-2ae1-42e8-a2d6-1bd00494f3ed tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:07.821762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf28030c-2ae1-42e8-a2d6-1bd00494f3ed tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:07.822911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf28030c-2ae1-42e8-a2d6-1bd00494f3ed tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:07.823363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf28030c-2ae1-42e8-a2d6-1bd00494f3ed tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:07.887126 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bf28030c-2ae1-42e8-a2d6-1bd00494f3ed tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.076118 Jan 22 21:11:07.891763 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1808/3759] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:07 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:07.893699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-28e2f6e1-4e84-487e-ae4b-a517da0b68ae req-c6819a6b-6bca-4ec5-9dc4-69d5dda86e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40cd339-38cd-40f4-a4e5-0b220e363df8", "name": "network-vif-unplugged", "status": "completed", "tag": "8c94703f-c59c-42e5-b507-01dab2c8cb70"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:07.895475 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:07.895475 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:11:07.905441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-28e2f6e1-4e84-487e-ae4b-a517da0b68ae req-c6819a6b-6bca-4ec5-9dc4-69d5dda86e39 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:07.905994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-28e2f6e1-4e84-487e-ae4b-a517da0b68ae req-c6819a6b-6bca-4ec5-9dc4-69d5dda86e39 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:07.919572 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-28e2f6e1-4e84-487e-ae4b-a517da0b68ae req-c6819a6b-6bca-4ec5-9dc4-69d5dda86e39 service nova] Creating event network-vif-unplugged:8c94703f-c59c-42e5-b507-01dab2c8cb70 for instance a40cd339-38cd-40f4-a4e5-0b220e363df8 on nch1-master-1 Jan 22 21:11:07.927012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-28e2f6e1-4e84-487e-ae4b-a517da0b68ae req-c6819a6b-6bca-4ec5-9dc4-69d5dda86e39 service nova] Instance a40cd339-38cd-40f4-a4e5-0b220e363df8 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:11:07.953021 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-28e2f6e1-4e84-487e-ae4b-a517da0b68ae req-c6819a6b-6bca-4ec5-9dc4-69d5dda86e39 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050626 Jan 22 21:11:07.953021 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1809/3760] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:07.953242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b539e4a9-50d2-4c14-858b-b666765967e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:07.953327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d75a08c-c540-4d9b-8373-b5b14018e7b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:07.953327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d75a08c-c540-4d9b-8373-b5b14018e7b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:07.955465 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b539e4a9-50d2-4c14-858b-b666765967e2 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.526573 Jan 22 21:11:07.956112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d75a08c-c540-4d9b-8373-b5b14018e7b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:07.956534 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1952/3761] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:07 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:07.957998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d75a08c-c540-4d9b-8373-b5b14018e7b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:07.958967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d75a08c-c540-4d9b-8373-b5b14018e7b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:07.960052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d75a08c-c540-4d9b-8373-b5b14018e7b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:08.104355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-be8932c1-b071-4d18-a2d7-d5b2e486e612 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:08.106090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-be8932c1-b071-4d18-a2d7-d5b2e486e612 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:08.115372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be8932c1-b071-4d18-a2d7-d5b2e486e612 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:08.115839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be8932c1-b071-4d18-a2d7-d5b2e486e612 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:08.116639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be8932c1-b071-4d18-a2d7-d5b2e486e612 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:08.117079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be8932c1-b071-4d18-a2d7-d5b2e486e612 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:08.180851 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-be8932c1-b071-4d18-a2d7-d5b2e486e612 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.080440 Jan 22 21:11:08.182972 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1953/3762] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:08 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:11:08.302261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3d75a08c-c540-4d9b-8373-b5b14018e7b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:08.314348 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d75a08c-c540-4d9b-8373-b5b14018e7b1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1544 microversion: 2.1 time: 0.371819 Jan 22 21:11:08.317410 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1810/3763] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:07 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1544 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:08.444668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e9b1b79d-6d48-4fee-a3b2-d2ad21969b5b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:08.445441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e9b1b79d-6d48-4fee-a3b2-d2ad21969b5b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:08.456133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9b1b79d-6d48-4fee-a3b2-d2ad21969b5b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:08.456404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9b1b79d-6d48-4fee-a3b2-d2ad21969b5b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:08.457233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9b1b79d-6d48-4fee-a3b2-d2ad21969b5b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:08.457736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9b1b79d-6d48-4fee-a3b2-d2ad21969b5b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:08.787609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e9b1b79d-6d48-4fee-a3b2-d2ad21969b5b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:08.806800 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e9b1b79d-6d48-4fee-a3b2-d2ad21969b5b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.361358 Jan 22 21:11:08.806800 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1954/3764] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:08 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:08.828356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-512fec57-8d02-4ead-add5-84fa3f3cd399 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:08.829773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-512fec57-8d02-4ead-add5-84fa3f3cd399 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:08.838389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-512fec57-8d02-4ead-add5-84fa3f3cd399 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:08.839061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-512fec57-8d02-4ead-add5-84fa3f3cd399 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:08.840465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-512fec57-8d02-4ead-add5-84fa3f3cd399 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:08.841461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-512fec57-8d02-4ead-add5-84fa3f3cd399 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:08.867041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1217388906", "imageRef": "5be96d12-22f7-4394-8bc7-659809ce9b58", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "37abd67f-03d8-4be2-afe9-270dfdcb7f31"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:08.954988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] validate_networks() for [('37abd67f-03d8-4be2-afe9-270dfdcb7f31', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:11:09.322342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-512fec57-8d02-4ead-add5-84fa3f3cd399 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:09.336223 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-512fec57-8d02-4ead-add5-84fa3f3cd399 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1313 microversion: 2.1 time: 0.515556 Jan 22 21:11:09.336927 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1955/3765] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:08 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:09.341868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6bd4f63d-1836-4498-b4d3-e4e844669f2c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:09.347677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6bd4f63d-1836-4498-b4d3-e4e844669f2c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:09.365746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bd4f63d-1836-4498-b4d3-e4e844669f2c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:09.369954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bd4f63d-1836-4498-b4d3-e4e844669f2c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:09.372052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bd4f63d-1836-4498-b4d3-e4e844669f2c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:09.374725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bd4f63d-1836-4498-b4d3-e4e844669f2c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:09.451182 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6bd4f63d-1836-4498-b4d3-e4e844669f2c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.112604 Jan 22 21:11:09.455720 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1956/3766] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:09 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:09.460982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-168c27fd-8ee0-4a8c-805a-d30de93d99ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:09.468813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-168c27fd-8ee0-4a8c-805a-d30de93d99ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:09.487769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-168c27fd-8ee0-4a8c-805a-d30de93d99ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:09.487769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-168c27fd-8ee0-4a8c-805a-d30de93d99ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:09.487769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-168c27fd-8ee0-4a8c-805a-d30de93d99ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:09.487769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-168c27fd-8ee0-4a8c-805a-d30de93d99ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:09.894677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-168c27fd-8ee0-4a8c-805a-d30de93d99ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:09.909401 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-168c27fd-8ee0-4a8c-805a-d30de93d99ad tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.452270 Jan 22 21:11:09.921246 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1957/3767] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:09 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:09.927842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f9c2edde-9fdc-4804-8465-3ce06a5c91d0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:09.929135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f9c2edde-9fdc-4804-8465-3ce06a5c91d0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:09.940368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9c2edde-9fdc-4804-8465-3ce06a5c91d0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:09.941943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9c2edde-9fdc-4804-8465-3ce06a5c91d0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:09.944080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9c2edde-9fdc-4804-8465-3ce06a5c91d0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:09.944827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9c2edde-9fdc-4804-8465-3ce06a5c91d0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:10.000066 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f9c2edde-9fdc-4804-8465-3ce06a5c91d0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.075243 Jan 22 21:11:10.003534 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1958/3768] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:09 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:10.025574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e18a7343-a268-4620-8dbb-7fc688c99b10 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:10.029432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e18a7343-a268-4620-8dbb-7fc688c99b10 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:10.040860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e18a7343-a268-4620-8dbb-7fc688c99b10 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:10.041714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e18a7343-a268-4620-8dbb-7fc688c99b10 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:10.042770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e18a7343-a268-4620-8dbb-7fc688c99b10 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:10.043934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e18a7343-a268-4620-8dbb-7fc688c99b10 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:10.251600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:11:10.252072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:11:10.252562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:11:10.253032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:11:10.253572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:11:10.269062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:10.269560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:10.270652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:10.271544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:10.298816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Getting quotas for project 4dfa8e2e09994a9d8746ab84c2cc6b6f. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:11:10.313009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Getting quotas for user ead04bf776f146eabbe0f9f32319542b and project 4dfa8e2e09994a9d8746ab84c2cc6b6f. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:11:10.337614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:11:10.340751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5be96d12-22f7-4394-8bc7-659809ce9b58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:11:10.541861 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96fd1b38-977d-466d-afe9-8e2b8fc8a71d tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.752658 Jan 22 21:11:10.543767 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1811/3769] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:11:08 2022] POST /compute/v2.1/servers => generated 382 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:11:10.556231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a7228b76-fca9-4604-980a-7c1d85f6d271 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:10.561463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a7228b76-fca9-4604-980a-7c1d85f6d271 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:10.587504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7228b76-fca9-4604-980a-7c1d85f6d271 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:10.591654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7228b76-fca9-4604-980a-7c1d85f6d271 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:10.595961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7228b76-fca9-4604-980a-7c1d85f6d271 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:10.609184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7228b76-fca9-4604-980a-7c1d85f6d271 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:10.618643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e18a7343-a268-4620-8dbb-7fc688c99b10 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:10.635872 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e18a7343-a268-4620-8dbb-7fc688c99b10 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1544 microversion: 2.1 time: 0.627142 Jan 22 21:11:10.635872 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1959/3770] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:10 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1544 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:10.639287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-efdcbf91-61ee-42a1-8328-af3fe729d09a req-a7a0134b-c80e-402c-99aa-44c7397353ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a40cd339-38cd-40f4-a4e5-0b220e363df8", "tag": "8c94703f-c59c-42e5-b507-01dab2c8cb70"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:10.641177 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:10.641177 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:11:10.652919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-efdcbf91-61ee-42a1-8328-af3fe729d09a req-a7a0134b-c80e-402c-99aa-44c7397353ad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:10.654160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-efdcbf91-61ee-42a1-8328-af3fe729d09a req-a7a0134b-c80e-402c-99aa-44c7397353ad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:10.681268 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-efdcbf91-61ee-42a1-8328-af3fe729d09a req-a7a0134b-c80e-402c-99aa-44c7397353ad service nova] Creating event network-changed:8c94703f-c59c-42e5-b507-01dab2c8cb70 for instance a40cd339-38cd-40f4-a4e5-0b220e363df8 on nch1-master-1 Jan 22 21:11:10.708378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-efdcbf91-61ee-42a1-8328-af3fe729d09a req-a7a0134b-c80e-402c-99aa-44c7397353ad service nova] Instance a40cd339-38cd-40f4-a4e5-0b220e363df8 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:11:10.740278 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-efdcbf91-61ee-42a1-8328-af3fe729d09a req-a7a0134b-c80e-402c-99aa-44c7397353ad service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104296 Jan 22 21:11:10.744990 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1960/3771] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:10.769852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3e68922d-6728-49a9-99b6-f213a6513ec5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:10.788051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3e68922d-6728-49a9-99b6-f213a6513ec5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:10.810726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e68922d-6728-49a9-99b6-f213a6513ec5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:10.811285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e68922d-6728-49a9-99b6-f213a6513ec5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:10.812217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e68922d-6728-49a9-99b6-f213a6513ec5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:10.812667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e68922d-6728-49a9-99b6-f213a6513ec5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:11.049702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3e68922d-6728-49a9-99b6-f213a6513ec5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:11.053466 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3e68922d-6728-49a9-99b6-f213a6513ec5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1313 microversion: 2.1 time: 0.306039 Jan 22 21:11:11.054595 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1961/3772] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:10 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:11.060246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b7dff6f2-0d99-490d-863e-707a94377726 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:11.061628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b7dff6f2-0d99-490d-863e-707a94377726 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:11.075900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7dff6f2-0d99-490d-863e-707a94377726 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:11.077193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7dff6f2-0d99-490d-863e-707a94377726 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:11.078217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7dff6f2-0d99-490d-863e-707a94377726 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:11.079421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7dff6f2-0d99-490d-863e-707a94377726 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:11.131454 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b7dff6f2-0d99-490d-863e-707a94377726 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.075541 Jan 22 21:11:11.133197 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1962/3773] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:11 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:11.155136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3b835109-a450-4cde-9083-3eb2cf6f225a tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:11.157219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3b835109-a450-4cde-9083-3eb2cf6f225a tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:11.270102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3b835109-a450-4cde-9083-3eb2cf6f225a tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:11.280207 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3b835109-a450-4cde-9083-3eb2cf6f225a tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1226 microversion: 2.1 time: 0.140709 Jan 22 21:11:11.281329 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1963/3774] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:11 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1226 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:11.312902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ca61440e-477e-4106-b172-295cd600dda0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:11.320592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ca61440e-477e-4106-b172-295cd600dda0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:11.360255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca61440e-477e-4106-b172-295cd600dda0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:11.369435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca61440e-477e-4106-b172-295cd600dda0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:11.369435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca61440e-477e-4106-b172-295cd600dda0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:11.369435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca61440e-477e-4106-b172-295cd600dda0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:11.481371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a7228b76-fca9-4604-980a-7c1d85f6d271 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:11.493056 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a7228b76-fca9-4604-980a-7c1d85f6d271 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.945398 Jan 22 21:11:11.512513 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1812/3775] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:10 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:11.532452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-852971e7-a841-4c42-b6e4-11b945084b8e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:11.534593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-852971e7-a841-4c42-b6e4-11b945084b8e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:11.549800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-852971e7-a841-4c42-b6e4-11b945084b8e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:11.550767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-852971e7-a841-4c42-b6e4-11b945084b8e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:11.552451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-852971e7-a841-4c42-b6e4-11b945084b8e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:11.556918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-852971e7-a841-4c42-b6e4-11b945084b8e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:11.619630 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-852971e7-a841-4c42-b6e4-11b945084b8e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.104274 Jan 22 21:11:11.621663 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1813/3776] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:11 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:11.650255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5319c71e-cad2-451c-ae27-eba915b9cae3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:11.652703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5319c71e-cad2-451c-ae27-eba915b9cae3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:11.670696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5319c71e-cad2-451c-ae27-eba915b9cae3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:11.672689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5319c71e-cad2-451c-ae27-eba915b9cae3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:11.674049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5319c71e-cad2-451c-ae27-eba915b9cae3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:11.675702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5319c71e-cad2-451c-ae27-eba915b9cae3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:11.706786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ca61440e-477e-4106-b172-295cd600dda0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:11.717173 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ca61440e-477e-4106-b172-295cd600dda0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.418690 Jan 22 21:11:11.736464 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1964/3777] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:11 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:12.074514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4ffc38bb-a0e5-40a0-babb-77ef65e8f2d8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:12.075637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4ffc38bb-a0e5-40a0-babb-77ef65e8f2d8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:12.090605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ffc38bb-a0e5-40a0-babb-77ef65e8f2d8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:12.091899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ffc38bb-a0e5-40a0-babb-77ef65e8f2d8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:12.093938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ffc38bb-a0e5-40a0-babb-77ef65e8f2d8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:12.094861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ffc38bb-a0e5-40a0-babb-77ef65e8f2d8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:12.368672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4ffc38bb-a0e5-40a0-babb-77ef65e8f2d8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:12.403784 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4ffc38bb-a0e5-40a0-babb-77ef65e8f2d8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1313 microversion: 2.1 time: 0.331870 Jan 22 21:11:12.403784 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1965/3778] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:12 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:12.415953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5319c71e-cad2-451c-ae27-eba915b9cae3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:12.416528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-848db4c7-988a-4f77-9516-ec784856df6c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:12.418517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-848db4c7-988a-4f77-9516-ec784856df6c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:12.427957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-848db4c7-988a-4f77-9516-ec784856df6c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:12.429347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-848db4c7-988a-4f77-9516-ec784856df6c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:12.430498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-848db4c7-988a-4f77-9516-ec784856df6c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:12.431152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-848db4c7-988a-4f77-9516-ec784856df6c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:12.440205 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5319c71e-cad2-451c-ae27-eba915b9cae3 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1476 microversion: 2.1 time: 0.794673 Jan 22 21:11:12.450355 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1814/3779] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:11 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1476 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:12.450355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-22b39cc0-c129-4238-aa2e-eff60f6cf11c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:12.450355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-22b39cc0-c129-4238-aa2e-eff60f6cf11c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:12.474044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22b39cc0-c129-4238-aa2e-eff60f6cf11c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:12.474448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22b39cc0-c129-4238-aa2e-eff60f6cf11c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:12.475286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22b39cc0-c129-4238-aa2e-eff60f6cf11c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:12.475732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22b39cc0-c129-4238-aa2e-eff60f6cf11c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:12.489268 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-848db4c7-988a-4f77-9516-ec784856df6c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.085497 Jan 22 21:11:12.494675 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1966/3780] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:12 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:12.534020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-851ce2c2-8a70-4090-ae36-1576145e7641 req-6767dda5-333b-4157-892d-48da6f5ef1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5503c80-72b0-4a0b-b82f-333ae4fdd2d8", "name": "network-vif-plugged", "status": "completed", "tag": "c87fc1c2-c18f-4e31-aa6b-1a0b3f73a309"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:12.535996 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:12.535996 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:11:12.553155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-851ce2c2-8a70-4090-ae36-1576145e7641 req-6767dda5-333b-4157-892d-48da6f5ef1a0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:12.554340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-851ce2c2-8a70-4090-ae36-1576145e7641 req-6767dda5-333b-4157-892d-48da6f5ef1a0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:12.571397 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-851ce2c2-8a70-4090-ae36-1576145e7641 req-6767dda5-333b-4157-892d-48da6f5ef1a0 service nova] Creating event network-vif-plugged:c87fc1c2-c18f-4e31-aa6b-1a0b3f73a309 for instance d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 on nch1-master-1 Jan 22 21:11:12.576815 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-851ce2c2-8a70-4090-ae36-1576145e7641 req-6767dda5-333b-4157-892d-48da6f5ef1a0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081165 Jan 22 21:11:12.577773 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1967/3781] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:12.584533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8bf6fff6-eb62-45d5-b6b2-af655bc27fd6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:12.585272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8bf6fff6-eb62-45d5-b6b2-af655bc27fd6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:12.594087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bf6fff6-eb62-45d5-b6b2-af655bc27fd6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:12.594556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bf6fff6-eb62-45d5-b6b2-af655bc27fd6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:12.595364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bf6fff6-eb62-45d5-b6b2-af655bc27fd6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:12.595810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bf6fff6-eb62-45d5-b6b2-af655bc27fd6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:12.658796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-22b39cc0-c129-4238-aa2e-eff60f6cf11c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:12.668957 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-22b39cc0-c129-4238-aa2e-eff60f6cf11c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1230 microversion: 2.1 time: 0.225875 Jan 22 21:11:12.678996 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1815/3782] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:12 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1230 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:12.684622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-515c93bd-a47e-42d5-9985-fb6539ad7406 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:12.685745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-515c93bd-a47e-42d5-9985-fb6539ad7406 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:12.692913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-515c93bd-a47e-42d5-9985-fb6539ad7406 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:12.694013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-515c93bd-a47e-42d5-9985-fb6539ad7406 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:12.695619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-515c93bd-a47e-42d5-9985-fb6539ad7406 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:12.696632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-515c93bd-a47e-42d5-9985-fb6539ad7406 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:12.757782 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-515c93bd-a47e-42d5-9985-fb6539ad7406 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.076915 Jan 22 21:11:12.761271 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1816/3783] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:12 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:12.774557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4d09e7de-8689-410f-904e-9ae683ac9945 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:12.775963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4d09e7de-8689-410f-904e-9ae683ac9945 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:12.790007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d09e7de-8689-410f-904e-9ae683ac9945 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:12.790469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d09e7de-8689-410f-904e-9ae683ac9945 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:12.792069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d09e7de-8689-410f-904e-9ae683ac9945 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:12.793300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d09e7de-8689-410f-904e-9ae683ac9945 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:12.895875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8bf6fff6-eb62-45d5-b6b2-af655bc27fd6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:12.912338 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8bf6fff6-eb62-45d5-b6b2-af655bc27fd6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.333278 Jan 22 21:11:12.913879 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1968/3784] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:12 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:13.317343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4d09e7de-8689-410f-904e-9ae683ac9945 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:13.326169 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4d09e7de-8689-410f-904e-9ae683ac9945 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.561027 Jan 22 21:11:13.326763 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1817/3785] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:12 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:13.419250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1a7180e9-6c8e-4e1b-94f0-8b11e2479a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:13.443061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1a7180e9-6c8e-4e1b-94f0-8b11e2479a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:13.443061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a7180e9-6c8e-4e1b-94f0-8b11e2479a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:13.443061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a7180e9-6c8e-4e1b-94f0-8b11e2479a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:13.443061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a7180e9-6c8e-4e1b-94f0-8b11e2479a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:13.443061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a7180e9-6c8e-4e1b-94f0-8b11e2479a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:13.457969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4a40f138-4349-44aa-8f7c-fd3969188a9d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:13.458963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4a40f138-4349-44aa-8f7c-fd3969188a9d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:13.471962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a40f138-4349-44aa-8f7c-fd3969188a9d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:13.472458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a40f138-4349-44aa-8f7c-fd3969188a9d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:13.473290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a40f138-4349-44aa-8f7c-fd3969188a9d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:13.473768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a40f138-4349-44aa-8f7c-fd3969188a9d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:13.662968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1a7180e9-6c8e-4e1b-94f0-8b11e2479a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:13.670114 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1a7180e9-6c8e-4e1b-94f0-8b11e2479a07 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1313 microversion: 2.1 time: 0.255673 Jan 22 21:11:13.670855 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1969/3786] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:13 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:13.676633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-53327346-d36c-4d35-8c8f-5f12dd43715d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:13.677739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-53327346-d36c-4d35-8c8f-5f12dd43715d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:13.685325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53327346-d36c-4d35-8c8f-5f12dd43715d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:13.685882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53327346-d36c-4d35-8c8f-5f12dd43715d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:13.686726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53327346-d36c-4d35-8c8f-5f12dd43715d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:13.687175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53327346-d36c-4d35-8c8f-5f12dd43715d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:13.733110 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-53327346-d36c-4d35-8c8f-5f12dd43715d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.059134 Jan 22 21:11:13.736863 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1970/3787] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:13 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:13.741680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2d49a8b4-e309-44e2-8e22-60e424a2bd45 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:13.742380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2d49a8b4-e309-44e2-8e22-60e424a2bd45 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:13.755873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d49a8b4-e309-44e2-8e22-60e424a2bd45 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:13.756610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d49a8b4-e309-44e2-8e22-60e424a2bd45 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:13.757440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d49a8b4-e309-44e2-8e22-60e424a2bd45 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:13.757923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d49a8b4-e309-44e2-8e22-60e424a2bd45 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:13.764697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4a40f138-4349-44aa-8f7c-fd3969188a9d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:13.776260 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4a40f138-4349-44aa-8f7c-fd3969188a9d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1476 microversion: 2.1 time: 0.322294 Jan 22 21:11:13.779956 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1818/3788] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:13 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1476 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:13.786052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-28040570-fd9a-4078-869e-bcfeb40b18c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:13.787389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-28040570-fd9a-4078-869e-bcfeb40b18c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:13.794842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28040570-fd9a-4078-869e-bcfeb40b18c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:13.795660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28040570-fd9a-4078-869e-bcfeb40b18c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:13.796695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28040570-fd9a-4078-869e-bcfeb40b18c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:13.797340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28040570-fd9a-4078-869e-bcfeb40b18c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:13.892173 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-28040570-fd9a-4078-869e-bcfeb40b18c5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.110636 Jan 22 21:11:13.897955 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1819/3789] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:13 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:13.934133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2d49a8b4-e309-44e2-8e22-60e424a2bd45 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:13.941467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c620890f-f629-4166-91a7-ab37f48f5fd9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:13.942431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c620890f-f629-4166-91a7-ab37f48f5fd9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:13.963131 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2d49a8b4-e309-44e2-8e22-60e424a2bd45 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1278 microversion: 2.1 time: 0.225760 Jan 22 21:11:13.966780 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1971/3790] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:13 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:13.969156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c620890f-f629-4166-91a7-ab37f48f5fd9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:13.972066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c620890f-f629-4166-91a7-ab37f48f5fd9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:13.973020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c620890f-f629-4166-91a7-ab37f48f5fd9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:13.973612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c620890f-f629-4166-91a7-ab37f48f5fd9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:14.346138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-da824289-1bcc-490a-86e6-26d1babd5ade tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:14.346640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-da824289-1bcc-490a-86e6-26d1babd5ade tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:14.357398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da824289-1bcc-490a-86e6-26d1babd5ade tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:14.358014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da824289-1bcc-490a-86e6-26d1babd5ade tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:14.358939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da824289-1bcc-490a-86e6-26d1babd5ade tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:14.359508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da824289-1bcc-490a-86e6-26d1babd5ade tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:14.559096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c620890f-f629-4166-91a7-ab37f48f5fd9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:14.609074 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c620890f-f629-4166-91a7-ab37f48f5fd9 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.675251 Jan 22 21:11:14.610533 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1820/3791] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:13 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:14.727753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ea1f3754-5844-4679-9f9e-26589e64cd67 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:14.735060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ea1f3754-5844-4679-9f9e-26589e64cd67 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:14.760924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea1f3754-5844-4679-9f9e-26589e64cd67 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:14.761484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea1f3754-5844-4679-9f9e-26589e64cd67 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:14.762436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea1f3754-5844-4679-9f9e-26589e64cd67 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:14.767215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea1f3754-5844-4679-9f9e-26589e64cd67 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:14.997184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-da824289-1bcc-490a-86e6-26d1babd5ade tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:15.008283 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-da824289-1bcc-490a-86e6-26d1babd5ade tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.666727 Jan 22 21:11:15.014562 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1972/3792] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:14 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:15.032432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-38753273-da5c-4881-8b2d-aacae250dd00 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:15.033634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-38753273-da5c-4881-8b2d-aacae250dd00 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:15.041232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38753273-da5c-4881-8b2d-aacae250dd00 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:15.041729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38753273-da5c-4881-8b2d-aacae250dd00 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:15.044907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38753273-da5c-4881-8b2d-aacae250dd00 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:15.045346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38753273-da5c-4881-8b2d-aacae250dd00 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:15.117388 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-38753273-da5c-4881-8b2d-aacae250dd00 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.101226 Jan 22 21:11:15.135687 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1973/3793] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:15 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:15.157614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-14e25194-e0f5-43ea-a355-389a33e2b162 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:15.158540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-14e25194-e0f5-43ea-a355-389a33e2b162 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:15.164151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ea1f3754-5844-4679-9f9e-26589e64cd67 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:15.183424 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ea1f3754-5844-4679-9f9e-26589e64cd67 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1313 microversion: 2.1 time: 0.463162 Jan 22 21:11:15.184808 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1821/3794] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:14 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:15.198002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-34da4697-cbcc-44d7-ae98-45b280db7ee7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:15.199740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-34da4697-cbcc-44d7-ae98-45b280db7ee7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:15.200562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14e25194-e0f5-43ea-a355-389a33e2b162 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:15.204253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14e25194-e0f5-43ea-a355-389a33e2b162 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:15.205107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14e25194-e0f5-43ea-a355-389a33e2b162 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:15.210354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14e25194-e0f5-43ea-a355-389a33e2b162 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:15.229305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34da4697-cbcc-44d7-ae98-45b280db7ee7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:15.230444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34da4697-cbcc-44d7-ae98-45b280db7ee7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:15.232354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34da4697-cbcc-44d7-ae98-45b280db7ee7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:15.233165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34da4697-cbcc-44d7-ae98-45b280db7ee7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:15.343164 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-34da4697-cbcc-44d7-ae98-45b280db7ee7 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.153731 Jan 22 21:11:15.348283 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1822/3795] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:15 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:15.355278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4cfd2d41-643c-4112-a6ed-27ce06a3ff8e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:15.360926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4cfd2d41-643c-4112-a6ed-27ce06a3ff8e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:15.371224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4cfd2d41-643c-4112-a6ed-27ce06a3ff8e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:15.372514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4cfd2d41-643c-4112-a6ed-27ce06a3ff8e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:15.373867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4cfd2d41-643c-4112-a6ed-27ce06a3ff8e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:15.374773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4cfd2d41-643c-4112-a6ed-27ce06a3ff8e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:15.747936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4cfd2d41-643c-4112-a6ed-27ce06a3ff8e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:15.763708 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4cfd2d41-643c-4112-a6ed-27ce06a3ff8e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1284 microversion: 2.1 time: 0.413265 Jan 22 21:11:15.774923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-14e25194-e0f5-43ea-a355-389a33e2b162 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:15.779207 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1823/3796] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:15 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1284 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:15.787712 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-14e25194-e0f5-43ea-a355-389a33e2b162 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1473 microversion: 2.1 time: 0.649560 Jan 22 21:11:15.789577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3c51b084-a167-47df-a4ea-646e71400cdc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:15.790634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3c51b084-a167-47df-a4ea-646e71400cdc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:15.801121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c51b084-a167-47df-a4ea-646e71400cdc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:15.802667 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1974/3797] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:15 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1473 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:15.803129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c51b084-a167-47df-a4ea-646e71400cdc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:15.804209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c51b084-a167-47df-a4ea-646e71400cdc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:15.804992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c51b084-a167-47df-a4ea-646e71400cdc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:15.816126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e828fd21-e980-41f2-bb40-f39746aeb9e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:15.817015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e828fd21-e980-41f2-bb40-f39746aeb9e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:15.832126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e828fd21-e980-41f2-bb40-f39746aeb9e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:15.832698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e828fd21-e980-41f2-bb40-f39746aeb9e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:15.833393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e828fd21-e980-41f2-bb40-f39746aeb9e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:15.833869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e828fd21-e980-41f2-bb40-f39746aeb9e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:15.934196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e828fd21-e980-41f2-bb40-f39746aeb9e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:15.934638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e828fd21-e980-41f2-bb40-f39746aeb9e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:15.935550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e828fd21-e980-41f2-bb40-f39746aeb9e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:15.936008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e828fd21-e980-41f2-bb40-f39746aeb9e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:16.008229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e828fd21-e980-41f2-bb40-f39746aeb9e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Getting quotas for project 80dba854f5414025a0cbf8b5d6571c42. Resources: {'cores', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:11:16.022127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e828fd21-e980-41f2-bb40-f39746aeb9e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Getting quotas for user 7f8e9e562bd740e782568f539dac4744 and project 80dba854f5414025a0cbf8b5d6571c42. Resources: {'cores', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:11:16.584572 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e828fd21-e980-41f2-bb40-f39746aeb9e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "POST /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8/action" status: 202 len: 0 microversion: 2.1 time: 0.780288 Jan 22 21:11:16.590387 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1975/3798] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:15 2022] POST /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8/action => generated 0 bytes in 787 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:16.597268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4811d73f-2b1c-4f74-a296-254cb9ac7f40 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:16.598366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4811d73f-2b1c-4f74-a296-254cb9ac7f40 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:16.608440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4811d73f-2b1c-4f74-a296-254cb9ac7f40 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:16.609243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4811d73f-2b1c-4f74-a296-254cb9ac7f40 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:16.610442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4811d73f-2b1c-4f74-a296-254cb9ac7f40 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:16.611151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4811d73f-2b1c-4f74-a296-254cb9ac7f40 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:16.677080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3c51b084-a167-47df-a4ea-646e71400cdc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:16.706749 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3c51b084-a167-47df-a4ea-646e71400cdc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.920384 Jan 22 21:11:16.714780 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1824/3799] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:15 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:16.728378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-131c56e6-08a2-4335-941b-f10cc01b5dbb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:16.734425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-131c56e6-08a2-4335-941b-f10cc01b5dbb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:16.760485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-131c56e6-08a2-4335-941b-f10cc01b5dbb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:16.762277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-131c56e6-08a2-4335-941b-f10cc01b5dbb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:16.766275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-131c56e6-08a2-4335-941b-f10cc01b5dbb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:16.768518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-131c56e6-08a2-4335-941b-f10cc01b5dbb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:16.871456 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-131c56e6-08a2-4335-941b-f10cc01b5dbb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.154201 Jan 22 21:11:16.873840 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1825/3800] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:16 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:16.881008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aa260bd7-b53a-476f-ae3f-7b0e9d2b2884 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:16.882169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aa260bd7-b53a-476f-ae3f-7b0e9d2b2884 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:16.894064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa260bd7-b53a-476f-ae3f-7b0e9d2b2884 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:16.899306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa260bd7-b53a-476f-ae3f-7b0e9d2b2884 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:16.903331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa260bd7-b53a-476f-ae3f-7b0e9d2b2884 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:16.904100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa260bd7-b53a-476f-ae3f-7b0e9d2b2884 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:17.028310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4811d73f-2b1c-4f74-a296-254cb9ac7f40 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:17.044287 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4811d73f-2b1c-4f74-a296-254cb9ac7f40 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.448855 Jan 22 21:11:17.054719 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1976/3801] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:16 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:17.134268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a10c70f5-36ae-44c5-8847-744d56828c3b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:17.134268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a10c70f5-36ae-44c5-8847-744d56828c3b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:17.134268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a10c70f5-36ae-44c5-8847-744d56828c3b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:17.134268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a10c70f5-36ae-44c5-8847-744d56828c3b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:17.134268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a10c70f5-36ae-44c5-8847-744d56828c3b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:17.134268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a10c70f5-36ae-44c5-8847-744d56828c3b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:17.180875 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a10c70f5-36ae-44c5-8847-744d56828c3b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.121954 Jan 22 21:11:17.186286 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1977/3802] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:17 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:17.208516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f27e7fe4-909a-4e40-88d3-39c21c89c6d7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:17.209555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f27e7fe4-909a-4e40-88d3-39c21c89c6d7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:17.227914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f27e7fe4-909a-4e40-88d3-39c21c89c6d7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:17.234364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f27e7fe4-909a-4e40-88d3-39c21c89c6d7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:17.235644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f27e7fe4-909a-4e40-88d3-39c21c89c6d7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:17.236269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f27e7fe4-909a-4e40-88d3-39c21c89c6d7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:17.361594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-aa260bd7-b53a-476f-ae3f-7b0e9d2b2884 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:17.376807 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aa260bd7-b53a-476f-ae3f-7b0e9d2b2884 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1492 microversion: 2.1 time: 0.499914 Jan 22 21:11:17.390308 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1826/3803] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:16 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1492 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:17.396428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2313d1dc-ae40-480f-8a01-843bd4f3a0e4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:17.401104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2313d1dc-ae40-480f-8a01-843bd4f3a0e4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:17.416737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2313d1dc-ae40-480f-8a01-843bd4f3a0e4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:17.423738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2313d1dc-ae40-480f-8a01-843bd4f3a0e4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:17.423738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2313d1dc-ae40-480f-8a01-843bd4f3a0e4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:17.423738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2313d1dc-ae40-480f-8a01-843bd4f3a0e4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:17.460472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f27e7fe4-909a-4e40-88d3-39c21c89c6d7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:17.472495 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f27e7fe4-909a-4e40-88d3-39c21c89c6d7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1472 microversion: 2.1 time: 0.281304 Jan 22 21:11:17.473722 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1978/3804] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:17 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1472 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:17.491691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4861f03c-e185-4fbd-b026-fadaa88e46d4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:17.494490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4861f03c-e185-4fbd-b026-fadaa88e46d4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:17.509595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4861f03c-e185-4fbd-b026-fadaa88e46d4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:17.510063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4861f03c-e185-4fbd-b026-fadaa88e46d4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:17.515318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4861f03c-e185-4fbd-b026-fadaa88e46d4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:17.515885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4861f03c-e185-4fbd-b026-fadaa88e46d4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:17.726704 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4861f03c-e185-4fbd-b026-fadaa88e46d4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "PUT /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1087 microversion: 2.1 time: 0.251872 Jan 22 21:11:17.727948 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1979/3805] 10.222.0.100 () {60 vars in 1260 bytes} [Sat Jan 22 21:11:17 2022] PUT /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1087 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:17.733367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d72ec46a-1571-4d6a-bf9d-fba691e8cc60 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:17.742155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d72ec46a-1571-4d6a-bf9d-fba691e8cc60 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:17.755736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d72ec46a-1571-4d6a-bf9d-fba691e8cc60 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:17.766245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d72ec46a-1571-4d6a-bf9d-fba691e8cc60 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:17.774831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d72ec46a-1571-4d6a-bf9d-fba691e8cc60 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:17.775694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d72ec46a-1571-4d6a-bf9d-fba691e8cc60 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:18.143848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2313d1dc-ae40-480f-8a01-843bd4f3a0e4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:18.157226 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2313d1dc-ae40-480f-8a01-843bd4f3a0e4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.765487 Jan 22 21:11:18.169249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d72ec46a-1571-4d6a-bf9d-fba691e8cc60 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:18.170628 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1827/3806] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:17 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:18.179723 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d72ec46a-1571-4d6a-bf9d-fba691e8cc60 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.450540 Jan 22 21:11:18.180604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1983fb5b-7acf-46cc-a68a-04de2631ed65 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:18.181328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1983fb5b-7acf-46cc-a68a-04de2631ed65 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:18.193204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1983fb5b-7acf-46cc-a68a-04de2631ed65 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:18.195414 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1980/3807] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:17 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:18.197077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1983fb5b-7acf-46cc-a68a-04de2631ed65 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:18.197077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1983fb5b-7acf-46cc-a68a-04de2631ed65 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:18.197265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1983fb5b-7acf-46cc-a68a-04de2631ed65 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:18.206864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9ec988ff-1486-427f-9a5d-8b75798c0d68 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:18.207986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9ec988ff-1486-427f-9a5d-8b75798c0d68 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:18.222795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ec988ff-1486-427f-9a5d-8b75798c0d68 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:18.225406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ec988ff-1486-427f-9a5d-8b75798c0d68 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:18.225406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ec988ff-1486-427f-9a5d-8b75798c0d68 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:18.225406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ec988ff-1486-427f-9a5d-8b75798c0d68 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:18.302555 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9ec988ff-1486-427f-9a5d-8b75798c0d68 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.105309 Jan 22 21:11:18.304473 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1981/3808] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:18 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:18.317905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2cda1189-3729-43b9-8cc8-d78051f62057 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:18.323112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2cda1189-3729-43b9-8cc8-d78051f62057 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:18.336065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2cda1189-3729-43b9-8cc8-d78051f62057 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:18.337253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2cda1189-3729-43b9-8cc8-d78051f62057 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:18.339119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2cda1189-3729-43b9-8cc8-d78051f62057 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:18.339967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2cda1189-3729-43b9-8cc8-d78051f62057 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:18.747736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2cda1189-3729-43b9-8cc8-d78051f62057 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:18.755524 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2cda1189-3729-43b9-8cc8-d78051f62057 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.443815 Jan 22 21:11:18.763137 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1982/3809] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:18 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:18.769423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e74eeda8-37a9-4011-82fe-f242aa54e833 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:18.770646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e74eeda8-37a9-4011-82fe-f242aa54e833 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:18.782968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e74eeda8-37a9-4011-82fe-f242aa54e833 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:18.783712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e74eeda8-37a9-4011-82fe-f242aa54e833 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:18.784542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e74eeda8-37a9-4011-82fe-f242aa54e833 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:18.784987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e74eeda8-37a9-4011-82fe-f242aa54e833 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:18.850057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1983fb5b-7acf-46cc-a68a-04de2631ed65 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:18.867936 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1983fb5b-7acf-46cc-a68a-04de2631ed65 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1513 microversion: 2.1 time: 0.690247 Jan 22 21:11:18.867936 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1828/3810] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:18 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1513 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:18.874520 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e74eeda8-37a9-4011-82fe-f242aa54e833 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.109690 Jan 22 21:11:18.880174 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1983/3811] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:18 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:18.887865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ff038593-aa3c-45bf-a7df-edf5023f6045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:18.888769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ff038593-aa3c-45bf-a7df-edf5023f6045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:18.891150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-5f504e9d-bc51-457b-99a1-2853c9676692 req-b04b7785-061d-4c4d-9150-05b22fc58d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40cd339-38cd-40f4-a4e5-0b220e363df8", "name": "network-vif-plugged", "status": "completed", "tag": "8c94703f-c59c-42e5-b507-01dab2c8cb70"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:18.893864 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:18.893864 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:11:18.903639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff038593-aa3c-45bf-a7df-edf5023f6045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:18.903639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff038593-aa3c-45bf-a7df-edf5023f6045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:18.903639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff038593-aa3c-45bf-a7df-edf5023f6045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:18.903639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff038593-aa3c-45bf-a7df-edf5023f6045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:18.907057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5f504e9d-bc51-457b-99a1-2853c9676692 req-b04b7785-061d-4c4d-9150-05b22fc58d0c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:18.907531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5f504e9d-bc51-457b-99a1-2853c9676692 req-b04b7785-061d-4c4d-9150-05b22fc58d0c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:18.933551 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-5f504e9d-bc51-457b-99a1-2853c9676692 req-b04b7785-061d-4c4d-9150-05b22fc58d0c service nova] Creating event network-vif-plugged:8c94703f-c59c-42e5-b507-01dab2c8cb70 for instance a40cd339-38cd-40f4-a4e5-0b220e363df8 on nch1-master-1 Jan 22 21:11:18.954950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-5f504e9d-bc51-457b-99a1-2853c9676692 req-b04b7785-061d-4c4d-9150-05b22fc58d0c service nova] Instance a40cd339-38cd-40f4-a4e5-0b220e363df8 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:11:18.986588 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-5f504e9d-bc51-457b-99a1-2853c9676692 req-b04b7785-061d-4c4d-9150-05b22fc58d0c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109261 Jan 22 21:11:18.996952 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1829/3812] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:19.010482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-526d3c6f-2920-453b-85bb-b5f17ae7f6b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:19.012820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-526d3c6f-2920-453b-85bb-b5f17ae7f6b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:19.031815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-526d3c6f-2920-453b-85bb-b5f17ae7f6b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:19.032538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-526d3c6f-2920-453b-85bb-b5f17ae7f6b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:19.041587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-526d3c6f-2920-453b-85bb-b5f17ae7f6b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:19.047774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-526d3c6f-2920-453b-85bb-b5f17ae7f6b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:19.435996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ff038593-aa3c-45bf-a7df-edf5023f6045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:19.457795 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ff038593-aa3c-45bf-a7df-edf5023f6045 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1472 microversion: 2.1 time: 0.575081 Jan 22 21:11:19.459342 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1984/3813] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:18 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1472 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:19.467563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-bca76100-9df8-48a6-a3df-448332c8dd3a req-10b007eb-e198-417c-b365-960e6a3a0dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a45a6b1-24c6-4009-ad8f-6203f05d6777", "tag": "ac95681d-6279-428c-a0df-b7ba96ca5f3d"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:19.470197 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:19.470197 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:11:19.483865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bca76100-9df8-48a6-a3df-448332c8dd3a req-10b007eb-e198-417c-b365-960e6a3a0dfa service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:19.484793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bca76100-9df8-48a6-a3df-448332c8dd3a req-10b007eb-e198-417c-b365-960e6a3a0dfa service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:19.520011 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-bca76100-9df8-48a6-a3df-448332c8dd3a req-10b007eb-e198-417c-b365-960e6a3a0dfa service nova] Creating event network-changed:ac95681d-6279-428c-a0df-b7ba96ca5f3d for instance 5a45a6b1-24c6-4009-ad8f-6203f05d6777 on nch2-master-1 Jan 22 21:11:19.524932 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-bca76100-9df8-48a6-a3df-448332c8dd3a req-10b007eb-e198-417c-b365-960e6a3a0dfa service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063380 Jan 22 21:11:19.525847 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1985/3814] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:19.532564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c8b73586-fb57-4889-8081-cb2a538d83ec tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:19.533287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c8b73586-fb57-4889-8081-cb2a538d83ec tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:19.544810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8b73586-fb57-4889-8081-cb2a538d83ec tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:19.544810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8b73586-fb57-4889-8081-cb2a538d83ec tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:19.545751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8b73586-fb57-4889-8081-cb2a538d83ec tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:19.546226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8b73586-fb57-4889-8081-cb2a538d83ec tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:19.593395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-526d3c6f-2920-453b-85bb-b5f17ae7f6b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:19.622182 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-526d3c6f-2920-453b-85bb-b5f17ae7f6b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1513 microversion: 2.1 time: 0.623495 Jan 22 21:11:19.634673 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1830/3815] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:18 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1513 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:19.642839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f970dbdb-b50d-4979-9624-5ce14fbdeec6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:19.643756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f970dbdb-b50d-4979-9624-5ce14fbdeec6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:19.663377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f970dbdb-b50d-4979-9624-5ce14fbdeec6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:19.664633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f970dbdb-b50d-4979-9624-5ce14fbdeec6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:19.667984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f970dbdb-b50d-4979-9624-5ce14fbdeec6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:19.668691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f970dbdb-b50d-4979-9624-5ce14fbdeec6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:19.795238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c8b73586-fb57-4889-8081-cb2a538d83ec tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:19.804096 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c8b73586-fb57-4889-8081-cb2a538d83ec tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.276999 Jan 22 21:11:19.804916 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1986/3816] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:19 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:19.810780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-55f878fe-62d7-4bb9-973f-1ac074451da5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:19.812073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-55f878fe-62d7-4bb9-973f-1ac074451da5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:19.818929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55f878fe-62d7-4bb9-973f-1ac074451da5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:19.820416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55f878fe-62d7-4bb9-973f-1ac074451da5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:19.821261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55f878fe-62d7-4bb9-973f-1ac074451da5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:19.822188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55f878fe-62d7-4bb9-973f-1ac074451da5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:19.883114 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-55f878fe-62d7-4bb9-973f-1ac074451da5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.076527 Jan 22 21:11:19.884122 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1987/3817] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:19 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:19.892644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-83d42fe2-5f32-489a-9331-499feb561ea5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:19.902682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-83d42fe2-5f32-489a-9331-499feb561ea5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:19.902682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83d42fe2-5f32-489a-9331-499feb561ea5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:19.902682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83d42fe2-5f32-489a-9331-499feb561ea5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:19.903146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83d42fe2-5f32-489a-9331-499feb561ea5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:19.903584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83d42fe2-5f32-489a-9331-499feb561ea5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:19.982595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-83d42fe2-5f32-489a-9331-499feb561ea5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:11:20.011783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f970dbdb-b50d-4979-9624-5ce14fbdeec6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:20.019539 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f970dbdb-b50d-4979-9624-5ce14fbdeec6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1509 microversion: 2.1 time: 0.380920 Jan 22 21:11:20.023845 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1831/3818] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:19 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1509 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:20.035618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ac51dfb2-bd5a-40a6-b2ff-4cd6118d96c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:20.035618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ac51dfb2-bd5a-40a6-b2ff-4cd6118d96c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:20.052713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac51dfb2-bd5a-40a6-b2ff-4cd6118d96c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:20.057487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac51dfb2-bd5a-40a6-b2ff-4cd6118d96c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:20.064347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac51dfb2-bd5a-40a6-b2ff-4cd6118d96c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:20.064347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac51dfb2-bd5a-40a6-b2ff-4cd6118d96c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:20.382159 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-83d42fe2-5f32-489a-9331-499feb561ea5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 204 len: 0 microversion: 2.1 time: 0.495930 Jan 22 21:11:20.391253 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1988/3819] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:11:19 2022] DELETE /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:11:20.398187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bf7ef707-0999-493f-955c-833f2e0da928 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:20.402775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bf7ef707-0999-493f-955c-833f2e0da928 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:20.415523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ac51dfb2-bd5a-40a6-b2ff-4cd6118d96c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:20.421692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf7ef707-0999-493f-955c-833f2e0da928 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:20.422221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf7ef707-0999-493f-955c-833f2e0da928 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:20.423746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf7ef707-0999-493f-955c-833f2e0da928 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:20.424302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf7ef707-0999-493f-955c-833f2e0da928 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:20.425316 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ac51dfb2-bd5a-40a6-b2ff-4cd6118d96c4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.400137 Jan 22 21:11:20.426083 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1832/3820] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:20 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:20.438272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-431d7504-1575-40dd-bdf1-691ced2a2b05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:20.443610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-431d7504-1575-40dd-bdf1-691ced2a2b05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:20.457154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-431d7504-1575-40dd-bdf1-691ced2a2b05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:20.463290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-431d7504-1575-40dd-bdf1-691ced2a2b05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:20.467398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-431d7504-1575-40dd-bdf1-691ced2a2b05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:20.467398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-431d7504-1575-40dd-bdf1-691ced2a2b05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:20.514901 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bf7ef707-0999-493f-955c-833f2e0da928 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.120655 Jan 22 21:11:20.519011 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1989/3821] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:20 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:20.556758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-518b1665-697c-4a2d-89d3-e6e5e90cdb01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:20.558815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-518b1665-697c-4a2d-89d3-e6e5e90cdb01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:20.585970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-518b1665-697c-4a2d-89d3-e6e5e90cdb01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:20.586967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-518b1665-697c-4a2d-89d3-e6e5e90cdb01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:20.597376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-518b1665-697c-4a2d-89d3-e6e5e90cdb01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:20.598497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-518b1665-697c-4a2d-89d3-e6e5e90cdb01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:20.875722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-431d7504-1575-40dd-bdf1-691ced2a2b05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:20.884504 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-431d7504-1575-40dd-bdf1-691ced2a2b05 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1519 microversion: 2.1 time: 0.453303 Jan 22 21:11:20.888610 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1833/3822] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:20 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1519 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:20.894548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e30e4d96-9732-4a3b-9ad7-5f65b86f8bc5 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:20.900052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e30e4d96-9732-4a3b-9ad7-5f65b86f8bc5 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:20.916420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e30e4d96-9732-4a3b-9ad7-5f65b86f8bc5 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:20.918002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e30e4d96-9732-4a3b-9ad7-5f65b86f8bc5 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:20.924006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-518b1665-697c-4a2d-89d3-e6e5e90cdb01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:20.935077 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-518b1665-697c-4a2d-89d3-e6e5e90cdb01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1472 microversion: 2.1 time: 0.411500 Jan 22 21:11:20.935077 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1990/3823] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:20 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1472 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:20.935374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e30e4d96-9732-4a3b-9ad7-5f65b86f8bc5 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:20.935474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e30e4d96-9732-4a3b-9ad7-5f65b86f8bc5 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:20.951277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ece59eea-011a-4d7b-ba7c-bc9159bbc9be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:20.952364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ece59eea-011a-4d7b-ba7c-bc9159bbc9be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:20.975418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ece59eea-011a-4d7b-ba7c-bc9159bbc9be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:20.976038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ece59eea-011a-4d7b-ba7c-bc9159bbc9be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:20.977150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ece59eea-011a-4d7b-ba7c-bc9159bbc9be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:20.978008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ece59eea-011a-4d7b-ba7c-bc9159bbc9be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:21.025460 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ece59eea-011a-4d7b-ba7c-bc9159bbc9be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.090051 Jan 22 21:11:21.027833 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1991/3824] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:20 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:21.044348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-358eb43e-ee71-4f7f-82c1-c40f954837b8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:21.048612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-358eb43e-ee71-4f7f-82c1-c40f954837b8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:21.053770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-358eb43e-ee71-4f7f-82c1-c40f954837b8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:21.054549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-358eb43e-ee71-4f7f-82c1-c40f954837b8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:21.055587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-358eb43e-ee71-4f7f-82c1-c40f954837b8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:21.056211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-358eb43e-ee71-4f7f-82c1-c40f954837b8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:21.257890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-358eb43e-ee71-4f7f-82c1-c40f954837b8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:21.282548 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-358eb43e-ee71-4f7f-82c1-c40f954837b8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1489 microversion: 2.1 time: 0.241861 Jan 22 21:11:21.284014 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1992/3825] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:21 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1489 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:21.292602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e30e4d96-9732-4a3b-9ad7-5f65b86f8bc5 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:21.305268 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e30e4d96-9732-4a3b-9ad7-5f65b86f8bc5 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.414572 Jan 22 21:11:21.308368 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1834/3826] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:20 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:21.459020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f79f58bb-12bb-4ecd-b97f-8e0bfe9c3a6b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:21.459778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f79f58bb-12bb-4ecd-b97f-8e0bfe9c3a6b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:21.484621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f79f58bb-12bb-4ecd-b97f-8e0bfe9c3a6b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:21.486673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f79f58bb-12bb-4ecd-b97f-8e0bfe9c3a6b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:21.487726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f79f58bb-12bb-4ecd-b97f-8e0bfe9c3a6b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:21.488285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f79f58bb-12bb-4ecd-b97f-8e0bfe9c3a6b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:21.499549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-296795151", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:21.586008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] validate_networks() for [('d49971f9-7c3a-4e50-bbcb-a6de45d7e148', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:11:21.662160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f79f58bb-12bb-4ecd-b97f-8e0bfe9c3a6b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:21.676240 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f79f58bb-12bb-4ecd-b97f-8e0bfe9c3a6b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.221154 Jan 22 21:11:21.685185 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1993/3827] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:21 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:21.692609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b51b7d4-890e-46f2-b05c-94c7e75d5640 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:21.693841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b51b7d4-890e-46f2-b05c-94c7e75d5640 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:21.712519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b51b7d4-890e-46f2-b05c-94c7e75d5640 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:21.712519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b51b7d4-890e-46f2-b05c-94c7e75d5640 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:21.712519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b51b7d4-890e-46f2-b05c-94c7e75d5640 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:21.712519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b51b7d4-890e-46f2-b05c-94c7e75d5640 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:21.785567 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b51b7d4-890e-46f2-b05c-94c7e75d5640 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.099436 Jan 22 21:11:21.789821 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1994/3828] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:21 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:21.905851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-22db07aa-710e-45b7-b534-4828a9350f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:21.907892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-22db07aa-710e-45b7-b534-4828a9350f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:21.926019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22db07aa-710e-45b7-b534-4828a9350f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:21.926476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22db07aa-710e-45b7-b534-4828a9350f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:21.927478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22db07aa-710e-45b7-b534-4828a9350f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:21.927929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22db07aa-710e-45b7-b534-4828a9350f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:22.125302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-22db07aa-710e-45b7-b534-4828a9350f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:22.142026 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-22db07aa-710e-45b7-b534-4828a9350f7f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1519 microversion: 2.1 time: 0.241052 Jan 22 21:11:22.142803 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1995/3829] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:21 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1519 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:22.157586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-15c1a0d7-5651-462a-a173-8962fc81e19f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:22.158511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-15c1a0d7-5651-462a-a173-8962fc81e19f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:22.165329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15c1a0d7-5651-462a-a173-8962fc81e19f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:22.166403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15c1a0d7-5651-462a-a173-8962fc81e19f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:22.167527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15c1a0d7-5651-462a-a173-8962fc81e19f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:22.168707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15c1a0d7-5651-462a-a173-8962fc81e19f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:22.190456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:11:22.190977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:11:22.191366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:11:22.191788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:11:22.192500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:11:22.208540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:22.209293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:22.210168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:22.210910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:22.261823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Getting quotas for project db6acf2143024ccf9ce1f7a2c8369626. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:11:22.272957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Getting quotas for user f783581ba8ca49b79a7d7cf7589b5b8e and project db6acf2143024ccf9ce1f7a2c8369626. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:11:22.300781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:11:22.304296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:11:22.374288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-15c1a0d7-5651-462a-a173-8962fc81e19f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:22.382591 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-15c1a0d7-5651-462a-a173-8962fc81e19f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1472 microversion: 2.1 time: 0.238731 Jan 22 21:11:22.387346 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1996/3830] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:22 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1472 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:22.396525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8ea0dc52-b238-4fab-8c12-23a85bdda34b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:22.401012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8ea0dc52-b238-4fab-8c12-23a85bdda34b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:22.409014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea0dc52-b238-4fab-8c12-23a85bdda34b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:22.413610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea0dc52-b238-4fab-8c12-23a85bdda34b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:22.413610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea0dc52-b238-4fab-8c12-23a85bdda34b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:22.413610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea0dc52-b238-4fab-8c12-23a85bdda34b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:22.550382 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8d3afe27-4c46-4e7d-bb30-ed72a928b7d8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.055522 Jan 22 21:11:22.558814 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1835/3831] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:11:21 2022] POST /compute/v2.1/servers => generated 385 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:11:22.564185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-28e353c6-3d3f-4066-b414-d6213a4cf802 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:22.565111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-28e353c6-3d3f-4066-b414-d6213a4cf802 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:22.578464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28e353c6-3d3f-4066-b414-d6213a4cf802 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:22.584779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28e353c6-3d3f-4066-b414-d6213a4cf802 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:22.584779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28e353c6-3d3f-4066-b414-d6213a4cf802 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:22.584779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28e353c6-3d3f-4066-b414-d6213a4cf802 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:22.610440 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8ea0dc52-b238-4fab-8c12-23a85bdda34b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.225193 Jan 22 21:11:22.612478 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1997/3832] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:22 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:22.619624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-69b63070-1eb5-4d3f-8f0f-84acdb466f0d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:22.636566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-69b63070-1eb5-4d3f-8f0f-84acdb466f0d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:22.761264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-69b63070-1eb5-4d3f-8f0f-84acdb466f0d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:22.777425 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-69b63070-1eb5-4d3f-8f0f-84acdb466f0d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1217 microversion: 2.1 time: 0.158797 Jan 22 21:11:22.777425 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1998/3833] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:22 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:22.780857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7ddbdc69-7dea-4c67-8dc8-3626436cf401 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:22.781680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7ddbdc69-7dea-4c67-8dc8-3626436cf401 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:22.797574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ddbdc69-7dea-4c67-8dc8-3626436cf401 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:22.798354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ddbdc69-7dea-4c67-8dc8-3626436cf401 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:22.799120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ddbdc69-7dea-4c67-8dc8-3626436cf401 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:22.799581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ddbdc69-7dea-4c67-8dc8-3626436cf401 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:22.915979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-28e353c6-3d3f-4066-b414-d6213a4cf802 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:22.929398 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-28e353c6-3d3f-4066-b414-d6213a4cf802 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.368863 Jan 22 21:11:22.935585 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1836/3834] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:22 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:22.945473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9b85c547-b8b2-4f88-889f-289bfbad6860 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:22.950945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9b85c547-b8b2-4f88-889f-289bfbad6860 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:22.978389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b85c547-b8b2-4f88-889f-289bfbad6860 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:22.981644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b85c547-b8b2-4f88-889f-289bfbad6860 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:22.991532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b85c547-b8b2-4f88-889f-289bfbad6860 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:22.991532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b85c547-b8b2-4f88-889f-289bfbad6860 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:23.050708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7ddbdc69-7dea-4c67-8dc8-3626436cf401 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:23.068448 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7ddbdc69-7dea-4c67-8dc8-3626436cf401 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.293117 Jan 22 21:11:23.079577 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 1999/3835] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:22 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:23.088930 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9b85c547-b8b2-4f88-889f-289bfbad6860 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.151687 Jan 22 21:11:23.089794 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1837/3836] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:22 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:23.160723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-66afbd7c-e051-4571-a091-96e17539bba2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:23.161832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-66afbd7c-e051-4571-a091-96e17539bba2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:23.170749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66afbd7c-e051-4571-a091-96e17539bba2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:23.171790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66afbd7c-e051-4571-a091-96e17539bba2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:23.179565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66afbd7c-e051-4571-a091-96e17539bba2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:23.181270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66afbd7c-e051-4571-a091-96e17539bba2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:23.271986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-66afbd7c-e051-4571-a091-96e17539bba2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:23.281721 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-66afbd7c-e051-4571-a091-96e17539bba2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 200 len: 1477 microversion: 2.1 time: 0.125148 Jan 22 21:11:23.287480 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2000/3837] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:23 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 1477 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:23.403998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5a1b6573-4e1a-4cdb-9976-b1ff53e558da tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:23.406592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5a1b6573-4e1a-4cdb-9976-b1ff53e558da tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:23.417742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-43bfe337-b31a-4e20-8087-39f7d1cf0484 req-fad34b2f-49f9-4eaf-ac63-6af250ae080f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5503c80-72b0-4a0b-b82f-333ae4fdd2d8", "name": "network-vif-deleted", "tag": "c87fc1c2-c18f-4e31-aa6b-1a0b3f73a309"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:23.419377 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:23.419377 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:11:23.427587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-43bfe337-b31a-4e20-8087-39f7d1cf0484 req-fad34b2f-49f9-4eaf-ac63-6af250ae080f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:23.432282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a1b6573-4e1a-4cdb-9976-b1ff53e558da tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:23.435715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a1b6573-4e1a-4cdb-9976-b1ff53e558da tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:23.436989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-43bfe337-b31a-4e20-8087-39f7d1cf0484 req-fad34b2f-49f9-4eaf-ac63-6af250ae080f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:23.437929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a1b6573-4e1a-4cdb-9976-b1ff53e558da tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:23.439008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a1b6573-4e1a-4cdb-9976-b1ff53e558da tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:23.474721 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-43bfe337-b31a-4e20-8087-39f7d1cf0484 req-fad34b2f-49f9-4eaf-ac63-6af250ae080f service nova] Creating event network-vif-deleted:c87fc1c2-c18f-4e31-aa6b-1a0b3f73a309 for instance d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 on nch1-master-1 Jan 22 21:11:23.489624 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-43bfe337-b31a-4e20-8087-39f7d1cf0484 req-fad34b2f-49f9-4eaf-ac63-6af250ae080f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077500 Jan 22 21:11:23.493850 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2001/3838] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:23.628252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3fb5fc0a-c3b4-461d-b117-4ff941ccb03f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:23.630080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3fb5fc0a-c3b4-461d-b117-4ff941ccb03f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:23.648905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fb5fc0a-c3b4-461d-b117-4ff941ccb03f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:23.652590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fb5fc0a-c3b4-461d-b117-4ff941ccb03f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:23.653755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fb5fc0a-c3b4-461d-b117-4ff941ccb03f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:23.655084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fb5fc0a-c3b4-461d-b117-4ff941ccb03f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:23.732554 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3fb5fc0a-c3b4-461d-b117-4ff941ccb03f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.111578 Jan 22 21:11:23.736206 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2002/3839] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:23 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:11:23.795090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5a1b6573-4e1a-4cdb-9976-b1ff53e558da tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:23.801687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a83807f4-e058-41ea-9b27-4b2744f98768 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:23.804382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a83807f4-e058-41ea-9b27-4b2744f98768 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:23.807031 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5a1b6573-4e1a-4cdb-9976-b1ff53e558da tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1538 microversion: 2.1 time: 0.410462 Jan 22 21:11:23.808995 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1838/3840] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:23 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1538 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:23.942743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a83807f4-e058-41ea-9b27-4b2744f98768 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:23.954145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8a9141e6-0d7d-4d1b-abd6-f261d6f810cf tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:23.955530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8a9141e6-0d7d-4d1b-abd6-f261d6f810cf tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:23.962967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a9141e6-0d7d-4d1b-abd6-f261d6f810cf tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:23.967571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a9141e6-0d7d-4d1b-abd6-f261d6f810cf tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:23.967571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a9141e6-0d7d-4d1b-abd6-f261d6f810cf tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:23.967571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a9141e6-0d7d-4d1b-abd6-f261d6f810cf tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:23.971148 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a83807f4-e058-41ea-9b27-4b2744f98768 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1217 microversion: 2.1 time: 0.169519 Jan 22 21:11:23.974447 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2003/3841] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:23 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:24.091503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2a2373db-1fef-4c73-aba6-5c2240b27435 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:24.092161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2a2373db-1fef-4c73-aba6-5c2240b27435 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:24.106296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a2373db-1fef-4c73-aba6-5c2240b27435 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:24.108368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a2373db-1fef-4c73-aba6-5c2240b27435 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:24.109160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a2373db-1fef-4c73-aba6-5c2240b27435 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:24.109655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a2373db-1fef-4c73-aba6-5c2240b27435 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:24.576412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2a2373db-1fef-4c73-aba6-5c2240b27435 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:24.595991 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2a2373db-1fef-4c73-aba6-5c2240b27435 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.509497 Jan 22 21:11:24.605663 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2004/3842] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:24 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:24.618133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9f2ede5c-3f91-412c-90d8-ac261ba5512f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:24.620595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9f2ede5c-3f91-412c-90d8-ac261ba5512f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:24.649676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f2ede5c-3f91-412c-90d8-ac261ba5512f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:24.649676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f2ede5c-3f91-412c-90d8-ac261ba5512f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:24.649676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f2ede5c-3f91-412c-90d8-ac261ba5512f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:24.649676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f2ede5c-3f91-412c-90d8-ac261ba5512f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:24.702405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8a9141e6-0d7d-4d1b-abd6-f261d6f810cf tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:24.711207 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8a9141e6-0d7d-4d1b-abd6-f261d6f810cf tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.761579 Jan 22 21:11:24.725751 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1839/3843] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:23 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:24.726384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-565c1c8c-3c14-4c39-9be7-a153500eb6c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:24.727209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-565c1c8c-3c14-4c39-9be7-a153500eb6c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:24.743111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-565c1c8c-3c14-4c39-9be7-a153500eb6c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:24.743806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-565c1c8c-3c14-4c39-9be7-a153500eb6c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:24.744761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-565c1c8c-3c14-4c39-9be7-a153500eb6c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:24.745479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-565c1c8c-3c14-4c39-9be7-a153500eb6c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:24.755772 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9f2ede5c-3f91-412c-90d8-ac261ba5512f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.140923 Jan 22 21:11:24.758659 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2005/3844] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:24 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:24.777821 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-565c1c8c-3c14-4c39-9be7-a153500eb6c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 could not be found. Jan 22 21:11:24.782190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-565c1c8c-3c14-4c39-9be7-a153500eb6c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:11:24.783296 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-565c1c8c-3c14-4c39-9be7-a153500eb6c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 404 len: 111 microversion: 2.1 time: 0.062615 Jan 22 21:11:24.784717 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1840/3845] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:24 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:11:24.793361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-91bc5d55-940e-43e0-8666-c4fa29b63183 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:24.793361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-91bc5d55-940e-43e0-8666-c4fa29b63183 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:24.810775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91bc5d55-940e-43e0-8666-c4fa29b63183 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:24.827295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-250d1e73-e4d5-4442-967b-38582c090d1a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:24.827911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-250d1e73-e4d5-4442-967b-38582c090d1a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:24.844363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91bc5d55-940e-43e0-8666-c4fa29b63183 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:24.847626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-250d1e73-e4d5-4442-967b-38582c090d1a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:24.848241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-250d1e73-e4d5-4442-967b-38582c090d1a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:24.849095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-250d1e73-e4d5-4442-967b-38582c090d1a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:24.849571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-250d1e73-e4d5-4442-967b-38582c090d1a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:24.852932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91bc5d55-940e-43e0-8666-c4fa29b63183 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:24.853289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91bc5d55-940e-43e0-8666-c4fa29b63183 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:24.943687 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-91bc5d55-940e-43e0-8666-c4fa29b63183 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.183575 Jan 22 21:11:24.947917 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2006/3846] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:24 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:24.992948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ccd75b23-fdc7-4c2e-9222-6e27fba48f46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:24.993686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ccd75b23-fdc7-4c2e-9222-6e27fba48f46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:25.008349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccd75b23-fdc7-4c2e-9222-6e27fba48f46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:25.008882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccd75b23-fdc7-4c2e-9222-6e27fba48f46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:25.016041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccd75b23-fdc7-4c2e-9222-6e27fba48f46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:25.016041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccd75b23-fdc7-4c2e-9222-6e27fba48f46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:25.136586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ccd75b23-fdc7-4c2e-9222-6e27fba48f46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:25.145101 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ccd75b23-fdc7-4c2e-9222-6e27fba48f46 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1269 microversion: 2.1 time: 0.156361 Jan 22 21:11:25.149767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-250d1e73-e4d5-4442-967b-38582c090d1a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:25.152765 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2007/3847] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:24 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:25.167253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1567978289", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "ab49ab48-066e-4b21-9cb5-bee63c0067a9"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:25.168652 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-250d1e73-e4d5-4442-967b-38582c090d1a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1538 microversion: 2.1 time: 0.345589 Jan 22 21:11:25.169241 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1841/3848] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:24 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1538 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:25.248589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] validate_networks() for [('ab49ab48-066e-4b21-9cb5-bee63c0067a9', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:11:25.593440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-9d8fa677-94f9-4ca7-a87f-360d06343355 req-b3bf07b9-3f09-4fdf-bb60-3515a6acec1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40cd339-38cd-40f4-a4e5-0b220e363df8", "name": "network-vif-unplugged", "status": "completed", "tag": "8c94703f-c59c-42e5-b507-01dab2c8cb70"}, {"name": "network-changed", "server_uuid": "a40cd339-38cd-40f4-a4e5-0b220e363df8", "tag": "8c94703f-c59c-42e5-b507-01dab2c8cb70"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:25.597589 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:25.597589 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:11:25.623407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9d8fa677-94f9-4ca7-a87f-360d06343355 req-b3bf07b9-3f09-4fdf-bb60-3515a6acec1f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:25.624179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9d8fa677-94f9-4ca7-a87f-360d06343355 req-b3bf07b9-3f09-4fdf-bb60-3515a6acec1f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:25.653517 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-9d8fa677-94f9-4ca7-a87f-360d06343355 req-b3bf07b9-3f09-4fdf-bb60-3515a6acec1f service nova] Creating event network-vif-unplugged:8c94703f-c59c-42e5-b507-01dab2c8cb70 for instance a40cd339-38cd-40f4-a4e5-0b220e363df8 on nch2-master-1 Jan 22 21:11:25.656655 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-9d8fa677-94f9-4ca7-a87f-360d06343355 req-b3bf07b9-3f09-4fdf-bb60-3515a6acec1f service nova] Creating event network-changed:8c94703f-c59c-42e5-b507-01dab2c8cb70 for instance a40cd339-38cd-40f4-a4e5-0b220e363df8 on nch2-master-1 Jan 22 21:11:25.666596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-9d8fa677-94f9-4ca7-a87f-360d06343355 req-b3bf07b9-3f09-4fdf-bb60-3515a6acec1f service nova] Instance a40cd339-38cd-40f4-a4e5-0b220e363df8 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:11:25.705705 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-9d8fa677-94f9-4ca7-a87f-360d06343355 req-b3bf07b9-3f09-4fdf-bb60-3515a6acec1f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.117719 Jan 22 21:11:25.710814 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1842/3849] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:11:25.720730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3f9260e7-8993-4c72-a558-8df0e2165aff tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:25.724928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3f9260e7-8993-4c72-a558-8df0e2165aff tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:25.736638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f9260e7-8993-4c72-a558-8df0e2165aff tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:25.737378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f9260e7-8993-4c72-a558-8df0e2165aff tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:25.738718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f9260e7-8993-4c72-a558-8df0e2165aff tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:25.739328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f9260e7-8993-4c72-a558-8df0e2165aff tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:26.248203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:11:26.248822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:11:26.249620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:11:26.250715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:11:26.251949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:11:26.266504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:26.268638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:26.270203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:26.270999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:26.309540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:11:26.320812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Getting quotas for user 75befd3272db4de48c7b4586adf6f849 and project fea0d2f31f914c52a4ea5db2f34a532e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:11:26.340955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:11:26.344822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:11:26.402528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3f9260e7-8993-4c72-a558-8df0e2165aff tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:26.410340 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3f9260e7-8993-4c72-a558-8df0e2165aff tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.700372 Jan 22 21:11:26.411476 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1843/3850] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:25 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:26.416285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-057fd99f-c2e4-47b2-ad3e-1d8e4413a08b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:26.417188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-057fd99f-c2e4-47b2-ad3e-1d8e4413a08b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:26.424271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-057fd99f-c2e4-47b2-ad3e-1d8e4413a08b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:26.424955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-057fd99f-c2e4-47b2-ad3e-1d8e4413a08b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:26.425964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-057fd99f-c2e4-47b2-ad3e-1d8e4413a08b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:26.426587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-057fd99f-c2e4-47b2-ad3e-1d8e4413a08b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:26.770310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-057fd99f-c2e4-47b2-ad3e-1d8e4413a08b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:26.788352 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-057fd99f-c2e4-47b2-ad3e-1d8e4413a08b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.374764 Jan 22 21:11:26.793137 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1844/3851] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:26 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:26.803970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d6e76334-7535-4777-b975-03f9667b7491 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:26.806486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d6e76334-7535-4777-b975-03f9667b7491 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:26.813901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6e76334-7535-4777-b975-03f9667b7491 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:26.814907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6e76334-7535-4777-b975-03f9667b7491 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:26.815993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6e76334-7535-4777-b975-03f9667b7491 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:26.816629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6e76334-7535-4777-b975-03f9667b7491 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:26.911438 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c7ba8a6f-57d9-4eb1-8a8f-b883d248c803 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.756899 Jan 22 21:11:26.917796 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2008/3852] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:11:25 2022] POST /compute/v2.1/servers => generated 382 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:11:26.919236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4be8cd56-a55b-4f83-92ec-7c270afd94f3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:26.920517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4be8cd56-a55b-4f83-92ec-7c270afd94f3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:26.928564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4be8cd56-a55b-4f83-92ec-7c270afd94f3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:26.929140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4be8cd56-a55b-4f83-92ec-7c270afd94f3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:26.930588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4be8cd56-a55b-4f83-92ec-7c270afd94f3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:26.931110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4be8cd56-a55b-4f83-92ec-7c270afd94f3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:26.935134 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d6e76334-7535-4777-b975-03f9667b7491 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.138223 Jan 22 21:11:26.939850 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1845/3853] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:26 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:26.945527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f52ef2bf-b7bb-4c49-8d68-955a09db70d0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:26.946563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f52ef2bf-b7bb-4c49-8d68-955a09db70d0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:26.957045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f52ef2bf-b7bb-4c49-8d68-955a09db70d0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:26.957995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f52ef2bf-b7bb-4c49-8d68-955a09db70d0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:26.959950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f52ef2bf-b7bb-4c49-8d68-955a09db70d0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:26.960603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f52ef2bf-b7bb-4c49-8d68-955a09db70d0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:27.036426 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4be8cd56-a55b-4f83-92ec-7c270afd94f3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.121907 Jan 22 21:11:27.037765 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2009/3854] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:26 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:27.049234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9e7340a3-7ea6-4cf7-9d70-a053a7dc6341 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:27.050533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9e7340a3-7ea6-4cf7-9d70-a053a7dc6341 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:27.064289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e7340a3-7ea6-4cf7-9d70-a053a7dc6341 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:27.065184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e7340a3-7ea6-4cf7-9d70-a053a7dc6341 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:27.066642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e7340a3-7ea6-4cf7-9d70-a053a7dc6341 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:27.067563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e7340a3-7ea6-4cf7-9d70-a053a7dc6341 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:27.318467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9e7340a3-7ea6-4cf7-9d70-a053a7dc6341 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:27.323396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f52ef2bf-b7bb-4c49-8d68-955a09db70d0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:27.334710 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9e7340a3-7ea6-4cf7-9d70-a053a7dc6341 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1538 microversion: 2.1 time: 0.294648 Jan 22 21:11:27.336826 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2010/3855] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:27 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1538 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:27.343606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-6f2078a5-737d-4566-9883-2375a9fb6daf req-c8aca238-f0e3-4edd-9482-a40f53e49bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b2aed8-f03f-4c04-b508-cc9a7e172dd6", "name": "network-vif-plugged", "status": "completed", "tag": "99dd6838-12b2-4c2b-b219-2af5c1a44a74"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:27.345859 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:27.345859 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:11:27.363221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6f2078a5-737d-4566-9883-2375a9fb6daf req-c8aca238-f0e3-4edd-9482-a40f53e49bb3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:27.363221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6f2078a5-737d-4566-9883-2375a9fb6daf req-c8aca238-f0e3-4edd-9482-a40f53e49bb3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:27.365996 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f52ef2bf-b7bb-4c49-8d68-955a09db70d0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1275 microversion: 2.1 time: 0.404972 Jan 22 21:11:27.383668 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-6f2078a5-737d-4566-9883-2375a9fb6daf req-c8aca238-f0e3-4edd-9482-a40f53e49bb3 service nova] Creating event network-vif-plugged:99dd6838-12b2-4c2b-b219-2af5c1a44a74 for instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 on nch1-master-1 Jan 22 21:11:27.406727 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-6f2078a5-737d-4566-9883-2375a9fb6daf req-c8aca238-f0e3-4edd-9482-a40f53e49bb3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065175 Jan 22 21:11:27.413233 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2011/3857] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:27.428947 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1846/3857] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:26 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1275 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:27.433041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-760e5609-920d-4cc5-aaf9-e1d3af518b2d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:27.437045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-760e5609-920d-4cc5-aaf9-e1d3af518b2d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:27.441998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e30b9bc1-37e5-4f47-b969-9a898da3ff96 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:27.445212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e30b9bc1-37e5-4f47-b969-9a898da3ff96 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:27.452417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-760e5609-920d-4cc5-aaf9-e1d3af518b2d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:27.460502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-760e5609-920d-4cc5-aaf9-e1d3af518b2d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:27.460502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-760e5609-920d-4cc5-aaf9-e1d3af518b2d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:27.460502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-760e5609-920d-4cc5-aaf9-e1d3af518b2d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:27.634000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e30b9bc1-37e5-4f47-b969-9a898da3ff96 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:27.669163 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e30b9bc1-37e5-4f47-b969-9a898da3ff96 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1213 microversion: 2.1 time: 0.249002 Jan 22 21:11:27.680764 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2012/3858] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:27 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1213 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:27.815120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1cfb259-d36e-4be4-b39f-f7193a5779e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:27.816132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1cfb259-d36e-4be4-b39f-f7193a5779e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:27.830580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1cfb259-d36e-4be4-b39f-f7193a5779e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:27.831046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1cfb259-d36e-4be4-b39f-f7193a5779e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:27.831854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1cfb259-d36e-4be4-b39f-f7193a5779e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:27.832304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1cfb259-d36e-4be4-b39f-f7193a5779e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:28.016790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-760e5609-920d-4cc5-aaf9-e1d3af518b2d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:28.038908 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-760e5609-920d-4cc5-aaf9-e1d3af518b2d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.608110 Jan 22 21:11:28.040793 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1847/3859] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:27 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:28.056612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24642e12-0c4c-4fc5-b779-043799aa9749 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:28.058980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-24642e12-0c4c-4fc5-b779-043799aa9749 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:28.079301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24642e12-0c4c-4fc5-b779-043799aa9749 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:28.080165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24642e12-0c4c-4fc5-b779-043799aa9749 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:28.083127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24642e12-0c4c-4fc5-b779-043799aa9749 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:28.085050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24642e12-0c4c-4fc5-b779-043799aa9749 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:28.112704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1cfb259-d36e-4be4-b39f-f7193a5779e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:28.139461 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1cfb259-d36e-4be4-b39f-f7193a5779e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.332235 Jan 22 21:11:28.140898 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2013/3860] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:27 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:28.146561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f157b8d-e4f8-41c6-a045-28fc779cb9dc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:28.148379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f157b8d-e4f8-41c6-a045-28fc779cb9dc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:28.157774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f157b8d-e4f8-41c6-a045-28fc779cb9dc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:28.159123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f157b8d-e4f8-41c6-a045-28fc779cb9dc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:28.161008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f157b8d-e4f8-41c6-a045-28fc779cb9dc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:28.161720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f157b8d-e4f8-41c6-a045-28fc779cb9dc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:28.168691 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-24642e12-0c4c-4fc5-b779-043799aa9749 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.121042 Jan 22 21:11:28.168691 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1848/3861] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:28 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:28.225566 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f157b8d-e4f8-41c6-a045-28fc779cb9dc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.073120 Jan 22 21:11:28.234160 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2014/3862] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:28 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:28.355767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b365dfed-aacf-403e-80b5-8f2362f03204 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:28.356754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b365dfed-aacf-403e-80b5-8f2362f03204 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:28.372381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b365dfed-aacf-403e-80b5-8f2362f03204 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:28.376215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b365dfed-aacf-403e-80b5-8f2362f03204 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:28.378341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b365dfed-aacf-403e-80b5-8f2362f03204 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:28.378966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b365dfed-aacf-403e-80b5-8f2362f03204 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:28.438184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ecf4cd3f-dbc7-493f-9d90-4e840e7a8f86 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:28.439159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ecf4cd3f-dbc7-493f-9d90-4e840e7a8f86 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:28.461939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ecf4cd3f-dbc7-493f-9d90-4e840e7a8f86 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:28.462464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ecf4cd3f-dbc7-493f-9d90-4e840e7a8f86 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:28.466531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ecf4cd3f-dbc7-493f-9d90-4e840e7a8f86 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:28.467334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ecf4cd3f-dbc7-493f-9d90-4e840e7a8f86 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:28.738206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b365dfed-aacf-403e-80b5-8f2362f03204 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:28.748812 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b365dfed-aacf-403e-80b5-8f2362f03204 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1538 microversion: 2.1 time: 0.397998 Jan 22 21:11:28.754011 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1849/3863] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:28 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1538 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:28.766732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a61fa67b-c5e1-44a1-881d-f0efe57790d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:28.767068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a61fa67b-c5e1-44a1-881d-f0efe57790d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:28.780914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ecf4cd3f-dbc7-493f-9d90-4e840e7a8f86 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:28.793659 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ecf4cd3f-dbc7-493f-9d90-4e840e7a8f86 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1317 microversion: 2.1 time: 0.360996 Jan 22 21:11:28.803304 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2015/3864] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:28 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:28.803522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a61fa67b-c5e1-44a1-881d-f0efe57790d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:28.804414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a61fa67b-c5e1-44a1-881d-f0efe57790d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:28.805542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a61fa67b-c5e1-44a1-881d-f0efe57790d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:28.810180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a61fa67b-c5e1-44a1-881d-f0efe57790d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:28.950277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a61fa67b-c5e1-44a1-881d-f0efe57790d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:28.962547 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a61fa67b-c5e1-44a1-881d-f0efe57790d3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1217 microversion: 2.1 time: 0.207068 Jan 22 21:11:28.965806 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1850/3865] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:28 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:29.061098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cff10284-2715-4d44-834e-9b931880b00c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:29.061758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cff10284-2715-4d44-834e-9b931880b00c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:29.071400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cff10284-2715-4d44-834e-9b931880b00c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:29.076318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cff10284-2715-4d44-834e-9b931880b00c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:29.076318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cff10284-2715-4d44-834e-9b931880b00c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:29.076318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cff10284-2715-4d44-834e-9b931880b00c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:29.167350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bd3c6ced-af3a-40f7-ad58-845eead84719 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:29.179453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bd3c6ced-af3a-40f7-ad58-845eead84719 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:29.208290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd3c6ced-af3a-40f7-ad58-845eead84719 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:29.210213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd3c6ced-af3a-40f7-ad58-845eead84719 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:29.217669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd3c6ced-af3a-40f7-ad58-845eead84719 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:29.217669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd3c6ced-af3a-40f7-ad58-845eead84719 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:29.496044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cff10284-2715-4d44-834e-9b931880b00c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:29.509327 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cff10284-2715-4d44-834e-9b931880b00c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.453748 Jan 22 21:11:29.513995 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2016/3866] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:29 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:29.516934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-557f0d28-6aeb-4b1b-9016-f73454f9654b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:29.519058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-557f0d28-6aeb-4b1b-9016-f73454f9654b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:29.527520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-557f0d28-6aeb-4b1b-9016-f73454f9654b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:29.528197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-557f0d28-6aeb-4b1b-9016-f73454f9654b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:29.529042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-557f0d28-6aeb-4b1b-9016-f73454f9654b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:29.529495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-557f0d28-6aeb-4b1b-9016-f73454f9654b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:29.686529 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-557f0d28-6aeb-4b1b-9016-f73454f9654b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.174495 Jan 22 21:11:29.687871 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2017/3867] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:29 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:29.694596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-05ca83e9-30fb-413b-9e00-19827664907f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:29.696164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-05ca83e9-30fb-413b-9e00-19827664907f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:29.706198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05ca83e9-30fb-413b-9e00-19827664907f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:29.706776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05ca83e9-30fb-413b-9e00-19827664907f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:29.707838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05ca83e9-30fb-413b-9e00-19827664907f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:29.708537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05ca83e9-30fb-413b-9e00-19827664907f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:29.762251 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-05ca83e9-30fb-413b-9e00-19827664907f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.071535 Jan 22 21:11:29.763636 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2018/3868] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:29 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:29.768768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-610df6ce-61e5-4a0e-9e9d-eba631ea2e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:29.769570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-610df6ce-61e5-4a0e-9e9d-eba631ea2e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:29.778387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-610df6ce-61e5-4a0e-9e9d-eba631ea2e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:29.778847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-610df6ce-61e5-4a0e-9e9d-eba631ea2e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:29.779698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-610df6ce-61e5-4a0e-9e9d-eba631ea2e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:29.780147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-610df6ce-61e5-4a0e-9e9d-eba631ea2e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:29.944752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-610df6ce-61e5-4a0e-9e9d-eba631ea2e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:29.949587 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-610df6ce-61e5-4a0e-9e9d-eba631ea2e3c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1538 microversion: 2.1 time: 0.184944 Jan 22 21:11:29.950182 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2019/3869] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:29 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1538 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:29.954705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cfeb8399-4982-498c-a0d6-06ba1816379e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:29.955366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cfeb8399-4982-498c-a0d6-06ba1816379e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:29.961239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfeb8399-4982-498c-a0d6-06ba1816379e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:29.961738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfeb8399-4982-498c-a0d6-06ba1816379e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:29.962538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfeb8399-4982-498c-a0d6-06ba1816379e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:29.962984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfeb8399-4982-498c-a0d6-06ba1816379e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:30.037859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bd3c6ced-af3a-40f7-ad58-845eead84719 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:30.050210 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bd3c6ced-af3a-40f7-ad58-845eead84719 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.892658 Jan 22 21:11:30.050210 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1851/3870] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:29 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:30.053259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6efbd336-eb46-4a02-a8ed-1c115da1efc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:30.053963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6efbd336-eb46-4a02-a8ed-1c115da1efc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:30.063418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6efbd336-eb46-4a02-a8ed-1c115da1efc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:30.064103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6efbd336-eb46-4a02-a8ed-1c115da1efc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:30.065080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6efbd336-eb46-4a02-a8ed-1c115da1efc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:30.066265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6efbd336-eb46-4a02-a8ed-1c115da1efc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:30.141494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6efbd336-eb46-4a02-a8ed-1c115da1efc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:30.148983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cfeb8399-4982-498c-a0d6-06ba1816379e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:30.154507 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6efbd336-eb46-4a02-a8ed-1c115da1efc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1265 microversion: 2.1 time: 0.105455 Jan 22 21:11:30.171118 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cfeb8399-4982-498c-a0d6-06ba1816379e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1317 microversion: 2.1 time: 0.215088 Jan 22 21:11:30.171118 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2020/3871] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:29 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:30.171358 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1852/3872] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:30 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:30.527916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-38b8b3ea-f762-44c8-a178-39c0f30313df tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:30.528950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-38b8b3ea-f762-44c8-a178-39c0f30313df tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:30.535554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38b8b3ea-f762-44c8-a178-39c0f30313df tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:30.536170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38b8b3ea-f762-44c8-a178-39c0f30313df tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:30.537137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38b8b3ea-f762-44c8-a178-39c0f30313df tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:30.537865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38b8b3ea-f762-44c8-a178-39c0f30313df tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:30.700893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0c689170-7b5d-4b72-bd0f-b625143e7f32 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:30.701953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0c689170-7b5d-4b72-bd0f-b625143e7f32 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:30.710137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c689170-7b5d-4b72-bd0f-b625143e7f32 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:30.710591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c689170-7b5d-4b72-bd0f-b625143e7f32 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:30.711593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c689170-7b5d-4b72-bd0f-b625143e7f32 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:30.712043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c689170-7b5d-4b72-bd0f-b625143e7f32 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:30.712852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-38b8b3ea-f762-44c8-a178-39c0f30313df tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:30.724272 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-38b8b3ea-f762-44c8-a178-39c0f30313df tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1522 microversion: 2.1 time: 0.200108 Jan 22 21:11:30.725372 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2021/3873] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:30 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:30.785936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1bd69254-dcac-446f-8d31-471e198199ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:30.787035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1bd69254-dcac-446f-8d31-471e198199ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:30.802026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bd69254-dcac-446f-8d31-471e198199ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:30.802946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bd69254-dcac-446f-8d31-471e198199ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:30.803357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bd69254-dcac-446f-8d31-471e198199ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:30.803850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bd69254-dcac-446f-8d31-471e198199ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:32.473944 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0c689170-7b5d-4b72-bd0f-b625143e7f32 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 1.777739 Jan 22 21:11:32.478574 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1853/3874] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:30 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:32.480310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-599e5e1e-2e8a-4bd0-b5f0-46c91c10333c req-adff773a-818f-4938-bd60-2d918dea227f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dfc70ea-429f-48ac-b11d-d720aa0130d6", "tag": "d9f0f206-48d8-436d-8afd-c78217567334"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:32.481964 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:32.481964 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:11:32.484243 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1bd69254-dcac-446f-8d31-471e198199ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 1.705618 Jan 22 21:11:32.486145 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2022/3875] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:30 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:32.491070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-599e5e1e-2e8a-4bd0-b5f0-46c91c10333c req-adff773a-818f-4938-bd60-2d918dea227f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:32.491940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-599e5e1e-2e8a-4bd0-b5f0-46c91c10333c req-adff773a-818f-4938-bd60-2d918dea227f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:32.494375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-654af122-bd8f-4dcd-9d6b-ed3adb886eb7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:32.496071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-654af122-bd8f-4dcd-9d6b-ed3adb886eb7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:32.504118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-654af122-bd8f-4dcd-9d6b-ed3adb886eb7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:32.504588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-654af122-bd8f-4dcd-9d6b-ed3adb886eb7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:32.505053 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-599e5e1e-2e8a-4bd0-b5f0-46c91c10333c req-adff773a-818f-4938-bd60-2d918dea227f service nova] Creating event network-changed:d9f0f206-48d8-436d-8afd-c78217567334 for instance 2dfc70ea-429f-48ac-b11d-d720aa0130d6 on nch1-master-1 Jan 22 21:11:32.505400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-654af122-bd8f-4dcd-9d6b-ed3adb886eb7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:32.505967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-654af122-bd8f-4dcd-9d6b-ed3adb886eb7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:32.511023 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-599e5e1e-2e8a-4bd0-b5f0-46c91c10333c req-adff773a-818f-4938-bd60-2d918dea227f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034816 Jan 22 21:11:32.511716 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1854/3876] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:32.518680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dcb56d4c-8d52-45c5-9b82-d27ab677eb6e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:32.519460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dcb56d4c-8d52-45c5-9b82-d27ab677eb6e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:32.527277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcb56d4c-8d52-45c5-9b82-d27ab677eb6e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:32.530952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcb56d4c-8d52-45c5-9b82-d27ab677eb6e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:32.530952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcb56d4c-8d52-45c5-9b82-d27ab677eb6e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:32.530952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcb56d4c-8d52-45c5-9b82-d27ab677eb6e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:32.699298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-654af122-bd8f-4dcd-9d6b-ed3adb886eb7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:32.709316 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-654af122-bd8f-4dcd-9d6b-ed3adb886eb7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1538 microversion: 2.1 time: 0.222449 Jan 22 21:11:32.710245 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2023/3877] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:32 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1538 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:32.716690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-369214c5-6c13-4a49-b8c7-35185a9eb20b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:32.717650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-369214c5-6c13-4a49-b8c7-35185a9eb20b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:32.728348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-369214c5-6c13-4a49-b8c7-35185a9eb20b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:32.730384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-369214c5-6c13-4a49-b8c7-35185a9eb20b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:32.731790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-369214c5-6c13-4a49-b8c7-35185a9eb20b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:32.732165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-369214c5-6c13-4a49-b8c7-35185a9eb20b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:32.898041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-369214c5-6c13-4a49-b8c7-35185a9eb20b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:32.906435 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-369214c5-6c13-4a49-b8c7-35185a9eb20b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1313 microversion: 2.1 time: 0.194940 Jan 22 21:11:32.907035 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2024/3878] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:32 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:32.912593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fd2ccbf6-39ab-49ae-b42e-b6200843fc84 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:32.913442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fd2ccbf6-39ab-49ae-b42e-b6200843fc84 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:32.921959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd2ccbf6-39ab-49ae-b42e-b6200843fc84 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:32.922451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd2ccbf6-39ab-49ae-b42e-b6200843fc84 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:32.928214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd2ccbf6-39ab-49ae-b42e-b6200843fc84 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:32.928214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd2ccbf6-39ab-49ae-b42e-b6200843fc84 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:32.973720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dcb56d4c-8d52-45c5-9b82-d27ab677eb6e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:32.981809 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dcb56d4c-8d52-45c5-9b82-d27ab677eb6e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.466931 Jan 22 21:11:32.991823 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1855/3879] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:32 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:33.000235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-39f36d1c-22a8-47de-b89d-c2ad53ea2fac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:33.004817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-39f36d1c-22a8-47de-b89d-c2ad53ea2fac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:33.007192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f36d1c-22a8-47de-b89d-c2ad53ea2fac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:33.007653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f36d1c-22a8-47de-b89d-c2ad53ea2fac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:33.008467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f36d1c-22a8-47de-b89d-c2ad53ea2fac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:33.009068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f36d1c-22a8-47de-b89d-c2ad53ea2fac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:33.088990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fd2ccbf6-39ab-49ae-b42e-b6200843fc84 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:33.097268 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fd2ccbf6-39ab-49ae-b42e-b6200843fc84 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1317 microversion: 2.1 time: 0.189085 Jan 22 21:11:33.097982 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2025/3880] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:32 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:33.486009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3ee20881-5ac1-4590-927f-0c200c9f28dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:33.488274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-39f36d1c-22a8-47de-b89d-c2ad53ea2fac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:33.491316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3ee20881-5ac1-4590-927f-0c200c9f28dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:33.500544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ee20881-5ac1-4590-927f-0c200c9f28dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:33.501073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ee20881-5ac1-4590-927f-0c200c9f28dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:33.501928 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-39f36d1c-22a8-47de-b89d-c2ad53ea2fac tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.518206 Jan 22 21:11:33.502063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ee20881-5ac1-4590-927f-0c200c9f28dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:33.502625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ee20881-5ac1-4590-927f-0c200c9f28dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:33.515344 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1856/3881] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:32 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:33.523341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-811ca26e-34cb-438c-9b1e-5d349ec81911 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:33.527558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-811ca26e-34cb-438c-9b1e-5d349ec81911 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:33.534314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-811ca26e-34cb-438c-9b1e-5d349ec81911 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:33.536733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-811ca26e-34cb-438c-9b1e-5d349ec81911 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:33.537733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-811ca26e-34cb-438c-9b1e-5d349ec81911 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:33.538866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-811ca26e-34cb-438c-9b1e-5d349ec81911 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:33.551286 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3ee20881-5ac1-4590-927f-0c200c9f28dc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.069037 Jan 22 21:11:33.551956 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2026/3882] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:33 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:33.557435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-87261941-b75a-4631-8df8-1eaf51a20389 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:33.558160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-87261941-b75a-4631-8df8-1eaf51a20389 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:33.565868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87261941-b75a-4631-8df8-1eaf51a20389 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:33.566324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87261941-b75a-4631-8df8-1eaf51a20389 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:33.567124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87261941-b75a-4631-8df8-1eaf51a20389 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:33.567564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87261941-b75a-4631-8df8-1eaf51a20389 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:33.585372 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-811ca26e-34cb-438c-9b1e-5d349ec81911 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.068468 Jan 22 21:11:33.586210 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1857/3883] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:33 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:33.732576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0b9ce3ab-2731-469a-90a9-ff2f4f8a792d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:33.733688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0b9ce3ab-2731-469a-90a9-ff2f4f8a792d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:33.741984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b9ce3ab-2731-469a-90a9-ff2f4f8a792d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:33.743793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b9ce3ab-2731-469a-90a9-ff2f4f8a792d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:33.744896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b9ce3ab-2731-469a-90a9-ff2f4f8a792d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:33.745642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b9ce3ab-2731-469a-90a9-ff2f4f8a792d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:33.804966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-87261941-b75a-4631-8df8-1eaf51a20389 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:33.814701 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-87261941-b75a-4631-8df8-1eaf51a20389 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.261017 Jan 22 21:11:33.820107 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2027/3884] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:33 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:33.839425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-432a64b1-a99f-4e99-95bc-1f9dd5dac89c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:33.840056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-432a64b1-a99f-4e99-95bc-1f9dd5dac89c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:33.846784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-432a64b1-a99f-4e99-95bc-1f9dd5dac89c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:33.847248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-432a64b1-a99f-4e99-95bc-1f9dd5dac89c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:33.848061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-432a64b1-a99f-4e99-95bc-1f9dd5dac89c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:33.848511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-432a64b1-a99f-4e99-95bc-1f9dd5dac89c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.082587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-432a64b1-a99f-4e99-95bc-1f9dd5dac89c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:34.092180 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-432a64b1-a99f-4e99-95bc-1f9dd5dac89c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.256890 Jan 22 21:11:34.097333 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2028/3885] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:33 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:34.099532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-24521b91-3a69-4022-a571-2abffafd7850 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:34.100558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-24521b91-3a69-4022-a571-2abffafd7850 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:34.109858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24521b91-3a69-4022-a571-2abffafd7850 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:34.110607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24521b91-3a69-4022-a571-2abffafd7850 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.111603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24521b91-3a69-4022-a571-2abffafd7850 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:34.112053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24521b91-3a69-4022-a571-2abffafd7850 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.124190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0b9ce3ab-2731-469a-90a9-ff2f4f8a792d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:34.132542 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0b9ce3ab-2731-469a-90a9-ff2f4f8a792d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1538 microversion: 2.1 time: 0.407962 Jan 22 21:11:34.144780 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1858/3886] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:33 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1538 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:34.150460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c35b778f-fef3-4e5e-92fc-4dc5d1129c7e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:34.151899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c35b778f-fef3-4e5e-92fc-4dc5d1129c7e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:34.158909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c35b778f-fef3-4e5e-92fc-4dc5d1129c7e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:34.159373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c35b778f-fef3-4e5e-92fc-4dc5d1129c7e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.160490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c35b778f-fef3-4e5e-92fc-4dc5d1129c7e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:34.161101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c35b778f-fef3-4e5e-92fc-4dc5d1129c7e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.293605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-24521b91-3a69-4022-a571-2abffafd7850 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:34.301049 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-24521b91-3a69-4022-a571-2abffafd7850 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1313 microversion: 2.1 time: 0.206660 Jan 22 21:11:34.301660 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2029/3887] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:34 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:34.308086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7cda6e27-ba14-413f-991c-54e3d9ea5b2f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:34.312569 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-7cda6e27-ba14-413f-991c-54e3d9ea5b2f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance 6ea56ce5-fc0f-48fa-9b1b-d0af75561318 has no mapping to a cell. Jan 22 21:11:34.313151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7cda6e27-ba14-413f-991c-54e3d9ea5b2f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance 6ea56ce5-fc0f-48fa-9b1b-d0af75561318 has no mapping to a cell. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:11:34.313776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c35b778f-fef3-4e5e-92fc-4dc5d1129c7e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:34.314161 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7cda6e27-ba14-413f-991c-54e3d9ea5b2f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/6ea56ce5-fc0f-48fa-9b1b-d0af75561318/action" status: 404 len: 117 microversion: 2.1 time: 0.011474 Jan 22 21:11:34.314725 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2030/3888] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:34 2022] POST /compute/v2.1/servers/6ea56ce5-fc0f-48fa-9b1b-d0af75561318/action => generated 117 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:11:34.319110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2235b207-c9d3-412c-bbc0-a4804303c450 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:34.319710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2235b207-c9d3-412c-bbc0-a4804303c450 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:34.324041 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c35b778f-fef3-4e5e-92fc-4dc5d1129c7e tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.177927 Jan 22 21:11:34.324959 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1859/3889] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:34 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:34.327992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2235b207-c9d3-412c-bbc0-a4804303c450 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:34.339305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2235b207-c9d3-412c-bbc0-a4804303c450 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.339305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2235b207-c9d3-412c-bbc0-a4804303c450 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:34.339488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-023737fb-e7d5-4b0b-b91d-a700faca088b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:34.339585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2235b207-c9d3-412c-bbc0-a4804303c450 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.339661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-023737fb-e7d5-4b0b-b91d-a700faca088b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:34.339661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-023737fb-e7d5-4b0b-b91d-a700faca088b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:34.339661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-023737fb-e7d5-4b0b-b91d-a700faca088b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.339661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-023737fb-e7d5-4b0b-b91d-a700faca088b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:34.339661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-023737fb-e7d5-4b0b-b91d-a700faca088b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.531144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-023737fb-e7d5-4b0b-b91d-a700faca088b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:34.541047 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-023737fb-e7d5-4b0b-b91d-a700faca088b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.215094 Jan 22 21:11:34.542209 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1860/3890] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:34 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:34.546774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-a7c58632-51b7-4ad9-acd8-62b1284d39a6 req-92a26010-374a-4bc8-bbb2-cdc68c91f81e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6246ed48-9f22-4375-bb21-57f112060395", "tag": "42fdb3d7-e8e0-4810-b944-f6f9b2944b32"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:34.548548 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:34.548548 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:11:34.555887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a7c58632-51b7-4ad9-acd8-62b1284d39a6 req-92a26010-374a-4bc8-bbb2-cdc68c91f81e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:34.556573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a7c58632-51b7-4ad9-acd8-62b1284d39a6 req-92a26010-374a-4bc8-bbb2-cdc68c91f81e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.570091 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-a7c58632-51b7-4ad9-acd8-62b1284d39a6 req-92a26010-374a-4bc8-bbb2-cdc68c91f81e service nova] Creating event network-changed:42fdb3d7-e8e0-4810-b944-f6f9b2944b32 for instance 6246ed48-9f22-4375-bb21-57f112060395 on nch1-master-1 Jan 22 21:11:34.575983 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-a7c58632-51b7-4ad9-acd8-62b1284d39a6 req-92a26010-374a-4bc8-bbb2-cdc68c91f81e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032424 Jan 22 21:11:34.580599 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1861/3891] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:34.582594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a1d34247-6253-4ea8-b864-de7cefcd6109 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:34.583300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a1d34247-6253-4ea8-b864-de7cefcd6109 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:34.589707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1d34247-6253-4ea8-b864-de7cefcd6109 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:34.590169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1d34247-6253-4ea8-b864-de7cefcd6109 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.590975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1d34247-6253-4ea8-b864-de7cefcd6109 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:34.591596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1d34247-6253-4ea8-b864-de7cefcd6109 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.607733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2235b207-c9d3-412c-bbc0-a4804303c450 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:34.622505 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2235b207-c9d3-412c-bbc0-a4804303c450 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1317 microversion: 2.1 time: 0.306360 Jan 22 21:11:34.624198 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2031/3892] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:34 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:34.633595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-343b48c0-55f2-40a3-b52e-6203a76f02c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:34.636877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-343b48c0-55f2-40a3-b52e-6203a76f02c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:34.648325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-343b48c0-55f2-40a3-b52e-6203a76f02c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:34.653110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-343b48c0-55f2-40a3-b52e-6203a76f02c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.654657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-343b48c0-55f2-40a3-b52e-6203a76f02c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:34.655471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-343b48c0-55f2-40a3-b52e-6203a76f02c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.719518 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-343b48c0-55f2-40a3-b52e-6203a76f02c8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.093406 Jan 22 21:11:34.720998 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2032/3893] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:34 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:34.726243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2c568e43-4fe3-46c0-8067-0e226d006094 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:34.727525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2c568e43-4fe3-46c0-8067-0e226d006094 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:34.735925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c568e43-4fe3-46c0-8067-0e226d006094 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:34.736426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c568e43-4fe3-46c0-8067-0e226d006094 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.737434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c568e43-4fe3-46c0-8067-0e226d006094 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:34.738078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c568e43-4fe3-46c0-8067-0e226d006094 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:34.783393 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2c568e43-4fe3-46c0-8067-0e226d006094 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.060683 Jan 22 21:11:34.785560 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2033/3894] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:34 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:34.999221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a1d34247-6253-4ea8-b864-de7cefcd6109 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:35.016955 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a1d34247-6253-4ea8-b864-de7cefcd6109 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.438760 Jan 22 21:11:35.019527 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1862/3895] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:34 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:35.043601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0473f6af-6c7c-4f13-a71b-835da4196800 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:35.044169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0473f6af-6c7c-4f13-a71b-835da4196800 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: c849f84f-c1df-4905-8247-2d75dfdcde98] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:35.052125 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-0473f6af-6c7c-4f13-a71b-835da4196800 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance c849f84f-c1df-4905-8247-2d75dfdcde98 could not be found. Jan 22 21:11:35.052970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0473f6af-6c7c-4f13-a71b-835da4196800 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance c849f84f-c1df-4905-8247-2d75dfdcde98 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:11:35.054156 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0473f6af-6c7c-4f13-a71b-835da4196800 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/c849f84f-c1df-4905-8247-2d75dfdcde98/action" status: 404 len: 111 microversion: 2.1 time: 0.016316 Jan 22 21:11:35.055050 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2034/3896] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:35 2022] POST /compute/v2.1/servers/c849f84f-c1df-4905-8247-2d75dfdcde98/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:11:35.065594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-66116858-fbd8-460e-9341-36485960598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:35.066530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-66116858-fbd8-460e-9341-36485960598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:35.075387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66116858-fbd8-460e-9341-36485960598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.076143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66116858-fbd8-460e-9341-36485960598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.077117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66116858-fbd8-460e-9341-36485960598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.077991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66116858-fbd8-460e-9341-36485960598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.151048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-05d2957b-c928-470f-b658-3ae493b92353 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:35.151903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-05d2957b-c928-470f-b658-3ae493b92353 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:35.160095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05d2957b-c928-470f-b658-3ae493b92353 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.160555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05d2957b-c928-470f-b658-3ae493b92353 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.161362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05d2957b-c928-470f-b658-3ae493b92353 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.161857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05d2957b-c928-470f-b658-3ae493b92353 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.335478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-05d2957b-c928-470f-b658-3ae493b92353 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:35.344849 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-05d2957b-c928-470f-b658-3ae493b92353 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1531 microversion: 2.1 time: 0.197650 Jan 22 21:11:35.345433 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2035/3897] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:35 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1531 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:35.350555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-66116858-fbd8-460e-9341-36485960598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:35.350962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-98a20995-9545-4d13-a7aa-0a9421637b94 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:35.351590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-98a20995-9545-4d13-a7aa-0a9421637b94 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:35.360049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98a20995-9545-4d13-a7aa-0a9421637b94 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.360517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98a20995-9545-4d13-a7aa-0a9421637b94 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.361016 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-66116858-fbd8-460e-9341-36485960598e tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.300007 Jan 22 21:11:35.361328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98a20995-9545-4d13-a7aa-0a9421637b94 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.366746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98a20995-9545-4d13-a7aa-0a9421637b94 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.366899 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1863/3898] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:35 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:35.368222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff4a69af-60c9-4bdf-bee1-dd8612184b58 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:35.369047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ff4a69af-60c9-4bdf-bee1-dd8612184b58 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:35.382489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff4a69af-60c9-4bdf-bee1-dd8612184b58 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.382954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff4a69af-60c9-4bdf-bee1-dd8612184b58 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.383770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff4a69af-60c9-4bdf-bee1-dd8612184b58 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.384353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff4a69af-60c9-4bdf-bee1-dd8612184b58 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.530744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-98a20995-9545-4d13-a7aa-0a9421637b94 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:35.533981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ff4a69af-60c9-4bdf-bee1-dd8612184b58 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:35.538402 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-98a20995-9545-4d13-a7aa-0a9421637b94 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1313 microversion: 2.1 time: 0.191918 Jan 22 21:11:35.538982 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2036/3899] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:35 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:35.544389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c639268e-813c-4063-80be-1ffd353b489e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:35.544987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c639268e-813c-4063-80be-1ffd353b489e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:35.550673 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff4a69af-60c9-4bdf-bee1-dd8612184b58 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.187409 Jan 22 21:11:35.550822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c639268e-813c-4063-80be-1ffd353b489e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.551171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c639268e-813c-4063-80be-1ffd353b489e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.551502 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1864/3900] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:35 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:35.551984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c639268e-813c-4063-80be-1ffd353b489e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.552453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c639268e-813c-4063-80be-1ffd353b489e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.558528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-43b653fa-9064-44d2-9fda-1622b7927a0b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:35.559247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-43b653fa-9064-44d2-9fda-1622b7927a0b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:35.565260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43b653fa-9064-44d2-9fda-1622b7927a0b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.565831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43b653fa-9064-44d2-9fda-1622b7927a0b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.566719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43b653fa-9064-44d2-9fda-1622b7927a0b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.567234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43b653fa-9064-44d2-9fda-1622b7927a0b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.712178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c639268e-813c-4063-80be-1ffd353b489e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:35.721124 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c639268e-813c-4063-80be-1ffd353b489e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1531 microversion: 2.1 time: 0.181145 Jan 22 21:11:35.721755 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2037/3901] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:35 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1531 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:35.726291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7a59fa60-5a38-47a3-8ed3-11923e25a87d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:35.726936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7a59fa60-5a38-47a3-8ed3-11923e25a87d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:35.733781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a59fa60-5a38-47a3-8ed3-11923e25a87d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.734396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a59fa60-5a38-47a3-8ed3-11923e25a87d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.736026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a59fa60-5a38-47a3-8ed3-11923e25a87d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.737346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a59fa60-5a38-47a3-8ed3-11923e25a87d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.743215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-43b653fa-9064-44d2-9fda-1622b7927a0b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:35.748191 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-43b653fa-9064-44d2-9fda-1622b7927a0b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.195647 Jan 22 21:11:35.748984 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1865/3902] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:35 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:35.753569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-438653d7-0a2d-446e-94e0-5c34604a23ad tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:35.754477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-438653d7-0a2d-446e-94e0-5c34604a23ad tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:35.760879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-438653d7-0a2d-446e-94e0-5c34604a23ad tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.761331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-438653d7-0a2d-446e-94e0-5c34604a23ad tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.766355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-438653d7-0a2d-446e-94e0-5c34604a23ad tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.766355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-438653d7-0a2d-446e-94e0-5c34604a23ad tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.808288 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-438653d7-0a2d-446e-94e0-5c34604a23ad tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.058249 Jan 22 21:11:35.808957 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1866/3903] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:35 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:35.815128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f8517ab4-dcc6-466e-9fcb-fb5322baf617 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:35.823087 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:35.823087 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:11:35.823617 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-f8517ab4-dcc6-466e-9fcb-fb5322baf617 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] HTTP exception thrown: Flavor 2531b960-168c-4722-ae27-7b97abf976c9 could not be found. Jan 22 21:11:35.824393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f8517ab4-dcc6-466e-9fcb-fb5322baf617 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Returning 404 to user: Flavor 2531b960-168c-4722-ae27-7b97abf976c9 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:11:35.825491 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f8517ab4-dcc6-466e-9fcb-fb5322baf617 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/2531b960-168c-4722-ae27-7b97abf976c9" status: 404 len: 109 microversion: 2.1 time: 0.015137 Jan 22 21:11:35.829376 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1867/3904] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:11:35 2022] DELETE /compute/v2.1/flavors/2531b960-168c-4722-ae27-7b97abf976c9 => generated 109 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:11:35.831363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b0957f53-e88c-43bf-b5f6-82771966961d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:35.832011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b0957f53-e88c-43bf-b5f6-82771966961d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:35.852615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0957f53-e88c-43bf-b5f6-82771966961d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.855086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0957f53-e88c-43bf-b5f6-82771966961d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.857999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0957f53-e88c-43bf-b5f6-82771966961d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.858707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0957f53-e88c-43bf-b5f6-82771966961d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.893683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-b0957f53-e88c-43bf-b5f6-82771966961d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lazy-loading 'flavor' on Instance uuid 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:11:35.931365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7a59fa60-5a38-47a3-8ed3-11923e25a87d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:35.941810 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7a59fa60-5a38-47a3-8ed3-11923e25a87d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1317 microversion: 2.1 time: 0.218931 Jan 22 21:11:35.952506 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2038/3905] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:35 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:35.958152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-534157eb-3037-4e0f-b935-bf64fe61ff71 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:35.959435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-534157eb-3037-4e0f-b935-bf64fe61ff71 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:35.967011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-534157eb-3037-4e0f-b935-bf64fe61ff71 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.967634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-534157eb-3037-4e0f-b935-bf64fe61ff71 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:35.968553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-534157eb-3037-4e0f-b935-bf64fe61ff71 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:35.969107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-534157eb-3037-4e0f-b935-bf64fe61ff71 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:36.010094 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-534157eb-3037-4e0f-b935-bf64fe61ff71 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.055651 Jan 22 21:11:36.011148 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2039/3906] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:35 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:36.016308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-53140728", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:36.073699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:11:36.258475 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b0957f53-e88c-43bf-b5f6-82771966961d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action" status: 202 len: 0 microversion: 2.1 time: 0.430834 Jan 22 21:11:36.259300 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1868/3907] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:35 2022] POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:36.265374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-46e5d002-ed3e-46e1-be76-36b772f76a40 req-f6ffaa08-1a25-4b47-921a-cebcbe053e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfc70ea-429f-48ac-b11d-d720aa0130d6", "name": "network-vif-plugged", "status": "completed", "tag": "d9f0f206-48d8-436d-8afd-c78217567334"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:36.267423 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:36.267423 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:11:36.276557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-46e5d002-ed3e-46e1-be76-36b772f76a40 req-f6ffaa08-1a25-4b47-921a-cebcbe053e00 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:36.277928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-46e5d002-ed3e-46e1-be76-36b772f76a40 req-f6ffaa08-1a25-4b47-921a-cebcbe053e00 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:36.294084 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-46e5d002-ed3e-46e1-be76-36b772f76a40 req-f6ffaa08-1a25-4b47-921a-cebcbe053e00 service nova] Creating event network-vif-plugged:d9f0f206-48d8-436d-8afd-c78217567334 for instance 2dfc70ea-429f-48ac-b11d-d720aa0130d6 on nch1-master-1 Jan 22 21:11:36.299533 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-46e5d002-ed3e-46e1-be76-36b772f76a40 req-f6ffaa08-1a25-4b47-921a-cebcbe053e00 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038248 Jan 22 21:11:36.304994 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1869/3908] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:36.306025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-596d1387-0807-45b1-8adb-fd70c12ab544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:36.318365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-596d1387-0807-45b1-8adb-fd70c12ab544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:36.336279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-596d1387-0807-45b1-8adb-fd70c12ab544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:36.336877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-596d1387-0807-45b1-8adb-fd70c12ab544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:36.337812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-596d1387-0807-45b1-8adb-fd70c12ab544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:36.338382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-596d1387-0807-45b1-8adb-fd70c12ab544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:36.404094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:11:36.404532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:11:36.405059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:11:36.405684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:11:36.406271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:11:36.415380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:36.415878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:36.417254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:36.417733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:36.436148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Getting quotas for project 80dba854f5414025a0cbf8b5d6571c42. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:11:36.441336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Getting quotas for user 7f8e9e562bd740e782568f539dac4744 and project 80dba854f5414025a0cbf8b5d6571c42. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:11:36.454496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:11:36.457110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:11:36.553329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-596d1387-0807-45b1-8adb-fd70c12ab544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:36.561646 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-596d1387-0807-45b1-8adb-fd70c12ab544 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1517 microversion: 2.1 time: 0.260059 Jan 22 21:11:36.562514 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1870/3909] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:36 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1517 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:36.567762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2e97eecf-2d2f-438b-b8e1-b2ebdbc7c2bc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:36.568485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2e97eecf-2d2f-438b-b8e1-b2ebdbc7c2bc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:36.574753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e97eecf-2d2f-438b-b8e1-b2ebdbc7c2bc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:36.575201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e97eecf-2d2f-438b-b8e1-b2ebdbc7c2bc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:36.576032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e97eecf-2d2f-438b-b8e1-b2ebdbc7c2bc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:36.576474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e97eecf-2d2f-438b-b8e1-b2ebdbc7c2bc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:36.614440 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ce8ad04c-6353-45b8-b658-8e3b616641ad tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.602082 Jan 22 21:11:36.615485 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2040/3910] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:11:36 2022] POST /compute/v2.1/servers => generated 382 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:11:36.621821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-71774678-f92a-43fd-88ff-db9112271a7c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:36.622279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-71774678-f92a-43fd-88ff-db9112271a7c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:36.628821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71774678-f92a-43fd-88ff-db9112271a7c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:36.629559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71774678-f92a-43fd-88ff-db9112271a7c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:36.630455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71774678-f92a-43fd-88ff-db9112271a7c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:36.630983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71774678-f92a-43fd-88ff-db9112271a7c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:36.743561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2e97eecf-2d2f-438b-b8e1-b2ebdbc7c2bc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:36.752455 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2e97eecf-2d2f-438b-b8e1-b2ebdbc7c2bc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1313 microversion: 2.1 time: 0.188288 Jan 22 21:11:36.762934 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1871/3911] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:36 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:36.768287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b183222b-49a8-47c7-ad95-0e75c706eae5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:36.769126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b183222b-49a8-47c7-ad95-0e75c706eae5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:36.825818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b183222b-49a8-47c7-ad95-0e75c706eae5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:36.834489 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b183222b-49a8-47c7-ad95-0e75c706eae5 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1215 microversion: 2.1 time: 0.070154 Jan 22 21:11:36.835242 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1872/3912] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:36 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:36.835674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-71774678-f92a-43fd-88ff-db9112271a7c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:36.841084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff90080b-9deb-4d95-9388-192263c3a9cc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:36.843398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ff90080b-9deb-4d95-9388-192263c3a9cc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:36.849284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff90080b-9deb-4d95-9388-192263c3a9cc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:36.849864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff90080b-9deb-4d95-9388-192263c3a9cc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:36.850755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff90080b-9deb-4d95-9388-192263c3a9cc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:36.851270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff90080b-9deb-4d95-9388-192263c3a9cc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:36.851539 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-71774678-f92a-43fd-88ff-db9112271a7c tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.234364 Jan 22 21:11:36.852689 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2041/3913] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:36 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:36.905106 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff90080b-9deb-4d95-9388-192263c3a9cc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.063663 Jan 22 21:11:36.905106 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1873/3914] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:36 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:36.959530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9cf46f5c-eacb-444c-9493-4727d98a25ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:36.960280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9cf46f5c-eacb-444c-9493-4727d98a25ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:36.967291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cf46f5c-eacb-444c-9493-4727d98a25ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:36.967825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cf46f5c-eacb-444c-9493-4727d98a25ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:36.968621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cf46f5c-eacb-444c-9493-4727d98a25ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:36.969099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cf46f5c-eacb-444c-9493-4727d98a25ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:37.023022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4629c009-21d6-410e-ab5d-8833a30303a3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:37.024032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4629c009-21d6-410e-ab5d-8833a30303a3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:37.031814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4629c009-21d6-410e-ab5d-8833a30303a3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:37.032277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4629c009-21d6-410e-ab5d-8833a30303a3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:37.033076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4629c009-21d6-410e-ab5d-8833a30303a3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:37.033545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4629c009-21d6-410e-ab5d-8833a30303a3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:37.080677 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4629c009-21d6-410e-ab5d-8833a30303a3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.061777 Jan 22 21:11:37.081612 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1874/3915] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:37 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:11:37.143522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9cf46f5c-eacb-444c-9493-4727d98a25ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:37.152370 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9cf46f5c-eacb-444c-9493-4727d98a25ca tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1317 microversion: 2.1 time: 0.196216 Jan 22 21:11:37.154879 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2042/3916] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:36 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:37.585147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8bd2698d-04be-4409-803f-ef954f3b3239 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:37.585897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8bd2698d-04be-4409-803f-ef954f3b3239 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:37.594611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bd2698d-04be-4409-803f-ef954f3b3239 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:37.595252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bd2698d-04be-4409-803f-ef954f3b3239 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:37.596450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bd2698d-04be-4409-803f-ef954f3b3239 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:37.596909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bd2698d-04be-4409-803f-ef954f3b3239 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:37.773525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-728e41fe-9aa9-4934-bfb5-abf35bd6c237 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:37.774290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-728e41fe-9aa9-4934-bfb5-abf35bd6c237 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:37.784425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-728e41fe-9aa9-4934-bfb5-abf35bd6c237 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:37.785048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-728e41fe-9aa9-4934-bfb5-abf35bd6c237 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:37.786528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-728e41fe-9aa9-4934-bfb5-abf35bd6c237 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:37.787204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-728e41fe-9aa9-4934-bfb5-abf35bd6c237 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:37.795508 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8bd2698d-04be-4409-803f-ef954f3b3239 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:37.804696 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8bd2698d-04be-4409-803f-ef954f3b3239 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1500 microversion: 2.1 time: 0.225596 Jan 22 21:11:37.805973 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1875/3917] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:37 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1500 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:37.826471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5362c803-1596-44df-8e41-ff9bd28b6097 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:37.827285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5362c803-1596-44df-8e41-ff9bd28b6097 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:37.835803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5362c803-1596-44df-8e41-ff9bd28b6097 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:37.836902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5362c803-1596-44df-8e41-ff9bd28b6097 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:37.838962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5362c803-1596-44df-8e41-ff9bd28b6097 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:37.839759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5362c803-1596-44df-8e41-ff9bd28b6097 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:37.890390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-5362c803-1596-44df-8e41-ff9bd28b6097 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lazy-loading 'flavor' on Instance uuid 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:11:37.927201 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-5362c803-1596-44df-8e41-ff9bd28b6097 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Cannot 'suspend' instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 while it is in vm_state suspended Jan 22 21:11:37.927830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5362c803-1596-44df-8e41-ff9bd28b6097 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 409 to user: Cannot 'suspend' instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 while it is in vm_state suspended {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:11:37.928689 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5362c803-1596-44df-8e41-ff9bd28b6097 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action" status: 409 len: 148 microversion: 2.1 time: 0.108449 Jan 22 21:11:37.929297 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1876/3918] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:37 2022] POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action => generated 148 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:11:37.937287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab4a3b93-fabd-42be-9e1a-442b5d9b90e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:37.937287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab4a3b93-fabd-42be-9e1a-442b5d9b90e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:37.948577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab4a3b93-fabd-42be-9e1a-442b5d9b90e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:37.949067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab4a3b93-fabd-42be-9e1a-442b5d9b90e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:37.950606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab4a3b93-fabd-42be-9e1a-442b5d9b90e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:37.951233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab4a3b93-fabd-42be-9e1a-442b5d9b90e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.023120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab4a3b93-fabd-42be-9e1a-442b5d9b90e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:38.032302 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab4a3b93-fabd-42be-9e1a-442b5d9b90e9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1219 microversion: 2.1 time: 0.101697 Jan 22 21:11:38.033726 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1877/3919] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:37 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:38.039627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee6296b5-637f-4bf0-8d22-a3765baa90e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:38.040633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ee6296b5-637f-4bf0-8d22-a3765baa90e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:38.059588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-728e41fe-9aa9-4934-bfb5-abf35bd6c237 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:38.060809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee6296b5-637f-4bf0-8d22-a3765baa90e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.061476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee6296b5-637f-4bf0-8d22-a3765baa90e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.062650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee6296b5-637f-4bf0-8d22-a3765baa90e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.065796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee6296b5-637f-4bf0-8d22-a3765baa90e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.079081 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-728e41fe-9aa9-4934-bfb5-abf35bd6c237 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1313 microversion: 2.1 time: 0.309066 Jan 22 21:11:38.094859 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2043/3920] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:37 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:38.110060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7964bdfe-f4da-487a-94c2-fd0fe410667e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:38.111610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7964bdfe-f4da-487a-94c2-fd0fe410667e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:38.120901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7964bdfe-f4da-487a-94c2-fd0fe410667e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.121906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7964bdfe-f4da-487a-94c2-fd0fe410667e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.123579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7964bdfe-f4da-487a-94c2-fd0fe410667e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.125069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7964bdfe-f4da-487a-94c2-fd0fe410667e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.189803 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7964bdfe-f4da-487a-94c2-fd0fe410667e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.091887 Jan 22 21:11:38.191973 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2044/3921] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:38 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:38.203675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d17421b-d6fc-4536-aa2b-5b8c51475ee5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:38.216230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d17421b-d6fc-4536-aa2b-5b8c51475ee5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:38.216230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d17421b-d6fc-4536-aa2b-5b8c51475ee5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.216230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d17421b-d6fc-4536-aa2b-5b8c51475ee5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.216230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d17421b-d6fc-4536-aa2b-5b8c51475ee5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.217363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d17421b-d6fc-4536-aa2b-5b8c51475ee5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.305754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ee6296b5-637f-4bf0-8d22-a3765baa90e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:38.315324 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee6296b5-637f-4bf0-8d22-a3765baa90e0 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.279463 Jan 22 21:11:38.316623 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1878/3922] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:38 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:38.323432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a624843e-9816-44d6-8837-b549a682c772 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:38.324947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a624843e-9816-44d6-8837-b549a682c772 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:38.332005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a624843e-9816-44d6-8837-b549a682c772 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.332594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a624843e-9816-44d6-8837-b549a682c772 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.333662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a624843e-9816-44d6-8837-b549a682c772 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.334201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a624843e-9816-44d6-8837-b549a682c772 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.389960 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a624843e-9816-44d6-8837-b549a682c772 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.066246 Jan 22 21:11:38.390892 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1879/3923] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:38 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:38.396768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9b60be40-f947-4247-b9bd-71df3d18a71b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:38.397871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9b60be40-f947-4247-b9bd-71df3d18a71b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:38.405725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b60be40-f947-4247-b9bd-71df3d18a71b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.406172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b60be40-f947-4247-b9bd-71df3d18a71b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.407009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b60be40-f947-4247-b9bd-71df3d18a71b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.407449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b60be40-f947-4247-b9bd-71df3d18a71b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.502320 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d17421b-d6fc-4536-aa2b-5b8c51475ee5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action" status: 202 len: 0 microversion: 2.1 time: 0.306455 Jan 22 21:11:38.509161 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2045/3924] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:38 2022] POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:38.509161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-8b371a14-790a-46c3-8f9d-2a48d3880296 req-596acaa2-52b1-4f01-9375-3e715052648d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40cd339-38cd-40f4-a4e5-0b220e363df8", "name": "network-vif-plugged", "status": "completed", "tag": "8c94703f-c59c-42e5-b507-01dab2c8cb70"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:38.509656 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:38.509656 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:11:38.517775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8b371a14-790a-46c3-8f9d-2a48d3880296 req-596acaa2-52b1-4f01-9375-3e715052648d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.518233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8b371a14-790a-46c3-8f9d-2a48d3880296 req-596acaa2-52b1-4f01-9375-3e715052648d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.531179 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-8b371a14-790a-46c3-8f9d-2a48d3880296 req-596acaa2-52b1-4f01-9375-3e715052648d service nova] Creating event network-vif-plugged:8c94703f-c59c-42e5-b507-01dab2c8cb70 for instance a40cd339-38cd-40f4-a4e5-0b220e363df8 on nch2-master-1 Jan 22 21:11:38.536250 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-8b371a14-790a-46c3-8f9d-2a48d3880296 req-596acaa2-52b1-4f01-9375-3e715052648d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031995 Jan 22 21:11:38.536859 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2046/3925] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:38.542345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f62dd744-8210-4b85-b221-efabf4d5026f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:38.543131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f62dd744-8210-4b85-b221-efabf4d5026f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:38.549800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f62dd744-8210-4b85-b221-efabf4d5026f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.550266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f62dd744-8210-4b85-b221-efabf4d5026f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.551073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f62dd744-8210-4b85-b221-efabf4d5026f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.551524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f62dd744-8210-4b85-b221-efabf4d5026f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.573182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9b60be40-f947-4247-b9bd-71df3d18a71b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:38.573182 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9b60be40-f947-4247-b9bd-71df3d18a71b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1503 microversion: 2.1 time: 0.175468 Jan 22 21:11:38.573182 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1880/3926] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:38 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:38.588751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3fdcefa9-ba55-4e6e-8557-415ee5752269 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:38.589730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3fdcefa9-ba55-4e6e-8557-415ee5752269 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:38.599754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fdcefa9-ba55-4e6e-8557-415ee5752269 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.599754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fdcefa9-ba55-4e6e-8557-415ee5752269 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.599754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fdcefa9-ba55-4e6e-8557-415ee5752269 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.599754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fdcefa9-ba55-4e6e-8557-415ee5752269 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.631491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-3fdcefa9-ba55-4e6e-8557-415ee5752269 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lazy-loading 'flavor' on Instance uuid 2dfc70ea-429f-48ac-b11d-d720aa0130d6 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:11:38.810504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f62dd744-8210-4b85-b221-efabf4d5026f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:38.811603 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f62dd744-8210-4b85-b221-efabf4d5026f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1506 microversion: 2.1 time: 0.273350 Jan 22 21:11:38.812249 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2047/3927] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:38 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:38.935820 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3fdcefa9-ba55-4e6e-8557-415ee5752269 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "POST /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6/action" status: 200 len: 32 microversion: 2.1 time: 0.350473 Jan 22 21:11:38.936740 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1881/3928] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:38 2022] POST /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6/action => generated 32 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:11:38.946037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0e4c42fe-d124-4683-80c6-8ea2dfbfc787 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:38.947275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0e4c42fe-d124-4683-80c6-8ea2dfbfc787 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:38.962869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e4c42fe-d124-4683-80c6-8ea2dfbfc787 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.962869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e4c42fe-d124-4683-80c6-8ea2dfbfc787 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:38.964321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e4c42fe-d124-4683-80c6-8ea2dfbfc787 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:38.964931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e4c42fe-d124-4683-80c6-8ea2dfbfc787 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:39.053394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3eab812c-53f1-4ce6-8003-9bba3c4d1525 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:39.054389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3eab812c-53f1-4ce6-8003-9bba3c4d1525 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:39.062406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3eab812c-53f1-4ce6-8003-9bba3c4d1525 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:39.062866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3eab812c-53f1-4ce6-8003-9bba3c4d1525 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:39.063776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3eab812c-53f1-4ce6-8003-9bba3c4d1525 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:39.064399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3eab812c-53f1-4ce6-8003-9bba3c4d1525 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:39.120678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0e4c42fe-d124-4683-80c6-8ea2dfbfc787 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:39.132039 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0e4c42fe-d124-4683-80c6-8ea2dfbfc787 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.190130 Jan 22 21:11:39.132628 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2048/3929] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:38 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:39.139053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1a5da44a-9fb5-41b7-b21c-6d8ea7ade792 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:39.139901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1a5da44a-9fb5-41b7-b21c-6d8ea7ade792 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:39.146338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a5da44a-9fb5-41b7-b21c-6d8ea7ade792 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:39.146795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a5da44a-9fb5-41b7-b21c-6d8ea7ade792 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:39.147696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a5da44a-9fb5-41b7-b21c-6d8ea7ade792 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:39.148138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a5da44a-9fb5-41b7-b21c-6d8ea7ade792 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:39.182389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3eab812c-53f1-4ce6-8003-9bba3c4d1525 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:39.190873 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3eab812c-53f1-4ce6-8003-9bba3c4d1525 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1275 microversion: 2.1 time: 0.141832 Jan 22 21:11:39.204683 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1882/3930] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:39 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:39.211022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-414cbe7d-a471-48b2-a0e9-b7e34f67fd96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:39.212186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-414cbe7d-a471-48b2-a0e9-b7e34f67fd96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:39.219195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-414cbe7d-a471-48b2-a0e9-b7e34f67fd96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:39.219896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-414cbe7d-a471-48b2-a0e9-b7e34f67fd96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:39.220701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-414cbe7d-a471-48b2-a0e9-b7e34f67fd96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:39.221201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-414cbe7d-a471-48b2-a0e9-b7e34f67fd96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:39.271329 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-414cbe7d-a471-48b2-a0e9-b7e34f67fd96 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.064699 Jan 22 21:11:39.272537 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1883/3931] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:39 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:39.302415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1a5da44a-9fb5-41b7-b21c-6d8ea7ade792 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:39.311637 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1a5da44a-9fb5-41b7-b21c-6d8ea7ade792 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1313 microversion: 2.1 time: 0.177678 Jan 22 21:11:39.318060 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2049/3932] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:39 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:39.334463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dca74f3a-3dea-4885-b8ad-4968c73a9eb4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:39.336508 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dca74f3a-3dea-4885-b8ad-4968c73a9eb4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:39.342689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dca74f3a-3dea-4885-b8ad-4968c73a9eb4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:39.343355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dca74f3a-3dea-4885-b8ad-4968c73a9eb4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:39.344340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dca74f3a-3dea-4885-b8ad-4968c73a9eb4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:39.344936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dca74f3a-3dea-4885-b8ad-4968c73a9eb4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:39.407102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cd9227e0-e56e-4204-b648-3aecd7c7e975 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:39.408083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cd9227e0-e56e-4204-b648-3aecd7c7e975 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:39.414206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd9227e0-e56e-4204-b648-3aecd7c7e975 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:39.414669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd9227e0-e56e-4204-b648-3aecd7c7e975 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:39.415558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd9227e0-e56e-4204-b648-3aecd7c7e975 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:39.415910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd9227e0-e56e-4204-b648-3aecd7c7e975 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:39.468399 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cd9227e0-e56e-4204-b648-3aecd7c7e975 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.064728 Jan 22 21:11:39.469546 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2050/3933] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:39 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:11:39.830340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c31ac77a-9b80-4782-ab9b-0ab3029aec20 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:39.831177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c31ac77a-9b80-4782-ab9b-0ab3029aec20 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:39.839539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c31ac77a-9b80-4782-ab9b-0ab3029aec20 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:39.852582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c31ac77a-9b80-4782-ab9b-0ab3029aec20 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:39.852582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c31ac77a-9b80-4782-ab9b-0ab3029aec20 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:39.852582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c31ac77a-9b80-4782-ab9b-0ab3029aec20 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:39.874502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dca74f3a-3dea-4885-b8ad-4968c73a9eb4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:39.909366 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dca74f3a-3dea-4885-b8ad-4968c73a9eb4 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.577248 Jan 22 21:11:39.910376 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1884/3934] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:39 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:40.041712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c31ac77a-9b80-4782-ab9b-0ab3029aec20 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:40.049260 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c31ac77a-9b80-4782-ab9b-0ab3029aec20 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1506 microversion: 2.1 time: 0.223818 Jan 22 21:11:40.049949 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2051/3935] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:39 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:40.151140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9e47c78f-e445-4510-869b-09694fb35892 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:40.152450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9e47c78f-e445-4510-869b-09694fb35892 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:40.159445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e47c78f-e445-4510-869b-09694fb35892 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:40.159912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e47c78f-e445-4510-869b-09694fb35892 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:40.160717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e47c78f-e445-4510-869b-09694fb35892 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:40.161168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e47c78f-e445-4510-869b-09694fb35892 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:40.213708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-90982d93-0610-44fb-b6ee-fc0d076b9c0f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:40.215034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-90982d93-0610-44fb-b6ee-fc0d076b9c0f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:40.223419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90982d93-0610-44fb-b6ee-fc0d076b9c0f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:40.224193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90982d93-0610-44fb-b6ee-fc0d076b9c0f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:40.225681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90982d93-0610-44fb-b6ee-fc0d076b9c0f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:40.226306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90982d93-0610-44fb-b6ee-fc0d076b9c0f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:40.294430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-90982d93-0610-44fb-b6ee-fc0d076b9c0f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:40.302058 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-90982d93-0610-44fb-b6ee-fc0d076b9c0f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1273 microversion: 2.1 time: 0.095072 Jan 22 21:11:40.302635 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2052/3936] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:40 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:40.312663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c9b96f2f-6f52-4e66-b9d7-f7e0ec6ec719 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:40.312663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c9b96f2f-6f52-4e66-b9d7-f7e0ec6ec719 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:40.315238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9b96f2f-6f52-4e66-b9d7-f7e0ec6ec719 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:40.315791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9b96f2f-6f52-4e66-b9d7-f7e0ec6ec719 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:40.316688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9b96f2f-6f52-4e66-b9d7-f7e0ec6ec719 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:40.317249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9b96f2f-6f52-4e66-b9d7-f7e0ec6ec719 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:40.367440 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c9b96f2f-6f52-4e66-b9d7-f7e0ec6ec719 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.063491 Jan 22 21:11:40.368316 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2053/3937] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:40 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:40.374019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c7ed3ece-5fe9-47ce-8b39-a499a9cf7bee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:40.374777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c7ed3ece-5fe9-47ce-8b39-a499a9cf7bee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:40.383303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7ed3ece-5fe9-47ce-8b39-a499a9cf7bee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:40.383717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7ed3ece-5fe9-47ce-8b39-a499a9cf7bee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:40.385540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7ed3ece-5fe9-47ce-8b39-a499a9cf7bee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:40.385943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7ed3ece-5fe9-47ce-8b39-a499a9cf7bee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:40.422701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9e47c78f-e445-4510-869b-09694fb35892 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:40.431201 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9e47c78f-e445-4510-869b-09694fb35892 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.284547 Jan 22 21:11:40.432521 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1885/3938] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:40 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:40.483734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e978818f-52a7-4dd7-a31a-825922a10426 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:40.485971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e978818f-52a7-4dd7-a31a-825922a10426 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:40.495202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e978818f-52a7-4dd7-a31a-825922a10426 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:40.496303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e978818f-52a7-4dd7-a31a-825922a10426 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:40.497422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e978818f-52a7-4dd7-a31a-825922a10426 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:40.498043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e978818f-52a7-4dd7-a31a-825922a10426 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:40.552450 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e978818f-52a7-4dd7-a31a-825922a10426 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.074982 Jan 22 21:11:40.553995 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1886/3939] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:40 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:40.559266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-61681e63-973e-4025-ac7b-a72b200c0416 req-1121af64-86d7-416d-9d88-e2ce92128c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a45a6b1-24c6-4009-ad8f-6203f05d6777", "name": "network-vif-plugged", "status": "completed", "tag": "ac95681d-6279-428c-a0df-b7ba96ca5f3d"}, {"server_uuid": "6246ed48-9f22-4375-bb21-57f112060395", "name": "network-vif-plugged", "status": "completed", "tag": "42fdb3d7-e8e0-4810-b944-f6f9b2944b32"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:40.561012 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:40.561012 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:11:40.570350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-61681e63-973e-4025-ac7b-a72b200c0416 req-1121af64-86d7-416d-9d88-e2ce92128c43 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:40.570806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-61681e63-973e-4025-ac7b-a72b200c0416 req-1121af64-86d7-416d-9d88-e2ce92128c43 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:40.584503 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-61681e63-973e-4025-ac7b-a72b200c0416 req-1121af64-86d7-416d-9d88-e2ce92128c43 service nova] Creating event network-vif-plugged:ac95681d-6279-428c-a0df-b7ba96ca5f3d for instance 5a45a6b1-24c6-4009-ad8f-6203f05d6777 on nch2-master-1 Jan 22 21:11:40.585038 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-61681e63-973e-4025-ac7b-a72b200c0416 req-1121af64-86d7-416d-9d88-e2ce92128c43 service nova] Creating event network-vif-plugged:42fdb3d7-e8e0-4810-b944-f6f9b2944b32 for instance 6246ed48-9f22-4375-bb21-57f112060395 on nch1-master-1 Jan 22 21:11:40.594405 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-61681e63-973e-4025-ac7b-a72b200c0416 req-1121af64-86d7-416d-9d88-e2ce92128c43 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038810 Jan 22 21:11:40.595017 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1887/3940] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:40.601207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c7ed3ece-5fe9-47ce-8b39-a499a9cf7bee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:40.610356 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c7ed3ece-5fe9-47ce-8b39-a499a9cf7bee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1313 microversion: 2.1 time: 0.241086 Jan 22 21:11:40.611492 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2054/3941] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:40 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:40.929078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-56f8026b-3fb0-4bb9-9424-9ecae95455a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:40.929835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-56f8026b-3fb0-4bb9-9424-9ecae95455a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:40.943348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56f8026b-3fb0-4bb9-9424-9ecae95455a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:40.943993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56f8026b-3fb0-4bb9-9424-9ecae95455a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:40.944771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56f8026b-3fb0-4bb9-9424-9ecae95455a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:40.945396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56f8026b-3fb0-4bb9-9424-9ecae95455a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.068188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6cefccf0-b9ea-425a-bb02-c2b140a2d31b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:41.075841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6cefccf0-b9ea-425a-bb02-c2b140a2d31b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:41.093175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6cefccf0-b9ea-425a-bb02-c2b140a2d31b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.094770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6cefccf0-b9ea-425a-bb02-c2b140a2d31b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.096737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6cefccf0-b9ea-425a-bb02-c2b140a2d31b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.098374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6cefccf0-b9ea-425a-bb02-c2b140a2d31b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.141163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-56f8026b-3fb0-4bb9-9424-9ecae95455a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:41.148788 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-56f8026b-3fb0-4bb9-9424-9ecae95455a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.225944 Jan 22 21:11:41.149668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1888/3942] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:40 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:41.259664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6cefccf0-b9ea-425a-bb02-c2b140a2d31b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:41.268815 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6cefccf0-b9ea-425a-bb02-c2b140a2d31b tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.206474 Jan 22 21:11:41.269398 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2055/3943] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:41 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:41.286624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e11efca7-d5f8-40c0-bd52-7fb096bac776 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:41.287232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e11efca7-d5f8-40c0-bd52-7fb096bac776 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:41.294810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e11efca7-d5f8-40c0-bd52-7fb096bac776 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.295363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e11efca7-d5f8-40c0-bd52-7fb096bac776 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.296844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e11efca7-d5f8-40c0-bd52-7fb096bac776 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.297357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e11efca7-d5f8-40c0-bd52-7fb096bac776 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.319982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3c94cefa-d987-49ed-ba53-4daf6f6a7577 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:41.320849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3c94cefa-d987-49ed-ba53-4daf6f6a7577 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:41.329550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c94cefa-d987-49ed-ba53-4daf6f6a7577 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.330273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c94cefa-d987-49ed-ba53-4daf6f6a7577 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.331271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c94cefa-d987-49ed-ba53-4daf6f6a7577 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.331876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c94cefa-d987-49ed-ba53-4daf6f6a7577 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.518434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3c94cefa-d987-49ed-ba53-4daf6f6a7577 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:41.526775 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3c94cefa-d987-49ed-ba53-4daf6f6a7577 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1315 microversion: 2.1 time: 0.210516 Jan 22 21:11:41.527513 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2056/3944] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:41 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:41.532802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-70d08839-3383-492e-bd51-e1a1b55f6f01 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:41.535993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-70d08839-3383-492e-bd51-e1a1b55f6f01 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:41.540034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70d08839-3383-492e-bd51-e1a1b55f6f01 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.540518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70d08839-3383-492e-bd51-e1a1b55f6f01 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.541957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70d08839-3383-492e-bd51-e1a1b55f6f01 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.542392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70d08839-3383-492e-bd51-e1a1b55f6f01 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.585458 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-70d08839-3383-492e-bd51-e1a1b55f6f01 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.056505 Jan 22 21:11:41.586367 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2057/3945] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:41 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:41.591071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-05a728e7-8256-4f2f-88a7-eef911bdf5c5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:41.591763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-05a728e7-8256-4f2f-88a7-eef911bdf5c5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:41.595326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e11efca7-d5f8-40c0-bd52-7fb096bac776 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:41.598460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05a728e7-8256-4f2f-88a7-eef911bdf5c5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.599066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05a728e7-8256-4f2f-88a7-eef911bdf5c5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.600026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05a728e7-8256-4f2f-88a7-eef911bdf5c5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.600621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05a728e7-8256-4f2f-88a7-eef911bdf5c5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.605314 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e11efca7-d5f8-40c0-bd52-7fb096bac776 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.322160 Jan 22 21:11:41.606150 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1889/3946] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:41 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:41.611074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b9026e23-5d7f-4f98-b444-a17bf1be61ae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:41.612060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b9026e23-5d7f-4f98-b444-a17bf1be61ae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:41.618092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9026e23-5d7f-4f98-b444-a17bf1be61ae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.618778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9026e23-5d7f-4f98-b444-a17bf1be61ae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.620378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9026e23-5d7f-4f98-b444-a17bf1be61ae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.620997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9026e23-5d7f-4f98-b444-a17bf1be61ae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.663197 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b9026e23-5d7f-4f98-b444-a17bf1be61ae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.055629 Jan 22 21:11:41.663866 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1890/3947] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:41 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:41.670251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f0797245-6ee2-467b-9561-cde4af2dc6e6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:41.671162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f0797245-6ee2-467b-9561-cde4af2dc6e6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 3b12c9f1-32fa-4e66-85ca-e9d8c7fc000f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:41.678506 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-f0797245-6ee2-467b-9561-cde4af2dc6e6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance 3b12c9f1-32fa-4e66-85ca-e9d8c7fc000f could not be found. Jan 22 21:11:41.679040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f0797245-6ee2-467b-9561-cde4af2dc6e6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance 3b12c9f1-32fa-4e66-85ca-e9d8c7fc000f could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:11:41.679880 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f0797245-6ee2-467b-9561-cde4af2dc6e6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/3b12c9f1-32fa-4e66-85ca-e9d8c7fc000f/action" status: 404 len: 111 microversion: 2.1 time: 0.014744 Jan 22 21:11:41.680461 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1891/3948] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:41 2022] POST /compute/v2.1/servers/3b12c9f1-32fa-4e66-85ca-e9d8c7fc000f/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:11:41.686625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ef72e9eb-68aa-4cca-8c3a-e92e09b4fdb1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:41.687238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ef72e9eb-68aa-4cca-8c3a-e92e09b4fdb1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:41.696509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef72e9eb-68aa-4cca-8c3a-e92e09b4fdb1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.697359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef72e9eb-68aa-4cca-8c3a-e92e09b4fdb1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.698759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef72e9eb-68aa-4cca-8c3a-e92e09b4fdb1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.699355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef72e9eb-68aa-4cca-8c3a-e92e09b4fdb1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.802129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-05a728e7-8256-4f2f-88a7-eef911bdf5c5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:41.810118 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-05a728e7-8256-4f2f-88a7-eef911bdf5c5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.222646 Jan 22 21:11:41.810906 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2058/3949] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:41 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:41.816247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e673e559-909a-49bb-a533-0ce492286b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:41.816247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e673e559-909a-49bb-a533-0ce492286b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:41.821965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e673e559-909a-49bb-a533-0ce492286b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.822605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e673e559-909a-49bb-a533-0ce492286b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.823628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e673e559-909a-49bb-a533-0ce492286b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:41.824073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e673e559-909a-49bb-a533-0ce492286b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:41.849045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ef72e9eb-68aa-4cca-8c3a-e92e09b4fdb1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:41.858510 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ef72e9eb-68aa-4cca-8c3a-e92e09b4fdb1 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1313 microversion: 2.1 time: 0.176478 Jan 22 21:11:41.859088 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1892/3950] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:41 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:42.012376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e673e559-909a-49bb-a533-0ce492286b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:42.020984 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e673e559-909a-49bb-a533-0ce492286b32 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.208843 Jan 22 21:11:42.022057 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2059/3951] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:41 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:42.039690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b09f2f86-86c0-4978-a10c-85eb6bcda36d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:42.041755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b09f2f86-86c0-4978-a10c-85eb6bcda36d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:42.049182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b09f2f86-86c0-4978-a10c-85eb6bcda36d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.049799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b09f2f86-86c0-4978-a10c-85eb6bcda36d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.051821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b09f2f86-86c0-4978-a10c-85eb6bcda36d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.051821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b09f2f86-86c0-4978-a10c-85eb6bcda36d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.176514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0a23223f-5b16-476c-94c3-58359ce85c77 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:42.177337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0a23223f-5b16-476c-94c3-58359ce85c77 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:42.188064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a23223f-5b16-476c-94c3-58359ce85c77 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.188945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a23223f-5b16-476c-94c3-58359ce85c77 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.189968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a23223f-5b16-476c-94c3-58359ce85c77 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.190433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a23223f-5b16-476c-94c3-58359ce85c77 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.233075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b09f2f86-86c0-4978-a10c-85eb6bcda36d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:42.241335 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b09f2f86-86c0-4978-a10c-85eb6bcda36d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.205265 Jan 22 21:11:42.241949 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1893/3952] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:42 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:42.257468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a4e6e2fd-1780-419c-879b-9621ed756ba0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:42.258036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a4e6e2fd-1780-419c-879b-9621ed756ba0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:42.265012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4e6e2fd-1780-419c-879b-9621ed756ba0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.265725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4e6e2fd-1780-419c-879b-9621ed756ba0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.266713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4e6e2fd-1780-419c-879b-9621ed756ba0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.267384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4e6e2fd-1780-419c-879b-9621ed756ba0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.293016 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-a4e6e2fd-1780-419c-879b-9621ed756ba0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Cannot 'unpause' instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 while it is in vm_state active Jan 22 21:11:42.293703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a4e6e2fd-1780-419c-879b-9621ed756ba0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 409 to user: Cannot 'unpause' instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 while it is in vm_state active {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:11:42.294737 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a4e6e2fd-1780-419c-879b-9621ed756ba0 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action" status: 409 len: 145 microversion: 2.1 time: 0.041058 Jan 22 21:11:42.296152 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1894/3953] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:42 2022] POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action => generated 145 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 22 21:11:42.305532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-982744c8-ae51-4b65-8fe3-1ae8993929f6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:42.306155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-982744c8-ae51-4b65-8fe3-1ae8993929f6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:42.323053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-982744c8-ae51-4b65-8fe3-1ae8993929f6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.323763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-982744c8-ae51-4b65-8fe3-1ae8993929f6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.324811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-982744c8-ae51-4b65-8fe3-1ae8993929f6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.326338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-982744c8-ae51-4b65-8fe3-1ae8993929f6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.403392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0a23223f-5b16-476c-94c3-58359ce85c77 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:42.422704 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0a23223f-5b16-476c-94c3-58359ce85c77 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1326 microversion: 2.1 time: 0.252164 Jan 22 21:11:42.423370 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2060/3954] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:42 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1326 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:42.430586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-58b03fb6-0d7f-40aa-8769-2596f0ada6cb req-80daf306-bc99-440b-845d-c39188e6249d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc5d005-c458-46e9-87ee-b837034d76c7", "tag": "c8ca2591-f475-4a3e-8f6c-e2b56416c2cf"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:42.434654 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:42.434654 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:11:42.452447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-58b03fb6-0d7f-40aa-8769-2596f0ada6cb req-80daf306-bc99-440b-845d-c39188e6249d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.454329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-58b03fb6-0d7f-40aa-8769-2596f0ada6cb req-80daf306-bc99-440b-845d-c39188e6249d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.478149 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-58b03fb6-0d7f-40aa-8769-2596f0ada6cb req-80daf306-bc99-440b-845d-c39188e6249d service nova] Creating event network-changed:c8ca2591-f475-4a3e-8f6c-e2b56416c2cf for instance fcc5d005-c458-46e9-87ee-b837034d76c7 on nch2-master-1 Jan 22 21:11:42.485185 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-58b03fb6-0d7f-40aa-8769-2596f0ada6cb req-80daf306-bc99-440b-845d-c39188e6249d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060328 Jan 22 21:11:42.486001 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2061/3955] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:42.545653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ac600c5d-7ec2-430f-891d-4579c8b6e04f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:42.546436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ac600c5d-7ec2-430f-891d-4579c8b6e04f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:42.552977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac600c5d-7ec2-430f-891d-4579c8b6e04f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.553551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac600c5d-7ec2-430f-891d-4579c8b6e04f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.554567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac600c5d-7ec2-430f-891d-4579c8b6e04f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.555175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac600c5d-7ec2-430f-891d-4579c8b6e04f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.587547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-982744c8-ae51-4b65-8fe3-1ae8993929f6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:42.597671 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-982744c8-ae51-4b65-8fe3-1ae8993929f6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.296629 Jan 22 21:11:42.605634 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1895/3956] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:42 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:42.605634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-709e073f-0ee9-4f64-98cc-fecf53e2267c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:42.605634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-709e073f-0ee9-4f64-98cc-fecf53e2267c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:42.611730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-709e073f-0ee9-4f64-98cc-fecf53e2267c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.612199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-709e073f-0ee9-4f64-98cc-fecf53e2267c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.613022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-709e073f-0ee9-4f64-98cc-fecf53e2267c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.613466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-709e073f-0ee9-4f64-98cc-fecf53e2267c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.688687 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-709e073f-0ee9-4f64-98cc-fecf53e2267c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.088833 Jan 22 21:11:42.689342 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1896/3957] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:42 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:42.703593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ddbd8bab-7b48-49fa-8610-81362413cd1f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:42.705453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ddbd8bab-7b48-49fa-8610-81362413cd1f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:42.717655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddbd8bab-7b48-49fa-8610-81362413cd1f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.718633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddbd8bab-7b48-49fa-8610-81362413cd1f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.720406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddbd8bab-7b48-49fa-8610-81362413cd1f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.721321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddbd8bab-7b48-49fa-8610-81362413cd1f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.814659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ac600c5d-7ec2-430f-891d-4579c8b6e04f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:42.824342 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ac600c5d-7ec2-430f-891d-4579c8b6e04f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1315 microversion: 2.1 time: 0.283693 Jan 22 21:11:42.834259 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2062/3958] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:42 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:42.834259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-16b862f8-cecf-472e-be65-440eae48ad2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:42.834259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-16b862f8-cecf-472e-be65-440eae48ad2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:42.840990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16b862f8-cecf-472e-be65-440eae48ad2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.841464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16b862f8-cecf-472e-be65-440eae48ad2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.842311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16b862f8-cecf-472e-be65-440eae48ad2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.842759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16b862f8-cecf-472e-be65-440eae48ad2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.890534 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-16b862f8-cecf-472e-be65-440eae48ad2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.061541 Jan 22 21:11:42.894226 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2063/3959] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:42 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:42.896383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-42dd5c23-99e0-450f-9738-63bb04a6670e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:42.897123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-42dd5c23-99e0-450f-9738-63bb04a6670e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:42.904841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42dd5c23-99e0-450f-9738-63bb04a6670e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.905307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42dd5c23-99e0-450f-9738-63bb04a6670e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:42.906187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42dd5c23-99e0-450f-9738-63bb04a6670e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:42.906636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42dd5c23-99e0-450f-9738-63bb04a6670e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.001975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ddbd8bab-7b48-49fa-8610-81362413cd1f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:43.012048 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ddbd8bab-7b48-49fa-8610-81362413cd1f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.321171 Jan 22 21:11:43.023890 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1897/3960] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:42 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:43.028910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c61326e7-1fd5-449c-a494-19d7cab813c3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:43.029678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c61326e7-1fd5-449c-a494-19d7cab813c3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:43.035747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c61326e7-1fd5-449c-a494-19d7cab813c3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:43.036335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c61326e7-1fd5-449c-a494-19d7cab813c3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.037263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c61326e7-1fd5-449c-a494-19d7cab813c3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:43.037845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c61326e7-1fd5-449c-a494-19d7cab813c3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.053726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-42dd5c23-99e0-450f-9738-63bb04a6670e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:43.066628 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-42dd5c23-99e0-450f-9738-63bb04a6670e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.173184 Jan 22 21:11:43.068048 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2064/3961] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:42 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:43.073467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a5337abe-c83f-4378-8cc2-9922078b4c0f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:43.074085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a5337abe-c83f-4378-8cc2-9922078b4c0f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: d323100c-a59a-4b39-92b4-8c8217d0a03f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:43.080339 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-a5337abe-c83f-4378-8cc2-9922078b4c0f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance d323100c-a59a-4b39-92b4-8c8217d0a03f could not be found. Jan 22 21:11:43.081117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a5337abe-c83f-4378-8cc2-9922078b4c0f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance d323100c-a59a-4b39-92b4-8c8217d0a03f could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:11:43.082003 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a5337abe-c83f-4378-8cc2-9922078b4c0f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/d323100c-a59a-4b39-92b4-8c8217d0a03f/action" status: 404 len: 111 microversion: 2.1 time: 0.012638 Jan 22 21:11:43.082590 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2065/3962] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:43 2022] POST /compute/v2.1/servers/d323100c-a59a-4b39-92b4-8c8217d0a03f/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:11:43.097711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d459955a-ffbd-45c8-a0e8-0233ac9777f9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:43.098426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d459955a-ffbd-45c8-a0e8-0233ac9777f9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:43.106461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d459955a-ffbd-45c8-a0e8-0233ac9777f9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:43.107037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d459955a-ffbd-45c8-a0e8-0233ac9777f9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.113621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d459955a-ffbd-45c8-a0e8-0233ac9777f9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:43.113621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d459955a-ffbd-45c8-a0e8-0233ac9777f9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.256308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d459955a-ffbd-45c8-a0e8-0233ac9777f9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:43.265190 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d459955a-ffbd-45c8-a0e8-0233ac9777f9 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.171319 Jan 22 21:11:43.265792 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2066/3963] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:43 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:43.282589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9a0acd09-3185-43ca-9d36-239baf082139 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:43.288446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9a0acd09-3185-43ca-9d36-239baf082139 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:43.289321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a0acd09-3185-43ca-9d36-239baf082139 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:43.289826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a0acd09-3185-43ca-9d36-239baf082139 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.290636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a0acd09-3185-43ca-9d36-239baf082139 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:43.291120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a0acd09-3185-43ca-9d36-239baf082139 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.468550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9a0acd09-3185-43ca-9d36-239baf082139 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:43.476252 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9a0acd09-3185-43ca-9d36-239baf082139 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.197323 Jan 22 21:11:43.476827 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2067/3964] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:43 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:43.482292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c61326e7-1fd5-449c-a494-19d7cab813c3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:43.490189 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c61326e7-1fd5-449c-a494-19d7cab813c3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1493 microversion: 2.1 time: 0.465098 Jan 22 21:11:43.490946 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1898/3965] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:43 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1493 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:43.492036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-01ccaa3d-ffe3-4a72-a29f-28e24a9f3f9a tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:43.492798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-01ccaa3d-ffe3-4a72-a29f-28e24a9f3f9a tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:43.496343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-982612bf-151a-46cc-90ab-3692bba72af4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:43.496920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-982612bf-151a-46cc-90ab-3692bba72af4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:43.500634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01ccaa3d-ffe3-4a72-a29f-28e24a9f3f9a tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:43.501248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01ccaa3d-ffe3-4a72-a29f-28e24a9f3f9a tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.502148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01ccaa3d-ffe3-4a72-a29f-28e24a9f3f9a tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:43.502662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01ccaa3d-ffe3-4a72-a29f-28e24a9f3f9a tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.507576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-982612bf-151a-46cc-90ab-3692bba72af4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:43.507927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-982612bf-151a-46cc-90ab-3692bba72af4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.508748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-982612bf-151a-46cc-90ab-3692bba72af4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:43.509560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-982612bf-151a-46cc-90ab-3692bba72af4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.545808 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-982612bf-151a-46cc-90ab-3692bba72af4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Cannot 'unshelve' instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 while it is in vm_state active Jan 22 21:11:43.546725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-982612bf-151a-46cc-90ab-3692bba72af4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 409 to user: Cannot 'unshelve' instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 while it is in vm_state active {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:11:43.548039 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-982612bf-151a-46cc-90ab-3692bba72af4 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action" status: 409 len: 146 microversion: 2.1 time: 0.055961 Jan 22 21:11:43.548886 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1899/3966] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:43 2022] POST /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6/action => generated 146 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:11:43.555965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-42af9304-cf69-4887-bfeb-4caa81a644b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1423391886"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:43.557780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-42af9304-cf69-4887-bfeb-4caa81a644b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:43.566518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42af9304-cf69-4887-bfeb-4caa81a644b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:43.567181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42af9304-cf69-4887-bfeb-4caa81a644b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.568444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42af9304-cf69-4887-bfeb-4caa81a644b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:43.568962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42af9304-cf69-4887-bfeb-4caa81a644b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.692072 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-42af9304-cf69-4887-bfeb-4caa81a644b0 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "PUT /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1078 microversion: 2.1 time: 0.141825 Jan 22 21:11:43.692855 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1900/3967] 10.222.0.100 () {60 vars in 1260 bytes} [Sat Jan 22 21:11:43 2022] PUT /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1078 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:43.706706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c3f29072-ded3-4601-a533-59c33f693db5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:43.707338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c3f29072-ded3-4601-a533-59c33f693db5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:43.713788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3f29072-ded3-4601-a533-59c33f693db5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:43.714266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3f29072-ded3-4601-a533-59c33f693db5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.715092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3f29072-ded3-4601-a533-59c33f693db5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:43.715544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3f29072-ded3-4601-a533-59c33f693db5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.958153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-01ccaa3d-ffe3-4a72-a29f-28e24a9f3f9a tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:43.961079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c3f29072-ded3-4601-a533-59c33f693db5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:43.970212 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c3f29072-ded3-4601-a533-59c33f693db5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.267396 Jan 22 21:11:43.971025 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1901/3968] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:43 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:43.980588 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-01ccaa3d-ffe3-4a72-a29f-28e24a9f3f9a tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1511 microversion: 2.1 time: 0.482697 Jan 22 21:11:43.980588 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2068/3969] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:43 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1511 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:43.980588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2dff8d13-da11-4745-8291-cf1138385ee8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:43.980588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2dff8d13-da11-4745-8291-cf1138385ee8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:43.991698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dff8d13-da11-4745-8291-cf1138385ee8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:43.992149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dff8d13-da11-4745-8291-cf1138385ee8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:43.993361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24a384a8-9823-4dee-9d45-3f269acfc941 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:43.994414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-24a384a8-9823-4dee-9d45-3f269acfc941 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:44.002054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dff8d13-da11-4745-8291-cf1138385ee8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.002054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dff8d13-da11-4745-8291-cf1138385ee8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.002372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a384a8-9823-4dee-9d45-3f269acfc941 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.002372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a384a8-9823-4dee-9d45-3f269acfc941 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.002372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a384a8-9823-4dee-9d45-3f269acfc941 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.002654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a384a8-9823-4dee-9d45-3f269acfc941 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.054463 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-24a384a8-9823-4dee-9d45-3f269acfc941 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.069956 Jan 22 21:11:44.056190 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1902/3970] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:43 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:44.065295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a6d0217f-4fc3-4870-859a-f2817878fc39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:44.066301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a6d0217f-4fc3-4870-859a-f2817878fc39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:44.076576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6d0217f-4fc3-4870-859a-f2817878fc39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.078122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6d0217f-4fc3-4870-859a-f2817878fc39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.080614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6d0217f-4fc3-4870-859a-f2817878fc39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.082640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6d0217f-4fc3-4870-859a-f2817878fc39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.200309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2dff8d13-da11-4745-8291-cf1138385ee8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:44.209557 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2dff8d13-da11-4745-8291-cf1138385ee8 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1504 microversion: 2.1 time: 0.235995 Jan 22 21:11:44.210647 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2069/3971] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:43 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:44.220058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-41ccf314-a920-4e8f-be6c-692ce5b480be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:44.221382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-41ccf314-a920-4e8f-be6c-692ce5b480be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:44.232852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41ccf314-a920-4e8f-be6c-692ce5b480be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.233389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41ccf314-a920-4e8f-be6c-692ce5b480be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.234531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41ccf314-a920-4e8f-be6c-692ce5b480be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.235316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41ccf314-a920-4e8f-be6c-692ce5b480be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.304908 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-41ccf314-a920-4e8f-be6c-692ce5b480be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.088436 Jan 22 21:11:44.310981 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2070/3972] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:44 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:44.315402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2085cd0c-fa29-461b-91d1-2d3ad6365067 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:44.316213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2085cd0c-fa29-461b-91d1-2d3ad6365067 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:44.317728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a6d0217f-4fc3-4870-859a-f2817878fc39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:44.323686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2085cd0c-fa29-461b-91d1-2d3ad6365067 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.324319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2085cd0c-fa29-461b-91d1-2d3ad6365067 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.325149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2085cd0c-fa29-461b-91d1-2d3ad6365067 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.325623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2085cd0c-fa29-461b-91d1-2d3ad6365067 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.326555 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a6d0217f-4fc3-4870-859a-f2817878fc39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1315 microversion: 2.1 time: 0.267971 Jan 22 21:11:44.327135 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1903/3973] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:44 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:44.332099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4fce3041-57b8-4c7e-be74-9893d7ca85d2 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:44.332710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4fce3041-57b8-4c7e-be74-9893d7ca85d2 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:44.341157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fce3041-57b8-4c7e-be74-9893d7ca85d2 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.342005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fce3041-57b8-4c7e-be74-9893d7ca85d2 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.342856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fce3041-57b8-4c7e-be74-9893d7ca85d2 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.343566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fce3041-57b8-4c7e-be74-9893d7ca85d2 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.549892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2085cd0c-fa29-461b-91d1-2d3ad6365067 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:44.559401 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2085cd0c-fa29-461b-91d1-2d3ad6365067 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.249173 Jan 22 21:11:44.559905 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2071/3974] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:44 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:44.564703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e80b7cb7-c455-42d7-952c-2812bfe5d86b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:44.565629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e80b7cb7-c455-42d7-952c-2812bfe5d86b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:44.570346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4fce3041-57b8-4c7e-be74-9893d7ca85d2 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:44.576775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e80b7cb7-c455-42d7-952c-2812bfe5d86b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.577360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e80b7cb7-c455-42d7-952c-2812bfe5d86b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.578511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e80b7cb7-c455-42d7-952c-2812bfe5d86b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.579006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e80b7cb7-c455-42d7-952c-2812bfe5d86b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.584556 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4fce3041-57b8-4c7e-be74-9893d7ca85d2 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.256371 Jan 22 21:11:44.585293 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1904/3975] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:44 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:44.593338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-67d4cec2-9b90-481c-926d-0f4c14f2f88d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1949616480_updated"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:44.596696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-67d4cec2-9b90-481c-926d-0f4c14f2f88d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 9c65ea8a-55ac-40ad-8734-6217fe1143b1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:44.604008 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-67d4cec2-9b90-481c-926d-0f4c14f2f88d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance 9c65ea8a-55ac-40ad-8734-6217fe1143b1 could not be found. Jan 22 21:11:44.605032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-67d4cec2-9b90-481c-926d-0f4c14f2f88d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance 9c65ea8a-55ac-40ad-8734-6217fe1143b1 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:11:44.606011 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-67d4cec2-9b90-481c-926d-0f4c14f2f88d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "PUT /compute/v2.1/servers/9c65ea8a-55ac-40ad-8734-6217fe1143b1" status: 404 len: 111 microversion: 2.1 time: 0.019545 Jan 22 21:11:44.606801 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1905/3976] 10.222.0.100 () {60 vars in 1260 bytes} [Sat Jan 22 21:11:44 2022] PUT /compute/v2.1/servers/9c65ea8a-55ac-40ad-8734-6217fe1143b1 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:11:44.615168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a7f53246-60cc-4853-8536-cb1e3e1ece4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:44.616273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a7f53246-60cc-4853-8536-cb1e3e1ece4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:44.623775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7f53246-60cc-4853-8536-cb1e3e1ece4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.624235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7f53246-60cc-4853-8536-cb1e3e1ece4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.625234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7f53246-60cc-4853-8536-cb1e3e1ece4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.626326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7f53246-60cc-4853-8536-cb1e3e1ece4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.785320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a7f53246-60cc-4853-8536-cb1e3e1ece4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:44.786750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e80b7cb7-c455-42d7-952c-2812bfe5d86b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:44.795008 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e80b7cb7-c455-42d7-952c-2812bfe5d86b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1504 microversion: 2.1 time: 0.233348 Jan 22 21:11:44.795111 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a7f53246-60cc-4853-8536-cb1e3e1ece4f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.182975 Jan 22 21:11:44.800712 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1906/3977] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:44 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:44.800826 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2072/3978] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:44 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:44.816458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9d2f03d9-c571-45a4-b96c-231caa790be3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:44.817900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-91252f3d-4271-4900-b523-f2c52a21062f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:44.818720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-91252f3d-4271-4900-b523-f2c52a21062f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:44.824035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d2f03d9-c571-45a4-b96c-231caa790be3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.824501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d2f03d9-c571-45a4-b96c-231caa790be3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.826835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91252f3d-4271-4900-b523-f2c52a21062f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.827533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91252f3d-4271-4900-b523-f2c52a21062f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.828806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91252f3d-4271-4900-b523-f2c52a21062f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:44.829725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91252f3d-4271-4900-b523-f2c52a21062f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:44.914839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9d2f03d9-c571-45a4-b96c-231caa790be3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Going to try to stop instance {{(pid=137033) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 22 21:11:44.975664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-91252f3d-4271-4900-b523-f2c52a21062f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:44.983142 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-91252f3d-4271-4900-b523-f2c52a21062f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.169107 Jan 22 21:11:44.983729 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2073/3979] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:44 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:44.999536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5943225d-b700-4cb3-9275-95b0a40e8ea8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:45.000732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5943225d-b700-4cb3-9275-95b0a40e8ea8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:11:45.001560 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5943225d-b700-4cb3-9275-95b0a40e8ea8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "PUT /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 400 len: 619 microversion: 2.1 time: 0.005663 Jan 22 21:11:45.002082 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2074/3980] 10.222.0.100 () {60 vars in 1261 bytes} [Sat Jan 22 21:11:44 2022] PUT /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 619 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 22 21:11:45.008906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ec73cd6c-2eca-44d1-9c77-3a8c9faa5d36 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:45.009578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ec73cd6c-2eca-44d1-9c77-3a8c9faa5d36 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:45.017272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec73cd6c-2eca-44d1-9c77-3a8c9faa5d36 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.019830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec73cd6c-2eca-44d1-9c77-3a8c9faa5d36 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.019830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec73cd6c-2eca-44d1-9c77-3a8c9faa5d36 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.019830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec73cd6c-2eca-44d1-9c77-3a8c9faa5d36 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.166651 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9d2f03d9-c571-45a4-b96c-231caa790be3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "POST /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395/action" status: 202 len: 0 microversion: 2.1 time: 0.353633 Jan 22 21:11:45.168043 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1907/3981] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:44 2022] POST /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:45.173226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ec73cd6c-2eca-44d1-9c77-3a8c9faa5d36 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:45.175788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e9e97d79-b3b0-4bcc-8f0a-1b0412fb4f85 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:45.177738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e9e97d79-b3b0-4bcc-8f0a-1b0412fb4f85 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:45.185304 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ec73cd6c-2eca-44d1-9c77-3a8c9faa5d36 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.175065 Jan 22 21:11:45.186008 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2075/3982] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:45 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:45.187315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9e97d79-b3b0-4bcc-8f0a-1b0412fb4f85 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.187849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9e97d79-b3b0-4bcc-8f0a-1b0412fb4f85 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.188794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9e97d79-b3b0-4bcc-8f0a-1b0412fb4f85 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.189343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9e97d79-b3b0-4bcc-8f0a-1b0412fb4f85 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.190590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-00caa91e-8ffa-4fe4-837f-af8bd721ddeb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:45.191206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-00caa91e-8ffa-4fe4-837f-af8bd721ddeb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:45.208800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00caa91e-8ffa-4fe4-837f-af8bd721ddeb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.209297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00caa91e-8ffa-4fe4-837f-af8bd721ddeb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.215574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00caa91e-8ffa-4fe4-837f-af8bd721ddeb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.216083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00caa91e-8ffa-4fe4-837f-af8bd721ddeb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.256790 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e9e97d79-b3b0-4bcc-8f0a-1b0412fb4f85 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.086908 Jan 22 21:11:45.257417 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1908/3983] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:45 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:45.263471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b5fa250c-6944-4049-ba49-221eed46b31d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:45.264301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b5fa250c-6944-4049-ba49-221eed46b31d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:45.271730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5fa250c-6944-4049-ba49-221eed46b31d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.272191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5fa250c-6944-4049-ba49-221eed46b31d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.273159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5fa250c-6944-4049-ba49-221eed46b31d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.273641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5fa250c-6944-4049-ba49-221eed46b31d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.366969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-00caa91e-8ffa-4fe4-837f-af8bd721ddeb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:45.383513 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-00caa91e-8ffa-4fe4-837f-af8bd721ddeb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.196397 Jan 22 21:11:45.385192 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2076/3984] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:45 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:45.390025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9be5d058-fa7d-4d3a-bf9a-32b076a6d668 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:45.391182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9be5d058-fa7d-4d3a-bf9a-32b076a6d668 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:45.397967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9be5d058-fa7d-4d3a-bf9a-32b076a6d668 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.398431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9be5d058-fa7d-4d3a-bf9a-32b076a6d668 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.399277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9be5d058-fa7d-4d3a-bf9a-32b076a6d668 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.399920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9be5d058-fa7d-4d3a-bf9a-32b076a6d668 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.442140 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9be5d058-fa7d-4d3a-bf9a-32b076a6d668 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.055356 Jan 22 21:11:45.446178 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2077/3985] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:45 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:45.450145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-49b343af-e170-4fc9-aa2c-28d0aef633ee tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:45.450855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-49b343af-e170-4fc9-aa2c-28d0aef633ee tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:45.458089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49b343af-e170-4fc9-aa2c-28d0aef633ee tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.458237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b5fa250c-6944-4049-ba49-221eed46b31d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:45.458559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49b343af-e170-4fc9-aa2c-28d0aef633ee tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.459368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49b343af-e170-4fc9-aa2c-28d0aef633ee tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.459867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49b343af-e170-4fc9-aa2c-28d0aef633ee tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.466640 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b5fa250c-6944-4049-ba49-221eed46b31d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.207993 Jan 22 21:11:45.467593 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1909/3986] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:45 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:45.484072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48d2c233-b636-4f24-befc-67d43153f28d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:45.485317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48d2c233-b636-4f24-befc-67d43153f28d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:11:45.486157 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48d2c233-b636-4f24-befc-67d43153f28d tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "PUT /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 400 len: 108 microversion: 2.1 time: 0.005832 Jan 22 21:11:45.486695 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1910/3987] 10.222.0.100 () {60 vars in 1260 bytes} [Sat Jan 22 21:11:45 2022] PUT /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 108 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 22 21:11:45.498782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e45bcdcf-9dd0-4429-a9a7-cf6f7e4a6da5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:45.499425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e45bcdcf-9dd0-4429-a9a7-cf6f7e4a6da5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:45.505411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e45bcdcf-9dd0-4429-a9a7-cf6f7e4a6da5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.505915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e45bcdcf-9dd0-4429-a9a7-cf6f7e4a6da5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.506723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e45bcdcf-9dd0-4429-a9a7-cf6f7e4a6da5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.507226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e45bcdcf-9dd0-4429-a9a7-cf6f7e4a6da5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.607585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-49b343af-e170-4fc9-aa2c-28d0aef633ee tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:45.616759 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-49b343af-e170-4fc9-aa2c-28d0aef633ee tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1315 microversion: 2.1 time: 0.172437 Jan 22 21:11:45.617534 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2078/3988] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:45 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:45.623861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74b3e540-ddfb-4d95-a101-0a92faf165f5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:45.623861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-74b3e540-ddfb-4d95-a101-0a92faf165f5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:45.629761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b3e540-ddfb-4d95-a101-0a92faf165f5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.630232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b3e540-ddfb-4d95-a101-0a92faf165f5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.631038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b3e540-ddfb-4d95-a101-0a92faf165f5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:45.631491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74b3e540-ddfb-4d95-a101-0a92faf165f5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:45.677929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e45bcdcf-9dd0-4429-a9a7-cf6f7e4a6da5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:45.692283 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e45bcdcf-9dd0-4429-a9a7-cf6f7e4a6da5 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1509 microversion: 2.1 time: 0.201378 Jan 22 21:11:45.693246 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1911/3989] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:45 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:45.778960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-74b3e540-ddfb-4d95-a101-0a92faf165f5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:45.786269 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-74b3e540-ddfb-4d95-a101-0a92faf165f5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.167667 Jan 22 21:11:45.786891 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2079/3990] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:45 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:46.268974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-74479a77-8912-41cc-b1af-f8ecdf2a9997 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:46.269936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-74479a77-8912-41cc-b1af-f8ecdf2a9997 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:46.277233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74479a77-8912-41cc-b1af-f8ecdf2a9997 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:46.277233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74479a77-8912-41cc-b1af-f8ecdf2a9997 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:46.278107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74479a77-8912-41cc-b1af-f8ecdf2a9997 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:46.278621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74479a77-8912-41cc-b1af-f8ecdf2a9997 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:46.326069 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-74479a77-8912-41cc-b1af-f8ecdf2a9997 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.060888 Jan 22 21:11:46.326837 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1912/3991] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:46 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:46.401282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e4a14eb7-7c5b-4e51-804e-49904c4274f6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:46.404877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e4a14eb7-7c5b-4e51-804e-49904c4274f6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:46.408637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4a14eb7-7c5b-4e51-804e-49904c4274f6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:46.409095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4a14eb7-7c5b-4e51-804e-49904c4274f6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:46.409928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4a14eb7-7c5b-4e51-804e-49904c4274f6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:46.410438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4a14eb7-7c5b-4e51-804e-49904c4274f6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:46.458345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-234e7734-e911-4399-a980-52656fbe07bd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:46.459465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-234e7734-e911-4399-a980-52656fbe07bd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:46.468830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-234e7734-e911-4399-a980-52656fbe07bd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:46.469381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-234e7734-e911-4399-a980-52656fbe07bd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:46.470281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-234e7734-e911-4399-a980-52656fbe07bd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:46.470803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-234e7734-e911-4399-a980-52656fbe07bd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:46.516750 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-234e7734-e911-4399-a980-52656fbe07bd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.062211 Jan 22 21:11:46.517432 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1913/3992] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:46 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:46.573056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e4a14eb7-7c5b-4e51-804e-49904c4274f6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:46.580890 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e4a14eb7-7c5b-4e51-804e-49904c4274f6 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.183659 Jan 22 21:11:46.581494 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2080/3993] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:46 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:46.637459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eb45a912-3fc6-4ced-999b-2e0934b4896f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:46.638053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eb45a912-3fc6-4ced-999b-2e0934b4896f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:46.646361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb45a912-3fc6-4ced-999b-2e0934b4896f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:46.646921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb45a912-3fc6-4ced-999b-2e0934b4896f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:46.647902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb45a912-3fc6-4ced-999b-2e0934b4896f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:46.648346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb45a912-3fc6-4ced-999b-2e0934b4896f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:46.805763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-48cc8c1f-501b-4d21-affd-df616110c4ba tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:46.806437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-48cc8c1f-501b-4d21-affd-df616110c4ba tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:46.808490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eb45a912-3fc6-4ced-999b-2e0934b4896f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:46.816488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48cc8c1f-501b-4d21-affd-df616110c4ba tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:46.818786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48cc8c1f-501b-4d21-affd-df616110c4ba tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:46.818786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48cc8c1f-501b-4d21-affd-df616110c4ba tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:46.818786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48cc8c1f-501b-4d21-affd-df616110c4ba tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:46.826474 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eb45a912-3fc6-4ced-999b-2e0934b4896f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1315 microversion: 2.1 time: 0.193220 Jan 22 21:11:46.827571 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1914/3994] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:46 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:46.880662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-52cbf7fc-633a-480b-bed3-22028ac0804b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d503e5d-13b7-4392-b749-17ade718b9e5"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:46.882337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-52cbf7fc-633a-480b-bed3-22028ac0804b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:46.889802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52cbf7fc-633a-480b-bed3-22028ac0804b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:46.890730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52cbf7fc-633a-480b-bed3-22028ac0804b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:46.891540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52cbf7fc-633a-480b-bed3-22028ac0804b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:46.891987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52cbf7fc-633a-480b-bed3-22028ac0804b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:46.997438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-48cc8c1f-501b-4d21-affd-df616110c4ba tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:47.004060 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-48cc8c1f-501b-4d21-affd-df616110c4ba tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.204572 Jan 22 21:11:47.004993 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2081/3995] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:46 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:47.340305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3881c20a-eea9-4e17-884f-00c00ea34aeb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:47.341285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3881c20a-eea9-4e17-884f-00c00ea34aeb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:47.347568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3881c20a-eea9-4e17-884f-00c00ea34aeb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:47.348025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3881c20a-eea9-4e17-884f-00c00ea34aeb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:47.348940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3881c20a-eea9-4e17-884f-00c00ea34aeb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:47.349390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3881c20a-eea9-4e17-884f-00c00ea34aeb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:47.394751 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3881c20a-eea9-4e17-884f-00c00ea34aeb tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.058448 Jan 22 21:11:47.398600 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2082/3996] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:47 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:11:47.528579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4f3aff70-fc26-451e-9766-b63d3559d40c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:47.529960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4f3aff70-fc26-451e-9766-b63d3559d40c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:47.537283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f3aff70-fc26-451e-9766-b63d3559d40c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:47.538236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f3aff70-fc26-451e-9766-b63d3559d40c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:47.538765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f3aff70-fc26-451e-9766-b63d3559d40c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:47.539038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f3aff70-fc26-451e-9766-b63d3559d40c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:47.591321 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4f3aff70-fc26-451e-9766-b63d3559d40c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.066741 Jan 22 21:11:47.596225 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2083/3997] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:47 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:11:47.598387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-009eaba6-d6a8-4f95-9d1f-1f730eae7437 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:47.599080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-009eaba6-d6a8-4f95-9d1f-1f730eae7437 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:47.606444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-009eaba6-d6a8-4f95-9d1f-1f730eae7437 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:47.606897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-009eaba6-d6a8-4f95-9d1f-1f730eae7437 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:47.607684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-009eaba6-d6a8-4f95-9d1f-1f730eae7437 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:47.608121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-009eaba6-d6a8-4f95-9d1f-1f730eae7437 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:47.663861 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-52cbf7fc-633a-480b-bed3-22028ac0804b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "POST /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.787585 Jan 22 21:11:47.664550 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1915/3998] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:11:46 2022] POST /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777/os-volume_attachments => generated 194 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:11:47.763610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-009eaba6-d6a8-4f95-9d1f-1f730eae7437 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:47.771466 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-009eaba6-d6a8-4f95-9d1f-1f730eae7437 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.176939 Jan 22 21:11:47.772038 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2084/3999] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:47 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:47.843926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d785187e-e354-40a8-8590-232611d35948 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:47.844621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d785187e-e354-40a8-8590-232611d35948 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:47.850953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d785187e-e354-40a8-8590-232611d35948 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:47.851434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d785187e-e354-40a8-8590-232611d35948 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:47.852230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d785187e-e354-40a8-8590-232611d35948 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:47.852669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d785187e-e354-40a8-8590-232611d35948 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:48.020998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-316f76eb-6ad0-4998-b8ea-02da1143e85b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:48.024745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d785187e-e354-40a8-8590-232611d35948 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:48.027363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-316f76eb-6ad0-4998-b8ea-02da1143e85b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:48.042465 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d785187e-e354-40a8-8590-232611d35948 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1315 microversion: 2.1 time: 0.202555 Jan 22 21:11:48.043263 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1916/4000] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:47 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:48.052048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-316f76eb-6ad0-4998-b8ea-02da1143e85b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:48.052699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-316f76eb-6ad0-4998-b8ea-02da1143e85b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:48.053764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-316f76eb-6ad0-4998-b8ea-02da1143e85b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:48.054380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-316f76eb-6ad0-4998-b8ea-02da1143e85b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:48.214116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-316f76eb-6ad0-4998-b8ea-02da1143e85b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:48.221991 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-316f76eb-6ad0-4998-b8ea-02da1143e85b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.205344 Jan 22 21:11:48.222727 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2085/4001] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:48 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:48.405828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cb609057-059d-4d53-a564-313c18dffc70 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:48.406759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cb609057-059d-4d53-a564-313c18dffc70 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:48.413116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb609057-059d-4d53-a564-313c18dffc70 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:48.413605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb609057-059d-4d53-a564-313c18dffc70 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:48.414398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb609057-059d-4d53-a564-313c18dffc70 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:48.414845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb609057-059d-4d53-a564-313c18dffc70 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:48.459177 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cb609057-059d-4d53-a564-313c18dffc70 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.056843 Jan 22 21:11:48.460031 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1917/4002] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:48 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:48.604759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-50373581-1238-4afd-bb8c-55783c0f20e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:48.611453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-50373581-1238-4afd-bb8c-55783c0f20e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:48.612720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50373581-1238-4afd-bb8c-55783c0f20e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:48.613174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50373581-1238-4afd-bb8c-55783c0f20e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:48.613992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50373581-1238-4afd-bb8c-55783c0f20e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:48.614435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50373581-1238-4afd-bb8c-55783c0f20e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:48.658908 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-50373581-1238-4afd-bb8c-55783c0f20e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.058492 Jan 22 21:11:48.660407 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2086/4003] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:48 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:48.789968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2fd8f2e1-bf59-449a-97fb-3cf99bd85146 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:48.791547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2fd8f2e1-bf59-449a-97fb-3cf99bd85146 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:48.804275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fd8f2e1-bf59-449a-97fb-3cf99bd85146 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:48.806674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fd8f2e1-bf59-449a-97fb-3cf99bd85146 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:48.825590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fd8f2e1-bf59-449a-97fb-3cf99bd85146 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:48.825590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fd8f2e1-bf59-449a-97fb-3cf99bd85146 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:48.973211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2fd8f2e1-bf59-449a-97fb-3cf99bd85146 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:48.981764 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2fd8f2e1-bf59-449a-97fb-3cf99bd85146 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.196177 Jan 22 21:11:48.994455 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1918/4004] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:48 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:49.060509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e52c7b5d-9a4f-4b9e-9d14-e3cb65a54e39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:49.062589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e52c7b5d-9a4f-4b9e-9d14-e3cb65a54e39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:49.069766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e52c7b5d-9a4f-4b9e-9d14-e3cb65a54e39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:49.070225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e52c7b5d-9a4f-4b9e-9d14-e3cb65a54e39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:49.071073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e52c7b5d-9a4f-4b9e-9d14-e3cb65a54e39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:49.071677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e52c7b5d-9a4f-4b9e-9d14-e3cb65a54e39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:49.214193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e52c7b5d-9a4f-4b9e-9d14-e3cb65a54e39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:49.222164 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e52c7b5d-9a4f-4b9e-9d14-e3cb65a54e39 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1315 microversion: 2.1 time: 0.166191 Jan 22 21:11:49.222784 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2087/4005] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:49 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:49.239386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7e82377b-16a1-4899-a078-6d8b8d3a9130 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:49.240010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7e82377b-16a1-4899-a078-6d8b8d3a9130 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:49.247065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e82377b-16a1-4899-a078-6d8b8d3a9130 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:49.247528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e82377b-16a1-4899-a078-6d8b8d3a9130 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:49.248453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e82377b-16a1-4899-a078-6d8b8d3a9130 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:49.248906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e82377b-16a1-4899-a078-6d8b8d3a9130 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:49.388750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7e82377b-16a1-4899-a078-6d8b8d3a9130 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:49.397023 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7e82377b-16a1-4899-a078-6d8b8d3a9130 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.161532 Jan 22 21:11:49.397750 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1919/4006] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:49 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:49.471993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0c43eeeb-dabe-477f-92ea-9c549a83c555 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:49.472964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0c43eeeb-dabe-477f-92ea-9c549a83c555 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:49.480660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c43eeeb-dabe-477f-92ea-9c549a83c555 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:49.481114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c43eeeb-dabe-477f-92ea-9c549a83c555 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:49.481966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c43eeeb-dabe-477f-92ea-9c549a83c555 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:49.482408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c43eeeb-dabe-477f-92ea-9c549a83c555 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:49.532834 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0c43eeeb-dabe-477f-92ea-9c549a83c555 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.064407 Jan 22 21:11:49.536759 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2088/4007] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:49 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:49.669454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-324af9ec-7cf7-4ed9-9241-01620294fa9d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:49.670482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-324af9ec-7cf7-4ed9-9241-01620294fa9d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:49.676780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-324af9ec-7cf7-4ed9-9241-01620294fa9d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:49.677254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-324af9ec-7cf7-4ed9-9241-01620294fa9d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:49.678056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-324af9ec-7cf7-4ed9-9241-01620294fa9d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:49.682044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-324af9ec-7cf7-4ed9-9241-01620294fa9d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:49.719214 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-324af9ec-7cf7-4ed9-9241-01620294fa9d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.053340 Jan 22 21:11:49.719846 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1920/4008] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:49 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:50.002493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7fd99571-048f-4d33-b3d5-7e2d453e8241 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:50.003260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7fd99571-048f-4d33-b3d5-7e2d453e8241 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:50.011065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fd99571-048f-4d33-b3d5-7e2d453e8241 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:50.011527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fd99571-048f-4d33-b3d5-7e2d453e8241 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:50.012354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fd99571-048f-4d33-b3d5-7e2d453e8241 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:50.012775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fd99571-048f-4d33-b3d5-7e2d453e8241 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:50.190733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7fd99571-048f-4d33-b3d5-7e2d453e8241 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:50.201279 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7fd99571-048f-4d33-b3d5-7e2d453e8241 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.202833 Jan 22 21:11:50.202157 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2089/4009] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:49 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:50.239739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4ff34930-ef7b-413f-9f86-6666317f1964 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:50.240432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4ff34930-ef7b-413f-9f86-6666317f1964 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:50.248507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ff34930-ef7b-413f-9f86-6666317f1964 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:50.248967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ff34930-ef7b-413f-9f86-6666317f1964 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:50.249830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ff34930-ef7b-413f-9f86-6666317f1964 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:50.254653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ff34930-ef7b-413f-9f86-6666317f1964 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:50.393996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4ff34930-ef7b-413f-9f86-6666317f1964 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:50.402604 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4ff34930-ef7b-413f-9f86-6666317f1964 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1315 microversion: 2.1 time: 0.166977 Jan 22 21:11:50.403193 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1921/4010] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:50 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:50.417133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b1c4f876-c412-45bd-bf5d-786f0cc171ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:50.417781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b1c4f876-c412-45bd-bf5d-786f0cc171ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:50.423626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1c4f876-c412-45bd-bf5d-786f0cc171ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:50.424083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1c4f876-c412-45bd-bf5d-786f0cc171ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:50.424877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1c4f876-c412-45bd-bf5d-786f0cc171ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:50.425408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1c4f876-c412-45bd-bf5d-786f0cc171ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:50.447048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f9feeac2-c2fb-48b8-bcba-d31e09c0d99d req-3af5bf51-2a49-4ee9-9706-5eed08f0e3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc5d005-c458-46e9-87ee-b837034d76c7", "name": "network-vif-plugged", "status": "completed", "tag": "c8ca2591-f475-4a3e-8f6c-e2b56416c2cf"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:50.448998 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:50.448998 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:11:50.456985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f9feeac2-c2fb-48b8-bcba-d31e09c0d99d req-3af5bf51-2a49-4ee9-9706-5eed08f0e3c2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:50.457705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f9feeac2-c2fb-48b8-bcba-d31e09c0d99d req-3af5bf51-2a49-4ee9-9706-5eed08f0e3c2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:50.474918 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f9feeac2-c2fb-48b8-bcba-d31e09c0d99d req-3af5bf51-2a49-4ee9-9706-5eed08f0e3c2 service nova] Creating event network-vif-plugged:c8ca2591-f475-4a3e-8f6c-e2b56416c2cf for instance fcc5d005-c458-46e9-87ee-b837034d76c7 on nch2-master-1 Jan 22 21:11:50.481243 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f9feeac2-c2fb-48b8-bcba-d31e09c0d99d req-3af5bf51-2a49-4ee9-9706-5eed08f0e3c2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037797 Jan 22 21:11:50.482557 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1922/4011] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:11:50.545569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-91555036-0ef7-4e33-a2ce-f966fea29357 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:50.546679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-91555036-0ef7-4e33-a2ce-f966fea29357 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:50.557070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91555036-0ef7-4e33-a2ce-f966fea29357 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:50.557557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91555036-0ef7-4e33-a2ce-f966fea29357 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:50.558426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91555036-0ef7-4e33-a2ce-f966fea29357 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:50.558831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91555036-0ef7-4e33-a2ce-f966fea29357 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:50.638354 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-91555036-0ef7-4e33-a2ce-f966fea29357 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.092548 Jan 22 21:11:50.638354 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1923/4012] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:50 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:50.649641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b1c4f876-c412-45bd-bf5d-786f0cc171ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:50.658282 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b1c4f876-c412-45bd-bf5d-786f0cc171ae tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.246102 Jan 22 21:11:50.658872 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2090/4013] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:50 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:50.734586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-37530965-fd34-4fe2-9cc5-0ccfad509a0d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:50.735619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-37530965-fd34-4fe2-9cc5-0ccfad509a0d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:50.746792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37530965-fd34-4fe2-9cc5-0ccfad509a0d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:50.747513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37530965-fd34-4fe2-9cc5-0ccfad509a0d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:50.748460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37530965-fd34-4fe2-9cc5-0ccfad509a0d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:50.748915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37530965-fd34-4fe2-9cc5-0ccfad509a0d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:50.971635 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-37530965-fd34-4fe2-9cc5-0ccfad509a0d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.241861 Jan 22 21:11:50.972292 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1924/4014] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:50 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:51.228744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f6ea3491-2023-4351-a899-93938128b477 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:51.230222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f6ea3491-2023-4351-a899-93938128b477 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:51.242649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6ea3491-2023-4351-a899-93938128b477 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:51.243413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6ea3491-2023-4351-a899-93938128b477 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:51.244296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6ea3491-2023-4351-a899-93938128b477 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:51.244939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6ea3491-2023-4351-a899-93938128b477 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:51.384967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f6ea3491-2023-4351-a899-93938128b477 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:51.393641 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f6ea3491-2023-4351-a899-93938128b477 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.177504 Jan 22 21:11:51.394223 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2091/4015] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:51 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:51.419787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-71b24611-7888-49d5-9606-8006ac84a9ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:51.420492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-71b24611-7888-49d5-9606-8006ac84a9ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:51.428004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71b24611-7888-49d5-9606-8006ac84a9ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:51.428467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71b24611-7888-49d5-9606-8006ac84a9ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:51.429272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71b24611-7888-49d5-9606-8006ac84a9ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:51.429748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71b24611-7888-49d5-9606-8006ac84a9ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:51.593384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-71b24611-7888-49d5-9606-8006ac84a9ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:51.601832 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-71b24611-7888-49d5-9606-8006ac84a9ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1315 microversion: 2.1 time: 0.186173 Jan 22 21:11:51.602682 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1925/4016] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:51 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:51.648222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d7d12618-1dce-4f53-a53e-9550579e6c4f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:51.649603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d7d12618-1dce-4f53-a53e-9550579e6c4f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:51.657113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7d12618-1dce-4f53-a53e-9550579e6c4f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:51.657615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7d12618-1dce-4f53-a53e-9550579e6c4f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:51.658415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7d12618-1dce-4f53-a53e-9550579e6c4f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:51.658866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7d12618-1dce-4f53-a53e-9550579e6c4f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:51.678968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-626fbe09-d165-44bd-ac38-aec8b1f7652d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:51.679670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-626fbe09-d165-44bd-ac38-aec8b1f7652d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:51.687437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-626fbe09-d165-44bd-ac38-aec8b1f7652d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:51.688679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-626fbe09-d165-44bd-ac38-aec8b1f7652d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:51.695216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-626fbe09-d165-44bd-ac38-aec8b1f7652d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:51.695918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-626fbe09-d165-44bd-ac38-aec8b1f7652d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:51.713275 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d7d12618-1dce-4f53-a53e-9550579e6c4f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.068856 Jan 22 21:11:51.713980 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2092/4017] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:51 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:51.840526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-626fbe09-d165-44bd-ac38-aec8b1f7652d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:51.848718 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-626fbe09-d165-44bd-ac38-aec8b1f7652d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.176442 Jan 22 21:11:51.849297 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1926/4018] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:51 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:51.991512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-44af679e-baed-48b7-8767-9e7a0caca08d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:51.993182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-44af679e-baed-48b7-8767-9e7a0caca08d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:52.000454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44af679e-baed-48b7-8767-9e7a0caca08d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.000913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44af679e-baed-48b7-8767-9e7a0caca08d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.001953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44af679e-baed-48b7-8767-9e7a0caca08d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.002403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44af679e-baed-48b7-8767-9e7a0caca08d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.045843 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-44af679e-baed-48b7-8767-9e7a0caca08d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.066511 Jan 22 21:11:52.046565 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2093/4019] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:51 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:52.112046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-beeddeb9-3840-488d-92b4-1227a8909c20 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:52.113187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-beeddeb9-3840-488d-92b4-1227a8909c20 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:52.120247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-beeddeb9-3840-488d-92b4-1227a8909c20 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.120712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-beeddeb9-3840-488d-92b4-1227a8909c20 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.121526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-beeddeb9-3840-488d-92b4-1227a8909c20 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.122097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-beeddeb9-3840-488d-92b4-1227a8909c20 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.154712 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-beeddeb9-3840-488d-92b4-1227a8909c20 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046415 Jan 22 21:11:52.159685 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1927/4020] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:11:52 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:52.168782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-654c8d07-276c-4489-af79-a3e7cec9c48f tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:52.169405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-654c8d07-276c-4489-af79-a3e7cec9c48f tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:52.176507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-654c8d07-276c-4489-af79-a3e7cec9c48f tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.176973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-654c8d07-276c-4489-af79-a3e7cec9c48f tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.177808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-654c8d07-276c-4489-af79-a3e7cec9c48f tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.178275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-654c8d07-276c-4489-af79-a3e7cec9c48f tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.268258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-654c8d07-276c-4489-af79-a3e7cec9c48f tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lazy-loading 'services' on Instance uuid 5a45a6b1-24c6-4009-ad8f-6203f05d6777 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:11:52.414857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-32392403-4aa2-4537-99ae-0a10c83cdada tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:52.414857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-32392403-4aa2-4537-99ae-0a10c83cdada tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:52.418980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32392403-4aa2-4537-99ae-0a10c83cdada tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.419428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32392403-4aa2-4537-99ae-0a10c83cdada tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.420342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32392403-4aa2-4537-99ae-0a10c83cdada tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.420915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32392403-4aa2-4537-99ae-0a10c83cdada tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.549496 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-654c8d07-276c-4489-af79-a3e7cec9c48f tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777/os-volume_attachments/8d503e5d-13b7-4392-b749-17ade718b9e5" status: 202 len: 0 microversion: 2.1 time: 0.385014 Jan 22 21:11:52.550331 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2094/4021] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 21:11:52 2022] DELETE /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777/os-volume_attachments/8d503e5d-13b7-4392-b749-17ade718b9e5 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:52.576404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-32392403-4aa2-4537-99ae-0a10c83cdada tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:52.586484 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-32392403-4aa2-4537-99ae-0a10c83cdada tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.178844 Jan 22 21:11:52.587300 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1928/4022] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:52 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:52.620547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4d96c3ba-62f0-49c8-bcee-32ef97061a7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:52.621253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4d96c3ba-62f0-49c8-bcee-32ef97061a7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:52.627931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d96c3ba-62f0-49c8-bcee-32ef97061a7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.627931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d96c3ba-62f0-49c8-bcee-32ef97061a7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.628740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d96c3ba-62f0-49c8-bcee-32ef97061a7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.629189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d96c3ba-62f0-49c8-bcee-32ef97061a7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.725622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-30b36615-4853-465e-84e1-bc98a7bf1406 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:52.727004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-30b36615-4853-465e-84e1-bc98a7bf1406 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:52.735121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30b36615-4853-465e-84e1-bc98a7bf1406 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.735838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30b36615-4853-465e-84e1-bc98a7bf1406 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.736788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30b36615-4853-465e-84e1-bc98a7bf1406 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.737816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30b36615-4853-465e-84e1-bc98a7bf1406 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.782750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4d96c3ba-62f0-49c8-bcee-32ef97061a7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:52.787715 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4d96c3ba-62f0-49c8-bcee-32ef97061a7f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1464 microversion: 2.1 time: 0.172086 Jan 22 21:11:52.788297 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2095/4023] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:52 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1464 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:52.795727 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-30b36615-4853-465e-84e1-bc98a7bf1406 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.073722 Jan 22 21:11:52.796513 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1929/4024] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:52 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:11:52.806116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-62cbacf5-54cc-462f-8758-71820e42ee81 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:52.811400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-62cbacf5-54cc-462f-8758-71820e42ee81 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:52.813301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62cbacf5-54cc-462f-8758-71820e42ee81 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.813800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62cbacf5-54cc-462f-8758-71820e42ee81 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.814656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62cbacf5-54cc-462f-8758-71820e42ee81 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.815104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62cbacf5-54cc-462f-8758-71820e42ee81 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.866002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c6cd8311-bf99-4584-b4c7-b21556db99aa tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:52.866722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c6cd8311-bf99-4584-b4c7-b21556db99aa tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:52.874912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6cd8311-bf99-4584-b4c7-b21556db99aa tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.875597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6cd8311-bf99-4584-b4c7-b21556db99aa tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.876574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6cd8311-bf99-4584-b4c7-b21556db99aa tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.877026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6cd8311-bf99-4584-b4c7-b21556db99aa tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.954087 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-62cbacf5-54cc-462f-8758-71820e42ee81 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1615 microversion: 2.1 time: 0.151817 Jan 22 21:11:52.954864 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2096/4025] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:52 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1615 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:52.974107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d47f2207-0269-4233-82e6-953b1fef4ddb tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:52.974699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d47f2207-0269-4233-82e6-953b1fef4ddb tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:52.981797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d47f2207-0269-4233-82e6-953b1fef4ddb tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.982259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d47f2207-0269-4233-82e6-953b1fef4ddb tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:52.983064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d47f2207-0269-4233-82e6-953b1fef4ddb tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:52.983512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d47f2207-0269-4233-82e6-953b1fef4ddb tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:53.029055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c6cd8311-bf99-4584-b4c7-b21556db99aa tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:53.037176 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c6cd8311-bf99-4584-b4c7-b21556db99aa tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.175289 Jan 22 21:11:53.045555 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1930/4026] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:52 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:53.059227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f2134d21-5ec6-4541-ac85-69f49925aeef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:53.060853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f2134d21-5ec6-4541-ac85-69f49925aeef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:53.068010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2134d21-5ec6-4541-ac85-69f49925aeef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:53.068704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2134d21-5ec6-4541-ac85-69f49925aeef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:53.069988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2134d21-5ec6-4541-ac85-69f49925aeef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:53.070543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2134d21-5ec6-4541-ac85-69f49925aeef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:53.078064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d47f2207-0269-4233-82e6-953b1fef4ddb tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c7fd06952c8247ef899e0196dc3f306c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8244a23d9b3f475080dbd45567f6d11b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:53.078824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d47f2207-0269-4233-82e6-953b1fef4ddb tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] flavor_id is None. Assuming migration. {{(pid=137032) resize /opt/stack/nova/nova/compute/api.py:4073}} Jan 22 21:11:53.085717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d47f2207-0269-4233-82e6-953b1fef4ddb tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137032) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 21:11:53.122838 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f2134d21-5ec6-4541-ac85-69f49925aeef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.069334 Jan 22 21:11:53.123787 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1931/4027] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:53 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:53.605482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-59da76c8-95fb-4173-b424-eebb35eebd63 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:53.606516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-59da76c8-95fb-4173-b424-eebb35eebd63 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:53.617759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59da76c8-95fb-4173-b424-eebb35eebd63 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:53.618319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59da76c8-95fb-4173-b424-eebb35eebd63 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:53.620405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59da76c8-95fb-4173-b424-eebb35eebd63 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:53.620939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59da76c8-95fb-4173-b424-eebb35eebd63 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:53.627778 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d47f2207-0269-4233-82e6-953b1fef4ddb tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7/action" status: 202 len: 0 microversion: 2.1 time: 0.657125 Jan 22 21:11:53.637423 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2097/4028] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:52 2022] POST /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7/action => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:11:53.653021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61fa396d-522b-408a-b75d-8481644814c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:53.653818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-61fa396d-522b-408a-b75d-8481644814c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:53.669431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61fa396d-522b-408a-b75d-8481644814c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:53.669939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61fa396d-522b-408a-b75d-8481644814c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:53.673912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61fa396d-522b-408a-b75d-8481644814c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:53.674751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61fa396d-522b-408a-b75d-8481644814c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:53.885478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-59da76c8-95fb-4173-b424-eebb35eebd63 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:53.888475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-61fa396d-522b-408a-b75d-8481644814c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:53.893803 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-59da76c8-95fb-4173-b424-eebb35eebd63 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.293215 Jan 22 21:11:53.894640 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1932/4029] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:53 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:53.904138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cb88c571-610b-4dcc-8e98-93a975c3e632 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:53.904138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cb88c571-610b-4dcc-8e98-93a975c3e632 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:53.908582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb88c571-610b-4dcc-8e98-93a975c3e632 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:53.908954 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61fa396d-522b-408a-b75d-8481644814c2 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1473 microversion: 2.1 time: 0.269882 Jan 22 21:11:53.909063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb88c571-610b-4dcc-8e98-93a975c3e632 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:53.909587 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2098/4030] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:53 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1473 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:53.911532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb88c571-610b-4dcc-8e98-93a975c3e632 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:53.914042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb88c571-610b-4dcc-8e98-93a975c3e632 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:53.961799 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cb88c571-610b-4dcc-8e98-93a975c3e632 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.064992 Jan 22 21:11:53.963134 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1933/4031] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:53 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:54.054808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bd3368ee-7e5e-4149-ab7f-3158cd294cea tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:54.055425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bd3368ee-7e5e-4149-ab7f-3158cd294cea tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:54.063118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd3368ee-7e5e-4149-ab7f-3158cd294cea tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:54.063682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd3368ee-7e5e-4149-ab7f-3158cd294cea tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:54.064631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd3368ee-7e5e-4149-ab7f-3158cd294cea tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:54.065171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd3368ee-7e5e-4149-ab7f-3158cd294cea tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:54.136475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b8921358-3697-4fd1-ac9e-c55f5834b2aa tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:54.137930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b8921358-3697-4fd1-ac9e-c55f5834b2aa tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:54.145005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8921358-3697-4fd1-ac9e-c55f5834b2aa tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:54.145455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8921358-3697-4fd1-ac9e-c55f5834b2aa tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:54.146305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8921358-3697-4fd1-ac9e-c55f5834b2aa tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:54.146742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8921358-3697-4fd1-ac9e-c55f5834b2aa tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:54.196237 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b8921358-3697-4fd1-ac9e-c55f5834b2aa tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.064889 Jan 22 21:11:54.197600 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1934/4032] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:54 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:11:54.216055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bd3368ee-7e5e-4149-ab7f-3158cd294cea tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:54.224489 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bd3368ee-7e5e-4149-ab7f-3158cd294cea tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.173334 Jan 22 21:11:54.225065 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2099/4033] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:54 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:54.788367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-79916457-fbdd-4ced-bf34-0b46e81d29e1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:54.789463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-79916457-fbdd-4ced-bf34-0b46e81d29e1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:54.801111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79916457-fbdd-4ced-bf34-0b46e81d29e1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:54.801111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79916457-fbdd-4ced-bf34-0b46e81d29e1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:54.801111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79916457-fbdd-4ced-bf34-0b46e81d29e1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:54.801111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79916457-fbdd-4ced-bf34-0b46e81d29e1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:54.832834 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-79916457-fbdd-4ced-bf34-0b46e81d29e1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048491 Jan 22 21:11:54.833385 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1935/4034] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:11:54 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:11:54.892383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4ff2168b-5778-45c7-b4ad-98f1cd4612e6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:54.893380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4ff2168b-5778-45c7-b4ad-98f1cd4612e6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:54.900560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ff2168b-5778-45c7-b4ad-98f1cd4612e6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:54.901052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ff2168b-5778-45c7-b4ad-98f1cd4612e6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:54.901950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ff2168b-5778-45c7-b4ad-98f1cd4612e6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:54.902403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ff2168b-5778-45c7-b4ad-98f1cd4612e6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:54.911620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-728d5011-9753-46cc-b3fc-48e75cda53e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:54.912232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-728d5011-9753-46cc-b3fc-48e75cda53e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:54.920627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-728d5011-9753-46cc-b3fc-48e75cda53e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:54.921081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-728d5011-9753-46cc-b3fc-48e75cda53e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:54.921890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-728d5011-9753-46cc-b3fc-48e75cda53e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:54.922330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-728d5011-9753-46cc-b3fc-48e75cda53e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:54.934158 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4ff2168b-5778-45c7-b4ad-98f1cd4612e6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045472 Jan 22 21:11:54.934741 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2100/4035] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:11:54 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:11:54.939272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e6b34ee0-5992-43cf-ada6-089e9fc732ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:54.940172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e6b34ee0-5992-43cf-ada6-089e9fc732ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:54.947387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6b34ee0-5992-43cf-ada6-089e9fc732ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:54.948172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6b34ee0-5992-43cf-ada6-089e9fc732ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:54.948996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6b34ee0-5992-43cf-ada6-089e9fc732ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:54.949444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6b34ee0-5992-43cf-ada6-089e9fc732ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:55.079759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-728d5011-9753-46cc-b3fc-48e75cda53e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:55.090062 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-728d5011-9753-46cc-b3fc-48e75cda53e4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.182036 Jan 22 21:11:55.094769 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1936/4036] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:54 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:55.095248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6da9296e-3294-4283-b862-b463c84cde6e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:55.096159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6da9296e-3294-4283-b862-b463c84cde6e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:55.102119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6da9296e-3294-4283-b862-b463c84cde6e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:55.102595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6da9296e-3294-4283-b862-b463c84cde6e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:55.103515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6da9296e-3294-4283-b862-b463c84cde6e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:55.104128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6da9296e-3294-4283-b862-b463c84cde6e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:55.104684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e6b34ee0-5992-43cf-ada6-089e9fc732ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:55.112834 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e6b34ee0-5992-43cf-ada6-089e9fc732ec tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1473 microversion: 2.1 time: 0.177077 Jan 22 21:11:55.113557 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2101/4037] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:54 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1473 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:55.119028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-28900fb7-3734-4ed3-a5ae-a18734231e90 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:55.119741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-28900fb7-3734-4ed3-a5ae-a18734231e90 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:55.125990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28900fb7-3734-4ed3-a5ae-a18734231e90 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:55.126457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28900fb7-3734-4ed3-a5ae-a18734231e90 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:55.127255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28900fb7-3734-4ed3-a5ae-a18734231e90 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:55.127755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28900fb7-3734-4ed3-a5ae-a18734231e90 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:55.146611 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6da9296e-3294-4283-b862-b463c84cde6e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.054631 Jan 22 21:11:55.147865 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1937/4038] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:55 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:55.158907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-28900fb7-3734-4ed3-a5ae-a18734231e90 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:11:55.209278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-caf84b12-c9f7-4d46-9f58-8113785f948f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:55.210315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-caf84b12-c9f7-4d46-9f58-8113785f948f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:55.218062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-caf84b12-c9f7-4d46-9f58-8113785f948f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:55.218558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-caf84b12-c9f7-4d46-9f58-8113785f948f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:55.219362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-caf84b12-c9f7-4d46-9f58-8113785f948f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:55.219805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-caf84b12-c9f7-4d46-9f58-8113785f948f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:55.262582 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-caf84b12-c9f7-4d46-9f58-8113785f948f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.057259 Jan 22 21:11:55.263157 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1938/4039] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:55 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:55.268179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-03830ad4-4ed1-4c76-9e37-2c045927ffc0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:55.268868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-03830ad4-4ed1-4c76-9e37-2c045927ffc0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:55.275924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03830ad4-4ed1-4c76-9e37-2c045927ffc0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:55.276370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03830ad4-4ed1-4c76-9e37-2c045927ffc0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:55.277152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03830ad4-4ed1-4c76-9e37-2c045927ffc0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:55.277617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03830ad4-4ed1-4c76-9e37-2c045927ffc0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:55.428723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-03830ad4-4ed1-4c76-9e37-2c045927ffc0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:55.436754 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-03830ad4-4ed1-4c76-9e37-2c045927ffc0 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.172468 Jan 22 21:11:55.437323 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1939/4040] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:55 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:55.503905 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-28900fb7-3734-4ed3-a5ae-a18734231e90 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 204 len: 0 microversion: 2.1 time: 0.388986 Jan 22 21:11:55.504573 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2102/4041] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:11:55 2022] DELETE /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:11:55.513009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-470fba12-e294-4a5c-987c-234534c976d3 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:55.513598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-470fba12-e294-4a5c-987c-234534c976d3 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:55.519933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-470fba12-e294-4a5c-987c-234534c976d3 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:55.520400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-470fba12-e294-4a5c-987c-234534c976d3 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:55.521173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-470fba12-e294-4a5c-987c-234534c976d3 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:55.521639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-470fba12-e294-4a5c-987c-234534c976d3 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:55.764109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-470fba12-e294-4a5c-987c-234534c976d3 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:55.772124 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-470fba12-e294-4a5c-987c-234534c976d3 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1517 microversion: 2.1 time: 0.263061 Jan 22 21:11:55.772803 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1940/4042] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:55 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1517 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:56.109901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3d3eebf0-ca0a-4815-9ba6-5c1700cfdd23 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:56.111186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3d3eebf0-ca0a-4815-9ba6-5c1700cfdd23 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:56.118767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d3eebf0-ca0a-4815-9ba6-5c1700cfdd23 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:56.125103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d3eebf0-ca0a-4815-9ba6-5c1700cfdd23 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:56.125103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d3eebf0-ca0a-4815-9ba6-5c1700cfdd23 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:56.125103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d3eebf0-ca0a-4815-9ba6-5c1700cfdd23 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:56.131405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-792a9a50-f856-4e53-82be-9a5c973a2052 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:56.132158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-792a9a50-f856-4e53-82be-9a5c973a2052 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:56.150642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-792a9a50-f856-4e53-82be-9a5c973a2052 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:56.151225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-792a9a50-f856-4e53-82be-9a5c973a2052 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:56.152109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-792a9a50-f856-4e53-82be-9a5c973a2052 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:56.152624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-792a9a50-f856-4e53-82be-9a5c973a2052 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:56.295558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3d3eebf0-ca0a-4815-9ba6-5c1700cfdd23 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:56.305136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-792a9a50-f856-4e53-82be-9a5c973a2052 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:56.309893 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3d3eebf0-ca0a-4815-9ba6-5c1700cfdd23 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.205563 Jan 22 21:11:56.310493 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2103/4043] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:56 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:56.316840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8bdc222d-ee4f-4fc3-919e-b5919f09a658 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:56.318035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8bdc222d-ee4f-4fc3-919e-b5919f09a658 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:56.318363 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-792a9a50-f856-4e53-82be-9a5c973a2052 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1473 microversion: 2.1 time: 0.190902 Jan 22 21:11:56.319074 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1941/4044] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:56 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1473 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:56.323610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b3fbe652-e131-464f-8b60-98c766681b21 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:56.324557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bdc222d-ee4f-4fc3-919e-b5919f09a658 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:56.324927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b3fbe652-e131-464f-8b60-98c766681b21 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:56.325440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bdc222d-ee4f-4fc3-919e-b5919f09a658 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:56.326265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bdc222d-ee4f-4fc3-919e-b5919f09a658 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:56.326711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bdc222d-ee4f-4fc3-919e-b5919f09a658 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:56.333051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3fbe652-e131-464f-8b60-98c766681b21 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:56.333541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3fbe652-e131-464f-8b60-98c766681b21 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:56.334350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3fbe652-e131-464f-8b60-98c766681b21 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:56.334798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3fbe652-e131-464f-8b60-98c766681b21 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:56.376882 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8bdc222d-ee4f-4fc3-919e-b5919f09a658 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.065126 Jan 22 21:11:56.377802 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2104/4045] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:56 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:56.389068 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b3fbe652-e131-464f-8b60-98c766681b21 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.068587 Jan 22 21:11:56.389770 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1942/4046] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:56 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:56.454567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-28514d23-6e9b-49c1-848c-cb747690d92e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:56.455265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-28514d23-6e9b-49c1-848c-cb747690d92e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:56.463028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28514d23-6e9b-49c1-848c-cb747690d92e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:56.463499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28514d23-6e9b-49c1-848c-cb747690d92e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:56.464432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28514d23-6e9b-49c1-848c-cb747690d92e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:56.464882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28514d23-6e9b-49c1-848c-cb747690d92e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:56.796957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1b83283e-6baf-4329-a9b0-3e4bdf5d2345 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:56.797801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1b83283e-6baf-4329-a9b0-3e4bdf5d2345 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:56.805396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b83283e-6baf-4329-a9b0-3e4bdf5d2345 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:56.806488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b83283e-6baf-4329-a9b0-3e4bdf5d2345 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:56.807485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b83283e-6baf-4329-a9b0-3e4bdf5d2345 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:56.807947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b83283e-6baf-4329-a9b0-3e4bdf5d2345 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:56.830786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-28514d23-6e9b-49c1-848c-cb747690d92e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:56.838608 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-28514d23-6e9b-49c1-848c-cb747690d92e tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.388258 Jan 22 21:11:56.839125 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2105/4047] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:56 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:57.049688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1b83283e-6baf-4329-a9b0-3e4bdf5d2345 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:57.058212 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1b83283e-6baf-4329-a9b0-3e4bdf5d2345 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1517 microversion: 2.1 time: 0.265495 Jan 22 21:11:57.058793 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1943/4048] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:56 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1517 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:57.332275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-09c84e5b-64da-4b67-ae88-6871d7760c44 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:57.332897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-09c84e5b-64da-4b67-ae88-6871d7760c44 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:57.338303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8f908ed7-e5e0-4d71-9c17-e62c8bfe4a5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:57.338936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8f908ed7-e5e0-4d71-9c17-e62c8bfe4a5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:57.348985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f908ed7-e5e0-4d71-9c17-e62c8bfe4a5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:57.349439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f908ed7-e5e0-4d71-9c17-e62c8bfe4a5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:57.350270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f908ed7-e5e0-4d71-9c17-e62c8bfe4a5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:57.350739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f908ed7-e5e0-4d71-9c17-e62c8bfe4a5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:57.355738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09c84e5b-64da-4b67-ae88-6871d7760c44 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:57.356201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09c84e5b-64da-4b67-ae88-6871d7760c44 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:57.357005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09c84e5b-64da-4b67-ae88-6871d7760c44 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:57.357456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09c84e5b-64da-4b67-ae88-6871d7760c44 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:57.522155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-09c84e5b-64da-4b67-ae88-6871d7760c44 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:57.530555 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-09c84e5b-64da-4b67-ae88-6871d7760c44 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.201931 Jan 22 21:11:57.531131 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2106/4049] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:57 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:57.531708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8f908ed7-e5e0-4d71-9c17-e62c8bfe4a5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:57.539496 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8f908ed7-e5e0-4d71-9c17-e62c8bfe4a5e tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1473 microversion: 2.1 time: 0.205218 Jan 22 21:11:57.541387 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1944/4050] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:57 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1473 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:57.545431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a945e5d8-ac04-4631-8973-379ff49953fe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:57.545971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-17b075e7-64a9-46ba-88a8-a4cf109298df tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:57.546451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a945e5d8-ac04-4631-8973-379ff49953fe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:57.546947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-17b075e7-64a9-46ba-88a8-a4cf109298df tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:57.552472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a945e5d8-ac04-4631-8973-379ff49953fe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:57.552851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17b075e7-64a9-46ba-88a8-a4cf109298df tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:57.552955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a945e5d8-ac04-4631-8973-379ff49953fe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:57.553311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17b075e7-64a9-46ba-88a8-a4cf109298df tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:57.553762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a945e5d8-ac04-4631-8973-379ff49953fe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:57.554126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17b075e7-64a9-46ba-88a8-a4cf109298df tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:57.554224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a945e5d8-ac04-4631-8973-379ff49953fe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:57.554569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17b075e7-64a9-46ba-88a8-a4cf109298df tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:57.607751 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-17b075e7-64a9-46ba-88a8-a4cf109298df tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.065015 Jan 22 21:11:57.608422 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1945/4051] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:57 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:57.615434 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a945e5d8-ac04-4631-8973-379ff49953fe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.073446 Jan 22 21:11:57.616620 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2107/4052] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:57 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:57.855093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ea69c5dd-25f4-4970-95bb-a431fbd9e347 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:57.856020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ea69c5dd-25f4-4970-95bb-a431fbd9e347 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:57.865996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea69c5dd-25f4-4970-95bb-a431fbd9e347 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:57.866776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea69c5dd-25f4-4970-95bb-a431fbd9e347 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:57.867394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea69c5dd-25f4-4970-95bb-a431fbd9e347 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:57.867973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea69c5dd-25f4-4970-95bb-a431fbd9e347 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:58.080024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9198f2fc-5210-4811-9c77-226a0f47d28b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:58.081213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9198f2fc-5210-4811-9c77-226a0f47d28b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:58.092950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9198f2fc-5210-4811-9c77-226a0f47d28b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:58.093871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9198f2fc-5210-4811-9c77-226a0f47d28b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:58.095341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9198f2fc-5210-4811-9c77-226a0f47d28b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:58.096033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9198f2fc-5210-4811-9c77-226a0f47d28b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:58.098737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ea69c5dd-25f4-4970-95bb-a431fbd9e347 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:58.106752 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ea69c5dd-25f4-4970-95bb-a431fbd9e347 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.255574 Jan 22 21:11:58.107807 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1946/4053] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:57 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:58.260864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9198f2fc-5210-4811-9c77-226a0f47d28b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:58.268393 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9198f2fc-5210-4811-9c77-226a0f47d28b tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1517 microversion: 2.1 time: 0.196792 Jan 22 21:11:58.268960 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2108/4054] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:58 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1517 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:58.389452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-2eae4807-5d56-47a0-a123-7dc482dc1c71 req-069a2917-4ea9-4b3e-af4e-2d2e65f853de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a45a6b1-24c6-4009-ad8f-6203f05d6777", "name": "network-vif-deleted", "tag": "ac95681d-6279-428c-a0df-b7ba96ca5f3d"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:58.391692 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:11:58.391692 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:11:58.400771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2eae4807-5d56-47a0-a123-7dc482dc1c71 req-069a2917-4ea9-4b3e-af4e-2d2e65f853de service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:58.401316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2eae4807-5d56-47a0-a123-7dc482dc1c71 req-069a2917-4ea9-4b3e-af4e-2d2e65f853de service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:58.416814 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-2eae4807-5d56-47a0-a123-7dc482dc1c71 req-069a2917-4ea9-4b3e-af4e-2d2e65f853de service nova] Creating event network-vif-deleted:ac95681d-6279-428c-a0df-b7ba96ca5f3d for instance 5a45a6b1-24c6-4009-ad8f-6203f05d6777 on nch2-master-1 Jan 22 21:11:58.422813 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-2eae4807-5d56-47a0-a123-7dc482dc1c71 req-069a2917-4ea9-4b3e-af4e-2d2e65f853de service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037005 Jan 22 21:11:58.426923 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1947/4055] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:11:58.547685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d0eae83-96b2-4f0f-8da8-d71cd058b7c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:58.548404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d0eae83-96b2-4f0f-8da8-d71cd058b7c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:58.555715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d0eae83-96b2-4f0f-8da8-d71cd058b7c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:58.556451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d0eae83-96b2-4f0f-8da8-d71cd058b7c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:58.557524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d0eae83-96b2-4f0f-8da8-d71cd058b7c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:58.557976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8196846c-f5e4-4345-b42d-67f312315e64 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:58.558115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d0eae83-96b2-4f0f-8da8-d71cd058b7c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:58.558611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8196846c-f5e4-4345-b42d-67f312315e64 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:58.564828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8196846c-f5e4-4345-b42d-67f312315e64 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:58.565278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8196846c-f5e4-4345-b42d-67f312315e64 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:58.566094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8196846c-f5e4-4345-b42d-67f312315e64 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:58.566530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8196846c-f5e4-4345-b42d-67f312315e64 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:58.700395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0d0eae83-96b2-4f0f-8da8-d71cd058b7c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:58.708580 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d0eae83-96b2-4f0f-8da8-d71cd058b7c4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.164694 Jan 22 21:11:58.709253 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2109/4056] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:58 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:58.719356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-216d3e6c-ccb6-4d40-8687-1be0945861d2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:58.719632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8196846c-f5e4-4345-b42d-67f312315e64 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:58.719740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-216d3e6c-ccb6-4d40-8687-1be0945861d2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:58.721939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-216d3e6c-ccb6-4d40-8687-1be0945861d2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:58.722492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-216d3e6c-ccb6-4d40-8687-1be0945861d2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:58.722730 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8196846c-f5e4-4345-b42d-67f312315e64 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.169228 Jan 22 21:11:58.723346 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1948/4057] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:58 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:58.723655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-216d3e6c-ccb6-4d40-8687-1be0945861d2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:58.724395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-216d3e6c-ccb6-4d40-8687-1be0945861d2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:58.728904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d7527279-35ca-432c-b46c-9080ed2a2b69 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:58.729853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d7527279-35ca-432c-b46c-9080ed2a2b69 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:58.736170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7527279-35ca-432c-b46c-9080ed2a2b69 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:58.736637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7527279-35ca-432c-b46c-9080ed2a2b69 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:58.737440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7527279-35ca-432c-b46c-9080ed2a2b69 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:58.737923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7527279-35ca-432c-b46c-9080ed2a2b69 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:58.773901 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-216d3e6c-ccb6-4d40-8687-1be0945861d2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.063175 Jan 22 21:11:58.777648 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2110/4058] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:58 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:58.782458 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d7527279-35ca-432c-b46c-9080ed2a2b69 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.057800 Jan 22 21:11:58.786529 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1949/4059] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:58 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:11:59.123831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d05cd8fd-ae10-4451-83a7-96a4b39e6410 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:59.124542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d05cd8fd-ae10-4451-83a7-96a4b39e6410 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:59.131568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d05cd8fd-ae10-4451-83a7-96a4b39e6410 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:59.132033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d05cd8fd-ae10-4451-83a7-96a4b39e6410 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:59.132828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d05cd8fd-ae10-4451-83a7-96a4b39e6410 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:59.133282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d05cd8fd-ae10-4451-83a7-96a4b39e6410 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:59.285815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bce1dab4-d2dd-4ca4-a3bd-814a17007591 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:59.286520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bce1dab4-d2dd-4ca4-a3bd-814a17007591 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:59.292310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d05cd8fd-ae10-4451-83a7-96a4b39e6410 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:59.294762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bce1dab4-d2dd-4ca4-a3bd-814a17007591 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:59.295220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bce1dab4-d2dd-4ca4-a3bd-814a17007591 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:59.296020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bce1dab4-d2dd-4ca4-a3bd-814a17007591 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:59.296462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bce1dab4-d2dd-4ca4-a3bd-814a17007591 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:59.299992 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d05cd8fd-ae10-4451-83a7-96a4b39e6410 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.180233 Jan 22 21:11:59.300778 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2111/4060] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:59 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:59.330358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bce1dab4-d2dd-4ca4-a3bd-814a17007591 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:59.330843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bce1dab4-d2dd-4ca4-a3bd-814a17007591 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:59.331306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-bce1dab4-d2dd-4ca4-a3bd-814a17007591 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lazy-loading 'fault' on Instance uuid 5a45a6b1-24c6-4009-ad8f-6203f05d6777 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:11:59.372491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bce1dab4-d2dd-4ca4-a3bd-814a17007591 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ead04bf776f146eabbe0f9f32319542b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfa8e2e09994a9d8746ab84c2cc6b6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:59.379477 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bce1dab4-d2dd-4ca4-a3bd-814a17007591 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 200 len: 1312 microversion: 2.1 time: 0.097913 Jan 22 21:11:59.380054 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1950/4061] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:59 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:59.726491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7930085b-86af-44f2-8f81-1e7a7a4254e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:59.727006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7930085b-86af-44f2-8f81-1e7a7a4254e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:59.733776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7930085b-86af-44f2-8f81-1e7a7a4254e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:59.734238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7930085b-86af-44f2-8f81-1e7a7a4254e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:59.735058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7930085b-86af-44f2-8f81-1e7a7a4254e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:59.735500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7930085b-86af-44f2-8f81-1e7a7a4254e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:59.742383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-096c789e-096c-40b9-b54c-f955428c3958 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:11:59.742999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-096c789e-096c-40b9-b54c-f955428c3958 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:59.750768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-096c789e-096c-40b9-b54c-f955428c3958 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:59.751223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-096c789e-096c-40b9-b54c-f955428c3958 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:59.752038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-096c789e-096c-40b9-b54c-f955428c3958 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:59.752481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-096c789e-096c-40b9-b54c-f955428c3958 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:59.892701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7930085b-86af-44f2-8f81-1e7a7a4254e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:59.901560 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7930085b-86af-44f2-8f81-1e7a7a4254e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.178746 Jan 22 21:11:59.902156 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2112/4062] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:59 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:11:59.906769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7b8c37fa-9759-4f4d-8410-53fb94d58b1e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:59.907741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7b8c37fa-9759-4f4d-8410-53fb94d58b1e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:59.913718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b8c37fa-9759-4f4d-8410-53fb94d58b1e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:59.914179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b8c37fa-9759-4f4d-8410-53fb94d58b1e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:59.915009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b8c37fa-9759-4f4d-8410-53fb94d58b1e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:59.915537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b8c37fa-9759-4f4d-8410-53fb94d58b1e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:59.918955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-096c789e-096c-40b9-b54c-f955428c3958 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:11:59.926578 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-096c789e-096c-40b9-b54c-f955428c3958 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.187937 Jan 22 21:11:59.927312 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1951/4063] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:11:59 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:11:59.940823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-607d3169-bd43-478d-b89c-6673f39e0522 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:11:59.948641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-607d3169-bd43-478d-b89c-6673f39e0522 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:11:59.955016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-607d3169-bd43-478d-b89c-6673f39e0522 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:59.955468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-607d3169-bd43-478d-b89c-6673f39e0522 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:59.956260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-607d3169-bd43-478d-b89c-6673f39e0522 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:11:59.956700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-607d3169-bd43-478d-b89c-6673f39e0522 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:11:59.961012 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7b8c37fa-9759-4f4d-8410-53fb94d58b1e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.057587 Jan 22 21:11:59.961692 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2113/4064] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:11:59 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:11:59.998702 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-607d3169-bd43-478d-b89c-6673f39e0522 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.069874 Jan 22 21:11:59.999533 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1952/4065] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:11:59 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:00.316849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-df2c663f-83db-420b-a8df-0f380c555df8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:00.317581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-df2c663f-83db-420b-a8df-0f380c555df8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:00.325573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df2c663f-83db-420b-a8df-0f380c555df8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:00.326047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df2c663f-83db-420b-a8df-0f380c555df8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:00.326885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df2c663f-83db-420b-a8df-0f380c555df8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:00.327624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df2c663f-83db-420b-a8df-0f380c555df8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:00.403033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ba269806-3608-44b0-aec0-2efc9cfcb9a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:00.403798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ba269806-3608-44b0-aec0-2efc9cfcb9a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:00.410746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba269806-3608-44b0-aec0-2efc9cfcb9a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:00.411252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba269806-3608-44b0-aec0-2efc9cfcb9a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:00.412056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba269806-3608-44b0-aec0-2efc9cfcb9a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:00.412673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba269806-3608-44b0-aec0-2efc9cfcb9a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:00.427703 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-ba269806-3608-44b0-aec0-2efc9cfcb9a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] HTTP exception thrown: Instance 5a45a6b1-24c6-4009-ad8f-6203f05d6777 could not be found. Jan 22 21:12:00.428307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ba269806-3608-44b0-aec0-2efc9cfcb9a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Returning 404 to user: Instance 5a45a6b1-24c6-4009-ad8f-6203f05d6777 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:00.429141 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ba269806-3608-44b0-aec0-2efc9cfcb9a1 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 404 len: 111 microversion: 2.1 time: 0.032701 Jan 22 21:12:00.429725 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1953/4066] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:00 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:12:00.467350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-df2c663f-83db-420b-a8df-0f380c555df8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:00.475028 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-df2c663f-83db-420b-a8df-0f380c555df8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.162233 Jan 22 21:12:00.475787 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2114/4067] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:00 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:00.918921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5b1b1cc6-d232-4168-bbbf-3b6bf9786dfa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:00.919533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5b1b1cc6-d232-4168-bbbf-3b6bf9786dfa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:00.926385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b1b1cc6-d232-4168-bbbf-3b6bf9786dfa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:00.926840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b1b1cc6-d232-4168-bbbf-3b6bf9786dfa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:00.927627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b1b1cc6-d232-4168-bbbf-3b6bf9786dfa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:00.928071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b1b1cc6-d232-4168-bbbf-3b6bf9786dfa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:00.944298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b3df482-55a7-4c21-be3c-637455e59e9f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:00.945013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b3df482-55a7-4c21-be3c-637455e59e9f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:00.952582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b3df482-55a7-4c21-be3c-637455e59e9f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:00.952951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b3df482-55a7-4c21-be3c-637455e59e9f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:00.953784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b3df482-55a7-4c21-be3c-637455e59e9f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:00.954232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b3df482-55a7-4c21-be3c-637455e59e9f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:01.071605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5b1b1cc6-d232-4168-bbbf-3b6bf9786dfa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:01.080235 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5b1b1cc6-d232-4168-bbbf-3b6bf9786dfa tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.165462 Jan 22 21:12:01.100094 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1954/4068] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:00 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:01.100094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7e183f48-6058-4252-a2c1-ace8ac0fe944 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:01.100094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7e183f48-6058-4252-a2c1-ace8ac0fe944 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:01.100094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e183f48-6058-4252-a2c1-ace8ac0fe944 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:01.100094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e183f48-6058-4252-a2c1-ace8ac0fe944 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:01.100094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e183f48-6058-4252-a2c1-ace8ac0fe944 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:01.100094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e183f48-6058-4252-a2c1-ace8ac0fe944 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:01.109463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8b3df482-55a7-4c21-be3c-637455e59e9f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:01.117343 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b3df482-55a7-4c21-be3c-637455e59e9f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.176746 Jan 22 21:12:01.118054 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2115/4069] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:00 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:01.123658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-12e8158d-705f-4cbc-9ad7-ae38e8e04153 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:01.124605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-12e8158d-705f-4cbc-9ad7-ae38e8e04153 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:01.130582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12e8158d-705f-4cbc-9ad7-ae38e8e04153 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:01.131044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12e8158d-705f-4cbc-9ad7-ae38e8e04153 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:01.131840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12e8158d-705f-4cbc-9ad7-ae38e8e04153 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:01.132287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12e8158d-705f-4cbc-9ad7-ae38e8e04153 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:01.140409 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7e183f48-6058-4252-a2c1-ace8ac0fe944 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.058241 Jan 22 21:12:01.141548 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1955/4070] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:01 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:01.176018 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-12e8158d-705f-4cbc-9ad7-ae38e8e04153 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 24577 microversion: 2.42 time: 0.053996 Jan 22 21:12:01.176018 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2116/4071] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:01 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 24577 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:01.492749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-399a0f05-a80e-49d7-8f91-dd51c8e132a5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:01.493456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-399a0f05-a80e-49d7-8f91-dd51c8e132a5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:01.502042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-399a0f05-a80e-49d7-8f91-dd51c8e132a5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:01.502505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-399a0f05-a80e-49d7-8f91-dd51c8e132a5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:01.503305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-399a0f05-a80e-49d7-8f91-dd51c8e132a5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:01.503757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-399a0f05-a80e-49d7-8f91-dd51c8e132a5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:01.644835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-399a0f05-a80e-49d7-8f91-dd51c8e132a5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:01.652880 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-399a0f05-a80e-49d7-8f91-dd51c8e132a5 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.164267 Jan 22 21:12:01.653454 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1956/4072] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:01 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:01.937587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e39a5afe-c5b3-42a3-a38f-09c092b9bff6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:01.938173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e39a5afe-c5b3-42a3-a38f-09c092b9bff6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:01.945097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e39a5afe-c5b3-42a3-a38f-09c092b9bff6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:01.945711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e39a5afe-c5b3-42a3-a38f-09c092b9bff6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:01.946440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e39a5afe-c5b3-42a3-a38f-09c092b9bff6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:01.947017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e39a5afe-c5b3-42a3-a38f-09c092b9bff6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:01.962612 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-e39a5afe-c5b3-42a3-a38f-09c092b9bff6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance afd13882-2a28-4355-a3d1-606aa99e9971 could not be found. Jan 22 21:12:01.963269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e39a5afe-c5b3-42a3-a38f-09c092b9bff6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance afd13882-2a28-4355-a3d1-606aa99e9971 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:01.964096 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e39a5afe-c5b3-42a3-a38f-09c092b9bff6 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "DELETE /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 404 len: 111 microversion: 2.1 time: 0.030621 Jan 22 21:12:01.965017 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2117/4073] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:01 2022] DELETE /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:12:01.972762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0eff31f9-72dc-4d88-bfc2-6a12fc8f76f8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:01.973542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0eff31f9-72dc-4d88-bfc2-6a12fc8f76f8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: afd13882-2a28-4355-a3d1-606aa99e9971] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:01.981322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0eff31f9-72dc-4d88-bfc2-6a12fc8f76f8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:01.981672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0eff31f9-72dc-4d88-bfc2-6a12fc8f76f8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:01.982528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0eff31f9-72dc-4d88-bfc2-6a12fc8f76f8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:01.982976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0eff31f9-72dc-4d88-bfc2-6a12fc8f76f8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:01.997280 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-0eff31f9-72dc-4d88-bfc2-6a12fc8f76f8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance afd13882-2a28-4355-a3d1-606aa99e9971 could not be found. Jan 22 21:12:01.997914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0eff31f9-72dc-4d88-bfc2-6a12fc8f76f8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance afd13882-2a28-4355-a3d1-606aa99e9971 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:01.998908 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0eff31f9-72dc-4d88-bfc2-6a12fc8f76f8 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971" status: 404 len: 111 microversion: 2.1 time: 0.029747 Jan 22 21:12:01.999474 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1957/4074] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:01 2022] GET /compute/v2.1/servers/afd13882-2a28-4355-a3d1-606aa99e9971 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:02.007294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0eac5930-e884-444e-9474-0fcacefa1ddb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:02.007823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0eac5930-e884-444e-9474-0fcacefa1ddb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:02.014455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0eac5930-e884-444e-9474-0fcacefa1ddb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:02.014911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0eac5930-e884-444e-9474-0fcacefa1ddb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:02.015703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0eac5930-e884-444e-9474-0fcacefa1ddb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:02.016149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0eac5930-e884-444e-9474-0fcacefa1ddb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:02.042565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0eac5930-e884-444e-9474-0fcacefa1ddb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:12:02.098394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-73d46a29-e2e7-453e-99d7-0947e8af89e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:02.099039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-73d46a29-e2e7-453e-99d7-0947e8af89e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:02.105724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73d46a29-e2e7-453e-99d7-0947e8af89e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:02.106141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73d46a29-e2e7-453e-99d7-0947e8af89e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:02.106928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73d46a29-e2e7-453e-99d7-0947e8af89e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:02.107371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73d46a29-e2e7-453e-99d7-0947e8af89e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:02.249715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-73d46a29-e2e7-453e-99d7-0947e8af89e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:02.260192 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-73d46a29-e2e7-453e-99d7-0947e8af89e3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.164817 Jan 22 21:12:02.261858 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1958/4075] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:02 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:02.274229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2a678438-9d42-4d28-8e76-dddc345d2d03 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:02.275060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2a678438-9d42-4d28-8e76-dddc345d2d03 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:02.281079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a678438-9d42-4d28-8e76-dddc345d2d03 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:02.284080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a678438-9d42-4d28-8e76-dddc345d2d03 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:02.284080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a678438-9d42-4d28-8e76-dddc345d2d03 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:02.284080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a678438-9d42-4d28-8e76-dddc345d2d03 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:02.355792 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0eac5930-e884-444e-9474-0fcacefa1ddb tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "DELETE /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 204 len: 0 microversion: 2.1 time: 0.351931 Jan 22 21:12:02.356385 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2118/4076] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:02 2022] DELETE /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:12:02.362956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fea588e6-3e5e-405c-960b-ca0bd1f0434f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:02.363973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fea588e6-3e5e-405c-960b-ca0bd1f0434f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:02.371101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fea588e6-3e5e-405c-960b-ca0bd1f0434f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:02.371564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fea588e6-3e5e-405c-960b-ca0bd1f0434f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:02.372398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fea588e6-3e5e-405c-960b-ca0bd1f0434f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:02.373488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fea588e6-3e5e-405c-960b-ca0bd1f0434f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:02.414823 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fea588e6-3e5e-405c-960b-ca0bd1f0434f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.055532 Jan 22 21:12:02.416008 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2119/4077] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:02 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:02.421911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0f8ccc5f-14c6-4613-bb35-5071725c454c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:02.422908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0f8ccc5f-14c6-4613-bb35-5071725c454c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:02.427586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2a678438-9d42-4d28-8e76-dddc345d2d03 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:02.430086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f8ccc5f-14c6-4613-bb35-5071725c454c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:02.430544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f8ccc5f-14c6-4613-bb35-5071725c454c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:02.432112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f8ccc5f-14c6-4613-bb35-5071725c454c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:02.432811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f8ccc5f-14c6-4613-bb35-5071725c454c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:02.435889 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2a678438-9d42-4d28-8e76-dddc345d2d03 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.165383 Jan 22 21:12:02.436502 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1959/4078] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:02 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:02.440867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c79aaad5-6805-43da-88a7-63c0f984410f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:02.443246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c79aaad5-6805-43da-88a7-63c0f984410f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:02.447654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c79aaad5-6805-43da-88a7-63c0f984410f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:02.448199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c79aaad5-6805-43da-88a7-63c0f984410f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:02.449057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c79aaad5-6805-43da-88a7-63c0f984410f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:02.451463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c79aaad5-6805-43da-88a7-63c0f984410f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:02.512630 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0f8ccc5f-14c6-4613-bb35-5071725c454c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.094674 Jan 22 21:12:02.513331 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2120/4079] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:02 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:02.590017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c79aaad5-6805-43da-88a7-63c0f984410f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:02.597803 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c79aaad5-6805-43da-88a7-63c0f984410f tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1515 microversion: 2.1 time: 0.160223 Jan 22 21:12:02.598376 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1960/4080] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:02 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:02.675538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d4d21d8-3191-41df-bbe2-b6045915c61d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:02.676245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d4d21d8-3191-41df-bbe2-b6045915c61d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:02.683465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d4d21d8-3191-41df-bbe2-b6045915c61d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:02.683951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d4d21d8-3191-41df-bbe2-b6045915c61d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:02.684778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d4d21d8-3191-41df-bbe2-b6045915c61d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:02.685230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d4d21d8-3191-41df-bbe2-b6045915c61d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:02.830406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5d4d21d8-3191-41df-bbe2-b6045915c61d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:02.838564 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d4d21d8-3191-41df-bbe2-b6045915c61d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.167061 Jan 22 21:12:02.839264 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2121/4081] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:02 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:03.277981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8bb6714e-a572-44ff-baae-8166b9c4908f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:03.278596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8bb6714e-a572-44ff-baae-8166b9c4908f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:03.285327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bb6714e-a572-44ff-baae-8166b9c4908f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:03.285822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bb6714e-a572-44ff-baae-8166b9c4908f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:03.286611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bb6714e-a572-44ff-baae-8166b9c4908f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:03.287056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bb6714e-a572-44ff-baae-8166b9c4908f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:03.420165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8bb6714e-a572-44ff-baae-8166b9c4908f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:03.426813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-044c7c0a-105c-49e4-a59b-593dac2d1208 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:03.431689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-044c7c0a-105c-49e4-a59b-593dac2d1208 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:03.431851 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8bb6714e-a572-44ff-baae-8166b9c4908f tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.154218 Jan 22 21:12:03.431851 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1961/4082] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:03 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:03.436328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-044c7c0a-105c-49e4-a59b-593dac2d1208 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:03.436792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-044c7c0a-105c-49e4-a59b-593dac2d1208 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:03.437725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-044c7c0a-105c-49e4-a59b-593dac2d1208 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:03.438177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-044c7c0a-105c-49e4-a59b-593dac2d1208 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:03.453314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6718f2b9-dbb1-48c0-b422-4b95cca8f4df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:03.453897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6718f2b9-dbb1-48c0-b422-4b95cca8f4df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:03.459609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6718f2b9-dbb1-48c0-b422-4b95cca8f4df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:03.460064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6718f2b9-dbb1-48c0-b422-4b95cca8f4df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:03.460847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6718f2b9-dbb1-48c0-b422-4b95cca8f4df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:03.461288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6718f2b9-dbb1-48c0-b422-4b95cca8f4df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:03.477061 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-044c7c0a-105c-49e4-a59b-593dac2d1208 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.053892 Jan 22 21:12:03.478280 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2122/4083] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:03 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:12:03.524941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c6b13514-3382-46d3-8377-95d9af83a750 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:03.525983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c6b13514-3382-46d3-8377-95d9af83a750 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:03.533080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6b13514-3382-46d3-8377-95d9af83a750 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:03.533564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6b13514-3382-46d3-8377-95d9af83a750 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:03.534452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6b13514-3382-46d3-8377-95d9af83a750 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:03.534899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6b13514-3382-46d3-8377-95d9af83a750 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:03.579387 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c6b13514-3382-46d3-8377-95d9af83a750 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.058471 Jan 22 21:12:03.583341 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2123/4084] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:03 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:03.601548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6718f2b9-dbb1-48c0-b422-4b95cca8f4df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:03.609443 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6718f2b9-dbb1-48c0-b422-4b95cca8f4df tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.159982 Jan 22 21:12:03.610038 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1962/4085] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:03 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:03.615458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aed8f01e-b821-4ab8-99c7-4324508faf06 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:03.616218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aed8f01e-b821-4ab8-99c7-4324508faf06 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:03.624101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aed8f01e-b821-4ab8-99c7-4324508faf06 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:03.624610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aed8f01e-b821-4ab8-99c7-4324508faf06 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:03.625394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aed8f01e-b821-4ab8-99c7-4324508faf06 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:03.625871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aed8f01e-b821-4ab8-99c7-4324508faf06 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:03.768093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aed8f01e-b821-4ab8-99c7-4324508faf06 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:03.775601 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aed8f01e-b821-4ab8-99c7-4324508faf06 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1515 microversion: 2.1 time: 0.164288 Jan 22 21:12:03.776157 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2124/4086] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:03 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:03.856441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e2812c06-7691-403c-bd54-100fcd3510b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:03.862706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e2812c06-7691-403c-bd54-100fcd3510b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:03.863211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2812c06-7691-403c-bd54-100fcd3510b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:03.863708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2812c06-7691-403c-bd54-100fcd3510b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:03.864608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2812c06-7691-403c-bd54-100fcd3510b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:03.864895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2812c06-7691-403c-bd54-100fcd3510b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:03.999700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e2812c06-7691-403c-bd54-100fcd3510b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:04.007171 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e2812c06-7691-403c-bd54-100fcd3510b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.155318 Jan 22 21:12:04.007734 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1963/4087] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:03 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:04.445409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-15fedc9e-d729-41c6-8f98-f8df54881b84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:04.446064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-15fedc9e-d729-41c6-8f98-f8df54881b84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:04.453731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15fedc9e-d729-41c6-8f98-f8df54881b84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:04.454201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15fedc9e-d729-41c6-8f98-f8df54881b84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:04.455012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15fedc9e-d729-41c6-8f98-f8df54881b84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:04.455465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15fedc9e-d729-41c6-8f98-f8df54881b84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:04.489040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a81f0fdb-1a63-49f5-b386-c14bd900fc52 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:04.490264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a81f0fdb-1a63-49f5-b386-c14bd900fc52 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:04.498033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a81f0fdb-1a63-49f5-b386-c14bd900fc52 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:04.498562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a81f0fdb-1a63-49f5-b386-c14bd900fc52 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:04.499454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a81f0fdb-1a63-49f5-b386-c14bd900fc52 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:04.499970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a81f0fdb-1a63-49f5-b386-c14bd900fc52 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:04.543792 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a81f0fdb-1a63-49f5-b386-c14bd900fc52 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.058283 Jan 22 21:12:04.546972 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1964/4088] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:04 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:12:04.592989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-215bfce6-ebe1-48f6-aa66-5a2caeea6129 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:04.594039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-215bfce6-ebe1-48f6-aa66-5a2caeea6129 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:04.595154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-15fedc9e-d729-41c6-8f98-f8df54881b84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:04.601221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-215bfce6-ebe1-48f6-aa66-5a2caeea6129 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:04.601703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-215bfce6-ebe1-48f6-aa66-5a2caeea6129 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:04.602501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-215bfce6-ebe1-48f6-aa66-5a2caeea6129 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:04.602881 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-15fedc9e-d729-41c6-8f98-f8df54881b84 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.161127 Jan 22 21:12:04.603008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-215bfce6-ebe1-48f6-aa66-5a2caeea6129 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:04.603859 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2125/4089] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:04 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:04.626948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ab05993-d2ce-4d57-9181-8c682ae2e499 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:04.627564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1ab05993-d2ce-4d57-9181-8c682ae2e499 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:04.633804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ab05993-d2ce-4d57-9181-8c682ae2e499 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:04.634969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ab05993-d2ce-4d57-9181-8c682ae2e499 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:04.636054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ab05993-d2ce-4d57-9181-8c682ae2e499 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:04.636506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ab05993-d2ce-4d57-9181-8c682ae2e499 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:04.648067 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-215bfce6-ebe1-48f6-aa66-5a2caeea6129 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.059972 Jan 22 21:12:04.649863 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1965/4090] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:04 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:04.745604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-258f6df8-4ddc-44cc-b427-8500a64be3b4 req-f519bfe8-dae6-49ba-b088-6421d0c9d4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49b2aed8-f03f-4c04-b508-cc9a7e172dd6", "name": "network-vif-deleted", "tag": "99dd6838-12b2-4c2b-b219-2af5c1a44a74"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:04.747539 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:04.747539 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:12:04.755307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-258f6df8-4ddc-44cc-b427-8500a64be3b4 req-f519bfe8-dae6-49ba-b088-6421d0c9d4c4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:04.755763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-258f6df8-4ddc-44cc-b427-8500a64be3b4 req-f519bfe8-dae6-49ba-b088-6421d0c9d4c4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:04.768237 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-258f6df8-4ddc-44cc-b427-8500a64be3b4 req-f519bfe8-dae6-49ba-b088-6421d0c9d4c4 service nova] Creating event network-vif-deleted:99dd6838-12b2-4c2b-b219-2af5c1a44a74 for instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 on nch1-master-1 Jan 22 21:12:04.773587 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-258f6df8-4ddc-44cc-b427-8500a64be3b4 req-f519bfe8-dae6-49ba-b088-6421d0c9d4c4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033302 Jan 22 21:12:04.774274 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1966/4091] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:12:04.793961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ca5b2aac-3c85-4d51-900d-556249feb6f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:04.794671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ca5b2aac-3c85-4d51-900d-556249feb6f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:04.805447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca5b2aac-3c85-4d51-900d-556249feb6f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:04.805447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca5b2aac-3c85-4d51-900d-556249feb6f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:04.805447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca5b2aac-3c85-4d51-900d-556249feb6f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:04.805447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca5b2aac-3c85-4d51-900d-556249feb6f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:04.806218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1ab05993-d2ce-4d57-9181-8c682ae2e499 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:04.813223 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ab05993-d2ce-4d57-9181-8c682ae2e499 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.189903 Jan 22 21:12:04.813847 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2126/4092] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:04 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:04.865040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ca5b2aac-3c85-4d51-900d-556249feb6f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2391e0ef53e044aabb95c2563c931028', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f96634e81cc246f1ae4438f83a03ed79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:04.873394 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ca5b2aac-3c85-4d51-900d-556249feb6f1 tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 200 len: 1473 microversion: 2.1 time: 0.084829 Jan 22 21:12:04.875382 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1967/4093] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:04 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 1473 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:05.024067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5578b22c-6c35-4d4c-9964-462f0896d0ee tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:05.025255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5578b22c-6c35-4d4c-9964-462f0896d0ee tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:05.031538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5578b22c-6c35-4d4c-9964-462f0896d0ee tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:05.032118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5578b22c-6c35-4d4c-9964-462f0896d0ee tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:05.032913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5578b22c-6c35-4d4c-9964-462f0896d0ee tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:05.033365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5578b22c-6c35-4d4c-9964-462f0896d0ee tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:05.176251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5578b22c-6c35-4d4c-9964-462f0896d0ee tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:05.184543 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5578b22c-6c35-4d4c-9964-462f0896d0ee tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.164298 Jan 22 21:12:05.185143 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2127/4094] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:05 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:05.554523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f557640e-ee85-4102-bc98-364825fee948 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:05.555473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f557640e-ee85-4102-bc98-364825fee948 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:05.562536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f557640e-ee85-4102-bc98-364825fee948 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:05.563045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f557640e-ee85-4102-bc98-364825fee948 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:05.563846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f557640e-ee85-4102-bc98-364825fee948 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:05.564295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f557640e-ee85-4102-bc98-364825fee948 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:05.604888 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f557640e-ee85-4102-bc98-364825fee948 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.053750 Jan 22 21:12:05.606249 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1968/4095] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:05 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:05.621811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-833ab8b0-6473-41cf-8836-ee558fd18754 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:05.622473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-833ab8b0-6473-41cf-8836-ee558fd18754 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:05.629768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-833ab8b0-6473-41cf-8836-ee558fd18754 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:05.630411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-833ab8b0-6473-41cf-8836-ee558fd18754 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:05.631244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-833ab8b0-6473-41cf-8836-ee558fd18754 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:05.631697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-833ab8b0-6473-41cf-8836-ee558fd18754 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:05.660885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-10c682f3-f760-48ef-ba17-659f075fce50 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:05.662137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-10c682f3-f760-48ef-ba17-659f075fce50 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:05.669813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10c682f3-f760-48ef-ba17-659f075fce50 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:05.670268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10c682f3-f760-48ef-ba17-659f075fce50 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:05.671069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10c682f3-f760-48ef-ba17-659f075fce50 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:05.671666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10c682f3-f760-48ef-ba17-659f075fce50 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:05.717496 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-10c682f3-f760-48ef-ba17-659f075fce50 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.060673 Jan 22 21:12:05.718471 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1969/4096] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:05 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:05.786111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-833ab8b0-6473-41cf-8836-ee558fd18754 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:05.794643 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-833ab8b0-6473-41cf-8836-ee558fd18754 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.178305 Jan 22 21:12:05.795219 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2128/4097] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:05 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:05.830925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-92a5c511-9fae-4f41-bc83-373f63820b63 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:05.831687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-92a5c511-9fae-4f41-bc83-373f63820b63 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:05.839382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92a5c511-9fae-4f41-bc83-373f63820b63 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:05.839837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92a5c511-9fae-4f41-bc83-373f63820b63 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:05.840611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92a5c511-9fae-4f41-bc83-373f63820b63 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:05.841052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92a5c511-9fae-4f41-bc83-373f63820b63 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:05.891998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d66635ae-f084-4829-ba08-e44dd15b8e6c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:05.892532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d66635ae-f084-4829-ba08-e44dd15b8e6c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] [instance: 49b2aed8-f03f-4c04-b508-cc9a7e172dd6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:05.898784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d66635ae-f084-4829-ba08-e44dd15b8e6c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:05.901404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d66635ae-f084-4829-ba08-e44dd15b8e6c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:05.901404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d66635ae-f084-4829-ba08-e44dd15b8e6c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:05.901404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d66635ae-f084-4829-ba08-e44dd15b8e6c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:05.914480 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-d66635ae-f084-4829-ba08-e44dd15b8e6c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] HTTP exception thrown: Instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 could not be found. Jan 22 21:12:05.915094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d66635ae-f084-4829-ba08-e44dd15b8e6c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] Returning 404 to user: Instance 49b2aed8-f03f-4c04-b508-cc9a7e172dd6 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:05.916073 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d66635ae-f084-4829-ba08-e44dd15b8e6c tempest-ServersNegativeTestJSON-1390801861 tempest-ServersNegativeTestJSON-1390801861-project] 10.222.0.100 "GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6" status: 404 len: 111 microversion: 2.1 time: 0.027964 Jan 22 21:12:05.917257 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2129/4098] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:05 2022] GET /compute/v2.1/servers/49b2aed8-f03f-4c04-b508-cc9a7e172dd6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:12:05.977705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-92a5c511-9fae-4f41-bc83-373f63820b63 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:05.986137 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-92a5c511-9fae-4f41-bc83-373f63820b63 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.159466 Jan 22 21:12:05.987289 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1970/4099] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:05 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:06.202876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-591f4421-ec7c-4f94-91b3-97bbfa54e9a8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:06.203558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-591f4421-ec7c-4f94-91b3-97bbfa54e9a8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:06.211506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-591f4421-ec7c-4f94-91b3-97bbfa54e9a8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:06.212171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-591f4421-ec7c-4f94-91b3-97bbfa54e9a8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:06.213150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-591f4421-ec7c-4f94-91b3-97bbfa54e9a8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:06.214243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-591f4421-ec7c-4f94-91b3-97bbfa54e9a8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:06.354812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-591f4421-ec7c-4f94-91b3-97bbfa54e9a8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:06.364012 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-591f4421-ec7c-4f94-91b3-97bbfa54e9a8 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.166392 Jan 22 21:12:06.364739 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2130/4100] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:06 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:06.617097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5970c01d-5a3b-48ea-bb67-70dca5fecb93 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:06.618574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5970c01d-5a3b-48ea-bb67-70dca5fecb93 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:06.627465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5970c01d-5a3b-48ea-bb67-70dca5fecb93 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:06.629479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5970c01d-5a3b-48ea-bb67-70dca5fecb93 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:06.629479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5970c01d-5a3b-48ea-bb67-70dca5fecb93 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:06.629479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5970c01d-5a3b-48ea-bb67-70dca5fecb93 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:06.668816 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5970c01d-5a3b-48ea-bb67-70dca5fecb93 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.055997 Jan 22 21:12:06.669409 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1971/4101] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:06 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:06.731336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-999e5508-7976-4422-b191-ed6aa7183fa3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:06.732398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-999e5508-7976-4422-b191-ed6aa7183fa3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:06.739455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-999e5508-7976-4422-b191-ed6aa7183fa3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:06.739910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-999e5508-7976-4422-b191-ed6aa7183fa3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:06.740769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-999e5508-7976-4422-b191-ed6aa7183fa3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:06.741212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-999e5508-7976-4422-b191-ed6aa7183fa3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:06.782787 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-999e5508-7976-4422-b191-ed6aa7183fa3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.055716 Jan 22 21:12:06.783426 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2131/4102] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:06 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:06.818455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-65387929-620d-4522-a479-d1f343dcff7e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:06.819143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-65387929-620d-4522-a479-d1f343dcff7e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:06.827362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65387929-620d-4522-a479-d1f343dcff7e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:06.827810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65387929-620d-4522-a479-d1f343dcff7e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:06.828584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65387929-620d-4522-a479-d1f343dcff7e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:06.829027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65387929-620d-4522-a479-d1f343dcff7e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:07.004214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d42e7f47-f446-4e04-8e81-87e053bd0d19 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:07.004916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d42e7f47-f446-4e04-8e81-87e053bd0d19 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:07.012898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d42e7f47-f446-4e04-8e81-87e053bd0d19 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:07.013397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d42e7f47-f446-4e04-8e81-87e053bd0d19 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:07.014273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d42e7f47-f446-4e04-8e81-87e053bd0d19 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:07.014724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d42e7f47-f446-4e04-8e81-87e053bd0d19 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:07.024207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-65387929-620d-4522-a479-d1f343dcff7e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:07.034052 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-65387929-620d-4522-a479-d1f343dcff7e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.219545 Jan 22 21:12:07.034891 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1972/4103] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:06 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:07.154687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d42e7f47-f446-4e04-8e81-87e053bd0d19 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:07.162344 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d42e7f47-f446-4e04-8e81-87e053bd0d19 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.162289 Jan 22 21:12:07.162915 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2132/4104] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:06 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:07.381845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7cea60c3-a70b-40a6-bd5a-d6467596a27a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:07.382461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7cea60c3-a70b-40a6-bd5a-d6467596a27a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:07.389442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cea60c3-a70b-40a6-bd5a-d6467596a27a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:07.389926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cea60c3-a70b-40a6-bd5a-d6467596a27a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:07.390728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cea60c3-a70b-40a6-bd5a-d6467596a27a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:07.391178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cea60c3-a70b-40a6-bd5a-d6467596a27a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:07.532364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7cea60c3-a70b-40a6-bd5a-d6467596a27a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:07.540255 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7cea60c3-a70b-40a6-bd5a-d6467596a27a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.162078 Jan 22 21:12:07.540811 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1973/4105] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:07 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:07.680274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a89a9ce8-cadd-4652-a204-97c7d82c1e2e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:07.681242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a89a9ce8-cadd-4652-a204-97c7d82c1e2e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:07.688755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a89a9ce8-cadd-4652-a204-97c7d82c1e2e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:07.689240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a89a9ce8-cadd-4652-a204-97c7d82c1e2e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:07.693438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a89a9ce8-cadd-4652-a204-97c7d82c1e2e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:07.693438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a89a9ce8-cadd-4652-a204-97c7d82c1e2e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:07.736073 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a89a9ce8-cadd-4652-a204-97c7d82c1e2e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.058302 Jan 22 21:12:07.737129 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2133/4106] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:07 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:07.795249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0510df75-06e3-450e-b556-9b2b75797c12 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:07.796492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0510df75-06e3-450e-b556-9b2b75797c12 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:07.803075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0510df75-06e3-450e-b556-9b2b75797c12 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:07.803540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0510df75-06e3-450e-b556-9b2b75797c12 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:07.804340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0510df75-06e3-450e-b556-9b2b75797c12 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:07.804782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0510df75-06e3-450e-b556-9b2b75797c12 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:07.846612 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0510df75-06e3-450e-b556-9b2b75797c12 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.055623 Jan 22 21:12:07.847357 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1974/4107] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:07 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:08.051810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dd47c4ad-dd43-46e4-b150-16724f1b2e69 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:08.052518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dd47c4ad-dd43-46e4-b150-16724f1b2e69 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:08.060722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd47c4ad-dd43-46e4-b150-16724f1b2e69 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:08.061190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd47c4ad-dd43-46e4-b150-16724f1b2e69 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:08.062098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd47c4ad-dd43-46e4-b150-16724f1b2e69 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:08.062555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd47c4ad-dd43-46e4-b150-16724f1b2e69 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:08.179886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5f89a901-4d9a-464f-a7b5-3ae03d1061c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:08.180592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5f89a901-4d9a-464f-a7b5-3ae03d1061c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:08.189135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f89a901-4d9a-464f-a7b5-3ae03d1061c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:08.189613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f89a901-4d9a-464f-a7b5-3ae03d1061c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:08.190416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f89a901-4d9a-464f-a7b5-3ae03d1061c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:08.190858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f89a901-4d9a-464f-a7b5-3ae03d1061c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:08.210587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dd47c4ad-dd43-46e4-b150-16724f1b2e69 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:08.218955 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dd47c4ad-dd43-46e4-b150-16724f1b2e69 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.171381 Jan 22 21:12:08.219532 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2134/4108] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:08 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:08.338353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5f89a901-4d9a-464f-a7b5-3ae03d1061c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:08.339499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a383050d-2340-4427-99f9-7e8f5256bf82 tempest-QuotasTestJSON-986789272 tempest-QuotasTestJSON-986789272-project] Calling method '.version_select at 0x7f1ed5dcc670>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:08.346636 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5f89a901-4d9a-464f-a7b5-3ae03d1061c0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.170742 Jan 22 21:12:08.347497 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1975/4109] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:08 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:08.403041 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a383050d-2340-4427-99f9-7e8f5256bf82 tempest-QuotasTestJSON-986789272 tempest-QuotasTestJSON-986789272-project] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/350df80107da4cdeb35cd6fae2fa7df9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.182446 Jan 22 21:12:08.403619 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2135/4110] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 21:12:08 2022] GET /compute/v2.1/os-quota-sets/350df80107da4cdeb35cd6fae2fa7df9/defaults => generated 371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:08.414421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-27e6d3b6-88b6-4c0d-b9a7-8cc01071138a tempest-QuotasTestJSON-986789272 tempest-QuotasTestJSON-986789272-project] Calling method '.version_select at 0x7f1edae058b0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:08.487254 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-27e6d3b6-88b6-4c0d-b9a7-8cc01071138a tempest-QuotasTestJSON-986789272 tempest-QuotasTestJSON-986789272-project] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/350df80107da4cdeb35cd6fae2fa7df9" status: 200 len: 371 microversion: 2.1 time: 0.076399 Jan 22 21:12:08.487824 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1976/4111] 10.222.0.100 () {58 vars in 1246 bytes} [Sat Jan 22 21:12:08 2022] GET /compute/v2.1/os-quota-sets/350df80107da4cdeb35cd6fae2fa7df9 => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:08.499914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f93d0e7-86a0-4f3c-985f-7e8218eb07da tempest-QuotasTestJSON-986789272 tempest-QuotasTestJSON-986789272-project] Calling method '.version_select at 0x7f1ed5232af0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:08.558313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-249ee9c5-fbee-4805-b0f9-65512dc29530 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:08.558966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-249ee9c5-fbee-4805-b0f9-65512dc29530 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:08.565428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-249ee9c5-fbee-4805-b0f9-65512dc29530 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:08.565944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-249ee9c5-fbee-4805-b0f9-65512dc29530 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:08.566760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-249ee9c5-fbee-4805-b0f9-65512dc29530 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:08.567196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-249ee9c5-fbee-4805-b0f9-65512dc29530 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:08.569209 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f93d0e7-86a0-4f3c-985f-7e8218eb07da tempest-QuotasTestJSON-986789272 tempest-QuotasTestJSON-986789272-project] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/350df80107da4cdeb35cd6fae2fa7df9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.072929 Jan 22 21:12:08.569834 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2136/4112] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 21:12:08 2022] GET /compute/v2.1/os-quota-sets/350df80107da4cdeb35cd6fae2fa7df9/defaults => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:08.588009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c6ea2f5f-74bd-47c2-8d38-ff622b87ba6a tempest-QuotasTestJSON-986789272 tempest-QuotasTestJSON-986789272-project] Calling method '.version_select at 0x7f1edae75160>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:08.677314 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c6ea2f5f-74bd-47c2-8d38-ff622b87ba6a tempest-QuotasTestJSON-986789272 tempest-QuotasTestJSON-986789272-project] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/350df80107da4cdeb35cd6fae2fa7df9" status: 200 len: 371 microversion: 2.1 time: 0.092905 Jan 22 21:12:08.678240 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2137/4113] 10.222.0.100 () {58 vars in 1246 bytes} [Sat Jan 22 21:12:08 2022] GET /compute/v2.1/os-quota-sets/350df80107da4cdeb35cd6fae2fa7df9 => generated 371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:12:08.690357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-49cfe610-10c1-4507-ae67-e5b64595ccc3 tempest-QuotasTestJSON-986789272 tempest-QuotasTestJSON-986789272-project] Calling method '.version_select at 0x7f1edae73700>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:08.736211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-249ee9c5-fbee-4805-b0f9-65512dc29530 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:08.744351 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-249ee9c5-fbee-4805-b0f9-65512dc29530 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.190051 Jan 22 21:12:08.746236 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1977/4114] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:08 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:08.758625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ba9f401-9e24-4493-b168-99a88407f0dc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:08.759603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3ba9f401-9e24-4493-b168-99a88407f0dc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:08.765596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ba9f401-9e24-4493-b168-99a88407f0dc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:08.766041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ba9f401-9e24-4493-b168-99a88407f0dc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:08.766831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ba9f401-9e24-4493-b168-99a88407f0dc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:08.767268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ba9f401-9e24-4493-b168-99a88407f0dc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:08.771560 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-49cfe610-10c1-4507-ae67-e5b64595ccc3 tempest-QuotasTestJSON-986789272 tempest-QuotasTestJSON-986789272-project] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/350df80107da4cdeb35cd6fae2fa7df9?user_id=a7c65dd4b9ec448a84103587a6c45885" status: 200 len: 371 microversion: 2.1 time: 0.084386 Jan 22 21:12:08.772680 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2138/4115] 10.222.0.100 () {58 vars in 1327 bytes} [Sat Jan 22 21:12:08 2022] GET /compute/v2.1/os-quota-sets/350df80107da4cdeb35cd6fae2fa7df9?user_id=a7c65dd4b9ec448a84103587a6c45885 => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:12:08.809869 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3ba9f401-9e24-4493-b168-99a88407f0dc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.054539 Jan 22 21:12:08.810859 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1978/4116] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:08 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:08.857875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-817aaf9e-86dc-4eab-badc-ed6bb85523d4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:08.859095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-817aaf9e-86dc-4eab-badc-ed6bb85523d4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:08.866347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-817aaf9e-86dc-4eab-badc-ed6bb85523d4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:08.866935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-817aaf9e-86dc-4eab-badc-ed6bb85523d4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:08.867824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-817aaf9e-86dc-4eab-badc-ed6bb85523d4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:08.868454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-817aaf9e-86dc-4eab-badc-ed6bb85523d4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:08.911440 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-817aaf9e-86dc-4eab-badc-ed6bb85523d4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.057258 Jan 22 21:12:08.913674 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2139/4117] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:08 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:09.236660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-daa60e5c-390f-48da-a8d9-a1500e9a3809 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:09.238361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-daa60e5c-390f-48da-a8d9-a1500e9a3809 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:09.246118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa60e5c-390f-48da-a8d9-a1500e9a3809 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:09.250639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa60e5c-390f-48da-a8d9-a1500e9a3809 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:09.250639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa60e5c-390f-48da-a8d9-a1500e9a3809 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:09.250639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa60e5c-390f-48da-a8d9-a1500e9a3809 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:09.365287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-90d791c0-ade3-4068-a769-d48d918e0663 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:09.366103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-90d791c0-ade3-4068-a769-d48d918e0663 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:09.376609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90d791c0-ade3-4068-a769-d48d918e0663 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:09.383228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90d791c0-ade3-4068-a769-d48d918e0663 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:09.383228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90d791c0-ade3-4068-a769-d48d918e0663 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:09.383802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90d791c0-ade3-4068-a769-d48d918e0663 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:09.473316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-daa60e5c-390f-48da-a8d9-a1500e9a3809 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:09.482223 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-daa60e5c-390f-48da-a8d9-a1500e9a3809 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.249611 Jan 22 21:12:09.482903 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1979/4118] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:09 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:09.541269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-90d791c0-ade3-4068-a769-d48d918e0663 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:09.550873 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-90d791c0-ade3-4068-a769-d48d918e0663 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.190262 Jan 22 21:12:09.551617 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2140/4119] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:09 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:09.579835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4e3d18c1-301c-4730-a815-283c952882f6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:09.583187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4e3d18c1-301c-4730-a815-283c952882f6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:09.587010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e3d18c1-301c-4730-a815-283c952882f6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:09.587482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e3d18c1-301c-4730-a815-283c952882f6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:09.588255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e3d18c1-301c-4730-a815-283c952882f6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:09.588696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e3d18c1-301c-4730-a815-283c952882f6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:09.606290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-4e3d18c1-301c-4730-a815-283c952882f6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] HTTP exception thrown: Instance 5a45a6b1-24c6-4009-ad8f-6203f05d6777 could not be found. Jan 22 21:12:09.606290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4e3d18c1-301c-4730-a815-283c952882f6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Returning 404 to user: Instance 5a45a6b1-24c6-4009-ad8f-6203f05d6777 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:09.606290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4e3d18c1-301c-4730-a815-283c952882f6 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 404 len: 111 microversion: 2.1 time: 0.030131 Jan 22 21:12:09.606667 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1980/4120] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:09 2022] DELETE /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:12:09.614638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-875dd20f-21c1-4f35-ad33-f1c190472112 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:09.615653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-875dd20f-21c1-4f35-ad33-f1c190472112 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] [instance: 5a45a6b1-24c6-4009-ad8f-6203f05d6777] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:09.634349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-875dd20f-21c1-4f35-ad33-f1c190472112 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:09.635341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-875dd20f-21c1-4f35-ad33-f1c190472112 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:09.635630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-875dd20f-21c1-4f35-ad33-f1c190472112 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:09.636148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-875dd20f-21c1-4f35-ad33-f1c190472112 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:09.651389 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-875dd20f-21c1-4f35-ad33-f1c190472112 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] HTTP exception thrown: Instance 5a45a6b1-24c6-4009-ad8f-6203f05d6777 could not be found. Jan 22 21:12:09.652590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-875dd20f-21c1-4f35-ad33-f1c190472112 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] Returning 404 to user: Instance 5a45a6b1-24c6-4009-ad8f-6203f05d6777 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:09.653421 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-875dd20f-21c1-4f35-ad33-f1c190472112 tempest-AttachSCSIVolumeTestJSON-1656487840 tempest-AttachSCSIVolumeTestJSON-1656487840-project] 10.222.0.100 "GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777" status: 404 len: 111 microversion: 2.1 time: 0.042865 Jan 22 21:12:09.656089 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2141/4121] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:09 2022] GET /compute/v2.1/servers/5a45a6b1-24c6-4009-ad8f-6203f05d6777 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:09.766857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0562a610-1dbd-4023-a9c2-e5bb73aa9dbd tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:09.768202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0562a610-1dbd-4023-a9c2-e5bb73aa9dbd tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:09.777980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0562a610-1dbd-4023-a9c2-e5bb73aa9dbd tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:09.781388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0562a610-1dbd-4023-a9c2-e5bb73aa9dbd tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:09.791853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0562a610-1dbd-4023-a9c2-e5bb73aa9dbd tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:09.791853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0562a610-1dbd-4023-a9c2-e5bb73aa9dbd tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:09.822122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-34c65a77-dc9e-4ba2-8e91-acdeaf1a9a7f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:09.824070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-34c65a77-dc9e-4ba2-8e91-acdeaf1a9a7f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:09.830978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34c65a77-dc9e-4ba2-8e91-acdeaf1a9a7f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:09.831533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34c65a77-dc9e-4ba2-8e91-acdeaf1a9a7f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:09.832411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34c65a77-dc9e-4ba2-8e91-acdeaf1a9a7f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:09.832973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34c65a77-dc9e-4ba2-8e91-acdeaf1a9a7f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:09.875497 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-34c65a77-dc9e-4ba2-8e91-acdeaf1a9a7f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.057096 Jan 22 21:12:09.876165 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2142/4122] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:09 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:12:09.926428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b070ad3-78c7-4674-81a2-e442ac5a85bc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:09.927571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b070ad3-78c7-4674-81a2-e442ac5a85bc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:09.935533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b070ad3-78c7-4674-81a2-e442ac5a85bc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:09.936088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b070ad3-78c7-4674-81a2-e442ac5a85bc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:09.936968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b070ad3-78c7-4674-81a2-e442ac5a85bc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:09.937524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b070ad3-78c7-4674-81a2-e442ac5a85bc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:09.987823 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b070ad3-78c7-4674-81a2-e442ac5a85bc tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.065336 Jan 22 21:12:09.992096 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2143/4123] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:09 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:10.273473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0562a610-1dbd-4023-a9c2-e5bb73aa9dbd tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:10.281794 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0562a610-1dbd-4023-a9c2-e5bb73aa9dbd tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.523408 Jan 22 21:12:10.282364 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1981/4124] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:09 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:10.500230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e0e68013-50a4-4c1a-93d0-251493b8d231 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:10.500868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e0e68013-50a4-4c1a-93d0-251493b8d231 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:10.508624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0e68013-50a4-4c1a-93d0-251493b8d231 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:10.509263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0e68013-50a4-4c1a-93d0-251493b8d231 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:10.510284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0e68013-50a4-4c1a-93d0-251493b8d231 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:10.510732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0e68013-50a4-4c1a-93d0-251493b8d231 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:10.574723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6afdfba9-64bc-47ee-afca-61d47d16b0ca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:10.576077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6afdfba9-64bc-47ee-afca-61d47d16b0ca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:10.597368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6afdfba9-64bc-47ee-afca-61d47d16b0ca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:10.598339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6afdfba9-64bc-47ee-afca-61d47d16b0ca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:10.601417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6afdfba9-64bc-47ee-afca-61d47d16b0ca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:10.602911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6afdfba9-64bc-47ee-afca-61d47d16b0ca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:10.694057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e0e68013-50a4-4c1a-93d0-251493b8d231 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:10.707522 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e0e68013-50a4-4c1a-93d0-251493b8d231 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.211285 Jan 22 21:12:10.708426 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2144/4125] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:10 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:10.872418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6afdfba9-64bc-47ee-afca-61d47d16b0ca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:10.882943 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6afdfba9-64bc-47ee-afca-61d47d16b0ca tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.318539 Jan 22 21:12:10.884075 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1982/4126] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:10 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:10.896441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e4fde73-6260-4bcc-9495-e944e2afb11f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:10.897374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e4fde73-6260-4bcc-9495-e944e2afb11f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:10.904326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e4fde73-6260-4bcc-9495-e944e2afb11f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:10.904784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e4fde73-6260-4bcc-9495-e944e2afb11f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:10.905723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e4fde73-6260-4bcc-9495-e944e2afb11f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:10.906169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e4fde73-6260-4bcc-9495-e944e2afb11f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:10.950174 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e4fde73-6260-4bcc-9495-e944e2afb11f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.066671 Jan 22 21:12:10.951219 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2145/4127] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:10 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:11.000179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a25495a5-3bb3-4772-a522-350ff68485ae tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:11.001222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a25495a5-3bb3-4772-a522-350ff68485ae tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:11.007138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a25495a5-3bb3-4772-a522-350ff68485ae tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:11.007598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a25495a5-3bb3-4772-a522-350ff68485ae tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:11.008397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a25495a5-3bb3-4772-a522-350ff68485ae tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:11.008845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a25495a5-3bb3-4772-a522-350ff68485ae tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:11.054574 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a25495a5-3bb3-4772-a522-350ff68485ae tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.058072 Jan 22 21:12:11.062982 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1983/4128] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:10 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:11.301036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ec3ee7f-6f6d-4f32-a481-26bb6f54f332 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:11.302051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1ec3ee7f-6f6d-4f32-a481-26bb6f54f332 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:11.310863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ec3ee7f-6f6d-4f32-a481-26bb6f54f332 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:11.311522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ec3ee7f-6f6d-4f32-a481-26bb6f54f332 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:11.312905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ec3ee7f-6f6d-4f32-a481-26bb6f54f332 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:11.313640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ec3ee7f-6f6d-4f32-a481-26bb6f54f332 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:11.520579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1ec3ee7f-6f6d-4f32-a481-26bb6f54f332 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:11.531510 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ec3ee7f-6f6d-4f32-a481-26bb6f54f332 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.234493 Jan 22 21:12:11.532523 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2146/4129] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:11 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:11.724823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9e18d6d9-d78d-4129-b715-1e22f0a84f20 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:11.725427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9e18d6d9-d78d-4129-b715-1e22f0a84f20 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:11.746360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e18d6d9-d78d-4129-b715-1e22f0a84f20 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:11.747504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e18d6d9-d78d-4129-b715-1e22f0a84f20 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:11.749491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e18d6d9-d78d-4129-b715-1e22f0a84f20 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:11.749848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e18d6d9-d78d-4129-b715-1e22f0a84f20 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:11.903638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f43047dc-cb79-449d-b38b-8b1167f80926 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:11.905594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f43047dc-cb79-449d-b38b-8b1167f80926 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:11.913247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f43047dc-cb79-449d-b38b-8b1167f80926 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:11.913731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f43047dc-cb79-449d-b38b-8b1167f80926 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:11.914732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f43047dc-cb79-449d-b38b-8b1167f80926 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:11.915341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f43047dc-cb79-449d-b38b-8b1167f80926 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:12.163442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f43047dc-cb79-449d-b38b-8b1167f80926 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:12.165246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9e18d6d9-d78d-4129-b715-1e22f0a84f20 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:12.188014 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9e18d6d9-d78d-4129-b715-1e22f0a84f20 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.467305 Jan 22 21:12:12.190762 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f43047dc-cb79-449d-b38b-8b1167f80926 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.293076 Jan 22 21:12:12.192262 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2147/4130] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:11 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:12.198065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7ca44fad-f604-4fe9-88ee-3ea152ce71a2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:12.202271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7ca44fad-f604-4fe9-88ee-3ea152ce71a2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:12.207142 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1984/4131] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:11 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:12.207975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ca44fad-f604-4fe9-88ee-3ea152ce71a2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:12.208693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ca44fad-f604-4fe9-88ee-3ea152ce71a2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:12.210489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ca44fad-f604-4fe9-88ee-3ea152ce71a2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:12.211291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ca44fad-f604-4fe9-88ee-3ea152ce71a2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:12.221404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0f80d3b4-d5cf-4de0-a182-371fcd4c4f91 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:12.222665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0f80d3b4-d5cf-4de0-a182-371fcd4c4f91 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:12.230363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f80d3b4-d5cf-4de0-a182-371fcd4c4f91 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:12.231025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f80d3b4-d5cf-4de0-a182-371fcd4c4f91 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:12.232062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f80d3b4-d5cf-4de0-a182-371fcd4c4f91 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:12.232656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f80d3b4-d5cf-4de0-a182-371fcd4c4f91 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:12.271198 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7ca44fad-f604-4fe9-88ee-3ea152ce71a2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.077345 Jan 22 21:12:12.272495 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2148/4132] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:12 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:12.284477 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0f80d3b4-d5cf-4de0-a182-371fcd4c4f91 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.066794 Jan 22 21:12:12.288904 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1985/4133] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:12 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:12.555072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7b6609f3-925a-4f9f-9eed-e44956b6726f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:12.556002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7b6609f3-925a-4f9f-9eed-e44956b6726f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:12.566382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b6609f3-925a-4f9f-9eed-e44956b6726f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:12.569292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b6609f3-925a-4f9f-9eed-e44956b6726f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:12.569292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b6609f3-925a-4f9f-9eed-e44956b6726f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:12.569292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b6609f3-925a-4f9f-9eed-e44956b6726f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:12.858329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7b6609f3-925a-4f9f-9eed-e44956b6726f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:12.874599 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7b6609f3-925a-4f9f-9eed-e44956b6726f tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.318780 Jan 22 21:12:12.874599 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2149/4134] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:12 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:13.215062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-070f1776-6fae-43fe-b1aa-65ed6f680cb6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:13.215778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-070f1776-6fae-43fe-b1aa-65ed6f680cb6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:13.234201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-02428f0e-a95c-4a23-9523-a8990d0dabdc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:13.234201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-02428f0e-a95c-4a23-9523-a8990d0dabdc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:13.270220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02428f0e-a95c-4a23-9523-a8990d0dabdc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:13.274202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02428f0e-a95c-4a23-9523-a8990d0dabdc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:13.274202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02428f0e-a95c-4a23-9523-a8990d0dabdc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:13.274202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02428f0e-a95c-4a23-9523-a8990d0dabdc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:13.281258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-070f1776-6fae-43fe-b1aa-65ed6f680cb6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:13.283136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-070f1776-6fae-43fe-b1aa-65ed6f680cb6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:13.285961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-070f1776-6fae-43fe-b1aa-65ed6f680cb6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:13.289252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-070f1776-6fae-43fe-b1aa-65ed6f680cb6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:13.647729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-02428f0e-a95c-4a23-9523-a8990d0dabdc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:13.663918 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-02428f0e-a95c-4a23-9523-a8990d0dabdc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.438266 Jan 22 21:12:13.666125 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2150/4135] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:13 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:13.676033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-070f1776-6fae-43fe-b1aa-65ed6f680cb6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:13.684158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9e31b466-b8ab-4bcb-9de9-8d060712fa82 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:13.685957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9e31b466-b8ab-4bcb-9de9-8d060712fa82 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:13.686450 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-070f1776-6fae-43fe-b1aa-65ed6f680cb6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.476364 Jan 22 21:12:13.688830 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1986/4136] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:13 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:13.698115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e31b466-b8ab-4bcb-9de9-8d060712fa82 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:13.699417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e31b466-b8ab-4bcb-9de9-8d060712fa82 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:13.700486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e31b466-b8ab-4bcb-9de9-8d060712fa82 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:13.701128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e31b466-b8ab-4bcb-9de9-8d060712fa82 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:13.706450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7250dc9c-141b-48d5-8101-90d2bcc2b779 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:13.707497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7250dc9c-141b-48d5-8101-90d2bcc2b779 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:13.716842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7250dc9c-141b-48d5-8101-90d2bcc2b779 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:13.717399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7250dc9c-141b-48d5-8101-90d2bcc2b779 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:13.718468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7250dc9c-141b-48d5-8101-90d2bcc2b779 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:13.720127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7250dc9c-141b-48d5-8101-90d2bcc2b779 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:13.790073 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9e31b466-b8ab-4bcb-9de9-8d060712fa82 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.110897 Jan 22 21:12:13.793836 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2151/4137] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:13 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:13.796526 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7250dc9c-141b-48d5-8101-90d2bcc2b779 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.094776 Jan 22 21:12:13.797668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1987/4138] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:13 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:13.886794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3b057cfe-ad74-4b5e-9404-6afcfb2c381d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:13.887756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3b057cfe-ad74-4b5e-9404-6afcfb2c381d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:13.896858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b057cfe-ad74-4b5e-9404-6afcfb2c381d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:13.897445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b057cfe-ad74-4b5e-9404-6afcfb2c381d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:13.898302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b057cfe-ad74-4b5e-9404-6afcfb2c381d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:13.898754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b057cfe-ad74-4b5e-9404-6afcfb2c381d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:14.227650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3b057cfe-ad74-4b5e-9404-6afcfb2c381d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:14.239426 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3b057cfe-ad74-4b5e-9404-6afcfb2c381d tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1489 microversion: 2.1 time: 0.357100 Jan 22 21:12:14.250046 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2152/4139] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:13 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1489 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:14.262637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-661039b9-1225-4570-981d-76bead348ddb tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:14.273964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-661039b9-1225-4570-981d-76bead348ddb tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:14.276197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-661039b9-1225-4570-981d-76bead348ddb tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:14.277241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-661039b9-1225-4570-981d-76bead348ddb tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:14.278133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-661039b9-1225-4570-981d-76bead348ddb tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:14.278641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-661039b9-1225-4570-981d-76bead348ddb tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:14.567782 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-661039b9-1225-4570-981d-76bead348ddb tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "POST /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6/action" status: 202 len: 0 microversion: 2.1 time: 0.312011 Jan 22 21:12:14.569052 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1988/4140] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:14 2022] POST /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:14.581746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1d624ceb-68d3-48d8-a219-1d61314b6381 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:14.582842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1d624ceb-68d3-48d8-a219-1d61314b6381 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:14.599013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d624ceb-68d3-48d8-a219-1d61314b6381 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:14.600001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d624ceb-68d3-48d8-a219-1d61314b6381 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:14.601242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d624ceb-68d3-48d8-a219-1d61314b6381 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:14.601995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d624ceb-68d3-48d8-a219-1d61314b6381 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:14.687812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-be458145-bfe7-403b-9d6c-1dffb44370dc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:14.688712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-be458145-bfe7-403b-9d6c-1dffb44370dc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:14.709367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be458145-bfe7-403b-9d6c-1dffb44370dc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:14.710061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be458145-bfe7-403b-9d6c-1dffb44370dc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:14.711282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be458145-bfe7-403b-9d6c-1dffb44370dc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:14.713570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be458145-bfe7-403b-9d6c-1dffb44370dc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:14.962753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1d624ceb-68d3-48d8-a219-1d61314b6381 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:14.971632 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1d624ceb-68d3-48d8-a219-1d61314b6381 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1497 microversion: 2.1 time: 0.395961 Jan 22 21:12:14.972248 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2153/4141] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:14 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1497 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:14.976857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3d292ab6-001c-41a0-8af8-0aa38865d8ef tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:14.977591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3d292ab6-001c-41a0-8af8-0aa38865d8ef tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:14.984957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d292ab6-001c-41a0-8af8-0aa38865d8ef tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:14.985455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d292ab6-001c-41a0-8af8-0aa38865d8ef tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:14.986332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d292ab6-001c-41a0-8af8-0aa38865d8ef tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:14.986791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d292ab6-001c-41a0-8af8-0aa38865d8ef tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:15.112161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-be458145-bfe7-403b-9d6c-1dffb44370dc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:15.133522 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-be458145-bfe7-403b-9d6c-1dffb44370dc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1514 microversion: 2.1 time: 0.453528 Jan 22 21:12:15.134486 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1989/4142] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:14 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1514 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:15.141812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1a0ad6e6-fc1e-4876-9e5d-f91505c2f9cf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:15.149747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1a0ad6e6-fc1e-4876-9e5d-f91505c2f9cf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:15.167832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a0ad6e6-fc1e-4876-9e5d-f91505c2f9cf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:15.170290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a0ad6e6-fc1e-4876-9e5d-f91505c2f9cf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:15.171278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a0ad6e6-fc1e-4876-9e5d-f91505c2f9cf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:15.181312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a0ad6e6-fc1e-4876-9e5d-f91505c2f9cf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:15.222443 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1a0ad6e6-fc1e-4876-9e5d-f91505c2f9cf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.086165 Jan 22 21:12:15.227346 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1990/4143] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:15 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:15.233680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9573535d-8f37-44e5-930d-1d5ccd37b8ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:15.234937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9573535d-8f37-44e5-930d-1d5ccd37b8ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:15.245039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9573535d-8f37-44e5-930d-1d5ccd37b8ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:15.245632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9573535d-8f37-44e5-930d-1d5ccd37b8ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:15.246366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9573535d-8f37-44e5-930d-1d5ccd37b8ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:15.246818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9573535d-8f37-44e5-930d-1d5ccd37b8ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:15.313173 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9573535d-8f37-44e5-930d-1d5ccd37b8ea tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.083892 Jan 22 21:12:15.317417 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1991/4144] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:15 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:15.629019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3d292ab6-001c-41a0-8af8-0aa38865d8ef tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:15.629844 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3d292ab6-001c-41a0-8af8-0aa38865d8ef tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.656219 Jan 22 21:12:15.645578 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2154/4145] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:14 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:15.990836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-81c51440-196f-417b-8e93-e31a5c5edd28 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:15.991590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-81c51440-196f-417b-8e93-e31a5c5edd28 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:16.005730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81c51440-196f-417b-8e93-e31a5c5edd28 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.006299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81c51440-196f-417b-8e93-e31a5c5edd28 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:16.007176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81c51440-196f-417b-8e93-e31a5c5edd28 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.007628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81c51440-196f-417b-8e93-e31a5c5edd28 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:16.155699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-20f63894-ea29-41df-bf34-5f6ac9af6343 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:16.156682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-20f63894-ea29-41df-bf34-5f6ac9af6343 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:16.171356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20f63894-ea29-41df-bf34-5f6ac9af6343 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.171825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20f63894-ea29-41df-bf34-5f6ac9af6343 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:16.172652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20f63894-ea29-41df-bf34-5f6ac9af6343 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.173103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20f63894-ea29-41df-bf34-5f6ac9af6343 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:16.313346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-81c51440-196f-417b-8e93-e31a5c5edd28 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:16.345983 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-81c51440-196f-417b-8e93-e31a5c5edd28 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1497 microversion: 2.1 time: 0.342514 Jan 22 21:12:16.348626 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1992/4146] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:15 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1497 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:16.364092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2869b2a2-2fbc-4819-a2dc-6e2b5a2a9666 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:16.366606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2869b2a2-2fbc-4819-a2dc-6e2b5a2a9666 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:16.385027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2869b2a2-2fbc-4819-a2dc-6e2b5a2a9666 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.386489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2869b2a2-2fbc-4819-a2dc-6e2b5a2a9666 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:16.387536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2869b2a2-2fbc-4819-a2dc-6e2b5a2a9666 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.388162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2869b2a2-2fbc-4819-a2dc-6e2b5a2a9666 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:16.454526 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2869b2a2-2fbc-4819-a2dc-6e2b5a2a9666 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.103168 Jan 22 21:12:16.458548 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1993/4147] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:16 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:16.464558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11ac2a5d-7e4b-414b-829c-75727adcb84b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:16.466293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-11ac2a5d-7e4b-414b-829c-75727adcb84b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:16.475840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11ac2a5d-7e4b-414b-829c-75727adcb84b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.478396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11ac2a5d-7e4b-414b-829c-75727adcb84b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:16.480847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11ac2a5d-7e4b-414b-829c-75727adcb84b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.481479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11ac2a5d-7e4b-414b-829c-75727adcb84b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:16.492839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-20f63894-ea29-41df-bf34-5f6ac9af6343 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:16.505091 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-20f63894-ea29-41df-bf34-5f6ac9af6343 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1491 microversion: 2.1 time: 0.356771 Jan 22 21:12:16.510366 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2155/4148] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:16 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1491 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:16.526989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1eb387af-37f5-4eb8-a060-071fda13e06e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-185748155"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:16.528775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1eb387af-37f5-4eb8-a060-071fda13e06e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:16.541593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1eb387af-37f5-4eb8-a060-071fda13e06e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.542594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1eb387af-37f5-4eb8-a060-071fda13e06e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:16.543401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1eb387af-37f5-4eb8-a060-071fda13e06e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.543852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1eb387af-37f5-4eb8-a060-071fda13e06e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:16.586430 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-11ac2a5d-7e4b-414b-829c-75727adcb84b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.128941 Jan 22 21:12:16.587703 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1994/4149] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:16 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:16.648882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a9c2ad6a-b1cf-4f45-b299-ccd37f53a1c4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:16.649427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a9c2ad6a-b1cf-4f45-b299-ccd37f53a1c4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:16.657018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9c2ad6a-b1cf-4f45-b299-ccd37f53a1c4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.657483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9c2ad6a-b1cf-4f45-b299-ccd37f53a1c4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:16.658319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9c2ad6a-b1cf-4f45-b299-ccd37f53a1c4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.658770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9c2ad6a-b1cf-4f45-b299-ccd37f53a1c4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:16.736517 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1eb387af-37f5-4eb8-a060-071fda13e06e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "PUT /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1063 microversion: 2.1 time: 0.214106 Jan 22 21:12:16.738257 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2156/4150] 10.222.0.100 () {60 vars in 1260 bytes} [Sat Jan 22 21:12:16 2022] PUT /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1063 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:16.752196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d9749e82-e3cf-4a3f-abc3-0a70d13203fc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:16.752994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d9749e82-e3cf-4a3f-abc3-0a70d13203fc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:16.760315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9749e82-e3cf-4a3f-abc3-0a70d13203fc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.761645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9749e82-e3cf-4a3f-abc3-0a70d13203fc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:16.762862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9749e82-e3cf-4a3f-abc3-0a70d13203fc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.764132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9749e82-e3cf-4a3f-abc3-0a70d13203fc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:16.923291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d9749e82-e3cf-4a3f-abc3-0a70d13203fc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:16.933367 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d9749e82-e3cf-4a3f-abc3-0a70d13203fc tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1490 microversion: 2.1 time: 0.184624 Jan 22 21:12:16.934686 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2157/4151] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:16 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1490 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:16.950121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6d246031-ce3e-46c9-b0b5-129e77cc4490 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:16.951156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6d246031-ce3e-46c9-b0b5-129e77cc4490 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:16.958859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d246031-ce3e-46c9-b0b5-129e77cc4490 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.959538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d246031-ce3e-46c9-b0b5-129e77cc4490 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:16.960632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d246031-ce3e-46c9-b0b5-129e77cc4490 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:16.961327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d246031-ce3e-46c9-b0b5-129e77cc4490 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:17.054920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a9c2ad6a-b1cf-4f45-b299-ccd37f53a1c4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:17.075513 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a9c2ad6a-b1cf-4f45-b299-ccd37f53a1c4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.430911 Jan 22 21:12:17.088919 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1995/4152] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:16 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:17.121603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6d246031-ce3e-46c9-b0b5-129e77cc4490 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:17.130663 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6d246031-ce3e-46c9-b0b5-129e77cc4490 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1490 microversion: 2.1 time: 0.184531 Jan 22 21:12:17.131923 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2158/4153] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:16 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1490 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:17.149576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8f9cfd75-7d73-4cc9-b83d-a2a9a7632cf2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:17.150339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8f9cfd75-7d73-4cc9-b83d-a2a9a7632cf2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:17.157570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f9cfd75-7d73-4cc9-b83d-a2a9a7632cf2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:17.157570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f9cfd75-7d73-4cc9-b83d-a2a9a7632cf2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:17.157826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f9cfd75-7d73-4cc9-b83d-a2a9a7632cf2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:17.158231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f9cfd75-7d73-4cc9-b83d-a2a9a7632cf2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:17.185391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8f9cfd75-7d73-4cc9-b83d-a2a9a7632cf2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:12:17.365623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-235de2ac-6e60-4d8a-94bb-7a8950c26e67 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:17.366292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-235de2ac-6e60-4d8a-94bb-7a8950c26e67 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:17.374538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-235de2ac-6e60-4d8a-94bb-7a8950c26e67 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:17.375256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-235de2ac-6e60-4d8a-94bb-7a8950c26e67 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:17.376077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-235de2ac-6e60-4d8a-94bb-7a8950c26e67 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:17.376831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-235de2ac-6e60-4d8a-94bb-7a8950c26e67 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:17.492420 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8f9cfd75-7d73-4cc9-b83d-a2a9a7632cf2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 204 len: 0 microversion: 2.1 time: 0.347425 Jan 22 21:12:17.494278 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1996/4154] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:17 2022] DELETE /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:12:17.503444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b3168301-1491-46b0-8552-a4d5f7630659 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:17.504769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b3168301-1491-46b0-8552-a4d5f7630659 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:17.516469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3168301-1491-46b0-8552-a4d5f7630659 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:17.517277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3168301-1491-46b0-8552-a4d5f7630659 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:17.518491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3168301-1491-46b0-8552-a4d5f7630659 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:17.524351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3168301-1491-46b0-8552-a4d5f7630659 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:17.587010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-235de2ac-6e60-4d8a-94bb-7a8950c26e67 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:17.588396 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b3168301-1491-46b0-8552-a4d5f7630659 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.090505 Jan 22 21:12:17.590969 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1997/4155] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:17 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:17.603202 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-235de2ac-6e60-4d8a-94bb-7a8950c26e67 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1497 microversion: 2.1 time: 0.240829 Jan 22 21:12:17.605395 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2159/4156] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:17 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1497 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:17.611720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d8ff2970-3117-480f-802e-9b62bb70f9cb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:17.613114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d8ff2970-3117-480f-802e-9b62bb70f9cb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:17.620423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c5774684-45b4-4e97-bb17-bfc196f5a532 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:17.621486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c5774684-45b4-4e97-bb17-bfc196f5a532 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:17.628886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5774684-45b4-4e97-bb17-bfc196f5a532 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:17.629483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5774684-45b4-4e97-bb17-bfc196f5a532 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:17.630537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5774684-45b4-4e97-bb17-bfc196f5a532 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:17.630755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8ff2970-3117-480f-802e-9b62bb70f9cb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:17.631200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5774684-45b4-4e97-bb17-bfc196f5a532 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:17.632004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8ff2970-3117-480f-802e-9b62bb70f9cb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:17.632961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8ff2970-3117-480f-802e-9b62bb70f9cb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:17.633416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d8ff2970-3117-480f-802e-9b62bb70f9cb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:17.708792 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c5774684-45b4-4e97-bb17-bfc196f5a532 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.102000 Jan 22 21:12:17.714259 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2160/4157] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:17 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:18.094188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c9e27c5d-e3cd-4b98-8fb1-29df6b474ffb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:18.094882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c9e27c5d-e3cd-4b98-8fb1-29df6b474ffb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:18.102263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9e27c5d-e3cd-4b98-8fb1-29df6b474ffb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:18.102734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9e27c5d-e3cd-4b98-8fb1-29df6b474ffb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:18.103560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9e27c5d-e3cd-4b98-8fb1-29df6b474ffb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:18.104018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9e27c5d-e3cd-4b98-8fb1-29df6b474ffb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:18.269816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c9e27c5d-e3cd-4b98-8fb1-29df6b474ffb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:18.281684 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c9e27c5d-e3cd-4b98-8fb1-29df6b474ffb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.191488 Jan 22 21:12:18.282282 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2161/4158] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:18 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:18.381612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d8ff2970-3117-480f-802e-9b62bb70f9cb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:18.394159 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d8ff2970-3117-480f-802e-9b62bb70f9cb tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1496 microversion: 2.1 time: 0.801221 Jan 22 21:12:18.394943 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1998/4159] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:17 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1496 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:18.600343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19111bc1-4ee8-460c-8e43-671e9adcf65d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:18.601640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-19111bc1-4ee8-460c-8e43-671e9adcf65d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:18.610666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19111bc1-4ee8-460c-8e43-671e9adcf65d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:18.611131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19111bc1-4ee8-460c-8e43-671e9adcf65d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:18.612016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19111bc1-4ee8-460c-8e43-671e9adcf65d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:18.612466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19111bc1-4ee8-460c-8e43-671e9adcf65d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:18.627034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-18da1dd9-0fb7-4fd2-91ee-9f01dfc6b307 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:18.628221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-18da1dd9-0fb7-4fd2-91ee-9f01dfc6b307 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:18.636411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18da1dd9-0fb7-4fd2-91ee-9f01dfc6b307 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:18.637603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18da1dd9-0fb7-4fd2-91ee-9f01dfc6b307 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:18.637859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18da1dd9-0fb7-4fd2-91ee-9f01dfc6b307 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:18.638221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18da1dd9-0fb7-4fd2-91ee-9f01dfc6b307 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:18.655386 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19111bc1-4ee8-460c-8e43-671e9adcf65d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.058572 Jan 22 21:12:18.660049 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2162/4160] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:18 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:18.722199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-33d540a9-3e2b-40ec-ae5f-f19b1c6f1624 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:18.723230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-33d540a9-3e2b-40ec-ae5f-f19b1c6f1624 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:18.733728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33d540a9-3e2b-40ec-ae5f-f19b1c6f1624 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:18.734520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33d540a9-3e2b-40ec-ae5f-f19b1c6f1624 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:18.735645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33d540a9-3e2b-40ec-ae5f-f19b1c6f1624 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:18.736243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33d540a9-3e2b-40ec-ae5f-f19b1c6f1624 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:18.793482 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-33d540a9-3e2b-40ec-ae5f-f19b1c6f1624 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.073853 Jan 22 21:12:18.794744 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2163/4161] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:18 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:19.035619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-18da1dd9-0fb7-4fd2-91ee-9f01dfc6b307 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:19.052673 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-18da1dd9-0fb7-4fd2-91ee-9f01dfc6b307 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1503 microversion: 2.1 time: 0.429293 Jan 22 21:12:19.069886 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 1999/4162] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:18 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1503 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:19.084964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e2223e46-a852-450c-81d3-6cceb5fce2b4 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:19.085935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e2223e46-a852-450c-81d3-6cceb5fce2b4 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:19.100139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2223e46-a852-450c-81d3-6cceb5fce2b4 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:19.101332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2223e46-a852-450c-81d3-6cceb5fce2b4 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:19.102401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2223e46-a852-450c-81d3-6cceb5fce2b4 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:19.103083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2223e46-a852-450c-81d3-6cceb5fce2b4 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:19.141680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e2223e46-a852-450c-81d3-6cceb5fce2b4 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:12:19.302618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-253c8e5f-74c3-4df6-8644-7ec3df8ebe01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:19.302618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-253c8e5f-74c3-4df6-8644-7ec3df8ebe01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:19.312213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-253c8e5f-74c3-4df6-8644-7ec3df8ebe01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:19.312852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-253c8e5f-74c3-4df6-8644-7ec3df8ebe01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:19.313865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-253c8e5f-74c3-4df6-8644-7ec3df8ebe01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:19.318283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-253c8e5f-74c3-4df6-8644-7ec3df8ebe01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:19.567327 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e2223e46-a852-450c-81d3-6cceb5fce2b4 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "DELETE /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 204 len: 0 microversion: 2.1 time: 0.489531 Jan 22 21:12:19.568193 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2164/4163] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:19 2022] DELETE /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:12:19.574647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5de1e0d9-c42d-4a7c-b81c-b79c3b1e39da tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:19.577412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5de1e0d9-c42d-4a7c-b81c-b79c3b1e39da tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:19.594473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5de1e0d9-c42d-4a7c-b81c-b79c3b1e39da tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:19.595833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5de1e0d9-c42d-4a7c-b81c-b79c3b1e39da tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:19.597092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5de1e0d9-c42d-4a7c-b81c-b79c3b1e39da tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:19.597843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5de1e0d9-c42d-4a7c-b81c-b79c3b1e39da tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:19.714658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-253c8e5f-74c3-4df6-8644-7ec3df8ebe01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:19.732524 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-253c8e5f-74c3-4df6-8644-7ec3df8ebe01 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.436996 Jan 22 21:12:19.733426 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2000/4164] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:19 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:19.738383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-103952a2-4d3a-41d0-931c-eef50c1dcb9b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:19.739216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-103952a2-4d3a-41d0-931c-eef50c1dcb9b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:19.753864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-103952a2-4d3a-41d0-931c-eef50c1dcb9b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:19.754571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-103952a2-4d3a-41d0-931c-eef50c1dcb9b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:19.755555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-103952a2-4d3a-41d0-931c-eef50c1dcb9b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:19.758987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-103952a2-4d3a-41d0-931c-eef50c1dcb9b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:19.858260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5de1e0d9-c42d-4a7c-b81c-b79c3b1e39da tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:19.866102 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5de1e0d9-c42d-4a7c-b81c-b79c3b1e39da tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1496 microversion: 2.1 time: 0.296391 Jan 22 21:12:19.873899 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2165/4165] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:19 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1496 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:19.885953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a7df3a11-4350-4e51-9f9e-8948c883418d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:19.888232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a7df3a11-4350-4e51-9f9e-8948c883418d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:19.899809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7df3a11-4350-4e51-9f9e-8948c883418d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:19.900862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7df3a11-4350-4e51-9f9e-8948c883418d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:19.902466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7df3a11-4350-4e51-9f9e-8948c883418d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:19.903393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7df3a11-4350-4e51-9f9e-8948c883418d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:19.958340 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a7df3a11-4350-4e51-9f9e-8948c883418d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.089520 Jan 22 21:12:19.973122 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2166/4166] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:19 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:19.980783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f2078a67-983e-4b02-9db5-3a1951120d99 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:19.984531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f2078a67-983e-4b02-9db5-3a1951120d99 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:20.008074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2078a67-983e-4b02-9db5-3a1951120d99 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:20.008687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2078a67-983e-4b02-9db5-3a1951120d99 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:20.009943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2078a67-983e-4b02-9db5-3a1951120d99 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:20.010531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2078a67-983e-4b02-9db5-3a1951120d99 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:20.087286 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f2078a67-983e-4b02-9db5-3a1951120d99 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.112217 Jan 22 21:12:20.092091 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2167/4167] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:19 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:20.102650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-103952a2-4d3a-41d0-931c-eef50c1dcb9b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:20.110323 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-103952a2-4d3a-41d0-931c-eef50c1dcb9b tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.375345 Jan 22 21:12:20.110923 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2001/4168] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:19 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:20.521854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-2fd066fc-a17a-4f71-9fc3-f658f7d16709 req-445cbba0-e3dd-4384-8d03-94815fc7dff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6246ed48-9f22-4375-bb21-57f112060395", "name": "network-vif-deleted", "tag": "42fdb3d7-e8e0-4810-b944-f6f9b2944b32"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:20.523509 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:20.523509 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:12:20.544575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2fd066fc-a17a-4f71-9fc3-f658f7d16709 req-445cbba0-e3dd-4384-8d03-94815fc7dff3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:20.547698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2fd066fc-a17a-4f71-9fc3-f658f7d16709 req-445cbba0-e3dd-4384-8d03-94815fc7dff3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:20.583168 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-2fd066fc-a17a-4f71-9fc3-f658f7d16709 req-445cbba0-e3dd-4384-8d03-94815fc7dff3 service nova] Creating event network-vif-deleted:42fdb3d7-e8e0-4810-b944-f6f9b2944b32 for instance 6246ed48-9f22-4375-bb21-57f112060395 on nch1-master-1 Jan 22 21:12:20.588776 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-2fd066fc-a17a-4f71-9fc3-f658f7d16709 req-445cbba0-e3dd-4384-8d03-94815fc7dff3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071646 Jan 22 21:12:20.599063 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2168/4169] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:20.751931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0202e5f9-23e6-4108-819d-751f53bf2cfa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:20.753772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0202e5f9-23e6-4108-819d-751f53bf2cfa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:20.780901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0202e5f9-23e6-4108-819d-751f53bf2cfa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:20.782045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0202e5f9-23e6-4108-819d-751f53bf2cfa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:20.790764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0202e5f9-23e6-4108-819d-751f53bf2cfa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:20.790764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0202e5f9-23e6-4108-819d-751f53bf2cfa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:20.893947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c9bd1233-5ee8-44fc-9c28-60a635026714 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:20.894835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c9bd1233-5ee8-44fc-9c28-60a635026714 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:20.902549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9bd1233-5ee8-44fc-9c28-60a635026714 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:20.903013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9bd1233-5ee8-44fc-9c28-60a635026714 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:20.904002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9bd1233-5ee8-44fc-9c28-60a635026714 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:20.904608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9bd1233-5ee8-44fc-9c28-60a635026714 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:20.951113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9bd1233-5ee8-44fc-9c28-60a635026714 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:20.952277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9bd1233-5ee8-44fc-9c28-60a635026714 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:20.952945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-c9bd1233-5ee8-44fc-9c28-60a635026714 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lazy-loading 'fault' on Instance uuid 6246ed48-9f22-4375-bb21-57f112060395 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:12:21.023652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c9bd1233-5ee8-44fc-9c28-60a635026714 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:21.033468 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c9bd1233-5ee8-44fc-9c28-60a635026714 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 200 len: 1313 microversion: 2.1 time: 0.144883 Jan 22 21:12:21.034076 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2169/4170] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:20 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:21.041339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74d65d9d-6421-4919-afca-dc85cb6e596a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:21.044509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-74d65d9d-6421-4919-afca-dc85cb6e596a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:21.056957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74d65d9d-6421-4919-afca-dc85cb6e596a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:21.058055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74d65d9d-6421-4919-afca-dc85cb6e596a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:21.058930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74d65d9d-6421-4919-afca-dc85cb6e596a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:21.059713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74d65d9d-6421-4919-afca-dc85cb6e596a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:21.112669 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-74d65d9d-6421-4919-afca-dc85cb6e596a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.074023 Jan 22 21:12:21.112669 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2170/4171] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:21 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:21.116844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-288daaf9-47bb-414e-b9b3-b44c8b0d600f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:21.118167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-288daaf9-47bb-414e-b9b3-b44c8b0d600f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:21.126340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-288daaf9-47bb-414e-b9b3-b44c8b0d600f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:21.126806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-288daaf9-47bb-414e-b9b3-b44c8b0d600f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:21.127771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-288daaf9-47bb-414e-b9b3-b44c8b0d600f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:21.128297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-288daaf9-47bb-414e-b9b3-b44c8b0d600f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:21.195073 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-288daaf9-47bb-414e-b9b3-b44c8b0d600f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.065644 Jan 22 21:12:21.195073 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2171/4172] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:21 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:21.195073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-28aecaca-4794-4755-8a9c-62c81707ae90 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:21.195073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-28aecaca-4794-4755-8a9c-62c81707ae90 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:21.195073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28aecaca-4794-4755-8a9c-62c81707ae90 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:21.196458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28aecaca-4794-4755-8a9c-62c81707ae90 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:21.196458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28aecaca-4794-4755-8a9c-62c81707ae90 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:21.196716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28aecaca-4794-4755-8a9c-62c81707ae90 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:21.217088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0202e5f9-23e6-4108-819d-751f53bf2cfa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:21.234923 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0202e5f9-23e6-4108-819d-751f53bf2cfa tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.482740 Jan 22 21:12:21.236340 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2002/4173] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:20 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:21.443284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-28aecaca-4794-4755-8a9c-62c81707ae90 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:21.451939 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-28aecaca-4794-4755-8a9c-62c81707ae90 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.272099 Jan 22 21:12:21.453752 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2172/4174] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:21 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:21.521144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0be32ced-3749-4143-ba6b-9de985ff7dc6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'create', calling method: .version_select at 0x7f1ed50418b0>, body: {"keypair": {"name": "tempest-keypair-1211694180"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:21.535490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0be32ced-3749-4143-ba6b-9de985ff7dc6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Getting quotas for project 25a102ec3753465793d2bd70ee845e09. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:12:21.540676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0be32ced-3749-4143-ba6b-9de985ff7dc6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Getting quotas for user 05463958163742cb8907fff532940f11 and project 25a102ec3753465793d2bd70ee845e09. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:12:21.755499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0be32ced-3749-4143-ba6b-9de985ff7dc6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Getting quotas for project 25a102ec3753465793d2bd70ee845e09. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:12:21.767425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0be32ced-3749-4143-ba6b-9de985ff7dc6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Getting quotas for user 05463958163742cb8907fff532940f11 and project 25a102ec3753465793d2bd70ee845e09. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:12:21.788262 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0be32ced-3749-4143-ba6b-9de985ff7dc6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.420838 Jan 22 21:12:21.788957 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2003/4175] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:12:21 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:22.051930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f86c8176-2bbb-40e4-98dd-5d1cadcc993b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.052552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f86c8176-2bbb-40e4-98dd-5d1cadcc993b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.060005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f86c8176-2bbb-40e4-98dd-5d1cadcc993b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.060562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f86c8176-2bbb-40e4-98dd-5d1cadcc993b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.061785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f86c8176-2bbb-40e4-98dd-5d1cadcc993b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.062603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f86c8176-2bbb-40e4-98dd-5d1cadcc993b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.081466 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-f86c8176-2bbb-40e4-98dd-5d1cadcc993b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance 6246ed48-9f22-4375-bb21-57f112060395 could not be found. Jan 22 21:12:22.082272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f86c8176-2bbb-40e4-98dd-5d1cadcc993b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance 6246ed48-9f22-4375-bb21-57f112060395 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:22.083269 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f86c8176-2bbb-40e4-98dd-5d1cadcc993b tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 404 len: 111 microversion: 2.1 time: 0.034983 Jan 22 21:12:22.084151 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2173/4176] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:22 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:22.107993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ba11d565-24ab-4799-b39a-b0330a45e340 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.108504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ba11d565-24ab-4799-b39a-b0330a45e340 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.115551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba11d565-24ab-4799-b39a-b0330a45e340 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.116550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba11d565-24ab-4799-b39a-b0330a45e340 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.117746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba11d565-24ab-4799-b39a-b0330a45e340 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.118537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba11d565-24ab-4799-b39a-b0330a45e340 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.123342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6f758b51-50c5-48a6-91cb-d4bcddea2807 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:22.124944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6f758b51-50c5-48a6-91cb-d4bcddea2807 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.133099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f758b51-50c5-48a6-91cb-d4bcddea2807 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.133887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f758b51-50c5-48a6-91cb-d4bcddea2807 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.134946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f758b51-50c5-48a6-91cb-d4bcddea2807 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.136349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f758b51-50c5-48a6-91cb-d4bcddea2807 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.160532 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-ba11d565-24ab-4799-b39a-b0330a45e340 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance 6246ed48-9f22-4375-bb21-57f112060395 could not be found. Jan 22 21:12:22.161547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ba11d565-24ab-4799-b39a-b0330a45e340 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance 6246ed48-9f22-4375-bb21-57f112060395 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:22.162143 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ba11d565-24ab-4799-b39a-b0330a45e340 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 404 len: 111 microversion: 2.1 time: 0.062083 Jan 22 21:12:22.165869 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2004/4177] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:22 2022] DELETE /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:22.183389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-59abf48a-6ee5-4cf4-a80a-546b1ce89f80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.183389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-59abf48a-6ee5-4cf4-a80a-546b1ce89f80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 6246ed48-9f22-4375-bb21-57f112060395] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.190517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59abf48a-6ee5-4cf4-a80a-546b1ce89f80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.191391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59abf48a-6ee5-4cf4-a80a-546b1ce89f80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.192398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59abf48a-6ee5-4cf4-a80a-546b1ce89f80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.193228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59abf48a-6ee5-4cf4-a80a-546b1ce89f80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.207626 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6f758b51-50c5-48a6-91cb-d4bcddea2807 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.089399 Jan 22 21:12:22.211634 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2174/4178] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:22 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:22.212034 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-59abf48a-6ee5-4cf4-a80a-546b1ce89f80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance 6246ed48-9f22-4375-bb21-57f112060395 could not be found. Jan 22 21:12:22.212647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-59abf48a-6ee5-4cf4-a80a-546b1ce89f80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance 6246ed48-9f22-4375-bb21-57f112060395 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:22.213549 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-59abf48a-6ee5-4cf4-a80a-546b1ce89f80 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395" status: 404 len: 111 microversion: 2.1 time: 0.045902 Jan 22 21:12:22.214077 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2005/4179] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:22 2022] GET /compute/v2.1/servers/6246ed48-9f22-4375-bb21-57f112060395 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:22.225234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85fa28fc-cb34-4d5d-ab22-1171b0678e6c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.227627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85fa28fc-cb34-4d5d-ab22-1171b0678e6c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.228240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e8003229-44ca-4f29-b053-e03f82bfb12d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:22.230963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e8003229-44ca-4f29-b053-e03f82bfb12d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.235654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85fa28fc-cb34-4d5d-ab22-1171b0678e6c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.236348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85fa28fc-cb34-4d5d-ab22-1171b0678e6c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.237871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85fa28fc-cb34-4d5d-ab22-1171b0678e6c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.238385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85fa28fc-cb34-4d5d-ab22-1171b0678e6c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.253766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8003229-44ca-4f29-b053-e03f82bfb12d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.255398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8003229-44ca-4f29-b053-e03f82bfb12d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.256358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8003229-44ca-4f29-b053-e03f82bfb12d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.257864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8003229-44ca-4f29-b053-e03f82bfb12d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.274979 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-85fa28fc-cb34-4d5d-ab22-1171b0678e6c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 could not be found. Jan 22 21:12:22.280126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85fa28fc-cb34-4d5d-ab22-1171b0678e6c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:22.280309 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-85fa28fc-cb34-4d5d-ab22-1171b0678e6c tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 404 len: 111 microversion: 2.1 time: 0.062082 Jan 22 21:12:22.281951 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2006/4180] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:22 2022] DELETE /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:12:22.287669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-797d2123-a28c-4868-a333-c2dc788b3e2c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.288292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-797d2123-a28c-4868-a333-c2dc788b3e2c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.296404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-797d2123-a28c-4868-a333-c2dc788b3e2c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.296870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-797d2123-a28c-4868-a333-c2dc788b3e2c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.297753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-797d2123-a28c-4868-a333-c2dc788b3e2c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.298839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-797d2123-a28c-4868-a333-c2dc788b3e2c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.353046 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e8003229-44ca-4f29-b053-e03f82bfb12d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.139932 Jan 22 21:12:22.354165 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2175/4181] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:22 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:22.366538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-15a7ae88-20d7-40b8-8d37-5b6423c18ab9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.366538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-15a7ae88-20d7-40b8-8d37-5b6423c18ab9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: d5503c80-72b0-4a0b-b82f-333ae4fdd2d8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.370960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15a7ae88-20d7-40b8-8d37-5b6423c18ab9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.371744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15a7ae88-20d7-40b8-8d37-5b6423c18ab9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.381337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15a7ae88-20d7-40b8-8d37-5b6423c18ab9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.382591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15a7ae88-20d7-40b8-8d37-5b6423c18ab9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.413097 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-15a7ae88-20d7-40b8-8d37-5b6423c18ab9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 could not be found. Jan 22 21:12:22.416857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-15a7ae88-20d7-40b8-8d37-5b6423c18ab9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:22.419134 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-15a7ae88-20d7-40b8-8d37-5b6423c18ab9 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8" status: 404 len: 111 microversion: 2.1 time: 0.062801 Jan 22 21:12:22.424597 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2176/4182] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:22 2022] GET /compute/v2.1/servers/d5503c80-72b0-4a0b-b82f-333ae4fdd2d8 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:22.430588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-faf7668c-f197-45d7-bcc2-87a464097d28 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.431603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-faf7668c-f197-45d7-bcc2-87a464097d28 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.441613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-faf7668c-f197-45d7-bcc2-87a464097d28 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.442266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-faf7668c-f197-45d7-bcc2-87a464097d28 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.443382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-faf7668c-f197-45d7-bcc2-87a464097d28 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.444007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-faf7668c-f197-45d7-bcc2-87a464097d28 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.461741 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-faf7668c-f197-45d7-bcc2-87a464097d28 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance 0e4b1a45-6907-44b8-9395-4d44ffeb22b7 could not be found. Jan 22 21:12:22.464265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-faf7668c-f197-45d7-bcc2-87a464097d28 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance 0e4b1a45-6907-44b8-9395-4d44ffeb22b7 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:22.464265 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-faf7668c-f197-45d7-bcc2-87a464097d28 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 404 len: 111 microversion: 2.1 time: 0.037347 Jan 22 21:12:22.464728 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2177/4183] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:22 2022] DELETE /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:22.478862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7f12f543-72e4-4315-9568-bea946775575 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.478862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7f12f543-72e4-4315-9568-bea946775575 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.482370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f12f543-72e4-4315-9568-bea946775575 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.483106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f12f543-72e4-4315-9568-bea946775575 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.484176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f12f543-72e4-4315-9568-bea946775575 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.484797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f12f543-72e4-4315-9568-bea946775575 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.521570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-797d2123-a28c-4868-a333-c2dc788b3e2c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:22.532247 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-797d2123-a28c-4868-a333-c2dc788b3e2c tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.249198 Jan 22 21:12:22.532946 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2007/4184] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:22 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:22.545430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-934a90de-f37a-4857-819c-4242b32fcc33 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.551556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-934a90de-f37a-4857-819c-4242b32fcc33 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 0e4b1a45-6907-44b8-9395-4d44ffeb22b7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.559939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-934a90de-f37a-4857-819c-4242b32fcc33 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.560785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-934a90de-f37a-4857-819c-4242b32fcc33 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.562115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-934a90de-f37a-4857-819c-4242b32fcc33 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.563744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-934a90de-f37a-4857-819c-4242b32fcc33 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.594585 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-934a90de-f37a-4857-819c-4242b32fcc33 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance 0e4b1a45-6907-44b8-9395-4d44ffeb22b7 could not be found. Jan 22 21:12:22.596041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-934a90de-f37a-4857-819c-4242b32fcc33 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance 0e4b1a45-6907-44b8-9395-4d44ffeb22b7 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:22.602063 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-934a90de-f37a-4857-819c-4242b32fcc33 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7" status: 404 len: 111 microversion: 2.1 time: 0.062612 Jan 22 21:12:22.602063 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2008/4185] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:22 2022] GET /compute/v2.1/servers/0e4b1a45-6907-44b8-9395-4d44ffeb22b7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:22.609017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a5dc6a4-fbd3-4f1c-a52d-4ceebabfc30a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.609910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9a5dc6a4-fbd3-4f1c-a52d-4ceebabfc30a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.619360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a5dc6a4-fbd3-4f1c-a52d-4ceebabfc30a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.620170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a5dc6a4-fbd3-4f1c-a52d-4ceebabfc30a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.621218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a5dc6a4-fbd3-4f1c-a52d-4ceebabfc30a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.621904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a5dc6a4-fbd3-4f1c-a52d-4ceebabfc30a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.656155 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-9a5dc6a4-fbd3-4f1c-a52d-4ceebabfc30a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance 8b638a02-13d3-4b01-bd61-47787c7db9dc could not be found. Jan 22 21:12:22.658696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a5dc6a4-fbd3-4f1c-a52d-4ceebabfc30a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance 8b638a02-13d3-4b01-bd61-47787c7db9dc could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:22.659851 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a5dc6a4-fbd3-4f1c-a52d-4ceebabfc30a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 404 len: 111 microversion: 2.1 time: 0.055882 Jan 22 21:12:22.663512 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2009/4186] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:22 2022] DELETE /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:22.671200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6ae63e1a-2bb7-4ff0-8eb2-7a12ea1dfaa3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.671357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6ae63e1a-2bb7-4ff0-8eb2-7a12ea1dfaa3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 8b638a02-13d3-4b01-bd61-47787c7db9dc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.679264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ae63e1a-2bb7-4ff0-8eb2-7a12ea1dfaa3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.679957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ae63e1a-2bb7-4ff0-8eb2-7a12ea1dfaa3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.680762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ae63e1a-2bb7-4ff0-8eb2-7a12ea1dfaa3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.681210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ae63e1a-2bb7-4ff0-8eb2-7a12ea1dfaa3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.700438 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-6ae63e1a-2bb7-4ff0-8eb2-7a12ea1dfaa3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance 8b638a02-13d3-4b01-bd61-47787c7db9dc could not be found. Jan 22 21:12:22.701082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6ae63e1a-2bb7-4ff0-8eb2-7a12ea1dfaa3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance 8b638a02-13d3-4b01-bd61-47787c7db9dc could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:22.702482 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6ae63e1a-2bb7-4ff0-8eb2-7a12ea1dfaa3 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc" status: 404 len: 111 microversion: 2.1 time: 0.037049 Jan 22 21:12:22.703514 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2010/4187] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:22 2022] GET /compute/v2.1/servers/8b638a02-13d3-4b01-bd61-47787c7db9dc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:22.714214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e33cb74b-01f1-4a79-83cd-04f28cd45506 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.715425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e33cb74b-01f1-4a79-83cd-04f28cd45506 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.724609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e33cb74b-01f1-4a79-83cd-04f28cd45506 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.725083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e33cb74b-01f1-4a79-83cd-04f28cd45506 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.726450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e33cb74b-01f1-4a79-83cd-04f28cd45506 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.726566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e33cb74b-01f1-4a79-83cd-04f28cd45506 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.745972 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-e33cb74b-01f1-4a79-83cd-04f28cd45506 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance ea383184-f9d7-42bf-ae0b-91ef44de1864 could not be found. Jan 22 21:12:22.746795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e33cb74b-01f1-4a79-83cd-04f28cd45506 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance ea383184-f9d7-42bf-ae0b-91ef44de1864 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:22.748140 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e33cb74b-01f1-4a79-83cd-04f28cd45506 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 404 len: 111 microversion: 2.1 time: 0.038614 Jan 22 21:12:22.749223 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2011/4188] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:22 2022] DELETE /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:12:22.756603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7f12f543-72e4-4315-9568-bea946775575 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:22.761792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-57606549-9a01-4d17-9587-6a573c8ec7f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.764892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-57606549-9a01-4d17-9587-6a573c8ec7f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: ea383184-f9d7-42bf-ae0b-91ef44de1864] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.771231 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7f12f543-72e4-4315-9568-bea946775575 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1509 microversion: 2.1 time: 0.300948 Jan 22 21:12:22.771231 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2178/4189] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:22 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1509 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:22.782398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57606549-9a01-4d17-9587-6a573c8ec7f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.783462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57606549-9a01-4d17-9587-6a573c8ec7f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.786109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57606549-9a01-4d17-9587-6a573c8ec7f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.786813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57606549-9a01-4d17-9587-6a573c8ec7f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.804648 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-57606549-9a01-4d17-9587-6a573c8ec7f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance ea383184-f9d7-42bf-ae0b-91ef44de1864 could not be found. Jan 22 21:12:22.805272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-57606549-9a01-4d17-9587-6a573c8ec7f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance ea383184-f9d7-42bf-ae0b-91ef44de1864 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:22.806134 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-57606549-9a01-4d17-9587-6a573c8ec7f4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864" status: 404 len: 111 microversion: 2.1 time: 0.052541 Jan 22 21:12:22.806718 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2012/4190] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:22 2022] GET /compute/v2.1/servers/ea383184-f9d7-42bf-ae0b-91ef44de1864 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:22.815095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-16631fe3-61f6-423f-82cf-3675cc4f17ee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.815612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-16631fe3-61f6-423f-82cf-3675cc4f17ee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.836561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16631fe3-61f6-423f-82cf-3675cc4f17ee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.840750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16631fe3-61f6-423f-82cf-3675cc4f17ee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.840750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16631fe3-61f6-423f-82cf-3675cc4f17ee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.840750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16631fe3-61f6-423f-82cf-3675cc4f17ee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.855402 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-16631fe3-61f6-423f-82cf-3675cc4f17ee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance b41b91ef-4d7d-4284-b923-7a1d415871eb could not be found. Jan 22 21:12:22.856017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-16631fe3-61f6-423f-82cf-3675cc4f17ee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance b41b91ef-4d7d-4284-b923-7a1d415871eb could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:22.856858 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-16631fe3-61f6-423f-82cf-3675cc4f17ee tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 404 len: 111 microversion: 2.1 time: 0.045585 Jan 22 21:12:22.857580 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2179/4191] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:22 2022] DELETE /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:22.866219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b419d799-b83e-454c-9acc-093afb4207e5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.866825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b419d799-b83e-454c-9acc-093afb4207e5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: b41b91ef-4d7d-4284-b923-7a1d415871eb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.874315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b419d799-b83e-454c-9acc-093afb4207e5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.874957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b419d799-b83e-454c-9acc-093afb4207e5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.876247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b419d799-b83e-454c-9acc-093afb4207e5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.876838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b419d799-b83e-454c-9acc-093afb4207e5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.892304 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-b419d799-b83e-454c-9acc-093afb4207e5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance b41b91ef-4d7d-4284-b923-7a1d415871eb could not be found. Jan 22 21:12:22.892911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b419d799-b83e-454c-9acc-093afb4207e5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance b41b91ef-4d7d-4284-b923-7a1d415871eb could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:22.893851 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b419d799-b83e-454c-9acc-093afb4207e5 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb" status: 404 len: 111 microversion: 2.1 time: 0.031666 Jan 22 21:12:22.894713 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2013/4192] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:22 2022] GET /compute/v2.1/servers/b41b91ef-4d7d-4284-b923-7a1d415871eb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:22.902780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0f49d214-9060-46dc-9d00-002a34c01b5a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.903279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0f49d214-9060-46dc-9d00-002a34c01b5a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.908810 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-0f49d214-9060-46dc-9d00-002a34c01b5a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance 7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024 could not be found. Jan 22 21:12:22.909395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0f49d214-9060-46dc-9d00-002a34c01b5a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance 7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:22.910253 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0f49d214-9060-46dc-9d00-002a34c01b5a tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024" status: 404 len: 111 microversion: 2.1 time: 0.011521 Jan 22 21:12:22.910975 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2180/4193] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:22 2022] DELETE /compute/v2.1/servers/7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024 => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:22.918654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96eb3369-ad66-433b-8234-c47f17279f34 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.919261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96eb3369-ad66-433b-8234-c47f17279f34 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.924781 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-96eb3369-ad66-433b-8234-c47f17279f34 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance 7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024 could not be found. Jan 22 21:12:22.926328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96eb3369-ad66-433b-8234-c47f17279f34 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance 7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:22.929690 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96eb3369-ad66-433b-8234-c47f17279f34 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024" status: 404 len: 111 microversion: 2.1 time: 0.012420 Jan 22 21:12:22.929690 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2014/4194] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:22 2022] GET /compute/v2.1/servers/7efc0923-dbfe-4ed9-87b1-2bcfdfd1d024 => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:22.936969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1fa84b9a-1741-4c62-a533-4e5a707feaf4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:22.937470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1fa84b9a-1741-4c62-a533-4e5a707feaf4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:22.946678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1fa84b9a-1741-4c62-a533-4e5a707feaf4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.947108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1fa84b9a-1741-4c62-a533-4e5a707feaf4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.949883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1fa84b9a-1741-4c62-a533-4e5a707feaf4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:22.950374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1fa84b9a-1741-4c62-a533-4e5a707feaf4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:22.977949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1fa84b9a-1741-4c62-a533-4e5a707feaf4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:12:23.221813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-934b2cd9-97f1-4319-a5be-0f9026f2fc22 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:23.225374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-934b2cd9-97f1-4319-a5be-0f9026f2fc22 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:23.238570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-934b2cd9-97f1-4319-a5be-0f9026f2fc22 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:23.241412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-934b2cd9-97f1-4319-a5be-0f9026f2fc22 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:23.243882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-934b2cd9-97f1-4319-a5be-0f9026f2fc22 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:23.244648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-934b2cd9-97f1-4319-a5be-0f9026f2fc22 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:23.328279 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-934b2cd9-97f1-4319-a5be-0f9026f2fc22 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.102335 Jan 22 21:12:23.329663 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2015/4195] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:23 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:23.366090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-67ef9b2d-9b2e-402f-b83e-3f835b06003f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:23.367196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-67ef9b2d-9b2e-402f-b83e-3f835b06003f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:23.377285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67ef9b2d-9b2e-402f-b83e-3f835b06003f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:23.377860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67ef9b2d-9b2e-402f-b83e-3f835b06003f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:23.378745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67ef9b2d-9b2e-402f-b83e-3f835b06003f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:23.379293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67ef9b2d-9b2e-402f-b83e-3f835b06003f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:23.426188 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-67ef9b2d-9b2e-402f-b83e-3f835b06003f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.064129 Jan 22 21:12:23.427190 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2016/4196] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:23 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:23.456104 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1fa84b9a-1741-4c62-a533-4e5a707feaf4 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "DELETE /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 204 len: 0 microversion: 2.1 time: 0.520270 Jan 22 21:12:23.457565 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2181/4197] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:22 2022] DELETE /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:12:23.466574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0276671a-f083-4735-904e-ca3f4b4ce062 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:23.467346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0276671a-f083-4735-904e-ca3f4b4ce062 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:23.476692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0276671a-f083-4735-904e-ca3f4b4ce062 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:23.477407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0276671a-f083-4735-904e-ca3f4b4ce062 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:23.479625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0276671a-f083-4735-904e-ca3f4b4ce062 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:23.481873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0276671a-f083-4735-904e-ca3f4b4ce062 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:23.550931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1679c799-a81e-414b-9e5c-aa7415b5bffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:23.551645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1679c799-a81e-414b-9e5c-aa7415b5bffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:23.559659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1679c799-a81e-414b-9e5c-aa7415b5bffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:23.560129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1679c799-a81e-414b-9e5c-aa7415b5bffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:23.560943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1679c799-a81e-414b-9e5c-aa7415b5bffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:23.561390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1679c799-a81e-414b-9e5c-aa7415b5bffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:23.692068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0276671a-f083-4735-904e-ca3f4b4ce062 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:23.704964 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0276671a-f083-4735-904e-ca3f4b4ce062 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1481 microversion: 2.1 time: 0.243149 Jan 22 21:12:23.707081 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2017/4198] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:23 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1481 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:23.786676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f24d667f-e479-4b0d-b6d8-7956e43f6dc1 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:23.788045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f24d667f-e479-4b0d-b6d8-7956e43f6dc1 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:23.801398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f24d667f-e479-4b0d-b6d8-7956e43f6dc1 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:23.804266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f24d667f-e479-4b0d-b6d8-7956e43f6dc1 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:23.808394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f24d667f-e479-4b0d-b6d8-7956e43f6dc1 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:23.809386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f24d667f-e479-4b0d-b6d8-7956e43f6dc1 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:23.935020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f24d667f-e479-4b0d-b6d8-7956e43f6dc1 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:23.946020 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f24d667f-e479-4b0d-b6d8-7956e43f6dc1 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1467 microversion: 2.1 time: 0.162843 Jan 22 21:12:23.952629 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2018/4199] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:23 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1467 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:23.952629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-517421aa-b70b-4e3e-a7f1-25c891472e81 req-ccc842fb-b470-4d2c-b306-5d1821207ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dfc70ea-429f-48ac-b11d-d720aa0130d6", "name": "network-vif-deleted", "tag": "d9f0f206-48d8-436d-8afd-c78217567334"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:23.954528 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:23.954528 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:12:23.963049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-517421aa-b70b-4e3e-a7f1-25c891472e81 req-ccc842fb-b470-4d2c-b306-5d1821207ccb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:23.964470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-517421aa-b70b-4e3e-a7f1-25c891472e81 req-ccc842fb-b470-4d2c-b306-5d1821207ccb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:23.976683 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-517421aa-b70b-4e3e-a7f1-25c891472e81 req-ccc842fb-b470-4d2c-b306-5d1821207ccb service nova] Creating event network-vif-deleted:d9f0f206-48d8-436d-8afd-c78217567334 for instance 2dfc70ea-429f-48ac-b11d-d720aa0130d6 on nch1-master-1 Jan 22 21:12:23.983835 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-517421aa-b70b-4e3e-a7f1-25c891472e81 req-ccc842fb-b470-4d2c-b306-5d1821207ccb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035923 Jan 22 21:12:23.984453 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2019/4200] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:24.056900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1679c799-a81e-414b-9e5c-aa7415b5bffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:24.065547 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1679c799-a81e-414b-9e5c-aa7415b5bffc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1478 microversion: 2.1 time: 0.518640 Jan 22 21:12:24.085282 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2182/4201] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:23 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1478 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:24.344464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5885ecfe-5bb5-4af2-9716-ef982d51944c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:24.347727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5885ecfe-5bb5-4af2-9716-ef982d51944c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:24.355637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5885ecfe-5bb5-4af2-9716-ef982d51944c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:24.356394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5885ecfe-5bb5-4af2-9716-ef982d51944c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:24.357386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5885ecfe-5bb5-4af2-9716-ef982d51944c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:24.358302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5885ecfe-5bb5-4af2-9716-ef982d51944c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:24.439052 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5885ecfe-5bb5-4af2-9716-ef982d51944c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.101836 Jan 22 21:12:24.439473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2097ac82-5cb6-4570-9c15-6b7abecb8dc8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:24.440361 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2020/4202] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:24 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:24.443253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2097ac82-5cb6-4570-9c15-6b7abecb8dc8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:24.464321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2097ac82-5cb6-4570-9c15-6b7abecb8dc8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:24.465232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2097ac82-5cb6-4570-9c15-6b7abecb8dc8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:24.465633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2097ac82-5cb6-4570-9c15-6b7abecb8dc8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:24.466133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2097ac82-5cb6-4570-9c15-6b7abecb8dc8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:24.519011 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2097ac82-5cb6-4570-9c15-6b7abecb8dc8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.084131 Jan 22 21:12:24.519791 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2183/4203] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:24 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:24.724855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d14258b5-932d-40bc-bbbe-9a4308ca963e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:24.729957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d14258b5-932d-40bc-bbbe-9a4308ca963e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:24.733539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d14258b5-932d-40bc-bbbe-9a4308ca963e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:24.734007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d14258b5-932d-40bc-bbbe-9a4308ca963e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:24.734881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d14258b5-932d-40bc-bbbe-9a4308ca963e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:24.735329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d14258b5-932d-40bc-bbbe-9a4308ca963e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:24.945945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d14258b5-932d-40bc-bbbe-9a4308ca963e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:24.963211 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d14258b5-932d-40bc-bbbe-9a4308ca963e tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1481 microversion: 2.1 time: 0.239340 Jan 22 21:12:24.964598 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2021/4204] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:24 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1481 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:24.965369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2b516c49-bb39-49f9-984a-490c5adbcb5a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:24.966128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2b516c49-bb39-49f9-984a-490c5adbcb5a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:24.983609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b516c49-bb39-49f9-984a-490c5adbcb5a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:24.983991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b516c49-bb39-49f9-984a-490c5adbcb5a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:24.984801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b516c49-bb39-49f9-984a-490c5adbcb5a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:24.985265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b516c49-bb39-49f9-984a-490c5adbcb5a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:25.066804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b516c49-bb39-49f9-984a-490c5adbcb5a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:25.067597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b516c49-bb39-49f9-984a-490c5adbcb5a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:25.068458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-2b516c49-bb39-49f9-984a-490c5adbcb5a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lazy-loading 'fault' on Instance uuid 2dfc70ea-429f-48ac-b11d-d720aa0130d6 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:12:25.086045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f609d289-95d3-4bfa-bb49-a02bf7ad6c5d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:25.087666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f609d289-95d3-4bfa-bb49-a02bf7ad6c5d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:25.096726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f609d289-95d3-4bfa-bb49-a02bf7ad6c5d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:25.097454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f609d289-95d3-4bfa-bb49-a02bf7ad6c5d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:25.098730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f609d289-95d3-4bfa-bb49-a02bf7ad6c5d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:25.099471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f609d289-95d3-4bfa-bb49-a02bf7ad6c5d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:25.126641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2b516c49-bb39-49f9-984a-490c5adbcb5a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:25.135682 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2b516c49-bb39-49f9-984a-490c5adbcb5a tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 200 len: 1307 microversion: 2.1 time: 0.175362 Jan 22 21:12:25.136316 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2184/4205] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:24 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 1307 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:25.287523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1255268800", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8333cfa-9dd9-48b4-af6f-4a39e320b704"}], "security_groups": [{"name": "tempest-securitygroup--533305295"}], "key_name": "tempest-keypair-1211694180", "user_data": "}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:25.431033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] validate_networks() for [('b8333cfa-9dd9-48b4-af6f-4a39e320b704', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:12:25.478049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f609d289-95d3-4bfa-bb49-a02bf7ad6c5d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:25.495325 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f609d289-95d3-4bfa-bb49-a02bf7ad6c5d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1477 microversion: 2.1 time: 0.414525 Jan 22 21:12:25.497706 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2022/4206] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:25 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1477 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:25.512548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-81a135de-0490-48f8-ab80-461c3c8722ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:25.519198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-81a135de-0490-48f8-ab80-461c3c8722ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:25.533891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81a135de-0490-48f8-ab80-461c3c8722ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:25.534378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81a135de-0490-48f8-ab80-461c3c8722ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:25.535880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81a135de-0490-48f8-ab80-461c3c8722ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:25.536345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81a135de-0490-48f8-ab80-461c3c8722ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:25.621212 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-81a135de-0490-48f8-ab80-461c3c8722ef tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.119171 Jan 22 21:12:25.628183 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2023/4207] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:25 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:25.642695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-efda9321-61df-494c-8304-7d06d9a9859d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:25.645668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-efda9321-61df-494c-8304-7d06d9a9859d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:25.660313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efda9321-61df-494c-8304-7d06d9a9859d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:25.660785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efda9321-61df-494c-8304-7d06d9a9859d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:25.661663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efda9321-61df-494c-8304-7d06d9a9859d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:25.662276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efda9321-61df-494c-8304-7d06d9a9859d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:25.746891 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-efda9321-61df-494c-8304-7d06d9a9859d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.119651 Jan 22 21:12:25.747673 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2024/4208] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:25 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:25.989386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4ce95718-451f-4446-9119-867cd048d150 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:25.990840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4ce95718-451f-4446-9119-867cd048d150 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:26.018280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ce95718-451f-4446-9119-867cd048d150 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:26.020708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ce95718-451f-4446-9119-867cd048d150 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:26.021790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ce95718-451f-4446-9119-867cd048d150 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:26.026809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ce95718-451f-4446-9119-867cd048d150 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:26.130794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:12:26.131740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:12:26.132389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:12:26.132976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:12:26.133606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:12:26.147713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:26.151741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:26.151741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:26.151741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:26.181219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Getting quotas for project 25a102ec3753465793d2bd70ee845e09. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:12:26.187388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Getting quotas for user 05463958163742cb8907fff532940f11 and project 25a102ec3753465793d2bd70ee845e09. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:12:26.205478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:12:26.209196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:12:26.372754 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b31b17cb-64d8-4eb0-ac44-bc4cc36d9030 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.090901 Jan 22 21:12:26.379154 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2185/4209] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:12:25 2022] POST /compute/v2.1/servers => generated 403 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:12:26.384268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-358b1389-387a-440c-ad57-8fbe9ebd2a70 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:26.385777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-358b1389-387a-440c-ad57-8fbe9ebd2a70 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: 2dfc70ea-429f-48ac-b11d-d720aa0130d6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:26.397385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-358b1389-387a-440c-ad57-8fbe9ebd2a70 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:26.397385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-358b1389-387a-440c-ad57-8fbe9ebd2a70 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:26.397385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-358b1389-387a-440c-ad57-8fbe9ebd2a70 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:26.397893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-358b1389-387a-440c-ad57-8fbe9ebd2a70 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:26.417369 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-358b1389-387a-440c-ad57-8fbe9ebd2a70 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] HTTP exception thrown: Instance 2dfc70ea-429f-48ac-b11d-d720aa0130d6 could not be found. Jan 22 21:12:26.418084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-358b1389-387a-440c-ad57-8fbe9ebd2a70 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Returning 404 to user: Instance 2dfc70ea-429f-48ac-b11d-d720aa0130d6 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:26.419019 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-358b1389-387a-440c-ad57-8fbe9ebd2a70 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6" status: 404 len: 111 microversion: 2.1 time: 0.038430 Jan 22 21:12:26.423080 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2186/4210] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:26 2022] GET /compute/v2.1/servers/2dfc70ea-429f-48ac-b11d-d720aa0130d6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:26.427851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-73c238ba-3119-4554-851f-128f054fe902 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:26.429487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-73c238ba-3119-4554-851f-128f054fe902 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:26.471535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4ce95718-451f-4446-9119-867cd048d150 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:26.479082 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4ce95718-451f-4446-9119-867cd048d150 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1481 microversion: 2.1 time: 0.499772 Jan 22 21:12:26.483248 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2025/4211] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:25 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1481 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:26.498873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-585e938c-e4e5-4a1f-9e71-c5ffbb3f2afc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:26.501810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-585e938c-e4e5-4a1f-9e71-c5ffbb3f2afc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:26.502153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-73c238ba-3119-4554-851f-128f054fe902 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:26.509032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-585e938c-e4e5-4a1f-9e71-c5ffbb3f2afc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:26.509755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-585e938c-e4e5-4a1f-9e71-c5ffbb3f2afc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:26.511703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-585e938c-e4e5-4a1f-9e71-c5ffbb3f2afc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:26.512359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-585e938c-e4e5-4a1f-9e71-c5ffbb3f2afc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:26.512744 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-73c238ba-3119-4554-851f-128f054fe902 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1242 microversion: 2.1 time: 0.088313 Jan 22 21:12:26.513352 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2187/4212] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:26 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:26.527120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-56378b98-b2b3-4562-9563-b51787ff74fc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:26.528064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-56378b98-b2b3-4562-9563-b51787ff74fc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:26.538426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56378b98-b2b3-4562-9563-b51787ff74fc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:26.542077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56378b98-b2b3-4562-9563-b51787ff74fc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:26.543072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56378b98-b2b3-4562-9563-b51787ff74fc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:26.543539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56378b98-b2b3-4562-9563-b51787ff74fc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:26.555211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-585e938c-e4e5-4a1f-9e71-c5ffbb3f2afc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:12:26.761868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-56378b98-b2b3-4562-9563-b51787ff74fc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:26.769607 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-56378b98-b2b3-4562-9563-b51787ff74fc tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1477 microversion: 2.1 time: 0.253831 Jan 22 21:12:26.770185 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2188/4213] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:26 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1477 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:26.775007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1f5664b6-785d-41b3-b0cd-d44fcce5b064 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:26.776577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1f5664b6-785d-41b3-b0cd-d44fcce5b064 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:26.782845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f5664b6-785d-41b3-b0cd-d44fcce5b064 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:26.783302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f5664b6-785d-41b3-b0cd-d44fcce5b064 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:26.784273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f5664b6-785d-41b3-b0cd-d44fcce5b064 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:26.784906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f5664b6-785d-41b3-b0cd-d44fcce5b064 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:26.825783 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1f5664b6-785d-41b3-b0cd-d44fcce5b064 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.054164 Jan 22 21:12:26.829943 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2189/4214] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:26 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:26.831542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-329cd2f4-7eb3-4da1-82a4-9acace6785d1 req-1dcc4469-d528-48f9-9beb-391594e8db5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc5d005-c458-46e9-87ee-b837034d76c7", "name": "network-vif-unplugged", "status": "completed", "tag": "c8ca2591-f475-4a3e-8f6c-e2b56416c2cf"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:26.833004 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:26.833004 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:12:26.841580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-329cd2f4-7eb3-4da1-82a4-9acace6785d1 req-1dcc4469-d528-48f9-9beb-391594e8db5c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:26.842038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-329cd2f4-7eb3-4da1-82a4-9acace6785d1 req-1dcc4469-d528-48f9-9beb-391594e8db5c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:26.855020 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-329cd2f4-7eb3-4da1-82a4-9acace6785d1 req-1dcc4469-d528-48f9-9beb-391594e8db5c service nova] Creating event network-vif-unplugged:c8ca2591-f475-4a3e-8f6c-e2b56416c2cf for instance fcc5d005-c458-46e9-87ee-b837034d76c7 on nch1-master-1 Jan 22 21:12:26.860662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-329cd2f4-7eb3-4da1-82a4-9acace6785d1 req-1dcc4469-d528-48f9-9beb-391594e8db5c service nova] Instance fcc5d005-c458-46e9-87ee-b837034d76c7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:12:26.871972 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-329cd2f4-7eb3-4da1-82a4-9acace6785d1 req-1dcc4469-d528-48f9-9beb-391594e8db5c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043924 Jan 22 21:12:26.877752 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2190/4215] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:26.878154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4e4a0192-aa6f-4b53-870e-c37ae733428a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:26.879179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4e4a0192-aa6f-4b53-870e-c37ae733428a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:26.885830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e4a0192-aa6f-4b53-870e-c37ae733428a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:26.886416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e4a0192-aa6f-4b53-870e-c37ae733428a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:26.887223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e4a0192-aa6f-4b53-870e-c37ae733428a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:26.887673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e4a0192-aa6f-4b53-870e-c37ae733428a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:26.945845 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4e4a0192-aa6f-4b53-870e-c37ae733428a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.071823 Jan 22 21:12:26.947219 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2191/4216] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:26 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:27.062754 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-585e938c-e4e5-4a1f-9e71-c5ffbb3f2afc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "DELETE /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 204 len: 0 microversion: 2.1 time: 0.578151 Jan 22 21:12:27.063889 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2026/4217] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:26 2022] DELETE /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:12:27.072336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d9b19273-4d9b-4212-b25c-7dd47a3dcfe6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:27.073681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d9b19273-4d9b-4212-b25c-7dd47a3dcfe6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:27.081815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9b19273-4d9b-4212-b25c-7dd47a3dcfe6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:27.082306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9b19273-4d9b-4212-b25c-7dd47a3dcfe6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:27.083118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9b19273-4d9b-4212-b25c-7dd47a3dcfe6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:27.083577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9b19273-4d9b-4212-b25c-7dd47a3dcfe6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:27.334150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d9b19273-4d9b-4212-b25c-7dd47a3dcfe6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:27.346934 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d9b19273-4d9b-4212-b25c-7dd47a3dcfe6 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1495 microversion: 2.1 time: 0.278490 Jan 22 21:12:27.347553 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2192/4218] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:27 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1495 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:27.500418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6202a05c-7635-4aaa-82b1-8c3813eb7bc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:27.501332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6202a05c-7635-4aaa-82b1-8c3813eb7bc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:27.509196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6202a05c-7635-4aaa-82b1-8c3813eb7bc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:27.510028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6202a05c-7635-4aaa-82b1-8c3813eb7bc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:27.511400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6202a05c-7635-4aaa-82b1-8c3813eb7bc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:27.512080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6202a05c-7635-4aaa-82b1-8c3813eb7bc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:27.539397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d0bac58b-5fd3-4654-b727-89c58ae3f704 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:27.540333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d0bac58b-5fd3-4654-b727-89c58ae3f704 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:27.568359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6202a05c-7635-4aaa-82b1-8c3813eb7bc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:27.569183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6202a05c-7635-4aaa-82b1-8c3813eb7bc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:27.570190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-6202a05c-7635-4aaa-82b1-8c3813eb7bc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lazy-loading 'fault' on Instance uuid 39f36bf0-d956-467f-9f13-4efbcae13cad {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:12:27.629741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d0bac58b-5fd3-4654-b727-89c58ae3f704 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:27.641012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6202a05c-7635-4aaa-82b1-8c3813eb7bc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75befd3272db4de48c7b4586adf6f849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0d2f31f914c52a4ea5db2f34a532e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:27.642023 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d0bac58b-5fd3-4654-b727-89c58ae3f704 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1242 microversion: 2.1 time: 0.115773 Jan 22 21:12:27.642938 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2193/4219] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:27 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1242 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:27.657222 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6202a05c-7635-4aaa-82b1-8c3813eb7bc2 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 200 len: 1286 microversion: 2.1 time: 0.160119 Jan 22 21:12:27.657955 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2027/4220] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:27 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 1286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:27.790213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-92547bbe-88da-4260-bfe3-5ff4ad315982 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:27.791140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-92547bbe-88da-4260-bfe3-5ff4ad315982 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:27.801267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92547bbe-88da-4260-bfe3-5ff4ad315982 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:27.802362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92547bbe-88da-4260-bfe3-5ff4ad315982 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:27.804147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92547bbe-88da-4260-bfe3-5ff4ad315982 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:27.805144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92547bbe-88da-4260-bfe3-5ff4ad315982 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:27.837692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-afbef354-0347-4b65-b4d7-32f81d874a2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:27.839331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-afbef354-0347-4b65-b4d7-32f81d874a2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:27.853186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afbef354-0347-4b65-b4d7-32f81d874a2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:27.854131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afbef354-0347-4b65-b4d7-32f81d874a2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:27.862641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afbef354-0347-4b65-b4d7-32f81d874a2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:27.863226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afbef354-0347-4b65-b4d7-32f81d874a2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:27.914691 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-afbef354-0347-4b65-b4d7-32f81d874a2f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.080447 Jan 22 21:12:27.915381 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2028/4221] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:27 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:27.959443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8aa1ca13-e35a-4468-8583-d64b4e5960d6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:27.960605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8aa1ca13-e35a-4468-8583-d64b4e5960d6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:27.968861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8aa1ca13-e35a-4468-8583-d64b4e5960d6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:27.971352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8aa1ca13-e35a-4468-8583-d64b4e5960d6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:27.971352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8aa1ca13-e35a-4468-8583-d64b4e5960d6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:27.971352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8aa1ca13-e35a-4468-8583-d64b4e5960d6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:28.018762 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8aa1ca13-e35a-4468-8583-d64b4e5960d6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.063304 Jan 22 21:12:28.020759 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2029/4222] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:27 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:28.064810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-92547bbe-88da-4260-bfe3-5ff4ad315982 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:28.073125 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-92547bbe-88da-4260-bfe3-5ff4ad315982 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1477 microversion: 2.1 time: 0.288809 Jan 22 21:12:28.083447 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2194/4223] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:27 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1477 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:28.365176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d23085c3-90dc-443b-a448-6bfa70585d45 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:28.365934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d23085c3-90dc-443b-a448-6bfa70585d45 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:28.373601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d23085c3-90dc-443b-a448-6bfa70585d45 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:28.374063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d23085c3-90dc-443b-a448-6bfa70585d45 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:28.375320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d23085c3-90dc-443b-a448-6bfa70585d45 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:28.375433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d23085c3-90dc-443b-a448-6bfa70585d45 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:28.531343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d23085c3-90dc-443b-a448-6bfa70585d45 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:28.539861 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d23085c3-90dc-443b-a448-6bfa70585d45 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1495 microversion: 2.1 time: 0.179261 Jan 22 21:12:28.540530 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2030/4224] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:28 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1495 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:28.659567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ddacbff-13d3-4c90-a88d-3d84b95a944c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:28.660195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1ddacbff-13d3-4c90-a88d-3d84b95a944c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:28.674035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ddacbff-13d3-4c90-a88d-3d84b95a944c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:28.675669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ddacbff-13d3-4c90-a88d-3d84b95a944c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:28.676520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ddacbff-13d3-4c90-a88d-3d84b95a944c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:28.676986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ddacbff-13d3-4c90-a88d-3d84b95a944c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:28.678043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f554a746-deb2-41e6-b71a-cd124e2bc737 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:28.678664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f554a746-deb2-41e6-b71a-cd124e2bc737 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] [instance: 39f36bf0-d956-467f-9f13-4efbcae13cad] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:28.690669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f554a746-deb2-41e6-b71a-cd124e2bc737 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:28.691135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f554a746-deb2-41e6-b71a-cd124e2bc737 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:28.691940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f554a746-deb2-41e6-b71a-cd124e2bc737 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:28.692588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f554a746-deb2-41e6-b71a-cd124e2bc737 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:28.711901 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-f554a746-deb2-41e6-b71a-cd124e2bc737 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] HTTP exception thrown: Instance 39f36bf0-d956-467f-9f13-4efbcae13cad could not be found. Jan 22 21:12:28.712841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f554a746-deb2-41e6-b71a-cd124e2bc737 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] Returning 404 to user: Instance 39f36bf0-d956-467f-9f13-4efbcae13cad could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:28.714108 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f554a746-deb2-41e6-b71a-cd124e2bc737 tempest-ServersTestJSON-519153844 tempest-ServersTestJSON-519153844-project] 10.222.0.100 "GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad" status: 404 len: 111 microversion: 2.1 time: 0.041708 Jan 22 21:12:28.715191 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2031/4225] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:28 2022] GET /compute/v2.1/servers/39f36bf0-d956-467f-9f13-4efbcae13cad => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:12:28.905376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-6d70ad3c-4f84-4e3e-ac73-8d52cb37362d req-9f8a7099-97c1-4b2e-99d3-8de085d0c4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f36bf0-d956-467f-9f13-4efbcae13cad", "name": "network-vif-deleted", "tag": "cb951044-bc3b-42bb-b7fc-24d5993fe2a9"}, {"name": "network-changed", "server_uuid": "fcc5d005-c458-46e9-87ee-b837034d76c7", "tag": "c8ca2591-f475-4a3e-8f6c-e2b56416c2cf"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:28.907161 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:28.907161 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:12:28.915610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6d70ad3c-4f84-4e3e-ac73-8d52cb37362d req-9f8a7099-97c1-4b2e-99d3-8de085d0c4b4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:28.916666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6d70ad3c-4f84-4e3e-ac73-8d52cb37362d req-9f8a7099-97c1-4b2e-99d3-8de085d0c4b4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:28.941613 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-6d70ad3c-4f84-4e3e-ac73-8d52cb37362d req-9f8a7099-97c1-4b2e-99d3-8de085d0c4b4 service nova] Creating event network-vif-deleted:cb951044-bc3b-42bb-b7fc-24d5993fe2a9 for instance 39f36bf0-d956-467f-9f13-4efbcae13cad on nch2-master-1 Jan 22 21:12:28.942227 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-6d70ad3c-4f84-4e3e-ac73-8d52cb37362d req-9f8a7099-97c1-4b2e-99d3-8de085d0c4b4 service nova] Creating event network-changed:c8ca2591-f475-4a3e-8f6c-e2b56416c2cf for instance fcc5d005-c458-46e9-87ee-b837034d76c7 on nch1-master-1 Jan 22 21:12:28.949489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-6d70ad3c-4f84-4e3e-ac73-8d52cb37362d req-9f8a7099-97c1-4b2e-99d3-8de085d0c4b4 service nova] Instance fcc5d005-c458-46e9-87ee-b837034d76c7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:12:28.964515 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-6d70ad3c-4f84-4e3e-ac73-8d52cb37362d req-9f8a7099-97c1-4b2e-99d3-8de085d0c4b4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.061758 Jan 22 21:12:28.965277 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2032/4226] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:28.971933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cbdb315f-6a2a-4ede-b0e8-68131365f52c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:28.972965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cbdb315f-6a2a-4ede-b0e8-68131365f52c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:28.982096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbdb315f-6a2a-4ede-b0e8-68131365f52c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:28.983320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbdb315f-6a2a-4ede-b0e8-68131365f52c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:28.984919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbdb315f-6a2a-4ede-b0e8-68131365f52c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:28.985294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbdb315f-6a2a-4ede-b0e8-68131365f52c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:29.032199 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cbdb315f-6a2a-4ede-b0e8-68131365f52c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.065461 Jan 22 21:12:29.033458 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2033/4227] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:28 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:29.038844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3dc0dbe3-db37-414a-9ebd-526e4c3ae3fe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:29.040053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3dc0dbe3-db37-414a-9ebd-526e4c3ae3fe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:29.048491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3dc0dbe3-db37-414a-9ebd-526e4c3ae3fe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:29.049373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3dc0dbe3-db37-414a-9ebd-526e4c3ae3fe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:29.050228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3dc0dbe3-db37-414a-9ebd-526e4c3ae3fe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:29.050667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3dc0dbe3-db37-414a-9ebd-526e4c3ae3fe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:29.055051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1ddacbff-13d3-4c90-a88d-3d84b95a944c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:29.074828 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ddacbff-13d3-4c90-a88d-3d84b95a944c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1294 microversion: 2.1 time: 0.418695 Jan 22 21:12:29.079119 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2195/4228] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:28 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1294 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:29.092505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5b130a97-a210-4143-8441-4547a690c7a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:29.094001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5b130a97-a210-4143-8441-4547a690c7a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:29.100327 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3dc0dbe3-db37-414a-9ebd-526e4c3ae3fe tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.065075 Jan 22 21:12:29.101017 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2034/4229] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:29 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:29.112361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b130a97-a210-4143-8441-4547a690c7a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:29.112361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b130a97-a210-4143-8441-4547a690c7a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:29.112361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b130a97-a210-4143-8441-4547a690c7a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:29.112361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b130a97-a210-4143-8441-4547a690c7a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:29.559392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-733a286d-07fd-48e7-ab53-39af0c5310b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:29.560314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-733a286d-07fd-48e7-ab53-39af0c5310b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:29.569580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-733a286d-07fd-48e7-ab53-39af0c5310b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:29.570575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-733a286d-07fd-48e7-ab53-39af0c5310b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:29.571565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-733a286d-07fd-48e7-ab53-39af0c5310b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:29.572237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-733a286d-07fd-48e7-ab53-39af0c5310b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:29.664195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5b130a97-a210-4143-8441-4547a690c7a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:29.677430 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5b130a97-a210-4143-8441-4547a690c7a7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1475 microversion: 2.1 time: 0.590261 Jan 22 21:12:29.679681 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2196/4230] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:29 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1475 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:30.045859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d713ca5a-84f2-4800-8613-e403a4b9ad54 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:30.047468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d713ca5a-84f2-4800-8613-e403a4b9ad54 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:30.055734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d713ca5a-84f2-4800-8613-e403a4b9ad54 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:30.059785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d713ca5a-84f2-4800-8613-e403a4b9ad54 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:30.059785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d713ca5a-84f2-4800-8613-e403a4b9ad54 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:30.059785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d713ca5a-84f2-4800-8613-e403a4b9ad54 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:30.155134 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d713ca5a-84f2-4800-8613-e403a4b9ad54 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.115474 Jan 22 21:12:30.155797 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2197/4231] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:30 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:12:30.167104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-958c1f2f-78bb-4462-a0f3-86063cf261e7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:30.167810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-958c1f2f-78bb-4462-a0f3-86063cf261e7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:30.181817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-958c1f2f-78bb-4462-a0f3-86063cf261e7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:30.182281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-958c1f2f-78bb-4462-a0f3-86063cf261e7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:30.184198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-958c1f2f-78bb-4462-a0f3-86063cf261e7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:30.184798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-958c1f2f-78bb-4462-a0f3-86063cf261e7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:30.244166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-733a286d-07fd-48e7-ab53-39af0c5310b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:30.256918 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-733a286d-07fd-48e7-ab53-39af0c5310b7 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1495 microversion: 2.1 time: 0.703459 Jan 22 21:12:30.257832 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2035/4232] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:29 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1495 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:30.269538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ec82484-025f-4bdc-9012-91847c098356 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:30.270454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ec82484-025f-4bdc-9012-91847c098356 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:30.284965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ec82484-025f-4bdc-9012-91847c098356 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:30.299472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ec82484-025f-4bdc-9012-91847c098356 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:30.300825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ec82484-025f-4bdc-9012-91847c098356 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:30.303526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ec82484-025f-4bdc-9012-91847c098356 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:30.312758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-958c1f2f-78bb-4462-a0f3-86063cf261e7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:30.327500 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-958c1f2f-78bb-4462-a0f3-86063cf261e7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1300 microversion: 2.1 time: 0.170378 Jan 22 21:12:30.335593 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2198/4233] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:30 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1300 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:30.397958 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ec82484-025f-4bdc-9012-91847c098356 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.137336 Jan 22 21:12:30.402350 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2036/4234] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:30 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:30.703577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3c67ed0-03ab-48a4-9c4c-9cdfad17ac2a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:30.704284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d3c67ed0-03ab-48a4-9c4c-9cdfad17ac2a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:30.715459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3c67ed0-03ab-48a4-9c4c-9cdfad17ac2a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:30.716281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3c67ed0-03ab-48a4-9c4c-9cdfad17ac2a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:30.717431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3c67ed0-03ab-48a4-9c4c-9cdfad17ac2a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:30.718099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3c67ed0-03ab-48a4-9c4c-9cdfad17ac2a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:31.163924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d3c67ed0-03ab-48a4-9c4c-9cdfad17ac2a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:31.169162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab91dd4b-8325-4f78-9b91-e071e5edbcb6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:31.170833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab91dd4b-8325-4f78-9b91-e071e5edbcb6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:31.179964 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d3c67ed0-03ab-48a4-9c4c-9cdfad17ac2a tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1472 microversion: 2.1 time: 0.480285 Jan 22 21:12:31.181281 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2199/4235] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:30 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1472 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:31.192500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab91dd4b-8325-4f78-9b91-e071e5edbcb6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:31.193268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab91dd4b-8325-4f78-9b91-e071e5edbcb6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:31.194118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab91dd4b-8325-4f78-9b91-e071e5edbcb6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:31.194672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab91dd4b-8325-4f78-9b91-e071e5edbcb6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:31.203966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17634859-09cb-4668-bdd8-bb070aa13046 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:31.204583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17634859-09cb-4668-bdd8-bb070aa13046 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:31.228467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17634859-09cb-4668-bdd8-bb070aa13046 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:31.230267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17634859-09cb-4668-bdd8-bb070aa13046 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:31.234695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17634859-09cb-4668-bdd8-bb070aa13046 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:31.237358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17634859-09cb-4668-bdd8-bb070aa13046 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:31.285933 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab91dd4b-8325-4f78-9b91-e071e5edbcb6 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.122397 Jan 22 21:12:31.291000 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2037/4236] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:31 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:31.301589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-69fc1a0e-f590-4432-bbdd-bb6686275abc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:31.302311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-69fc1a0e-f590-4432-bbdd-bb6686275abc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:31.318675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69fc1a0e-f590-4432-bbdd-bb6686275abc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:31.319590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69fc1a0e-f590-4432-bbdd-bb6686275abc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:31.320568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69fc1a0e-f590-4432-bbdd-bb6686275abc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:31.323915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69fc1a0e-f590-4432-bbdd-bb6686275abc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:31.967561 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17634859-09cb-4668-bdd8-bb070aa13046 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "POST /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7/action" status: 202 len: 0 microversion: 2.1 time: 0.685973 Jan 22 21:12:31.967561 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2200/4237] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:31 2022] POST /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:31.967561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e488a98e-b80e-4c83-9623-40ac57429766 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:31.967561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e488a98e-b80e-4c83-9623-40ac57429766 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:31.967561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e488a98e-b80e-4c83-9623-40ac57429766 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:31.967561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e488a98e-b80e-4c83-9623-40ac57429766 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:31.967561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e488a98e-b80e-4c83-9623-40ac57429766 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:31.967561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e488a98e-b80e-4c83-9623-40ac57429766 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:31.968689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-69fc1a0e-f590-4432-bbdd-bb6686275abc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:31.968689 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-69fc1a0e-f590-4432-bbdd-bb6686275abc tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1495 microversion: 2.1 time: 0.627419 Jan 22 21:12:31.968689 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2038/4238] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:31 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1495 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:31.968689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-62b35903-d361-47bb-a77b-5231d9f503ff tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:31.968689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-62b35903-d361-47bb-a77b-5231d9f503ff tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:31.968689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62b35903-d361-47bb-a77b-5231d9f503ff tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:31.968689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62b35903-d361-47bb-a77b-5231d9f503ff tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:31.968689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62b35903-d361-47bb-a77b-5231d9f503ff tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:31.968689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62b35903-d361-47bb-a77b-5231d9f503ff tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:31.973828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e488a98e-b80e-4c83-9623-40ac57429766 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:31.982418 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e488a98e-b80e-4c83-9623-40ac57429766 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1300 microversion: 2.1 time: 0.100991 Jan 22 21:12:31.983009 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2201/4239] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:31 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1300 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:31.989798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d717aadc-e40d-4664-a413-b70815c15fc4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:31.990884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d717aadc-e40d-4664-a413-b70815c15fc4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:31.998805 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-62b35903-d361-47bb-a77b-5231d9f503ff tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.075819 Jan 22 21:12:31.999025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d717aadc-e40d-4664-a413-b70815c15fc4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:31.999313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d717aadc-e40d-4664-a413-b70815c15fc4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:31.999640 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2039/4240] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:31 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:32.000810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d717aadc-e40d-4664-a413-b70815c15fc4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:32.001276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d717aadc-e40d-4664-a413-b70815c15fc4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:32.299940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7433c222-de48-4f72-bf34-5a421f9c85ac tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:32.301029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7433c222-de48-4f72-bf34-5a421f9c85ac tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:32.323545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7433c222-de48-4f72-bf34-5a421f9c85ac tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:32.324016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7433c222-de48-4f72-bf34-5a421f9c85ac tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:32.324847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7433c222-de48-4f72-bf34-5a421f9c85ac tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:32.332733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7433c222-de48-4f72-bf34-5a421f9c85ac tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:32.437895 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7433c222-de48-4f72-bf34-5a421f9c85ac tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.138228 Jan 22 21:12:32.444376 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2040/4241] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:32 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:12:32.467517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-b4c07756-e4bd-478c-85be-be23bbca7063 req-3b38eecc-3d75-4044-96c0-666092ad293e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da69aec5-3978-4803-b644-988cc15608db", "name": "network-vif-deleted", "tag": "af2f4a08-c004-4922-8159-98b9ae008e00"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:32.467517 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:32.467517 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:12:32.488040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-b4c07756-e4bd-478c-85be-be23bbca7063 req-3b38eecc-3d75-4044-96c0-666092ad293e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:32.488040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-b4c07756-e4bd-478c-85be-be23bbca7063 req-3b38eecc-3d75-4044-96c0-666092ad293e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:32.518812 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-b4c07756-e4bd-478c-85be-be23bbca7063 req-3b38eecc-3d75-4044-96c0-666092ad293e service nova] Creating event network-vif-deleted:af2f4a08-c004-4922-8159-98b9ae008e00 for instance da69aec5-3978-4803-b644-988cc15608db on nch1-master-1 Jan 22 21:12:32.524374 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-b4c07756-e4bd-478c-85be-be23bbca7063 req-3b38eecc-3d75-4044-96c0-666092ad293e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082021 Jan 22 21:12:32.526206 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2041/4242] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:32.557099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d717aadc-e40d-4664-a413-b70815c15fc4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:32.579929 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d717aadc-e40d-4664-a413-b70815c15fc4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1471 microversion: 2.1 time: 0.591569 Jan 22 21:12:32.588086 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2202/4243] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:31 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1471 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:32.626057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-fc96b5ea-538e-4847-a252-e29816ec24ff req-b5b1ab9b-df77-4edb-bbc6-2c344cb1025b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc5d005-c458-46e9-87ee-b837034d76c7", "name": "network-vif-plugged", "status": "completed", "tag": "c8ca2591-f475-4a3e-8f6c-e2b56416c2cf"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:32.634227 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:32.634227 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:12:32.643958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fc96b5ea-538e-4847-a252-e29816ec24ff req-b5b1ab9b-df77-4edb-bbc6-2c344cb1025b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:32.644547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fc96b5ea-538e-4847-a252-e29816ec24ff req-b5b1ab9b-df77-4edb-bbc6-2c344cb1025b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:32.664340 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-fc96b5ea-538e-4847-a252-e29816ec24ff req-b5b1ab9b-df77-4edb-bbc6-2c344cb1025b service nova] Creating event network-vif-plugged:c8ca2591-f475-4a3e-8f6c-e2b56416c2cf for instance fcc5d005-c458-46e9-87ee-b837034d76c7 on nch1-master-1 Jan 22 21:12:32.672820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-fc96b5ea-538e-4847-a252-e29816ec24ff req-b5b1ab9b-df77-4edb-bbc6-2c344cb1025b service nova] Instance fcc5d005-c458-46e9-87ee-b837034d76c7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:12:32.686770 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-fc96b5ea-538e-4847-a252-e29816ec24ff req-b5b1ab9b-df77-4edb-bbc6-2c344cb1025b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071959 Jan 22 21:12:32.688107 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2042/4244] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:12:32.948449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eb656211-cd18-4ed1-adf8-b7fe5675d368 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:32.949242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eb656211-cd18-4ed1-adf8-b7fe5675d368 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:32.975151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb656211-cd18-4ed1-adf8-b7fe5675d368 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:32.975734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb656211-cd18-4ed1-adf8-b7fe5675d368 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:32.982092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb656211-cd18-4ed1-adf8-b7fe5675d368 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:32.982697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb656211-cd18-4ed1-adf8-b7fe5675d368 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:33.005417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e8d16659-1f39-42a9-b756-4eec9f251520 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:33.012009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e8d16659-1f39-42a9-b756-4eec9f251520 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:33.018489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8d16659-1f39-42a9-b756-4eec9f251520 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:33.030471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8d16659-1f39-42a9-b756-4eec9f251520 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:33.033069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8d16659-1f39-42a9-b756-4eec9f251520 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:33.034423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8d16659-1f39-42a9-b756-4eec9f251520 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:33.112617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb656211-cd18-4ed1-adf8-b7fe5675d368 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:33.113231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb656211-cd18-4ed1-adf8-b7fe5675d368 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:33.113863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-eb656211-cd18-4ed1-adf8-b7fe5675d368 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lazy-loading 'fault' on Instance uuid da69aec5-3978-4803-b644-988cc15608db {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:12:33.298585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-eb656211-cd18-4ed1-adf8-b7fe5675d368 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f783581ba8ca49b79a7d7cf7589b5b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db6acf2143024ccf9ce1f7a2c8369626', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:33.318450 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eb656211-cd18-4ed1-adf8-b7fe5675d368 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 200 len: 1307 microversion: 2.1 time: 0.374849 Jan 22 21:12:33.319482 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2203/4245] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:32 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 1307 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:33.334266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6ea5d65-7da2-4460-9468-ed0d9826a82b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:33.338629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b6ea5d65-7da2-4460-9468-ed0d9826a82b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:33.353619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6ea5d65-7da2-4460-9468-ed0d9826a82b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:33.354522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6ea5d65-7da2-4460-9468-ed0d9826a82b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:33.355589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6ea5d65-7da2-4460-9468-ed0d9826a82b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:33.356415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6ea5d65-7da2-4460-9468-ed0d9826a82b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:33.423399 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b6ea5d65-7da2-4460-9468-ed0d9826a82b tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.099432 Jan 22 21:12:33.424784 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2204/4246] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:33 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:33.528682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e8d16659-1f39-42a9-b756-4eec9f251520 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:33.543839 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e8d16659-1f39-42a9-b756-4eec9f251520 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1367 microversion: 2.1 time: 0.547627 Jan 22 21:12:33.549284 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2043/4247] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:32 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1367 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:33.560960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-77cc3afb-1652-4065-b676-970f9b065614 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:33.562320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-77cc3afb-1652-4065-b676-970f9b065614 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:33.569803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-77cc3afb-1652-4065-b676-970f9b065614 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:33.570641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-77cc3afb-1652-4065-b676-970f9b065614 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:33.571725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-77cc3afb-1652-4065-b676-970f9b065614 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:33.573004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-77cc3afb-1652-4065-b676-970f9b065614 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:33.657446 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-77cc3afb-1652-4065-b676-970f9b065614 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.106099 Jan 22 21:12:33.658595 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2044/4248] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:33 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:33.678797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-649e1aa6-c9c7-44f0-ac0d-df12ee708bd4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:33.678797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-649e1aa6-c9c7-44f0-ac0d-df12ee708bd4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:33.689835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-649e1aa6-c9c7-44f0-ac0d-df12ee708bd4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:33.692340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-649e1aa6-c9c7-44f0-ac0d-df12ee708bd4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:33.693143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-649e1aa6-c9c7-44f0-ac0d-df12ee708bd4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:33.693663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-649e1aa6-c9c7-44f0-ac0d-df12ee708bd4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:33.730951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ef06375c-fb9b-4e19-9aff-d03c2a67999a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1977674328", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": "none"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:33.797358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ef06375c-fb9b-4e19-9aff-d03c2a67999a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:12:33.799899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ef06375c-fb9b-4e19-9aff-d03c2a67999a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:12:33.799899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ef06375c-fb9b-4e19-9aff-d03c2a67999a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:12:33.799899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ef06375c-fb9b-4e19-9aff-d03c2a67999a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:12:33.799899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ef06375c-fb9b-4e19-9aff-d03c2a67999a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:12:33.809382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef06375c-fb9b-4e19-9aff-d03c2a67999a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:33.809756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef06375c-fb9b-4e19-9aff-d03c2a67999a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:33.810586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef06375c-fb9b-4e19-9aff-d03c2a67999a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:33.812860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef06375c-fb9b-4e19-9aff-d03c2a67999a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:33.830765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ef06375c-fb9b-4e19-9aff-d03c2a67999a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Getting quotas for project afaafee1e7fe4f07a3e523bcc5d9141b. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:12:33.843999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ef06375c-fb9b-4e19-9aff-d03c2a67999a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Getting quotas for user 5afa5e585e014cdcbde4e76a1cd7d2d3 and project afaafee1e7fe4f07a3e523bcc5d9141b. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:12:33.862731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ef06375c-fb9b-4e19-9aff-d03c2a67999a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:12:33.874711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ef06375c-fb9b-4e19-9aff-d03c2a67999a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:12:34.079715 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ef06375c-fb9b-4e19-9aff-d03c2a67999a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.54 time: 0.652273 Jan 22 21:12:34.082294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-649e1aa6-c9c7-44f0-ac0d-df12ee708bd4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:34.083354 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2205/4249] 10.222.0.100 () {62 vars in 1192 bytes} [Sat Jan 22 21:12:33 2022] POST /compute/v2.1/servers => generated 382 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 22 21:12:34.095673 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-649e1aa6-c9c7-44f0-ac0d-df12ee708bd4 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1471 microversion: 2.1 time: 0.435740 Jan 22 21:12:34.096258 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2045/4250] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:33 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1471 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:34.115794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4d5321b8-e4c0-4cec-89dd-18d0a8d4220a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:34.122554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4d5321b8-e4c0-4cec-89dd-18d0a8d4220a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:34.193029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4d5321b8-e4c0-4cec-89dd-18d0a8d4220a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:34.205167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4d5321b8-e4c0-4cec-89dd-18d0a8d4220a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:34.206746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4d5321b8-e4c0-4cec-89dd-18d0a8d4220a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:34.207920 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4d5321b8-e4c0-4cec-89dd-18d0a8d4220a tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1281 microversion: 2.54 time: 0.108504 Jan 22 21:12:34.208985 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2206/4251] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:34 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1281 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:12:34.344689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2cc021e1-75d8-4523-8983-2b160ff44696 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:34.345304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2cc021e1-75d8-4523-8983-2b160ff44696 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] [instance: da69aec5-3978-4803-b644-988cc15608db] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:34.356632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cc021e1-75d8-4523-8983-2b160ff44696 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:34.356632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cc021e1-75d8-4523-8983-2b160ff44696 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:34.356632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cc021e1-75d8-4523-8983-2b160ff44696 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:34.356632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cc021e1-75d8-4523-8983-2b160ff44696 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:34.391377 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-2cc021e1-75d8-4523-8983-2b160ff44696 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] HTTP exception thrown: Instance da69aec5-3978-4803-b644-988cc15608db could not be found. Jan 22 21:12:34.391997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2cc021e1-75d8-4523-8983-2b160ff44696 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] Returning 404 to user: Instance da69aec5-3978-4803-b644-988cc15608db could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:34.392846 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2cc021e1-75d8-4523-8983-2b160ff44696 tempest-ServerRescueTestJSON-1516818755 tempest-ServerRescueTestJSON-1516818755-project] 10.222.0.100 "GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db" status: 404 len: 111 microversion: 2.1 time: 0.051839 Jan 22 21:12:34.400969 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2046/4252] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:34 2022] GET /compute/v2.1/servers/da69aec5-3978-4803-b644-988cc15608db => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:34.438093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bc6f79ed-9e7a-4049-958a-b2ac6dbebd48 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:34.439227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bc6f79ed-9e7a-4049-958a-b2ac6dbebd48 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:34.448513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc6f79ed-9e7a-4049-958a-b2ac6dbebd48 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:34.448958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc6f79ed-9e7a-4049-958a-b2ac6dbebd48 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:34.449835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc6f79ed-9e7a-4049-958a-b2ac6dbebd48 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:34.450279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc6f79ed-9e7a-4049-958a-b2ac6dbebd48 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:34.536636 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bc6f79ed-9e7a-4049-958a-b2ac6dbebd48 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.102751 Jan 22 21:12:34.537545 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2207/4253] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:34 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:34.553567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-30f9f847-e8af-4ae3-a7e5-4a7838195987 req-5fd0d58c-7721-4bdc-ae0d-b3ed038979d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3e8847-08c7-4122-914b-d4650821edcc", "tag": "c2831901-064f-4d39-9a46-9472394ab33f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:34.556112 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:34.556112 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:12:34.565919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-30f9f847-e8af-4ae3-a7e5-4a7838195987 req-5fd0d58c-7721-4bdc-ae0d-b3ed038979d5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:34.567516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-30f9f847-e8af-4ae3-a7e5-4a7838195987 req-5fd0d58c-7721-4bdc-ae0d-b3ed038979d5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:34.567864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-480e2458-0fb6-45f8-b3b1-de8b2a69c9f8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:34.568606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-480e2458-0fb6-45f8-b3b1-de8b2a69c9f8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:34.587644 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-30f9f847-e8af-4ae3-a7e5-4a7838195987 req-5fd0d58c-7721-4bdc-ae0d-b3ed038979d5 service nova] Creating event network-changed:c2831901-064f-4d39-9a46-9472394ab33f for instance 3b3e8847-08c7-4122-914b-d4650821edcc on nch1-master-1 Jan 22 21:12:34.594946 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-30f9f847-e8af-4ae3-a7e5-4a7838195987 req-5fd0d58c-7721-4bdc-ae0d-b3ed038979d5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049515 Jan 22 21:12:34.596977 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2047/4254] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:34.601017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-480e2458-0fb6-45f8-b3b1-de8b2a69c9f8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:34.601495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-480e2458-0fb6-45f8-b3b1-de8b2a69c9f8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:34.606692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-480e2458-0fb6-45f8-b3b1-de8b2a69c9f8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:34.607067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-480e2458-0fb6-45f8-b3b1-de8b2a69c9f8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:34.671188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b0a62f8a-aece-4fc2-a6cf-a5fd387393c7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:34.672843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b0a62f8a-aece-4fc2-a6cf-a5fd387393c7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:34.716975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0a62f8a-aece-4fc2-a6cf-a5fd387393c7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:34.717988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0a62f8a-aece-4fc2-a6cf-a5fd387393c7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:34.722358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0a62f8a-aece-4fc2-a6cf-a5fd387393c7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:34.723125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0a62f8a-aece-4fc2-a6cf-a5fd387393c7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:34.842724 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b0a62f8a-aece-4fc2-a6cf-a5fd387393c7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.176845 Jan 22 21:12:34.843428 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2048/4255] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:34 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:12:35.087622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-480e2458-0fb6-45f8-b3b1-de8b2a69c9f8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:35.099253 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-480e2458-0fb6-45f8-b3b1-de8b2a69c9f8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1367 microversion: 2.1 time: 0.536538 Jan 22 21:12:35.111752 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2208/4256] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:34 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1367 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:35.114976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2eb2d96f-6c6f-49ef-ab66-d0f6001417e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:35.115698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2eb2d96f-6c6f-49ef-ab66-d0f6001417e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:35.123964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eb2d96f-6c6f-49ef-ab66-d0f6001417e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:35.129392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eb2d96f-6c6f-49ef-ab66-d0f6001417e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:35.129392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eb2d96f-6c6f-49ef-ab66-d0f6001417e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:35.129392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eb2d96f-6c6f-49ef-ab66-d0f6001417e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:35.229892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f05f455-5a79-44a7-8548-2022b7a2ed96 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:35.230503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f05f455-5a79-44a7-8548-2022b7a2ed96 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:35.383729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f05f455-5a79-44a7-8548-2022b7a2ed96 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:35.409356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f05f455-5a79-44a7-8548-2022b7a2ed96 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:35.411360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f05f455-5a79-44a7-8548-2022b7a2ed96 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:35.413460 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f05f455-5a79-44a7-8548-2022b7a2ed96 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1281 microversion: 2.54 time: 0.187343 Jan 22 21:12:35.414420 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2209/4257] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:35 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:12:35.449075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2eb2d96f-6c6f-49ef-ab66-d0f6001417e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:35.461140 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2eb2d96f-6c6f-49ef-ab66-d0f6001417e0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1471 microversion: 2.1 time: 0.350521 Jan 22 21:12:35.464234 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2049/4258] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:35 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1471 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:35.549150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-88b46642-9e1f-40a6-a560-3f2b7c7d6155 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:35.550128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-88b46642-9e1f-40a6-a560-3f2b7c7d6155 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:35.564244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88b46642-9e1f-40a6-a560-3f2b7c7d6155 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:35.564802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88b46642-9e1f-40a6-a560-3f2b7c7d6155 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:35.567067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88b46642-9e1f-40a6-a560-3f2b7c7d6155 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:35.568221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88b46642-9e1f-40a6-a560-3f2b7c7d6155 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:35.671954 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-88b46642-9e1f-40a6-a560-3f2b7c7d6155 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.126913 Jan 22 21:12:35.676928 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2210/4259] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:35 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:35.854483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-21d2fb57-d912-4826-be84-361b7dd3dcd2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:35.860428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-21d2fb57-d912-4826-be84-361b7dd3dcd2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:35.868193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21d2fb57-d912-4826-be84-361b7dd3dcd2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:35.868670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21d2fb57-d912-4826-be84-361b7dd3dcd2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:35.870061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21d2fb57-d912-4826-be84-361b7dd3dcd2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:35.874160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21d2fb57-d912-4826-be84-361b7dd3dcd2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:35.926418 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-21d2fb57-d912-4826-be84-361b7dd3dcd2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.075400 Jan 22 21:12:35.927818 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2050/4260] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:35 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:36.119746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-215931cd-b926-49e7-8c5c-057300c3f998 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:36.120720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-215931cd-b926-49e7-8c5c-057300c3f998 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:36.135043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-215931cd-b926-49e7-8c5c-057300c3f998 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:36.135632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-215931cd-b926-49e7-8c5c-057300c3f998 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:36.136742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-215931cd-b926-49e7-8c5c-057300c3f998 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:36.137405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-215931cd-b926-49e7-8c5c-057300c3f998 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:36.433926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ae5a3d7-25a7-4761-a233-93aa1f9a694f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:36.435361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3ae5a3d7-25a7-4761-a233-93aa1f9a694f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:36.448912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ae5a3d7-25a7-4761-a233-93aa1f9a694f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:36.449467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ae5a3d7-25a7-4761-a233-93aa1f9a694f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:36.450433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ae5a3d7-25a7-4761-a233-93aa1f9a694f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:36.451264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ae5a3d7-25a7-4761-a233-93aa1f9a694f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:36.529117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3ae5a3d7-25a7-4761-a233-93aa1f9a694f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:36.537481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3ae5a3d7-25a7-4761-a233-93aa1f9a694f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:36.539167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3ae5a3d7-25a7-4761-a233-93aa1f9a694f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:36.540589 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3ae5a3d7-25a7-4761-a233-93aa1f9a694f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1333 microversion: 2.54 time: 0.111391 Jan 22 21:12:36.542910 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2051/4261] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:36 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1333 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:12:36.555838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2f8c1db7-6b19-41f5-ada0-e04bf9ef1d52 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:36.557293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2f8c1db7-6b19-41f5-ada0-e04bf9ef1d52 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:36.563985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f8c1db7-6b19-41f5-ada0-e04bf9ef1d52 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:36.564458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f8c1db7-6b19-41f5-ada0-e04bf9ef1d52 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:36.565256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f8c1db7-6b19-41f5-ada0-e04bf9ef1d52 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:36.565913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f8c1db7-6b19-41f5-ada0-e04bf9ef1d52 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:36.644910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-215931cd-b926-49e7-8c5c-057300c3f998 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:36.653766 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-215931cd-b926-49e7-8c5c-057300c3f998 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1367 microversion: 2.1 time: 0.538831 Jan 22 21:12:36.654869 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2211/4262] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:36 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1367 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:36.685338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4b965b2c-672f-4536-8dee-0ecec6ff0dab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:36.686498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4b965b2c-672f-4536-8dee-0ecec6ff0dab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:36.693111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b965b2c-672f-4536-8dee-0ecec6ff0dab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:36.693687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b965b2c-672f-4536-8dee-0ecec6ff0dab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:36.696099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b965b2c-672f-4536-8dee-0ecec6ff0dab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:36.696614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b965b2c-672f-4536-8dee-0ecec6ff0dab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:36.730969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2f8c1db7-6b19-41f5-ada0-e04bf9ef1d52 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:36.741581 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2f8c1db7-6b19-41f5-ada0-e04bf9ef1d52 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1471 microversion: 2.1 time: 0.197345 Jan 22 21:12:36.742743 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2052/4263] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:36 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1471 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:36.761023 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4b965b2c-672f-4536-8dee-0ecec6ff0dab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.079375 Jan 22 21:12:36.765461 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2212/4264] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:36 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:36.948833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-038f5aa3-9d73-4d5a-9c60-35b674062fbc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:36.954631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-038f5aa3-9d73-4d5a-9c60-35b674062fbc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:36.976139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-038f5aa3-9d73-4d5a-9c60-35b674062fbc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:36.976614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-038f5aa3-9d73-4d5a-9c60-35b674062fbc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:36.977487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-038f5aa3-9d73-4d5a-9c60-35b674062fbc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:36.983459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-038f5aa3-9d73-4d5a-9c60-35b674062fbc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:37.037335 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-038f5aa3-9d73-4d5a-9c60-35b674062fbc tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.099985 Jan 22 21:12:37.038513 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2053/4265] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:36 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:37.081766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2090823483", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "11c5d3c2-f473-483b-8127-34bbf3efe45d"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:37.167589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] validate_networks() for [('11c5d3c2-f473-483b-8127-34bbf3efe45d', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:12:37.574871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ca224a0d-351e-42b0-bead-212128fd9c2b tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:37.593151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ca224a0d-351e-42b0-bead-212128fd9c2b tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:37.608284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca224a0d-351e-42b0-bead-212128fd9c2b tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:37.610717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca224a0d-351e-42b0-bead-212128fd9c2b tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:37.611758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca224a0d-351e-42b0-bead-212128fd9c2b tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:37.612299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca224a0d-351e-42b0-bead-212128fd9c2b tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:37.767281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ca224a0d-351e-42b0-bead-212128fd9c2b tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:37.799152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ca224a0d-351e-42b0-bead-212128fd9c2b tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:37.803718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ca224a0d-351e-42b0-bead-212128fd9c2b tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:37.811395 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ca224a0d-351e-42b0-bead-212128fd9c2b tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1339 microversion: 2.54 time: 0.247490 Jan 22 21:12:37.827868 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2054/4266] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:37 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1339 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:12:37.827868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-69c27126-5936-4cf7-ac46-ea469f78ce2c req-09c24db2-24b2-4b7f-aafd-c890981c2c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc5d005-c458-46e9-87ee-b837034d76c7", "name": "network-vif-unplugged", "status": "completed", "tag": "c8ca2591-f475-4a3e-8f6c-e2b56416c2cf"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:37.827868 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:37.827868 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:12:37.843868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-69c27126-5936-4cf7-ac46-ea469f78ce2c req-09c24db2-24b2-4b7f-aafd-c890981c2c07 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:37.844485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-69c27126-5936-4cf7-ac46-ea469f78ce2c req-09c24db2-24b2-4b7f-aafd-c890981c2c07 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:37.873805 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-69c27126-5936-4cf7-ac46-ea469f78ce2c req-09c24db2-24b2-4b7f-aafd-c890981c2c07 service nova] Creating event network-vif-unplugged:c8ca2591-f475-4a3e-8f6c-e2b56416c2cf for instance fcc5d005-c458-46e9-87ee-b837034d76c7 on nch2-master-1 Jan 22 21:12:37.874504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-69c27126-5936-4cf7-ac46-ea469f78ce2c req-09c24db2-24b2-4b7f-aafd-c890981c2c07 service nova] Instance fcc5d005-c458-46e9-87ee-b837034d76c7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:12:37.888105 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-69c27126-5936-4cf7-ac46-ea469f78ce2c req-09c24db2-24b2-4b7f-aafd-c890981c2c07 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073432 Jan 22 21:12:37.889047 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2055/4267] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:37.896008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fcddc327-2087-441c-ab2d-a16e99e3d34b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:37.896646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fcddc327-2087-441c-ab2d-a16e99e3d34b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:37.910459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcddc327-2087-441c-ab2d-a16e99e3d34b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:37.910932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcddc327-2087-441c-ab2d-a16e99e3d34b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:37.911784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcddc327-2087-441c-ab2d-a16e99e3d34b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:37.912788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcddc327-2087-441c-ab2d-a16e99e3d34b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:37.966877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:12:37.967309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:12:37.967792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:12:37.968208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:12:37.968633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:12:37.984588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:37.994565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:37.996090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:37.996710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:38.027971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Getting quotas for project 8fee2320503f41948e06d83350863358. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:12:38.037688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Getting quotas for user cb5abf45e6a842cea2bc7dba6f13e4ae and project 8fee2320503f41948e06d83350863358. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:12:38.069982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:12:38.073258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:12:38.163447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fcddc327-2087-441c-ab2d-a16e99e3d34b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:38.174213 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fcddc327-2087-441c-ab2d-a16e99e3d34b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1367 microversion: 2.1 time: 0.283829 Jan 22 21:12:38.174877 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2056/4268] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:37 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:38.207567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0af09717-5a74-4f9a-b7e6-215f8233cc02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:38.207948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0af09717-5a74-4f9a-b7e6-215f8233cc02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:38.225897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0af09717-5a74-4f9a-b7e6-215f8233cc02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:38.226647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0af09717-5a74-4f9a-b7e6-215f8233cc02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:38.227627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0af09717-5a74-4f9a-b7e6-215f8233cc02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:38.228226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0af09717-5a74-4f9a-b7e6-215f8233cc02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:38.246705 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-935a5b99-23f8-4abc-b219-a80ad6c8841c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.239180 Jan 22 21:12:38.269136 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2213/4269] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:12:37 2022] POST /compute/v2.1/servers => generated 382 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:12:38.284852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7b88a713-4811-4d8c-8fb0-880ad5fa684e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:38.297136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7b88a713-4811-4d8c-8fb0-880ad5fa684e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:38.313555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b88a713-4811-4d8c-8fb0-880ad5fa684e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:38.314616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b88a713-4811-4d8c-8fb0-880ad5fa684e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:38.316976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b88a713-4811-4d8c-8fb0-880ad5fa684e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:38.322745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b88a713-4811-4d8c-8fb0-880ad5fa684e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:38.441745 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7b88a713-4811-4d8c-8fb0-880ad5fa684e tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.170949 Jan 22 21:12:38.450933 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2214/4270] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:38 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:38.456630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-561ddb42-f075-4fd9-aa74-e5c6ba3be243 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:38.457801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-561ddb42-f075-4fd9-aa74-e5c6ba3be243 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:38.465865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-561ddb42-f075-4fd9-aa74-e5c6ba3be243 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:38.467589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-561ddb42-f075-4fd9-aa74-e5c6ba3be243 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:38.468691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-561ddb42-f075-4fd9-aa74-e5c6ba3be243 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:38.469078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-561ddb42-f075-4fd9-aa74-e5c6ba3be243 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:38.548976 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-561ddb42-f075-4fd9-aa74-e5c6ba3be243 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.096096 Jan 22 21:12:38.550096 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2215/4271] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:38 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:38.566504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b27bf5d6-e836-4390-8721-d9f4f806ad76 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:38.567424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b27bf5d6-e836-4390-8721-d9f4f806ad76 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:38.683471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b27bf5d6-e836-4390-8721-d9f4f806ad76 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:38.694100 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b27bf5d6-e836-4390-8721-d9f4f806ad76 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1228 microversion: 2.1 time: 0.142170 Jan 22 21:12:38.695689 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2216/4272] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:38 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1228 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:38.833150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-23c67286-266d-4883-97b1-8dedd44ab316 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:38.833821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-23c67286-266d-4883-97b1-8dedd44ab316 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:38.850378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23c67286-266d-4883-97b1-8dedd44ab316 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:38.850863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23c67286-266d-4883-97b1-8dedd44ab316 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:38.853942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23c67286-266d-4883-97b1-8dedd44ab316 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:38.857103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23c67286-266d-4883-97b1-8dedd44ab316 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:38.952572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-23c67286-266d-4883-97b1-8dedd44ab316 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:38.963630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-23c67286-266d-4883-97b1-8dedd44ab316 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:38.972586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-23c67286-266d-4883-97b1-8dedd44ab316 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:38.974596 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-23c67286-266d-4883-97b1-8dedd44ab316 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1339 microversion: 2.54 time: 0.145225 Jan 22 21:12:38.984945 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2217/4273] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:38 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1339 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:12:39.149430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0af09717-5a74-4f9a-b7e6-215f8233cc02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:39.162855 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0af09717-5a74-4f9a-b7e6-215f8233cc02 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1471 microversion: 2.1 time: 0.963245 Jan 22 21:12:39.167443 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2057/4274] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:38 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1471 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:39.192188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1eb13be0-aa74-4ba4-acc3-9990c8c1d041 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:39.193335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1eb13be0-aa74-4ba4-acc3-9990c8c1d041 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:39.207042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1eb13be0-aa74-4ba4-acc3-9990c8c1d041 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:39.233744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1eb13be0-aa74-4ba4-acc3-9990c8c1d041 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:39.253958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1eb13be0-aa74-4ba4-acc3-9990c8c1d041 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:39.254549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1eb13be0-aa74-4ba4-acc3-9990c8c1d041 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:39.455453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-82dfbb38-fe56-4f54-bdf8-2a141d274589 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:39.456388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-82dfbb38-fe56-4f54-bdf8-2a141d274589 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:39.476885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82dfbb38-fe56-4f54-bdf8-2a141d274589 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:39.481274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82dfbb38-fe56-4f54-bdf8-2a141d274589 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:39.481274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82dfbb38-fe56-4f54-bdf8-2a141d274589 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:39.488540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82dfbb38-fe56-4f54-bdf8-2a141d274589 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:39.599292 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-82dfbb38-fe56-4f54-bdf8-2a141d274589 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.148924 Jan 22 21:12:39.599959 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2058/4275] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:39 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:39.697422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1eb13be0-aa74-4ba4-acc3-9990c8c1d041 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:39.706716 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1eb13be0-aa74-4ba4-acc3-9990c8c1d041 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1367 microversion: 2.1 time: 0.518321 Jan 22 21:12:39.720645 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2218/4276] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:39 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:39.725884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-58775193-5561-4d48-a151-5ed40f319100 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:39.726737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-58775193-5561-4d48-a151-5ed40f319100 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:39.778285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-92ac1946-a23a-4b8b-a248-695dde1857fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:39.787982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-92ac1946-a23a-4b8b-a248-695dde1857fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:39.802889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92ac1946-a23a-4b8b-a248-695dde1857fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:39.803824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92ac1946-a23a-4b8b-a248-695dde1857fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:39.804897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92ac1946-a23a-4b8b-a248-695dde1857fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:39.805586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92ac1946-a23a-4b8b-a248-695dde1857fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:39.835123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-58775193-5561-4d48-a151-5ed40f319100 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:39.848982 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-58775193-5561-4d48-a151-5ed40f319100 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1228 microversion: 2.1 time: 0.126650 Jan 22 21:12:39.860946 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2219/4277] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:39 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1228 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:39.881969 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-92ac1946-a23a-4b8b-a248-695dde1857fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.278591 Jan 22 21:12:39.884171 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2059/4278] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:39 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:39.912506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-0c9c26b6-3df2-470f-875c-b925c26037a1 req-c208cc7f-71a1-4489-b7e8-542879547fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc5d005-c458-46e9-87ee-b837034d76c7", "tag": "c8ca2591-f475-4a3e-8f6c-e2b56416c2cf"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:39.916234 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:39.916234 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:12:39.927460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0c9c26b6-3df2-470f-875c-b925c26037a1 req-c208cc7f-71a1-4489-b7e8-542879547fad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:39.928685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0c9c26b6-3df2-470f-875c-b925c26037a1 req-c208cc7f-71a1-4489-b7e8-542879547fad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:39.947912 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-0c9c26b6-3df2-470f-875c-b925c26037a1 req-c208cc7f-71a1-4489-b7e8-542879547fad service nova] Creating event network-changed:c8ca2591-f475-4a3e-8f6c-e2b56416c2cf for instance fcc5d005-c458-46e9-87ee-b837034d76c7 on nch2-master-1 Jan 22 21:12:39.980663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-0c9c26b6-3df2-470f-875c-b925c26037a1 req-c208cc7f-71a1-4489-b7e8-542879547fad service nova] Instance fcc5d005-c458-46e9-87ee-b837034d76c7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:12:40.001998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ffdd1dcf-9ed1-498d-99fb-fa5048aa4045 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:40.003202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ffdd1dcf-9ed1-498d-99fb-fa5048aa4045 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:40.021930 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-0c9c26b6-3df2-470f-875c-b925c26037a1 req-c208cc7f-71a1-4489-b7e8-542879547fad service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115548 Jan 22 21:12:40.022901 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2220/4279] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:40.027947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffdd1dcf-9ed1-498d-99fb-fa5048aa4045 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:40.028421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffdd1dcf-9ed1-498d-99fb-fa5048aa4045 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:40.029331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffdd1dcf-9ed1-498d-99fb-fa5048aa4045 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:40.029823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffdd1dcf-9ed1-498d-99fb-fa5048aa4045 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:40.187018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-826fb36d-7e9a-411d-b492-8b16a3b548af tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:40.187991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-826fb36d-7e9a-411d-b492-8b16a3b548af tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:40.196933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-826fb36d-7e9a-411d-b492-8b16a3b548af tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:40.198200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-826fb36d-7e9a-411d-b492-8b16a3b548af tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:40.199919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-826fb36d-7e9a-411d-b492-8b16a3b548af tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:40.200861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-826fb36d-7e9a-411d-b492-8b16a3b548af tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:40.214629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ffdd1dcf-9ed1-498d-99fb-fa5048aa4045 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:40.223661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ffdd1dcf-9ed1-498d-99fb-fa5048aa4045 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:40.232278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ffdd1dcf-9ed1-498d-99fb-fa5048aa4045 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:40.233490 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ffdd1dcf-9ed1-498d-99fb-fa5048aa4045 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1339 microversion: 2.54 time: 0.243130 Jan 22 21:12:40.239403 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2060/4280] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:39 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1339 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:12:40.510250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-826fb36d-7e9a-411d-b492-8b16a3b548af tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:40.520018 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-826fb36d-7e9a-411d-b492-8b16a3b548af tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1471 microversion: 2.1 time: 0.339307 Jan 22 21:12:40.520631 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2221/4281] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:40 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1471 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:40.614023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-59fa7030-2ba7-4e85-ba8f-6f71b85a80ab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:40.616373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-59fa7030-2ba7-4e85-ba8f-6f71b85a80ab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:40.626801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59fa7030-2ba7-4e85-ba8f-6f71b85a80ab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:40.628301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59fa7030-2ba7-4e85-ba8f-6f71b85a80ab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:40.628636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59fa7030-2ba7-4e85-ba8f-6f71b85a80ab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:40.629275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59fa7030-2ba7-4e85-ba8f-6f71b85a80ab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:40.708310 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-59fa7030-2ba7-4e85-ba8f-6f71b85a80ab tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.098567 Jan 22 21:12:40.710362 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2061/4282] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:40 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:40.733242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4f61159b-0323-425d-aa42-b63128d26b31 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:40.734421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4f61159b-0323-425d-aa42-b63128d26b31 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:40.758626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f61159b-0323-425d-aa42-b63128d26b31 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:40.759173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f61159b-0323-425d-aa42-b63128d26b31 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:40.760103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f61159b-0323-425d-aa42-b63128d26b31 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:40.765661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f61159b-0323-425d-aa42-b63128d26b31 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:40.873636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b0db24d5-79ad-4330-8e73-53eb25c83c31 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:40.874600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b0db24d5-79ad-4330-8e73-53eb25c83c31 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:40.890768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0db24d5-79ad-4330-8e73-53eb25c83c31 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:40.894470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0db24d5-79ad-4330-8e73-53eb25c83c31 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:40.894470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0db24d5-79ad-4330-8e73-53eb25c83c31 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:40.895281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0db24d5-79ad-4330-8e73-53eb25c83c31 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:41.050115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4f61159b-0323-425d-aa42-b63128d26b31 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:41.059380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b0db24d5-79ad-4330-8e73-53eb25c83c31 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:41.074722 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b0db24d5-79ad-4330-8e73-53eb25c83c31 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1224 microversion: 2.1 time: 0.207611 Jan 22 21:12:41.082652 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4f61159b-0323-425d-aa42-b63128d26b31 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1367 microversion: 2.1 time: 0.358133 Jan 22 21:12:41.084644 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2062/4283] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:40 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1224 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:41.091372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-142120d8-5048-4d6c-aa14-e2badc3d0b2f req-56ddef01-8207-4cbe-8d53-6728bc7475d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3e8847-08c7-4122-914b-d4650821edcc", "name": "network-vif-plugged", "status": "completed", "tag": "c2831901-064f-4d39-9a46-9472394ab33f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:41.095277 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:41.095277 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:12:41.098699 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2222/4284] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:40 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:41.107997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0b2db5ed-a39e-41ba-aafd-7b6ad4d58dae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:41.112702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0b2db5ed-a39e-41ba-aafd-7b6ad4d58dae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:41.117481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-142120d8-5048-4d6c-aa14-e2badc3d0b2f req-56ddef01-8207-4cbe-8d53-6728bc7475d4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:41.118463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-142120d8-5048-4d6c-aa14-e2badc3d0b2f req-56ddef01-8207-4cbe-8d53-6728bc7475d4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:41.136229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b2db5ed-a39e-41ba-aafd-7b6ad4d58dae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:41.137460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b2db5ed-a39e-41ba-aafd-7b6ad4d58dae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:41.137738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b2db5ed-a39e-41ba-aafd-7b6ad4d58dae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:41.137981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b2db5ed-a39e-41ba-aafd-7b6ad4d58dae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:41.159410 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-142120d8-5048-4d6c-aa14-e2badc3d0b2f req-56ddef01-8207-4cbe-8d53-6728bc7475d4 service nova] Creating event network-vif-plugged:c2831901-064f-4d39-9a46-9472394ab33f for instance 3b3e8847-08c7-4122-914b-d4650821edcc on nch1-master-1 Jan 22 21:12:41.164664 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-142120d8-5048-4d6c-aa14-e2badc3d0b2f req-56ddef01-8207-4cbe-8d53-6728bc7475d4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078511 Jan 22 21:12:41.165962 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2063/4285] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:41.200429 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0b2db5ed-a39e-41ba-aafd-7b6ad4d58dae tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.100149 Jan 22 21:12:41.205938 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2223/4286] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:41 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:41.262010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-42facff2-403b-4414-aafb-d4b9564e1a89 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:41.263292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-42facff2-403b-4414-aafb-d4b9564e1a89 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:41.273442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42facff2-403b-4414-aafb-d4b9564e1a89 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:41.273902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42facff2-403b-4414-aafb-d4b9564e1a89 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:41.274827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42facff2-403b-4414-aafb-d4b9564e1a89 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:41.275757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42facff2-403b-4414-aafb-d4b9564e1a89 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:41.419199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-42facff2-403b-4414-aafb-d4b9564e1a89 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:41.426525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-42facff2-403b-4414-aafb-d4b9564e1a89 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:41.428646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-42facff2-403b-4414-aafb-d4b9564e1a89 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:41.430178 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-42facff2-403b-4414-aafb-d4b9564e1a89 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1360 microversion: 2.54 time: 0.173505 Jan 22 21:12:41.431334 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2064/4287] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:41 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1360 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:12:41.450461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-81f04dc4-9152-4813-b40c-bbb99c47a7c3 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Action: 'create', calling method: .version_select at 0x7f1edae753a0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-11018423"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:41.491440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-81f04dc4-9152-4813-b40c-bbb99c47a7c3 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Getting quotas for project afaafee1e7fe4f07a3e523bcc5d9141b. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:12:41.512678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-81f04dc4-9152-4813-b40c-bbb99c47a7c3 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Getting quotas for user 5afa5e585e014cdcbde4e76a1cd7d2d3 and project afaafee1e7fe4f07a3e523bcc5d9141b. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:12:41.538309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0adb3c56-c70d-46e0-9c5e-1a8d4fff7219 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:41.539138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0adb3c56-c70d-46e0-9c5e-1a8d4fff7219 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:41.553470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0adb3c56-c70d-46e0-9c5e-1a8d4fff7219 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:41.558530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0adb3c56-c70d-46e0-9c5e-1a8d4fff7219 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:41.565637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0adb3c56-c70d-46e0-9c5e-1a8d4fff7219 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:41.568313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0adb3c56-c70d-46e0-9c5e-1a8d4fff7219 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:41.954781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0adb3c56-c70d-46e0-9c5e-1a8d4fff7219 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:41.969821 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0adb3c56-c70d-46e0-9c5e-1a8d4fff7219 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1471 microversion: 2.1 time: 0.435615 Jan 22 21:12:41.970581 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2065/4288] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:41 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1471 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:41.977354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2d5da9c1-53ae-4f66-ba42-882facf8677d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:41.983804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2d5da9c1-53ae-4f66-ba42-882facf8677d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:41.994614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d5da9c1-53ae-4f66-ba42-882facf8677d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:41.995271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d5da9c1-53ae-4f66-ba42-882facf8677d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:41.996259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d5da9c1-53ae-4f66-ba42-882facf8677d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:41.996769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d5da9c1-53ae-4f66-ba42-882facf8677d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:42.053265 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2d5da9c1-53ae-4f66-ba42-882facf8677d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.081132 Jan 22 21:12:42.056002 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2066/4289] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:41 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:42.096690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-03e3c7c0-c279-45c1-aea9-3286e4a2e1f5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:42.097434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-03e3c7c0-c279-45c1-aea9-3286e4a2e1f5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:42.104812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03e3c7c0-c279-45c1-aea9-3286e4a2e1f5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:42.105264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03e3c7c0-c279-45c1-aea9-3286e4a2e1f5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:42.106117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03e3c7c0-c279-45c1-aea9-3286e4a2e1f5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:42.106576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03e3c7c0-c279-45c1-aea9-3286e4a2e1f5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:42.167401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-81f04dc4-9152-4813-b40c-bbb99c47a7c3 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Getting quotas for project afaafee1e7fe4f07a3e523bcc5d9141b. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:12:42.175251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-81f04dc4-9152-4813-b40c-bbb99c47a7c3 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Getting quotas for user 5afa5e585e014cdcbde4e76a1cd7d2d3 and project afaafee1e7fe4f07a3e523bcc5d9141b. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:12:42.191260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-03e3c7c0-c279-45c1-aea9-3286e4a2e1f5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:42.195290 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-81f04dc4-9152-4813-b40c-bbb99c47a7c3 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 2333 microversion: 2.54 time: 0.749731 Jan 22 21:12:42.196071 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2224/4290] 10.222.0.100 () {62 vars in 1203 bytes} [Sat Jan 22 21:12:41 2022] POST /compute/v2.1/os-keypairs => generated 2333 bytes in 751 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:12:42.199757 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-03e3c7c0-c279-45c1-aea9-3286e4a2e1f5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1286 microversion: 2.1 time: 0.107100 Jan 22 21:12:42.200314 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2067/4291] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:42 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:42.201400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-561e3e16-90cb-4760-b208-2bf022828868 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:42.208210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-561e3e16-90cb-4760-b208-2bf022828868 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:42.208375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-11018423", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:42.208822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:42.214388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-561e3e16-90cb-4760-b208-2bf022828868 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:42.215094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-561e3e16-90cb-4760-b208-2bf022828868 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:42.215975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-561e3e16-90cb-4760-b208-2bf022828868 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:42.216087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:42.216425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:42.216528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-561e3e16-90cb-4760-b208-2bf022828868 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:42.217212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:42.217699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:42.329703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:12:42.330298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:12:42.330871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:12:42.331592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:12:42.338038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:12:42.419781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-561e3e16-90cb-4760-b208-2bf022828868 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:42.429298 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-561e3e16-90cb-4760-b208-2bf022828868 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1367 microversion: 2.1 time: 0.232151 Jan 22 21:12:42.431598 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2225/4292] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:42 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:42.445048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-077c0bb8-4445-4061-8f34-084480c2c580 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:42.446313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-077c0bb8-4445-4061-8f34-084480c2c580 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:42.454635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-077c0bb8-4445-4061-8f34-084480c2c580 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:42.455890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-077c0bb8-4445-4061-8f34-084480c2c580 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:42.456703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-077c0bb8-4445-4061-8f34-084480c2c580 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:42.457301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-077c0bb8-4445-4061-8f34-084480c2c580 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:42.516553 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-077c0bb8-4445-4061-8f34-084480c2c580 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.082449 Jan 22 21:12:42.518502 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2226/4293] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:42 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:42.743113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:42.772979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:42.773765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:42.776728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:42.779372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:42.822958 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c2359767-64a3-4caf-95fd-a0daf2620907 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "POST /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8/action" status: 202 len: 1141 microversion: 2.54 time: 0.619307 Jan 22 21:12:42.823858 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2068/4294] 10.222.0.100 () {62 vars in 1324 bytes} [Sat Jan 22 21:12:42 2022] POST /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8/action => generated 1141 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 455 bytes (2 switches on core 0) Jan 22 21:12:42.847073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5764ed19-1758-4e39-a2eb-bf3bdcaeb8e4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:42.847833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5764ed19-1758-4e39-a2eb-bf3bdcaeb8e4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:42.857059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5764ed19-1758-4e39-a2eb-bf3bdcaeb8e4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:42.857564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5764ed19-1758-4e39-a2eb-bf3bdcaeb8e4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:42.864138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5764ed19-1758-4e39-a2eb-bf3bdcaeb8e4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:42.864519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5764ed19-1758-4e39-a2eb-bf3bdcaeb8e4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:42.989289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f5bdd801-7305-4d43-ac3d-534e0830e14b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:42.989942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f5bdd801-7305-4d43-ac3d-534e0830e14b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:42.991011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5764ed19-1758-4e39-a2eb-bf3bdcaeb8e4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:42.999854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5bdd801-7305-4d43-ac3d-534e0830e14b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:43.000326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5bdd801-7305-4d43-ac3d-534e0830e14b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:43.005982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5bdd801-7305-4d43-ac3d-534e0830e14b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:43.006482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5bdd801-7305-4d43-ac3d-534e0830e14b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:43.006593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5764ed19-1758-4e39-a2eb-bf3bdcaeb8e4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:43.015922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5764ed19-1758-4e39-a2eb-bf3bdcaeb8e4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:43.015922 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5764ed19-1758-4e39-a2eb-bf3bdcaeb8e4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.177903 Jan 22 21:12:43.018469 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2227/4295] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:42 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:12:43.069482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e4803455-ed83-4908-a788-748c0c35a0e5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:43.070450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e4803455-ed83-4908-a788-748c0c35a0e5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:43.079887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4803455-ed83-4908-a788-748c0c35a0e5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:43.080359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4803455-ed83-4908-a788-748c0c35a0e5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:43.081175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4803455-ed83-4908-a788-748c0c35a0e5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:43.081683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4803455-ed83-4908-a788-748c0c35a0e5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:43.165252 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e4803455-ed83-4908-a788-748c0c35a0e5 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.101559 Jan 22 21:12:43.167494 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2228/4296] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:43 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:43.221030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-92eb5180-1687-4a6f-978b-cbaa92ad1301 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:43.221800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-92eb5180-1687-4a6f-978b-cbaa92ad1301 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:43.231199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92eb5180-1687-4a6f-978b-cbaa92ad1301 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:43.231667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92eb5180-1687-4a6f-978b-cbaa92ad1301 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:43.232540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92eb5180-1687-4a6f-978b-cbaa92ad1301 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:43.234594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92eb5180-1687-4a6f-978b-cbaa92ad1301 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:43.263854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f5bdd801-7305-4d43-ac3d-534e0830e14b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:43.273460 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f5bdd801-7305-4d43-ac3d-534e0830e14b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1471 microversion: 2.1 time: 0.288843 Jan 22 21:12:43.275572 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2069/4297] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:42 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1471 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:43.449587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-60f94083-c6d7-4ad5-99a8-91e338d7c288 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:43.450266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-60f94083-c6d7-4ad5-99a8-91e338d7c288 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:43.464868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60f94083-c6d7-4ad5-99a8-91e338d7c288 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:43.473671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60f94083-c6d7-4ad5-99a8-91e338d7c288 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:43.473671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60f94083-c6d7-4ad5-99a8-91e338d7c288 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:43.473671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60f94083-c6d7-4ad5-99a8-91e338d7c288 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:43.550429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-92eb5180-1687-4a6f-978b-cbaa92ad1301 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:43.562853 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-92eb5180-1687-4a6f-978b-cbaa92ad1301 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1328 microversion: 2.1 time: 0.346900 Jan 22 21:12:43.573902 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2229/4298] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:43 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1328 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:43.579253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b398fb6c-10cf-4593-8337-424a97240966 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:43.580372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b398fb6c-10cf-4593-8337-424a97240966 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:43.586902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b398fb6c-10cf-4593-8337-424a97240966 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:43.587355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b398fb6c-10cf-4593-8337-424a97240966 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:43.588396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b398fb6c-10cf-4593-8337-424a97240966 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:43.589752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b398fb6c-10cf-4593-8337-424a97240966 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:43.637162 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b398fb6c-10cf-4593-8337-424a97240966 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.061683 Jan 22 21:12:43.638004 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2230/4299] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:43 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:43.834226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-60f94083-c6d7-4ad5-99a8-91e338d7c288 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:43.842520 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-60f94083-c6d7-4ad5-99a8-91e338d7c288 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1553 microversion: 2.1 time: 0.398170 Jan 22 21:12:43.843350 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2070/4300] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:43 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1553 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:43.859911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-507b823a-5649-43d2-9bb9-ad62638fb62e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:43.860536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-507b823a-5649-43d2-9bb9-ad62638fb62e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:43.867771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-507b823a-5649-43d2-9bb9-ad62638fb62e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:43.868226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-507b823a-5649-43d2-9bb9-ad62638fb62e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:43.869587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-507b823a-5649-43d2-9bb9-ad62638fb62e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:43.870034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-507b823a-5649-43d2-9bb9-ad62638fb62e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:43.963005 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-507b823a-5649-43d2-9bb9-ad62638fb62e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106971 Jan 22 21:12:43.963508 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2231/4301] 10.222.0.100 () {58 vars in 1279 bytes} [Sat Jan 22 21:12:43 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:12:44.034715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-247d3f97-92d3-4ceb-b8fd-204206f2e2ea tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:44.035588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-247d3f97-92d3-4ceb-b8fd-204206f2e2ea tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:44.041954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-247d3f97-92d3-4ceb-b8fd-204206f2e2ea tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:44.042531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-247d3f97-92d3-4ceb-b8fd-204206f2e2ea tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:44.043405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-247d3f97-92d3-4ceb-b8fd-204206f2e2ea tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:44.043929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-247d3f97-92d3-4ceb-b8fd-204206f2e2ea tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:44.178604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b3a5a1a1-d967-4868-bec7-3c6b6b04d762 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:44.179494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b3a5a1a1-d967-4868-bec7-3c6b6b04d762 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:44.181611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-247d3f97-92d3-4ceb-b8fd-204206f2e2ea tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:44.188578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3a5a1a1-d967-4868-bec7-3c6b6b04d762 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:44.190304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3a5a1a1-d967-4868-bec7-3c6b6b04d762 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:44.192320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3a5a1a1-d967-4868-bec7-3c6b6b04d762 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:44.192443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-247d3f97-92d3-4ceb-b8fd-204206f2e2ea tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:44.193289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3a5a1a1-d967-4868-bec7-3c6b6b04d762 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:44.194833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-247d3f97-92d3-4ceb-b8fd-204206f2e2ea tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:44.200817 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-247d3f97-92d3-4ceb-b8fd-204206f2e2ea tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.165217 Jan 22 21:12:44.200817 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2071/4302] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:44 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:12:44.283238 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b3a5a1a1-d967-4868-bec7-3c6b6b04d762 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.108742 Jan 22 21:12:44.283982 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2232/4303] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:44 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:44.293041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-42bdd18d-47b1-4e33-8e35-baf6018be6c7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:44.293757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-42bdd18d-47b1-4e33-8e35-baf6018be6c7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:44.301829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42bdd18d-47b1-4e33-8e35-baf6018be6c7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:44.302323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42bdd18d-47b1-4e33-8e35-baf6018be6c7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:44.304118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42bdd18d-47b1-4e33-8e35-baf6018be6c7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:44.304118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42bdd18d-47b1-4e33-8e35-baf6018be6c7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:44.581866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5870eaf5-e61c-4f78-8f45-22566b09994a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:44.582993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5870eaf5-e61c-4f78-8f45-22566b09994a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:44.592353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5870eaf5-e61c-4f78-8f45-22566b09994a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:44.593255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5870eaf5-e61c-4f78-8f45-22566b09994a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:44.594139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5870eaf5-e61c-4f78-8f45-22566b09994a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:44.594593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5870eaf5-e61c-4f78-8f45-22566b09994a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:44.919481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5870eaf5-e61c-4f78-8f45-22566b09994a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:44.928094 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5870eaf5-e61c-4f78-8f45-22566b09994a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1328 microversion: 2.1 time: 0.349676 Jan 22 21:12:44.942061 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2233/4304] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:44 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1328 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:44.956685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2e668746-d60d-4272-aff2-ac8ff6dfa915 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:44.958073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2e668746-d60d-4272-aff2-ac8ff6dfa915 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:44.966579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e668746-d60d-4272-aff2-ac8ff6dfa915 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:44.967268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e668746-d60d-4272-aff2-ac8ff6dfa915 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:44.968563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e668746-d60d-4272-aff2-ac8ff6dfa915 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:44.969236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e668746-d60d-4272-aff2-ac8ff6dfa915 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:45.027888 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2e668746-d60d-4272-aff2-ac8ff6dfa915 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.082653 Jan 22 21:12:45.032165 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2234/4305] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:44 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:45.038600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-8f169053-1e36-4a81-9760-982182dac0fc req-ac48f3e5-0099-4309-a6a5-329f9e154005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc5d005-c458-46e9-87ee-b837034d76c7", "name": "network-vif-plugged", "status": "completed", "tag": "c8ca2591-f475-4a3e-8f6c-e2b56416c2cf"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:45.041188 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:45.041188 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:12:45.051057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8f169053-1e36-4a81-9760-982182dac0fc req-ac48f3e5-0099-4309-a6a5-329f9e154005 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:45.051744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8f169053-1e36-4a81-9760-982182dac0fc req-ac48f3e5-0099-4309-a6a5-329f9e154005 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:45.070702 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-8f169053-1e36-4a81-9760-982182dac0fc req-ac48f3e5-0099-4309-a6a5-329f9e154005 service nova] Creating event network-vif-plugged:c8ca2591-f475-4a3e-8f6c-e2b56416c2cf for instance fcc5d005-c458-46e9-87ee-b837034d76c7 on nch2-master-1 Jan 22 21:12:45.077830 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-8f169053-1e36-4a81-9760-982182dac0fc req-ac48f3e5-0099-4309-a6a5-329f9e154005 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043035 Jan 22 21:12:45.078140 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2235/4306] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:45.219513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9156cf65-93de-4728-ba37-dcc5206487a7 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:45.220773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9156cf65-93de-4728-ba37-dcc5206487a7 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:45.230694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9156cf65-93de-4728-ba37-dcc5206487a7 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:45.231804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9156cf65-93de-4728-ba37-dcc5206487a7 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:45.232913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9156cf65-93de-4728-ba37-dcc5206487a7 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:45.234101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9156cf65-93de-4728-ba37-dcc5206487a7 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:45.266389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-42bdd18d-47b1-4e33-8e35-baf6018be6c7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:45.277712 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-42bdd18d-47b1-4e33-8e35-baf6018be6c7 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1464 microversion: 2.1 time: 0.989529 Jan 22 21:12:45.278330 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2072/4307] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:44 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1464 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:45.298869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ddf22061-7585-47a1-9b0a-1bc6732c2879 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:45.300080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ddf22061-7585-47a1-9b0a-1bc6732c2879 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:45.307690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddf22061-7585-47a1-9b0a-1bc6732c2879 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:45.317177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddf22061-7585-47a1-9b0a-1bc6732c2879 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:45.317177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddf22061-7585-47a1-9b0a-1bc6732c2879 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:45.317177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ddf22061-7585-47a1-9b0a-1bc6732c2879 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:45.318011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9156cf65-93de-4728-ba37-dcc5206487a7 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:45.328016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9156cf65-93de-4728-ba37-dcc5206487a7 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:45.330364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9156cf65-93de-4728-ba37-dcc5206487a7 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:45.332702 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9156cf65-93de-4728-ba37-dcc5206487a7 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.120062 Jan 22 21:12:45.333739 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2236/4308] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:45 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:12:45.338539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b93cba1-3b06-4139-a20b-51bf8179fa57 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:45.339181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6b93cba1-3b06-4139-a20b-51bf8179fa57 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:45.346638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b93cba1-3b06-4139-a20b-51bf8179fa57 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:45.347105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b93cba1-3b06-4139-a20b-51bf8179fa57 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:45.348510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b93cba1-3b06-4139-a20b-51bf8179fa57 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:45.348933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b93cba1-3b06-4139-a20b-51bf8179fa57 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:45.366685 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ddf22061-7585-47a1-9b0a-1bc6732c2879 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.071368 Jan 22 21:12:45.369574 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2073/4309] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:45 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:45.657157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-13d6eb78-157a-4b75-bbc5-8daff02d80bd req-47c9b699-c193-4699-a46e-f9fa706f6ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b77cc52-a232-427f-9304-a151f4110d69", "tag": "208377a2-2e65-4185-94a6-ce2de003a880"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:45.664102 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:45.664102 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:12:45.671493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-13d6eb78-157a-4b75-bbc5-8daff02d80bd req-47c9b699-c193-4699-a46e-f9fa706f6ff8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:45.672002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-13d6eb78-157a-4b75-bbc5-8daff02d80bd req-47c9b699-c193-4699-a46e-f9fa706f6ff8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:45.698957 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-13d6eb78-157a-4b75-bbc5-8daff02d80bd req-47c9b699-c193-4699-a46e-f9fa706f6ff8 service nova] Creating event network-changed:208377a2-2e65-4185-94a6-ce2de003a880 for instance 3b77cc52-a232-427f-9304-a151f4110d69 on nch2-master-1 Jan 22 21:12:45.708872 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-13d6eb78-157a-4b75-bbc5-8daff02d80bd req-47c9b699-c193-4699-a46e-f9fa706f6ff8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057047 Jan 22 21:12:45.709756 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2074/4310] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:45.850575 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b93cba1-3b06-4139-a20b-51bf8179fa57 tempest-MigrationsAdminTest-1795929769 tempest-MigrationsAdminTest-1795929769-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1615 microversion: 2.1 time: 0.515532 Jan 22 21:12:45.864711 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2237/4311] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:45 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1615 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:45.881137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-69992678-b70f-4011-a516-696f572d5006 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:45.881934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-69992678-b70f-4011-a516-696f572d5006 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:45.889851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69992678-b70f-4011-a516-696f572d5006 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:45.890310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69992678-b70f-4011-a516-696f572d5006 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:45.898601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69992678-b70f-4011-a516-696f572d5006 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:45.898601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69992678-b70f-4011-a516-696f572d5006 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:45.936049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-69992678-b70f-4011-a516-696f572d5006 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:12:45.947707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aaa95dd1-f938-4388-8332-0ea4decb7124 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:45.948345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aaa95dd1-f938-4388-8332-0ea4decb7124 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:45.954896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aaa95dd1-f938-4388-8332-0ea4decb7124 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:45.955067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aaa95dd1-f938-4388-8332-0ea4decb7124 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:45.955992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aaa95dd1-f938-4388-8332-0ea4decb7124 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:45.964559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aaa95dd1-f938-4388-8332-0ea4decb7124 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:46.222491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aaa95dd1-f938-4388-8332-0ea4decb7124 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:46.233204 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aaa95dd1-f938-4388-8332-0ea4decb7124 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1328 microversion: 2.1 time: 0.289974 Jan 22 21:12:46.234182 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2238/4312] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:45 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1328 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:46.239107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-91fabb53-895a-40f9-9c2f-946e956c5bc4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:46.240400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-91fabb53-895a-40f9-9c2f-946e956c5bc4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:46.249250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91fabb53-895a-40f9-9c2f-946e956c5bc4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:46.250459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91fabb53-895a-40f9-9c2f-946e956c5bc4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:46.251512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91fabb53-895a-40f9-9c2f-946e956c5bc4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:46.252309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91fabb53-895a-40f9-9c2f-946e956c5bc4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:46.295983 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-91fabb53-895a-40f9-9c2f-946e956c5bc4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.060154 Jan 22 21:12:46.298292 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2239/4313] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:46 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:46.352738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-39d5f8a1-db67-447c-854a-cf16f89bc54e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:46.353398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-39d5f8a1-db67-447c-854a-cf16f89bc54e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:46.360752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39d5f8a1-db67-447c-854a-cf16f89bc54e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:46.361213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39d5f8a1-db67-447c-854a-cf16f89bc54e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:46.362055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39d5f8a1-db67-447c-854a-cf16f89bc54e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:46.362514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39d5f8a1-db67-447c-854a-cf16f89bc54e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:46.419644 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-69992678-b70f-4011-a516-696f572d5006 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "DELETE /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 204 len: 0 microversion: 2.1 time: 0.543881 Jan 22 21:12:46.422596 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2075/4314] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:45 2022] DELETE /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:12:46.430310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2eaabe38-3175-44bf-974a-85d1ee821cc6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:46.432900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2eaabe38-3175-44bf-974a-85d1ee821cc6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:46.456613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-39d5f8a1-db67-447c-854a-cf16f89bc54e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:46.467766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-39d5f8a1-db67-447c-854a-cf16f89bc54e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:46.468764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eaabe38-3175-44bf-974a-85d1ee821cc6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:46.468999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eaabe38-3175-44bf-974a-85d1ee821cc6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:46.469966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eaabe38-3175-44bf-974a-85d1ee821cc6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:46.470266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eaabe38-3175-44bf-974a-85d1ee821cc6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:46.471196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-39d5f8a1-db67-447c-854a-cf16f89bc54e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:46.473896 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-39d5f8a1-db67-447c-854a-cf16f89bc54e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.125833 Jan 22 21:12:46.474682 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2240/4315] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:46 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:12:46.492101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c650db13-f66d-4c9f-aa7f-a064a0be6762 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:46.496461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c650db13-f66d-4c9f-aa7f-a064a0be6762 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:46.501329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c650db13-f66d-4c9f-aa7f-a064a0be6762 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:46.502223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c650db13-f66d-4c9f-aa7f-a064a0be6762 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:46.503249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c650db13-f66d-4c9f-aa7f-a064a0be6762 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:46.504478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c650db13-f66d-4c9f-aa7f-a064a0be6762 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:46.567356 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2eaabe38-3175-44bf-974a-85d1ee821cc6 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.142884 Jan 22 21:12:46.568913 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2076/4316] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:46 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:46.574932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4e92eb3-2e4f-48b3-a0e1-4b50a0f79056 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:46.576273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c4e92eb3-2e4f-48b3-a0e1-4b50a0f79056 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:46.583683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4e92eb3-2e4f-48b3-a0e1-4b50a0f79056 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:46.584390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4e92eb3-2e4f-48b3-a0e1-4b50a0f79056 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:46.586758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4e92eb3-2e4f-48b3-a0e1-4b50a0f79056 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:46.589185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4e92eb3-2e4f-48b3-a0e1-4b50a0f79056 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:46.639630 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c4e92eb3-2e4f-48b3-a0e1-4b50a0f79056 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 14 microversion: 2.1 time: 0.069265 Jan 22 21:12:46.644108 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2077/4317] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:46 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:12:46.756070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c650db13-f66d-4c9f-aa7f-a064a0be6762 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:46.770229 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c650db13-f66d-4c9f-aa7f-a064a0be6762 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1470 microversion: 2.1 time: 0.282254 Jan 22 21:12:46.781550 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2241/4318] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:46 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1470 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:47.250585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ef210299-991e-4134-8297-28fa24a22a2e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:47.251543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ef210299-991e-4134-8297-28fa24a22a2e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:47.259054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef210299-991e-4134-8297-28fa24a22a2e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:47.260500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef210299-991e-4134-8297-28fa24a22a2e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:47.261547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef210299-991e-4134-8297-28fa24a22a2e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:47.262300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef210299-991e-4134-8297-28fa24a22a2e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:47.309001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-51028b32-c812-4cc7-a8fe-66f1d169838c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:47.309968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-51028b32-c812-4cc7-a8fe-66f1d169838c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:47.321733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51028b32-c812-4cc7-a8fe-66f1d169838c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:47.322209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51028b32-c812-4cc7-a8fe-66f1d169838c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:47.324078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51028b32-c812-4cc7-a8fe-66f1d169838c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:47.324538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51028b32-c812-4cc7-a8fe-66f1d169838c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:47.375943 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-51028b32-c812-4cc7-a8fe-66f1d169838c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.069492 Jan 22 21:12:47.375943 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2242/4319] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:47 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:12:47.472539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ef210299-991e-4134-8297-28fa24a22a2e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:47.482084 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ef210299-991e-4134-8297-28fa24a22a2e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1328 microversion: 2.1 time: 0.235319 Jan 22 21:12:47.482670 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2078/4320] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:47 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1328 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:47.495301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9a58a2d4-0753-4359-b50d-bf9fff4ff263 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:47.496046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9a58a2d4-0753-4359-b50d-bf9fff4ff263 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:47.508502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a58a2d4-0753-4359-b50d-bf9fff4ff263 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:47.508966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a58a2d4-0753-4359-b50d-bf9fff4ff263 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:47.510565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a58a2d4-0753-4359-b50d-bf9fff4ff263 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:47.511023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a58a2d4-0753-4359-b50d-bf9fff4ff263 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:47.581543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-25aba713-4fbd-4fae-a5bc-a5ab3146a1af tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:47.582562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-25aba713-4fbd-4fae-a5bc-a5ab3146a1af tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:47.591143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9a58a2d4-0753-4359-b50d-bf9fff4ff263 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:47.600602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9a58a2d4-0753-4359-b50d-bf9fff4ff263 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:47.601644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25aba713-4fbd-4fae-a5bc-a5ab3146a1af tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:47.602229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9a58a2d4-0753-4359-b50d-bf9fff4ff263 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:47.603581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25aba713-4fbd-4fae-a5bc-a5ab3146a1af tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:47.604356 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9a58a2d4-0753-4359-b50d-bf9fff4ff263 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.114473 Jan 22 21:12:47.605126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25aba713-4fbd-4fae-a5bc-a5ab3146a1af tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:47.605421 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2243/4321] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:47 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:12:47.606476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25aba713-4fbd-4fae-a5bc-a5ab3146a1af tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:47.653869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b1041d59-6c05-4067-9eb6-a0531e3e07ff tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:47.654816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b1041d59-6c05-4067-9eb6-a0531e3e07ff tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:47.670981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1041d59-6c05-4067-9eb6-a0531e3e07ff tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:47.672006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1041d59-6c05-4067-9eb6-a0531e3e07ff tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:47.673488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1041d59-6c05-4067-9eb6-a0531e3e07ff tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:47.673978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1041d59-6c05-4067-9eb6-a0531e3e07ff tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:47.693675 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-25aba713-4fbd-4fae-a5bc-a5ab3146a1af tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.117892 Jan 22 21:12:47.694357 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2079/4322] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:47 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:47.757136 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b1041d59-6c05-4067-9eb6-a0531e3e07ff tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 14 microversion: 2.1 time: 0.107746 Jan 22 21:12:47.758155 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2244/4323] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:47 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:12:47.789376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d2e46601-1871-4292-89cd-c316461de489 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:47.790134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d2e46601-1871-4292-89cd-c316461de489 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:47.808875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2e46601-1871-4292-89cd-c316461de489 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:47.808875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2e46601-1871-4292-89cd-c316461de489 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:47.808875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2e46601-1871-4292-89cd-c316461de489 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:47.808875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2e46601-1871-4292-89cd-c316461de489 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:47.809299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-9822d46e-2810-46cf-a46f-aff0cf5e5ab4 req-3cae69ca-2105-4a7d-b064-31b9c0d75ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3e8847-08c7-4122-914b-d4650821edcc", "tag": "c2831901-064f-4d39-9a46-9472394ab33f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:47.809905 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:47.809905 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:12:47.831028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9822d46e-2810-46cf-a46f-aff0cf5e5ab4 req-3cae69ca-2105-4a7d-b064-31b9c0d75ba7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:47.831492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9822d46e-2810-46cf-a46f-aff0cf5e5ab4 req-3cae69ca-2105-4a7d-b064-31b9c0d75ba7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:47.869300 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-9822d46e-2810-46cf-a46f-aff0cf5e5ab4 req-3cae69ca-2105-4a7d-b064-31b9c0d75ba7 service nova] Creating event network-changed:c2831901-064f-4d39-9a46-9472394ab33f for instance 3b3e8847-08c7-4122-914b-d4650821edcc on nch1-master-1 Jan 22 21:12:47.882160 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-9822d46e-2810-46cf-a46f-aff0cf5e5ab4 req-3cae69ca-2105-4a7d-b064-31b9c0d75ba7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078960 Jan 22 21:12:47.882918 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2245/4324] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:12:48.305143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d2e46601-1871-4292-89cd-c316461de489 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:48.327364 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d2e46601-1871-4292-89cd-c316461de489 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1470 microversion: 2.1 time: 0.541619 Jan 22 21:12:48.328559 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2080/4325] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:47 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1470 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:48.391366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-43d2810d-8dd8-4047-9a8c-c62efba97b53 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:48.393250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-43d2810d-8dd8-4047-9a8c-c62efba97b53 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:48.403309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43d2810d-8dd8-4047-9a8c-c62efba97b53 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:48.403994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43d2810d-8dd8-4047-9a8c-c62efba97b53 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:48.405747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43d2810d-8dd8-4047-9a8c-c62efba97b53 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:48.406641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43d2810d-8dd8-4047-9a8c-c62efba97b53 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:48.491362 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-43d2810d-8dd8-4047-9a8c-c62efba97b53 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.107584 Jan 22 21:12:48.496890 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2246/4326] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:48 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:48.502501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-91f7e818-8f6f-469a-978b-7ae34b91282a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:48.503990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-91f7e818-8f6f-469a-978b-7ae34b91282a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:48.514628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91f7e818-8f6f-469a-978b-7ae34b91282a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:48.515477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91f7e818-8f6f-469a-978b-7ae34b91282a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:48.516636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91f7e818-8f6f-469a-978b-7ae34b91282a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:48.517417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91f7e818-8f6f-469a-978b-7ae34b91282a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:48.624727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ced82d81-6e7e-439e-81e7-8415afe3dd3f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:48.625644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ced82d81-6e7e-439e-81e7-8415afe3dd3f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:48.638465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ced82d81-6e7e-439e-81e7-8415afe3dd3f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:48.641856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ced82d81-6e7e-439e-81e7-8415afe3dd3f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:48.643086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ced82d81-6e7e-439e-81e7-8415afe3dd3f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:48.643754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ced82d81-6e7e-439e-81e7-8415afe3dd3f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:48.741346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ced82d81-6e7e-439e-81e7-8415afe3dd3f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:48.751835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ced82d81-6e7e-439e-81e7-8415afe3dd3f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:48.757402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ced82d81-6e7e-439e-81e7-8415afe3dd3f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:48.760223 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ced82d81-6e7e-439e-81e7-8415afe3dd3f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.139219 Jan 22 21:12:48.760810 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2247/4327] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:48 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:12:48.766646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b7bf4c82-09bf-42ac-9b1b-31bf46723772 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:48.767930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b7bf4c82-09bf-42ac-9b1b-31bf46723772 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:48.774490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7bf4c82-09bf-42ac-9b1b-31bf46723772 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:48.776732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7bf4c82-09bf-42ac-9b1b-31bf46723772 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:48.776732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7bf4c82-09bf-42ac-9b1b-31bf46723772 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:48.776903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7bf4c82-09bf-42ac-9b1b-31bf46723772 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:48.824419 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b7bf4c82-09bf-42ac-9b1b-31bf46723772 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.062061 Jan 22 21:12:48.825097 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2248/4328] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:48 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:48.830910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d79778c3-3ab0-4115-b665-2121bd967532 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:48.832018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d79778c3-3ab0-4115-b665-2121bd967532 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:48.839800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d79778c3-3ab0-4115-b665-2121bd967532 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:48.842221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d79778c3-3ab0-4115-b665-2121bd967532 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:48.842221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d79778c3-3ab0-4115-b665-2121bd967532 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:48.842221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d79778c3-3ab0-4115-b665-2121bd967532 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:48.883148 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d79778c3-3ab0-4115-b665-2121bd967532 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 14 microversion: 2.1 time: 0.056181 Jan 22 21:12:48.886509 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2249/4329] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:48 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:12:49.344599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aa92db66-c977-4993-8784-88189ac3ba5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:49.345301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aa92db66-c977-4993-8784-88189ac3ba5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:49.352532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa92db66-c977-4993-8784-88189ac3ba5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:49.353031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa92db66-c977-4993-8784-88189ac3ba5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:49.358253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa92db66-c977-4993-8784-88189ac3ba5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:49.358253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa92db66-c977-4993-8784-88189ac3ba5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:49.510977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-91f7e818-8f6f-469a-978b-7ae34b91282a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:49.529478 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-91f7e818-8f6f-469a-978b-7ae34b91282a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1328 microversion: 2.1 time: 1.030902 Jan 22 21:12:49.533886 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2081/4330] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:48 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1328 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:49.543137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-957a9cc7-3b40-4d87-85f8-79fd82110567 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:49.547736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-957a9cc7-3b40-4d87-85f8-79fd82110567 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:49.563674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-957a9cc7-3b40-4d87-85f8-79fd82110567 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:49.568122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-957a9cc7-3b40-4d87-85f8-79fd82110567 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:49.569453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-957a9cc7-3b40-4d87-85f8-79fd82110567 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:49.571192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-957a9cc7-3b40-4d87-85f8-79fd82110567 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:49.649232 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-957a9cc7-3b40-4d87-85f8-79fd82110567 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.109719 Jan 22 21:12:49.653820 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2082/4331] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:49 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:49.660754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aa92db66-c977-4993-8784-88189ac3ba5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:49.669867 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aa92db66-c977-4993-8784-88189ac3ba5f tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1470 microversion: 2.1 time: 0.329179 Jan 22 21:12:49.672513 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2250/4332] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:49 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1470 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:49.793106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b1e60478-c6b0-4ac0-9355-946aecc9d4c5 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:49.793106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b1e60478-c6b0-4ac0-9355-946aecc9d4c5 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:49.799626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1e60478-c6b0-4ac0-9355-946aecc9d4c5 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:49.800300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1e60478-c6b0-4ac0-9355-946aecc9d4c5 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:49.801290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1e60478-c6b0-4ac0-9355-946aecc9d4c5 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:49.802067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1e60478-c6b0-4ac0-9355-946aecc9d4c5 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:49.838403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-819f617b-eca5-422e-8dbc-59b454aea7b3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:49.840271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-819f617b-eca5-422e-8dbc-59b454aea7b3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:49.848915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-819f617b-eca5-422e-8dbc-59b454aea7b3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:49.849693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-819f617b-eca5-422e-8dbc-59b454aea7b3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:49.851704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-819f617b-eca5-422e-8dbc-59b454aea7b3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:49.852253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-819f617b-eca5-422e-8dbc-59b454aea7b3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:49.924448 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-819f617b-eca5-422e-8dbc-59b454aea7b3 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.090413 Jan 22 21:12:49.926487 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2251/4333] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:49 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:49.934639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-53ecb1ca-16f8-43db-8fdd-ded919ae0375 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:49.936224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-53ecb1ca-16f8-43db-8fdd-ded919ae0375 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:49.946193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53ecb1ca-16f8-43db-8fdd-ded919ae0375 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:49.947937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53ecb1ca-16f8-43db-8fdd-ded919ae0375 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:49.949226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53ecb1ca-16f8-43db-8fdd-ded919ae0375 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:49.949996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53ecb1ca-16f8-43db-8fdd-ded919ae0375 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:49.957744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b1e60478-c6b0-4ac0-9355-946aecc9d4c5 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:49.969431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b1e60478-c6b0-4ac0-9355-946aecc9d4c5 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:49.972909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b1e60478-c6b0-4ac0-9355-946aecc9d4c5 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:49.974478 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b1e60478-c6b0-4ac0-9355-946aecc9d4c5 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.197368 Jan 22 21:12:49.975666 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2083/4334] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:49 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:12:50.011676 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-53ecb1ca-16f8-43db-8fdd-ded919ae0375 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 14 microversion: 2.1 time: 0.083387 Jan 22 21:12:50.017379 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2252/4335] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:49 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:12:50.242049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-ec75d63a-8e20-42cd-85a5-e1fd97dde9f7 req-76f0303d-2256-4e0c-9af8-924034745512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc5d005-c458-46e9-87ee-b837034d76c7", "name": "network-vif-deleted", "tag": "c8ca2591-f475-4a3e-8f6c-e2b56416c2cf"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:50.250953 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:50.250953 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:12:50.272979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-ec75d63a-8e20-42cd-85a5-e1fd97dde9f7 req-76f0303d-2256-4e0c-9af8-924034745512 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:50.273988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-ec75d63a-8e20-42cd-85a5-e1fd97dde9f7 req-76f0303d-2256-4e0c-9af8-924034745512 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:50.295796 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-ec75d63a-8e20-42cd-85a5-e1fd97dde9f7 req-76f0303d-2256-4e0c-9af8-924034745512 service nova] Creating event network-vif-deleted:c8ca2591-f475-4a3e-8f6c-e2b56416c2cf for instance fcc5d005-c458-46e9-87ee-b837034d76c7 on nch2-master-1 Jan 22 21:12:50.309048 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-ec75d63a-8e20-42cd-85a5-e1fd97dde9f7 req-76f0303d-2256-4e0c-9af8-924034745512 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071450 Jan 22 21:12:50.310422 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2084/4336] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:50.549858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3d231c73-5670-4d56-b0f5-24ef02a83f4d tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:50.550868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3d231c73-5670-4d56-b0f5-24ef02a83f4d tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:50.559729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d231c73-5670-4d56-b0f5-24ef02a83f4d tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:50.560190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d231c73-5670-4d56-b0f5-24ef02a83f4d tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:50.561181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d231c73-5670-4d56-b0f5-24ef02a83f4d tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:50.561657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d231c73-5670-4d56-b0f5-24ef02a83f4d tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:50.661198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8f66d96c-ab52-496b-9bf2-6bf3eb95120c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:50.663041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8f66d96c-ab52-496b-9bf2-6bf3eb95120c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:50.673422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f66d96c-ab52-496b-9bf2-6bf3eb95120c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:50.678664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f66d96c-ab52-496b-9bf2-6bf3eb95120c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:50.679589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f66d96c-ab52-496b-9bf2-6bf3eb95120c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:50.682243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f66d96c-ab52-496b-9bf2-6bf3eb95120c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:50.726860 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8f66d96c-ab52-496b-9bf2-6bf3eb95120c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.070602 Jan 22 21:12:50.729366 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2085/4337] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:50 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:12:50.737798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5cbc33a4-f61c-429a-ac5b-c330d15e215b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:50.739093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5cbc33a4-f61c-429a-ac5b-c330d15e215b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:50.749056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5cbc33a4-f61c-429a-ac5b-c330d15e215b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:50.749973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5cbc33a4-f61c-429a-ac5b-c330d15e215b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:50.751055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5cbc33a4-f61c-429a-ac5b-c330d15e215b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:50.751589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5cbc33a4-f61c-429a-ac5b-c330d15e215b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:50.804779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5cbc33a4-f61c-429a-ac5b-c330d15e215b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:50.805701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5cbc33a4-f61c-429a-ac5b-c330d15e215b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:50.806602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3d231c73-5670-4d56-b0f5-24ef02a83f4d tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:50.807756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-5cbc33a4-f61c-429a-ac5b-c330d15e215b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lazy-loading 'fault' on Instance uuid fcc5d005-c458-46e9-87ee-b837034d76c7 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:12:50.815649 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3d231c73-5670-4d56-b0f5-24ef02a83f4d tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1328 microversion: 2.1 time: 0.270036 Jan 22 21:12:50.825922 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2253/4338] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:50 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1328 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:50.858316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5cbc33a4-f61c-429a-ac5b-c330d15e215b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:50.868147 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5cbc33a4-f61c-429a-ac5b-c330d15e215b tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 200 len: 1305 microversion: 2.1 time: 0.137282 Jan 22 21:12:50.869346 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2086/4339] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:50 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 1305 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:50.938612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f531964-8da4-4a93-9fb7-501c8c632014 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:50.939913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f531964-8da4-4a93-9fb7-501c8c632014 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:50.948094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f531964-8da4-4a93-9fb7-501c8c632014 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:50.948866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f531964-8da4-4a93-9fb7-501c8c632014 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:50.949934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f531964-8da4-4a93-9fb7-501c8c632014 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:50.950838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f531964-8da4-4a93-9fb7-501c8c632014 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:51.004179 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f531964-8da4-4a93-9fb7-501c8c632014 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.070409 Jan 22 21:12:51.004884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-589425ca-66aa-4ccb-8995-c7a526242d36 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:51.005384 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2254/4340] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:50 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:51.005832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-589425ca-66aa-4ccb-8995-c7a526242d36 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:51.014177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-589425ca-66aa-4ccb-8995-c7a526242d36 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:51.017077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-589425ca-66aa-4ccb-8995-c7a526242d36 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:51.017077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-589425ca-66aa-4ccb-8995-c7a526242d36 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:51.017077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-589425ca-66aa-4ccb-8995-c7a526242d36 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:51.057125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eebd3185-f875-473f-8a1d-a4a5b2e2d508 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:51.058489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eebd3185-f875-473f-8a1d-a4a5b2e2d508 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:51.074279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eebd3185-f875-473f-8a1d-a4a5b2e2d508 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:51.079200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eebd3185-f875-473f-8a1d-a4a5b2e2d508 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:51.080172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eebd3185-f875-473f-8a1d-a4a5b2e2d508 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:51.080542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eebd3185-f875-473f-8a1d-a4a5b2e2d508 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:51.139176 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eebd3185-f875-473f-8a1d-a4a5b2e2d508 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 14 microversion: 2.1 time: 0.104665 Jan 22 21:12:51.144481 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2255/4341] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:51 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:12:51.187231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-589425ca-66aa-4ccb-8995-c7a526242d36 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:51.210452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-589425ca-66aa-4ccb-8995-c7a526242d36 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:51.210452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-589425ca-66aa-4ccb-8995-c7a526242d36 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:51.210452 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-589425ca-66aa-4ccb-8995-c7a526242d36 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.204411 Jan 22 21:12:51.210452 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2087/4342] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:50 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:12:51.746655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bc683c69-0636-4618-b228-18fd4e019146 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:51.747860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bc683c69-0636-4618-b228-18fd4e019146 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:51.757185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc683c69-0636-4618-b228-18fd4e019146 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:51.758041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc683c69-0636-4618-b228-18fd4e019146 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:51.760019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc683c69-0636-4618-b228-18fd4e019146 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:51.760988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc683c69-0636-4618-b228-18fd4e019146 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:51.823608 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bc683c69-0636-4618-b228-18fd4e019146 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.085191 Jan 22 21:12:51.826958 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2256/4343] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:51 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:51.834839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5627129d-2530-41dd-aaff-1c16f96d8e40 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:51.836011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5627129d-2530-41dd-aaff-1c16f96d8e40 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:51.843483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5627129d-2530-41dd-aaff-1c16f96d8e40 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:51.844114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5627129d-2530-41dd-aaff-1c16f96d8e40 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:51.845363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5627129d-2530-41dd-aaff-1c16f96d8e40 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:51.846005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5627129d-2530-41dd-aaff-1c16f96d8e40 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:51.886382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3e40f135-5c40-4da4-b3d6-26a914e02110 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:51.887644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3e40f135-5c40-4da4-b3d6-26a914e02110 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: fcc5d005-c458-46e9-87ee-b837034d76c7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:51.896721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e40f135-5c40-4da4-b3d6-26a914e02110 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:51.897665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e40f135-5c40-4da4-b3d6-26a914e02110 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:51.898676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e40f135-5c40-4da4-b3d6-26a914e02110 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:51.899325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e40f135-5c40-4da4-b3d6-26a914e02110 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:51.917193 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-3e40f135-5c40-4da4-b3d6-26a914e02110 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] HTTP exception thrown: Instance fcc5d005-c458-46e9-87ee-b837034d76c7 could not be found. Jan 22 21:12:51.918359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3e40f135-5c40-4da4-b3d6-26a914e02110 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Returning 404 to user: Instance fcc5d005-c458-46e9-87ee-b837034d76c7 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:51.919532 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3e40f135-5c40-4da4-b3d6-26a914e02110 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7" status: 404 len: 111 microversion: 2.1 time: 0.037637 Jan 22 21:12:51.920309 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2257/4344] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:51 2022] GET /compute/v2.1/servers/fcc5d005-c458-46e9-87ee-b837034d76c7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:12:51.929062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e3d37d86-6702-4d3d-bfe8-fa2e8cdf8d75 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:51.929955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e3d37d86-6702-4d3d-bfe8-fa2e8cdf8d75 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:51.937317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3d37d86-6702-4d3d-bfe8-fa2e8cdf8d75 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:51.938361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3d37d86-6702-4d3d-bfe8-fa2e8cdf8d75 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:51.939450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3d37d86-6702-4d3d-bfe8-fa2e8cdf8d75 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:51.940202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3d37d86-6702-4d3d-bfe8-fa2e8cdf8d75 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:51.971753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e3d37d86-6702-4d3d-bfe8-fa2e8cdf8d75 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:12:52.176228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5627129d-2530-41dd-aaff-1c16f96d8e40 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:52.186063 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5627129d-2530-41dd-aaff-1c16f96d8e40 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1328 microversion: 2.1 time: 0.356052 Jan 22 21:12:52.197745 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2088/4345] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:51 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1328 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:52.203833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ad4db436-f85d-48da-b0ef-5d3b57bde3c4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:52.205018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ad4db436-f85d-48da-b0ef-5d3b57bde3c4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:52.212040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad4db436-f85d-48da-b0ef-5d3b57bde3c4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:52.212846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad4db436-f85d-48da-b0ef-5d3b57bde3c4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:52.213892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad4db436-f85d-48da-b0ef-5d3b57bde3c4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:52.214729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad4db436-f85d-48da-b0ef-5d3b57bde3c4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:52.269762 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ad4db436-f85d-48da-b0ef-5d3b57bde3c4 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.070201 Jan 22 21:12:52.271320 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2089/4346] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:52 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:52.279115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-de415a93-48aa-4e98-b2ef-ba6313af719c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:52.280373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-de415a93-48aa-4e98-b2ef-ba6313af719c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:52.288410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de415a93-48aa-4e98-b2ef-ba6313af719c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:52.289287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de415a93-48aa-4e98-b2ef-ba6313af719c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:52.290328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de415a93-48aa-4e98-b2ef-ba6313af719c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:52.290778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de415a93-48aa-4e98-b2ef-ba6313af719c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:52.341316 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-de415a93-48aa-4e98-b2ef-ba6313af719c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 14 microversion: 2.1 time: 0.067829 Jan 22 21:12:52.342362 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2090/4347] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:52 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:12:52.348366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-afa62189-42c4-4234-8341-3f75742aa8e1 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:52.349100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-afa62189-42c4-4234-8341-3f75742aa8e1 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:52.356911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afa62189-42c4-4234-8341-3f75742aa8e1 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:52.357261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afa62189-42c4-4234-8341-3f75742aa8e1 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:52.358101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afa62189-42c4-4234-8341-3f75742aa8e1 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:52.358579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afa62189-42c4-4234-8341-3f75742aa8e1 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:52.365061 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e3d37d86-6702-4d3d-bfe8-fa2e8cdf8d75 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 204 len: 0 microversion: 2.1 time: 0.439834 Jan 22 21:12:52.366162 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2258/4348] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:51 2022] DELETE /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:12:52.448178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-afa62189-42c4-4234-8341-3f75742aa8e1 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:52.460143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-afa62189-42c4-4234-8341-3f75742aa8e1 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:52.463957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-afa62189-42c4-4234-8341-3f75742aa8e1 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:52.465883 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-afa62189-42c4-4234-8341-3f75742aa8e1 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.122224 Jan 22 21:12:52.468236 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2091/4349] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:52 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:12:52.661680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d85e8348-538c-4d17-9067-1a4a8147aa00 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:52.662572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d85e8348-538c-4d17-9067-1a4a8147aa00 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:52.670590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d85e8348-538c-4d17-9067-1a4a8147aa00 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:52.671141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d85e8348-538c-4d17-9067-1a4a8147aa00 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:52.672009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d85e8348-538c-4d17-9067-1a4a8147aa00 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:52.672638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d85e8348-538c-4d17-9067-1a4a8147aa00 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:52.836296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d85e8348-538c-4d17-9067-1a4a8147aa00 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:52.837002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-78fa4163-3f8a-4903-9cf4-99fe502e689a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:52.837590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-78fa4163-3f8a-4903-9cf4-99fe502e689a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:52.846509 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d85e8348-538c-4d17-9067-1a4a8147aa00 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1537 microversion: 2.1 time: 0.475270 Jan 22 21:12:52.848835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78fa4163-3f8a-4903-9cf4-99fe502e689a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:52.849484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78fa4163-3f8a-4903-9cf4-99fe502e689a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:52.850467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78fa4163-3f8a-4903-9cf4-99fe502e689a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:52.854072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78fa4163-3f8a-4903-9cf4-99fe502e689a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:52.858327 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2259/4350] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:52 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1537 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:52.904140 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-78fa4163-3f8a-4903-9cf4-99fe502e689a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.071109 Jan 22 21:12:52.905031 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2092/4351] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:52 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:12:53.206235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fbdf03ad-81ca-4209-89d5-0da1373f6232 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:53.207070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fbdf03ad-81ca-4209-89d5-0da1373f6232 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:53.218743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fbdf03ad-81ca-4209-89d5-0da1373f6232 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:53.218743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fbdf03ad-81ca-4209-89d5-0da1373f6232 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:53.218743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fbdf03ad-81ca-4209-89d5-0da1373f6232 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:53.218743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fbdf03ad-81ca-4209-89d5-0da1373f6232 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:53.284857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2b0e4de3-3eb4-48eb-abad-95ef0c1a405c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:53.285960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2b0e4de3-3eb4-48eb-abad-95ef0c1a405c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:53.296348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b0e4de3-3eb4-48eb-abad-95ef0c1a405c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:53.296675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b0e4de3-3eb4-48eb-abad-95ef0c1a405c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:53.297489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b0e4de3-3eb4-48eb-abad-95ef0c1a405c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:53.297959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b0e4de3-3eb4-48eb-abad-95ef0c1a405c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:53.373690 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2b0e4de3-3eb4-48eb-abad-95ef0c1a405c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.091804 Jan 22 21:12:53.375080 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2093/4352] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:53 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:12:53.385804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f55a1b99-59fd-413e-8351-0f5cecd9ef33 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:53.387082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f55a1b99-59fd-413e-8351-0f5cecd9ef33 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:53.400433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f55a1b99-59fd-413e-8351-0f5cecd9ef33 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:53.400433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f55a1b99-59fd-413e-8351-0f5cecd9ef33 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:53.400433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f55a1b99-59fd-413e-8351-0f5cecd9ef33 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:53.400433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f55a1b99-59fd-413e-8351-0f5cecd9ef33 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:53.454461 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f55a1b99-59fd-413e-8351-0f5cecd9ef33 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 14 microversion: 2.1 time: 0.078513 Jan 22 21:12:53.457796 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2094/4353] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:53 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:12:53.458570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fbdf03ad-81ca-4209-89d5-0da1373f6232 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:53.475201 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fbdf03ad-81ca-4209-89d5-0da1373f6232 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1328 microversion: 2.1 time: 0.270436 Jan 22 21:12:53.475201 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2260/4354] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:53 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1328 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:53.505982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a1b8a37-3ba8-4d88-aa8d-8e119ab96fa6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:53.506991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a1b8a37-3ba8-4d88-aa8d-8e119ab96fa6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:53.516354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a1b8a37-3ba8-4d88-aa8d-8e119ab96fa6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:53.517575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a1b8a37-3ba8-4d88-aa8d-8e119ab96fa6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:53.518811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a1b8a37-3ba8-4d88-aa8d-8e119ab96fa6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:53.519489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a1b8a37-3ba8-4d88-aa8d-8e119ab96fa6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:53.610997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6a1b8a37-3ba8-4d88-aa8d-8e119ab96fa6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:53.623119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6a1b8a37-3ba8-4d88-aa8d-8e119ab96fa6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:53.625528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6a1b8a37-3ba8-4d88-aa8d-8e119ab96fa6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:53.627190 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a1b8a37-3ba8-4d88-aa8d-8e119ab96fa6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.133373 Jan 22 21:12:53.627841 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2261/4355] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:53 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:12:53.668600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-766a03c2-fdf1-4244-8483-876fa9f8cb3e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'create', calling method: .version_select at 0x7f1ed4f71f70>, body: {"keypair": {"name": "tempest-keypair-588674945"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:53.684006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-766a03c2-fdf1-4244-8483-876fa9f8cb3e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Getting quotas for project 76ecd70d0be147b59ffbda6d93f73aa6. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:12:53.690003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-766a03c2-fdf1-4244-8483-876fa9f8cb3e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Getting quotas for user c0be514b27f14d8a9e4fd71b31a6d2e3 and project 76ecd70d0be147b59ffbda6d93f73aa6. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:12:53.867355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2dea23e9-10d7-4eed-bb79-e40c99ed8ab6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:53.870314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2dea23e9-10d7-4eed-bb79-e40c99ed8ab6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:53.880279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dea23e9-10d7-4eed-bb79-e40c99ed8ab6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:53.880976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dea23e9-10d7-4eed-bb79-e40c99ed8ab6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:53.881973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dea23e9-10d7-4eed-bb79-e40c99ed8ab6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:53.882643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dea23e9-10d7-4eed-bb79-e40c99ed8ab6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:53.910944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-766a03c2-fdf1-4244-8483-876fa9f8cb3e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Getting quotas for project 76ecd70d0be147b59ffbda6d93f73aa6. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:12:53.919335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-766a03c2-fdf1-4244-8483-876fa9f8cb3e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Getting quotas for user c0be514b27f14d8a9e4fd71b31a6d2e3 and project 76ecd70d0be147b59ffbda6d93f73aa6. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:12:53.938214 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-766a03c2-fdf1-4244-8483-876fa9f8cb3e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.481470 Jan 22 21:12:53.948137 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2095/4356] 10.222.0.100 () {62 vars in 1203 bytes} [Sat Jan 22 21:12:53 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 483 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:12:53.948137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ecbaa907-5839-4df2-a4da-c33462648d2e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:53.948137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ecbaa907-5839-4df2-a4da-c33462648d2e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:53.978504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecbaa907-5839-4df2-a4da-c33462648d2e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:53.984073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecbaa907-5839-4df2-a4da-c33462648d2e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:53.986164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecbaa907-5839-4df2-a4da-c33462648d2e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:53.988598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecbaa907-5839-4df2-a4da-c33462648d2e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:54.115141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2dea23e9-10d7-4eed-bb79-e40c99ed8ab6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:54.129661 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2dea23e9-10d7-4eed-bb79-e40c99ed8ab6 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1537 microversion: 2.1 time: 0.268271 Jan 22 21:12:54.142070 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2262/4357] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:53 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1537 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:54.142277 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ecbaa907-5839-4df2-a4da-c33462648d2e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.192599 Jan 22 21:12:54.142277 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2096/4358] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:53 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:54.142584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-f81a6350-409a-4d3e-87a6-e8e5a4099331 req-bc97353f-a85a-4589-99ba-b5c077c0ea4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b77cc52-a232-427f-9304-a151f4110d69", "name": "network-vif-plugged", "status": "completed", "tag": "208377a2-2e65-4185-94a6-ce2de003a880"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:54.142584 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:54.142584 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:12:54.149146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f81a6350-409a-4d3e-87a6-e8e5a4099331 req-bc97353f-a85a-4589-99ba-b5c077c0ea4f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:54.150315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f81a6350-409a-4d3e-87a6-e8e5a4099331 req-bc97353f-a85a-4589-99ba-b5c077c0ea4f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:54.166393 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f81a6350-409a-4d3e-87a6-e8e5a4099331 req-bc97353f-a85a-4589-99ba-b5c077c0ea4f service nova] Creating event network-vif-plugged:208377a2-2e65-4185-94a6-ce2de003a880 for instance 3b77cc52-a232-427f-9304-a151f4110d69 on nch2-master-1 Jan 22 21:12:54.171826 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-f81a6350-409a-4d3e-87a6-e8e5a4099331 req-bc97353f-a85a-4589-99ba-b5c077c0ea4f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039355 Jan 22 21:12:54.172852 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2263/4359] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:54.392317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab56cc24-2c8a-4257-a09d-d555109c3026 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:54.393674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab56cc24-2c8a-4257-a09d-d555109c3026 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:54.407347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab56cc24-2c8a-4257-a09d-d555109c3026 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:54.408362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab56cc24-2c8a-4257-a09d-d555109c3026 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:54.409958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab56cc24-2c8a-4257-a09d-d555109c3026 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:54.410813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab56cc24-2c8a-4257-a09d-d555109c3026 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:54.469364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-05ec8cfe-f18d-4fab-84e8-ed5f23f38e69 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:54.470195 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab56cc24-2c8a-4257-a09d-d555109c3026 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.087244 Jan 22 21:12:54.471577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-05ec8cfe-f18d-4fab-84e8-ed5f23f38e69 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:54.472919 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2097/4360] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:54 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:54.486352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05ec8cfe-f18d-4fab-84e8-ed5f23f38e69 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:54.487009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05ec8cfe-f18d-4fab-84e8-ed5f23f38e69 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:54.489062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05ec8cfe-f18d-4fab-84e8-ed5f23f38e69 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:54.489918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05ec8cfe-f18d-4fab-84e8-ed5f23f38e69 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:54.492546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8f66fcf3-0723-4760-bbf9-289ce3795bf5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:54.494429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8f66fcf3-0723-4760-bbf9-289ce3795bf5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:54.502348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f66fcf3-0723-4760-bbf9-289ce3795bf5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:54.503136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f66fcf3-0723-4760-bbf9-289ce3795bf5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:54.504527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f66fcf3-0723-4760-bbf9-289ce3795bf5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:54.505182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f66fcf3-0723-4760-bbf9-289ce3795bf5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:54.547996 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-05ec8cfe-f18d-4fab-84e8-ed5f23f38e69 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 14 microversion: 2.1 time: 0.085797 Jan 22 21:12:54.549209 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2264/4361] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:54 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:12:54.646783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c89bc8de-10d4-458f-a722-7ad20c05a14d tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:54.649125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c89bc8de-10d4-458f-a722-7ad20c05a14d tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:54.658030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c89bc8de-10d4-458f-a722-7ad20c05a14d tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:54.663347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c89bc8de-10d4-458f-a722-7ad20c05a14d tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:54.663347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c89bc8de-10d4-458f-a722-7ad20c05a14d tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:54.663347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c89bc8de-10d4-458f-a722-7ad20c05a14d tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:54.762668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c89bc8de-10d4-458f-a722-7ad20c05a14d tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:54.786801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c89bc8de-10d4-458f-a722-7ad20c05a14d tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:54.788239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8f66fcf3-0723-4760-bbf9-289ce3795bf5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:54.797241 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8f66fcf3-0723-4760-bbf9-289ce3795bf5 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1328 microversion: 2.1 time: 0.308762 Jan 22 21:12:54.797620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c89bc8de-10d4-458f-a722-7ad20c05a14d tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:54.798963 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c89bc8de-10d4-458f-a722-7ad20c05a14d tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.156888 Jan 22 21:12:54.799753 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2265/4362] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:54 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:12:54.808146 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2098/4363] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:54 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1328 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:55.098914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-937b67a3-f816-40c2-9ddf-ebf3d589c0e8 req-2233d6f6-eadd-4a5a-8750-df5f20fd9915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a40cd339-38cd-40f4-a4e5-0b220e363df8", "name": "network-vif-deleted", "tag": "8c94703f-c59c-42e5-b507-01dab2c8cb70"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:55.101252 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:12:55.101252 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:12:55.110016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-937b67a3-f816-40c2-9ddf-ebf3d589c0e8 req-2233d6f6-eadd-4a5a-8750-df5f20fd9915 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:55.110730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-937b67a3-f816-40c2-9ddf-ebf3d589c0e8 req-2233d6f6-eadd-4a5a-8750-df5f20fd9915 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:55.127822 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-937b67a3-f816-40c2-9ddf-ebf3d589c0e8 req-2233d6f6-eadd-4a5a-8750-df5f20fd9915 service nova] Creating event network-vif-deleted:8c94703f-c59c-42e5-b507-01dab2c8cb70 for instance a40cd339-38cd-40f4-a4e5-0b220e363df8 on nch2-master-1 Jan 22 21:12:55.129800 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-937b67a3-f816-40c2-9ddf-ebf3d589c0e8 req-2233d6f6-eadd-4a5a-8750-df5f20fd9915 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035254 Jan 22 21:12:55.134711 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2266/4364] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:12:55.150918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb2fe372-8905-4d29-8f7c-3637762d5311 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:55.154743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb2fe372-8905-4d29-8f7c-3637762d5311 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:55.168904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d9903d8d-cbca-47b6-b501-ce23d88a84a1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:55.169970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d9903d8d-cbca-47b6-b501-ce23d88a84a1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:55.174852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb2fe372-8905-4d29-8f7c-3637762d5311 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:55.175326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb2fe372-8905-4d29-8f7c-3637762d5311 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:55.178705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb2fe372-8905-4d29-8f7c-3637762d5311 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:55.179357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb2fe372-8905-4d29-8f7c-3637762d5311 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:55.180609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9903d8d-cbca-47b6-b501-ce23d88a84a1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:55.182595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9903d8d-cbca-47b6-b501-ce23d88a84a1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:55.183633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9903d8d-cbca-47b6-b501-ce23d88a84a1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:55.184790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9903d8d-cbca-47b6-b501-ce23d88a84a1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:55.232686 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb2fe372-8905-4d29-8f7c-3637762d5311 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.088707 Jan 22 21:12:55.233670 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2099/4365] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:55 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:12:55.269414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d9903d8d-cbca-47b6-b501-ce23d88a84a1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:55.281053 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d9903d8d-cbca-47b6-b501-ce23d88a84a1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1495 microversion: 2.1 time: 0.121586 Jan 22 21:12:55.281053 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2267/4366] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:55 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1495 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:55.486714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0cc2db89-729e-4426-957a-f5d3eeeb4130 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:55.487853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0cc2db89-729e-4426-957a-f5d3eeeb4130 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:55.514988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cc2db89-729e-4426-957a-f5d3eeeb4130 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:55.516950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cc2db89-729e-4426-957a-f5d3eeeb4130 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:55.518344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cc2db89-729e-4426-957a-f5d3eeeb4130 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:55.530642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cc2db89-729e-4426-957a-f5d3eeeb4130 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:55.560166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6ae84f38-d704-4418-a2b5-345fe7fc702f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:55.561116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6ae84f38-d704-4418-a2b5-345fe7fc702f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:55.573258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ae84f38-d704-4418-a2b5-345fe7fc702f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:55.577434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ae84f38-d704-4418-a2b5-345fe7fc702f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:55.578622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ae84f38-d704-4418-a2b5-345fe7fc702f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:55.579166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ae84f38-d704-4418-a2b5-345fe7fc702f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:55.632401 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0cc2db89-729e-4426-957a-f5d3eeeb4130 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.145861 Jan 22 21:12:55.632401 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2100/4367] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:55 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:55.688576 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6ae84f38-d704-4418-a2b5-345fe7fc702f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 8203 microversion: 2.1 time: 0.133059 Jan 22 21:12:55.691992 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2268/4368] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:55 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 8203 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:55.818820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a7e82094-935b-4641-ae68-3f0283b5df02 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:55.818820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a7e82094-935b-4641-ae68-3f0283b5df02 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:55.831369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7e82094-935b-4641-ae68-3f0283b5df02 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:55.832117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7e82094-935b-4641-ae68-3f0283b5df02 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:55.835274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7e82094-935b-4641-ae68-3f0283b5df02 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:55.836622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7e82094-935b-4641-ae68-3f0283b5df02 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:55.876821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0edfbbfd-a9d3-4674-9d07-0e49cdf29e95 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:55.877564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0edfbbfd-a9d3-4674-9d07-0e49cdf29e95 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:55.890065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0edfbbfd-a9d3-4674-9d07-0e49cdf29e95 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:55.890530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0edfbbfd-a9d3-4674-9d07-0e49cdf29e95 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:55.898638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0edfbbfd-a9d3-4674-9d07-0e49cdf29e95 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:55.899235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0edfbbfd-a9d3-4674-9d07-0e49cdf29e95 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:56.020356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0edfbbfd-a9d3-4674-9d07-0e49cdf29e95 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:56.030005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0edfbbfd-a9d3-4674-9d07-0e49cdf29e95 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:56.031516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0edfbbfd-a9d3-4674-9d07-0e49cdf29e95 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:56.032811 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0edfbbfd-a9d3-4674-9d07-0e49cdf29e95 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.160588 Jan 22 21:12:56.033391 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2269/4369] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:55 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:12:56.246666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c7687a26-ce61-4ebd-ba43-355d48bc17a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:56.247754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c7687a26-ce61-4ebd-ba43-355d48bc17a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:56.262831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7687a26-ce61-4ebd-ba43-355d48bc17a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:56.263574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7687a26-ce61-4ebd-ba43-355d48bc17a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:56.264619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7687a26-ce61-4ebd-ba43-355d48bc17a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:56.265086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7687a26-ce61-4ebd-ba43-355d48bc17a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:56.316772 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c7687a26-ce61-4ebd-ba43-355d48bc17a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.075851 Jan 22 21:12:56.318323 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2270/4370] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:56 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:56.326222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3a85b06d-e0dc-445c-a543-02bdd01cf146 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:56.327003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3a85b06d-e0dc-445c-a543-02bdd01cf146 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:56.336501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a85b06d-e0dc-445c-a543-02bdd01cf146 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:56.337931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a85b06d-e0dc-445c-a543-02bdd01cf146 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:56.339093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a85b06d-e0dc-445c-a543-02bdd01cf146 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:56.339554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a85b06d-e0dc-445c-a543-02bdd01cf146 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:56.389178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a85b06d-e0dc-445c-a543-02bdd01cf146 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:56.390081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a85b06d-e0dc-445c-a543-02bdd01cf146 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:56.391057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-3a85b06d-e0dc-445c-a543-02bdd01cf146 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lazy-loading 'fault' on Instance uuid a40cd339-38cd-40f4-a4e5-0b220e363df8 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:12:56.454570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3a85b06d-e0dc-445c-a543-02bdd01cf146 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:56.470559 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3a85b06d-e0dc-445c-a543-02bdd01cf146 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 200 len: 1372 microversion: 2.1 time: 0.150786 Jan 22 21:12:56.472447 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2271/4371] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:56 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:56.641041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4776479d-cffd-4108-bacf-4d1fd7245237 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:56.642338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4776479d-cffd-4108-bacf-4d1fd7245237 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:56.649045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4776479d-cffd-4108-bacf-4d1fd7245237 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:56.650166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4776479d-cffd-4108-bacf-4d1fd7245237 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:56.651288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4776479d-cffd-4108-bacf-4d1fd7245237 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:56.651945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4776479d-cffd-4108-bacf-4d1fd7245237 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:56.657787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a7e82094-935b-4641-ae68-3f0283b5df02 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:56.673437 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a7e82094-935b-4641-ae68-3f0283b5df02 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1328 microversion: 2.1 time: 0.861859 Jan 22 21:12:56.676812 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2101/4372] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:55 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1328 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:56.702974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b02ba245-66e3-4d6a-9e1b-58985c6c2ab4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:56.704161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b02ba245-66e3-4d6a-9e1b-58985c6c2ab4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:56.705813 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4776479d-cffd-4108-bacf-4d1fd7245237 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.068194 Jan 22 21:12:56.706923 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2272/4373] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:56 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:56.715493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b02ba245-66e3-4d6a-9e1b-58985c6c2ab4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:56.715952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b02ba245-66e3-4d6a-9e1b-58985c6c2ab4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:56.716868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b02ba245-66e3-4d6a-9e1b-58985c6c2ab4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:56.717405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b02ba245-66e3-4d6a-9e1b-58985c6c2ab4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:56.781073 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b02ba245-66e3-4d6a-9e1b-58985c6c2ab4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 16385 microversion: 2.1 time: 0.083859 Jan 22 21:12:56.781981 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2102/4374] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:56 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 16385 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:12:57.052490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-59d8a863-25bd-4745-844d-2ccbdbdcf0c9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:57.053978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-59d8a863-25bd-4745-844d-2ccbdbdcf0c9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:57.061283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59d8a863-25bd-4745-844d-2ccbdbdcf0c9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:57.062006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59d8a863-25bd-4745-844d-2ccbdbdcf0c9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:57.062984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59d8a863-25bd-4745-844d-2ccbdbdcf0c9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:57.063612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59d8a863-25bd-4745-844d-2ccbdbdcf0c9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:57.131759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-59d8a863-25bd-4745-844d-2ccbdbdcf0c9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:57.141761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-59d8a863-25bd-4745-844d-2ccbdbdcf0c9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:57.143267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-59d8a863-25bd-4745-844d-2ccbdbdcf0c9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:57.144528 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-59d8a863-25bd-4745-844d-2ccbdbdcf0c9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.096098 Jan 22 21:12:57.157193 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2273/4375] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:57 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:12:57.334776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48d806a6-ffe2-413d-868c-5ea252c4e0d0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:57.336267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48d806a6-ffe2-413d-868c-5ea252c4e0d0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:57.366392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48d806a6-ffe2-413d-868c-5ea252c4e0d0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:57.367790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48d806a6-ffe2-413d-868c-5ea252c4e0d0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:57.370158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48d806a6-ffe2-413d-868c-5ea252c4e0d0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:57.370792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48d806a6-ffe2-413d-868c-5ea252c4e0d0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:57.436136 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48d806a6-ffe2-413d-868c-5ea252c4e0d0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.111070 Jan 22 21:12:57.442564 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2103/4376] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:57 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:57.494819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d1605b95-c9cd-487b-9d2a-0715ac65070d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:57.495584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d1605b95-c9cd-487b-9d2a-0715ac65070d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: a40cd339-38cd-40f4-a4e5-0b220e363df8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:57.504652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1605b95-c9cd-487b-9d2a-0715ac65070d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:57.505960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1605b95-c9cd-487b-9d2a-0715ac65070d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:57.507512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1605b95-c9cd-487b-9d2a-0715ac65070d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:57.508078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1605b95-c9cd-487b-9d2a-0715ac65070d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:57.530444 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-d1605b95-c9cd-487b-9d2a-0715ac65070d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] HTTP exception thrown: Instance a40cd339-38cd-40f4-a4e5-0b220e363df8 could not be found. Jan 22 21:12:57.531417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d1605b95-c9cd-487b-9d2a-0715ac65070d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Returning 404 to user: Instance a40cd339-38cd-40f4-a4e5-0b220e363df8 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:12:57.532355 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d1605b95-c9cd-487b-9d2a-0715ac65070d tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8" status: 404 len: 111 microversion: 2.1 time: 0.042450 Jan 22 21:12:57.533465 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2274/4377] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:57 2022] GET /compute/v2.1/servers/a40cd339-38cd-40f4-a4e5-0b220e363df8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:12:57.544108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d82a153a-47da-41a0-8108-b7bef1d9da24 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:57.549739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d82a153a-47da-41a0-8108-b7bef1d9da24 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:57.555325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d82a153a-47da-41a0-8108-b7bef1d9da24 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:57.556689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d82a153a-47da-41a0-8108-b7bef1d9da24 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:57.558136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d82a153a-47da-41a0-8108-b7bef1d9da24 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:57.558811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d82a153a-47da-41a0-8108-b7bef1d9da24 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:57.610092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d82a153a-47da-41a0-8108-b7bef1d9da24 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:12:57.696667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6786dee-fbda-4858-9098-609967d16ffb tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:57.698594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b6786dee-fbda-4858-9098-609967d16ffb tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:57.707384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6786dee-fbda-4858-9098-609967d16ffb tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:57.708130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6786dee-fbda-4858-9098-609967d16ffb tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:57.709106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6786dee-fbda-4858-9098-609967d16ffb tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:57.710050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6786dee-fbda-4858-9098-609967d16ffb tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:57.951842 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d82a153a-47da-41a0-8108-b7bef1d9da24 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "DELETE /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 204 len: 0 microversion: 2.1 time: 0.413469 Jan 22 21:12:57.956802 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2104/4378] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:12:57 2022] DELETE /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:12:57.964441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3acac095-6239-42e7-afd0-bdcf95c0e3ca tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:57.964441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3acac095-6239-42e7-afd0-bdcf95c0e3ca tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:57.985998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3acac095-6239-42e7-afd0-bdcf95c0e3ca tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:57.986729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3acac095-6239-42e7-afd0-bdcf95c0e3ca tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:57.989428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3acac095-6239-42e7-afd0-bdcf95c0e3ca tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:57.992828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3acac095-6239-42e7-afd0-bdcf95c0e3ca tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:58.003130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b6786dee-fbda-4858-9098-609967d16ffb tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:58.015061 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b6786dee-fbda-4858-9098-609967d16ffb tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1524 microversion: 2.1 time: 0.324558 Jan 22 21:12:58.025471 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2275/4379] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:57 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1524 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:12:58.030227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bcf35427-9fc1-41a8-af80-ada0239b1c5f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:58.031434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bcf35427-9fc1-41a8-af80-ada0239b1c5f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:58.039280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcf35427-9fc1-41a8-af80-ada0239b1c5f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:58.040282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcf35427-9fc1-41a8-af80-ada0239b1c5f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:58.041333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcf35427-9fc1-41a8-af80-ada0239b1c5f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:58.041934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcf35427-9fc1-41a8-af80-ada0239b1c5f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:58.094701 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3acac095-6239-42e7-afd0-bdcf95c0e3ca tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.138084 Jan 22 21:12:58.108244 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bcf35427-9fc1-41a8-af80-ada0239b1c5f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 16385 microversion: 2.1 time: 0.090694 Jan 22 21:12:58.112123 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2276/4380] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:58 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 16385 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:58.112517 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2105/4381] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:57 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:58.121774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d6fb766-d849-4dda-895f-4e10ad2c2292 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:58.122524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d6fb766-d849-4dda-895f-4e10ad2c2292 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:58.123600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0ebc547f-cff2-4052-b618-3c67183ccc67 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Action: 'create', calling method: .version_select at 0x7f1ed4f59160>, body: {"pool": null} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:58.130897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d6fb766-d849-4dda-895f-4e10ad2c2292 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:58.131375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d6fb766-d849-4dda-895f-4e10ad2c2292 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:58.132346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d6fb766-d849-4dda-895f-4e10ad2c2292 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:58.137358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d6fb766-d849-4dda-895f-4e10ad2c2292 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:58.468866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5d6fb766-d849-4dda-895f-4e10ad2c2292 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:58.476873 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d6fb766-d849-4dda-895f-4e10ad2c2292 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1472 microversion: 2.1 time: 0.360868 Jan 22 21:12:58.478835 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2277/4382] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:58 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1472 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:58.483992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-77878f07-b12d-47fe-9078-7ebad92759e8 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:58.485203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-77878f07-b12d-47fe-9078-7ebad92759e8 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:58.492081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77878f07-b12d-47fe-9078-7ebad92759e8 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:58.492565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77878f07-b12d-47fe-9078-7ebad92759e8 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:58.494279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77878f07-b12d-47fe-9078-7ebad92759e8 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:58.495062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77878f07-b12d-47fe-9078-7ebad92759e8 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:58.565196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-77878f07-b12d-47fe-9078-7ebad92759e8 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:58.576014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-77878f07-b12d-47fe-9078-7ebad92759e8 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:58.577957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-77878f07-b12d-47fe-9078-7ebad92759e8 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:58.579350 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-77878f07-b12d-47fe-9078-7ebad92759e8 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.099133 Jan 22 21:12:58.579944 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2278/4383] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:58 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:12:58.585484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-854858312", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a953f459-5982-44b7-9e73-c038b6d680f5"}], "security_groups": [{"name": "tempest-securitygroup--499566348"}], "key_name": "tempest-keypair-588674945", "user_data": "}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:58.705809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] validate_networks() for [('a953f459-5982-44b7-9e73-c038b6d680f5', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:12:59.166354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:12:59.166859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:12:59.167425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:12:59.168886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:12:59.169391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:12:59.181262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:59.181889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:59.182846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:59.183462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:59.204377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Getting quotas for project 76ecd70d0be147b59ffbda6d93f73aa6. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:12:59.211038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Getting quotas for user c0be514b27f14d8a9e4fd71b31a6d2e3 and project 76ecd70d0be147b59ffbda6d93f73aa6. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:12:59.226484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:12:59.229745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:12:59.396962 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61f8ce2d-04f3-4128-9c14-09c3149e89dd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 0.815486 Jan 22 21:12:59.397844 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2279/4384] 10.222.0.100 () {62 vars in 1192 bytes} [Sat Jan 22 21:12:58 2022] POST /compute/v2.1/servers => generated 403 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 22 21:12:59.409440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1af0b9bb-384f-4baa-86e2-8cbc66666dcf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:59.410486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1af0b9bb-384f-4baa-86e2-8cbc66666dcf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:59.418674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1af0b9bb-384f-4baa-86e2-8cbc66666dcf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:59.418883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1af0b9bb-384f-4baa-86e2-8cbc66666dcf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:59.420035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1af0b9bb-384f-4baa-86e2-8cbc66666dcf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:59.420492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1af0b9bb-384f-4baa-86e2-8cbc66666dcf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:59.483369 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1af0b9bb-384f-4baa-86e2-8cbc66666dcf tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.074810 Jan 22 21:12:59.485277 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2280/4385] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:59 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:59.492113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-057bbe66-5ac8-4ca1-9a26-0e7cb4c5fb1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:59.493735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-057bbe66-5ac8-4ca1-9a26-0e7cb4c5fb1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:59.503671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-057bbe66-5ac8-4ca1-9a26-0e7cb4c5fb1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:59.504240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-057bbe66-5ac8-4ca1-9a26-0e7cb4c5fb1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:59.505383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-057bbe66-5ac8-4ca1-9a26-0e7cb4c5fb1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:59.505869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-057bbe66-5ac8-4ca1-9a26-0e7cb4c5fb1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:59.564613 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-057bbe66-5ac8-4ca1-9a26-0e7cb4c5fb1c tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.077683 Jan 22 21:12:59.565774 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2281/4386] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:12:59 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:12:59.576632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-425bb11c-904f-44ea-aab7-faa88c46a1f5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:12:59.577799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-425bb11c-904f-44ea-aab7-faa88c46a1f5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:59.586872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-425bb11c-904f-44ea-aab7-faa88c46a1f5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:59.587208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-425bb11c-904f-44ea-aab7-faa88c46a1f5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:59.588013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-425bb11c-904f-44ea-aab7-faa88c46a1f5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:59.588462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-425bb11c-904f-44ea-aab7-faa88c46a1f5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:59.632900 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-425bb11c-904f-44ea-aab7-faa88c46a1f5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 16385 microversion: 2.1 time: 0.061425 Jan 22 21:12:59.634150 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2282/4387] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:12:59 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 16385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:12:59.639041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-090500a7-37e0-467d-86b6-127cedfc21e4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:59.639987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-090500a7-37e0-467d-86b6-127cedfc21e4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:59.703875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-090500a7-37e0-467d-86b6-127cedfc21e4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:59.711425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-090500a7-37e0-467d-86b6-127cedfc21e4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:59.713533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-090500a7-37e0-467d-86b6-127cedfc21e4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:59.714663 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-090500a7-37e0-467d-86b6-127cedfc21e4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1284 microversion: 2.20 time: 0.080035 Jan 22 21:12:59.715237 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2283/4388] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:59 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1284 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:12:59.724017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cea75560-7111-493a-9146-b4d754894959 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:59.724633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cea75560-7111-493a-9146-b4d754894959 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:59.735896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cea75560-7111-493a-9146-b4d754894959 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:59.736565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cea75560-7111-493a-9146-b4d754894959 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:59.737764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cea75560-7111-493a-9146-b4d754894959 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:59.738442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cea75560-7111-493a-9146-b4d754894959 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:59.919602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cea75560-7111-493a-9146-b4d754894959 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:12:59.934412 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cea75560-7111-493a-9146-b4d754894959 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1472 microversion: 2.1 time: 0.215635 Jan 22 21:12:59.935319 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2284/4389] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:12:59 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1472 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:12:59.951673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2c66b236-61f7-49af-8a3f-da2ac41360ba tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:12:59.952521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2c66b236-61f7-49af-8a3f-da2ac41360ba tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:12:59.960294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c66b236-61f7-49af-8a3f-da2ac41360ba tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:59.960294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c66b236-61f7-49af-8a3f-da2ac41360ba tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:12:59.961110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c66b236-61f7-49af-8a3f-da2ac41360ba tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:12:59.962135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c66b236-61f7-49af-8a3f-da2ac41360ba tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:00.040574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2c66b236-61f7-49af-8a3f-da2ac41360ba tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:00.050440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2c66b236-61f7-49af-8a3f-da2ac41360ba tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:00.052008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2c66b236-61f7-49af-8a3f-da2ac41360ba tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:00.053435 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2c66b236-61f7-49af-8a3f-da2ac41360ba tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.107001 Jan 22 21:13:00.054270 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2285/4390] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:12:59 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:00.493561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bbd9258f-de46-407e-bd03-bfec236e3d90 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:00.494691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bbd9258f-de46-407e-bd03-bfec236e3d90 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:00.505445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbd9258f-de46-407e-bd03-bfec236e3d90 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:00.507099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbd9258f-de46-407e-bd03-bfec236e3d90 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:00.508130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbd9258f-de46-407e-bd03-bfec236e3d90 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:00.508969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbd9258f-de46-407e-bd03-bfec236e3d90 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:00.558542 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bbd9258f-de46-407e-bd03-bfec236e3d90 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.069665 Jan 22 21:13:00.559525 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2286/4391] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:00 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:00.583265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a4c3107-e9ce-447f-85f5-9e6437a2ef0f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:00.587991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a4c3107-e9ce-447f-85f5-9e6437a2ef0f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:00.606371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a4c3107-e9ce-447f-85f5-9e6437a2ef0f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:00.608664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a4c3107-e9ce-447f-85f5-9e6437a2ef0f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:00.609486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a4c3107-e9ce-447f-85f5-9e6437a2ef0f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:00.610119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a4c3107-e9ce-447f-85f5-9e6437a2ef0f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:00.667320 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a4c3107-e9ce-447f-85f5-9e6437a2ef0f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.092423 Jan 22 21:13:00.668243 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2287/4392] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:00 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:00.674330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-9a8a460a-eb9c-40cb-b360-c2821712536e req-32d5519f-37c5-4aae-9e59-c47a12d92af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928ef427-4b8d-4fb6-b1ff-9b99172cf1b8", "name": "network-vif-deleted", "tag": "185dedd3-23dc-46aa-9214-659f5ce5e4f5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:00.676106 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:00.676106 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:13:00.685866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9a8a460a-eb9c-40cb-b360-c2821712536e req-32d5519f-37c5-4aae-9e59-c47a12d92af0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:00.689579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9a8a460a-eb9c-40cb-b360-c2821712536e req-32d5519f-37c5-4aae-9e59-c47a12d92af0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:00.700144 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-9a8a460a-eb9c-40cb-b360-c2821712536e req-32d5519f-37c5-4aae-9e59-c47a12d92af0 service nova] Creating event network-vif-deleted:185dedd3-23dc-46aa-9214-659f5ce5e4f5 for instance 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 on nch1-master-1 Jan 22 21:13:00.706978 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-9a8a460a-eb9c-40cb-b360-c2821712536e req-32d5519f-37c5-4aae-9e59-c47a12d92af0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036664 Jan 22 21:13:00.708298 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2288/4393] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:00.722932 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0ebc547f-cff2-4052-b618-3c67183ccc67 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.609897 Jan 22 21:13:00.723776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c0ef687b-1fbc-4696-a53b-02363bdb1ca6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:00.725097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c0ef687b-1fbc-4696-a53b-02363bdb1ca6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:00.726427 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2106/4394] 10.222.0.100 () {60 vars in 1174 bytes} [Sat Jan 22 21:12:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:00.748212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1dc7ea64-4d57-4d53-a5b1-70192b0a63ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:00.748972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1dc7ea64-4d57-4d53-a5b1-70192b0a63ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:00.750858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0ef687b-1fbc-4696-a53b-02363bdb1ca6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:00.751535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0ef687b-1fbc-4696-a53b-02363bdb1ca6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:00.752553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0ef687b-1fbc-4696-a53b-02363bdb1ca6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:00.753191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0ef687b-1fbc-4696-a53b-02363bdb1ca6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:00.768999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1dc7ea64-4d57-4d53-a5b1-70192b0a63ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:00.775284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1dc7ea64-4d57-4d53-a5b1-70192b0a63ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:00.776306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1dc7ea64-4d57-4d53-a5b1-70192b0a63ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:00.776770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1dc7ea64-4d57-4d53-a5b1-70192b0a63ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:00.808062 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c0ef687b-1fbc-4696-a53b-02363bdb1ca6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 16385 microversion: 2.1 time: 0.095724 Jan 22 21:13:00.811953 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2289/4395] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:00 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 16385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:00.870301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1dc7ea64-4d57-4d53-a5b1-70192b0a63ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:00.875575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-957336467", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "11c5d3c2-f473-483b-8127-34bbf3efe45d"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:00.879479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1dc7ea64-4d57-4d53-a5b1-70192b0a63ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:00.881060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1dc7ea64-4d57-4d53-a5b1-70192b0a63ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:00.882220 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1dc7ea64-4d57-4d53-a5b1-70192b0a63ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1288 microversion: 2.20 time: 0.143300 Jan 22 21:13:00.882787 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2107/4396] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:00 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1288 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:13:00.935980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] validate_networks() for [('11c5d3c2-f473-483b-8127-34bbf3efe45d', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:13:00.954625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-42948f32-3f82-4647-bf06-3fae9d03f697 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:00.955386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-42948f32-3f82-4647-bf06-3fae9d03f697 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:00.963424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42948f32-3f82-4647-bf06-3fae9d03f697 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:00.963974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42948f32-3f82-4647-bf06-3fae9d03f697 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:00.964862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42948f32-3f82-4647-bf06-3fae9d03f697 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:00.965389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42948f32-3f82-4647-bf06-3fae9d03f697 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:01.000320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42948f32-3f82-4647-bf06-3fae9d03f697 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:01.000868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42948f32-3f82-4647-bf06-3fae9d03f697 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:01.001391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-42948f32-3f82-4647-bf06-3fae9d03f697 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lazy-loading 'fault' on Instance uuid 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:13:01.043711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-42948f32-3f82-4647-bf06-3fae9d03f697 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:01.061216 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-42948f32-3f82-4647-bf06-3fae9d03f697 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 200 len: 1306 microversion: 2.1 time: 0.111949 Jan 22 21:13:01.062417 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2108/4397] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:00 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 1306 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:01.084430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4ce2a087-11e1-4834-b547-1fff2088d345 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:01.085466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4ce2a087-11e1-4834-b547-1fff2088d345 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:01.092862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ce2a087-11e1-4834-b547-1fff2088d345 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:01.093360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ce2a087-11e1-4834-b547-1fff2088d345 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:01.094564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ce2a087-11e1-4834-b547-1fff2088d345 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:01.095071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ce2a087-11e1-4834-b547-1fff2088d345 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:01.161424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4ce2a087-11e1-4834-b547-1fff2088d345 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:01.177998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4ce2a087-11e1-4834-b547-1fff2088d345 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:01.181032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4ce2a087-11e1-4834-b547-1fff2088d345 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:01.182745 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4ce2a087-11e1-4834-b547-1fff2088d345 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.109226 Jan 22 21:13:01.183894 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2109/4398] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:01 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:01.412300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:13:01.412732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:13:01.413215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:13:01.413675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:13:01.414099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:13:01.423804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:01.424176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:01.425006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:01.425458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:01.444422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Getting quotas for project 8fee2320503f41948e06d83350863358. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:13:01.450788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Getting quotas for user cb5abf45e6a842cea2bc7dba6f13e4ae and project 8fee2320503f41948e06d83350863358. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:13:01.463082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:13:01.465683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:13:01.570459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b791eb9-3a04-471f-8081-5423f283ccf4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:01.571550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4b791eb9-3a04-471f-8081-5423f283ccf4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:01.578487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b791eb9-3a04-471f-8081-5423f283ccf4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:01.578952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b791eb9-3a04-471f-8081-5423f283ccf4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:01.579728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b791eb9-3a04-471f-8081-5423f283ccf4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:01.580164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b791eb9-3a04-471f-8081-5423f283ccf4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:01.628147 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b791eb9-3a04-471f-8081-5423f283ccf4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.061277 Jan 22 21:13:01.628796 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2110/4399] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:01 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:01.679113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-94613ce1-b1f1-4499-b4dc-6c9cee680b14 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:01.681182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-94613ce1-b1f1-4499-b4dc-6c9cee680b14 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:01.681988 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c92531a9-3b26-4e45-84d2-31393c8b2a43 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.811110 Jan 22 21:13:01.687453 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2290/4400] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:13:00 2022] POST /compute/v2.1/servers => generated 382 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:13:01.693608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5769a862-8892-4179-bb04-64c3c65b8853 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:01.694625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5769a862-8892-4179-bb04-64c3c65b8853 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:01.697104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94613ce1-b1f1-4499-b4dc-6c9cee680b14 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:01.697104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94613ce1-b1f1-4499-b4dc-6c9cee680b14 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:01.698220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94613ce1-b1f1-4499-b4dc-6c9cee680b14 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:01.698870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94613ce1-b1f1-4499-b4dc-6c9cee680b14 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:01.755640 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-94613ce1-b1f1-4499-b4dc-6c9cee680b14 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.080567 Jan 22 21:13:01.757350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5769a862-8892-4179-bb04-64c3c65b8853 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:01.757495 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2111/4401] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:01 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:13:01.765565 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5769a862-8892-4179-bb04-64c3c65b8853 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 200 len: 1227 microversion: 2.1 time: 0.076766 Jan 22 21:13:01.766284 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2291/4402] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:01 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 1227 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:01.821396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5242e155-6047-437f-97cc-b63b5215cd26 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:01.822465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5242e155-6047-437f-97cc-b63b5215cd26 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:01.830645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5242e155-6047-437f-97cc-b63b5215cd26 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:01.831159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5242e155-6047-437f-97cc-b63b5215cd26 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:01.832083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5242e155-6047-437f-97cc-b63b5215cd26 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:01.832615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5242e155-6047-437f-97cc-b63b5215cd26 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:01.896159 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5242e155-6047-437f-97cc-b63b5215cd26 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 24555 microversion: 2.1 time: 0.079868 Jan 22 21:13:01.896817 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2112/4403] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:01 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 24555 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:01.901441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cbec0481-dbe2-46a5-b162-b5879eb4d0b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:01.902087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cbec0481-dbe2-46a5-b162-b5879eb4d0b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:01.909191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cbec0481-dbe2-46a5-b162-b5879eb4d0b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:01.909749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cbec0481-dbe2-46a5-b162-b5879eb4d0b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:01.910709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cbec0481-dbe2-46a5-b162-b5879eb4d0b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:01.911231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cbec0481-dbe2-46a5-b162-b5879eb4d0b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:01.981900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cbec0481-dbe2-46a5-b162-b5879eb4d0b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:01.991215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cbec0481-dbe2-46a5-b162-b5879eb4d0b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:01.992904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cbec0481-dbe2-46a5-b162-b5879eb4d0b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:01.994523 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cbec0481-dbe2-46a5-b162-b5879eb4d0b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1344 microversion: 2.20 time: 0.098148 Jan 22 21:13:01.995384 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2292/4404] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:01 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1344 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:13:02.082253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7414cfb1-41ea-485c-bb16-8cbe4b8fe966 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:02.082959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7414cfb1-41ea-485c-bb16-8cbe4b8fe966 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:02.091108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7414cfb1-41ea-485c-bb16-8cbe4b8fe966 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:02.091573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7414cfb1-41ea-485c-bb16-8cbe4b8fe966 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:02.092393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7414cfb1-41ea-485c-bb16-8cbe4b8fe966 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:02.092835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7414cfb1-41ea-485c-bb16-8cbe4b8fe966 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:02.117642 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-7414cfb1-41ea-485c-bb16-8cbe4b8fe966 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] HTTP exception thrown: Instance 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 could not be found. Jan 22 21:13:02.119300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7414cfb1-41ea-485c-bb16-8cbe4b8fe966 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Returning 404 to user: Instance 928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:13:02.120358 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7414cfb1-41ea-485c-bb16-8cbe4b8fe966 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8" status: 404 len: 111 microversion: 2.1 time: 0.042342 Jan 22 21:13:02.121460 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2113/4405] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:02 2022] GET /compute/v2.1/servers/928ef427-4b8d-4fb6-b1ff-9b99172cf1b8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:13:02.129083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c5b1bb36-f384-4257-9f8a-425afb0b30d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:02.130023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c5b1bb36-f384-4257-9f8a-425afb0b30d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:02.138037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5b1bb36-f384-4257-9f8a-425afb0b30d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:02.138859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5b1bb36-f384-4257-9f8a-425afb0b30d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:02.139907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5b1bb36-f384-4257-9f8a-425afb0b30d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:02.140570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5b1bb36-f384-4257-9f8a-425afb0b30d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:02.175630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c5b1bb36-f384-4257-9f8a-425afb0b30d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:13:02.211263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3cd153bb-fa5f-49de-86b0-7e207f5a3883 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:02.212580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3cd153bb-fa5f-49de-86b0-7e207f5a3883 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:02.234450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cd153bb-fa5f-49de-86b0-7e207f5a3883 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:02.237103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cd153bb-fa5f-49de-86b0-7e207f5a3883 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:02.240150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cd153bb-fa5f-49de-86b0-7e207f5a3883 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:02.240537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cd153bb-fa5f-49de-86b0-7e207f5a3883 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:02.603121 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c5b1bb36-f384-4257-9f8a-425afb0b30d0 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "DELETE /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 204 len: 0 microversion: 2.1 time: 0.476843 Jan 22 21:13:02.603764 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2293/4406] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:13:02 2022] DELETE /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:13:02.624252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3cd153bb-fa5f-49de-86b0-7e207f5a3883 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:02.636799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3cd153bb-fa5f-49de-86b0-7e207f5a3883 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:02.639317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3cd153bb-fa5f-49de-86b0-7e207f5a3883 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:02.640461 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3cd153bb-fa5f-49de-86b0-7e207f5a3883 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.436134 Jan 22 21:13:02.641105 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2114/4407] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:02 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:13:02.645750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-16df6928-4985-4103-9912-6932bc630fa9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:02.646434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-16df6928-4985-4103-9912-6932bc630fa9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:02.652952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16df6928-4985-4103-9912-6932bc630fa9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:02.653786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16df6928-4985-4103-9912-6932bc630fa9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:02.654882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16df6928-4985-4103-9912-6932bc630fa9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:02.655402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16df6928-4985-4103-9912-6932bc630fa9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:02.736308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1204348043", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "8c361452-fa4d-4ab7-8f83-c94733a0410d"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:02.792036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] validate_networks() for [('8c361452-fa4d-4ab7-8f83-c94733a0410d', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:13:02.809074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-16df6928-4985-4103-9912-6932bc630fa9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:02.817879 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-16df6928-4985-4103-9912-6932bc630fa9 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1471 microversion: 2.1 time: 0.175398 Jan 22 21:13:02.818428 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2115/4408] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:02 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:02.826878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c3adb0a2-1f35-45ae-b0ab-e654564b34a8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:02.948357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c3adb0a2-1f35-45ae-b0ab-e654564b34a8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:02.948357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3adb0a2-1f35-45ae-b0ab-e654564b34a8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:02.948357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3adb0a2-1f35-45ae-b0ab-e654564b34a8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:02.948357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3adb0a2-1f35-45ae-b0ab-e654564b34a8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:02.948357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3adb0a2-1f35-45ae-b0ab-e654564b34a8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:02.948357 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c3adb0a2-1f35-45ae-b0ab-e654564b34a8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.056147 Jan 22 21:13:02.948357 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2116/4409] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:02 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:02.948357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a30dd923-8b6a-4430-81c4-bb89c2eed1ce tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:02.948357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a30dd923-8b6a-4430-81c4-bb89c2eed1ce tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:02.948357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a30dd923-8b6a-4430-81c4-bb89c2eed1ce tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:02.948357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a30dd923-8b6a-4430-81c4-bb89c2eed1ce tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:02.948357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a30dd923-8b6a-4430-81c4-bb89c2eed1ce tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:02.948357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a30dd923-8b6a-4430-81c4-bb89c2eed1ce tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:02.950281 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a30dd923-8b6a-4430-81c4-bb89c2eed1ce tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.068092 Jan 22 21:13:02.950691 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2117/4410] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:02 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:02.955706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-baa0f9c3-3cfb-4f66-b734-bb1e2aa7e0e9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:02.956405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-baa0f9c3-3cfb-4f66-b734-bb1e2aa7e0e9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:02.964050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baa0f9c3-3cfb-4f66-b734-bb1e2aa7e0e9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:02.964507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baa0f9c3-3cfb-4f66-b734-bb1e2aa7e0e9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:02.965308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baa0f9c3-3cfb-4f66-b734-bb1e2aa7e0e9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:02.965801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baa0f9c3-3cfb-4f66-b734-bb1e2aa7e0e9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:03.031784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-baa0f9c3-3cfb-4f66-b734-bb1e2aa7e0e9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:03.039929 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-baa0f9c3-3cfb-4f66-b734-bb1e2aa7e0e9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 200 len: 1231 microversion: 2.1 time: 0.088084 Jan 22 21:13:03.040488 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2118/4411] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:02 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 1231 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:03.045279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-79496cc5-24eb-4d0e-9334-bcbaa11bf20c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:03.049158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-79496cc5-24eb-4d0e-9334-bcbaa11bf20c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:03.052440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79496cc5-24eb-4d0e-9334-bcbaa11bf20c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:03.053302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79496cc5-24eb-4d0e-9334-bcbaa11bf20c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:03.054172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79496cc5-24eb-4d0e-9334-bcbaa11bf20c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:03.054619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79496cc5-24eb-4d0e-9334-bcbaa11bf20c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:03.112553 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-79496cc5-24eb-4d0e-9334-bcbaa11bf20c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 24555 microversion: 2.1 time: 0.070774 Jan 22 21:13:03.113776 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2119/4412] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:03 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 24555 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:03.120199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-62cb7bd1-c3e0-4d0f-ac89-c151c22cd4a4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:03.124438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-62cb7bd1-c3e0-4d0f-ac89-c151c22cd4a4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:03.130151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62cb7bd1-c3e0-4d0f-ac89-c151c22cd4a4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:03.130629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62cb7bd1-c3e0-4d0f-ac89-c151c22cd4a4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:03.132024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62cb7bd1-c3e0-4d0f-ac89-c151c22cd4a4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:03.132580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62cb7bd1-c3e0-4d0f-ac89-c151c22cd4a4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:03.168836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:13:03.169314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:13:03.170109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:13:03.170559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:13:03.170983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:13:03.181820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:03.182279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:03.183139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:03.183686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:03.202191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Getting quotas for project cda1afcb57254df4b0dc8a26bd9d297c. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:13:03.207620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Getting quotas for user 08db8a972cc0443282eabcc89f0033d3 and project cda1afcb57254df4b0dc8a26bd9d297c. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:13:03.213245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-62cb7bd1-c3e0-4d0f-ac89-c151c22cd4a4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:03.222236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:13:03.227126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-62cb7bd1-c3e0-4d0f-ac89-c151c22cd4a4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:03.227126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-62cb7bd1-c3e0-4d0f-ac89-c151c22cd4a4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:03.227517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:13:03.227629 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-62cb7bd1-c3e0-4d0f-ac89-c151c22cd4a4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1342 microversion: 2.20 time: 0.110851 Jan 22 21:13:03.227629 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2120/4413] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:03 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1342 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:03.377994 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-435334f1-98ed-4cbc-b93a-22d1968456e3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.769622 Jan 22 21:13:03.381859 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2294/4414] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:13:02 2022] POST /compute/v2.1/servers => generated 382 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:13:03.395416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9c5a7292-e90a-4cdb-a843-b19f59b02740 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:03.395416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9c5a7292-e90a-4cdb-a843-b19f59b02740 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:03.455737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9c5a7292-e90a-4cdb-a843-b19f59b02740 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:03.464760 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9c5a7292-e90a-4cdb-a843-b19f59b02740 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1218 microversion: 2.1 time: 0.075465 Jan 22 21:13:03.473833 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2121/4415] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:03 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:03.661628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-05431f3f-3801-48c8-95b9-f872fdadf6bd tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:03.662311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-05431f3f-3801-48c8-95b9-f872fdadf6bd tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:03.669824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05431f3f-3801-48c8-95b9-f872fdadf6bd tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:03.670280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05431f3f-3801-48c8-95b9-f872fdadf6bd tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:03.671077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05431f3f-3801-48c8-95b9-f872fdadf6bd tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:03.671529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-05431f3f-3801-48c8-95b9-f872fdadf6bd tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:03.735023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-05431f3f-3801-48c8-95b9-f872fdadf6bd tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:03.743289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-05431f3f-3801-48c8-95b9-f872fdadf6bd tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:03.744828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-05431f3f-3801-48c8-95b9-f872fdadf6bd tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:03.746127 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-05431f3f-3801-48c8-95b9-f872fdadf6bd tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.088349 Jan 22 21:13:03.746696 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2295/4416] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:03 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:03.836274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-99830980-ced2-4fec-bfe5-cef205d969fe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:03.837539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-99830980-ced2-4fec-bfe5-cef205d969fe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:03.860427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99830980-ced2-4fec-bfe5-cef205d969fe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:03.860427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99830980-ced2-4fec-bfe5-cef205d969fe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:03.860427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99830980-ced2-4fec-bfe5-cef205d969fe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:03.860427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99830980-ced2-4fec-bfe5-cef205d969fe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:03.959887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0a2852bc-894c-49e9-a04f-84c4b37b3e73 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:03.960903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0a2852bc-894c-49e9-a04f-84c4b37b3e73 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:03.969430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a2852bc-894c-49e9-a04f-84c4b37b3e73 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:03.970360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a2852bc-894c-49e9-a04f-84c4b37b3e73 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:03.971332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a2852bc-894c-49e9-a04f-84c4b37b3e73 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:03.972160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a2852bc-894c-49e9-a04f-84c4b37b3e73 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:04.016074 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0a2852bc-894c-49e9-a04f-84c4b37b3e73 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.061483 Jan 22 21:13:04.021002 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2296/4417] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:03 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:04.028145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8584fccb-d75f-4c9b-a642-c0ea5032e6d0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:04.029633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8584fccb-d75f-4c9b-a642-c0ea5032e6d0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:04.038620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8584fccb-d75f-4c9b-a642-c0ea5032e6d0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:04.039279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8584fccb-d75f-4c9b-a642-c0ea5032e6d0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:04.040343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8584fccb-d75f-4c9b-a642-c0ea5032e6d0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:04.041608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8584fccb-d75f-4c9b-a642-c0ea5032e6d0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:04.101121 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8584fccb-d75f-4c9b-a642-c0ea5032e6d0 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.077749 Jan 22 21:13:04.105355 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2297/4418] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:04 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:04.121647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-99830980-ced2-4fec-bfe5-cef205d969fe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:04.128382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9c28ced7-4058-47c7-8fee-158750024dae tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:04.129121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9c28ced7-4058-47c7-8fee-158750024dae tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:04.131892 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-99830980-ced2-4fec-bfe5-cef205d969fe tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1471 microversion: 2.1 time: 0.300305 Jan 22 21:13:04.132641 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2122/4419] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:03 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1471 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:04.149119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c28ced7-4058-47c7-8fee-158750024dae tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:04.151365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-18c64985-8a9b-42b6-83e2-d13bde8f86d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:04.153698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c28ced7-4058-47c7-8fee-158750024dae tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:04.154607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c28ced7-4058-47c7-8fee-158750024dae tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:04.155068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c28ced7-4058-47c7-8fee-158750024dae tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:04.156211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-18c64985-8a9b-42b6-83e2-d13bde8f86d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:04.164107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18c64985-8a9b-42b6-83e2-d13bde8f86d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:04.164821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18c64985-8a9b-42b6-83e2-d13bde8f86d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:04.165954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18c64985-8a9b-42b6-83e2-d13bde8f86d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:04.173428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18c64985-8a9b-42b6-83e2-d13bde8f86d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:04.214557 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-18c64985-8a9b-42b6-83e2-d13bde8f86d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 24555 microversion: 2.1 time: 0.078587 Jan 22 21:13:04.217558 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2123/4420] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:04 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 24555 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:04.248374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bd7d04bb-16c1-4833-87c6-7bfb9f44e922 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:04.249184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bd7d04bb-16c1-4833-87c6-7bfb9f44e922 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:04.249613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9c28ced7-4058-47c7-8fee-158750024dae tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:04.260525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd7d04bb-16c1-4833-87c6-7bfb9f44e922 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:04.265408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd7d04bb-16c1-4833-87c6-7bfb9f44e922 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:04.265600 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9c28ced7-4058-47c7-8fee-158750024dae tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 200 len: 1279 microversion: 2.1 time: 0.156939 Jan 22 21:13:04.265600 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2298/4421] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:04 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:04.266413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd7d04bb-16c1-4833-87c6-7bfb9f44e922 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:04.267430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd7d04bb-16c1-4833-87c6-7bfb9f44e922 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:04.482897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-421962e1-4fac-4034-a016-de11b79596c3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:04.483606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-421962e1-4fac-4034-a016-de11b79596c3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:04.545403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-421962e1-4fac-4034-a016-de11b79596c3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:04.552385 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-421962e1-4fac-4034-a016-de11b79596c3 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1218 microversion: 2.1 time: 0.073676 Jan 22 21:13:04.553175 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2299/4422] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:04 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:04.765619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-73e55c2f-dc31-4596-accb-27853ef54c42 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:04.766324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-73e55c2f-dc31-4596-accb-27853ef54c42 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:04.777346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73e55c2f-dc31-4596-accb-27853ef54c42 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:04.778048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73e55c2f-dc31-4596-accb-27853ef54c42 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:04.788293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bd7d04bb-16c1-4833-87c6-7bfb9f44e922 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:04.788477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73e55c2f-dc31-4596-accb-27853ef54c42 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:04.788477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73e55c2f-dc31-4596-accb-27853ef54c42 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:04.788659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bd7d04bb-16c1-4833-87c6-7bfb9f44e922 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:04.791037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bd7d04bb-16c1-4833-87c6-7bfb9f44e922 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:04.792326 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bd7d04bb-16c1-4833-87c6-7bfb9f44e922 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1409 microversion: 2.20 time: 0.550646 Jan 22 21:13:04.800270 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2124/4423] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:04 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1409 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:13:04.865877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-73e55c2f-dc31-4596-accb-27853ef54c42 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:04.875974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-73e55c2f-dc31-4596-accb-27853ef54c42 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:04.877838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-73e55c2f-dc31-4596-accb-27853ef54c42 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:04.879810 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-73e55c2f-dc31-4596-accb-27853ef54c42 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.118183 Jan 22 21:13:04.880503 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2300/4424] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:04 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:13:05.028396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b836e92-757f-4ff2-b5c3-f7af929d729d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:05.029464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4b836e92-757f-4ff2-b5c3-f7af929d729d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:05.037447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b836e92-757f-4ff2-b5c3-f7af929d729d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.038155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b836e92-757f-4ff2-b5c3-f7af929d729d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.039257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b836e92-757f-4ff2-b5c3-f7af929d729d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.040128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b836e92-757f-4ff2-b5c3-f7af929d729d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.080115 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b836e92-757f-4ff2-b5c3-f7af929d729d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.056059 Jan 22 21:13:05.083874 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2125/4425] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:05 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:05.112619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c577673e-abd8-442d-a7be-3d8a39d59682 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:05.113799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c577673e-abd8-442d-a7be-3d8a39d59682 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:05.121710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c577673e-abd8-442d-a7be-3d8a39d59682 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.122411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c577673e-abd8-442d-a7be-3d8a39d59682 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.123388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c577673e-abd8-442d-a7be-3d8a39d59682 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.123836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c577673e-abd8-442d-a7be-3d8a39d59682 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.150585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-377bfff0-2d8a-4845-a1e4-8d14f7dacd21 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:05.151501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-377bfff0-2d8a-4845-a1e4-8d14f7dacd21 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:05.160252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-377bfff0-2d8a-4845-a1e4-8d14f7dacd21 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.161039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-377bfff0-2d8a-4845-a1e4-8d14f7dacd21 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.163018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-377bfff0-2d8a-4845-a1e4-8d14f7dacd21 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.167749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-377bfff0-2d8a-4845-a1e4-8d14f7dacd21 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.182531 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c577673e-abd8-442d-a7be-3d8a39d59682 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.071878 Jan 22 21:13:05.185250 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2301/4426] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:05 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:05.226826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-820e4d72-5e72-421a-9a03-3889d2bee038 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:05.228908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-820e4d72-5e72-421a-9a03-3889d2bee038 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:05.250385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-820e4d72-5e72-421a-9a03-3889d2bee038 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.252102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-820e4d72-5e72-421a-9a03-3889d2bee038 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.254297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-820e4d72-5e72-421a-9a03-3889d2bee038 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.256863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-820e4d72-5e72-421a-9a03-3889d2bee038 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.315603 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-820e4d72-5e72-421a-9a03-3889d2bee038 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 24555 microversion: 2.1 time: 0.092760 Jan 22 21:13:05.316715 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2302/4427] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:05 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 24555 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:05.322041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb1a5b3d-7821-42de-8da9-8eb7082a3f58 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:05.322735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fb1a5b3d-7821-42de-8da9-8eb7082a3f58 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:05.330524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb1a5b3d-7821-42de-8da9-8eb7082a3f58 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.330874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb1a5b3d-7821-42de-8da9-8eb7082a3f58 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.331705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb1a5b3d-7821-42de-8da9-8eb7082a3f58 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.333000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb1a5b3d-7821-42de-8da9-8eb7082a3f58 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.410983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fb1a5b3d-7821-42de-8da9-8eb7082a3f58 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:05.419053 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fb1a5b3d-7821-42de-8da9-8eb7082a3f58 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 200 len: 1285 microversion: 2.1 time: 0.101196 Jan 22 21:13:05.421034 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2303/4428] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:05 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:05.572842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-98453d1d-1902-4f42-b761-f2ff6729ac37 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:05.577155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-98453d1d-1902-4f42-b761-f2ff6729ac37 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:05.590176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98453d1d-1902-4f42-b761-f2ff6729ac37 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.591862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98453d1d-1902-4f42-b761-f2ff6729ac37 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.592538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98453d1d-1902-4f42-b761-f2ff6729ac37 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.593018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98453d1d-1902-4f42-b761-f2ff6729ac37 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.657941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-98453d1d-1902-4f42-b761-f2ff6729ac37 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:05.663744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-377bfff0-2d8a-4845-a1e4-8d14f7dacd21 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:05.666403 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-98453d1d-1902-4f42-b761-f2ff6729ac37 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1270 microversion: 2.1 time: 0.100338 Jan 22 21:13:05.667184 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2304/4429] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:05 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:05.674696 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-377bfff0-2d8a-4845-a1e4-8d14f7dacd21 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1471 microversion: 2.1 time: 0.528495 Jan 22 21:13:05.679708 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2126/4430] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:05 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1471 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:05.697978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-c4da1396-4f4f-447d-acec-af220d59737e req-0f7e7697-3f37-427d-8fe1-1d84889ab074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd923b09-9a4a-4371-8e4e-044fd3787b72", "name": "network-vif-deleted", "tag": "b5da264d-bc7c-4452-b54d-69a739e13c9f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:05.699795 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:05.699795 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:13:05.706724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c4da1396-4f4f-447d-acec-af220d59737e req-0f7e7697-3f37-427d-8fe1-1d84889ab074 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.707180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c4da1396-4f4f-447d-acec-af220d59737e req-0f7e7697-3f37-427d-8fe1-1d84889ab074 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.719157 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-c4da1396-4f4f-447d-acec-af220d59737e req-0f7e7697-3f37-427d-8fe1-1d84889ab074 service nova] Creating event network-vif-deleted:b5da264d-bc7c-4452-b54d-69a739e13c9f for instance dd923b09-9a4a-4371-8e4e-044fd3787b72 on nch2-master-1 Jan 22 21:13:05.724323 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-c4da1396-4f4f-447d-acec-af220d59737e req-0f7e7697-3f37-427d-8fe1-1d84889ab074 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030185 Jan 22 21:13:05.728231 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2305/4431] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:05.811001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-22eb6551-7902-4029-844e-744e06ff5655 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:05.811615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-22eb6551-7902-4029-844e-744e06ff5655 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:05.818413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22eb6551-7902-4029-844e-744e06ff5655 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.818863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22eb6551-7902-4029-844e-744e06ff5655 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.819847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22eb6551-7902-4029-844e-744e06ff5655 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.820443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22eb6551-7902-4029-844e-744e06ff5655 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.900754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-66ce7859-9787-49c9-aec2-f56805083f35 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:05.901471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-66ce7859-9787-49c9-aec2-f56805083f35 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:05.907886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66ce7859-9787-49c9-aec2-f56805083f35 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.908563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66ce7859-9787-49c9-aec2-f56805083f35 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:05.909376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66ce7859-9787-49c9-aec2-f56805083f35 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:05.909979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66ce7859-9787-49c9-aec2-f56805083f35 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:06.022518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-66ce7859-9787-49c9-aec2-f56805083f35 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:06.036289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-66ce7859-9787-49c9-aec2-f56805083f35 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:06.036289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-66ce7859-9787-49c9-aec2-f56805083f35 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:06.037041 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-66ce7859-9787-49c9-aec2-f56805083f35 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.141957 Jan 22 21:13:06.037880 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2306/4432] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:05 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:13:06.092125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-83f6fb70-f2f5-4ff8-a1fb-1432d5720ec5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:06.093107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-83f6fb70-f2f5-4ff8-a1fb-1432d5720ec5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:06.107877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83f6fb70-f2f5-4ff8-a1fb-1432d5720ec5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:06.107877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83f6fb70-f2f5-4ff8-a1fb-1432d5720ec5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:06.107877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83f6fb70-f2f5-4ff8-a1fb-1432d5720ec5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:06.107877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83f6fb70-f2f5-4ff8-a1fb-1432d5720ec5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:06.179392 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-83f6fb70-f2f5-4ff8-a1fb-1432d5720ec5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.090917 Jan 22 21:13:06.187265 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2307/4433] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:06 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:06.206754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e1d77531-d22f-47bb-a306-d20f6eb77a6f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:06.212255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e1d77531-d22f-47bb-a306-d20f6eb77a6f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:06.223895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1d77531-d22f-47bb-a306-d20f6eb77a6f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:06.223895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1d77531-d22f-47bb-a306-d20f6eb77a6f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:06.236009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1d77531-d22f-47bb-a306-d20f6eb77a6f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:06.236730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1d77531-d22f-47bb-a306-d20f6eb77a6f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:06.298913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-22eb6551-7902-4029-844e-744e06ff5655 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:06.299363 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e1d77531-d22f-47bb-a306-d20f6eb77a6f tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.099164 Jan 22 21:13:06.302953 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2308/4434] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:06 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:06.310850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-22eb6551-7902-4029-844e-744e06ff5655 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:06.312478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-22eb6551-7902-4029-844e-744e06ff5655 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:06.314035 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-22eb6551-7902-4029-844e-744e06ff5655 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1409 microversion: 2.20 time: 0.506831 Jan 22 21:13:06.315630 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2127/4435] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:05 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1409 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:06.334229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e16e875d-ec6e-4c06-86b8-81b4246e099f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:06.335268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e16e875d-ec6e-4c06-86b8-81b4246e099f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:06.343120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e16e875d-ec6e-4c06-86b8-81b4246e099f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:06.343575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e16e875d-ec6e-4c06-86b8-81b4246e099f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:06.344406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e16e875d-ec6e-4c06-86b8-81b4246e099f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:06.344977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e16e875d-ec6e-4c06-86b8-81b4246e099f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:06.418367 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e16e875d-ec6e-4c06-86b8-81b4246e099f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 24555 microversion: 2.1 time: 0.089435 Jan 22 21:13:06.424927 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2309/4436] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:06 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 24555 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:06.452062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bdd84e1b-45c5-4f0d-9118-ab0a13647aa4 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:06.452062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bdd84e1b-45c5-4f0d-9118-ab0a13647aa4 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:06.455019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdd84e1b-45c5-4f0d-9118-ab0a13647aa4 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:06.455698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdd84e1b-45c5-4f0d-9118-ab0a13647aa4 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:06.457114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdd84e1b-45c5-4f0d-9118-ab0a13647aa4 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:06.457904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdd84e1b-45c5-4f0d-9118-ab0a13647aa4 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:06.685903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bbf2c1c9-4ba5-4d1b-be25-eaae72a08395 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:06.686632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bbf2c1c9-4ba5-4d1b-be25-eaae72a08395 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:06.701770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbf2c1c9-4ba5-4d1b-be25-eaae72a08395 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:06.702148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbf2c1c9-4ba5-4d1b-be25-eaae72a08395 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:06.703459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbf2c1c9-4ba5-4d1b-be25-eaae72a08395 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:06.706426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbf2c1c9-4ba5-4d1b-be25-eaae72a08395 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:06.802742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bbf2c1c9-4ba5-4d1b-be25-eaae72a08395 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:06.814357 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bbf2c1c9-4ba5-4d1b-be25-eaae72a08395 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1276 microversion: 2.1 time: 0.133343 Jan 22 21:13:06.817568 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2310/4437] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:06 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1276 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:06.824158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3659390b-e4c2-4b0a-a091-9413dc657eeb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:06.825097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3659390b-e4c2-4b0a-a091-9413dc657eeb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:06.846470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3659390b-e4c2-4b0a-a091-9413dc657eeb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:06.846470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3659390b-e4c2-4b0a-a091-9413dc657eeb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:06.846470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3659390b-e4c2-4b0a-a091-9413dc657eeb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:06.846470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3659390b-e4c2-4b0a-a091-9413dc657eeb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:06.877904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3659390b-e4c2-4b0a-a091-9413dc657eeb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:06.878375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3659390b-e4c2-4b0a-a091-9413dc657eeb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:06.878980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-3659390b-e4c2-4b0a-a091-9413dc657eeb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lazy-loading 'fault' on Instance uuid dd923b09-9a4a-4371-8e4e-044fd3787b72 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:13:06.922629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3659390b-e4c2-4b0a-a091-9413dc657eeb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8e9e562bd740e782568f539dac4744', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80dba854f5414025a0cbf8b5d6571c42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:06.930944 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3659390b-e4c2-4b0a-a091-9413dc657eeb tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 200 len: 1305 microversion: 2.1 time: 0.114350 Jan 22 21:13:06.931583 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2311/4438] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:06 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:06.964283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bdd84e1b-45c5-4f0d-9118-ab0a13647aa4 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:06.972192 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bdd84e1b-45c5-4f0d-9118-ab0a13647aa4 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 200 len: 1327 microversion: 2.1 time: 0.538591 Jan 22 21:13:06.972777 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2128/4439] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:06 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 1327 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:07.057910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e95a5a95-1f65-4fdf-8814-278ad579b641 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:07.062814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e95a5a95-1f65-4fdf-8814-278ad579b641 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:07.066158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e95a5a95-1f65-4fdf-8814-278ad579b641 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.066624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e95a5a95-1f65-4fdf-8814-278ad579b641 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.067436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e95a5a95-1f65-4fdf-8814-278ad579b641 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.067886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e95a5a95-1f65-4fdf-8814-278ad579b641 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.137065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e95a5a95-1f65-4fdf-8814-278ad579b641 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:07.145772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e95a5a95-1f65-4fdf-8814-278ad579b641 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:07.147303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e95a5a95-1f65-4fdf-8814-278ad579b641 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:07.148494 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e95a5a95-1f65-4fdf-8814-278ad579b641 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.095708 Jan 22 21:13:07.149680 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2312/4440] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:07 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:07.191522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-219e2967-e3b6-410c-b2c0-3324326ad390 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:07.192503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-219e2967-e3b6-410c-b2c0-3324326ad390 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:07.198941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-219e2967-e3b6-410c-b2c0-3324326ad390 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.199393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-219e2967-e3b6-410c-b2c0-3324326ad390 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.200442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-219e2967-e3b6-410c-b2c0-3324326ad390 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.200884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-219e2967-e3b6-410c-b2c0-3324326ad390 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.249202 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-219e2967-e3b6-410c-b2c0-3324326ad390 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.061277 Jan 22 21:13:07.250303 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2129/4441] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:07 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:07.311179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3b92d3d2-cdce-4cc9-ac16-74f0a19c529a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:07.312429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3b92d3d2-cdce-4cc9-ac16-74f0a19c529a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:07.319731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b92d3d2-cdce-4cc9-ac16-74f0a19c529a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.320191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b92d3d2-cdce-4cc9-ac16-74f0a19c529a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.321756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b92d3d2-cdce-4cc9-ac16-74f0a19c529a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.322325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b92d3d2-cdce-4cc9-ac16-74f0a19c529a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.335687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-09674de3-66f6-4fdf-9ce1-dc94aeba2c36 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:07.336513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-09674de3-66f6-4fdf-9ce1-dc94aeba2c36 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:07.344585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09674de3-66f6-4fdf-9ce1-dc94aeba2c36 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.345284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09674de3-66f6-4fdf-9ce1-dc94aeba2c36 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.346344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09674de3-66f6-4fdf-9ce1-dc94aeba2c36 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.346784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09674de3-66f6-4fdf-9ce1-dc94aeba2c36 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.377951 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3b92d3d2-cdce-4cc9-ac16-74f0a19c529a tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.067663 Jan 22 21:13:07.379720 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2313/4442] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:07 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:07.441041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d96430b7-6d10-408d-b0ce-5f9a7a585969 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:07.442183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d96430b7-6d10-408d-b0ce-5f9a7a585969 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:07.450758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96430b7-6d10-408d-b0ce-5f9a7a585969 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.451311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96430b7-6d10-408d-b0ce-5f9a7a585969 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.452194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96430b7-6d10-408d-b0ce-5f9a7a585969 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.452708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96430b7-6d10-408d-b0ce-5f9a7a585969 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.507689 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d96430b7-6d10-408d-b0ce-5f9a7a585969 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 24555 microversion: 2.1 time: 0.070599 Jan 22 21:13:07.508529 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2314/4443] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:07 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 24555 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:07.757353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-b232091a-9da3-49a6-9af1-581d3958ea3d req-9d8a4b63-91c1-4f7e-855f-935c104d5657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8288fe26-7e9c-451c-a9a2-222abbcf201e", "tag": "92a02346-3106-4ce0-82fd-0bae77d72810"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:07.759327 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:07.759327 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:13:07.768147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b232091a-9da3-49a6-9af1-581d3958ea3d req-9d8a4b63-91c1-4f7e-855f-935c104d5657 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.768597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b232091a-9da3-49a6-9af1-581d3958ea3d req-9d8a4b63-91c1-4f7e-855f-935c104d5657 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.780031 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-b232091a-9da3-49a6-9af1-581d3958ea3d req-9d8a4b63-91c1-4f7e-855f-935c104d5657 service nova] Creating event network-changed:92a02346-3106-4ce0-82fd-0bae77d72810 for instance 8288fe26-7e9c-451c-a9a2-222abbcf201e on nch2-master-1 Jan 22 21:13:07.785282 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-b232091a-9da3-49a6-9af1-581d3958ea3d req-9d8a4b63-91c1-4f7e-855f-935c104d5657 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032135 Jan 22 21:13:07.786166 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2315/4444] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:07.833210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4c48d44d-843a-4dd6-a449-3fa7e5b5c27a tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:07.834081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4c48d44d-843a-4dd6-a449-3fa7e5b5c27a tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:07.840771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c48d44d-843a-4dd6-a449-3fa7e5b5c27a tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.841269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c48d44d-843a-4dd6-a449-3fa7e5b5c27a tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.842109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c48d44d-843a-4dd6-a449-3fa7e5b5c27a tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.842579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c48d44d-843a-4dd6-a449-3fa7e5b5c27a tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.909772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4c48d44d-843a-4dd6-a449-3fa7e5b5c27a tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:07.918166 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4c48d44d-843a-4dd6-a449-3fa7e5b5c27a tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1276 microversion: 2.1 time: 0.089384 Jan 22 21:13:07.918875 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2316/4445] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:07 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:07.948090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-461cea7d-3710-4479-8cc8-55b98bfdb8f1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:07.948755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-461cea7d-3710-4479-8cc8-55b98bfdb8f1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] [instance: dd923b09-9a4a-4371-8e4e-044fd3787b72] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:07.955603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-461cea7d-3710-4479-8cc8-55b98bfdb8f1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.958404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-461cea7d-3710-4479-8cc8-55b98bfdb8f1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.958404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-461cea7d-3710-4479-8cc8-55b98bfdb8f1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.958404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-461cea7d-3710-4479-8cc8-55b98bfdb8f1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.972920 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-461cea7d-3710-4479-8cc8-55b98bfdb8f1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] HTTP exception thrown: Instance dd923b09-9a4a-4371-8e4e-044fd3787b72 could not be found. Jan 22 21:13:07.973548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-461cea7d-3710-4479-8cc8-55b98bfdb8f1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] Returning 404 to user: Instance dd923b09-9a4a-4371-8e4e-044fd3787b72 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:13:07.974393 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-461cea7d-3710-4479-8cc8-55b98bfdb8f1 tempest-MigrationsAdminTest-532065111 tempest-MigrationsAdminTest-532065111-project] 10.222.0.100 "GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72" status: 404 len: 111 microversion: 2.1 time: 0.030372 Jan 22 21:13:07.974964 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2317/4446] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:07 2022] GET /compute/v2.1/servers/dd923b09-9a4a-4371-8e4e-044fd3787b72 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:13:07.989849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f722e0d9-c5d1-416b-bea0-87a9caa513be tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:07.990714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f722e0d9-c5d1-416b-bea0-87a9caa513be tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:07.998316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f722e0d9-c5d1-416b-bea0-87a9caa513be tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:07.998717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f722e0d9-c5d1-416b-bea0-87a9caa513be tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:07.999721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f722e0d9-c5d1-416b-bea0-87a9caa513be tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:08.000180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f722e0d9-c5d1-416b-bea0-87a9caa513be tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:08.140092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-09674de3-66f6-4fdf-9ce1-dc94aeba2c36 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:08.148652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-09674de3-66f6-4fdf-9ce1-dc94aeba2c36 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:08.150460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-09674de3-66f6-4fdf-9ce1-dc94aeba2c36 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:08.151895 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-09674de3-66f6-4fdf-9ce1-dc94aeba2c36 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1409 microversion: 2.20 time: 0.820672 Jan 22 21:13:08.154043 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2130/4447] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:07 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1409 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:13:08.170935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-433427df-ebd5-4993-8105-c634f80674fc tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:08.171886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-433427df-ebd5-4993-8105-c634f80674fc tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:08.183860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-433427df-ebd5-4993-8105-c634f80674fc tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:08.184682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-433427df-ebd5-4993-8105-c634f80674fc tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:08.185798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-433427df-ebd5-4993-8105-c634f80674fc tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:08.186446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-433427df-ebd5-4993-8105-c634f80674fc tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:08.201794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f722e0d9-c5d1-416b-bea0-87a9caa513be tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:08.211796 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f722e0d9-c5d1-416b-bea0-87a9caa513be tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 200 len: 1327 microversion: 2.1 time: 0.225760 Jan 22 21:13:08.212927 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2318/4448] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:07 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 1327 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:08.262218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7701d12e-4ed7-4772-b97c-1fb1d71f9420 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:08.263235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7701d12e-4ed7-4772-b97c-1fb1d71f9420 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:08.269717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7701d12e-4ed7-4772-b97c-1fb1d71f9420 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:08.270330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7701d12e-4ed7-4772-b97c-1fb1d71f9420 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:08.271203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7701d12e-4ed7-4772-b97c-1fb1d71f9420 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:08.271717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7701d12e-4ed7-4772-b97c-1fb1d71f9420 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:08.315863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-433427df-ebd5-4993-8105-c634f80674fc tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:08.317977 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7701d12e-4ed7-4772-b97c-1fb1d71f9420 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.060487 Jan 22 21:13:08.321557 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2319/4449] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:08 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:08.328483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-433427df-ebd5-4993-8105-c634f80674fc tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:08.330145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-433427df-ebd5-4993-8105-c634f80674fc tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:08.331456 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-433427df-ebd5-4993-8105-c634f80674fc tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.165561 Jan 22 21:13:08.332189 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2131/4450] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:08 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:08.389479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-34d3767c-a2c6-4d64-b886-26a7c75e7df2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:08.391052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-34d3767c-a2c6-4d64-b886-26a7c75e7df2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:08.400439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34d3767c-a2c6-4d64-b886-26a7c75e7df2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:08.400969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34d3767c-a2c6-4d64-b886-26a7c75e7df2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:08.401943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34d3767c-a2c6-4d64-b886-26a7c75e7df2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:08.402391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34d3767c-a2c6-4d64-b886-26a7c75e7df2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:08.457096 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-34d3767c-a2c6-4d64-b886-26a7c75e7df2 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.073432 Jan 22 21:13:08.461271 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2320/4451] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:08 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:08.519710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-315002e9-1fe3-4a9b-a44d-16bd3ebb53a9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:08.520918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-315002e9-1fe3-4a9b-a44d-16bd3ebb53a9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:08.532285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-315002e9-1fe3-4a9b-a44d-16bd3ebb53a9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:08.532917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-315002e9-1fe3-4a9b-a44d-16bd3ebb53a9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:08.534188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-315002e9-1fe3-4a9b-a44d-16bd3ebb53a9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:08.534778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-315002e9-1fe3-4a9b-a44d-16bd3ebb53a9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:08.582290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-315002e9-1fe3-4a9b-a44d-16bd3ebb53a9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 24555 microversion: 2.1 time: 0.066723 Jan 22 21:13:08.583371 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2132/4452] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:08 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 24555 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:08.936338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4110a745-55d4-4bf1-a8c1-b952c171d545 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:08.937048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4110a745-55d4-4bf1-a8c1-b952c171d545 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:08.960618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4110a745-55d4-4bf1-a8c1-b952c171d545 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:08.961848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4110a745-55d4-4bf1-a8c1-b952c171d545 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:08.964252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4110a745-55d4-4bf1-a8c1-b952c171d545 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:08.966047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4110a745-55d4-4bf1-a8c1-b952c171d545 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:09.120695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4110a745-55d4-4bf1-a8c1-b952c171d545 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:09.129107 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4110a745-55d4-4bf1-a8c1-b952c171d545 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1318 microversion: 2.1 time: 0.196916 Jan 22 21:13:09.130014 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2321/4453] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:08 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:09.173381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8cae97df-a0fc-41aa-9f36-c1b7c9e99c3d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:09.174293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8cae97df-a0fc-41aa-9f36-c1b7c9e99c3d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:09.182447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cae97df-a0fc-41aa-9f36-c1b7c9e99c3d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:09.182895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cae97df-a0fc-41aa-9f36-c1b7c9e99c3d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:09.183963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cae97df-a0fc-41aa-9f36-c1b7c9e99c3d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:09.184405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cae97df-a0fc-41aa-9f36-c1b7c9e99c3d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:09.228590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f228f19-552e-42bc-a9b1-3a1bd0d1ee57 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:09.229207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f228f19-552e-42bc-a9b1-3a1bd0d1ee57 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:09.235792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f228f19-552e-42bc-a9b1-3a1bd0d1ee57 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:09.236247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f228f19-552e-42bc-a9b1-3a1bd0d1ee57 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:09.237139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f228f19-552e-42bc-a9b1-3a1bd0d1ee57 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:09.237472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f228f19-552e-42bc-a9b1-3a1bd0d1ee57 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:09.396951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5f228f19-552e-42bc-a9b1-3a1bd0d1ee57 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:09.405209 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f228f19-552e-42bc-a9b1-3a1bd0d1ee57 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 200 len: 1327 microversion: 2.1 time: 0.180924 Jan 22 21:13:09.405832 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2322/4454] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:09 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 1327 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:09.414779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5bbc2449-2b16-45da-96f9-89afc06a4c1f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:09.415778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5bbc2449-2b16-45da-96f9-89afc06a4c1f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:09.422078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bbc2449-2b16-45da-96f9-89afc06a4c1f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:09.422543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bbc2449-2b16-45da-96f9-89afc06a4c1f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:09.423359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bbc2449-2b16-45da-96f9-89afc06a4c1f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:09.423807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bbc2449-2b16-45da-96f9-89afc06a4c1f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:09.466078 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5bbc2449-2b16-45da-96f9-89afc06a4c1f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.058868 Jan 22 21:13:09.466995 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2323/4455] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:09 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:09.472039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c3881079-f64d-46c8-90fc-0930fab89f98 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:09.472743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c3881079-f64d-46c8-90fc-0930fab89f98 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:09.480419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3881079-f64d-46c8-90fc-0930fab89f98 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:09.480884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3881079-f64d-46c8-90fc-0930fab89f98 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:09.481729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3881079-f64d-46c8-90fc-0930fab89f98 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:09.482182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3881079-f64d-46c8-90fc-0930fab89f98 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:09.508716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8cae97df-a0fc-41aa-9f36-c1b7c9e99c3d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:09.517632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8cae97df-a0fc-41aa-9f36-c1b7c9e99c3d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:09.519325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8cae97df-a0fc-41aa-9f36-c1b7c9e99c3d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:09.520558 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8cae97df-a0fc-41aa-9f36-c1b7c9e99c3d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1409 microversion: 2.20 time: 0.351720 Jan 22 21:13:09.521206 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2133/4456] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:09 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1409 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:09.526700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ab371e1-f6f4-40b9-8438-dbf046fb7382 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:09.529899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3ab371e1-f6f4-40b9-8438-dbf046fb7382 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:09.536476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ab371e1-f6f4-40b9-8438-dbf046fb7382 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:09.537065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ab371e1-f6f4-40b9-8438-dbf046fb7382 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:09.538458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ab371e1-f6f4-40b9-8438-dbf046fb7382 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:09.538908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ab371e1-f6f4-40b9-8438-dbf046fb7382 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:09.558830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c3881079-f64d-46c8-90fc-0930fab89f98 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:09.571544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c3881079-f64d-46c8-90fc-0930fab89f98 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:09.573770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c3881079-f64d-46c8-90fc-0930fab89f98 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:09.576008 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c3881079-f64d-46c8-90fc-0930fab89f98 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.107829 Jan 22 21:13:09.576584 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2324/4457] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:09 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:09.594984 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3ab371e1-f6f4-40b9-8438-dbf046fb7382 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.072135 Jan 22 21:13:09.595242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fcd90d02-170c-4f94-8bf2-2ef05a89fe25 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:09.596181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fcd90d02-170c-4f94-8bf2-2ef05a89fe25 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:09.596652 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2134/4458] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:09 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:09.603352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcd90d02-170c-4f94-8bf2-2ef05a89fe25 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:09.604047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcd90d02-170c-4f94-8bf2-2ef05a89fe25 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:09.604911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcd90d02-170c-4f94-8bf2-2ef05a89fe25 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:09.605369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcd90d02-170c-4f94-8bf2-2ef05a89fe25 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:09.647386 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fcd90d02-170c-4f94-8bf2-2ef05a89fe25 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 24555 microversion: 2.1 time: 0.055911 Jan 22 21:13:09.648475 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2325/4459] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:09 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 24555 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:09.818753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-66ee0705-bf77-473a-aff6-fecddf52bfa4 req-00e12e8c-d662-4043-948f-6b4b099f3c08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a142f83a-c576-4972-a9f4-0d2e8ac5d0d5", "tag": "47e5ddad-21d0-45de-bfef-390954745b7c"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:09.818753 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:09.818753 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:13:09.820945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-66ee0705-bf77-473a-aff6-fecddf52bfa4 req-00e12e8c-d662-4043-948f-6b4b099f3c08 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:09.821610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-66ee0705-bf77-473a-aff6-fecddf52bfa4 req-00e12e8c-d662-4043-948f-6b4b099f3c08 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:09.834969 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-66ee0705-bf77-473a-aff6-fecddf52bfa4 req-00e12e8c-d662-4043-948f-6b4b099f3c08 service nova] Creating event network-changed:47e5ddad-21d0-45de-bfef-390954745b7c for instance a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 on nch1-master-1 Jan 22 21:13:09.840638 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-66ee0705-bf77-473a-aff6-fecddf52bfa4 req-00e12e8c-d662-4043-948f-6b4b099f3c08 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041351 Jan 22 21:13:09.841323 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2135/4460] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:10.147569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7e688a19-19ea-4eb3-bba8-c883e40c96b9 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:10.148278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7e688a19-19ea-4eb3-bba8-c883e40c96b9 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:10.158702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e688a19-19ea-4eb3-bba8-c883e40c96b9 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:10.158702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e688a19-19ea-4eb3-bba8-c883e40c96b9 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:10.158702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e688a19-19ea-4eb3-bba8-c883e40c96b9 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:10.158702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e688a19-19ea-4eb3-bba8-c883e40c96b9 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:10.301371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7e688a19-19ea-4eb3-bba8-c883e40c96b9 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:10.310108 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7e688a19-19ea-4eb3-bba8-c883e40c96b9 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1318 microversion: 2.1 time: 0.166637 Jan 22 21:13:10.311071 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2326/4461] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:10 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:10.423587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-948948a5-4523-43a1-ae56-bacff303fe5c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:10.424288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-948948a5-4523-43a1-ae56-bacff303fe5c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:10.430778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-948948a5-4523-43a1-ae56-bacff303fe5c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:10.431502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-948948a5-4523-43a1-ae56-bacff303fe5c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:10.432362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-948948a5-4523-43a1-ae56-bacff303fe5c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:10.432976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-948948a5-4523-43a1-ae56-bacff303fe5c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:10.479966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-496bf155-fb26-4fbc-a344-682f15f6219e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:10.480673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-496bf155-fb26-4fbc-a344-682f15f6219e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:10.487315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-496bf155-fb26-4fbc-a344-682f15f6219e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:10.487780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-496bf155-fb26-4fbc-a344-682f15f6219e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:10.488597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-496bf155-fb26-4fbc-a344-682f15f6219e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:10.489299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-496bf155-fb26-4fbc-a344-682f15f6219e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:10.532563 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-496bf155-fb26-4fbc-a344-682f15f6219e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.058674 Jan 22 21:13:10.534006 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2327/4462] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:10 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:10.543048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-526c5884-dd8f-40ac-9aa2-cfdc7100bfda tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:10.544420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-526c5884-dd8f-40ac-9aa2-cfdc7100bfda tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:10.553213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-526c5884-dd8f-40ac-9aa2-cfdc7100bfda tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:10.556811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-526c5884-dd8f-40ac-9aa2-cfdc7100bfda tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:10.556811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-526c5884-dd8f-40ac-9aa2-cfdc7100bfda tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:10.556811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-526c5884-dd8f-40ac-9aa2-cfdc7100bfda tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:10.715001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-526c5884-dd8f-40ac-9aa2-cfdc7100bfda tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:10.724084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-526c5884-dd8f-40ac-9aa2-cfdc7100bfda tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:10.725738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-526c5884-dd8f-40ac-9aa2-cfdc7100bfda tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:10.727237 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-526c5884-dd8f-40ac-9aa2-cfdc7100bfda tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1409 microversion: 2.20 time: 0.192340 Jan 22 21:13:10.728115 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2328/4463] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:10 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1409 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:10.733119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3dca4a08-1f2f-4b29-b5ae-bfda47baa93e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:10.734339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3dca4a08-1f2f-4b29-b5ae-bfda47baa93e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:10.742698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dca4a08-1f2f-4b29-b5ae-bfda47baa93e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:10.743547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dca4a08-1f2f-4b29-b5ae-bfda47baa93e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:10.744766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dca4a08-1f2f-4b29-b5ae-bfda47baa93e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:10.749671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dca4a08-1f2f-4b29-b5ae-bfda47baa93e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:10.793316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-948948a5-4523-43a1-ae56-bacff303fe5c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:10.802806 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-948948a5-4523-43a1-ae56-bacff303fe5c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 200 len: 1327 microversion: 2.1 time: 0.383936 Jan 22 21:13:10.803533 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2136/4464] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:10 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 1327 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:10.809850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-14e940e7-9cc8-4c62-8c25-1c4d506c3363 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:10.810894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-14e940e7-9cc8-4c62-8c25-1c4d506c3363 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:10.817648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14e940e7-9cc8-4c62-8c25-1c4d506c3363 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:10.818217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14e940e7-9cc8-4c62-8c25-1c4d506c3363 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:10.819149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14e940e7-9cc8-4c62-8c25-1c4d506c3363 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:10.819691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14e940e7-9cc8-4c62-8c25-1c4d506c3363 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:10.825369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3dca4a08-1f2f-4b29-b5ae-bfda47baa93e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:10.847293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3dca4a08-1f2f-4b29-b5ae-bfda47baa93e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:10.847293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3dca4a08-1f2f-4b29-b5ae-bfda47baa93e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:10.847293 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3dca4a08-1f2f-4b29-b5ae-bfda47baa93e tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.107560 Jan 22 21:13:10.847293 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2329/4465] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:10 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:10.847293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-94cc54ff-bb96-4294-b021-6d520d0388b9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:10.847293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-94cc54ff-bb96-4294-b021-6d520d0388b9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:10.848916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94cc54ff-bb96-4294-b021-6d520d0388b9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:10.849360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94cc54ff-bb96-4294-b021-6d520d0388b9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:10.850319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94cc54ff-bb96-4294-b021-6d520d0388b9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:10.850765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94cc54ff-bb96-4294-b021-6d520d0388b9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:10.881261 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-14e940e7-9cc8-4c62-8c25-1c4d506c3363 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.076395 Jan 22 21:13:10.885667 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2137/4466] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:10 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:10.893353 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-94cc54ff-bb96-4294-b021-6d520d0388b9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 24555 microversion: 2.1 time: 0.054724 Jan 22 21:13:10.894196 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2330/4467] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:10 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 24555 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:11.329019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-15cc0548-bb4f-4aa9-8419-ccb800be3a2c tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:11.329764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-15cc0548-bb4f-4aa9-8419-ccb800be3a2c tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:11.336819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15cc0548-bb4f-4aa9-8419-ccb800be3a2c tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:11.337278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15cc0548-bb4f-4aa9-8419-ccb800be3a2c tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:11.338105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15cc0548-bb4f-4aa9-8419-ccb800be3a2c tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:11.338552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15cc0548-bb4f-4aa9-8419-ccb800be3a2c tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:11.482765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-15cc0548-bb4f-4aa9-8419-ccb800be3a2c tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:11.490265 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-15cc0548-bb4f-4aa9-8419-ccb800be3a2c tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1318 microversion: 2.1 time: 0.165602 Jan 22 21:13:11.490828 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2138/4468] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:11 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:11.545530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ba12f751-c397-4a81-940c-dd42f2a3476b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:11.547270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ba12f751-c397-4a81-940c-dd42f2a3476b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:11.555600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba12f751-c397-4a81-940c-dd42f2a3476b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:11.556200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba12f751-c397-4a81-940c-dd42f2a3476b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:11.557043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba12f751-c397-4a81-940c-dd42f2a3476b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:11.557486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba12f751-c397-4a81-940c-dd42f2a3476b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:11.601245 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ba12f751-c397-4a81-940c-dd42f2a3476b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.059512 Jan 22 21:13:11.605364 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2331/4469] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:11 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:11.745135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-39ae10f4-fe02-40c3-af4c-eef4c562ce1c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:11.750049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-39ae10f4-fe02-40c3-af4c-eef4c562ce1c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:11.752352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39ae10f4-fe02-40c3-af4c-eef4c562ce1c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:11.752848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39ae10f4-fe02-40c3-af4c-eef4c562ce1c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:11.753680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39ae10f4-fe02-40c3-af4c-eef4c562ce1c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:11.754124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39ae10f4-fe02-40c3-af4c-eef4c562ce1c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:11.822653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4acfe85a-7ab5-4518-98c7-b8dbd9cf99cc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:11.823362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4acfe85a-7ab5-4518-98c7-b8dbd9cf99cc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:11.833874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4acfe85a-7ab5-4518-98c7-b8dbd9cf99cc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:11.834553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4acfe85a-7ab5-4518-98c7-b8dbd9cf99cc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:11.836531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4acfe85a-7ab5-4518-98c7-b8dbd9cf99cc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:11.837247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4acfe85a-7ab5-4518-98c7-b8dbd9cf99cc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:11.910824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-39ae10f4-fe02-40c3-af4c-eef4c562ce1c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:11.920857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-39ae10f4-fe02-40c3-af4c-eef4c562ce1c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:11.923929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-39ae10f4-fe02-40c3-af4c-eef4c562ce1c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:11.925306 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-39ae10f4-fe02-40c3-af4c-eef4c562ce1c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1409 microversion: 2.20 time: 0.184003 Jan 22 21:13:11.926672 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2139/4470] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:11 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1409 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:11.933324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-17c8b6a5-cf88-4d36-a5f4-05bc4707eec8 req-cd249429-b98d-47ec-ac1f-7f880ec29786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9918df-8a8e-48ab-a9a2-05922a783d69", "tag": "006b8beb-7ced-4e60-b992-5ea57c4c79d1"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:11.935019 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:11.935019 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:13:11.942540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-17c8b6a5-cf88-4d36-a5f4-05bc4707eec8 req-cd249429-b98d-47ec-ac1f-7f880ec29786 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:11.943091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-17c8b6a5-cf88-4d36-a5f4-05bc4707eec8 req-cd249429-b98d-47ec-ac1f-7f880ec29786 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:11.956286 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-17c8b6a5-cf88-4d36-a5f4-05bc4707eec8 req-cd249429-b98d-47ec-ac1f-7f880ec29786 service nova] Creating event network-changed:006b8beb-7ced-4e60-b992-5ea57c4c79d1 for instance bf9918df-8a8e-48ab-a9a2-05922a783d69 on nch1-master-1 Jan 22 21:13:11.961789 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-17c8b6a5-cf88-4d36-a5f4-05bc4707eec8 req-cd249429-b98d-47ec-ac1f-7f880ec29786 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033479 Jan 22 21:13:11.962846 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2140/4471] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:11.971453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-21e5bd0f-4c1b-433e-be49-ac1abe71812f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:11.972233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-21e5bd0f-4c1b-433e-be49-ac1abe71812f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:11.979538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21e5bd0f-4c1b-433e-be49-ac1abe71812f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:11.980330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21e5bd0f-4c1b-433e-be49-ac1abe71812f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:11.981372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21e5bd0f-4c1b-433e-be49-ac1abe71812f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:11.982029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21e5bd0f-4c1b-433e-be49-ac1abe71812f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:12.071894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4acfe85a-7ab5-4518-98c7-b8dbd9cf99cc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:12.076918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-21e5bd0f-4c1b-433e-be49-ac1abe71812f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:12.086904 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4acfe85a-7ab5-4518-98c7-b8dbd9cf99cc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 200 len: 1327 microversion: 2.1 time: 0.268528 Jan 22 21:13:12.089231 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2332/4472] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:11 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 1327 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:12.090080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-21e5bd0f-4c1b-433e-be49-ac1abe71812f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:12.091524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-21e5bd0f-4c1b-433e-be49-ac1abe71812f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:12.092850 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-21e5bd0f-4c1b-433e-be49-ac1abe71812f tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.125889 Jan 22 21:13:12.097478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b5502911-4fb0-4f57-bff7-8611efc2e6f1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:12.098623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b5502911-4fb0-4f57-bff7-8611efc2e6f1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:12.104840 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2141/4473] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:11 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:12.109977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b5502911-4fb0-4f57-bff7-8611efc2e6f1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:12.109977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b5502911-4fb0-4f57-bff7-8611efc2e6f1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:12.109977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b5502911-4fb0-4f57-bff7-8611efc2e6f1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:12.109977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b5502911-4fb0-4f57-bff7-8611efc2e6f1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:12.110463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fa6af60d-7d00-44fe-8282-5153b10ec22c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:12.110651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fa6af60d-7d00-44fe-8282-5153b10ec22c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:12.118699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa6af60d-7d00-44fe-8282-5153b10ec22c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:12.119155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa6af60d-7d00-44fe-8282-5153b10ec22c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:12.120154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa6af60d-7d00-44fe-8282-5153b10ec22c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:12.120600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa6af60d-7d00-44fe-8282-5153b10ec22c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:12.152471 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b5502911-4fb0-4f57-bff7-8611efc2e6f1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.063368 Jan 22 21:13:12.153551 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2333/4474] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:12 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:12.161291 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fa6af60d-7d00-44fe-8282-5153b10ec22c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 24555 microversion: 2.1 time: 0.054941 Jan 22 21:13:12.162215 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2142/4475] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:12 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 24555 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:12.362397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4fa03951-8261-473d-a0c2-f1b99faa2d7a tempest-SecurityGroupsTestAdminJSON-1369527049 tempest-SecurityGroupsTestAdminJSON-1369527049-project] Action: 'create', calling method: .version_select at 0x7f1ed636e550>, body: {"security_group": {"name": "tempest-securitygroup-1355557898", "description": "tempest-description-949820276"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:12.512591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b80fa3d5-5bd8-48bd-8b8c-0a7c695e8439 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:12.513486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b80fa3d5-5bd8-48bd-8b8c-0a7c695e8439 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:12.521098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b80fa3d5-5bd8-48bd-8b8c-0a7c695e8439 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:12.521663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b80fa3d5-5bd8-48bd-8b8c-0a7c695e8439 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:12.522519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b80fa3d5-5bd8-48bd-8b8c-0a7c695e8439 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:12.523048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b80fa3d5-5bd8-48bd-8b8c-0a7c695e8439 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:12.799702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b80fa3d5-5bd8-48bd-8b8c-0a7c695e8439 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:12.807948 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b80fa3d5-5bd8-48bd-8b8c-0a7c695e8439 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1318 microversion: 2.1 time: 0.299730 Jan 22 21:13:12.817533 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2143/4476] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:12 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:12.825594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b3d7a98-9162-48ad-a54d-e89c058c8d45 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:12.826742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4b3d7a98-9162-48ad-a54d-e89c058c8d45 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:12.833790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b3d7a98-9162-48ad-a54d-e89c058c8d45 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:12.834509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b3d7a98-9162-48ad-a54d-e89c058c8d45 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:12.835699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b3d7a98-9162-48ad-a54d-e89c058c8d45 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:12.843816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b3d7a98-9162-48ad-a54d-e89c058c8d45 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:12.884206 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b3d7a98-9162-48ad-a54d-e89c058c8d45 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.064024 Jan 22 21:13:12.888744 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2144/4477] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:12 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:12.950784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f72690d4-67de-4e7b-bb1a-e6689c4a2841 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:12.953152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f72690d4-67de-4e7b-bb1a-e6689c4a2841 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:12.965123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f72690d4-67de-4e7b-bb1a-e6689c4a2841 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:12.965629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f72690d4-67de-4e7b-bb1a-e6689c4a2841 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:12.967052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f72690d4-67de-4e7b-bb1a-e6689c4a2841 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:12.968422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f72690d4-67de-4e7b-bb1a-e6689c4a2841 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:13.050046 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4fa03951-8261-473d-a0c2-f1b99faa2d7a tempest-SecurityGroupsTestAdminJSON-1369527049 tempest-SecurityGroupsTestAdminJSON-1369527049-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.895273 Jan 22 21:13:13.050600 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2334/4478] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:13:12 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:13.062007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-31e660f8-7107-4e9b-abfe-45848e9088d0 tempest-SecurityGroupsTestAdminJSON-1369527049 tempest-SecurityGroupsTestAdminJSON-1369527049-project] Action: 'create', calling method: .version_select at 0x7f1ed61d8ee0>, body: {"security_group": {"name": "tempest-securitygroup-768785078", "description": "tempest-description-1137078308"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:13.120970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f72690d4-67de-4e7b-bb1a-e6689c4a2841 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:13.129022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f72690d4-67de-4e7b-bb1a-e6689c4a2841 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:13.130561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f72690d4-67de-4e7b-bb1a-e6689c4a2841 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:13.131664 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f72690d4-67de-4e7b-bb1a-e6689c4a2841 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1409 microversion: 2.20 time: 0.187491 Jan 22 21:13:13.134731 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2145/4479] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:12 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1409 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:13:13.137171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a105e053-0cbc-44c3-8cc6-2179842d5db0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:13.137795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a105e053-0cbc-44c3-8cc6-2179842d5db0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:13.143382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a105e053-0cbc-44c3-8cc6-2179842d5db0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:13.143839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a105e053-0cbc-44c3-8cc6-2179842d5db0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:13.144617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a105e053-0cbc-44c3-8cc6-2179842d5db0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:13.145058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a105e053-0cbc-44c3-8cc6-2179842d5db0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:13.289053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a105e053-0cbc-44c3-8cc6-2179842d5db0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:13.302097 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a105e053-0cbc-44c3-8cc6-2179842d5db0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 200 len: 1327 microversion: 2.1 time: 0.163945 Jan 22 21:13:13.302097 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2146/4480] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:13 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 1327 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:13.302365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-73ed2f52-d330-474c-a1d5-f9024037d7b0 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:13.302839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-73ed2f52-d330-474c-a1d5-f9024037d7b0 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:13.309462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73ed2f52-d330-474c-a1d5-f9024037d7b0 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:13.309953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73ed2f52-d330-474c-a1d5-f9024037d7b0 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:13.312057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73ed2f52-d330-474c-a1d5-f9024037d7b0 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:13.312511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73ed2f52-d330-474c-a1d5-f9024037d7b0 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:13.389861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-73ed2f52-d330-474c-a1d5-f9024037d7b0 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:13.403352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-73ed2f52-d330-474c-a1d5-f9024037d7b0 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:13.405533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-73ed2f52-d330-474c-a1d5-f9024037d7b0 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:13.406163 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-73ed2f52-d330-474c-a1d5-f9024037d7b0 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.107432 Jan 22 21:13:13.406730 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2147/4481] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:13 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:13.411115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1105ab08-489d-4cb0-95f0-180fecf4b667 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:13.412122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1105ab08-489d-4cb0-95f0-180fecf4b667 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:13.417961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1105ab08-489d-4cb0-95f0-180fecf4b667 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:13.418420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1105ab08-489d-4cb0-95f0-180fecf4b667 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:13.419206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1105ab08-489d-4cb0-95f0-180fecf4b667 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:13.419654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1105ab08-489d-4cb0-95f0-180fecf4b667 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:13.461665 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1105ab08-489d-4cb0-95f0-180fecf4b667 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.053652 Jan 22 21:13:13.465666 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2148/4482] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:13 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:13.467177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b8ff90db-c44c-4dd7-be47-ab880ecb672d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:13.468165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b8ff90db-c44c-4dd7-be47-ab880ecb672d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:13.475114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8ff90db-c44c-4dd7-be47-ab880ecb672d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:13.475609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8ff90db-c44c-4dd7-be47-ab880ecb672d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:13.476402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8ff90db-c44c-4dd7-be47-ab880ecb672d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:13.477478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8ff90db-c44c-4dd7-be47-ab880ecb672d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:13.495488 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-31e660f8-7107-4e9b-abfe-45848e9088d0 tempest-SecurityGroupsTestAdminJSON-1369527049 tempest-SecurityGroupsTestAdminJSON-1369527049-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.435984 Jan 22 21:13:13.495488 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2335/4483] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:13:13 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:13.517301 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b8ff90db-c44c-4dd7-be47-ab880ecb672d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 24555 microversion: 2.1 time: 0.053612 Jan 22 21:13:13.518085 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2149/4484] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:13 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 24555 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:13.557777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fa4c8836-0f71-4e60-9b5b-b5d54bd38d6e tempest-SecurityGroupsTestAdminJSON-260834476 tempest-SecurityGroupsTestAdminJSON-260834476-project-admin] Action: 'create', calling method: .version_select at 0x7f1ed601aaf0>, body: {"security_group": {"name": "tempest-securitygroup-1789947057", "description": "tempest-description-680103097"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:13.825049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-16da37c7-5435-44a7-9562-09c59e1237c0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:13.829902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-16da37c7-5435-44a7-9562-09c59e1237c0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:13.833050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16da37c7-5435-44a7-9562-09c59e1237c0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:13.833524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16da37c7-5435-44a7-9562-09c59e1237c0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:13.834333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16da37c7-5435-44a7-9562-09c59e1237c0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:13.834780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16da37c7-5435-44a7-9562-09c59e1237c0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:13.978218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-16da37c7-5435-44a7-9562-09c59e1237c0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:13.987851 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-16da37c7-5435-44a7-9562-09c59e1237c0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1318 microversion: 2.1 time: 0.165199 Jan 22 21:13:13.987851 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2150/4485] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:13 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:13.991549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5bd65607-b47e-4fd9-a448-29a2a0dd29d0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:13.992622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5bd65607-b47e-4fd9-a448-29a2a0dd29d0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:13.999384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bd65607-b47e-4fd9-a448-29a2a0dd29d0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:13.999835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bd65607-b47e-4fd9-a448-29a2a0dd29d0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:14.000758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bd65607-b47e-4fd9-a448-29a2a0dd29d0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:14.001190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bd65607-b47e-4fd9-a448-29a2a0dd29d0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:14.045258 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5bd65607-b47e-4fd9-a448-29a2a0dd29d0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.057652 Jan 22 21:13:14.046184 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2151/4486] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:13 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:14.075147 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fa4c8836-0f71-4e60-9b5b-b5d54bd38d6e tempest-SecurityGroupsTestAdminJSON-260834476 tempest-SecurityGroupsTestAdminJSON-260834476-project-admin] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.569071 Jan 22 21:13:14.075147 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2336/4487] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:13:13 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:13:14.085397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f4bb5ed0-2751-44f9-8402-b677695f5b60 tempest-SecurityGroupsTestAdminJSON-260834476 tempest-SecurityGroupsTestAdminJSON-260834476-project-admin] Action: 'create', calling method: .version_select at 0x7f1ed4f59430>, body: {"security_group": {"name": "tempest-securitygroup-23735767", "description": "tempest-description-751067247"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:14.150136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4f880c00-c373-4c2f-a798-e44c253d54d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:14.150863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4f880c00-c373-4c2f-a798-e44c253d54d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:14.157990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f880c00-c373-4c2f-a798-e44c253d54d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:14.158449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f880c00-c373-4c2f-a798-e44c253d54d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:14.159235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f880c00-c373-4c2f-a798-e44c253d54d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:14.159679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f880c00-c373-4c2f-a798-e44c253d54d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:14.302319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4f880c00-c373-4c2f-a798-e44c253d54d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:14.312051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4f880c00-c373-4c2f-a798-e44c253d54d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:14.313773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4f880c00-c373-4c2f-a798-e44c253d54d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:14.314949 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4f880c00-c373-4c2f-a798-e44c253d54d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1409 microversion: 2.20 time: 0.169217 Jan 22 21:13:14.315649 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2337/4488] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:14 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1409 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:13:14.320991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fca85184-f634-42dd-9968-e4210d969c41 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:14.321131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fca85184-f634-42dd-9968-e4210d969c41 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:14.327793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fca85184-f634-42dd-9968-e4210d969c41 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:14.328208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fca85184-f634-42dd-9968-e4210d969c41 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:14.329017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fca85184-f634-42dd-9968-e4210d969c41 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:14.329474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fca85184-f634-42dd-9968-e4210d969c41 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:14.476340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fca85184-f634-42dd-9968-e4210d969c41 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:14.494057 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fca85184-f634-42dd-9968-e4210d969c41 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 200 len: 1327 microversion: 2.1 time: 0.167610 Jan 22 21:13:14.494057 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2338/4489] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:14 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 1327 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:14.494231 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f4bb5ed0-2751-44f9-8402-b677695f5b60 tempest-SecurityGroupsTestAdminJSON-260834476 tempest-SecurityGroupsTestAdminJSON-260834476-project-admin] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.407283 Jan 22 21:13:14.494231 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2152/4490] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:13:14 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:14.494374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-207a84fd-37f2-46d9-bd41-48a897613948 req-4aedaf28-7ece-4d72-865f-88c2966d5ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8288fe26-7e9c-451c-a9a2-222abbcf201e", "name": "network-vif-plugged", "status": "completed", "tag": "92a02346-3106-4ce0-82fd-0bae77d72810"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:14.494374 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:14.494374 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:13:14.498275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-207a84fd-37f2-46d9-bd41-48a897613948 req-4aedaf28-7ece-4d72-865f-88c2966d5ee7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:14.498713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-09e1fea8-f7fa-4680-aa68-3e3aa65349ca tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:14.498824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-207a84fd-37f2-46d9-bd41-48a897613948 req-4aedaf28-7ece-4d72-865f-88c2966d5ee7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:14.499448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-09e1fea8-f7fa-4680-aa68-3e3aa65349ca tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:14.506073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09e1fea8-f7fa-4680-aa68-3e3aa65349ca tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:14.506529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09e1fea8-f7fa-4680-aa68-3e3aa65349ca tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:14.507325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09e1fea8-f7fa-4680-aa68-3e3aa65349ca tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:14.508310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09e1fea8-f7fa-4680-aa68-3e3aa65349ca tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:14.513834 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-207a84fd-37f2-46d9-bd41-48a897613948 req-4aedaf28-7ece-4d72-865f-88c2966d5ee7 service nova] Creating event network-vif-plugged:92a02346-3106-4ce0-82fd-0bae77d72810 for instance 8288fe26-7e9c-451c-a9a2-222abbcf201e on nch2-master-1 Jan 22 21:13:14.519789 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-207a84fd-37f2-46d9-bd41-48a897613948 req-4aedaf28-7ece-4d72-865f-88c2966d5ee7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033813 Jan 22 21:13:14.520614 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2339/4491] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:14.528256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fdbb11fe-0194-439a-818f-6bbb655e79b9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:14.529493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fdbb11fe-0194-439a-818f-6bbb655e79b9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:14.536395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdbb11fe-0194-439a-818f-6bbb655e79b9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:14.538830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdbb11fe-0194-439a-818f-6bbb655e79b9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:14.538830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdbb11fe-0194-439a-818f-6bbb655e79b9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:14.538830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdbb11fe-0194-439a-818f-6bbb655e79b9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:14.583605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-09e1fea8-f7fa-4680-aa68-3e3aa65349ca tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:14.589875 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fdbb11fe-0194-439a-818f-6bbb655e79b9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.068036 Jan 22 21:13:14.592889 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2340/4492] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:14 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:14.595109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-09e1fea8-f7fa-4680-aa68-3e3aa65349ca tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:14.596689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-09e1fea8-f7fa-4680-aa68-3e3aa65349ca tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:14.598281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-77d07001-3af6-4d3a-b956-d0a6040b2774 tempest-SecurityGroupsTestAdminJSON-260834476 tempest-SecurityGroupsTestAdminJSON-260834476-project-admin] Calling method '.version_select at 0x7f1ed5be6d30>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:14.598699 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-09e1fea8-f7fa-4680-aa68-3e3aa65349ca tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.108400 Jan 22 21:13:14.599424 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2153/4493] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:14 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:14.604840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-370543c8-a5bc-4823-b3db-2c4014bd9a3d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:14.606047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-370543c8-a5bc-4823-b3db-2c4014bd9a3d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:14.613835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-370543c8-a5bc-4823-b3db-2c4014bd9a3d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:14.614297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-370543c8-a5bc-4823-b3db-2c4014bd9a3d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:14.615396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-370543c8-a5bc-4823-b3db-2c4014bd9a3d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:14.615913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-370543c8-a5bc-4823-b3db-2c4014bd9a3d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:14.670471 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-370543c8-a5bc-4823-b3db-2c4014bd9a3d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 24555 microversion: 2.1 time: 0.068884 Jan 22 21:13:14.671830 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2154/4494] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:14 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 24555 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:15.003308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-79dd3f38-851b-4450-bdc5-787cd085fd05 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:15.004367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-79dd3f38-851b-4450-bdc5-787cd085fd05 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:15.013197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79dd3f38-851b-4450-bdc5-787cd085fd05 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:15.013695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79dd3f38-851b-4450-bdc5-787cd085fd05 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:15.017252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79dd3f38-851b-4450-bdc5-787cd085fd05 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:15.017252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79dd3f38-851b-4450-bdc5-787cd085fd05 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:15.167549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-79dd3f38-851b-4450-bdc5-787cd085fd05 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:15.175006 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-79dd3f38-851b-4450-bdc5-787cd085fd05 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1318 microversion: 2.1 time: 0.175838 Jan 22 21:13:15.175583 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2155/4495] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:14 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:15.188751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee39d77d-9acf-4330-b95b-5e7170c58b36 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:15.195133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ee39d77d-9acf-4330-b95b-5e7170c58b36 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:15.198469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee39d77d-9acf-4330-b95b-5e7170c58b36 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:15.198956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee39d77d-9acf-4330-b95b-5e7170c58b36 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:15.200216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee39d77d-9acf-4330-b95b-5e7170c58b36 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:15.200852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee39d77d-9acf-4330-b95b-5e7170c58b36 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:15.244993 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee39d77d-9acf-4330-b95b-5e7170c58b36 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.068153 Jan 22 21:13:15.245663 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2156/4496] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:15 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:15.334979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d2ca6c98-4245-428d-aec0-76859698e4eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:15.335781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d2ca6c98-4245-428d-aec0-76859698e4eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:15.343501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2ca6c98-4245-428d-aec0-76859698e4eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:15.343960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2ca6c98-4245-428d-aec0-76859698e4eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:15.344849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2ca6c98-4245-428d-aec0-76859698e4eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:15.345298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2ca6c98-4245-428d-aec0-76859698e4eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:15.503046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d2ca6c98-4245-428d-aec0-76859698e4eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:15.511623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d2ca6c98-4245-428d-aec0-76859698e4eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:15.513129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d2ca6c98-4245-428d-aec0-76859698e4eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:15.514293 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d2ca6c98-4245-428d-aec0-76859698e4eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1409 microversion: 2.20 time: 0.183376 Jan 22 21:13:15.514855 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2157/4497] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:15 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1409 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:13:15.519082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-77c10150-8220-44aa-991f-4366c46a2a76 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:15.519685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-77c10150-8220-44aa-991f-4366c46a2a76 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:15.529088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-77c10150-8220-44aa-991f-4366c46a2a76 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:15.530060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-77c10150-8220-44aa-991f-4366c46a2a76 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:15.530654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-77c10150-8220-44aa-991f-4366c46a2a76 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:15.531125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-77c10150-8220-44aa-991f-4366c46a2a76 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:15.667060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-77c10150-8220-44aa-991f-4366c46a2a76 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:15.674740 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-77c10150-8220-44aa-991f-4366c46a2a76 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 200 len: 1327 microversion: 2.1 time: 0.158874 Jan 22 21:13:15.676636 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2158/4498] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:15 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 1327 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:15.680785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-142b2feb-b884-42af-852b-ee3997a813e8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:15.681823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-142b2feb-b884-42af-852b-ee3997a813e8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:15.688009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-142b2feb-b884-42af-852b-ee3997a813e8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:15.688467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-142b2feb-b884-42af-852b-ee3997a813e8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:15.689301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-142b2feb-b884-42af-852b-ee3997a813e8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:15.689759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-142b2feb-b884-42af-852b-ee3997a813e8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:15.733878 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-142b2feb-b884-42af-852b-ee3997a813e8 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.057137 Jan 22 21:13:15.737446 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2159/4499] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:15 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:15.739843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-701a78f8-7e18-427a-8981-006a184ad067 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:15.740545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-701a78f8-7e18-427a-8981-006a184ad067 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:15.747492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-701a78f8-7e18-427a-8981-006a184ad067 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:15.747952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-701a78f8-7e18-427a-8981-006a184ad067 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:15.748750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-701a78f8-7e18-427a-8981-006a184ad067 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:15.749198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-701a78f8-7e18-427a-8981-006a184ad067 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:16.045411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-701a78f8-7e18-427a-8981-006a184ad067 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:16.045956 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-77d07001-3af6-4d3a-b956-d0a6040b2774 tempest-SecurityGroupsTestAdminJSON-260834476 tempest-SecurityGroupsTestAdminJSON-260834476-project-admin] 10.222.0.100 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12228 microversion: 2.1 time: 1.453401 Jan 22 21:13:16.046878 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2341/4500] 10.222.0.100 () {58 vars in 1195 bytes} [Sat Jan 22 21:13:14 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12228 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:16.051768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6549eabc-be12-4ff4-8f7e-4a4bb254e120 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:16.053085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6549eabc-be12-4ff4-8f7e-4a4bb254e120 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:16.061533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6549eabc-be12-4ff4-8f7e-4a4bb254e120 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:16.062242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6549eabc-be12-4ff4-8f7e-4a4bb254e120 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:16.063049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6549eabc-be12-4ff4-8f7e-4a4bb254e120 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:16.063499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6549eabc-be12-4ff4-8f7e-4a4bb254e120 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:16.067704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-701a78f8-7e18-427a-8981-006a184ad067 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:16.069680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-701a78f8-7e18-427a-8981-006a184ad067 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:16.071226 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-701a78f8-7e18-427a-8981-006a184ad067 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1410 microversion: 2.54 time: 0.335314 Jan 22 21:13:16.071959 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2160/4501] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:15 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1410 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:16.077222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9cb128ed-020c-4e45-a768-9f2682f8aa4c tempest-SecurityGroupsTestAdminJSON-1369527049 tempest-SecurityGroupsTestAdminJSON-1369527049-project] Calling method '.version_select at 0x7f1ed4f4f820>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:16.118228 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6549eabc-be12-4ff4-8f7e-4a4bb254e120 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 24555 microversion: 2.1 time: 0.069309 Jan 22 21:13:16.119256 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2342/4502] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:16 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 24555 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:16.192867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab73de3a-bf3a-452b-97fb-dc92c6f0d291 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:16.193888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ab73de3a-bf3a-452b-97fb-dc92c6f0d291 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:16.201931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab73de3a-bf3a-452b-97fb-dc92c6f0d291 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:16.202351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab73de3a-bf3a-452b-97fb-dc92c6f0d291 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:16.203154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab73de3a-bf3a-452b-97fb-dc92c6f0d291 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:16.203599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab73de3a-bf3a-452b-97fb-dc92c6f0d291 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:16.261341 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9cb128ed-020c-4e45-a768-9f2682f8aa4c tempest-SecurityGroupsTestAdminJSON-1369527049 tempest-SecurityGroupsTestAdminJSON-1369527049-project] 10.222.0.100 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.187892 Jan 22 21:13:16.262033 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2161/4503] 10.222.0.100 () {58 vars in 1195 bytes} [Sat Jan 22 21:13:16 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:16.267588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6a1d24aa-0e3b-4da7-861a-34587b4afc86 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:16.268826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6a1d24aa-0e3b-4da7-861a-34587b4afc86 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:16.276358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a1d24aa-0e3b-4da7-861a-34587b4afc86 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:16.283413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a1d24aa-0e3b-4da7-861a-34587b4afc86 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:16.283413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a1d24aa-0e3b-4da7-861a-34587b4afc86 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:16.283413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a1d24aa-0e3b-4da7-861a-34587b4afc86 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:16.319930 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6a1d24aa-0e3b-4da7-861a-34587b4afc86 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.056315 Jan 22 21:13:16.321183 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2162/4504] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:16 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:16.326663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fd5a796a-393d-4eee-8969-c1de389d4b6f tempest-SecurityGroupsTestAdminJSON-260834476 tempest-SecurityGroupsTestAdminJSON-260834476-project-admin] Calling method '.version_select at 0x7f1ed4f4f8b0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:16.347939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ab73de3a-bf3a-452b-97fb-dc92c6f0d291 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:16.356181 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab73de3a-bf3a-452b-97fb-dc92c6f0d291 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1318 microversion: 2.1 time: 0.167579 Jan 22 21:13:16.357151 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2343/4505] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:16 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:16.532577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-488aab0d-b347-4b90-b229-4c1356c02dbf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:16.533241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-488aab0d-b347-4b90-b229-4c1356c02dbf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:16.542021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-488aab0d-b347-4b90-b229-4c1356c02dbf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:16.546639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-488aab0d-b347-4b90-b229-4c1356c02dbf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:16.546639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-488aab0d-b347-4b90-b229-4c1356c02dbf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:16.546639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-488aab0d-b347-4b90-b229-4c1356c02dbf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:16.569009 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fd5a796a-393d-4eee-8969-c1de389d4b6f tempest-SecurityGroupsTestAdminJSON-260834476 tempest-SecurityGroupsTestAdminJSON-260834476-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/92876128-2fb5-41eb-9a42-d24c75d69ed3" status: 202 len: 0 microversion: 2.1 time: 0.246270 Jan 22 21:13:16.573074 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2163/4506] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:13:16 2022] DELETE /compute/v2.1/os-security-groups/92876128-2fb5-41eb-9a42-d24c75d69ed3 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:16.575509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f026e265-d1b0-407f-80b5-84d56a009cbd req-090913fe-5968-4704-adc9-1a13bae7963e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9918df-8a8e-48ab-a9a2-05922a783d69", "name": "network-vif-plugged", "status": "completed", "tag": "006b8beb-7ced-4e60-b992-5ea57c4c79d1"}, {"server_uuid": "a142f83a-c576-4972-a9f4-0d2e8ac5d0d5", "name": "network-vif-plugged", "status": "completed", "tag": "47e5ddad-21d0-45de-bfef-390954745b7c"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:16.577310 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:16.577310 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:13:16.595958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f026e265-d1b0-407f-80b5-84d56a009cbd req-090913fe-5968-4704-adc9-1a13bae7963e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:16.596675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f026e265-d1b0-407f-80b5-84d56a009cbd req-090913fe-5968-4704-adc9-1a13bae7963e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:16.610877 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f026e265-d1b0-407f-80b5-84d56a009cbd req-090913fe-5968-4704-adc9-1a13bae7963e service nova] Creating event network-vif-plugged:006b8beb-7ced-4e60-b992-5ea57c4c79d1 for instance bf9918df-8a8e-48ab-a9a2-05922a783d69 on nch1-master-1 Jan 22 21:13:16.611384 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f026e265-d1b0-407f-80b5-84d56a009cbd req-090913fe-5968-4704-adc9-1a13bae7963e service nova] Creating event network-vif-plugged:47e5ddad-21d0-45de-bfef-390954745b7c for instance a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 on nch1-master-1 Jan 22 21:13:16.618805 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f026e265-d1b0-407f-80b5-84d56a009cbd req-090913fe-5968-4704-adc9-1a13bae7963e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047739 Jan 22 21:13:16.619417 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2164/4507] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:16.624398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-806dbfd7-982c-4e1d-bf90-be713b170d90 tempest-SecurityGroupsTestAdminJSON-260834476 tempest-SecurityGroupsTestAdminJSON-260834476-project-admin] Calling method '.version_select at 0x7f1ed4f59790>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:16.710168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-488aab0d-b347-4b90-b229-4c1356c02dbf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:16.719948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-488aab0d-b347-4b90-b229-4c1356c02dbf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:16.722357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-488aab0d-b347-4b90-b229-4c1356c02dbf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:16.723583 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-488aab0d-b347-4b90-b229-4c1356c02dbf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1601 microversion: 2.20 time: 0.195208 Jan 22 21:13:16.724167 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2344/4508] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:16 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1601 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:13:16.730265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e1d8f02c-8a77-4f4a-a813-eef541a57577 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:16.730887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e1d8f02c-8a77-4f4a-a813-eef541a57577 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:16.737186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1d8f02c-8a77-4f4a-a813-eef541a57577 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:16.737694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1d8f02c-8a77-4f4a-a813-eef541a57577 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:16.739092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1d8f02c-8a77-4f4a-a813-eef541a57577 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:16.739919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1d8f02c-8a77-4f4a-a813-eef541a57577 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:16.883005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e1d8f02c-8a77-4f4a-a813-eef541a57577 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:16.890602 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e1d8f02c-8a77-4f4a-a813-eef541a57577 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 200 len: 1327 microversion: 2.1 time: 0.165243 Jan 22 21:13:16.891184 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2345/4509] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:16 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 1327 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:16.895656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad8ff993-0319-454a-b82b-f5f0e159e076 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:16.896158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad8ff993-0319-454a-b82b-f5f0e159e076 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:16.904174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad8ff993-0319-454a-b82b-f5f0e159e076 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:16.904640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad8ff993-0319-454a-b82b-f5f0e159e076 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:16.905451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad8ff993-0319-454a-b82b-f5f0e159e076 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:16.906030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad8ff993-0319-454a-b82b-f5f0e159e076 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:16.990903 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad8ff993-0319-454a-b82b-f5f0e159e076 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098641 Jan 22 21:13:16.991515 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2346/4510] 10.222.0.100 () {60 vars in 1320 bytes} [Sat Jan 22 21:13:16 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:16.996009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-028da2df-4476-4a83-8a14-793c3a38686d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:16.996981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-028da2df-4476-4a83-8a14-793c3a38686d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:17.003217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-028da2df-4476-4a83-8a14-793c3a38686d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:17.003678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-028da2df-4476-4a83-8a14-793c3a38686d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:17.004680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-028da2df-4476-4a83-8a14-793c3a38686d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:17.004992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-028da2df-4476-4a83-8a14-793c3a38686d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:17.011305 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-806dbfd7-982c-4e1d-bf90-be713b170d90 tempest-SecurityGroupsTestAdminJSON-260834476 tempest-SecurityGroupsTestAdminJSON-260834476-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/213be5a6-a6cb-4953-b553-c41826d4a8fe" status: 202 len: 0 microversion: 2.1 time: 0.390681 Jan 22 21:13:17.015755 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2165/4511] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:13:16 2022] DELETE /compute/v2.1/os-security-groups/213be5a6-a6cb-4953-b553-c41826d4a8fe => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:17.031398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ce15ca38-a518-43ce-ad6c-69344fc4b2f4 tempest-SecurityGroupsTestAdminJSON-1369527049 tempest-SecurityGroupsTestAdminJSON-1369527049-project] Calling method '.version_select at 0x7f1ed4f59040>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:17.052712 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-028da2df-4476-4a83-8a14-793c3a38686d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.059916 Jan 22 21:13:17.054548 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2347/4512] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:16 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:17.068627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b97fd924-3790-48ff-a60c-19316bcfba04 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:17.070150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b97fd924-3790-48ff-a60c-19316bcfba04 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:17.083625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b97fd924-3790-48ff-a60c-19316bcfba04 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:17.084080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b97fd924-3790-48ff-a60c-19316bcfba04 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:17.085064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b97fd924-3790-48ff-a60c-19316bcfba04 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:17.085696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b97fd924-3790-48ff-a60c-19316bcfba04 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:17.346041 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ce15ca38-a518-43ce-ad6c-69344fc4b2f4 tempest-SecurityGroupsTestAdminJSON-1369527049 tempest-SecurityGroupsTestAdminJSON-1369527049-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/49b7bc5a-1dfd-4ade-8625-6191ab95bf2b" status: 202 len: 0 microversion: 2.1 time: 0.328055 Jan 22 21:13:17.349934 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2166/4513] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:13:17 2022] DELETE /compute/v2.1/os-security-groups/49b7bc5a-1dfd-4ade-8625-6191ab95bf2b => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:17.355093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bacf896b-cde0-4163-b5ce-d6aa0e27ebc9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:17.356083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bacf896b-cde0-4163-b5ce-d6aa0e27ebc9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:17.364199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bacf896b-cde0-4163-b5ce-d6aa0e27ebc9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:17.364795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bacf896b-cde0-4163-b5ce-d6aa0e27ebc9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:17.365873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bacf896b-cde0-4163-b5ce-d6aa0e27ebc9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:17.366426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bacf896b-cde0-4163-b5ce-d6aa0e27ebc9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:17.446765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bacf896b-cde0-4163-b5ce-d6aa0e27ebc9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:17.455737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bacf896b-cde0-4163-b5ce-d6aa0e27ebc9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:17.457284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bacf896b-cde0-4163-b5ce-d6aa0e27ebc9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:17.458510 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bacf896b-cde0-4163-b5ce-d6aa0e27ebc9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1416 microversion: 2.54 time: 0.110361 Jan 22 21:13:17.459085 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2167/4514] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:17 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1416 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:17.463827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3f3f395d-a255-44c3-97dc-cccf530e03a1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:17.464773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3f3f395d-a255-44c3-97dc-cccf530e03a1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:17.471069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f3f395d-a255-44c3-97dc-cccf530e03a1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:17.471531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f3f395d-a255-44c3-97dc-cccf530e03a1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:17.472350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f3f395d-a255-44c3-97dc-cccf530e03a1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:17.472797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f3f395d-a255-44c3-97dc-cccf530e03a1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:17.531082 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3f3f395d-a255-44c3-97dc-cccf530e03a1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.070710 Jan 22 21:13:17.533493 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2168/4515] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:17 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:17.536719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b66d99fb-0e28-4823-bc1d-5d7eb2ff0530 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:17.537754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b66d99fb-0e28-4823-bc1d-5d7eb2ff0530 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:17.545062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b66d99fb-0e28-4823-bc1d-5d7eb2ff0530 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:17.545538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b66d99fb-0e28-4823-bc1d-5d7eb2ff0530 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:17.546370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b66d99fb-0e28-4823-bc1d-5d7eb2ff0530 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:17.546807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b66d99fb-0e28-4823-bc1d-5d7eb2ff0530 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:17.589445 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b66d99fb-0e28-4823-bc1d-5d7eb2ff0530 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.056347 Jan 22 21:13:17.593421 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2169/4516] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:17 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:17.594876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4a21b4d-7bdd-40d1-910d-199232447bf6 tempest-SecurityGroupsTestAdminJSON-1369527049 tempest-SecurityGroupsTestAdminJSON-1369527049-project] Calling method '.version_select at 0x7f1ed4f7aaf0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:17.689806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b97fd924-3790-48ff-a60c-19316bcfba04 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:17.700775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b97fd924-3790-48ff-a60c-19316bcfba04 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:17.702680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b97fd924-3790-48ff-a60c-19316bcfba04 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:17.704047 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b97fd924-3790-48ff-a60c-19316bcfba04 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 2959 microversion: 2.42 time: 0.643511 Jan 22 21:13:17.704908 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2348/4517] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:17 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 2959 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:13:17.709377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-70db8f8b-ff88-4c16-95ed-50f38a7f8426 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:17.710123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-70db8f8b-ff88-4c16-95ed-50f38a7f8426 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:17.718741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70db8f8b-ff88-4c16-95ed-50f38a7f8426 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:17.719601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70db8f8b-ff88-4c16-95ed-50f38a7f8426 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:17.720220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70db8f8b-ff88-4c16-95ed-50f38a7f8426 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:17.720835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70db8f8b-ff88-4c16-95ed-50f38a7f8426 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:17.843911 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c4a21b4d-7bdd-40d1-910d-199232447bf6 tempest-SecurityGroupsTestAdminJSON-1369527049 tempest-SecurityGroupsTestAdminJSON-1369527049-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/f93704b2-84ff-4fad-82bf-b39a3752278f" status: 202 len: 0 microversion: 2.1 time: 0.252575 Jan 22 21:13:17.844580 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2170/4518] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:13:17 2022] DELETE /compute/v2.1/os-security-groups/f93704b2-84ff-4fad-82bf-b39a3752278f => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:17.849475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-df4de822-72da-4b67-9d3b-729111009155 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:17.850469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-df4de822-72da-4b67-9d3b-729111009155 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:17.868081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df4de822-72da-4b67-9d3b-729111009155 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:17.869161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df4de822-72da-4b67-9d3b-729111009155 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:17.870565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df4de822-72da-4b67-9d3b-729111009155 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:17.871196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df4de822-72da-4b67-9d3b-729111009155 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:18.026257 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-df4de822-72da-4b67-9d3b-729111009155 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.180550 Jan 22 21:13:18.026964 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2171/4519] 10.222.0.100 () {60 vars in 1320 bytes} [Sat Jan 22 21:13:17 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/os-interface => generated 1831 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:18.032217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1e702e2e-edd2-4f31-92ec-2f2a017fb267 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:18.033715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1e702e2e-edd2-4f31-92ec-2f2a017fb267 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:18.040119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e702e2e-edd2-4f31-92ec-2f2a017fb267 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:18.040669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e702e2e-edd2-4f31-92ec-2f2a017fb267 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:18.041463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e702e2e-edd2-4f31-92ec-2f2a017fb267 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:18.041933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e702e2e-edd2-4f31-92ec-2f2a017fb267 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:18.095556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-70db8f8b-ff88-4c16-95ed-50f38a7f8426 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:18.104411 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-70db8f8b-ff88-4c16-95ed-50f38a7f8426 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1318 microversion: 2.1 time: 0.398206 Jan 22 21:13:18.105313 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2349/4520] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:17 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:18.190825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1e702e2e-edd2-4f31-92ec-2f2a017fb267 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:18.199401 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1e702e2e-edd2-4f31-92ec-2f2a017fb267 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 200 len: 1327 microversion: 2.1 time: 0.171055 Jan 22 21:13:18.200738 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2172/4521] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:18 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 1327 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:18.478015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3b91c927-e834-49bb-b06d-d38805b8ddd9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:18.478642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3b91c927-e834-49bb-b06d-d38805b8ddd9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:18.485310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b91c927-e834-49bb-b06d-d38805b8ddd9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:18.486011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b91c927-e834-49bb-b06d-d38805b8ddd9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:18.487025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b91c927-e834-49bb-b06d-d38805b8ddd9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:18.487474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b91c927-e834-49bb-b06d-d38805b8ddd9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:18.544729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9e91f23d-547b-4f7f-9c6c-0186e57c9baf tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:18.546539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9e91f23d-547b-4f7f-9c6c-0186e57c9baf tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:18.557811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e91f23d-547b-4f7f-9c6c-0186e57c9baf tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:18.558651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e91f23d-547b-4f7f-9c6c-0186e57c9baf tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:18.559748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e91f23d-547b-4f7f-9c6c-0186e57c9baf tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:18.561172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e91f23d-547b-4f7f-9c6c-0186e57c9baf tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:18.609836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3b91c927-e834-49bb-b06d-d38805b8ddd9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:18.618212 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9e91f23d-547b-4f7f-9c6c-0186e57c9baf tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.078612 Jan 22 21:13:18.619939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3b91c927-e834-49bb-b06d-d38805b8ddd9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:18.620371 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2173/4522] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:18 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:18.621671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3b91c927-e834-49bb-b06d-d38805b8ddd9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:18.623572 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3b91c927-e834-49bb-b06d-d38805b8ddd9 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1416 microversion: 2.54 time: 0.149659 Jan 22 21:13:18.624616 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2350/4523] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:18 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1416 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:18.627694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b1e136b1-9d12-4adc-bbf0-6416a9535a1f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:18.629117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b1e136b1-9d12-4adc-bbf0-6416a9535a1f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:18.636362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1e136b1-9d12-4adc-bbf0-6416a9535a1f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:18.636749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1e136b1-9d12-4adc-bbf0-6416a9535a1f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:18.637613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1e136b1-9d12-4adc-bbf0-6416a9535a1f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:18.638052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1e136b1-9d12-4adc-bbf0-6416a9535a1f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:18.689968 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b1e136b1-9d12-4adc-bbf0-6416a9535a1f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.066929 Jan 22 21:13:18.693975 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2174/4524] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:18 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:18.841880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fd5a4793-706d-4382-8c60-8efe022a88f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:18.843551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fd5a4793-706d-4382-8c60-8efe022a88f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:18.854444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd5a4793-706d-4382-8c60-8efe022a88f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:18.855517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd5a4793-706d-4382-8c60-8efe022a88f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:18.856833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd5a4793-706d-4382-8c60-8efe022a88f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:18.858526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd5a4793-706d-4382-8c60-8efe022a88f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:18.908962 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fd5a4793-706d-4382-8c60-8efe022a88f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 14 microversion: 2.20 time: 0.072941 Jan 22 21:13:18.912743 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2175/4525] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:18 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:18.974252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-10711c7a-61ad-4f5a-a409-322f9d026e89 req-c9d332b4-d45e-4ed6-9103-70349f113949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8288fe26-7e9c-451c-a9a2-222abbcf201e", "tag": "92a02346-3106-4ce0-82fd-0bae77d72810"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:18.975783 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:18.975783 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:13:18.984290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-10711c7a-61ad-4f5a-a409-322f9d026e89 req-c9d332b4-d45e-4ed6-9103-70349f113949 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:18.984820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-10711c7a-61ad-4f5a-a409-322f9d026e89 req-c9d332b4-d45e-4ed6-9103-70349f113949 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:18.996884 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-10711c7a-61ad-4f5a-a409-322f9d026e89 req-c9d332b4-d45e-4ed6-9103-70349f113949 service nova] Creating event network-changed:92a02346-3106-4ce0-82fd-0bae77d72810 for instance 8288fe26-7e9c-451c-a9a2-222abbcf201e on nch2-master-1 Jan 22 21:13:19.002075 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-10711c7a-61ad-4f5a-a409-322f9d026e89 req-c9d332b4-d45e-4ed6-9103-70349f113949 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169976 Jan 22 21:13:19.002681 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2351/4526] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:13:19.124139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-47c67185-3f4e-4b6a-a0d6-c6c0857daac2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:19.130837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-47c67185-3f4e-4b6a-a0d6-c6c0857daac2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:19.152769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47c67185-3f4e-4b6a-a0d6-c6c0857daac2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:19.156620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47c67185-3f4e-4b6a-a0d6-c6c0857daac2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:19.158575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47c67185-3f4e-4b6a-a0d6-c6c0857daac2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:19.159944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47c67185-3f4e-4b6a-a0d6-c6c0857daac2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:19.216844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b1f1f8d7-a562-45c5-84d7-28293b4d4449 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:19.217739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b1f1f8d7-a562-45c5-84d7-28293b4d4449 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:19.226826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1f1f8d7-a562-45c5-84d7-28293b4d4449 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:19.227326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1f1f8d7-a562-45c5-84d7-28293b4d4449 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:19.228270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1f1f8d7-a562-45c5-84d7-28293b4d4449 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:19.228722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1f1f8d7-a562-45c5-84d7-28293b4d4449 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:19.408597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b1f1f8d7-a562-45c5-84d7-28293b4d4449 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:19.424744 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b1f1f8d7-a562-45c5-84d7-28293b4d4449 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 200 len: 1523 microversion: 2.1 time: 0.211824 Jan 22 21:13:19.426930 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2352/4527] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:19 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:19.445479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-243c4bc4-2281-4c5c-8533-5701a798ae0a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.153"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:19.447234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-243c4bc4-2281-4c5c-8533-5701a798ae0a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:19.454142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-243c4bc4-2281-4c5c-8533-5701a798ae0a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:19.454609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-243c4bc4-2281-4c5c-8533-5701a798ae0a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:19.455421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-243c4bc4-2281-4c5c-8533-5701a798ae0a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:19.456898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-243c4bc4-2281-4c5c-8533-5701a798ae0a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:19.472218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-47c67185-3f4e-4b6a-a0d6-c6c0857daac2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:19.481576 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-47c67185-3f4e-4b6a-a0d6-c6c0857daac2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1501 microversion: 2.1 time: 0.364400 Jan 22 21:13:19.483081 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2176/4528] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:19 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1501 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:19.536140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-243c4bc4-2281-4c5c-8533-5701a798ae0a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Acquired lock "refresh_cache-3b77cc52-a232-427f-9304-a151f4110d69" {{(pid=137032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 22 21:13:19.631094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-463fe0d3-4beb-450c-be02-0898d1925a54 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:19.632315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-463fe0d3-4beb-450c-be02-0898d1925a54 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:19.645713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-463fe0d3-4beb-450c-be02-0898d1925a54 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:19.646180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-463fe0d3-4beb-450c-be02-0898d1925a54 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:19.648504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-463fe0d3-4beb-450c-be02-0898d1925a54 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:19.649446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-463fe0d3-4beb-450c-be02-0898d1925a54 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:19.703799 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-463fe0d3-4beb-450c-be02-0898d1925a54 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.077626 Jan 22 21:13:19.704468 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2177/4529] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:19 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:19.709743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-00743a5d-b8dc-429c-b05b-9b6779c794fe tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:19.710689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-00743a5d-b8dc-429c-b05b-9b6779c794fe tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:19.718231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00743a5d-b8dc-429c-b05b-9b6779c794fe tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:19.718920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00743a5d-b8dc-429c-b05b-9b6779c794fe tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:19.719932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00743a5d-b8dc-429c-b05b-9b6779c794fe tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:19.720540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00743a5d-b8dc-429c-b05b-9b6779c794fe tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:19.818758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-00743a5d-b8dc-429c-b05b-9b6779c794fe tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:19.828950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-00743a5d-b8dc-429c-b05b-9b6779c794fe tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:19.830817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-00743a5d-b8dc-429c-b05b-9b6779c794fe tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:19.832074 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-00743a5d-b8dc-429c-b05b-9b6779c794fe tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1401 microversion: 2.54 time: 0.126147 Jan 22 21:13:19.832973 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2178/4530] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:19 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1401 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:19.838550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-41220c82-ddff-45cf-9234-fd9278d5c6f9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:19.840119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-41220c82-ddff-45cf-9234-fd9278d5c6f9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:19.847722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41220c82-ddff-45cf-9234-fd9278d5c6f9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:19.848431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41220c82-ddff-45cf-9234-fd9278d5c6f9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:19.854515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41220c82-ddff-45cf-9234-fd9278d5c6f9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:19.855237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41220c82-ddff-45cf-9234-fd9278d5c6f9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:19.921246 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-41220c82-ddff-45cf-9234-fd9278d5c6f9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.085680 Jan 22 21:13:19.922328 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2179/4531] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:19 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:19.928966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f9bf1bbf-de9e-4bda-9c87-7b010310fe54 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '.version_select at 0x7f1ed4f4f0d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:20.028351 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f9bf1bbf-de9e-4bda-9c87-7b010310fe54 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-11018423" status: 204 len: 0 microversion: 2.54 time: 0.104572 Jan 22 21:13:20.032246 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2180/4532] 10.222.0.100 () {60 vars in 1317 bytes} [Sat Jan 22 21:13:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-11018423 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:13:20.034046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d53ff101-b7e5-40ff-9771-04420efc3e01 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:20.036489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d53ff101-b7e5-40ff-9771-04420efc3e01 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:20.048265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d53ff101-b7e5-40ff-9771-04420efc3e01 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:20.048727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d53ff101-b7e5-40ff-9771-04420efc3e01 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:20.049613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d53ff101-b7e5-40ff-9771-04420efc3e01 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:20.050076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d53ff101-b7e5-40ff-9771-04420efc3e01 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:20.099875 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d53ff101-b7e5-40ff-9771-04420efc3e01 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 14 microversion: 2.20 time: 0.069396 Jan 22 21:13:20.104308 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2181/4533] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:20 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:20.114586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b8e4a6ba-e078-428d-a58d-9ce0f52fbff4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:20.116392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b8e4a6ba-e078-428d-a58d-9ce0f52fbff4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:20.125854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8e4a6ba-e078-428d-a58d-9ce0f52fbff4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:20.126036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8e4a6ba-e078-428d-a58d-9ce0f52fbff4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:20.127243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8e4a6ba-e078-428d-a58d-9ce0f52fbff4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:20.128779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8e4a6ba-e078-428d-a58d-9ce0f52fbff4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:20.202071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b8e4a6ba-e078-428d-a58d-9ce0f52fbff4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:13:20.608077 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b8e4a6ba-e078-428d-a58d-9ce0f52fbff4 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "DELETE /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 204 len: 0 microversion: 2.54 time: 0.499743 Jan 22 21:13:20.614717 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2182/4534] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:13:20 2022] DELETE /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:13:20.627548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-370d77e4-c81e-4449-ad1e-ee7551855f8c tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:20.629335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-370d77e4-c81e-4449-ad1e-ee7551855f8c tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:20.646830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-370d77e4-c81e-4449-ad1e-ee7551855f8c tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:20.649343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-370d77e4-c81e-4449-ad1e-ee7551855f8c tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:20.650761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-370d77e4-c81e-4449-ad1e-ee7551855f8c tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:20.651435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-370d77e4-c81e-4449-ad1e-ee7551855f8c tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:20.745841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-370d77e4-c81e-4449-ad1e-ee7551855f8c tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:20.765669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-370d77e4-c81e-4449-ad1e-ee7551855f8c tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:20.767633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-370d77e4-c81e-4449-ad1e-ee7551855f8c tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:20.769107 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-370d77e4-c81e-4449-ad1e-ee7551855f8c tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1407 microversion: 2.54 time: 0.152297 Jan 22 21:13:20.780754 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2183/4535] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:20 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:13:20.780754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-58d9816c-1404-4c53-9047-87f14edc5d08 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:20.781551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-58d9816c-1404-4c53-9047-87f14edc5d08 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:20.793728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58d9816c-1404-4c53-9047-87f14edc5d08 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:20.794193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58d9816c-1404-4c53-9047-87f14edc5d08 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:20.795265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58d9816c-1404-4c53-9047-87f14edc5d08 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:20.797364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58d9816c-1404-4c53-9047-87f14edc5d08 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:20.848878 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-58d9816c-1404-4c53-9047-87f14edc5d08 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.075349 Jan 22 21:13:20.853319 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2184/4536] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:20 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:20.933214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-120fab2a-b342-49a4-9c16-762c3e2cba1d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:20.934344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-120fab2a-b342-49a4-9c16-762c3e2cba1d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:20.941768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-120fab2a-b342-49a4-9c16-762c3e2cba1d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:20.942229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-120fab2a-b342-49a4-9c16-762c3e2cba1d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:20.943025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-120fab2a-b342-49a4-9c16-762c3e2cba1d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:20.943474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-120fab2a-b342-49a4-9c16-762c3e2cba1d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:20.996388 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-120fab2a-b342-49a4-9c16-762c3e2cba1d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.067896 Jan 22 21:13:20.996983 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2185/4537] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:20 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:21.111768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-596fd946-78f3-4030-a66e-eb2d34679cee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:21.112854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-596fd946-78f3-4030-a66e-eb2d34679cee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:21.120234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-596fd946-78f3-4030-a66e-eb2d34679cee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:21.120683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-596fd946-78f3-4030-a66e-eb2d34679cee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:21.121479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-596fd946-78f3-4030-a66e-eb2d34679cee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:21.121993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-596fd946-78f3-4030-a66e-eb2d34679cee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:21.161725 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-596fd946-78f3-4030-a66e-eb2d34679cee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 14 microversion: 2.20 time: 0.053937 Jan 22 21:13:21.162451 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2186/4538] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:21 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:21.307806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-243c4bc4-2281-4c5c-8533-5701a798ae0a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Building network info cache for instance {{(pid=137032) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 22 21:13:21.334222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-2ae5af06-323d-433b-8b43-64b9e3ec1611 req-9fa0479b-2181-4009-8fd1-316bc112878b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b77cc52-a232-427f-9304-a151f4110d69", "tag": "208377a2-2e65-4185-94a6-ce2de003a880"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:21.336359 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:21.336359 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:13:21.347420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2ae5af06-323d-433b-8b43-64b9e3ec1611 req-9fa0479b-2181-4009-8fd1-316bc112878b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:21.347877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2ae5af06-323d-433b-8b43-64b9e3ec1611 req-9fa0479b-2181-4009-8fd1-316bc112878b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:21.360328 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-2ae5af06-323d-433b-8b43-64b9e3ec1611 req-9fa0479b-2181-4009-8fd1-316bc112878b service nova] Creating event network-changed:208377a2-2e65-4185-94a6-ce2de003a880 for instance 3b77cc52-a232-427f-9304-a151f4110d69 on nch2-master-1 Jan 22 21:13:21.365247 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-2ae5af06-323d-433b-8b43-64b9e3ec1611 req-9fa0479b-2181-4009-8fd1-316bc112878b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036021 Jan 22 21:13:21.366120 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2187/4539] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:13:21.790098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4e09f692-9cd3-4d9e-9c93-73d76a604ce6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:21.790853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4e09f692-9cd3-4d9e-9c93-73d76a604ce6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:21.806321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e09f692-9cd3-4d9e-9c93-73d76a604ce6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:21.806780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e09f692-9cd3-4d9e-9c93-73d76a604ce6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:21.807583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e09f692-9cd3-4d9e-9c93-73d76a604ce6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:21.808025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e09f692-9cd3-4d9e-9c93-73d76a604ce6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:21.928258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4e09f692-9cd3-4d9e-9c93-73d76a604ce6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:21.938689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4e09f692-9cd3-4d9e-9c93-73d76a604ce6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:21.940510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4e09f692-9cd3-4d9e-9c93-73d76a604ce6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:21.942420 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4e09f692-9cd3-4d9e-9c93-73d76a604ce6 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1407 microversion: 2.54 time: 0.157495 Jan 22 21:13:21.955484 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2188/4540] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:21 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:13:21.961526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-020d6a78-ae7f-4687-8316-3324cadad10c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:21.962504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-020d6a78-ae7f-4687-8316-3324cadad10c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:21.969791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-020d6a78-ae7f-4687-8316-3324cadad10c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:21.970251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-020d6a78-ae7f-4687-8316-3324cadad10c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:21.971065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-020d6a78-ae7f-4687-8316-3324cadad10c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:21.971677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-020d6a78-ae7f-4687-8316-3324cadad10c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:22.036395 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-020d6a78-ae7f-4687-8316-3324cadad10c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.080386 Jan 22 21:13:22.037583 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2189/4541] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:21 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:22.043841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3cdea3d7-b979-4794-a930-4e85a9e1cd02 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:22.044002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-243c4bc4-2281-4c5c-8533-5701a798ae0a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Updating instance_info_cache with network_info: [{"id": "208377a2-2e65-4185-94a6-ce2de003a880", "address": "fa:16:3e:53:b5:da", "network": {"id": "11c5d3c2-f473-483b-8127-34bbf3efe45d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1105396235-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8fee2320503f41948e06d83350863358", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap208377a2-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137032) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 22 21:13:22.045077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3cdea3d7-b979-4794-a930-4e85a9e1cd02 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:22.052396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cdea3d7-b979-4794-a930-4e85a9e1cd02 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:22.052996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cdea3d7-b979-4794-a930-4e85a9e1cd02 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:22.053848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cdea3d7-b979-4794-a930-4e85a9e1cd02 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:22.055117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cdea3d7-b979-4794-a930-4e85a9e1cd02 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:22.113244 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3cdea3d7-b979-4794-a930-4e85a9e1cd02 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.074162 Jan 22 21:13:22.119222 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2190/4542] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:22 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:22.139286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-243c4bc4-2281-4c5c-8533-5701a798ae0a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Releasing lock "refresh_cache-3b77cc52-a232-427f-9304-a151f4110d69" {{(pid=137032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 22 21:13:22.140182 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-243c4bc4-2281-4c5c-8533-5701a798ae0a tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "POST /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69/action" status: 202 len: 0 microversion: 2.1 time: 2.698612 Jan 22 21:13:22.140800 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2353/4543] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:19 2022] POST /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69/action => generated 0 bytes in 2700 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 22 21:13:22.150242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-75a10c67-eb09-4551-b9dc-4deb524d2728 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.153"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:22.151428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-75a10c67-eb09-4551-b9dc-4deb524d2728 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:22.158117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75a10c67-eb09-4551-b9dc-4deb524d2728 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:22.158572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75a10c67-eb09-4551-b9dc-4deb524d2728 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:22.159362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75a10c67-eb09-4551-b9dc-4deb524d2728 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:22.159819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75a10c67-eb09-4551-b9dc-4deb524d2728 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:22.172516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9ef52faf-b0d9-4531-b50e-e83cbe701dd6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:22.173525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9ef52faf-b0d9-4531-b50e-e83cbe701dd6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:22.181519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ef52faf-b0d9-4531-b50e-e83cbe701dd6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:22.183144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ef52faf-b0d9-4531-b50e-e83cbe701dd6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:22.183144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ef52faf-b0d9-4531-b50e-e83cbe701dd6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:22.183466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ef52faf-b0d9-4531-b50e-e83cbe701dd6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:22.192374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75a10c67-eb09-4551-b9dc-4deb524d2728 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Acquired lock "refresh_cache-a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 22 21:13:22.224367 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9ef52faf-b0d9-4531-b50e-e83cbe701dd6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 14 microversion: 2.20 time: 0.055619 Jan 22 21:13:22.225161 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2354/4544] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:22 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:22.824641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2025814837", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:22.875516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:13:23.099412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:13:23.099839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:13:23.100348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:13:23.100755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:13:23.102197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:13:23.115249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:23.115701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:23.116528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:23.117009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:23.134616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Getting quotas for project fb6cd65ef53949b2a4bbdae54953280d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:13:23.139729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Getting quotas for user 8ee6e2c7f8d44322839477c3b5ee84d9 and project fb6cd65ef53949b2a4bbdae54953280d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:13:23.152833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:13:23.155335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:13:23.334747 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5ad77418-7b9c-43d3-8b71-b231a43299e7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.676519 Jan 22 21:13:23.335321 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2355/4545] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:13:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:13:23.340427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-13dcf601-0186-4e98-b48c-61651c889755 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:23.341037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-13dcf601-0186-4e98-b48c-61651c889755 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:23.347798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13dcf601-0186-4e98-b48c-61651c889755 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:23.348714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13dcf601-0186-4e98-b48c-61651c889755 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:23.349808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13dcf601-0186-4e98-b48c-61651c889755 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:23.350265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13dcf601-0186-4e98-b48c-61651c889755 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:23.388840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13dcf601-0186-4e98-b48c-61651c889755 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:23.389456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13dcf601-0186-4e98-b48c-61651c889755 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:23.390178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-13dcf601-0186-4e98-b48c-61651c889755 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lazy-loading 'fault' on Instance uuid dd68a721-84e0-4cd5-b986-49d31a56d2b8 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:13:23.442528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13dcf601-0186-4e98-b48c-61651c889755 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:23.451553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13dcf601-0186-4e98-b48c-61651c889755 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:23.453231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13dcf601-0186-4e98-b48c-61651c889755 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afa5e585e014cdcbde4e76a1cd7d2d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaafee1e7fe4f07a3e523bcc5d9141b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:23.454809 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-13dcf601-0186-4e98-b48c-61651c889755 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 200 len: 1412 microversion: 2.54 time: 0.117823 Jan 22 21:13:23.457655 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2356/4546] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:23 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:23.470843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1619cecb-df5c-4d48-b758-ded45de71937 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:23.472106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1619cecb-df5c-4d48-b758-ded45de71937 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:23.481754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1619cecb-df5c-4d48-b758-ded45de71937 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:23.481754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1619cecb-df5c-4d48-b758-ded45de71937 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:23.481754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1619cecb-df5c-4d48-b758-ded45de71937 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:23.481754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1619cecb-df5c-4d48-b758-ded45de71937 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:23.523411 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1619cecb-df5c-4d48-b758-ded45de71937 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.064140 Jan 22 21:13:23.528248 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2357/4547] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:23 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:23.530662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-44e8b901-d190-44e5-ae61-115aaa8e5533 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:23.531715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-44e8b901-d190-44e5-ae61-115aaa8e5533 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:23.541328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44e8b901-d190-44e5-ae61-115aaa8e5533 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:23.541824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44e8b901-d190-44e5-ae61-115aaa8e5533 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:23.543958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44e8b901-d190-44e5-ae61-115aaa8e5533 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:23.543958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44e8b901-d190-44e5-ae61-115aaa8e5533 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:23.589543 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-44e8b901-d190-44e5-ae61-115aaa8e5533 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.062499 Jan 22 21:13:23.591494 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2358/4548] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:23 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:23.596978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f9f162e3-dbb4-471f-8eb8-5d165ad219a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:23.598157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f9f162e3-dbb4-471f-8eb8-5d165ad219a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:23.606286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9f162e3-dbb4-471f-8eb8-5d165ad219a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:23.606813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9f162e3-dbb4-471f-8eb8-5d165ad219a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:23.607614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9f162e3-dbb4-471f-8eb8-5d165ad219a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:23.608060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9f162e3-dbb4-471f-8eb8-5d165ad219a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:23.648485 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f9f162e3-dbb4-471f-8eb8-5d165ad219a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 14 microversion: 2.20 time: 0.054831 Jan 22 21:13:23.650585 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2359/4549] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:23 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:23.656769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d97ee0b-989b-49cd-8a6b-45d345ddf6c6 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:23.657640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d97ee0b-989b-49cd-8a6b-45d345ddf6c6 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:23.713949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5d97ee0b-989b-49cd-8a6b-45d345ddf6c6 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:23.722317 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d97ee0b-989b-49cd-8a6b-45d345ddf6c6 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1226 microversion: 2.1 time: 0.071181 Jan 22 21:13:23.723080 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2360/4550] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:23 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1226 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:24.100967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b82483c7-a8fe-4992-be85-878f280034a0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:24.101905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b82483c7-a8fe-4992-be85-878f280034a0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:24.108162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b82483c7-a8fe-4992-be85-878f280034a0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:24.119249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b82483c7-a8fe-4992-be85-878f280034a0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:24.119249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b82483c7-a8fe-4992-be85-878f280034a0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:24.119249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b82483c7-a8fe-4992-be85-878f280034a0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:24.137771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b82483c7-a8fe-4992-be85-878f280034a0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:13:24.479961 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b82483c7-a8fe-4992-be85-878f280034a0 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "DELETE /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 204 len: 0 microversion: 2.1 time: 0.382084 Jan 22 21:13:24.480575 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2361/4551] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:13:24 2022] DELETE /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:13:24.487091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1b406c0b-a6e4-48d3-a8a0-b5ca7a177688 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:24.487880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1b406c0b-a6e4-48d3-a8a0-b5ca7a177688 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] [instance: dd68a721-84e0-4cd5-b986-49d31a56d2b8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:24.494313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b406c0b-a6e4-48d3-a8a0-b5ca7a177688 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:24.494777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b406c0b-a6e4-48d3-a8a0-b5ca7a177688 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:24.495637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b406c0b-a6e4-48d3-a8a0-b5ca7a177688 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:24.496089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b406c0b-a6e4-48d3-a8a0-b5ca7a177688 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:24.511108 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-1b406c0b-a6e4-48d3-a8a0-b5ca7a177688 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] HTTP exception thrown: Instance dd68a721-84e0-4cd5-b986-49d31a56d2b8 could not be found. Jan 22 21:13:24.511725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1b406c0b-a6e4-48d3-a8a0-b5ca7a177688 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] Returning 404 to user: Instance dd68a721-84e0-4cd5-b986-49d31a56d2b8 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:13:24.512583 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1b406c0b-a6e4-48d3-a8a0-b5ca7a177688 tempest-ServerShowV254Test-1901568540 tempest-ServerShowV254Test-1901568540-project] 10.222.0.100 "GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8" status: 404 len: 111 microversion: 2.54 time: 0.029541 Jan 22 21:13:24.513207 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2362/4552] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:13:24 2022] GET /compute/v2.1/servers/dd68a721-84e0-4cd5-b986-49d31a56d2b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:13:24.518182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e49d91fb-bf4d-4733-a673-c874240636c2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:24.518345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e49d91fb-bf4d-4733-a673-c874240636c2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:24.525887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e49d91fb-bf4d-4733-a673-c874240636c2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:24.526348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e49d91fb-bf4d-4733-a673-c874240636c2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:24.527158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e49d91fb-bf4d-4733-a673-c874240636c2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:24.527616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e49d91fb-bf4d-4733-a673-c874240636c2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:24.697797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e49d91fb-bf4d-4733-a673-c874240636c2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:24.706150 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e49d91fb-bf4d-4733-a673-c874240636c2 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1507 microversion: 2.1 time: 0.191866 Jan 22 21:13:24.706742 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2363/4553] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:24 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:24.712039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0752b840-1eba-4c7d-bcc8-b45810768b0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:24.712952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0752b840-1eba-4c7d-bcc8-b45810768b0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:24.720092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0752b840-1eba-4c7d-bcc8-b45810768b0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:24.720553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0752b840-1eba-4c7d-bcc8-b45810768b0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:24.721371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0752b840-1eba-4c7d-bcc8-b45810768b0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:24.721856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0752b840-1eba-4c7d-bcc8-b45810768b0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:24.766912 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0752b840-1eba-4c7d-bcc8-b45810768b0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.058750 Jan 22 21:13:24.770969 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2364/4554] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:24 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:24.775970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-22a06fd5-cfce-4c09-b2be-1faf515c40bd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:24.777097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-22a06fd5-cfce-4c09-b2be-1faf515c40bd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:24.784240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22a06fd5-cfce-4c09-b2be-1faf515c40bd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:24.784702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22a06fd5-cfce-4c09-b2be-1faf515c40bd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:24.785558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22a06fd5-cfce-4c09-b2be-1faf515c40bd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:24.786019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22a06fd5-cfce-4c09-b2be-1faf515c40bd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:24.828657 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-22a06fd5-cfce-4c09-b2be-1faf515c40bd tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.059375 Jan 22 21:13:24.830411 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2365/4555] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:24 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:24.834743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c39eff59-e7dd-4f88-b9b3-e31421723b3b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:24.835937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c39eff59-e7dd-4f88-b9b3-e31421723b3b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:24.844347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c39eff59-e7dd-4f88-b9b3-e31421723b3b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:24.844820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c39eff59-e7dd-4f88-b9b3-e31421723b3b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:24.845716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c39eff59-e7dd-4f88-b9b3-e31421723b3b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:24.846175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c39eff59-e7dd-4f88-b9b3-e31421723b3b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:24.890365 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c39eff59-e7dd-4f88-b9b3-e31421723b3b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 14 microversion: 2.20 time: 0.059572 Jan 22 21:13:24.891440 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2366/4556] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:24 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:24.896376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-133bb666-926e-4760-8432-a53bfd662757 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:24.897078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-133bb666-926e-4760-8432-a53bfd662757 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:24.904082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-133bb666-926e-4760-8432-a53bfd662757 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:24.904596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-133bb666-926e-4760-8432-a53bfd662757 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:24.905468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-133bb666-926e-4760-8432-a53bfd662757 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:24.905952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-133bb666-926e-4760-8432-a53bfd662757 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:24.988019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-133bb666-926e-4760-8432-a53bfd662757 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:24.998571 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-133bb666-926e-4760-8432-a53bfd662757 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1222 microversion: 2.1 time: 0.105779 Jan 22 21:13:25.000189 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2367/4557] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:24 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:25.345523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-aca7bb79-93b4-4d4d-a1b6-c96fd709ac4d req-8390483e-5e00-4ea2-ab3f-8d9fc56a15d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b77cc52-a232-427f-9304-a151f4110d69", "tag": "208377a2-2e65-4185-94a6-ce2de003a880"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:25.348201 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:25.348201 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:13:25.359525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-aca7bb79-93b4-4d4d-a1b6-c96fd709ac4d req-8390483e-5e00-4ea2-ab3f-8d9fc56a15d0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:25.360628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-aca7bb79-93b4-4d4d-a1b6-c96fd709ac4d req-8390483e-5e00-4ea2-ab3f-8d9fc56a15d0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:25.384923 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-aca7bb79-93b4-4d4d-a1b6-c96fd709ac4d req-8390483e-5e00-4ea2-ab3f-8d9fc56a15d0 service nova] Creating event network-changed:208377a2-2e65-4185-94a6-ce2de003a880 for instance 3b77cc52-a232-427f-9304-a151f4110d69 on nch2-master-1 Jan 22 21:13:25.390677 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-aca7bb79-93b4-4d4d-a1b6-c96fd709ac4d req-8390483e-5e00-4ea2-ab3f-8d9fc56a15d0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050934 Jan 22 21:13:25.392218 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2368/4558] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:25.462835 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.network.neutron [None req-75a10c67-eb09-4551-b9dc-4deb524d2728 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] re-assign floating IP 172.35.1.153 from instance 3b77cc52-a232-427f-9304-a151f4110d69 Jan 22 21:13:25.537457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-75a10c67-eb09-4551-b9dc-4deb524d2728 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Building network info cache for instance {{(pid=137033) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 22 21:13:25.728969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-43da6ea3-8168-4551-906d-2fe50c496318 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:25.729452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-43da6ea3-8168-4551-906d-2fe50c496318 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:25.737719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43da6ea3-8168-4551-906d-2fe50c496318 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:25.738185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43da6ea3-8168-4551-906d-2fe50c496318 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:25.739502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43da6ea3-8168-4551-906d-2fe50c496318 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:25.739903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43da6ea3-8168-4551-906d-2fe50c496318 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:25.969004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-43da6ea3-8168-4551-906d-2fe50c496318 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:25.978839 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-43da6ea3-8168-4551-906d-2fe50c496318 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1507 microversion: 2.1 time: 0.258202 Jan 22 21:13:25.988807 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2369/4559] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:25 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1507 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:25.988807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a7e0c74c-dd6c-407a-9e99-3239d0cb9a7b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:25.988807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a7e0c74c-dd6c-407a-9e99-3239d0cb9a7b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:26.002912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7e0c74c-dd6c-407a-9e99-3239d0cb9a7b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:26.003230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7e0c74c-dd6c-407a-9e99-3239d0cb9a7b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:26.012939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7e0c74c-dd6c-407a-9e99-3239d0cb9a7b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:26.012939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7e0c74c-dd6c-407a-9e99-3239d0cb9a7b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:26.064124 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a7e0c74c-dd6c-407a-9e99-3239d0cb9a7b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.082681 Jan 22 21:13:26.064931 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2370/4560] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:25 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:26.070715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-85c1cd83-9b75-416d-9e0a-6b4d570e7ad7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:26.072006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-85c1cd83-9b75-416d-9e0a-6b4d570e7ad7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:26.079399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85c1cd83-9b75-416d-9e0a-6b4d570e7ad7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:26.079856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85c1cd83-9b75-416d-9e0a-6b4d570e7ad7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:26.080659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85c1cd83-9b75-416d-9e0a-6b4d570e7ad7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:26.081112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85c1cd83-9b75-416d-9e0a-6b4d570e7ad7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:26.145401 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-85c1cd83-9b75-416d-9e0a-6b4d570e7ad7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.079024 Jan 22 21:13:26.148304 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2371/4561] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:26 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:26.154647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-18d62843-30f4-4deb-af21-2e6f03abcd7f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:26.155816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-18d62843-30f4-4deb-af21-2e6f03abcd7f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:26.183037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18d62843-30f4-4deb-af21-2e6f03abcd7f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:26.183653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18d62843-30f4-4deb-af21-2e6f03abcd7f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:26.184729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18d62843-30f4-4deb-af21-2e6f03abcd7f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:26.185263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18d62843-30f4-4deb-af21-2e6f03abcd7f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:26.233075 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-18d62843-30f4-4deb-af21-2e6f03abcd7f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 14 microversion: 2.20 time: 0.082983 Jan 22 21:13:26.236323 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2372/4562] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:26 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:26.240174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-28fdb50a-1d49-42fa-9eac-de1b8898d927 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:26.241030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-28fdb50a-1d49-42fa-9eac-de1b8898d927 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:26.250709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28fdb50a-1d49-42fa-9eac-de1b8898d927 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:26.251413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28fdb50a-1d49-42fa-9eac-de1b8898d927 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:26.252327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28fdb50a-1d49-42fa-9eac-de1b8898d927 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:26.258146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28fdb50a-1d49-42fa-9eac-de1b8898d927 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:26.358103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-28fdb50a-1d49-42fa-9eac-de1b8898d927 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:26.369522 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-28fdb50a-1d49-42fa-9eac-de1b8898d927 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1284 microversion: 2.1 time: 0.133939 Jan 22 21:13:26.370256 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2373/4563] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:26 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:26.995745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-95445d81-28db-4180-8cfb-f9311f92229d tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:26.996556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-95445d81-28db-4180-8cfb-f9311f92229d tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:27.004039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95445d81-28db-4180-8cfb-f9311f92229d tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:27.006200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95445d81-28db-4180-8cfb-f9311f92229d tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:27.009820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95445d81-28db-4180-8cfb-f9311f92229d tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:27.014274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95445d81-28db-4180-8cfb-f9311f92229d tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:27.178814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-75a10c67-eb09-4551-b9dc-4deb524d2728 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Updating instance_info_cache with network_info: [{"id": "208377a2-2e65-4185-94a6-ce2de003a880", "address": "fa:16:3e:53:b5:da", "network": {"id": "11c5d3c2-f473-483b-8127-34bbf3efe45d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1105396235-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8fee2320503f41948e06d83350863358", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap208377a2-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137033) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 22 21:13:27.191277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-75a10c67-eb09-4551-b9dc-4deb524d2728 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Building network info cache for instance {{(pid=137033) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 22 21:13:27.201245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-95445d81-28db-4180-8cfb-f9311f92229d tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:27.209116 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-95445d81-28db-4180-8cfb-f9311f92229d tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1507 microversion: 2.1 time: 0.217434 Jan 22 21:13:27.210365 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2374/4564] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:26 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:27.216898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-86e75db2-96f4-4c82-8c21-2197c8515cb7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:27.218289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-86e75db2-96f4-4c82-8c21-2197c8515cb7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:27.225493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86e75db2-96f4-4c82-8c21-2197c8515cb7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:27.226964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86e75db2-96f4-4c82-8c21-2197c8515cb7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:27.228167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86e75db2-96f4-4c82-8c21-2197c8515cb7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:27.228776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86e75db2-96f4-4c82-8c21-2197c8515cb7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:27.280260 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-86e75db2-96f4-4c82-8c21-2197c8515cb7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.067688 Jan 22 21:13:27.281720 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2375/4565] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:27 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:27.287608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08756dc1-f8e8-4d8c-8c4e-256ff7aad415 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:27.289183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-08756dc1-f8e8-4d8c-8c4e-256ff7aad415 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:27.297023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08756dc1-f8e8-4d8c-8c4e-256ff7aad415 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:27.297415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08756dc1-f8e8-4d8c-8c4e-256ff7aad415 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:27.298245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08756dc1-f8e8-4d8c-8c4e-256ff7aad415 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:27.298685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08756dc1-f8e8-4d8c-8c4e-256ff7aad415 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:27.350223 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-08756dc1-f8e8-4d8c-8c4e-256ff7aad415 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.066782 Jan 22 21:13:27.351878 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2376/4566] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:27 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:27.357980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1983a601-927a-4264-bedf-1f5f3b03a46b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:27.359011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1983a601-927a-4264-bedf-1f5f3b03a46b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:27.368116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1983a601-927a-4264-bedf-1f5f3b03a46b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:27.368572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1983a601-927a-4264-bedf-1f5f3b03a46b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:27.369368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1983a601-927a-4264-bedf-1f5f3b03a46b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:27.370129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1983a601-927a-4264-bedf-1f5f3b03a46b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:27.426800 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1983a601-927a-4264-bedf-1f5f3b03a46b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 14 microversion: 2.20 time: 0.073302 Jan 22 21:13:27.431803 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2377/4567] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:27 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:27.436369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-643910fd-96c1-41a7-a4e8-ca2193a0421c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:27.437658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-643910fd-96c1-41a7-a4e8-ca2193a0421c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:27.450908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-643910fd-96c1-41a7-a4e8-ca2193a0421c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:27.451683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-643910fd-96c1-41a7-a4e8-ca2193a0421c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:27.452764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-643910fd-96c1-41a7-a4e8-ca2193a0421c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:27.453217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-643910fd-96c1-41a7-a4e8-ca2193a0421c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:27.543772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-643910fd-96c1-41a7-a4e8-ca2193a0421c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:27.553674 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-643910fd-96c1-41a7-a4e8-ca2193a0421c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1284 microversion: 2.1 time: 0.123488 Jan 22 21:13:27.557571 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2378/4568] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:27 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:27.559616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-3f815300-c3de-4557-be30-0ac10e9f0461 req-58a935ea-6597-4cd7-8ea3-54eff1cb48bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a142f83a-c576-4972-a9f4-0d2e8ac5d0d5", "tag": "47e5ddad-21d0-45de-bfef-390954745b7c"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:27.561133 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:27.561133 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:13:27.568493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-3f815300-c3de-4557-be30-0ac10e9f0461 req-58a935ea-6597-4cd7-8ea3-54eff1cb48bd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:27.569092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-3f815300-c3de-4557-be30-0ac10e9f0461 req-58a935ea-6597-4cd7-8ea3-54eff1cb48bd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:27.581969 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-3f815300-c3de-4557-be30-0ac10e9f0461 req-58a935ea-6597-4cd7-8ea3-54eff1cb48bd service nova] Creating event network-changed:47e5ddad-21d0-45de-bfef-390954745b7c for instance a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 on nch1-master-1 Jan 22 21:13:27.587654 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-3f815300-c3de-4557-be30-0ac10e9f0461 req-58a935ea-6597-4cd7-8ea3-54eff1cb48bd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031621 Jan 22 21:13:27.589137 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2379/4569] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:28.229300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b9f7f0c3-24cd-4ced-87c6-9f38e52499ac tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:28.230817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b9f7f0c3-24cd-4ced-87c6-9f38e52499ac tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:28.237278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9f7f0c3-24cd-4ced-87c6-9f38e52499ac tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:28.237890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9f7f0c3-24cd-4ced-87c6-9f38e52499ac tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:28.238776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9f7f0c3-24cd-4ced-87c6-9f38e52499ac tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:28.239299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9f7f0c3-24cd-4ced-87c6-9f38e52499ac tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:28.276067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9f7f0c3-24cd-4ced-87c6-9f38e52499ac tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:28.276522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9f7f0c3-24cd-4ced-87c6-9f38e52499ac tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:28.276988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-b9f7f0c3-24cd-4ced-87c6-9f38e52499ac tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lazy-loading 'fault' on Instance uuid bf9918df-8a8e-48ab-a9a2-05922a783d69 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:13:28.334037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b9f7f0c3-24cd-4ced-87c6-9f38e52499ac tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08db8a972cc0443282eabcc89f0033d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda1afcb57254df4b0dc8a26bd9d297c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:28.342480 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b9f7f0c3-24cd-4ced-87c6-9f38e52499ac tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 200 len: 1308 microversion: 2.1 time: 0.118510 Jan 22 21:13:28.352653 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2380/4570] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:28 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 1308 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:28.352653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f4ef149e-1606-4a3f-9391-219467cf3369 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:28.352653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f4ef149e-1606-4a3f-9391-219467cf3369 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:28.360437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4ef149e-1606-4a3f-9391-219467cf3369 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:28.361227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4ef149e-1606-4a3f-9391-219467cf3369 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:28.361757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4ef149e-1606-4a3f-9391-219467cf3369 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:28.370362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4ef149e-1606-4a3f-9391-219467cf3369 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:28.420425 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f4ef149e-1606-4a3f-9391-219467cf3369 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.076049 Jan 22 21:13:28.425599 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2381/4571] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:28 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:28.432012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-29962a1f-60b2-42bc-8794-2f3a98b2197f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:28.433582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-29962a1f-60b2-42bc-8794-2f3a98b2197f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:28.441901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29962a1f-60b2-42bc-8794-2f3a98b2197f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:28.442362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29962a1f-60b2-42bc-8794-2f3a98b2197f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:28.443384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29962a1f-60b2-42bc-8794-2f3a98b2197f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:28.443995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29962a1f-60b2-42bc-8794-2f3a98b2197f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:28.494982 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-29962a1f-60b2-42bc-8794-2f3a98b2197f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.067243 Jan 22 21:13:28.498972 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2382/4572] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:28 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:28.510924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-173c06b5-7c39-481d-a13a-7b4c3995c68e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:28.512040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-173c06b5-7c39-481d-a13a-7b4c3995c68e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:28.519771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-173c06b5-7c39-481d-a13a-7b4c3995c68e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:28.520323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-173c06b5-7c39-481d-a13a-7b4c3995c68e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:28.521204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-173c06b5-7c39-481d-a13a-7b4c3995c68e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:28.521782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-173c06b5-7c39-481d-a13a-7b4c3995c68e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:28.583395 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-173c06b5-7c39-481d-a13a-7b4c3995c68e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 8207 microversion: 2.20 time: 0.077663 Jan 22 21:13:28.587376 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2383/4573] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:28 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 8207 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:13:28.590622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c4ff94e6-8074-47f7-ac1e-6a543cafc206 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:28.590992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c4ff94e6-8074-47f7-ac1e-6a543cafc206 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:28.598621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4ff94e6-8074-47f7-ac1e-6a543cafc206 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:28.599153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4ff94e6-8074-47f7-ac1e-6a543cafc206 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:28.599949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4ff94e6-8074-47f7-ac1e-6a543cafc206 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:28.600454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4ff94e6-8074-47f7-ac1e-6a543cafc206 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:28.772373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c4ff94e6-8074-47f7-ac1e-6a543cafc206 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:28.781425 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c4ff94e6-8074-47f7-ac1e-6a543cafc206 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1326 microversion: 2.1 time: 0.195894 Jan 22 21:13:28.782067 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2384/4574] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:28 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1326 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:28.798206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-75a10c67-eb09-4551-b9dc-4deb524d2728 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Updating instance_info_cache with network_info: [{"id": "47e5ddad-21d0-45de-bfef-390954745b7c", "address": "fa:16:3e:1c:e1:8d", "network": {"id": "11c5d3c2-f473-483b-8127-34bbf3efe45d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1105396235-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8fee2320503f41948e06d83350863358", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap47e5ddad-21", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137033) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 22 21:13:28.900891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75a10c67-eb09-4551-b9dc-4deb524d2728 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Releasing lock "refresh_cache-a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 22 21:13:28.901848 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-75a10c67-eb09-4551-b9dc-4deb524d2728 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "POST /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5/action" status: 202 len: 0 microversion: 2.1 time: 6.756357 Jan 22 21:13:28.906577 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2191/4575] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:22 2022] POST /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5/action => generated 0 bytes in 6759 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 22 21:13:28.916902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-058e96c4-10b2-4cd5-b1a8-25270a25a47c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Action: 'action', calling method: .version_select at 0x7f1ed84975e0>, body: {"removeFloatingIp": {"address": "172.35.1.153"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:29.104636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-058e96c4-10b2-4cd5-b1a8-25270a25a47c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:29.111961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-058e96c4-10b2-4cd5-b1a8-25270a25a47c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:29.115935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-058e96c4-10b2-4cd5-b1a8-25270a25a47c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:29.115935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-058e96c4-10b2-4cd5-b1a8-25270a25a47c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:29.115935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-058e96c4-10b2-4cd5-b1a8-25270a25a47c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:29.350331 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-058e96c4-10b2-4cd5-b1a8-25270a25a47c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] HTTP exception thrown: Floating IP 172.35.1.153 is not associated with instance 3b77cc52-a232-427f-9304-a151f4110d69. Jan 22 21:13:29.351116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-058e96c4-10b2-4cd5-b1a8-25270a25a47c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Returning 409 to user: Floating IP 172.35.1.153 is not associated with instance 3b77cc52-a232-427f-9304-a151f4110d69. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:13:29.352078 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-058e96c4-10b2-4cd5-b1a8-25270a25a47c tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "POST /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69/action" status: 409 len: 146 microversion: 2.1 time: 0.443812 Jan 22 21:13:29.355730 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2385/4576] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:28 2022] POST /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69/action => generated 146 bytes in 446 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:13:29.366626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-86122614-3b0d-40d9-b132-01a871f9dd26 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:29.366626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-86122614-3b0d-40d9-b132-01a871f9dd26 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] [instance: bf9918df-8a8e-48ab-a9a2-05922a783d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:29.368925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bd256128-7ecd-4322-84f9-6caa6407dfa9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.153"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:29.369396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86122614-3b0d-40d9-b132-01a871f9dd26 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:29.369733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86122614-3b0d-40d9-b132-01a871f9dd26 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:29.370409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86122614-3b0d-40d9-b132-01a871f9dd26 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:29.370863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86122614-3b0d-40d9-b132-01a871f9dd26 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:29.390761 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-86122614-3b0d-40d9-b132-01a871f9dd26 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] HTTP exception thrown: Instance bf9918df-8a8e-48ab-a9a2-05922a783d69 could not be found. Jan 22 21:13:29.391613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-86122614-3b0d-40d9-b132-01a871f9dd26 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] Returning 404 to user: Instance bf9918df-8a8e-48ab-a9a2-05922a783d69 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:13:29.392572 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-86122614-3b0d-40d9-b132-01a871f9dd26 tempest-VolumesActionsTest-2008934241 tempest-VolumesActionsTest-2008934241-project] 10.222.0.100 "GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69" status: 404 len: 111 microversion: 2.1 time: 0.036143 Jan 22 21:13:29.398559 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2192/4577] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:29 2022] GET /compute/v2.1/servers/bf9918df-8a8e-48ab-a9a2-05922a783d69 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:13:29.443889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fae33583-36cf-4fa7-876f-427e0ae0608f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:29.445732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fae33583-36cf-4fa7-876f-427e0ae0608f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:29.452941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fae33583-36cf-4fa7-876f-427e0ae0608f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:29.453404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fae33583-36cf-4fa7-876f-427e0ae0608f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:29.454487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fae33583-36cf-4fa7-876f-427e0ae0608f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:29.454940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fae33583-36cf-4fa7-876f-427e0ae0608f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:29.498413 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fae33583-36cf-4fa7-876f-427e0ae0608f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.068863 Jan 22 21:13:29.499520 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2193/4578] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:29 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:29.506447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0acfa5a2-1370-43c6-8e8b-7709382e1599 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:29.508051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0acfa5a2-1370-43c6-8e8b-7709382e1599 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:29.515034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0acfa5a2-1370-43c6-8e8b-7709382e1599 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:29.515730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0acfa5a2-1370-43c6-8e8b-7709382e1599 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:29.517179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0acfa5a2-1370-43c6-8e8b-7709382e1599 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:29.518534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0acfa5a2-1370-43c6-8e8b-7709382e1599 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:29.524681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bd256128-7ecd-4322-84f9-6caa6407dfa9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:29.532127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd256128-7ecd-4322-84f9-6caa6407dfa9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:29.534218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd256128-7ecd-4322-84f9-6caa6407dfa9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:29.534218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd256128-7ecd-4322-84f9-6caa6407dfa9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:29.534218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd256128-7ecd-4322-84f9-6caa6407dfa9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:29.568358 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0acfa5a2-1370-43c6-8e8b-7709382e1599 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.065561 Jan 22 21:13:29.569325 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2194/4579] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:29 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:29.595892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-689e1ef0-f6b2-4dd1-9d2d-022d8c9265e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:29.597044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-689e1ef0-f6b2-4dd1-9d2d-022d8c9265e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:29.604937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-689e1ef0-f6b2-4dd1-9d2d-022d8c9265e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:29.605662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-689e1ef0-f6b2-4dd1-9d2d-022d8c9265e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:29.610413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-689e1ef0-f6b2-4dd1-9d2d-022d8c9265e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:29.610413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-689e1ef0-f6b2-4dd1-9d2d-022d8c9265e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:29.658282 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-689e1ef0-f6b2-4dd1-9d2d-022d8c9265e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 8207 microversion: 2.20 time: 0.066280 Jan 22 21:13:29.660142 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2195/4580] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:29 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 8207 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:13:29.671965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-4625e413-c7af-4e8a-9ca9-62174ac6641f req-ca6c53e3-3194-4374-a08e-1ea0e7823e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9918df-8a8e-48ab-a9a2-05922a783d69", "name": "network-vif-deleted", "tag": "006b8beb-7ced-4e60-b992-5ea57c4c79d1"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:29.673840 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:29.673840 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:13:29.690784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4625e413-c7af-4e8a-9ca9-62174ac6641f req-ca6c53e3-3194-4374-a08e-1ea0e7823e12 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:29.690784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4625e413-c7af-4e8a-9ca9-62174ac6641f req-ca6c53e3-3194-4374-a08e-1ea0e7823e12 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:29.708485 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-4625e413-c7af-4e8a-9ca9-62174ac6641f req-ca6c53e3-3194-4374-a08e-1ea0e7823e12 service nova] Creating event network-vif-deleted:006b8beb-7ced-4e60-b992-5ea57c4c79d1 for instance bf9918df-8a8e-48ab-a9a2-05922a783d69 on nch1-master-1 Jan 22 21:13:29.728952 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-4625e413-c7af-4e8a-9ca9-62174ac6641f req-ca6c53e3-3194-4374-a08e-1ea0e7823e12 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060673 Jan 22 21:13:29.729922 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2196/4581] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:29.794673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd256128-7ecd-4322-84f9-6caa6407dfa9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Acquired lock "refresh_cache-a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" {{(pid=137032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 22 21:13:29.801173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-04110e00-1d30-4022-9771-a7e28e5e0b82 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:29.802050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-04110e00-1d30-4022-9771-a7e28e5e0b82 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:29.810922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04110e00-1d30-4022-9771-a7e28e5e0b82 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:29.811422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04110e00-1d30-4022-9771-a7e28e5e0b82 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:29.812383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04110e00-1d30-4022-9771-a7e28e5e0b82 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:29.813025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04110e00-1d30-4022-9771-a7e28e5e0b82 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:30.007855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-04110e00-1d30-4022-9771-a7e28e5e0b82 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:30.011880 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-04110e00-1d30-4022-9771-a7e28e5e0b82 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1326 microversion: 2.1 time: 0.215741 Jan 22 21:13:30.012464 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2197/4582] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:29 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1326 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:30.515172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ad6c3bdf-09af-4be4-9f13-9ee101fd0da6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:30.516980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ad6c3bdf-09af-4be4-9f13-9ee101fd0da6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:30.542685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad6c3bdf-09af-4be4-9f13-9ee101fd0da6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:30.547738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad6c3bdf-09af-4be4-9f13-9ee101fd0da6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:30.549312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad6c3bdf-09af-4be4-9f13-9ee101fd0da6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:30.550195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad6c3bdf-09af-4be4-9f13-9ee101fd0da6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:30.628830 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ad6c3bdf-09af-4be4-9f13-9ee101fd0da6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.121981 Jan 22 21:13:30.630079 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2198/4583] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:30 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:30.637662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dd065a18-d690-4dfb-beb9-de407ae044e0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:30.639838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dd065a18-d690-4dfb-beb9-de407ae044e0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:30.657069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd065a18-d690-4dfb-beb9-de407ae044e0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:30.658308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd065a18-d690-4dfb-beb9-de407ae044e0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:30.660131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd065a18-d690-4dfb-beb9-de407ae044e0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:30.660753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd065a18-d690-4dfb-beb9-de407ae044e0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:30.713269 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dd065a18-d690-4dfb-beb9-de407ae044e0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.080950 Jan 22 21:13:30.714732 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2199/4584] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:30 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:30.725263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-736c57e0-915e-4572-bc0a-24863d554f18 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:30.727588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-736c57e0-915e-4572-bc0a-24863d554f18 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:30.737668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-736c57e0-915e-4572-bc0a-24863d554f18 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:30.738462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-736c57e0-915e-4572-bc0a-24863d554f18 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:30.740350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-736c57e0-915e-4572-bc0a-24863d554f18 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:30.740886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-736c57e0-915e-4572-bc0a-24863d554f18 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:30.820041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-bd256128-7ecd-4322-84f9-6caa6407dfa9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Building network info cache for instance {{(pid=137032) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 22 21:13:30.826649 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-736c57e0-915e-4572-bc0a-24863d554f18 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 16401 microversion: 2.20 time: 0.108505 Jan 22 21:13:30.830442 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2200/4585] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:30 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 16401 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:30.869571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f5333816-5c82-4cac-84e1-29ce90cd6c40 req-02f47d01-646f-4f21-bdfa-3031a8d89855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a142f83a-c576-4972-a9f4-0d2e8ac5d0d5", "tag": "47e5ddad-21d0-45de-bfef-390954745b7c"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:30.871330 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:30.871330 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:13:30.879993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f5333816-5c82-4cac-84e1-29ce90cd6c40 req-02f47d01-646f-4f21-bdfa-3031a8d89855 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:30.880665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f5333816-5c82-4cac-84e1-29ce90cd6c40 req-02f47d01-646f-4f21-bdfa-3031a8d89855 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:30.897941 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f5333816-5c82-4cac-84e1-29ce90cd6c40 req-02f47d01-646f-4f21-bdfa-3031a8d89855 service nova] Creating event network-changed:47e5ddad-21d0-45de-bfef-390954745b7c for instance a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 on nch1-master-1 Jan 22 21:13:30.909192 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f5333816-5c82-4cac-84e1-29ce90cd6c40 req-02f47d01-646f-4f21-bdfa-3031a8d89855 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040224 Jan 22 21:13:30.909192 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2201/4586] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:13:31.033022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a612fdc6-ca92-4ed1-8a4b-6ef8feb6d48f tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:31.035508 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a612fdc6-ca92-4ed1-8a4b-6ef8feb6d48f tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:31.050435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a612fdc6-ca92-4ed1-8a4b-6ef8feb6d48f tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:31.051465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a612fdc6-ca92-4ed1-8a4b-6ef8feb6d48f tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:31.053542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a612fdc6-ca92-4ed1-8a4b-6ef8feb6d48f tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:31.056866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a612fdc6-ca92-4ed1-8a4b-6ef8feb6d48f tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:31.407078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a612fdc6-ca92-4ed1-8a4b-6ef8feb6d48f tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:31.427322 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a612fdc6-ca92-4ed1-8a4b-6ef8feb6d48f tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1326 microversion: 2.1 time: 0.396458 Jan 22 21:13:31.434968 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2202/4587] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:31 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1326 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:31.641018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee340674-a672-442b-b94f-fd62572f62e8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:31.642023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ee340674-a672-442b-b94f-fd62572f62e8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:31.652512 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee340674-a672-442b-b94f-fd62572f62e8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:31.652992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee340674-a672-442b-b94f-fd62572f62e8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:31.653854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee340674-a672-442b-b94f-fd62572f62e8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:31.654304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee340674-a672-442b-b94f-fd62572f62e8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:31.715184 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee340674-a672-442b-b94f-fd62572f62e8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.078215 Jan 22 21:13:31.716105 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2203/4588] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:31 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:31.727834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-87dc04a1-0e21-4dfa-9301-720894395bba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:31.728967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-87dc04a1-0e21-4dfa-9301-720894395bba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:31.736143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87dc04a1-0e21-4dfa-9301-720894395bba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:31.736605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87dc04a1-0e21-4dfa-9301-720894395bba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:31.737404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87dc04a1-0e21-4dfa-9301-720894395bba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:31.737979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87dc04a1-0e21-4dfa-9301-720894395bba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:31.784482 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-87dc04a1-0e21-4dfa-9301-720894395bba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.060434 Jan 22 21:13:31.789691 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2204/4589] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:31 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:31.797338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-c384e2a9-cb89-4838-89b3-09581ca1a583 req-14c20dac-638d-4591-9c23-7d47dd49feae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab34a474-341d-4204-9616-72afb1140379", "tag": "8f698936-2040-48a0-b71f-e6239702bdc3"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:31.800436 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:31.800436 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:13:31.807873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-bd256128-7ecd-4322-84f9-6caa6407dfa9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Updating instance_info_cache with network_info: [{"id": "47e5ddad-21d0-45de-bfef-390954745b7c", "address": "fa:16:3e:1c:e1:8d", "network": {"id": "11c5d3c2-f473-483b-8127-34bbf3efe45d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1105396235-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8fee2320503f41948e06d83350863358", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap47e5ddad-21", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137032) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 22 21:13:31.808802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c384e2a9-cb89-4838-89b3-09581ca1a583 req-14c20dac-638d-4591-9c23-7d47dd49feae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:31.809305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c384e2a9-cb89-4838-89b3-09581ca1a583 req-14c20dac-638d-4591-9c23-7d47dd49feae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:31.820040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd256128-7ecd-4322-84f9-6caa6407dfa9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Releasing lock "refresh_cache-a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" {{(pid=137032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 22 21:13:31.821002 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bd256128-7ecd-4322-84f9-6caa6407dfa9 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "POST /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5/action" status: 202 len: 0 microversion: 2.1 time: 2.456045 Jan 22 21:13:31.822032 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2386/4590] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:29 2022] POST /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5/action => generated 0 bytes in 2457 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 22 21:13:31.823494 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-c384e2a9-cb89-4838-89b3-09581ca1a583 req-14c20dac-638d-4591-9c23-7d47dd49feae service nova] Creating event network-changed:8f698936-2040-48a0-b71f-e6239702bdc3 for instance ab34a474-341d-4204-9616-72afb1140379 on nch2-master-1 Jan 22 21:13:31.829283 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-c384e2a9-cb89-4838-89b3-09581ca1a583 req-14c20dac-638d-4591-9c23-7d47dd49feae service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042070 Jan 22 21:13:31.830261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3914ad8f-acf7-45a7-ba45-61b26f0eb1fc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:31.830555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3914ad8f-acf7-45a7-ba45-61b26f0eb1fc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:31.833353 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2205/4591] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:31.838685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3914ad8f-acf7-45a7-ba45-61b26f0eb1fc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:31.839478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3914ad8f-acf7-45a7-ba45-61b26f0eb1fc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:31.840592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3914ad8f-acf7-45a7-ba45-61b26f0eb1fc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:31.841612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3914ad8f-acf7-45a7-ba45-61b26f0eb1fc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:31.842896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c519c9fd-e27d-45d0-bdd7-641a662cb54f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:31.843914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c519c9fd-e27d-45d0-bdd7-641a662cb54f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:31.852392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c519c9fd-e27d-45d0-bdd7-641a662cb54f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:31.853186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c519c9fd-e27d-45d0-bdd7-641a662cb54f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:31.854223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c519c9fd-e27d-45d0-bdd7-641a662cb54f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:31.861716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c519c9fd-e27d-45d0-bdd7-641a662cb54f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:31.876594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3914ad8f-acf7-45a7-ba45-61b26f0eb1fc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:13:31.930193 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c519c9fd-e27d-45d0-bdd7-641a662cb54f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 16401 microversion: 2.20 time: 0.088147 Jan 22 21:13:31.930193 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2206/4592] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:31 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 16401 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:32.206469 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3914ad8f-acf7-45a7-ba45-61b26f0eb1fc tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 204 len: 0 microversion: 2.1 time: 0.378636 Jan 22 21:13:32.217411 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2387/4593] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:13:31 2022] DELETE /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:13:32.219865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1b89cc48-0b50-4cb5-8609-5cab9f2071bd tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.153"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:32.221168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1b89cc48-0b50-4cb5-8609-5cab9f2071bd tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:32.229620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b89cc48-0b50-4cb5-8609-5cab9f2071bd tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:32.231549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b89cc48-0b50-4cb5-8609-5cab9f2071bd tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:32.231549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b89cc48-0b50-4cb5-8609-5cab9f2071bd tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:32.232039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b89cc48-0b50-4cb5-8609-5cab9f2071bd tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:32.266778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b89cc48-0b50-4cb5-8609-5cab9f2071bd tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Acquired lock "refresh_cache-3b77cc52-a232-427f-9304-a151f4110d69" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 22 21:13:32.445679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-173851dc-0773-4ae8-b65c-60e93cd71a84 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:32.446472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-173851dc-0773-4ae8-b65c-60e93cd71a84 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:32.454747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-173851dc-0773-4ae8-b65c-60e93cd71a84 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:32.455340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-173851dc-0773-4ae8-b65c-60e93cd71a84 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:32.456108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-173851dc-0773-4ae8-b65c-60e93cd71a84 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:32.456835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-173851dc-0773-4ae8-b65c-60e93cd71a84 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:32.656975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-173851dc-0773-4ae8-b65c-60e93cd71a84 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:32.666584 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-173851dc-0773-4ae8-b65c-60e93cd71a84 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1326 microversion: 2.1 time: 0.225389 Jan 22 21:13:32.668147 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2388/4594] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:32 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1326 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:32.727561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ec249598-1d79-4801-aeb3-16e22da25f87 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:32.728717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ec249598-1d79-4801-aeb3-16e22da25f87 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:32.735468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec249598-1d79-4801-aeb3-16e22da25f87 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:32.736005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec249598-1d79-4801-aeb3-16e22da25f87 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:32.736935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec249598-1d79-4801-aeb3-16e22da25f87 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:32.737445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec249598-1d79-4801-aeb3-16e22da25f87 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:32.792110 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ec249598-1d79-4801-aeb3-16e22da25f87 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.068498 Jan 22 21:13:32.796742 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2389/4595] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:32 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:32.800985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8c10b4ee-ac38-4896-98e5-530c9cb1b17d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:32.802275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8c10b4ee-ac38-4896-98e5-530c9cb1b17d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:32.824097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c10b4ee-ac38-4896-98e5-530c9cb1b17d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:32.824097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c10b4ee-ac38-4896-98e5-530c9cb1b17d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:32.824097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c10b4ee-ac38-4896-98e5-530c9cb1b17d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:32.824097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c10b4ee-ac38-4896-98e5-530c9cb1b17d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:32.861787 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8c10b4ee-ac38-4896-98e5-530c9cb1b17d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.065723 Jan 22 21:13:32.864950 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2390/4596] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:32 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:32.940400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0c673ab7-36bd-4897-bf48-2611dd2d5033 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:32.941844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0c673ab7-36bd-4897-bf48-2611dd2d5033 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:32.954024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c673ab7-36bd-4897-bf48-2611dd2d5033 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:32.954493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c673ab7-36bd-4897-bf48-2611dd2d5033 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:32.955357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c673ab7-36bd-4897-bf48-2611dd2d5033 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:32.955996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c673ab7-36bd-4897-bf48-2611dd2d5033 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:32.999524 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0c673ab7-36bd-4897-bf48-2611dd2d5033 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 16401 microversion: 2.20 time: 0.063624 Jan 22 21:13:33.000185 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2391/4597] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:32 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 16401 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:13:33.685003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-090948da-ecb5-41a1-9bcf-fbc8804841c8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:33.685964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-090948da-ecb5-41a1-9bcf-fbc8804841c8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:33.697392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-090948da-ecb5-41a1-9bcf-fbc8804841c8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:33.697889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-090948da-ecb5-41a1-9bcf-fbc8804841c8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:33.699133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-090948da-ecb5-41a1-9bcf-fbc8804841c8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:33.699784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-090948da-ecb5-41a1-9bcf-fbc8804841c8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:33.720997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-1b89cc48-0b50-4cb5-8609-5cab9f2071bd tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Building network info cache for instance {{(pid=137033) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 22 21:13:33.849817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-090948da-ecb5-41a1-9bcf-fbc8804841c8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:33.858977 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-090948da-ecb5-41a1-9bcf-fbc8804841c8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1326 microversion: 2.1 time: 0.178091 Jan 22 21:13:33.864797 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2392/4598] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:33 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1326 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:33.878014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2fb571c0-e3e8-44e7-8164-4c86ff646c99 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:33.878955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2fb571c0-e3e8-44e7-8164-4c86ff646c99 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:33.887193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fb571c0-e3e8-44e7-8164-4c86ff646c99 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:33.887651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fb571c0-e3e8-44e7-8164-4c86ff646c99 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:33.888661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fb571c0-e3e8-44e7-8164-4c86ff646c99 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:33.890618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fb571c0-e3e8-44e7-8164-4c86ff646c99 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:33.980465 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2fb571c0-e3e8-44e7-8164-4c86ff646c99 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.112830 Jan 22 21:13:33.984560 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2393/4599] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:33 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:33.990607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-dbaf83ec-5332-430e-9edb-f5ccceab721a req-6726bdca-28ff-4e28-b6e7-029cceac15a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b77cc52-a232-427f-9304-a151f4110d69", "tag": "208377a2-2e65-4185-94a6-ce2de003a880"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:33.993183 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:33.993183 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:13:34.002914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-dbaf83ec-5332-430e-9edb-f5ccceab721a req-6726bdca-28ff-4e28-b6e7-029cceac15a3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:34.003373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-dbaf83ec-5332-430e-9edb-f5ccceab721a req-6726bdca-28ff-4e28-b6e7-029cceac15a3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:34.018533 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-dbaf83ec-5332-430e-9edb-f5ccceab721a req-6726bdca-28ff-4e28-b6e7-029cceac15a3 service nova] Creating event network-changed:208377a2-2e65-4185-94a6-ce2de003a880 for instance 3b77cc52-a232-427f-9304-a151f4110d69 on nch2-master-1 Jan 22 21:13:34.024178 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-dbaf83ec-5332-430e-9edb-f5ccceab721a req-6726bdca-28ff-4e28-b6e7-029cceac15a3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037095 Jan 22 21:13:34.025186 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2394/4600] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:34.034940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19fbee8a-0026-47a3-ae63-8f46e159099a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:34.036350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-19fbee8a-0026-47a3-ae63-8f46e159099a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:34.046644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19fbee8a-0026-47a3-ae63-8f46e159099a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:34.047471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19fbee8a-0026-47a3-ae63-8f46e159099a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:34.048537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19fbee8a-0026-47a3-ae63-8f46e159099a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:34.049205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19fbee8a-0026-47a3-ae63-8f46e159099a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:34.106025 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19fbee8a-0026-47a3-ae63-8f46e159099a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.078992 Jan 22 21:13:34.107025 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2395/4601] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:34 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:34.117251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e9202691-72e7-4228-a8e8-e33e96c6747c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:34.118303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e9202691-72e7-4228-a8e8-e33e96c6747c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:34.125872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9202691-72e7-4228-a8e8-e33e96c6747c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:34.126652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9202691-72e7-4228-a8e8-e33e96c6747c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:34.127738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9202691-72e7-4228-a8e8-e33e96c6747c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:34.128793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9202691-72e7-4228-a8e8-e33e96c6747c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:34.194255 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e9202691-72e7-4228-a8e8-e33e96c6747c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 16401 microversion: 2.20 time: 0.085226 Jan 22 21:13:34.195434 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2396/4602] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:34 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 16401 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:34.876823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ee5c9c70-ad62-4d24-952f-f6f60dd59cd8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:34.877638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ee5c9c70-ad62-4d24-952f-f6f60dd59cd8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:34.886365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee5c9c70-ad62-4d24-952f-f6f60dd59cd8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:34.887992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee5c9c70-ad62-4d24-952f-f6f60dd59cd8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:34.889083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee5c9c70-ad62-4d24-952f-f6f60dd59cd8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:34.890321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee5c9c70-ad62-4d24-952f-f6f60dd59cd8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:35.104765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ee5c9c70-ad62-4d24-952f-f6f60dd59cd8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:35.110856 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ee5c9c70-ad62-4d24-952f-f6f60dd59cd8 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1326 microversion: 2.1 time: 0.238089 Jan 22 21:13:35.111882 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2397/4603] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:34 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1326 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:35.117637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d8858047-4fe9-4f2e-8ba8-216992e9a2ad tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:35.118776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d8858047-4fe9-4f2e-8ba8-216992e9a2ad tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:35.126574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8858047-4fe9-4f2e-8ba8-216992e9a2ad tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:35.127707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8858047-4fe9-4f2e-8ba8-216992e9a2ad tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:35.128564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8858047-4fe9-4f2e-8ba8-216992e9a2ad tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:35.129109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8858047-4fe9-4f2e-8ba8-216992e9a2ad tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:35.186577 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d8858047-4fe9-4f2e-8ba8-216992e9a2ad tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.072956 Jan 22 21:13:35.189602 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2398/4604] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:35 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:35.195894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3c1b23e4-04e6-4bf5-9401-861917f3d4a1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:35.195894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3c1b23e4-04e6-4bf5-9401-861917f3d4a1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:35.204967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c1b23e4-04e6-4bf5-9401-861917f3d4a1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:35.207094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c1b23e4-04e6-4bf5-9401-861917f3d4a1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:35.208234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c1b23e4-04e6-4bf5-9401-861917f3d4a1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:35.208887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c1b23e4-04e6-4bf5-9401-861917f3d4a1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:35.260135 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3c1b23e4-04e6-4bf5-9401-861917f3d4a1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.071121 Jan 22 21:13:35.260962 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2399/4605] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:35 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:35.275204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-852fcd6d-3a93-4bc6-a963-c26f396ab5de tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:35.275204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-852fcd6d-3a93-4bc6-a963-c26f396ab5de tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:35.284608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-852fcd6d-3a93-4bc6-a963-c26f396ab5de tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:35.285413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-852fcd6d-3a93-4bc6-a963-c26f396ab5de tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:35.286863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-852fcd6d-3a93-4bc6-a963-c26f396ab5de tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:35.288173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-852fcd6d-3a93-4bc6-a963-c26f396ab5de tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:35.350246 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-852fcd6d-3a93-4bc6-a963-c26f396ab5de tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.087500 Jan 22 21:13:35.351304 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2400/4606] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:35 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:35.472519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-1b89cc48-0b50-4cb5-8609-5cab9f2071bd tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Updating instance_info_cache with network_info: [{"id": "208377a2-2e65-4185-94a6-ce2de003a880", "address": "fa:16:3e:53:b5:da", "network": {"id": "11c5d3c2-f473-483b-8127-34bbf3efe45d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1105396235-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8fee2320503f41948e06d83350863358", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap208377a2-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137033) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 22 21:13:35.631526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b89cc48-0b50-4cb5-8609-5cab9f2071bd tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Releasing lock "refresh_cache-3b77cc52-a232-427f-9304-a151f4110d69" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 22 21:13:35.636722 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1b89cc48-0b50-4cb5-8609-5cab9f2071bd tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "POST /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69/action" status: 202 len: 0 microversion: 2.1 time: 3.416816 Jan 22 21:13:35.636722 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2207/4607] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:32 2022] POST /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69/action => generated 0 bytes in 3418 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 22 21:13:35.643001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dc5db4a3-4d4c-4e55-94f1-c9c45f945f04 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '.version_select at 0x7f1ed5e65f70>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:35.836278 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dc5db4a3-4d4c-4e55-94f1-c9c45f945f04 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/os-floating-ips/558a2126-1d50-4397-a002-8fe79d36dfe6" status: 200 len: 184 microversion: 2.1 time: 0.197732 Jan 22 21:13:35.836881 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2401/4608] 10.222.0.100 () {58 vars in 1264 bytes} [Sat Jan 22 21:13:35 2022] GET /compute/v2.1/os-floating-ips/558a2126-1d50-4397-a002-8fe79d36dfe6 => generated 184 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:35.848303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ef09945c-0210-47a9-8445-8ee140980a73 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.153"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:35.983108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ef09945c-0210-47a9-8445-8ee140980a73 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:35.986290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef09945c-0210-47a9-8445-8ee140980a73 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:35.986982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef09945c-0210-47a9-8445-8ee140980a73 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:35.987825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef09945c-0210-47a9-8445-8ee140980a73 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:35.988300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef09945c-0210-47a9-8445-8ee140980a73 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:36.071824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-2d3f1799-4228-4e27-b7da-57d3d3fd1a74 req-184b168f-aee9-4d56-8030-352ca080b1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a142f83a-c576-4972-a9f4-0d2e8ac5d0d5", "name": "network-vif-deleted", "tag": "47e5ddad-21d0-45de-bfef-390954745b7c"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:36.073340 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:36.073340 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:13:36.081864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2d3f1799-4228-4e27-b7da-57d3d3fd1a74 req-184b168f-aee9-4d56-8030-352ca080b1d8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:36.086327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2d3f1799-4228-4e27-b7da-57d3d3fd1a74 req-184b168f-aee9-4d56-8030-352ca080b1d8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:36.094069 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-2d3f1799-4228-4e27-b7da-57d3d3fd1a74 req-184b168f-aee9-4d56-8030-352ca080b1d8 service nova] Creating event network-vif-deleted:47e5ddad-21d0-45de-bfef-390954745b7c for instance a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 on nch1-master-1 Jan 22 21:13:36.098944 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-2d3f1799-4228-4e27-b7da-57d3d3fd1a74 req-184b168f-aee9-4d56-8030-352ca080b1d8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030757 Jan 22 21:13:36.099560 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2402/4609] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:13:36.129173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-42d396ce-b6bf-49a4-8b3e-967fd201e4d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:36.129993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-42d396ce-b6bf-49a4-8b3e-967fd201e4d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:36.136635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42d396ce-b6bf-49a4-8b3e-967fd201e4d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:36.138168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42d396ce-b6bf-49a4-8b3e-967fd201e4d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:36.138168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42d396ce-b6bf-49a4-8b3e-967fd201e4d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:36.138458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42d396ce-b6bf-49a4-8b3e-967fd201e4d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:36.226787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef09945c-0210-47a9-8445-8ee140980a73 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Acquired lock "refresh_cache-3b77cc52-a232-427f-9304-a151f4110d69" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 22 21:13:36.309391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-42d396ce-b6bf-49a4-8b3e-967fd201e4d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:36.317266 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-42d396ce-b6bf-49a4-8b3e-967fd201e4d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1326 microversion: 2.1 time: 0.192955 Jan 22 21:13:36.317965 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2403/4610] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:36 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1326 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:36.323317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3a9076d7-b372-4894-bf26-11a23b1ed3ad tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:36.324429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3a9076d7-b372-4894-bf26-11a23b1ed3ad tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:36.332799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a9076d7-b372-4894-bf26-11a23b1ed3ad tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:36.333349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a9076d7-b372-4894-bf26-11a23b1ed3ad tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:36.334181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a9076d7-b372-4894-bf26-11a23b1ed3ad tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:36.334631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a9076d7-b372-4894-bf26-11a23b1ed3ad tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:36.382538 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3a9076d7-b372-4894-bf26-11a23b1ed3ad tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.063074 Jan 22 21:13:36.383439 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2404/4611] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:36 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:36.388175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-201dadc9-eb8a-416c-a03f-52b25533a419 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:36.389340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-201dadc9-eb8a-416c-a03f-52b25533a419 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:36.399359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-201dadc9-eb8a-416c-a03f-52b25533a419 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:36.399830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-201dadc9-eb8a-416c-a03f-52b25533a419 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:36.400644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-201dadc9-eb8a-416c-a03f-52b25533a419 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:36.401091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-201dadc9-eb8a-416c-a03f-52b25533a419 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:36.448036 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-201dadc9-eb8a-416c-a03f-52b25533a419 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.063288 Jan 22 21:13:36.448994 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2405/4612] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:36 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:36.454284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4f2223fa-3582-4711-82a9-6e301d89557f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:36.455600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4f2223fa-3582-4711-82a9-6e301d89557f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:36.465049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f2223fa-3582-4711-82a9-6e301d89557f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:36.465049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f2223fa-3582-4711-82a9-6e301d89557f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:36.465726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f2223fa-3582-4711-82a9-6e301d89557f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:36.465726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f2223fa-3582-4711-82a9-6e301d89557f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:36.515899 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4f2223fa-3582-4711-82a9-6e301d89557f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.065027 Jan 22 21:13:36.517398 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2406/4613] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:36 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:37.051874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-8a9d3c03-884b-4b55-8efe-2e05c64c523c req-5cb63cb6-ea03-4114-a5c6-c2f17d2406a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab34a474-341d-4204-9616-72afb1140379", "name": "network-vif-plugged", "status": "completed", "tag": "8f698936-2040-48a0-b71f-e6239702bdc3"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:37.058206 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:37.058206 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:13:37.067089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-ef09945c-0210-47a9-8445-8ee140980a73 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Building network info cache for instance {{(pid=137033) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Jan 22 21:13:37.085867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8a9d3c03-884b-4b55-8efe-2e05c64c523c req-5cb63cb6-ea03-4114-a5c6-c2f17d2406a7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:37.086986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8a9d3c03-884b-4b55-8efe-2e05c64c523c req-5cb63cb6-ea03-4114-a5c6-c2f17d2406a7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:37.112939 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-8a9d3c03-884b-4b55-8efe-2e05c64c523c req-5cb63cb6-ea03-4114-a5c6-c2f17d2406a7 service nova] Creating event network-vif-plugged:8f698936-2040-48a0-b71f-e6239702bdc3 for instance ab34a474-341d-4204-9616-72afb1140379 on nch2-master-1 Jan 22 21:13:37.124163 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-8a9d3c03-884b-4b55-8efe-2e05c64c523c req-5cb63cb6-ea03-4114-a5c6-c2f17d2406a7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077016 Jan 22 21:13:37.125357 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2407/4614] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:13:37.337041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61ef92a9-2ad0-47d4-ad55-6eb8cb69d1d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:37.338239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-61ef92a9-2ad0-47d4-ad55-6eb8cb69d1d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:37.344791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61ef92a9-2ad0-47d4-ad55-6eb8cb69d1d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:37.345254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61ef92a9-2ad0-47d4-ad55-6eb8cb69d1d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:37.346087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61ef92a9-2ad0-47d4-ad55-6eb8cb69d1d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:37.346540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61ef92a9-2ad0-47d4-ad55-6eb8cb69d1d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:37.528638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-61ef92a9-2ad0-47d4-ad55-6eb8cb69d1d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:37.537600 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61ef92a9-2ad0-47d4-ad55-6eb8cb69d1d1 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1326 microversion: 2.1 time: 0.205659 Jan 22 21:13:37.548299 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2408/4615] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:37 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1326 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:37.548299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e73ba532-89be-463c-8412-e218c61a2466 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:37.548299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e73ba532-89be-463c-8412-e218c61a2466 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:37.552040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e73ba532-89be-463c-8412-e218c61a2466 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:37.552500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e73ba532-89be-463c-8412-e218c61a2466 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:37.553483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e73ba532-89be-463c-8412-e218c61a2466 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:37.554686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e73ba532-89be-463c-8412-e218c61a2466 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:37.606840 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e73ba532-89be-463c-8412-e218c61a2466 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.065940 Jan 22 21:13:37.609047 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2409/4616] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:37 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:37.617071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7cd5c197-60e9-4720-8f69-115a6b77a1e5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:37.623131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7cd5c197-60e9-4720-8f69-115a6b77a1e5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:37.628920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cd5c197-60e9-4720-8f69-115a6b77a1e5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:37.629902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cd5c197-60e9-4720-8f69-115a6b77a1e5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:37.631330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cd5c197-60e9-4720-8f69-115a6b77a1e5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:37.633127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cd5c197-60e9-4720-8f69-115a6b77a1e5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:37.686196 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7cd5c197-60e9-4720-8f69-115a6b77a1e5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.075475 Jan 22 21:13:37.689566 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2410/4617] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:37 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:37.690389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-ef09945c-0210-47a9-8445-8ee140980a73 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Updating instance_info_cache with network_info: [{"id": "208377a2-2e65-4185-94a6-ce2de003a880", "address": "fa:16:3e:53:b5:da", "network": {"id": "11c5d3c2-f473-483b-8127-34bbf3efe45d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1105396235-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8fee2320503f41948e06d83350863358", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap208377a2-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137033) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 22 21:13:37.692091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-649f285e-b671-4f34-a4c8-6fe5905fdb0c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:37.693092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-649f285e-b671-4f34-a4c8-6fe5905fdb0c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:37.700630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-649f285e-b671-4f34-a4c8-6fe5905fdb0c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:37.703393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-649f285e-b671-4f34-a4c8-6fe5905fdb0c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:37.703393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-649f285e-b671-4f34-a4c8-6fe5905fdb0c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:37.703393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-649f285e-b671-4f34-a4c8-6fe5905fdb0c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:37.747601 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-649f285e-b671-4f34-a4c8-6fe5905fdb0c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.059002 Jan 22 21:13:37.751532 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2411/4618] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:37 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:37.791124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef09945c-0210-47a9-8445-8ee140980a73 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Releasing lock "refresh_cache-3b77cc52-a232-427f-9304-a151f4110d69" {{(pid=137033) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 22 21:13:37.792047 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ef09945c-0210-47a9-8445-8ee140980a73 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "POST /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69/action" status: 202 len: 0 microversion: 2.1 time: 1.948180 Jan 22 21:13:37.795441 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2208/4619] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:35 2022] POST /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69/action => generated 0 bytes in 1949 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jan 22 21:13:37.802234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-41198085-e291-4cfd-a093-ed05f52abd65 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:37.802820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-41198085-e291-4cfd-a093-ed05f52abd65 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:37.811095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41198085-e291-4cfd-a093-ed05f52abd65 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:37.811561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41198085-e291-4cfd-a093-ed05f52abd65 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:37.812743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41198085-e291-4cfd-a093-ed05f52abd65 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:37.813193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41198085-e291-4cfd-a093-ed05f52abd65 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:37.828680 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-41198085-e291-4cfd-a093-ed05f52abd65 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] HTTP exception thrown: Instance a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 could not be found. Jan 22 21:13:37.829287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-41198085-e291-4cfd-a093-ed05f52abd65 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Returning 404 to user: Instance a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:13:37.830316 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-41198085-e291-4cfd-a093-ed05f52abd65 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 404 len: 111 microversion: 2.1 time: 0.032091 Jan 22 21:13:37.831058 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2412/4620] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:13:37 2022] DELETE /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:13:37.839203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11e64913-f928-479b-985f-35e097428dd6 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:37.840197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-11e64913-f928-479b-985f-35e097428dd6 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: a142f83a-c576-4972-a9f4-0d2e8ac5d0d5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:37.845911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11e64913-f928-479b-985f-35e097428dd6 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:37.846375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11e64913-f928-479b-985f-35e097428dd6 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:37.847379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11e64913-f928-479b-985f-35e097428dd6 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:37.847828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11e64913-f928-479b-985f-35e097428dd6 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:37.863333 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-11e64913-f928-479b-985f-35e097428dd6 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] HTTP exception thrown: Instance a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 could not be found. Jan 22 21:13:37.863970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11e64913-f928-479b-985f-35e097428dd6 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Returning 404 to user: Instance a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:13:37.864814 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-11e64913-f928-479b-985f-35e097428dd6 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5" status: 404 len: 111 microversion: 2.1 time: 0.029836 Jan 22 21:13:37.865372 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2209/4621] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:37 2022] GET /compute/v2.1/servers/a142f83a-c576-4972-a9f4-0d2e8ac5d0d5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:13:37.873941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-35bc5ebb-376c-450b-bfb7-a4c50d1771a3 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '.version_select at 0x7f1ed5be69d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:38.121698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-6ce1ee56-a40a-41cc-b610-c6453990dc9c req-c490d6ac-51f7-4288-bee1-a2c3e89febfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b77cc52-a232-427f-9304-a151f4110d69", "tag": "208377a2-2e65-4185-94a6-ce2de003a880"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:38.124047 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:38.124047 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:13:38.154998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6ce1ee56-a40a-41cc-b610-c6453990dc9c req-c490d6ac-51f7-4288-bee1-a2c3e89febfb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:38.155711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6ce1ee56-a40a-41cc-b610-c6453990dc9c req-c490d6ac-51f7-4288-bee1-a2c3e89febfb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:38.171118 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-6ce1ee56-a40a-41cc-b610-c6453990dc9c req-c490d6ac-51f7-4288-bee1-a2c3e89febfb service nova] Creating event network-changed:208377a2-2e65-4185-94a6-ce2de003a880 for instance 3b77cc52-a232-427f-9304-a151f4110d69 on nch2-master-1 Jan 22 21:13:38.180757 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-6ce1ee56-a40a-41cc-b610-c6453990dc9c req-c490d6ac-51f7-4288-bee1-a2c3e89febfb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064495 Jan 22 21:13:38.181370 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2210/4622] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:13:38.556817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-50fea926-f182-4f1d-ae5f-1d628da76fba tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:38.557928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-50fea926-f182-4f1d-ae5f-1d628da76fba tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:38.566783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50fea926-f182-4f1d-ae5f-1d628da76fba tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:38.567362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50fea926-f182-4f1d-ae5f-1d628da76fba tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:38.568308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50fea926-f182-4f1d-ae5f-1d628da76fba tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:38.570009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50fea926-f182-4f1d-ae5f-1d628da76fba tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:38.821302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-50fea926-f182-4f1d-ae5f-1d628da76fba tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:38.837470 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-50fea926-f182-4f1d-ae5f-1d628da76fba tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1326 microversion: 2.1 time: 0.284156 Jan 22 21:13:38.854470 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2211/4623] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:38 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1326 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:38.854470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8af88f5a-601f-4102-82ed-692e154a68ed tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:38.854470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8af88f5a-601f-4102-82ed-692e154a68ed tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:38.854986 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-35bc5ebb-376c-450b-bfb7-a4c50d1771a3 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "DELETE /compute/v2.1/os-floating-ips/558a2126-1d50-4397-a002-8fe79d36dfe6" status: 202 len: 0 microversion: 2.1 time: 0.982018 Jan 22 21:13:38.856942 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2413/4624] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:13:37 2022] DELETE /compute/v2.1/os-floating-ips/558a2126-1d50-4397-a002-8fe79d36dfe6 => generated 0 bytes in 987 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:13:38.867380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8af88f5a-601f-4102-82ed-692e154a68ed tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:38.868034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8af88f5a-601f-4102-82ed-692e154a68ed tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:38.869549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8af88f5a-601f-4102-82ed-692e154a68ed tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:38.870232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8af88f5a-601f-4102-82ed-692e154a68ed tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:38.870513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b0a8f30d-ddb1-4494-80e6-83bc0cb02c18 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:38.874339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b0a8f30d-ddb1-4494-80e6-83bc0cb02c18 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:38.883079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0a8f30d-ddb1-4494-80e6-83bc0cb02c18 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:38.883944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0a8f30d-ddb1-4494-80e6-83bc0cb02c18 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:38.885038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0a8f30d-ddb1-4494-80e6-83bc0cb02c18 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:38.885483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0a8f30d-ddb1-4494-80e6-83bc0cb02c18 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:38.931477 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8af88f5a-601f-4102-82ed-692e154a68ed tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.091843 Jan 22 21:13:38.932154 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2212/4625] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:38 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:38.933588 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b0a8f30d-ddb1-4494-80e6-83bc0cb02c18 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.073180 Jan 22 21:13:38.935186 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2414/4626] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:38 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:38.938663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0cae311e-8928-40f8-8db4-da493e66f17a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:38.938663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0cae311e-8928-40f8-8db4-da493e66f17a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:38.939560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3fc15362-ec33-42d0-906e-53476ffb8b9f tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:38.940211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3fc15362-ec33-42d0-906e-53476ffb8b9f tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:38.946987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cae311e-8928-40f8-8db4-da493e66f17a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:38.947450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cae311e-8928-40f8-8db4-da493e66f17a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:38.948535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cae311e-8928-40f8-8db4-da493e66f17a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:38.948959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fc15362-ec33-42d0-906e-53476ffb8b9f tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:38.949084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cae311e-8928-40f8-8db4-da493e66f17a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:38.949568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fc15362-ec33-42d0-906e-53476ffb8b9f tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:38.950460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fc15362-ec33-42d0-906e-53476ffb8b9f tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:38.950902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fc15362-ec33-42d0-906e-53476ffb8b9f tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:38.977851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3fc15362-ec33-42d0-906e-53476ffb8b9f tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:13:38.993966 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0cae311e-8928-40f8-8db4-da493e66f17a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.060366 Jan 22 21:13:38.994635 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2213/4627] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:38 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:39.356584 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3fc15362-ec33-42d0-906e-53476ffb8b9f tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "DELETE /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 204 len: 0 microversion: 2.1 time: 0.420763 Jan 22 21:13:39.357198 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2415/4628] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:13:38 2022] DELETE /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:13:39.365673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-00413844-e85c-490f-b2bc-3c3f24317e3b tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:39.369643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-00413844-e85c-490f-b2bc-3c3f24317e3b tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:39.373997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00413844-e85c-490f-b2bc-3c3f24317e3b tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:39.374668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00413844-e85c-490f-b2bc-3c3f24317e3b tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:39.375473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00413844-e85c-490f-b2bc-3c3f24317e3b tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:39.375918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00413844-e85c-490f-b2bc-3c3f24317e3b tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:39.517033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-00413844-e85c-490f-b2bc-3c3f24317e3b tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:39.525840 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-00413844-e85c-490f-b2bc-3c3f24317e3b tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1530 microversion: 2.1 time: 0.164262 Jan 22 21:13:39.526417 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2214/4629] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:39 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1530 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:39.870654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19b7cac8-2fd2-4eef-b3d1-e6e00532caff tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:39.871360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-19b7cac8-2fd2-4eef-b3d1-e6e00532caff tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:39.877818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19b7cac8-2fd2-4eef-b3d1-e6e00532caff tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:39.878297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19b7cac8-2fd2-4eef-b3d1-e6e00532caff tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:39.879085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19b7cac8-2fd2-4eef-b3d1-e6e00532caff tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:39.879539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19b7cac8-2fd2-4eef-b3d1-e6e00532caff tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:39.944844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e51b4160-d85d-4fa8-a46d-2feb20cde578 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:39.946206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e51b4160-d85d-4fa8-a46d-2feb20cde578 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:39.953939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e51b4160-d85d-4fa8-a46d-2feb20cde578 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:39.954507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e51b4160-d85d-4fa8-a46d-2feb20cde578 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:39.955413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e51b4160-d85d-4fa8-a46d-2feb20cde578 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:39.955930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e51b4160-d85d-4fa8-a46d-2feb20cde578 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:40.003214 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e51b4160-d85d-4fa8-a46d-2feb20cde578 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.062602 Jan 22 21:13:40.004132 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2215/4630] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:39 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:40.009592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-611405e2-1550-48dc-8e1b-7147b36f3e3a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:40.010591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-611405e2-1550-48dc-8e1b-7147b36f3e3a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:40.017611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-611405e2-1550-48dc-8e1b-7147b36f3e3a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:40.018174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-611405e2-1550-48dc-8e1b-7147b36f3e3a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:40.018966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-611405e2-1550-48dc-8e1b-7147b36f3e3a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:40.019407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-611405e2-1550-48dc-8e1b-7147b36f3e3a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:40.021345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-19b7cac8-2fd2-4eef-b3d1-e6e00532caff tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:40.030189 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19b7cac8-2fd2-4eef-b3d1-e6e00532caff tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1476 microversion: 2.1 time: 0.164120 Jan 22 21:13:40.030770 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2416/4631] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:39 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1476 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:40.047565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3aa84654-0f48-460f-a284-a9262061e8b5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:40.053562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3aa84654-0f48-460f-a284-a9262061e8b5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:40.055820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3aa84654-0f48-460f-a284-a9262061e8b5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:40.056285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3aa84654-0f48-460f-a284-a9262061e8b5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:40.057089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3aa84654-0f48-460f-a284-a9262061e8b5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:40.057559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3aa84654-0f48-460f-a284-a9262061e8b5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:40.059732 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-611405e2-1550-48dc-8e1b-7147b36f3e3a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.054441 Jan 22 21:13:40.063707 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2216/4632] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:40 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:40.114760 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3aa84654-0f48-460f-a284-a9262061e8b5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.070609 Jan 22 21:13:40.115729 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2417/4633] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:40 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:40.321735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c76bf66d-4d0b-4a42-81b5-3d4f8f0a127a tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:40.325013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c76bf66d-4d0b-4a42-81b5-3d4f8f0a127a tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] [instance: 00c044ad-ae34-4661-bc0d-59072d08475d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:40.328913 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-c76bf66d-4d0b-4a42-81b5-3d4f8f0a127a tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] HTTP exception thrown: Instance 00c044ad-ae34-4661-bc0d-59072d08475d could not be found. Jan 22 21:13:40.329529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c76bf66d-4d0b-4a42-81b5-3d4f8f0a127a tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Returning 404 to user: Instance 00c044ad-ae34-4661-bc0d-59072d08475d could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:13:40.330383 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c76bf66d-4d0b-4a42-81b5-3d4f8f0a127a tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/00c044ad-ae34-4661-bc0d-59072d08475d/action" status: 404 len: 111 microversion: 2.1 time: 0.266909 Jan 22 21:13:40.330950 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2217/4634] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:40 2022] POST /compute/v2.1/servers/00c044ad-ae34-4661-bc0d-59072d08475d/action => generated 111 bytes in 269 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:13:40.437615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1052684613", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:40.489731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:13:40.542150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-54846cd4-735b-4b2b-8a5b-72cd98ea989e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:40.542908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-54846cd4-735b-4b2b-8a5b-72cd98ea989e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:40.549727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54846cd4-735b-4b2b-8a5b-72cd98ea989e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:40.550321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54846cd4-735b-4b2b-8a5b-72cd98ea989e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:40.551221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54846cd4-735b-4b2b-8a5b-72cd98ea989e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:40.551771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54846cd4-735b-4b2b-8a5b-72cd98ea989e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:40.716394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-54846cd4-735b-4b2b-8a5b-72cd98ea989e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:40.725137 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-54846cd4-735b-4b2b-8a5b-72cd98ea989e tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1530 microversion: 2.1 time: 0.186235 Jan 22 21:13:40.730505 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2218/4635] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:40 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1530 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:40.769257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:13:40.769718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:13:40.770284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:13:40.770944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:13:40.771743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:13:40.783877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:40.784581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:40.785419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:40.785903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:40.807333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Getting quotas for project fb6cd65ef53949b2a4bbdae54953280d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:13:40.813190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Getting quotas for user 8ee6e2c7f8d44322839477c3b5ee84d9 and project fb6cd65ef53949b2a4bbdae54953280d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:13:40.828793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:13:40.831300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:13:40.946804 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bf995080-55fb-47bb-81a2-d2b8efbc72ed tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.513198 Jan 22 21:13:40.949147 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2418/4636] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:13:40 2022] POST /compute/v2.1/servers => generated 382 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:13:40.959198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-83808c9c-fc0b-423d-80a5-b21d3b9eb78a tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:40.960666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-83808c9c-fc0b-423d-80a5-b21d3b9eb78a tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:41.017025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cd7009be-9ded-4661-b3bd-c2bc7d462720 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:41.018703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cd7009be-9ded-4661-b3bd-c2bc7d462720 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:41.029591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd7009be-9ded-4661-b3bd-c2bc7d462720 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:41.030451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd7009be-9ded-4661-b3bd-c2bc7d462720 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:41.031545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd7009be-9ded-4661-b3bd-c2bc7d462720 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:41.032214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd7009be-9ded-4661-b3bd-c2bc7d462720 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:41.055528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-83808c9c-fc0b-423d-80a5-b21d3b9eb78a tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:41.063878 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-83808c9c-fc0b-423d-80a5-b21d3b9eb78a tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1226 microversion: 2.1 time: 0.106092 Jan 22 21:13:41.064511 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2219/4637] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:40 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:41.081645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fa72851b-a17a-439c-9d65-2271142fcdb7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:41.083120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fa72851b-a17a-439c-9d65-2271142fcdb7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:41.096395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa72851b-a17a-439c-9d65-2271142fcdb7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:41.097224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa72851b-a17a-439c-9d65-2271142fcdb7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:41.098786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa72851b-a17a-439c-9d65-2271142fcdb7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:41.099258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa72851b-a17a-439c-9d65-2271142fcdb7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:41.112211 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cd7009be-9ded-4661-b3bd-c2bc7d462720 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.099567 Jan 22 21:13:41.114507 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2419/4638] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:41 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:41.129715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c5a0f826-2565-495e-a9ce-1e9eefeb0699 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:41.132324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c5a0f826-2565-495e-a9ce-1e9eefeb0699 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:41.149182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5a0f826-2565-495e-a9ce-1e9eefeb0699 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:41.149836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5a0f826-2565-495e-a9ce-1e9eefeb0699 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:41.150666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5a0f826-2565-495e-a9ce-1e9eefeb0699 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:41.151248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5a0f826-2565-495e-a9ce-1e9eefeb0699 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:41.159421 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fa72851b-a17a-439c-9d65-2271142fcdb7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.092271 Jan 22 21:13:41.165092 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2220/4639] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:41 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:41.204455 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c5a0f826-2565-495e-a9ce-1e9eefeb0699 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.079278 Jan 22 21:13:41.205261 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2420/4640] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:41 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:13:41.721229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-31262969-9897-4992-a368-db9b33965cf3 req-c09be970-6b66-452e-804d-7331dbfeda58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b77cc52-a232-427f-9304-a151f4110d69", "name": "network-vif-deleted", "tag": "208377a2-2e65-4185-94a6-ce2de003a880"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:41.721229 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:41.721229 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:13:41.721229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-31262969-9897-4992-a368-db9b33965cf3 req-c09be970-6b66-452e-804d-7331dbfeda58 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:41.721229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-31262969-9897-4992-a368-db9b33965cf3 req-c09be970-6b66-452e-804d-7331dbfeda58 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:41.721229 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-31262969-9897-4992-a368-db9b33965cf3 req-c09be970-6b66-452e-804d-7331dbfeda58 service nova] Creating event network-vif-deleted:208377a2-2e65-4185-94a6-ce2de003a880 for instance 3b77cc52-a232-427f-9304-a151f4110d69 on nch2-master-1 Jan 22 21:13:41.726499 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-31262969-9897-4992-a368-db9b33965cf3 req-c09be970-6b66-452e-804d-7331dbfeda58 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033891 Jan 22 21:13:41.727167 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2221/4641] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:41.743747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-92f3c80a-3fa5-4fab-a12f-e9d27c6f77d0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:41.744579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-92f3c80a-3fa5-4fab-a12f-e9d27c6f77d0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:41.757532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92f3c80a-3fa5-4fab-a12f-e9d27c6f77d0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:41.758088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92f3c80a-3fa5-4fab-a12f-e9d27c6f77d0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:41.758915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92f3c80a-3fa5-4fab-a12f-e9d27c6f77d0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:41.759369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92f3c80a-3fa5-4fab-a12f-e9d27c6f77d0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:41.843462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-92f3c80a-3fa5-4fab-a12f-e9d27c6f77d0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5abf45e6a842cea2bc7dba6f13e4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fee2320503f41948e06d83350863358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:41.852243 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-92f3c80a-3fa5-4fab-a12f-e9d27c6f77d0 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 200 len: 1488 microversion: 2.1 time: 0.112772 Jan 22 21:13:41.853082 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2421/4642] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:41 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 1488 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:42.084063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-74ba2791-364a-4b3f-860d-e54816111b52 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:42.089269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-74ba2791-364a-4b3f-860d-e54816111b52 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:42.093209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74ba2791-364a-4b3f-860d-e54816111b52 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:42.093912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74ba2791-364a-4b3f-860d-e54816111b52 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:42.094890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74ba2791-364a-4b3f-860d-e54816111b52 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:42.095512 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74ba2791-364a-4b3f-860d-e54816111b52 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:42.124347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-186bbeee-7b4f-4667-a9c4-b872ddd1b05b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:42.125299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-186bbeee-7b4f-4667-a9c4-b872ddd1b05b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:42.137009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-186bbeee-7b4f-4667-a9c4-b872ddd1b05b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:42.137470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-186bbeee-7b4f-4667-a9c4-b872ddd1b05b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:42.138315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-186bbeee-7b4f-4667-a9c4-b872ddd1b05b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:42.138765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-186bbeee-7b4f-4667-a9c4-b872ddd1b05b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:42.173957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-74ba2791-364a-4b3f-860d-e54816111b52 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:42.183813 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-74ba2791-364a-4b3f-860d-e54816111b52 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1230 microversion: 2.1 time: 0.103937 Jan 22 21:13:42.184445 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2222/4643] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:42 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:42.189083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-57727845-db1d-4590-b813-3c8e598b7fd0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:42.190092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-57727845-db1d-4590-b813-3c8e598b7fd0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:42.197024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57727845-db1d-4590-b813-3c8e598b7fd0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:42.197484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57727845-db1d-4590-b813-3c8e598b7fd0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:42.198921 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-186bbeee-7b4f-4667-a9c4-b872ddd1b05b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.078042 Jan 22 21:13:42.199049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57727845-db1d-4590-b813-3c8e598b7fd0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:42.199372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57727845-db1d-4590-b813-3c8e598b7fd0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:42.200202 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2422/4644] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:42 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:42.217210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-77474cca-f998-4a3b-bd69-df47d22c440e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:42.218308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-77474cca-f998-4a3b-bd69-df47d22c440e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:42.225574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77474cca-f998-4a3b-bd69-df47d22c440e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:42.226025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77474cca-f998-4a3b-bd69-df47d22c440e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:42.226871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77474cca-f998-4a3b-bd69-df47d22c440e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:42.227310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77474cca-f998-4a3b-bd69-df47d22c440e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:42.241587 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-57727845-db1d-4590-b813-3c8e598b7fd0 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.055713 Jan 22 21:13:42.245151 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2223/4645] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:42 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:42.265357 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-77474cca-f998-4a3b-bd69-df47d22c440e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.052608 Jan 22 21:13:42.266037 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2423/4646] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:42 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:13:42.871542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-415dd05b-dc6b-4e6c-a076-4036778e3641 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:42.872539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-415dd05b-dc6b-4e6c-a076-4036778e3641 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] [instance: 3b77cc52-a232-427f-9304-a151f4110d69] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:42.889926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-415dd05b-dc6b-4e6c-a076-4036778e3641 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:42.890389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-415dd05b-dc6b-4e6c-a076-4036778e3641 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:42.891222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-415dd05b-dc6b-4e6c-a076-4036778e3641 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:42.891661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-415dd05b-dc6b-4e6c-a076-4036778e3641 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:42.907766 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-415dd05b-dc6b-4e6c-a076-4036778e3641 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] HTTP exception thrown: Instance 3b77cc52-a232-427f-9304-a151f4110d69 could not be found. Jan 22 21:13:42.908377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-415dd05b-dc6b-4e6c-a076-4036778e3641 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] Returning 404 to user: Instance 3b77cc52-a232-427f-9304-a151f4110d69 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:13:42.909217 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-415dd05b-dc6b-4e6c-a076-4036778e3641 tempest-FloatingIPsAssociationTestJSON-479131821 tempest-FloatingIPsAssociationTestJSON-479131821-project] 10.222.0.100 "GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69" status: 404 len: 111 microversion: 2.1 time: 0.044003 Jan 22 21:13:42.909799 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2224/4647] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:42 2022] GET /compute/v2.1/servers/3b77cc52-a232-427f-9304-a151f4110d69 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:13:43.202206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1f04e31b-69c8-47f2-ad7e-2d463d3342dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:43.203155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1f04e31b-69c8-47f2-ad7e-2d463d3342dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:43.212809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f04e31b-69c8-47f2-ad7e-2d463d3342dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:43.213219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-35f687c6-774c-4026-99af-40b7416a82ef tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:43.213404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f04e31b-69c8-47f2-ad7e-2d463d3342dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:43.214330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f04e31b-69c8-47f2-ad7e-2d463d3342dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:43.214477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-35f687c6-774c-4026-99af-40b7416a82ef tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:43.214892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f04e31b-69c8-47f2-ad7e-2d463d3342dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:43.223424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35f687c6-774c-4026-99af-40b7416a82ef tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:43.224346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35f687c6-774c-4026-99af-40b7416a82ef tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:43.235686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35f687c6-774c-4026-99af-40b7416a82ef tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:43.238621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35f687c6-774c-4026-99af-40b7416a82ef tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:43.319045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1f04e31b-69c8-47f2-ad7e-2d463d3342dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:43.321517 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-35f687c6-774c-4026-99af-40b7416a82ef tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.114272 Jan 22 21:13:43.322661 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2225/4648] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:43 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:43.332035 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1f04e31b-69c8-47f2-ad7e-2d463d3342dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1278 microversion: 2.1 time: 0.134855 Jan 22 21:13:43.334098 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2424/4649] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:43 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:43.341426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d5fbf65-f3a1-455a-87b2-8eacd1a61248 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:43.343399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d5fbf65-f3a1-455a-87b2-8eacd1a61248 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:43.345061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0824433e-f041-4b20-90a7-031a692e4e82 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:43.346356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0824433e-f041-4b20-90a7-031a692e4e82 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:43.352693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d5fbf65-f3a1-455a-87b2-8eacd1a61248 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:43.353164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d5fbf65-f3a1-455a-87b2-8eacd1a61248 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:43.354186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d5fbf65-f3a1-455a-87b2-8eacd1a61248 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:43.354690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d5fbf65-f3a1-455a-87b2-8eacd1a61248 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:43.355851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0824433e-f041-4b20-90a7-031a692e4e82 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:43.356576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0824433e-f041-4b20-90a7-031a692e4e82 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:43.357554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0824433e-f041-4b20-90a7-031a692e4e82 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:43.358150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0824433e-f041-4b20-90a7-031a692e4e82 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:43.408734 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d5fbf65-f3a1-455a-87b2-8eacd1a61248 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.073229 Jan 22 21:13:43.418218 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2425/4650] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:43 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:43.422493 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0824433e-f041-4b20-90a7-031a692e4e82 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.098075 Jan 22 21:13:43.423439 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2226/4651] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:43 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:44.336280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4b5f50a9-b9f2-4290-bbb7-0d917494c669 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:44.337762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4b5f50a9-b9f2-4290-bbb7-0d917494c669 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:44.345687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b5f50a9-b9f2-4290-bbb7-0d917494c669 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:44.350106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b5f50a9-b9f2-4290-bbb7-0d917494c669 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:44.353269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cdb0b38e-a96e-4262-8164-e4097b4687c7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:44.354422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cdb0b38e-a96e-4262-8164-e4097b4687c7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:44.358890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b5f50a9-b9f2-4290-bbb7-0d917494c669 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:44.359561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b5f50a9-b9f2-4290-bbb7-0d917494c669 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:44.363864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdb0b38e-a96e-4262-8164-e4097b4687c7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:44.364890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdb0b38e-a96e-4262-8164-e4097b4687c7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:44.367177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdb0b38e-a96e-4262-8164-e4097b4687c7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:44.367870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdb0b38e-a96e-4262-8164-e4097b4687c7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:44.421348 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4b5f50a9-b9f2-4290-bbb7-0d917494c669 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.089935 Jan 22 21:13:44.425771 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2426/4652] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:44 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:44.432315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-be9be947-0077-4e7b-9d6b-750f917a61ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:44.433843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-be9be947-0077-4e7b-9d6b-750f917a61ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:44.443131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be9be947-0077-4e7b-9d6b-750f917a61ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:44.443639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be9be947-0077-4e7b-9d6b-750f917a61ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:44.444480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be9be947-0077-4e7b-9d6b-750f917a61ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:44.445036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be9be947-0077-4e7b-9d6b-750f917a61ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:44.474599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cdb0b38e-a96e-4262-8164-e4097b4687c7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:44.488102 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cdb0b38e-a96e-4262-8164-e4097b4687c7 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1284 microversion: 2.1 time: 0.139687 Jan 22 21:13:44.488684 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2227/4653] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:44 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:44.492067 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-be9be947-0077-4e7b-9d6b-750f917a61ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.066815 Jan 22 21:13:44.496311 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2427/4654] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:44 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:44.499925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ba2ab14e-02b3-469a-a0be-56b2f7951461 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:44.501629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ba2ab14e-02b3-469a-a0be-56b2f7951461 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:44.508728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba2ab14e-02b3-469a-a0be-56b2f7951461 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:44.509407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba2ab14e-02b3-469a-a0be-56b2f7951461 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:44.510456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba2ab14e-02b3-469a-a0be-56b2f7951461 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:44.511525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba2ab14e-02b3-469a-a0be-56b2f7951461 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:44.562955 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ba2ab14e-02b3-469a-a0be-56b2f7951461 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.072322 Jan 22 21:13:44.564028 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2228/4655] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:44 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:45.437391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a7665fc5-35f4-4e34-a13c-c4521b53a5e9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:45.439473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a7665fc5-35f4-4e34-a13c-c4521b53a5e9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:45.460894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7665fc5-35f4-4e34-a13c-c4521b53a5e9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:45.461802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7665fc5-35f4-4e34-a13c-c4521b53a5e9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:45.470407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7665fc5-35f4-4e34-a13c-c4521b53a5e9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:45.471480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7665fc5-35f4-4e34-a13c-c4521b53a5e9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:45.505722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c48341cf-ff78-48ec-86da-45d79e18d00f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:45.506852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c48341cf-ff78-48ec-86da-45d79e18d00f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:45.521169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c48341cf-ff78-48ec-86da-45d79e18d00f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:45.521740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c48341cf-ff78-48ec-86da-45d79e18d00f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:45.523707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c48341cf-ff78-48ec-86da-45d79e18d00f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:45.524217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c48341cf-ff78-48ec-86da-45d79e18d00f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:45.547957 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a7665fc5-35f4-4e34-a13c-c4521b53a5e9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.117821 Jan 22 21:13:45.549050 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2428/4656] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:45 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:45.554641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a2595927-fdfb-4758-9491-a11d3d7d2b7c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:45.555350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a2595927-fdfb-4758-9491-a11d3d7d2b7c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:45.564845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2595927-fdfb-4758-9491-a11d3d7d2b7c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:45.564845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2595927-fdfb-4758-9491-a11d3d7d2b7c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:45.564845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2595927-fdfb-4758-9491-a11d3d7d2b7c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:45.565120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2595927-fdfb-4758-9491-a11d3d7d2b7c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:45.583202 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c48341cf-ff78-48ec-86da-45d79e18d00f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.082296 Jan 22 21:13:45.586245 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2229/4657] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:45 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:45.599288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4e56994-12f4-44eb-a598-f1b2a00296ea tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:45.599288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c4e56994-12f4-44eb-a598-f1b2a00296ea tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:45.603974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4e56994-12f4-44eb-a598-f1b2a00296ea tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:45.604906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4e56994-12f4-44eb-a598-f1b2a00296ea tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:45.605925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4e56994-12f4-44eb-a598-f1b2a00296ea tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:45.606533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4e56994-12f4-44eb-a598-f1b2a00296ea tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:45.653980 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c4e56994-12f4-44eb-a598-f1b2a00296ea tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.065902 Jan 22 21:13:45.654786 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2230/4658] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:45 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:45.751791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a2595927-fdfb-4758-9491-a11d3d7d2b7c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:45.763223 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a2595927-fdfb-4758-9491-a11d3d7d2b7c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1326 microversion: 2.1 time: 0.212780 Jan 22 21:13:45.764100 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2429/4659] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:45 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1326 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:46.560634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-36cb0c0b-2806-4d0e-b785-06c2837a5590 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:46.562476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-36cb0c0b-2806-4d0e-b785-06c2837a5590 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:46.564487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-06656b75-0c38-4a12-850f-3198b4ed4147 req-9abbac1b-6ad3-4853-b5c3-89c617e12207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a266513-609c-46ea-81b1-c23dc2304acf", "tag": "baa85dfe-66d8-48a7-83f6-d390af758567"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:46.570445 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:46.570445 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:13:46.578284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36cb0c0b-2806-4d0e-b785-06c2837a5590 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:46.580278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36cb0c0b-2806-4d0e-b785-06c2837a5590 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:46.581242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36cb0c0b-2806-4d0e-b785-06c2837a5590 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:46.581830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36cb0c0b-2806-4d0e-b785-06c2837a5590 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:46.605251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-06656b75-0c38-4a12-850f-3198b4ed4147 req-9abbac1b-6ad3-4853-b5c3-89c617e12207 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:46.605717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-06656b75-0c38-4a12-850f-3198b4ed4147 req-9abbac1b-6ad3-4853-b5c3-89c617e12207 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:46.621122 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-06656b75-0c38-4a12-850f-3198b4ed4147 req-9abbac1b-6ad3-4853-b5c3-89c617e12207 service nova] Creating event network-changed:baa85dfe-66d8-48a7-83f6-d390af758567 for instance 2a266513-609c-46ea-81b1-c23dc2304acf on nch1-master-1 Jan 22 21:13:46.628296 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-06656b75-0c38-4a12-850f-3198b4ed4147 req-9abbac1b-6ad3-4853-b5c3-89c617e12207 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075029 Jan 22 21:13:46.629600 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2231/4660] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:46.638092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9d5a9028-877a-4f58-acd3-0650d16dde42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:46.639359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9d5a9028-877a-4f58-acd3-0650d16dde42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:46.646898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d5a9028-877a-4f58-acd3-0650d16dde42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:46.648295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d5a9028-877a-4f58-acd3-0650d16dde42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:46.649312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d5a9028-877a-4f58-acd3-0650d16dde42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:46.650010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d5a9028-877a-4f58-acd3-0650d16dde42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:46.684660 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-36cb0c0b-2806-4d0e-b785-06c2837a5590 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.128385 Jan 22 21:13:46.685458 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2430/4661] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:46 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:46.693411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-72d38d23-33f6-42ed-b4f2-d3b183294e4a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:46.694857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-72d38d23-33f6-42ed-b4f2-d3b183294e4a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:46.702637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72d38d23-33f6-42ed-b4f2-d3b183294e4a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:46.703545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72d38d23-33f6-42ed-b4f2-d3b183294e4a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:46.704613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72d38d23-33f6-42ed-b4f2-d3b183294e4a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:46.705281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72d38d23-33f6-42ed-b4f2-d3b183294e4a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:46.707334 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9d5a9028-877a-4f58-acd3-0650d16dde42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.075800 Jan 22 21:13:46.708009 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2232/4662] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:46 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:46.771113 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-72d38d23-33f6-42ed-b4f2-d3b183294e4a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.083523 Jan 22 21:13:46.772037 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2431/4663] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:46 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:46.785110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a67ba196-6a86-4ea5-809b-ee2d99e631eb tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:46.786059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a67ba196-6a86-4ea5-809b-ee2d99e631eb tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:46.795275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a67ba196-6a86-4ea5-809b-ee2d99e631eb tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:46.795984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a67ba196-6a86-4ea5-809b-ee2d99e631eb tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:46.797033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a67ba196-6a86-4ea5-809b-ee2d99e631eb tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:46.797477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a67ba196-6a86-4ea5-809b-ee2d99e631eb tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:47.102968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a67ba196-6a86-4ea5-809b-ee2d99e631eb tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:47.111841 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a67ba196-6a86-4ea5-809b-ee2d99e631eb tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1326 microversion: 2.1 time: 0.333721 Jan 22 21:13:47.113670 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2233/4664] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:46 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1326 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:47.697793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9dd25f00-0d29-4ac6-b9b3-5947cc8e6de8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:47.703664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9dd25f00-0d29-4ac6-b9b3-5947cc8e6de8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:47.707427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9dd25f00-0d29-4ac6-b9b3-5947cc8e6de8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:47.707889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9dd25f00-0d29-4ac6-b9b3-5947cc8e6de8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:47.708698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9dd25f00-0d29-4ac6-b9b3-5947cc8e6de8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:47.709285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9dd25f00-0d29-4ac6-b9b3-5947cc8e6de8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:47.723147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c8893e50-c7be-4c86-87e3-aa07bca4df11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:47.724085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c8893e50-c7be-4c86-87e3-aa07bca4df11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:47.733832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8893e50-c7be-4c86-87e3-aa07bca4df11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:47.734297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8893e50-c7be-4c86-87e3-aa07bca4df11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:47.735104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8893e50-c7be-4c86-87e3-aa07bca4df11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:47.735553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8893e50-c7be-4c86-87e3-aa07bca4df11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:47.765863 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9dd25f00-0d29-4ac6-b9b3-5947cc8e6de8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.072742 Jan 22 21:13:47.769720 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2432/4665] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:47 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:47.784332 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c8893e50-c7be-4c86-87e3-aa07bca4df11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.063113 Jan 22 21:13:47.787584 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2234/4666] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:47 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:47.792195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4a96140e-3786-4ead-b44c-93b0f5e2f7fb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:47.793294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4a96140e-3786-4ead-b44c-93b0f5e2f7fb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:47.801050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a96140e-3786-4ead-b44c-93b0f5e2f7fb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:47.802144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a96140e-3786-4ead-b44c-93b0f5e2f7fb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:47.805875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a96140e-3786-4ead-b44c-93b0f5e2f7fb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:47.805875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a96140e-3786-4ead-b44c-93b0f5e2f7fb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:47.853277 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4a96140e-3786-4ead-b44c-93b0f5e2f7fb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.067166 Jan 22 21:13:47.855093 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2433/4667] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:47 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:48.132932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4a72c308-6a29-4f01-998c-8251e902e22c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:48.137275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4a72c308-6a29-4f01-998c-8251e902e22c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:48.140497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a72c308-6a29-4f01-998c-8251e902e22c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:48.140979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a72c308-6a29-4f01-998c-8251e902e22c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:48.141798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a72c308-6a29-4f01-998c-8251e902e22c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:48.142397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a72c308-6a29-4f01-998c-8251e902e22c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:48.337796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4a72c308-6a29-4f01-998c-8251e902e22c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:48.343741 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4a72c308-6a29-4f01-998c-8251e902e22c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1326 microversion: 2.1 time: 0.218248 Jan 22 21:13:48.344329 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2235/4668] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:48 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1326 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:48.779374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dff0cdd1-6743-47d9-ba62-c1e686541c72 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:48.780375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dff0cdd1-6743-47d9-ba62-c1e686541c72 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:48.791495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dff0cdd1-6743-47d9-ba62-c1e686541c72 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:48.791495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dff0cdd1-6743-47d9-ba62-c1e686541c72 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:48.791495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dff0cdd1-6743-47d9-ba62-c1e686541c72 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:48.791495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dff0cdd1-6743-47d9-ba62-c1e686541c72 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:48.798396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1c5887b6-372c-4a0a-8b35-97522b658ebc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:48.799496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1c5887b6-372c-4a0a-8b35-97522b658ebc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:48.810135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c5887b6-372c-4a0a-8b35-97522b658ebc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:48.810603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c5887b6-372c-4a0a-8b35-97522b658ebc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:48.811408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c5887b6-372c-4a0a-8b35-97522b658ebc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:48.812460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c5887b6-372c-4a0a-8b35-97522b658ebc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:48.839282 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dff0cdd1-6743-47d9-ba62-c1e686541c72 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.064031 Jan 22 21:13:48.843469 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2434/4669] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:48 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:48.858061 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1c5887b6-372c-4a0a-8b35-97522b658ebc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.063515 Jan 22 21:13:48.858729 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2236/4670] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:48 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:48.865849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-936d275e-6993-4f55-876d-810891b74233 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:48.867304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-936d275e-6993-4f55-876d-810891b74233 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:48.874060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-936d275e-6993-4f55-876d-810891b74233 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:48.874479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-936d275e-6993-4f55-876d-810891b74233 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:48.875400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-936d275e-6993-4f55-876d-810891b74233 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:48.875848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-936d275e-6993-4f55-876d-810891b74233 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:48.918533 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-936d275e-6993-4f55-876d-810891b74233 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.056787 Jan 22 21:13:48.919426 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2435/4671] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:48 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:49.361908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8c9159bf-3916-43ee-bd40-9961f552ef3a tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:49.362977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8c9159bf-3916-43ee-bd40-9961f552ef3a tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:49.370693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c9159bf-3916-43ee-bd40-9961f552ef3a tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:49.371157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c9159bf-3916-43ee-bd40-9961f552ef3a tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:49.372033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c9159bf-3916-43ee-bd40-9961f552ef3a tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:49.372529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c9159bf-3916-43ee-bd40-9961f552ef3a tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:49.517128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8c9159bf-3916-43ee-bd40-9961f552ef3a tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:49.525267 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8c9159bf-3916-43ee-bd40-9961f552ef3a tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1326 microversion: 2.1 time: 0.167794 Jan 22 21:13:49.525873 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2237/4672] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:49 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1326 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:49.852586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d6c61437-9d5c-4ce8-b988-a4b211e957f8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:49.853751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d6c61437-9d5c-4ce8-b988-a4b211e957f8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:49.861280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6c61437-9d5c-4ce8-b988-a4b211e957f8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:49.861768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6c61437-9d5c-4ce8-b988-a4b211e957f8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:49.862571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6c61437-9d5c-4ce8-b988-a4b211e957f8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:49.863021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6c61437-9d5c-4ce8-b988-a4b211e957f8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:49.871182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7f980894-17a4-4854-808d-db0528b722a8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:49.872988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7f980894-17a4-4854-808d-db0528b722a8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:49.885162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f980894-17a4-4854-808d-db0528b722a8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:49.885663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f980894-17a4-4854-808d-db0528b722a8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:49.886473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f980894-17a4-4854-808d-db0528b722a8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:49.886920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f980894-17a4-4854-808d-db0528b722a8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:49.911626 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d6c61437-9d5c-4ce8-b988-a4b211e957f8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.063559 Jan 22 21:13:49.917754 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2436/4673] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:49 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:49.935489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f4b4c199-cf5b-46d9-8e4a-e8d274c79c9d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:49.941180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f4b4c199-cf5b-46d9-8e4a-e8d274c79c9d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:49.944033 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7f980894-17a4-4854-808d-db0528b722a8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.077422 Jan 22 21:13:49.944794 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2238/4674] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:49 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:49.952560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4b4c199-cf5b-46d9-8e4a-e8d274c79c9d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:49.953096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4b4c199-cf5b-46d9-8e4a-e8d274c79c9d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:49.953929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4b4c199-cf5b-46d9-8e4a-e8d274c79c9d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:49.954376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4b4c199-cf5b-46d9-8e4a-e8d274c79c9d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:49.998966 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f4b4c199-cf5b-46d9-8e4a-e8d274c79c9d tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.067593 Jan 22 21:13:50.003282 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2437/4675] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:49 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:50.532145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-117ed12f-90ae-482c-b392-2e2a0b9c4376 tempest-ListImageFiltersNegativeTestJSON-674354106 tempest-ListImageFiltersNegativeTestJSON-674354106-project] Calling method '.version_select at 0x7f1ed4ec3280>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:50.546173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-02690fa3-d52a-47bc-8262-d680ff0f4712 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:50.546909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-02690fa3-d52a-47bc-8262-d680ff0f4712 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:50.554980 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-117ed12f-90ae-482c-b392-2e2a0b9c4376 tempest-ListImageFiltersNegativeTestJSON-674354106 tempest-ListImageFiltersNegativeTestJSON-674354106-project] HTTP exception thrown: Image not found. Jan 22 21:13:50.555298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02690fa3-d52a-47bc-8262-d680ff0f4712 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:50.555764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02690fa3-d52a-47bc-8262-d680ff0f4712 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:50.556054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-117ed12f-90ae-482c-b392-2e2a0b9c4376 tempest-ListImageFiltersNegativeTestJSON-674354106 tempest-ListImageFiltersNegativeTestJSON-674354106-project] Returning 404 to user: Image not found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:13:50.556585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02690fa3-d52a-47bc-8262-d680ff0f4712 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:50.557038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02690fa3-d52a-47bc-8262-d680ff0f4712 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:50.557154 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-117ed12f-90ae-482c-b392-2e2a0b9c4376 tempest-ListImageFiltersNegativeTestJSON-674354106 tempest-ListImageFiltersNegativeTestJSON-674354106-project] 10.222.0.100 "GET /compute/v2.1/images/98e97908-e985-43bc-8f8f-fac3e144b327" status: 404 len: 62 microversion: 2.1 time: 0.138992 Jan 22 21:13:50.557655 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2239/4676] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:13:50 2022] GET /compute/v2.1/images/98e97908-e985-43bc-8f8f-fac3e144b327 => generated 62 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:13:50.708697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-02690fa3-d52a-47bc-8262-d680ff0f4712 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:50.717791 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-02690fa3-d52a-47bc-8262-d680ff0f4712 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1326 microversion: 2.1 time: 0.178107 Jan 22 21:13:50.719028 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2438/4677] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:50 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1326 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:50.926393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-acd798da-c64c-4c44-a0a0-7c5f5ca4a8ef tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:50.927568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-acd798da-c64c-4c44-a0a0-7c5f5ca4a8ef tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:50.934054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acd798da-c64c-4c44-a0a0-7c5f5ca4a8ef tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:50.934516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acd798da-c64c-4c44-a0a0-7c5f5ca4a8ef tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:50.935377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acd798da-c64c-4c44-a0a0-7c5f5ca4a8ef tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:50.935863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acd798da-c64c-4c44-a0a0-7c5f5ca4a8ef tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:50.956105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2c4e28f6-6e36-4834-8690-de53ba5c06e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:50.956955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2c4e28f6-6e36-4834-8690-de53ba5c06e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:50.965272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c4e28f6-6e36-4834-8690-de53ba5c06e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:50.965756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c4e28f6-6e36-4834-8690-de53ba5c06e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:50.966554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c4e28f6-6e36-4834-8690-de53ba5c06e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:50.966999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c4e28f6-6e36-4834-8690-de53ba5c06e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:50.985096 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-acd798da-c64c-4c44-a0a0-7c5f5ca4a8ef tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.063196 Jan 22 21:13:50.985805 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2240/4678] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:50 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:51.010976 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2c4e28f6-6e36-4834-8690-de53ba5c06e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.058468 Jan 22 21:13:51.011794 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2439/4679] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:50 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:13:51.013590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0fa686b4-ff3a-41b3-bd2e-c754352f65a8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:51.014715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0fa686b4-ff3a-41b3-bd2e-c754352f65a8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:51.021672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fa686b4-ff3a-41b3-bd2e-c754352f65a8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:51.022209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fa686b4-ff3a-41b3-bd2e-c754352f65a8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:51.024029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fa686b4-ff3a-41b3-bd2e-c754352f65a8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:51.024655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fa686b4-ff3a-41b3-bd2e-c754352f65a8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:51.077618 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0fa686b4-ff3a-41b3-bd2e-c754352f65a8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.068817 Jan 22 21:13:51.081547 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2241/4680] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:51 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:51.736462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d96298aa-3905-45fd-84fe-eb8ab5c6bab5 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:51.737284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d96298aa-3905-45fd-84fe-eb8ab5c6bab5 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:51.745010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96298aa-3905-45fd-84fe-eb8ab5c6bab5 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:51.745739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96298aa-3905-45fd-84fe-eb8ab5c6bab5 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:51.746702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96298aa-3905-45fd-84fe-eb8ab5c6bab5 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:51.747715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96298aa-3905-45fd-84fe-eb8ab5c6bab5 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:51.889038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d96298aa-3905-45fd-84fe-eb8ab5c6bab5 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:51.896588 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d96298aa-3905-45fd-84fe-eb8ab5c6bab5 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1326 microversion: 2.1 time: 0.164525 Jan 22 21:13:51.897255 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2440/4681] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:51 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1326 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:51.997996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f32620fd-fc74-4588-b5ff-148c10267b91 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:51.999304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f32620fd-fc74-4588-b5ff-148c10267b91 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:52.007356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f32620fd-fc74-4588-b5ff-148c10267b91 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:52.007913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f32620fd-fc74-4588-b5ff-148c10267b91 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:52.008824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f32620fd-fc74-4588-b5ff-148c10267b91 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:52.009343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f32620fd-fc74-4588-b5ff-148c10267b91 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:52.022769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9c1a105e-85ae-41c6-881c-40e74a4216ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:52.024062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9c1a105e-85ae-41c6-881c-40e74a4216ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:52.031841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c1a105e-85ae-41c6-881c-40e74a4216ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:52.032742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c1a105e-85ae-41c6-881c-40e74a4216ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:52.033746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c1a105e-85ae-41c6-881c-40e74a4216ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:52.034414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c1a105e-85ae-41c6-881c-40e74a4216ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:52.054475 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f32620fd-fc74-4588-b5ff-148c10267b91 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.059765 Jan 22 21:13:52.058728 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2242/4682] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:51 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:52.080014 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9c1a105e-85ae-41c6-881c-40e74a4216ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.060979 Jan 22 21:13:52.084023 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2441/4683] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:52 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:13:52.091258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1224133d-c1f0-42d3-b70a-5eeab06bb129 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:52.092275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1224133d-c1f0-42d3-b70a-5eeab06bb129 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:52.101273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1224133d-c1f0-42d3-b70a-5eeab06bb129 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:52.101273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1224133d-c1f0-42d3-b70a-5eeab06bb129 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:52.101273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1224133d-c1f0-42d3-b70a-5eeab06bb129 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:52.101636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1224133d-c1f0-42d3-b70a-5eeab06bb129 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:52.153785 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1224133d-c1f0-42d3-b70a-5eeab06bb129 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.066644 Jan 22 21:13:52.154891 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2243/4684] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:52 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:52.913290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-02384c14-781a-4bab-85b7-5b2fae2ae3dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:52.913855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-02384c14-781a-4bab-85b7-5b2fae2ae3dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:52.921113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02384c14-781a-4bab-85b7-5b2fae2ae3dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:52.921621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02384c14-781a-4bab-85b7-5b2fae2ae3dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:52.922422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02384c14-781a-4bab-85b7-5b2fae2ae3dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:52.922882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02384c14-781a-4bab-85b7-5b2fae2ae3dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:52.997885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-1793166f-aadb-4c1c-81e1-1456ec280506 req-46f954f9-b25d-470b-ac0d-10c3e9d0e27b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a266513-609c-46ea-81b1-c23dc2304acf", "name": "network-vif-plugged", "status": "completed", "tag": "baa85dfe-66d8-48a7-83f6-d390af758567"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:53.000038 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:13:53.000038 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:13:53.009895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1793166f-aadb-4c1c-81e1-1456ec280506 req-46f954f9-b25d-470b-ac0d-10c3e9d0e27b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:53.010579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1793166f-aadb-4c1c-81e1-1456ec280506 req-46f954f9-b25d-470b-ac0d-10c3e9d0e27b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:53.025743 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-1793166f-aadb-4c1c-81e1-1456ec280506 req-46f954f9-b25d-470b-ac0d-10c3e9d0e27b service nova] Creating event network-vif-plugged:baa85dfe-66d8-48a7-83f6-d390af758567 for instance 2a266513-609c-46ea-81b1-c23dc2304acf on nch1-master-1 Jan 22 21:13:53.031293 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-1793166f-aadb-4c1c-81e1-1456ec280506 req-46f954f9-b25d-470b-ac0d-10c3e9d0e27b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037739 Jan 22 21:13:53.032163 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2244/4685] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:53.067911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-556d79b4-8c0a-4982-abb8-f773c035701b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:53.070567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-556d79b4-8c0a-4982-abb8-f773c035701b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:53.079079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-556d79b4-8c0a-4982-abb8-f773c035701b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:53.079808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-556d79b4-8c0a-4982-abb8-f773c035701b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:53.081036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-556d79b4-8c0a-4982-abb8-f773c035701b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:53.081708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-556d79b4-8c0a-4982-abb8-f773c035701b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:53.115666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-02384c14-781a-4bab-85b7-5b2fae2ae3dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:53.125743 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-02384c14-781a-4bab-85b7-5b2fae2ae3dc tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1326 microversion: 2.1 time: 0.216597 Jan 22 21:13:53.127211 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-556d79b4-8c0a-4982-abb8-f773c035701b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.063091 Jan 22 21:13:53.127953 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2442/4686] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:52 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1326 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:53.128083 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2245/4687] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:53 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:53.134280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b6ced730-8787-489f-8b49-ba70cab81fe7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:53.135298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b6ced730-8787-489f-8b49-ba70cab81fe7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:53.142609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6ced730-8787-489f-8b49-ba70cab81fe7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:53.143121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6ced730-8787-489f-8b49-ba70cab81fe7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:53.144111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6ced730-8787-489f-8b49-ba70cab81fe7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:53.144731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6ced730-8787-489f-8b49-ba70cab81fe7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:53.165266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-32c6e26a-4dc5-425a-b8c2-7751f859bf70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:53.166483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-32c6e26a-4dc5-425a-b8c2-7751f859bf70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:53.184726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32c6e26a-4dc5-425a-b8c2-7751f859bf70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:53.186277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32c6e26a-4dc5-425a-b8c2-7751f859bf70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:53.187519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32c6e26a-4dc5-425a-b8c2-7751f859bf70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:53.189761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32c6e26a-4dc5-425a-b8c2-7751f859bf70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:53.212981 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b6ced730-8787-489f-8b49-ba70cab81fe7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.083300 Jan 22 21:13:53.214739 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2246/4688] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:53 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:53.255424 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-32c6e26a-4dc5-425a-b8c2-7751f859bf70 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.094052 Jan 22 21:13:53.259786 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2443/4689] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:53 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:54.144853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2c8243fd-fba1-4b7e-93ae-142ab45c0e84 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:54.145693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2c8243fd-fba1-4b7e-93ae-142ab45c0e84 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:54.152062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b074e8d-d442-4083-b461-f0c35a0cdf30 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:54.155567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b074e8d-d442-4083-b461-f0c35a0cdf30 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:54.155684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c8243fd-fba1-4b7e-93ae-142ab45c0e84 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:54.155890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c8243fd-fba1-4b7e-93ae-142ab45c0e84 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:54.156961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c8243fd-fba1-4b7e-93ae-142ab45c0e84 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:54.157590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c8243fd-fba1-4b7e-93ae-142ab45c0e84 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:54.164623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b074e8d-d442-4083-b461-f0c35a0cdf30 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:54.165098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b074e8d-d442-4083-b461-f0c35a0cdf30 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:54.167364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b074e8d-d442-4083-b461-f0c35a0cdf30 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:54.168001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b074e8d-d442-4083-b461-f0c35a0cdf30 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:54.207462 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2c8243fd-fba1-4b7e-93ae-142ab45c0e84 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.069065 Jan 22 21:13:54.208916 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2247/4690] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:54 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:54.226716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-624ab142-1acc-4a7d-97ea-84bbcd9380f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:54.227765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-624ab142-1acc-4a7d-97ea-84bbcd9380f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:54.236628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-624ab142-1acc-4a7d-97ea-84bbcd9380f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:54.237093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-624ab142-1acc-4a7d-97ea-84bbcd9380f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:54.237965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-624ab142-1acc-4a7d-97ea-84bbcd9380f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:54.238415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-624ab142-1acc-4a7d-97ea-84bbcd9380f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:54.283415 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-624ab142-1acc-4a7d-97ea-84bbcd9380f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.060949 Jan 22 21:13:54.284327 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2248/4691] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:54 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:13:54.291883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-adef3538-67e7-43d4-bb90-b10360db457f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:54.292910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-adef3538-67e7-43d4-bb90-b10360db457f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:54.300994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adef3538-67e7-43d4-bb90-b10360db457f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:54.301752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adef3538-67e7-43d4-bb90-b10360db457f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:54.302724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adef3538-67e7-43d4-bb90-b10360db457f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:54.304546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adef3538-67e7-43d4-bb90-b10360db457f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:54.369203 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-adef3538-67e7-43d4-bb90-b10360db457f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.083281 Jan 22 21:13:54.369964 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2249/4692] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:54 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:54.431574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8b074e8d-d442-4083-b461-f0c35a0cdf30 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:54.439965 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b074e8d-d442-4083-b461-f0c35a0cdf30 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1326 microversion: 2.1 time: 0.299288 Jan 22 21:13:54.440555 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2444/4693] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:54 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1326 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:55.222150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a801da8e-4193-4e48-be2f-83c1125b0d44 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:55.223245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a801da8e-4193-4e48-be2f-83c1125b0d44 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:55.232329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a801da8e-4193-4e48-be2f-83c1125b0d44 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:55.233150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a801da8e-4193-4e48-be2f-83c1125b0d44 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:55.234105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a801da8e-4193-4e48-be2f-83c1125b0d44 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:55.234724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a801da8e-4193-4e48-be2f-83c1125b0d44 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:55.278404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-28d27e6f-6017-44ba-b93e-39769e6cedd1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'create', calling method: .version_select at 0x7f1ed66270d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1838581249", "description": "tempest-description-929820147"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:55.282074 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a801da8e-4193-4e48-be2f-83c1125b0d44 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.062693 Jan 22 21:13:55.283691 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2445/4694] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:55 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:55.295539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f44ce69d-8447-48f7-8d2b-d037da2cba03 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:55.296650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f44ce69d-8447-48f7-8d2b-d037da2cba03 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:55.304326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f44ce69d-8447-48f7-8d2b-d037da2cba03 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:55.304780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f44ce69d-8447-48f7-8d2b-d037da2cba03 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:55.305616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f44ce69d-8447-48f7-8d2b-d037da2cba03 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:55.306059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f44ce69d-8447-48f7-8d2b-d037da2cba03 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:55.348500 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f44ce69d-8447-48f7-8d2b-d037da2cba03 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.056875 Jan 22 21:13:55.350236 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2446/4695] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:55 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:13:55.381139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5ef481b8-d422-4c94-82f4-669a550e674a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:55.384201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5ef481b8-d422-4c94-82f4-669a550e674a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:55.391501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ef481b8-d422-4c94-82f4-669a550e674a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:55.391955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ef481b8-d422-4c94-82f4-669a550e674a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:55.397549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ef481b8-d422-4c94-82f4-669a550e674a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:55.397549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ef481b8-d422-4c94-82f4-669a550e674a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:55.454561 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5ef481b8-d422-4c94-82f4-669a550e674a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.073853 Jan 22 21:13:55.458822 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2447/4696] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:55 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:13:55.467074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ffe72884-3d15-4000-8343-f4df567c644c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:55.471779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ffe72884-3d15-4000-8343-f4df567c644c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:55.476112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffe72884-3d15-4000-8343-f4df567c644c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:55.476577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffe72884-3d15-4000-8343-f4df567c644c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:55.477394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffe72884-3d15-4000-8343-f4df567c644c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:55.477874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffe72884-3d15-4000-8343-f4df567c644c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:55.638915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ffe72884-3d15-4000-8343-f4df567c644c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:55.646394 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ffe72884-3d15-4000-8343-f4df567c644c tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1476 microversion: 2.1 time: 0.185174 Jan 22 21:13:55.647437 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2448/4697] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:55 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1476 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:55.663578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1f0d68c0-ddd3-4041-a573-553a89729a7d tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:55.664506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1f0d68c0-ddd3-4041-a573-553a89729a7d tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:55.671012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f0d68c0-ddd3-4041-a573-553a89729a7d tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:55.673094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f0d68c0-ddd3-4041-a573-553a89729a7d tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:55.673094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f0d68c0-ddd3-4041-a573-553a89729a7d tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:55.673094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f0d68c0-ddd3-4041-a573-553a89729a7d tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:55.707340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-1f0d68c0-ddd3-4041-a573-553a89729a7d tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lazy-loading 'flavor' on Instance uuid 2a266513-609c-46ea-81b1-c23dc2304acf {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:13:55.830400 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-28d27e6f-6017-44ba-b93e-39769e6cedd1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.847689 Jan 22 21:13:55.831013 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2250/4698] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:13:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:13:55.842600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1f8df858-f601-479b-886b-847655acca19 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'create', calling method: .version_select at 0x7f1ed503d9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-441440260", "description": "tempest-description-337905748"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:56.067723 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1f0d68c0-ddd3-4041-a573-553a89729a7d tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf/action" status: 202 len: 0 microversion: 2.1 time: 0.407974 Jan 22 21:13:56.073096 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2449/4699] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:55 2022] POST /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:13:56.079168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-102b68dd-6410-45b3-a646-f067ee381b6b tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:56.079930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-102b68dd-6410-45b3-a646-f067ee381b6b tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:56.086931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-102b68dd-6410-45b3-a646-f067ee381b6b tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:56.087452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-102b68dd-6410-45b3-a646-f067ee381b6b tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:56.095793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-102b68dd-6410-45b3-a646-f067ee381b6b tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:56.095793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-102b68dd-6410-45b3-a646-f067ee381b6b tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:56.404216 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-102b68dd-6410-45b3-a646-f067ee381b6b tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1635 microversion: 2.1 time: 0.329111 Jan 22 21:13:56.414715 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2450/4700] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:56 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1635 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:56.422407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5b2a77e1-4426-4fc0-9c87-d2a910a87261 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:56.423400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5b2a77e1-4426-4fc0-9c87-d2a910a87261 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:56.430567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b2a77e1-4426-4fc0-9c87-d2a910a87261 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:56.431038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b2a77e1-4426-4fc0-9c87-d2a910a87261 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:56.431854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b2a77e1-4426-4fc0-9c87-d2a910a87261 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:56.432301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b2a77e1-4426-4fc0-9c87-d2a910a87261 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:56.445615 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1f8df858-f601-479b-886b-847655acca19 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.606192 Jan 22 21:13:56.447940 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2251/4701] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:13:55 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:13:56.453294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-249898ec-d6cc-49b7-b909-e80baf684b52 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:56.454496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-249898ec-d6cc-49b7-b909-e80baf684b52 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:56.477241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-249898ec-d6cc-49b7-b909-e80baf684b52 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:56.479927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-249898ec-d6cc-49b7-b909-e80baf684b52 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:56.480871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-249898ec-d6cc-49b7-b909-e80baf684b52 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:56.481426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-249898ec-d6cc-49b7-b909-e80baf684b52 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:56.503997 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5b2a77e1-4426-4fc0-9c87-d2a910a87261 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.087913 Jan 22 21:13:56.504666 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2451/4702] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:56 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:56.521295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9ec089e0-718a-4d8a-b9c0-81624aa38ba2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:56.522992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9ec089e0-718a-4d8a-b9c0-81624aa38ba2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:56.535911 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-249898ec-d6cc-49b7-b909-e80baf684b52 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.084830 Jan 22 21:13:56.541556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ec089e0-718a-4d8a-b9c0-81624aa38ba2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:56.541988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ec089e0-718a-4d8a-b9c0-81624aa38ba2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:56.542147 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2252/4703] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:56 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:56.542798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ec089e0-718a-4d8a-b9c0-81624aa38ba2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:56.543401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ec089e0-718a-4d8a-b9c0-81624aa38ba2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:56.619850 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9ec089e0-718a-4d8a-b9c0-81624aa38ba2 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.109136 Jan 22 21:13:56.622505 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2452/4704] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:56 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:56.636760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1218060643", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "68368c3e-1691-4fac-8baf-b36339fae90d"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:56.699122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] validate_networks() for [('68368c3e-1691-4fac-8baf-b36339fae90d', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:13:57.422619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a1449a76-79d0-4b49-9e53-bb59705d9e9e tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:57.423312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a1449a76-79d0-4b49-9e53-bb59705d9e9e tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:57.431092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1449a76-79d0-4b49-9e53-bb59705d9e9e tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:57.431770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1449a76-79d0-4b49-9e53-bb59705d9e9e tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:57.432890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1449a76-79d0-4b49-9e53-bb59705d9e9e tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:57.433717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1449a76-79d0-4b49-9e53-bb59705d9e9e tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:57.573382 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a1449a76-79d0-4b49-9e53-bb59705d9e9e tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1618 microversion: 2.1 time: 0.155107 Jan 22 21:13:57.575295 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2453/4705] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:57 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1618 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:13:57.581992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6d99ce8f-4d55-42ec-8def-8263b7b1fb9e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:57.583286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6d99ce8f-4d55-42ec-8def-8263b7b1fb9e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:57.593292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d99ce8f-4d55-42ec-8def-8263b7b1fb9e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:57.594230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d99ce8f-4d55-42ec-8def-8263b7b1fb9e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:57.595437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d99ce8f-4d55-42ec-8def-8263b7b1fb9e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:57.595949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d99ce8f-4d55-42ec-8def-8263b7b1fb9e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:57.673318 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6d99ce8f-4d55-42ec-8def-8263b7b1fb9e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.095385 Jan 22 21:13:57.678825 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2454/4706] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:57 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:57.682173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-180b8684-8bf4-4d74-8e46-12c745365558 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:57.683364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-180b8684-8bf4-4d74-8e46-12c745365558 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:57.701692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-180b8684-8bf4-4d74-8e46-12c745365558 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:57.701692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-180b8684-8bf4-4d74-8e46-12c745365558 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:57.701692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-180b8684-8bf4-4d74-8e46-12c745365558 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:57.702864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-180b8684-8bf4-4d74-8e46-12c745365558 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:57.708057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:13:57.710831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:13:57.712594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:13:57.713343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:13:57.714445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:13:57.728482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:57.729827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:57.730193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:57.731332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:57.757944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Getting quotas for project 7a9f8a87f60b4668b8a968fa1e63282d. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:13:57.760223 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-180b8684-8bf4-4d74-8e46-12c745365558 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.083848 Jan 22 21:13:57.761591 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2455/4707] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:57 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:57.763417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Getting quotas for user e2bb2fab98714702bab120f7e5a222d6 and project 7a9f8a87f60b4668b8a968fa1e63282d. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:13:57.767100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-006c4768-cc73-42df-b7ab-1298ffb10e43 tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:57.770714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-006c4768-cc73-42df-b7ab-1298ffb10e43 tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:57.776114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-006c4768-cc73-42df-b7ab-1298ffb10e43 tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:57.776581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-006c4768-cc73-42df-b7ab-1298ffb10e43 tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:57.777387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-006c4768-cc73-42df-b7ab-1298ffb10e43 tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:57.777875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-006c4768-cc73-42df-b7ab-1298ffb10e43 tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:57.778558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:13:57.781052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:13:57.808600 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-006c4768-cc73-42df-b7ab-1298ffb10e43 tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] HTTP exception thrown: Cannot 'migrate' instance 2a266513-609c-46ea-81b1-c23dc2304acf while it is in vm_state suspended Jan 22 21:13:57.809212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-006c4768-cc73-42df-b7ab-1298ffb10e43 tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Returning 409 to user: Cannot 'migrate' instance 2a266513-609c-46ea-81b1-c23dc2304acf while it is in vm_state suspended {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:13:57.810344 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-006c4768-cc73-42df-b7ab-1298ffb10e43 tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf/action" status: 409 len: 148 microversion: 2.1 time: 0.048201 Jan 22 21:13:57.810917 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2456/4708] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:57 2022] POST /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf/action => generated 148 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:13:57.815414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-02638147-feea-4541-9be2-dbc9333cb875 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:57.816333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-02638147-feea-4541-9be2-dbc9333cb875 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:57.823286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02638147-feea-4541-9be2-dbc9333cb875 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:57.823945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02638147-feea-4541-9be2-dbc9333cb875 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:57.824941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02638147-feea-4541-9be2-dbc9333cb875 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:57.825329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02638147-feea-4541-9be2-dbc9333cb875 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:57.867620 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-02638147-feea-4541-9be2-dbc9333cb875 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.055467 Jan 22 21:13:57.868983 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2457/4709] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:57 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:57.874238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d39d17f9-0787-48c1-8abb-cd12a0d4ed93 tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:57.875582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d39d17f9-0787-48c1-8abb-cd12a0d4ed93 tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:13:57.876400 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d39d17f9-0787-48c1-8abb-cd12a0d4ed93 tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379/action" status: 400 len: 144 microversion: 2.1 time: 0.006142 Jan 22 21:13:57.876936 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2458/4710] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:57 2022] POST /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379/action => generated 144 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:13:57.889323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2b6f5a51-b8fd-40df-bd5c-ecdf7f8f08fb tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:57.890459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2b6f5a51-b8fd-40df-bd5c-ecdf7f8f08fb tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:13:57.891374 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2b6f5a51-b8fd-40df-bd5c-ecdf7f8f08fb tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379/action" status: 400 len: 120 microversion: 2.1 time: 0.008914 Jan 22 21:13:57.892280 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2459/4711] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:57 2022] POST /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379/action => generated 120 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 22 21:13:57.911854 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2764b10e-bc2a-45ad-9de4-88c62f97a79a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.279147 Jan 22 21:13:57.913167 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2253/4712] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:13:56 2022] POST /compute/v2.1/servers => generated 382 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:13:57.921269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3504363f-9b38-4f68-9ec2-2f6363e6a01e tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:57.922419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3504363f-9b38-4f68-9ec2-2f6363e6a01e tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Failed to fetch instance by id 999 {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2871}} Jan 22 21:13:57.922714 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-3504363f-9b38-4f68-9ec2-2f6363e6a01e tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] HTTP exception thrown: Instance 999 could not be found. Jan 22 21:13:57.923270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3504363f-9b38-4f68-9ec2-2f6363e6a01e tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:13:57.924077 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3504363f-9b38-4f68-9ec2-2f6363e6a01e tempest-ServersAdminNegativeTestJSON-1229709273 tempest-ServersAdminNegativeTestJSON-1229709273-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.013490 Jan 22 21:13:57.924674 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2460/4713] 10.222.0.100 () {60 vars in 1183 bytes} [Sat Jan 22 21:13:57 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:13:57.930282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ad222d90-e778-401f-8061-a94255ea73d9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:57.930898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ad222d90-e778-401f-8061-a94255ea73d9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:57.940549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5de84308-9bd4-4374-9ed8-ef626e7ac579 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:57.940748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5de84308-9bd4-4374-9ed8-ef626e7ac579 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:57.947935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5de84308-9bd4-4374-9ed8-ef626e7ac579 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:57.948388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5de84308-9bd4-4374-9ed8-ef626e7ac579 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:57.949332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5de84308-9bd4-4374-9ed8-ef626e7ac579 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:57.949756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5de84308-9bd4-4374-9ed8-ef626e7ac579 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:57.978068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5de84308-9bd4-4374-9ed8-ef626e7ac579 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:13:57.996419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ad222d90-e778-401f-8061-a94255ea73d9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:58.005385 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ad222d90-e778-401f-8061-a94255ea73d9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 200 len: 1220 microversion: 2.1 time: 0.079405 Jan 22 21:13:58.014967 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2254/4714] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:57 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:58.362985 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5de84308-9bd4-4374-9ed8-ef626e7ac579 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "DELETE /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 204 len: 0 microversion: 2.1 time: 0.427142 Jan 22 21:13:58.363662 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2461/4715] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:13:57 2022] DELETE /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:13:58.371627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-26047056-7f16-49ee-a132-32cf3d886768 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:58.372789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-26047056-7f16-49ee-a132-32cf3d886768 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:58.380414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26047056-7f16-49ee-a132-32cf3d886768 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:58.381092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26047056-7f16-49ee-a132-32cf3d886768 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:58.382285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26047056-7f16-49ee-a132-32cf3d886768 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:58.382737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26047056-7f16-49ee-a132-32cf3d886768 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:58.517229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-26047056-7f16-49ee-a132-32cf3d886768 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:58.525437 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-26047056-7f16-49ee-a132-32cf3d886768 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1473 microversion: 2.1 time: 0.157610 Jan 22 21:13:58.526093 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2255/4716] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:58 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1473 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:58.686373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a77b9485-4d0d-4125-98cb-9aadb602d8d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:58.687384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a77b9485-4d0d-4125-98cb-9aadb602d8d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:58.697314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a77b9485-4d0d-4125-98cb-9aadb602d8d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:58.698064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a77b9485-4d0d-4125-98cb-9aadb602d8d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:58.699052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a77b9485-4d0d-4125-98cb-9aadb602d8d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:58.699512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a77b9485-4d0d-4125-98cb-9aadb602d8d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:58.744561 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a77b9485-4d0d-4125-98cb-9aadb602d8d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.062017 Jan 22 21:13:58.745346 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2462/4717] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:58 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:58.773843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9e76b675-8efb-4bbf-80e4-982d0135d1d5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:58.774532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9e76b675-8efb-4bbf-80e4-982d0135d1d5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:58.782207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e76b675-8efb-4bbf-80e4-982d0135d1d5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:58.782687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e76b675-8efb-4bbf-80e4-982d0135d1d5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:58.783476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e76b675-8efb-4bbf-80e4-982d0135d1d5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:58.783921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e76b675-8efb-4bbf-80e4-982d0135d1d5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:58.830654 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9e76b675-8efb-4bbf-80e4-982d0135d1d5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.061699 Jan 22 21:13:58.831308 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2256/4718] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:58 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:58.880385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-426c4390-d7b8-43d7-874c-bff7c55b7a39 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:58.881605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-426c4390-d7b8-43d7-874c-bff7c55b7a39 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:58.888678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-426c4390-d7b8-43d7-874c-bff7c55b7a39 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:58.889137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-426c4390-d7b8-43d7-874c-bff7c55b7a39 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:58.889965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-426c4390-d7b8-43d7-874c-bff7c55b7a39 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:58.890414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-426c4390-d7b8-43d7-874c-bff7c55b7a39 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:58.932419 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-426c4390-d7b8-43d7-874c-bff7c55b7a39 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.056058 Jan 22 21:13:58.933274 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2463/4719] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:58 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:59.023239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-647b7205-40dc-48b4-a77d-9c57c0931550 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:59.024334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-647b7205-40dc-48b4-a77d-9c57c0931550 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:59.085284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-647b7205-40dc-48b4-a77d-9c57c0931550 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:59.091899 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-647b7205-40dc-48b4-a77d-9c57c0931550 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 200 len: 1220 microversion: 2.1 time: 0.072995 Jan 22 21:13:59.092470 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2257/4720] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:59 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 1220 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:59.544148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f365d640-af1d-44db-873e-b467e7b03c66 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:13:59.544960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f365d640-af1d-44db-873e-b467e7b03c66 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:59.555091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f365d640-af1d-44db-873e-b467e7b03c66 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:59.555626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f365d640-af1d-44db-873e-b467e7b03c66 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:59.556783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f365d640-af1d-44db-873e-b467e7b03c66 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:59.557310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f365d640-af1d-44db-873e-b467e7b03c66 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:59.711161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f365d640-af1d-44db-873e-b467e7b03c66 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:13:59.720048 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f365d640-af1d-44db-873e-b467e7b03c66 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1473 microversion: 2.1 time: 0.180360 Jan 22 21:13:59.721002 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2464/4721] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:13:59 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1473 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:13:59.756862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-66415451-c216-4303-8fb2-be7d5904398d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:59.757917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-66415451-c216-4303-8fb2-be7d5904398d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:59.765121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66415451-c216-4303-8fb2-be7d5904398d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:59.765951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66415451-c216-4303-8fb2-be7d5904398d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:59.767086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66415451-c216-4303-8fb2-be7d5904398d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:59.771003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66415451-c216-4303-8fb2-be7d5904398d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:59.819967 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-66415451-c216-4303-8fb2-be7d5904398d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.066656 Jan 22 21:13:59.826728 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2258/4722] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:59 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:13:59.851312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-613a2913-6b46-4e5f-96f9-ae63f14fa857 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:59.851312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-613a2913-6b46-4e5f-96f9-ae63f14fa857 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:59.854501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-613a2913-6b46-4e5f-96f9-ae63f14fa857 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:59.855665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-613a2913-6b46-4e5f-96f9-ae63f14fa857 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:59.856480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-613a2913-6b46-4e5f-96f9-ae63f14fa857 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:59.856923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-613a2913-6b46-4e5f-96f9-ae63f14fa857 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:59.906754 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-613a2913-6b46-4e5f-96f9-ae63f14fa857 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.067821 Jan 22 21:13:59.907533 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2465/4723] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:13:59 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:13:59.948597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e547ec0c-edf1-4564-b10a-7a24be9cad96 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:13:59.954782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e547ec0c-edf1-4564-b10a-7a24be9cad96 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:13:59.968082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e547ec0c-edf1-4564-b10a-7a24be9cad96 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:59.968082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e547ec0c-edf1-4564-b10a-7a24be9cad96 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:13:59.968082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e547ec0c-edf1-4564-b10a-7a24be9cad96 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:13:59.968082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e547ec0c-edf1-4564-b10a-7a24be9cad96 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:00.007962 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e547ec0c-edf1-4564-b10a-7a24be9cad96 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.067801 Jan 22 21:14:00.012009 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2259/4724] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:13:59 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:00.110308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-027d6b5f-ba73-4734-8714-c6df8972a39d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:00.111004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-027d6b5f-ba73-4734-8714-c6df8972a39d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:00.118139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-027d6b5f-ba73-4734-8714-c6df8972a39d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:00.118592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-027d6b5f-ba73-4734-8714-c6df8972a39d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:00.119386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-027d6b5f-ba73-4734-8714-c6df8972a39d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:00.119823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-027d6b5f-ba73-4734-8714-c6df8972a39d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:00.185013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-027d6b5f-ba73-4734-8714-c6df8972a39d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:00.193093 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-027d6b5f-ba73-4734-8714-c6df8972a39d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 200 len: 1272 microversion: 2.1 time: 0.086781 Jan 22 21:14:00.197690 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2466/4725] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:00 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:00.738698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ae60f3c-ad69-4c2c-9e12-e7f8c7ae93e2 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:00.739481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3ae60f3c-ad69-4c2c-9e12-e7f8c7ae93e2 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:00.746759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ae60f3c-ad69-4c2c-9e12-e7f8c7ae93e2 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:00.747475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ae60f3c-ad69-4c2c-9e12-e7f8c7ae93e2 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:00.748472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ae60f3c-ad69-4c2c-9e12-e7f8c7ae93e2 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:00.749066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ae60f3c-ad69-4c2c-9e12-e7f8c7ae93e2 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:00.831859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-29dbf9dd-3ee6-4236-b57a-dea3177eaa60 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:00.832786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-29dbf9dd-3ee6-4236-b57a-dea3177eaa60 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:00.840347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29dbf9dd-3ee6-4236-b57a-dea3177eaa60 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:00.841241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29dbf9dd-3ee6-4236-b57a-dea3177eaa60 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:00.842498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29dbf9dd-3ee6-4236-b57a-dea3177eaa60 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:00.843214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29dbf9dd-3ee6-4236-b57a-dea3177eaa60 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:00.901244 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-29dbf9dd-3ee6-4236-b57a-dea3177eaa60 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.073035 Jan 22 21:14:00.910305 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2467/4726] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:00 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:14:00.924921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-694dd8e1-d8d5-488a-b946-650401b7941a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:00.927873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-694dd8e1-d8d5-488a-b946-650401b7941a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:00.936900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-694dd8e1-d8d5-488a-b946-650401b7941a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:00.937448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-694dd8e1-d8d5-488a-b946-650401b7941a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:00.938395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-694dd8e1-d8d5-488a-b946-650401b7941a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:00.939143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-694dd8e1-d8d5-488a-b946-650401b7941a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:00.990069 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-694dd8e1-d8d5-488a-b946-650401b7941a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.073012 Jan 22 21:14:00.992444 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2468/4727] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:00 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:01.030809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f2badaad-05dd-458b-9c29-eb067ca86f05 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:01.032000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f2badaad-05dd-458b-9c29-eb067ca86f05 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:01.046807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2badaad-05dd-458b-9c29-eb067ca86f05 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:01.051672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2badaad-05dd-458b-9c29-eb067ca86f05 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:01.057492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3ae60f3c-ad69-4c2c-9e12-e7f8c7ae93e2 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:01.062447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2badaad-05dd-458b-9c29-eb067ca86f05 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:01.062982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2badaad-05dd-458b-9c29-eb067ca86f05 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:01.070988 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3ae60f3c-ad69-4c2c-9e12-e7f8c7ae93e2 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1473 microversion: 2.1 time: 0.336086 Jan 22 21:14:01.075722 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2260/4728] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:00 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1473 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:01.108846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-18cd4cc5-6040-4469-9878-f0e60f5ff606 req-26c5ecc2-7fff-4cbe-8a53-a93b251f2def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a266513-609c-46ea-81b1-c23dc2304acf", "name": "network-vif-deleted", "tag": "baa85dfe-66d8-48a7-83f6-d390af758567"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:01.110874 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:14:01.110874 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:14:01.120586 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f2badaad-05dd-458b-9c29-eb067ca86f05 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.103673 Jan 22 21:14:01.121250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-18cd4cc5-6040-4469-9878-f0e60f5ff606 req-26c5ecc2-7fff-4cbe-8a53-a93b251f2def service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:01.124365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-18cd4cc5-6040-4469-9878-f0e60f5ff606 req-26c5ecc2-7fff-4cbe-8a53-a93b251f2def service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:01.124498 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2469/4729] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:01 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:01.135735 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-18cd4cc5-6040-4469-9878-f0e60f5ff606 req-26c5ecc2-7fff-4cbe-8a53-a93b251f2def service nova] Creating event network-vif-deleted:baa85dfe-66d8-48a7-83f6-d390af758567 for instance 2a266513-609c-46ea-81b1-c23dc2304acf on nch1-master-1 Jan 22 21:14:01.140781 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-18cd4cc5-6040-4469-9878-f0e60f5ff606 req-26c5ecc2-7fff-4cbe-8a53-a93b251f2def service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036783 Jan 22 21:14:01.141823 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2261/4730] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:14:01.212670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab64b110-0c23-487f-a601-8cc432087069 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:01.213311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ab64b110-0c23-487f-a601-8cc432087069 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:01.220353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab64b110-0c23-487f-a601-8cc432087069 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:01.220809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab64b110-0c23-487f-a601-8cc432087069 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:01.221656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab64b110-0c23-487f-a601-8cc432087069 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:01.222099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab64b110-0c23-487f-a601-8cc432087069 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:01.285068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ab64b110-0c23-487f-a601-8cc432087069 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:01.294429 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab64b110-0c23-487f-a601-8cc432087069 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 200 len: 1278 microversion: 2.1 time: 0.086703 Jan 22 21:14:01.295204 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2470/4731] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:01 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:01.918754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a5f1127f-da0c-44f0-96bf-9b699828564e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:01.921159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a5f1127f-da0c-44f0-96bf-9b699828564e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:01.930629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5f1127f-da0c-44f0-96bf-9b699828564e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:01.931341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5f1127f-da0c-44f0-96bf-9b699828564e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:01.932451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5f1127f-da0c-44f0-96bf-9b699828564e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:01.933055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5f1127f-da0c-44f0-96bf-9b699828564e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:01.981888 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a5f1127f-da0c-44f0-96bf-9b699828564e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.067201 Jan 22 21:14:01.983079 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2262/4732] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:01 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:02.002516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-566117dd-ff1f-4643-90d8-4e5b069ea987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:02.004275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-566117dd-ff1f-4643-90d8-4e5b069ea987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:02.012041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-566117dd-ff1f-4643-90d8-4e5b069ea987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:02.012544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-566117dd-ff1f-4643-90d8-4e5b069ea987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:02.014345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-566117dd-ff1f-4643-90d8-4e5b069ea987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:02.014345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-566117dd-ff1f-4643-90d8-4e5b069ea987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:02.064834 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-566117dd-ff1f-4643-90d8-4e5b069ea987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.065862 Jan 22 21:14:02.065699 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2471/4733] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:01 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:02.093525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bcd73d55-50d3-425f-83f1-ae6fba54f3d6 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:02.094318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bcd73d55-50d3-425f-83f1-ae6fba54f3d6 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:02.102649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcd73d55-50d3-425f-83f1-ae6fba54f3d6 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:02.103116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcd73d55-50d3-425f-83f1-ae6fba54f3d6 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:02.103923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcd73d55-50d3-425f-83f1-ae6fba54f3d6 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:02.104501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcd73d55-50d3-425f-83f1-ae6fba54f3d6 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:02.133063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f4c36d40-b791-493d-96bd-6e6194d47738 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:02.134304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f4c36d40-b791-493d-96bd-6e6194d47738 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:02.136985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcd73d55-50d3-425f-83f1-ae6fba54f3d6 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:02.137440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcd73d55-50d3-425f-83f1-ae6fba54f3d6 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:02.139726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-bcd73d55-50d3-425f-83f1-ae6fba54f3d6 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lazy-loading 'fault' on Instance uuid 2a266513-609c-46ea-81b1-c23dc2304acf {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:14:02.144136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4c36d40-b791-493d-96bd-6e6194d47738 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:02.145197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4c36d40-b791-493d-96bd-6e6194d47738 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:02.148247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4c36d40-b791-493d-96bd-6e6194d47738 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:02.149181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4c36d40-b791-493d-96bd-6e6194d47738 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:02.184287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bcd73d55-50d3-425f-83f1-ae6fba54f3d6 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:02.191991 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bcd73d55-50d3-425f-83f1-ae6fba54f3d6 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 200 len: 1316 microversion: 2.1 time: 0.103066 Jan 22 21:14:02.192958 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2263/4734] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:02 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 1316 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:02.215817 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f4c36d40-b791-493d-96bd-6e6194d47738 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.086792 Jan 22 21:14:02.217532 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2472/4735] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:02 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:02.313025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a48ce10-853d-4695-9997-af479125183a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:02.313025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9a48ce10-853d-4695-9997-af479125183a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:02.317695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a48ce10-853d-4695-9997-af479125183a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:02.318165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a48ce10-853d-4695-9997-af479125183a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:02.330220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a48ce10-853d-4695-9997-af479125183a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:02.330220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a48ce10-853d-4695-9997-af479125183a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:02.512646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9a48ce10-853d-4695-9997-af479125183a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:02.520554 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a48ce10-853d-4695-9997-af479125183a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 200 len: 1320 microversion: 2.1 time: 0.213855 Jan 22 21:14:02.521213 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2264/4736] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:02 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 1320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:02.998360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d0e3e79e-fac0-4f05-85d9-7ba1596b97ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:02.999818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d0e3e79e-fac0-4f05-85d9-7ba1596b97ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:03.012008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0e3e79e-fac0-4f05-85d9-7ba1596b97ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:03.012669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0e3e79e-fac0-4f05-85d9-7ba1596b97ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:03.013876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0e3e79e-fac0-4f05-85d9-7ba1596b97ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:03.015034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0e3e79e-fac0-4f05-85d9-7ba1596b97ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:03.063886 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d0e3e79e-fac0-4f05-85d9-7ba1596b97ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.073569 Jan 22 21:14:03.067913 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2473/4737] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:02 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:03.076446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d97b3dc7-c73a-450d-a0ee-4c2c977a3ef3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:03.077375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d97b3dc7-c73a-450d-a0ee-4c2c977a3ef3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:03.084542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d97b3dc7-c73a-450d-a0ee-4c2c977a3ef3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:03.085320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d97b3dc7-c73a-450d-a0ee-4c2c977a3ef3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:03.086176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d97b3dc7-c73a-450d-a0ee-4c2c977a3ef3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:03.086633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d97b3dc7-c73a-450d-a0ee-4c2c977a3ef3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:03.135210 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d97b3dc7-c73a-450d-a0ee-4c2c977a3ef3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.062590 Jan 22 21:14:03.136132 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2265/4738] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:03 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:03.159778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-b5cc1866-aadb-4d3c-a234-0ee645630d65 req-32a23719-b062-419c-97df-22409480b695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d1e763-6bd8-4953-b498-12aca41a8786", "tag": "92eb88b1-b83c-46dd-8fa7-9f78e33202e2"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:03.161264 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:14:03.161264 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:14:03.170728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b5cc1866-aadb-4d3c-a234-0ee645630d65 req-32a23719-b062-419c-97df-22409480b695 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:03.171417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b5cc1866-aadb-4d3c-a234-0ee645630d65 req-32a23719-b062-419c-97df-22409480b695 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:03.188324 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-b5cc1866-aadb-4d3c-a234-0ee645630d65 req-32a23719-b062-419c-97df-22409480b695 service nova] Creating event network-changed:92eb88b1-b83c-46dd-8fa7-9f78e33202e2 for instance f7d1e763-6bd8-4953-b498-12aca41a8786 on nch1-master-1 Jan 22 21:14:03.193197 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-b5cc1866-aadb-4d3c-a234-0ee645630d65 req-32a23719-b062-419c-97df-22409480b695 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037688 Jan 22 21:14:03.194720 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2474/4739] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:14:03.220488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-37255e0d-d43c-4fac-8851-4735538c1220 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:03.221867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-37255e0d-d43c-4fac-8851-4735538c1220 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: 2a266513-609c-46ea-81b1-c23dc2304acf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:03.234204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37255e0d-d43c-4fac-8851-4735538c1220 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:03.234913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37255e0d-d43c-4fac-8851-4735538c1220 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:03.236032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37255e0d-d43c-4fac-8851-4735538c1220 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:03.236277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-317a21e4-65e1-4280-932b-652edd94999b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:03.236693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37255e0d-d43c-4fac-8851-4735538c1220 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:03.237416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-317a21e4-65e1-4280-932b-652edd94999b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:03.245645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-317a21e4-65e1-4280-932b-652edd94999b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:03.246889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-317a21e4-65e1-4280-932b-652edd94999b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:03.247700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-317a21e4-65e1-4280-932b-652edd94999b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:03.248140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-317a21e4-65e1-4280-932b-652edd94999b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:03.276292 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-37255e0d-d43c-4fac-8851-4735538c1220 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] HTTP exception thrown: Instance 2a266513-609c-46ea-81b1-c23dc2304acf could not be found. Jan 22 21:14:03.277711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-37255e0d-d43c-4fac-8851-4735538c1220 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Returning 404 to user: Instance 2a266513-609c-46ea-81b1-c23dc2304acf could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:03.278837 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-37255e0d-d43c-4fac-8851-4735538c1220 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf" status: 404 len: 111 microversion: 2.1 time: 0.064890 Jan 22 21:14:03.279887 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2266/4740] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:03 2022] GET /compute/v2.1/servers/2a266513-609c-46ea-81b1-c23dc2304acf => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:14:03.290175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-abc4a124-c6ef-40d5-a2b4-4ea632725203 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:03.290943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-abc4a124-c6ef-40d5-a2b4-4ea632725203 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:03.292172 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-317a21e4-65e1-4280-932b-652edd94999b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.060718 Jan 22 21:14:03.293026 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2475/4741] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:03 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:03.300163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abc4a124-c6ef-40d5-a2b4-4ea632725203 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:03.300633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abc4a124-c6ef-40d5-a2b4-4ea632725203 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:03.301412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abc4a124-c6ef-40d5-a2b4-4ea632725203 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:03.302651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abc4a124-c6ef-40d5-a2b4-4ea632725203 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:03.329593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-abc4a124-c6ef-40d5-a2b4-4ea632725203 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:14:03.538943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7ff70ba2-5f51-483f-8379-98b0b956c385 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:03.540477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7ff70ba2-5f51-483f-8379-98b0b956c385 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:03.549154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ff70ba2-5f51-483f-8379-98b0b956c385 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:03.551023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ff70ba2-5f51-483f-8379-98b0b956c385 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:03.551843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ff70ba2-5f51-483f-8379-98b0b956c385 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:03.552370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ff70ba2-5f51-483f-8379-98b0b956c385 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:03.595494 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-abc4a124-c6ef-40d5-a2b4-4ea632725203 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 204 len: 0 microversion: 2.1 time: 0.310557 Jan 22 21:14:03.596221 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2267/4742] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:14:03 2022] DELETE /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:14:03.606172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c770ed8a-6db3-4d3a-a4ac-37e8462e57db tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:03.606976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c770ed8a-6db3-4d3a-a4ac-37e8462e57db tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:03.613355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c770ed8a-6db3-4d3a-a4ac-37e8462e57db tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:03.613953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c770ed8a-6db3-4d3a-a4ac-37e8462e57db tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:03.614893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c770ed8a-6db3-4d3a-a4ac-37e8462e57db tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:03.617147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c770ed8a-6db3-4d3a-a4ac-37e8462e57db tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:03.721642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7ff70ba2-5f51-483f-8379-98b0b956c385 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:03.730359 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7ff70ba2-5f51-483f-8379-98b0b956c385 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 200 len: 1320 microversion: 2.1 time: 0.197175 Jan 22 21:14:03.730948 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2476/4743] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:03 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:03.843961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c770ed8a-6db3-4d3a-a4ac-37e8462e57db tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:03.853662 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c770ed8a-6db3-4d3a-a4ac-37e8462e57db tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1482 microversion: 2.1 time: 0.251392 Jan 22 21:14:03.854905 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2268/4744] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:03 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1482 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:04.075782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-095fb785-0ac7-4b85-ba77-1196c186e94d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:04.076732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-095fb785-0ac7-4b85-ba77-1196c186e94d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:04.084390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-095fb785-0ac7-4b85-ba77-1196c186e94d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:04.085426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-095fb785-0ac7-4b85-ba77-1196c186e94d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:04.086478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-095fb785-0ac7-4b85-ba77-1196c186e94d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:04.086915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-095fb785-0ac7-4b85-ba77-1196c186e94d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:04.128803 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-095fb785-0ac7-4b85-ba77-1196c186e94d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.056987 Jan 22 21:14:04.129446 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2477/4745] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:04 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:04.146708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-47a65383-d8ca-484a-82b6-7e82c604d0a5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:04.148249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-47a65383-d8ca-484a-82b6-7e82c604d0a5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:04.156741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47a65383-d8ca-484a-82b6-7e82c604d0a5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:04.156741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47a65383-d8ca-484a-82b6-7e82c604d0a5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:04.156741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47a65383-d8ca-484a-82b6-7e82c604d0a5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:04.156741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47a65383-d8ca-484a-82b6-7e82c604d0a5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:04.197809 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-47a65383-d8ca-484a-82b6-7e82c604d0a5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.054292 Jan 22 21:14:04.198581 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2269/4746] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:04 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:04.305377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e564187a-f819-4730-8f09-5cade2099d39 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:04.306354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e564187a-f819-4730-8f09-5cade2099d39 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:04.313370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e564187a-f819-4730-8f09-5cade2099d39 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:04.313853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e564187a-f819-4730-8f09-5cade2099d39 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:04.314639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e564187a-f819-4730-8f09-5cade2099d39 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:04.315107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e564187a-f819-4730-8f09-5cade2099d39 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:04.357727 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e564187a-f819-4730-8f09-5cade2099d39 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.056800 Jan 22 21:14:04.358800 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2478/4747] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:04 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:04.748758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ba13b216-212e-40fb-a800-250f1cdbf184 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:04.753224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ba13b216-212e-40fb-a800-250f1cdbf184 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:04.756507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba13b216-212e-40fb-a800-250f1cdbf184 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:04.757226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba13b216-212e-40fb-a800-250f1cdbf184 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:04.758243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba13b216-212e-40fb-a800-250f1cdbf184 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:04.758697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba13b216-212e-40fb-a800-250f1cdbf184 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:04.872367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-29405c42-0157-4d36-9b13-1db0ef28b148 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:04.873200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-29405c42-0157-4d36-9b13-1db0ef28b148 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:04.881338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29405c42-0157-4d36-9b13-1db0ef28b148 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:04.883019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29405c42-0157-4d36-9b13-1db0ef28b148 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:04.884604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29405c42-0157-4d36-9b13-1db0ef28b148 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:04.885119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29405c42-0157-4d36-9b13-1db0ef28b148 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:04.901482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ba13b216-212e-40fb-a800-250f1cdbf184 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:04.909755 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ba13b216-212e-40fb-a800-250f1cdbf184 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 200 len: 1320 microversion: 2.1 time: 0.165062 Jan 22 21:14:04.910334 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2270/4748] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:04 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:05.043575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-29405c42-0157-4d36-9b13-1db0ef28b148 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:05.053037 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-29405c42-0157-4d36-9b13-1db0ef28b148 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1482 microversion: 2.1 time: 0.184902 Jan 22 21:14:05.054309 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2479/4749] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:04 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1482 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:05.140330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-35dece7b-e78d-4ba7-bf25-65675beb7231 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:05.141272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-35dece7b-e78d-4ba7-bf25-65675beb7231 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:05.148880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35dece7b-e78d-4ba7-bf25-65675beb7231 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:05.153536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35dece7b-e78d-4ba7-bf25-65675beb7231 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:05.153536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35dece7b-e78d-4ba7-bf25-65675beb7231 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:05.153536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35dece7b-e78d-4ba7-bf25-65675beb7231 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:05.193375 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-35dece7b-e78d-4ba7-bf25-65675beb7231 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.056789 Jan 22 21:14:05.194069 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2271/4750] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:05 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:05.210597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9e57a4cb-7417-4f8a-96b2-872520d0d74b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:05.214441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9e57a4cb-7417-4f8a-96b2-872520d0d74b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:05.219398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e57a4cb-7417-4f8a-96b2-872520d0d74b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:05.219865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e57a4cb-7417-4f8a-96b2-872520d0d74b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:05.220689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e57a4cb-7417-4f8a-96b2-872520d0d74b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:05.221147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e57a4cb-7417-4f8a-96b2-872520d0d74b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:05.263644 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9e57a4cb-7417-4f8a-96b2-872520d0d74b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.057299 Jan 22 21:14:05.264320 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2480/4751] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:05 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:05.372241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-31ccf505-81a4-4cf9-bd7f-f384adfbca22 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:05.373272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-31ccf505-81a4-4cf9-bd7f-f384adfbca22 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:05.381899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31ccf505-81a4-4cf9-bd7f-f384adfbca22 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:05.382448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31ccf505-81a4-4cf9-bd7f-f384adfbca22 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:05.383550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31ccf505-81a4-4cf9-bd7f-f384adfbca22 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:05.384144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31ccf505-81a4-4cf9-bd7f-f384adfbca22 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:05.435659 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-31ccf505-81a4-4cf9-bd7f-f384adfbca22 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.067942 Jan 22 21:14:05.437093 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2272/4752] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:05 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:05.890834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-342f0d78-5239-40cf-b4f1-a6dcc0280907 req-02557512-4fbf-494c-9bec-cd95e420d7ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab34a474-341d-4204-9616-72afb1140379", "name": "network-vif-deleted", "tag": "8f698936-2040-48a0-b71f-e6239702bdc3"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:05.893566 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:14:05.893566 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:14:05.910250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-342f0d78-5239-40cf-b4f1-a6dcc0280907 req-02557512-4fbf-494c-9bec-cd95e420d7ec service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:05.910795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-342f0d78-5239-40cf-b4f1-a6dcc0280907 req-02557512-4fbf-494c-9bec-cd95e420d7ec service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:05.924964 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-342f0d78-5239-40cf-b4f1-a6dcc0280907 req-02557512-4fbf-494c-9bec-cd95e420d7ec service nova] Creating event network-vif-deleted:8f698936-2040-48a0-b71f-e6239702bdc3 for instance ab34a474-341d-4204-9616-72afb1140379 on nch2-master-1 Jan 22 21:14:05.928087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c86fbd80-c0ca-413b-a924-793284b080cd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:05.931407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c86fbd80-c0ca-413b-a924-793284b080cd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:05.931959 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-342f0d78-5239-40cf-b4f1-a6dcc0280907 req-02557512-4fbf-494c-9bec-cd95e420d7ec service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044966 Jan 22 21:14:05.931959 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2481/4753] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:05.940221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c86fbd80-c0ca-413b-a924-793284b080cd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:05.940910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c86fbd80-c0ca-413b-a924-793284b080cd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:05.941781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c86fbd80-c0ca-413b-a924-793284b080cd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:05.942286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c86fbd80-c0ca-413b-a924-793284b080cd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:06.073820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-67684db3-ea1a-4b1c-ad00-d104926bb767 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:06.075433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-67684db3-ea1a-4b1c-ad00-d104926bb767 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:06.086849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67684db3-ea1a-4b1c-ad00-d104926bb767 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:06.088249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67684db3-ea1a-4b1c-ad00-d104926bb767 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:06.089352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67684db3-ea1a-4b1c-ad00-d104926bb767 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:06.090175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67684db3-ea1a-4b1c-ad00-d104926bb767 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:06.107380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c86fbd80-c0ca-413b-a924-793284b080cd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:06.115939 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c86fbd80-c0ca-413b-a924-793284b080cd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 200 len: 1320 microversion: 2.1 time: 0.191705 Jan 22 21:14:06.117636 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2273/4754] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:05 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 1320 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:06.178341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-67684db3-ea1a-4b1c-ad00-d104926bb767 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ee6e2c7f8d44322839477c3b5ee84d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6cd65ef53949b2a4bbdae54953280d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:06.189370 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-67684db3-ea1a-4b1c-ad00-d104926bb767 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 200 len: 1311 microversion: 2.1 time: 0.122707 Jan 22 21:14:06.194800 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2482/4755] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:06 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 1311 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:06.206219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7efc7202-a786-4290-9fe4-f0c986ae283a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:06.207158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7efc7202-a786-4290-9fe4-f0c986ae283a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:06.215448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7efc7202-a786-4290-9fe4-f0c986ae283a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:06.215911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7efc7202-a786-4290-9fe4-f0c986ae283a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:06.216920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7efc7202-a786-4290-9fe4-f0c986ae283a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:06.217368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7efc7202-a786-4290-9fe4-f0c986ae283a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:06.261992 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7efc7202-a786-4290-9fe4-f0c986ae283a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.059349 Jan 22 21:14:06.262637 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2274/4756] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:06 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:06.277148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d9202874-ed16-4e18-8307-f137380d2f84 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:06.278158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d9202874-ed16-4e18-8307-f137380d2f84 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:06.284723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9202874-ed16-4e18-8307-f137380d2f84 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:06.285178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9202874-ed16-4e18-8307-f137380d2f84 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:06.285989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9202874-ed16-4e18-8307-f137380d2f84 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:06.286427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9202874-ed16-4e18-8307-f137380d2f84 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:06.326198 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d9202874-ed16-4e18-8307-f137380d2f84 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.053249 Jan 22 21:14:06.327033 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2483/4757] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:06 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:06.449255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2756fb0a-ca8c-40d1-b4f7-706423b9443b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:06.450305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2756fb0a-ca8c-40d1-b4f7-706423b9443b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:06.460799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2756fb0a-ca8c-40d1-b4f7-706423b9443b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:06.460799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2756fb0a-ca8c-40d1-b4f7-706423b9443b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:06.460799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2756fb0a-ca8c-40d1-b4f7-706423b9443b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:06.460799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2756fb0a-ca8c-40d1-b4f7-706423b9443b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:06.499604 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2756fb0a-ca8c-40d1-b4f7-706423b9443b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.055835 Jan 22 21:14:06.500449 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2275/4758] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:06 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:07.083777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-33d25c3d-2e4b-41b3-bc91-21c331b47fdf req-f3dfc0e0-fec3-4e0b-a16d-f59fba869f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d1e763-6bd8-4953-b498-12aca41a8786", "name": "network-vif-plugged", "status": "completed", "tag": "92eb88b1-b83c-46dd-8fa7-9f78e33202e2"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:07.086702 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:14:07.086702 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:14:07.095092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-33d25c3d-2e4b-41b3-bc91-21c331b47fdf req-f3dfc0e0-fec3-4e0b-a16d-f59fba869f8c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:07.095559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-33d25c3d-2e4b-41b3-bc91-21c331b47fdf req-f3dfc0e0-fec3-4e0b-a16d-f59fba869f8c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:07.109465 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-33d25c3d-2e4b-41b3-bc91-21c331b47fdf req-f3dfc0e0-fec3-4e0b-a16d-f59fba869f8c service nova] Creating event network-vif-plugged:92eb88b1-b83c-46dd-8fa7-9f78e33202e2 for instance f7d1e763-6bd8-4953-b498-12aca41a8786 on nch1-master-1 Jan 22 21:14:07.114118 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-33d25c3d-2e4b-41b3-bc91-21c331b47fdf req-f3dfc0e0-fec3-4e0b-a16d-f59fba869f8c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035111 Jan 22 21:14:07.115111 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2484/4759] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:07.136193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b82c4e85-6f53-4766-ba02-6dc5c4106cbc tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:07.146637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b82c4e85-6f53-4766-ba02-6dc5c4106cbc tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:07.146637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b82c4e85-6f53-4766-ba02-6dc5c4106cbc tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:07.146980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b82c4e85-6f53-4766-ba02-6dc5c4106cbc tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:07.148904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b82c4e85-6f53-4766-ba02-6dc5c4106cbc tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:07.149574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b82c4e85-6f53-4766-ba02-6dc5c4106cbc tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:07.213079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2b29a91e-3d8f-4050-9af7-38fe44363bc4 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:07.213826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2b29a91e-3d8f-4050-9af7-38fe44363bc4 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] [instance: ab34a474-341d-4204-9616-72afb1140379] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:07.230638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b29a91e-3d8f-4050-9af7-38fe44363bc4 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:07.231105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b29a91e-3d8f-4050-9af7-38fe44363bc4 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:07.231929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b29a91e-3d8f-4050-9af7-38fe44363bc4 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:07.232380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b29a91e-3d8f-4050-9af7-38fe44363bc4 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:07.265074 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-2b29a91e-3d8f-4050-9af7-38fe44363bc4 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] HTTP exception thrown: Instance ab34a474-341d-4204-9616-72afb1140379 could not be found. Jan 22 21:14:07.265714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2b29a91e-3d8f-4050-9af7-38fe44363bc4 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] Returning 404 to user: Instance ab34a474-341d-4204-9616-72afb1140379 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:07.266752 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2b29a91e-3d8f-4050-9af7-38fe44363bc4 tempest-ServersAdminNegativeTestJSON-1812398829 tempest-ServersAdminNegativeTestJSON-1812398829-project] 10.222.0.100 "GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379" status: 404 len: 111 microversion: 2.1 time: 0.060114 Jan 22 21:14:07.267730 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2485/4760] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:07 2022] GET /compute/v2.1/servers/ab34a474-341d-4204-9616-72afb1140379 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:14:07.273384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f4480d11-eb57-4c5a-9bcb-8d3be84661df tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:07.274521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f4480d11-eb57-4c5a-9bcb-8d3be84661df tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:07.280761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4480d11-eb57-4c5a-9bcb-8d3be84661df tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:07.281406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4480d11-eb57-4c5a-9bcb-8d3be84661df tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:07.286274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4480d11-eb57-4c5a-9bcb-8d3be84661df tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:07.286274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4480d11-eb57-4c5a-9bcb-8d3be84661df tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:07.341357 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f4480d11-eb57-4c5a-9bcb-8d3be84661df tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.071658 Jan 22 21:14:07.342857 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2486/4761] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:07 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:14:07.349867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-80a21d65-02c1-4e39-8803-e4917172db99 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:07.351944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-80a21d65-02c1-4e39-8803-e4917172db99 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:07.359954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80a21d65-02c1-4e39-8803-e4917172db99 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:07.360587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80a21d65-02c1-4e39-8803-e4917172db99 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:07.361767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80a21d65-02c1-4e39-8803-e4917172db99 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:07.362366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80a21d65-02c1-4e39-8803-e4917172db99 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:07.413848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b82c4e85-6f53-4766-ba02-6dc5c4106cbc tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:07.423030 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b82c4e85-6f53-4766-ba02-6dc5c4106cbc tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 200 len: 1320 microversion: 2.1 time: 0.293160 Jan 22 21:14:07.423711 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2276/4762] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:07 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 1320 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:07.436249 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-80a21d65-02c1-4e39-8803-e4917172db99 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.091884 Jan 22 21:14:07.438737 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2487/4763] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:07 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:07.511713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-03608161-02ef-4a9d-84b0-b0855828672e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:07.512650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-03608161-02ef-4a9d-84b0-b0855828672e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:07.519243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03608161-02ef-4a9d-84b0-b0855828672e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:07.519709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03608161-02ef-4a9d-84b0-b0855828672e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:07.520513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03608161-02ef-4a9d-84b0-b0855828672e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:07.520973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03608161-02ef-4a9d-84b0-b0855828672e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:07.561193 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-03608161-02ef-4a9d-84b0-b0855828672e tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.053178 Jan 22 21:14:07.561900 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2277/4764] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:07 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:08.354397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e3a96248-a1f1-46c8-95d1-d3e3ea87cd16 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:08.355549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e3a96248-a1f1-46c8-95d1-d3e3ea87cd16 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:08.363356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3a96248-a1f1-46c8-95d1-d3e3ea87cd16 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:08.363829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3a96248-a1f1-46c8-95d1-d3e3ea87cd16 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:08.364642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3a96248-a1f1-46c8-95d1-d3e3ea87cd16 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:08.365092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3a96248-a1f1-46c8-95d1-d3e3ea87cd16 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:08.410370 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e3a96248-a1f1-46c8-95d1-d3e3ea87cd16 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.060313 Jan 22 21:14:08.411258 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2488/4765] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:08 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:08.440873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-40ac55c0-c4db-4b82-85ad-ae3e1a8ab0a6 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:08.441647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-40ac55c0-c4db-4b82-85ad-ae3e1a8ab0a6 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:08.449894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40ac55c0-c4db-4b82-85ad-ae3e1a8ab0a6 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:08.450354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-04ce5c3d-3de0-4ab9-8a43-7fc6c41e15c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:08.450505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40ac55c0-c4db-4b82-85ad-ae3e1a8ab0a6 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:08.451163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40ac55c0-c4db-4b82-85ad-ae3e1a8ab0a6 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:08.451387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-04ce5c3d-3de0-4ab9-8a43-7fc6c41e15c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:08.451616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40ac55c0-c4db-4b82-85ad-ae3e1a8ab0a6 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:08.458730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04ce5c3d-3de0-4ab9-8a43-7fc6c41e15c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:08.460776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04ce5c3d-3de0-4ab9-8a43-7fc6c41e15c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:08.460998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04ce5c3d-3de0-4ab9-8a43-7fc6c41e15c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:08.461410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04ce5c3d-3de0-4ab9-8a43-7fc6c41e15c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:08.517794 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-04ce5c3d-3de0-4ab9-8a43-7fc6c41e15c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.071501 Jan 22 21:14:08.517794 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2489/4766] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:08 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:08.578235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4d56557a-c0d4-41d1-9e15-f1fe3213113c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:08.580182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4d56557a-c0d4-41d1-9e15-f1fe3213113c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:08.592560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d56557a-c0d4-41d1-9e15-f1fe3213113c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:08.594019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d56557a-c0d4-41d1-9e15-f1fe3213113c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:08.595614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d56557a-c0d4-41d1-9e15-f1fe3213113c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:08.609902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d56557a-c0d4-41d1-9e15-f1fe3213113c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:08.641546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-40ac55c0-c4db-4b82-85ad-ae3e1a8ab0a6 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:08.651417 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-40ac55c0-c4db-4b82-85ad-ae3e1a8ab0a6 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 200 len: 1320 microversion: 2.1 time: 0.214867 Jan 22 21:14:08.652183 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2278/4767] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:08 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:08.654137 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4d56557a-c0d4-41d1-9e15-f1fe3213113c tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.084819 Jan 22 21:14:08.654794 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2490/4768] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:08 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:09.423193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4c55cda9-f073-46bc-a78d-2587d8f1853b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:09.424223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4c55cda9-f073-46bc-a78d-2587d8f1853b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:09.431907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c55cda9-f073-46bc-a78d-2587d8f1853b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:09.432368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c55cda9-f073-46bc-a78d-2587d8f1853b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:09.433162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c55cda9-f073-46bc-a78d-2587d8f1853b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:09.433636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c55cda9-f073-46bc-a78d-2587d8f1853b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:09.477585 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4c55cda9-f073-46bc-a78d-2587d8f1853b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.058930 Jan 22 21:14:09.478288 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2279/4769] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:09 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:09.529666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-65e155f8-e405-4b62-87e3-33b5c0de081d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:09.554566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-65e155f8-e405-4b62-87e3-33b5c0de081d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:09.554566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65e155f8-e405-4b62-87e3-33b5c0de081d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:09.554566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65e155f8-e405-4b62-87e3-33b5c0de081d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:09.554566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65e155f8-e405-4b62-87e3-33b5c0de081d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:09.554566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65e155f8-e405-4b62-87e3-33b5c0de081d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:09.579829 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-65e155f8-e405-4b62-87e3-33b5c0de081d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.054272 Jan 22 21:14:09.580655 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2491/4770] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:09 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:09.666929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c3397f3a-0aae-45d3-9532-7c40efba8853 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:09.668088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c3397f3a-0aae-45d3-9532-7c40efba8853 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:09.669551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2b4e8d69-13ce-49ab-88eb-88406666f285 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:09.670268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2b4e8d69-13ce-49ab-88eb-88406666f285 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:09.677744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b4e8d69-13ce-49ab-88eb-88406666f285 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:09.678598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b4e8d69-13ce-49ab-88eb-88406666f285 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:09.679441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b4e8d69-13ce-49ab-88eb-88406666f285 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:09.679845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b4e8d69-13ce-49ab-88eb-88406666f285 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:09.686788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3397f3a-0aae-45d3-9532-7c40efba8853 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:09.686788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3397f3a-0aae-45d3-9532-7c40efba8853 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:09.686788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3397f3a-0aae-45d3-9532-7c40efba8853 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:09.686788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3397f3a-0aae-45d3-9532-7c40efba8853 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:09.765209 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c3397f3a-0aae-45d3-9532-7c40efba8853 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.102455 Jan 22 21:14:09.767062 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2280/4771] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:09 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:09.840500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2b4e8d69-13ce-49ab-88eb-88406666f285 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:09.853024 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2b4e8d69-13ce-49ab-88eb-88406666f285 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 200 len: 1509 microversion: 2.1 time: 0.187864 Jan 22 21:14:09.853655 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2492/4772] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:09 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:09.878819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-83293919-eeb5-4a1c-9547-352c26ab674d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1838581249"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:09.879848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-83293919-eeb5-4a1c-9547-352c26ab674d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:09.895190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83293919-eeb5-4a1c-9547-352c26ab674d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:09.895807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83293919-eeb5-4a1c-9547-352c26ab674d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:09.896724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83293919-eeb5-4a1c-9547-352c26ab674d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:09.898847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83293919-eeb5-4a1c-9547-352c26ab674d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:10.068297 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.network.security_group_api [None req-83293919-eeb5-4a1c-9547-352c26ab674d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Adding security group 3cc0e06e-6d10-4702-b32f-e1fa246eeb98 to port 92eb88b1-b83c-46dd-8fa7-9f78e33202e2 Jan 22 21:14:10.489625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3c9575c0-0352-4ae5-9578-62c61d945840 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:10.490548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3c9575c0-0352-4ae5-9578-62c61d945840 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:10.498042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c9575c0-0352-4ae5-9578-62c61d945840 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:10.498535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c9575c0-0352-4ae5-9578-62c61d945840 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:10.499360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c9575c0-0352-4ae5-9578-62c61d945840 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:10.499819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c9575c0-0352-4ae5-9578-62c61d945840 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:10.541236 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3c9575c0-0352-4ae5-9578-62c61d945840 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.055344 Jan 22 21:14:10.541952 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2493/4773] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:10 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:14:10.598999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3dc3087c-f372-4845-85a8-90091b5b5823 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:10.600035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3dc3087c-f372-4845-85a8-90091b5b5823 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:10.604031 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-83293919-eeb5-4a1c-9547-352c26ab674d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786/action" status: 202 len: 0 microversion: 2.1 time: 0.735282 Jan 22 21:14:10.604767 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2281/4774] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:09 2022] POST /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786/action => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:10.615349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-95dd04ff-ab1c-42b7-a49f-e29c77a85a64 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-441440260"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:10.615519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dc3087c-f372-4845-85a8-90091b5b5823 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:10.615643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-95dd04ff-ab1c-42b7-a49f-e29c77a85a64 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:10.615836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dc3087c-f372-4845-85a8-90091b5b5823 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:10.615836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dc3087c-f372-4845-85a8-90091b5b5823 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:10.616907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dc3087c-f372-4845-85a8-90091b5b5823 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:10.629946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95dd04ff-ab1c-42b7-a49f-e29c77a85a64 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:10.630658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95dd04ff-ab1c-42b7-a49f-e29c77a85a64 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:10.633939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95dd04ff-ab1c-42b7-a49f-e29c77a85a64 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:10.634407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95dd04ff-ab1c-42b7-a49f-e29c77a85a64 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:10.684131 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3dc3087c-f372-4845-85a8-90091b5b5823 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.095201 Jan 22 21:14:10.692684 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2494/4775] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:10 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:10.692684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-49511274-8f39-48fc-a7ad-38cc73f2ef3f req-40bbf428-7b27-4d64-91b0-279192e5249d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d1e763-6bd8-4953-b498-12aca41a8786", "tag": "92eb88b1-b83c-46dd-8fa7-9f78e33202e2"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:10.694332 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:14:10.694332 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:14:10.703683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-49511274-8f39-48fc-a7ad-38cc73f2ef3f req-40bbf428-7b27-4d64-91b0-279192e5249d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:10.704127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-49511274-8f39-48fc-a7ad-38cc73f2ef3f req-40bbf428-7b27-4d64-91b0-279192e5249d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:10.728171 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-49511274-8f39-48fc-a7ad-38cc73f2ef3f req-40bbf428-7b27-4d64-91b0-279192e5249d service nova] Creating event network-changed:92eb88b1-b83c-46dd-8fa7-9f78e33202e2 for instance f7d1e763-6bd8-4953-b498-12aca41a8786 on nch1-master-1 Jan 22 21:14:10.739685 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-49511274-8f39-48fc-a7ad-38cc73f2ef3f req-40bbf428-7b27-4d64-91b0-279192e5249d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053128 Jan 22 21:14:10.740319 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2495/4776] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:10.794765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d05e32c4-598d-4704-9d79-6cca760aa8ba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:10.803444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d05e32c4-598d-4704-9d79-6cca760aa8ba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:10.818955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d05e32c4-598d-4704-9d79-6cca760aa8ba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:10.819413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d05e32c4-598d-4704-9d79-6cca760aa8ba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:10.820256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d05e32c4-598d-4704-9d79-6cca760aa8ba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:10.821065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d05e32c4-598d-4704-9d79-6cca760aa8ba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:10.872126 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.network.security_group_api [None req-95dd04ff-ab1c-42b7-a49f-e29c77a85a64 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Adding security group 24848c83-c746-43fc-a158-f06585f3aa69 to port 92eb88b1-b83c-46dd-8fa7-9f78e33202e2 Jan 22 21:14:10.895504 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d05e32c4-598d-4704-9d79-6cca760aa8ba tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.119262 Jan 22 21:14:10.899872 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2496/4777] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:10 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:11.552968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e813afe4-08c9-4b42-bf15-2c92bf6e600b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:11.555837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e813afe4-08c9-4b42-bf15-2c92bf6e600b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:11.562534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e813afe4-08c9-4b42-bf15-2c92bf6e600b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:11.563124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e813afe4-08c9-4b42-bf15-2c92bf6e600b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:11.564051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e813afe4-08c9-4b42-bf15-2c92bf6e600b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:11.564498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e813afe4-08c9-4b42-bf15-2c92bf6e600b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:11.612412 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e813afe4-08c9-4b42-bf15-2c92bf6e600b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.063124 Jan 22 21:14:11.614768 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2497/4778] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:11 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:11.669825 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-95dd04ff-ab1c-42b7-a49f-e29c77a85a64 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786/action" status: 202 len: 0 microversion: 2.1 time: 1.060625 Jan 22 21:14:11.670517 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2282/4779] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:10 2022] POST /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786/action => generated 0 bytes in 1062 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:11.679998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c6cdc436-90a5-4d56-a9fc-30694a0159cd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:11.680728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c6cdc436-90a5-4d56-a9fc-30694a0159cd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:11.688042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6cdc436-90a5-4d56-a9fc-30694a0159cd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:11.688632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6cdc436-90a5-4d56-a9fc-30694a0159cd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:11.689559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6cdc436-90a5-4d56-a9fc-30694a0159cd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:11.690229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6cdc436-90a5-4d56-a9fc-30694a0159cd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:11.696690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6fe067fb-56e2-4701-89ac-b0e3b0180b24 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:11.698407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6fe067fb-56e2-4701-89ac-b0e3b0180b24 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:11.709342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6fe067fb-56e2-4701-89ac-b0e3b0180b24 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:11.714135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6fe067fb-56e2-4701-89ac-b0e3b0180b24 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:11.714135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6fe067fb-56e2-4701-89ac-b0e3b0180b24 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:11.714135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6fe067fb-56e2-4701-89ac-b0e3b0180b24 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:11.754688 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6fe067fb-56e2-4701-89ac-b0e3b0180b24 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.062254 Jan 22 21:14:11.755678 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2283/4780] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:11 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:11.904035 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c6cdc436-90a5-4d56-a9fc-30694a0159cd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.228922 Jan 22 21:14:11.904948 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2498/4781] 10.222.0.100 () {58 vars in 1297 bytes} [Sat Jan 22 21:14:11 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786/os-security-groups => generated 1156 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:11.918893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2f7fd814-b55e-42a0-b8b4-df0776688631 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:11.919943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2f7fd814-b55e-42a0-b8b4-df0776688631 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:11.926023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3f1f95c1-370f-4a45-86a4-78aa8c83e00d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'create', calling method: .version_select at 0x7f1ed5de1dc0>, body: {"security_group": {"name": " tempest-securitygroup -1585585832 ", "description": "tempest-description-1364268983"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:11.937862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f7fd814-b55e-42a0-b8b4-df0776688631 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:11.938326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f7fd814-b55e-42a0-b8b4-df0776688631 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:11.939149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f7fd814-b55e-42a0-b8b4-df0776688631 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:11.939767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f7fd814-b55e-42a0-b8b4-df0776688631 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:12.001815 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2f7fd814-b55e-42a0-b8b4-df0776688631 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.086725 Jan 22 21:14:12.002712 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2284/4782] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:11 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:12.343866 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3f1f95c1-370f-4a45-86a4-78aa8c83e00d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.423654 Jan 22 21:14:12.344599 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2499/4783] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:14:11 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:12.360295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3391f4b6-d776-405f-9b58-794c3f8f6013 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1edae05430>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:12.420270 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3391f4b6-d776-405f-9b58-794c3f8f6013 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/os-security-groups/815d4c2a-0838-480a-949a-f05f780a39e1" status: 200 len: 224 microversion: 2.1 time: 0.067158 Jan 22 21:14:12.420995 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2285/4784] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 21:14:12 2022] GET /compute/v2.1/os-security-groups/815d4c2a-0838-480a-949a-f05f780a39e1 => generated 224 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:12.432238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2e2092e5-aceb-4b82-b591-dd1f804b3d1f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1edaf94dc0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:12.629072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ed8e29b9-60bd-4ca9-8ff6-2a40333970e6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:12.630915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ed8e29b9-60bd-4ca9-8ff6-2a40333970e6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:12.637836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed8e29b9-60bd-4ca9-8ff6-2a40333970e6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:12.638519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed8e29b9-60bd-4ca9-8ff6-2a40333970e6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:12.639498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed8e29b9-60bd-4ca9-8ff6-2a40333970e6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:12.640098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed8e29b9-60bd-4ca9-8ff6-2a40333970e6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:12.689315 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ed8e29b9-60bd-4ca9-8ff6-2a40333970e6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.063693 Jan 22 21:14:12.690661 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2286/4785] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:12 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:12.768382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f6124451-ef2c-4ea4-8bea-98511905ff18 req-352d4d68-f26b-4ea8-840b-f9ca5ffba027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d1e763-6bd8-4953-b498-12aca41a8786", "tag": "92eb88b1-b83c-46dd-8fa7-9f78e33202e2"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:12.770436 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:14:12.770436 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:14:12.783765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f6124451-ef2c-4ea4-8bea-98511905ff18 req-352d4d68-f26b-4ea8-840b-f9ca5ffba027 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:12.784791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f6124451-ef2c-4ea4-8bea-98511905ff18 req-352d4d68-f26b-4ea8-840b-f9ca5ffba027 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:12.803037 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f6124451-ef2c-4ea4-8bea-98511905ff18 req-352d4d68-f26b-4ea8-840b-f9ca5ffba027 service nova] Creating event network-changed:92eb88b1-b83c-46dd-8fa7-9f78e33202e2 for instance f7d1e763-6bd8-4953-b498-12aca41a8786 on nch1-master-1 Jan 22 21:14:12.808938 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f6124451-ef2c-4ea4-8bea-98511905ff18 req-352d4d68-f26b-4ea8-840b-f9ca5ffba027 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048162 Jan 22 21:14:12.810205 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2287/4786] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:14:12.815708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a38c8d1b-a7ec-43a2-b049-582d8cfd0a32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:12.816838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a38c8d1b-a7ec-43a2-b049-582d8cfd0a32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:12.825805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a38c8d1b-a7ec-43a2-b049-582d8cfd0a32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:12.826498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a38c8d1b-a7ec-43a2-b049-582d8cfd0a32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:12.827636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a38c8d1b-a7ec-43a2-b049-582d8cfd0a32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:12.828242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a38c8d1b-a7ec-43a2-b049-582d8cfd0a32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:12.843436 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2e2092e5-aceb-4b82-b591-dd1f804b3d1f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/815d4c2a-0838-480a-949a-f05f780a39e1" status: 202 len: 0 microversion: 2.1 time: 0.415593 Jan 22 21:14:12.849632 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2500/4787] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:12 2022] DELETE /compute/v2.1/os-security-groups/815d4c2a-0838-480a-949a-f05f780a39e1 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:12.852184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-80622f9d-7e8b-4aff-843a-91f2dea4a9d9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed5f70550>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:12.887363 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a38c8d1b-a7ec-43a2-b049-582d8cfd0a32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.075468 Jan 22 21:14:12.889445 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2288/4788] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:12 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:12.891694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG neutronclient.v2_0.client [None req-80622f9d-7e8b-4aff-843a-91f2dea4a9d9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 815d4c2a-0838-480a-949a-f05f780a39e1 does not exist", "detail": ""}} {{(pid=137032) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:12.892309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.security_group_api [None req-80622f9d-7e8b-4aff-843a-91f2dea4a9d9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Neutron security group 815d4c2a-0838-480a-949a-f05f780a39e1 not found {{(pid=137032) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 22 21:14:12.892851 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-80622f9d-7e8b-4aff-843a-91f2dea4a9d9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Security group 815d4c2a-0838-480a-949a-f05f780a39e1 does not exist Jan 22 21:14:12.892851 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-a5011608-f1bc-4a7d-b842-995d4c945a75'] Jan 22 21:14:12.893457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-80622f9d-7e8b-4aff-843a-91f2dea4a9d9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 404 to user: Security group 815d4c2a-0838-480a-949a-f05f780a39e1 does not exist Jan 22 21:14:12.893457 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-a5011608-f1bc-4a7d-b842-995d4c945a75'] {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:12.894329 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-80622f9d-7e8b-4aff-843a-91f2dea4a9d9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/os-security-groups/815d4c2a-0838-480a-949a-f05f780a39e1" status: 404 len: 194 microversion: 2.1 time: 0.046327 Jan 22 21:14:12.895220 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2501/4789] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 21:14:12 2022] GET /compute/v2.1/os-security-groups/815d4c2a-0838-480a-949a-f05f780a39e1 => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:14:12.908930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3808ed20-c83a-47e9-873f-fe54acecbd11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'create', calling method: .version_select at 0x7f1edae25dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-66427827", "description": "tempest-description-150330385"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:13.015771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-57c76d47-67c1-4303-b16b-ecf60fdac0a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:13.016900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-57c76d47-67c1-4303-b16b-ecf60fdac0a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:13.028203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57c76d47-67c1-4303-b16b-ecf60fdac0a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:13.028528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57c76d47-67c1-4303-b16b-ecf60fdac0a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:13.029544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57c76d47-67c1-4303-b16b-ecf60fdac0a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:13.030247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57c76d47-67c1-4303-b16b-ecf60fdac0a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:13.101049 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-57c76d47-67c1-4303-b16b-ecf60fdac0a9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.088999 Jan 22 21:14:13.102646 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2502/4790] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:13 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:13.713447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a19449f9-b78a-49cb-b798-e5675e55d54f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:13.714896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a19449f9-b78a-49cb-b798-e5675e55d54f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:13.724265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a19449f9-b78a-49cb-b798-e5675e55d54f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:13.741978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a19449f9-b78a-49cb-b798-e5675e55d54f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:13.741978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a19449f9-b78a-49cb-b798-e5675e55d54f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:13.741978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a19449f9-b78a-49cb-b798-e5675e55d54f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:13.814697 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a19449f9-b78a-49cb-b798-e5675e55d54f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.106280 Jan 22 21:14:13.815362 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2503/4791] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:13 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:13.891619 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3808ed20-c83a-47e9-873f-fe54acecbd11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.987608 Jan 22 21:14:13.892224 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2289/4792] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:14:12 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:13.902579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9c757972-6aee-4033-ba01-4d38eb9b1a0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:13.904470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9c757972-6aee-4033-ba01-4d38eb9b1a0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:13.907762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8f7862e0-d2d6-49ed-9468-b16247547a2c tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'create', calling method: .version_select at 0x7f1ed4f4f0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-228152723", "description": "tempest-description-2064862769"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:13.913335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c757972-6aee-4033-ba01-4d38eb9b1a0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:13.914309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c757972-6aee-4033-ba01-4d38eb9b1a0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:13.915460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c757972-6aee-4033-ba01-4d38eb9b1a0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:13.916067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c757972-6aee-4033-ba01-4d38eb9b1a0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:13.977365 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9c757972-6aee-4033-ba01-4d38eb9b1a0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.080345 Jan 22 21:14:13.978229 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2504/4793] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:13 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:14.112790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a81889f6-d7ba-4033-baea-47d827060deb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:14.114673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a81889f6-d7ba-4033-baea-47d827060deb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:14.123209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a81889f6-d7ba-4033-baea-47d827060deb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:14.123640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a81889f6-d7ba-4033-baea-47d827060deb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:14.124446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a81889f6-d7ba-4033-baea-47d827060deb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:14.124897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a81889f6-d7ba-4033-baea-47d827060deb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:14.176445 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a81889f6-d7ba-4033-baea-47d827060deb tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.062631 Jan 22 21:14:14.176445 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2505/4794] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:14 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:14:14.420080 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8f7862e0-d2d6-49ed-9468-b16247547a2c tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.519702 Jan 22 21:14:14.420690 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2290/4795] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:14:13 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:14:14.432557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b74c5387-4c21-4b66-bd99-efe8eca59d17 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'create', calling method: .version_select at 0x7f1ed5e0a550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1501687405", "description": "tempest-description-1981674883"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:14.827604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c92d0e85-7148-4fb6-89de-ec6d5ef7bcaa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:14.829346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c92d0e85-7148-4fb6-89de-ec6d5ef7bcaa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:14.836886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c92d0e85-7148-4fb6-89de-ec6d5ef7bcaa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:14.837478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c92d0e85-7148-4fb6-89de-ec6d5ef7bcaa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:14.838574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c92d0e85-7148-4fb6-89de-ec6d5ef7bcaa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:14.839217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c92d0e85-7148-4fb6-89de-ec6d5ef7bcaa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:14.917181 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c92d0e85-7148-4fb6-89de-ec6d5ef7bcaa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.088944 Jan 22 21:14:14.917181 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2291/4796] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:14 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:14:14.991910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8a735775-5810-42cb-b49b-93e588dc6183 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:14.991910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8a735775-5810-42cb-b49b-93e588dc6183 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:15.011454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a735775-5810-42cb-b49b-93e588dc6183 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:15.012142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a735775-5810-42cb-b49b-93e588dc6183 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:15.013410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a735775-5810-42cb-b49b-93e588dc6183 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:15.014683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a735775-5810-42cb-b49b-93e588dc6183 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:15.075000 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8a735775-5810-42cb-b49b-93e588dc6183 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.089663 Jan 22 21:14:15.079228 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2292/4797] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:14 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:15.179231 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b74c5387-4c21-4b66-bd99-efe8eca59d17 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.749153 Jan 22 21:14:15.187564 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2506/4798] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:14:14 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:15.191663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48e40279-4dc1-4d6e-83c1-c4386b985f0b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:15.193314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48e40279-4dc1-4d6e-83c1-c4386b985f0b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:15.199169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eb005ad3-c80a-4120-a4f3-96d54ecac224 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1edafae3a0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:15.204054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48e40279-4dc1-4d6e-83c1-c4386b985f0b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:15.205431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48e40279-4dc1-4d6e-83c1-c4386b985f0b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:15.206502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48e40279-4dc1-4d6e-83c1-c4386b985f0b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:15.207647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48e40279-4dc1-4d6e-83c1-c4386b985f0b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:15.252203 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48e40279-4dc1-4d6e-83c1-c4386b985f0b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.071452 Jan 22 21:14:15.253074 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2293/4799] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:15 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:15.461691 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eb005ad3-c80a-4120-a4f3-96d54ecac224 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.271418 Jan 22 21:14:15.462630 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2507/4800] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 21:14:15 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:15.475552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-894f37dc-ae4a-426a-954c-00e4430ce057 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed6324d30>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:15.808573 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-894f37dc-ae4a-426a-954c-00e4430ce057 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/70cb2b98-42de-46ef-9535-52bba4273fef" status: 202 len: 0 microversion: 2.1 time: 0.337443 Jan 22 21:14:15.809003 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2294/4801] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:15 2022] DELETE /compute/v2.1/os-security-groups/70cb2b98-42de-46ef-9535-52bba4273fef => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:15.817831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c2c2c5d8-026c-414b-85e9-2be65c392003 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed5133820>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:15.849684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG neutronclient.v2_0.client [None req-c2c2c5d8-026c-414b-85e9-2be65c392003 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 70cb2b98-42de-46ef-9535-52bba4273fef does not exist", "detail": ""}} {{(pid=137032) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:15.850684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.security_group_api [None req-c2c2c5d8-026c-414b-85e9-2be65c392003 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Neutron security group 70cb2b98-42de-46ef-9535-52bba4273fef not found {{(pid=137032) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 22 21:14:15.853353 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-c2c2c5d8-026c-414b-85e9-2be65c392003 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Security group 70cb2b98-42de-46ef-9535-52bba4273fef does not exist Jan 22 21:14:15.853353 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-3509a5fd-73fc-47e9-b661-4a6fd868b1a4'] Jan 22 21:14:15.854002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c2c2c5d8-026c-414b-85e9-2be65c392003 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 404 to user: Security group 70cb2b98-42de-46ef-9535-52bba4273fef does not exist Jan 22 21:14:15.854002 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-3509a5fd-73fc-47e9-b661-4a6fd868b1a4'] {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:15.854848 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c2c2c5d8-026c-414b-85e9-2be65c392003 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/os-security-groups/70cb2b98-42de-46ef-9535-52bba4273fef" status: 404 len: 194 microversion: 2.1 time: 0.041728 Jan 22 21:14:15.855416 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2508/4802] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 21:14:15 2022] GET /compute/v2.1/os-security-groups/70cb2b98-42de-46ef-9535-52bba4273fef => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:14:15.867323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ac0c778-c729-42a4-9ee6-afca11f27fd7 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed5438820>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:15.924425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-23213750-2525-4f5b-b4de-18210adbf612 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:15.926136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-23213750-2525-4f5b-b4de-18210adbf612 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:15.939702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23213750-2525-4f5b-b4de-18210adbf612 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:15.940389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23213750-2525-4f5b-b4de-18210adbf612 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:15.947713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23213750-2525-4f5b-b4de-18210adbf612 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:15.947713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23213750-2525-4f5b-b4de-18210adbf612 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:15.995662 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-23213750-2525-4f5b-b4de-18210adbf612 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.074969 Jan 22 21:14:15.998287 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2509/4803] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:15 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:14:16.091477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6ba7f545-4ac1-440f-b819-cd1367a13840 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:16.093316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6ba7f545-4ac1-440f-b819-cd1367a13840 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:16.104002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ba7f545-4ac1-440f-b819-cd1367a13840 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:16.104897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ba7f545-4ac1-440f-b819-cd1367a13840 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:16.106008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ba7f545-4ac1-440f-b819-cd1367a13840 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:16.106717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ba7f545-4ac1-440f-b819-cd1367a13840 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:16.153841 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6ba7f545-4ac1-440f-b819-cd1367a13840 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.070786 Jan 22 21:14:16.154534 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2510/4804] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:16 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:16.264517 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1ac0c778-c729-42a4-9ee6-afca11f27fd7 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/41ff5099-cb17-4b97-82b8-41a8b5106ffd" status: 202 len: 0 microversion: 2.1 time: 0.404079 Jan 22 21:14:16.265084 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2295/4805] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:15 2022] DELETE /compute/v2.1/os-security-groups/41ff5099-cb17-4b97-82b8-41a8b5106ffd => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:16.269492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-42f16db4-6032-4f7c-9596-b8970e9c8ba8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:16.271178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-42f16db4-6032-4f7c-9596-b8970e9c8ba8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:16.273841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e2e8dd18-1168-4412-b93a-6e5925d19abd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed4f42d30>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:16.279014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42f16db4-6032-4f7c-9596-b8970e9c8ba8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:16.279755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42f16db4-6032-4f7c-9596-b8970e9c8ba8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:16.280763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42f16db4-6032-4f7c-9596-b8970e9c8ba8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:16.281396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42f16db4-6032-4f7c-9596-b8970e9c8ba8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:16.316196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG neutronclient.v2_0.client [None req-e2e8dd18-1168-4412-b93a-6e5925d19abd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 41ff5099-cb17-4b97-82b8-41a8b5106ffd does not exist", "detail": ""}} {{(pid=137033) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:16.316809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.security_group_api [None req-e2e8dd18-1168-4412-b93a-6e5925d19abd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Neutron security group 41ff5099-cb17-4b97-82b8-41a8b5106ffd not found {{(pid=137033) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 22 21:14:16.317346 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-e2e8dd18-1168-4412-b93a-6e5925d19abd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Security group 41ff5099-cb17-4b97-82b8-41a8b5106ffd does not exist Jan 22 21:14:16.317346 ncdv-master-1 devstack@n-api.service[137033]: Neutron server returns request_ids: ['req-ee3b7fc6-531e-48fe-88be-6f3f1d162f98'] Jan 22 21:14:16.317983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e2e8dd18-1168-4412-b93a-6e5925d19abd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 404 to user: Security group 41ff5099-cb17-4b97-82b8-41a8b5106ffd does not exist Jan 22 21:14:16.317983 ncdv-master-1 devstack@n-api.service[137033]: Neutron server returns request_ids: ['req-ee3b7fc6-531e-48fe-88be-6f3f1d162f98'] {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:16.319857 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e2e8dd18-1168-4412-b93a-6e5925d19abd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/os-security-groups/41ff5099-cb17-4b97-82b8-41a8b5106ffd" status: 404 len: 194 microversion: 2.1 time: 0.049447 Jan 22 21:14:16.325181 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2296/4806] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 21:14:16 2022] GET /compute/v2.1/os-security-groups/41ff5099-cb17-4b97-82b8-41a8b5106ffd => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:14:16.329267 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-42f16db4-6032-4f7c-9596-b8970e9c8ba8 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.064637 Jan 22 21:14:16.329437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6085467b-72b0-44e8-b44e-bb14481f93b5 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed503d820>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:16.330776 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2511/4807] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:16 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:16.692325 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6085467b-72b0-44e8-b44e-bb14481f93b5 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/c1afcb21-726b-41e8-8719-835558e3cece" status: 202 len: 0 microversion: 2.1 time: 0.367180 Jan 22 21:14:16.692930 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2297/4808] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:16 2022] DELETE /compute/v2.1/os-security-groups/c1afcb21-726b-41e8-8719-835558e3cece => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:16.702326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3eaf9adf-1f24-4450-abc9-ff1fd6d69866 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed5dc9a60>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:16.727473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG neutronclient.v2_0.client [None req-3eaf9adf-1f24-4450-abc9-ff1fd6d69866 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c1afcb21-726b-41e8-8719-835558e3cece does not exist", "detail": ""}} {{(pid=137032) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:16.728115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.security_group_api [None req-3eaf9adf-1f24-4450-abc9-ff1fd6d69866 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Neutron security group c1afcb21-726b-41e8-8719-835558e3cece not found {{(pid=137032) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 22 21:14:16.728684 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-3eaf9adf-1f24-4450-abc9-ff1fd6d69866 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Security group c1afcb21-726b-41e8-8719-835558e3cece does not exist Jan 22 21:14:16.728684 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-13fd279e-4332-457d-8e97-c14f78f245bc'] Jan 22 21:14:16.729294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3eaf9adf-1f24-4450-abc9-ff1fd6d69866 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 404 to user: Security group c1afcb21-726b-41e8-8719-835558e3cece does not exist Jan 22 21:14:16.729294 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-13fd279e-4332-457d-8e97-c14f78f245bc'] {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:16.730174 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3eaf9adf-1f24-4450-abc9-ff1fd6d69866 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/os-security-groups/c1afcb21-726b-41e8-8719-835558e3cece" status: 404 len: 194 microversion: 2.1 time: 0.032173 Jan 22 21:14:16.730755 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2512/4809] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 21:14:16 2022] GET /compute/v2.1/os-security-groups/c1afcb21-726b-41e8-8719-835558e3cece => generated 194 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:14:16.738680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7b139907-5a59-4722-88be-701a11bcceb0 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed4f423a0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:16.971599 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7b139907-5a59-4722-88be-701a11bcceb0 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.236466 Jan 22 21:14:16.972409 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2298/4810] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 21:14:16 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:16.987539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-de1cc382-0f75-4861-b9ef-682d91b87ad3 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'create', calling method: .version_select at 0x7f1ed5e8c4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-395711028", "description": "tempest-description-1227152474"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:17.010694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f5ab75c-1abe-4bc5-aa81-8553da63b0ac tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:17.012898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9f5ab75c-1abe-4bc5-aa81-8553da63b0ac tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:17.024279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f5ab75c-1abe-4bc5-aa81-8553da63b0ac tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:17.025065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f5ab75c-1abe-4bc5-aa81-8553da63b0ac tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:17.026243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f5ab75c-1abe-4bc5-aa81-8553da63b0ac tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:17.027430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f5ab75c-1abe-4bc5-aa81-8553da63b0ac tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:17.077612 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9f5ab75c-1abe-4bc5-aa81-8553da63b0ac tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.072334 Jan 22 21:14:17.081081 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2299/4811] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:17 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:14:17.166547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-90e64c45-f1e6-4557-b6ce-70bcdfd11bf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:17.167643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-90e64c45-f1e6-4557-b6ce-70bcdfd11bf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:17.174927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90e64c45-f1e6-4557-b6ce-70bcdfd11bf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:17.175637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90e64c45-f1e6-4557-b6ce-70bcdfd11bf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:17.176706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90e64c45-f1e6-4557-b6ce-70bcdfd11bf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:17.177432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90e64c45-f1e6-4557-b6ce-70bcdfd11bf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:17.236369 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-90e64c45-f1e6-4557-b6ce-70bcdfd11bf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.074028 Jan 22 21:14:17.237725 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2300/4812] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:17 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:17.341535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8e6dde6b-77a0-411e-8329-6674d2aa895a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:17.342672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8e6dde6b-77a0-411e-8329-6674d2aa895a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:17.350434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e6dde6b-77a0-411e-8329-6674d2aa895a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:17.350901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e6dde6b-77a0-411e-8329-6674d2aa895a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:17.351922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e6dde6b-77a0-411e-8329-6674d2aa895a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:17.352536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e6dde6b-77a0-411e-8329-6674d2aa895a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:17.404636 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8e6dde6b-77a0-411e-8329-6674d2aa895a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.067127 Jan 22 21:14:17.410802 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2301/4813] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:17 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:14:17.586087 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-de1cc382-0f75-4861-b9ef-682d91b87ad3 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.603608 Jan 22 21:14:17.589661 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2513/4814] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:14:16 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:17.600665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f685c190-2d94-496d-bd81-7a514c3d93f3 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'create', calling method: .version_select at 0x7f1ed6324280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1195633415", "description": "tempest-description-316198402"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:18.055007 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f685c190-2d94-496d-bd81-7a514c3d93f3 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.460760 Jan 22 21:14:18.058064 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2302/4815] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:14:17 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:14:18.093468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3dbae91-8f31-43b2-a4fa-c3e83cd982b0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:18.094969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d3dbae91-8f31-43b2-a4fa-c3e83cd982b0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:18.109101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3dbae91-8f31-43b2-a4fa-c3e83cd982b0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:18.109839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3dbae91-8f31-43b2-a4fa-c3e83cd982b0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:18.110980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3dbae91-8f31-43b2-a4fa-c3e83cd982b0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:18.111584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3dbae91-8f31-43b2-a4fa-c3e83cd982b0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:18.183312 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d3dbae91-8f31-43b2-a4fa-c3e83cd982b0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.094862 Jan 22 21:14:18.185367 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2514/4816] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:18 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:18.230106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-175822534", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "68368c3e-1691-4fac-8baf-b36339fae90d"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:18.249581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8a210c8e-ad68-492d-94d5-080e989b4cde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:18.250592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8a210c8e-ad68-492d-94d5-080e989b4cde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:18.261861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a210c8e-ad68-492d-94d5-080e989b4cde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:18.262516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a210c8e-ad68-492d-94d5-080e989b4cde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:18.263474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a210c8e-ad68-492d-94d5-080e989b4cde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:18.264453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a210c8e-ad68-492d-94d5-080e989b4cde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:18.312267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] validate_networks() for [('68368c3e-1691-4fac-8baf-b36339fae90d', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:14:18.315031 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8a210c8e-ad68-492d-94d5-080e989b4cde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.070136 Jan 22 21:14:18.316715 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2515/4817] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:18 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:18.678975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e70fed90-e1f6-44cf-8aec-e47aa8c437a3 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] Action: 'create', calling method: .version_select at 0x7f1ed5b7ef70>, body: {"pool": null} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:18.791658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:14:18.792705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:14:18.793358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:14:18.793804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:14:18.794455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:14:18.809707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:18.810166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:18.811647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:18.812105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:18.832520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Getting quotas for project 7a9f8a87f60b4668b8a968fa1e63282d. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:14:18.838460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Getting quotas for user e2bb2fab98714702bab120f7e5a222d6 and project 7a9f8a87f60b4668b8a968fa1e63282d. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:14:18.853258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:14:18.855756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:14:18.981204 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ed0ab351-0ffa-4e20-ad48-df1efe841b11 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.755291 Jan 22 21:14:18.986719 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2303/4818] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:14:18 2022] POST /compute/v2.1/servers => generated 382 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:14:18.987503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ba0835c8-60ea-4d9d-8d28-3507f4d5f1d1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:18.988497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ba0835c8-60ea-4d9d-8d28-3507f4d5f1d1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:18.996764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba0835c8-60ea-4d9d-8d28-3507f4d5f1d1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:18.997716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba0835c8-60ea-4d9d-8d28-3507f4d5f1d1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:18.998692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba0835c8-60ea-4d9d-8d28-3507f4d5f1d1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:18.999307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba0835c8-60ea-4d9d-8d28-3507f4d5f1d1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:19.051667 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ba0835c8-60ea-4d9d-8d28-3507f4d5f1d1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.067587 Jan 22 21:14:19.052881 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2304/4819] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:18 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:19.059181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b17659b1-a040-4cd8-b425-4238c6b9b459 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:19.059916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b17659b1-a040-4cd8-b425-4238c6b9b459 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:19.163699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b17659b1-a040-4cd8-b425-4238c6b9b459 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:19.163699 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b17659b1-a040-4cd8-b425-4238c6b9b459 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1219 microversion: 2.1 time: 0.105682 Jan 22 21:14:19.163699 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2305/4820] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:19 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:19.195583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-597fce31-cbbc-4033-a06b-820fa8e49be1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:19.196931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-597fce31-cbbc-4033-a06b-820fa8e49be1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:19.210044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-597fce31-cbbc-4033-a06b-820fa8e49be1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:19.210687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-597fce31-cbbc-4033-a06b-820fa8e49be1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:19.211602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-597fce31-cbbc-4033-a06b-820fa8e49be1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:19.213302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-597fce31-cbbc-4033-a06b-820fa8e49be1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:19.266248 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-597fce31-cbbc-4033-a06b-820fa8e49be1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.074401 Jan 22 21:14:19.267774 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2306/4821] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:19 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:19.328014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a3226c3-6ccf-4a45-ac14-ccd033964d41 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:19.329047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9a3226c3-6ccf-4a45-ac14-ccd033964d41 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:19.338506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a3226c3-6ccf-4a45-ac14-ccd033964d41 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:19.339235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a3226c3-6ccf-4a45-ac14-ccd033964d41 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:19.340210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a3226c3-6ccf-4a45-ac14-ccd033964d41 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:19.340817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a3226c3-6ccf-4a45-ac14-ccd033964d41 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:19.394515 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a3226c3-6ccf-4a45-ac14-ccd033964d41 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.070733 Jan 22 21:14:19.396413 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2307/4822] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:19 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:20.064820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a8041a62-62da-4749-ad4c-0d693eba8850 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:20.065927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a8041a62-62da-4749-ad4c-0d693eba8850 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:20.074938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8041a62-62da-4749-ad4c-0d693eba8850 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:20.075646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8041a62-62da-4749-ad4c-0d693eba8850 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:20.077476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8041a62-62da-4749-ad4c-0d693eba8850 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:20.078134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8041a62-62da-4749-ad4c-0d693eba8850 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:20.126461 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a8041a62-62da-4749-ad4c-0d693eba8850 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.065751 Jan 22 21:14:20.127132 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2308/4823] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:20 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:14:20.179997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-af038e6a-3899-444f-a284-ce9950cbaf18 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:20.180709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-af038e6a-3899-444f-a284-ce9950cbaf18 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:20.188142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af038e6a-3899-444f-a284-ce9950cbaf18 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:20.188603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af038e6a-3899-444f-a284-ce9950cbaf18 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:20.189394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af038e6a-3899-444f-a284-ce9950cbaf18 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:20.190033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af038e6a-3899-444f-a284-ce9950cbaf18 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:20.265025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-af038e6a-3899-444f-a284-ce9950cbaf18 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:20.275463 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-af038e6a-3899-444f-a284-ce9950cbaf18 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1223 microversion: 2.1 time: 0.100247 Jan 22 21:14:20.278011 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2309/4824] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:20 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:20.291466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-111abd70-5437-44f6-a53a-adb1b1b50083 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:20.292432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-111abd70-5437-44f6-a53a-adb1b1b50083 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:20.300468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-111abd70-5437-44f6-a53a-adb1b1b50083 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:20.301334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-111abd70-5437-44f6-a53a-adb1b1b50083 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:20.302389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-111abd70-5437-44f6-a53a-adb1b1b50083 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:20.303971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-111abd70-5437-44f6-a53a-adb1b1b50083 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:20.359263 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-111abd70-5437-44f6-a53a-adb1b1b50083 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.077135 Jan 22 21:14:20.363018 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2310/4825] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:20 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:20.407485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-02ac3780-0753-4dc1-8572-189badc18d25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:20.408659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-02ac3780-0753-4dc1-8572-189badc18d25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:20.416569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-02ac3780-0753-4dc1-8572-189badc18d25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:20.417101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-02ac3780-0753-4dc1-8572-189badc18d25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:20.418016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-02ac3780-0753-4dc1-8572-189badc18d25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:20.418531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-02ac3780-0753-4dc1-8572-189badc18d25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:20.465349 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-02ac3780-0753-4dc1-8572-189badc18d25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.062421 Jan 22 21:14:20.469389 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2311/4826] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:20 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:20.933391 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e70fed90-e1f6-44cf-8aec-e47aa8c437a3 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] 10.222.0.100 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.578390 Jan 22 21:14:20.935460 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2516/4827] 10.222.0.100 () {60 vars in 1174 bytes} [Sat Jan 22 21:14:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:20.948696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-13cecdcd-a576-4674-95e0-122d70a4536c tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] Action: 'create', calling method: .version_select at 0x7f1ed635ba60>, body: {"pool": null} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:21.140349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-70134383-737c-4b40-b06a-a541a30857b1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:21.142147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-70134383-737c-4b40-b06a-a541a30857b1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:21.154474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70134383-737c-4b40-b06a-a541a30857b1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:21.158959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70134383-737c-4b40-b06a-a541a30857b1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:21.158959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70134383-737c-4b40-b06a-a541a30857b1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:21.158959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70134383-737c-4b40-b06a-a541a30857b1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:21.212929 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-70134383-737c-4b40-b06a-a541a30857b1 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.077353 Jan 22 21:14:21.213972 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2517/4828] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:21 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:21.293709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-15fdf6b6-99b4-4ff0-900e-754a8e25cd24 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:21.294598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-15fdf6b6-99b4-4ff0-900e-754a8e25cd24 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:21.302268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15fdf6b6-99b4-4ff0-900e-754a8e25cd24 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:21.303936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15fdf6b6-99b4-4ff0-900e-754a8e25cd24 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:21.304969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15fdf6b6-99b4-4ff0-900e-754a8e25cd24 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:21.305654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15fdf6b6-99b4-4ff0-900e-754a8e25cd24 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:21.404309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-15fdf6b6-99b4-4ff0-900e-754a8e25cd24 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:21.415450 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-15fdf6b6-99b4-4ff0-900e-754a8e25cd24 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1271 microversion: 2.1 time: 0.126088 Jan 22 21:14:21.416137 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2518/4829] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:21 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:21.438959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dd7527ba-f891-4b60-8575-5a612ea6ec4e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:21.440750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dd7527ba-f891-4b60-8575-5a612ea6ec4e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:21.455798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd7527ba-f891-4b60-8575-5a612ea6ec4e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:21.456267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd7527ba-f891-4b60-8575-5a612ea6ec4e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:21.463694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd7527ba-f891-4b60-8575-5a612ea6ec4e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:21.463694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd7527ba-f891-4b60-8575-5a612ea6ec4e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:21.541102 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dd7527ba-f891-4b60-8575-5a612ea6ec4e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.123414 Jan 22 21:14:21.542160 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2519/4830] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:21 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:21.557952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5a4929a5-dd23-45cc-93f5-48e8a4b51a61 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:21.557952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5a4929a5-dd23-45cc-93f5-48e8a4b51a61 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:21.570424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a4929a5-dd23-45cc-93f5-48e8a4b51a61 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:21.570978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a4929a5-dd23-45cc-93f5-48e8a4b51a61 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:21.572104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a4929a5-dd23-45cc-93f5-48e8a4b51a61 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:21.572549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a4929a5-dd23-45cc-93f5-48e8a4b51a61 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:21.664751 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5a4929a5-dd23-45cc-93f5-48e8a4b51a61 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.120722 Jan 22 21:14:21.669407 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2520/4831] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:21 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:22.227563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d51e4445-1e8a-4fea-bb05-1a541ba2e784 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:22.229566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d51e4445-1e8a-4fea-bb05-1a541ba2e784 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:22.245794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d51e4445-1e8a-4fea-bb05-1a541ba2e784 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:22.247651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d51e4445-1e8a-4fea-bb05-1a541ba2e784 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:22.248760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d51e4445-1e8a-4fea-bb05-1a541ba2e784 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:22.249367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d51e4445-1e8a-4fea-bb05-1a541ba2e784 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:22.311273 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d51e4445-1e8a-4fea-bb05-1a541ba2e784 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.090304 Jan 22 21:14:22.314758 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2521/4832] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:22 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:14:22.434389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e1e1fe2f-8d72-4740-9268-232f189c7e70 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:22.435503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e1e1fe2f-8d72-4740-9268-232f189c7e70 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:22.442566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1e1fe2f-8d72-4740-9268-232f189c7e70 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:22.443296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1e1fe2f-8d72-4740-9268-232f189c7e70 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:22.444184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1e1fe2f-8d72-4740-9268-232f189c7e70 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:22.444764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1e1fe2f-8d72-4740-9268-232f189c7e70 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:22.531785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e1e1fe2f-8d72-4740-9268-232f189c7e70 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:22.540901 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e1e1fe2f-8d72-4740-9268-232f189c7e70 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1277 microversion: 2.1 time: 0.111423 Jan 22 21:14:22.542095 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2522/4833] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:22 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:22.553976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-da3b2472-df5a-42b3-9cb5-cffe01440411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:22.556833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-da3b2472-df5a-42b3-9cb5-cffe01440411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:22.562121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da3b2472-df5a-42b3-9cb5-cffe01440411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:22.562893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da3b2472-df5a-42b3-9cb5-cffe01440411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:22.564009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da3b2472-df5a-42b3-9cb5-cffe01440411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:22.564679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da3b2472-df5a-42b3-9cb5-cffe01440411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:22.614865 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-da3b2472-df5a-42b3-9cb5-cffe01440411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.066201 Jan 22 21:14:22.617596 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2523/4834] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:22 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:22.682141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19cbd351-9a54-4214-b4ed-93674c61800a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:22.683179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-19cbd351-9a54-4214-b4ed-93674c61800a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:22.691116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19cbd351-9a54-4214-b4ed-93674c61800a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:22.691862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19cbd351-9a54-4214-b4ed-93674c61800a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:22.692800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19cbd351-9a54-4214-b4ed-93674c61800a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:22.693448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19cbd351-9a54-4214-b4ed-93674c61800a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:22.738421 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19cbd351-9a54-4214-b4ed-93674c61800a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 24573 microversion: 2.20 time: 0.062299 Jan 22 21:14:22.739085 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2524/4835] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:22 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 24573 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:23.339152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1741a564-2e1d-41ae-a420-1e5856f39ad5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:23.343616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1741a564-2e1d-41ae-a420-1e5856f39ad5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:23.360912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1741a564-2e1d-41ae-a420-1e5856f39ad5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:23.361655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1741a564-2e1d-41ae-a420-1e5856f39ad5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:23.362498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1741a564-2e1d-41ae-a420-1e5856f39ad5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:23.363178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1741a564-2e1d-41ae-a420-1e5856f39ad5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:23.443853 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1741a564-2e1d-41ae-a420-1e5856f39ad5 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.116679 Jan 22 21:14:23.444701 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2525/4836] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:23 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:23.451652 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-13cecdcd-a576-4674-95e0-122d70a4536c tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] 10.222.0.100 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.508494 Jan 22 21:14:23.452261 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2312/4837] 10.222.0.100 () {60 vars in 1174 bytes} [Sat Jan 22 21:14:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:23.480840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e99cd68-8263-47c5-b52b-511ce25bb095 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] Action: 'create', calling method: .version_select at 0x7f1ed5142430>, body: {"pool": null} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:23.566271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0cc62fea-3f56-40b3-aa31-3a3663828e8f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:23.567049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0cc62fea-3f56-40b3-aa31-3a3663828e8f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:23.578480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cc62fea-3f56-40b3-aa31-3a3663828e8f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:23.579201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cc62fea-3f56-40b3-aa31-3a3663828e8f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:23.580493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cc62fea-3f56-40b3-aa31-3a3663828e8f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:23.581110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cc62fea-3f56-40b3-aa31-3a3663828e8f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:23.834259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0cc62fea-3f56-40b3-aa31-3a3663828e8f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:23.842011 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0cc62fea-3f56-40b3-aa31-3a3663828e8f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1319 microversion: 2.1 time: 0.281439 Jan 22 21:14:23.851636 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2313/4838] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:23 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:23.856719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cd898606-7e67-4ef1-ad3e-8234e125166b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:23.862591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cd898606-7e67-4ef1-ad3e-8234e125166b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:23.863669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd898606-7e67-4ef1-ad3e-8234e125166b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:23.864131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd898606-7e67-4ef1-ad3e-8234e125166b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:23.864940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd898606-7e67-4ef1-ad3e-8234e125166b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:23.866103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd898606-7e67-4ef1-ad3e-8234e125166b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:23.928262 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cd898606-7e67-4ef1-ad3e-8234e125166b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.073195 Jan 22 21:14:23.929332 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2314/4839] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:23 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:23.935044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-696e3a94-44ca-4846-8f84-61bbc43717d2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:23.936345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-696e3a94-44ca-4846-8f84-61bbc43717d2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:23.944500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-696e3a94-44ca-4846-8f84-61bbc43717d2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:23.945262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-696e3a94-44ca-4846-8f84-61bbc43717d2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:23.946263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-696e3a94-44ca-4846-8f84-61bbc43717d2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:23.947152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-696e3a94-44ca-4846-8f84-61bbc43717d2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:24.003617 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-696e3a94-44ca-4846-8f84-61bbc43717d2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.072508 Jan 22 21:14:24.009976 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2315/4840] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:23 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:24.398399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-ee1b1d7d-7b3e-4133-b5f2-f018062b7902 req-329d095a-9cd9-4e63-88e3-f65e9e81c736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "538b47c7-66d4-4337-a45e-f0b2f966cb44", "tag": "26bc35da-4fb9-42e3-9065-1f087403b15f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:24.401447 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:14:24.401447 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:14:24.410300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-ee1b1d7d-7b3e-4133-b5f2-f018062b7902 req-329d095a-9cd9-4e63-88e3-f65e9e81c736 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:24.411155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-ee1b1d7d-7b3e-4133-b5f2-f018062b7902 req-329d095a-9cd9-4e63-88e3-f65e9e81c736 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:24.426368 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-ee1b1d7d-7b3e-4133-b5f2-f018062b7902 req-329d095a-9cd9-4e63-88e3-f65e9e81c736 service nova] Creating event network-changed:26bc35da-4fb9-42e3-9065-1f087403b15f for instance 538b47c7-66d4-4337-a45e-f0b2f966cb44 on nch2-master-1 Jan 22 21:14:24.433065 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-ee1b1d7d-7b3e-4133-b5f2-f018062b7902 req-329d095a-9cd9-4e63-88e3-f65e9e81c736 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040351 Jan 22 21:14:24.434231 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2316/4841] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:24.459394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-27a9d003-cfe9-48dc-a313-25adf7a37ce7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:24.460908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-27a9d003-cfe9-48dc-a313-25adf7a37ce7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:24.473876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27a9d003-cfe9-48dc-a313-25adf7a37ce7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:24.474340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27a9d003-cfe9-48dc-a313-25adf7a37ce7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:24.476378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27a9d003-cfe9-48dc-a313-25adf7a37ce7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:24.476836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27a9d003-cfe9-48dc-a313-25adf7a37ce7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:24.518484 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-27a9d003-cfe9-48dc-a313-25adf7a37ce7 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.065866 Jan 22 21:14:24.519145 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2317/4842] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:24 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:14:24.861092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b3766021-ed15-4d81-b2b4-424ca9d51348 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:24.861885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b3766021-ed15-4d81-b2b4-424ca9d51348 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:24.869867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3766021-ed15-4d81-b2b4-424ca9d51348 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:24.870596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3766021-ed15-4d81-b2b4-424ca9d51348 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:24.871405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3766021-ed15-4d81-b2b4-424ca9d51348 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:24.871853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3766021-ed15-4d81-b2b4-424ca9d51348 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:25.118842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b3766021-ed15-4d81-b2b4-424ca9d51348 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:25.127096 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b3766021-ed15-4d81-b2b4-424ca9d51348 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1319 microversion: 2.1 time: 0.270036 Jan 22 21:14:25.138232 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2318/4843] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:24 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:25.143631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-58cf8f03-99d4-4fb9-8138-4290aae0a645 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:25.144677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-58cf8f03-99d4-4fb9-8138-4290aae0a645 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:25.152727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58cf8f03-99d4-4fb9-8138-4290aae0a645 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:25.153195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58cf8f03-99d4-4fb9-8138-4290aae0a645 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:25.154029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58cf8f03-99d4-4fb9-8138-4290aae0a645 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:25.154480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58cf8f03-99d4-4fb9-8138-4290aae0a645 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:25.205805 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-58cf8f03-99d4-4fb9-8138-4290aae0a645 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.065778 Jan 22 21:14:25.206517 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2319/4844] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:25 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:25.212120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-39f33807-b62c-4f5f-acf9-697444c9b047 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:25.213121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-39f33807-b62c-4f5f-acf9-697444c9b047 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:25.220532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f33807-b62c-4f5f-acf9-697444c9b047 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:25.220914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f33807-b62c-4f5f-acf9-697444c9b047 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:25.221940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f33807-b62c-4f5f-acf9-697444c9b047 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:25.222537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f33807-b62c-4f5f-acf9-697444c9b047 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:25.281212 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-39f33807-b62c-4f5f-acf9-697444c9b047 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.072974 Jan 22 21:14:25.281633 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e99cd68-8263-47c5-b52b-511ce25bb095 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] 10.222.0.100 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.815789 Jan 22 21:14:25.286206 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2320/4845] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:25 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:25.288737 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2526/4846] 10.222.0.100 () {60 vars in 1174 bytes} [Sat Jan 22 21:14:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:25.294218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-485b2512-83d9-4aa8-bf0d-3743d09eab64 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] Action: 'create', calling method: .version_select at 0x7f1ed60f9040>, body: {"pool": null} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:25.530415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f567079b-255c-49ea-a78c-543ed37f988f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:25.531446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f567079b-255c-49ea-a78c-543ed37f988f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:25.538192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f567079b-255c-49ea-a78c-543ed37f988f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:25.538655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f567079b-255c-49ea-a78c-543ed37f988f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:25.539702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f567079b-255c-49ea-a78c-543ed37f988f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:25.540144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f567079b-255c-49ea-a78c-543ed37f988f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:25.580257 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f567079b-255c-49ea-a78c-543ed37f988f tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.053912 Jan 22 21:14:25.581112 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2527/4847] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:25 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:14:26.145462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-72bae4dd-e942-4a14-9395-7425d7c09b44 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:26.146238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-72bae4dd-e942-4a14-9395-7425d7c09b44 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:26.154094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72bae4dd-e942-4a14-9395-7425d7c09b44 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:26.154561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72bae4dd-e942-4a14-9395-7425d7c09b44 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:26.155366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72bae4dd-e942-4a14-9395-7425d7c09b44 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:26.155850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-72bae4dd-e942-4a14-9395-7425d7c09b44 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:26.306112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-72bae4dd-e942-4a14-9395-7425d7c09b44 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:26.313914 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-72bae4dd-e942-4a14-9395-7425d7c09b44 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1319 microversion: 2.1 time: 0.172431 Jan 22 21:14:26.323599 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2528/4848] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:26 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:26.328583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b110fbb7-de29-4840-b471-32441a945d06 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:26.329800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b110fbb7-de29-4840-b471-32441a945d06 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:26.336110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b110fbb7-de29-4840-b471-32441a945d06 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:26.336771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b110fbb7-de29-4840-b471-32441a945d06 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:26.337798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b110fbb7-de29-4840-b471-32441a945d06 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:26.338409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b110fbb7-de29-4840-b471-32441a945d06 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:26.395512 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b110fbb7-de29-4840-b471-32441a945d06 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 32635 microversion: 2.1 time: 0.070345 Jan 22 21:14:26.397226 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2529/4849] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:26 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 32635 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:26.404781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-03bdb306-07f0-490b-ae05-645812c8ff6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:26.405836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-03bdb306-07f0-490b-ae05-645812c8ff6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:26.413527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03bdb306-07f0-490b-ae05-645812c8ff6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:26.414017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03bdb306-07f0-490b-ae05-645812c8ff6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:26.414834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03bdb306-07f0-490b-ae05-645812c8ff6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:26.415277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03bdb306-07f0-490b-ae05-645812c8ff6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:26.456518 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-03bdb306-07f0-490b-ae05-645812c8ff6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.057715 Jan 22 21:14:26.461171 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2530/4850] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:26 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:26.598452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1bd4abee-0a6d-48f2-833f-97a0fe169784 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:26.600855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1bd4abee-0a6d-48f2-833f-97a0fe169784 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:26.612883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bd4abee-0a6d-48f2-833f-97a0fe169784 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:26.613597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bd4abee-0a6d-48f2-833f-97a0fe169784 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:26.614783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bd4abee-0a6d-48f2-833f-97a0fe169784 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:26.615970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bd4abee-0a6d-48f2-833f-97a0fe169784 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:26.658085 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1bd4abee-0a6d-48f2-833f-97a0fe169784 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.068216 Jan 22 21:14:26.658752 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2531/4851] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:26 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:14:26.877506 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-485b2512-83d9-4aa8-bf0d-3743d09eab64 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] 10.222.0.100 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.587149 Jan 22 21:14:26.878210 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2321/4852] 10.222.0.100 () {60 vars in 1174 bytes} [Sat Jan 22 21:14:25 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:26.889593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-03c11f53-4abd-47ae-9dd6-73f90c3163f3 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] Calling method '.version_select at 0x7f1ed5237c10>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:27.063724 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-03c11f53-4abd-47ae-9dd6-73f90c3163f3 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] 10.222.0.100 "GET /compute/v2.1/os-floating-ips/a9fff9a1-7e89-4e45-b016-b538bdce9df2" status: 200 len: 142 microversion: 2.1 time: 0.178232 Jan 22 21:14:27.064414 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2532/4853] 10.222.0.100 () {58 vars in 1264 bytes} [Sat Jan 22 21:14:26 2022] GET /compute/v2.1/os-floating-ips/a9fff9a1-7e89-4e45-b016-b538bdce9df2 => generated 142 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:27.076052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b12aeccc-d3b1-49e5-b639-448d0edf8e1c tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] Calling method '.version_select at 0x7f1ed64e0f70>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:27.330884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c8b8f44c-d411-4490-878b-7dd1bace4eea tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:27.331851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c8b8f44c-d411-4490-878b-7dd1bace4eea tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:27.339507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8b8f44c-d411-4490-878b-7dd1bace4eea tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:27.340117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8b8f44c-d411-4490-878b-7dd1bace4eea tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:27.340919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8b8f44c-d411-4490-878b-7dd1bace4eea tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:27.341575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8b8f44c-d411-4490-878b-7dd1bace4eea tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:27.526836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c8b8f44c-d411-4490-878b-7dd1bace4eea tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:27.539003 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c8b8f44c-d411-4490-878b-7dd1bace4eea tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1319 microversion: 2.1 time: 0.213074 Jan 22 21:14:27.540083 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2533/4854] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:27 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:27.544857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-48dda209-cc79-4808-9687-7a49659f73ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:27.549893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-48dda209-cc79-4808-9687-7a49659f73ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:27.555320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48dda209-cc79-4808-9687-7a49659f73ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:27.555860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48dda209-cc79-4808-9687-7a49659f73ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:27.557048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48dda209-cc79-4808-9687-7a49659f73ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:27.557786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48dda209-cc79-4808-9687-7a49659f73ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:27.624695 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-48dda209-cc79-4808-9687-7a49659f73ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 200 len: 40788 microversion: 2.1 time: 0.083159 Jan 22 21:14:27.626182 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2534/4855] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:27 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 40788 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:27.637265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0435b210-137d-4a07-82bb-b24062d5a27f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:27.640193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0435b210-137d-4a07-82bb-b24062d5a27f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:27.648047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0435b210-137d-4a07-82bb-b24062d5a27f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:27.648508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0435b210-137d-4a07-82bb-b24062d5a27f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:27.653302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0435b210-137d-4a07-82bb-b24062d5a27f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:27.653302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0435b210-137d-4a07-82bb-b24062d5a27f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:27.699397 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0435b210-137d-4a07-82bb-b24062d5a27f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.071205 Jan 22 21:14:27.700494 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2535/4856] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:27 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:27.705991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7065af1d-11d9-499e-af11-0c336bc0743e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:27.706577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7065af1d-11d9-499e-af11-0c336bc0743e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:27.715104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7065af1d-11d9-499e-af11-0c336bc0743e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:27.716610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7065af1d-11d9-499e-af11-0c336bc0743e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:27.716610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7065af1d-11d9-499e-af11-0c336bc0743e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:27.716791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7065af1d-11d9-499e-af11-0c336bc0743e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:27.742601 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7065af1d-11d9-499e-af11-0c336bc0743e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/ips" status: 200 len: 146 microversion: 2.1 time: 0.040664 Jan 22 21:14:27.743590 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2536/4857] 10.222.0.100 () {58 vars in 1252 bytes} [Sat Jan 22 21:14:27 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:27.754074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b10b5058-6932-4ab8-9566-199ea6cb609a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:27.756037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b10b5058-6932-4ab8-9566-199ea6cb609a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:27.765089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b10b5058-6932-4ab8-9566-199ea6cb609a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:27.772024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b10b5058-6932-4ab8-9566-199ea6cb609a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:27.772024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b10b5058-6932-4ab8-9566-199ea6cb609a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:27.772024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b10b5058-6932-4ab8-9566-199ea6cb609a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:27.809732 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b10b5058-6932-4ab8-9566-199ea6cb609a tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action" status: 200 len: 24494 microversion: 2.1 time: 0.064310 Jan 22 21:14:27.811226 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2537/4858] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:27 2022] POST /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37/action => generated 24494 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:14:27.820721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-76ff0c85-62a9-4f6f-85dc-f6628ec65ac9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:27.821712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-76ff0c85-62a9-4f6f-85dc-f6628ec65ac9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:27.829058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76ff0c85-62a9-4f6f-85dc-f6628ec65ac9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:27.829524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76ff0c85-62a9-4f6f-85dc-f6628ec65ac9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:27.830339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76ff0c85-62a9-4f6f-85dc-f6628ec65ac9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:27.830784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76ff0c85-62a9-4f6f-85dc-f6628ec65ac9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:27.972559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-76ff0c85-62a9-4f6f-85dc-f6628ec65ac9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:27.982754 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-76ff0c85-62a9-4f6f-85dc-f6628ec65ac9 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1606 microversion: 2.1 time: 0.164443 Jan 22 21:14:27.982754 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2538/4859] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:27 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1606 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:28.148247 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b12aeccc-d3b1-49e5-b639-448d0edf8e1c tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] 10.222.0.100 "DELETE /compute/v2.1/os-floating-ips/a9fff9a1-7e89-4e45-b016-b538bdce9df2" status: 202 len: 0 microversion: 2.1 time: 1.075883 Jan 22 21:14:28.149352 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2322/4860] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:14:27 2022] DELETE /compute/v2.1/os-floating-ips/a9fff9a1-7e89-4e45-b016-b538bdce9df2 => generated 0 bytes in 1078 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:28.158357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4bd5447d-3390-41f3-8c23-279e16491bf2 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] Calling method '.version_select at 0x7f1ed5ec6550>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:28.361894 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4bd5447d-3390-41f3-8c23-279e16491bf2 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] 10.222.0.100 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.207233 Jan 22 21:14:28.362490 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2539/4861] 10.222.0.100 () {58 vars in 1168 bytes} [Sat Jan 22 21:14:28 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:14:28.380502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-38f9a88e-29ad-4abb-b061-ba5edea08e86 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] Calling method '.version_select at 0x7f1ed54e50d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:28.556600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6c6970ec-078f-42a7-9f88-99dba69b2691 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:28.557603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6c6970ec-078f-42a7-9f88-99dba69b2691 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:28.564546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c6970ec-078f-42a7-9f88-99dba69b2691 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:28.565015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c6970ec-078f-42a7-9f88-99dba69b2691 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:28.567271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c6970ec-078f-42a7-9f88-99dba69b2691 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:28.573675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c6970ec-078f-42a7-9f88-99dba69b2691 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:28.586045 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-38f9a88e-29ad-4abb-b061-ba5edea08e86 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] 10.222.0.100 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.215928 Jan 22 21:14:28.587218 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2323/4862] 10.222.0.100 () {58 vars in 1153 bytes} [Sat Jan 22 21:14:28 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:28.600401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f0017a55-0b0e-4ce8-a895-1c70c5e46800 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] Calling method '.version_select at 0x7f1edaee3af0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:28.736202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6c6970ec-078f-42a7-9f88-99dba69b2691 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:28.744894 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6c6970ec-078f-42a7-9f88-99dba69b2691 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1319 microversion: 2.1 time: 0.192631 Jan 22 21:14:28.755126 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2540/4863] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:28 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:28.760998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0288ba84-4aeb-4e3a-9489-1ec898845963 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:28.762319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0288ba84-4aeb-4e3a-9489-1ec898845963 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:28.770796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0288ba84-4aeb-4e3a-9489-1ec898845963 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:28.772060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0288ba84-4aeb-4e3a-9489-1ec898845963 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:28.773456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0288ba84-4aeb-4e3a-9489-1ec898845963 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:28.774192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0288ba84-4aeb-4e3a-9489-1ec898845963 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:28.820722 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0288ba84-4aeb-4e3a-9489-1ec898845963 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.061842 Jan 22 21:14:28.820722 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2541/4864] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:28 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:29.762832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-40a67ba6-dfc9-4f1d-bf09-9069585ae405 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:29.763531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-40a67ba6-dfc9-4f1d-bf09-9069585ae405 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:29.772569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40a67ba6-dfc9-4f1d-bf09-9069585ae405 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:29.773096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40a67ba6-dfc9-4f1d-bf09-9069585ae405 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:29.774114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40a67ba6-dfc9-4f1d-bf09-9069585ae405 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:29.774578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40a67ba6-dfc9-4f1d-bf09-9069585ae405 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:29.790515 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f0017a55-0b0e-4ce8-a895-1c70c5e46800 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] 10.222.0.100 "DELETE /compute/v2.1/os-floating-ips/825d1023-af56-45d1-9ad6-368941eaad27" status: 202 len: 0 microversion: 2.1 time: 1.194746 Jan 22 21:14:29.791150 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2324/4865] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:14:28 2022] DELETE /compute/v2.1/os-floating-ips/825d1023-af56-45d1-9ad6-368941eaad27 => generated 0 bytes in 1196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:29.799106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-848fc0e2-341c-4556-8d81-8367d15cd1e0 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] Calling method '.version_select at 0x7f1edae05dc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:29.928552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-40a67ba6-dfc9-4f1d-bf09-9069585ae405 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:29.937876 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-40a67ba6-dfc9-4f1d-bf09-9069585ae405 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1319 microversion: 2.1 time: 0.179127 Jan 22 21:14:29.939116 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2542/4866] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:29 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:29.946749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2645df20-baaa-4354-b801-fb88967537df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:29.947883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2645df20-baaa-4354-b801-fb88967537df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:29.954372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2645df20-baaa-4354-b801-fb88967537df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:29.954957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2645df20-baaa-4354-b801-fb88967537df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:29.955872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2645df20-baaa-4354-b801-fb88967537df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:29.956430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2645df20-baaa-4354-b801-fb88967537df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:30.019075 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2645df20-baaa-4354-b801-fb88967537df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.077375 Jan 22 21:14:30.021559 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2543/4867] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:29 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:30.624737 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-848fc0e2-341c-4556-8d81-8367d15cd1e0 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] 10.222.0.100 "DELETE /compute/v2.1/os-floating-ips/96df485e-7c15-46c3-a6ca-797df9e0474c" status: 202 len: 0 microversion: 2.1 time: 0.829392 Jan 22 21:14:30.625333 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2325/4868] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:14:29 2022] DELETE /compute/v2.1/os-floating-ips/96df485e-7c15-46c3-a6ca-797df9e0474c => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:30.633831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5dcb36b9-a7e4-4d1b-958c-f213f5bf9700 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] Calling method '.version_select at 0x7f1edae24d30>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:30.955865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-6d153112-6d8b-41c4-b260-802538e44b40 req-d777fcc4-9164-4e15-afa6-b10c389d22cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "538b47c7-66d4-4337-a45e-f0b2f966cb44", "name": "network-vif-plugged", "status": "completed", "tag": "26bc35da-4fb9-42e3-9065-1f087403b15f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:30.958100 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:14:30.958100 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:14:30.968322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6d153112-6d8b-41c4-b260-802538e44b40 req-d777fcc4-9164-4e15-afa6-b10c389d22cc service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:30.968805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6d153112-6d8b-41c4-b260-802538e44b40 req-d777fcc4-9164-4e15-afa6-b10c389d22cc service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:30.979644 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-6d153112-6d8b-41c4-b260-802538e44b40 req-d777fcc4-9164-4e15-afa6-b10c389d22cc service nova] Creating event network-vif-plugged:26bc35da-4fb9-42e3-9065-1f087403b15f for instance 538b47c7-66d4-4337-a45e-f0b2f966cb44 on nch2-master-1 Jan 22 21:14:30.984461 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-6d153112-6d8b-41c4-b260-802538e44b40 req-d777fcc4-9164-4e15-afa6-b10c389d22cc service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032821 Jan 22 21:14:30.985060 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2326/4869] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:30.990870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-709f3086-6e9a-4eec-929d-1cd989216181 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:30.991583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-709f3086-6e9a-4eec-929d-1cd989216181 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:30.997893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-709f3086-6e9a-4eec-929d-1cd989216181 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:30.998352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-709f3086-6e9a-4eec-929d-1cd989216181 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:30.999326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-709f3086-6e9a-4eec-929d-1cd989216181 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:30.999925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-709f3086-6e9a-4eec-929d-1cd989216181 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:31.236397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-709f3086-6e9a-4eec-929d-1cd989216181 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:31.245181 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-709f3086-6e9a-4eec-929d-1cd989216181 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1319 microversion: 2.1 time: 0.258466 Jan 22 21:14:31.245800 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2327/4870] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:30 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:31.251219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5af8b5db-47bb-493c-b130-ad0b505b2fe7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:31.252332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5af8b5db-47bb-493c-b130-ad0b505b2fe7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:31.260118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5af8b5db-47bb-493c-b130-ad0b505b2fe7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:31.260577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5af8b5db-47bb-493c-b130-ad0b505b2fe7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:31.261573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5af8b5db-47bb-493c-b130-ad0b505b2fe7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:31.262180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5af8b5db-47bb-493c-b130-ad0b505b2fe7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:31.508974 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5af8b5db-47bb-493c-b130-ad0b505b2fe7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.261692 Jan 22 21:14:31.513084 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2328/4871] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:31 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:31.518411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2036b40d-b69e-4a63-8c07-faa1eb6eac5e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b554aa9-05f4-43e4-9e7d-76a8b52309ae"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:31.522996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2036b40d-b69e-4a63-8c07-faa1eb6eac5e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:31.527954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2036b40d-b69e-4a63-8c07-faa1eb6eac5e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:31.528423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2036b40d-b69e-4a63-8c07-faa1eb6eac5e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:31.529228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2036b40d-b69e-4a63-8c07-faa1eb6eac5e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:31.529718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2036b40d-b69e-4a63-8c07-faa1eb6eac5e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:31.586652 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5dcb36b9-a7e4-4d1b-958c-f213f5bf9700 tempest-FloatingIPDetailsTestJSON-1782301365 tempest-FloatingIPDetailsTestJSON-1782301365-project] 10.222.0.100 "DELETE /compute/v2.1/os-floating-ips/a1bac00f-7eb1-4731-bdd8-6ca07faf32f2" status: 202 len: 0 microversion: 2.1 time: 0.956917 Jan 22 21:14:31.587304 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2544/4872] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:14:30 2022] DELETE /compute/v2.1/os-floating-ips/a1bac00f-7eb1-4731-bdd8-6ca07faf32f2 => generated 0 bytes in 958 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:32.262964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5ac942fd-e54b-4fac-a617-4da5563bbaf1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:32.263723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5ac942fd-e54b-4fac-a617-4da5563bbaf1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:32.270422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ac942fd-e54b-4fac-a617-4da5563bbaf1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:32.270937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ac942fd-e54b-4fac-a617-4da5563bbaf1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:32.272227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ac942fd-e54b-4fac-a617-4da5563bbaf1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:32.277663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ac942fd-e54b-4fac-a617-4da5563bbaf1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:32.307130 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2036b40d-b69e-4a63-8c07-faa1eb6eac5e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.795240 Jan 22 21:14:32.313278 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2329/4873] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:14:31 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/os-volume_attachments => generated 194 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:32.500512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5ac942fd-e54b-4fac-a617-4da5563bbaf1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:32.516998 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5ac942fd-e54b-4fac-a617-4da5563bbaf1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1319 microversion: 2.1 time: 0.256606 Jan 22 21:14:32.526208 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2545/4874] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:32 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:32.532295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-09699b96-08b3-4e64-88e5-4cf28225dfb7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:32.533386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-09699b96-08b3-4e64-88e5-4cf28225dfb7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:32.552958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09699b96-08b3-4e64-88e5-4cf28225dfb7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:32.555937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09699b96-08b3-4e64-88e5-4cf28225dfb7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:32.555937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09699b96-08b3-4e64-88e5-4cf28225dfb7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:32.555937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09699b96-08b3-4e64-88e5-4cf28225dfb7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:32.603199 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-09699b96-08b3-4e64-88e5-4cf28225dfb7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.086314 Jan 22 21:14:32.604911 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2330/4875] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:32 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:33.537427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6c0af890-206c-429d-8c12-cf8cff2a120c tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:33.539494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6c0af890-206c-429d-8c12-cf8cff2a120c tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:33.547230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c0af890-206c-429d-8c12-cf8cff2a120c tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:33.547904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c0af890-206c-429d-8c12-cf8cff2a120c tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:33.549238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c0af890-206c-429d-8c12-cf8cff2a120c tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:33.549348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c0af890-206c-429d-8c12-cf8cff2a120c tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:33.615695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b7e4b64e-18ff-41c0-8382-81555ddecad9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:33.616717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b7e4b64e-18ff-41c0-8382-81555ddecad9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:33.624794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7e4b64e-18ff-41c0-8382-81555ddecad9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:33.625239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7e4b64e-18ff-41c0-8382-81555ddecad9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:33.626077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7e4b64e-18ff-41c0-8382-81555ddecad9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:33.626515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7e4b64e-18ff-41c0-8382-81555ddecad9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:33.669637 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b7e4b64e-18ff-41c0-8382-81555ddecad9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.058007 Jan 22 21:14:33.673604 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2331/4876] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:33 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:33.895282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6c0af890-206c-429d-8c12-cf8cff2a120c tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:33.904646 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6c0af890-206c-429d-8c12-cf8cff2a120c tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1507 microversion: 2.1 time: 0.374468 Jan 22 21:14:33.905333 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2546/4877] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:33 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1507 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:33.924526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f970eaf3-5d77-4cbb-9a67-0af4ee502b8e tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-395711028"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:33.925067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f970eaf3-5d77-4cbb-9a67-0af4ee502b8e tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:33.934125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f970eaf3-5d77-4cbb-9a67-0af4ee502b8e tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:33.934584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f970eaf3-5d77-4cbb-9a67-0af4ee502b8e tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:33.935390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f970eaf3-5d77-4cbb-9a67-0af4ee502b8e tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:33.935841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f970eaf3-5d77-4cbb-9a67-0af4ee502b8e tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:34.126842 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.network.security_group_api [None req-f970eaf3-5d77-4cbb-9a67-0af4ee502b8e tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Adding security group 0d404012-2424-4df7-9687-78e28f7e126d to port 26bc35da-4fb9-42e3-9065-1f087403b15f Jan 22 21:14:34.666554 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f970eaf3-5d77-4cbb-9a67-0af4ee502b8e tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44/action" status: 202 len: 0 microversion: 2.1 time: 0.746167 Jan 22 21:14:34.667924 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2332/4878] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:33 2022] POST /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44/action => generated 0 bytes in 748 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:34.681158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8bfa4ed7-4894-47fe-91da-d7582cbc8671 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1edafae9d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:34.681685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-558cc6ac-0dad-4e56-9e16-eaf51a64333b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:34.682379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-558cc6ac-0dad-4e56-9e16-eaf51a64333b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:34.697120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-558cc6ac-0dad-4e56-9e16-eaf51a64333b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:34.697120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-558cc6ac-0dad-4e56-9e16-eaf51a64333b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:34.697120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-558cc6ac-0dad-4e56-9e16-eaf51a64333b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:34.697120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-558cc6ac-0dad-4e56-9e16-eaf51a64333b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:34.745805 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-558cc6ac-0dad-4e56-9e16-eaf51a64333b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.068669 Jan 22 21:14:34.752977 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2333/4879] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:34 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:34.763793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-172b6011-7cdf-4e81-ae8b-1502b1951915 req-21e20ca6-d5bd-49cb-ba30-b68e8a3bedb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "538b47c7-66d4-4337-a45e-f0b2f966cb44", "tag": "26bc35da-4fb9-42e3-9065-1f087403b15f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:34.765818 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:14:34.765818 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:14:34.778440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-172b6011-7cdf-4e81-ae8b-1502b1951915 req-21e20ca6-d5bd-49cb-ba30-b68e8a3bedb5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:34.779184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-172b6011-7cdf-4e81-ae8b-1502b1951915 req-21e20ca6-d5bd-49cb-ba30-b68e8a3bedb5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:34.794307 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-172b6011-7cdf-4e81-ae8b-1502b1951915 req-21e20ca6-d5bd-49cb-ba30-b68e8a3bedb5 service nova] Creating event network-changed:26bc35da-4fb9-42e3-9065-1f087403b15f for instance 538b47c7-66d4-4337-a45e-f0b2f966cb44 on nch2-master-1 Jan 22 21:14:34.801315 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-172b6011-7cdf-4e81-ae8b-1502b1951915 req-21e20ca6-d5bd-49cb-ba30-b68e8a3bedb5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042033 Jan 22 21:14:34.819296 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2334/4880] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:34.870648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG neutronclient.v2_0.client [None req-8bfa4ed7-4894-47fe-91da-d7582cbc8671 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0d404012-2424-4df7-9687-78e28f7e126d in use.", "detail": ""}} {{(pid=137032) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:34.871359 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-8bfa4ed7-4894-47fe-91da-d7582cbc8671 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Security Group 0d404012-2424-4df7-9687-78e28f7e126d in use. Jan 22 21:14:34.871359 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-e94c6d86-d528-4c09-99de-39600f28daa2'] Jan 22 21:14:34.876823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8bfa4ed7-4894-47fe-91da-d7582cbc8671 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 400 to user: Security Group 0d404012-2424-4df7-9687-78e28f7e126d in use. Jan 22 21:14:34.876823 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-e94c6d86-d528-4c09-99de-39600f28daa2'] {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:34.876823 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8bfa4ed7-4894-47fe-91da-d7582cbc8671 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/0d404012-2424-4df7-9687-78e28f7e126d" status: 400 len: 185 microversion: 2.1 time: 0.200743 Jan 22 21:14:34.876823 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2547/4881] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:34 2022] DELETE /compute/v2.1/os-security-groups/0d404012-2424-4df7-9687-78e28f7e126d => generated 185 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:14:34.884434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5e9520a2-2359-4318-8a72-2597d866759f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:34.885491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5e9520a2-2359-4318-8a72-2597d866759f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:34.900787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e9520a2-2359-4318-8a72-2597d866759f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:34.900913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e9520a2-2359-4318-8a72-2597d866759f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:34.902273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e9520a2-2359-4318-8a72-2597d866759f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:34.903244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e9520a2-2359-4318-8a72-2597d866759f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:35.433774 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5e9520a2-2359-4318-8a72-2597d866759f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44/action" status: 202 len: 0 microversion: 2.1 time: 0.554496 Jan 22 21:14:35.434745 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2335/4882] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:34 2022] POST /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:35.447603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-041ef652-9756-4d8d-be57-50524e8f45dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:35.448663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-041ef652-9756-4d8d-be57-50524e8f45dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:35.457390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-041ef652-9756-4d8d-be57-50524e8f45dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:35.458247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-041ef652-9756-4d8d-be57-50524e8f45dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:35.459834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-041ef652-9756-4d8d-be57-50524e8f45dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:35.460890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-041ef652-9756-4d8d-be57-50524e8f45dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:35.731365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-041ef652-9756-4d8d-be57-50524e8f45dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:35.740079 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-041ef652-9756-4d8d-be57-50524e8f45dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1577 microversion: 2.1 time: 0.297118 Jan 22 21:14:35.742108 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2548/4883] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:35 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1577 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:35.763784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d9ae5830-b61a-4b0d-8a66-62f78bffec39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:35.766572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d9ae5830-b61a-4b0d-8a66-62f78bffec39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:35.787079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9ae5830-b61a-4b0d-8a66-62f78bffec39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:35.787906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9ae5830-b61a-4b0d-8a66-62f78bffec39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:35.789068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9ae5830-b61a-4b0d-8a66-62f78bffec39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:35.789542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9ae5830-b61a-4b0d-8a66-62f78bffec39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:35.857168 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d9ae5830-b61a-4b0d-8a66-62f78bffec39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.101198 Jan 22 21:14:35.859393 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2336/4884] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:35 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:36.709988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fdc02f0f-0e54-426c-b4df-cc3dff59dcb0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:36.717118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdc02f0f-0e54-426c-b4df-cc3dff59dcb0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:36.719062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdc02f0f-0e54-426c-b4df-cc3dff59dcb0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:36.741872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fdc02f0f-0e54-426c-b4df-cc3dff59dcb0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Going to try to stop instance {{(pid=137032) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 22 21:14:36.758732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-254df415-e169-4cf8-bf05-ae44b5ca46dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:36.759403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-254df415-e169-4cf8-bf05-ae44b5ca46dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:36.766877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-254df415-e169-4cf8-bf05-ae44b5ca46dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:36.767519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-254df415-e169-4cf8-bf05-ae44b5ca46dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:36.771444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-254df415-e169-4cf8-bf05-ae44b5ca46dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:36.771444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-254df415-e169-4cf8-bf05-ae44b5ca46dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:36.924860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-254df415-e169-4cf8-bf05-ae44b5ca46dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:36.933902 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-254df415-e169-4cf8-bf05-ae44b5ca46dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1582 microversion: 2.1 time: 0.179881 Jan 22 21:14:36.934501 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2337/4885] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:36 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1582 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:36.939196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11084ced-1b13-4a50-8a18-2df150814df4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:36.946948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-11084ced-1b13-4a50-8a18-2df150814df4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:36.948193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11084ced-1b13-4a50-8a18-2df150814df4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:36.948788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11084ced-1b13-4a50-8a18-2df150814df4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:36.949871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11084ced-1b13-4a50-8a18-2df150814df4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:36.951523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11084ced-1b13-4a50-8a18-2df150814df4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:36.996486 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-11084ced-1b13-4a50-8a18-2df150814df4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.060716 Jan 22 21:14:36.997386 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2338/4886] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:36 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:37.006042 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fdc02f0f-0e54-426c-b4df-cc3dff59dcb0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 202 len: 0 microversion: 2.1 time: 0.299666 Jan 22 21:14:37.006674 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2549/4887] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:36 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:37.015492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0cd07add-d4dd-45c5-8f39-035ea6b0a348 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:37.016343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0cd07add-d4dd-45c5-8f39-035ea6b0a348 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:37.024886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cd07add-d4dd-45c5-8f39-035ea6b0a348 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:37.025476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cd07add-d4dd-45c5-8f39-035ea6b0a348 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:37.026417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cd07add-d4dd-45c5-8f39-035ea6b0a348 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:37.027010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cd07add-d4dd-45c5-8f39-035ea6b0a348 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:37.206652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0cd07add-d4dd-45c5-8f39-035ea6b0a348 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:37.216130 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0cd07add-d4dd-45c5-8f39-035ea6b0a348 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1728 microversion: 2.1 time: 0.205002 Jan 22 21:14:37.216720 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2339/4888] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:37 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1728 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:37.955716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e66025e-17a5-453b-bfc9-a15d70b02d0a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:37.956421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e66025e-17a5-453b-bfc9-a15d70b02d0a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:37.963239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e66025e-17a5-453b-bfc9-a15d70b02d0a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:37.963746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e66025e-17a5-453b-bfc9-a15d70b02d0a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:37.964553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e66025e-17a5-453b-bfc9-a15d70b02d0a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:37.965011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e66025e-17a5-453b-bfc9-a15d70b02d0a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:38.013212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7de8f7bd-3ee4-4a7a-8111-7f254456a75c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:38.014194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7de8f7bd-3ee4-4a7a-8111-7f254456a75c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:38.022829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7de8f7bd-3ee4-4a7a-8111-7f254456a75c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:38.026524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7de8f7bd-3ee4-4a7a-8111-7f254456a75c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:38.026524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7de8f7bd-3ee4-4a7a-8111-7f254456a75c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:38.026524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7de8f7bd-3ee4-4a7a-8111-7f254456a75c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:38.071803 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7de8f7bd-3ee4-4a7a-8111-7f254456a75c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.061999 Jan 22 21:14:38.073056 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2340/4889] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:38 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:38.148173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5e66025e-17a5-453b-bfc9-a15d70b02d0a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:38.156245 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e66025e-17a5-453b-bfc9-a15d70b02d0a tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1575 microversion: 2.1 time: 0.205456 Jan 22 21:14:38.160871 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2550/4890] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:37 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:38.179620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4f6548f3-87dd-4a43-b590-6cd38d451ec0 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1195633415"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:38.180398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4f6548f3-87dd-4a43-b590-6cd38d451ec0 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:38.188248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6548f3-87dd-4a43-b590-6cd38d451ec0 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:38.196400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6548f3-87dd-4a43-b590-6cd38d451ec0 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:38.196400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6548f3-87dd-4a43-b590-6cd38d451ec0 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:38.196400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6548f3-87dd-4a43-b590-6cd38d451ec0 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:38.233900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-421be4e4-e273-4210-b8d2-023c857ff126 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:38.234520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-421be4e4-e273-4210-b8d2-023c857ff126 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:38.242565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-421be4e4-e273-4210-b8d2-023c857ff126 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:38.243029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-421be4e4-e273-4210-b8d2-023c857ff126 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:38.244113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-421be4e4-e273-4210-b8d2-023c857ff126 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:38.245288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-421be4e4-e273-4210-b8d2-023c857ff126 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:38.357721 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.network.security_group_api [None req-4f6548f3-87dd-4a43-b590-6cd38d451ec0 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Adding security group 5154c9a1-08fb-4b67-8bda-ff27c7877ce6 to port 26bc35da-4fb9-42e3-9065-1f087403b15f Jan 22 21:14:38.401461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-421be4e4-e273-4210-b8d2-023c857ff126 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:38.409759 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-421be4e4-e273-4210-b8d2-023c857ff126 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1728 microversion: 2.1 time: 0.179981 Jan 22 21:14:38.412563 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2551/4891] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:38 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:38.918073 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4f6548f3-87dd-4a43-b590-6cd38d451ec0 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44/action" status: 202 len: 0 microversion: 2.1 time: 0.743620 Jan 22 21:14:38.918073 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2341/4892] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:38 2022] POST /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:38.929447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-9e434fce-b075-414f-8406-a094f07fe912 req-808f7b00-a4cd-42cb-bba5-3dbfbb1367d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "538b47c7-66d4-4337-a45e-f0b2f966cb44", "tag": "26bc35da-4fb9-42e3-9065-1f087403b15f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:38.936274 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:14:38.936274 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:14:38.939112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-98882ee5-731c-47ce-9b65-245bc90726a5 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed50b05e0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:38.957522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9e434fce-b075-414f-8406-a094f07fe912 req-808f7b00-a4cd-42cb-bba5-3dbfbb1367d4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:38.958563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9e434fce-b075-414f-8406-a094f07fe912 req-808f7b00-a4cd-42cb-bba5-3dbfbb1367d4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:38.975560 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-9e434fce-b075-414f-8406-a094f07fe912 req-808f7b00-a4cd-42cb-bba5-3dbfbb1367d4 service nova] Creating event network-changed:26bc35da-4fb9-42e3-9065-1f087403b15f for instance 538b47c7-66d4-4337-a45e-f0b2f966cb44 on nch2-master-1 Jan 22 21:14:38.982052 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-9e434fce-b075-414f-8406-a094f07fe912 req-808f7b00-a4cd-42cb-bba5-3dbfbb1367d4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062061 Jan 22 21:14:38.983488 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2552/4893] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:39.215484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e85fa196-6232-4ddf-a435-f41a9b7f1ca3 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] Calling method '.version_select at 0x7f1edafdeb80>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:39.232937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG neutronclient.v2_0.client [None req-98882ee5-731c-47ce-9b65-245bc90726a5 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 5154c9a1-08fb-4b67-8bda-ff27c7877ce6 in use.", "detail": ""}} {{(pid=137033) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:39.235329 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-98882ee5-731c-47ce-9b65-245bc90726a5 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Security Group 5154c9a1-08fb-4b67-8bda-ff27c7877ce6 in use. Jan 22 21:14:39.235329 ncdv-master-1 devstack@n-api.service[137033]: Neutron server returns request_ids: ['req-e387201b-da4f-4bdb-b88c-bc3018483c7a'] Jan 22 21:14:39.241419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-98882ee5-731c-47ce-9b65-245bc90726a5 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 400 to user: Security Group 5154c9a1-08fb-4b67-8bda-ff27c7877ce6 in use. Jan 22 21:14:39.241419 ncdv-master-1 devstack@n-api.service[137033]: Neutron server returns request_ids: ['req-e387201b-da4f-4bdb-b88c-bc3018483c7a'] {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:39.245905 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-98882ee5-731c-47ce-9b65-245bc90726a5 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/5154c9a1-08fb-4b67-8bda-ff27c7877ce6" status: 400 len: 185 microversion: 2.1 time: 0.319357 Jan 22 21:14:39.248176 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2342/4894] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:38 2022] DELETE /compute/v2.1/os-security-groups/5154c9a1-08fb-4b67-8bda-ff27c7877ce6 => generated 185 bytes in 323 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:14:39.259746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff11563c-95bd-41b8-8f46-ce73cb687de8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:39.259746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ff11563c-95bd-41b8-8f46-ce73cb687de8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:39.264666 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-e85fa196-6232-4ddf-a435-f41a9b7f1ca3 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] HTTP exception thrown: Image not found. Jan 22 21:14:39.266404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e85fa196-6232-4ddf-a435-f41a9b7f1ca3 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] Returning 404 to user: Image not found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:39.267529 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e85fa196-6232-4ddf-a435-f41a9b7f1ca3 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] 10.222.0.100 "DELETE /compute/v2.1/images/02722e73-7a53-438e-9b7e-228021e39529/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.223902 Jan 22 21:14:39.268645 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2553/4895] 10.222.0.100 () {58 vars in 1297 bytes} [Sat Jan 22 21:14:39 2022] DELETE /compute/v2.1/images/02722e73-7a53-438e-9b7e-228021e39529/metadata/os_distro => generated 62 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 22 21:14:39.268766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff11563c-95bd-41b8-8f46-ce73cb687de8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:39.269224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff11563c-95bd-41b8-8f46-ce73cb687de8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:39.275507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff11563c-95bd-41b8-8f46-ce73cb687de8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:39.275960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c9c5caca-7434-4d3b-95ee-2c60f73747db tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:39.276073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff11563c-95bd-41b8-8f46-ce73cb687de8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:39.276689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c9c5caca-7434-4d3b-95ee-2c60f73747db tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:39.287126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9c5caca-7434-4d3b-95ee-2c60f73747db tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:39.287861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9c5caca-7434-4d3b-95ee-2c60f73747db tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:39.289237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9c5caca-7434-4d3b-95ee-2c60f73747db tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:39.289773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9c5caca-7434-4d3b-95ee-2c60f73747db tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:39.325242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c9c5caca-7434-4d3b-95ee-2c60f73747db tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:14:39.345049 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff11563c-95bd-41b8-8f46-ce73cb687de8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.094704 Jan 22 21:14:39.345778 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2343/4896] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:39 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:39.355412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-34c0e33f-352d-4b08-a514-1db597ec3af1 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] Calling method '.version_select at 0x7f1edaeaa820>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:39.401868 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-34c0e33f-352d-4b08-a514-1db597ec3af1 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] HTTP exception thrown: Image not found. Jan 22 21:14:39.402639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-34c0e33f-352d-4b08-a514-1db597ec3af1 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] Returning 404 to user: Image not found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:39.403764 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-34c0e33f-352d-4b08-a514-1db597ec3af1 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] 10.222.0.100 "GET /compute/v2.1/images/e99897cc-2bea-43f0-8f5c-526310645fb7/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.053544 Jan 22 21:14:39.404598 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2344/4897] 10.222.0.100 () {58 vars in 1297 bytes} [Sat Jan 22 21:14:39 2022] GET /compute/v2.1/images/e99897cc-2bea-43f0-8f5c-526310645fb7/metadata/os_version => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:14:39.415698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f33c1d47-0f1f-4d51-b2f3-e6877e0babc5 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] Calling method '.version_select at 0x7f1ed4f599d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:39.440733 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-f33c1d47-0f1f-4d51-b2f3-e6877e0babc5 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] HTTP exception thrown: Image not found. Jan 22 21:14:39.441344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f33c1d47-0f1f-4d51-b2f3-e6877e0babc5 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] Returning 404 to user: Image not found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:39.442234 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f33c1d47-0f1f-4d51-b2f3-e6877e0babc5 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] 10.222.0.100 "GET /compute/v2.1/images/7c2362b3-36a8-4f91-a4c1-ba4570bcebd7/metadata" status: 404 len: 62 microversion: 2.1 time: 0.032606 Jan 22 21:14:39.448229 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2345/4898] 10.222.0.100 () {58 vars in 1264 bytes} [Sat Jan 22 21:14:39 2022] GET /compute/v2.1/images/7c2362b3-36a8-4f91-a4c1-ba4570bcebd7/metadata => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:14:39.451576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9ea6c199-6215-44a9-8ba9-c1b03ba8a2fb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:39.452627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9ea6c199-6215-44a9-8ba9-c1b03ba8a2fb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:39.462564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9ea6c199-6215-44a9-8ba9-c1b03ba8a2fb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:39.463258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9ea6c199-6215-44a9-8ba9-c1b03ba8a2fb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:39.464432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9ea6c199-6215-44a9-8ba9-c1b03ba8a2fb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:39.464884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9ea6c199-6215-44a9-8ba9-c1b03ba8a2fb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:39.756817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9ea6c199-6215-44a9-8ba9-c1b03ba8a2fb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:39.764853 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9ea6c199-6215-44a9-8ba9-c1b03ba8a2fb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1728 microversion: 2.1 time: 0.319650 Jan 22 21:14:39.765425 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2346/4899] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:39 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1728 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:39.769891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-27ae30e1-fbcd-4e6f-9214-6033faee2968 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] Action: 'update_all', calling method: .version_select at 0x7f1ed6105af0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:39.793171 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c9c5caca-7434-4d3b-95ee-2c60f73747db tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 204 len: 0 microversion: 2.1 time: 0.517879 Jan 22 21:14:39.793171 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2554/4900] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:14:39 2022] DELETE /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:14:39.793392 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-27ae30e1-fbcd-4e6f-9214-6033faee2968 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] HTTP exception thrown: Image not found. Jan 22 21:14:39.793523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-27ae30e1-fbcd-4e6f-9214-6033faee2968 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] Returning 404 to user: Image not found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:39.794320 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-27ae30e1-fbcd-4e6f-9214-6033faee2968 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] 10.222.0.100 "PUT /compute/v2.1/images/25302b71-5fb9-4a99-aa78-f5b2002d76b3/metadata" status: 404 len: 62 microversion: 2.1 time: 0.027966 Jan 22 21:14:39.795052 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2347/4901] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:14:39 2022] PUT /compute/v2.1/images/25302b71-5fb9-4a99-aa78-f5b2002d76b3/metadata => generated 62 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:14:39.800500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b588a10d-f00a-4dbe-9a22-9aa05db780f5 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:39.801202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b588a10d-f00a-4dbe-9a22-9aa05db780f5 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:39.805249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5ada954c-aa15-49d5-bc27-bea043ee6814 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] Action: 'update', calling method: .version_select at 0x7f1ed4ffc160>, body: {"meta": {"os_distro": "alt"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:39.808218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b588a10d-f00a-4dbe-9a22-9aa05db780f5 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:39.808680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b588a10d-f00a-4dbe-9a22-9aa05db780f5 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:39.809489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b588a10d-f00a-4dbe-9a22-9aa05db780f5 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:39.809965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b588a10d-f00a-4dbe-9a22-9aa05db780f5 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:39.833441 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-5ada954c-aa15-49d5-bc27-bea043ee6814 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] HTTP exception thrown: Image not found. Jan 22 21:14:39.844473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5ada954c-aa15-49d5-bc27-bea043ee6814 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] Returning 404 to user: Image not found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:39.844473 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5ada954c-aa15-49d5-bc27-bea043ee6814 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] 10.222.0.100 "PUT /compute/v2.1/images/a44b9a90-be5e-4bce-a360-08322c9691c2/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.034594 Jan 22 21:14:39.844473 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2348/4902] 10.222.0.100 () {60 vars in 1314 bytes} [Sat Jan 22 21:14:39 2022] PUT /compute/v2.1/images/a44b9a90-be5e-4bce-a360-08322c9691c2/metadata/os_distro => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jan 22 21:14:39.845353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d14f5f01-9e1d-4d72-8973-b43c122239d5 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] Action: 'create', calling method: .version_select at 0x7f1ed5d353a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:39.876019 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-d14f5f01-9e1d-4d72-8973-b43c122239d5 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] HTTP exception thrown: Image not found. Jan 22 21:14:39.876624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d14f5f01-9e1d-4d72-8973-b43c122239d5 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] Returning 404 to user: Image not found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:39.877464 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d14f5f01-9e1d-4d72-8973-b43c122239d5 tempest-ImagesMetadataNegativeTestJSON-98665217 tempest-ImagesMetadataNegativeTestJSON-98665217-project] 10.222.0.100 "POST /compute/v2.1/images/6cc8ff1a-9675-4135-ba10-95dda4e7611f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036677 Jan 22 21:14:39.878061 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2349/4903] 10.222.0.100 () {60 vars in 1285 bytes} [Sat Jan 22 21:14:39 2022] POST /compute/v2.1/images/6cc8ff1a-9675-4135-ba10-95dda4e7611f/metadata => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:14:39.985682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b588a10d-f00a-4dbe-9a22-9aa05db780f5 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:39.995915 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b588a10d-f00a-4dbe-9a22-9aa05db780f5 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1650 microversion: 2.1 time: 0.197328 Jan 22 21:14:39.995915 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2555/4904] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:39 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1650 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:40.358121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c3e46df1-8179-4f21-a4e2-017c94b5d06f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:40.359093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c3e46df1-8179-4f21-a4e2-017c94b5d06f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:40.365829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3e46df1-8179-4f21-a4e2-017c94b5d06f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:40.366521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3e46df1-8179-4f21-a4e2-017c94b5d06f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:40.367562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3e46df1-8179-4f21-a4e2-017c94b5d06f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:40.368253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3e46df1-8179-4f21-a4e2-017c94b5d06f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:40.421752 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c3e46df1-8179-4f21-a4e2-017c94b5d06f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.068929 Jan 22 21:14:40.423954 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2350/4905] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:40 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:40.783974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-24663cbf-6a94-4aef-b5a8-19256d118883 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:40.784735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-24663cbf-6a94-4aef-b5a8-19256d118883 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:40.802381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24663cbf-6a94-4aef-b5a8-19256d118883 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:40.802381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24663cbf-6a94-4aef-b5a8-19256d118883 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:40.803200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24663cbf-6a94-4aef-b5a8-19256d118883 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:40.803484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24663cbf-6a94-4aef-b5a8-19256d118883 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:41.012339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2c902b2c-979a-4b0c-b14e-f5bc5339bd67 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:41.013207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2c902b2c-979a-4b0c-b14e-f5bc5339bd67 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:41.022732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c902b2c-979a-4b0c-b14e-f5bc5339bd67 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:41.023200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c902b2c-979a-4b0c-b14e-f5bc5339bd67 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:41.024020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c902b2c-979a-4b0c-b14e-f5bc5339bd67 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:41.024479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c902b2c-979a-4b0c-b14e-f5bc5339bd67 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:41.044467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-24663cbf-6a94-4aef-b5a8-19256d118883 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:41.054197 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-24663cbf-6a94-4aef-b5a8-19256d118883 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1728 microversion: 2.1 time: 0.274787 Jan 22 21:14:41.054907 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2556/4906] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:40 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1728 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:41.241806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2c902b2c-979a-4b0c-b14e-f5bc5339bd67 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:41.258409 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2c902b2c-979a-4b0c-b14e-f5bc5339bd67 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1650 microversion: 2.1 time: 0.250396 Jan 22 21:14:41.267779 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2351/4907] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:41 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1650 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:41.434149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d06d4144-ac9d-4033-a727-a8afd572da05 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:41.435636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d06d4144-ac9d-4033-a727-a8afd572da05 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:41.448058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d06d4144-ac9d-4033-a727-a8afd572da05 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:41.448058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d06d4144-ac9d-4033-a727-a8afd572da05 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:41.448058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d06d4144-ac9d-4033-a727-a8afd572da05 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:41.448058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d06d4144-ac9d-4033-a727-a8afd572da05 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:41.496293 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d06d4144-ac9d-4033-a727-a8afd572da05 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.065703 Jan 22 21:14:41.497135 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2557/4908] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:41 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:41.952409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-e430af76-c3bf-4bfe-9160-e237a1c98ec1 req-9a9f8376-50f6-4060-9f05-ddda82e7ea81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "538b47c7-66d4-4337-a45e-f0b2f966cb44", "name": "network-vif-deleted", "tag": "26bc35da-4fb9-42e3-9065-1f087403b15f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:41.954246 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:14:41.954246 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:14:41.963673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e430af76-c3bf-4bfe-9160-e237a1c98ec1 req-9a9f8376-50f6-4060-9f05-ddda82e7ea81 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:41.964132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e430af76-c3bf-4bfe-9160-e237a1c98ec1 req-9a9f8376-50f6-4060-9f05-ddda82e7ea81 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:41.978662 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-e430af76-c3bf-4bfe-9160-e237a1c98ec1 req-9a9f8376-50f6-4060-9f05-ddda82e7ea81 service nova] Creating event network-vif-deleted:26bc35da-4fb9-42e3-9065-1f087403b15f for instance 538b47c7-66d4-4337-a45e-f0b2f966cb44 on nch2-master-1 Jan 22 21:14:41.982521 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-e430af76-c3bf-4bfe-9160-e237a1c98ec1 req-9a9f8376-50f6-4060-9f05-ddda82e7ea81 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034018 Jan 22 21:14:41.983401 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2352/4909] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:42.072695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d58b2acb-bf42-4c4a-927e-c86a6f942ab0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:42.073494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d58b2acb-bf42-4c4a-927e-c86a6f942ab0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:42.088360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d58b2acb-bf42-4c4a-927e-c86a6f942ab0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:42.089358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d58b2acb-bf42-4c4a-927e-c86a6f942ab0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:42.090916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d58b2acb-bf42-4c4a-927e-c86a6f942ab0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:42.091526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d58b2acb-bf42-4c4a-927e-c86a6f942ab0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:42.247387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d58b2acb-bf42-4c4a-927e-c86a6f942ab0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:42.256230 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d58b2acb-bf42-4c4a-927e-c86a6f942ab0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1728 microversion: 2.1 time: 0.188811 Jan 22 21:14:42.257077 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2558/4910] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:42 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:42.278375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8dd95b1a-1a7f-432e-990c-87d0bd1bedb7 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:42.278375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8dd95b1a-1a7f-432e-990c-87d0bd1bedb7 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:42.287831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd95b1a-1a7f-432e-990c-87d0bd1bedb7 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:42.288396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd95b1a-1a7f-432e-990c-87d0bd1bedb7 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:42.289279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd95b1a-1a7f-432e-990c-87d0bd1bedb7 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:42.290137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd95b1a-1a7f-432e-990c-87d0bd1bedb7 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:42.328509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd95b1a-1a7f-432e-990c-87d0bd1bedb7 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:42.329168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd95b1a-1a7f-432e-990c-87d0bd1bedb7 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:42.329763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-8dd95b1a-1a7f-432e-990c-87d0bd1bedb7 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lazy-loading 'fault' on Instance uuid 538b47c7-66d4-4337-a45e-f0b2f966cb44 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:14:42.386930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8dd95b1a-1a7f-432e-990c-87d0bd1bedb7 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:42.399187 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8dd95b1a-1a7f-432e-990c-87d0bd1bedb7 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 200 len: 1309 microversion: 2.1 time: 0.126685 Jan 22 21:14:42.399187 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2353/4911] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:42 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 1309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:42.509884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dfe288e2-7ced-45ea-982f-5a7e3117f0b7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:42.509884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dfe288e2-7ced-45ea-982f-5a7e3117f0b7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:42.516395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfe288e2-7ced-45ea-982f-5a7e3117f0b7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:42.516947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfe288e2-7ced-45ea-982f-5a7e3117f0b7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:42.517845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfe288e2-7ced-45ea-982f-5a7e3117f0b7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:42.518362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfe288e2-7ced-45ea-982f-5a7e3117f0b7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:42.559439 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dfe288e2-7ced-45ea-982f-5a7e3117f0b7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.054727 Jan 22 21:14:42.560080 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2559/4912] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:42 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:43.273644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6c2fc28f-2529-41e2-b3ed-b1a080decaf4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:43.274264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6c2fc28f-2529-41e2-b3ed-b1a080decaf4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:43.280861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c2fc28f-2529-41e2-b3ed-b1a080decaf4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:43.281323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c2fc28f-2529-41e2-b3ed-b1a080decaf4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:43.282296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c2fc28f-2529-41e2-b3ed-b1a080decaf4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:43.282587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c2fc28f-2529-41e2-b3ed-b1a080decaf4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:43.415792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a9174a35-fb9c-4577-bb60-5a344f5df2e1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:43.416489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a9174a35-fb9c-4577-bb60-5a344f5df2e1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:43.420501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6c2fc28f-2529-41e2-b3ed-b1a080decaf4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:43.423893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9174a35-fb9c-4577-bb60-5a344f5df2e1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:43.424353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9174a35-fb9c-4577-bb60-5a344f5df2e1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:43.425166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9174a35-fb9c-4577-bb60-5a344f5df2e1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:43.425618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9174a35-fb9c-4577-bb60-5a344f5df2e1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:43.430431 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6c2fc28f-2529-41e2-b3ed-b1a080decaf4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1728 microversion: 2.1 time: 0.160975 Jan 22 21:14:43.431026 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2354/4913] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:43 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:43.439587 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-a9174a35-fb9c-4577-bb60-5a344f5df2e1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Instance 538b47c7-66d4-4337-a45e-f0b2f966cb44 could not be found. Jan 22 21:14:43.440181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a9174a35-fb9c-4577-bb60-5a344f5df2e1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 404 to user: Instance 538b47c7-66d4-4337-a45e-f0b2f966cb44 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:43.441007 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a9174a35-fb9c-4577-bb60-5a344f5df2e1 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 404 len: 111 microversion: 2.1 time: 0.029287 Jan 22 21:14:43.441558 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2560/4914] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:43 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:14:43.450164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-913bba2f-ef3d-47d9-b559-6ee8f0d498be tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed551c5e0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:43.572572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-799536a1-21ca-41f4-a785-0b08b5be2fab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:43.573733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-799536a1-21ca-41f4-a785-0b08b5be2fab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:43.579944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-799536a1-21ca-41f4-a785-0b08b5be2fab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:43.580477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-799536a1-21ca-41f4-a785-0b08b5be2fab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:43.581675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-799536a1-21ca-41f4-a785-0b08b5be2fab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:43.582074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-799536a1-21ca-41f4-a785-0b08b5be2fab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:43.637669 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-799536a1-21ca-41f4-a785-0b08b5be2fab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.070048 Jan 22 21:14:43.641699 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2561/4915] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:43 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:43.727296 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-913bba2f-ef3d-47d9-b559-6ee8f0d498be tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/0d404012-2424-4df7-9687-78e28f7e126d" status: 202 len: 0 microversion: 2.1 time: 0.280590 Jan 22 21:14:43.728084 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2355/4916] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:43 2022] DELETE /compute/v2.1/os-security-groups/0d404012-2424-4df7-9687-78e28f7e126d => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:43.737175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a06012be-d74c-4d98-81b9-7fa17af65d88 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed5237670>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:44.012311 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a06012be-d74c-4d98-81b9-7fa17af65d88 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/5154c9a1-08fb-4b67-8bda-ff27c7877ce6" status: 202 len: 0 microversion: 2.1 time: 0.279627 Jan 22 21:14:44.012938 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2562/4917] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:43 2022] DELETE /compute/v2.1/os-security-groups/5154c9a1-08fb-4b67-8bda-ff27c7877ce6 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:44.023942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-401bd77c-b6e2-4816-b1bf-cc85619d8461 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'create', calling method: .version_select at 0x7f1ed5df8940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1317427403", "description": "tempest-description-1669293097"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:44.171509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e0a79f58-f7b8-4629-8ca6-e63f5e865bee tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5ec6790>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:44.218674 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e0a79f58-f7b8-4629-8ca6-e63f5e865bee tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/f4418b4f-51ff-4020-a782-f0c1502bea64" status: 200 len: 665 microversion: 2.1 time: 0.051320 Jan 22 21:14:44.219578 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2563/4918] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:14:44 2022] GET /compute/v2.1/images/f4418b4f-51ff-4020-a782-f0c1502bea64 => generated 665 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:14:44.232767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5492a917-6004-4fca-9d7e-9571c9eb879f tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5155280>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:44.276424 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5492a917-6004-4fca-9d7e-9571c9eb879f tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/f4418b4f-51ff-4020-a782-f0c1502bea64" status: 200 len: 665 microversion: 2.1 time: 0.047765 Jan 22 21:14:44.277037 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2564/4919] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:14:44 2022] GET /compute/v2.1/images/f4418b4f-51ff-4020-a782-f0c1502bea64 => generated 665 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:44.448033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-09d771f2-3ba3-4d93-9e88-8c6ff6f7f877 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:44.448770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-09d771f2-3ba3-4d93-9e88-8c6ff6f7f877 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:44.455182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09d771f2-3ba3-4d93-9e88-8c6ff6f7f877 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:44.455669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09d771f2-3ba3-4d93-9e88-8c6ff6f7f877 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:44.456442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09d771f2-3ba3-4d93-9e88-8c6ff6f7f877 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:44.456890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09d771f2-3ba3-4d93-9e88-8c6ff6f7f877 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:44.546422 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-401bd77c-b6e2-4816-b1bf-cc85619d8461 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.526201 Jan 22 21:14:44.547948 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2356/4920] 10.222.0.100 () {60 vars in 1184 bytes} [Sat Jan 22 21:14:44 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:44.559360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e99dc208-1d48-4e17-a8a6-3ffca2c5294f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Action: 'update', calling method: .version_select at 0x7f1ed5d67670>, body: {"security_group": {"name": "tempest-sg-hth-1156670726", "description": "tempest-description-hth-792725053"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:44.600112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-09d771f2-3ba3-4d93-9e88-8c6ff6f7f877 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:44.609029 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-09d771f2-3ba3-4d93-9e88-8c6ff6f7f877 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1728 microversion: 2.1 time: 0.166087 Jan 22 21:14:44.610118 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2565/4921] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:44 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:44.654696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-83dc29cc-2bfb-464a-86ca-63f1276668d6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:44.656366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-83dc29cc-2bfb-464a-86ca-63f1276668d6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:44.664845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83dc29cc-2bfb-464a-86ca-63f1276668d6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:44.665410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83dc29cc-2bfb-464a-86ca-63f1276668d6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:44.666312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83dc29cc-2bfb-464a-86ca-63f1276668d6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:44.666850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83dc29cc-2bfb-464a-86ca-63f1276668d6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:44.717517 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-83dc29cc-2bfb-464a-86ca-63f1276668d6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.069072 Jan 22 21:14:44.718366 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2566/4922] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:44 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:44.800436 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e99dc208-1d48-4e17-a8a6-3ffca2c5294f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "PUT /compute/v2.1/os-security-groups/88cd3b8b-1d88-498a-b7b3-af8bc1659b4e" status: 200 len: 217 microversion: 2.1 time: 0.244602 Jan 22 21:14:44.801062 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2357/4923] 10.222.0.100 () {60 vars in 1294 bytes} [Sat Jan 22 21:14:44 2022] PUT /compute/v2.1/os-security-groups/88cd3b8b-1d88-498a-b7b3-af8bc1659b4e => generated 217 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:14:44.812312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5b6bbc22-14e1-439e-a08d-a2c9b87421af tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed514c8b0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:44.862273 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5b6bbc22-14e1-439e-a08d-a2c9b87421af tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/os-security-groups/88cd3b8b-1d88-498a-b7b3-af8bc1659b4e" status: 200 len: 217 microversion: 2.1 time: 0.053902 Jan 22 21:14:44.862923 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2567/4924] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 21:14:44 2022] GET /compute/v2.1/os-security-groups/88cd3b8b-1d88-498a-b7b3-af8bc1659b4e => generated 217 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:44.874533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6a931da9-21d7-4bda-9521-8d148857de4d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed4f4f8b0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:45.171758 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6a931da9-21d7-4bda-9521-8d148857de4d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/88cd3b8b-1d88-498a-b7b3-af8bc1659b4e" status: 202 len: 0 microversion: 2.1 time: 0.300776 Jan 22 21:14:45.172333 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2358/4925] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:44 2022] DELETE /compute/v2.1/os-security-groups/88cd3b8b-1d88-498a-b7b3-af8bc1659b4e => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:45.181659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dbf2c5e5-977b-4837-95bf-6db884ee14f3 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:45.182301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dbf2c5e5-977b-4837-95bf-6db884ee14f3 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:45.189804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbf2c5e5-977b-4837-95bf-6db884ee14f3 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:45.190273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbf2c5e5-977b-4837-95bf-6db884ee14f3 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:45.193170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbf2c5e5-977b-4837-95bf-6db884ee14f3 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:45.193170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbf2c5e5-977b-4837-95bf-6db884ee14f3 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:45.206570 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-dbf2c5e5-977b-4837-95bf-6db884ee14f3 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Instance 538b47c7-66d4-4337-a45e-f0b2f966cb44 could not be found. Jan 22 21:14:45.207189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dbf2c5e5-977b-4837-95bf-6db884ee14f3 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 404 to user: Instance 538b47c7-66d4-4337-a45e-f0b2f966cb44 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:45.208234 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dbf2c5e5-977b-4837-95bf-6db884ee14f3 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 404 len: 111 microversion: 2.1 time: 0.031612 Jan 22 21:14:45.209247 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2568/4926] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:14:45 2022] DELETE /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:14:45.216672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-92739220-1acf-4053-98e0-cbe324dbae84 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:45.217276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-92739220-1acf-4053-98e0-cbe324dbae84 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: 538b47c7-66d4-4337-a45e-f0b2f966cb44] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:45.224402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92739220-1acf-4053-98e0-cbe324dbae84 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:45.224936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92739220-1acf-4053-98e0-cbe324dbae84 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:45.225777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92739220-1acf-4053-98e0-cbe324dbae84 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:45.226232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92739220-1acf-4053-98e0-cbe324dbae84 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:45.242362 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-92739220-1acf-4053-98e0-cbe324dbae84 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Instance 538b47c7-66d4-4337-a45e-f0b2f966cb44 could not be found. Jan 22 21:14:45.242976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-92739220-1acf-4053-98e0-cbe324dbae84 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 404 to user: Instance 538b47c7-66d4-4337-a45e-f0b2f966cb44 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:45.243838 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-92739220-1acf-4053-98e0-cbe324dbae84 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44" status: 404 len: 111 microversion: 2.1 time: 0.030931 Jan 22 21:14:45.244396 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2359/4927] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:45 2022] GET /compute/v2.1/servers/538b47c7-66d4-4337-a45e-f0b2f966cb44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:14:45.252570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-64ae805d-1c2a-44a6-9c55-deff60ed8a43 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed82b9f70>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:45.274912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG neutronclient.v2_0.client [None req-64ae805d-1c2a-44a6-9c55-deff60ed8a43 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5154c9a1-08fb-4b67-8bda-ff27c7877ce6 does not exist", "detail": ""}} {{(pid=137032) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:45.275717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.security_group_api [None req-64ae805d-1c2a-44a6-9c55-deff60ed8a43 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Neutron security group 5154c9a1-08fb-4b67-8bda-ff27c7877ce6 not found {{(pid=137032) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 22 21:14:45.276368 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-64ae805d-1c2a-44a6-9c55-deff60ed8a43 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Security group 5154c9a1-08fb-4b67-8bda-ff27c7877ce6 does not exist Jan 22 21:14:45.276368 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-cd832b13-533f-49dc-9f6c-237269a05941'] Jan 22 21:14:45.277064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-64ae805d-1c2a-44a6-9c55-deff60ed8a43 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 404 to user: Security group 5154c9a1-08fb-4b67-8bda-ff27c7877ce6 does not exist Jan 22 21:14:45.277064 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-cd832b13-533f-49dc-9f6c-237269a05941'] {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:45.278040 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-64ae805d-1c2a-44a6-9c55-deff60ed8a43 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/5154c9a1-08fb-4b67-8bda-ff27c7877ce6" status: 404 len: 194 microversion: 2.1 time: 0.029321 Jan 22 21:14:45.278767 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2569/4928] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:45 2022] DELETE /compute/v2.1/os-security-groups/5154c9a1-08fb-4b67-8bda-ff27c7877ce6 => generated 194 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:14:45.287610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-21613d61-d30d-4f2e-bfde-0c6201c51a92 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed5438550>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:45.314003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG neutronclient.v2_0.client [None req-21613d61-d30d-4f2e-bfde-0c6201c51a92 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0d404012-2424-4df7-9687-78e28f7e126d does not exist", "detail": ""}} {{(pid=137033) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:45.314643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.security_group_api [None req-21613d61-d30d-4f2e-bfde-0c6201c51a92 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Neutron security group 0d404012-2424-4df7-9687-78e28f7e126d not found {{(pid=137033) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 22 21:14:45.315293 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-21613d61-d30d-4f2e-bfde-0c6201c51a92 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Security group 0d404012-2424-4df7-9687-78e28f7e126d does not exist Jan 22 21:14:45.315293 ncdv-master-1 devstack@n-api.service[137033]: Neutron server returns request_ids: ['req-16bc1162-163b-4e44-a248-39c1e5ac8b80'] Jan 22 21:14:45.315892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-21613d61-d30d-4f2e-bfde-0c6201c51a92 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 404 to user: Security group 0d404012-2424-4df7-9687-78e28f7e126d does not exist Jan 22 21:14:45.315892 ncdv-master-1 devstack@n-api.service[137033]: Neutron server returns request_ids: ['req-16bc1162-163b-4e44-a248-39c1e5ac8b80'] {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:45.316755 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-21613d61-d30d-4f2e-bfde-0c6201c51a92 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/0d404012-2424-4df7-9687-78e28f7e126d" status: 404 len: 194 microversion: 2.1 time: 0.033887 Jan 22 21:14:45.317333 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2360/4929] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:45 2022] DELETE /compute/v2.1/os-security-groups/0d404012-2424-4df7-9687-78e28f7e126d => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:14:45.325785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f498830f-e3c7-4310-8ef0-4e1455faf6dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed5e13940>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:45.349771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG neutronclient.v2_0.client [None req-f498830f-e3c7-4310-8ef0-4e1455faf6dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c1afcb21-726b-41e8-8719-835558e3cece does not exist", "detail": ""}} {{(pid=137032) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:45.350371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.security_group_api [None req-f498830f-e3c7-4310-8ef0-4e1455faf6dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Neutron security group c1afcb21-726b-41e8-8719-835558e3cece not found {{(pid=137032) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 22 21:14:45.350898 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-f498830f-e3c7-4310-8ef0-4e1455faf6dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Security group c1afcb21-726b-41e8-8719-835558e3cece does not exist Jan 22 21:14:45.350898 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-2f4f8b1f-99c0-43e8-8a4c-ea838f0c809b'] Jan 22 21:14:45.351492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f498830f-e3c7-4310-8ef0-4e1455faf6dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 404 to user: Security group c1afcb21-726b-41e8-8719-835558e3cece does not exist Jan 22 21:14:45.351492 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-2f4f8b1f-99c0-43e8-8a4c-ea838f0c809b'] {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:45.352359 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f498830f-e3c7-4310-8ef0-4e1455faf6dd tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/c1afcb21-726b-41e8-8719-835558e3cece" status: 404 len: 194 microversion: 2.1 time: 0.030275 Jan 22 21:14:45.352913 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2570/4930] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:45 2022] DELETE /compute/v2.1/os-security-groups/c1afcb21-726b-41e8-8719-835558e3cece => generated 194 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:14:45.360654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4020b9b1-2103-49ce-9c89-6df467516e30 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1edaeba4c0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:45.387152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG neutronclient.v2_0.client [None req-4020b9b1-2103-49ce-9c89-6df467516e30 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 41ff5099-cb17-4b97-82b8-41a8b5106ffd does not exist", "detail": ""}} {{(pid=137033) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:45.387755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.security_group_api [None req-4020b9b1-2103-49ce-9c89-6df467516e30 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Neutron security group 41ff5099-cb17-4b97-82b8-41a8b5106ffd not found {{(pid=137033) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 22 21:14:45.388275 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-4020b9b1-2103-49ce-9c89-6df467516e30 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Security group 41ff5099-cb17-4b97-82b8-41a8b5106ffd does not exist Jan 22 21:14:45.388275 ncdv-master-1 devstack@n-api.service[137033]: Neutron server returns request_ids: ['req-dc505d5c-5444-4e07-b1d3-7a20994df99f'] Jan 22 21:14:45.388866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4020b9b1-2103-49ce-9c89-6df467516e30 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 404 to user: Security group 41ff5099-cb17-4b97-82b8-41a8b5106ffd does not exist Jan 22 21:14:45.388866 ncdv-master-1 devstack@n-api.service[137033]: Neutron server returns request_ids: ['req-dc505d5c-5444-4e07-b1d3-7a20994df99f'] {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:45.389810 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4020b9b1-2103-49ce-9c89-6df467516e30 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/41ff5099-cb17-4b97-82b8-41a8b5106ffd" status: 404 len: 194 microversion: 2.1 time: 0.032801 Jan 22 21:14:45.390518 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2361/4931] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:45 2022] DELETE /compute/v2.1/os-security-groups/41ff5099-cb17-4b97-82b8-41a8b5106ffd => generated 194 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:14:45.399163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-79d34e55-3a54-4ead-b5d0-5f014fc60090 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1edae24a60>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:45.422438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG neutronclient.v2_0.client [None req-79d34e55-3a54-4ead-b5d0-5f014fc60090 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 70cb2b98-42de-46ef-9535-52bba4273fef does not exist", "detail": ""}} {{(pid=137032) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:45.422571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.security_group_api [None req-79d34e55-3a54-4ead-b5d0-5f014fc60090 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Neutron security group 70cb2b98-42de-46ef-9535-52bba4273fef not found {{(pid=137032) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 22 21:14:45.423068 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-79d34e55-3a54-4ead-b5d0-5f014fc60090 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Security group 70cb2b98-42de-46ef-9535-52bba4273fef does not exist Jan 22 21:14:45.423068 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-bbb2d85d-9fa1-4879-9574-65977f31039e'] Jan 22 21:14:45.423667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-79d34e55-3a54-4ead-b5d0-5f014fc60090 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 404 to user: Security group 70cb2b98-42de-46ef-9535-52bba4273fef does not exist Jan 22 21:14:45.423667 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-bbb2d85d-9fa1-4879-9574-65977f31039e'] {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:45.424591 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-79d34e55-3a54-4ead-b5d0-5f014fc60090 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/70cb2b98-42de-46ef-9535-52bba4273fef" status: 404 len: 194 microversion: 2.1 time: 0.030080 Jan 22 21:14:45.425105 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2571/4932] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:45 2022] DELETE /compute/v2.1/os-security-groups/70cb2b98-42de-46ef-9535-52bba4273fef => generated 194 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:14:45.433150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bd59d226-f35e-4a65-83e5-411be9f935f9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed5438550>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:45.460160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG neutronclient.v2_0.client [None req-bd59d226-f35e-4a65-83e5-411be9f935f9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 815d4c2a-0838-480a-949a-f05f780a39e1 does not exist", "detail": ""}} {{(pid=137033) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:45.461861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.security_group_api [None req-bd59d226-f35e-4a65-83e5-411be9f935f9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Neutron security group 815d4c2a-0838-480a-949a-f05f780a39e1 not found {{(pid=137033) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 22 21:14:45.462502 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-bd59d226-f35e-4a65-83e5-411be9f935f9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Security group 815d4c2a-0838-480a-949a-f05f780a39e1 does not exist Jan 22 21:14:45.462502 ncdv-master-1 devstack@n-api.service[137033]: Neutron server returns request_ids: ['req-e4287321-6c90-4067-9930-37d158eef06f'] Jan 22 21:14:45.463340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bd59d226-f35e-4a65-83e5-411be9f935f9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 404 to user: Security group 815d4c2a-0838-480a-949a-f05f780a39e1 does not exist Jan 22 21:14:45.463340 ncdv-master-1 devstack@n-api.service[137033]: Neutron server returns request_ids: ['req-e4287321-6c90-4067-9930-37d158eef06f'] {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:45.464293 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bd59d226-f35e-4a65-83e5-411be9f935f9 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/815d4c2a-0838-480a-949a-f05f780a39e1" status: 404 len: 194 microversion: 2.1 time: 0.035214 Jan 22 21:14:45.465085 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2362/4933] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:45 2022] DELETE /compute/v2.1/os-security-groups/815d4c2a-0838-480a-949a-f05f780a39e1 => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:14:45.475166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-97229ada-b4c3-4d20-ad78-8f2b6540b532 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:45.475690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-97229ada-b4c3-4d20-ad78-8f2b6540b532 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:45.482015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-97229ada-b4c3-4d20-ad78-8f2b6540b532 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:45.482482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-97229ada-b4c3-4d20-ad78-8f2b6540b532 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:45.483291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-97229ada-b4c3-4d20-ad78-8f2b6540b532 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:45.483745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-97229ada-b4c3-4d20-ad78-8f2b6540b532 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:45.514747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-97229ada-b4c3-4d20-ad78-8f2b6540b532 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:14:45.628461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f7023610-daff-4828-afdb-d546e3cb0c1d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:45.630721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f7023610-daff-4828-afdb-d546e3cb0c1d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:45.640026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7023610-daff-4828-afdb-d546e3cb0c1d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:45.640668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7023610-daff-4828-afdb-d546e3cb0c1d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:45.641930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7023610-daff-4828-afdb-d546e3cb0c1d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:45.642642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7023610-daff-4828-afdb-d546e3cb0c1d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:45.809750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f7023610-daff-4828-afdb-d546e3cb0c1d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:45.820929 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f7023610-daff-4828-afdb-d546e3cb0c1d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1728 microversion: 2.1 time: 0.196025 Jan 22 21:14:45.822523 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2363/4934] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:45 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:45.831760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0b88ad2d-d31b-45c5-b639-4eb30a7eb6bc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:45.833037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0b88ad2d-d31b-45c5-b639-4eb30a7eb6bc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:45.839621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b88ad2d-d31b-45c5-b639-4eb30a7eb6bc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:45.840117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b88ad2d-d31b-45c5-b639-4eb30a7eb6bc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:45.841108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b88ad2d-d31b-45c5-b639-4eb30a7eb6bc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:45.841989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b88ad2d-d31b-45c5-b639-4eb30a7eb6bc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:45.886056 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0b88ad2d-d31b-45c5-b639-4eb30a7eb6bc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.057638 Jan 22 21:14:45.886719 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2364/4935] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:45 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:45.918830 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-97229ada-b4c3-4d20-ad78-8f2b6540b532 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 204 len: 0 microversion: 2.1 time: 0.449487 Jan 22 21:14:45.919443 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2572/4936] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:14:45 2022] DELETE /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:14:45.928515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2464b6c3-6270-44ad-bb3f-ad76f4ec7a2d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:45.929336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2464b6c3-6270-44ad-bb3f-ad76f4ec7a2d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:45.936527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2464b6c3-6270-44ad-bb3f-ad76f4ec7a2d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:45.936998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2464b6c3-6270-44ad-bb3f-ad76f4ec7a2d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:45.937880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2464b6c3-6270-44ad-bb3f-ad76f4ec7a2d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:45.938278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2464b6c3-6270-44ad-bb3f-ad76f4ec7a2d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:46.103698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2464b6c3-6270-44ad-bb3f-ad76f4ec7a2d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:46.113180 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2464b6c3-6270-44ad-bb3f-ad76f4ec7a2d tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 200 len: 1652 microversion: 2.1 time: 0.189290 Jan 22 21:14:46.113835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-16592928-7564-452c-b13a-e37afe41f86f tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed61604c0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:46.113988 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2365/4937] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:45 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 1652 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:46.163560 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-16592928-7564-452c-b13a-e37afe41f86f tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/b46f809e-b51d-4718-85c5-3ef046928a9b" status: 200 len: 665 microversion: 2.1 time: 0.053863 Jan 22 21:14:46.164150 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2573/4938] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:14:46 2022] GET /compute/v2.1/images/b46f809e-b51d-4718-85c5-3ef046928a9b => generated 665 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:14:46.178214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-01d117ea-08aa-458c-90b2-645d547765ef tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5d35e50>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:46.221037 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-01d117ea-08aa-458c-90b2-645d547765ef tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/b46f809e-b51d-4718-85c5-3ef046928a9b" status: 200 len: 665 microversion: 2.1 time: 0.048780 Jan 22 21:14:46.221658 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2366/4939] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:14:46 2022] GET /compute/v2.1/images/b46f809e-b51d-4718-85c5-3ef046928a9b => generated 665 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:14:46.841054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad6bb896-bb09-4ab1-b8f6-3fcab78ee871 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:46.841887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad6bb896-bb09-4ab1-b8f6-3fcab78ee871 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:46.851300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad6bb896-bb09-4ab1-b8f6-3fcab78ee871 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:46.851765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad6bb896-bb09-4ab1-b8f6-3fcab78ee871 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:46.852595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad6bb896-bb09-4ab1-b8f6-3fcab78ee871 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:46.853029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad6bb896-bb09-4ab1-b8f6-3fcab78ee871 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:46.899143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-93a895d5-9598-4198-b36c-c441896f98c0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:46.900881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-93a895d5-9598-4198-b36c-c441896f98c0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:46.907043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93a895d5-9598-4198-b36c-c441896f98c0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:46.907496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93a895d5-9598-4198-b36c-c441896f98c0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:46.908295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93a895d5-9598-4198-b36c-c441896f98c0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:46.908738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93a895d5-9598-4198-b36c-c441896f98c0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:46.948910 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-93a895d5-9598-4198-b36c-c441896f98c0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.054406 Jan 22 21:14:46.950030 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2367/4940] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:46 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:47.042759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ad6bb896-bb09-4ab1-b8f6-3fcab78ee871 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:47.049799 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad6bb896-bb09-4ab1-b8f6-3fcab78ee871 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1728 microversion: 2.1 time: 0.213524 Jan 22 21:14:47.050362 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2574/4941] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:46 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:47.132095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3a383814-be55-45f7-ac1e-4a1cc8fd39e8 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:47.132776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3a383814-be55-45f7-ac1e-4a1cc8fd39e8 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:47.143722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a383814-be55-45f7-ac1e-4a1cc8fd39e8 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:47.143722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a383814-be55-45f7-ac1e-4a1cc8fd39e8 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:47.143722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a383814-be55-45f7-ac1e-4a1cc8fd39e8 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:47.143722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a383814-be55-45f7-ac1e-4a1cc8fd39e8 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:47.326187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3a383814-be55-45f7-ac1e-4a1cc8fd39e8 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:47.333918 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3a383814-be55-45f7-ac1e-4a1cc8fd39e8 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 200 len: 1652 microversion: 2.1 time: 0.205917 Jan 22 21:14:47.334540 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2368/4942] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:47 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 1652 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:47.962326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-863ab667-ba91-4d2c-b938-93ea918030a5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:47.963489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-863ab667-ba91-4d2c-b938-93ea918030a5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:47.970801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-863ab667-ba91-4d2c-b938-93ea918030a5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:47.971621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-863ab667-ba91-4d2c-b938-93ea918030a5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:47.972443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-863ab667-ba91-4d2c-b938-93ea918030a5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:47.972893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-863ab667-ba91-4d2c-b938-93ea918030a5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:48.023110 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-863ab667-ba91-4d2c-b938-93ea918030a5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.064334 Jan 22 21:14:48.024650 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2575/4943] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:47 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:48.069223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b0847afe-2215-4dcc-8c91-9fb0fe19d7f6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:48.069994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b0847afe-2215-4dcc-8c91-9fb0fe19d7f6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:48.080511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0847afe-2215-4dcc-8c91-9fb0fe19d7f6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:48.080990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0847afe-2215-4dcc-8c91-9fb0fe19d7f6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:48.081857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0847afe-2215-4dcc-8c91-9fb0fe19d7f6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:48.082493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0847afe-2215-4dcc-8c91-9fb0fe19d7f6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:48.093494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-0d68ffde-155f-4975-b3d2-cdc4465e4996 req-f76953ec-8e99-4f38-85b8-73f3e8e8e87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d1e763-6bd8-4953-b498-12aca41a8786", "name": "network-vif-deleted", "tag": "92eb88b1-b83c-46dd-8fa7-9f78e33202e2"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:48.099464 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:14:48.099464 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:14:48.104448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0d68ffde-155f-4975-b3d2-cdc4465e4996 req-f76953ec-8e99-4f38-85b8-73f3e8e8e87c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:48.105044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0d68ffde-155f-4975-b3d2-cdc4465e4996 req-f76953ec-8e99-4f38-85b8-73f3e8e8e87c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:48.117826 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-0d68ffde-155f-4975-b3d2-cdc4465e4996 req-f76953ec-8e99-4f38-85b8-73f3e8e8e87c service nova] Creating event network-vif-deleted:92eb88b1-b83c-46dd-8fa7-9f78e33202e2 for instance f7d1e763-6bd8-4953-b498-12aca41a8786 on nch1-master-1 Jan 22 21:14:48.123294 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-0d68ffde-155f-4975-b3d2-cdc4465e4996 req-f76953ec-8e99-4f38-85b8-73f3e8e8e87c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035484 Jan 22 21:14:48.127994 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2576/4944] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:14:48.219154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-14405e6a-d7fc-42f4-8b5e-bf665afed92c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed82b9f70>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:48.278111 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-14405e6a-d7fc-42f4-8b5e-bf665afed92c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/d8bc5ab6-41f5-4528-b093-639e1eac08d6" status: 200 len: 664 microversion: 2.1 time: 0.063506 Jan 22 21:14:48.278924 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2577/4945] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:14:48 2022] GET /compute/v2.1/images/d8bc5ab6-41f5-4528-b093-639e1eac08d6 => generated 664 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:14:48.294698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-86173d3b-0923-4fb3-b6c9-eaa87a1c5a2b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed6167b80>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:48.303612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b0847afe-2215-4dcc-8c91-9fb0fe19d7f6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:48.319081 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b0847afe-2215-4dcc-8c91-9fb0fe19d7f6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1705 microversion: 2.1 time: 0.255364 Jan 22 21:14:48.325224 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2369/4946] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:48 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1705 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:48.352331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e7dfc422-ef3a-4c3c-b53a-d82439431b3b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:48.353428 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-86173d3b-0923-4fb3-b6c9-eaa87a1c5a2b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/d8bc5ab6-41f5-4528-b093-639e1eac08d6" status: 200 len: 664 microversion: 2.1 time: 0.066746 Jan 22 21:14:48.355834 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2578/4947] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:14:48 2022] GET /compute/v2.1/images/d8bc5ab6-41f5-4528-b093-639e1eac08d6 => generated 664 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:48.359781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7dfc422-ef3a-4c3c-b53a-d82439431b3b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:48.360300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7dfc422-ef3a-4c3c-b53a-d82439431b3b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:48.366989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-742c8a43-d82e-4396-a5c6-66d88cbc246f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:48.367738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-742c8a43-d82e-4396-a5c6-66d88cbc246f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:48.385481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-742c8a43-d82e-4396-a5c6-66d88cbc246f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:48.387728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-742c8a43-d82e-4396-a5c6-66d88cbc246f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:48.388568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-742c8a43-d82e-4396-a5c6-66d88cbc246f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:48.389031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-742c8a43-d82e-4396-a5c6-66d88cbc246f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:48.409550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e7dfc422-ef3a-4c3c-b53a-d82439431b3b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Going to try to start instance {{(pid=137033) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 22 21:14:48.529890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-742c8a43-d82e-4396-a5c6-66d88cbc246f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2bb2fab98714702bab120f7e5a222d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9f8a87f60b4668b8a968fa1e63282d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:48.534404 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-742c8a43-d82e-4396-a5c6-66d88cbc246f tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 200 len: 1305 microversion: 2.1 time: 0.177384 Jan 22 21:14:48.535230 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2579/4948] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:48 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 1305 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:48.540777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1956499373", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:48.590193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:14:48.748382 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e7dfc422-ef3a-4c3c-b53a-d82439431b3b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 202 len: 0 microversion: 2.1 time: 0.400461 Jan 22 21:14:48.749052 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2370/4949] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:14:48 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:48.759476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eb49f1ab-9118-4a3f-a8c8-8f95a312236f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:48.761106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eb49f1ab-9118-4a3f-a8c8-8f95a312236f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:48.768988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb49f1ab-9118-4a3f-a8c8-8f95a312236f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:48.769704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb49f1ab-9118-4a3f-a8c8-8f95a312236f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:48.771604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb49f1ab-9118-4a3f-a8c8-8f95a312236f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:48.772498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb49f1ab-9118-4a3f-a8c8-8f95a312236f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:48.840884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:14:48.841576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:14:48.842666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:14:48.843284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:14:48.843896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:14:48.854540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:48.855156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:48.855997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:48.856447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:48.877066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Getting quotas for project 4661f9e656a74bbcba6320d8e9576de7. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:14:48.886860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Getting quotas for user 42fe72df26be4408873f97db23731ca3 and project 4661f9e656a74bbcba6320d8e9576de7. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:14:48.899232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:14:48.903054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 0b558471-88c9-43fa-a970-799679fcbbf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:14:49.068852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eb49f1ab-9118-4a3f-a8c8-8f95a312236f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:49.078264 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eb49f1ab-9118-4a3f-a8c8-8f95a312236f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1714 microversion: 2.1 time: 0.324703 Jan 22 21:14:49.078946 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2371/4950] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:48 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1714 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:49.089588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c37b1adc-07b5-455f-b32f-760d214022f6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:49.089588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c37b1adc-07b5-455f-b32f-760d214022f6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:49.091812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c37b1adc-07b5-455f-b32f-760d214022f6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:49.092267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c37b1adc-07b5-455f-b32f-760d214022f6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:49.093254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c37b1adc-07b5-455f-b32f-760d214022f6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:49.093696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c37b1adc-07b5-455f-b32f-760d214022f6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:49.135985 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c37b1adc-07b5-455f-b32f-760d214022f6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.055767 Jan 22 21:14:49.138886 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2372/4951] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:49 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:49.152913 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c41e14c4-4786-4370-97cb-e13833df0fcd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.615793 Jan 22 21:14:49.153625 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2580/4952] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:14:48 2022] POST /compute/v2.1/servers => generated 382 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:14:49.287796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1333387900", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:49.369843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:14:49.554035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e089b003-d369-4f30-9ff6-e94b84894dbb tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:49.554756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e089b003-d369-4f30-9ff6-e94b84894dbb tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] [instance: f7d1e763-6bd8-4953-b498-12aca41a8786] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:49.564006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e089b003-d369-4f30-9ff6-e94b84894dbb tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:49.564006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e089b003-d369-4f30-9ff6-e94b84894dbb tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:49.564006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e089b003-d369-4f30-9ff6-e94b84894dbb tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:49.564320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e089b003-d369-4f30-9ff6-e94b84894dbb tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:49.580175 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-e089b003-d369-4f30-9ff6-e94b84894dbb tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] HTTP exception thrown: Instance f7d1e763-6bd8-4953-b498-12aca41a8786 could not be found. Jan 22 21:14:49.580765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e089b003-d369-4f30-9ff6-e94b84894dbb tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Returning 404 to user: Instance f7d1e763-6bd8-4953-b498-12aca41a8786 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:49.581768 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e089b003-d369-4f30-9ff6-e94b84894dbb tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786" status: 404 len: 111 microversion: 2.1 time: 0.032908 Jan 22 21:14:49.582337 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2581/4953] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:49 2022] GET /compute/v2.1/servers/f7d1e763-6bd8-4953-b498-12aca41a8786 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:14:49.590652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b77bfc2b-eb80-4649-9470-ffb299165600 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1edae1a820>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:49.904803 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b77bfc2b-eb80-4649-9470-ffb299165600 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/24848c83-c746-43fc-a158-f06585f3aa69" status: 202 len: 0 microversion: 2.1 time: 0.317640 Jan 22 21:14:49.905840 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2582/4954] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:49 2022] DELETE /compute/v2.1/os-security-groups/24848c83-c746-43fc-a158-f06585f3aa69 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:49.914729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-099082bb-0364-4006-bdda-28f008d15044 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] Calling method '.version_select at 0x7f1ed5133f70>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:50.039615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:14:50.040300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:14:50.041153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:14:50.041908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:14:50.042684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:14:50.056640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:50.057102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:50.062579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:50.063054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:50.093333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Getting quotas for project 4661f9e656a74bbcba6320d8e9576de7. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:14:50.105156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Getting quotas for user 42fe72df26be4408873f97db23731ca3 and project 4661f9e656a74bbcba6320d8e9576de7. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:14:50.126844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:14:50.129473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:14:50.317381 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7d756004-7005-42d3-9a16-697fee10cfbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.036077 Jan 22 21:14:50.318469 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2373/4955] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:14:49 2022] POST /compute/v2.1/servers => generated 382 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:14:50.323614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-307e221c-558c-4fc4-b46c-d1800573876a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:50.324446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-307e221c-558c-4fc4-b46c-d1800573876a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:50.331086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-307e221c-558c-4fc4-b46c-d1800573876a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:50.331750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-307e221c-558c-4fc4-b46c-d1800573876a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:50.332553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-307e221c-558c-4fc4-b46c-d1800573876a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:50.333074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-307e221c-558c-4fc4-b46c-d1800573876a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:50.409263 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-099082bb-0364-4006-bdda-28f008d15044 tempest-SecurityGroupsTestJSON-671737531 tempest-SecurityGroupsTestJSON-671737531-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/3cc0e06e-6d10-4702-b32f-e1fa246eeb98" status: 202 len: 0 microversion: 2.1 time: 0.499388 Jan 22 21:14:50.413406 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2583/4956] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:49 2022] DELETE /compute/v2.1/os-security-groups/3cc0e06e-6d10-4702-b32f-e1fa246eeb98 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:50.418002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d80a659f-d22e-4647-a658-bee484d3f7fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:50.419236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d80a659f-d22e-4647-a658-bee484d3f7fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:50.439258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d80a659f-d22e-4647-a658-bee484d3f7fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:50.440000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d80a659f-d22e-4647-a658-bee484d3f7fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:50.442149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d80a659f-d22e-4647-a658-bee484d3f7fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:50.445158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d80a659f-d22e-4647-a658-bee484d3f7fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:50.539477 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d80a659f-d22e-4647-a658-bee484d3f7fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.127868 Jan 22 21:14:50.540147 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2584/4957] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:50 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:50.556004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-649efcea-f3eb-4c3d-8b5a-56162222c61e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:50.556613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-649efcea-f3eb-4c3d-8b5a-56162222c61e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:50.614084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-307e221c-558c-4fc4-b46c-d1800573876a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:50.625330 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-307e221c-558c-4fc4-b46c-d1800573876a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1714 microversion: 2.1 time: 0.305573 Jan 22 21:14:50.625963 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2374/4958] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:50 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1714 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:50.628161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-649efcea-f3eb-4c3d-8b5a-56162222c61e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:50.642692 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-649efcea-f3eb-4c3d-8b5a-56162222c61e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1222 microversion: 2.1 time: 0.099857 Jan 22 21:14:50.643419 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2585/4959] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:50 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:51.551549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d11afb34-cddb-488b-a0ae-eee9f561dcc2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:51.553123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d11afb34-cddb-488b-a0ae-eee9f561dcc2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:51.560283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d11afb34-cddb-488b-a0ae-eee9f561dcc2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:51.560749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d11afb34-cddb-488b-a0ae-eee9f561dcc2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:51.561585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d11afb34-cddb-488b-a0ae-eee9f561dcc2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:51.562035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d11afb34-cddb-488b-a0ae-eee9f561dcc2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:51.603152 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d11afb34-cddb-488b-a0ae-eee9f561dcc2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.055248 Jan 22 21:14:51.603860 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2375/4960] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:51 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:51.644275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3e8dab79-36ce-4bfc-91f8-5d40f5680ad2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:51.647302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3e8dab79-36ce-4bfc-91f8-5d40f5680ad2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:51.658283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e8dab79-36ce-4bfc-91f8-5d40f5680ad2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:51.659495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e8dab79-36ce-4bfc-91f8-5d40f5680ad2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:51.663041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e8dab79-36ce-4bfc-91f8-5d40f5680ad2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:51.663511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e8dab79-36ce-4bfc-91f8-5d40f5680ad2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:51.667091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5e1c7fa0-7f6b-4c23-b585-f6a5351eebd8 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:51.667801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5e1c7fa0-7f6b-4c23-b585-f6a5351eebd8 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:51.674823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e1c7fa0-7f6b-4c23-b585-f6a5351eebd8 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:51.675282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e1c7fa0-7f6b-4c23-b585-f6a5351eebd8 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:51.676208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e1c7fa0-7f6b-4c23-b585-f6a5351eebd8 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:51.677462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e1c7fa0-7f6b-4c23-b585-f6a5351eebd8 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:51.747673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5e1c7fa0-7f6b-4c23-b585-f6a5351eebd8 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:51.757742 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5e1c7fa0-7f6b-4c23-b585-f6a5351eebd8 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1226 microversion: 2.1 time: 0.098424 Jan 22 21:14:51.757742 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2376/4961] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:51 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:51.841735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3e8dab79-36ce-4bfc-91f8-5d40f5680ad2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:51.851998 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3e8dab79-36ce-4bfc-91f8-5d40f5680ad2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1718 microversion: 2.1 time: 0.211979 Jan 22 21:14:51.853258 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2586/4962] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:51 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1718 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:52.615452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-84e823b6-f4ac-49f5-a9a2-95264af85df3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:52.616406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-84e823b6-f4ac-49f5-a9a2-95264af85df3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:52.626188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84e823b6-f4ac-49f5-a9a2-95264af85df3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:52.626664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84e823b6-f4ac-49f5-a9a2-95264af85df3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:52.627484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84e823b6-f4ac-49f5-a9a2-95264af85df3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:52.627940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84e823b6-f4ac-49f5-a9a2-95264af85df3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:52.678318 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-84e823b6-f4ac-49f5-a9a2-95264af85df3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.067008 Jan 22 21:14:52.681531 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2377/4963] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:52 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:52.776598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b32dda64-197d-423a-805f-bf5fc23f2667 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:52.778362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b32dda64-197d-423a-805f-bf5fc23f2667 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:52.790089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b32dda64-197d-423a-805f-bf5fc23f2667 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:52.790552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b32dda64-197d-423a-805f-bf5fc23f2667 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:52.791538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b32dda64-197d-423a-805f-bf5fc23f2667 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:52.792176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b32dda64-197d-423a-805f-bf5fc23f2667 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:52.909265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b32dda64-197d-423a-805f-bf5fc23f2667 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:52.919807 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b32dda64-197d-423a-805f-bf5fc23f2667 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1274 microversion: 2.1 time: 0.148993 Jan 22 21:14:52.930792 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2587/4964] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:52 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:53.700578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-36d1fc71-a2b3-4e23-8ca4-05ad6119516c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:53.701654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-36d1fc71-a2b3-4e23-8ca4-05ad6119516c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:53.714679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36d1fc71-a2b3-4e23-8ca4-05ad6119516c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:53.715158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36d1fc71-a2b3-4e23-8ca4-05ad6119516c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:53.716014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36d1fc71-a2b3-4e23-8ca4-05ad6119516c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:53.716462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36d1fc71-a2b3-4e23-8ca4-05ad6119516c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:53.771546 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-36d1fc71-a2b3-4e23-8ca4-05ad6119516c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.083797 Jan 22 21:14:53.776617 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2378/4965] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:53 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:53.937732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dfc6d3ff-5d9f-4d7b-871e-df3d31975c2f tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:53.938445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dfc6d3ff-5d9f-4d7b-871e-df3d31975c2f tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:53.946440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfc6d3ff-5d9f-4d7b-871e-df3d31975c2f tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:53.946933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfc6d3ff-5d9f-4d7b-871e-df3d31975c2f tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:53.951415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfc6d3ff-5d9f-4d7b-871e-df3d31975c2f tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:53.951415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dfc6d3ff-5d9f-4d7b-871e-df3d31975c2f tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:54.499599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dfc6d3ff-5d9f-4d7b-871e-df3d31975c2f tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:54.509396 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dfc6d3ff-5d9f-4d7b-871e-df3d31975c2f tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1322 microversion: 2.1 time: 0.575401 Jan 22 21:14:54.511168 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2588/4966] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:53 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1322 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:54.789202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d4dfd70f-97d9-412f-a889-409f5c8af3b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:54.796180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d4dfd70f-97d9-412f-a889-409f5c8af3b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:54.808392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4dfd70f-97d9-412f-a889-409f5c8af3b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:54.809164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4dfd70f-97d9-412f-a889-409f5c8af3b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:54.811206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4dfd70f-97d9-412f-a889-409f5c8af3b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:54.811994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4dfd70f-97d9-412f-a889-409f5c8af3b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:54.860376 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d4dfd70f-97d9-412f-a889-409f5c8af3b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.079048 Jan 22 21:14:54.865193 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2379/4967] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:54 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:54.876041 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:14:54.876231 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 21:14:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:14:55.467708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-bbc0dbe2-c4b2-4cc4-a5e8-d3a6db7358d0 req-d147cb24-3f97-49b9-b8d3-563e7eba3ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b558471-88c9-43fa-a970-799679fcbbf4", "tag": "36634d05-9144-45d4-99b4-8efa52e8e426"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:55.469961 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:14:55.469961 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:14:55.481545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bbc0dbe2-c4b2-4cc4-a5e8-d3a6db7358d0 req-d147cb24-3f97-49b9-b8d3-563e7eba3ab4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:55.482237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bbc0dbe2-c4b2-4cc4-a5e8-d3a6db7358d0 req-d147cb24-3f97-49b9-b8d3-563e7eba3ab4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:55.513354 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-bbc0dbe2-c4b2-4cc4-a5e8-d3a6db7358d0 req-d147cb24-3f97-49b9-b8d3-563e7eba3ab4 service nova] Creating event network-changed:36634d05-9144-45d4-99b4-8efa52e8e426 for instance 0b558471-88c9-43fa-a970-799679fcbbf4 on nch1-master-1 Jan 22 21:14:55.528313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-76c85ce6-85ff-4fec-be68-c366f4b6da5b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:55.529029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-76c85ce6-85ff-4fec-be68-c366f4b6da5b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:55.535649 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-bbc0dbe2-c4b2-4cc4-a5e8-d3a6db7358d0 req-d147cb24-3f97-49b9-b8d3-563e7eba3ab4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071095 Jan 22 21:14:55.538804 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2589/4968] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:55.544333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76c85ce6-85ff-4fec-be68-c366f4b6da5b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:55.546579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76c85ce6-85ff-4fec-be68-c366f4b6da5b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:55.547577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76c85ce6-85ff-4fec-be68-c366f4b6da5b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:55.552733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76c85ce6-85ff-4fec-be68-c366f4b6da5b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:55.872709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e4dda3aa-69f4-41e7-9aa2-458d7c61563f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:55.873988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e4dda3aa-69f4-41e7-9aa2-458d7c61563f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:55.881607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4dda3aa-69f4-41e7-9aa2-458d7c61563f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:55.882430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4dda3aa-69f4-41e7-9aa2-458d7c61563f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:55.886283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4dda3aa-69f4-41e7-9aa2-458d7c61563f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:55.887432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4dda3aa-69f4-41e7-9aa2-458d7c61563f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:55.949472 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e4dda3aa-69f4-41e7-9aa2-458d7c61563f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.080627 Jan 22 21:14:55.953808 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2590/4969] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:55 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:56.280359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-76c85ce6-85ff-4fec-be68-c366f4b6da5b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:56.293559 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-76c85ce6-85ff-4fec-be68-c366f4b6da5b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1322 microversion: 2.1 time: 0.769365 Jan 22 21:14:56.294633 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2380/4970] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:55 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1322 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:14:56.965059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c70401e7-b282-44b6-877b-e26a5b78aa0e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:56.966738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c70401e7-b282-44b6-877b-e26a5b78aa0e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:56.975233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c70401e7-b282-44b6-877b-e26a5b78aa0e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:56.976102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c70401e7-b282-44b6-877b-e26a5b78aa0e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:56.977174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c70401e7-b282-44b6-877b-e26a5b78aa0e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:56.977914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c70401e7-b282-44b6-877b-e26a5b78aa0e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:57.032739 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c70401e7-b282-44b6-877b-e26a5b78aa0e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.071915 Jan 22 21:14:57.033635 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2591/4971] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:56 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:14:57.316259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-808c9c0a-6ffc-4e86-98a9-7ec8a5eaec98 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:57.317295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-808c9c0a-6ffc-4e86-98a9-7ec8a5eaec98 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:57.327467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-808c9c0a-6ffc-4e86-98a9-7ec8a5eaec98 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:57.328153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-808c9c0a-6ffc-4e86-98a9-7ec8a5eaec98 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:57.329010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-808c9c0a-6ffc-4e86-98a9-7ec8a5eaec98 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:57.329711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-808c9c0a-6ffc-4e86-98a9-7ec8a5eaec98 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:57.452012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eed07a7e-0bf8-4798-8755-899e68d0bd35 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Calling method '.version_select at 0x7f1ed5d52940>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:57.540699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG neutronclient.v2_0.client [None req-eed07a7e-0bf8-4798-8755-899e68d0bd35 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ccb16440-4d08-4a02-8b7e-e0d08ecce43c does not exist", "detail": ""}} {{(pid=137033) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:57.541461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.security_group_api [None req-eed07a7e-0bf8-4798-8755-899e68d0bd35 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Neutron security group ccb16440-4d08-4a02-8b7e-e0d08ecce43c not found {{(pid=137033) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 22 21:14:57.542095 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-eed07a7e-0bf8-4798-8755-899e68d0bd35 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] HTTP exception thrown: Security group ccb16440-4d08-4a02-8b7e-e0d08ecce43c does not exist Jan 22 21:14:57.542095 ncdv-master-1 devstack@n-api.service[137033]: Neutron server returns request_ids: ['req-1c766c14-3a4f-4128-ac8d-bd18a2ace3ac'] Jan 22 21:14:57.542907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eed07a7e-0bf8-4798-8755-899e68d0bd35 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Returning 404 to user: Security group ccb16440-4d08-4a02-8b7e-e0d08ecce43c does not exist Jan 22 21:14:57.542907 ncdv-master-1 devstack@n-api.service[137033]: Neutron server returns request_ids: ['req-1c766c14-3a4f-4128-ac8d-bd18a2ace3ac'] {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:57.544285 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eed07a7e-0bf8-4798-8755-899e68d0bd35 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/ccb16440-4d08-4a02-8b7e-e0d08ecce43c" status: 404 len: 194 microversion: 2.1 time: 0.369042 Jan 22 21:14:57.547312 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2381/4972] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:57 2022] DELETE /compute/v2.1/os-security-groups/ccb16440-4d08-4a02-8b7e-e0d08ecce43c => generated 194 bytes in 373 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:14:57.559547 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e9c58926-0c28-4eb6-8064-2b40caffc04e tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.006593 Jan 22 21:14:57.560381 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2382/4973] 10.222.0.100 () {58 vars in 1168 bytes} [Sat Jan 22 21:14:57 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 22 21:14:57.569101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bac893f2-c6a9-4474-a83a-d1e37cc3b29f tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Calling method '.version_select at 0x7f1ed61051f0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:57.569267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-808c9c0a-6ffc-4e86-98a9-7ec8a5eaec98 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:57.585325 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-808c9c0a-6ffc-4e86-98a9-7ec8a5eaec98 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1322 microversion: 2.1 time: 0.276655 Jan 22 21:14:57.586526 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2592/4974] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:57 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:57.613423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5db76f6b-22b2-4afd-9445-9d8ab8cad57a req-7eda6b52-ae3a-44ce-a5cd-c0e64cdf9ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72918dc8-a7cc-4046-aa2d-9a91eb7d5332", "tag": "36e7c743-4981-4f44-8177-d4ee4fdfa234"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:57.616725 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:14:57.616725 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:14:57.627679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5db76f6b-22b2-4afd-9445-9d8ab8cad57a req-7eda6b52-ae3a-44ce-a5cd-c0e64cdf9ac8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:57.628815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5db76f6b-22b2-4afd-9445-9d8ab8cad57a req-7eda6b52-ae3a-44ce-a5cd-c0e64cdf9ac8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:57.642144 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5db76f6b-22b2-4afd-9445-9d8ab8cad57a req-7eda6b52-ae3a-44ce-a5cd-c0e64cdf9ac8 service nova] Creating event network-changed:36e7c743-4981-4f44-8177-d4ee4fdfa234 for instance 72918dc8-a7cc-4046-aa2d-9a91eb7d5332 on nch1-master-1 Jan 22 21:14:57.648542 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-5db76f6b-22b2-4afd-9445-9d8ab8cad57a req-7eda6b52-ae3a-44ce-a5cd-c0e64cdf9ac8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039991 Jan 22 21:14:57.649666 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2593/4975] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:57.903022 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bac893f2-c6a9-4474-a83a-d1e37cc3b29f tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] 10.222.0.100 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.337587 Jan 22 21:14:57.903820 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2383/4976] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 21:14:57 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:14:57.916644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ad5d07e-38e1-414a-87ff-e53017c7d598 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Calling method '.version_select at 0x7f1ed51488b0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:58.042467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG neutronclient.v2_0.client [None req-1ad5d07e-38e1-414a-87ff-e53017c7d598 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=137032) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:58.042467 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-1ad5d07e-38e1-414a-87ff-e53017c7d598 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] HTTP exception thrown: Insufficient rights for removing default security group. Jan 22 21:14:58.042467 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-6fcd2a57-5e16-4e89-bfea-6a229d264329'] Jan 22 21:14:58.042467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ad5d07e-38e1-414a-87ff-e53017c7d598 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Returning 400 to user: Insufficient rights for removing default security group. Jan 22 21:14:58.042467 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-6fcd2a57-5e16-4e89-bfea-6a229d264329'] {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:58.042467 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ad5d07e-38e1-414a-87ff-e53017c7d598 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] 10.222.0.100 "DELETE /compute/v2.1/os-security-groups/08d6eacb-c318-4757-ba71-cc99a42f496f" status: 400 len: 182 microversion: 2.1 time: 0.130099 Jan 22 21:14:58.046796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fa8482af-146b-4480-9a22-f81810952df2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:58.052823 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2594/4977] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:14:57 2022] DELETE /compute/v2.1/os-security-groups/08d6eacb-c318-4757-ba71-cc99a42f496f => generated 182 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:14:58.054454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fa8482af-146b-4480-9a22-f81810952df2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:58.059078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4c68f8c3-935c-49de-b4af-ade7c6400d3c tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Calling method '.version_select at 0x7f1ed5b7e5e0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:58.066111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa8482af-146b-4480-9a22-f81810952df2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:58.066569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa8482af-146b-4480-9a22-f81810952df2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:58.067396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa8482af-146b-4480-9a22-f81810952df2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:58.067842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa8482af-146b-4480-9a22-f81810952df2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:58.087749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG neutronclient.v2_0.client [None req-4c68f8c3-935c-49de-b4af-ade7c6400d3c tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3b628cb9-3258-4d0c-b164-05b79a2cc607 does not exist", "detail": ""}} {{(pid=137032) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:58.088381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.security_group_api [None req-4c68f8c3-935c-49de-b4af-ade7c6400d3c tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Neutron security group 3b628cb9-3258-4d0c-b164-05b79a2cc607 not found {{(pid=137032) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 22 21:14:58.088908 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-4c68f8c3-935c-49de-b4af-ade7c6400d3c tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] HTTP exception thrown: Security group 3b628cb9-3258-4d0c-b164-05b79a2cc607 does not exist Jan 22 21:14:58.088908 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-3e0bae80-1c8d-4ba5-bac9-c25207fe6cd0'] Jan 22 21:14:58.090210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4c68f8c3-935c-49de-b4af-ade7c6400d3c tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Returning 404 to user: Security group 3b628cb9-3258-4d0c-b164-05b79a2cc607 does not exist Jan 22 21:14:58.090210 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-3e0bae80-1c8d-4ba5-bac9-c25207fe6cd0'] {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:58.091071 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4c68f8c3-935c-49de-b4af-ade7c6400d3c tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] 10.222.0.100 "GET /compute/v2.1/os-security-groups/3b628cb9-3258-4d0c-b164-05b79a2cc607" status: 404 len: 194 microversion: 2.1 time: 0.036707 Jan 22 21:14:58.091647 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2595/4978] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 21:14:58 2022] GET /compute/v2.1/os-security-groups/3b628cb9-3258-4d0c-b164-05b79a2cc607 => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:14:58.102262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-75773770-9a21-4730-ae67-e835f4d90b89 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Action: 'update', calling method: .version_select at 0x7f1ed50faaf0>, body: {"security_group": {"name": "tempest-sg-216352955", "description": "tempest-description-1525964163"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:58.120044 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fa8482af-146b-4480-9a22-f81810952df2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.077572 Jan 22 21:14:58.120726 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2384/4979] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:58 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:14:58.133937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG neutronclient.v2_0.client [None req-75773770-9a21-4730-ae67-e835f4d90b89 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 00090f25-86f9-4ec0-950c-da3c4ea6e017 does not exist", "detail": ""}} {{(pid=137032) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jan 22 21:14:58.134573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.security_group_api [None req-75773770-9a21-4730-ae67-e835f4d90b89 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Neutron security group 00090f25-86f9-4ec0-950c-da3c4ea6e017 not found {{(pid=137032) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jan 22 21:14:58.135172 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-75773770-9a21-4730-ae67-e835f4d90b89 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] HTTP exception thrown: Security group 00090f25-86f9-4ec0-950c-da3c4ea6e017 does not exist Jan 22 21:14:58.135172 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-e244fa1a-9483-4c46-acf0-560c67bdda54'] Jan 22 21:14:58.135706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-75773770-9a21-4730-ae67-e835f4d90b89 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] Returning 404 to user: Security group 00090f25-86f9-4ec0-950c-da3c4ea6e017 does not exist Jan 22 21:14:58.135706 ncdv-master-1 devstack@n-api.service[137032]: Neutron server returns request_ids: ['req-e244fa1a-9483-4c46-acf0-560c67bdda54'] {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:14:58.136811 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-75773770-9a21-4730-ae67-e835f4d90b89 tempest-SecurityGroupsNegativeTestJSON-708679166 tempest-SecurityGroupsNegativeTestJSON-708679166-project] 10.222.0.100 "PUT /compute/v2.1/os-security-groups/00090f25-86f9-4ec0-950c-da3c4ea6e017" status: 404 len: 194 microversion: 2.1 time: 0.039020 Jan 22 21:14:58.137392 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2596/4980] 10.222.0.100 () {60 vars in 1294 bytes} [Sat Jan 22 21:14:58 2022] PUT /compute/v2.1/os-security-groups/00090f25-86f9-4ec0-950c-da3c4ea6e017 => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:14:58.604871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a95c313b-0441-436c-9440-b0ffc59296f7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:14:58.605672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a95c313b-0441-436c-9440-b0ffc59296f7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:58.615119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a95c313b-0441-436c-9440-b0ffc59296f7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:58.615643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a95c313b-0441-436c-9440-b0ffc59296f7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:58.616634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a95c313b-0441-436c-9440-b0ffc59296f7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:58.617322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a95c313b-0441-436c-9440-b0ffc59296f7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:59.004260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a95c313b-0441-436c-9440-b0ffc59296f7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:14:59.012352 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a95c313b-0441-436c-9440-b0ffc59296f7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1322 microversion: 2.1 time: 0.412468 Jan 22 21:14:59.012974 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2385/4981] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:14:58 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:14:59.134705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2c45e828-85d8-4606-9b3a-8d3edbc866c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:14:59.138155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2c45e828-85d8-4606-9b3a-8d3edbc866c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:14:59.145380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c45e828-85d8-4606-9b3a-8d3edbc866c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:59.146674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c45e828-85d8-4606-9b3a-8d3edbc866c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:59.147066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c45e828-85d8-4606-9b3a-8d3edbc866c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:14:59.147505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c45e828-85d8-4606-9b3a-8d3edbc866c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:14:59.190920 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2c45e828-85d8-4606-9b3a-8d3edbc866c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.058856 Jan 22 21:14:59.197792 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2597/4982] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:14:59 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:00.030475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e80cfca9-2d08-4d37-ab04-e6e6fa181ee7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:00.031377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e80cfca9-2d08-4d37-ab04-e6e6fa181ee7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:00.041370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e80cfca9-2d08-4d37-ab04-e6e6fa181ee7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:00.042112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e80cfca9-2d08-4d37-ab04-e6e6fa181ee7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:00.043277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e80cfca9-2d08-4d37-ab04-e6e6fa181ee7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:00.043866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e80cfca9-2d08-4d37-ab04-e6e6fa181ee7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:00.189853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e80cfca9-2d08-4d37-ab04-e6e6fa181ee7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:00.199509 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e80cfca9-2d08-4d37-ab04-e6e6fa181ee7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1322 microversion: 2.1 time: 0.172414 Jan 22 21:15:00.200094 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2386/4983] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:00 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:00.205077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-478dac6a-3586-471f-aa44-aea5ab5d60cb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:00.206853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-478dac6a-3586-471f-aa44-aea5ab5d60cb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:00.219057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-478dac6a-3586-471f-aa44-aea5ab5d60cb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:00.220082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-478dac6a-3586-471f-aa44-aea5ab5d60cb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:00.257284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-478dac6a-3586-471f-aa44-aea5ab5d60cb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:00.257284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-478dac6a-3586-471f-aa44-aea5ab5d60cb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:00.277898 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-478dac6a-3586-471f-aa44-aea5ab5d60cb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.077239 Jan 22 21:15:00.281683 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2598/4984] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:00 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:15:01.216311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9243eb03-a81e-4d6a-9dc0-aa37c28b6a7b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:01.217001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9243eb03-a81e-4d6a-9dc0-aa37c28b6a7b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:01.225943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9243eb03-a81e-4d6a-9dc0-aa37c28b6a7b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:01.226721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9243eb03-a81e-4d6a-9dc0-aa37c28b6a7b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:01.227616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9243eb03-a81e-4d6a-9dc0-aa37c28b6a7b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:01.228064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9243eb03-a81e-4d6a-9dc0-aa37c28b6a7b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:01.295885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-458122b1-175c-44b9-8171-0a3d7c8a6beb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:01.298150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-458122b1-175c-44b9-8171-0a3d7c8a6beb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:01.309321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-458122b1-175c-44b9-8171-0a3d7c8a6beb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:01.310065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-458122b1-175c-44b9-8171-0a3d7c8a6beb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:01.311309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-458122b1-175c-44b9-8171-0a3d7c8a6beb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:01.313464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-458122b1-175c-44b9-8171-0a3d7c8a6beb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:01.363751 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-458122b1-175c-44b9-8171-0a3d7c8a6beb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.074266 Jan 22 21:15:01.364635 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2599/4985] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:01 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:01.391987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9243eb03-a81e-4d6a-9dc0-aa37c28b6a7b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:01.400273 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9243eb03-a81e-4d6a-9dc0-aa37c28b6a7b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1322 microversion: 2.1 time: 0.187903 Jan 22 21:15:01.400855 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2387/4986] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:01 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:01.516516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-523d6334-e556-4f4a-b47d-c6a3db78a2a9 req-dee17004-763e-4ab3-a105-56347ed1a368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b558471-88c9-43fa-a970-799679fcbbf4", "name": "network-vif-plugged", "status": "completed", "tag": "36634d05-9144-45d4-99b4-8efa52e8e426"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:01.518378 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:15:01.518378 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:15:01.531270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-523d6334-e556-4f4a-b47d-c6a3db78a2a9 req-dee17004-763e-4ab3-a105-56347ed1a368 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:01.531728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-523d6334-e556-4f4a-b47d-c6a3db78a2a9 req-dee17004-763e-4ab3-a105-56347ed1a368 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:01.550531 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-523d6334-e556-4f4a-b47d-c6a3db78a2a9 req-dee17004-763e-4ab3-a105-56347ed1a368 service nova] Creating event network-vif-plugged:36634d05-9144-45d4-99b4-8efa52e8e426 for instance 0b558471-88c9-43fa-a970-799679fcbbf4 on nch1-master-1 Jan 22 21:15:01.556331 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-523d6334-e556-4f4a-b47d-c6a3db78a2a9 req-dee17004-763e-4ab3-a105-56347ed1a368 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043634 Jan 22 21:15:01.557449 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2600/4987] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:15:02.379192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0df1436e-c0c2-4c2b-9ecd-3828c25a8d4b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:02.381393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0df1436e-c0c2-4c2b-9ecd-3828c25a8d4b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:02.388688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0df1436e-c0c2-4c2b-9ecd-3828c25a8d4b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:02.389230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0df1436e-c0c2-4c2b-9ecd-3828c25a8d4b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:02.390260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0df1436e-c0c2-4c2b-9ecd-3828c25a8d4b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:02.390717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0df1436e-c0c2-4c2b-9ecd-3828c25a8d4b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:02.418871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a179d6c5-c467-489c-ba3c-45c3e819a8de tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:02.420502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a179d6c5-c467-489c-ba3c-45c3e819a8de tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:02.427175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a179d6c5-c467-489c-ba3c-45c3e819a8de tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:02.427782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a179d6c5-c467-489c-ba3c-45c3e819a8de tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:02.429146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a179d6c5-c467-489c-ba3c-45c3e819a8de tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:02.429649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a179d6c5-c467-489c-ba3c-45c3e819a8de tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:02.434038 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0df1436e-c0c2-4c2b-9ecd-3828c25a8d4b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.058579 Jan 22 21:15:02.437053 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2388/4988] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:02 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:02.697796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a179d6c5-c467-489c-ba3c-45c3e819a8de tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:02.711710 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a179d6c5-c467-489c-ba3c-45c3e819a8de tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1322 microversion: 2.1 time: 0.297955 Jan 22 21:15:02.712551 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2601/4989] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:02 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:03.450186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-304a628a-8b52-4cb3-a6c4-69af47299645 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:03.451246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-304a628a-8b52-4cb3-a6c4-69af47299645 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:03.468856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-304a628a-8b52-4cb3-a6c4-69af47299645 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:03.469787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-304a628a-8b52-4cb3-a6c4-69af47299645 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:03.474342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-304a628a-8b52-4cb3-a6c4-69af47299645 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:03.475359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-304a628a-8b52-4cb3-a6c4-69af47299645 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:03.539190 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-304a628a-8b52-4cb3-a6c4-69af47299645 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.094533 Jan 22 21:15:03.539941 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2602/4990] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:03 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:03.550222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1851440830", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "96cc3928-7569-4c1f-becd-807913ebf734"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:03.578249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-3483e036-0351-490b-b77e-e10041b4494f req-77b65268-c740-4105-a3f1-82e356829621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72918dc8-a7cc-4046-aa2d-9a91eb7d5332", "name": "network-vif-plugged", "status": "completed", "tag": "36e7c743-4981-4f44-8177-d4ee4fdfa234"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:03.579878 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:15:03.579878 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:15:03.592465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-3483e036-0351-490b-b77e-e10041b4494f req-77b65268-c740-4105-a3f1-82e356829621 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:03.593644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-3483e036-0351-490b-b77e-e10041b4494f req-77b65268-c740-4105-a3f1-82e356829621 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:03.609388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] validate_networks() for [('96cc3928-7569-4c1f-becd-807913ebf734', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:15:03.621566 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-3483e036-0351-490b-b77e-e10041b4494f req-77b65268-c740-4105-a3f1-82e356829621 service nova] Creating event network-vif-plugged:36e7c743-4981-4f44-8177-d4ee4fdfa234 for instance 72918dc8-a7cc-4046-aa2d-9a91eb7d5332 on nch1-master-1 Jan 22 21:15:03.628051 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-3483e036-0351-490b-b77e-e10041b4494f req-77b65268-c740-4105-a3f1-82e356829621 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060901 Jan 22 21:15:03.629574 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2603/4991] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:15:03.730779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6c9ea1f8-e640-4393-989b-46c33960863b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:03.731811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6c9ea1f8-e640-4393-989b-46c33960863b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:03.740114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c9ea1f8-e640-4393-989b-46c33960863b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:03.740864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c9ea1f8-e640-4393-989b-46c33960863b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:03.741955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c9ea1f8-e640-4393-989b-46c33960863b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:03.742618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c9ea1f8-e640-4393-989b-46c33960863b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:03.910403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6c9ea1f8-e640-4393-989b-46c33960863b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:03.920042 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6c9ea1f8-e640-4393-989b-46c33960863b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1322 microversion: 2.1 time: 0.193468 Jan 22 21:15:03.920734 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2604/4992] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:03 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:04.086915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:15:04.087348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:15:04.087840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:15:04.088256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:15:04.088679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:15:04.097706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:04.098383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:04.099279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:04.099728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:04.117886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Getting quotas for project 5b1c3aa9e1ae4cc8a5a021434ad4a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:15:04.123064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Getting quotas for user b93108a71872461ea979735a490694a6 and project 5b1c3aa9e1ae4cc8a5a021434ad4a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:15:04.136226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:15:04.138706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:15:04.286672 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d0d8cf3-2cd8-4719-807c-76c88c77bf74 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.907247 Jan 22 21:15:04.287611 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2389/4993] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:15:03 2022] POST /compute/v2.1/servers => generated 382 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:15:04.300730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f24085a7-e7e0-4983-82e1-e4ddb0375c7d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:04.302345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f24085a7-e7e0-4983-82e1-e4ddb0375c7d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:04.393694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f24085a7-e7e0-4983-82e1-e4ddb0375c7d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:04.400837 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f24085a7-e7e0-4983-82e1-e4ddb0375c7d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 200 len: 1219 microversion: 2.1 time: 0.105466 Jan 22 21:15:04.401434 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2605/4994] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:04 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:04.552630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e86cd693-0e1f-4e49-b326-f7fd612531f1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:04.553544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e86cd693-0e1f-4e49-b326-f7fd612531f1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:04.559878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e86cd693-0e1f-4e49-b326-f7fd612531f1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:04.560347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e86cd693-0e1f-4e49-b326-f7fd612531f1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:04.561192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e86cd693-0e1f-4e49-b326-f7fd612531f1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:04.561653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e86cd693-0e1f-4e49-b326-f7fd612531f1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:04.602904 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e86cd693-0e1f-4e49-b326-f7fd612531f1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.055403 Jan 22 21:15:04.603885 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2390/4995] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:04 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:04.938318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1e28a2cd-254f-4810-9091-28bcc00f2641 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:04.938921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1e28a2cd-254f-4810-9091-28bcc00f2641 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:04.948895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e28a2cd-254f-4810-9091-28bcc00f2641 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:04.949685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e28a2cd-254f-4810-9091-28bcc00f2641 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:04.950498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e28a2cd-254f-4810-9091-28bcc00f2641 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:04.950950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e28a2cd-254f-4810-9091-28bcc00f2641 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:05.188721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1e28a2cd-254f-4810-9091-28bcc00f2641 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:05.197771 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1e28a2cd-254f-4810-9091-28bcc00f2641 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1322 microversion: 2.1 time: 0.263030 Jan 22 21:15:05.202731 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2606/4996] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:04 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:05.423592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-95d39516-255c-4540-aa0a-aef3b57d2044 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:05.424296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-95d39516-255c-4540-aa0a-aef3b57d2044 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:05.432317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95d39516-255c-4540-aa0a-aef3b57d2044 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:05.433093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95d39516-255c-4540-aa0a-aef3b57d2044 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:05.433617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95d39516-255c-4540-aa0a-aef3b57d2044 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:05.434067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95d39516-255c-4540-aa0a-aef3b57d2044 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:05.506841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-95d39516-255c-4540-aa0a-aef3b57d2044 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:05.515416 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-95d39516-255c-4540-aa0a-aef3b57d2044 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 200 len: 1223 microversion: 2.1 time: 0.095841 Jan 22 21:15:05.517642 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2391/4997] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:05 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:05.615502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f7cbdad9-7867-447d-ada1-b943696e58f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:05.616513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f7cbdad9-7867-447d-ada1-b943696e58f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:05.623707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7cbdad9-7867-447d-ada1-b943696e58f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:05.627008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7cbdad9-7867-447d-ada1-b943696e58f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:05.627008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7cbdad9-7867-447d-ada1-b943696e58f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:05.627008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7cbdad9-7867-447d-ada1-b943696e58f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:05.669670 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f7cbdad9-7867-447d-ada1-b943696e58f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.058355 Jan 22 21:15:05.673700 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2607/4998] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:05 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:06.215487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a91f73f5-d5f9-42ee-b845-b08ec253d3fc tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:06.216238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a91f73f5-d5f9-42ee-b845-b08ec253d3fc tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:06.224458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a91f73f5-d5f9-42ee-b845-b08ec253d3fc tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:06.225432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a91f73f5-d5f9-42ee-b845-b08ec253d3fc tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:06.226630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a91f73f5-d5f9-42ee-b845-b08ec253d3fc tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:06.227182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a91f73f5-d5f9-42ee-b845-b08ec253d3fc tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:06.373866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a91f73f5-d5f9-42ee-b845-b08ec253d3fc tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:06.382650 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a91f73f5-d5f9-42ee-b845-b08ec253d3fc tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1472 microversion: 2.1 time: 0.171116 Jan 22 21:15:06.383227 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2392/4999] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:06 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:06.400518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-567c0249-e5d9-4a1e-94ca-02a355742d73 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:06.401306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-567c0249-e5d9-4a1e-94ca-02a355742d73 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 0b558471-88c9-43fa-a970-799679fcbbf4] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:06.409740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-567c0249-e5d9-4a1e-94ca-02a355742d73 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:06.410308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-567c0249-e5d9-4a1e-94ca-02a355742d73 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:06.412674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-567c0249-e5d9-4a1e-94ca-02a355742d73 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:06.413209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-567c0249-e5d9-4a1e-94ca-02a355742d73 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:06.532474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-da626664-b3b0-4515-ab21-74df421190e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:06.534203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-da626664-b3b0-4515-ab21-74df421190e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:06.541397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da626664-b3b0-4515-ab21-74df421190e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:06.541964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da626664-b3b0-4515-ab21-74df421190e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:06.542866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da626664-b3b0-4515-ab21-74df421190e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:06.543518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da626664-b3b0-4515-ab21-74df421190e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:06.620504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-da626664-b3b0-4515-ab21-74df421190e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:06.628253 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-da626664-b3b0-4515-ab21-74df421190e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 200 len: 1279 microversion: 2.1 time: 0.099737 Jan 22 21:15:06.628805 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2393/5000] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:06 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 1279 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:06.633641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-567c0249-e5d9-4a1e-94ca-02a355742d73 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:06.641975 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-567c0249-e5d9-4a1e-94ca-02a355742d73 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4" status: 200 len: 1472 microversion: 2.1 time: 0.245551 Jan 22 21:15:06.643660 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2608/5001] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:06 2022] GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4 => generated 1472 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:06.658897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-18ee9e42-83b2-4cc0-a999-e09249ee5006 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-673875573"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:06.659978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-18ee9e42-83b2-4cc0-a999-e09249ee5006 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 0b558471-88c9-43fa-a970-799679fcbbf4] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:06.667328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18ee9e42-83b2-4cc0-a999-e09249ee5006 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:06.667870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18ee9e42-83b2-4cc0-a999-e09249ee5006 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:06.668750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18ee9e42-83b2-4cc0-a999-e09249ee5006 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:06.669272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18ee9e42-83b2-4cc0-a999-e09249ee5006 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:06.681309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fe0f7f90-fca6-4431-9c48-b67dfed3d9bd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:06.683780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fe0f7f90-fca6-4431-9c48-b67dfed3d9bd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:06.695280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe0f7f90-fca6-4431-9c48-b67dfed3d9bd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:06.696007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe0f7f90-fca6-4431-9c48-b67dfed3d9bd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:06.697052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe0f7f90-fca6-4431-9c48-b67dfed3d9bd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:06.697740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe0f7f90-fca6-4431-9c48-b67dfed3d9bd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:06.753570 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fe0f7f90-fca6-4431-9c48-b67dfed3d9bd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.075938 Jan 22 21:15:06.768192 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2609/5002] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:06 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:07.227993 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-18ee9e42-83b2-4cc0-a999-e09249ee5006 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "POST /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4/action" status: 202 len: 0 microversion: 2.1 time: 0.572772 Jan 22 21:15:07.228663 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2394/5003] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:15:06 2022] POST /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 22 21:15:07.241773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-38ccefc1-3603-4335-b6a1-d42a2c7913aa tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed51439d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:07.285404 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-38ccefc1-3603-4335-b6a1-d42a2c7913aa tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.050764 Jan 22 21:15:07.286088 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2610/5004] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:07 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:07.646262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8f2f3f8b-a976-40f1-8651-c4266fba986c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:07.646894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8f2f3f8b-a976-40f1-8651-c4266fba986c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:07.654069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f2f3f8b-a976-40f1-8651-c4266fba986c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:07.654827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f2f3f8b-a976-40f1-8651-c4266fba986c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:07.655842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f2f3f8b-a976-40f1-8651-c4266fba986c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:07.656488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f2f3f8b-a976-40f1-8651-c4266fba986c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:07.771861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-361901c4-2575-40b0-a499-fcf87ba2909d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:07.773813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-361901c4-2575-40b0-a499-fcf87ba2909d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:07.780911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-361901c4-2575-40b0-a499-fcf87ba2909d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:07.781366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-361901c4-2575-40b0-a499-fcf87ba2909d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:07.782400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-361901c4-2575-40b0-a499-fcf87ba2909d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:07.783031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-361901c4-2575-40b0-a499-fcf87ba2909d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:07.823812 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-361901c4-2575-40b0-a499-fcf87ba2909d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.057434 Jan 22 21:15:07.824726 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2611/5005] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:07 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:07.922942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8f2f3f8b-a976-40f1-8651-c4266fba986c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:07.935697 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8f2f3f8b-a976-40f1-8651-c4266fba986c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 200 len: 1319 microversion: 2.1 time: 0.293523 Jan 22 21:15:07.949303 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2395/5006] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:07 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:08.299435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ea0a082d-51f2-4a8f-93b9-4405b4a04566 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edafae3a0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:08.345200 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ea0a082d-51f2-4a8f-93b9-4405b4a04566 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.049840 Jan 22 21:15:08.345807 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2612/5007] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:08 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:08.397414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-6df0af79-3545-4153-81b0-a899b68ce135 req-b6dcbd31-3e9f-4219-861f-48f75548a2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dac5148a-6b7f-45bc-aaa2-c3a6f03ab403", "tag": "99c84d44-3ae1-4677-b4a2-4335393f1f04"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:08.401811 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:15:08.401811 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:15:08.411274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6df0af79-3545-4153-81b0-a899b68ce135 req-b6dcbd31-3e9f-4219-861f-48f75548a2e7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:08.411881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6df0af79-3545-4153-81b0-a899b68ce135 req-b6dcbd31-3e9f-4219-861f-48f75548a2e7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:08.423793 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-6df0af79-3545-4153-81b0-a899b68ce135 req-b6dcbd31-3e9f-4219-861f-48f75548a2e7 service nova] Creating event network-changed:99c84d44-3ae1-4677-b4a2-4335393f1f04 for instance dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 on nch2-master-1 Jan 22 21:15:08.428931 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-6df0af79-3545-4153-81b0-a899b68ce135 req-b6dcbd31-3e9f-4219-861f-48f75548a2e7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035903 Jan 22 21:15:08.429717 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2396/5008] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:15:08.837924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-01b085ff-d3d4-4113-9b2e-180ee9fac8fa tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:08.839164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-01b085ff-d3d4-4113-9b2e-180ee9fac8fa tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:08.846203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01b085ff-d3d4-4113-9b2e-180ee9fac8fa tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:08.846808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01b085ff-d3d4-4113-9b2e-180ee9fac8fa tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:08.848511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01b085ff-d3d4-4113-9b2e-180ee9fac8fa tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:08.849170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01b085ff-d3d4-4113-9b2e-180ee9fac8fa tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:08.890946 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-01b085ff-d3d4-4113-9b2e-180ee9fac8fa tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.058151 Jan 22 21:15:08.892626 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2613/5009] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:08 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:15:08.965216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-484fb6d6-9b40-490e-9217-5cca6207051c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:08.965975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-484fb6d6-9b40-490e-9217-5cca6207051c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:08.972624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-484fb6d6-9b40-490e-9217-5cca6207051c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:08.973106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-484fb6d6-9b40-490e-9217-5cca6207051c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:08.973962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-484fb6d6-9b40-490e-9217-5cca6207051c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:08.974435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-484fb6d6-9b40-490e-9217-5cca6207051c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:09.319009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-484fb6d6-9b40-490e-9217-5cca6207051c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:09.327008 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-484fb6d6-9b40-490e-9217-5cca6207051c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 200 len: 1319 microversion: 2.1 time: 0.366139 Jan 22 21:15:09.327594 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2397/5010] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:08 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:09.360026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-65a232c4-afb6-433b-88b8-89a91e0606de tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edaecd8b0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:09.429237 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-65a232c4-afb6-433b-88b8-89a91e0606de tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.073722 Jan 22 21:15:09.429867 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2614/5011] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:09 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:09.904045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-77cc11f7-052a-49a1-ba06-aabde318fc79 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:09.909277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-77cc11f7-052a-49a1-ba06-aabde318fc79 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:09.913062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-77cc11f7-052a-49a1-ba06-aabde318fc79 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:09.913541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-77cc11f7-052a-49a1-ba06-aabde318fc79 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:09.914353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-77cc11f7-052a-49a1-ba06-aabde318fc79 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:09.914879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-77cc11f7-052a-49a1-ba06-aabde318fc79 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:09.955752 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-77cc11f7-052a-49a1-ba06-aabde318fc79 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.055472 Jan 22 21:15:09.956841 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2398/5012] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:09 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:10.346041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-edc25247-b460-43c9-b185-87ed4244ba68 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:10.347529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-edc25247-b460-43c9-b185-87ed4244ba68 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:10.355614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edc25247-b460-43c9-b185-87ed4244ba68 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:10.356478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edc25247-b460-43c9-b185-87ed4244ba68 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:10.357824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edc25247-b460-43c9-b185-87ed4244ba68 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:10.358288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edc25247-b460-43c9-b185-87ed4244ba68 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:10.442988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7d2f08a4-8eb8-49c1-9b42-7be2fd0f283b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed6611310>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:10.494022 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7d2f08a4-8eb8-49c1-9b42-7be2fd0f283b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.055030 Jan 22 21:15:10.494612 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2399/5013] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:10 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:10.563320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-edc25247-b460-43c9-b185-87ed4244ba68 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:10.585563 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-edc25247-b460-43c9-b185-87ed4244ba68 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 200 len: 1319 microversion: 2.1 time: 0.244839 Jan 22 21:15:10.587595 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2615/5014] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:10 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:10.969364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d61a404-920d-4d6d-93d1-52df152998ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:10.970389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d61a404-920d-4d6d-93d1-52df152998ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:10.977432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d61a404-920d-4d6d-93d1-52df152998ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:10.977915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d61a404-920d-4d6d-93d1-52df152998ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:10.978932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d61a404-920d-4d6d-93d1-52df152998ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:10.979381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d61a404-920d-4d6d-93d1-52df152998ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:11.019797 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d61a404-920d-4d6d-93d1-52df152998ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.055132 Jan 22 21:15:11.020823 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2400/5015] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:10 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:11.251890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-45b53f1e-be1f-4a9b-a758-ca150218486b req-b94ebdff-50d2-42fc-a503-3cab2b63a021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b558471-88c9-43fa-a970-799679fcbbf4", "name": "network-vif-plugged", "status": "completed", "tag": "36634d05-9144-45d4-99b4-8efa52e8e426"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:11.253727 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:15:11.253727 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:15:11.270888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-45b53f1e-be1f-4a9b-a758-ca150218486b req-b94ebdff-50d2-42fc-a503-3cab2b63a021 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:11.276524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-45b53f1e-be1f-4a9b-a758-ca150218486b req-b94ebdff-50d2-42fc-a503-3cab2b63a021 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:11.286210 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-45b53f1e-be1f-4a9b-a758-ca150218486b req-b94ebdff-50d2-42fc-a503-3cab2b63a021 service nova] Creating event network-vif-plugged:36634d05-9144-45d4-99b4-8efa52e8e426 for instance 0b558471-88c9-43fa-a970-799679fcbbf4 on nch1-master-1 Jan 22 21:15:11.292840 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-45b53f1e-be1f-4a9b-a758-ca150218486b req-b94ebdff-50d2-42fc-a503-3cab2b63a021 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051622 Jan 22 21:15:11.294023 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2616/5016] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:15:11.509169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dccc8bbb-3ac8-4111-93f0-3621d0b711fa tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5e68e50>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:11.572451 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dccc8bbb-3ac8-4111-93f0-3621d0b711fa tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.068345 Jan 22 21:15:11.574246 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2401/5017] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:11 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:11.605072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4e80b6d3-b1c1-47c4-a789-5fc3e29edd92 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:11.605792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4e80b6d3-b1c1-47c4-a789-5fc3e29edd92 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:11.613009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e80b6d3-b1c1-47c4-a789-5fc3e29edd92 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:11.613472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e80b6d3-b1c1-47c4-a789-5fc3e29edd92 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:11.614295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e80b6d3-b1c1-47c4-a789-5fc3e29edd92 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:11.617201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e80b6d3-b1c1-47c4-a789-5fc3e29edd92 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:11.786693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4e80b6d3-b1c1-47c4-a789-5fc3e29edd92 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:11.795755 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4e80b6d3-b1c1-47c4-a789-5fc3e29edd92 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 200 len: 1319 microversion: 2.1 time: 0.195166 Jan 22 21:15:11.796848 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2617/5018] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:11 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:12.035565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee923ef5-b403-4a24-9bde-ed0b388eb049 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:12.037924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ee923ef5-b403-4a24-9bde-ed0b388eb049 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:12.045797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee923ef5-b403-4a24-9bde-ed0b388eb049 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:12.046465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee923ef5-b403-4a24-9bde-ed0b388eb049 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:12.047315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee923ef5-b403-4a24-9bde-ed0b388eb049 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:12.047766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee923ef5-b403-4a24-9bde-ed0b388eb049 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:12.089994 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee923ef5-b403-4a24-9bde-ed0b388eb049 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.060881 Jan 22 21:15:12.090862 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2402/5019] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:12 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:12.602152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c2398911-b4be-48b6-b85f-d575ed5e3c13 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed510e670>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:12.665192 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c2398911-b4be-48b6-b85f-d575ed5e3c13 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.074233 Jan 22 21:15:12.667213 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2618/5020] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:12 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:12.824971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c8e4a81b-b154-4350-8404-61ebb18e993c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:12.826038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c8e4a81b-b154-4350-8404-61ebb18e993c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:12.851093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8e4a81b-b154-4350-8404-61ebb18e993c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:12.852938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8e4a81b-b154-4350-8404-61ebb18e993c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:12.853955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8e4a81b-b154-4350-8404-61ebb18e993c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:12.855082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c8e4a81b-b154-4350-8404-61ebb18e993c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:13.097439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c8e4a81b-b154-4350-8404-61ebb18e993c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:13.107632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-10336496-54d2-4b56-8230-440f27bcbe04 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:13.108824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-10336496-54d2-4b56-8230-440f27bcbe04 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:13.124176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10336496-54d2-4b56-8230-440f27bcbe04 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:13.124777 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c8e4a81b-b154-4350-8404-61ebb18e993c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 200 len: 1319 microversion: 2.1 time: 0.303953 Jan 22 21:15:13.125111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10336496-54d2-4b56-8230-440f27bcbe04 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:13.128400 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2403/5021] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:12 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:13.138730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10336496-54d2-4b56-8230-440f27bcbe04 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:13.139593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10336496-54d2-4b56-8230-440f27bcbe04 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:13.184850 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-10336496-54d2-4b56-8230-440f27bcbe04 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.085279 Jan 22 21:15:13.185533 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2619/5022] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:13 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:13.680569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-687a4c08-4bc9-4231-8f9b-7ee164d485f2 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5a3d280>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:13.733779 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-687a4c08-4bc9-4231-8f9b-7ee164d485f2 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.057431 Jan 22 21:15:13.743526 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2404/5023] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:13 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:14.146192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e70e4f16-d409-454e-837b-c9f6763f39aa tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:14.151241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e70e4f16-d409-454e-837b-c9f6763f39aa tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:14.156876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e70e4f16-d409-454e-837b-c9f6763f39aa tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:14.157340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e70e4f16-d409-454e-837b-c9f6763f39aa tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:14.158312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e70e4f16-d409-454e-837b-c9f6763f39aa tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:14.158934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e70e4f16-d409-454e-837b-c9f6763f39aa tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:14.198928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1e1bf834-cdaa-45d4-bacd-cf6bb697918a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:14.200585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1e1bf834-cdaa-45d4-bacd-cf6bb697918a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:14.212178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e1bf834-cdaa-45d4-bacd-cf6bb697918a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:14.212829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e1bf834-cdaa-45d4-bacd-cf6bb697918a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:14.213913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e1bf834-cdaa-45d4-bacd-cf6bb697918a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:14.214605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e1bf834-cdaa-45d4-bacd-cf6bb697918a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:14.262991 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1e1bf834-cdaa-45d4-bacd-cf6bb697918a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.070071 Jan 22 21:15:14.267176 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2405/5024] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:14 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:14.350831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e70e4f16-d409-454e-837b-c9f6763f39aa tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:14.359167 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e70e4f16-d409-454e-837b-c9f6763f39aa tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 200 len: 1319 microversion: 2.1 time: 0.220201 Jan 22 21:15:14.371181 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2620/5025] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:14 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:14.751717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-188174af-7cc3-4bce-92a4-ccf9e908a8da tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5fe0d30>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:14.806653 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-188174af-7cc3-4bce-92a4-ccf9e908a8da tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.059081 Jan 22 21:15:14.807252 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2406/5026] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:14 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:15.276405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-adda263e-46cf-4229-8995-974467bdd83b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:15.278254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-adda263e-46cf-4229-8995-974467bdd83b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:15.286926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-adda263e-46cf-4229-8995-974467bdd83b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:15.287733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-adda263e-46cf-4229-8995-974467bdd83b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:15.288897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-adda263e-46cf-4229-8995-974467bdd83b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:15.289529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-adda263e-46cf-4229-8995-974467bdd83b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:15.346622 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-adda263e-46cf-4229-8995-974467bdd83b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.066656 Jan 22 21:15:15.352533 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2621/5027] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:15 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:15.398462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e9dc44b4-47d4-4ae9-85bd-7300d4309281 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:15.399342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e9dc44b4-47d4-4ae9-85bd-7300d4309281 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:15.405196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-b2dffa24-7017-4e9e-a3a2-8e0e10e2841b req-63e574b8-8dc2-4078-b1fa-1fcd8f7f874f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac5148a-6b7f-45bc-aaa2-c3a6f03ab403", "name": "network-vif-plugged", "status": "completed", "tag": "99c84d44-3ae1-4677-b4a2-4335393f1f04"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:15.408320 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:15:15.408320 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:15:15.414290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9dc44b4-47d4-4ae9-85bd-7300d4309281 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:15.415581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9dc44b4-47d4-4ae9-85bd-7300d4309281 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:15.416753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9dc44b4-47d4-4ae9-85bd-7300d4309281 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:15.417434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9dc44b4-47d4-4ae9-85bd-7300d4309281 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:15.421623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b2dffa24-7017-4e9e-a3a2-8e0e10e2841b req-63e574b8-8dc2-4078-b1fa-1fcd8f7f874f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:15.422090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b2dffa24-7017-4e9e-a3a2-8e0e10e2841b req-63e574b8-8dc2-4078-b1fa-1fcd8f7f874f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:15.437334 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-b2dffa24-7017-4e9e-a3a2-8e0e10e2841b req-63e574b8-8dc2-4078-b1fa-1fcd8f7f874f service nova] Creating event network-vif-plugged:99c84d44-3ae1-4677-b4a2-4335393f1f04 for instance dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 on nch2-master-1 Jan 22 21:15:15.446624 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-b2dffa24-7017-4e9e-a3a2-8e0e10e2841b req-63e574b8-8dc2-4078-b1fa-1fcd8f7f874f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063824 Jan 22 21:15:15.450007 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2622/5028] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:15:15.652918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e9dc44b4-47d4-4ae9-85bd-7300d4309281 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:15.660790 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e9dc44b4-47d4-4ae9-85bd-7300d4309281 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 200 len: 1319 microversion: 2.1 time: 0.277705 Jan 22 21:15:15.661586 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2407/5029] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:15 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:15.821414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a7ae40e6-6185-403b-83ff-5b82000947f1 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5f709d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:15.867851 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a7ae40e6-6185-403b-83ff-5b82000947f1 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.051388 Jan 22 21:15:15.868968 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2623/5030] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:15 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:16.364566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-05b1cabb-c625-4f0b-a741-11c65237eb34 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:16.368374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-05b1cabb-c625-4f0b-a741-11c65237eb34 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:16.377545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05b1cabb-c625-4f0b-a741-11c65237eb34 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:16.379479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05b1cabb-c625-4f0b-a741-11c65237eb34 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:16.391351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05b1cabb-c625-4f0b-a741-11c65237eb34 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:16.392115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05b1cabb-c625-4f0b-a741-11c65237eb34 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:16.450355 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-05b1cabb-c625-4f0b-a741-11c65237eb34 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.091693 Jan 22 21:15:16.462505 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2408/5031] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:16 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:16.680276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f2fe557-5f73-4aaa-abd2-ffe9a504724d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:16.681719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8f2fe557-5f73-4aaa-abd2-ffe9a504724d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:16.690288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f2fe557-5f73-4aaa-abd2-ffe9a504724d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:16.690757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f2fe557-5f73-4aaa-abd2-ffe9a504724d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:16.691756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f2fe557-5f73-4aaa-abd2-ffe9a504724d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:16.692428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f2fe557-5f73-4aaa-abd2-ffe9a504724d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:16.881834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5c255743-20e6-4ee1-aaee-410166788325 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5da8430>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:16.971452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8f2fe557-5f73-4aaa-abd2-ffe9a504724d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:16.981075 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8f2fe557-5f73-4aaa-abd2-ffe9a504724d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 200 len: 1319 microversion: 2.1 time: 0.305819 Jan 22 21:15:16.981819 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2624/5032] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:16 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:16.995465 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5c255743-20e6-4ee1-aaee-410166788325 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.116921 Jan 22 21:15:16.995465 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2409/5033] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:16 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:17.467271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c8282512-6da6-4625-afae-81e942786455 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:17.468715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c8282512-6da6-4625-afae-81e942786455 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:17.476175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8282512-6da6-4625-afae-81e942786455 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:17.476629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8282512-6da6-4625-afae-81e942786455 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:17.477549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8282512-6da6-4625-afae-81e942786455 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:17.478208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c8282512-6da6-4625-afae-81e942786455 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:17.525301 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c8282512-6da6-4625-afae-81e942786455 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.061557 Jan 22 21:15:17.526617 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2625/5034] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:17 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:17.999007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1a22d3e3-719a-4134-9593-6d2d97bc3115 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:18.000810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1a22d3e3-719a-4134-9593-6d2d97bc3115 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:18.008891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-73e801cd-2117-42dc-b58f-3d14876a5fd4 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed514cc10>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:18.013164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a22d3e3-719a-4134-9593-6d2d97bc3115 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:18.013825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a22d3e3-719a-4134-9593-6d2d97bc3115 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:18.015626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a22d3e3-719a-4134-9593-6d2d97bc3115 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:18.016516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a22d3e3-719a-4134-9593-6d2d97bc3115 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:18.074944 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-73e801cd-2117-42dc-b58f-3d14876a5fd4 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.068568 Jan 22 21:15:18.074944 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2626/5035] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:18 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:18.254740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1a22d3e3-719a-4134-9593-6d2d97bc3115 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:18.267089 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1a22d3e3-719a-4134-9593-6d2d97bc3115 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 200 len: 1506 microversion: 2.1 time: 0.272166 Jan 22 21:15:18.268224 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2410/5036] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:17 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:18.286385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ddc8c0b1-2089-4b18-ad6e-b804a6fbc267 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:18.287714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ddc8c0b1-2089-4b18-ad6e-b804a6fbc267 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:18.293671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddc8c0b1-2089-4b18-ad6e-b804a6fbc267 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:18.294260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddc8c0b1-2089-4b18-ad6e-b804a6fbc267 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:18.295244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddc8c0b1-2089-4b18-ad6e-b804a6fbc267 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:18.295872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ddc8c0b1-2089-4b18-ad6e-b804a6fbc267 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:18.331953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ddc8c0b1-2089-4b18-ad6e-b804a6fbc267 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:15:18.546678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e894c6cb-7578-4992-8fde-d7844d4a3021 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:18.551930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e894c6cb-7578-4992-8fde-d7844d4a3021 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:18.563076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e894c6cb-7578-4992-8fde-d7844d4a3021 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:18.563636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e894c6cb-7578-4992-8fde-d7844d4a3021 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:18.564447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e894c6cb-7578-4992-8fde-d7844d4a3021 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:18.564900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e894c6cb-7578-4992-8fde-d7844d4a3021 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:18.612609 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e894c6cb-7578-4992-8fde-d7844d4a3021 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.077613 Jan 22 21:15:18.613653 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2411/5037] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:18 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:18.732898 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ddc8c0b1-2089-4b18-ad6e-b804a6fbc267 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 204 len: 0 microversion: 2.1 time: 0.450882 Jan 22 21:15:18.733727 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2627/5038] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:15:18 2022] DELETE /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:15:18.742579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-67f9ff0d-54a8-4524-8281-54cd333500f9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:18.743288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-67f9ff0d-54a8-4524-8281-54cd333500f9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:18.751371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67f9ff0d-54a8-4524-8281-54cd333500f9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:18.751809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67f9ff0d-54a8-4524-8281-54cd333500f9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:18.752937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67f9ff0d-54a8-4524-8281-54cd333500f9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:18.754044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67f9ff0d-54a8-4524-8281-54cd333500f9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:18.908587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-67f9ff0d-54a8-4524-8281-54cd333500f9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:18.917225 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-67f9ff0d-54a8-4524-8281-54cd333500f9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 200 len: 1512 microversion: 2.1 time: 0.179028 Jan 22 21:15:18.917825 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2412/5039] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:18 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:19.085829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-049865ae-54c4-4d5d-b00d-5c58f3b3e155 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed50f7040>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:19.135063 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-049865ae-54c4-4d5d-b00d-5c58f3b3e155 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.053166 Jan 22 21:15:19.135634 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2628/5040] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:19 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:19.625087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-52717987-4eba-4eea-b1a5-0e6d4f512aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:19.626763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-52717987-4eba-4eea-b1a5-0e6d4f512aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:19.634490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52717987-4eba-4eea-b1a5-0e6d4f512aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:19.635279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52717987-4eba-4eea-b1a5-0e6d4f512aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:19.636328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52717987-4eba-4eea-b1a5-0e6d4f512aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:19.636867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52717987-4eba-4eea-b1a5-0e6d4f512aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:19.690512 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-52717987-4eba-4eea-b1a5-0e6d4f512aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.069122 Jan 22 21:15:19.691452 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2413/5041] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:19 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:19.934320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a2a4892b-013a-4709-86a6-29e52b421567 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:19.935419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a2a4892b-013a-4709-86a6-29e52b421567 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:19.943196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2a4892b-013a-4709-86a6-29e52b421567 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:19.944054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2a4892b-013a-4709-86a6-29e52b421567 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:19.945478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2a4892b-013a-4709-86a6-29e52b421567 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:19.946172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2a4892b-013a-4709-86a6-29e52b421567 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:20.150674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1b62b1ee-4f01-41a3-93ac-6602f2158cbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5a989d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:20.239490 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1b62b1ee-4f01-41a3-93ac-6602f2158cbd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.094303 Jan 22 21:15:20.241429 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2414/5042] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:20 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:20.248546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a2a4892b-013a-4709-86a6-29e52b421567 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:20.260752 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a2a4892b-013a-4709-86a6-29e52b421567 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 200 len: 1512 microversion: 2.1 time: 0.329658 Jan 22 21:15:20.272717 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2629/5043] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:19 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 1512 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:20.703680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9c417c0c-ae6e-44f9-a390-d57b6529bed1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:20.705533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9c417c0c-ae6e-44f9-a390-d57b6529bed1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:20.716707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c417c0c-ae6e-44f9-a390-d57b6529bed1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:20.717555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c417c0c-ae6e-44f9-a390-d57b6529bed1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:20.727548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c417c0c-ae6e-44f9-a390-d57b6529bed1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:20.727548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c417c0c-ae6e-44f9-a390-d57b6529bed1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:20.795043 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9c417c0c-ae6e-44f9-a390-d57b6529bed1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.095980 Jan 22 21:15:20.796896 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2415/5044] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:20 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:21.189491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-dd67b82c-3d8c-468a-befd-f6ee137e6d35 req-fae11668-01f0-45c1-bb6c-44659c2966ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac5148a-6b7f-45bc-aaa2-c3a6f03ab403", "name": "network-vif-deleted", "tag": "99c84d44-3ae1-4677-b4a2-4335393f1f04"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:21.191258 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:15:21.191258 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:15:21.201363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-dd67b82c-3d8c-468a-befd-f6ee137e6d35 req-fae11668-01f0-45c1-bb6c-44659c2966ba service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:21.202093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-dd67b82c-3d8c-468a-befd-f6ee137e6d35 req-fae11668-01f0-45c1-bb6c-44659c2966ba service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:21.223064 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-dd67b82c-3d8c-468a-befd-f6ee137e6d35 req-fae11668-01f0-45c1-bb6c-44659c2966ba service nova] Creating event network-vif-deleted:99c84d44-3ae1-4677-b4a2-4335393f1f04 for instance dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 on nch2-master-1 Jan 22 21:15:21.230645 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-dd67b82c-3d8c-468a-befd-f6ee137e6d35 req-fae11668-01f0-45c1-bb6c-44659c2966ba service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217249 Jan 22 21:15:21.231789 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2630/5045] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:15:21.258149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c9b04bb4-ccf6-4846-bcfc-293a0ad6520c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5a3d9d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:21.288386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c734ac8a-26eb-470a-9f3d-3bddf9a0e8b3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:21.289084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c734ac8a-26eb-470a-9f3d-3bddf9a0e8b3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:21.304812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c734ac8a-26eb-470a-9f3d-3bddf9a0e8b3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:21.305278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c734ac8a-26eb-470a-9f3d-3bddf9a0e8b3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:21.311959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c734ac8a-26eb-470a-9f3d-3bddf9a0e8b3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:21.313143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c734ac8a-26eb-470a-9f3d-3bddf9a0e8b3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:21.342788 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c9b04bb4-ccf6-4846-bcfc-293a0ad6520c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.090986 Jan 22 21:15:21.349557 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2416/5046] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:21 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:21.401866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c734ac8a-26eb-470a-9f3d-3bddf9a0e8b3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:21.409537 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c734ac8a-26eb-470a-9f3d-3bddf9a0e8b3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 200 len: 1304 microversion: 2.1 time: 0.132595 Jan 22 21:15:21.410940 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2631/5047] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:21 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:21.814636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-698477f6-1c59-4d05-9598-e0ea71ae25cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:21.816435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-698477f6-1c59-4d05-9598-e0ea71ae25cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:21.824105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-698477f6-1c59-4d05-9598-e0ea71ae25cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:21.824968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-698477f6-1c59-4d05-9598-e0ea71ae25cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:21.826232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-698477f6-1c59-4d05-9598-e0ea71ae25cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:21.826913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-698477f6-1c59-4d05-9598-e0ea71ae25cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:21.873613 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-698477f6-1c59-4d05-9598-e0ea71ae25cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.066605 Jan 22 21:15:21.877279 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2417/5048] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:21 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:22.356328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6c555199-f9fc-4e0e-9a9f-1426915f5316 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed510e940>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:22.418382 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6c555199-f9fc-4e0e-9a9f-1426915f5316 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.065830 Jan 22 21:15:22.426010 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2632/5049] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:22 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:22.435212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6ae52f9c-7bae-41b3-af41-931fadf3d6f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:22.436442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6ae52f9c-7bae-41b3-af41-931fadf3d6f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:22.444852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ae52f9c-7bae-41b3-af41-931fadf3d6f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:22.445598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ae52f9c-7bae-41b3-af41-931fadf3d6f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:22.446754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ae52f9c-7bae-41b3-af41-931fadf3d6f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:22.447296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ae52f9c-7bae-41b3-af41-931fadf3d6f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:22.464236 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-6ae52f9c-7bae-41b3-af41-931fadf3d6f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 could not be found. Jan 22 21:15:22.465007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6ae52f9c-7bae-41b3-af41-931fadf3d6f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:15:22.466226 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6ae52f9c-7bae-41b3-af41-931fadf3d6f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 404 len: 111 microversion: 2.1 time: 0.035391 Jan 22 21:15:22.467268 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2418/5050] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:22 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:15:22.580047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-325166333", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "96cc3928-7569-4c1f-becd-807913ebf734"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:22.631673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] validate_networks() for [('96cc3928-7569-4c1f-becd-807913ebf734', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:15:22.891231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-86b16156-f2b8-4736-8973-24e7f4b2d192 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:22.892235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-86b16156-f2b8-4736-8973-24e7f4b2d192 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:22.902794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86b16156-f2b8-4736-8973-24e7f4b2d192 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:22.903395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86b16156-f2b8-4736-8973-24e7f4b2d192 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:22.904195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86b16156-f2b8-4736-8973-24e7f4b2d192 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:22.904640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86b16156-f2b8-4736-8973-24e7f4b2d192 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:22.949937 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-86b16156-f2b8-4736-8973-24e7f4b2d192 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.063599 Jan 22 21:15:22.953983 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2419/5051] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:22 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:23.370565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:15:23.371089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:15:23.371517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:15:23.372135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:15:23.372560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:15:23.382566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:23.387332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:23.387332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:23.387332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:23.405699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Getting quotas for project 5b1c3aa9e1ae4cc8a5a021434ad4a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:15:23.411963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Getting quotas for user b93108a71872461ea979735a490694a6 and project 5b1c3aa9e1ae4cc8a5a021434ad4a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:15:23.424472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:15:23.427634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:15:23.434651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee33c034-f4a1-4601-a868-9e31db39de81 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5e68310>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:23.494306 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee33c034-f4a1-4601-a868-9e31db39de81 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1459 microversion: 2.1 time: 0.063640 Jan 22 21:15:23.495181 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2420/5052] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:23 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1459 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:23.633329 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e54705bf-8e94-40b2-8930-4ff631ac209a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.056958 Jan 22 21:15:23.634314 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2633/5053] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:15:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:15:23.643989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7c87bf9c-a8b4-4b0f-8f4d-7fe3c3a91e7e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:23.645488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7c87bf9c-a8b4-4b0f-8f4d-7fe3c3a91e7e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:23.716494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7c87bf9c-a8b4-4b0f-8f4d-7fe3c3a91e7e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:23.725185 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7c87bf9c-a8b4-4b0f-8f4d-7fe3c3a91e7e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1218 microversion: 2.1 time: 0.085051 Jan 22 21:15:23.735499 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2421/5054] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:23 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:23.961998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-45901c04-2d53-4464-8271-68b5253d26f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:23.965216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-45901c04-2d53-4464-8271-68b5253d26f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:23.970681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45901c04-2d53-4464-8271-68b5253d26f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:23.971050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45901c04-2d53-4464-8271-68b5253d26f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:23.971887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45901c04-2d53-4464-8271-68b5253d26f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:23.972262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45901c04-2d53-4464-8271-68b5253d26f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:24.012400 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-45901c04-2d53-4464-8271-68b5253d26f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.054389 Jan 22 21:15:24.016622 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2634/5055] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:23 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:24.508778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2fdf8c74-2063-4662-a8fc-d1f642559cc2 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5dcf550>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:24.555985 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2fdf8c74-2063-4662-a8fc-d1f642559cc2 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1468 microversion: 2.1 time: 0.051306 Jan 22 21:15:24.556595 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2422/5056] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:24 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1468 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:24.569691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d1e8ecfd-d2f2-4363-bce9-e18505f11370 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed50faa60>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:24.622922 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d1e8ecfd-d2f2-4363-bce9-e18505f11370 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 200 len: 1468 microversion: 2.1 time: 0.058027 Jan 22 21:15:24.623635 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2635/5057] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:24 2022] GET /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 1468 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:24.634563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-550a2404-69f4-4603-9c01-9141b281b954 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:24.635362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-550a2404-69f4-4603-9c01-9141b281b954 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 0b558471-88c9-43fa-a970-799679fcbbf4] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:24.641608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-550a2404-69f4-4603-9c01-9141b281b954 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:24.645958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-550a2404-69f4-4603-9c01-9141b281b954 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:24.645958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-550a2404-69f4-4603-9c01-9141b281b954 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:24.645958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-550a2404-69f4-4603-9c01-9141b281b954 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:24.742958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0f1921df-f245-4b41-be14-99ff0c7766a2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:24.744058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0f1921df-f245-4b41-be14-99ff0c7766a2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:24.796667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-550a2404-69f4-4603-9c01-9141b281b954 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:24.797864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0f1921df-f245-4b41-be14-99ff0c7766a2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:24.805157 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-550a2404-69f4-4603-9c01-9141b281b954 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4" status: 200 len: 1472 microversion: 2.1 time: 0.174175 Jan 22 21:15:24.805773 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2423/5058] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:24 2022] GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4 => generated 1472 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:24.806335 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0f1921df-f245-4b41-be14-99ff0c7766a2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1218 microversion: 2.1 time: 0.067648 Jan 22 21:15:24.807069 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2636/5059] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:24 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:24.821722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d6ec573b-6d41-4f3c-935d-07705decf819 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1394243545"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:24.822965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d6ec573b-6d41-4f3c-935d-07705decf819 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:24.829048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6ec573b-6d41-4f3c-935d-07705decf819 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:24.829404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6ec573b-6d41-4f3c-935d-07705decf819 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:24.830339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6ec573b-6d41-4f3c-935d-07705decf819 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:24.830649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6ec573b-6d41-4f3c-935d-07705decf819 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:25.025321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1f935686-d457-4844-9450-ab046ff66d9a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:25.026327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1f935686-d457-4844-9450-ab046ff66d9a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:25.034251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f935686-d457-4844-9450-ab046ff66d9a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:25.034713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f935686-d457-4844-9450-ab046ff66d9a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:25.035521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f935686-d457-4844-9450-ab046ff66d9a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:25.036063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f935686-d457-4844-9450-ab046ff66d9a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:25.074962 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1f935686-d457-4844-9450-ab046ff66d9a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.054233 Jan 22 21:15:25.075615 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2637/5060] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:25 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:25.534949 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d6ec573b-6d41-4f3c-935d-07705decf819 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "POST /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332/action" status: 202 len: 0 microversion: 2.1 time: 0.717572 Jan 22 21:15:25.536525 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2424/5061] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:15:24 2022] POST /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332/action => generated 0 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 22 21:15:25.547607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bff62c1a-8920-4e0a-b9d1-e20addaa2a49 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed50faca0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:25.605813 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bff62c1a-8920-4e0a-b9d1-e20addaa2a49 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.063571 Jan 22 21:15:25.606909 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2638/5062] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:25 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:25.824853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-264ea6a5-041d-4a0e-ba15-78da8549ae3d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:25.825474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-264ea6a5-041d-4a0e-ba15-78da8549ae3d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:25.832969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-264ea6a5-041d-4a0e-ba15-78da8549ae3d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:25.833786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-264ea6a5-041d-4a0e-ba15-78da8549ae3d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:25.834599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-264ea6a5-041d-4a0e-ba15-78da8549ae3d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:25.835045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-264ea6a5-041d-4a0e-ba15-78da8549ae3d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:25.909720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-264ea6a5-041d-4a0e-ba15-78da8549ae3d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:25.918266 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-264ea6a5-041d-4a0e-ba15-78da8549ae3d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1270 microversion: 2.1 time: 0.097639 Jan 22 21:15:25.918857 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2425/5063] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:25 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:26.088014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-64996589-24a9-4d2b-a765-080a6cc2c4b6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:26.089168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-64996589-24a9-4d2b-a765-080a6cc2c4b6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:26.095844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64996589-24a9-4d2b-a765-080a6cc2c4b6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:26.096398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64996589-24a9-4d2b-a765-080a6cc2c4b6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:26.097218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64996589-24a9-4d2b-a765-080a6cc2c4b6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:26.097701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64996589-24a9-4d2b-a765-080a6cc2c4b6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:26.146505 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-64996589-24a9-4d2b-a765-080a6cc2c4b6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.062434 Jan 22 21:15:26.147699 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2639/5064] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:26 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:26.619943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ea8848a1-cd3a-49f2-b4bd-a2559e5cf9ad tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5141430>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:26.667224 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ea8848a1-cd3a-49f2-b4bd-a2559e5cf9ad tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.051108 Jan 22 21:15:26.667804 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2426/5065] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:26 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:26.936751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ada77832-f21e-4a8f-94c5-5bdaafc9cb0d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:26.937544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ada77832-f21e-4a8f-94c5-5bdaafc9cb0d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:26.946037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ada77832-f21e-4a8f-94c5-5bdaafc9cb0d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:26.946498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ada77832-f21e-4a8f-94c5-5bdaafc9cb0d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:26.947306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ada77832-f21e-4a8f-94c5-5bdaafc9cb0d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:26.947758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ada77832-f21e-4a8f-94c5-5bdaafc9cb0d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:27.017518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ada77832-f21e-4a8f-94c5-5bdaafc9cb0d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:27.026800 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ada77832-f21e-4a8f-94c5-5bdaafc9cb0d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1276 microversion: 2.1 time: 0.094210 Jan 22 21:15:27.027749 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2640/5066] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:26 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:27.162141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-892f270b-2dea-46da-84c5-beb78e53f007 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:27.163519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-892f270b-2dea-46da-84c5-beb78e53f007 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:27.170936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-892f270b-2dea-46da-84c5-beb78e53f007 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:27.171486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-892f270b-2dea-46da-84c5-beb78e53f007 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:27.172361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-892f270b-2dea-46da-84c5-beb78e53f007 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:27.172850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-892f270b-2dea-46da-84c5-beb78e53f007 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:27.213294 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-892f270b-2dea-46da-84c5-beb78e53f007 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.056135 Jan 22 21:15:27.214681 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2427/5067] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:27 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:27.682946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-66630018-6533-40ec-84d1-972a957dbe8d tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5141430>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:27.745793 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-66630018-6533-40ec-84d1-972a957dbe8d tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.065526 Jan 22 21:15:27.752300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-83b74ea6-250a-495e-9ade-571cf0b73af1 req-63afb9e5-7146-4056-b495-9b3848a5b9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b558471-88c9-43fa-a970-799679fcbbf4", "name": "network-vif-unplugged", "status": "completed", "tag": "36634d05-9144-45d4-99b4-8efa52e8e426"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:27.754441 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:15:27.754441 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:15:27.758332 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2428/5068] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:27 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:27.764809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-83b74ea6-250a-495e-9ade-571cf0b73af1 req-63afb9e5-7146-4056-b495-9b3848a5b9df service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:27.765275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-83b74ea6-250a-495e-9ade-571cf0b73af1 req-63afb9e5-7146-4056-b495-9b3848a5b9df service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:27.777317 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-83b74ea6-250a-495e-9ade-571cf0b73af1 req-63afb9e5-7146-4056-b495-9b3848a5b9df service nova] Creating event network-vif-unplugged:36634d05-9144-45d4-99b4-8efa52e8e426 for instance 0b558471-88c9-43fa-a970-799679fcbbf4 on nch1-master-1 Jan 22 21:15:27.782909 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-83b74ea6-250a-495e-9ade-571cf0b73af1 req-63afb9e5-7146-4056-b495-9b3848a5b9df service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.197205 Jan 22 21:15:27.784053 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2641/5069] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:15:28.044426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e778a2e1-a293-41bf-9d6d-d39efafc1ca9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:28.045917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e778a2e1-a293-41bf-9d6d-d39efafc1ca9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:28.064205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e778a2e1-a293-41bf-9d6d-d39efafc1ca9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:28.064691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e778a2e1-a293-41bf-9d6d-d39efafc1ca9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:28.065552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e778a2e1-a293-41bf-9d6d-d39efafc1ca9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:28.066013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e778a2e1-a293-41bf-9d6d-d39efafc1ca9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:28.228407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d449f411-8f80-41f1-84df-882d08ac7452 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:28.230050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d449f411-8f80-41f1-84df-882d08ac7452 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:28.237461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d449f411-8f80-41f1-84df-882d08ac7452 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:28.238214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d449f411-8f80-41f1-84df-882d08ac7452 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:28.240013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d449f411-8f80-41f1-84df-882d08ac7452 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:28.240463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d449f411-8f80-41f1-84df-882d08ac7452 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:28.285012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e778a2e1-a293-41bf-9d6d-d39efafc1ca9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:28.288179 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d449f411-8f80-41f1-84df-882d08ac7452 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.066000 Jan 22 21:15:28.289453 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2642/5070] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:28 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:15:28.293870 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e778a2e1-a293-41bf-9d6d-d39efafc1ca9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1318 microversion: 2.1 time: 0.253376 Jan 22 21:15:28.294538 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2429/5071] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:28 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:28.425601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-8d5319ee-b8c1-4faf-bb02-bd2c79a9d480 req-0b45079f-088f-4619-93ea-0d61c6f5efa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d60673-d54a-4970-8d8f-0419aee033dd", "tag": "e3388e05-28cd-44b5-a15c-33f2a2e91ee6"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:28.427548 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:15:28.427548 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:15:28.435829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8d5319ee-b8c1-4faf-bb02-bd2c79a9d480 req-0b45079f-088f-4619-93ea-0d61c6f5efa3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:28.436283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8d5319ee-b8c1-4faf-bb02-bd2c79a9d480 req-0b45079f-088f-4619-93ea-0d61c6f5efa3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:28.448023 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-8d5319ee-b8c1-4faf-bb02-bd2c79a9d480 req-0b45079f-088f-4619-93ea-0d61c6f5efa3 service nova] Creating event network-changed:e3388e05-28cd-44b5-a15c-33f2a2e91ee6 for instance 29d60673-d54a-4970-8d8f-0419aee033dd on nch2-master-1 Jan 22 21:15:28.456704 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-8d5319ee-b8c1-4faf-bb02-bd2c79a9d480 req-0b45079f-088f-4619-93ea-0d61c6f5efa3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035123 Jan 22 21:15:28.457477 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2643/5072] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:15:28.771633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9e6716d4-5bf6-40ab-aeff-4787dd894418 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5de55e0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:28.840221 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9e6716d4-5bf6-40ab-aeff-4787dd894418 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.072858 Jan 22 21:15:28.840811 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2430/5073] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:28 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:29.303136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61c0252e-7a5c-4c72-83a2-178534b26bb9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:29.304848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-61c0252e-7a5c-4c72-83a2-178534b26bb9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:29.312539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61c0252e-7a5c-4c72-83a2-178534b26bb9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:29.312999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61c0252e-7a5c-4c72-83a2-178534b26bb9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:29.314031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61c0252e-7a5c-4c72-83a2-178534b26bb9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:29.314631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-41cc191b-f580-4a74-b3b8-b7d99d590425 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:29.314763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61c0252e-7a5c-4c72-83a2-178534b26bb9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:29.315254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-41cc191b-f580-4a74-b3b8-b7d99d590425 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:29.323592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41cc191b-f580-4a74-b3b8-b7d99d590425 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:29.324359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41cc191b-f580-4a74-b3b8-b7d99d590425 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:29.325527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41cc191b-f580-4a74-b3b8-b7d99d590425 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:29.325930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41cc191b-f580-4a74-b3b8-b7d99d590425 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:29.366496 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61c0252e-7a5c-4c72-83a2-178534b26bb9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.067750 Jan 22 21:15:29.367825 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2644/5074] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:29 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:29.667982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-41cc191b-f580-4a74-b3b8-b7d99d590425 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:29.675679 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-41cc191b-f580-4a74-b3b8-b7d99d590425 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1318 microversion: 2.1 time: 0.364701 Jan 22 21:15:29.677230 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2431/5075] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:29 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:29.800951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-cd3a90ab-390c-46b9-9ff3-227c2d37afae req-edb17c9c-1dfa-414f-a2e0-e5e4af5e5612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72918dc8-a7cc-4046-aa2d-9a91eb7d5332", "name": "network-vif-plugged", "status": "completed", "tag": "36e7c743-4981-4f44-8177-d4ee4fdfa234"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:29.803051 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:15:29.803051 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:15:29.811735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-cd3a90ab-390c-46b9-9ff3-227c2d37afae req-edb17c9c-1dfa-414f-a2e0-e5e4af5e5612 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:29.812188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-cd3a90ab-390c-46b9-9ff3-227c2d37afae req-edb17c9c-1dfa-414f-a2e0-e5e4af5e5612 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:29.828224 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-cd3a90ab-390c-46b9-9ff3-227c2d37afae req-edb17c9c-1dfa-414f-a2e0-e5e4af5e5612 service nova] Creating event network-vif-plugged:36e7c743-4981-4f44-8177-d4ee4fdfa234 for instance 72918dc8-a7cc-4046-aa2d-9a91eb7d5332 on nch1-master-1 Jan 22 21:15:29.832741 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-cd3a90ab-390c-46b9-9ff3-227c2d37afae req-edb17c9c-1dfa-414f-a2e0-e5e4af5e5612 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035833 Jan 22 21:15:29.833394 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2645/5076] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:15:29.852598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3fe3a684-3979-42df-ba7c-6f2dffcc053c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5e681f0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:29.897932 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3fe3a684-3979-42df-ba7c-6f2dffcc053c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.048878 Jan 22 21:15:29.903423 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2432/5077] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:29 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:30.380002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d5ca7b47-f52c-4a69-baf4-297d69510a0b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:30.381899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d5ca7b47-f52c-4a69-baf4-297d69510a0b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:30.391761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5ca7b47-f52c-4a69-baf4-297d69510a0b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:30.392631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5ca7b47-f52c-4a69-baf4-297d69510a0b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:30.393531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5ca7b47-f52c-4a69-baf4-297d69510a0b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:30.393998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5ca7b47-f52c-4a69-baf4-297d69510a0b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:30.437178 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d5ca7b47-f52c-4a69-baf4-297d69510a0b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.062482 Jan 22 21:15:30.438581 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2646/5078] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:30 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:30.693245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-338a4819-45da-4997-9624-acbe236030ba tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:30.695010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-338a4819-45da-4997-9624-acbe236030ba tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:30.702041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-338a4819-45da-4997-9624-acbe236030ba tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:30.702656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-338a4819-45da-4997-9624-acbe236030ba tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:30.704497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-338a4819-45da-4997-9624-acbe236030ba tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:30.704497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-338a4819-45da-4997-9624-acbe236030ba tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:30.844484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-338a4819-45da-4997-9624-acbe236030ba tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:30.852887 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-338a4819-45da-4997-9624-acbe236030ba tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1318 microversion: 2.1 time: 0.163857 Jan 22 21:15:30.853577 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2433/5079] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:30 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:30.916824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ccdedcf5-01c6-4317-bd6c-b882146b1c88 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed510ea60>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:30.972922 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ccdedcf5-01c6-4317-bd6c-b882146b1c88 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.065631 Jan 22 21:15:30.973493 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2647/5080] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:30 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:31.451703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7dccad86-9aa6-4ce3-947b-91225a46bc8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:31.452892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7dccad86-9aa6-4ce3-947b-91225a46bc8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:31.460339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7dccad86-9aa6-4ce3-947b-91225a46bc8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:31.460810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7dccad86-9aa6-4ce3-947b-91225a46bc8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:31.461696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7dccad86-9aa6-4ce3-947b-91225a46bc8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:31.462075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7dccad86-9aa6-4ce3-947b-91225a46bc8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:31.506005 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7dccad86-9aa6-4ce3-947b-91225a46bc8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.058480 Jan 22 21:15:31.507563 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2434/5081] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:31 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:31.539662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0bf4c971-83c3-444d-8dde-7fd844d7510c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:31.540292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0bf4c971-83c3-444d-8dde-7fd844d7510c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:31.548615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bf4c971-83c3-444d-8dde-7fd844d7510c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:31.549054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bf4c971-83c3-444d-8dde-7fd844d7510c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:31.549892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bf4c971-83c3-444d-8dde-7fd844d7510c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:31.550344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bf4c971-83c3-444d-8dde-7fd844d7510c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:31.631654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-0bf4c971-83c3-444d-8dde-7fd844d7510c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lazy-loading 'services' on Instance uuid 3b3e8847-08c7-4122-914b-d4650821edcc {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:15:31.871404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a7fb98cd-4129-4787-8898-6c449bffdb6e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:31.872271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a7fb98cd-4129-4787-8898-6c449bffdb6e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:31.886511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7fb98cd-4129-4787-8898-6c449bffdb6e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:31.887408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7fb98cd-4129-4787-8898-6c449bffdb6e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:31.888378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7fb98cd-4129-4787-8898-6c449bffdb6e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:31.889089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7fb98cd-4129-4787-8898-6c449bffdb6e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:32.009135 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0bf4c971-83c3-444d-8dde-7fd844d7510c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "DELETE /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/os-volume_attachments/2b554aa9-05f4-43e4-9e7d-76a8b52309ae" status: 202 len: 0 microversion: 2.1 time: 0.474423 Jan 22 21:15:32.010552 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2648/5082] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 21:15:31 2022] DELETE /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/os-volume_attachments/2b554aa9-05f4-43e4-9e7d-76a8b52309ae => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:32.043286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-03785457-d9dc-49f9-a916-db54f2be621b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edaecd550>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:32.083441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a7fb98cd-4129-4787-8898-6c449bffdb6e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:32.094323 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a7fb98cd-4129-4787-8898-6c449bffdb6e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1318 microversion: 2.1 time: 0.226692 Jan 22 21:15:32.094323 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2435/5083] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:31 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:32.111318 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-03785457-d9dc-49f9-a916-db54f2be621b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.098575 Jan 22 21:15:32.111828 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2649/5084] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:32 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:32.518822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ced8ab2a-e51b-4e66-a7eb-243b77d65ba1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:32.519861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ced8ab2a-e51b-4e66-a7eb-243b77d65ba1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:32.531039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ced8ab2a-e51b-4e66-a7eb-243b77d65ba1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:32.531506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ced8ab2a-e51b-4e66-a7eb-243b77d65ba1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:32.532718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ced8ab2a-e51b-4e66-a7eb-243b77d65ba1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:32.533448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ced8ab2a-e51b-4e66-a7eb-243b77d65ba1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:32.579229 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ced8ab2a-e51b-4e66-a7eb-243b77d65ba1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.063986 Jan 22 21:15:32.581774 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2436/5085] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:32 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:33.110778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dbcf836b-9152-4c34-90dc-7c3eb35de11c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:33.111985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dbcf836b-9152-4c34-90dc-7c3eb35de11c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:33.126015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c0a3061d-9fb7-4c2a-a6cf-683dfc6adde4 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed60c7a60>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:33.128726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbcf836b-9152-4c34-90dc-7c3eb35de11c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:33.130395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbcf836b-9152-4c34-90dc-7c3eb35de11c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:33.133451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbcf836b-9152-4c34-90dc-7c3eb35de11c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:33.133946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dbcf836b-9152-4c34-90dc-7c3eb35de11c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:33.215641 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c0a3061d-9fb7-4c2a-a6cf-683dfc6adde4 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.092888 Jan 22 21:15:33.218789 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2437/5086] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:33 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:33.398635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0b1dda6a-ec53-47af-9952-b26af58ba5a5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:33.407187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b1dda6a-ec53-47af-9952-b26af58ba5a5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:33.407967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b1dda6a-ec53-47af-9952-b26af58ba5a5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:33.431560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dbcf836b-9152-4c34-90dc-7c3eb35de11c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:33.437270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0b1dda6a-ec53-47af-9952-b26af58ba5a5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Going to try to stop instance {{(pid=137033) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 22 21:15:33.441399 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dbcf836b-9152-4c34-90dc-7c3eb35de11c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1318 microversion: 2.1 time: 0.334521 Jan 22 21:15:33.442395 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2650/5087] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:33 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:33.594211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab5d9f5a-ef71-41bf-a602-dc8b2a5e8dd9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:33.595834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ab5d9f5a-ef71-41bf-a602-dc8b2a5e8dd9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:33.611319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab5d9f5a-ef71-41bf-a602-dc8b2a5e8dd9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:33.615509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab5d9f5a-ef71-41bf-a602-dc8b2a5e8dd9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:33.621707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab5d9f5a-ef71-41bf-a602-dc8b2a5e8dd9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:33.621707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab5d9f5a-ef71-41bf-a602-dc8b2a5e8dd9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:33.683988 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab5d9f5a-ef71-41bf-a602-dc8b2a5e8dd9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.093941 Jan 22 21:15:33.686058 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2651/5088] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:33 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:33.716481 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0b1dda6a-ec53-47af-9952-b26af58ba5a5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 202 len: 0 microversion: 2.1 time: 0.321878 Jan 22 21:15:33.717262 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2438/5089] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:15:33 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:15:33.729222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a818bb9-bd9c-42e2-bb7e-76e42b107676 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:33.730468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a818bb9-bd9c-42e2-bb7e-76e42b107676 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:33.740737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a818bb9-bd9c-42e2-bb7e-76e42b107676 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:33.741586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a818bb9-bd9c-42e2-bb7e-76e42b107676 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:33.742674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a818bb9-bd9c-42e2-bb7e-76e42b107676 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:33.743317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a818bb9-bd9c-42e2-bb7e-76e42b107676 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:33.926896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6a818bb9-bd9c-42e2-bb7e-76e42b107676 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:33.937029 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a818bb9-bd9c-42e2-bb7e-76e42b107676 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1682 microversion: 2.1 time: 0.214450 Jan 22 21:15:33.938141 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2652/5090] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:33 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:34.230217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e048d0b6-3a27-4beb-8f51-8e9272fd16ae tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5e13550>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:34.283578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a6516ffd-44a0-4ff2-bf5a-595b31991efd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'create', calling method: .version_select at 0x7f1ed5e68040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-164490969"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:34.292750 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e048d0b6-3a27-4beb-8f51-8e9272fd16ae tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.066289 Jan 22 21:15:34.302255 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2653/5091] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:34 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:34.310062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-a6516ffd-44a0-4ff2-bf5a-595b31991efd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:15:34.327459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-a6516ffd-44a0-4ff2-bf5a-595b31991efd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for user 80aa2e03fde44436844a88a0ccc5d6a6 and project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:15:34.462981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-868a3bfd-ee47-4881-9a82-bf7cc274abde tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:34.463819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-868a3bfd-ee47-4881-9a82-bf7cc274abde tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:34.472417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-868a3bfd-ee47-4881-9a82-bf7cc274abde tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:34.473365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-868a3bfd-ee47-4881-9a82-bf7cc274abde tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:34.474582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-868a3bfd-ee47-4881-9a82-bf7cc274abde tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:34.475283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-868a3bfd-ee47-4881-9a82-bf7cc274abde tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:34.546790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-a6516ffd-44a0-4ff2-bf5a-595b31991efd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:15:34.553288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-a6516ffd-44a0-4ff2-bf5a-595b31991efd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for user 80aa2e03fde44436844a88a0ccc5d6a6 and project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:15:34.572211 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a6516ffd-44a0-4ff2-bf5a-595b31991efd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.542554 Jan 22 21:15:34.573202 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2439/5092] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:15:34 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:34.687358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-868a3bfd-ee47-4881-9a82-bf7cc274abde tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:34.698765 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-868a3bfd-ee47-4881-9a82-bf7cc274abde tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1318 microversion: 2.1 time: 0.240907 Jan 22 21:15:34.702858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-311223a8-5719-4af7-b462-ca536d365b64 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:34.703941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-311223a8-5719-4af7-b462-ca536d365b64 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:34.710191 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2654/5093] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:34 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:34.735667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-311223a8-5719-4af7-b462-ca536d365b64 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:34.735667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-311223a8-5719-4af7-b462-ca536d365b64 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:34.736775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-311223a8-5719-4af7-b462-ca536d365b64 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:34.742019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-311223a8-5719-4af7-b462-ca536d365b64 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:34.811356 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-311223a8-5719-4af7-b462-ca536d365b64 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.114110 Jan 22 21:15:34.812023 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2440/5094] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:34 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:15:34.956155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e90d34d3-5253-41dc-8abf-30c850afe7db tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:34.956789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e90d34d3-5253-41dc-8abf-30c850afe7db tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:34.966799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e90d34d3-5253-41dc-8abf-30c850afe7db tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:34.973609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e90d34d3-5253-41dc-8abf-30c850afe7db tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:34.974719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e90d34d3-5253-41dc-8abf-30c850afe7db tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:34.975378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e90d34d3-5253-41dc-8abf-30c850afe7db tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:35.182348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e90d34d3-5253-41dc-8abf-30c850afe7db tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:35.189849 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e90d34d3-5253-41dc-8abf-30c850afe7db tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1682 microversion: 2.1 time: 0.237505 Jan 22 21:15:35.190750 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2655/5095] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:34 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1682 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:35.307143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-60d19773-c520-4f25-9eaa-228e408a82e5 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5d67f70>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:35.369420 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-60d19773-c520-4f25-9eaa-228e408a82e5 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.067448 Jan 22 21:15:35.370707 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2441/5096] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:35 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:35.427187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-33c8a113-932a-4524-aa1b-7cc24231fcdf req-44e838b7-d408-4599-8491-f9d98e129e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d60673-d54a-4970-8d8f-0419aee033dd", "name": "network-vif-plugged", "status": "completed", "tag": "e3388e05-28cd-44b5-a15c-33f2a2e91ee6"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:35.429536 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:15:35.429536 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:15:35.440222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-33c8a113-932a-4524-aa1b-7cc24231fcdf req-44e838b7-d408-4599-8491-f9d98e129e5e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:35.440662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-33c8a113-932a-4524-aa1b-7cc24231fcdf req-44e838b7-d408-4599-8491-f9d98e129e5e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:35.452858 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-33c8a113-932a-4524-aa1b-7cc24231fcdf req-44e838b7-d408-4599-8491-f9d98e129e5e service nova] Creating event network-vif-plugged:e3388e05-28cd-44b5-a15c-33f2a2e91ee6 for instance 29d60673-d54a-4970-8d8f-0419aee033dd on nch2-master-1 Jan 22 21:15:35.461820 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-33c8a113-932a-4524-aa1b-7cc24231fcdf req-44e838b7-d408-4599-8491-f9d98e129e5e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037966 Jan 22 21:15:35.462996 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2656/5097] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:15:35.721354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b2d740c0-9c9e-4df8-a84a-a1825b37c1e6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:35.725449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b2d740c0-9c9e-4df8-a84a-a1825b37c1e6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:35.730654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2d740c0-9c9e-4df8-a84a-a1825b37c1e6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:35.732119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2d740c0-9c9e-4df8-a84a-a1825b37c1e6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:35.733328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2d740c0-9c9e-4df8-a84a-a1825b37c1e6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:35.734529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2d740c0-9c9e-4df8-a84a-a1825b37c1e6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:35.843539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-71eab8f1-192b-4d32-8609-f164e5138631 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:35.847164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-71eab8f1-192b-4d32-8609-f164e5138631 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:35.859038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71eab8f1-192b-4d32-8609-f164e5138631 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:35.859734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71eab8f1-192b-4d32-8609-f164e5138631 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:35.869876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71eab8f1-192b-4d32-8609-f164e5138631 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:35.871103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71eab8f1-192b-4d32-8609-f164e5138631 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:35.952648 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-71eab8f1-192b-4d32-8609-f164e5138631 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.113023 Jan 22 21:15:35.953332 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2657/5098] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:35 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:15:36.020383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b2d740c0-9c9e-4df8-a84a-a1825b37c1e6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:36.033468 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b2d740c0-9c9e-4df8-a84a-a1825b37c1e6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1318 microversion: 2.1 time: 0.318867 Jan 22 21:15:36.044304 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2442/5099] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:35 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:36.208867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-73f92209-137a-4024-b85a-b7456b8057e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:36.209650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-73f92209-137a-4024-b85a-b7456b8057e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:36.216788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73f92209-137a-4024-b85a-b7456b8057e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:36.217336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73f92209-137a-4024-b85a-b7456b8057e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:36.218333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73f92209-137a-4024-b85a-b7456b8057e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:36.218854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73f92209-137a-4024-b85a-b7456b8057e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:36.369448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-73f92209-137a-4024-b85a-b7456b8057e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:36.377171 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-73f92209-137a-4024-b85a-b7456b8057e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1682 microversion: 2.1 time: 0.173063 Jan 22 21:15:36.378290 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2658/5100] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:36 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:36.382576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-09fa4c9b-e376-4f9c-8a7e-f7bb59488b67 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5a980d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:36.428531 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-09fa4c9b-e376-4f9c-8a7e-f7bb59488b67 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.049801 Jan 22 21:15:36.429097 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2443/5101] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:36 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:36.967668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-85eb2706-24a6-4135-95c7-722d1cff4d8d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:36.970356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-85eb2706-24a6-4135-95c7-722d1cff4d8d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:36.980223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85eb2706-24a6-4135-95c7-722d1cff4d8d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:36.981197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85eb2706-24a6-4135-95c7-722d1cff4d8d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:36.982372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85eb2706-24a6-4135-95c7-722d1cff4d8d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:36.983075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85eb2706-24a6-4135-95c7-722d1cff4d8d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:37.029042 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-85eb2706-24a6-4135-95c7-722d1cff4d8d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.066088 Jan 22 21:15:37.030952 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2659/5102] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:36 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:37.054549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-868b4769-3111-4fa8-abad-ada26587e74c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:37.055302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-868b4769-3111-4fa8-abad-ada26587e74c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:37.063260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-868b4769-3111-4fa8-abad-ada26587e74c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:37.064009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-868b4769-3111-4fa8-abad-ada26587e74c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:37.064963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-868b4769-3111-4fa8-abad-ada26587e74c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:37.065492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-868b4769-3111-4fa8-abad-ada26587e74c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:37.275846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-868b4769-3111-4fa8-abad-ada26587e74c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:37.288563 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-868b4769-3111-4fa8-abad-ada26587e74c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1318 microversion: 2.1 time: 0.240934 Jan 22 21:15:37.300627 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2444/5103] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:37 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:37.399722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6afc9991-7628-4b29-b2ff-67aa77ecc4fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:37.404590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6afc9991-7628-4b29-b2ff-67aa77ecc4fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:37.415224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6afc9991-7628-4b29-b2ff-67aa77ecc4fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:37.415835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6afc9991-7628-4b29-b2ff-67aa77ecc4fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:37.416943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6afc9991-7628-4b29-b2ff-67aa77ecc4fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:37.417664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6afc9991-7628-4b29-b2ff-67aa77ecc4fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:37.441960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b01a60df-f9f0-488c-adb5-deaac2bc0d9e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edaeeb670>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:37.531259 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b01a60df-f9f0-488c-adb5-deaac2bc0d9e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.091929 Jan 22 21:15:37.532382 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2445/5104] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:37 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:37.638065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6afc9991-7628-4b29-b2ff-67aa77ecc4fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:37.646241 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6afc9991-7628-4b29-b2ff-67aa77ecc4fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1682 microversion: 2.1 time: 0.252795 Jan 22 21:15:37.655778 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2660/5105] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:37 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1682 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:38.044365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2d50464d-0c0d-409e-8492-9e6d9aacb424 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:38.045487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2d50464d-0c0d-409e-8492-9e6d9aacb424 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:38.054273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d50464d-0c0d-409e-8492-9e6d9aacb424 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:38.055074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d50464d-0c0d-409e-8492-9e6d9aacb424 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:38.056422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d50464d-0c0d-409e-8492-9e6d9aacb424 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:38.056881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d50464d-0c0d-409e-8492-9e6d9aacb424 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:38.107597 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2d50464d-0c0d-409e-8492-9e6d9aacb424 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.068270 Jan 22 21:15:38.109361 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2446/5106] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:38 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:38.306625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-702c769d-3d23-4be1-8970-2f13b99edd81 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:38.307979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-702c769d-3d23-4be1-8970-2f13b99edd81 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:38.315193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-702c769d-3d23-4be1-8970-2f13b99edd81 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:38.315868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-702c769d-3d23-4be1-8970-2f13b99edd81 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:38.316806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-702c769d-3d23-4be1-8970-2f13b99edd81 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:38.319411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-702c769d-3d23-4be1-8970-2f13b99edd81 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:38.544156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-702c769d-3d23-4be1-8970-2f13b99edd81 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:38.547973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5b7c3b5e-aa3b-4ee8-9dac-59557d836e25 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed63c9160>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:38.552913 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-702c769d-3d23-4be1-8970-2f13b99edd81 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1504 microversion: 2.1 time: 0.249660 Jan 22 21:15:38.571474 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2661/5107] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:38 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1504 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:38.636719 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5b7c3b5e-aa3b-4ee8-9dac-59557d836e25 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.095655 Jan 22 21:15:38.649489 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2447/5108] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:38 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:38.665023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5dfa4375-4608-4807-b75d-cf1c9f8c871a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:38.666526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5dfa4375-4608-4807-b75d-cf1c9f8c871a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:38.678952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5dfa4375-4608-4807-b75d-cf1c9f8c871a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:38.679782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5dfa4375-4608-4807-b75d-cf1c9f8c871a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:38.684239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5dfa4375-4608-4807-b75d-cf1c9f8c871a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:38.684794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5dfa4375-4608-4807-b75d-cf1c9f8c871a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:38.899559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5dfa4375-4608-4807-b75d-cf1c9f8c871a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:38.908988 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5dfa4375-4608-4807-b75d-cf1c9f8c871a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1682 microversion: 2.1 time: 0.249226 Jan 22 21:15:38.922189 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2662/5109] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:38 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1682 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:39.132981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f6fcd468-afe2-47ee-bfd5-a7f5f13c9032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:39.134707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f6fcd468-afe2-47ee-bfd5-a7f5f13c9032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:39.143062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6fcd468-afe2-47ee-bfd5-a7f5f13c9032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:39.144348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6fcd468-afe2-47ee-bfd5-a7f5f13c9032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:39.145784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6fcd468-afe2-47ee-bfd5-a7f5f13c9032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:39.149083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6fcd468-afe2-47ee-bfd5-a7f5f13c9032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:39.213802 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f6fcd468-afe2-47ee-bfd5-a7f5f13c9032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.089070 Jan 22 21:15:39.215199 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2448/5110] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:39 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:39.660091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c95363a6-c188-4ae2-a2e7-7cc388a051d4 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed510e310>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:39.914928 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c95363a6-c188-4ae2-a2e7-7cc388a051d4 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.059409 Jan 22 21:15:39.914928 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2663/5111] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:39 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:39.927167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e4529993-5b91-43ed-9037-73d0b184d62f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:39.927949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e4529993-5b91-43ed-9037-73d0b184d62f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:39.936111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4529993-5b91-43ed-9037-73d0b184d62f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:39.936700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4529993-5b91-43ed-9037-73d0b184d62f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:39.937735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4529993-5b91-43ed-9037-73d0b184d62f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:39.938259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4529993-5b91-43ed-9037-73d0b184d62f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:40.149043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e4529993-5b91-43ed-9037-73d0b184d62f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:40.156785 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e4529993-5b91-43ed-9037-73d0b184d62f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1682 microversion: 2.1 time: 0.234082 Jan 22 21:15:40.157362 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2449/5112] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:39 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1682 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:40.226801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d5b82cfd-d4f6-440b-b3f9-3d96fdfb38c9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:40.227753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d5b82cfd-d4f6-440b-b3f9-3d96fdfb38c9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:40.234593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5b82cfd-d4f6-440b-b3f9-3d96fdfb38c9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:40.235053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5b82cfd-d4f6-440b-b3f9-3d96fdfb38c9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:40.235881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5b82cfd-d4f6-440b-b3f9-3d96fdfb38c9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:40.236330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5b82cfd-d4f6-440b-b3f9-3d96fdfb38c9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:40.280576 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d5b82cfd-d4f6-440b-b3f9-3d96fdfb38c9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.058219 Jan 22 21:15:40.281384 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2664/5113] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:40 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:40.728862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-27c03216-3e58-47a2-bff5-05f761524af1 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5dcf4c0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:40.787412 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-27c03216-3e58-47a2-bff5-05f761524af1 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.062401 Jan 22 21:15:40.788028 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2450/5114] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:40 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:41.176690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-204c2af7-04df-477b-8577-3445e65600ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:41.178946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-204c2af7-04df-477b-8577-3445e65600ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:41.198131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-204c2af7-04df-477b-8577-3445e65600ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:41.199032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-204c2af7-04df-477b-8577-3445e65600ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:41.200305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-204c2af7-04df-477b-8577-3445e65600ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:41.201040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-204c2af7-04df-477b-8577-3445e65600ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:41.294152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0b427b1a-81ac-4ef0-bfbe-1c555ebc1f46 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:41.295090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0b427b1a-81ac-4ef0-bfbe-1c555ebc1f46 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:41.303890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b427b1a-81ac-4ef0-bfbe-1c555ebc1f46 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:41.308219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b427b1a-81ac-4ef0-bfbe-1c555ebc1f46 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:41.308219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b427b1a-81ac-4ef0-bfbe-1c555ebc1f46 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:41.308219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b427b1a-81ac-4ef0-bfbe-1c555ebc1f46 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:41.359174 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0b427b1a-81ac-4ef0-bfbe-1c555ebc1f46 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.069752 Jan 22 21:15:41.360713 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2451/5115] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:41 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:41.581813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-204c2af7-04df-477b-8577-3445e65600ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:41.594551 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-204c2af7-04df-477b-8577-3445e65600ae tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1682 microversion: 2.1 time: 0.423854 Jan 22 21:15:41.605902 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2665/5116] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:41 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1682 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:41.804851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-08067462-47e2-4dab-9b66-c64e034d3ee7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5d73ca0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:41.903877 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-08067462-47e2-4dab-9b66-c64e034d3ee7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.106452 Jan 22 21:15:41.905456 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2452/5117] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:41 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:42.372721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ac8876d4-3d6d-4633-8ca2-003e5f585a00 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:42.374112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ac8876d4-3d6d-4633-8ca2-003e5f585a00 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:42.404701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac8876d4-3d6d-4633-8ca2-003e5f585a00 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:42.406537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac8876d4-3d6d-4633-8ca2-003e5f585a00 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:42.421872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac8876d4-3d6d-4633-8ca2-003e5f585a00 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:42.427182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac8876d4-3d6d-4633-8ca2-003e5f585a00 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:42.523091 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ac8876d4-3d6d-4633-8ca2-003e5f585a00 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.153690 Jan 22 21:15:42.536112 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2666/5118] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:42 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:15:42.616169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-68c9d1e8-c400-4f95-91fa-55f364d2d770 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:42.617061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-68c9d1e8-c400-4f95-91fa-55f364d2d770 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:42.627639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68c9d1e8-c400-4f95-91fa-55f364d2d770 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:42.629621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68c9d1e8-c400-4f95-91fa-55f364d2d770 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:42.634123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68c9d1e8-c400-4f95-91fa-55f364d2d770 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:42.634590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68c9d1e8-c400-4f95-91fa-55f364d2d770 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:42.841957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dcf5f1a6-5bf0-4811-b425-b98e5b81c67c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17dd6a14-8c30-4a4b-8cea-30088ada2948"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:42.843259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dcf5f1a6-5bf0-4811-b425-b98e5b81c67c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:42.870111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dcf5f1a6-5bf0-4811-b425-b98e5b81c67c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:42.870111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dcf5f1a6-5bf0-4811-b425-b98e5b81c67c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:42.870111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dcf5f1a6-5bf0-4811-b425-b98e5b81c67c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:42.870111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dcf5f1a6-5bf0-4811-b425-b98e5b81c67c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:43.354305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-68c9d1e8-c400-4f95-91fa-55f364d2d770 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:43.362926 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-68c9d1e8-c400-4f95-91fa-55f364d2d770 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1682 microversion: 2.1 time: 0.751493 Jan 22 21:15:43.365906 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2453/5119] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:42 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1682 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:43.385097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-964d961f-6a51-4da0-9c14-16b6cf7921c2 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5ffc5e0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:43.482657 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-964d961f-6a51-4da0-9c14-16b6cf7921c2 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.107535 Jan 22 21:15:43.483275 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2454/5120] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:43 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:43.545007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-69d0a5e4-c397-428d-ab83-e35566733e8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:43.546545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-69d0a5e4-c397-428d-ab83-e35566733e8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:43.579456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69d0a5e4-c397-428d-ab83-e35566733e8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:43.580321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69d0a5e4-c397-428d-ab83-e35566733e8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:43.581359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69d0a5e4-c397-428d-ab83-e35566733e8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:43.582340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69d0a5e4-c397-428d-ab83-e35566733e8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:43.638987 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-69d0a5e4-c397-428d-ab83-e35566733e8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.097518 Jan 22 21:15:43.648640 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2455/5121] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:43 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:15:44.070500 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dcf5f1a6-5bf0-4811-b425-b98e5b81c67c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "POST /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.252647 Jan 22 21:15:44.071710 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2667/5122] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:15:42 2022] POST /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd/os-volume_attachments => generated 194 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:15:44.384298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c2a4c79c-a5df-4e88-aa65-da9920c29420 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:44.385241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c2a4c79c-a5df-4e88-aa65-da9920c29420 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:44.393713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2a4c79c-a5df-4e88-aa65-da9920c29420 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:44.394373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2a4c79c-a5df-4e88-aa65-da9920c29420 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:44.395366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2a4c79c-a5df-4e88-aa65-da9920c29420 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:44.396645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2a4c79c-a5df-4e88-aa65-da9920c29420 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:44.496760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-40221ec7-7a28-4634-9421-9cb24914c498 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edaf31280>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:44.622300 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-40221ec7-7a28-4634-9421-9cb24914c498 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.129672 Jan 22 21:15:44.622901 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2668/5123] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:44 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:44.659076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f206e095-be1b-4c0e-ba35-df4df84dbade tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:44.660174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f206e095-be1b-4c0e-ba35-df4df84dbade tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:44.674369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f206e095-be1b-4c0e-ba35-df4df84dbade tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:44.674871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f206e095-be1b-4c0e-ba35-df4df84dbade tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:44.675713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f206e095-be1b-4c0e-ba35-df4df84dbade tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:44.676168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f206e095-be1b-4c0e-ba35-df4df84dbade tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:44.800946 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f206e095-be1b-4c0e-ba35-df4df84dbade tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.145687 Jan 22 21:15:44.801660 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2669/5124] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:44 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:15:44.891323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c2a4c79c-a5df-4e88-aa65-da9920c29420 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:44.909896 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c2a4c79c-a5df-4e88-aa65-da9920c29420 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1659 microversion: 2.1 time: 0.530926 Jan 22 21:15:44.923589 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2456/5125] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:44 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1659 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:44.929299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7251d1f6-7065-4388-afc9-d78f14104c3f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:44.944694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7251d1f6-7065-4388-afc9-d78f14104c3f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:44.945582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7251d1f6-7065-4388-afc9-d78f14104c3f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:44.986911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7251d1f6-7065-4388-afc9-d78f14104c3f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Going to try to start instance {{(pid=137032) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 22 21:15:45.346684 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7251d1f6-7065-4388-afc9-d78f14104c3f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action" status: 202 len: 0 microversion: 2.1 time: 0.416862 Jan 22 21:15:45.346684 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2670/5126] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:15:44 2022] POST /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:45.354612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d189be0a-40b8-4c27-a51f-923b02e347f4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:45.357493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d189be0a-40b8-4c27-a51f-923b02e347f4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:45.371401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d189be0a-40b8-4c27-a51f-923b02e347f4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:45.372119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d189be0a-40b8-4c27-a51f-923b02e347f4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:45.394860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d189be0a-40b8-4c27-a51f-923b02e347f4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:45.395561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d189be0a-40b8-4c27-a51f-923b02e347f4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:45.638580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b2871a5-df18-4185-a08c-5a97fa7620fd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed50d13a0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:45.750223 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b2871a5-df18-4185-a08c-5a97fa7620fd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.117458 Jan 22 21:15:45.751567 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2671/5127] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:45 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:45.814881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-99e17a38-5c5b-491d-93aa-0e0ce4ee11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:45.816476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-99e17a38-5c5b-491d-93aa-0e0ce4ee11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:45.830328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99e17a38-5c5b-491d-93aa-0e0ce4ee11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:45.831247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99e17a38-5c5b-491d-93aa-0e0ce4ee11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:45.832430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99e17a38-5c5b-491d-93aa-0e0ce4ee11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:45.836939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99e17a38-5c5b-491d-93aa-0e0ce4ee11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:45.903641 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-99e17a38-5c5b-491d-93aa-0e0ce4ee11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.087662 Jan 22 21:15:45.914433 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2672/5128] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:45 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:15:46.292507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d189be0a-40b8-4c27-a51f-923b02e347f4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:46.312248 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d189be0a-40b8-4c27-a51f-923b02e347f4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1668 microversion: 2.1 time: 0.965438 Jan 22 21:15:46.324763 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2457/5129] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:45 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1668 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:46.766736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3c828daf-e889-46c0-9284-a6da73f749b6 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed50f7040>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:46.850744 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3c828daf-e889-46c0-9284-a6da73f749b6 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1460 microversion: 2.1 time: 0.089580 Jan 22 21:15:46.856144 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2673/5130] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:46 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1460 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:46.917842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-57b0e8d8-b00e-4c57-b586-cc1342c35aea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:46.918909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-57b0e8d8-b00e-4c57-b586-cc1342c35aea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:46.926675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57b0e8d8-b00e-4c57-b586-cc1342c35aea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:46.927838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57b0e8d8-b00e-4c57-b586-cc1342c35aea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:46.928715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57b0e8d8-b00e-4c57-b586-cc1342c35aea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:46.929489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57b0e8d8-b00e-4c57-b586-cc1342c35aea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:46.977968 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-57b0e8d8-b00e-4c57-b586-cc1342c35aea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.063635 Jan 22 21:15:46.982279 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2458/5131] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:46 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:47.337202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f05d4479-eefb-407b-910b-7c8f43b4a8bd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:47.338473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f05d4479-eefb-407b-910b-7c8f43b4a8bd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:47.354186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f05d4479-eefb-407b-910b-7c8f43b4a8bd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:47.358268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f05d4479-eefb-407b-910b-7c8f43b4a8bd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:47.359441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f05d4479-eefb-407b-910b-7c8f43b4a8bd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:47.360568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f05d4479-eefb-407b-910b-7c8f43b4a8bd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:47.554026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f05d4479-eefb-407b-910b-7c8f43b4a8bd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:47.579767 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f05d4479-eefb-407b-910b-7c8f43b4a8bd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1668 microversion: 2.1 time: 0.237934 Jan 22 21:15:47.579767 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2674/5132] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:47 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1668 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:47.869607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e6071926-8198-46df-bf0c-5e21a5fe0482 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed60a7550>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:47.937570 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e6071926-8198-46df-bf0c-5e21a5fe0482 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1469 microversion: 2.1 time: 0.075739 Jan 22 21:15:47.946175 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2459/5133] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:47 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1469 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:47.952669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e43519a9-3549-413d-a8c8-a6e161017e44 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed512ee50>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:47.991664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-75f0183f-a955-413d-9c0c-79c8fb53f0ea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:47.992878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-75f0183f-a955-413d-9c0c-79c8fb53f0ea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:48.005915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75f0183f-a955-413d-9c0c-79c8fb53f0ea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:48.007045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75f0183f-a955-413d-9c0c-79c8fb53f0ea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:48.008344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75f0183f-a955-413d-9c0c-79c8fb53f0ea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:48.010335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75f0183f-a955-413d-9c0c-79c8fb53f0ea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:48.019965 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e43519a9-3549-413d-a8c8-a6e161017e44 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 200 len: 1469 microversion: 2.1 time: 0.071574 Jan 22 21:15:48.039253 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2675/5134] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:47 2022] GET /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 1469 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:48.040078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-34c562a7-5413-499f-b60b-c234a043bf3d tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:48.040722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-34c562a7-5413-499f-b60b-c234a043bf3d tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:48.053160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34c562a7-5413-499f-b60b-c234a043bf3d tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:48.055475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34c562a7-5413-499f-b60b-c234a043bf3d tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:48.061287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34c562a7-5413-499f-b60b-c234a043bf3d tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:48.061287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34c562a7-5413-499f-b60b-c234a043bf3d tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:48.066048 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-75f0183f-a955-413d-9c0c-79c8fb53f0ea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.079812 Jan 22 21:15:48.076405 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2460/5135] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:47 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:48.233337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-34c562a7-5413-499f-b60b-c234a043bf3d tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:48.241878 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-34c562a7-5413-499f-b60b-c234a043bf3d tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1472 microversion: 2.1 time: 0.207173 Jan 22 21:15:48.242473 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2676/5136] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:48 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1472 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:48.264718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-73374ebc-3d38-45be-bbc5-972ea9dc621c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1614871011"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:48.266004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-73374ebc-3d38-45be-bbc5-972ea9dc621c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 0b558471-88c9-43fa-a970-799679fcbbf4] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:48.274738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73374ebc-3d38-45be-bbc5-972ea9dc621c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:48.275643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73374ebc-3d38-45be-bbc5-972ea9dc621c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:48.276660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73374ebc-3d38-45be-bbc5-972ea9dc621c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:48.277303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73374ebc-3d38-45be-bbc5-972ea9dc621c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:48.586969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e7d202b6-171f-4aa1-809e-b66227a7002e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:48.587954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e7d202b6-171f-4aa1-809e-b66227a7002e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:48.594736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7d202b6-171f-4aa1-809e-b66227a7002e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:48.595472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7d202b6-171f-4aa1-809e-b66227a7002e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:48.596499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7d202b6-171f-4aa1-809e-b66227a7002e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:48.597190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7d202b6-171f-4aa1-809e-b66227a7002e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:48.767025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e7d202b6-171f-4aa1-809e-b66227a7002e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:48.775652 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e7d202b6-171f-4aa1-809e-b66227a7002e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1668 microversion: 2.1 time: 0.192853 Jan 22 21:15:48.776546 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2677/5137] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:48 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1668 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:48.777103 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-73374ebc-3d38-45be-bbc5-972ea9dc621c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "POST /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4/action" status: 202 len: 0 microversion: 2.1 time: 0.515506 Jan 22 21:15:48.782212 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2461/5138] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:15:48 2022] POST /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 22 21:15:48.788409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b255b57-7c96-4e83-a0db-0a22b2698fbb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5237670>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:48.844451 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b255b57-7c96-4e83-a0db-0a22b2698fbb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.060095 Jan 22 21:15:48.845323 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2678/5139] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:48 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:49.079196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-534d6634-2d70-496d-94cc-67e6f9004fa7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:49.080208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-534d6634-2d70-496d-94cc-67e6f9004fa7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:49.088375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-534d6634-2d70-496d-94cc-67e6f9004fa7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:49.088832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-534d6634-2d70-496d-94cc-67e6f9004fa7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:49.089661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-534d6634-2d70-496d-94cc-67e6f9004fa7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:49.090248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-534d6634-2d70-496d-94cc-67e6f9004fa7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:49.131881 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-534d6634-2d70-496d-94cc-67e6f9004fa7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.056643 Jan 22 21:15:49.132976 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2462/5140] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:49 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:15:49.470495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-07703bbe-80e7-4141-9cfd-22786fa49560 req-4112813e-6987-4ba8-b8ff-7183f5f2a538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72918dc8-a7cc-4046-aa2d-9a91eb7d5332", "name": "network-vif-unplugged", "status": "completed", "tag": "36e7c743-4981-4f44-8177-d4ee4fdfa234"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:49.472079 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:15:49.472079 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:15:49.481640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-07703bbe-80e7-4141-9cfd-22786fa49560 req-4112813e-6987-4ba8-b8ff-7183f5f2a538 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:49.483389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-07703bbe-80e7-4141-9cfd-22786fa49560 req-4112813e-6987-4ba8-b8ff-7183f5f2a538 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:49.516611 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-07703bbe-80e7-4141-9cfd-22786fa49560 req-4112813e-6987-4ba8-b8ff-7183f5f2a538 service nova] Creating event network-vif-unplugged:36e7c743-4981-4f44-8177-d4ee4fdfa234 for instance 72918dc8-a7cc-4046-aa2d-9a91eb7d5332 on nch1-master-1 Jan 22 21:15:49.529140 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-07703bbe-80e7-4141-9cfd-22786fa49560 req-4112813e-6987-4ba8-b8ff-7183f5f2a538 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064740 Jan 22 21:15:49.533045 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2679/5141] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:15:49.766696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2110567415", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "79aa74a3-029b-4997-9559-6fafaab734c7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-164490969", "security_groups": [{"name": "tempest-secgroup-smoke-746114978"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:49.768127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fc768a90-9674-4853-bb6c-5e83a164edb1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:49.769251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fc768a90-9674-4853-bb6c-5e83a164edb1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:49.783581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc768a90-9674-4853-bb6c-5e83a164edb1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:49.791927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc768a90-9674-4853-bb6c-5e83a164edb1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:49.791927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc768a90-9674-4853-bb6c-5e83a164edb1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:49.791927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc768a90-9674-4853-bb6c-5e83a164edb1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:49.831170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fc768a90-9674-4853-bb6c-5e83a164edb1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:15:50.000822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] validate_networks() for [('79aa74a3-029b-4997-9559-6fafaab734c7', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:15:50.241472 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fc768a90-9674-4853-bb6c-5e83a164edb1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 204 len: 0 microversion: 2.1 time: 0.482359 Jan 22 21:15:50.246499 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2680/5142] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:15:49 2022] DELETE /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:15:50.253293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f90881bf-bcbf-4706-8262-fbb3e9bf674a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:50.253867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f90881bf-bcbf-4706-8262-fbb3e9bf674a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:50.290264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f90881bf-bcbf-4706-8262-fbb3e9bf674a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:50.290735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f90881bf-bcbf-4706-8262-fbb3e9bf674a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:50.292225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f90881bf-bcbf-4706-8262-fbb3e9bf674a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:50.292225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f90881bf-bcbf-4706-8262-fbb3e9bf674a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:50.471310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f90881bf-bcbf-4706-8262-fbb3e9bf674a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:50.480550 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f90881bf-bcbf-4706-8262-fbb3e9bf674a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1672 microversion: 2.1 time: 0.232360 Jan 22 21:15:50.481145 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2681/5143] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:50 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1672 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:50.487366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08290fe3-96fe-4b11-845b-9ebdcb1ea000 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edae24ca0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:50.557960 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-08290fe3-96fe-4b11-845b-9ebdcb1ea000 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.075163 Jan 22 21:15:50.558573 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2682/5144] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:50 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:50.580106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e2cb0190-e0cb-4d40-abc5-c1e38ad8bcff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:50.581280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e2cb0190-e0cb-4d40-abc5-c1e38ad8bcff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:50.591371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2cb0190-e0cb-4d40-abc5-c1e38ad8bcff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:50.593139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2cb0190-e0cb-4d40-abc5-c1e38ad8bcff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:50.593139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2cb0190-e0cb-4d40-abc5-c1e38ad8bcff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:50.593139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e2cb0190-e0cb-4d40-abc5-c1e38ad8bcff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:50.667217 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e2cb0190-e0cb-4d40-abc5-c1e38ad8bcff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.092071 Jan 22 21:15:50.673208 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2683/5145] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:50 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:50.679530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e621864a-3900-4850-ab4a-5fc9bddac7e9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:50.680307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e621864a-3900-4850-ab4a-5fc9bddac7e9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:50.691816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:15:50.693891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:15:50.695579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:15:50.696070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:15:50.696509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:15:50.701288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e621864a-3900-4850-ab4a-5fc9bddac7e9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:50.702908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e621864a-3900-4850-ab4a-5fc9bddac7e9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:50.704245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e621864a-3900-4850-ab4a-5fc9bddac7e9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:50.704918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e621864a-3900-4850-ab4a-5fc9bddac7e9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:50.709212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:50.710014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:50.711078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:50.711842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:50.733438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:15:50.744252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for user 80aa2e03fde44436844a88a0ccc5d6a6 and project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:15:50.761071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:15:50.764184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:15:50.922542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e621864a-3900-4850-ab4a-5fc9bddac7e9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:50.944883 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e621864a-3900-4850-ab4a-5fc9bddac7e9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1556 microversion: 2.1 time: 0.270823 Jan 22 21:15:50.948885 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2684/5146] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:50 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1556 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:50.957814 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-521f5bc8-c8a6-4c10-af53-44a78d652257 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.195874 Jan 22 21:15:50.957814 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2463/5147] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:15:49 2022] POST /compute/v2.1/servers => generated 407 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:15:50.969662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b89846a-0606-4052-9a0d-40ebf4ec80c4 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:50.971621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b89846a-0606-4052-9a0d-40ebf4ec80c4 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:51.047376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8b89846a-0606-4052-9a0d-40ebf4ec80c4 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:51.060807 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b89846a-0606-4052-9a0d-40ebf4ec80c4 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1270 microversion: 2.1 time: 0.097704 Jan 22 21:15:51.066100 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2685/5148] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:50 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:51.576914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b44eff08-ff6d-41c4-8651-100672943a97 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5e68d30>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:51.651002 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b44eff08-ff6d-41c4-8651-100672943a97 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.082222 Jan 22 21:15:51.652377 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2464/5149] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:51 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:51.679462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad5f4735-5672-4138-8628-37fcf3895bcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:51.680583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad5f4735-5672-4138-8628-37fcf3895bcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:51.694776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad5f4735-5672-4138-8628-37fcf3895bcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:51.695568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad5f4735-5672-4138-8628-37fcf3895bcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:51.696824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad5f4735-5672-4138-8628-37fcf3895bcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:51.698025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad5f4735-5672-4138-8628-37fcf3895bcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:51.754364 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad5f4735-5672-4138-8628-37fcf3895bcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 32644 microversion: 2.20 time: 0.078738 Jan 22 21:15:51.760270 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2686/5150] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:51 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 32644 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:15:51.965443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4251bbb8-e060-4efc-abc9-6e9330800342 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:51.966733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4251bbb8-e060-4efc-abc9-6e9330800342 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:51.975807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4251bbb8-e060-4efc-abc9-6e9330800342 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:51.976607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4251bbb8-e060-4efc-abc9-6e9330800342 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:51.977738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4251bbb8-e060-4efc-abc9-6e9330800342 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:51.978944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4251bbb8-e060-4efc-abc9-6e9330800342 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:52.079544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b8cd0960-bc1d-4d52-a34a-5601eb4b6e91 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:52.080160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b8cd0960-bc1d-4d52-a34a-5601eb4b6e91 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:52.159494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b8cd0960-bc1d-4d52-a34a-5601eb4b6e91 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:52.171438 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b8cd0960-bc1d-4d52-a34a-5601eb4b6e91 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1270 microversion: 2.1 time: 0.095925 Jan 22 21:15:52.172776 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2687/5151] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:52 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:52.269747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4251bbb8-e060-4efc-abc9-6e9330800342 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:52.282333 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4251bbb8-e060-4efc-abc9-6e9330800342 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1556 microversion: 2.1 time: 0.321181 Jan 22 21:15:52.283022 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2465/5152] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:51 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1556 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:52.665092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ffef4560-a0e4-43fa-9b64-2071e1d354d7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed510c5e0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:52.718573 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ffef4560-a0e4-43fa-9b64-2071e1d354d7 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.058122 Jan 22 21:15:52.726306 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2688/5153] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:52 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:52.767237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-156debdf-2043-43a4-bf46-7e81b2800e38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:52.768245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-156debdf-2043-43a4-bf46-7e81b2800e38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:52.776484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-156debdf-2043-43a4-bf46-7e81b2800e38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:52.777178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-156debdf-2043-43a4-bf46-7e81b2800e38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:52.778213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-156debdf-2043-43a4-bf46-7e81b2800e38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:52.778822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-156debdf-2043-43a4-bf46-7e81b2800e38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:52.832119 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-156debdf-2043-43a4-bf46-7e81b2800e38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 200 len: 40793 microversion: 2.20 time: 0.068614 Jan 22 21:15:52.836765 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2466/5154] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:52 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 40793 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:15:52.846605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-90eca151-7e5e-46a0-9a6e-95fcd93bf907 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:52.847139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-90eca151-7e5e-46a0-9a6e-95fcd93bf907 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:52.855675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90eca151-7e5e-46a0-9a6e-95fcd93bf907 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:52.855675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90eca151-7e5e-46a0-9a6e-95fcd93bf907 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:52.856322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90eca151-7e5e-46a0-9a6e-95fcd93bf907 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:52.856553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90eca151-7e5e-46a0-9a6e-95fcd93bf907 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:52.882532 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-90eca151-7e5e-46a0-9a6e-95fcd93bf907 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/ips" status: 200 len: 152 microversion: 2.20 time: 0.042867 Jan 22 21:15:52.883116 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2689/5155] 10.222.0.100 () {60 vars in 1293 bytes} [Sat Jan 22 21:15:52 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:15:53.050600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-4ae2aabf-6944-4852-bd06-4bfc8d4cf0b3 req-d3d10585-6153-4068-816f-93e8bc5254b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d60673-d54a-4970-8d8f-0419aee033dd", "name": "network-vif-deleted", "tag": "e3388e05-28cd-44b5-a15c-33f2a2e91ee6"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:53.053224 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:15:53.053224 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:15:53.063127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4ae2aabf-6944-4852-bd06-4bfc8d4cf0b3 req-d3d10585-6153-4068-816f-93e8bc5254b7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:53.063372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4ae2aabf-6944-4852-bd06-4bfc8d4cf0b3 req-d3d10585-6153-4068-816f-93e8bc5254b7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:53.081185 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-4ae2aabf-6944-4852-bd06-4bfc8d4cf0b3 req-d3d10585-6153-4068-816f-93e8bc5254b7 service nova] Creating event network-vif-deleted:e3388e05-28cd-44b5-a15c-33f2a2e91ee6 for instance 29d60673-d54a-4970-8d8f-0419aee033dd on nch2-master-1 Jan 22 21:15:53.086229 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-4ae2aabf-6944-4852-bd06-4bfc8d4cf0b3 req-d3d10585-6153-4068-816f-93e8bc5254b7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041379 Jan 22 21:15:53.086977 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2467/5156] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:15:53.193749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-91677312-2e1e-4050-be76-433804b9c577 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:53.194396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-91677312-2e1e-4050-be76-433804b9c577 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:53.201017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91677312-2e1e-4050-be76-433804b9c577 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:53.201484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91677312-2e1e-4050-be76-433804b9c577 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:53.202325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91677312-2e1e-4050-be76-433804b9c577 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:53.202774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91677312-2e1e-4050-be76-433804b9c577 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:53.269939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-91677312-2e1e-4050-be76-433804b9c577 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:53.278055 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-91677312-2e1e-4050-be76-433804b9c577 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1322 microversion: 2.1 time: 0.093702 Jan 22 21:15:53.279159 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2690/5157] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:53 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1322 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:53.300023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2a7d387c-cac6-4538-be95-01b90d87fdee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:53.300723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2a7d387c-cac6-4538-be95-01b90d87fdee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:53.307454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a7d387c-cac6-4538-be95-01b90d87fdee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:53.307921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a7d387c-cac6-4538-be95-01b90d87fdee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:53.308693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a7d387c-cac6-4538-be95-01b90d87fdee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:53.309166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a7d387c-cac6-4538-be95-01b90d87fdee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:53.375015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2a7d387c-cac6-4538-be95-01b90d87fdee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:53.387230 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2a7d387c-cac6-4538-be95-01b90d87fdee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1349 microversion: 2.1 time: 0.090615 Jan 22 21:15:53.390027 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2468/5158] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:53 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:53.578905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-bc84b920-0ae2-4efe-93fa-e1225e48dad5 req-ad7631ce-eeae-45e9-8cbb-488f55e5bf99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b558471-88c9-43fa-a970-799679fcbbf4", "name": "network-vif-plugged", "status": "completed", "tag": "36634d05-9144-45d4-99b4-8efa52e8e426"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:53.580699 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:15:53.580699 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:15:53.590744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bc84b920-0ae2-4efe-93fa-e1225e48dad5 req-ad7631ce-eeae-45e9-8cbb-488f55e5bf99 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:53.591210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bc84b920-0ae2-4efe-93fa-e1225e48dad5 req-ad7631ce-eeae-45e9-8cbb-488f55e5bf99 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:53.603775 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-bc84b920-0ae2-4efe-93fa-e1225e48dad5 req-ad7631ce-eeae-45e9-8cbb-488f55e5bf99 service nova] Creating event network-vif-plugged:36634d05-9144-45d4-99b4-8efa52e8e426 for instance 0b558471-88c9-43fa-a970-799679fcbbf4 on nch1-master-1 Jan 22 21:15:53.608971 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-bc84b920-0ae2-4efe-93fa-e1225e48dad5 req-ad7631ce-eeae-45e9-8cbb-488f55e5bf99 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034048 Jan 22 21:15:53.610480 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2691/5159] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:15:53.733295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-90d6abb9-010c-43af-bad6-0e906ba5a862 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5ab2c10>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:53.841718 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-90d6abb9-010c-43af-bad6-0e906ba5a862 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.111876 Jan 22 21:15:53.844045 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2469/5160] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:53 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:54.297901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-da8eb108-aa74-4d36-a13e-a4bc361bff5a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:54.299429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-da8eb108-aa74-4d36-a13e-a4bc361bff5a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:54.306487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da8eb108-aa74-4d36-a13e-a4bc361bff5a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:54.308363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da8eb108-aa74-4d36-a13e-a4bc361bff5a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:54.308363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da8eb108-aa74-4d36-a13e-a4bc361bff5a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:54.308992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da8eb108-aa74-4d36-a13e-a4bc361bff5a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:54.404519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5376ca78-113b-4d5c-9269-9c0a83f4fe41 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:54.405875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5376ca78-113b-4d5c-9269-9c0a83f4fe41 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:54.418701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5376ca78-113b-4d5c-9269-9c0a83f4fe41 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:54.424682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5376ca78-113b-4d5c-9269-9c0a83f4fe41 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:54.426034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5376ca78-113b-4d5c-9269-9c0a83f4fe41 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:54.426730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5376ca78-113b-4d5c-9269-9c0a83f4fe41 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:54.448042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-da8eb108-aa74-4d36-a13e-a4bc361bff5a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:54.457591 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-da8eb108-aa74-4d36-a13e-a4bc361bff5a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1340 microversion: 2.1 time: 0.164841 Jan 22 21:15:54.461494 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2692/5161] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:54 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1340 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:54.548387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5376ca78-113b-4d5c-9269-9c0a83f4fe41 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:54.549071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5376ca78-113b-4d5c-9269-9c0a83f4fe41 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:54.550072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-5376ca78-113b-4d5c-9269-9c0a83f4fe41 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lazy-loading 'fault' on Instance uuid 29d60673-d54a-4970-8d8f-0419aee033dd {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:15:54.640025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5376ca78-113b-4d5c-9269-9c0a83f4fe41 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:54.651202 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5376ca78-113b-4d5c-9269-9c0a83f4fe41 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 200 len: 1354 microversion: 2.1 time: 0.250817 Jan 22 21:15:54.653397 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2470/5162] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:54 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 1354 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:15:54.856028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2ddc4e87-845d-48a2-98ea-b2444c0698af tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edaee55e0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:54.915418 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2ddc4e87-845d-48a2-98ea-b2444c0698af tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.063492 Jan 22 21:15:54.916294 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2693/5163] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:54 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:55.490099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ec7297b-ea8c-40fc-803e-1808de444563 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:55.490099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3ec7297b-ea8c-40fc-803e-1808de444563 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:55.496269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ec7297b-ea8c-40fc-803e-1808de444563 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:55.496726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ec7297b-ea8c-40fc-803e-1808de444563 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:55.497548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ec7297b-ea8c-40fc-803e-1808de444563 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:55.498000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ec7297b-ea8c-40fc-803e-1808de444563 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:55.670358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3ff5c0a-930b-477e-bf89-206b8e06778b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:55.671670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d3ff5c0a-930b-477e-bf89-206b8e06778b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:55.680738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3ff5c0a-930b-477e-bf89-206b8e06778b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:55.681563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3ff5c0a-930b-477e-bf89-206b8e06778b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:55.682698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3ff5c0a-930b-477e-bf89-206b8e06778b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:55.683383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3ff5c0a-930b-477e-bf89-206b8e06778b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:55.698632 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-d3ff5c0a-930b-477e-bf89-206b8e06778b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 29d60673-d54a-4970-8d8f-0419aee033dd could not be found. Jan 22 21:15:55.704501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3ff5c0a-930b-477e-bf89-206b8e06778b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 29d60673-d54a-4970-8d8f-0419aee033dd could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:15:55.706311 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d3ff5c0a-930b-477e-bf89-206b8e06778b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 404 len: 111 microversion: 2.1 time: 0.039758 Jan 22 21:15:55.707591 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2694/5164] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:55 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:15:55.794030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3ec7297b-ea8c-40fc-803e-1808de444563 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:55.807477 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3ec7297b-ea8c-40fc-803e-1808de444563 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1395 microversion: 2.1 time: 0.327250 Jan 22 21:15:55.813342 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2471/5165] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:55 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1395 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:55.864044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9d1ec199-4b0e-4201-a9bf-78913de9eabc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:55.865689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9d1ec199-4b0e-4201-a9bf-78913de9eabc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:55.875707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d1ec199-4b0e-4201-a9bf-78913de9eabc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:55.878034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d1ec199-4b0e-4201-a9bf-78913de9eabc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:55.879819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d1ec199-4b0e-4201-a9bf-78913de9eabc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:55.882248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d1ec199-4b0e-4201-a9bf-78913de9eabc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:55.912464 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-9d1ec199-4b0e-4201-a9bf-78913de9eabc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 29d60673-d54a-4970-8d8f-0419aee033dd could not be found. Jan 22 21:15:55.913256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9d1ec199-4b0e-4201-a9bf-78913de9eabc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 29d60673-d54a-4970-8d8f-0419aee033dd could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:15:55.914446 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9d1ec199-4b0e-4201-a9bf-78913de9eabc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.056564 Jan 22 21:15:55.915980 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2695/5166] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:15:55 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd/os-volume_attachments => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:15:55.928496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ed578f2d-e6fc-4221-84c9-3ede8e0616bd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5df84c0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:56.004622 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ed578f2d-e6fc-4221-84c9-3ede8e0616bd tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.076857 Jan 22 21:15:56.006728 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2472/5167] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:55 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:56.253892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-628746140", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "96cc3928-7569-4c1f-becd-807913ebf734"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:56.368119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] validate_networks() for [('96cc3928-7569-4c1f-becd-807913ebf734', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:15:56.834008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f6dfa836-6cec-4ebd-a796-d8821b274bf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:56.835409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f6dfa836-6cec-4ebd-a796-d8821b274bf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:56.847246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6dfa836-6cec-4ebd-a796-d8821b274bf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:56.854781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6dfa836-6cec-4ebd-a796-d8821b274bf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:56.855982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6dfa836-6cec-4ebd-a796-d8821b274bf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:56.858701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6dfa836-6cec-4ebd-a796-d8821b274bf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:57.115657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:15:57.116867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:15:57.120846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:15:57.120846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:15:57.121630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:15:57.134767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:57.135663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:57.136740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:57.137405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:57.162827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Getting quotas for project 5b1c3aa9e1ae4cc8a5a021434ad4a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:15:57.171538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Getting quotas for user b93108a71872461ea979735a490694a6 and project 5b1c3aa9e1ae4cc8a5a021434ad4a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:15:57.189532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:15:57.190521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: daeb01c3-b726-42b0-bd38-001d83d6a716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:15:57.201012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f6dfa836-6cec-4ebd-a796-d8821b274bf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:57.224946 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f6dfa836-6cec-4ebd-a796-d8821b274bf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1395 microversion: 2.1 time: 0.396340 Jan 22 21:15:57.227340 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2473/5168] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:56 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1395 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:57.233077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-01ce7df0-eb7d-4e06-ba68-eb3e00cbd945 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5df84c0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:57.326527 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-01ce7df0-eb7d-4e06-ba68-eb3e00cbd945 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.097679 Jan 22 21:15:57.327725 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2474/5169] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:57 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:57.346688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-557fdf3a-5194-446d-ae59-28757b5d174f req-e690d353-cd61-48ce-823e-323d59e653f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdde4f64-417f-4c19-ac24-3250a9619db1", "tag": "a1a87111-ee94-490d-8f2e-69e60e3d6517"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:57.349048 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:15:57.349048 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:15:57.362446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-557fdf3a-5194-446d-ae59-28757b5d174f req-e690d353-cd61-48ce-823e-323d59e653f7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:57.369870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-557fdf3a-5194-446d-ae59-28757b5d174f req-e690d353-cd61-48ce-823e-323d59e653f7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:57.382576 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a1ce6772-e288-4394-91f7-81f14b4f08db tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.132159 Jan 22 21:15:57.393689 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2696/5170] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:15:56 2022] POST /compute/v2.1/servers => generated 382 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:15:57.399663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-62490d0c-1552-4767-87a9-9f4337617ef5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:57.409339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-62490d0c-1552-4767-87a9-9f4337617ef5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: daeb01c3-b726-42b0-bd38-001d83d6a716] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:57.420851 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-557fdf3a-5194-446d-ae59-28757b5d174f req-e690d353-cd61-48ce-823e-323d59e653f7 service nova] Creating event network-changed:a1a87111-ee94-490d-8f2e-69e60e3d6517 for instance cdde4f64-417f-4c19-ac24-3250a9619db1 on nch2-master-1 Jan 22 21:15:57.438222 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-557fdf3a-5194-446d-ae59-28757b5d174f req-e690d353-cd61-48ce-823e-323d59e653f7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106522 Jan 22 21:15:57.442407 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2475/5171] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:15:57.539543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-62490d0c-1552-4767-87a9-9f4337617ef5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:57.548432 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-62490d0c-1552-4767-87a9-9f4337617ef5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/daeb01c3-b726-42b0-bd38-001d83d6a716" status: 200 len: 1218 microversion: 2.1 time: 0.153146 Jan 22 21:15:57.549014 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2697/5172] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:57 2022] GET /compute/v2.1/servers/daeb01c3-b726-42b0-bd38-001d83d6a716 => generated 1218 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:57.573126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-34601b61-0ac4-4cd9-a905-034b1f8a1bc3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:57.573749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-34601b61-0ac4-4cd9-a905-034b1f8a1bc3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: daeb01c3-b726-42b0-bd38-001d83d6a716] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:57.637158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-34601b61-0ac4-4cd9-a905-034b1f8a1bc3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: daeb01c3-b726-42b0-bd38-001d83d6a716] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:15:58.014816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f31bbfd5-c2bc-4c73-8a30-0afa8c0a0062 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:58.015516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f31bbfd5-c2bc-4c73-8a30-0afa8c0a0062 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:58.030955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f31bbfd5-c2bc-4c73-8a30-0afa8c0a0062 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:58.031646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f31bbfd5-c2bc-4c73-8a30-0afa8c0a0062 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:58.032670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f31bbfd5-c2bc-4c73-8a30-0afa8c0a0062 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:58.033271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f31bbfd5-c2bc-4c73-8a30-0afa8c0a0062 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:58.061393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-f31bbfd5-c2bc-4c73-8a30-0afa8c0a0062 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lazy-loading 'flavor' on Instance uuid 8288fe26-7e9c-451c-a9a2-222abbcf201e {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:15:58.420770 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.scheduler.client.report [None req-34601b61-0ac4-4cd9-a905-034b1f8a1bc3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Deleted allocations for instance daeb01c3-b726-42b0-bd38-001d83d6a716 Jan 22 21:15:58.428289 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.compute.api [None req-34601b61-0ac4-4cd9-a905-034b1f8a1bc3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: daeb01c3-b726-42b0-bd38-001d83d6a716] Instance Mapping does not exist while attempting local delete cleanup. Jan 22 21:15:58.429542 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-34601b61-0ac4-4cd9-a905-034b1f8a1bc3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/daeb01c3-b726-42b0-bd38-001d83d6a716" status: 204 len: 0 microversion: 2.1 time: 0.868359 Jan 22 21:15:58.430133 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2476/5173] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:15:57 2022] DELETE /compute/v2.1/servers/daeb01c3-b726-42b0-bd38-001d83d6a716 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:15:58.440883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ee43bfe-f59c-4e49-a009-c14b3576aa12 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:58.441568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3ee43bfe-f59c-4e49-a009-c14b3576aa12 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:58.465998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ee43bfe-f59c-4e49-a009-c14b3576aa12 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:58.470183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ee43bfe-f59c-4e49-a009-c14b3576aa12 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:58.470183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ee43bfe-f59c-4e49-a009-c14b3576aa12 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:58.470183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ee43bfe-f59c-4e49-a009-c14b3576aa12 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:58.841975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3ee43bfe-f59c-4e49-a009-c14b3576aa12 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:58.859940 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3ee43bfe-f59c-4e49-a009-c14b3576aa12 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1395 microversion: 2.1 time: 0.426858 Jan 22 21:15:58.860984 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2477/5174] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:58 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1395 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:58.872589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2a69d846-2e5e-4344-8671-6ef3c62f3ce8 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5ffcaf0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:58.910847 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f31bbfd5-c2bc-4c73-8a30-0afa8c0a0062 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 202 len: 0 microversion: 2.20 time: 0.900447 Jan 22 21:15:58.918976 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2698/5175] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:15:58 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 0 bytes in 910 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:15:58.937005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-884b07de-d639-4674-b75e-e8ca77550b91 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:58.938559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-884b07de-d639-4674-b75e-e8ca77550b91 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: daeb01c3-b726-42b0-bd38-001d83d6a716] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:58.955502 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-884b07de-d639-4674-b75e-e8ca77550b91 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance daeb01c3-b726-42b0-bd38-001d83d6a716 could not be found. Jan 22 21:15:58.962371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-884b07de-d639-4674-b75e-e8ca77550b91 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance daeb01c3-b726-42b0-bd38-001d83d6a716 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:15:58.962371 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-884b07de-d639-4674-b75e-e8ca77550b91 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/daeb01c3-b726-42b0-bd38-001d83d6a716" status: 404 len: 111 microversion: 2.1 time: 0.037117 Jan 22 21:15:58.962371 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2699/5176] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:58 2022] GET /compute/v2.1/servers/daeb01c3-b726-42b0-bd38-001d83d6a716 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:15:58.980864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e9317aa7-a48f-4654-8b22-b316259f864f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:58.982316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e9317aa7-a48f-4654-8b22-b316259f864f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:58.987549 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2a69d846-2e5e-4344-8671-6ef3c62f3ce8 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.119123 Jan 22 21:15:58.989713 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2478/5177] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:15:58 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:15:58.994828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9317aa7-a48f-4654-8b22-b316259f864f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:58.995534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9317aa7-a48f-4654-8b22-b316259f864f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:58.996557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9317aa7-a48f-4654-8b22-b316259f864f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:58.997473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9317aa7-a48f-4654-8b22-b316259f864f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:59.052201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-521826818", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "96cc3928-7569-4c1f-becd-807913ebf734"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:15:59.146139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] validate_networks() for [('96cc3928-7569-4c1f-becd-807913ebf734', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:15:59.401319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e9317aa7-a48f-4654-8b22-b316259f864f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:59.425441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e9317aa7-a48f-4654-8b22-b316259f864f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:59.427053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e9317aa7-a48f-4654-8b22-b316259f864f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:15:59.428356 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e9317aa7-a48f-4654-8b22-b316259f864f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.467439 Jan 22 21:15:59.428982 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2700/5178] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:15:58 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:15:59.878478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6024a931-44cb-4b69-885d-137d46425735 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:15:59.879099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6024a931-44cb-4b69-885d-137d46425735 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:15:59.886468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6024a931-44cb-4b69-885d-137d46425735 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:59.887037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6024a931-44cb-4b69-885d-137d46425735 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:59.888099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6024a931-44cb-4b69-885d-137d46425735 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:59.888659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6024a931-44cb-4b69-885d-137d46425735 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:59.984440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:15:59.984939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:15:59.985357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:15:59.985818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:15:59.986366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:15:59.995973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:59.996706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:15:59.997763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:15:59.998213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:00.026722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Getting quotas for project 5b1c3aa9e1ae4cc8a5a021434ad4a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:16:00.033587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Getting quotas for user b93108a71872461ea979735a490694a6 and project 5b1c3aa9e1ae4cc8a5a021434ad4a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:16:00.039375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6024a931-44cb-4b69-885d-137d46425735 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:00.047964 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6024a931-44cb-4b69-885d-137d46425735 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1395 microversion: 2.1 time: 0.173135 Jan 22 21:16:00.048472 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2701/5179] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:15:59 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1395 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:00.049449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:16:00.053311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:16:00.054870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-edf0f037-7a52-443b-822e-948f39f1ddbf tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5237820>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:00.098809 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-edf0f037-7a52-443b-822e-948f39f1ddbf tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.048422 Jan 22 21:16:00.099640 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2702/5180] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:16:00 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:00.245138 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-95db35cc-bdc7-4b52-b5af-4c8f878c9ee3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.196376 Jan 22 21:16:00.248107 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2479/5181] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:15:59 2022] POST /compute/v2.1/servers => generated 382 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:16:00.262754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9cdea99b-c5c2-42f1-bf27-afa09e7ea3d9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:00.263585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9cdea99b-c5c2-42f1-bf27-afa09e7ea3d9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:00.344232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9cdea99b-c5c2-42f1-bf27-afa09e7ea3d9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:00.356729 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9cdea99b-c5c2-42f1-bf27-afa09e7ea3d9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1218 microversion: 2.1 time: 0.102609 Jan 22 21:16:00.357325 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2703/5182] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:00 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:00.452787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e2e77823-19bb-40f7-a249-c3a7778e0fcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:00.453706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e2e77823-19bb-40f7-a249-c3a7778e0fcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:00.462644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2e77823-19bb-40f7-a249-c3a7778e0fcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:00.463414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2e77823-19bb-40f7-a249-c3a7778e0fcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:00.464651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2e77823-19bb-40f7-a249-c3a7778e0fcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:00.465310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2e77823-19bb-40f7-a249-c3a7778e0fcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:00.649830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e2e77823-19bb-40f7-a249-c3a7778e0fcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:00.662420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e2e77823-19bb-40f7-a249-c3a7778e0fcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:00.665341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e2e77823-19bb-40f7-a249-c3a7778e0fcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:00.667266 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e2e77823-19bb-40f7-a249-c3a7778e0fcb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.218049 Jan 22 21:16:00.678946 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2480/5183] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:00 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:16:01.070774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f026c7aa-008d-4c5c-ba8d-bb57a78ddb29 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:01.072137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f026c7aa-008d-4c5c-ba8d-bb57a78ddb29 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:01.080603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f026c7aa-008d-4c5c-ba8d-bb57a78ddb29 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:01.081213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f026c7aa-008d-4c5c-ba8d-bb57a78ddb29 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:01.085879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f026c7aa-008d-4c5c-ba8d-bb57a78ddb29 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:01.086429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f026c7aa-008d-4c5c-ba8d-bb57a78ddb29 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:01.112220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24a1a91d-6c34-497a-aa42-af8aa87f01ce tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5ffc430>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:01.168179 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-24a1a91d-6c34-497a-aa42-af8aa87f01ce tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.059489 Jan 22 21:16:01.168865 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2481/5184] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:16:01 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:01.401035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7a500944-7617-42ba-a374-b1b1e6a61b69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:01.404134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7a500944-7617-42ba-a374-b1b1e6a61b69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:01.415632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a500944-7617-42ba-a374-b1b1e6a61b69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:01.416098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a500944-7617-42ba-a374-b1b1e6a61b69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:01.425884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a500944-7617-42ba-a374-b1b1e6a61b69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:01.430067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a500944-7617-42ba-a374-b1b1e6a61b69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:01.519153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7a500944-7617-42ba-a374-b1b1e6a61b69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:01.526463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f026c7aa-008d-4c5c-ba8d-bb57a78ddb29 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:01.528845 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7a500944-7617-42ba-a374-b1b1e6a61b69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1222 microversion: 2.1 time: 0.143049 Jan 22 21:16:01.529778 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2482/5185] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:01 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1222 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:01.535456 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f026c7aa-008d-4c5c-ba8d-bb57a78ddb29 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1395 microversion: 2.1 time: 0.474200 Jan 22 21:16:01.539199 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2704/5186] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:01 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1395 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:01.686560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7b75a1aa-e9fa-44ff-a253-cea2ab7e8d0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:01.687174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7b75a1aa-e9fa-44ff-a253-cea2ab7e8d0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:01.697739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b75a1aa-e9fa-44ff-a253-cea2ab7e8d0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:01.698455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b75a1aa-e9fa-44ff-a253-cea2ab7e8d0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:01.699690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b75a1aa-e9fa-44ff-a253-cea2ab7e8d0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:01.700308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b75a1aa-e9fa-44ff-a253-cea2ab7e8d0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:01.920746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7b75a1aa-e9fa-44ff-a253-cea2ab7e8d0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:01.931966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7b75a1aa-e9fa-44ff-a253-cea2ab7e8d0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:01.936390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7b75a1aa-e9fa-44ff-a253-cea2ab7e8d0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:01.936390 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7b75a1aa-e9fa-44ff-a253-cea2ab7e8d0d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.252279 Jan 22 21:16:01.938850 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2483/5187] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:01 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:16:02.182011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-20b2cd3c-5e70-46c6-bc2d-7612e6436d04 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed512eca0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:02.235906 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-20b2cd3c-5e70-46c6-bc2d-7612e6436d04 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.058019 Jan 22 21:16:02.242631 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2705/5188] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:16:02 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:02.554142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f15b320a-083d-4d86-b571-ea85ed048c84 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:02.555388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f15b320a-083d-4d86-b571-ea85ed048c84 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:02.557736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4c361bf1-f5d3-4a27-83fd-9472e82eb572 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:02.558726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4c361bf1-f5d3-4a27-83fd-9472e82eb572 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:02.568561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f15b320a-083d-4d86-b571-ea85ed048c84 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:02.569025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f15b320a-083d-4d86-b571-ea85ed048c84 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:02.569862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f15b320a-083d-4d86-b571-ea85ed048c84 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:02.570511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f15b320a-083d-4d86-b571-ea85ed048c84 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:02.576979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c361bf1-f5d3-4a27-83fd-9472e82eb572 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:02.577873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c361bf1-f5d3-4a27-83fd-9472e82eb572 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:02.578997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c361bf1-f5d3-4a27-83fd-9472e82eb572 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:02.580134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c361bf1-f5d3-4a27-83fd-9472e82eb572 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:02.754382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4c361bf1-f5d3-4a27-83fd-9472e82eb572 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:02.777874 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4c361bf1-f5d3-4a27-83fd-9472e82eb572 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1270 microversion: 2.1 time: 0.221714 Jan 22 21:16:02.787071 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2706/5189] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:02 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1270 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:02.958116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-684dc435-1dc1-4900-8567-23bbf96fe1e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:02.958872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-684dc435-1dc1-4900-8567-23bbf96fe1e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:02.965438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-684dc435-1dc1-4900-8567-23bbf96fe1e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:02.965930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-684dc435-1dc1-4900-8567-23bbf96fe1e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:02.966744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-684dc435-1dc1-4900-8567-23bbf96fe1e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:02.967197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-684dc435-1dc1-4900-8567-23bbf96fe1e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:03.159118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f15b320a-083d-4d86-b571-ea85ed048c84 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:03.170022 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f15b320a-083d-4d86-b571-ea85ed048c84 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1395 microversion: 2.1 time: 0.621103 Jan 22 21:16:03.171236 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2484/5190] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:02 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1395 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:03.249981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ccdc24fd-cc18-429a-8dc0-8fb0986c877f tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5de58b0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:03.304597 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ccdc24fd-cc18-429a-8dc0-8fb0986c877f tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.058351 Jan 22 21:16:03.310972 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2485/5191] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:16:03 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:03.614205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-68ed0f75-a4bb-4565-95a0-3e71933ca45e req-8c4de4ef-b225-4916-92ab-41ad3427da32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdde4f64-417f-4c19-ac24-3250a9619db1", "name": "network-vif-plugged", "status": "completed", "tag": "a1a87111-ee94-490d-8f2e-69e60e3d6517"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:03.615809 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:03.615809 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:16:03.630546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-68ed0f75-a4bb-4565-95a0-3e71933ca45e req-8c4de4ef-b225-4916-92ab-41ad3427da32 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:03.630994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-68ed0f75-a4bb-4565-95a0-3e71933ca45e req-8c4de4ef-b225-4916-92ab-41ad3427da32 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:03.656512 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-68ed0f75-a4bb-4565-95a0-3e71933ca45e req-8c4de4ef-b225-4916-92ab-41ad3427da32 service nova] Creating event network-vif-plugged:a1a87111-ee94-490d-8f2e-69e60e3d6517 for instance cdde4f64-417f-4c19-ac24-3250a9619db1 on nch2-master-1 Jan 22 21:16:03.657399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-684dc435-1dc1-4900-8567-23bbf96fe1e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:03.670802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-684dc435-1dc1-4900-8567-23bbf96fe1e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:03.672835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-684dc435-1dc1-4900-8567-23bbf96fe1e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:03.674685 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-684dc435-1dc1-4900-8567-23bbf96fe1e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.720511 Jan 22 21:16:03.676905 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2707/5192] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:02 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:03.686740 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-68ed0f75-a4bb-4565-95a0-3e71933ca45e req-8c4de4ef-b225-4916-92ab-41ad3427da32 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077091 Jan 22 21:16:03.695168 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2486/5193] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:03.799589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-16d7d37b-31e3-497e-94b9-603c0b8a0c42 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:03.800233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-16d7d37b-31e3-497e-94b9-603c0b8a0c42 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:03.813207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16d7d37b-31e3-497e-94b9-603c0b8a0c42 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:03.814137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16d7d37b-31e3-497e-94b9-603c0b8a0c42 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:03.816159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16d7d37b-31e3-497e-94b9-603c0b8a0c42 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:03.816927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16d7d37b-31e3-497e-94b9-603c0b8a0c42 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:03.963490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-16d7d37b-31e3-497e-94b9-603c0b8a0c42 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:03.979156 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-16d7d37b-31e3-497e-94b9-603c0b8a0c42 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1276 microversion: 2.1 time: 0.186206 Jan 22 21:16:03.989632 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2708/5194] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:03 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1276 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:04.189954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-53125b43-56b2-4877-a60a-e94972a397b9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:04.191435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-53125b43-56b2-4877-a60a-e94972a397b9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:04.211258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53125b43-56b2-4877-a60a-e94972a397b9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:04.211258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53125b43-56b2-4877-a60a-e94972a397b9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:04.211258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53125b43-56b2-4877-a60a-e94972a397b9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:04.211258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53125b43-56b2-4877-a60a-e94972a397b9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:04.325866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4cf8a416-b965-4976-8ffb-14c9b431abee tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed510cdc0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:04.475827 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4cf8a416-b965-4976-8ffb-14c9b431abee tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.079963 Jan 22 21:16:04.475827 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2709/5195] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:16:04 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:04.486515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-53125b43-56b2-4877-a60a-e94972a397b9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:04.497080 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-53125b43-56b2-4877-a60a-e94972a397b9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1395 microversion: 2.1 time: 0.311690 Jan 22 21:16:04.498056 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2487/5196] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:04 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1395 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:04.701829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8502b400-4bb9-4f4d-b110-c713e2d61c20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:04.702649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8502b400-4bb9-4f4d-b110-c713e2d61c20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:04.712871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8502b400-4bb9-4f4d-b110-c713e2d61c20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:04.713881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8502b400-4bb9-4f4d-b110-c713e2d61c20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:04.715370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8502b400-4bb9-4f4d-b110-c713e2d61c20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:04.715908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8502b400-4bb9-4f4d-b110-c713e2d61c20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:04.881052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8502b400-4bb9-4f4d-b110-c713e2d61c20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:04.889673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8502b400-4bb9-4f4d-b110-c713e2d61c20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:04.891580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8502b400-4bb9-4f4d-b110-c713e2d61c20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:04.892366 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8502b400-4bb9-4f4d-b110-c713e2d61c20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.197495 Jan 22 21:16:04.892922 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2710/5197] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:04 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:04.998050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bcc537c1-3089-47b5-82be-e6fecdf3d4f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:04.998744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bcc537c1-3089-47b5-82be-e6fecdf3d4f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:05.008851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcc537c1-3089-47b5-82be-e6fecdf3d4f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:05.009395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcc537c1-3089-47b5-82be-e6fecdf3d4f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:05.010533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcc537c1-3089-47b5-82be-e6fecdf3d4f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:05.012205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcc537c1-3089-47b5-82be-e6fecdf3d4f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:05.413495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b156baa7-0338-4570-a72c-44cc575f03b4 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed510c670>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:05.471414 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b156baa7-0338-4570-a72c-44cc575f03b4 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.061450 Jan 22 21:16:05.471944 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2711/5198] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:16:05 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:05.483161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bcc537c1-3089-47b5-82be-e6fecdf3d4f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:05.492192 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bcc537c1-3089-47b5-82be-e6fecdf3d4f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1318 microversion: 2.1 time: 0.499846 Jan 22 21:16:05.493163 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2488/5199] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:04 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:05.517114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-040aaf70-1bc5-44ee-b6a9-9c6743afa852 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:05.517914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-040aaf70-1bc5-44ee-b6a9-9c6743afa852 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:05.530077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-040aaf70-1bc5-44ee-b6a9-9c6743afa852 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:05.530540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-040aaf70-1bc5-44ee-b6a9-9c6743afa852 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:05.531509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-040aaf70-1bc5-44ee-b6a9-9c6743afa852 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:05.531963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-040aaf70-1bc5-44ee-b6a9-9c6743afa852 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:05.751740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-040aaf70-1bc5-44ee-b6a9-9c6743afa852 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:05.763990 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-040aaf70-1bc5-44ee-b6a9-9c6743afa852 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1566 microversion: 2.1 time: 0.250821 Jan 22 21:16:05.776162 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2712/5200] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:05 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1566 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:05.788938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1adf6039-62c5-444b-b4fc-57f02c6e0c62 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:05.793645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1adf6039-62c5-444b-b4fc-57f02c6e0c62 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:05.807117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1adf6039-62c5-444b-b4fc-57f02c6e0c62 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:05.810916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1adf6039-62c5-444b-b4fc-57f02c6e0c62 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:05.811807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1adf6039-62c5-444b-b4fc-57f02c6e0c62 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:05.812272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1adf6039-62c5-444b-b4fc-57f02c6e0c62 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:05.917474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-468f9eb3-1e96-4372-8930-0af6a7d00c53 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:05.918155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-468f9eb3-1e96-4372-8930-0af6a7d00c53 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:05.949796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-468f9eb3-1e96-4372-8930-0af6a7d00c53 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:05.950299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-468f9eb3-1e96-4372-8930-0af6a7d00c53 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:05.953652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-468f9eb3-1e96-4372-8930-0af6a7d00c53 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:05.955858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-468f9eb3-1e96-4372-8930-0af6a7d00c53 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:06.137971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-468f9eb3-1e96-4372-8930-0af6a7d00c53 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:06.162376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-468f9eb3-1e96-4372-8930-0af6a7d00c53 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:06.165219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-468f9eb3-1e96-4372-8930-0af6a7d00c53 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:06.166563 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-468f9eb3-1e96-4372-8930-0af6a7d00c53 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.258111 Jan 22 21:16:06.179710 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2713/5201] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:05 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:06.229931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1adf6039-62c5-444b-b4fc-57f02c6e0c62 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:06.242520 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1adf6039-62c5-444b-b4fc-57f02c6e0c62 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1566 microversion: 2.1 time: 0.458898 Jan 22 21:16:06.243962 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2489/5202] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:05 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1566 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:06.488929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f30ebf56-1b65-4709-b0f0-f096e0fd7fe8 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5ec6dc0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:06.508604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b330c3b2-569d-4413-acd8-7375a09c21e2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:06.509467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b330c3b2-569d-4413-acd8-7375a09c21e2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:06.522812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b330c3b2-569d-4413-acd8-7375a09c21e2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:06.524681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b330c3b2-569d-4413-acd8-7375a09c21e2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:06.527852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b330c3b2-569d-4413-acd8-7375a09c21e2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:06.528535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b330c3b2-569d-4413-acd8-7375a09c21e2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:06.583171 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f30ebf56-1b65-4709-b0f0-f096e0fd7fe8 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.096317 Jan 22 21:16:06.583171 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2714/5203] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:16:06 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:06.612518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-d41f5d24-222c-4e41-8aec-261deb6e22b5 req-6104b5e7-4b38-415e-82f4-f8a6be1ca87c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ec4d907-48d2-48e9-8c9a-63dea188dab0", "tag": "c0a08ff2-3af1-46bf-8105-501a08abcd20"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:06.616544 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:06.616544 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:16:06.649455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d41f5d24-222c-4e41-8aec-261deb6e22b5 req-6104b5e7-4b38-415e-82f4-f8a6be1ca87c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:06.657070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d41f5d24-222c-4e41-8aec-261deb6e22b5 req-6104b5e7-4b38-415e-82f4-f8a6be1ca87c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:06.681105 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d41f5d24-222c-4e41-8aec-261deb6e22b5 req-6104b5e7-4b38-415e-82f4-f8a6be1ca87c service nova] Creating event network-changed:c0a08ff2-3af1-46bf-8105-501a08abcd20 for instance 1ec4d907-48d2-48e9-8c9a-63dea188dab0 on nch1-master-1 Jan 22 21:16:06.693364 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-d41f5d24-222c-4e41-8aec-261deb6e22b5 req-6104b5e7-4b38-415e-82f4-f8a6be1ca87c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083902 Jan 22 21:16:06.696763 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2715/5204] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:06.942283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b330c3b2-569d-4413-acd8-7375a09c21e2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:06.958947 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b330c3b2-569d-4413-acd8-7375a09c21e2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1318 microversion: 2.1 time: 0.454190 Jan 22 21:16:06.971521 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2490/5205] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:06 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:07.188536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4096a21f-e31e-4d0a-bff6-13c3048b42d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:07.189236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4096a21f-e31e-4d0a-bff6-13c3048b42d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:07.196570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4096a21f-e31e-4d0a-bff6-13c3048b42d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:07.197263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4096a21f-e31e-4d0a-bff6-13c3048b42d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:07.198307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4096a21f-e31e-4d0a-bff6-13c3048b42d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:07.198912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4096a21f-e31e-4d0a-bff6-13c3048b42d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:07.592978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-18ac4be0-2573-47f3-89f6-c9c3cd391a1c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5a90dc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:07.633674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4096a21f-e31e-4d0a-bff6-13c3048b42d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:07.642577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4096a21f-e31e-4d0a-bff6-13c3048b42d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:07.650729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4096a21f-e31e-4d0a-bff6-13c3048b42d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:07.651376 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4096a21f-e31e-4d0a-bff6-13c3048b42d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.463940 Jan 22 21:16:07.651767 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2716/5206] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:07 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:07.656098 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-18ac4be0-2573-47f3-89f6-c9c3cd391a1c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.067395 Jan 22 21:16:07.657844 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2491/5207] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:16:07 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:07.978841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-51221d0d-ce13-4aca-b5ec-9e61163d4395 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:07.979951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-51221d0d-ce13-4aca-b5ec-9e61163d4395 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:07.990732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51221d0d-ce13-4aca-b5ec-9e61163d4395 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:07.991793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51221d0d-ce13-4aca-b5ec-9e61163d4395 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:07.992890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51221d0d-ce13-4aca-b5ec-9e61163d4395 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:07.994003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51221d0d-ce13-4aca-b5ec-9e61163d4395 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:08.319621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-51221d0d-ce13-4aca-b5ec-9e61163d4395 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:08.329970 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-51221d0d-ce13-4aca-b5ec-9e61163d4395 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1318 microversion: 2.1 time: 0.357397 Jan 22 21:16:08.340684 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2717/5208] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:07 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:08.789051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-69b3eece-f451-4e63-bbf9-2dcc375c541a tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5de5e50>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:08.791521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1763850-73a4-41c2-acca-572a0397e6c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:08.791521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1763850-73a4-41c2-acca-572a0397e6c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:08.791521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1763850-73a4-41c2-acca-572a0397e6c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:08.791521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1763850-73a4-41c2-acca-572a0397e6c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:08.791521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1763850-73a4-41c2-acca-572a0397e6c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:08.791521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1763850-73a4-41c2-acca-572a0397e6c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:08.792322 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-69b3eece-f451-4e63-bbf9-2dcc375c541a tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.053298 Jan 22 21:16:08.792322 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2492/5209] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:16:08 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:08.836736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1763850-73a4-41c2-acca-572a0397e6c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:08.844962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1763850-73a4-41c2-acca-572a0397e6c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:08.846529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1763850-73a4-41c2-acca-572a0397e6c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:08.847774 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1763850-73a4-41c2-acca-572a0397e6c6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.168310 Jan 22 21:16:08.848896 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2718/5210] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:08 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:16:09.352041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0322db37-dabb-4b6b-a209-cb4e77997521 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:09.353154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0322db37-dabb-4b6b-a209-cb4e77997521 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:09.364908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0322db37-dabb-4b6b-a209-cb4e77997521 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:09.366714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0322db37-dabb-4b6b-a209-cb4e77997521 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:09.366714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0322db37-dabb-4b6b-a209-cb4e77997521 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:09.367444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0322db37-dabb-4b6b-a209-cb4e77997521 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:09.628008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0322db37-dabb-4b6b-a209-cb4e77997521 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:09.640635 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0322db37-dabb-4b6b-a209-cb4e77997521 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1318 microversion: 2.1 time: 0.296865 Jan 22 21:16:09.641556 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2493/5211] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:09 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:09.740026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-16e5e331-915b-44fd-8619-1d4b72fcba67 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed512aa60>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:09.857935 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-16e5e331-915b-44fd-8619-1d4b72fcba67 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1460 microversion: 2.1 time: 0.121368 Jan 22 21:16:09.863976 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2719/5212] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:16:09 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1460 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:09.865956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e97d648b-dcb0-4feb-a32d-9dc84903a09f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:09.866626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e97d648b-dcb0-4feb-a32d-9dc84903a09f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:09.874173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e97d648b-dcb0-4feb-a32d-9dc84903a09f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:09.878780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e97d648b-dcb0-4feb-a32d-9dc84903a09f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:09.878780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e97d648b-dcb0-4feb-a32d-9dc84903a09f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:09.878780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e97d648b-dcb0-4feb-a32d-9dc84903a09f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:10.152527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e97d648b-dcb0-4feb-a32d-9dc84903a09f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:10.170326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e97d648b-dcb0-4feb-a32d-9dc84903a09f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:10.172026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e97d648b-dcb0-4feb-a32d-9dc84903a09f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:10.173477 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e97d648b-dcb0-4feb-a32d-9dc84903a09f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.311704 Jan 22 21:16:10.174854 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2494/5213] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:09 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:10.453111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cad0751f-3575-4d17-aa43-2727d3511c9d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:10.453759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cad0751f-3575-4d17-aa43-2727d3511c9d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:10.458537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f68cbc4d-ca1c-4bda-917f-597ab650c78a req-1ae005c0-d71f-40b5-8b8b-60a6f3ca32c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdde4f64-417f-4c19-ac24-3250a9619db1", "tag": "a1a87111-ee94-490d-8f2e-69e60e3d6517"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:10.461189 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:10.461189 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:16:10.462882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cad0751f-3575-4d17-aa43-2727d3511c9d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:10.463541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cad0751f-3575-4d17-aa43-2727d3511c9d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:10.464542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cad0751f-3575-4d17-aa43-2727d3511c9d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:10.465175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cad0751f-3575-4d17-aa43-2727d3511c9d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:10.478981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f68cbc4d-ca1c-4bda-917f-597ab650c78a req-1ae005c0-d71f-40b5-8b8b-60a6f3ca32c4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:10.478981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f68cbc4d-ca1c-4bda-917f-597ab650c78a req-1ae005c0-d71f-40b5-8b8b-60a6f3ca32c4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:10.493166 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f68cbc4d-ca1c-4bda-917f-597ab650c78a req-1ae005c0-d71f-40b5-8b8b-60a6f3ca32c4 service nova] Creating event network-changed:a1a87111-ee94-490d-8f2e-69e60e3d6517 for instance cdde4f64-417f-4c19-ac24-3250a9619db1 on nch2-master-1 Jan 22 21:16:10.499499 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f68cbc4d-ca1c-4bda-917f-597ab650c78a req-1ae005c0-d71f-40b5-8b8b-60a6f3ca32c4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045717 Jan 22 21:16:10.503975 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2495/5214] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:10.646211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cad0751f-3575-4d17-aa43-2727d3511c9d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:10.658159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-76d446b3-ccde-4dfe-b3b0-4f3e1d91ad30 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:10.658892 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cad0751f-3575-4d17-aa43-2727d3511c9d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1566 microversion: 2.1 time: 0.208507 Jan 22 21:16:10.659328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-76d446b3-ccde-4dfe-b3b0-4f3e1d91ad30 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:10.667102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76d446b3-ccde-4dfe-b3b0-4f3e1d91ad30 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:10.667811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76d446b3-ccde-4dfe-b3b0-4f3e1d91ad30 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:10.668796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76d446b3-ccde-4dfe-b3b0-4f3e1d91ad30 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:10.669525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76d446b3-ccde-4dfe-b3b0-4f3e1d91ad30 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:10.671840 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2720/5215] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:10 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:10.871918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-90eccdfc-2acb-4f31-854b-072048cf52bf tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5148d30>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:10.921231 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-90eccdfc-2acb-4f31-854b-072048cf52bf tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1469 microversion: 2.1 time: 0.053008 Jan 22 21:16:10.929445 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2721/5216] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:16:10 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1469 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:10.935679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4c000939-db65-4531-b925-419113b03a4a tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edafde4c0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:10.986354 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4c000939-db65-4531-b925-419113b03a4a tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 200 len: 1469 microversion: 2.1 time: 0.055253 Jan 22 21:16:11.000282 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2722/5217] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:16:10 2022] GET /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 1469 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:11.000282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-feaeba1a-aeb2-4628-8fd1-e460ba07cb49 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:11.000282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-feaeba1a-aeb2-4628-8fd1-e460ba07cb49 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 0b558471-88c9-43fa-a970-799679fcbbf4] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:11.005969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-feaeba1a-aeb2-4628-8fd1-e460ba07cb49 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:11.006430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-feaeba1a-aeb2-4628-8fd1-e460ba07cb49 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:11.007242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-feaeba1a-aeb2-4628-8fd1-e460ba07cb49 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:11.007792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-feaeba1a-aeb2-4628-8fd1-e460ba07cb49 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:11.162115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-feaeba1a-aeb2-4628-8fd1-e460ba07cb49 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:11.170778 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-feaeba1a-aeb2-4628-8fd1-e460ba07cb49 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4" status: 200 len: 1485 microversion: 2.1 time: 0.175998 Jan 22 21:16:11.171522 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2723/5218] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:10 2022] GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4 => generated 1485 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:11.195013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f2efa18a-f0ff-4787-8009-809c02374e74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:11.195635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f2efa18a-f0ff-4787-8009-809c02374e74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:11.202822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2efa18a-f0ff-4787-8009-809c02374e74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:11.203514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2efa18a-f0ff-4787-8009-809c02374e74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:11.204535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2efa18a-f0ff-4787-8009-809c02374e74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:11.205036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2efa18a-f0ff-4787-8009-809c02374e74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:11.374562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f2efa18a-f0ff-4787-8009-809c02374e74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:11.387662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f2efa18a-f0ff-4787-8009-809c02374e74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:11.389998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f2efa18a-f0ff-4787-8009-809c02374e74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:11.391612 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f2efa18a-f0ff-4787-8009-809c02374e74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.201773 Jan 22 21:16:11.393271 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2724/5219] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:11 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:16:11.412018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-76d446b3-ccde-4dfe-b3b0-4f3e1d91ad30 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:11.423876 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-76d446b3-ccde-4dfe-b3b0-4f3e1d91ad30 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1318 microversion: 2.1 time: 0.769465 Jan 22 21:16:11.424400 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2496/5220] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:10 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1318 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:11.973284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-55811ad5-833d-4d7e-846e-696f503c8cff req-d00b1297-04b0-47c7-ad08-6a8614ba0b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ec4d907-48d2-48e9-8c9a-63dea188dab0", "name": "network-vif-plugged", "status": "completed", "tag": "c0a08ff2-3af1-46bf-8105-501a08abcd20"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:11.975491 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:11.975491 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:16:11.984209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-55811ad5-833d-4d7e-846e-696f503c8cff req-d00b1297-04b0-47c7-ad08-6a8614ba0b10 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:11.985065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-55811ad5-833d-4d7e-846e-696f503c8cff req-d00b1297-04b0-47c7-ad08-6a8614ba0b10 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:11.996667 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-55811ad5-833d-4d7e-846e-696f503c8cff req-d00b1297-04b0-47c7-ad08-6a8614ba0b10 service nova] Creating event network-vif-plugged:c0a08ff2-3af1-46bf-8105-501a08abcd20 for instance 1ec4d907-48d2-48e9-8c9a-63dea188dab0 on nch1-master-1 Jan 22 21:16:12.001535 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-55811ad5-833d-4d7e-846e-696f503c8cff req-d00b1297-04b0-47c7-ad08-6a8614ba0b10 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032156 Jan 22 21:16:12.002707 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2725/5221] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:12.187932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-18965d26-510c-4307-9f9b-f1ca9277e4fb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:12.189831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-18965d26-510c-4307-9f9b-f1ca9277e4fb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 0b558471-88c9-43fa-a970-799679fcbbf4] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:12.196333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18965d26-510c-4307-9f9b-f1ca9277e4fb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:12.196789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18965d26-510c-4307-9f9b-f1ca9277e4fb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:12.197630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18965d26-510c-4307-9f9b-f1ca9277e4fb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:12.198082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18965d26-510c-4307-9f9b-f1ca9277e4fb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:12.412000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-abefb8a0-7b54-4ce4-869d-1f1e86994d1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:12.412754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-abefb8a0-7b54-4ce4-869d-1f1e86994d1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:12.418910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abefb8a0-7b54-4ce4-869d-1f1e86994d1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:12.419377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abefb8a0-7b54-4ce4-869d-1f1e86994d1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:12.420212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abefb8a0-7b54-4ce4-869d-1f1e86994d1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:12.420621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abefb8a0-7b54-4ce4-869d-1f1e86994d1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:12.448938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-18965d26-510c-4307-9f9b-f1ca9277e4fb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:12.456796 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-18965d26-510c-4307-9f9b-f1ca9277e4fb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4" status: 200 len: 1472 microversion: 2.1 time: 0.272498 Jan 22 21:16:12.457982 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2497/5222] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:12 2022] GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4 => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:12.462766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e6c70d20-3153-4de8-b1e3-4f8c8848e44e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:12.466639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e6c70d20-3153-4de8-b1e3-4f8c8848e44e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:12.478493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6c70d20-3153-4de8-b1e3-4f8c8848e44e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:12.479047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6c70d20-3153-4de8-b1e3-4f8c8848e44e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:12.479937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6c70d20-3153-4de8-b1e3-4f8c8848e44e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:12.480454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6c70d20-3153-4de8-b1e3-4f8c8848e44e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:12.575555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-abefb8a0-7b54-4ce4-869d-1f1e86994d1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:12.583994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-abefb8a0-7b54-4ce4-869d-1f1e86994d1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:12.585496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-abefb8a0-7b54-4ce4-869d-1f1e86994d1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:12.586698 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-abefb8a0-7b54-4ce4-869d-1f1e86994d1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.179004 Jan 22 21:16:12.595537 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2726/5223] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:12 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:16:12.595537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-259c305d-7f2a-4dd8-a087-74d416519e73 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edafdee50>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:12.696067 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-259c305d-7f2a-4dd8-a087-74d416519e73 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images?changes-since=2022-01-22T21%3A14%3A46Z" status: 200 len: 2390 microversion: 2.1 time: 0.107759 Jan 22 21:16:12.698707 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2727/5224] 10.222.0.100 () {58 vars in 1203 bytes} [Sat Jan 22 21:16:12 2022] GET /compute/v2.1/images?changes-since=2022-01-22T21%3A14%3A46Z => generated 2390 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:12.710736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4efe2ddf-a22c-488d-bb4e-3d9f0e8dbca0 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5ed8670>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:12.728287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e6c70d20-3153-4de8-b1e3-4f8c8848e44e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:12.735805 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e6c70d20-3153-4de8-b1e3-4f8c8848e44e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1318 microversion: 2.1 time: 0.276606 Jan 22 21:16:12.737014 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2498/5225] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:12 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:12.782378 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4efe2ddf-a22c-488d-bb4e-3d9f0e8dbca0 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1188889871" status: 200 len: 488 microversion: 2.1 time: 0.076410 Jan 22 21:16:12.793574 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2728/5226] 10.222.0.100 () {58 vars in 1235 bytes} [Sat Jan 22 21:16:12 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1188889871 => generated 488 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:16:12.795073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bfccb49f-3c9d-48ed-8014-efc1e21c9a75 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed6105550>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:12.903046 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bfccb49f-3c9d-48ed-8014-efc1e21c9a75 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images?server=0b558471-88c9-43fa-a970-799679fcbbf4" status: 200 len: 963 microversion: 2.1 time: 0.111341 Jan 22 21:16:12.905887 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2499/5227] 10.222.0.100 () {58 vars in 1213 bytes} [Sat Jan 22 21:16:12 2022] GET /compute/v2.1/images?server=0b558471-88c9-43fa-a970-799679fcbbf4 => generated 963 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:12.916593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-11189c67-88a9-45fc-bd99-0b5ebfc3f815 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edaf1f4c0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:12.973971 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-11189c67-88a9-45fc-bd99-0b5ebfc3f815 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.100%2Fcompute%2Fv2.1%2Fservers%2F72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 488 microversion: 2.1 time: 0.056917 Jan 22 21:16:12.973971 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2729/5228] 10.222.0.100 () {58 vars in 1323 bytes} [Sat Jan 22 21:16:12 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.100%2Fcompute%2Fv2.1%2Fservers%2F72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 488 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:12.981262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-14a50e50-cbd9-4a12-ae2a-e743d0bb207b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5a3df70>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:13.031032 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-14a50e50-cbd9-4a12-ae2a-e743d0bb207b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.100%2Fcompute%2Fservers%2F72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 488 microversion: 2.1 time: 0.053336 Jan 22 21:16:13.031800 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2500/5229] 10.222.0.100 () {58 vars in 1309 bytes} [Sat Jan 22 21:16:12 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.100%2Fcompute%2Fservers%2F72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 488 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:13.044692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9ab92398-ced6-4e46-a6c0-81518380bf81 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edafde670>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:13.265730 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9ab92398-ced6-4e46-a6c0-81518380bf81 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3302 microversion: 2.1 time: 0.225738 Jan 22 21:16:13.266738 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2730/5230] 10.222.0.100 () {58 vars in 1153 bytes} [Sat Jan 22 21:16:13 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3302 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:13.281022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-edec187a-258c-4263-9774-5595adbf7250 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5ab2e50>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:13.349675 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-edec187a-258c-4263-9774-5595adbf7250 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1439 microversion: 2.1 time: 0.072543 Jan 22 21:16:13.350530 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2501/5231] 10.222.0.100 () {58 vars in 1153 bytes} [Sat Jan 22 21:16:13 2022] GET /compute/v2.1/images?type=snapshot => generated 1439 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:13.362778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ee915d71-600b-4a8d-b073-0bc60212ca9c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edaf1f160>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:13.418507 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ee915d71-600b-4a8d-b073-0bc60212ca9c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images?limit=1" status: 200 len: 626 microversion: 2.1 time: 0.059769 Jan 22 21:16:13.419086 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2731/5232] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:16:13 2022] GET /compute/v2.1/images?limit=1 => generated 626 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:13.430226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fd0dd455-1f28-4987-bbea-44166064a0b1 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5d67c10>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:13.520291 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fd0dd455-1f28-4987-bbea-44166064a0b1 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/detail?changes-since=2022-01-22T21%3A14%3A42Z" status: 200 len: 6358 microversion: 2.1 time: 0.087678 Jan 22 21:16:13.521002 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2502/5233] 10.222.0.100 () {58 vars in 1224 bytes} [Sat Jan 22 21:16:13 2022] GET /compute/v2.1/images/detail?changes-since=2022-01-22T21%3A14%3A42Z => generated 6358 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:13.541807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e450b7c8-3265-45d4-8505-0f0a25eb614e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed510c3a0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:13.589945 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e450b7c8-3265-45d4-8505-0f0a25eb614e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1188889871" status: 200 len: 668 microversion: 2.1 time: 0.051953 Jan 22 21:16:13.590681 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2732/5234] 10.222.0.100 () {58 vars in 1256 bytes} [Sat Jan 22 21:16:13 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1188889871 => generated 668 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:13.606499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2a0b60de-f279-4fc0-ae92-a29a86ff7540 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed6094670>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:13.608755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a3b7f568-9c3b-4c06-9029-5683293b6246 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:13.609671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a3b7f568-9c3b-4c06-9029-5683293b6246 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:13.618098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b7f568-9c3b-4c06-9029-5683293b6246 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:13.618554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b7f568-9c3b-4c06-9029-5683293b6246 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:13.619577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b7f568-9c3b-4c06-9029-5683293b6246 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:13.620041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b7f568-9c3b-4c06-9029-5683293b6246 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:13.663954 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2a0b60de-f279-4fc0-ae92-a29a86ff7540 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.100%2Fcompute%2Fv2.1%2Fservers%2F72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1472 microversion: 2.1 time: 0.062531 Jan 22 21:16:13.664838 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2503/5235] 10.222.0.100 () {58 vars in 1344 bytes} [Sat Jan 22 21:16:13 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.100%2Fcompute%2Fv2.1%2Fservers%2F72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1472 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:13.680383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6f81988a-0852-4c55-9f1f-c7ca11abe89b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edae7f4c0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:13.738829 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6f81988a-0852-4c55-9f1f-c7ca11abe89b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.100%2Fcompute%2Fservers%2F72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1472 microversion: 2.1 time: 0.064497 Jan 22 21:16:13.739652 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2504/5236] 10.222.0.100 () {58 vars in 1330 bytes} [Sat Jan 22 21:16:13 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.100%2Fcompute%2Fservers%2F72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1472 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:13.752549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-495ef3f3-d748-4364-b349-cbe08079432c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:13.759269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-495ef3f3-d748-4364-b349-cbe08079432c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:13.759753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-495ef3f3-d748-4364-b349-cbe08079432c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:13.760209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-495ef3f3-d748-4364-b349-cbe08079432c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:13.761013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-495ef3f3-d748-4364-b349-cbe08079432c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:13.761453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-495ef3f3-d748-4364-b349-cbe08079432c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:13.777732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a3b7f568-9c3b-4c06-9029-5683293b6246 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:13.787301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a3b7f568-9c3b-4c06-9029-5683293b6246 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:13.789161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a3b7f568-9c3b-4c06-9029-5683293b6246 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:13.790666 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a3b7f568-9c3b-4c06-9029-5683293b6246 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.188078 Jan 22 21:16:13.791310 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2733/5237] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:13 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:13.795970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f9ae69c5-f6fc-477a-a80e-6b28b3ad551b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed512a8b0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:13.877249 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f9ae69c5-f6fc-477a-a80e-6b28b3ad551b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7136 microversion: 2.1 time: 0.084413 Jan 22 21:16:13.877879 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2734/5238] 10.222.0.100 () {58 vars in 1174 bytes} [Sat Jan 22 21:16:13 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7136 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:13.894230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-be1f5f70-06cf-4597-8309-2dcae3fa5827 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed510c280>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:13.960309 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-be1f5f70-06cf-4597-8309-2dcae3fa5827 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4391 microversion: 2.1 time: 0.069696 Jan 22 21:16:13.960887 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2735/5239] 10.222.0.100 () {58 vars in 1174 bytes} [Sat Jan 22 21:16:13 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4391 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:13.974381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e5894b4c-0a54-403d-a7de-e7e28d9e308e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edaf1f8b0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:13.980053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-495ef3f3-d748-4364-b349-cbe08079432c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:13.987569 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-495ef3f3-d748-4364-b349-cbe08079432c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1504 microversion: 2.1 time: 0.238649 Jan 22 21:16:13.988187 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2505/5240] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:13 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:14.003240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5504545e-819e-40db-af7c-deeb61c8c16d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:14.003932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5504545e-819e-40db-af7c-deeb61c8c16d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:14.009918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5504545e-819e-40db-af7c-deeb61c8c16d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:14.010373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5504545e-819e-40db-af7c-deeb61c8c16d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:14.011152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5504545e-819e-40db-af7c-deeb61c8c16d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:14.011590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5504545e-819e-40db-af7c-deeb61c8c16d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:14.015129 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e5894b4c-0a54-403d-a7de-e7e28d9e308e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/373cb480-3bc4-4821-93e2-442b4e852b80" status: 200 len: 787 microversion: 2.1 time: 0.044991 Jan 22 21:16:14.019935 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2736/5241] 10.222.0.100 () {58 vars in 1237 bytes} [Sat Jan 22 21:16:13 2022] GET /compute/v2.1/images/373cb480-3bc4-4821-93e2-442b4e852b80 => generated 787 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:16:14.030559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c7ce2db0-2546-4ad0-8162-f96aa2bae567 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5ed8d30>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:14.086689 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c7ce2db0-2546-4ad0-8162-f96aa2bae567 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1617 microversion: 2.1 time: 0.059597 Jan 22 21:16:14.087344 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2737/5242] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 21:16:14 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1617 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:14.100169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-63899126-bbf3-49e8-9759-b26cb42c983b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edaf1f3a0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:14.197965 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5504545e-819e-40db-af7c-deeb61c8c16d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "POST /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0/action" status: 202 len: 0 microversion: 2.1 time: 0.198043 Jan 22 21:16:14.199230 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2506/5243] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:16:13 2022] POST /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:16:14.213079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1643ee5e-3fe9-4f28-8358-5f9865f2b5d4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:14.213079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1643ee5e-3fe9-4f28-8358-5f9865f2b5d4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:14.218855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1643ee5e-3fe9-4f28-8358-5f9865f2b5d4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:14.219387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1643ee5e-3fe9-4f28-8358-5f9865f2b5d4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:14.220516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1643ee5e-3fe9-4f28-8358-5f9865f2b5d4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:14.221171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1643ee5e-3fe9-4f28-8358-5f9865f2b5d4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:14.465534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1643ee5e-3fe9-4f28-8358-5f9865f2b5d4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:14.474203 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1643ee5e-3fe9-4f28-8358-5f9865f2b5d4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1509 microversion: 2.1 time: 0.270545 Jan 22 21:16:14.474725 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2507/5244] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:14 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:14.808086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9386f5b2-3bdd-4ded-80e9-a887ded72730 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:14.810811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9386f5b2-3bdd-4ded-80e9-a887ded72730 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:14.818553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9386f5b2-3bdd-4ded-80e9-a887ded72730 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:14.819005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9386f5b2-3bdd-4ded-80e9-a887ded72730 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:14.819803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9386f5b2-3bdd-4ded-80e9-a887ded72730 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:14.820259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9386f5b2-3bdd-4ded-80e9-a887ded72730 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:14.967218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9386f5b2-3bdd-4ded-80e9-a887ded72730 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:14.975734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9386f5b2-3bdd-4ded-80e9-a887ded72730 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:14.977234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9386f5b2-3bdd-4ded-80e9-a887ded72730 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:14.978431 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9386f5b2-3bdd-4ded-80e9-a887ded72730 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.174169 Jan 22 21:16:14.978993 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2508/5245] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:14 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:15.354621 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-63899126-bbf3-49e8-9759-b26cb42c983b tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "DELETE /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d" status: 204 len: 0 microversion: 2.1 time: 1.258308 Jan 22 21:16:15.355628 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2738/5246] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:14 2022] DELETE /compute/v2.1/images/a4002bbe-f3ff-4819-935d-dc7ad22f122d => generated 0 bytes in 1260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:16:15.364550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8184a92d-1064-4b39-ae5f-e83d056500af tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed602a9d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:15.491029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c87ee55d-faec-467b-b5c3-cbb1209636b4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:15.492128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c87ee55d-faec-467b-b5c3-cbb1209636b4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:15.502872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c87ee55d-faec-467b-b5c3-cbb1209636b4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:15.504644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c87ee55d-faec-467b-b5c3-cbb1209636b4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:15.506132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c87ee55d-faec-467b-b5c3-cbb1209636b4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:15.506798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c87ee55d-faec-467b-b5c3-cbb1209636b4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:15.813252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c87ee55d-faec-467b-b5c3-cbb1209636b4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:15.822079 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c87ee55d-faec-467b-b5c3-cbb1209636b4 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1489 microversion: 2.1 time: 0.335134 Jan 22 21:16:15.822801 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2739/5247] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:15 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1489 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:15.837867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-05c920f2-c35e-4640-8e9a-ddfec8529882 req-f3470a60-c2e3-4676-9faf-2db28e39f387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b558471-88c9-43fa-a970-799679fcbbf4", "name": "network-vif-unplugged", "status": "completed", "tag": "36634d05-9144-45d4-99b4-8efa52e8e426"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:15.839453 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:15.839453 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:16:15.847114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-05c920f2-c35e-4640-8e9a-ddfec8529882 req-f3470a60-c2e3-4676-9faf-2db28e39f387 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:15.847667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-05c920f2-c35e-4640-8e9a-ddfec8529882 req-f3470a60-c2e3-4676-9faf-2db28e39f387 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:15.858740 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-05c920f2-c35e-4640-8e9a-ddfec8529882 req-f3470a60-c2e3-4676-9faf-2db28e39f387 service nova] Creating event network-vif-unplugged:36634d05-9144-45d4-99b4-8efa52e8e426 for instance 0b558471-88c9-43fa-a970-799679fcbbf4 on nch1-master-1 Jan 22 21:16:15.863999 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-05c920f2-c35e-4640-8e9a-ddfec8529882 req-f3470a60-c2e3-4676-9faf-2db28e39f387 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029915 Jan 22 21:16:15.864738 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2740/5248] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:15.872101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f38e768c-e03f-47be-8700-5c9d1cf7f108 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:15.872681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f38e768c-e03f-47be-8700-5c9d1cf7f108 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:15.879207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f38e768c-e03f-47be-8700-5c9d1cf7f108 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:15.881987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f38e768c-e03f-47be-8700-5c9d1cf7f108 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:15.881987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f38e768c-e03f-47be-8700-5c9d1cf7f108 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:15.881987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f38e768c-e03f-47be-8700-5c9d1cf7f108 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:15.908738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f38e768c-e03f-47be-8700-5c9d1cf7f108 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:16:16.257608 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f38e768c-e03f-47be-8700-5c9d1cf7f108 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 204 len: 0 microversion: 2.1 time: 0.388850 Jan 22 21:16:16.258251 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2741/5249] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:16:15 2022] DELETE /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:16:16.263462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cfa5248a-92f5-4250-9d2d-b72acf4d11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:16.264163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cfa5248a-92f5-4250-9d2d-b72acf4d11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:16.287372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfa5248a-92f5-4250-9d2d-b72acf4d11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:16.289082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfa5248a-92f5-4250-9d2d-b72acf4d11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:16.289082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfa5248a-92f5-4250-9d2d-b72acf4d11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:16.289363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfa5248a-92f5-4250-9d2d-b72acf4d11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:16.427643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cfa5248a-92f5-4250-9d2d-b72acf4d11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:16.435954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cfa5248a-92f5-4250-9d2d-b72acf4d11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:16.437821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cfa5248a-92f5-4250-9d2d-b72acf4d11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:16.439020 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cfa5248a-92f5-4250-9d2d-b72acf4d11ff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1747 microversion: 2.20 time: 0.179596 Jan 22 21:16:16.439596 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2742/5250] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:16 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1747 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:16.450892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3399848d-14b5-4a5c-b0b6-f43d0185eb47 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:16.450892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3399848d-14b5-4a5c-b0b6-f43d0185eb47 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:16.451864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3399848d-14b5-4a5c-b0b6-f43d0185eb47 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:16.452323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3399848d-14b5-4a5c-b0b6-f43d0185eb47 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:16.453127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3399848d-14b5-4a5c-b0b6-f43d0185eb47 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:16.453614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3399848d-14b5-4a5c-b0b6-f43d0185eb47 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:16.611368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3399848d-14b5-4a5c-b0b6-f43d0185eb47 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:16.619378 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3399848d-14b5-4a5c-b0b6-f43d0185eb47 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1495 microversion: 2.1 time: 0.178618 Jan 22 21:16:16.620321 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2743/5251] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:16 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1495 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:16.839038 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8184a92d-1064-4b39-ae5f-e83d056500af tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "DELETE /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14" status: 204 len: 0 microversion: 2.1 time: 1.478989 Jan 22 21:16:16.839617 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2509/5252] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:15 2022] DELETE /compute/v2.1/images/680768c4-2f3e-4153-a5d3-393e7f150c14 => generated 0 bytes in 1480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:16:16.848495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1a70626f-faf2-4919-b464-38523fee7fbc tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1edaf1f5e0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:17.459084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-72ebd8a1-c751-4338-99e8-eb09610464fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:17.459809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-72ebd8a1-c751-4338-99e8-eb09610464fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:17.467343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72ebd8a1-c751-4338-99e8-eb09610464fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:17.468025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72ebd8a1-c751-4338-99e8-eb09610464fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:17.469241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72ebd8a1-c751-4338-99e8-eb09610464fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:17.469617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72ebd8a1-c751-4338-99e8-eb09610464fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:17.612842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-72ebd8a1-c751-4338-99e8-eb09610464fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:17.623009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-72ebd8a1-c751-4338-99e8-eb09610464fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:17.624340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-72ebd8a1-c751-4338-99e8-eb09610464fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:17.626013 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-72ebd8a1-c751-4338-99e8-eb09610464fc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1747 microversion: 2.20 time: 0.172029 Jan 22 21:16:17.626583 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2510/5253] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:17 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1747 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:16:17.642786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fd2c126c-46fa-476a-8112-50642d8c8802 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:17.643874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fd2c126c-46fa-476a-8112-50642d8c8802 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:17.650361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd2c126c-46fa-476a-8112-50642d8c8802 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:17.650703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd2c126c-46fa-476a-8112-50642d8c8802 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:17.651513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd2c126c-46fa-476a-8112-50642d8c8802 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:17.651966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd2c126c-46fa-476a-8112-50642d8c8802 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:17.805449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fd2c126c-46fa-476a-8112-50642d8c8802 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:17.820747 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fd2c126c-46fa-476a-8112-50642d8c8802 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1495 microversion: 2.1 time: 0.180875 Jan 22 21:16:17.821360 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2511/5254] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:17 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1495 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:18.165770 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1a70626f-faf2-4919-b464-38523fee7fbc tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "DELETE /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7" status: 204 len: 0 microversion: 2.1 time: 1.321880 Jan 22 21:16:18.166356 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2744/5255] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:16 2022] DELETE /compute/v2.1/images/ab03a461-fcbe-4072-8ad6-2224995255a7 => generated 0 bytes in 1323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:16:18.174241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-17a1130b-20a6-45a0-9857-255b1568f426 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:18.175103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-17a1130b-20a6-45a0-9857-255b1568f426 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:18.182126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17a1130b-20a6-45a0-9857-255b1568f426 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:18.192724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17a1130b-20a6-45a0-9857-255b1568f426 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:18.192724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17a1130b-20a6-45a0-9857-255b1568f426 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:18.192724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17a1130b-20a6-45a0-9857-255b1568f426 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:18.212051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-17a1130b-20a6-45a0-9857-255b1568f426 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:16:18.498220 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-17a1130b-20a6-45a0-9857-255b1568f426 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "DELETE /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 204 len: 0 microversion: 2.1 time: 0.325788 Jan 22 21:16:18.498220 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2512/5256] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:16:18 2022] DELETE /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:16:18.506675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f739eeb1-b957-4178-a94c-7e0d981f3280 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:18.507719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f739eeb1-b957-4178-a94c-7e0d981f3280 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:18.516649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f739eeb1-b957-4178-a94c-7e0d981f3280 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:18.517492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f739eeb1-b957-4178-a94c-7e0d981f3280 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:18.518714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f739eeb1-b957-4178-a94c-7e0d981f3280 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:18.519983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f739eeb1-b957-4178-a94c-7e0d981f3280 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:18.622104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-2b50536d-1773-409f-95cf-5161d80f6b28 req-7e6391e3-4b5d-4cd4-ac95-58877a462e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ec4d907-48d2-48e9-8c9a-63dea188dab0", "name": "network-vif-deleted", "tag": "c0a08ff2-3af1-46bf-8105-501a08abcd20"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:18.624133 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:18.624133 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:16:18.632120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2b50536d-1773-409f-95cf-5161d80f6b28 req-7e6391e3-4b5d-4cd4-ac95-58877a462e77 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:18.632876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2b50536d-1773-409f-95cf-5161d80f6b28 req-7e6391e3-4b5d-4cd4-ac95-58877a462e77 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:18.644783 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-2b50536d-1773-409f-95cf-5161d80f6b28 req-7e6391e3-4b5d-4cd4-ac95-58877a462e77 service nova] Creating event network-vif-deleted:c0a08ff2-3af1-46bf-8105-501a08abcd20 for instance 1ec4d907-48d2-48e9-8c9a-63dea188dab0 on nch1-master-1 Jan 22 21:16:18.653806 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-2b50536d-1773-409f-95cf-5161d80f6b28 req-7e6391e3-4b5d-4cd4-ac95-58877a462e77 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035705 Jan 22 21:16:18.654568 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2513/5257] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:18.671195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ce8a4a63-46e6-4fdc-b2ff-757b7c0607ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:18.672074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ce8a4a63-46e6-4fdc-b2ff-757b7c0607ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:18.681262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce8a4a63-46e6-4fdc-b2ff-757b7c0607ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:18.682076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce8a4a63-46e6-4fdc-b2ff-757b7c0607ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:18.683161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce8a4a63-46e6-4fdc-b2ff-757b7c0607ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:18.684572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce8a4a63-46e6-4fdc-b2ff-757b7c0607ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:18.816626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f739eeb1-b957-4178-a94c-7e0d981f3280 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:18.826357 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f739eeb1-b957-4178-a94c-7e0d981f3280 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1478 microversion: 2.1 time: 0.324550 Jan 22 21:16:18.830913 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2745/5258] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:18 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1478 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:18.839047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-73805663-7bce-4c46-b156-75b15c29d4a8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:18.839827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-73805663-7bce-4c46-b156-75b15c29d4a8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:18.841092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ce8a4a63-46e6-4fdc-b2ff-757b7c0607ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:18.846016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73805663-7bce-4c46-b156-75b15c29d4a8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:18.846473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73805663-7bce-4c46-b156-75b15c29d4a8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:18.848068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73805663-7bce-4c46-b156-75b15c29d4a8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:18.849251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73805663-7bce-4c46-b156-75b15c29d4a8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:18.851133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ce8a4a63-46e6-4fdc-b2ff-757b7c0607ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:18.852657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ce8a4a63-46e6-4fdc-b2ff-757b7c0607ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:18.853880 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ce8a4a63-46e6-4fdc-b2ff-757b7c0607ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1747 microversion: 2.20 time: 0.195322 Jan 22 21:16:18.855128 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2514/5259] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:18 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1747 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:18.983537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-73805663-7bce-4c46-b156-75b15c29d4a8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:18.992558 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-73805663-7bce-4c46-b156-75b15c29d4a8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 200 len: 1288 microversion: 2.1 time: 0.157357 Jan 22 21:16:18.993142 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2746/5260] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:18 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 1288 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:19.496567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-a3a2e140-999c-49c2-b3f6-5978ea452bd7 req-4ef67387-0935-4b54-adbb-3614f51000e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8288fe26-7e9c-451c-a9a2-222abbcf201e", "name": "network-vif-plugged", "status": "completed", "tag": "92a02346-3106-4ce0-82fd-0bae77d72810"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:19.498839 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:19.498839 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:16:19.507889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a3a2e140-999c-49c2-b3f6-5978ea452bd7 req-4ef67387-0935-4b54-adbb-3614f51000e4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:19.508334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a3a2e140-999c-49c2-b3f6-5978ea452bd7 req-4ef67387-0935-4b54-adbb-3614f51000e4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:19.520155 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-a3a2e140-999c-49c2-b3f6-5978ea452bd7 req-4ef67387-0935-4b54-adbb-3614f51000e4 service nova] Creating event network-vif-plugged:92a02346-3106-4ce0-82fd-0bae77d72810 for instance 8288fe26-7e9c-451c-a9a2-222abbcf201e on nch2-master-1 Jan 22 21:16:19.528199 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-a3a2e140-999c-49c2-b3f6-5978ea452bd7 req-4ef67387-0935-4b54-adbb-3614f51000e4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037246 Jan 22 21:16:19.529770 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2515/5261] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:19.844496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-438838a1-aaa4-47f8-b4bf-ae578d70e91e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:19.845217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-438838a1-aaa4-47f8-b4bf-ae578d70e91e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:19.852776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-438838a1-aaa4-47f8-b4bf-ae578d70e91e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:19.853277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-438838a1-aaa4-47f8-b4bf-ae578d70e91e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:19.854334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-438838a1-aaa4-47f8-b4bf-ae578d70e91e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:19.854791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-438838a1-aaa4-47f8-b4bf-ae578d70e91e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:19.874679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1bce8a1f-086b-442b-8e95-6d679400bf97 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:19.875475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1bce8a1f-086b-442b-8e95-6d679400bf97 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:19.883064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bce8a1f-086b-442b-8e95-6d679400bf97 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:19.883612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bce8a1f-086b-442b-8e95-6d679400bf97 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:19.884517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bce8a1f-086b-442b-8e95-6d679400bf97 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:19.885214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bce8a1f-086b-442b-8e95-6d679400bf97 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:20.019984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1bce8a1f-086b-442b-8e95-6d679400bf97 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:20.028366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1bce8a1f-086b-442b-8e95-6d679400bf97 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:20.030022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1bce8a1f-086b-442b-8e95-6d679400bf97 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:20.031275 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1bce8a1f-086b-442b-8e95-6d679400bf97 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1747 microversion: 2.20 time: 0.160900 Jan 22 21:16:20.031925 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2516/5262] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:19 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:16:20.036962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-308dbcc4-508d-4d51-9d20-651754fbac6f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:20.037895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-308dbcc4-508d-4d51-9d20-651754fbac6f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:20.044088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-308dbcc4-508d-4d51-9d20-651754fbac6f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:20.050778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-308dbcc4-508d-4d51-9d20-651754fbac6f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:20.050778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-308dbcc4-508d-4d51-9d20-651754fbac6f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:20.050778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-308dbcc4-508d-4d51-9d20-651754fbac6f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:20.060795 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-308dbcc4-508d-4d51-9d20-651754fbac6f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 1ec4d907-48d2-48e9-8c9a-63dea188dab0 could not be found. Jan 22 21:16:20.061406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-308dbcc4-508d-4d51-9d20-651754fbac6f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 1ec4d907-48d2-48e9-8c9a-63dea188dab0 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:16:20.062304 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-308dbcc4-508d-4d51-9d20-651754fbac6f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 404 len: 111 microversion: 2.1 time: 0.029463 Jan 22 21:16:20.063075 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2517/5263] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:20 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:16:20.118143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1470024569", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "96cc3928-7569-4c1f-becd-807913ebf734"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:20.172581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] validate_networks() for [('96cc3928-7569-4c1f-becd-807913ebf734', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:16:20.508045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-438838a1-aaa4-47f8-b4bf-ae578d70e91e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:20.516190 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-438838a1-aaa4-47f8-b4bf-ae578d70e91e tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1478 microversion: 2.1 time: 0.675532 Jan 22 21:16:20.517651 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2747/5264] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:19 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1478 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:20.695111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:16:20.695612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:16:20.696173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:16:20.696592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:16:20.697014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:16:20.712359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:20.712960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:20.713989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:20.714712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:20.733661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Getting quotas for project 5b1c3aa9e1ae4cc8a5a021434ad4a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:16:20.746171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Getting quotas for user b93108a71872461ea979735a490694a6 and project 5b1c3aa9e1ae4cc8a5a021434ad4a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:16:20.771016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:16:20.773520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:16:20.916882 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6641253a-3baf-4725-bda9-1b7b209e2c48 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.802306 Jan 22 21:16:20.922439 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2518/5265] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:16:20 2022] POST /compute/v2.1/servers => generated 382 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:16:20.928170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-354bfbb8-daa3-4cbb-89f6-04de32baae95 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:20.929252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-354bfbb8-daa3-4cbb-89f6-04de32baae95 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:21.015220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-354bfbb8-daa3-4cbb-89f6-04de32baae95 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:21.051554 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-354bfbb8-daa3-4cbb-89f6-04de32baae95 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1219 microversion: 2.1 time: 0.112874 Jan 22 21:16:21.056439 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2748/5266] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:20 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:21.056782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-50d7f73b-8912-445e-8dc7-9ef46edf12ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:21.056782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-50d7f73b-8912-445e-8dc7-9ef46edf12ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:21.063274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50d7f73b-8912-445e-8dc7-9ef46edf12ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:21.071344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50d7f73b-8912-445e-8dc7-9ef46edf12ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:21.089716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50d7f73b-8912-445e-8dc7-9ef46edf12ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:21.090206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50d7f73b-8912-445e-8dc7-9ef46edf12ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:21.145772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-bf2365ff-0a2d-4d40-a57f-10bfdacfb2cf req-26186299-fe92-4079-a65b-1c7c3c7df6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72918dc8-a7cc-4046-aa2d-9a91eb7d5332", "name": "network-vif-deleted", "tag": "36e7c743-4981-4f44-8177-d4ee4fdfa234"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:21.145772 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:21.145772 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:16:21.160793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bf2365ff-0a2d-4d40-a57f-10bfdacfb2cf req-26186299-fe92-4079-a65b-1c7c3c7df6dc service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:21.161253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bf2365ff-0a2d-4d40-a57f-10bfdacfb2cf req-26186299-fe92-4079-a65b-1c7c3c7df6dc service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:21.189336 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-bf2365ff-0a2d-4d40-a57f-10bfdacfb2cf req-26186299-fe92-4079-a65b-1c7c3c7df6dc service nova] Creating event network-vif-deleted:36e7c743-4981-4f44-8177-d4ee4fdfa234 for instance 72918dc8-a7cc-4046-aa2d-9a91eb7d5332 on nch1-master-1 Jan 22 21:16:21.200385 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-bf2365ff-0a2d-4d40-a57f-10bfdacfb2cf req-26186299-fe92-4079-a65b-1c7c3c7df6dc service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060628 Jan 22 21:16:21.201004 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2749/5267] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:16:21.299178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-50d7f73b-8912-445e-8dc7-9ef46edf12ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:21.307787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-50d7f73b-8912-445e-8dc7-9ef46edf12ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:21.309638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-50d7f73b-8912-445e-8dc7-9ef46edf12ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:21.311845 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-50d7f73b-8912-445e-8dc7-9ef46edf12ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1742 microversion: 2.20 time: 0.264314 Jan 22 21:16:21.311845 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2519/5268] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:21 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1742 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:21.538875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b724a06b-1b60-4067-8397-390c1c918eeb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:21.539627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b724a06b-1b60-4067-8397-390c1c918eeb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:21.563521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b724a06b-1b60-4067-8397-390c1c918eeb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:21.567588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b724a06b-1b60-4067-8397-390c1c918eeb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:21.568655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b724a06b-1b60-4067-8397-390c1c918eeb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:21.569319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b724a06b-1b60-4067-8397-390c1c918eeb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:21.614963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b724a06b-1b60-4067-8397-390c1c918eeb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:21.616008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b724a06b-1b60-4067-8397-390c1c918eeb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:21.616544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-b724a06b-1b60-4067-8397-390c1c918eeb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lazy-loading 'fault' on Instance uuid 72918dc8-a7cc-4046-aa2d-9a91eb7d5332 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:16:21.666239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b724a06b-1b60-4067-8397-390c1c918eeb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:21.675743 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b724a06b-1b60-4067-8397-390c1c918eeb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 200 len: 1312 microversion: 2.1 time: 0.143483 Jan 22 21:16:21.676756 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2750/5269] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:21 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 1312 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:22.068971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ae554d63-0cf5-4e3d-a7a9-ef128182229a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:22.070475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ae554d63-0cf5-4e3d-a7a9-ef128182229a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:22.080122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae554d63-0cf5-4e3d-a7a9-ef128182229a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:22.081002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae554d63-0cf5-4e3d-a7a9-ef128182229a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:22.082046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae554d63-0cf5-4e3d-a7a9-ef128182229a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:22.082967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae554d63-0cf5-4e3d-a7a9-ef128182229a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:22.168868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ae554d63-0cf5-4e3d-a7a9-ef128182229a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:22.179667 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ae554d63-0cf5-4e3d-a7a9-ef128182229a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1223 microversion: 2.1 time: 0.115307 Jan 22 21:16:22.181247 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2520/5270] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:22 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1223 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:22.330897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-28f8059b-886a-4223-96c6-85fdc06f049e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:22.334288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-28f8059b-886a-4223-96c6-85fdc06f049e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:22.353608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28f8059b-886a-4223-96c6-85fdc06f049e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:22.358576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28f8059b-886a-4223-96c6-85fdc06f049e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:22.358576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28f8059b-886a-4223-96c6-85fdc06f049e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:22.358576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28f8059b-886a-4223-96c6-85fdc06f049e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:22.564322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-28f8059b-886a-4223-96c6-85fdc06f049e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:22.576286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-28f8059b-886a-4223-96c6-85fdc06f049e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:22.578158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-28f8059b-886a-4223-96c6-85fdc06f049e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:22.579918 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-28f8059b-886a-4223-96c6-85fdc06f049e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1742 microversion: 2.20 time: 0.254061 Jan 22 21:16:22.581109 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2751/5271] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:22 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1742 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:22.694490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dd6656f0-ac1e-486b-9d67-e70cf7a90300 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:22.695485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dd6656f0-ac1e-486b-9d67-e70cf7a90300 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 72918dc8-a7cc-4046-aa2d-9a91eb7d5332] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:22.701977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd6656f0-ac1e-486b-9d67-e70cf7a90300 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:22.702752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd6656f0-ac1e-486b-9d67-e70cf7a90300 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:22.703775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd6656f0-ac1e-486b-9d67-e70cf7a90300 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:22.704441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd6656f0-ac1e-486b-9d67-e70cf7a90300 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:22.724793 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-dd6656f0-ac1e-486b-9d67-e70cf7a90300 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] HTTP exception thrown: Instance 72918dc8-a7cc-4046-aa2d-9a91eb7d5332 could not be found. Jan 22 21:16:22.725851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dd6656f0-ac1e-486b-9d67-e70cf7a90300 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Returning 404 to user: Instance 72918dc8-a7cc-4046-aa2d-9a91eb7d5332 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:16:22.726922 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dd6656f0-ac1e-486b-9d67-e70cf7a90300 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332" status: 404 len: 111 microversion: 2.1 time: 0.037469 Jan 22 21:16:22.727900 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2521/5272] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:22 2022] GET /compute/v2.1/servers/72918dc8-a7cc-4046-aa2d-9a91eb7d5332 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:16:22.735559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-55e8f994-d7e7-4659-85a6-749ea3a96d03 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:22.736292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-55e8f994-d7e7-4659-85a6-749ea3a96d03 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 0b558471-88c9-43fa-a970-799679fcbbf4] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:22.743824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55e8f994-d7e7-4659-85a6-749ea3a96d03 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:22.744749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55e8f994-d7e7-4659-85a6-749ea3a96d03 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:22.745646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55e8f994-d7e7-4659-85a6-749ea3a96d03 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:22.746249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55e8f994-d7e7-4659-85a6-749ea3a96d03 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:22.780368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-55e8f994-d7e7-4659-85a6-749ea3a96d03 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 0b558471-88c9-43fa-a970-799679fcbbf4] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:16:23.198138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9c29ed4a-cfc8-4857-8134-7c7642ee311a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:23.199457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9c29ed4a-cfc8-4857-8134-7c7642ee311a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:23.209913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c29ed4a-cfc8-4857-8134-7c7642ee311a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:23.210663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c29ed4a-cfc8-4857-8134-7c7642ee311a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:23.211461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c29ed4a-cfc8-4857-8134-7c7642ee311a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:23.212080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c29ed4a-cfc8-4857-8134-7c7642ee311a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:23.291387 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-55e8f994-d7e7-4659-85a6-749ea3a96d03 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "DELETE /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4" status: 204 len: 0 microversion: 2.1 time: 0.559160 Jan 22 21:16:23.292131 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2752/5273] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:16:22 2022] DELETE /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:16:23.303714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f4c81f1e-3485-4a61-9905-80c55664d4cb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:23.305393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f4c81f1e-3485-4a61-9905-80c55664d4cb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 0b558471-88c9-43fa-a970-799679fcbbf4] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:23.324397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4c81f1e-3485-4a61-9905-80c55664d4cb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:23.324871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4c81f1e-3485-4a61-9905-80c55664d4cb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:23.325731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4c81f1e-3485-4a61-9905-80c55664d4cb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:23.326191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4c81f1e-3485-4a61-9905-80c55664d4cb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:23.339390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9c29ed4a-cfc8-4857-8134-7c7642ee311a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:23.348450 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9c29ed4a-cfc8-4857-8134-7c7642ee311a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1271 microversion: 2.1 time: 0.154228 Jan 22 21:16:23.349809 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2522/5274] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:23 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:23.602882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b21ddbc5-5f82-4e95-ae36-0179de4702a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:23.603854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b21ddbc5-5f82-4e95-ae36-0179de4702a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:23.619106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b21ddbc5-5f82-4e95-ae36-0179de4702a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:23.619983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b21ddbc5-5f82-4e95-ae36-0179de4702a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:23.620980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b21ddbc5-5f82-4e95-ae36-0179de4702a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:23.622217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b21ddbc5-5f82-4e95-ae36-0179de4702a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:23.647255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f4c81f1e-3485-4a61-9905-80c55664d4cb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:23.663776 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f4c81f1e-3485-4a61-9905-80c55664d4cb tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4" status: 200 len: 1478 microversion: 2.1 time: 0.364599 Jan 22 21:16:23.665064 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2753/5275] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:23 2022] GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4 => generated 1478 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:24.229533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b21ddbc5-5f82-4e95-ae36-0179de4702a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:24.241632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b21ddbc5-5f82-4e95-ae36-0179de4702a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:24.243159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b21ddbc5-5f82-4e95-ae36-0179de4702a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:24.244355 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b21ddbc5-5f82-4e95-ae36-0179de4702a1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1742 microversion: 2.20 time: 0.647637 Jan 22 21:16:24.244920 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2523/5276] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:23 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1742 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:16:24.368020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b186db65-3f70-45b6-83db-946aca62eb5d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:24.368669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b186db65-3f70-45b6-83db-946aca62eb5d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:24.389472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b186db65-3f70-45b6-83db-946aca62eb5d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:24.396844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b186db65-3f70-45b6-83db-946aca62eb5d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:24.399182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b186db65-3f70-45b6-83db-946aca62eb5d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:24.399860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b186db65-3f70-45b6-83db-946aca62eb5d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:24.538635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b186db65-3f70-45b6-83db-946aca62eb5d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:24.549316 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b186db65-3f70-45b6-83db-946aca62eb5d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1277 microversion: 2.1 time: 0.187917 Jan 22 21:16:24.550923 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2754/5277] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:24 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:24.681937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0ee09336-7d66-4abf-9072-6b1535dcc55a tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:24.684583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0ee09336-7d66-4abf-9072-6b1535dcc55a tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 0b558471-88c9-43fa-a970-799679fcbbf4] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:24.700382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ee09336-7d66-4abf-9072-6b1535dcc55a tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:24.700920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ee09336-7d66-4abf-9072-6b1535dcc55a tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:24.708334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ee09336-7d66-4abf-9072-6b1535dcc55a tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:24.709020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ee09336-7d66-4abf-9072-6b1535dcc55a tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:24.955074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0ee09336-7d66-4abf-9072-6b1535dcc55a tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:24.964384 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0ee09336-7d66-4abf-9072-6b1535dcc55a tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4" status: 200 len: 1478 microversion: 2.1 time: 0.286825 Jan 22 21:16:24.965047 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2524/5278] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:24 2022] GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4 => generated 1478 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:25.263861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3c3222ce-ef88-49b7-a085-dfa6a6d9cca3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:25.264269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3c3222ce-ef88-49b7-a085-dfa6a6d9cca3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:25.283475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c3222ce-ef88-49b7-a085-dfa6a6d9cca3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:25.289793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c3222ce-ef88-49b7-a085-dfa6a6d9cca3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:25.289793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c3222ce-ef88-49b7-a085-dfa6a6d9cca3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:25.289793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c3222ce-ef88-49b7-a085-dfa6a6d9cca3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:25.569541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6bf66125-675d-47cb-a53d-2a65d81d2be7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:25.579677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6bf66125-675d-47cb-a53d-2a65d81d2be7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:25.582988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6bf66125-675d-47cb-a53d-2a65d81d2be7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:25.584377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6bf66125-675d-47cb-a53d-2a65d81d2be7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:25.585446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6bf66125-675d-47cb-a53d-2a65d81d2be7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:25.588727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6bf66125-675d-47cb-a53d-2a65d81d2be7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:25.631702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3c3222ce-ef88-49b7-a085-dfa6a6d9cca3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:25.644856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3c3222ce-ef88-49b7-a085-dfa6a6d9cca3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:25.650560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3c3222ce-ef88-49b7-a085-dfa6a6d9cca3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:25.652448 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3c3222ce-ef88-49b7-a085-dfa6a6d9cca3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1742 microversion: 2.20 time: 0.393278 Jan 22 21:16:25.655696 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2755/5279] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:25 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1742 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:25.984118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3f263b7-d823-4f5c-b648-80d6acaa0dc9 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:25.985105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d3f263b7-d823-4f5c-b648-80d6acaa0dc9 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 0b558471-88c9-43fa-a970-799679fcbbf4] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:25.993340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3f263b7-d823-4f5c-b648-80d6acaa0dc9 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:25.994401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3f263b7-d823-4f5c-b648-80d6acaa0dc9 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:25.995967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3f263b7-d823-4f5c-b648-80d6acaa0dc9 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:25.996647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3f263b7-d823-4f5c-b648-80d6acaa0dc9 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:26.170886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d3f263b7-d823-4f5c-b648-80d6acaa0dc9 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:26.181163 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d3f263b7-d823-4f5c-b648-80d6acaa0dc9 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4" status: 200 len: 1478 microversion: 2.1 time: 0.201657 Jan 22 21:16:26.185593 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2756/5280] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:25 2022] GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4 => generated 1478 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:26.223231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6bf66125-675d-47cb-a53d-2a65d81d2be7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:26.235671 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6bf66125-675d-47cb-a53d-2a65d81d2be7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1319 microversion: 2.1 time: 0.672520 Jan 22 21:16:26.239197 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2525/5281] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:25 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1319 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:26.679504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-230b8f1e-da1a-41ff-b60b-71d87066302a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:26.680313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-230b8f1e-da1a-41ff-b60b-71d87066302a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:26.698454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-230b8f1e-da1a-41ff-b60b-71d87066302a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:26.698931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-230b8f1e-da1a-41ff-b60b-71d87066302a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:26.699888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-230b8f1e-da1a-41ff-b60b-71d87066302a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:26.708098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-230b8f1e-da1a-41ff-b60b-71d87066302a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:26.935499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-230b8f1e-da1a-41ff-b60b-71d87066302a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:26.942664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-230b8f1e-da1a-41ff-b60b-71d87066302a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:26.944318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-230b8f1e-da1a-41ff-b60b-71d87066302a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:26.945562 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-230b8f1e-da1a-41ff-b60b-71d87066302a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1742 microversion: 2.20 time: 0.270793 Jan 22 21:16:26.947360 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2757/5282] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:26 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1742 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:26.983975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-6d80b71a-4dc9-40ff-b000-ee153eaec2e6 req-9d81613e-9dde-46c3-9cdd-21177e2f9a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b558471-88c9-43fa-a970-799679fcbbf4", "name": "network-vif-deleted", "tag": "36634d05-9144-45d4-99b4-8efa52e8e426"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:26.987061 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:26.987061 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:16:27.005744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6d80b71a-4dc9-40ff-b000-ee153eaec2e6 req-9d81613e-9dde-46c3-9cdd-21177e2f9a98 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:27.006589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6d80b71a-4dc9-40ff-b000-ee153eaec2e6 req-9d81613e-9dde-46c3-9cdd-21177e2f9a98 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:27.021583 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-6d80b71a-4dc9-40ff-b000-ee153eaec2e6 req-9d81613e-9dde-46c3-9cdd-21177e2f9a98 service nova] Creating event network-vif-deleted:36634d05-9144-45d4-99b4-8efa52e8e426 for instance 0b558471-88c9-43fa-a970-799679fcbbf4 on nch1-master-1 Jan 22 21:16:27.027459 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-6d80b71a-4dc9-40ff-b000-ee153eaec2e6 req-9d81613e-9dde-46c3-9cdd-21177e2f9a98 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047178 Jan 22 21:16:27.028634 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2526/5283] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:27.199469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7e6a5c1a-6456-4650-b4d3-5439154c3f46 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:27.199999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7e6a5c1a-6456-4650-b4d3-5439154c3f46 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 0b558471-88c9-43fa-a970-799679fcbbf4] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:27.211755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e6a5c1a-6456-4650-b4d3-5439154c3f46 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:27.212634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e6a5c1a-6456-4650-b4d3-5439154c3f46 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:27.213692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e6a5c1a-6456-4650-b4d3-5439154c3f46 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:27.214304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e6a5c1a-6456-4650-b4d3-5439154c3f46 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:27.255512 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cf6f2955-5498-4b49-95be-1ccf90699879 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:27.257109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cf6f2955-5498-4b49-95be-1ccf90699879 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:27.269234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf6f2955-5498-4b49-95be-1ccf90699879 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:27.269837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf6f2955-5498-4b49-95be-1ccf90699879 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:27.270647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf6f2955-5498-4b49-95be-1ccf90699879 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:27.284487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf6f2955-5498-4b49-95be-1ccf90699879 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:27.466289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7e6a5c1a-6456-4650-b4d3-5439154c3f46 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42fe72df26be4408873f97db23731ca3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4661f9e656a74bbcba6320d8e9576de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:27.474647 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7e6a5c1a-6456-4650-b4d3-5439154c3f46 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4" status: 200 len: 1307 microversion: 2.1 time: 0.279136 Jan 22 21:16:27.475238 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2758/5284] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:27 2022] GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4 => generated 1307 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:27.650880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cf6f2955-5498-4b49-95be-1ccf90699879 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:27.661681 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cf6f2955-5498-4b49-95be-1ccf90699879 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1319 microversion: 2.1 time: 0.410045 Jan 22 21:16:27.662250 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2527/5285] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:27 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:27.964972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5b6bcb5a-c3f8-4195-ad5b-9493938b35b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:27.965640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5b6bcb5a-c3f8-4195-ad5b-9493938b35b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:27.977676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b6bcb5a-c3f8-4195-ad5b-9493938b35b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:27.978703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b6bcb5a-c3f8-4195-ad5b-9493938b35b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:27.979729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b6bcb5a-c3f8-4195-ad5b-9493938b35b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:27.980388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b6bcb5a-c3f8-4195-ad5b-9493938b35b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:28.330300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5b6bcb5a-c3f8-4195-ad5b-9493938b35b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:28.372346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5b6bcb5a-c3f8-4195-ad5b-9493938b35b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:28.387197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5b6bcb5a-c3f8-4195-ad5b-9493938b35b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:28.388795 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5b6bcb5a-c3f8-4195-ad5b-9493938b35b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1742 microversion: 2.20 time: 0.427699 Jan 22 21:16:28.397143 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2759/5286] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:27 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1742 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:28.496769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ed60e56f-59ca-4fab-8a9f-e91d82030ff1 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:28.497526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ed60e56f-59ca-4fab-8a9f-e91d82030ff1 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] [instance: 0b558471-88c9-43fa-a970-799679fcbbf4] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:28.508265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed60e56f-59ca-4fab-8a9f-e91d82030ff1 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:28.510076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed60e56f-59ca-4fab-8a9f-e91d82030ff1 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:28.512390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed60e56f-59ca-4fab-8a9f-e91d82030ff1 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:28.515058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed60e56f-59ca-4fab-8a9f-e91d82030ff1 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:28.543704 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-ed60e56f-59ca-4fab-8a9f-e91d82030ff1 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] HTTP exception thrown: Instance 0b558471-88c9-43fa-a970-799679fcbbf4 could not be found. Jan 22 21:16:28.544645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ed60e56f-59ca-4fab-8a9f-e91d82030ff1 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Returning 404 to user: Instance 0b558471-88c9-43fa-a970-799679fcbbf4 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:16:28.545777 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ed60e56f-59ca-4fab-8a9f-e91d82030ff1 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4" status: 404 len: 111 microversion: 2.1 time: 0.057517 Jan 22 21:16:28.549698 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2528/5287] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:28 2022] GET /compute/v2.1/servers/0b558471-88c9-43fa-a970-799679fcbbf4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:16:28.555579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a09016ab-d90d-48cf-a5fa-876009a61133 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed5d22af0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:28.683247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8fff76d5-4742-4162-babe-11d3bf5ca2b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:28.683799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8fff76d5-4742-4162-babe-11d3bf5ca2b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:28.696483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fff76d5-4742-4162-babe-11d3bf5ca2b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:28.698318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fff76d5-4742-4162-babe-11d3bf5ca2b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:28.698318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fff76d5-4742-4162-babe-11d3bf5ca2b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:28.698318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fff76d5-4742-4162-babe-11d3bf5ca2b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:29.023544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8fff76d5-4742-4162-babe-11d3bf5ca2b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:29.032184 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8fff76d5-4742-4162-babe-11d3bf5ca2b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1319 microversion: 2.1 time: 0.357337 Jan 22 21:16:29.032813 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2529/5288] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:28 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:29.038994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7ebc2ed6-6e3f-4ae9-81cb-73f9271178ff tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:29.040276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7ebc2ed6-6e3f-4ae9-81cb-73f9271178ff tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:29.046204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ebc2ed6-6e3f-4ae9-81cb-73f9271178ff tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:29.052107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ebc2ed6-6e3f-4ae9-81cb-73f9271178ff tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:29.052107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ebc2ed6-6e3f-4ae9-81cb-73f9271178ff tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:29.052107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ebc2ed6-6e3f-4ae9-81cb-73f9271178ff tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:29.083816 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7ebc2ed6-6e3f-4ae9-81cb-73f9271178ff tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049862 Jan 22 21:16:29.084319 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2530/5289] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:16:29 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:16:29.088876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-2cc2cf83-50bc-4b42-80f9-5b5819e41332 req-90bf0b55-ec17-449d-8b45-c707eef8c8cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94caeb9b-99d6-4bf0-afa1-14362bcefed1", "tag": "f1d8fe43-1089-47c2-b9bd-b99ad91bfb28"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:29.091038 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:29.091038 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:16:29.098893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2cc2cf83-50bc-4b42-80f9-5b5819e41332 req-90bf0b55-ec17-449d-8b45-c707eef8c8cf service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:29.099610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2cc2cf83-50bc-4b42-80f9-5b5819e41332 req-90bf0b55-ec17-449d-8b45-c707eef8c8cf service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:29.111686 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-2cc2cf83-50bc-4b42-80f9-5b5819e41332 req-90bf0b55-ec17-449d-8b45-c707eef8c8cf service nova] Creating event network-changed:f1d8fe43-1089-47c2-b9bd-b99ad91bfb28 for instance 94caeb9b-99d6-4bf0-afa1-14362bcefed1 on nch1-master-1 Jan 22 21:16:29.117392 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-2cc2cf83-50bc-4b42-80f9-5b5819e41332 req-90bf0b55-ec17-449d-8b45-c707eef8c8cf service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031944 Jan 22 21:16:29.118045 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2531/5290] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:29.161876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-17edf7b7-d612-4f54-a258-f7e36f3ac3dc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:29.162474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-17edf7b7-d612-4f54-a258-f7e36f3ac3dc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:29.169198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17edf7b7-d612-4f54-a258-f7e36f3ac3dc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:29.169754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17edf7b7-d612-4f54-a258-f7e36f3ac3dc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:29.170575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17edf7b7-d612-4f54-a258-f7e36f3ac3dc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:29.171018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17edf7b7-d612-4f54-a258-f7e36f3ac3dc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:29.205423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-17edf7b7-d612-4f54-a258-f7e36f3ac3dc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:16:29.740302 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-17edf7b7-d612-4f54-a258-f7e36f3ac3dc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "DELETE /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 204 len: 0 microversion: 2.1 time: 0.580501 Jan 22 21:16:29.742819 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2532/5291] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:16:29 2022] DELETE /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:16:29.785052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-428732fe-196f-4fd5-8229-b5f45a5d0a28 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:29.789314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-428732fe-196f-4fd5-8229-b5f45a5d0a28 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:29.831363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-428732fe-196f-4fd5-8229-b5f45a5d0a28 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:29.834338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-428732fe-196f-4fd5-8229-b5f45a5d0a28 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:29.836075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-428732fe-196f-4fd5-8229-b5f45a5d0a28 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:29.868071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-428732fe-196f-4fd5-8229-b5f45a5d0a28 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:30.030067 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a09016ab-d90d-48cf-a5fa-876009a61133 tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "DELETE /compute/v2.1/images/d8bc5ab6-41f5-4528-b093-639e1eac08d6" status: 204 len: 0 microversion: 2.1 time: 1.478267 Jan 22 21:16:30.030504 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2760/5292] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:28 2022] DELETE /compute/v2.1/images/d8bc5ab6-41f5-4528-b093-639e1eac08d6 => generated 0 bytes in 1480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:16:30.041524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2b2f1948-0668-4614-beca-cd2e796c5bf8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:30.046555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2b2f1948-0668-4614-beca-cd2e796c5bf8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:30.063696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b2f1948-0668-4614-beca-cd2e796c5bf8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:30.064243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b2f1948-0668-4614-beca-cd2e796c5bf8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:30.065116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b2f1948-0668-4614-beca-cd2e796c5bf8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:30.070562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b2f1948-0668-4614-beca-cd2e796c5bf8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:30.196234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-428732fe-196f-4fd5-8229-b5f45a5d0a28 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:30.213290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-428732fe-196f-4fd5-8229-b5f45a5d0a28 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:30.215593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-428732fe-196f-4fd5-8229-b5f45a5d0a28 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:30.217537 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-428732fe-196f-4fd5-8229-b5f45a5d0a28 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1742 microversion: 2.20 time: 0.473344 Jan 22 21:16:30.219429 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2533/5293] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:29 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1742 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:30.226658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-214b8d57-6e6d-4537-b95f-020c735e4fad tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed50f6b80>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:30.517179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2b2f1948-0668-4614-beca-cd2e796c5bf8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:30.524165 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2b2f1948-0668-4614-beca-cd2e796c5bf8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1678 microversion: 2.1 time: 0.487648 Jan 22 21:16:30.525935 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2761/5294] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:30 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1678 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:30.538749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d595b832-83c1-45f7-b8a4-0045930e58cc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:30.540253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d595b832-83c1-45f7-b8a4-0045930e58cc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:30.566808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d595b832-83c1-45f7-b8a4-0045930e58cc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:30.567622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d595b832-83c1-45f7-b8a4-0045930e58cc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:30.569219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d595b832-83c1-45f7-b8a4-0045930e58cc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:30.569908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d595b832-83c1-45f7-b8a4-0045930e58cc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:30.892693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d595b832-83c1-45f7-b8a4-0045930e58cc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:30.910397 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d595b832-83c1-45f7-b8a4-0045930e58cc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1319 microversion: 2.1 time: 0.376994 Jan 22 21:16:30.911509 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2762/5295] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:30 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:31.076540 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-214b8d57-6e6d-4537-b95f-020c735e4fad tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "DELETE /compute/v2.1/images/b46f809e-b51d-4718-85c5-3ef046928a9b" status: 204 len: 0 microversion: 2.1 time: 0.855242 Jan 22 21:16:31.080908 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2534/5296] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:30 2022] DELETE /compute/v2.1/images/b46f809e-b51d-4718-85c5-3ef046928a9b => generated 0 bytes in 858 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:16:31.086138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2143fe42-9d34-4bec-98fb-8b4cadde394c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] Calling method '.version_select at 0x7f1ed512a160>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:31.238041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-72c6c483-3a97-4b18-b821-593a54d81f51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:31.239340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-72c6c483-3a97-4b18-b821-593a54d81f51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:31.260400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72c6c483-3a97-4b18-b821-593a54d81f51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:31.264498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72c6c483-3a97-4b18-b821-593a54d81f51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:31.265376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72c6c483-3a97-4b18-b821-593a54d81f51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:31.265869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72c6c483-3a97-4b18-b821-593a54d81f51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:31.730229 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2143fe42-9d34-4bec-98fb-8b4cadde394c tempest-ListImageFiltersTestJSON-1393919849 tempest-ListImageFiltersTestJSON-1393919849-project] 10.222.0.100 "DELETE /compute/v2.1/images/f4418b4f-51ff-4020-a782-f0c1502bea64" status: 204 len: 0 microversion: 2.1 time: 0.647628 Jan 22 21:16:31.730819 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2763/5297] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:31 2022] DELETE /compute/v2.1/images/f4418b4f-51ff-4020-a782-f0c1502bea64 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:16:31.736464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dba956a9-79d6-4831-b6f0-f236b3c524e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:31.739336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dba956a9-79d6-4831-b6f0-f236b3c524e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:31.756052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dba956a9-79d6-4831-b6f0-f236b3c524e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:31.756859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dba956a9-79d6-4831-b6f0-f236b3c524e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:31.757965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dba956a9-79d6-4831-b6f0-f236b3c524e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:31.758624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dba956a9-79d6-4831-b6f0-f236b3c524e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:31.865586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-72c6c483-3a97-4b18-b821-593a54d81f51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:31.881216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-72c6c483-3a97-4b18-b821-593a54d81f51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:31.882775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-72c6c483-3a97-4b18-b821-593a54d81f51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:31.883989 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-72c6c483-3a97-4b18-b821-593a54d81f51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1742 microversion: 2.20 time: 0.651303 Jan 22 21:16:31.903378 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2535/5298] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:31 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1742 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:31.929888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eaef2d10-502d-47b8-88d8-8041eb843367 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:31.930795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eaef2d10-502d-47b8-88d8-8041eb843367 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:31.944873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaef2d10-502d-47b8-88d8-8041eb843367 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:31.945619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaef2d10-502d-47b8-88d8-8041eb843367 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:31.946646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaef2d10-502d-47b8-88d8-8041eb843367 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:31.947252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaef2d10-502d-47b8-88d8-8041eb843367 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:32.145702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dba956a9-79d6-4831-b6f0-f236b3c524e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:32.154206 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dba956a9-79d6-4831-b6f0-f236b3c524e0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1678 microversion: 2.1 time: 0.422188 Jan 22 21:16:32.172304 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2764/5299] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:31 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1678 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:32.391328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eaef2d10-502d-47b8-88d8-8041eb843367 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:32.404740 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eaef2d10-502d-47b8-88d8-8041eb843367 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1319 microversion: 2.1 time: 0.480275 Jan 22 21:16:32.405926 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2536/5300] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:31 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1319 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:32.905685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-50659493-5e41-4575-87b4-fd46209efb9f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:32.906701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-50659493-5e41-4575-87b4-fd46209efb9f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:32.924180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50659493-5e41-4575-87b4-fd46209efb9f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:32.930902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50659493-5e41-4575-87b4-fd46209efb9f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:32.932160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50659493-5e41-4575-87b4-fd46209efb9f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:32.932871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50659493-5e41-4575-87b4-fd46209efb9f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:33.134594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-50659493-5e41-4575-87b4-fd46209efb9f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:33.160425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-50659493-5e41-4575-87b4-fd46209efb9f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:33.162512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-50659493-5e41-4575-87b4-fd46209efb9f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:33.163696 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-50659493-5e41-4575-87b4-fd46209efb9f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1742 microversion: 2.20 time: 0.264728 Jan 22 21:16:33.178835 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2765/5301] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:32 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1742 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:33.184685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c9f7272c-48ae-403f-bd24-5bf56c9d12d5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:33.185425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c9f7272c-48ae-403f-bd24-5bf56c9d12d5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:33.203620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9f7272c-48ae-403f-bd24-5bf56c9d12d5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:33.204256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9f7272c-48ae-403f-bd24-5bf56c9d12d5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:33.205178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9f7272c-48ae-403f-bd24-5bf56c9d12d5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:33.205767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9f7272c-48ae-403f-bd24-5bf56c9d12d5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:33.429181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d768c20f-d647-4d39-a73e-a4f43e2b3a2f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:33.430165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d768c20f-d647-4d39-a73e-a4f43e2b3a2f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:33.441751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d768c20f-d647-4d39-a73e-a4f43e2b3a2f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:33.442738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d768c20f-d647-4d39-a73e-a4f43e2b3a2f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:33.443814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d768c20f-d647-4d39-a73e-a4f43e2b3a2f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:33.444493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d768c20f-d647-4d39-a73e-a4f43e2b3a2f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:33.594998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c9f7272c-48ae-403f-bd24-5bf56c9d12d5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:33.611069 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c9f7272c-48ae-403f-bd24-5bf56c9d12d5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1678 microversion: 2.1 time: 0.436213 Jan 22 21:16:33.618028 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2537/5302] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:33 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1678 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:33.678224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d768c20f-d647-4d39-a73e-a4f43e2b3a2f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:33.687427 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d768c20f-d647-4d39-a73e-a4f43e2b3a2f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1319 microversion: 2.1 time: 0.267254 Jan 22 21:16:33.697726 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2766/5303] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:33 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:34.186347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-65999fac-4b31-454f-aa31-969caf6085db tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:34.186964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-65999fac-4b31-454f-aa31-969caf6085db tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:34.197346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65999fac-4b31-454f-aa31-969caf6085db tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:34.197346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65999fac-4b31-454f-aa31-969caf6085db tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:34.197346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65999fac-4b31-454f-aa31-969caf6085db tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:34.197346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65999fac-4b31-454f-aa31-969caf6085db tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:34.371192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-13533f43-ce3e-489d-b8b9-a782887a17ed req-d1949271-b06b-4b70-ab4a-5ca1f7ef7474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94caeb9b-99d6-4bf0-afa1-14362bcefed1", "name": "network-vif-plugged", "status": "completed", "tag": "f1d8fe43-1089-47c2-b9bd-b99ad91bfb28"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:34.382927 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:34.382927 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:16:34.399991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-13533f43-ce3e-489d-b8b9-a782887a17ed req-d1949271-b06b-4b70-ab4a-5ca1f7ef7474 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:34.400689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-13533f43-ce3e-489d-b8b9-a782887a17ed req-d1949271-b06b-4b70-ab4a-5ca1f7ef7474 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:34.423500 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-13533f43-ce3e-489d-b8b9-a782887a17ed req-d1949271-b06b-4b70-ab4a-5ca1f7ef7474 service nova] Creating event network-vif-plugged:f1d8fe43-1089-47c2-b9bd-b99ad91bfb28 for instance 94caeb9b-99d6-4bf0-afa1-14362bcefed1 on nch1-master-1 Jan 22 21:16:34.436073 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-13533f43-ce3e-489d-b8b9-a782887a17ed req-d1949271-b06b-4b70-ab4a-5ca1f7ef7474 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071650 Jan 22 21:16:34.436073 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2767/5304] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:16:34.557332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-65999fac-4b31-454f-aa31-969caf6085db tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:34.567900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-65999fac-4b31-454f-aa31-969caf6085db tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:34.569438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-65999fac-4b31-454f-aa31-969caf6085db tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:34.570674 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-65999fac-4b31-454f-aa31-969caf6085db tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1742 microversion: 2.20 time: 0.388143 Jan 22 21:16:34.587864 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2538/5305] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:34 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1742 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:34.639452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4aaccea8-6d0c-48f5-8851-e31e67bb71bb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:34.640165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4aaccea8-6d0c-48f5-8851-e31e67bb71bb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:34.674744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aaccea8-6d0c-48f5-8851-e31e67bb71bb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:34.677963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aaccea8-6d0c-48f5-8851-e31e67bb71bb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:34.679666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aaccea8-6d0c-48f5-8851-e31e67bb71bb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:34.681071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aaccea8-6d0c-48f5-8851-e31e67bb71bb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:34.706992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fe42ec02-b457-4cbb-936b-bf4e942a5ac7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:34.707588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fe42ec02-b457-4cbb-936b-bf4e942a5ac7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:34.724240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe42ec02-b457-4cbb-936b-bf4e942a5ac7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:34.724724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe42ec02-b457-4cbb-936b-bf4e942a5ac7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:34.725572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe42ec02-b457-4cbb-936b-bf4e942a5ac7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:34.726029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe42ec02-b457-4cbb-936b-bf4e942a5ac7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:34.846146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4aaccea8-6d0c-48f5-8851-e31e67bb71bb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:34.854107 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4aaccea8-6d0c-48f5-8851-e31e67bb71bb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1611 microversion: 2.1 time: 0.222511 Jan 22 21:16:34.855376 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2768/5306] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:34 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1611 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:35.218412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f81fcf1-a764-44d9-824c-3a992f424b84 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Action: 'create', calling method: .version_select at 0x7f1ed5d4aee0>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:35.232478 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-8f81fcf1-a764-44d9-824c-3a992f424b84 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jan 22 21:16:35.233587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f81fcf1-a764-44d9-824c-3a992f424b84 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:16:35.240745 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8f81fcf1-a764-44d9-824c-3a992f424b84 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.172941 Jan 22 21:16:35.241558 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2769/5307] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:16:35 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:16:35.251587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-53263eb5-42d5-4808-9536-87b1020c2f35 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Action: 'create', calling method: .version_select at 0x7f1ed5ce9310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2082226507", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:35.283356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-53263eb5-42d5-4808-9536-87b1020c2f35 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Getting quotas for project 39a89a7692234a818135c06e6c7f6730. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:16:35.333678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-53263eb5-42d5-4808-9536-87b1020c2f35 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Getting quotas for user 0a080351f36f454b8afe803b202b51cb and project 39a89a7692234a818135c06e6c7f6730. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:16:35.345883 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-53263eb5-42d5-4808-9536-87b1020c2f35 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jan 22 21:16:35.347074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-53263eb5-42d5-4808-9536-87b1020c2f35 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:16:35.348089 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-53263eb5-42d5-4808-9536-87b1020c2f35 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.100556 Jan 22 21:16:35.348974 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2770/5308] 10.222.0.100 () {60 vars in 1164 bytes} [Sat Jan 22 21:16:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 22 21:16:35.368700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-44b7e109-b889-47f8-a6e2-c7ccb07778e9 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Action: 'create', calling method: .version_select at 0x7f1ed5d4a3a0>, body: {"keypair": {"name": "tempest-keypair-78129551"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:35.389411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-44b7e109-b889-47f8-a6e2-c7ccb07778e9 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Getting quotas for project 39a89a7692234a818135c06e6c7f6730. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:16:35.398384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-44b7e109-b889-47f8-a6e2-c7ccb07778e9 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Getting quotas for user 0a080351f36f454b8afe803b202b51cb and project 39a89a7692234a818135c06e6c7f6730. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:16:35.609680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fe42ec02-b457-4cbb-936b-bf4e942a5ac7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:35.619966 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fe42ec02-b457-4cbb-936b-bf4e942a5ac7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1319 microversion: 2.1 time: 0.918503 Jan 22 21:16:35.620839 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2539/5309] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:34 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1319 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:35.634102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-68e163aa-3c86-4e11-9fea-8e42883b15e9 req-1a9239a6-1e14-4471-b184-4d31a0fa1a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3e8847-08c7-4122-914b-d4650821edcc", "name": "network-vif-deleted", "tag": "c2831901-064f-4d39-9a46-9472394ab33f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:35.635728 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:35.635728 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:16:35.642807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-68e163aa-3c86-4e11-9fea-8e42883b15e9 req-1a9239a6-1e14-4471-b184-4d31a0fa1a7a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:35.644169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-68e163aa-3c86-4e11-9fea-8e42883b15e9 req-1a9239a6-1e14-4471-b184-4d31a0fa1a7a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:35.658708 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-68e163aa-3c86-4e11-9fea-8e42883b15e9 req-1a9239a6-1e14-4471-b184-4d31a0fa1a7a service nova] Creating event network-vif-deleted:c2831901-064f-4d39-9a46-9472394ab33f for instance 3b3e8847-08c7-4122-914b-d4650821edcc on nch1-master-1 Jan 22 21:16:35.666251 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-68e163aa-3c86-4e11-9fea-8e42883b15e9 req-1a9239a6-1e14-4471-b184-4d31a0fa1a7a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043918 Jan 22 21:16:35.667878 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2540/5310] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:35.675679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-66d54dc2-c7ce-478e-84d3-97d369c3d2f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:35.676678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-66d54dc2-c7ce-478e-84d3-97d369c3d2f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:35.686594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66d54dc2-c7ce-478e-84d3-97d369c3d2f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:35.687769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66d54dc2-c7ce-478e-84d3-97d369c3d2f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:35.688527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66d54dc2-c7ce-478e-84d3-97d369c3d2f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:35.689144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66d54dc2-c7ce-478e-84d3-97d369c3d2f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:35.931482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-66d54dc2-c7ce-478e-84d3-97d369c3d2f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:35.944849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-66d54dc2-c7ce-478e-84d3-97d369c3d2f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:35.946748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-66d54dc2-c7ce-478e-84d3-97d369c3d2f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:35.948358 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-66d54dc2-c7ce-478e-84d3-97d369c3d2f0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1742 microversion: 2.20 time: 0.278623 Jan 22 21:16:35.949105 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2541/5311] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:35 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1742 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:35.954182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d9bf9549-8ddc-445a-b055-b0d06ea08d9d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:35.954814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d9bf9549-8ddc-445a-b055-b0d06ea08d9d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:35.962379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9bf9549-8ddc-445a-b055-b0d06ea08d9d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:35.962901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9bf9549-8ddc-445a-b055-b0d06ea08d9d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:35.963707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9bf9549-8ddc-445a-b055-b0d06ea08d9d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:35.964158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9bf9549-8ddc-445a-b055-b0d06ea08d9d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:36.045639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-44b7e109-b889-47f8-a6e2-c7ccb07778e9 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Getting quotas for project 39a89a7692234a818135c06e6c7f6730. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:16:36.053761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-44b7e109-b889-47f8-a6e2-c7ccb07778e9 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Getting quotas for user 0a080351f36f454b8afe803b202b51cb and project 39a89a7692234a818135c06e6c7f6730. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:16:36.057103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d9bf9549-8ddc-445a-b055-b0d06ea08d9d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:36.070464 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d9bf9549-8ddc-445a-b055-b0d06ea08d9d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 200 len: 1327 microversion: 2.1 time: 0.118882 Jan 22 21:16:36.071074 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2542/5312] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:35 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:36.084289 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-44b7e109-b889-47f8-a6e2-c7ccb07778e9 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.730074 Jan 22 21:16:36.085191 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2771/5313] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:16:35 2022] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:36.099773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7263e168-f285-411b-b2ec-3c2f9368db30 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Action: 'create', calling method: .version_select at 0x7f1ed5188e50>, body: {"keypair": {"name": "tempest-keypair-78129551"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:36.116060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7263e168-f285-411b-b2ec-3c2f9368db30 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Getting quotas for project 39a89a7692234a818135c06e6c7f6730. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:16:36.123175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7263e168-f285-411b-b2ec-3c2f9368db30 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Getting quotas for user 0a080351f36f454b8afe803b202b51cb and project 39a89a7692234a818135c06e6c7f6730. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:16:36.448644 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-7263e168-f285-411b-b2ec-3c2f9368db30 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] HTTP exception thrown: Key pair 'tempest-keypair-78129551' already exists. Jan 22 21:16:36.449279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7263e168-f285-411b-b2ec-3c2f9368db30 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Returning 409 to user: Key pair 'tempest-keypair-78129551' already exists. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:16:36.450282 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7263e168-f285-411b-b2ec-3c2f9368db30 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 409 len: 103 microversion: 2.1 time: 0.358655 Jan 22 21:16:36.451205 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2543/5314] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:16:36 2022] POST /compute/v2.1/os-keypairs => generated 103 bytes in 360 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:16:36.475360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-84443b8b-984f-4beb-ad47-4295d1dc9928 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Calling method '.version_select at 0x7f1ed5da84c0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:36.580289 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-84443b8b-984f-4beb-ad47-4295d1dc9928 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-78129551" status: 202 len: 0 microversion: 2.1 time: 0.120823 Jan 22 21:16:36.580448 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2544/5315] 10.222.0.100 () {58 vars in 1219 bytes} [Sat Jan 22 21:16:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-78129551 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:16:36.598755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc2f2363-2270-4ea7-986c-2af70fc65fcf tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Action: 'create', calling method: .version_select at 0x7f1ed5188670>, body: {"keypair": {"name": ""}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:36.606842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc2f2363-2270-4ea7-986c-2af70fc65fcf tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:16:36.608248 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bc2f2363-2270-4ea7-986c-2af70fc65fcf tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.016426 Jan 22 21:16:36.610600 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2545/5316] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:16:36 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:16:36.627393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7d42cf4f-5b8b-4eb9-91b6-2471e9a61340 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Action: 'create', calling method: .version_select at 0x7f1ed5cf93a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1746616601", "public_key": " "}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:36.648603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a6508d2-23d0-4b3a-bbc3-c9deba909787 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:36.650412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a6508d2-23d0-4b3a-bbc3-c9deba909787 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:36.653563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7d42cf4f-5b8b-4eb9-91b6-2471e9a61340 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Getting quotas for project 39a89a7692234a818135c06e6c7f6730. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:16:36.660037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a6508d2-23d0-4b3a-bbc3-c9deba909787 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:36.660279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7d42cf4f-5b8b-4eb9-91b6-2471e9a61340 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Getting quotas for user 0a080351f36f454b8afe803b202b51cb and project 39a89a7692234a818135c06e6c7f6730. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:16:36.662190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a6508d2-23d0-4b3a-bbc3-c9deba909787 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:36.663137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a6508d2-23d0-4b3a-bbc3-c9deba909787 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:36.663967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a6508d2-23d0-4b3a-bbc3-c9deba909787 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:36.682323 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-7d42cf4f-5b8b-4eb9-91b6-2471e9a61340 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jan 22 21:16:36.682937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7d42cf4f-5b8b-4eb9-91b6-2471e9a61340 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:16:36.683845 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7d42cf4f-5b8b-4eb9-91b6-2471e9a61340 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.067532 Jan 22 21:16:36.688886 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2546/5317] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:16:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 22 21:16:36.692464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1f5e8dba-0086-46ce-80d7-0846b2f0e804 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:36.693159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1f5e8dba-0086-46ce-80d7-0846b2f0e804 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:36.701685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f5e8dba-0086-46ce-80d7-0846b2f0e804 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:36.702149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f5e8dba-0086-46ce-80d7-0846b2f0e804 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:36.703259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f5e8dba-0086-46ce-80d7-0846b2f0e804 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:36.703623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f5e8dba-0086-46ce-80d7-0846b2f0e804 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:36.727658 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a6508d2-23d0-4b3a-bbc3-c9deba909787 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action" status: 200 len: 32490 microversion: 2.42 time: 0.446366 Jan 22 21:16:36.732956 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2772/5318] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:16:36 2022] POST /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92/action => generated 32490 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:16:36.741565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ede863c0-e12d-4c39-bed5-28d3da3091fd tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Action: 'create', calling method: .version_select at 0x7f1edaf31af0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:36.744401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ede863c0-e12d-4c39-bed5-28d3da3091fd tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:16:36.745591 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ede863c0-e12d-4c39-bed5-28d3da3091fd tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.011241 Jan 22 21:16:36.746862 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2773/5319] 10.222.0.100 () {60 vars in 1163 bytes} [Sat Jan 22 21:16:36 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:16:36.752480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-46f29bdf-7464-48a8-9c50-0e87ba87bf9d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:36.753898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-46f29bdf-7464-48a8-9c50-0e87ba87bf9d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:36.762038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46f29bdf-7464-48a8-9c50-0e87ba87bf9d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:36.762722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46f29bdf-7464-48a8-9c50-0e87ba87bf9d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:36.770222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46f29bdf-7464-48a8-9c50-0e87ba87bf9d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:36.770222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46f29bdf-7464-48a8-9c50-0e87ba87bf9d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:36.804152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-46f29bdf-7464-48a8-9c50-0e87ba87bf9d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:16:36.888138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1f5e8dba-0086-46ce-80d7-0846b2f0e804 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:36.897197 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1f5e8dba-0086-46ce-80d7-0846b2f0e804 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1319 microversion: 2.1 time: 0.211394 Jan 22 21:16:36.898363 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2547/5320] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:36 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:36.902922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b9f0ebc9-d235-4b63-b2eb-208e355c9c9d tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Action: 'create', calling method: .version_select at 0x7f1ed5d52700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-598736313", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:36.917585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-b9f0ebc9-d235-4b63-b2eb-208e355c9c9d tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Getting quotas for project 39a89a7692234a818135c06e6c7f6730. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:16:36.922582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-b9f0ebc9-d235-4b63-b2eb-208e355c9c9d tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Getting quotas for user 0a080351f36f454b8afe803b202b51cb and project 39a89a7692234a818135c06e6c7f6730. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:16:36.938731 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-b9f0ebc9-d235-4b63-b2eb-208e355c9c9d tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jan 22 21:16:36.939397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b9f0ebc9-d235-4b63-b2eb-208e355c9c9d tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:16:36.940769 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b9f0ebc9-d235-4b63-b2eb-208e355c9c9d tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.040839 Jan 22 21:16:36.941653 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2548/5321] 10.222.0.100 () {60 vars in 1163 bytes} [Sat Jan 22 21:16:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 22 21:16:36.950513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6f7e9135-2498-4a58-8b62-4d45a1b46ef3 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Calling method '.version_select at 0x7f1ed50f6a60>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:36.965467 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-6f7e9135-2498-4a58-8b62-4d45a1b46ef3 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-170299788 not found for user 0a080351f36f454b8afe803b202b51cb Jan 22 21:16:36.966251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6f7e9135-2498-4a58-8b62-4d45a1b46ef3 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] Returning 404 to user: Keypair tempest-keypair-non-existent-170299788 not found for user 0a080351f36f454b8afe803b202b51cb {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:16:36.967097 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6f7e9135-2498-4a58-8b62-4d45a1b46ef3 tempest-KeyPairsNegativeTestJSON-684321731 tempest-KeyPairsNegativeTestJSON-684321731-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-170299788" status: 404 len: 144 microversion: 2.1 time: 0.020205 Jan 22 21:16:36.973434 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2549/5322] 10.222.0.100 () {58 vars in 1261 bytes} [Sat Jan 22 21:16:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-170299788 => generated 144 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:16:36.973434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-730b49df-14bf-4bda-8ac9-e3147d3aa8c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:36.974102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-730b49df-14bf-4bda-8ac9-e3147d3aa8c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:36.981013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-730b49df-14bf-4bda-8ac9-e3147d3aa8c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:36.981584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-730b49df-14bf-4bda-8ac9-e3147d3aa8c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:36.986352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-730b49df-14bf-4bda-8ac9-e3147d3aa8c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:36.986352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-730b49df-14bf-4bda-8ac9-e3147d3aa8c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:37.181267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-730b49df-14bf-4bda-8ac9-e3147d3aa8c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:37.190779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-730b49df-14bf-4bda-8ac9-e3147d3aa8c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:37.192683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-730b49df-14bf-4bda-8ac9-e3147d3aa8c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:37.194007 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-730b49df-14bf-4bda-8ac9-e3147d3aa8c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1724 microversion: 2.20 time: 0.225337 Jan 22 21:16:37.208608 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2550/5323] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:36 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:37.210776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab697fa6-5230-47df-bead-5b1d0e99e411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:37.210952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab697fa6-5230-47df-bead-5b1d0e99e411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:37.217005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab697fa6-5230-47df-bead-5b1d0e99e411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:37.217467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab697fa6-5230-47df-bead-5b1d0e99e411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:37.218290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab697fa6-5230-47df-bead-5b1d0e99e411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:37.218736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab697fa6-5230-47df-bead-5b1d0e99e411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:37.233615 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-ab697fa6-5230-47df-bead-5b1d0e99e411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] HTTP exception thrown: Instance 3b3e8847-08c7-4122-914b-d4650821edcc could not be found. Jan 22 21:16:37.234217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab697fa6-5230-47df-bead-5b1d0e99e411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Returning 404 to user: Instance 3b3e8847-08c7-4122-914b-d4650821edcc could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:16:37.235053 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab697fa6-5230-47df-bead-5b1d0e99e411 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 404 len: 111 microversion: 2.1 time: 0.029377 Jan 22 21:16:37.235815 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2551/5324] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:37 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:16:37.245440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bda863d2-06f7-46f2-bad7-81b50f871683 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '.version_select at 0x7f1ed50f6940>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:37.258437 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-46f29bdf-7464-48a8-9c50-0e87ba87bf9d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "DELETE /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 204 len: 0 microversion: 2.42 time: 0.510104 Jan 22 21:16:37.259615 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2774/5325] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:16:36 2022] DELETE /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:16:37.274046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7200c20a-aa3f-47be-a211-e3d272ba21ef tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:37.274751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7200c20a-aa3f-47be-a211-e3d272ba21ef tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:37.280712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7200c20a-aa3f-47be-a211-e3d272ba21ef tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:37.281157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7200c20a-aa3f-47be-a211-e3d272ba21ef tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:37.281992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7200c20a-aa3f-47be-a211-e3d272ba21ef tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:37.282497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7200c20a-aa3f-47be-a211-e3d272ba21ef tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:37.339197 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bda863d2-06f7-46f2-bad7-81b50f871683 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1211694180" status: 202 len: 0 microversion: 2.1 time: 0.095026 Jan 22 21:16:37.340905 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2552/5326] 10.222.0.100 () {58 vars in 1225 bytes} [Sat Jan 22 21:16:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1211694180 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:16:37.609275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7200c20a-aa3f-47be-a211-e3d272ba21ef tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:37.626919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7200c20a-aa3f-47be-a211-e3d272ba21ef tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:37.629811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7200c20a-aa3f-47be-a211-e3d272ba21ef tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:37.631192 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7200c20a-aa3f-47be-a211-e3d272ba21ef tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 2965 microversion: 2.42 time: 0.361139 Jan 22 21:16:37.632922 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2775/5327] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:37 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 2965 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:16:37.917695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b730b945-c1d6-4ebf-b17c-5a90eba589ec tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:37.918408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b730b945-c1d6-4ebf-b17c-5a90eba589ec tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:37.926338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b730b945-c1d6-4ebf-b17c-5a90eba589ec tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:37.927503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b730b945-c1d6-4ebf-b17c-5a90eba589ec tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:37.927643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b730b945-c1d6-4ebf-b17c-5a90eba589ec tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:37.928167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b730b945-c1d6-4ebf-b17c-5a90eba589ec tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:38.144507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b730b945-c1d6-4ebf-b17c-5a90eba589ec tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:38.154686 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b730b945-c1d6-4ebf-b17c-5a90eba589ec tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1505 microversion: 2.1 time: 0.242177 Jan 22 21:16:38.155434 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2553/5328] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:37 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:38.171933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5620e0ba-8a5f-4f40-bc68-9afa09674f79 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:38.172478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5620e0ba-8a5f-4f40-bc68-9afa09674f79 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:38.179619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5620e0ba-8a5f-4f40-bc68-9afa09674f79 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:38.180003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5620e0ba-8a5f-4f40-bc68-9afa09674f79 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:38.180806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5620e0ba-8a5f-4f40-bc68-9afa09674f79 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:38.181868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5620e0ba-8a5f-4f40-bc68-9afa09674f79 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:38.212887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4faef020-647f-4701-b673-1a11b6e4fcf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:38.213652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4faef020-647f-4701-b673-1a11b6e4fcf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:38.218422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-5620e0ba-8a5f-4f40-bc68-9afa09674f79 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lazy-loading 'flavor' on Instance uuid 94caeb9b-99d6-4bf0-afa1-14362bcefed1 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:16:38.225396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4faef020-647f-4701-b673-1a11b6e4fcf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:38.226169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4faef020-647f-4701-b673-1a11b6e4fcf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:38.227138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4faef020-647f-4701-b673-1a11b6e4fcf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:38.227805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4faef020-647f-4701-b673-1a11b6e4fcf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:38.482017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4faef020-647f-4701-b673-1a11b6e4fcf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:38.492260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4faef020-647f-4701-b673-1a11b6e4fcf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:38.494173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4faef020-647f-4701-b673-1a11b6e4fcf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:38.495305 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4faef020-647f-4701-b673-1a11b6e4fcf6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1724 microversion: 2.20 time: 0.286225 Jan 22 21:16:38.496077 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2554/5329] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:38 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:38.654787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e98ee1cd-5636-4173-9fa8-7bdc7a353fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:38.654787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e98ee1cd-5636-4173-9fa8-7bdc7a353fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:38.661425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e98ee1cd-5636-4173-9fa8-7bdc7a353fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:38.663645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e98ee1cd-5636-4173-9fa8-7bdc7a353fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:38.664464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e98ee1cd-5636-4173-9fa8-7bdc7a353fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:38.666771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e98ee1cd-5636-4173-9fa8-7bdc7a353fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:38.961931 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5620e0ba-8a5f-4f40-bc68-9afa09674f79 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "POST /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1/action" status: 202 len: 0 microversion: 2.1 time: 0.793585 Jan 22 21:16:38.966306 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2776/5330] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:16:38 2022] POST /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1/action => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:16:38.993360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-72e1e424-4dbf-4fdd-86e5-399e0d752c90 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'create', calling method: .version_select at 0x7f1edafdeee0>, body: {"keypair": {"name": "tempest-keypair-1892142365"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:39.014785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e98ee1cd-5636-4173-9fa8-7bdc7a353fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:39.027530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e98ee1cd-5636-4173-9fa8-7bdc7a353fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:39.029541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e98ee1cd-5636-4173-9fa8-7bdc7a353fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:39.031590 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e98ee1cd-5636-4173-9fa8-7bdc7a353fc9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 2965 microversion: 2.42 time: 0.381706 Jan 22 21:16:39.033308 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2555/5331] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:38 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 2965 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:16:39.040263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5bdb1f2c-abd3-4179-8fde-7f818e6689c2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:39.048172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5bdb1f2c-abd3-4179-8fde-7f818e6689c2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:39.052942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-72e1e424-4dbf-4fdd-86e5-399e0d752c90 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Getting quotas for project 25a102ec3753465793d2bd70ee845e09. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:16:39.057052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bdb1f2c-abd3-4179-8fde-7f818e6689c2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:39.058045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bdb1f2c-abd3-4179-8fde-7f818e6689c2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:39.059037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bdb1f2c-abd3-4179-8fde-7f818e6689c2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:39.059716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bdb1f2c-abd3-4179-8fde-7f818e6689c2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:39.069435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-72e1e424-4dbf-4fdd-86e5-399e0d752c90 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Getting quotas for user 05463958163742cb8907fff532940f11 and project 25a102ec3753465793d2bd70ee845e09. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:16:39.314260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-72e1e424-4dbf-4fdd-86e5-399e0d752c90 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Getting quotas for project 25a102ec3753465793d2bd70ee845e09. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:16:39.320352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-72e1e424-4dbf-4fdd-86e5-399e0d752c90 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Getting quotas for user 05463958163742cb8907fff532940f11 and project 25a102ec3753465793d2bd70ee845e09. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:16:39.337963 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-72e1e424-4dbf-4fdd-86e5-399e0d752c90 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.352297 Jan 22 21:16:39.338935 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2777/5332] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:16:38 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:39.469541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5bdb1f2c-abd3-4179-8fde-7f818e6689c2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:39.479162 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5bdb1f2c-abd3-4179-8fde-7f818e6689c2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.443822 Jan 22 21:16:39.479746 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2556/5333] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:39 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:39.515818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e25bad57-95f9-488c-9963-e0049c4f49c3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:39.516589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e25bad57-95f9-488c-9963-e0049c4f49c3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:39.531330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e25bad57-95f9-488c-9963-e0049c4f49c3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:39.536198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e25bad57-95f9-488c-9963-e0049c4f49c3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:39.536198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e25bad57-95f9-488c-9963-e0049c4f49c3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:39.536198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e25bad57-95f9-488c-9963-e0049c4f49c3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:39.570383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-024feb27-20d2-432a-b02e-cbabe6356082 req-e72ca338-ed10-4b61-b142-580aec8226ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8288fe26-7e9c-451c-a9a2-222abbcf201e", "name": "network-vif-unplugged", "status": "completed", "tag": "92a02346-3106-4ce0-82fd-0bae77d72810"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:39.571883 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:39.571883 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:16:39.583506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-024feb27-20d2-432a-b02e-cbabe6356082 req-e72ca338-ed10-4b61-b142-580aec8226ca service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:39.584211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-024feb27-20d2-432a-b02e-cbabe6356082 req-e72ca338-ed10-4b61-b142-580aec8226ca service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:39.600146 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-024feb27-20d2-432a-b02e-cbabe6356082 req-e72ca338-ed10-4b61-b142-580aec8226ca service nova] Creating event network-vif-unplugged:92a02346-3106-4ce0-82fd-0bae77d72810 for instance 8288fe26-7e9c-451c-a9a2-222abbcf201e on nch2-master-1 Jan 22 21:16:39.606242 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-024feb27-20d2-432a-b02e-cbabe6356082 req-e72ca338-ed10-4b61-b142-580aec8226ca service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040586 Jan 22 21:16:39.607374 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2557/5334] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:16:39.840168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e25bad57-95f9-488c-9963-e0049c4f49c3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:39.851149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e25bad57-95f9-488c-9963-e0049c4f49c3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:39.852682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e25bad57-95f9-488c-9963-e0049c4f49c3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:39.853999 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e25bad57-95f9-488c-9963-e0049c4f49c3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1724 microversion: 2.20 time: 0.342407 Jan 22 21:16:39.857987 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2778/5335] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:39 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:40.055661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab5062d3-5a8f-4f6f-8382-728c24cd37d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:40.056373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab5062d3-5a8f-4f6f-8382-728c24cd37d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:40.072661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab5062d3-5a8f-4f6f-8382-728c24cd37d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:40.076486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab5062d3-5a8f-4f6f-8382-728c24cd37d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:40.077785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab5062d3-5a8f-4f6f-8382-728c24cd37d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:40.079361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab5062d3-5a8f-4f6f-8382-728c24cd37d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:40.497274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e54a9a03-de8c-4cbb-9472-7b8575ba7670 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:40.497944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e54a9a03-de8c-4cbb-9472-7b8575ba7670 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:40.506056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e54a9a03-de8c-4cbb-9472-7b8575ba7670 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:40.509732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e54a9a03-de8c-4cbb-9472-7b8575ba7670 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:40.509732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e54a9a03-de8c-4cbb-9472-7b8575ba7670 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:40.509732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e54a9a03-de8c-4cbb-9472-7b8575ba7670 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:40.531858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab5062d3-5a8f-4f6f-8382-728c24cd37d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:40.548197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab5062d3-5a8f-4f6f-8382-728c24cd37d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:40.552041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab5062d3-5a8f-4f6f-8382-728c24cd37d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:40.554014 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab5062d3-5a8f-4f6f-8382-728c24cd37d9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 2944 microversion: 2.42 time: 0.503280 Jan 22 21:16:40.554705 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2558/5336] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:40 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 2944 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:40.770006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e54a9a03-de8c-4cbb-9472-7b8575ba7670 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:40.779035 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e54a9a03-de8c-4cbb-9472-7b8575ba7670 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.286597 Jan 22 21:16:40.779911 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2779/5337] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:40 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:40.875735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dc428660-2a01-4191-8f77-e3025b518032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:40.878583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dc428660-2a01-4191-8f77-e3025b518032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:40.883740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc428660-2a01-4191-8f77-e3025b518032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:40.884536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc428660-2a01-4191-8f77-e3025b518032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:40.885827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc428660-2a01-4191-8f77-e3025b518032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:40.886632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc428660-2a01-4191-8f77-e3025b518032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:41.216808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dc428660-2a01-4191-8f77-e3025b518032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:41.228271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dc428660-2a01-4191-8f77-e3025b518032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:41.230803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dc428660-2a01-4191-8f77-e3025b518032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:41.232404 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dc428660-2a01-4191-8f77-e3025b518032 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1667 microversion: 2.20 time: 0.362797 Jan 22 21:16:41.233539 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2559/5338] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:40 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1667 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:41.251788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-10afb1ef-b99d-470a-a227-98a477d4b3b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df46cbf4-ba70-4e61-b51d-9f2a257ff669"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:41.253822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-10afb1ef-b99d-470a-a227-98a477d4b3b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:41.264124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10afb1ef-b99d-470a-a227-98a477d4b3b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:41.265005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10afb1ef-b99d-470a-a227-98a477d4b3b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:41.266409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10afb1ef-b99d-470a-a227-98a477d4b3b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:41.267434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10afb1ef-b99d-470a-a227-98a477d4b3b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:41.576568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-25dcb3fe-2114-4735-872a-3d68a3c4a8ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:41.587700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-25dcb3fe-2114-4735-872a-3d68a3c4a8ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:41.599939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25dcb3fe-2114-4735-872a-3d68a3c4a8ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:41.600637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25dcb3fe-2114-4735-872a-3d68a3c4a8ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:41.601975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25dcb3fe-2114-4735-872a-3d68a3c4a8ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:41.602637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25dcb3fe-2114-4735-872a-3d68a3c4a8ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:42.275743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-25dcb3fe-2114-4735-872a-3d68a3c4a8ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:42.286823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-25dcb3fe-2114-4735-872a-3d68a3c4a8ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:42.289106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-25dcb3fe-2114-4735-872a-3d68a3c4a8ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:42.290732 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-25dcb3fe-2114-4735-872a-3d68a3c4a8ed tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 2923 microversion: 2.42 time: 0.718921 Jan 22 21:16:42.291868 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2560/5339] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:41 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 2923 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:42.298592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-c3cd1f79-7d01-46ce-9ed8-6380f9e4cc1b req-ef93d0bf-0874-47ef-9025-a907126b36d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-unplugged", "status": "completed", "tag": "d4efec9f-1ce8-4f39-b074-2e15fb38a93f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:42.301340 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:42.301340 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:16:42.317336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c3cd1f79-7d01-46ce-9ed8-6380f9e4cc1b req-ef93d0bf-0874-47ef-9025-a907126b36d3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:42.318678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c3cd1f79-7d01-46ce-9ed8-6380f9e4cc1b req-ef93d0bf-0874-47ef-9025-a907126b36d3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:42.336799 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-c3cd1f79-7d01-46ce-9ed8-6380f9e4cc1b req-ef93d0bf-0874-47ef-9025-a907126b36d3 service nova] Creating event network-vif-unplugged:d4efec9f-1ce8-4f39-b074-2e15fb38a93f for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:16:42.344159 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-c3cd1f79-7d01-46ce-9ed8-6380f9e4cc1b req-ef93d0bf-0874-47ef-9025-a907126b36d3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050802 Jan 22 21:16:42.345554 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2561/5340] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:42.355203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6b659f06-6b41-4a0c-a354-6001932aad5e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:42.358136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6b659f06-6b41-4a0c-a354-6001932aad5e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:42.370317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b659f06-6b41-4a0c-a354-6001932aad5e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:42.371422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b659f06-6b41-4a0c-a354-6001932aad5e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:42.372452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b659f06-6b41-4a0c-a354-6001932aad5e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:42.373438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b659f06-6b41-4a0c-a354-6001932aad5e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:42.417616 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-10afb1ef-b99d-470a-a227-98a477d4b3b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.169836 Jan 22 21:16:42.418597 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2780/5341] 10.222.0.100 () {62 vars in 1368 bytes} [Sat Jan 22 21:16:41 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/os-volume_attachments => generated 188 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:16:42.531500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-1db88606-09ee-4623-9eab-9582d6ffc196 req-dfa5a9f9-961d-4002-b964-272313c8daa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-deleted", "tag": "d4efec9f-1ce8-4f39-b074-2e15fb38a93f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:42.535154 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:42.535154 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:16:42.553799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1db88606-09ee-4623-9eab-9582d6ffc196 req-dfa5a9f9-961d-4002-b964-272313c8daa7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:42.556934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1db88606-09ee-4623-9eab-9582d6ffc196 req-dfa5a9f9-961d-4002-b964-272313c8daa7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:42.581173 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-1db88606-09ee-4623-9eab-9582d6ffc196 req-dfa5a9f9-961d-4002-b964-272313c8daa7 service nova] Creating event network-vif-deleted:d4efec9f-1ce8-4f39-b074-2e15fb38a93f for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:16:42.589910 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-1db88606-09ee-4623-9eab-9582d6ffc196 req-dfa5a9f9-961d-4002-b964-272313c8daa7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061682 Jan 22 21:16:42.590805 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2781/5342] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:16:42.597280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a4a9bc29-e2b9-4df0-8394-91b45c842dd4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:42.597944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a4a9bc29-e2b9-4df0-8394-91b45c842dd4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:42.605174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4a9bc29-e2b9-4df0-8394-91b45c842dd4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:42.605174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4a9bc29-e2b9-4df0-8394-91b45c842dd4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:42.605982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4a9bc29-e2b9-4df0-8394-91b45c842dd4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:42.606510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4a9bc29-e2b9-4df0-8394-91b45c842dd4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:42.745203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6b659f06-6b41-4a0c-a354-6001932aad5e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:42.754651 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6b659f06-6b41-4a0c-a354-6001932aad5e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.406625 Jan 22 21:16:42.755243 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2562/5343] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:42 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:42.959547 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a4a9bc29-e2b9-4df0-8394-91b45c842dd4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action" status: 202 len: 0 microversion: 2.20 time: 0.367481 Jan 22 21:16:42.960691 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2782/5344] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:16:42 2022] POST /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:16:42.968465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-28b706af-57be-4526-84c3-29452cc59abe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:42.970108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-28b706af-57be-4526-84c3-29452cc59abe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:42.985468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28b706af-57be-4526-84c3-29452cc59abe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:42.985468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28b706af-57be-4526-84c3-29452cc59abe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:42.986861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28b706af-57be-4526-84c3-29452cc59abe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:42.987555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28b706af-57be-4526-84c3-29452cc59abe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:43.311891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b3a1faf9-2b44-41b2-8b20-4faa8aa566f9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:43.312893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b3a1faf9-2b44-41b2-8b20-4faa8aa566f9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:43.324213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3a1faf9-2b44-41b2-8b20-4faa8aa566f9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:43.327627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3a1faf9-2b44-41b2-8b20-4faa8aa566f9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:43.328704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3a1faf9-2b44-41b2-8b20-4faa8aa566f9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:43.329454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3a1faf9-2b44-41b2-8b20-4faa8aa566f9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:43.349732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-28b706af-57be-4526-84c3-29452cc59abe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:43.368828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-28b706af-57be-4526-84c3-29452cc59abe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:43.370810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-28b706af-57be-4526-84c3-29452cc59abe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:43.373039 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-28b706af-57be-4526-84c3-29452cc59abe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1753 microversion: 2.20 time: 0.407731 Jan 22 21:16:43.384574 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2563/5345] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:42 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1753 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:43.771943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-84df4227-e21e-498f-aec4-f429fa316c22 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:43.772684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-84df4227-e21e-498f-aec4-f429fa316c22 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:43.781008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b3a1faf9-2b44-41b2-8b20-4faa8aa566f9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:43.781966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84df4227-e21e-498f-aec4-f429fa316c22 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:43.782419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84df4227-e21e-498f-aec4-f429fa316c22 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:43.791502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84df4227-e21e-498f-aec4-f429fa316c22 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:43.791502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84df4227-e21e-498f-aec4-f429fa316c22 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:43.793266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b3a1faf9-2b44-41b2-8b20-4faa8aa566f9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:43.795090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b3a1faf9-2b44-41b2-8b20-4faa8aa566f9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:43.796799 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b3a1faf9-2b44-41b2-8b20-4faa8aa566f9 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 2762 microversion: 2.42 time: 0.489101 Jan 22 21:16:43.797766 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2783/5346] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:43 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 2762 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:44.309259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-910986892", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8333cfa-9dd9-48b4-af6f-4a39e320b704"}], "security_groups": [{"name": "tempest-securitygroup--1769296934"}], "key_name": "tempest-keypair-1892142365", "user_data": "}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:44.352250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-84df4227-e21e-498f-aec4-f429fa316c22 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:44.365565 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-84df4227-e21e-498f-aec4-f429fa316c22 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.597753 Jan 22 21:16:44.366747 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2564/5347] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:43 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:44.411143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fd3f0e1c-7995-4fc9-87d2-e09baea35d8f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:44.411143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fd3f0e1c-7995-4fc9-87d2-e09baea35d8f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:44.419662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd3f0e1c-7995-4fc9-87d2-e09baea35d8f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:44.420345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd3f0e1c-7995-4fc9-87d2-e09baea35d8f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:44.421693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd3f0e1c-7995-4fc9-87d2-e09baea35d8f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:44.422441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd3f0e1c-7995-4fc9-87d2-e09baea35d8f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:44.532131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] validate_networks() for [('b8333cfa-9dd9-48b4-af6f-4a39e320b704', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:16:44.761300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fd3f0e1c-7995-4fc9-87d2-e09baea35d8f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:44.776823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fd3f0e1c-7995-4fc9-87d2-e09baea35d8f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:44.778551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fd3f0e1c-7995-4fc9-87d2-e09baea35d8f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:44.779901 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fd3f0e1c-7995-4fc9-87d2-e09baea35d8f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1753 microversion: 2.20 time: 0.390532 Jan 22 21:16:44.781474 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2565/5348] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:44 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1753 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:44.788863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-bf0bbb58-bd64-4737-8f12-0d43e23e1839 req-6904d274-1c44-4ff4-937f-9c96a4199b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-unplugged", "status": "completed", "tag": "65a17ac8-ab35-4509-a302-dc7bac50087c"}, {"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-unplugged", "status": "completed", "tag": "751bac06-ae8b-43dc-bb1e-57283b8cf014"}, {"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-unplugged", "status": "completed", "tag": "926072cb-8b2b-4fa0-b9dc-cb5c9a1b57cc"}, {"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-unplugged", "status": "completed", "tag": "c631b245-837f-4809-9d1f-2d6792f3e2fb"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:44.791626 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:44.791626 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:16:44.801323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bf0bbb58-bd64-4737-8f12-0d43e23e1839 req-6904d274-1c44-4ff4-937f-9c96a4199b3c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:44.802062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bf0bbb58-bd64-4737-8f12-0d43e23e1839 req-6904d274-1c44-4ff4-937f-9c96a4199b3c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:44.834719 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-bf0bbb58-bd64-4737-8f12-0d43e23e1839 req-6904d274-1c44-4ff4-937f-9c96a4199b3c service nova] Creating event network-vif-unplugged:65a17ac8-ab35-4509-a302-dc7bac50087c for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:16:44.836109 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-bf0bbb58-bd64-4737-8f12-0d43e23e1839 req-6904d274-1c44-4ff4-937f-9c96a4199b3c service nova] Creating event network-vif-unplugged:751bac06-ae8b-43dc-bb1e-57283b8cf014 for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:16:44.836949 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-bf0bbb58-bd64-4737-8f12-0d43e23e1839 req-6904d274-1c44-4ff4-937f-9c96a4199b3c service nova] Creating event network-vif-unplugged:926072cb-8b2b-4fa0-b9dc-cb5c9a1b57cc for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:16:44.838003 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-bf0bbb58-bd64-4737-8f12-0d43e23e1839 req-6904d274-1c44-4ff4-937f-9c96a4199b3c service nova] Creating event network-vif-unplugged:c631b245-837f-4809-9d1f-2d6792f3e2fb for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:16:44.851648 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-bf0bbb58-bd64-4737-8f12-0d43e23e1839 req-6904d274-1c44-4ff4-937f-9c96a4199b3c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.063273 Jan 22 21:16:44.857248 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2566/5349] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:44.872184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-75cd736c-a4b7-4b1e-9089-35cb1ce25fb9 req-bdda4020-dd1d-42c0-ba74-0af3865208f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-deleted", "tag": "926072cb-8b2b-4fa0-b9dc-cb5c9a1b57cc"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:44.874137 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:44.874137 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:16:44.898152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-75cd736c-a4b7-4b1e-9089-35cb1ce25fb9 req-bdda4020-dd1d-42c0-ba74-0af3865208f5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:44.898818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-75cd736c-a4b7-4b1e-9089-35cb1ce25fb9 req-bdda4020-dd1d-42c0-ba74-0af3865208f5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:44.927539 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-75cd736c-a4b7-4b1e-9089-35cb1ce25fb9 req-bdda4020-dd1d-42c0-ba74-0af3865208f5 service nova] Creating event network-vif-deleted:926072cb-8b2b-4fa0-b9dc-cb5c9a1b57cc for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:16:44.935129 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-75cd736c-a4b7-4b1e-9089-35cb1ce25fb9 req-bdda4020-dd1d-42c0-ba74-0af3865208f5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074983 Jan 22 21:16:44.938633 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2567/5350] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:44.946708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6a4c6b7a-8e43-414c-8cc9-aaf648f91855 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:44.947652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6a4c6b7a-8e43-414c-8cc9-aaf648f91855 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:44.962131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a4c6b7a-8e43-414c-8cc9-aaf648f91855 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:44.962890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a4c6b7a-8e43-414c-8cc9-aaf648f91855 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:44.963940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a4c6b7a-8e43-414c-8cc9-aaf648f91855 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:44.964568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a4c6b7a-8e43-414c-8cc9-aaf648f91855 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:45.405028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6a4c6b7a-8e43-414c-8cc9-aaf648f91855 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:45.427185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6a4c6b7a-8e43-414c-8cc9-aaf648f91855 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:45.430739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6a4c6b7a-8e43-414c-8cc9-aaf648f91855 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:45.437770 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6a4c6b7a-8e43-414c-8cc9-aaf648f91855 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 2715 microversion: 2.42 time: 0.496674 Jan 22 21:16:45.440431 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2568/5351] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:44 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 2715 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:45.450099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ac65355a-9153-4c94-9856-ed30f5fbf3d0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:45.451562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ac65355a-9153-4c94-9856-ed30f5fbf3d0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:45.460312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac65355a-9153-4c94-9856-ed30f5fbf3d0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:45.460769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac65355a-9153-4c94-9856-ed30f5fbf3d0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:45.461873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac65355a-9153-4c94-9856-ed30f5fbf3d0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:45.462117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac65355a-9153-4c94-9856-ed30f5fbf3d0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:45.522866 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ac65355a-9153-4c94-9856-ed30f5fbf3d0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1/action" status: 200 len: 24563 microversion: 2.1 time: 0.079477 Jan 22 21:16:45.524594 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2569/5352] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:16:45 2022] POST /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1/action => generated 24563 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:16:45.556051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-45003f70-2cd1-4665-b0e0-a6d49c5c897e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:45.563826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-45003f70-2cd1-4665-b0e0-a6d49c5c897e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:45.578035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45003f70-2cd1-4665-b0e0-a6d49c5c897e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:45.578991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45003f70-2cd1-4665-b0e0-a6d49c5c897e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:45.579832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45003f70-2cd1-4665-b0e0-a6d49c5c897e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:45.580820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45003f70-2cd1-4665-b0e0-a6d49c5c897e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:46.022023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:16:46.023494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:16:46.024139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:16:46.024719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:16:46.025313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:16:46.040453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:46.043596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:46.044669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:46.045346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:46.093251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Getting quotas for project 25a102ec3753465793d2bd70ee845e09. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:16:46.105200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Getting quotas for user 05463958163742cb8907fff532940f11 and project 25a102ec3753465793d2bd70ee845e09. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:16:46.135336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:16:46.140844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:16:46.286127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-45003f70-2cd1-4665-b0e0-a6d49c5c897e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:46.295021 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-45003f70-2cd1-4665-b0e0-a6d49c5c897e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.754408 Jan 22 21:16:46.299939 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2570/5353] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:45 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:46.318236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a56381f7-03f2-4509-8171-8aecb155d33e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:46.319098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a56381f7-03f2-4509-8171-8aecb155d33e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:46.332500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a56381f7-03f2-4509-8171-8aecb155d33e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:46.337965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a56381f7-03f2-4509-8171-8aecb155d33e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:46.342515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a56381f7-03f2-4509-8171-8aecb155d33e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:46.343181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a56381f7-03f2-4509-8171-8aecb155d33e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:46.417991 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3b74281f-21a1-497a-86c0-dc68a03b23c1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.096843 Jan 22 21:16:46.419096 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2784/5354] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:16:44 2022] POST /compute/v2.1/servers => generated 404 bytes in 2121 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:16:46.453156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-66f94b8d-d42b-4113-896e-8ae89dc11ed9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:46.463841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-66f94b8d-d42b-4113-896e-8ae89dc11ed9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:46.664682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-66f94b8d-d42b-4113-896e-8ae89dc11ed9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:46.680215 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-66f94b8d-d42b-4113-896e-8ae89dc11ed9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1241 microversion: 2.1 time: 0.244256 Jan 22 21:16:46.680893 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2785/5355] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:46 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1241 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:46.696579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-11a39cba-31d9-4e56-a874-36614ba31f5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:46.707535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-11a39cba-31d9-4e56-a874-36614ba31f5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:46.718380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11a39cba-31d9-4e56-a874-36614ba31f5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:46.719116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11a39cba-31d9-4e56-a874-36614ba31f5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:46.722748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11a39cba-31d9-4e56-a874-36614ba31f5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:46.722748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11a39cba-31d9-4e56-a874-36614ba31f5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:47.135703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-11a39cba-31d9-4e56-a874-36614ba31f5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:47.151317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-11a39cba-31d9-4e56-a874-36614ba31f5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:47.153441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-11a39cba-31d9-4e56-a874-36614ba31f5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:47.155034 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-11a39cba-31d9-4e56-a874-36614ba31f5d tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 2554 microversion: 2.42 time: 0.470673 Jan 22 21:16:47.155891 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2786/5356] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:46 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 2554 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:47.234185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-f161b2aa-0a40-474f-96e2-daa98b1894e0 req-ab7dfd1d-48bc-4442-b610-7382f623e2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-deleted", "tag": "c631b245-837f-4809-9d1f-2d6792f3e2fb"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:47.235742 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:47.235742 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:16:47.250110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f161b2aa-0a40-474f-96e2-daa98b1894e0 req-ab7dfd1d-48bc-4442-b610-7382f623e2ec service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:47.255460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f161b2aa-0a40-474f-96e2-daa98b1894e0 req-ab7dfd1d-48bc-4442-b610-7382f623e2ec service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:47.279659 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f161b2aa-0a40-474f-96e2-daa98b1894e0 req-ab7dfd1d-48bc-4442-b610-7382f623e2ec service nova] Creating event network-vif-deleted:c631b245-837f-4809-9d1f-2d6792f3e2fb for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:16:47.292067 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-f161b2aa-0a40-474f-96e2-daa98b1894e0 req-ab7dfd1d-48bc-4442-b610-7382f623e2ec service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061337 Jan 22 21:16:47.293975 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2787/5357] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:16:47.317704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cf6464a5-0aad-43b9-9e3b-a4e4a25a739e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:47.318743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cf6464a5-0aad-43b9-9e3b-a4e4a25a739e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:47.328189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf6464a5-0aad-43b9-9e3b-a4e4a25a739e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:47.328888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf6464a5-0aad-43b9-9e3b-a4e4a25a739e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:47.331235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf6464a5-0aad-43b9-9e3b-a4e4a25a739e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:47.332210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf6464a5-0aad-43b9-9e3b-a4e4a25a739e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:47.573591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a56381f7-03f2-4509-8171-8aecb155d33e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:47.582396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a56381f7-03f2-4509-8171-8aecb155d33e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:47.584503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a56381f7-03f2-4509-8171-8aecb155d33e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:47.586065 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a56381f7-03f2-4509-8171-8aecb155d33e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1755 microversion: 2.20 time: 1.284678 Jan 22 21:16:47.586667 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2571/5358] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:46 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1755 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:47.651374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cf6464a5-0aad-43b9-9e3b-a4e4a25a739e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:47.663189 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cf6464a5-0aad-43b9-9e3b-a4e4a25a739e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.350515 Jan 22 21:16:47.664325 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2788/5359] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:47 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:47.697944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5c1f990c-749a-4d20-9a0f-440b50d2e5d0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:47.698693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5c1f990c-749a-4d20-9a0f-440b50d2e5d0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:47.799214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5c1f990c-749a-4d20-9a0f-440b50d2e5d0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:47.809762 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5c1f990c-749a-4d20-9a0f-440b50d2e5d0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1241 microversion: 2.1 time: 0.115350 Jan 22 21:16:47.820998 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2572/5360] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:47 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1241 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:48.179581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e51472b9-33d9-46b4-8ac1-2c0c8f426560 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:48.180342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e51472b9-33d9-46b4-8ac1-2c0c8f426560 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:48.189364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51472b9-33d9-46b4-8ac1-2c0c8f426560 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:48.191543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51472b9-33d9-46b4-8ac1-2c0c8f426560 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:48.192760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51472b9-33d9-46b4-8ac1-2c0c8f426560 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:48.193405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51472b9-33d9-46b4-8ac1-2c0c8f426560 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:48.456803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e51472b9-33d9-46b4-8ac1-2c0c8f426560 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:48.467191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e51472b9-33d9-46b4-8ac1-2c0c8f426560 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:48.469159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e51472b9-33d9-46b4-8ac1-2c0c8f426560 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:48.471591 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e51472b9-33d9-46b4-8ac1-2c0c8f426560 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 2216 microversion: 2.42 time: 0.298329 Jan 22 21:16:48.472791 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2789/5361] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:48 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 2216 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:48.610149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fea7ea4e-bda3-460b-b229-e8f4459f0ac6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:48.611034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fea7ea4e-bda3-460b-b229-e8f4459f0ac6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:48.641314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fea7ea4e-bda3-460b-b229-e8f4459f0ac6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:48.644311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fea7ea4e-bda3-460b-b229-e8f4459f0ac6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:48.646607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fea7ea4e-bda3-460b-b229-e8f4459f0ac6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:48.653998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fea7ea4e-bda3-460b-b229-e8f4459f0ac6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:48.680034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d5dff8aa-8e7f-4c9e-9a22-d6e7d075c57a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:48.681061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d5dff8aa-8e7f-4c9e-9a22-d6e7d075c57a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:48.693462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5dff8aa-8e7f-4c9e-9a22-d6e7d075c57a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:48.702280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5dff8aa-8e7f-4c9e-9a22-d6e7d075c57a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:48.702280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5dff8aa-8e7f-4c9e-9a22-d6e7d075c57a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:48.702280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5dff8aa-8e7f-4c9e-9a22-d6e7d075c57a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:48.916478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d5dff8aa-8e7f-4c9e-9a22-d6e7d075c57a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:48.926275 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d5dff8aa-8e7f-4c9e-9a22-d6e7d075c57a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.249763 Jan 22 21:16:48.927322 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2790/5362] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:48 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:48.934540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1385f50c-bad9-4dc5-9950-ddafe77cf604 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:48.937843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1385f50c-bad9-4dc5-9950-ddafe77cf604 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:48.943693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1385f50c-bad9-4dc5-9950-ddafe77cf604 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:48.944169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1385f50c-bad9-4dc5-9950-ddafe77cf604 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:48.945086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1385f50c-bad9-4dc5-9950-ddafe77cf604 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:48.946066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1385f50c-bad9-4dc5-9950-ddafe77cf604 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:49.046496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1385f50c-bad9-4dc5-9950-ddafe77cf604 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:49.061004 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1385f50c-bad9-4dc5-9950-ddafe77cf604 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1293 microversion: 2.1 time: 0.131628 Jan 22 21:16:49.062023 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2791/5363] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:48 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1293 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:49.192932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fea7ea4e-bda3-460b-b229-e8f4459f0ac6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:49.204903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fea7ea4e-bda3-460b-b229-e8f4459f0ac6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:49.207388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fea7ea4e-bda3-460b-b229-e8f4459f0ac6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:49.209646 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fea7ea4e-bda3-460b-b229-e8f4459f0ac6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.602564 Jan 22 21:16:49.215954 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2573/5364] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:48 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:49.319747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-b1843b41-ced2-4224-b66a-3ad210f9c9cd req-cb170163-1ea5-415e-b95c-e027b722a20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-deleted", "tag": "751bac06-ae8b-43dc-bb1e-57283b8cf014"}, {"server_uuid": "e65e0727-0cb5-4cc6-a5fb-188f60007d92", "name": "network-vif-deleted", "tag": "65a17ac8-ab35-4509-a302-dc7bac50087c"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:49.321402 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:49.321402 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:16:49.329097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b1843b41-ced2-4224-b66a-3ad210f9c9cd req-cb170163-1ea5-415e-b95c-e027b722a20a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:49.329998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b1843b41-ced2-4224-b66a-3ad210f9c9cd req-cb170163-1ea5-415e-b95c-e027b722a20a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:49.347241 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-b1843b41-ced2-4224-b66a-3ad210f9c9cd req-cb170163-1ea5-415e-b95c-e027b722a20a service nova] Creating event network-vif-deleted:751bac06-ae8b-43dc-bb1e-57283b8cf014 for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:16:49.347774 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-b1843b41-ced2-4224-b66a-3ad210f9c9cd req-cb170163-1ea5-415e-b95c-e027b722a20a service nova] Creating event network-vif-deleted:65a17ac8-ab35-4509-a302-dc7bac50087c for instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 on nch2-master-1 Jan 22 21:16:49.354329 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-b1843b41-ced2-4224-b66a-3ad210f9c9cd req-cb170163-1ea5-415e-b95c-e027b722a20a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040107 Jan 22 21:16:49.354950 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2792/5365] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:49.494697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-41528259-1860-460a-bb95-1e15f8484318 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:49.495836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-41528259-1860-460a-bb95-1e15f8484318 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:49.505185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41528259-1860-460a-bb95-1e15f8484318 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:49.506043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41528259-1860-460a-bb95-1e15f8484318 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:49.507126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41528259-1860-460a-bb95-1e15f8484318 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:49.507804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-41528259-1860-460a-bb95-1e15f8484318 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:49.840296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-41528259-1860-460a-bb95-1e15f8484318 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:49.857392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-41528259-1860-460a-bb95-1e15f8484318 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:49.860140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-41528259-1860-460a-bb95-1e15f8484318 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:49.861471 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-41528259-1860-460a-bb95-1e15f8484318 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1991 microversion: 2.42 time: 0.373200 Jan 22 21:16:49.862524 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2574/5366] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:49 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1991 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:49.945545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-054e4f12-1361-4cd6-a8c5-d35a63295a80 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:49.947057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-054e4f12-1361-4cd6-a8c5-d35a63295a80 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:49.954475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-054e4f12-1361-4cd6-a8c5-d35a63295a80 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:49.955229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-054e4f12-1361-4cd6-a8c5-d35a63295a80 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:49.957002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-054e4f12-1361-4cd6-a8c5-d35a63295a80 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:49.957652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-054e4f12-1361-4cd6-a8c5-d35a63295a80 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:50.078621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b2d5feb9-8b10-46ba-93f4-1f7c566ca791 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:50.079296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b2d5feb9-8b10-46ba-93f4-1f7c566ca791 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:50.099502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2d5feb9-8b10-46ba-93f4-1f7c566ca791 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:50.099966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2d5feb9-8b10-46ba-93f4-1f7c566ca791 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:50.102145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2d5feb9-8b10-46ba-93f4-1f7c566ca791 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:50.103662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2d5feb9-8b10-46ba-93f4-1f7c566ca791 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:50.126060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-054e4f12-1361-4cd6-a8c5-d35a63295a80 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:50.137194 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-054e4f12-1361-4cd6-a8c5-d35a63295a80 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.194392 Jan 22 21:16:50.138089 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2793/5367] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:49 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:50.234953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b2d5feb9-8b10-46ba-93f4-1f7c566ca791 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:50.239690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4aa65644-0c7f-4e9d-a35b-591550572f11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:50.242080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4aa65644-0c7f-4e9d-a35b-591550572f11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:50.251847 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b2d5feb9-8b10-46ba-93f4-1f7c566ca791 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1299 microversion: 2.1 time: 0.176845 Jan 22 21:16:50.256163 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2575/5368] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:50 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:50.256428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aa65644-0c7f-4e9d-a35b-591550572f11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:50.257149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aa65644-0c7f-4e9d-a35b-591550572f11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:50.259481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aa65644-0c7f-4e9d-a35b-591550572f11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:50.260161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aa65644-0c7f-4e9d-a35b-591550572f11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:50.460661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4aa65644-0c7f-4e9d-a35b-591550572f11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:50.470350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4aa65644-0c7f-4e9d-a35b-591550572f11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:50.472261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4aa65644-0c7f-4e9d-a35b-591550572f11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:50.474320 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4aa65644-0c7f-4e9d-a35b-591550572f11 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.249950 Jan 22 21:16:50.475433 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2794/5369] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:50 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:50.884910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-12672aef-04c4-4866-a1d6-9554767ddc07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:50.886086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-12672aef-04c4-4866-a1d6-9554767ddc07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:50.892859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12672aef-04c4-4866-a1d6-9554767ddc07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:50.893301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12672aef-04c4-4866-a1d6-9554767ddc07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:50.894580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12672aef-04c4-4866-a1d6-9554767ddc07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:50.896063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12672aef-04c4-4866-a1d6-9554767ddc07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:50.951700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12672aef-04c4-4866-a1d6-9554767ddc07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:50.954002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12672aef-04c4-4866-a1d6-9554767ddc07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:50.957160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-12672aef-04c4-4866-a1d6-9554767ddc07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lazy-loading 'fault' on Instance uuid e65e0727-0cb5-4cc6-a5fb-188f60007d92 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:16:51.055326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-12672aef-04c4-4866-a1d6-9554767ddc07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:51.066227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-12672aef-04c4-4866-a1d6-9554767ddc07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:51.068146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-12672aef-04c4-4866-a1d6-9554767ddc07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6394c313d9a45a6b6ab718256a7b454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e437a5b9bd14e108f01a125645d62b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:51.069862 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-12672aef-04c4-4866-a1d6-9554767ddc07 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 200 len: 1882 microversion: 2.42 time: 0.188734 Jan 22 21:16:51.082690 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2576/5370] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:50 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 1882 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:51.154834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4887a911-3e71-473b-9e19-62384bfd583c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:51.156068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4887a911-3e71-473b-9e19-62384bfd583c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:51.164420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4887a911-3e71-473b-9e19-62384bfd583c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:51.164880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4887a911-3e71-473b-9e19-62384bfd583c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:51.166796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4887a911-3e71-473b-9e19-62384bfd583c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:51.167477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4887a911-3e71-473b-9e19-62384bfd583c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:51.273042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab872ba7-2a11-45c3-826b-89390e01f9aa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:51.273694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab872ba7-2a11-45c3-826b-89390e01f9aa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:51.282277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab872ba7-2a11-45c3-826b-89390e01f9aa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:51.283017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab872ba7-2a11-45c3-826b-89390e01f9aa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:51.284621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab872ba7-2a11-45c3-826b-89390e01f9aa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:51.285176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab872ba7-2a11-45c3-826b-89390e01f9aa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:51.360887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4887a911-3e71-473b-9e19-62384bfd583c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:51.370016 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4887a911-3e71-473b-9e19-62384bfd583c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.218893 Jan 22 21:16:51.370297 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2795/5371] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:51 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:51.476280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab872ba7-2a11-45c3-826b-89390e01f9aa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:51.483790 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab872ba7-2a11-45c3-826b-89390e01f9aa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1299 microversion: 2.1 time: 0.214564 Jan 22 21:16:51.484622 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2577/5372] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:51 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1299 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:51.492532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3e626e1b-b5de-47d8-b758-2cc034e6dbd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:51.493811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3e626e1b-b5de-47d8-b758-2cc034e6dbd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:51.499429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e626e1b-b5de-47d8-b758-2cc034e6dbd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:51.499889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e626e1b-b5de-47d8-b758-2cc034e6dbd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:51.500692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e626e1b-b5de-47d8-b758-2cc034e6dbd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:51.501142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e626e1b-b5de-47d8-b758-2cc034e6dbd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:51.686140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3e626e1b-b5de-47d8-b758-2cc034e6dbd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:51.700633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3e626e1b-b5de-47d8-b758-2cc034e6dbd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:51.708869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3e626e1b-b5de-47d8-b758-2cc034e6dbd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:51.718997 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3e626e1b-b5de-47d8-b758-2cc034e6dbd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.229879 Jan 22 21:16:51.722955 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2796/5373] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:51 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:16:52.010400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-7f567ec0-317d-42cc-9d6a-6916d3f128c0 req-47a434db-43b0-4134-85e0-0982ee77b634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8288fe26-7e9c-451c-a9a2-222abbcf201e", "tag": "92a02346-3106-4ce0-82fd-0bae77d72810"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:52.015602 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:52.015602 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:16:52.028890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7f567ec0-317d-42cc-9d6a-6916d3f128c0 req-47a434db-43b0-4134-85e0-0982ee77b634 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:52.030422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7f567ec0-317d-42cc-9d6a-6916d3f128c0 req-47a434db-43b0-4134-85e0-0982ee77b634 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:52.051452 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-7f567ec0-317d-42cc-9d6a-6916d3f128c0 req-47a434db-43b0-4134-85e0-0982ee77b634 service nova] Creating event network-changed:92a02346-3106-4ce0-82fd-0bae77d72810 for instance 8288fe26-7e9c-451c-a9a2-222abbcf201e on nch1-master-1 Jan 22 21:16:52.066462 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-7f567ec0-317d-42cc-9d6a-6916d3f128c0 req-47a434db-43b0-4134-85e0-0982ee77b634 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066099 Jan 22 21:16:52.069831 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2578/5374] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:52.090868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f7bde26f-1b9b-4acc-9f98-bc5cda1848b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:52.094204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f7bde26f-1b9b-4acc-9f98-bc5cda1848b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:52.103922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7bde26f-1b9b-4acc-9f98-bc5cda1848b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:52.107968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7bde26f-1b9b-4acc-9f98-bc5cda1848b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:52.108904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7bde26f-1b9b-4acc-9f98-bc5cda1848b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:52.109368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7bde26f-1b9b-4acc-9f98-bc5cda1848b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:52.136861 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-f7bde26f-1b9b-4acc-9f98-bc5cda1848b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] HTTP exception thrown: Instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 could not be found. Jan 22 21:16:52.137470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f7bde26f-1b9b-4acc-9f98-bc5cda1848b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Returning 404 to user: Instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:16:52.138339 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f7bde26f-1b9b-4acc-9f98-bc5cda1848b1 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 404 len: 111 microversion: 2.42 time: 0.052578 Jan 22 21:16:52.142255 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2797/5375] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:52 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:16:52.151717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b87fd263-4643-46e9-b1fc-01736a58a695 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '.version_select at 0x7f1ed5449430>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:52.260717 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b87fd263-4643-46e9-b1fc-01736a58a695 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1839206740" status: 204 len: 0 microversion: 2.42 time: 0.113308 Jan 22 21:16:52.263340 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2579/5376] 10.222.0.100 () {60 vars in 1266 bytes} [Sat Jan 22 21:16:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1839206740 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 22 21:16:52.389087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0fafde46-0106-484f-a845-7f08c107af7b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:52.391095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0fafde46-0106-484f-a845-7f08c107af7b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:52.419066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0fafde46-0106-484f-a845-7f08c107af7b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:52.422134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0fafde46-0106-484f-a845-7f08c107af7b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:52.423206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0fafde46-0106-484f-a845-7f08c107af7b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:52.423699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0fafde46-0106-484f-a845-7f08c107af7b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:52.504083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a710044c-0619-4795-91f8-6a83c3c7dc56 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:52.506102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a710044c-0619-4795-91f8-6a83c3c7dc56 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:52.516984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a710044c-0619-4795-91f8-6a83c3c7dc56 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:52.518376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a710044c-0619-4795-91f8-6a83c3c7dc56 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:52.519674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a710044c-0619-4795-91f8-6a83c3c7dc56 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:52.520322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a710044c-0619-4795-91f8-6a83c3c7dc56 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:52.732990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0fafde46-0106-484f-a845-7f08c107af7b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:52.742730 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0fafde46-0106-484f-a845-7f08c107af7b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.359350 Jan 22 21:16:52.743318 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2798/5377] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:52 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:52.760513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2c6b3cb8-85e4-42a2-9099-8467e8436cd0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:52.760513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2c6b3cb8-85e4-42a2-9099-8467e8436cd0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:52.764222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c6b3cb8-85e4-42a2-9099-8467e8436cd0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:52.764904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c6b3cb8-85e4-42a2-9099-8467e8436cd0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:52.765926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c6b3cb8-85e4-42a2-9099-8467e8436cd0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:52.766555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c6b3cb8-85e4-42a2-9099-8467e8436cd0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:53.062411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2c6b3cb8-85e4-42a2-9099-8467e8436cd0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:53.075603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2c6b3cb8-85e4-42a2-9099-8467e8436cd0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:53.078741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2c6b3cb8-85e4-42a2-9099-8467e8436cd0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:53.080932 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2c6b3cb8-85e4-42a2-9099-8467e8436cd0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.335823 Jan 22 21:16:53.082519 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2799/5378] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:52 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:53.300700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a710044c-0619-4795-91f8-6a83c3c7dc56 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:53.309203 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a710044c-0619-4795-91f8-6a83c3c7dc56 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1367 microversion: 2.1 time: 0.812883 Jan 22 21:16:53.310011 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2580/5379] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:52 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1367 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:53.760421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8da58f33-8f11-4143-b373-ac1c00cf583d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:53.761234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8da58f33-8f11-4143-b373-ac1c00cf583d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:53.774105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8da58f33-8f11-4143-b373-ac1c00cf583d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:53.774575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8da58f33-8f11-4143-b373-ac1c00cf583d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:53.775434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8da58f33-8f11-4143-b373-ac1c00cf583d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:53.775883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8da58f33-8f11-4143-b373-ac1c00cf583d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:54.073125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8da58f33-8f11-4143-b373-ac1c00cf583d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:54.083807 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8da58f33-8f11-4143-b373-ac1c00cf583d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.327591 Jan 22 21:16:54.085041 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2800/5380] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:53 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:54.101428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ce00c042-0340-4370-8f45-e95eeea75311 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:54.102604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ce00c042-0340-4370-8f45-e95eeea75311 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:54.122614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce00c042-0340-4370-8f45-e95eeea75311 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:54.123079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce00c042-0340-4370-8f45-e95eeea75311 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:54.124139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce00c042-0340-4370-8f45-e95eeea75311 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:54.124594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce00c042-0340-4370-8f45-e95eeea75311 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:54.328985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9d13dfd7-01af-4e8c-843b-0b9b3f22499b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:54.330570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9d13dfd7-01af-4e8c-843b-0b9b3f22499b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:54.346841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d13dfd7-01af-4e8c-843b-0b9b3f22499b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:54.347544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d13dfd7-01af-4e8c-843b-0b9b3f22499b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:54.348589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d13dfd7-01af-4e8c-843b-0b9b3f22499b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:54.349220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d13dfd7-01af-4e8c-843b-0b9b3f22499b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:54.626542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ce00c042-0340-4370-8f45-e95eeea75311 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:54.646399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ce00c042-0340-4370-8f45-e95eeea75311 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:54.649326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ce00c042-0340-4370-8f45-e95eeea75311 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:54.650871 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ce00c042-0340-4370-8f45-e95eeea75311 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.553438 Jan 22 21:16:54.652089 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2581/5381] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:54 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:16:54.692272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9d13dfd7-01af-4e8c-843b-0b9b3f22499b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:54.705442 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9d13dfd7-01af-4e8c-843b-0b9b3f22499b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1367 microversion: 2.1 time: 0.380721 Jan 22 21:16:54.706374 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2801/5382] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:54 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1367 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:55.103745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-941dbfa7-1b64-417b-8c4c-c1a1bfc34c2a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:55.104376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-941dbfa7-1b64-417b-8c4c-c1a1bfc34c2a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:55.121316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-941dbfa7-1b64-417b-8c4c-c1a1bfc34c2a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:55.122685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-941dbfa7-1b64-417b-8c4c-c1a1bfc34c2a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:55.125224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-941dbfa7-1b64-417b-8c4c-c1a1bfc34c2a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:55.127969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-941dbfa7-1b64-417b-8c4c-c1a1bfc34c2a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:55.669153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-daacb779-bf25-4828-82d9-dc61e5377503 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:55.669828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-daacb779-bf25-4828-82d9-dc61e5377503 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:55.689213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-daacb779-bf25-4828-82d9-dc61e5377503 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:55.691037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-daacb779-bf25-4828-82d9-dc61e5377503 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:55.692276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-daacb779-bf25-4828-82d9-dc61e5377503 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:55.695190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-daacb779-bf25-4828-82d9-dc61e5377503 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:55.700142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-941dbfa7-1b64-417b-8c4c-c1a1bfc34c2a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:55.712203 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-941dbfa7-1b64-417b-8c4c-c1a1bfc34c2a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.613914 Jan 22 21:16:55.730725 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2582/5383] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:55 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:55.738467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d92a5e3b-5449-4e7e-9904-fdc8ab161e7b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:55.739446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d92a5e3b-5449-4e7e-9904-fdc8ab161e7b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:55.748823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d92a5e3b-5449-4e7e-9904-fdc8ab161e7b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:55.751115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d92a5e3b-5449-4e7e-9904-fdc8ab161e7b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:55.751862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d92a5e3b-5449-4e7e-9904-fdc8ab161e7b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:55.752591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d92a5e3b-5449-4e7e-9904-fdc8ab161e7b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:56.224296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-daacb779-bf25-4828-82d9-dc61e5377503 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:56.246714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-daacb779-bf25-4828-82d9-dc61e5377503 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:56.253492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-daacb779-bf25-4828-82d9-dc61e5377503 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:56.256790 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-daacb779-bf25-4828-82d9-dc61e5377503 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.590315 Jan 22 21:16:56.261685 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2802/5384] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:55 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:16:56.268873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5947a69f-a90f-41ff-9a97-8a07a0b1da30 req-d10de6e6-20d7-4e21-9397-33aacfb42259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b", "tag": "9337e9b6-78b2-48c1-b58f-3cf24e8cbbb5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:16:56.276907 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:16:56.276907 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:16:56.291059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5947a69f-a90f-41ff-9a97-8a07a0b1da30 req-d10de6e6-20d7-4e21-9397-33aacfb42259 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:56.300354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5947a69f-a90f-41ff-9a97-8a07a0b1da30 req-d10de6e6-20d7-4e21-9397-33aacfb42259 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:56.323916 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5947a69f-a90f-41ff-9a97-8a07a0b1da30 req-d10de6e6-20d7-4e21-9397-33aacfb42259 service nova] Creating event network-changed:9337e9b6-78b2-48c1-b58f-3cf24e8cbbb5 for instance 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b on nch1-master-1 Jan 22 21:16:56.336427 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-5947a69f-a90f-41ff-9a97-8a07a0b1da30 req-d10de6e6-20d7-4e21-9397-33aacfb42259 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074210 Jan 22 21:16:56.338340 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2803/5385] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:16:56.490950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d92a5e3b-5449-4e7e-9904-fdc8ab161e7b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:56.505432 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d92a5e3b-5449-4e7e-9904-fdc8ab161e7b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1367 microversion: 2.1 time: 0.771340 Jan 22 21:16:56.538496 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2583/5386] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:55 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1367 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:56.738720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7463825b-ddee-4179-8c25-3f734434a57b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:56.739525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7463825b-ddee-4179-8c25-3f734434a57b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:56.759068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7463825b-ddee-4179-8c25-3f734434a57b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:56.759941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7463825b-ddee-4179-8c25-3f734434a57b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:56.760908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7463825b-ddee-4179-8c25-3f734434a57b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:56.761546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7463825b-ddee-4179-8c25-3f734434a57b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:57.276201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d5f8ce64-750c-4057-b841-1b9e7df9be42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:57.277224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d5f8ce64-750c-4057-b841-1b9e7df9be42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:57.288924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5f8ce64-750c-4057-b841-1b9e7df9be42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:57.289762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5f8ce64-750c-4057-b841-1b9e7df9be42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:57.293746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5f8ce64-750c-4057-b841-1b9e7df9be42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:57.294459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5f8ce64-750c-4057-b841-1b9e7df9be42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:57.372272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7463825b-ddee-4179-8c25-3f734434a57b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:57.384595 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7463825b-ddee-4179-8c25-3f734434a57b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.650809 Jan 22 21:16:57.385293 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2804/5387] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:56 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:57.541748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-123dd03f-736b-442f-b22d-b96b15149f07 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:57.542679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-123dd03f-736b-442f-b22d-b96b15149f07 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:57.553933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-123dd03f-736b-442f-b22d-b96b15149f07 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:57.555972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-123dd03f-736b-442f-b22d-b96b15149f07 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:57.559083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-123dd03f-736b-442f-b22d-b96b15149f07 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:57.560009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-123dd03f-736b-442f-b22d-b96b15149f07 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:57.835397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-123dd03f-736b-442f-b22d-b96b15149f07 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:57.851325 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-123dd03f-736b-442f-b22d-b96b15149f07 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1367 microversion: 2.1 time: 0.315026 Jan 22 21:16:57.854999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d5f8ce64-750c-4057-b841-1b9e7df9be42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:57.856079 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2805/5388] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:57 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:16:57.898651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d5f8ce64-750c-4057-b841-1b9e7df9be42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:57.900436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d5f8ce64-750c-4057-b841-1b9e7df9be42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:57.905342 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d5f8ce64-750c-4057-b841-1b9e7df9be42 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.629292 Jan 22 21:16:57.907436 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2584/5389] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:57 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:16:58.402668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-04a7600c-1607-4f82-b85f-0613694803b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:58.403434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-04a7600c-1607-4f82-b85f-0613694803b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:58.428010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04a7600c-1607-4f82-b85f-0613694803b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:58.432177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04a7600c-1607-4f82-b85f-0613694803b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:58.433312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04a7600c-1607-4f82-b85f-0613694803b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:58.435752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04a7600c-1607-4f82-b85f-0613694803b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:58.717824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-04a7600c-1607-4f82-b85f-0613694803b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:58.733914 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-04a7600c-1607-4f82-b85f-0613694803b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.332381 Jan 22 21:16:58.735242 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2806/5390] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:58 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:58.881622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-661a1443-55b1-42d4-8a50-c1ae0d7a8df8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:58.882977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-661a1443-55b1-42d4-8a50-c1ae0d7a8df8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:58.893862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-661a1443-55b1-42d4-8a50-c1ae0d7a8df8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:58.894812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-661a1443-55b1-42d4-8a50-c1ae0d7a8df8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:58.896146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-661a1443-55b1-42d4-8a50-c1ae0d7a8df8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:58.897901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-661a1443-55b1-42d4-8a50-c1ae0d7a8df8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:58.927352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f28b4ce6-c5b8-463a-a2c2-73d7392e31a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:58.928970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f28b4ce6-c5b8-463a-a2c2-73d7392e31a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:58.943791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f28b4ce6-c5b8-463a-a2c2-73d7392e31a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:58.944830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f28b4ce6-c5b8-463a-a2c2-73d7392e31a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:58.946203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f28b4ce6-c5b8-463a-a2c2-73d7392e31a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:58.947047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f28b4ce6-c5b8-463a-a2c2-73d7392e31a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:59.323015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f28b4ce6-c5b8-463a-a2c2-73d7392e31a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:59.336965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f28b4ce6-c5b8-463a-a2c2-73d7392e31a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:59.338532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f28b4ce6-c5b8-463a-a2c2-73d7392e31a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:59.365973 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f28b4ce6-c5b8-463a-a2c2-73d7392e31a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.444144 Jan 22 21:16:59.379097 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2807/5391] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:16:58 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:16:59.557026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-661a1443-55b1-42d4-8a50-c1ae0d7a8df8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:16:59.567098 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-661a1443-55b1-42d4-8a50-c1ae0d7a8df8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1367 microversion: 2.1 time: 0.696563 Jan 22 21:16:59.567098 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2585/5392] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:58 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1367 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:16:59.756936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fe9c47cf-4ce7-49ff-b5fa-c540badf456d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:16:59.757678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fe9c47cf-4ce7-49ff-b5fa-c540badf456d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:16:59.775985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe9c47cf-4ce7-49ff-b5fa-c540badf456d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:59.779271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe9c47cf-4ce7-49ff-b5fa-c540badf456d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:16:59.781302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe9c47cf-4ce7-49ff-b5fa-c540badf456d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:16:59.782088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe9c47cf-4ce7-49ff-b5fa-c540badf456d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:00.062429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fe9c47cf-4ce7-49ff-b5fa-c540badf456d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:00.076808 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fe9c47cf-4ce7-49ff-b5fa-c540badf456d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.326109 Jan 22 21:17:00.077544 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2808/5393] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:16:59 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:00.392750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-724a18ae-7d37-48e9-95f6-106b098e2185 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:00.394236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-724a18ae-7d37-48e9-95f6-106b098e2185 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:00.411517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-724a18ae-7d37-48e9-95f6-106b098e2185 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:00.413787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-724a18ae-7d37-48e9-95f6-106b098e2185 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:00.413787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-724a18ae-7d37-48e9-95f6-106b098e2185 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:00.413787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-724a18ae-7d37-48e9-95f6-106b098e2185 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:00.583724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2997b6dd-397c-4768-9f33-bc1746ab30a2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:00.584849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2997b6dd-397c-4768-9f33-bc1746ab30a2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:00.602998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2997b6dd-397c-4768-9f33-bc1746ab30a2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:00.604688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2997b6dd-397c-4768-9f33-bc1746ab30a2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:00.604688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2997b6dd-397c-4768-9f33-bc1746ab30a2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:00.609761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2997b6dd-397c-4768-9f33-bc1746ab30a2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:00.855252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2997b6dd-397c-4768-9f33-bc1746ab30a2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:00.866102 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2997b6dd-397c-4768-9f33-bc1746ab30a2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1367 microversion: 2.1 time: 0.286613 Jan 22 21:17:00.875722 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2809/5394] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:00 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:01.100757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b929782b-70c3-47b8-ba3c-52c2ee480961 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:01.101381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b929782b-70c3-47b8-ba3c-52c2ee480961 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:01.115978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b929782b-70c3-47b8-ba3c-52c2ee480961 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:01.120399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b929782b-70c3-47b8-ba3c-52c2ee480961 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:01.120399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b929782b-70c3-47b8-ba3c-52c2ee480961 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:01.120399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b929782b-70c3-47b8-ba3c-52c2ee480961 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:01.348969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-724a18ae-7d37-48e9-95f6-106b098e2185 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:01.358903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-724a18ae-7d37-48e9-95f6-106b098e2185 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:01.368290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-724a18ae-7d37-48e9-95f6-106b098e2185 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:01.381344 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-724a18ae-7d37-48e9-95f6-106b098e2185 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.988757 Jan 22 21:17:01.381344 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2586/5395] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:00 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:01.403344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b929782b-70c3-47b8-ba3c-52c2ee480961 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:01.413217 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b929782b-70c3-47b8-ba3c-52c2ee480961 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.321662 Jan 22 21:17:01.414338 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2810/5396] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:01 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:01.884367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ec61bd38-b137-46d2-8a2e-729797155266 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:01.886249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ec61bd38-b137-46d2-8a2e-729797155266 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:01.903828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec61bd38-b137-46d2-8a2e-729797155266 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:01.909697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec61bd38-b137-46d2-8a2e-729797155266 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:01.909697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec61bd38-b137-46d2-8a2e-729797155266 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:01.909697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec61bd38-b137-46d2-8a2e-729797155266 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:02.316435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ec61bd38-b137-46d2-8a2e-729797155266 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:02.331206 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ec61bd38-b137-46d2-8a2e-729797155266 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1367 microversion: 2.1 time: 0.451265 Jan 22 21:17:02.332379 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2587/5397] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:01 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1367 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:02.393875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5ecc6c4e-4b8e-4ab5-b786-de36ee26c31b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:02.396310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5ecc6c4e-4b8e-4ab5-b786-de36ee26c31b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:02.412890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ecc6c4e-4b8e-4ab5-b786-de36ee26c31b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:02.417637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ecc6c4e-4b8e-4ab5-b786-de36ee26c31b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:02.417637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ecc6c4e-4b8e-4ab5-b786-de36ee26c31b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:02.417637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ecc6c4e-4b8e-4ab5-b786-de36ee26c31b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:02.436040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f7238e68-2bcf-479b-ba08-c363ea602ccb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:02.440594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f7238e68-2bcf-479b-ba08-c363ea602ccb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:02.460168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7238e68-2bcf-479b-ba08-c363ea602ccb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:02.461160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7238e68-2bcf-479b-ba08-c363ea602ccb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:02.465552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7238e68-2bcf-479b-ba08-c363ea602ccb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:02.469341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7238e68-2bcf-479b-ba08-c363ea602ccb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:03.016995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5ecc6c4e-4b8e-4ab5-b786-de36ee26c31b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:03.030838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5ecc6c4e-4b8e-4ab5-b786-de36ee26c31b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:03.048133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5ecc6c4e-4b8e-4ab5-b786-de36ee26c31b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:03.048133 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5ecc6c4e-4b8e-4ab5-b786-de36ee26c31b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.648997 Jan 22 21:17:03.048133 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2811/5398] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:02 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:03.048991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f7238e68-2bcf-479b-ba08-c363ea602ccb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:03.050414 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f7238e68-2bcf-479b-ba08-c363ea602ccb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.622673 Jan 22 21:17:03.051943 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2588/5399] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:02 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:03.348869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-53bd4389-29ff-47aa-b96f-1c5b7376639b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:03.350519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-53bd4389-29ff-47aa-b96f-1c5b7376639b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:03.364970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53bd4389-29ff-47aa-b96f-1c5b7376639b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:03.365439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53bd4389-29ff-47aa-b96f-1c5b7376639b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:03.366427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53bd4389-29ff-47aa-b96f-1c5b7376639b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:03.372314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53bd4389-29ff-47aa-b96f-1c5b7376639b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:03.550662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-17de641a-7a97-4dac-9f1e-6016532bac87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:03.551461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-17de641a-7a97-4dac-9f1e-6016532bac87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:03.559471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17de641a-7a97-4dac-9f1e-6016532bac87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:03.570388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17de641a-7a97-4dac-9f1e-6016532bac87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:03.572495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17de641a-7a97-4dac-9f1e-6016532bac87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:03.574144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17de641a-7a97-4dac-9f1e-6016532bac87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:03.591354 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-17de641a-7a97-4dac-9f1e-6016532bac87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] HTTP exception thrown: Instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 could not be found. Jan 22 21:17:03.592298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-17de641a-7a97-4dac-9f1e-6016532bac87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Returning 404 to user: Instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:17:03.593324 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-17de641a-7a97-4dac-9f1e-6016532bac87 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "DELETE /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 404 len: 111 microversion: 2.42 time: 0.048834 Jan 22 21:17:03.594532 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2589/5400] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:17:03 2022] DELETE /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:17:03.608736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ebf87f00-4998-451f-90ac-996893b3e711 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:03.609368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ebf87f00-4998-451f-90ac-996893b3e711 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] [instance: e65e0727-0cb5-4cc6-a5fb-188f60007d92] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:03.621962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebf87f00-4998-451f-90ac-996893b3e711 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:03.626214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebf87f00-4998-451f-90ac-996893b3e711 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:03.628736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebf87f00-4998-451f-90ac-996893b3e711 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:03.629783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebf87f00-4998-451f-90ac-996893b3e711 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:03.653309 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-ebf87f00-4998-451f-90ac-996893b3e711 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] HTTP exception thrown: Instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 could not be found. Jan 22 21:17:03.654230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ebf87f00-4998-451f-90ac-996893b3e711 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] Returning 404 to user: Instance e65e0727-0cb5-4cc6-a5fb-188f60007d92 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:17:03.655399 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ebf87f00-4998-451f-90ac-996893b3e711 tempest-TaggedBootDevicesTest_v242-884103753 tempest-TaggedBootDevicesTest_v242-884103753-project] 10.222.0.100 "GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92" status: 404 len: 111 microversion: 2.42 time: 0.054601 Jan 22 21:17:03.656458 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2590/5401] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:03 2022] GET /compute/v2.1/servers/e65e0727-0cb5-4cc6-a5fb-188f60007d92 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:17:03.792323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-53bd4389-29ff-47aa-b96f-1c5b7376639b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:03.808820 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-53bd4389-29ff-47aa-b96f-1c5b7376639b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1367 microversion: 2.1 time: 0.462859 Jan 22 21:17:03.812952 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2812/5402] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:03 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1367 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:04.055641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dc390ecf-9ffd-488f-a94a-9083b05ec019 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:04.056870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dc390ecf-9ffd-488f-a94a-9083b05ec019 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:04.125609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8ceb98cd-8f8c-4af7-865a-1ed410685a77 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:04.125609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8ceb98cd-8f8c-4af7-865a-1ed410685a77 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:04.127322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc390ecf-9ffd-488f-a94a-9083b05ec019 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:04.127322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc390ecf-9ffd-488f-a94a-9083b05ec019 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:04.127322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc390ecf-9ffd-488f-a94a-9083b05ec019 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:04.127322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc390ecf-9ffd-488f-a94a-9083b05ec019 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:04.127641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ceb98cd-8f8c-4af7-865a-1ed410685a77 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:04.127641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ceb98cd-8f8c-4af7-865a-1ed410685a77 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:04.127641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ceb98cd-8f8c-4af7-865a-1ed410685a77 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:04.127641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ceb98cd-8f8c-4af7-865a-1ed410685a77 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:04.324571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8ceb98cd-8f8c-4af7-865a-1ed410685a77 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:04.336234 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8ceb98cd-8f8c-4af7-865a-1ed410685a77 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.271586 Jan 22 21:17:04.354077 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2813/5403] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:04 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:17:04.396553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-d41e3c0b-39a4-4160-bea1-fb30dbdd5488 req-e246a26f-5982-469c-bdf2-fd3c9d70a3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b", "name": "network-vif-plugged", "status": "completed", "tag": "9337e9b6-78b2-48c1-b58f-3cf24e8cbbb5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:04.398918 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:17:04.398918 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:17:04.425052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d41e3c0b-39a4-4160-bea1-fb30dbdd5488 req-e246a26f-5982-469c-bdf2-fd3c9d70a3d7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:04.425531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d41e3c0b-39a4-4160-bea1-fb30dbdd5488 req-e246a26f-5982-469c-bdf2-fd3c9d70a3d7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:04.440634 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d41e3c0b-39a4-4160-bea1-fb30dbdd5488 req-e246a26f-5982-469c-bdf2-fd3c9d70a3d7 service nova] Creating event network-vif-plugged:9337e9b6-78b2-48c1-b58f-3cf24e8cbbb5 for instance 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b on nch1-master-1 Jan 22 21:17:04.446817 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-d41e3c0b-39a4-4160-bea1-fb30dbdd5488 req-e246a26f-5982-469c-bdf2-fd3c9d70a3d7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060514 Jan 22 21:17:04.451457 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2814/5404] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:17:04.571729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dc390ecf-9ffd-488f-a94a-9083b05ec019 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:04.588615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dc390ecf-9ffd-488f-a94a-9083b05ec019 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:04.593016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dc390ecf-9ffd-488f-a94a-9083b05ec019 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:04.597536 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dc390ecf-9ffd-488f-a94a-9083b05ec019 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.546028 Jan 22 21:17:04.627370 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2591/5405] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:04 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:17:04.830295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1d8a662a-72d0-458d-b682-4c3bfdb46b79 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:04.831099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1d8a662a-72d0-458d-b682-4c3bfdb46b79 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:04.845755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d8a662a-72d0-458d-b682-4c3bfdb46b79 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:04.849489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d8a662a-72d0-458d-b682-4c3bfdb46b79 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:04.850718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d8a662a-72d0-458d-b682-4c3bfdb46b79 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:04.857625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d8a662a-72d0-458d-b682-4c3bfdb46b79 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:05.107556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1d8a662a-72d0-458d-b682-4c3bfdb46b79 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:05.120252 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1d8a662a-72d0-458d-b682-4c3bfdb46b79 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1367 microversion: 2.1 time: 0.293253 Jan 22 21:17:05.120252 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2815/5406] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:04 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:17:05.353739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4ea936d4-e35c-4e8f-9c25-311a7c166dc2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:05.354386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4ea936d4-e35c-4e8f-9c25-311a7c166dc2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:05.370829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ea936d4-e35c-4e8f-9c25-311a7c166dc2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:05.371301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ea936d4-e35c-4e8f-9c25-311a7c166dc2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:05.372128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ea936d4-e35c-4e8f-9c25-311a7c166dc2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:05.372610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ea936d4-e35c-4e8f-9c25-311a7c166dc2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:05.635664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2c7ab454-6bab-440b-bc93-113d40ad968b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:05.636482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2c7ab454-6bab-440b-bc93-113d40ad968b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:05.650087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c7ab454-6bab-440b-bc93-113d40ad968b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:05.650945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c7ab454-6bab-440b-bc93-113d40ad968b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:05.652422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c7ab454-6bab-440b-bc93-113d40ad968b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:05.653096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c7ab454-6bab-440b-bc93-113d40ad968b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:05.689139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4ea936d4-e35c-4e8f-9c25-311a7c166dc2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:05.706275 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4ea936d4-e35c-4e8f-9c25-311a7c166dc2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.348624 Jan 22 21:17:05.708294 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2592/5407] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:05 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:05.970142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2c7ab454-6bab-440b-bc93-113d40ad968b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:05.984656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2c7ab454-6bab-440b-bc93-113d40ad968b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:05.987003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2c7ab454-6bab-440b-bc93-113d40ad968b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:05.988738 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2c7ab454-6bab-440b-bc93-113d40ad968b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.358415 Jan 22 21:17:05.989521 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2816/5408] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:05 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:06.138104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-86911445-01bc-425a-a305-30dd4e128f80 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:06.138997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-86911445-01bc-425a-a305-30dd4e128f80 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:06.156701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86911445-01bc-425a-a305-30dd4e128f80 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:06.158049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86911445-01bc-425a-a305-30dd4e128f80 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:06.159461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86911445-01bc-425a-a305-30dd4e128f80 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:06.160117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86911445-01bc-425a-a305-30dd4e128f80 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:06.456756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-86911445-01bc-425a-a305-30dd4e128f80 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:06.466102 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-86911445-01bc-425a-a305-30dd4e128f80 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1367 microversion: 2.1 time: 0.333499 Jan 22 21:17:06.486965 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2593/5409] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:06 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:06.726378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cfcd4489-2ce2-42d4-b4b5-2c7472833fe9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:06.727471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cfcd4489-2ce2-42d4-b4b5-2c7472833fe9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:06.751548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfcd4489-2ce2-42d4-b4b5-2c7472833fe9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:06.756667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfcd4489-2ce2-42d4-b4b5-2c7472833fe9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:06.758709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfcd4489-2ce2-42d4-b4b5-2c7472833fe9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:06.759400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfcd4489-2ce2-42d4-b4b5-2c7472833fe9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:07.008559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4a936332-f86c-49c5-9cac-e88827ecb07c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:07.009176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4a936332-f86c-49c5-9cac-e88827ecb07c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:07.027561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a936332-f86c-49c5-9cac-e88827ecb07c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:07.027992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a936332-f86c-49c5-9cac-e88827ecb07c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:07.029002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a936332-f86c-49c5-9cac-e88827ecb07c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:07.029652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a936332-f86c-49c5-9cac-e88827ecb07c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:07.119287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cfcd4489-2ce2-42d4-b4b5-2c7472833fe9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:07.129802 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cfcd4489-2ce2-42d4-b4b5-2c7472833fe9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.408605 Jan 22 21:17:07.140248 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2817/5410] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:06 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:07.387576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4a936332-f86c-49c5-9cac-e88827ecb07c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:07.400069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4a936332-f86c-49c5-9cac-e88827ecb07c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:07.400810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4a936332-f86c-49c5-9cac-e88827ecb07c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:07.402263 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4a936332-f86c-49c5-9cac-e88827ecb07c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.398626 Jan 22 21:17:07.402965 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2594/5411] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:07 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:07.484209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7ede0ddc-9f4b-464c-be45-b73c5fd5ee4f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:07.485102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7ede0ddc-9f4b-464c-be45-b73c5fd5ee4f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:07.493697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ede0ddc-9f4b-464c-be45-b73c5fd5ee4f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:07.497142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ede0ddc-9f4b-464c-be45-b73c5fd5ee4f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:07.497142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ede0ddc-9f4b-464c-be45-b73c5fd5ee4f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:07.497142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ede0ddc-9f4b-464c-be45-b73c5fd5ee4f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:07.974587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7ede0ddc-9f4b-464c-be45-b73c5fd5ee4f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:07.988603 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7ede0ddc-9f4b-464c-be45-b73c5fd5ee4f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1367 microversion: 2.1 time: 0.508240 Jan 22 21:17:07.989232 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2818/5412] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:07 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1367 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:08.148842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c6f4fc5f-c60d-4b4b-9152-3bf2d6a4fc1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:08.149430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c6f4fc5f-c60d-4b4b-9152-3bf2d6a4fc1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:08.160546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6f4fc5f-c60d-4b4b-9152-3bf2d6a4fc1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:08.162181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6f4fc5f-c60d-4b4b-9152-3bf2d6a4fc1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:08.166255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6f4fc5f-c60d-4b4b-9152-3bf2d6a4fc1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:08.166255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6f4fc5f-c60d-4b4b-9152-3bf2d6a4fc1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:08.423018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b00d39c-f100-4ae3-9527-8dffe4799771 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:08.424334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6b00d39c-f100-4ae3-9527-8dffe4799771 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:08.431163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b00d39c-f100-4ae3-9527-8dffe4799771 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:08.431718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b00d39c-f100-4ae3-9527-8dffe4799771 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:08.432905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b00d39c-f100-4ae3-9527-8dffe4799771 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:08.433611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b00d39c-f100-4ae3-9527-8dffe4799771 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:08.544130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c6f4fc5f-c60d-4b4b-9152-3bf2d6a4fc1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:08.556070 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c6f4fc5f-c60d-4b4b-9152-3bf2d6a4fc1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.413649 Jan 22 21:17:08.557531 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2595/5413] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:08 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:08.605115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6b00d39c-f100-4ae3-9527-8dffe4799771 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:08.616346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6b00d39c-f100-4ae3-9527-8dffe4799771 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:08.617957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6b00d39c-f100-4ae3-9527-8dffe4799771 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:08.619833 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b00d39c-f100-4ae3-9527-8dffe4799771 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.200230 Jan 22 21:17:08.620418 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2819/5414] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:08 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:17:09.006419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-47e451da-c865-4682-8aa9-bd066a837f6c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:09.007158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-47e451da-c865-4682-8aa9-bd066a837f6c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:09.013236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47e451da-c865-4682-8aa9-bd066a837f6c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:09.013742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47e451da-c865-4682-8aa9-bd066a837f6c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:09.014547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47e451da-c865-4682-8aa9-bd066a837f6c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:09.014989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47e451da-c865-4682-8aa9-bd066a837f6c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:09.338994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-47e451da-c865-4682-8aa9-bd066a837f6c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:09.347090 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-47e451da-c865-4682-8aa9-bd066a837f6c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1552 microversion: 2.1 time: 0.344279 Jan 22 21:17:09.347687 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2596/5415] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:09 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1552 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:17:09.368109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8aaa4a57-c463-46f3-995e-8a4716e1d154 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:09.368620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8aaa4a57-c463-46f3-995e-8a4716e1d154 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:09.384847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8aaa4a57-c463-46f3-995e-8a4716e1d154 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:09.389727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8aaa4a57-c463-46f3-995e-8a4716e1d154 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:09.389727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8aaa4a57-c463-46f3-995e-8a4716e1d154 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:09.389727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8aaa4a57-c463-46f3-995e-8a4716e1d154 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:09.488802 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8aaa4a57-c463-46f3-995e-8a4716e1d154 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124421 Jan 22 21:17:09.495564 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2820/5416] 10.222.0.100 () {58 vars in 1279 bytes} [Sat Jan 22 21:17:09 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:17:09.574159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-93fa9f33-4190-4b5c-a3bc-82b6de3ddac9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:09.574714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-93fa9f33-4190-4b5c-a3bc-82b6de3ddac9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:09.587324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93fa9f33-4190-4b5c-a3bc-82b6de3ddac9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:09.589685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93fa9f33-4190-4b5c-a3bc-82b6de3ddac9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:09.590735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93fa9f33-4190-4b5c-a3bc-82b6de3ddac9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:09.594358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93fa9f33-4190-4b5c-a3bc-82b6de3ddac9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:09.637460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9890d765-9545-475f-a244-00f7169e7191 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:09.644117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9890d765-9545-475f-a244-00f7169e7191 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:09.664484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9890d765-9545-475f-a244-00f7169e7191 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:09.664484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9890d765-9545-475f-a244-00f7169e7191 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:09.664484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9890d765-9545-475f-a244-00f7169e7191 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:09.664484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9890d765-9545-475f-a244-00f7169e7191 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:10.042393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-93fa9f33-4190-4b5c-a3bc-82b6de3ddac9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:10.056940 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-93fa9f33-4190-4b5c-a3bc-82b6de3ddac9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1511 microversion: 2.1 time: 0.486688 Jan 22 21:17:10.059214 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2597/5417] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:09 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1511 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:10.092352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9890d765-9545-475f-a244-00f7169e7191 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:10.104260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9890d765-9545-475f-a244-00f7169e7191 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:10.105937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9890d765-9545-475f-a244-00f7169e7191 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:10.108169 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9890d765-9545-475f-a244-00f7169e7191 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.474481 Jan 22 21:17:10.109205 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2821/5418] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:09 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:10.946136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-88df62ac-0209-4526-bc86-a68f2c037db8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:10.947172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-b5490eda-94b0-43a7-8d58-c8c1dd2190e5 req-d8f59aeb-96a7-4729-8e89-bdc4ec31aea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b", "tag": "9337e9b6-78b2-48c1-b58f-3cf24e8cbbb5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:10.948782 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:17:10.948782 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:17:10.949776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-88df62ac-0209-4526-bc86-a68f2c037db8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:10.966469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88df62ac-0209-4526-bc86-a68f2c037db8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:10.968673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b5490eda-94b0-43a7-8d58-c8c1dd2190e5 req-d8f59aeb-96a7-4729-8e89-bdc4ec31aea7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:10.969132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b5490eda-94b0-43a7-8d58-c8c1dd2190e5 req-d8f59aeb-96a7-4729-8e89-bdc4ec31aea7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:10.971222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88df62ac-0209-4526-bc86-a68f2c037db8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:10.986681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88df62ac-0209-4526-bc86-a68f2c037db8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:10.986681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88df62ac-0209-4526-bc86-a68f2c037db8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:10.996689 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-b5490eda-94b0-43a7-8d58-c8c1dd2190e5 req-d8f59aeb-96a7-4729-8e89-bdc4ec31aea7 service nova] Creating event network-changed:9337e9b6-78b2-48c1-b58f-3cf24e8cbbb5 for instance 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b on nch1-master-1 Jan 22 21:17:11.003117 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-b5490eda-94b0-43a7-8d58-c8c1dd2190e5 req-d8f59aeb-96a7-4729-8e89-bdc4ec31aea7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063857 Jan 22 21:17:11.004298 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2822/5419] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:17:11.037729 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-88df62ac-0209-4526-bc86-a68f2c037db8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 14 microversion: 2.1 time: 0.101715 Jan 22 21:17:11.038696 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2598/5420] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:10 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:17:11.077225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6c96e481-2272-4ab6-b460-cc91ac7edb72 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:11.078095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6c96e481-2272-4ab6-b460-cc91ac7edb72 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:11.087725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c96e481-2272-4ab6-b460-cc91ac7edb72 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:11.090021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c96e481-2272-4ab6-b460-cc91ac7edb72 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:11.091049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c96e481-2272-4ab6-b460-cc91ac7edb72 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:11.091635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c96e481-2272-4ab6-b460-cc91ac7edb72 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:11.130555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-91a80850-801e-473f-acf7-0f55c424f638 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:11.131718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-91a80850-801e-473f-acf7-0f55c424f638 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:11.150165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91a80850-801e-473f-acf7-0f55c424f638 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:11.152316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91a80850-801e-473f-acf7-0f55c424f638 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:11.153602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91a80850-801e-473f-acf7-0f55c424f638 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:11.155640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91a80850-801e-473f-acf7-0f55c424f638 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:11.316359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6c96e481-2272-4ab6-b460-cc91ac7edb72 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:11.337025 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6c96e481-2272-4ab6-b460-cc91ac7edb72 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1532 microversion: 2.1 time: 0.264606 Jan 22 21:17:11.349461 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2823/5421] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:11 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1532 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:11.933827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-91a80850-801e-473f-acf7-0f55c424f638 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:11.953577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-91a80850-801e-473f-acf7-0f55c424f638 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:11.958117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-91a80850-801e-473f-acf7-0f55c424f638 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:11.965830 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-91a80850-801e-473f-acf7-0f55c424f638 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.839313 Jan 22 21:17:11.983880 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2599/5422] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:11 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:12.049055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3c414541-e4df-483f-8581-d9c30e9f30e1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:12.056037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3c414541-e4df-483f-8581-d9c30e9f30e1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:12.065181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c414541-e4df-483f-8581-d9c30e9f30e1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:12.065875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c414541-e4df-483f-8581-d9c30e9f30e1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:12.068151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c414541-e4df-483f-8581-d9c30e9f30e1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:12.068807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c414541-e4df-483f-8581-d9c30e9f30e1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:12.123671 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3c414541-e4df-483f-8581-d9c30e9f30e1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 14 microversion: 2.1 time: 0.078943 Jan 22 21:17:12.125015 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2824/5423] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:12 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:17:12.355540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-54b3af11-b444-4c3a-ae78-eafc0a57f74a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:12.356452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-54b3af11-b444-4c3a-ae78-eafc0a57f74a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:12.367034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54b3af11-b444-4c3a-ae78-eafc0a57f74a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:12.367689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54b3af11-b444-4c3a-ae78-eafc0a57f74a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:12.368723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54b3af11-b444-4c3a-ae78-eafc0a57f74a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:12.369720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54b3af11-b444-4c3a-ae78-eafc0a57f74a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:12.663958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-54b3af11-b444-4c3a-ae78-eafc0a57f74a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:12.677745 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-54b3af11-b444-4c3a-ae78-eafc0a57f74a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1527 microversion: 2.1 time: 0.325722 Jan 22 21:17:12.678440 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2600/5424] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:12 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1527 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:12.993346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c4652e56-e792-4fb6-9365-32fc3a1bc436 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:12.994331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c4652e56-e792-4fb6-9365-32fc3a1bc436 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:13.022124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4652e56-e792-4fb6-9365-32fc3a1bc436 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:13.022124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4652e56-e792-4fb6-9365-32fc3a1bc436 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:13.022124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4652e56-e792-4fb6-9365-32fc3a1bc436 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:13.022124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4652e56-e792-4fb6-9365-32fc3a1bc436 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:13.136412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-50d8f24c-870d-4a16-ba61-5610307164f1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:13.137367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-50d8f24c-870d-4a16-ba61-5610307164f1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:13.149339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50d8f24c-870d-4a16-ba61-5610307164f1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:13.151339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50d8f24c-870d-4a16-ba61-5610307164f1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:13.152448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50d8f24c-870d-4a16-ba61-5610307164f1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:13.156460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50d8f24c-870d-4a16-ba61-5610307164f1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:13.252774 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-50d8f24c-870d-4a16-ba61-5610307164f1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 14 microversion: 2.1 time: 0.118954 Jan 22 21:17:13.259719 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2601/5425] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:13 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:17:13.306598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c4652e56-e792-4fb6-9365-32fc3a1bc436 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:13.319753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c4652e56-e792-4fb6-9365-32fc3a1bc436 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:13.323433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c4652e56-e792-4fb6-9365-32fc3a1bc436 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:13.328527 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c4652e56-e792-4fb6-9365-32fc3a1bc436 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.339839 Jan 22 21:17:13.328527 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2825/5426] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:12 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:13.705251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f90b675-4e8b-4cac-ac3c-9f1e4198f665 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:13.705251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9f90b675-4e8b-4cac-ac3c-9f1e4198f665 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:13.720360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f90b675-4e8b-4cac-ac3c-9f1e4198f665 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:13.720546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f90b675-4e8b-4cac-ac3c-9f1e4198f665 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:13.721364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f90b675-4e8b-4cac-ac3c-9f1e4198f665 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:13.725691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f90b675-4e8b-4cac-ac3c-9f1e4198f665 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:14.117430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9f90b675-4e8b-4cac-ac3c-9f1e4198f665 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:14.117430 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9f90b675-4e8b-4cac-ac3c-9f1e4198f665 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1527 microversion: 2.1 time: 0.274927 Jan 22 21:17:14.117430 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2602/5427] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:13 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1527 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:14.266022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-276682a2-e153-43e8-a94b-ae00d72625b7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:14.267162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-276682a2-e153-43e8-a94b-ae00d72625b7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:14.281798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-276682a2-e153-43e8-a94b-ae00d72625b7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:14.283156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-276682a2-e153-43e8-a94b-ae00d72625b7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:14.286439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-276682a2-e153-43e8-a94b-ae00d72625b7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:14.286906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-276682a2-e153-43e8-a94b-ae00d72625b7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:14.341056 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-276682a2-e153-43e8-a94b-ae00d72625b7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 14 microversion: 2.1 time: 0.078904 Jan 22 21:17:14.344020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9460a6f3-5a76-4e03-bed2-eb496b62a2f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:14.345406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9460a6f3-5a76-4e03-bed2-eb496b62a2f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:14.346384 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2826/5428] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:14 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:17:14.352191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9460a6f3-5a76-4e03-bed2-eb496b62a2f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:14.362611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9460a6f3-5a76-4e03-bed2-eb496b62a2f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:14.363493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9460a6f3-5a76-4e03-bed2-eb496b62a2f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:14.363946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9460a6f3-5a76-4e03-bed2-eb496b62a2f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:14.653526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-e208fe1f-8364-4a56-9332-71477f86d685 req-497f1a29-863c-4cfd-a1ab-5930f6d7f4db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94caeb9b-99d6-4bf0-afa1-14362bcefed1", "name": "network-vif-plugged", "status": "completed", "tag": "f1d8fe43-1089-47c2-b9bd-b99ad91bfb28"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:14.661985 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:17:14.661985 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:17:14.682474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e208fe1f-8364-4a56-9332-71477f86d685 req-497f1a29-863c-4cfd-a1ab-5930f6d7f4db service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:14.684166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e208fe1f-8364-4a56-9332-71477f86d685 req-497f1a29-863c-4cfd-a1ab-5930f6d7f4db service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:14.714395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9460a6f3-5a76-4e03-bed2-eb496b62a2f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:14.718163 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-e208fe1f-8364-4a56-9332-71477f86d685 req-497f1a29-863c-4cfd-a1ab-5930f6d7f4db service nova] Creating event network-vif-plugged:f1d8fe43-1089-47c2-b9bd-b99ad91bfb28 for instance 94caeb9b-99d6-4bf0-afa1-14362bcefed1 on nch1-master-1 Jan 22 21:17:14.728302 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-e208fe1f-8364-4a56-9332-71477f86d685 req-497f1a29-863c-4cfd-a1ab-5930f6d7f4db service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084047 Jan 22 21:17:14.728918 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2827/5429] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:17:14.738652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9460a6f3-5a76-4e03-bed2-eb496b62a2f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:14.741719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9460a6f3-5a76-4e03-bed2-eb496b62a2f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:14.741719 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9460a6f3-5a76-4e03-bed2-eb496b62a2f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.401217 Jan 22 21:17:14.753156 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2603/5430] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:14 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:15.099462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3e499021-0bbc-4ca4-9744-57e35d2d41ac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:15.100507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3e499021-0bbc-4ca4-9744-57e35d2d41ac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:15.113215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e499021-0bbc-4ca4-9744-57e35d2d41ac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:15.116390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e499021-0bbc-4ca4-9744-57e35d2d41ac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:15.117424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e499021-0bbc-4ca4-9744-57e35d2d41ac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:15.130225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e499021-0bbc-4ca4-9744-57e35d2d41ac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:15.353941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a04570ac-d8a5-4151-a690-9257b6550095 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:15.355598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a04570ac-d8a5-4151-a690-9257b6550095 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:15.374599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a04570ac-d8a5-4151-a690-9257b6550095 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:15.376430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a04570ac-d8a5-4151-a690-9257b6550095 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:15.380113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a04570ac-d8a5-4151-a690-9257b6550095 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:15.380796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a04570ac-d8a5-4151-a690-9257b6550095 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:15.426835 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a04570ac-d8a5-4151-a690-9257b6550095 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 14 microversion: 2.1 time: 0.076463 Jan 22 21:17:15.428077 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2604/5431] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:15 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:17:15.439906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3e499021-0bbc-4ca4-9744-57e35d2d41ac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:15.450576 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3e499021-0bbc-4ca4-9744-57e35d2d41ac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1527 microversion: 2.1 time: 0.354484 Jan 22 21:17:15.453445 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2828/5432] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:15 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1527 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:15.765025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-896752e2-a184-43da-9f95-04f4c129eaad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:15.766929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-896752e2-a184-43da-9f95-04f4c129eaad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:15.779162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-896752e2-a184-43da-9f95-04f4c129eaad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:15.786306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-896752e2-a184-43da-9f95-04f4c129eaad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:15.788599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-896752e2-a184-43da-9f95-04f4c129eaad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:15.790508 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-896752e2-a184-43da-9f95-04f4c129eaad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:16.018891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-896752e2-a184-43da-9f95-04f4c129eaad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:16.030655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-896752e2-a184-43da-9f95-04f4c129eaad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:16.033761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-896752e2-a184-43da-9f95-04f4c129eaad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:16.037215 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-896752e2-a184-43da-9f95-04f4c129eaad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.279080 Jan 22 21:17:16.037632 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2605/5433] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:15 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:16.440349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3ee1688d-baba-496a-88cd-39786051940a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:16.442129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3ee1688d-baba-496a-88cd-39786051940a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:16.451908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ee1688d-baba-496a-88cd-39786051940a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:16.453650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ee1688d-baba-496a-88cd-39786051940a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:16.455776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ee1688d-baba-496a-88cd-39786051940a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:16.457125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ee1688d-baba-496a-88cd-39786051940a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:16.470362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0cb154de-3def-446e-aaf8-b05b2f0eed76 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:16.471891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0cb154de-3def-446e-aaf8-b05b2f0eed76 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:16.483809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cb154de-3def-446e-aaf8-b05b2f0eed76 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:16.484771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cb154de-3def-446e-aaf8-b05b2f0eed76 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:16.486273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cb154de-3def-446e-aaf8-b05b2f0eed76 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:16.494017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cb154de-3def-446e-aaf8-b05b2f0eed76 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:16.524389 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3ee1688d-baba-496a-88cd-39786051940a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 14 microversion: 2.1 time: 0.089713 Jan 22 21:17:16.525828 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2829/5434] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:16 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:17:16.748177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0cb154de-3def-446e-aaf8-b05b2f0eed76 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:16.757144 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0cb154de-3def-446e-aaf8-b05b2f0eed76 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1527 microversion: 2.1 time: 0.290691 Jan 22 21:17:16.758152 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2606/5435] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:16 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1527 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:17.072251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-81434f4a-b5a8-4e8f-b0e9-6fdf8efe009d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:17.075904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-81434f4a-b5a8-4e8f-b0e9-6fdf8efe009d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:17.082488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81434f4a-b5a8-4e8f-b0e9-6fdf8efe009d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:17.082966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81434f4a-b5a8-4e8f-b0e9-6fdf8efe009d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:17.083814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81434f4a-b5a8-4e8f-b0e9-6fdf8efe009d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:17.091133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81434f4a-b5a8-4e8f-b0e9-6fdf8efe009d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:17.380334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-81434f4a-b5a8-4e8f-b0e9-6fdf8efe009d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:17.380334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-81434f4a-b5a8-4e8f-b0e9-6fdf8efe009d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:17.380334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-81434f4a-b5a8-4e8f-b0e9-6fdf8efe009d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:17.380334 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-81434f4a-b5a8-4e8f-b0e9-6fdf8efe009d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.288626 Jan 22 21:17:17.380334 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2830/5436] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:17 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:17.536764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-102968c4-442a-4040-8843-7c13b6bf5cc0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:17.539676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-102968c4-442a-4040-8843-7c13b6bf5cc0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:17.547942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-102968c4-442a-4040-8843-7c13b6bf5cc0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:17.548493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-102968c4-442a-4040-8843-7c13b6bf5cc0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:17.552552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-102968c4-442a-4040-8843-7c13b6bf5cc0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:17.552552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-102968c4-442a-4040-8843-7c13b6bf5cc0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:17.615399 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-102968c4-442a-4040-8843-7c13b6bf5cc0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 14 microversion: 2.1 time: 0.081988 Jan 22 21:17:17.616052 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2607/5437] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:17 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:17:17.775693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b11564c9-c4ef-4147-b70d-68e50de89a35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:17.776318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b11564c9-c4ef-4147-b70d-68e50de89a35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:17.796311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b11564c9-c4ef-4147-b70d-68e50de89a35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:17.799241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b11564c9-c4ef-4147-b70d-68e50de89a35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:17.800320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b11564c9-c4ef-4147-b70d-68e50de89a35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:17.801399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b11564c9-c4ef-4147-b70d-68e50de89a35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:18.062538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b11564c9-c4ef-4147-b70d-68e50de89a35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:18.073646 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b11564c9-c4ef-4147-b70d-68e50de89a35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1527 microversion: 2.1 time: 0.302413 Jan 22 21:17:18.074920 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2831/5438] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:17 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1527 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:18.238678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-28e978a8-04c0-4d1c-815b-94ad90e8d150 req-e689b2da-8973-4f8a-b8c2-1530f5d34423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8288fe26-7e9c-451c-a9a2-222abbcf201e", "name": "network-vif-plugged", "status": "completed", "tag": "92a02346-3106-4ce0-82fd-0bae77d72810"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:18.240764 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:17:18.240764 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:17:18.252058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-28e978a8-04c0-4d1c-815b-94ad90e8d150 req-e689b2da-8973-4f8a-b8c2-1530f5d34423 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:18.254422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-28e978a8-04c0-4d1c-815b-94ad90e8d150 req-e689b2da-8973-4f8a-b8c2-1530f5d34423 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:18.271597 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-28e978a8-04c0-4d1c-815b-94ad90e8d150 req-e689b2da-8973-4f8a-b8c2-1530f5d34423 service nova] Creating event network-vif-plugged:92a02346-3106-4ce0-82fd-0bae77d72810 for instance 8288fe26-7e9c-451c-a9a2-222abbcf201e on nch1-master-1 Jan 22 21:17:18.274438 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-28e978a8-04c0-4d1c-815b-94ad90e8d150 req-e689b2da-8973-4f8a-b8c2-1530f5d34423 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043811 Jan 22 21:17:18.276645 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2608/5439] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:17:18.391838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-325d0d5d-0923-4e7d-bdd2-d79618325275 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:18.392555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-325d0d5d-0923-4e7d-bdd2-d79618325275 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:18.412858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-325d0d5d-0923-4e7d-bdd2-d79618325275 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:18.413603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-325d0d5d-0923-4e7d-bdd2-d79618325275 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:18.414341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-325d0d5d-0923-4e7d-bdd2-d79618325275 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:18.414800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-325d0d5d-0923-4e7d-bdd2-d79618325275 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:18.628077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-170c724e-2e32-451e-9d90-e46404803cda tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:18.629162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-170c724e-2e32-451e-9d90-e46404803cda tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:18.644987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-170c724e-2e32-451e-9d90-e46404803cda tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:18.645746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-170c724e-2e32-451e-9d90-e46404803cda tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:18.648084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-170c724e-2e32-451e-9d90-e46404803cda tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:18.650045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-170c724e-2e32-451e-9d90-e46404803cda tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:18.705924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-325d0d5d-0923-4e7d-bdd2-d79618325275 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:18.722800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-325d0d5d-0923-4e7d-bdd2-d79618325275 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:18.726657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-325d0d5d-0923-4e7d-bdd2-d79618325275 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:18.727138 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-325d0d5d-0923-4e7d-bdd2-d79618325275 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.354448 Jan 22 21:17:18.728668 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2832/5440] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:18 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:18.731903 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-170c724e-2e32-451e-9d90-e46404803cda tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 14 microversion: 2.1 time: 0.108622 Jan 22 21:17:18.732773 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2609/5441] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:18 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:17:19.091152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-920a4e36-c1e2-4135-8309-dc8e0a21e371 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:19.091777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-920a4e36-c1e2-4135-8309-dc8e0a21e371 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:19.103716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-920a4e36-c1e2-4135-8309-dc8e0a21e371 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:19.107099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-920a4e36-c1e2-4135-8309-dc8e0a21e371 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:19.107099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-920a4e36-c1e2-4135-8309-dc8e0a21e371 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:19.107099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-920a4e36-c1e2-4135-8309-dc8e0a21e371 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:19.316565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-920a4e36-c1e2-4135-8309-dc8e0a21e371 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:19.327780 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-920a4e36-c1e2-4135-8309-dc8e0a21e371 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1527 microversion: 2.1 time: 0.240358 Jan 22 21:17:19.329246 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2833/5442] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:19 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1527 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:19.743639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7da3c618-4c34-4251-9261-7e4270bbed49 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:19.745271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7da3c618-4c34-4251-9261-7e4270bbed49 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:19.753153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7da3c618-4c34-4251-9261-7e4270bbed49 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:19.753649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7da3c618-4c34-4251-9261-7e4270bbed49 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:19.754459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7da3c618-4c34-4251-9261-7e4270bbed49 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:19.754903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7da3c618-4c34-4251-9261-7e4270bbed49 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:19.768616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a5c26f3e-bfac-4b37-8f0b-c8f06fb91aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:19.770253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a5c26f3e-bfac-4b37-8f0b-c8f06fb91aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:19.801311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5c26f3e-bfac-4b37-8f0b-c8f06fb91aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:19.801854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5c26f3e-bfac-4b37-8f0b-c8f06fb91aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:19.810280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5c26f3e-bfac-4b37-8f0b-c8f06fb91aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:19.814915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5c26f3e-bfac-4b37-8f0b-c8f06fb91aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:19.837250 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7da3c618-4c34-4251-9261-7e4270bbed49 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 14 microversion: 2.1 time: 0.097782 Jan 22 21:17:19.838230 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2610/5443] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:19 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:17:20.144264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a5c26f3e-bfac-4b37-8f0b-c8f06fb91aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:20.160059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a5c26f3e-bfac-4b37-8f0b-c8f06fb91aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:20.161935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a5c26f3e-bfac-4b37-8f0b-c8f06fb91aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:20.168088 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a5c26f3e-bfac-4b37-8f0b-c8f06fb91aab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.419619 Jan 22 21:17:20.168953 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2834/5444] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:19 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:20.351593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-38eb7103-c38c-482e-a7f9-e2d00964051d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:20.352293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-38eb7103-c38c-482e-a7f9-e2d00964051d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:20.372414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38eb7103-c38c-482e-a7f9-e2d00964051d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:20.376182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38eb7103-c38c-482e-a7f9-e2d00964051d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:20.376182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38eb7103-c38c-482e-a7f9-e2d00964051d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:20.376182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38eb7103-c38c-482e-a7f9-e2d00964051d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:20.723425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-38eb7103-c38c-482e-a7f9-e2d00964051d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:20.737569 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-38eb7103-c38c-482e-a7f9-e2d00964051d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1527 microversion: 2.1 time: 0.391287 Jan 22 21:17:20.738163 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2611/5445] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:20 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1527 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:20.850782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b605f5e3-fc59-425e-9e1d-57153a99218c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:20.850782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b605f5e3-fc59-425e-9e1d-57153a99218c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:20.861890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b605f5e3-fc59-425e-9e1d-57153a99218c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:20.864039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b605f5e3-fc59-425e-9e1d-57153a99218c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:20.865484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b605f5e3-fc59-425e-9e1d-57153a99218c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:20.891987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b605f5e3-fc59-425e-9e1d-57153a99218c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:20.989174 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b605f5e3-fc59-425e-9e1d-57153a99218c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 14 microversion: 2.1 time: 0.144252 Jan 22 21:17:20.990852 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2835/5446] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:20 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:17:21.190414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-df17bfd3-709f-4b32-a4d4-a82c8b8be832 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:21.191869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-df17bfd3-709f-4b32-a4d4-a82c8b8be832 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:21.219970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df17bfd3-709f-4b32-a4d4-a82c8b8be832 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:21.221113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df17bfd3-709f-4b32-a4d4-a82c8b8be832 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:21.222857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df17bfd3-709f-4b32-a4d4-a82c8b8be832 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:21.224336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df17bfd3-709f-4b32-a4d4-a82c8b8be832 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:21.436625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-df17bfd3-709f-4b32-a4d4-a82c8b8be832 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:21.447796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-df17bfd3-709f-4b32-a4d4-a82c8b8be832 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:21.449672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-df17bfd3-709f-4b32-a4d4-a82c8b8be832 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:21.451766 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-df17bfd3-709f-4b32-a4d4-a82c8b8be832 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.267341 Jan 22 21:17:21.453146 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2612/5447] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:21 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:21.758558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2f68dcab-a003-42c3-9a53-b4b10bc51ea9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:21.759951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2f68dcab-a003-42c3-9a53-b4b10bc51ea9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:21.767630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f68dcab-a003-42c3-9a53-b4b10bc51ea9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:21.768371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f68dcab-a003-42c3-9a53-b4b10bc51ea9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:21.769199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f68dcab-a003-42c3-9a53-b4b10bc51ea9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:21.769682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f68dcab-a003-42c3-9a53-b4b10bc51ea9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:21.930927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2f68dcab-a003-42c3-9a53-b4b10bc51ea9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:21.941913 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2f68dcab-a003-42c3-9a53-b4b10bc51ea9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1527 microversion: 2.1 time: 0.190856 Jan 22 21:17:21.942751 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2836/5448] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:21 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1527 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:22.177956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-47db4f02-7214-40c0-af92-5f962502392f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:22.178921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-47db4f02-7214-40c0-af92-5f962502392f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:22.186076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47db4f02-7214-40c0-af92-5f962502392f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:22.186539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47db4f02-7214-40c0-af92-5f962502392f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:22.187342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47db4f02-7214-40c0-af92-5f962502392f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:22.189091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47db4f02-7214-40c0-af92-5f962502392f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:22.251424 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-47db4f02-7214-40c0-af92-5f962502392f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 8208 microversion: 2.1 time: 0.253507 Jan 22 21:17:22.253057 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2613/5449] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:21 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 8208 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:22.482880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fa8f613a-f0d1-4607-ba7a-e95e824e5ef4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:22.483582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fa8f613a-f0d1-4607-ba7a-e95e824e5ef4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:22.492163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa8f613a-f0d1-4607-ba7a-e95e824e5ef4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:22.502469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa8f613a-f0d1-4607-ba7a-e95e824e5ef4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:22.502469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa8f613a-f0d1-4607-ba7a-e95e824e5ef4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:22.502469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa8f613a-f0d1-4607-ba7a-e95e824e5ef4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:22.771322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fa8f613a-f0d1-4607-ba7a-e95e824e5ef4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:22.784222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fa8f613a-f0d1-4607-ba7a-e95e824e5ef4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:22.787056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fa8f613a-f0d1-4607-ba7a-e95e824e5ef4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:22.788476 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fa8f613a-f0d1-4607-ba7a-e95e824e5ef4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1811 microversion: 2.20 time: 0.321149 Jan 22 21:17:22.801595 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2837/5450] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:22 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1811 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:22.960151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2d5acb2d-20aa-4055-a8ee-5b0f2024d7f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:22.960849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2d5acb2d-20aa-4055-a8ee-5b0f2024d7f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:22.971853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d5acb2d-20aa-4055-a8ee-5b0f2024d7f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:22.972335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d5acb2d-20aa-4055-a8ee-5b0f2024d7f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:22.973135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d5acb2d-20aa-4055-a8ee-5b0f2024d7f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:22.975149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d5acb2d-20aa-4055-a8ee-5b0f2024d7f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:23.206315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2d5acb2d-20aa-4055-a8ee-5b0f2024d7f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:23.210987 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2d5acb2d-20aa-4055-a8ee-5b0f2024d7f2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1527 microversion: 2.1 time: 0.254525 Jan 22 21:17:23.212134 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2614/5451] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:22 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1527 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:23.262881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-04f92559-3903-4c8c-a2be-d46f392bbbf7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:23.263920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-04f92559-3903-4c8c-a2be-d46f392bbbf7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:23.271441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f92559-3903-4c8c-a2be-d46f392bbbf7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:23.274967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f92559-3903-4c8c-a2be-d46f392bbbf7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:23.275634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f92559-3903-4c8c-a2be-d46f392bbbf7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:23.276889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f92559-3903-4c8c-a2be-d46f392bbbf7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:23.341684 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-04f92559-3903-4c8c-a2be-d46f392bbbf7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 16400 microversion: 2.1 time: 0.082510 Jan 22 21:17:23.342745 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2838/5452] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:23 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 16400 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:23.809863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a644b74e-c4fd-4417-9fa8-f024d6b2b4a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:23.811136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a644b74e-c4fd-4417-9fa8-f024d6b2b4a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:23.818890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a644b74e-c4fd-4417-9fa8-f024d6b2b4a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:23.819484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a644b74e-c4fd-4417-9fa8-f024d6b2b4a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:23.820413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a644b74e-c4fd-4417-9fa8-f024d6b2b4a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:23.820869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a644b74e-c4fd-4417-9fa8-f024d6b2b4a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:24.011780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a644b74e-c4fd-4417-9fa8-f024d6b2b4a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:24.025330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a644b74e-c4fd-4417-9fa8-f024d6b2b4a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:24.028079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a644b74e-c4fd-4417-9fa8-f024d6b2b4a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:24.037744 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a644b74e-c4fd-4417-9fa8-f024d6b2b4a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1798 microversion: 2.20 time: 0.231390 Jan 22 21:17:24.038615 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2615/5453] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:23 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1798 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:24.229735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74603e44-047b-4145-95e8-d533d8274f94 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:24.230434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-74603e44-047b-4145-95e8-d533d8274f94 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:24.239411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74603e44-047b-4145-95e8-d533d8274f94 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:24.239883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74603e44-047b-4145-95e8-d533d8274f94 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:24.240905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74603e44-047b-4145-95e8-d533d8274f94 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:24.241360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74603e44-047b-4145-95e8-d533d8274f94 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:24.354466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0a630f2b-20e1-4a41-a672-2207423f867f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:24.355322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0a630f2b-20e1-4a41-a672-2207423f867f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:24.372155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a630f2b-20e1-4a41-a672-2207423f867f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:24.372921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a630f2b-20e1-4a41-a672-2207423f867f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:24.374053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a630f2b-20e1-4a41-a672-2207423f867f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:24.374753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a630f2b-20e1-4a41-a672-2207423f867f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:24.433913 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0a630f2b-20e1-4a41-a672-2207423f867f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 16400 microversion: 2.1 time: 0.083287 Jan 22 21:17:24.435525 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2616/5454] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:24 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 16400 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:17:24.470278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-74603e44-047b-4145-95e8-d533d8274f94 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:24.482292 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-74603e44-047b-4145-95e8-d533d8274f94 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1527 microversion: 2.1 time: 0.254549 Jan 22 21:17:24.483702 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2839/5455] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:24 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1527 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:24.656468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-82365840-2973-4fa9-8b05-494a3fa5365b tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:24.657448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-82365840-2973-4fa9-8b05-494a3fa5365b tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:24.665184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82365840-2973-4fa9-8b05-494a3fa5365b tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:24.668124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82365840-2973-4fa9-8b05-494a3fa5365b tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:24.669332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82365840-2973-4fa9-8b05-494a3fa5365b tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:24.669821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82365840-2973-4fa9-8b05-494a3fa5365b tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:25.062434 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-82365840-2973-4fa9-8b05-494a3fa5365b tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1836 microversion: 2.1 time: 0.412148 Jan 22 21:17:25.065678 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2617/5456] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:24 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1836 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:25.080025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-661dc85c-3db4-4d3b-ac39-d16ffe7df753 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:25.080656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-661dc85c-3db4-4d3b-ac39-d16ffe7df753 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:25.088823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-661dc85c-3db4-4d3b-ac39-d16ffe7df753 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:25.089291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-661dc85c-3db4-4d3b-ac39-d16ffe7df753 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:25.090143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-661dc85c-3db4-4d3b-ac39-d16ffe7df753 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:25.090597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-661dc85c-3db4-4d3b-ac39-d16ffe7df753 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:25.287339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-661dc85c-3db4-4d3b-ac39-d16ffe7df753 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:25.298589 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-661dc85c-3db4-4d3b-ac39-d16ffe7df753 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1685 microversion: 2.1 time: 0.222080 Jan 22 21:17:25.299950 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2840/5457] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:25 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1685 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:25.421223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4ed92d1-f0f0-4212-8e72-3854c4a8d613 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:25.422261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c4ed92d1-f0f0-4212-8e72-3854c4a8d613 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:25.431442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4ed92d1-f0f0-4212-8e72-3854c4a8d613 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:25.431906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4ed92d1-f0f0-4212-8e72-3854c4a8d613 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:25.432710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4ed92d1-f0f0-4212-8e72-3854c4a8d613 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:25.433140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4ed92d1-f0f0-4212-8e72-3854c4a8d613 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:25.454880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e56cfabe-492a-41f3-9786-57283d0cca0c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:25.456076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e56cfabe-492a-41f3-9786-57283d0cca0c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:25.473849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e56cfabe-492a-41f3-9786-57283d0cca0c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:25.477460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e56cfabe-492a-41f3-9786-57283d0cca0c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:25.477460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e56cfabe-492a-41f3-9786-57283d0cca0c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:25.477460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e56cfabe-492a-41f3-9786-57283d0cca0c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:25.512478 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c4ed92d1-f0f0-4212-8e72-3854c4a8d613 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1/action" status: 200 len: 32633 microversion: 2.1 time: 0.094348 Jan 22 21:17:25.524351 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2618/5458] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:25 2022] POST /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1/action => generated 32633 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:25.541236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b009badc-af81-4eeb-aac2-2bd015f733a6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:25.542042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b009badc-af81-4eeb-aac2-2bd015f733a6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:25.558173 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e56cfabe-492a-41f3-9786-57283d0cca0c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 16400 microversion: 2.1 time: 0.112756 Jan 22 21:17:25.560058 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2841/5459] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:25 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 16400 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:17:25.563986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b009badc-af81-4eeb-aac2-2bd015f733a6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:25.565039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b009badc-af81-4eeb-aac2-2bd015f733a6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:25.566915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b009badc-af81-4eeb-aac2-2bd015f733a6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:25.568093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b009badc-af81-4eeb-aac2-2bd015f733a6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:25.651825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-be22fcac-d528-42c6-aca0-c2293b01fc7f tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:25.652703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-be22fcac-d528-42c6-aca0-c2293b01fc7f tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:25.661721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be22fcac-d528-42c6-aca0-c2293b01fc7f tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:25.661721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be22fcac-d528-42c6-aca0-c2293b01fc7f tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:25.662474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be22fcac-d528-42c6-aca0-c2293b01fc7f tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:25.662925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be22fcac-d528-42c6-aca0-c2293b01fc7f tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:25.700190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-be22fcac-d528-42c6-aca0-c2293b01fc7f tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '98251eaa4d0c423d8cc89e9e94960b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8a2d1cf924036b1c35d2972d42163', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:25.700836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-be22fcac-d528-42c6-aca0-c2293b01fc7f tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] flavor_id is None. Assuming migration. {{(pid=137032) resize /opt/stack/nova/nova/compute/api.py:4073}} Jan 22 21:17:25.701355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-be22fcac-d528-42c6-aca0-c2293b01fc7f tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137032) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 21:17:25.811497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b009badc-af81-4eeb-aac2-2bd015f733a6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:25.823148 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b009badc-af81-4eeb-aac2-2bd015f733a6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1527 microversion: 2.1 time: 0.297429 Jan 22 21:17:25.824607 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2619/5460] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:25 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1527 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:26.278409 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-be22fcac-d528-42c6-aca0-c2293b01fc7f tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1/action" status: 202 len: 0 microversion: 2.1 time: 0.631202 Jan 22 21:17:26.280778 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2842/5461] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:25 2022] POST /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1/action => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:17:26.290495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48605d21-041b-485b-9b43-2993224cadb6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:26.291872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48605d21-041b-485b-9b43-2993224cadb6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:26.308017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48605d21-041b-485b-9b43-2993224cadb6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:26.308881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48605d21-041b-485b-9b43-2993224cadb6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:26.309758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48605d21-041b-485b-9b43-2993224cadb6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:26.310202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48605d21-041b-485b-9b43-2993224cadb6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:26.530000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-48605d21-041b-485b-9b43-2993224cadb6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:26.543775 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48605d21-041b-485b-9b43-2993224cadb6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1694 microversion: 2.1 time: 0.257542 Jan 22 21:17:26.545312 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2620/5462] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:26 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1694 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:26.569612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9c8caf5a-eff2-4a7a-b424-bf0a554524c3 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:26.570543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9c8caf5a-eff2-4a7a-b424-bf0a554524c3 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:26.580161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c8caf5a-eff2-4a7a-b424-bf0a554524c3 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:26.580621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c8caf5a-eff2-4a7a-b424-bf0a554524c3 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:26.581427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c8caf5a-eff2-4a7a-b424-bf0a554524c3 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:26.581906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c8caf5a-eff2-4a7a-b424-bf0a554524c3 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:26.624584 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9c8caf5a-eff2-4a7a-b424-bf0a554524c3 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 16400 microversion: 2.1 time: 0.058516 Jan 22 21:17:26.626424 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2843/5463] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:26 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 16400 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:26.840015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-834fe3cb-4e8d-419b-a553-f03701a929de tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:26.840635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-834fe3cb-4e8d-419b-a553-f03701a929de tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:26.847768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-834fe3cb-4e8d-419b-a553-f03701a929de tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:26.848261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-834fe3cb-4e8d-419b-a553-f03701a929de tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:26.849066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-834fe3cb-4e8d-419b-a553-f03701a929de tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:26.849529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-834fe3cb-4e8d-419b-a553-f03701a929de tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:26.997107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-834fe3cb-4e8d-419b-a553-f03701a929de tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:27.007393 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-834fe3cb-4e8d-419b-a553-f03701a929de tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1527 microversion: 2.1 time: 0.170249 Jan 22 21:17:27.007393 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2621/5464] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:26 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1527 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:27.565736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-11cc48e8-a5cb-4d3a-8b26-ce3a00748662 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:27.567223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-11cc48e8-a5cb-4d3a-8b26-ce3a00748662 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:27.575608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11cc48e8-a5cb-4d3a-8b26-ce3a00748662 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:27.576988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11cc48e8-a5cb-4d3a-8b26-ce3a00748662 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:27.577992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11cc48e8-a5cb-4d3a-8b26-ce3a00748662 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:27.581016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11cc48e8-a5cb-4d3a-8b26-ce3a00748662 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:27.636330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b6340eb4-a0ae-42b2-a517-581318bc94e7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:27.637300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b6340eb4-a0ae-42b2-a517-581318bc94e7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:27.645165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6340eb4-a0ae-42b2-a517-581318bc94e7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:27.645718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6340eb4-a0ae-42b2-a517-581318bc94e7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:27.646446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6340eb4-a0ae-42b2-a517-581318bc94e7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:27.646880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6340eb4-a0ae-42b2-a517-581318bc94e7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:27.715677 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b6340eb4-a0ae-42b2-a517-581318bc94e7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 16400 microversion: 2.1 time: 0.082216 Jan 22 21:17:27.717677 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2622/5465] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:27 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 16400 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:27.823232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-11cc48e8-a5cb-4d3a-8b26-ce3a00748662 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:27.833189 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-11cc48e8-a5cb-4d3a-8b26-ce3a00748662 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1694 microversion: 2.1 time: 0.275262 Jan 22 21:17:27.834205 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2844/5466] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:27 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1694 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:28.025440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cb939b5f-7c7f-4af5-b39d-1bc5347797be tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:28.026350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cb939b5f-7c7f-4af5-b39d-1bc5347797be tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:28.041233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb939b5f-7c7f-4af5-b39d-1bc5347797be tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:28.041233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb939b5f-7c7f-4af5-b39d-1bc5347797be tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:28.041233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb939b5f-7c7f-4af5-b39d-1bc5347797be tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:28.041233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb939b5f-7c7f-4af5-b39d-1bc5347797be tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:28.308600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cb939b5f-7c7f-4af5-b39d-1bc5347797be tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:28.319320 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cb939b5f-7c7f-4af5-b39d-1bc5347797be tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1509 microversion: 2.1 time: 0.298733 Jan 22 21:17:28.329335 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2623/5467] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:28 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1509 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:28.728277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bd230e4a-4d42-48d0-8cfa-09a2ba9f72bc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:28.729338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bd230e4a-4d42-48d0-8cfa-09a2ba9f72bc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:28.738455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd230e4a-4d42-48d0-8cfa-09a2ba9f72bc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:28.740433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd230e4a-4d42-48d0-8cfa-09a2ba9f72bc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:28.741538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd230e4a-4d42-48d0-8cfa-09a2ba9f72bc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:28.742092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd230e4a-4d42-48d0-8cfa-09a2ba9f72bc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:28.807108 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bd230e4a-4d42-48d0-8cfa-09a2ba9f72bc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 24573 microversion: 2.1 time: 0.082819 Jan 22 21:17:28.807817 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2845/5468] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:28 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 24573 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:17:28.851115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a7cca23a-2c0b-42d5-a218-9ecf68a3cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:28.851809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a7cca23a-2c0b-42d5-a218-9ecf68a3cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:28.859811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7cca23a-2c0b-42d5-a218-9ecf68a3cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:28.860387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7cca23a-2c0b-42d5-a218-9ecf68a3cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:28.861200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7cca23a-2c0b-42d5-a218-9ecf68a3cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:28.861697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7cca23a-2c0b-42d5-a218-9ecf68a3cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:29.033930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a7cca23a-2c0b-42d5-a218-9ecf68a3cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:29.044323 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a7cca23a-2c0b-42d5-a218-9ecf68a3cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1694 microversion: 2.1 time: 0.196050 Jan 22 21:17:29.045449 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2624/5469] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:28 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:29.336872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9b1eada5-e2e4-470b-bc24-a35a5218892d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:29.339153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9b1eada5-e2e4-470b-bc24-a35a5218892d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:29.346432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b1eada5-e2e4-470b-bc24-a35a5218892d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:29.347536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b1eada5-e2e4-470b-bc24-a35a5218892d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:29.348667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b1eada5-e2e4-470b-bc24-a35a5218892d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:29.349599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b1eada5-e2e4-470b-bc24-a35a5218892d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:29.647554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9b1eada5-e2e4-470b-bc24-a35a5218892d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:29.658016 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9b1eada5-e2e4-470b-bc24-a35a5218892d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1509 microversion: 2.1 time: 0.325139 Jan 22 21:17:29.658799 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2846/5470] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:29 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1509 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:29.823447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2256267c-8deb-42c7-a75e-7f6a5da385d1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:29.824634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2256267c-8deb-42c7-a75e-7f6a5da385d1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:29.833423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2256267c-8deb-42c7-a75e-7f6a5da385d1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:29.834202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2256267c-8deb-42c7-a75e-7f6a5da385d1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:29.835333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2256267c-8deb-42c7-a75e-7f6a5da385d1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:29.835984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2256267c-8deb-42c7-a75e-7f6a5da385d1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:29.880682 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2256267c-8deb-42c7-a75e-7f6a5da385d1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 24573 microversion: 2.1 time: 0.063749 Jan 22 21:17:29.882035 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2625/5471] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:29 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 24573 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:30.061766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-045ecb3f-0e8a-4c92-b240-e1494809d07b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:30.063077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-045ecb3f-0e8a-4c92-b240-e1494809d07b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:30.071035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-045ecb3f-0e8a-4c92-b240-e1494809d07b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:30.071562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-045ecb3f-0e8a-4c92-b240-e1494809d07b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:30.072692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-045ecb3f-0e8a-4c92-b240-e1494809d07b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:30.073137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-045ecb3f-0e8a-4c92-b240-e1494809d07b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:30.223046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-045ecb3f-0e8a-4c92-b240-e1494809d07b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:30.230576 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-045ecb3f-0e8a-4c92-b240-e1494809d07b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1699 microversion: 2.1 time: 0.172581 Jan 22 21:17:30.231151 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2847/5472] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:30 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1699 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:30.678031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2669b595-f235-4385-a92e-bd465282af4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:30.679293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2669b595-f235-4385-a92e-bd465282af4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:30.718221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2669b595-f235-4385-a92e-bd465282af4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:30.721777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2669b595-f235-4385-a92e-bd465282af4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:30.723891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2669b595-f235-4385-a92e-bd465282af4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:30.724367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2669b595-f235-4385-a92e-bd465282af4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:30.894215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a90459a-78f6-4f16-b68f-1943196c8fbf tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:30.896003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a90459a-78f6-4f16-b68f-1943196c8fbf tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:30.904854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a90459a-78f6-4f16-b68f-1943196c8fbf tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:30.906269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a90459a-78f6-4f16-b68f-1943196c8fbf tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:30.907384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a90459a-78f6-4f16-b68f-1943196c8fbf tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:30.907945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a90459a-78f6-4f16-b68f-1943196c8fbf tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:30.933921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2669b595-f235-4385-a92e-bd465282af4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:30.948595 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2669b595-f235-4385-a92e-bd465282af4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 200 len: 1512 microversion: 2.1 time: 0.276597 Jan 22 21:17:30.949850 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2626/5473] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:30 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 1512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:30.967380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6eaabe61-00f8-4b91-8e5f-db3bb58d92ce tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:30.967901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6eaabe61-00f8-4b91-8e5f-db3bb58d92ce tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:30.972315 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a90459a-78f6-4f16-b68f-1943196c8fbf tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 24573 microversion: 2.1 time: 0.082014 Jan 22 21:17:30.975108 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2848/5474] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:30 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 24573 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:30.982737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6eaabe61-00f8-4b91-8e5f-db3bb58d92ce tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:30.983641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6eaabe61-00f8-4b91-8e5f-db3bb58d92ce tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:30.985452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6eaabe61-00f8-4b91-8e5f-db3bb58d92ce tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:30.986365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6eaabe61-00f8-4b91-8e5f-db3bb58d92ce tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:31.024012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6eaabe61-00f8-4b91-8e5f-db3bb58d92ce tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:17:31.033056 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.compute.api [None req-6eaabe61-00f8-4b91-8e5f-db3bb58d92ce tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Working on deleting snapshot 4a6729e7-fba8-457d-ac22-cd127525dc4c from shelved instance... Jan 22 21:17:31.251148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e7b5c5e2-2ed1-409f-8dfa-8493189aeb2a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:31.251845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e7b5c5e2-2ed1-409f-8dfa-8493189aeb2a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:31.260067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7b5c5e2-2ed1-409f-8dfa-8493189aeb2a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:31.261235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7b5c5e2-2ed1-409f-8dfa-8493189aeb2a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:31.261486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7b5c5e2-2ed1-409f-8dfa-8493189aeb2a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:31.261866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7b5c5e2-2ed1-409f-8dfa-8493189aeb2a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:31.523346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e7b5c5e2-2ed1-409f-8dfa-8493189aeb2a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:31.534658 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e7b5c5e2-2ed1-409f-8dfa-8493189aeb2a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1699 microversion: 2.1 time: 0.288076 Jan 22 21:17:31.552228 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2849/5475] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:31 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1699 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:31.986375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-851ca94b-641b-4f37-92a4-e187270d56c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:31.987412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-851ca94b-641b-4f37-92a4-e187270d56c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:31.995002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-851ca94b-641b-4f37-92a4-e187270d56c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:31.995756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-851ca94b-641b-4f37-92a4-e187270d56c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:31.996680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-851ca94b-641b-4f37-92a4-e187270d56c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:31.997234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-851ca94b-641b-4f37-92a4-e187270d56c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:32.052920 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-851ca94b-641b-4f37-92a4-e187270d56c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 24573 microversion: 2.1 time: 0.067422 Jan 22 21:17:32.057568 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2850/5476] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:31 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 24573 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:17:32.089695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-31caf00b-f2d8-4e65-a25b-526c4351df66 req-0795eb17-a672-4a7d-9a20-2217495d0aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94caeb9b-99d6-4bf0-afa1-14362bcefed1", "name": "network-vif-unplugged", "status": "completed", "tag": "f1d8fe43-1089-47c2-b9bd-b99ad91bfb28"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:32.091596 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:17:32.091596 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:17:32.101054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-31caf00b-f2d8-4e65-a25b-526c4351df66 req-0795eb17-a672-4a7d-9a20-2217495d0aac service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:32.102335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-31caf00b-f2d8-4e65-a25b-526c4351df66 req-0795eb17-a672-4a7d-9a20-2217495d0aac service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:32.120854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.compute.server_external_events [req-31caf00b-f2d8-4e65-a25b-526c4351df66 req-0795eb17-a672-4a7d-9a20-2217495d0aac service nova] Unable to find a host for instance 94caeb9b-99d6-4bf0-afa1-14362bcefed1. Dropping event network-vif-unplugged {{(pid=137032) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 22 21:17:32.120854 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-31caf00b-f2d8-4e65-a25b-526c4351df66 req-0795eb17-a672-4a7d-9a20-2217495d0aac service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041764 Jan 22 21:17:32.120854 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2851/5477] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 22 21:17:32.555460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-95183541-bbf7-471e-924d-c6b4a7d93e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:32.559946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-95183541-bbf7-471e-924d-c6b4a7d93e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:32.571240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95183541-bbf7-471e-924d-c6b4a7d93e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:32.571987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95183541-bbf7-471e-924d-c6b4a7d93e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:32.573002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95183541-bbf7-471e-924d-c6b4a7d93e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:32.573657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95183541-bbf7-471e-924d-c6b4a7d93e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:32.826751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6eaabe61-00f8-4b91-8e5f-db3bb58d92ce tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Doing local delete in cell 52f5c6ef-d4de-4047-a310-d7aef14748aa(cell1) {{(pid=137033) _delete /opt/stack/nova/nova/compute/api.py:2439}} Jan 22 21:17:32.826751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6eaabe61-00f8-4b91-8e5f-db3bb58d92ce tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:32.826751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6eaabe61-00f8-4b91-8e5f-db3bb58d92ce tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:32.826751 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.compute.api [None req-6eaabe61-00f8-4b91-8e5f-db3bb58d92ce tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jan 22 21:17:32.830839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-6eaabe61-00f8-4b91-8e5f-db3bb58d92ce tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] deallocate_for_instance() {{(pid=137033) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Jan 22 21:17:33.074819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-95183541-bbf7-471e-924d-c6b4a7d93e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:33.089749 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-95183541-bbf7-471e-924d-c6b4a7d93e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1699 microversion: 2.1 time: 0.538741 Jan 22 21:17:33.096536 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2852/5478] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:32 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1699 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:33.110146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-54aabe80-c153-4545-bd78-f05a5c03165a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:33.115796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-54aabe80-c153-4545-bd78-f05a5c03165a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:33.119050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54aabe80-c153-4545-bd78-f05a5c03165a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:33.119928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54aabe80-c153-4545-bd78-f05a5c03165a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:33.121131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54aabe80-c153-4545-bd78-f05a5c03165a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:33.121870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54aabe80-c153-4545-bd78-f05a5c03165a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:33.177709 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-54aabe80-c153-4545-bd78-f05a5c03165a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 24573 microversion: 2.1 time: 0.079652 Jan 22 21:17:33.178887 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2853/5479] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:33 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 24573 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:34.096048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-eda0e248-c7a6-410d-bd60-3a56552a99eb req-a0e614f2-8732-4100-a5d2-16e44bebe492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94caeb9b-99d6-4bf0-afa1-14362bcefed1", "name": "network-vif-deleted", "tag": "f1d8fe43-1089-47c2-b9bd-b99ad91bfb28"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:34.097878 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:17:34.097878 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:17:34.112940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-eda0e248-c7a6-410d-bd60-3a56552a99eb req-a0e614f2-8732-4100-a5d2-16e44bebe492 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:34.112940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-eda0e248-c7a6-410d-bd60-3a56552a99eb req-a0e614f2-8732-4100-a5d2-16e44bebe492 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:34.124370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.compute.server_external_events [req-eda0e248-c7a6-410d-bd60-3a56552a99eb req-a0e614f2-8732-4100-a5d2-16e44bebe492 service nova] Unable to find a host for instance 94caeb9b-99d6-4bf0-afa1-14362bcefed1. Dropping event network-vif-deleted {{(pid=137032) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 22 21:17:34.126978 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-eda0e248-c7a6-410d-bd60-3a56552a99eb req-a0e614f2-8732-4100-a5d2-16e44bebe492 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.036988 Jan 22 21:17:34.132457 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2854/5480] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 22 21:17:34.137932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-199557af-8db7-4213-9d02-e0aced9b9005 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:34.138941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-199557af-8db7-4213-9d02-e0aced9b9005 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:34.156562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-199557af-8db7-4213-9d02-e0aced9b9005 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:34.157432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-199557af-8db7-4213-9d02-e0aced9b9005 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:34.159147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-199557af-8db7-4213-9d02-e0aced9b9005 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:34.174127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-199557af-8db7-4213-9d02-e0aced9b9005 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:34.178287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-6eaabe61-00f8-4b91-8e5f-db3bb58d92ce tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Updating instance_info_cache with network_info: [] {{(pid=137033) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 22 21:17:34.458384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-199557af-8db7-4213-9d02-e0aced9b9005 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:34.472378 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-199557af-8db7-4213-9d02-e0aced9b9005 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1699 microversion: 2.1 time: 0.338208 Jan 22 21:17:34.472992 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2855/5481] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:34 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1699 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:34.488006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a580eab3-0bc7-415c-b7b1-39695805d146 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:34.491847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a580eab3-0bc7-415c-b7b1-39695805d146 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:34.502904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a580eab3-0bc7-415c-b7b1-39695805d146 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:34.503651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a580eab3-0bc7-415c-b7b1-39695805d146 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:34.508134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a580eab3-0bc7-415c-b7b1-39695805d146 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:34.508691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a580eab3-0bc7-415c-b7b1-39695805d146 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:34.564005 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a580eab3-0bc7-415c-b7b1-39695805d146 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 24573 microversion: 2.1 time: 0.079348 Jan 22 21:17:34.564860 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2856/5482] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:34 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 24573 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:34.570332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5dfe1c2f-715e-4587-b034-36a906f14c08 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'create', calling method: .version_select at 0x7f1ed5debee0>, body: {"keypair": {"name": "tempest-keypair-1410337914"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:34.587353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-5dfe1c2f-715e-4587-b034-36a906f14c08 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Getting quotas for project d9480b0ab9b5461c953e555cb140b8f1. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:17:34.595182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-5dfe1c2f-715e-4587-b034-36a906f14c08 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Getting quotas for user a5f940a48ba74abeaca28109a6bf6f69 and project d9480b0ab9b5461c953e555cb140b8f1. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:17:34.868697 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6eaabe61-00f8-4b91-8e5f-db3bb58d92ce tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 204 len: 0 microversion: 2.1 time: 3.906345 Jan 22 21:17:34.869308 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2627/5483] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:17:30 2022] DELETE /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 0 bytes in 3908 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:17:34.883054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2da93973-04db-4d69-93e9-a7515bd096b7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:34.883054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2da93973-04db-4d69-93e9-a7515bd096b7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:34.895253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2da93973-04db-4d69-93e9-a7515bd096b7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:34.895717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2da93973-04db-4d69-93e9-a7515bd096b7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:34.896526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2da93973-04db-4d69-93e9-a7515bd096b7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:34.897153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2da93973-04db-4d69-93e9-a7515bd096b7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:34.911975 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-2da93973-04db-4d69-93e9-a7515bd096b7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 94caeb9b-99d6-4bf0-afa1-14362bcefed1 could not be found. Jan 22 21:17:34.913166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2da93973-04db-4d69-93e9-a7515bd096b7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 94caeb9b-99d6-4bf0-afa1-14362bcefed1 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:17:34.914251 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2da93973-04db-4d69-93e9-a7515bd096b7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 404 len: 111 microversion: 2.1 time: 0.040866 Jan 22 21:17:34.915334 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2628/5484] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:34 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:17:34.968013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-5dfe1c2f-715e-4587-b034-36a906f14c08 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Getting quotas for project d9480b0ab9b5461c953e555cb140b8f1. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:17:34.974541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-5dfe1c2f-715e-4587-b034-36a906f14c08 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Getting quotas for user a5f940a48ba74abeaca28109a6bf6f69 and project d9480b0ab9b5461c953e555cb140b8f1. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:17:34.990762 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5dfe1c2f-715e-4587-b034-36a906f14c08 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.32 time: 0.424511 Jan 22 21:17:34.991695 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2857/5485] 10.222.0.100 () {62 vars in 1203 bytes} [Sat Jan 22 21:17:34 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 426 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:17:35.050004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2079961044", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "96cc3928-7569-4c1f-becd-807913ebf734"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:35.108570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] validate_networks() for [('96cc3928-7569-4c1f-becd-807913ebf734', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:17:35.491935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08467a00-8ecd-439b-a20d-a10ede2d72d8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:35.492771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-08467a00-8ecd-439b-a20d-a10ede2d72d8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:35.499647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08467a00-8ecd-439b-a20d-a10ede2d72d8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:35.500382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08467a00-8ecd-439b-a20d-a10ede2d72d8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:35.501527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08467a00-8ecd-439b-a20d-a10ede2d72d8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:35.502882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08467a00-8ecd-439b-a20d-a10ede2d72d8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:35.578899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:17:35.579515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:17:35.579997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:17:35.580409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:17:35.580823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:17:35.593147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:35.594598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:35.596399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:35.596925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:35.624210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Getting quotas for project 5b1c3aa9e1ae4cc8a5a021434ad4a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:17:35.644876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Getting quotas for user b93108a71872461ea979735a490694a6 and project 5b1c3aa9e1ae4cc8a5a021434ad4a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:17:35.665666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:17:35.668897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:17:35.703854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-08467a00-8ecd-439b-a20d-a10ede2d72d8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:35.713289 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-08467a00-8ecd-439b-a20d-a10ede2d72d8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1699 microversion: 2.1 time: 0.225668 Jan 22 21:17:35.720231 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2858/5486] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:35 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1699 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:17:35.726445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-93b25596-e6b8-47aa-95f4-66aa3410dac2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:35.727760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-93b25596-e6b8-47aa-95f4-66aa3410dac2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:35.738090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93b25596-e6b8-47aa-95f4-66aa3410dac2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:35.739303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93b25596-e6b8-47aa-95f4-66aa3410dac2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:35.743456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93b25596-e6b8-47aa-95f4-66aa3410dac2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:35.743456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93b25596-e6b8-47aa-95f4-66aa3410dac2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:35.788935 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-93b25596-e6b8-47aa-95f4-66aa3410dac2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 24573 microversion: 2.1 time: 0.068161 Jan 22 21:17:35.789796 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2859/5487] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:35 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 24573 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:35.856836 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4ef741ce-5247-4e04-a2ff-4a30593348c6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.810960 Jan 22 21:17:35.857483 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2629/5488] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:17:35 2022] POST /compute/v2.1/servers => generated 382 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:17:35.874091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f98ed7e1-9f49-43de-942b-9a1a819c449b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:35.874091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f98ed7e1-9f49-43de-942b-9a1a819c449b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:35.973975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f98ed7e1-9f49-43de-942b-9a1a819c449b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:35.981225 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f98ed7e1-9f49-43de-942b-9a1a819c449b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1219 microversion: 2.1 time: 0.115940 Jan 22 21:17:35.982119 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2860/5489] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:35 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:36.734706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7591cfbc-13d7-4033-83d0-c6244c37dab8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:36.735637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7591cfbc-13d7-4033-83d0-c6244c37dab8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:36.742888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7591cfbc-13d7-4033-83d0-c6244c37dab8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:36.743379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7591cfbc-13d7-4033-83d0-c6244c37dab8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:36.744182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7591cfbc-13d7-4033-83d0-c6244c37dab8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:36.744628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7591cfbc-13d7-4033-83d0-c6244c37dab8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:36.809077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b9ccbc7f-a441-402b-8701-af27f8d480c5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:36.810855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b9ccbc7f-a441-402b-8701-af27f8d480c5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:36.828187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9ccbc7f-a441-402b-8701-af27f8d480c5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:36.834259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9ccbc7f-a441-402b-8701-af27f8d480c5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:36.835140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9ccbc7f-a441-402b-8701-af27f8d480c5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:36.835656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9ccbc7f-a441-402b-8701-af27f8d480c5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:36.882280 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b9ccbc7f-a441-402b-8701-af27f8d480c5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 24573 microversion: 2.1 time: 0.083371 Jan 22 21:17:36.882957 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2861/5490] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:36 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 24573 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:36.999751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-64c5d376-f4e7-4244-981f-6ac34052fc52 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:37.001159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-64c5d376-f4e7-4244-981f-6ac34052fc52 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:37.009724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64c5d376-f4e7-4244-981f-6ac34052fc52 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:37.010191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64c5d376-f4e7-4244-981f-6ac34052fc52 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:37.011661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64c5d376-f4e7-4244-981f-6ac34052fc52 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:37.012304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64c5d376-f4e7-4244-981f-6ac34052fc52 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:37.077336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7591cfbc-13d7-4033-83d0-c6244c37dab8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:37.089998 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7591cfbc-13d7-4033-83d0-c6244c37dab8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1699 microversion: 2.1 time: 0.358874 Jan 22 21:17:37.094069 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2630/5491] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:36 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1699 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:37.150046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-64c5d376-f4e7-4244-981f-6ac34052fc52 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:37.163761 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-64c5d376-f4e7-4244-981f-6ac34052fc52 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1223 microversion: 2.1 time: 0.168112 Jan 22 21:17:37.167669 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2862/5492] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:36 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1223 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:17:37.897611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9d278906-1e7c-4cc8-8caa-56bc2ad913bc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:37.898585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9d278906-1e7c-4cc8-8caa-56bc2ad913bc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:37.914609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d278906-1e7c-4cc8-8caa-56bc2ad913bc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:37.915455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d278906-1e7c-4cc8-8caa-56bc2ad913bc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:37.916556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d278906-1e7c-4cc8-8caa-56bc2ad913bc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:37.917073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d278906-1e7c-4cc8-8caa-56bc2ad913bc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:38.002383 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9d278906-1e7c-4cc8-8caa-56bc2ad913bc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 24573 microversion: 2.1 time: 0.109528 Jan 22 21:17:38.007226 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2631/5493] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:37 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 24573 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:38.109320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1a54b0b-c1cb-48b4-9299-9bbebe0f51e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:38.109971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1a54b0b-c1cb-48b4-9299-9bbebe0f51e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:38.117126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1a54b0b-c1cb-48b4-9299-9bbebe0f51e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:38.117618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1a54b0b-c1cb-48b4-9299-9bbebe0f51e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:38.118779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1a54b0b-c1cb-48b4-9299-9bbebe0f51e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:38.119240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1a54b0b-c1cb-48b4-9299-9bbebe0f51e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:38.187764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-865739a6-14cd-4949-b45e-cc28909d8768 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:38.192451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-865739a6-14cd-4949-b45e-cc28909d8768 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:38.219128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-865739a6-14cd-4949-b45e-cc28909d8768 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:38.219882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-865739a6-14cd-4949-b45e-cc28909d8768 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:38.221687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-865739a6-14cd-4949-b45e-cc28909d8768 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:38.222359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-865739a6-14cd-4949-b45e-cc28909d8768 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:38.311904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1a54b0b-c1cb-48b4-9299-9bbebe0f51e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:38.337403 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1a54b0b-c1cb-48b4-9299-9bbebe0f51e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1699 microversion: 2.1 time: 0.218537 Jan 22 21:17:38.337403 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2863/5494] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:38 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1699 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:38.441495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-865739a6-14cd-4949-b45e-cc28909d8768 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:38.450337 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-865739a6-14cd-4949-b45e-cc28909d8768 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1279 microversion: 2.1 time: 0.269734 Jan 22 21:17:38.451238 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2632/5495] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:38 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1279 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:17:39.022191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d870cf5d-8525-4816-99c1-7cd499c55a5d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:39.023887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d870cf5d-8525-4816-99c1-7cd499c55a5d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:39.032221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d870cf5d-8525-4816-99c1-7cd499c55a5d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:39.033308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d870cf5d-8525-4816-99c1-7cd499c55a5d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:39.034363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d870cf5d-8525-4816-99c1-7cd499c55a5d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:39.034889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d870cf5d-8525-4816-99c1-7cd499c55a5d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:39.085841 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d870cf5d-8525-4816-99c1-7cd499c55a5d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 24573 microversion: 2.1 time: 0.067991 Jan 22 21:17:39.088249 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2864/5496] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:39 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 24573 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:39.220018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-616649286", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "bc73765f-f3b5-47a9-8f3e-8bb1b1a10c5d"}, {"port": "da0ef06a-1226-49f4-b8db-7103fe846c99", "tag": "port-1"}, {"port": "cf20b5e5-413a-4b45-9640-028e8825cf06", "tag": "port-2"}, {"uuid": "cca47eb4-0b93-4160-b1b5-3c7938aeadb9", "tag": "net-1"}, {"uuid": "cca47eb4-0b93-4160-b1b5-3c7938aeadb9"}, {"uuid": "a98f6cdc-0cc7-4283-b93a-0ef3f563aaf0", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a98f6cdc-0cc7-4283-b93a-0ef3f563aaf0", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "fe1f8ef9-19a5-4687-8faf-0666021816d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c8294219-e877-4aee-abe6-451466fa194f", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0a4a89b1-bfa5-41ab-9b69-2aa9236eafba", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--649717956"}], "key_name": "tempest-keypair-1410337914", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:39.347563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f6eca37d-b92c-4a45-8530-e3164f7b872e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:39.348623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f6eca37d-b92c-4a45-8530-e3164f7b872e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:39.395235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] validate_networks() for [('bc73765f-f3b5-47a9-8f3e-8bb1b1a10c5d', None, None, None, None, None), (None, None, 'da0ef06a-1226-49f4-b8db-7103fe846c99', None, None, None), (None, None, 'cf20b5e5-413a-4b45-9640-028e8825cf06', None, None, None), ('cca47eb4-0b93-4160-b1b5-3c7938aeadb9', None, None, None, None, None), ('cca47eb4-0b93-4160-b1b5-3c7938aeadb9', None, None, None, None, None), ('a98f6cdc-0cc7-4283-b93a-0ef3f563aaf0', '10.2.2.100', None, None, None, None), ('a98f6cdc-0cc7-4283-b93a-0ef3f563aaf0', '10.2.2.200', None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:17:39.397800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6eca37d-b92c-4a45-8530-e3164f7b872e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:39.398367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6eca37d-b92c-4a45-8530-e3164f7b872e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:39.405317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6eca37d-b92c-4a45-8530-e3164f7b872e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:39.406030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6eca37d-b92c-4a45-8530-e3164f7b872e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:39.700886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f6eca37d-b92c-4a45-8530-e3164f7b872e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:39.717132 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f6eca37d-b92c-4a45-8530-e3164f7b872e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1699 microversion: 2.1 time: 0.376374 Jan 22 21:17:39.728137 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2865/5497] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:39 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1699 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:39.740239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e1459624-2c8d-4aa8-908a-920f99533033 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:39.741037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e1459624-2c8d-4aa8-908a-920f99533033 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:39.753140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1459624-2c8d-4aa8-908a-920f99533033 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:39.753759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1459624-2c8d-4aa8-908a-920f99533033 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:39.754693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1459624-2c8d-4aa8-908a-920f99533033 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:39.755145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1459624-2c8d-4aa8-908a-920f99533033 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:39.944656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e1459624-2c8d-4aa8-908a-920f99533033 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:39.953023 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e1459624-2c8d-4aa8-908a-920f99533033 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1319 microversion: 2.1 time: 0.224603 Jan 22 21:17:39.954431 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2866/5498] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:39 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:40.098639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-77d254aa-0ad5-425a-871f-966b58afc817 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:40.099645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-77d254aa-0ad5-425a-871f-966b58afc817 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:40.107452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77d254aa-0ad5-425a-871f-966b58afc817 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:40.107915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77d254aa-0ad5-425a-871f-966b58afc817 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:40.108934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77d254aa-0ad5-425a-871f-966b58afc817 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:40.109399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77d254aa-0ad5-425a-871f-966b58afc817 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:40.154705 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-77d254aa-0ad5-425a-871f-966b58afc817 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 24573 microversion: 2.1 time: 0.058135 Jan 22 21:17:40.154705 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2867/5499] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:40 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 24573 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:17:40.742860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-be3dab17-266f-4cde-821e-41522fadb0db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:40.742860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-be3dab17-266f-4cde-821e-41522fadb0db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:40.746669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be3dab17-266f-4cde-821e-41522fadb0db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:40.747362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be3dab17-266f-4cde-821e-41522fadb0db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:40.748552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be3dab17-266f-4cde-821e-41522fadb0db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:40.749175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be3dab17-266f-4cde-821e-41522fadb0db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:40.932074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-be3dab17-266f-4cde-821e-41522fadb0db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:40.947408 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-be3dab17-266f-4cde-821e-41522fadb0db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1699 microversion: 2.1 time: 0.208635 Jan 22 21:17:40.947408 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2868/5500] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:40 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1699 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:17:40.975918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d854a0b3-6eb3-4efa-839a-f28706a25f0c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:40.975918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d854a0b3-6eb3-4efa-839a-f28706a25f0c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:40.978588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d854a0b3-6eb3-4efa-839a-f28706a25f0c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:40.979098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d854a0b3-6eb3-4efa-839a-f28706a25f0c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:40.979956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d854a0b3-6eb3-4efa-839a-f28706a25f0c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:40.980346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d854a0b3-6eb3-4efa-839a-f28706a25f0c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:41.152130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d854a0b3-6eb3-4efa-839a-f28706a25f0c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:41.161826 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d854a0b3-6eb3-4efa-839a-f28706a25f0c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1319 microversion: 2.1 time: 0.194529 Jan 22 21:17:41.162423 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2869/5501] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:40 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:17:41.167033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4bd38db6-78ba-43c5-a9a2-4a908f466620 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:41.169049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4bd38db6-78ba-43c5-a9a2-4a908f466620 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:41.174334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bd38db6-78ba-43c5-a9a2-4a908f466620 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:41.174796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bd38db6-78ba-43c5-a9a2-4a908f466620 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:41.175595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bd38db6-78ba-43c5-a9a2-4a908f466620 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:41.176040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bd38db6-78ba-43c5-a9a2-4a908f466620 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:41.219179 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4bd38db6-78ba-43c5-a9a2-4a908f466620 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 24573 microversion: 2.1 time: 0.054614 Jan 22 21:17:41.220809 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2870/5502] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:41 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 24573 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:41.488060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-6ac6ab4c-e000-4604-98a2-faaf81972547 req-9a4b195f-ba2f-4a82-b3e5-f0812ea86a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "003afb2c-4163-45fa-8f37-346bd32ffb62", "tag": "3c7d1f54-9806-4bb5-be24-a5cc055adc17"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:41.489569 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:17:41.489569 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:17:41.499113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6ac6ab4c-e000-4604-98a2-faaf81972547 req-9a4b195f-ba2f-4a82-b3e5-f0812ea86a11 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:41.500480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6ac6ab4c-e000-4604-98a2-faaf81972547 req-9a4b195f-ba2f-4a82-b3e5-f0812ea86a11 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:41.515068 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-6ac6ab4c-e000-4604-98a2-faaf81972547 req-9a4b195f-ba2f-4a82-b3e5-f0812ea86a11 service nova] Creating event network-changed:3c7d1f54-9806-4bb5-be24-a5cc055adc17 for instance 003afb2c-4163-45fa-8f37-346bd32ffb62 on nch2-master-1 Jan 22 21:17:41.522139 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-6ac6ab4c-e000-4604-98a2-faaf81972547 req-9a4b195f-ba2f-4a82-b3e5-f0812ea86a11 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038996 Jan 22 21:17:41.522879 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2871/5503] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:17:41.967149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0a12d71d-2a3a-43a6-a80f-ad6f42460f3c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:41.969018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0a12d71d-2a3a-43a6-a80f-ad6f42460f3c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:41.977583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a12d71d-2a3a-43a6-a80f-ad6f42460f3c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:41.978349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a12d71d-2a3a-43a6-a80f-ad6f42460f3c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:41.979202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a12d71d-2a3a-43a6-a80f-ad6f42460f3c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:41.979669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a12d71d-2a3a-43a6-a80f-ad6f42460f3c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:42.197358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0a12d71d-2a3a-43a6-a80f-ad6f42460f3c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:42.208720 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0a12d71d-2a3a-43a6-a80f-ad6f42460f3c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1699 microversion: 2.1 time: 0.250534 Jan 22 21:17:42.210947 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2872/5504] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:41 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1699 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:42.221826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0390b48e-391b-4f6c-8e27-5333ade4e78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:42.222470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0390b48e-391b-4f6c-8e27-5333ade4e78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:42.229665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0390b48e-391b-4f6c-8e27-5333ade4e78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:42.233263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0390b48e-391b-4f6c-8e27-5333ade4e78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:42.233263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0390b48e-391b-4f6c-8e27-5333ade4e78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:42.233263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0390b48e-391b-4f6c-8e27-5333ade4e78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:42.410556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0390b48e-391b-4f6c-8e27-5333ade4e78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:42.418404 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0390b48e-391b-4f6c-8e27-5333ade4e78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1319 microversion: 2.1 time: 0.206116 Jan 22 21:17:42.419071 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2873/5505] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:42 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:42.427184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f9e8c0e-6584-446f-bf21-e7b7c040031c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:42.429132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8f9e8c0e-6584-446f-bf21-e7b7c040031c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:42.438019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f9e8c0e-6584-446f-bf21-e7b7c040031c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:42.439280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f9e8c0e-6584-446f-bf21-e7b7c040031c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:42.440474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f9e8c0e-6584-446f-bf21-e7b7c040031c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:42.440854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f9e8c0e-6584-446f-bf21-e7b7c040031c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:42.495225 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8f9e8c0e-6584-446f-bf21-e7b7c040031c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 24573 microversion: 2.1 time: 0.074678 Jan 22 21:17:42.498098 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2874/5506] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:42 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 24573 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:43.227857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3ebdb5c6-7467-4da1-aa3b-cd8b6586499c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:43.229217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3ebdb5c6-7467-4da1-aa3b-cd8b6586499c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:43.236830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ebdb5c6-7467-4da1-aa3b-cd8b6586499c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:43.237714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ebdb5c6-7467-4da1-aa3b-cd8b6586499c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:43.238705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ebdb5c6-7467-4da1-aa3b-cd8b6586499c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:43.239330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ebdb5c6-7467-4da1-aa3b-cd8b6586499c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:43.380066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:17:43.381310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:17:43.381909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:17:43.382474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:17:43.383329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:17:43.407007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:43.407435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:43.417973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:43.418541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:43.451922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Getting quotas for project d9480b0ab9b5461c953e555cb140b8f1. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:17:43.457709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Getting quotas for user a5f940a48ba74abeaca28109a6bf6f69 and project d9480b0ab9b5461c953e555cb140b8f1. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:17:43.599881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3ebdb5c6-7467-4da1-aa3b-cd8b6586499c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:43.635072 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3ebdb5c6-7467-4da1-aa3b-cd8b6586499c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1698 microversion: 2.1 time: 0.410557 Jan 22 21:17:43.636821 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2875/5507] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:43 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1698 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:17:43.651375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ed5e253-9887-4695-8f51-129963085d4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:43.652951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1ed5e253-9887-4695-8f51-129963085d4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:43.666062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ed5e253-9887-4695-8f51-129963085d4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:43.674856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ed5e253-9887-4695-8f51-129963085d4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:43.674856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ed5e253-9887-4695-8f51-129963085d4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:43.674856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ed5e253-9887-4695-8f51-129963085d4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:43.702677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:17:43.706887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='fe1f8ef9-19a5-4687-8faf-0666021816d4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c8294219-e877-4aee-abe6-451466fa194f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a4a89b1-bfa5-41ab-9b69-2aa9236eafba',volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:17:44.025365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1ed5e253-9887-4695-8f51-129963085d4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:44.034162 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ed5e253-9887-4695-8f51-129963085d4e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1319 microversion: 2.1 time: 0.395893 Jan 22 21:17:44.040735 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2876/5508] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:43 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:44.046815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-623e8590-c470-435e-9c76-8bdb85d14c63 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:44.050770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-623e8590-c470-435e-9c76-8bdb85d14c63 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:44.068176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-623e8590-c470-435e-9c76-8bdb85d14c63 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:44.073741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-623e8590-c470-435e-9c76-8bdb85d14c63 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:44.074625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-623e8590-c470-435e-9c76-8bdb85d14c63 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:44.075087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-623e8590-c470-435e-9c76-8bdb85d14c63 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:44.162269 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-623e8590-c470-435e-9c76-8bdb85d14c63 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.112906 Jan 22 21:17:44.162269 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2877/5509] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:44 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:44.168022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-d66e2b62-0b75-42ed-b6de-c5c2021868a7 req-45f52f14-c2e0-4d6d-b641-74d6637f2b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdde4f64-417f-4c19-ac24-3250a9619db1", "name": "network-vif-unplugged", "status": "completed", "tag": "a1a87111-ee94-490d-8f2e-69e60e3d6517"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:44.172741 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:17:44.172741 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:17:44.196629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d66e2b62-0b75-42ed-b6de-c5c2021868a7 req-45f52f14-c2e0-4d6d-b641-74d6637f2b95 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:44.202372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d66e2b62-0b75-42ed-b6de-c5c2021868a7 req-45f52f14-c2e0-4d6d-b641-74d6637f2b95 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:44.216639 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d66e2b62-0b75-42ed-b6de-c5c2021868a7 req-45f52f14-c2e0-4d6d-b641-74d6637f2b95 service nova] Creating event network-vif-unplugged:a1a87111-ee94-490d-8f2e-69e60e3d6517 for instance cdde4f64-417f-4c19-ac24-3250a9619db1 on nch1-master-1 Jan 22 21:17:44.227170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-d66e2b62-0b75-42ed-b6de-c5c2021868a7 req-45f52f14-c2e0-4d6d-b641-74d6637f2b95 service nova] Instance cdde4f64-417f-4c19-ac24-3250a9619db1 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:17:44.255286 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-d66e2b62-0b75-42ed-b6de-c5c2021868a7 req-45f52f14-c2e0-4d6d-b641-74d6637f2b95 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086372 Jan 22 21:17:44.263124 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2878/5510] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:17:44.661169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-954738df-246f-451b-9b7a-e391777d41db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:44.672540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-954738df-246f-451b-9b7a-e391777d41db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:44.672540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-954738df-246f-451b-9b7a-e391777d41db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:44.672540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-954738df-246f-451b-9b7a-e391777d41db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:44.672540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-954738df-246f-451b-9b7a-e391777d41db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:44.672540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-954738df-246f-451b-9b7a-e391777d41db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:45.141028 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-29aae5f5-d137-48dd-ba11-0b8520f3d314 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.32 time: 5.923533 Jan 22 21:17:45.147960 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2633/5511] 10.222.0.100 () {62 vars in 1193 bytes} [Sat Jan 22 21:17:39 2022] POST /compute/v2.1/servers => generated 407 bytes in 5933 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 22 21:17:45.153301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-800d5a96-28a2-447f-8a32-e796e07edebb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:45.153983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-800d5a96-28a2-447f-8a32-e796e07edebb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:45.162687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-800d5a96-28a2-447f-8a32-e796e07edebb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:45.163454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-800d5a96-28a2-447f-8a32-e796e07edebb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:45.164511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-800d5a96-28a2-447f-8a32-e796e07edebb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:45.165166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-800d5a96-28a2-447f-8a32-e796e07edebb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:45.323596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-954738df-246f-451b-9b7a-e391777d41db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:45.331450 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-954738df-246f-451b-9b7a-e391777d41db tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1698 microversion: 2.1 time: 0.675811 Jan 22 21:17:45.332073 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2879/5512] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:44 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1698 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:17:45.344034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a00ec52a-32eb-474f-8d12-e9f910f2a4c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:45.348739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a00ec52a-32eb-474f-8d12-e9f910f2a4c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:45.497572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a00ec52a-32eb-474f-8d12-e9f910f2a4c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:45.508654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a00ec52a-32eb-474f-8d12-e9f910f2a4c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:45.510209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a00ec52a-32eb-474f-8d12-e9f910f2a4c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:45.511688 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a00ec52a-32eb-474f-8d12-e9f910f2a4c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1289 microversion: 2.32 time: 0.178694 Jan 22 21:17:45.512261 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2880/5513] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:45 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1289 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:45.532492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f18d4035-3566-4e5d-9393-5e47c1972842 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:45.534602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f18d4035-3566-4e5d-9393-5e47c1972842 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:45.543919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f18d4035-3566-4e5d-9393-5e47c1972842 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:45.545082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f18d4035-3566-4e5d-9393-5e47c1972842 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:45.547962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f18d4035-3566-4e5d-9393-5e47c1972842 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:45.549252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f18d4035-3566-4e5d-9393-5e47c1972842 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:45.575016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-800d5a96-28a2-447f-8a32-e796e07edebb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:45.586080 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-800d5a96-28a2-447f-8a32-e796e07edebb tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1319 microversion: 2.1 time: 0.436836 Jan 22 21:17:45.587342 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2634/5514] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:45 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:45.631619 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f18d4035-3566-4e5d-9393-5e47c1972842 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.117185 Jan 22 21:17:45.635121 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2881/5515] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:45 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:46.292500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-943cc71c-99b8-45cd-88f3-87627f93ac05 req-a74589f4-c8ae-4ca2-92cd-e715f859801d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdde4f64-417f-4c19-ac24-3250a9619db1", "tag": "a1a87111-ee94-490d-8f2e-69e60e3d6517"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:46.294548 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:17:46.294548 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:17:46.304742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-943cc71c-99b8-45cd-88f3-87627f93ac05 req-a74589f4-c8ae-4ca2-92cd-e715f859801d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:46.305266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-943cc71c-99b8-45cd-88f3-87627f93ac05 req-a74589f4-c8ae-4ca2-92cd-e715f859801d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:46.326689 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-943cc71c-99b8-45cd-88f3-87627f93ac05 req-a74589f4-c8ae-4ca2-92cd-e715f859801d service nova] Creating event network-changed:a1a87111-ee94-490d-8f2e-69e60e3d6517 for instance cdde4f64-417f-4c19-ac24-3250a9619db1 on nch1-master-1 Jan 22 21:17:46.333465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-943cc71c-99b8-45cd-88f3-87627f93ac05 req-a74589f4-c8ae-4ca2-92cd-e715f859801d service nova] Instance cdde4f64-417f-4c19-ac24-3250a9619db1 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:17:46.350212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1c7d7c0a-7310-43bf-b2e9-5e664faa00d7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:46.351044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1c7d7c0a-7310-43bf-b2e9-5e664faa00d7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:46.357308 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-943cc71c-99b8-45cd-88f3-87627f93ac05 req-a74589f4-c8ae-4ca2-92cd-e715f859801d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069112 Jan 22 21:17:46.358713 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2635/5516] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:17:46.362583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c7d7c0a-7310-43bf-b2e9-5e664faa00d7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:46.363155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c7d7c0a-7310-43bf-b2e9-5e664faa00d7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:46.364353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c7d7c0a-7310-43bf-b2e9-5e664faa00d7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:46.364886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c7d7c0a-7310-43bf-b2e9-5e664faa00d7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:46.533920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c34f45ae-037f-40e0-85d0-20dde3ad6ce9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:46.534628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c34f45ae-037f-40e0-85d0-20dde3ad6ce9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:46.677904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1c7d7c0a-7310-43bf-b2e9-5e664faa00d7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:46.689405 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1c7d7c0a-7310-43bf-b2e9-5e664faa00d7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1698 microversion: 2.1 time: 0.343559 Jan 22 21:17:46.697491 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2882/5517] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:46 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1698 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:17:46.710634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-79dc9712-b3c0-4a6f-8110-9f2e8708e24b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:46.717277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-79dc9712-b3c0-4a6f-8110-9f2e8708e24b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:46.724963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c34f45ae-037f-40e0-85d0-20dde3ad6ce9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:46.743506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79dc9712-b3c0-4a6f-8110-9f2e8708e24b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:46.743972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79dc9712-b3c0-4a6f-8110-9f2e8708e24b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:46.744695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c34f45ae-037f-40e0-85d0-20dde3ad6ce9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:46.744841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79dc9712-b3c0-4a6f-8110-9f2e8708e24b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:46.745547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79dc9712-b3c0-4a6f-8110-9f2e8708e24b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:46.752284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c34f45ae-037f-40e0-85d0-20dde3ad6ce9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:46.757660 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c34f45ae-037f-40e0-85d0-20dde3ad6ce9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1289 microversion: 2.32 time: 0.228491 Jan 22 21:17:46.759439 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2636/5518] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:46 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1289 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:46.772760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-21f89f19-b4b7-4c99-93fe-427ef5c413fd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:46.776555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-21f89f19-b4b7-4c99-93fe-427ef5c413fd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:46.791389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21f89f19-b4b7-4c99-93fe-427ef5c413fd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:46.791785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21f89f19-b4b7-4c99-93fe-427ef5c413fd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:46.792610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21f89f19-b4b7-4c99-93fe-427ef5c413fd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:46.793062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21f89f19-b4b7-4c99-93fe-427ef5c413fd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:46.885083 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-21f89f19-b4b7-4c99-93fe-427ef5c413fd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.122181 Jan 22 21:17:46.886285 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2637/5519] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:46 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:47.087861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-79dc9712-b3c0-4a6f-8110-9f2e8708e24b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:47.112048 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-79dc9712-b3c0-4a6f-8110-9f2e8708e24b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1319 microversion: 2.1 time: 0.413118 Jan 22 21:17:47.121799 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2883/5520] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:46 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:47.713264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a8fc1bc-7fc3-4398-8fe0-a7770871b088 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:47.714214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9a8fc1bc-7fc3-4398-8fe0-a7770871b088 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:47.723170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a8fc1bc-7fc3-4398-8fe0-a7770871b088 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:47.724652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a8fc1bc-7fc3-4398-8fe0-a7770871b088 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:47.724890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a8fc1bc-7fc3-4398-8fe0-a7770871b088 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:47.725999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a8fc1bc-7fc3-4398-8fe0-a7770871b088 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:47.781638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aaa8aa49-ddf3-49af-968b-6d21da407faa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:47.782421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aaa8aa49-ddf3-49af-968b-6d21da407faa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:47.789435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aaa8aa49-ddf3-49af-968b-6d21da407faa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:47.789944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aaa8aa49-ddf3-49af-968b-6d21da407faa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:47.790759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aaa8aa49-ddf3-49af-968b-6d21da407faa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:47.791210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aaa8aa49-ddf3-49af-968b-6d21da407faa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:47.893915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aaa8aa49-ddf3-49af-968b-6d21da407faa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:47.912502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aaa8aa49-ddf3-49af-968b-6d21da407faa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:47.915882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aaa8aa49-ddf3-49af-968b-6d21da407faa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:47.917093 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aaa8aa49-ddf3-49af-968b-6d21da407faa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1523 microversion: 2.32 time: 0.139313 Jan 22 21:17:47.918905 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2884/5521] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:47 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1523 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:17:47.939406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-944894ff-b9a2-4b05-b6ee-d31b99e48761 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:47.944056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-944894ff-b9a2-4b05-b6ee-d31b99e48761 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:47.954750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-944894ff-b9a2-4b05-b6ee-d31b99e48761 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:47.956477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-944894ff-b9a2-4b05-b6ee-d31b99e48761 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:47.959828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-944894ff-b9a2-4b05-b6ee-d31b99e48761 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:47.960335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-944894ff-b9a2-4b05-b6ee-d31b99e48761 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:48.039680 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-944894ff-b9a2-4b05-b6ee-d31b99e48761 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.107743 Jan 22 21:17:48.042371 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2885/5522] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:47 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:48.132090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-392db494-2246-48f2-baaa-5337f78c6eda tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:48.133275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-392db494-2246-48f2-baaa-5337f78c6eda tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:48.147321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-392db494-2246-48f2-baaa-5337f78c6eda tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:48.148210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-392db494-2246-48f2-baaa-5337f78c6eda tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:48.150568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-392db494-2246-48f2-baaa-5337f78c6eda tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:48.151876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-392db494-2246-48f2-baaa-5337f78c6eda tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:48.241276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9a8fc1bc-7fc3-4398-8fe0-a7770871b088 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:48.253750 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a8fc1bc-7fc3-4398-8fe0-a7770871b088 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1696 microversion: 2.1 time: 0.544369 Jan 22 21:17:48.255568 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2638/5523] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:47 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1696 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:48.263087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-7d58dd42-df37-4bbb-9e41-cf1a217c39e3 req-c3d9cf53-0677-44d7-88a8-9da0d51b21a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003afb2c-4163-45fa-8f37-346bd32ffb62", "name": "network-vif-plugged", "status": "completed", "tag": "3c7d1f54-9806-4bb5-be24-a5cc055adc17"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:48.265464 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:17:48.265464 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:17:48.275183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7d58dd42-df37-4bbb-9e41-cf1a217c39e3 req-c3d9cf53-0677-44d7-88a8-9da0d51b21a7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:48.275827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7d58dd42-df37-4bbb-9e41-cf1a217c39e3 req-c3d9cf53-0677-44d7-88a8-9da0d51b21a7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:48.291073 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-7d58dd42-df37-4bbb-9e41-cf1a217c39e3 req-c3d9cf53-0677-44d7-88a8-9da0d51b21a7 service nova] Creating event network-vif-plugged:3c7d1f54-9806-4bb5-be24-a5cc055adc17 for instance 003afb2c-4163-45fa-8f37-346bd32ffb62 on nch2-master-1 Jan 22 21:17:48.299376 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-7d58dd42-df37-4bbb-9e41-cf1a217c39e3 req-c3d9cf53-0677-44d7-88a8-9da0d51b21a7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041416 Jan 22 21:17:48.300281 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2639/5524] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:17:48.352357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-392db494-2246-48f2-baaa-5337f78c6eda tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:48.361317 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-392db494-2246-48f2-baaa-5337f78c6eda tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1319 microversion: 2.1 time: 0.235868 Jan 22 21:17:48.362253 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2886/5525] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:48 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:48.950345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d17dff1-6591-4401-ac36-3c98be721484 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:48.953161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d17dff1-6591-4401-ac36-3c98be721484 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:48.978249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d17dff1-6591-4401-ac36-3c98be721484 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:48.983514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d17dff1-6591-4401-ac36-3c98be721484 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:48.983514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d17dff1-6591-4401-ac36-3c98be721484 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:48.983514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d17dff1-6591-4401-ac36-3c98be721484 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:49.053041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-45f5fa28-a2f7-4435-a460-2b802449eca5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:49.054190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-45f5fa28-a2f7-4435-a460-2b802449eca5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:49.061024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45f5fa28-a2f7-4435-a460-2b802449eca5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:49.061491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45f5fa28-a2f7-4435-a460-2b802449eca5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:49.062637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45f5fa28-a2f7-4435-a460-2b802449eca5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:49.063096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45f5fa28-a2f7-4435-a460-2b802449eca5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:49.066039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3d17dff1-6591-4401-ac36-3c98be721484 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:49.078493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3d17dff1-6591-4401-ac36-3c98be721484 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:49.080224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3d17dff1-6591-4401-ac36-3c98be721484 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:49.081523 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d17dff1-6591-4401-ac36-3c98be721484 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1587 microversion: 2.32 time: 0.141945 Jan 22 21:17:49.082088 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2640/5526] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:48 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1587 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:49.108621 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-45f5fa28-a2f7-4435-a460-2b802449eca5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.060196 Jan 22 21:17:49.110104 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2887/5527] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:49 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:17:49.272692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4cd1234e-9e65-4911-9cab-919b4d265bc3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:49.273314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4cd1234e-9e65-4911-9cab-919b4d265bc3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:49.288631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4cd1234e-9e65-4911-9cab-919b4d265bc3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:49.289097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4cd1234e-9e65-4911-9cab-919b4d265bc3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:49.290135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4cd1234e-9e65-4911-9cab-919b4d265bc3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:49.291996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4cd1234e-9e65-4911-9cab-919b4d265bc3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:49.393969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-44cedda5-a3a1-4d99-9f01-7860ff0cb3e0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:49.394895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-44cedda5-a3a1-4d99-9f01-7860ff0cb3e0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:49.402727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44cedda5-a3a1-4d99-9f01-7860ff0cb3e0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:49.403437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44cedda5-a3a1-4d99-9f01-7860ff0cb3e0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:49.404495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44cedda5-a3a1-4d99-9f01-7860ff0cb3e0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:49.405272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44cedda5-a3a1-4d99-9f01-7860ff0cb3e0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:49.561749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4cd1234e-9e65-4911-9cab-919b4d265bc3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:49.578005 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4cd1234e-9e65-4911-9cab-919b4d265bc3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1693 microversion: 2.1 time: 0.309002 Jan 22 21:17:49.578593 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2641/5528] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:49 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1693 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:49.599641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-88ddf4a3-cb44-4148-8b17-274276d4b6c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:49.600443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-88ddf4a3-cb44-4148-8b17-274276d4b6c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:49.607043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88ddf4a3-cb44-4148-8b17-274276d4b6c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:49.607753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88ddf4a3-cb44-4148-8b17-274276d4b6c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:49.608550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88ddf4a3-cb44-4148-8b17-274276d4b6c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:49.608988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88ddf4a3-cb44-4148-8b17-274276d4b6c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:49.768195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-44cedda5-a3a1-4d99-9f01-7860ff0cb3e0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:49.779500 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-44cedda5-a3a1-4d99-9f01-7860ff0cb3e0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1319 microversion: 2.1 time: 0.395256 Jan 22 21:17:49.779500 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2888/5529] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:49 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:49.838167 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-88ddf4a3-cb44-4148-8b17-274276d4b6c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1/action" status: 204 len: 0 microversion: 2.1 time: 0.241934 Jan 22 21:17:49.839554 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2642/5530] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:49 2022] POST /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1/action => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:17:49.848908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1a2af3fa-04d3-49f7-a8ab-efee768cc78e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:49.850239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1a2af3fa-04d3-49f7-a8ab-efee768cc78e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:49.859848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a2af3fa-04d3-49f7-a8ab-efee768cc78e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:49.862133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a2af3fa-04d3-49f7-a8ab-efee768cc78e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:49.864630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a2af3fa-04d3-49f7-a8ab-efee768cc78e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:49.865812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a2af3fa-04d3-49f7-a8ab-efee768cc78e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:50.103619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ecc40460-cb03-4f05-8477-f21f5b23cf5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:50.104388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ecc40460-cb03-4f05-8477-f21f5b23cf5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:50.118722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecc40460-cb03-4f05-8477-f21f5b23cf5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:50.121073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecc40460-cb03-4f05-8477-f21f5b23cf5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:50.124972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecc40460-cb03-4f05-8477-f21f5b23cf5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:50.127237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecc40460-cb03-4f05-8477-f21f5b23cf5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:50.233687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1a2af3fa-04d3-49f7-a8ab-efee768cc78e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:50.252033 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1a2af3fa-04d3-49f7-a8ab-efee768cc78e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1693 microversion: 2.1 time: 0.407184 Jan 22 21:17:50.252985 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2889/5531] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:49 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1693 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:17:50.270570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-658977c3-f828-4317-8fff-596891f96c0a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:50.271831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-658977c3-f828-4317-8fff-596891f96c0a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:50.280167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-658977c3-f828-4317-8fff-596891f96c0a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:50.280942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-658977c3-f828-4317-8fff-596891f96c0a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:50.282070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-658977c3-f828-4317-8fff-596891f96c0a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:50.282917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-658977c3-f828-4317-8fff-596891f96c0a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:50.337894 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-658977c3-f828-4317-8fff-596891f96c0a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.073199 Jan 22 21:17:50.338662 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2890/5532] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:50 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:50.591123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ecc40460-cb03-4f05-8477-f21f5b23cf5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:50.606714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ecc40460-cb03-4f05-8477-f21f5b23cf5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:50.610733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ecc40460-cb03-4f05-8477-f21f5b23cf5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:50.613385 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ecc40460-cb03-4f05-8477-f21f5b23cf5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1664 microversion: 2.32 time: 0.515549 Jan 22 21:17:50.617226 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2643/5533] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:50 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1664 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:50.794793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f9e2424-e97a-42a6-b72f-61d71ae18f1f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:50.795510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8f9e2424-e97a-42a6-b72f-61d71ae18f1f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:50.811311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f9e2424-e97a-42a6-b72f-61d71ae18f1f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:50.812094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f9e2424-e97a-42a6-b72f-61d71ae18f1f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:50.822632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f9e2424-e97a-42a6-b72f-61d71ae18f1f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:50.823992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f9e2424-e97a-42a6-b72f-61d71ae18f1f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:51.021440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8f9e2424-e97a-42a6-b72f-61d71ae18f1f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:51.036494 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8f9e2424-e97a-42a6-b72f-61d71ae18f1f tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1506 microversion: 2.1 time: 0.245707 Jan 22 21:17:51.040330 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2891/5534] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:50 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:51.059679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4773f49b-0a00-4f53-9611-26dece6c8ea5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:51.067649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4773f49b-0a00-4f53-9611-26dece6c8ea5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:51.071798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4773f49b-0a00-4f53-9611-26dece6c8ea5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:51.110064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4773f49b-0a00-4f53-9611-26dece6c8ea5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Going to try to stop instance {{(pid=137033) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 22 21:17:51.271618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a97a230-7e59-43f7-a23c-e2e36cf375ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:51.272262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a97a230-7e59-43f7-a23c-e2e36cf375ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:51.280836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a97a230-7e59-43f7-a23c-e2e36cf375ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:51.281057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a97a230-7e59-43f7-a23c-e2e36cf375ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:51.283367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a97a230-7e59-43f7-a23c-e2e36cf375ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:51.283833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a97a230-7e59-43f7-a23c-e2e36cf375ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:51.395102 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4773f49b-0a00-4f53-9611-26dece6c8ea5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "POST /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62/action" status: 202 len: 0 microversion: 2.1 time: 0.339016 Jan 22 21:17:51.395723 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2644/5535] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:51 2022] POST /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:17:51.404571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4fecb557-d05b-46df-b787-c539e558777f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:51.406008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4fecb557-d05b-46df-b787-c539e558777f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:51.428255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fecb557-d05b-46df-b787-c539e558777f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:51.428714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fecb557-d05b-46df-b787-c539e558777f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:51.429548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fecb557-d05b-46df-b787-c539e558777f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:51.429989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fecb557-d05b-46df-b787-c539e558777f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:51.498702 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4fecb557-d05b-46df-b787-c539e558777f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.100082 Jan 22 21:17:51.501761 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2645/5536] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:51 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:51.514526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-97ba858c-ad6f-411f-91fd-380362d0d16d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:51.517865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-97ba858c-ad6f-411f-91fd-380362d0d16d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:51.529617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97ba858c-ad6f-411f-91fd-380362d0d16d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:51.530266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97ba858c-ad6f-411f-91fd-380362d0d16d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:51.531412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97ba858c-ad6f-411f-91fd-380362d0d16d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:51.533162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97ba858c-ad6f-411f-91fd-380362d0d16d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:51.596227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6a97a230-7e59-43f7-a23c-e2e36cf375ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:51.618073 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a97a230-7e59-43f7-a23c-e2e36cf375ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1693 microversion: 2.1 time: 0.351534 Jan 22 21:17:51.633693 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2892/5537] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:51 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1693 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:17:51.647093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6e149395-3d1a-4de7-b89b-5d9a5081a547 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:51.649075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6e149395-3d1a-4de7-b89b-5d9a5081a547 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:51.663491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e149395-3d1a-4de7-b89b-5d9a5081a547 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:51.664299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e149395-3d1a-4de7-b89b-5d9a5081a547 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:51.665296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e149395-3d1a-4de7-b89b-5d9a5081a547 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:51.666973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e149395-3d1a-4de7-b89b-5d9a5081a547 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:51.906105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6e149395-3d1a-4de7-b89b-5d9a5081a547 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:51.923334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6e149395-3d1a-4de7-b89b-5d9a5081a547 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:51.925354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6e149395-3d1a-4de7-b89b-5d9a5081a547 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:51.926731 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6e149395-3d1a-4de7-b89b-5d9a5081a547 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1664 microversion: 2.32 time: 0.291623 Jan 22 21:17:51.927732 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2893/5538] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:51 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1664 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:52.103687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-97ba858c-ad6f-411f-91fd-380362d0d16d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:52.113726 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-97ba858c-ad6f-411f-91fd-380362d0d16d tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.609385 Jan 22 21:17:52.115466 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2646/5539] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:51 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:52.277251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-22540701-8732-42a9-82a1-c2e1cca5547b req-a1d86a1c-92b9-4650-bcd3-7613d20ba78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdde4f64-417f-4c19-ac24-3250a9619db1", "name": "network-vif-plugged", "status": "completed", "tag": "a1a87111-ee94-490d-8f2e-69e60e3d6517"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:52.279511 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:17:52.279511 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:17:52.296366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-22540701-8732-42a9-82a1-c2e1cca5547b req-a1d86a1c-92b9-4650-bcd3-7613d20ba78b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:52.297142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-22540701-8732-42a9-82a1-c2e1cca5547b req-a1d86a1c-92b9-4650-bcd3-7613d20ba78b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:52.329093 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-22540701-8732-42a9-82a1-c2e1cca5547b req-a1d86a1c-92b9-4650-bcd3-7613d20ba78b service nova] Creating event network-vif-plugged:a1a87111-ee94-490d-8f2e-69e60e3d6517 for instance cdde4f64-417f-4c19-ac24-3250a9619db1 on nch1-master-1 Jan 22 21:17:52.337252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-22540701-8732-42a9-82a1-c2e1cca5547b req-a1d86a1c-92b9-4650-bcd3-7613d20ba78b service nova] Instance cdde4f64-417f-4c19-ac24-3250a9619db1 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:17:52.350311 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-22540701-8732-42a9-82a1-c2e1cca5547b req-a1d86a1c-92b9-4650-bcd3-7613d20ba78b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076877 Jan 22 21:17:52.351680 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2894/5540] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:17:52.512762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0a86dfa4-744a-43cd-9ff9-d106a2e1bec9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:52.513801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0a86dfa4-744a-43cd-9ff9-d106a2e1bec9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:52.537003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a86dfa4-744a-43cd-9ff9-d106a2e1bec9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:52.538875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a86dfa4-744a-43cd-9ff9-d106a2e1bec9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:52.539761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a86dfa4-744a-43cd-9ff9-d106a2e1bec9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:52.540211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a86dfa4-744a-43cd-9ff9-d106a2e1bec9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:52.603191 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0a86dfa4-744a-43cd-9ff9-d106a2e1bec9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.094346 Jan 22 21:17:52.604629 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2647/5541] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:52 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:52.639046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0920ed52-8386-4048-b337-95a9f99b88e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:52.640141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0920ed52-8386-4048-b337-95a9f99b88e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:52.649199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0920ed52-8386-4048-b337-95a9f99b88e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:52.649923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0920ed52-8386-4048-b337-95a9f99b88e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:52.651034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0920ed52-8386-4048-b337-95a9f99b88e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:52.651995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0920ed52-8386-4048-b337-95a9f99b88e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:52.943346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0920ed52-8386-4048-b337-95a9f99b88e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:52.946921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-95304589-d65a-43a2-9b96-2b7a2b468cd0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:52.948064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-95304589-d65a-43a2-9b96-2b7a2b468cd0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:52.950949 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0920ed52-8386-4048-b337-95a9f99b88e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1693 microversion: 2.1 time: 0.317186 Jan 22 21:17:52.951548 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2895/5542] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:52 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1693 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:52.956451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95304589-d65a-43a2-9b96-2b7a2b468cd0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:52.957025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95304589-d65a-43a2-9b96-2b7a2b468cd0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:52.957995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95304589-d65a-43a2-9b96-2b7a2b468cd0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:52.958566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95304589-d65a-43a2-9b96-2b7a2b468cd0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:53.132319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-704c57f9-ee19-4fad-a560-afdcb34fa674 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:53.133229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-704c57f9-ee19-4fad-a560-afdcb34fa674 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:53.140727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-704c57f9-ee19-4fad-a560-afdcb34fa674 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:53.142304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-704c57f9-ee19-4fad-a560-afdcb34fa674 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:53.143647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-704c57f9-ee19-4fad-a560-afdcb34fa674 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:53.144347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-704c57f9-ee19-4fad-a560-afdcb34fa674 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:53.489966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-704c57f9-ee19-4fad-a560-afdcb34fa674 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:53.491570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-95304589-d65a-43a2-9b96-2b7a2b468cd0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:53.503403 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-704c57f9-ee19-4fad-a560-afdcb34fa674 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.374426 Jan 22 21:17:53.504193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-95304589-d65a-43a2-9b96-2b7a2b468cd0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:53.505011 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2896/5543] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:53 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:53.506214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-95304589-d65a-43a2-9b96-2b7a2b468cd0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:53.518937 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-95304589-d65a-43a2-9b96-2b7a2b468cd0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1710 microversion: 2.32 time: 0.565090 Jan 22 21:17:53.518937 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2648/5544] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:52 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1710 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:53.623066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-90a5c92b-e4fe-4867-94a7-9d0392de107a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:53.623066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-90a5c92b-e4fe-4867-94a7-9d0392de107a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:53.627356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90a5c92b-e4fe-4867-94a7-9d0392de107a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:53.628037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90a5c92b-e4fe-4867-94a7-9d0392de107a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:53.629063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90a5c92b-e4fe-4867-94a7-9d0392de107a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:53.629724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90a5c92b-e4fe-4867-94a7-9d0392de107a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:53.705689 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-90a5c92b-e4fe-4867-94a7-9d0392de107a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.089022 Jan 22 21:17:53.710420 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2897/5545] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:53 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:17:53.968428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-91ca36e7-6a6d-41a9-9205-89cec14b2828 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:53.969341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-91ca36e7-6a6d-41a9-9205-89cec14b2828 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:53.977996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91ca36e7-6a6d-41a9-9205-89cec14b2828 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:53.984614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91ca36e7-6a6d-41a9-9205-89cec14b2828 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:53.984614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91ca36e7-6a6d-41a9-9205-89cec14b2828 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:53.984614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91ca36e7-6a6d-41a9-9205-89cec14b2828 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:54.524134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-07afd1fa-c923-4515-9b9f-331a2a57782e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:54.525086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-07afd1fa-c923-4515-9b9f-331a2a57782e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:54.539251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07afd1fa-c923-4515-9b9f-331a2a57782e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:54.539251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07afd1fa-c923-4515-9b9f-331a2a57782e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:54.539251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07afd1fa-c923-4515-9b9f-331a2a57782e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:54.539251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07afd1fa-c923-4515-9b9f-331a2a57782e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:54.778668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-91ca36e7-6a6d-41a9-9205-89cec14b2828 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:54.802203 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-91ca36e7-6a6d-41a9-9205-89cec14b2828 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1685 microversion: 2.1 time: 0.837721 Jan 22 21:17:54.803583 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2649/5546] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:53 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1685 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:54.809132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2b19d55a-7816-4850-88a2-222cb2949a69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:54.809984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2b19d55a-7816-4850-88a2-222cb2949a69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:54.823488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b19d55a-7816-4850-88a2-222cb2949a69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:54.823950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b19d55a-7816-4850-88a2-222cb2949a69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:54.824759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b19d55a-7816-4850-88a2-222cb2949a69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:54.825334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b19d55a-7816-4850-88a2-222cb2949a69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:54.910368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-07afd1fa-c923-4515-9b9f-331a2a57782e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:54.921399 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-07afd1fa-c923-4515-9b9f-331a2a57782e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.404703 Jan 22 21:17:54.933152 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2898/5547] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:54 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:17:54.933445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-86b95cca-ddab-4ec4-9858-df4aa9e5bea9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:54.935486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-86b95cca-ddab-4ec4-9858-df4aa9e5bea9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:54.942374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86b95cca-ddab-4ec4-9858-df4aa9e5bea9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:54.942845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86b95cca-ddab-4ec4-9858-df4aa9e5bea9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:54.943873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86b95cca-ddab-4ec4-9858-df4aa9e5bea9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:54.944517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86b95cca-ddab-4ec4-9858-df4aa9e5bea9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:55.007424 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-86b95cca-ddab-4ec4-9858-df4aa9e5bea9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.079242 Jan 22 21:17:55.009461 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2899/5548] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:54 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:55.226736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2b19d55a-7816-4850-88a2-222cb2949a69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:55.235973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2b19d55a-7816-4850-88a2-222cb2949a69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:55.237781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2b19d55a-7816-4850-88a2-222cb2949a69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:55.239844 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2b19d55a-7816-4850-88a2-222cb2949a69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1756 microversion: 2.32 time: 0.435136 Jan 22 21:17:55.251969 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2650/5549] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:54 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1756 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:55.942389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-422f6086-5a3b-4ac2-b8e9-38e77b68a828 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:55.948262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-422f6086-5a3b-4ac2-b8e9-38e77b68a828 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:55.957172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-422f6086-5a3b-4ac2-b8e9-38e77b68a828 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:55.957899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-422f6086-5a3b-4ac2-b8e9-38e77b68a828 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:55.958726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-422f6086-5a3b-4ac2-b8e9-38e77b68a828 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:55.959351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-422f6086-5a3b-4ac2-b8e9-38e77b68a828 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:56.021363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-317f4160-8a6c-455c-a607-39aa83e13aa6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:56.022382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-317f4160-8a6c-455c-a607-39aa83e13aa6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:56.036495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-317f4160-8a6c-455c-a607-39aa83e13aa6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:56.036962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-317f4160-8a6c-455c-a607-39aa83e13aa6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:56.040419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-317f4160-8a6c-455c-a607-39aa83e13aa6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:56.043876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-317f4160-8a6c-455c-a607-39aa83e13aa6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:56.124222 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-317f4160-8a6c-455c-a607-39aa83e13aa6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.107428 Jan 22 21:17:56.125736 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2651/5550] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:56 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:17:56.208978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-422f6086-5a3b-4ac2-b8e9-38e77b68a828 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:56.218251 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-422f6086-5a3b-4ac2-b8e9-38e77b68a828 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.280842 Jan 22 21:17:56.226317 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2900/5551] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:55 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:56.260906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a121861a-a7b5-4842-8fb5-6f7e5967b6b1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:56.261730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a121861a-a7b5-4842-8fb5-6f7e5967b6b1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:56.275568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a121861a-a7b5-4842-8fb5-6f7e5967b6b1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:56.275991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a121861a-a7b5-4842-8fb5-6f7e5967b6b1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:56.277110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a121861a-a7b5-4842-8fb5-6f7e5967b6b1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:56.277829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a121861a-a7b5-4842-8fb5-6f7e5967b6b1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:56.439598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cc93bd8b-37cf-4fc0-8f3b-c3286b5161e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:56.445407 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:17:56.445407 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:17:56.447949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cc93bd8b-37cf-4fc0-8f3b-c3286b5161e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:56.449386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cc93bd8b-37cf-4fc0-8f3b-c3286b5161e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Searching by: {'deleted': False, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:17:56.457052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc93bd8b-37cf-4fc0-8f3b-c3286b5161e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:56.458509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc93bd8b-37cf-4fc0-8f3b-c3286b5161e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:56.459907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc93bd8b-37cf-4fc0-8f3b-c3286b5161e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:56.460573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc93bd8b-37cf-4fc0-8f3b-c3286b5161e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:56.477120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a121861a-a7b5-4842-8fb5-6f7e5967b6b1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:56.488464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a121861a-a7b5-4842-8fb5-6f7e5967b6b1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:56.491218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a121861a-a7b5-4842-8fb5-6f7e5967b6b1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:56.497799 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a121861a-a7b5-4842-8fb5-6f7e5967b6b1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1744 microversion: 2.32 time: 0.235732 Jan 22 21:17:56.497799 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2901/5552] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:56 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1744 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:17:56.505389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-cc93bd8b-37cf-4fc0-8f3b-c3286b5161e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:17:56.537819 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cc93bd8b-37cf-4fc0-8f3b-c3286b5161e3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.410196 Jan 22 21:17:56.538446 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2652/5553] 10.222.0.100 () {58 vars in 1129 bytes} [Sat Jan 22 21:17:56 2022] GET /compute/v2.1/servers => generated 345 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:17:56.551224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d2bbb91b-2658-49de-8d08-b2fde1fe2070 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:56.555284 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:17:56.555284 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:17:56.556776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d2bbb91b-2658-49de-8d08-b2fde1fe2070 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:56.557802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d2bbb91b-2658-49de-8d08-b2fde1fe2070 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Searching by: {'deleted': False, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:17:56.565114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2bbb91b-2658-49de-8d08-b2fde1fe2070 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:56.565608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2bbb91b-2658-49de-8d08-b2fde1fe2070 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:56.566443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2bbb91b-2658-49de-8d08-b2fde1fe2070 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:56.566896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2bbb91b-2658-49de-8d08-b2fde1fe2070 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:56.597217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-d2bbb91b-2658-49de-8d08-b2fde1fe2070 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:17:56.652927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d2bbb91b-2658-49de-8d08-b2fde1fe2070 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:56.660721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2bbb91b-2658-49de-8d08-b2fde1fe2070 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:56.661188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2bbb91b-2658-49de-8d08-b2fde1fe2070 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:57.039445 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d2bbb91b-2658-49de-8d08-b2fde1fe2070 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/detail" status: 200 len: 1609 microversion: 2.1 time: 0.493236 Jan 22 21:17:57.040397 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2902/5554] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:17:56 2022] GET /compute/v2.1/servers/detail => generated 1609 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:57.060252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5808d308-6f88-48a8-b62a-425ddd1e4e0b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:57.076676 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5808d308-6f88-48a8-b62a-425ddd1e4e0b tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.014209 Jan 22 21:17:57.077347 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2653/5555] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:17:57 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:17:57.137825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2a6a2007-647c-4b63-9bbd-42381a354a27 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:57.139345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2a6a2007-647c-4b63-9bbd-42381a354a27 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:57.148165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a6a2007-647c-4b63-9bbd-42381a354a27 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:57.149310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a6a2007-647c-4b63-9bbd-42381a354a27 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:57.154489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a6a2007-647c-4b63-9bbd-42381a354a27 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:57.154489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a6a2007-647c-4b63-9bbd-42381a354a27 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:57.242766 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2a6a2007-647c-4b63-9bbd-42381a354a27 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.109796 Jan 22 21:17:57.243445 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2903/5556] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:57 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:57.252806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0a95b3ef-93a1-4625-8ace-fc3b9e42bee2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:57.253677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0a95b3ef-93a1-4625-8ace-fc3b9e42bee2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:57.270006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a95b3ef-93a1-4625-8ace-fc3b9e42bee2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:57.276959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a95b3ef-93a1-4625-8ace-fc3b9e42bee2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:57.283800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a95b3ef-93a1-4625-8ace-fc3b9e42bee2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:57.284510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a95b3ef-93a1-4625-8ace-fc3b9e42bee2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:57.368975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a8943be6-08b2-4c95-ab4a-367b0fad2949 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:57.370113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a8943be6-08b2-4c95-ab4a-367b0fad2949 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:57.378211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8943be6-08b2-4c95-ab4a-367b0fad2949 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:57.379533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8943be6-08b2-4c95-ab4a-367b0fad2949 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:57.380522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8943be6-08b2-4c95-ab4a-367b0fad2949 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:57.381132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8943be6-08b2-4c95-ab4a-367b0fad2949 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:57.425673 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a8943be6-08b2-4c95-ab4a-367b0fad2949 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/os-volume_attachments/df46cbf4-ba70-4e61-b51d-9f2a257ff669" status: 200 len: 194 microversion: 2.20 time: 0.272562 Jan 22 21:17:57.426576 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2654/5557] 10.222.0.100 () {60 vars in 1458 bytes} [Sat Jan 22 21:17:57 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/os-volume_attachments/df46cbf4-ba70-4e61-b51d-9f2a257ff669 => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:17:57.432703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:57.433639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:57.443372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:57.447987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:57.447987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:57.447987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:57.483467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:17:57.621250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0a95b3ef-93a1-4625-8ace-fc3b9e42bee2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:57.634705 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0a95b3ef-93a1-4625-8ace-fc3b9e42bee2 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.389614 Jan 22 21:17:57.648884 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2904/5558] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:57 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:57.656674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7e2db72b-e2f9-4d54-9d72-e62baa8775e1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:57.657821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7e2db72b-e2f9-4d54-9d72-e62baa8775e1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:57.666764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e2db72b-e2f9-4d54-9d72-e62baa8775e1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:57.668138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e2db72b-e2f9-4d54-9d72-e62baa8775e1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:57.671235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e2db72b-e2f9-4d54-9d72-e62baa8775e1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:57.671981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e2db72b-e2f9-4d54-9d72-e62baa8775e1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:57.857646 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-39d6ea96-4cfd-44a7-a4b9-712bc8f446fe tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 204 len: 0 microversion: 2.1 time: 0.423522 Jan 22 21:17:57.857646 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2655/5559] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:17:57 2022] DELETE /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:17:57.866946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0c0fd4f2-b199-4cd9-a205-9ea569286a31 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:57.868061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0c0fd4f2-b199-4cd9-a205-9ea569286a31 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:57.880590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c0fd4f2-b199-4cd9-a205-9ea569286a31 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:57.881394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c0fd4f2-b199-4cd9-a205-9ea569286a31 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:57.882475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c0fd4f2-b199-4cd9-a205-9ea569286a31 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:57.883748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c0fd4f2-b199-4cd9-a205-9ea569286a31 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:58.092559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-0c0fd4f2-b199-4cd9-a205-9ea569286a31 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lazy-loading 'services' on Instance uuid 8288fe26-7e9c-451c-a9a2-222abbcf201e {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:17:58.184665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7e2db72b-e2f9-4d54-9d72-e62baa8775e1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:58.196900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7e2db72b-e2f9-4d54-9d72-e62baa8775e1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:58.198778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7e2db72b-e2f9-4d54-9d72-e62baa8775e1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:58.201085 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7e2db72b-e2f9-4d54-9d72-e62baa8775e1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1790 microversion: 2.32 time: 0.550833 Jan 22 21:17:58.211569 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2905/5560] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:57 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1790 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:17:58.216769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ed6698eb-a63d-44e6-8aad-610205d750be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:58.221463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ed6698eb-a63d-44e6-8aad-610205d750be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:58.236148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed6698eb-a63d-44e6-8aad-610205d750be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:58.236653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed6698eb-a63d-44e6-8aad-610205d750be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:58.237748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed6698eb-a63d-44e6-8aad-610205d750be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:58.238207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed6698eb-a63d-44e6-8aad-610205d750be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:58.424669 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0c0fd4f2-b199-4cd9-a205-9ea569286a31 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/os-volume_attachments/df46cbf4-ba70-4e61-b51d-9f2a257ff669" status: 202 len: 0 microversion: 2.20 time: 0.566906 Jan 22 21:17:58.424669 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2656/5561] 10.222.0.100 () {60 vars in 1461 bytes} [Sat Jan 22 21:17:57 2022] DELETE /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/os-volume_attachments/df46cbf4-ba70-4e61-b51d-9f2a257ff669 => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:17:58.430980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fedeb207-b12d-4e99-8450-c21a9aae0239 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:58.432476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fedeb207-b12d-4e99-8450-c21a9aae0239 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:58.441046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fedeb207-b12d-4e99-8450-c21a9aae0239 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:58.442003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fedeb207-b12d-4e99-8450-c21a9aae0239 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:58.443049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fedeb207-b12d-4e99-8450-c21a9aae0239 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:58.443712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fedeb207-b12d-4e99-8450-c21a9aae0239 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:58.490133 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fedeb207-b12d-4e99-8450-c21a9aae0239 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.063790 Jan 22 21:17:58.496340 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2657/5562] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:58 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:58.503236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d6451ac3-ee6d-4ead-a3dd-b8a02281b20d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:58.505724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d6451ac3-ee6d-4ead-a3dd-b8a02281b20d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:58.512906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6451ac3-ee6d-4ead-a3dd-b8a02281b20d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:58.513753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6451ac3-ee6d-4ead-a3dd-b8a02281b20d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:58.514807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6451ac3-ee6d-4ead-a3dd-b8a02281b20d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:58.515415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d6451ac3-ee6d-4ead-a3dd-b8a02281b20d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:58.562231 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d6451ac3-ee6d-4ead-a3dd-b8a02281b20d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063201 Jan 22 21:17:58.564907 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2658/5563] 10.222.0.100 () {60 vars in 1347 bytes} [Sat Jan 22 21:17:58 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:58.654912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b53b05f6-f58a-482b-a861-17979ed91db9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:58.655839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b53b05f6-f58a-482b-a861-17979ed91db9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:58.665297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b53b05f6-f58a-482b-a861-17979ed91db9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:58.671599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b53b05f6-f58a-482b-a861-17979ed91db9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:58.671599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b53b05f6-f58a-482b-a861-17979ed91db9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:58.671599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b53b05f6-f58a-482b-a861-17979ed91db9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:58.684815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed6698eb-a63d-44e6-8aad-610205d750be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:58.699499 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ed6698eb-a63d-44e6-8aad-610205d750be tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1612 microversion: 2.1 time: 0.486586 Jan 22 21:17:58.700846 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2906/5564] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:58 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1612 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:59.234796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fd9a268d-d29c-4452-84e5-140858d7ee54 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:59.234796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fd9a268d-d29c-4452-84e5-140858d7ee54 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:59.247365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd9a268d-d29c-4452-84e5-140858d7ee54 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:59.247365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd9a268d-d29c-4452-84e5-140858d7ee54 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:59.247365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd9a268d-d29c-4452-84e5-140858d7ee54 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:59.247365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd9a268d-d29c-4452-84e5-140858d7ee54 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:59.292910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b53b05f6-f58a-482b-a861-17979ed91db9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:59.301968 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b53b05f6-f58a-482b-a861-17979ed91db9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.653324 Jan 22 21:17:59.306124 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2659/5565] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:58 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:59.503873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4de8c58-32ef-4f3f-8a06-d0279ae2f477 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:17:59.505340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c4de8c58-32ef-4f3f-8a06-d0279ae2f477 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:59.521434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4de8c58-32ef-4f3f-8a06-d0279ae2f477 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:59.522161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4de8c58-32ef-4f3f-8a06-d0279ae2f477 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:59.523323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4de8c58-32ef-4f3f-8a06-d0279ae2f477 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:59.526005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4de8c58-32ef-4f3f-8a06-d0279ae2f477 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:59.587734 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c4de8c58-32ef-4f3f-8a06-d0279ae2f477 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.087209 Jan 22 21:17:59.588387 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2660/5566] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:17:59 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:17:59.593548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c0b4f47a-f617-43a5-95ae-8d759fde9694 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:59.595124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c0b4f47a-f617-43a5-95ae-8d759fde9694 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:59.605909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0b4f47a-f617-43a5-95ae-8d759fde9694 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:59.606673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0b4f47a-f617-43a5-95ae-8d759fde9694 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:59.607513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0b4f47a-f617-43a5-95ae-8d759fde9694 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:59.608150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0b4f47a-f617-43a5-95ae-8d759fde9694 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:59.651424 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c0b4f47a-f617-43a5-95ae-8d759fde9694 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061605 Jan 22 21:17:59.652715 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2661/5567] 10.222.0.100 () {60 vars in 1347 bytes} [Sat Jan 22 21:17:59 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:17:59.723180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9658c8a7-c2af-4687-b722-fe16635a4300 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:59.724306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9658c8a7-c2af-4687-b722-fe16635a4300 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:59.737023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9658c8a7-c2af-4687-b722-fe16635a4300 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:59.737917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9658c8a7-c2af-4687-b722-fe16635a4300 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:59.740184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9658c8a7-c2af-4687-b722-fe16635a4300 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:59.741753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9658c8a7-c2af-4687-b722-fe16635a4300 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:59.781133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fd9a268d-d29c-4452-84e5-140858d7ee54 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:59.801274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fd9a268d-d29c-4452-84e5-140858d7ee54 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:59.807673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fd9a268d-d29c-4452-84e5-140858d7ee54 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:17:59.811042 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fd9a268d-d29c-4452-84e5-140858d7ee54 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1836 microversion: 2.32 time: 0.580850 Jan 22 21:17:59.817937 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2907/5568] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:17:59 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1836 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:17:59.824419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-11bfe6b6-2bf1-4ea8-8ec1-0cd576dd73ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:17:59.829267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-11bfe6b6-2bf1-4ea8-8ec1-0cd576dd73ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:17:59.837003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11bfe6b6-2bf1-4ea8-8ec1-0cd576dd73ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:59.838398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11bfe6b6-2bf1-4ea8-8ec1-0cd576dd73ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:59.840809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11bfe6b6-2bf1-4ea8-8ec1-0cd576dd73ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:17:59.842063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11bfe6b6-2bf1-4ea8-8ec1-0cd576dd73ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:17:59.893730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-11bfe6b6-2bf1-4ea8-8ec1-0cd576dd73ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:18:00.230533 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-11bfe6b6-2bf1-4ea8-8ec1-0cd576dd73ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 204 len: 0 microversion: 2.20 time: 0.410654 Jan 22 21:18:00.231666 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2908/5569] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:17:59 2022] DELETE /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:18:00.244083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7d0753ed-2049-4afe-9bae-e7074ba8dfde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:00.244898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7d0753ed-2049-4afe-9bae-e7074ba8dfde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:00.270364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d0753ed-2049-4afe-9bae-e7074ba8dfde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:00.272736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d0753ed-2049-4afe-9bae-e7074ba8dfde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:00.274685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d0753ed-2049-4afe-9bae-e7074ba8dfde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:00.276017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d0753ed-2049-4afe-9bae-e7074ba8dfde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:00.605355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9658c8a7-c2af-4687-b722-fe16635a4300 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:00.614542 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9658c8a7-c2af-4687-b722-fe16635a4300 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1612 microversion: 2.1 time: 0.896769 Jan 22 21:18:00.615129 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2662/5570] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:17:59 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1612 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:18:00.623593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c3ec7445-ae5c-47e8-b742-6bf689d628ab tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:00.630737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7d0753ed-2049-4afe-9bae-e7074ba8dfde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:00.635992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c3ec7445-ae5c-47e8-b742-6bf689d628ab tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:00.642426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3ec7445-ae5c-47e8-b742-6bf689d628ab tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:00.642887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3ec7445-ae5c-47e8-b742-6bf689d628ab tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:00.643682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3ec7445-ae5c-47e8-b742-6bf689d628ab tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:00.644036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7d0753ed-2049-4afe-9bae-e7074ba8dfde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:00.644191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3ec7445-ae5c-47e8-b742-6bf689d628ab tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:00.645987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7d0753ed-2049-4afe-9bae-e7074ba8dfde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:00.647215 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7d0753ed-2049-4afe-9bae-e7074ba8dfde tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.410502 Jan 22 21:18:00.647788 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2909/5571] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:00 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:00.657109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-15430738-df1b-4df8-8bf1-32476688ad28 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:00.658498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-15430738-df1b-4df8-8bf1-32476688ad28 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:00.678759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15430738-df1b-4df8-8bf1-32476688ad28 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:00.679221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15430738-df1b-4df8-8bf1-32476688ad28 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:00.680239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15430738-df1b-4df8-8bf1-32476688ad28 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:00.680853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15430738-df1b-4df8-8bf1-32476688ad28 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:00.737527 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-15430738-df1b-4df8-8bf1-32476688ad28 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.084160 Jan 22 21:18:00.738603 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2910/5572] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:00 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:00.841763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-31a22426-6753-400a-9025-b0ec72efc5d3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:00.841763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-31a22426-6753-400a-9025-b0ec72efc5d3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:00.847840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31a22426-6753-400a-9025-b0ec72efc5d3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:00.848286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31a22426-6753-400a-9025-b0ec72efc5d3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:00.849310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31a22426-6753-400a-9025-b0ec72efc5d3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:00.849954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31a22426-6753-400a-9025-b0ec72efc5d3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:01.127401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c3ec7445-ae5c-47e8-b742-6bf689d628ab tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:01.144310 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c3ec7445-ae5c-47e8-b742-6bf689d628ab tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.524993 Jan 22 21:18:01.153713 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2663/5573] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:00 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:01.408447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-31a22426-6753-400a-9025-b0ec72efc5d3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:01.426101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-31a22426-6753-400a-9025-b0ec72efc5d3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:01.429145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-31a22426-6753-400a-9025-b0ec72efc5d3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:01.431426 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-31a22426-6753-400a-9025-b0ec72efc5d3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1836 microversion: 2.32 time: 0.604025 Jan 22 21:18:01.434992 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2911/5574] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:00 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1836 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:01.631371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-93b5fcbd-a672-482e-b323-140113a74496 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:01.632670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-93b5fcbd-a672-482e-b323-140113a74496 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:01.639624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93b5fcbd-a672-482e-b323-140113a74496 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:01.640350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93b5fcbd-a672-482e-b323-140113a74496 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:01.641698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93b5fcbd-a672-482e-b323-140113a74496 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:01.642319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93b5fcbd-a672-482e-b323-140113a74496 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:01.667164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-36fbab0d-6880-4950-b239-61e0b7c270ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:01.668055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-36fbab0d-6880-4950-b239-61e0b7c270ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:01.693988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36fbab0d-6880-4950-b239-61e0b7c270ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:01.694643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36fbab0d-6880-4950-b239-61e0b7c270ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:01.695649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36fbab0d-6880-4950-b239-61e0b7c270ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:01.696741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36fbab0d-6880-4950-b239-61e0b7c270ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:01.823582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-93b5fcbd-a672-482e-b323-140113a74496 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:01.832782 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-93b5fcbd-a672-482e-b323-140113a74496 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1544 microversion: 2.1 time: 0.204969 Jan 22 21:18:01.842729 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2664/5575] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:01 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1544 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:01.842729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3f7cb1ae-6ea7-4cc4-af3f-dbfb19bf1005 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:01.842729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3f7cb1ae-6ea7-4cc4-af3f-dbfb19bf1005 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:01.852281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f7cb1ae-6ea7-4cc4-af3f-dbfb19bf1005 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:01.852878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f7cb1ae-6ea7-4cc4-af3f-dbfb19bf1005 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:01.853876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f7cb1ae-6ea7-4cc4-af3f-dbfb19bf1005 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:01.854429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f7cb1ae-6ea7-4cc4-af3f-dbfb19bf1005 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:01.906868 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3f7cb1ae-6ea7-4cc4-af3f-dbfb19bf1005 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.071895 Jan 22 21:18:01.910820 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2665/5576] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:01 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:01.965769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-50e56a44-68e0-4a1c-ad96-9df92205352f req-3241c80e-ed11-422d-857c-5589d266f46f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "tag": "f1445cec-d592-4347-ab81-b946b09943fa"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:01.967450 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:01.967450 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:18:02.009917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-50e56a44-68e0-4a1c-ad96-9df92205352f req-3241c80e-ed11-422d-857c-5589d266f46f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:02.010389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-50e56a44-68e0-4a1c-ad96-9df92205352f req-3241c80e-ed11-422d-857c-5589d266f46f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:02.037402 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-50e56a44-68e0-4a1c-ad96-9df92205352f req-3241c80e-ed11-422d-857c-5589d266f46f service nova] Creating event network-changed:f1445cec-d592-4347-ab81-b946b09943fa for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:18:02.048212 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-50e56a44-68e0-4a1c-ad96-9df92205352f req-3241c80e-ed11-422d-857c-5589d266f46f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091388 Jan 22 21:18:02.048916 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2666/5577] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:18:02.077630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-36fbab0d-6880-4950-b239-61e0b7c270ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:02.090296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-36fbab0d-6880-4950-b239-61e0b7c270ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:02.091998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-36fbab0d-6880-4950-b239-61e0b7c270ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:02.098665 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-36fbab0d-6880-4950-b239-61e0b7c270ee tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.429967 Jan 22 21:18:02.098665 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2912/5578] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:01 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:02.166588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8581757a-f013-477d-9f48-8d38973eb516 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:02.167796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8581757a-f013-477d-9f48-8d38973eb516 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:02.183418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8581757a-f013-477d-9f48-8d38973eb516 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:02.184920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8581757a-f013-477d-9f48-8d38973eb516 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:02.187409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8581757a-f013-477d-9f48-8d38973eb516 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:02.190936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8581757a-f013-477d-9f48-8d38973eb516 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:02.453928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-196716e1-7318-4d9a-9f1e-18f20ae48a43 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:02.455235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-196716e1-7318-4d9a-9f1e-18f20ae48a43 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:02.463474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-196716e1-7318-4d9a-9f1e-18f20ae48a43 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:02.463950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-196716e1-7318-4d9a-9f1e-18f20ae48a43 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:02.464802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-196716e1-7318-4d9a-9f1e-18f20ae48a43 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:02.468149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-196716e1-7318-4d9a-9f1e-18f20ae48a43 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:02.776279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-196716e1-7318-4d9a-9f1e-18f20ae48a43 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:02.786537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-196716e1-7318-4d9a-9f1e-18f20ae48a43 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:02.788337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-196716e1-7318-4d9a-9f1e-18f20ae48a43 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:02.789767 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-196716e1-7318-4d9a-9f1e-18f20ae48a43 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1836 microversion: 2.32 time: 0.339856 Jan 22 21:18:02.790812 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2913/5579] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:02 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1836 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:02.850813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-270a066d-7fd2-49fe-ba1c-b71074b2bdb3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:02.851727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-270a066d-7fd2-49fe-ba1c-b71074b2bdb3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:02.858180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-270a066d-7fd2-49fe-ba1c-b71074b2bdb3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:02.858833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-270a066d-7fd2-49fe-ba1c-b71074b2bdb3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:02.861168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-270a066d-7fd2-49fe-ba1c-b71074b2bdb3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:02.862138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-270a066d-7fd2-49fe-ba1c-b71074b2bdb3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:03.049874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-270a066d-7fd2-49fe-ba1c-b71074b2bdb3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:03.059637 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-270a066d-7fd2-49fe-ba1c-b71074b2bdb3 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1544 microversion: 2.1 time: 0.212791 Jan 22 21:18:03.070656 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2914/5580] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:02 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1544 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:18:03.076991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-20fe7c39-80d1-46dd-a5ac-051cfa82bb55 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:03.078663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-20fe7c39-80d1-46dd-a5ac-051cfa82bb55 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:03.080119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8581757a-f013-477d-9f48-8d38973eb516 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:03.086437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20fe7c39-80d1-46dd-a5ac-051cfa82bb55 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:03.087216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20fe7c39-80d1-46dd-a5ac-051cfa82bb55 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:03.088149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20fe7c39-80d1-46dd-a5ac-051cfa82bb55 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:03.094649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20fe7c39-80d1-46dd-a5ac-051cfa82bb55 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:03.100697 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8581757a-f013-477d-9f48-8d38973eb516 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.940961 Jan 22 21:18:03.106459 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2667/5581] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:02 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:03.129751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e2843fe3-d229-4ed4-8ac8-12c61504017e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:03.130888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e2843fe3-d229-4ed4-8ac8-12c61504017e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:03.140697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2843fe3-d229-4ed4-8ac8-12c61504017e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:03.144641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2843fe3-d229-4ed4-8ac8-12c61504017e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:03.149397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2843fe3-d229-4ed4-8ac8-12c61504017e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:03.150002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2843fe3-d229-4ed4-8ac8-12c61504017e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:03.180749 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-20fe7c39-80d1-46dd-a5ac-051cfa82bb55 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.108149 Jan 22 21:18:03.181616 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2915/5582] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:03 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:03.743262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e2843fe3-d229-4ed4-8ac8-12c61504017e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:03.760926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e2843fe3-d229-4ed4-8ac8-12c61504017e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:03.765410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e2843fe3-d229-4ed4-8ac8-12c61504017e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:03.766516 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e2843fe3-d229-4ed4-8ac8-12c61504017e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1726 microversion: 2.20 time: 0.646357 Jan 22 21:18:03.767218 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2668/5583] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:03 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1726 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:03.809897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-52cbbef9-3f85-4f54-8ee5-368bf8c7bb3e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:03.810775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-52cbbef9-3f85-4f54-8ee5-368bf8c7bb3e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:03.827545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52cbbef9-3f85-4f54-8ee5-368bf8c7bb3e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:03.828014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52cbbef9-3f85-4f54-8ee5-368bf8c7bb3e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:03.829753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52cbbef9-3f85-4f54-8ee5-368bf8c7bb3e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:03.835074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52cbbef9-3f85-4f54-8ee5-368bf8c7bb3e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:04.078185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b20401ee-f302-4f53-8b18-6e367a218a94 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:04.079680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b20401ee-f302-4f53-8b18-6e367a218a94 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:04.088012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b20401ee-f302-4f53-8b18-6e367a218a94 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:04.089132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b20401ee-f302-4f53-8b18-6e367a218a94 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:04.090307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b20401ee-f302-4f53-8b18-6e367a218a94 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:04.090954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b20401ee-f302-4f53-8b18-6e367a218a94 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:04.186467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b20401ee-f302-4f53-8b18-6e367a218a94 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:04.202789 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b20401ee-f302-4f53-8b18-6e367a218a94 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1254 microversion: 2.1 time: 0.128855 Jan 22 21:18:04.204749 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2669/5584] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:04 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1254 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:04.219274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ed3b920f-393e-420b-9cd6-4f23058a9ff1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:04.220054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ed3b920f-393e-420b-9cd6-4f23058a9ff1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:04.221946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-52cbbef9-3f85-4f54-8ee5-368bf8c7bb3e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:04.235493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-52cbbef9-3f85-4f54-8ee5-368bf8c7bb3e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:04.238011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-52cbbef9-3f85-4f54-8ee5-368bf8c7bb3e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:04.238273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed3b920f-393e-420b-9cd6-4f23058a9ff1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:04.238863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed3b920f-393e-420b-9cd6-4f23058a9ff1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:04.239852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed3b920f-393e-420b-9cd6-4f23058a9ff1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:04.240173 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-52cbbef9-3f85-4f54-8ee5-368bf8c7bb3e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1836 microversion: 2.32 time: 0.434934 Jan 22 21:18:04.240901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed3b920f-393e-420b-9cd6-4f23058a9ff1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:04.253307 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2916/5585] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:03 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1836 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:04.258676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aa0f94b6-e26f-4879-97fb-1267fb64df9c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:04.259644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aa0f94b6-e26f-4879-97fb-1267fb64df9c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:04.268770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa0f94b6-e26f-4879-97fb-1267fb64df9c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:04.269311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa0f94b6-e26f-4879-97fb-1267fb64df9c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:04.270374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa0f94b6-e26f-4879-97fb-1267fb64df9c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:04.270989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa0f94b6-e26f-4879-97fb-1267fb64df9c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:04.352962 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aa0f94b6-e26f-4879-97fb-1267fb64df9c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.077123 Jan 22 21:18:04.352962 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2917/5586] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:04 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:04.602193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-84b4d378-4e94-44b8-9a8d-82705f948ed6 req-33567120-7074-4779-a90f-f3c75b905cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6275dd89-0924-4941-a1ab-1b37c7020f37", "name": "network-vif-deleted", "tag": "5daf99eb-9bf9-4785-80a9-5e188da8fabd"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:04.603811 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:04.603811 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:18:04.623135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-84b4d378-4e94-44b8-9a8d-82705f948ed6 req-33567120-7074-4779-a90f-f3c75b905cae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:04.624754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-84b4d378-4e94-44b8-9a8d-82705f948ed6 req-33567120-7074-4779-a90f-f3c75b905cae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:04.639210 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-84b4d378-4e94-44b8-9a8d-82705f948ed6 req-33567120-7074-4779-a90f-f3c75b905cae service nova] Creating event network-vif-deleted:5daf99eb-9bf9-4785-80a9-5e188da8fabd for instance 6275dd89-0924-4941-a1ab-1b37c7020f37 on nch2-master-1 Jan 22 21:18:04.652071 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-84b4d378-4e94-44b8-9a8d-82705f948ed6 req-33567120-7074-4779-a90f-f3c75b905cae service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061836 Jan 22 21:18:04.654819 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2918/5587] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:04.785578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e991ca50-dfb7-4cfb-9e23-822720502596 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:04.786233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e991ca50-dfb7-4cfb-9e23-822720502596 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:04.799481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e991ca50-dfb7-4cfb-9e23-822720502596 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:04.799481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e991ca50-dfb7-4cfb-9e23-822720502596 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:04.799481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e991ca50-dfb7-4cfb-9e23-822720502596 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:04.799921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e991ca50-dfb7-4cfb-9e23-822720502596 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:04.891288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ed3b920f-393e-420b-9cd6-4f23058a9ff1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:04.917813 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ed3b920f-393e-420b-9cd6-4f23058a9ff1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.711411 Jan 22 21:18:04.931017 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2670/5588] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:04 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:04.945833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e991ca50-dfb7-4cfb-9e23-822720502596 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:04.956498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e991ca50-dfb7-4cfb-9e23-822720502596 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:04.958137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e991ca50-dfb7-4cfb-9e23-822720502596 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:04.959483 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e991ca50-dfb7-4cfb-9e23-822720502596 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1659 microversion: 2.20 time: 0.178781 Jan 22 21:18:04.978574 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2919/5589] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:04 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1659 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:05.254812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ef0eaad9-80c9-46b9-909d-923656109bd4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:05.255470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ef0eaad9-80c9-46b9-909d-923656109bd4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:05.258752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1a01d723-b5b4-4820-9654-a65fd2299cd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:05.259372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1a01d723-b5b4-4820-9654-a65fd2299cd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:05.286868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef0eaad9-80c9-46b9-909d-923656109bd4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:05.288557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef0eaad9-80c9-46b9-909d-923656109bd4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:05.289590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a01d723-b5b4-4820-9654-a65fd2299cd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:05.290271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a01d723-b5b4-4820-9654-a65fd2299cd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:05.290864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef0eaad9-80c9-46b9-909d-923656109bd4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:05.291321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef0eaad9-80c9-46b9-909d-923656109bd4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:05.296040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a01d723-b5b4-4820-9654-a65fd2299cd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:05.296753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a01d723-b5b4-4820-9654-a65fd2299cd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:05.379083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef0eaad9-80c9-46b9-909d-923656109bd4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:05.383761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef0eaad9-80c9-46b9-909d-923656109bd4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:05.384519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-ef0eaad9-80c9-46b9-909d-923656109bd4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lazy-loading 'fault' on Instance uuid 6275dd89-0924-4941-a1ab-1b37c7020f37 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:18:05.567862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ef0eaad9-80c9-46b9-909d-923656109bd4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb0f4bdcf5b6411aae7daba6bb727313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d86f3305fd4f6a89443ba40bf2778e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:05.576959 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ef0eaad9-80c9-46b9-909d-923656109bd4 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 200 len: 1213 microversion: 2.1 time: 0.360416 Jan 22 21:18:05.580341 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2671/5590] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:05 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 1213 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:05.591856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2382ea0a-3061-46b3-8c21-604a8998aadd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:05.595409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2382ea0a-3061-46b3-8c21-604a8998aadd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:05.613558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2382ea0a-3061-46b3-8c21-604a8998aadd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:05.614415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2382ea0a-3061-46b3-8c21-604a8998aadd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:05.617804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2382ea0a-3061-46b3-8c21-604a8998aadd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:05.619833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2382ea0a-3061-46b3-8c21-604a8998aadd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:05.678598 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2382ea0a-3061-46b3-8c21-604a8998aadd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.096589 Jan 22 21:18:05.682944 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2672/5591] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:05 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:05.873789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1a01d723-b5b4-4820-9654-a65fd2299cd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:05.900175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1a01d723-b5b4-4820-9654-a65fd2299cd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:05.904115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1a01d723-b5b4-4820-9654-a65fd2299cd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:05.904115 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1a01d723-b5b4-4820-9654-a65fd2299cd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1857 microversion: 2.32 time: 0.648374 Jan 22 21:18:05.904115 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2920/5592] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:05 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1857 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:05.947988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7e0861d5-2269-42dd-b80f-84f33b1b3069 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:05.948993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7e0861d5-2269-42dd-b80f-84f33b1b3069 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:05.980671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e0861d5-2269-42dd-b80f-84f33b1b3069 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:05.981141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3ae4230d-5599-4e7f-b6b6-571db70835c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:05.981807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3ae4230d-5599-4e7f-b6b6-571db70835c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:05.986646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e0861d5-2269-42dd-b80f-84f33b1b3069 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:05.987849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e0861d5-2269-42dd-b80f-84f33b1b3069 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:05.988915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e0861d5-2269-42dd-b80f-84f33b1b3069 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:05.990419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ae4230d-5599-4e7f-b6b6-571db70835c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:05.995338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ae4230d-5599-4e7f-b6b6-571db70835c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:05.996297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ae4230d-5599-4e7f-b6b6-571db70835c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:05.996779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ae4230d-5599-4e7f-b6b6-571db70835c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:06.086773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3ae4230d-5599-4e7f-b6b6-571db70835c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:06.111654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3ae4230d-5599-4e7f-b6b6-571db70835c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:06.111654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3ae4230d-5599-4e7f-b6b6-571db70835c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:06.111654 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3ae4230d-5599-4e7f-b6b6-571db70835c5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 200 len: 1369 microversion: 2.20 time: 0.132144 Jan 22 21:18:06.111654 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2921/5593] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:05 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 1369 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:06.310023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7e0861d5-2269-42dd-b80f-84f33b1b3069 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:06.319613 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7e0861d5-2269-42dd-b80f-84f33b1b3069 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.386555 Jan 22 21:18:06.323565 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2673/5594] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:05 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:06.597164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7804282b-3fbf-4ea5-ad45-64bacc6389ab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:06.597837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7804282b-3fbf-4ea5-ad45-64bacc6389ab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] [instance: 6275dd89-0924-4941-a1ab-1b37c7020f37] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:06.606487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7804282b-3fbf-4ea5-ad45-64bacc6389ab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:06.607820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7804282b-3fbf-4ea5-ad45-64bacc6389ab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:06.608120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7804282b-3fbf-4ea5-ad45-64bacc6389ab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:06.608580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7804282b-3fbf-4ea5-ad45-64bacc6389ab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:06.628127 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-7804282b-3fbf-4ea5-ad45-64bacc6389ab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] HTTP exception thrown: Instance 6275dd89-0924-4941-a1ab-1b37c7020f37 could not be found. Jan 22 21:18:06.632519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7804282b-3fbf-4ea5-ad45-64bacc6389ab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Returning 404 to user: Instance 6275dd89-0924-4941-a1ab-1b37c7020f37 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:18:06.632519 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7804282b-3fbf-4ea5-ad45-64bacc6389ab tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37" status: 404 len: 111 microversion: 2.1 time: 0.036710 Jan 22 21:18:06.632519 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2922/5595] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:06 2022] GET /compute/v2.1/servers/6275dd89-0924-4941-a1ab-1b37c7020f37 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:18:06.638899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-769e7fbc-0e27-4ae7-89ba-67521b071f68 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] Calling method '.version_select at 0x7f1ed4e22f70>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:06.691844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7c5aca26-dacf-4e2c-a7ed-65c534ff2509 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:06.692862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7c5aca26-dacf-4e2c-a7ed-65c534ff2509 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:06.702570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c5aca26-dacf-4e2c-a7ed-65c534ff2509 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:06.704289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c5aca26-dacf-4e2c-a7ed-65c534ff2509 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:06.706780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c5aca26-dacf-4e2c-a7ed-65c534ff2509 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:06.707462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c5aca26-dacf-4e2c-a7ed-65c534ff2509 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:06.776045 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7c5aca26-dacf-4e2c-a7ed-65c534ff2509 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.088891 Jan 22 21:18:06.776704 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2923/5596] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:06 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:18:06.821198 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-769e7fbc-0e27-4ae7-89ba-67521b071f68 tempest-ServersTestBootFromVolume-1509582670 tempest-ServersTestBootFromVolume-1509582670-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-644373818" status: 202 len: 0 microversion: 2.1 time: 0.185373 Jan 22 21:18:06.822214 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2674/5597] 10.222.0.100 () {58 vars in 1222 bytes} [Sat Jan 22 21:18:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-644373818 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:18:06.842155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-73d17f24-48a2-4432-997e-64d3ce974c8d req-d26dadf4-ee5e-41f5-ae9f-6a77c3ea624a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "tag": "da0ef06a-1226-49f4-b8db-7103fe846c99"}, {"server_uuid": "8288fe26-7e9c-451c-a9a2-222abbcf201e", "name": "network-vif-deleted", "tag": "92a02346-3106-4ce0-82fd-0bae77d72810"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:06.844641 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:06.844641 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:18:06.870992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-73d17f24-48a2-4432-997e-64d3ce974c8d req-d26dadf4-ee5e-41f5-ae9f-6a77c3ea624a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:06.871454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-73d17f24-48a2-4432-997e-64d3ce974c8d req-d26dadf4-ee5e-41f5-ae9f-6a77c3ea624a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:06.906061 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-73d17f24-48a2-4432-997e-64d3ce974c8d req-d26dadf4-ee5e-41f5-ae9f-6a77c3ea624a service nova] Creating event network-changed:da0ef06a-1226-49f4-b8db-7103fe846c99 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:18:06.906762 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-73d17f24-48a2-4432-997e-64d3ce974c8d req-d26dadf4-ee5e-41f5-ae9f-6a77c3ea624a service nova] Creating event network-vif-deleted:92a02346-3106-4ce0-82fd-0bae77d72810 for instance 8288fe26-7e9c-451c-a9a2-222abbcf201e on nch1-master-1 Jan 22 21:18:06.916108 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-73d17f24-48a2-4432-997e-64d3ce974c8d req-d26dadf4-ee5e-41f5-ae9f-6a77c3ea624a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.077376 Jan 22 21:18:06.917609 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2924/5598] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:06.947510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b3464683-2d8a-4cc9-89d2-853523184266 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:06.948519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b3464683-2d8a-4cc9-89d2-853523184266 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:06.958939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3464683-2d8a-4cc9-89d2-853523184266 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:06.959688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3464683-2d8a-4cc9-89d2-853523184266 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:06.960976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3464683-2d8a-4cc9-89d2-853523184266 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:06.961768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3464683-2d8a-4cc9-89d2-853523184266 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:07.130927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-39056", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "dfd87d5c-a009-41b5-88aa-0e344db06844"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:07.251816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] validate_networks() for [('dfd87d5c-a009-41b5-88aa-0e344db06844', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:18:07.301738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b3464683-2d8a-4cc9-89d2-853523184266 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:07.314504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b3464683-2d8a-4cc9-89d2-853523184266 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:07.317871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b3464683-2d8a-4cc9-89d2-853523184266 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:07.323790 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b3464683-2d8a-4cc9-89d2-853523184266 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.399987 Jan 22 21:18:07.323790 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2925/5599] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:06 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:07.326333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-185f280c-d41d-4a2f-bea7-65dec5c16139 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:07.326952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-185f280c-d41d-4a2f-bea7-65dec5c16139 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:07.334233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-185f280c-d41d-4a2f-bea7-65dec5c16139 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:07.335246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-185f280c-d41d-4a2f-bea7-65dec5c16139 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:07.335486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-185f280c-d41d-4a2f-bea7-65dec5c16139 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:07.336195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-185f280c-d41d-4a2f-bea7-65dec5c16139 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:07.353650 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-185f280c-d41d-4a2f-bea7-65dec5c16139 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] HTTP exception thrown: Instance 8288fe26-7e9c-451c-a9a2-222abbcf201e could not be found. Jan 22 21:18:07.357428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-185f280c-d41d-4a2f-bea7-65dec5c16139 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Returning 404 to user: Instance 8288fe26-7e9c-451c-a9a2-222abbcf201e could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:18:07.358604 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-185f280c-d41d-4a2f-bea7-65dec5c16139 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 404 len: 111 microversion: 2.20 time: 0.037168 Jan 22 21:18:07.360419 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2926/5600] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:07 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:18:07.365985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f744ebb9-411f-4cbd-8111-f4c690d9b21c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:07.368656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f744ebb9-411f-4cbd-8111-f4c690d9b21c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:07.376286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f744ebb9-411f-4cbd-8111-f4c690d9b21c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:07.377061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f744ebb9-411f-4cbd-8111-f4c690d9b21c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:07.378187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f744ebb9-411f-4cbd-8111-f4c690d9b21c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:07.378923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f744ebb9-411f-4cbd-8111-f4c690d9b21c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:07.650285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f744ebb9-411f-4cbd-8111-f4c690d9b21c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:07.658732 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f744ebb9-411f-4cbd-8111-f4c690d9b21c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.296930 Jan 22 21:18:07.668191 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2927/5601] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:07 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:07.668191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b2fd23e5-7983-4f1c-a7ca-0324df41fe12 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '.version_select at 0x7f1ed5ea0310>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:07.769620 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b2fd23e5-7983-4f1c-a7ca-0324df41fe12 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-588674945" status: 204 len: 0 microversion: 2.20 time: 0.109143 Jan 22 21:18:07.770455 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2928/5602] 10.222.0.100 () {60 vars in 1263 bytes} [Sat Jan 22 21:18:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-588674945 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:18:07.795780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dadb704b-e502-4182-9f26-359d6b9d0837 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:07.796748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dadb704b-e502-4182-9f26-359d6b9d0837 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:07.808126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dadb704b-e502-4182-9f26-359d6b9d0837 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:07.808848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dadb704b-e502-4182-9f26-359d6b9d0837 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:07.809869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dadb704b-e502-4182-9f26-359d6b9d0837 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:07.810854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dadb704b-e502-4182-9f26-359d6b9d0837 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:07.871967 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dadb704b-e502-4182-9f26-359d6b9d0837 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.085117 Jan 22 21:18:07.873637 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2929/5603] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:07 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:08.340467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b1ddc71e-b9a1-4901-bdb5-80efb4845f98 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:08.342610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b1ddc71e-b9a1-4901-bdb5-80efb4845f98 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:08.351653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1ddc71e-b9a1-4901-bdb5-80efb4845f98 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:08.355466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1ddc71e-b9a1-4901-bdb5-80efb4845f98 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:08.355466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1ddc71e-b9a1-4901-bdb5-80efb4845f98 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:08.355466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1ddc71e-b9a1-4901-bdb5-80efb4845f98 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:08.447151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:18:08.447661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:18:08.448247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:18:08.448672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:18:08.449094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:18:08.460599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:08.461786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:08.463359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:08.464008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:08.490374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Getting quotas for project 0b00237a726f43a680de4033f6bc83be. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:18:08.496280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Getting quotas for user 94ddc507bb7842679bc465847e00ed3a and project 0b00237a726f43a680de4033f6bc83be. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:18:08.517739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:18:08.520326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:18:08.630968 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b5543ead-2cec-4589-a01b-18f4c13a1e47 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.21 time: 1.764756 Jan 22 21:18:08.632623 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2675/5604] 10.222.0.100 () {62 vars in 1192 bytes} [Sat Jan 22 21:18:06 2022] POST /compute/v2.1/servers => generated 382 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 22 21:18:08.643763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a52f517a-003c-49f4-a959-59434c58f80a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:08.644786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a52f517a-003c-49f4-a959-59434c58f80a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:08.684729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b1ddc71e-b9a1-4901-bdb5-80efb4845f98 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:08.695769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b1ddc71e-b9a1-4901-bdb5-80efb4845f98 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:08.697603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b1ddc71e-b9a1-4901-bdb5-80efb4845f98 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:08.699038 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b1ddc71e-b9a1-4901-bdb5-80efb4845f98 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.362652 Jan 22 21:18:08.717940 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2930/5605] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:08 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:08.717940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-809f99c4-37c0-4fc8-a7ad-529457fa5afe tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:08.717940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-809f99c4-37c0-4fc8-a7ad-529457fa5afe tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:08.730293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-809f99c4-37c0-4fc8-a7ad-529457fa5afe tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:08.730940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-809f99c4-37c0-4fc8-a7ad-529457fa5afe tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:08.731943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-809f99c4-37c0-4fc8-a7ad-529457fa5afe tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:08.732626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-809f99c4-37c0-4fc8-a7ad-529457fa5afe tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:08.936714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a52f517a-003c-49f4-a959-59434c58f80a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:08.948019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a52f517a-003c-49f4-a959-59434c58f80a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:08.950734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a52f517a-003c-49f4-a959-59434c58f80a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:08.951384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-809f99c4-37c0-4fc8-a7ad-529457fa5afe tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:08.951933 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a52f517a-003c-49f4-a959-59434c58f80a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1258 microversion: 2.21 time: 0.313531 Jan 22 21:18:08.962860 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-809f99c4-37c0-4fc8-a7ad-529457fa5afe tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.250065 Jan 22 21:18:08.975829 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2676/5606] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:08 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1258 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:08.976150 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2931/5607] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:08 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:08.976245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-75194153-4a3f-4aae-bf7a-f14068605d94 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:08.976245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-75194153-4a3f-4aae-bf7a-f14068605d94 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:08.977332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75194153-4a3f-4aae-bf7a-f14068605d94 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:08.977823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75194153-4a3f-4aae-bf7a-f14068605d94 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:08.978615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75194153-4a3f-4aae-bf7a-f14068605d94 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:08.979055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-75194153-4a3f-4aae-bf7a-f14068605d94 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:08.982011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-d0e24f22-60e6-498e-bc3f-731c2a1d158f req-999fb5e8-83db-41f6-98b0-a4c67ae8c6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "tag": "cf20b5e5-413a-4b45-9640-028e8825cf06"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:08.983847 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:08.983847 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:18:09.004633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d0e24f22-60e6-498e-bc3f-731c2a1d158f req-999fb5e8-83db-41f6-98b0-a4c67ae8c6db service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:09.005595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d0e24f22-60e6-498e-bc3f-731c2a1d158f req-999fb5e8-83db-41f6-98b0-a4c67ae8c6db service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:09.019891 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d0e24f22-60e6-498e-bc3f-731c2a1d158f req-999fb5e8-83db-41f6-98b0-a4c67ae8c6db service nova] Creating event network-changed:cf20b5e5-413a-4b45-9640-028e8825cf06 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:18:09.025460 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-d0e24f22-60e6-498e-bc3f-731c2a1d158f req-999fb5e8-83db-41f6-98b0-a4c67ae8c6db service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058571 Jan 22 21:18:09.026406 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2932/5608] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:09.027613 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-75194153-4a3f-4aae-bf7a-f14068605d94 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.062082 Jan 22 21:18:09.028881 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2677/5609] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:08 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:09.723994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-42a84b1a-ed8d-4236-84d5-d76e869d87c1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:09.725527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-42a84b1a-ed8d-4236-84d5-d76e869d87c1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:09.755697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42a84b1a-ed8d-4236-84d5-d76e869d87c1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:09.756499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42a84b1a-ed8d-4236-84d5-d76e869d87c1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:09.761080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42a84b1a-ed8d-4236-84d5-d76e869d87c1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:09.761985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42a84b1a-ed8d-4236-84d5-d76e869d87c1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:09.974126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b320f93f-d3ab-4778-8829-0ba61e1a638d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:09.975568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b320f93f-d3ab-4778-8829-0ba61e1a638d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:09.990167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b320f93f-d3ab-4778-8829-0ba61e1a638d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:09.990749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b320f93f-d3ab-4778-8829-0ba61e1a638d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:09.993989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b320f93f-d3ab-4778-8829-0ba61e1a638d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:09.994557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b320f93f-d3ab-4778-8829-0ba61e1a638d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:10.160433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-42a84b1a-ed8d-4236-84d5-d76e869d87c1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:10.170503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-42a84b1a-ed8d-4236-84d5-d76e869d87c1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:10.173575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-42a84b1a-ed8d-4236-84d5-d76e869d87c1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:10.174985 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-42a84b1a-ed8d-4236-84d5-d76e869d87c1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.460379 Jan 22 21:18:10.175636 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2933/5610] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:09 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:10.180390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5a67c8e3-3e5a-4c5f-b4b1-aa6ddef47cf9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:10.181075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5a67c8e3-3e5a-4c5f-b4b1-aa6ddef47cf9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:10.188512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a67c8e3-3e5a-4c5f-b4b1-aa6ddef47cf9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:10.189062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a67c8e3-3e5a-4c5f-b4b1-aa6ddef47cf9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:10.190011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a67c8e3-3e5a-4c5f-b4b1-aa6ddef47cf9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:10.190529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a67c8e3-3e5a-4c5f-b4b1-aa6ddef47cf9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:10.447719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5a67c8e3-3e5a-4c5f-b4b1-aa6ddef47cf9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:10.463397 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5a67c8e3-3e5a-4c5f-b4b1-aa6ddef47cf9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.286643 Jan 22 21:18:10.463984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b320f93f-d3ab-4778-8829-0ba61e1a638d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:10.464703 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2934/5611] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:10 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:10.470369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3b21d73-42ea-4be5-9427-8ce013a4896d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:10.471814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d3b21d73-42ea-4be5-9427-8ce013a4896d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:10.478335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b320f93f-d3ab-4778-8829-0ba61e1a638d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:10.479807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b320f93f-d3ab-4778-8829-0ba61e1a638d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:10.481247 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b320f93f-d3ab-4778-8829-0ba61e1a638d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1262 microversion: 2.21 time: 0.513961 Jan 22 21:18:10.485367 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2678/5612] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:09 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1262 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:10.502491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3b21d73-42ea-4be5-9427-8ce013a4896d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:10.503577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3b21d73-42ea-4be5-9427-8ce013a4896d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:10.504853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3b21d73-42ea-4be5-9427-8ce013a4896d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:10.506241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3b21d73-42ea-4be5-9427-8ce013a4896d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:10.564714 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d3b21d73-42ea-4be5-9427-8ce013a4896d tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.098198 Jan 22 21:18:10.565392 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2935/5613] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:10 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:10.732872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c93542d2-6626-45db-9f26-ebf960a11ff5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'create', calling method: .version_select at 0x7f1ed4e02ee0>, body: {"keypair": {"name": "tempest-keypair-713307230"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:10.759327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-c93542d2-6626-45db-9f26-ebf960a11ff5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Getting quotas for project 76ecd70d0be147b59ffbda6d93f73aa6. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:18:10.765046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-c93542d2-6626-45db-9f26-ebf960a11ff5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Getting quotas for user c0be514b27f14d8a9e4fd71b31a6d2e3 and project 76ecd70d0be147b59ffbda6d93f73aa6. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:18:11.067058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-58af7934-58b4-45ab-ad10-a20ac73cdfd1 req-c89b4186-4988-4996-a3ce-ee06f796ea34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "tag": "6e0c2428-e53e-4cf5-abde-0f2811b46da4"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:11.077348 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:11.077348 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:18:11.093250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-58af7934-58b4-45ab-ad10-a20ac73cdfd1 req-c89b4186-4988-4996-a3ce-ee06f796ea34 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:11.094286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-58af7934-58b4-45ab-ad10-a20ac73cdfd1 req-c89b4186-4988-4996-a3ce-ee06f796ea34 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:11.115955 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-58af7934-58b4-45ab-ad10-a20ac73cdfd1 req-c89b4186-4988-4996-a3ce-ee06f796ea34 service nova] Creating event network-changed:6e0c2428-e53e-4cf5-abde-0f2811b46da4 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:18:11.132520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-c93542d2-6626-45db-9f26-ebf960a11ff5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Getting quotas for project 76ecd70d0be147b59ffbda6d93f73aa6. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:18:11.142338 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-58af7934-58b4-45ab-ad10-a20ac73cdfd1 req-c89b4186-4988-4996-a3ce-ee06f796ea34 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079520 Jan 22 21:18:11.144136 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2936/5614] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:11.150094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-c93542d2-6626-45db-9f26-ebf960a11ff5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Getting quotas for user c0be514b27f14d8a9e4fd71b31a6d2e3 and project 76ecd70d0be147b59ffbda6d93f73aa6. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:18:11.171355 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c93542d2-6626-45db-9f26-ebf960a11ff5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.444184 Jan 22 21:18:11.173590 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2679/5615] 10.222.0.100 () {62 vars in 1203 bytes} [Sat Jan 22 21:18:10 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 447 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:18:11.202807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4ce26212-c43e-4d48-b28e-2bfb2145be14 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:11.205461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4ce26212-c43e-4d48-b28e-2bfb2145be14 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:11.214852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ce26212-c43e-4d48-b28e-2bfb2145be14 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:11.215317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ce26212-c43e-4d48-b28e-2bfb2145be14 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:11.217186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ce26212-c43e-4d48-b28e-2bfb2145be14 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:11.217950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ce26212-c43e-4d48-b28e-2bfb2145be14 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:11.481924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-56be7928-89e7-4e57-9108-04b5f4a8b573 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:11.483349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-56be7928-89e7-4e57-9108-04b5f4a8b573 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:11.491536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56be7928-89e7-4e57-9108-04b5f4a8b573 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:11.492104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56be7928-89e7-4e57-9108-04b5f4a8b573 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:11.492970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56be7928-89e7-4e57-9108-04b5f4a8b573 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:11.493646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56be7928-89e7-4e57-9108-04b5f4a8b573 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:11.662420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4ce26212-c43e-4d48-b28e-2bfb2145be14 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:11.674999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4ce26212-c43e-4d48-b28e-2bfb2145be14 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:11.677835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4ce26212-c43e-4d48-b28e-2bfb2145be14 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:11.679497 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4ce26212-c43e-4d48-b28e-2bfb2145be14 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.487651 Jan 22 21:18:11.680579 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2937/5616] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:11 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:11.685173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e6091a00-be9c-49ef-8ca6-dc0a4843c765 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:11.688320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e6091a00-be9c-49ef-8ca6-dc0a4843c765 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:11.695677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6091a00-be9c-49ef-8ca6-dc0a4843c765 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:11.696898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6091a00-be9c-49ef-8ca6-dc0a4843c765 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:11.698537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6091a00-be9c-49ef-8ca6-dc0a4843c765 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:11.699015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6091a00-be9c-49ef-8ca6-dc0a4843c765 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:11.816302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e6091a00-be9c-49ef-8ca6-dc0a4843c765 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:11.826939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e6091a00-be9c-49ef-8ca6-dc0a4843c765 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:11.837719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e6091a00-be9c-49ef-8ca6-dc0a4843c765 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:11.837719 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e6091a00-be9c-49ef-8ca6-dc0a4843c765 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1328 microversion: 2.21 time: 0.154653 Jan 22 21:18:11.837719 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2938/5617] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:11 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1328 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:11.842031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0e4a7d68-bf57-4514-8dc4-eeec770f80a0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:11.843124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0e4a7d68-bf57-4514-8dc4-eeec770f80a0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:11.853975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e4a7d68-bf57-4514-8dc4-eeec770f80a0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:11.859995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e4a7d68-bf57-4514-8dc4-eeec770f80a0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:11.859995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e4a7d68-bf57-4514-8dc4-eeec770f80a0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:11.859995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e4a7d68-bf57-4514-8dc4-eeec770f80a0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:11.912739 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0e4a7d68-bf57-4514-8dc4-eeec770f80a0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.074337 Jan 22 21:18:11.913368 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2939/5618] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:11 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:12.232178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-56be7928-89e7-4e57-9108-04b5f4a8b573 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:12.244701 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-56be7928-89e7-4e57-9108-04b5f4a8b573 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.766923 Jan 22 21:18:12.246409 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2680/5619] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:11 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:12.700605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2ebf0048-2419-44a7-9e93-3a5f640299fc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:12.703880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2ebf0048-2419-44a7-9e93-3a5f640299fc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:12.714084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ebf0048-2419-44a7-9e93-3a5f640299fc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:12.714903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ebf0048-2419-44a7-9e93-3a5f640299fc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:12.715950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ebf0048-2419-44a7-9e93-3a5f640299fc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:12.716776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ebf0048-2419-44a7-9e93-3a5f640299fc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:12.867115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9af9b9cf-3178-45db-8dc1-94d645fa31a4 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:12.867740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9af9b9cf-3178-45db-8dc1-94d645fa31a4 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:12.879389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9af9b9cf-3178-45db-8dc1-94d645fa31a4 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:12.883059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9af9b9cf-3178-45db-8dc1-94d645fa31a4 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:12.891691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9af9b9cf-3178-45db-8dc1-94d645fa31a4 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:12.891691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9af9b9cf-3178-45db-8dc1-94d645fa31a4 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:13.049786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9af9b9cf-3178-45db-8dc1-94d645fa31a4 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:13.075234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9af9b9cf-3178-45db-8dc1-94d645fa31a4 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:13.077286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9af9b9cf-3178-45db-8dc1-94d645fa31a4 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:13.097392 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9af9b9cf-3178-45db-8dc1-94d645fa31a4 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1316 microversion: 2.21 time: 0.218276 Jan 22 21:18:13.110707 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2681/5620] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:12 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1316 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:13.118962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-372bc3ec-922d-46ea-a1ea-9d12da5ceb5b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:13.121366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-372bc3ec-922d-46ea-a1ea-9d12da5ceb5b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:13.135094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-372bc3ec-922d-46ea-a1ea-9d12da5ceb5b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:13.135785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-372bc3ec-922d-46ea-a1ea-9d12da5ceb5b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:13.136729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-372bc3ec-922d-46ea-a1ea-9d12da5ceb5b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:13.137269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-372bc3ec-922d-46ea-a1ea-9d12da5ceb5b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:13.154426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2ebf0048-2419-44a7-9e93-3a5f640299fc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:13.170808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2ebf0048-2419-44a7-9e93-3a5f640299fc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:13.175966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2ebf0048-2419-44a7-9e93-3a5f640299fc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:13.177961 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2ebf0048-2419-44a7-9e93-3a5f640299fc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.481989 Jan 22 21:18:13.178711 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2940/5621] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:12 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:13.199810 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-372bc3ec-922d-46ea-a1ea-9d12da5ceb5b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.092919 Jan 22 21:18:13.201232 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2682/5622] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:13 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:13.263574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-064310ed-7593-4c77-bc12-733c00db1ba8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:13.264404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-064310ed-7593-4c77-bc12-733c00db1ba8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:13.278254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-064310ed-7593-4c77-bc12-733c00db1ba8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:13.280013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-064310ed-7593-4c77-bc12-733c00db1ba8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:13.282265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-064310ed-7593-4c77-bc12-733c00db1ba8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:13.282724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-064310ed-7593-4c77-bc12-733c00db1ba8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:13.473428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-064310ed-7593-4c77-bc12-733c00db1ba8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:13.482636 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-064310ed-7593-4c77-bc12-733c00db1ba8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.222966 Jan 22 21:18:13.484622 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2941/5623] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:13 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:14.110773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-c255607b-78bb-412b-a5e6-e4f2152ba6cd req-9456eab6-dc6c-4f38-81e5-b5e46b6e257e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "tag": "d6ad2c1e-3a87-493b-b14b-01230bfd2da6"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:14.112304 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:14.112304 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:18:14.122206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d91c70e1-259f-4e67-bab9-dc6684f94aa5 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:14.125276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d91c70e1-259f-4e67-bab9-dc6684f94aa5 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:14.136228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d91c70e1-259f-4e67-bab9-dc6684f94aa5 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:14.137023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d91c70e1-259f-4e67-bab9-dc6684f94aa5 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:14.138647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d91c70e1-259f-4e67-bab9-dc6684f94aa5 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:14.139277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d91c70e1-259f-4e67-bab9-dc6684f94aa5 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:14.150201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c255607b-78bb-412b-a5e6-e4f2152ba6cd req-9456eab6-dc6c-4f38-81e5-b5e46b6e257e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:14.152503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c255607b-78bb-412b-a5e6-e4f2152ba6cd req-9456eab6-dc6c-4f38-81e5-b5e46b6e257e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:14.185981 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-c255607b-78bb-412b-a5e6-e4f2152ba6cd req-9456eab6-dc6c-4f38-81e5-b5e46b6e257e service nova] Creating event network-changed:d6ad2c1e-3a87-493b-b14b-01230bfd2da6 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:18:14.196489 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-c255607b-78bb-412b-a5e6-e4f2152ba6cd req-9456eab6-dc6c-4f38-81e5-b5e46b6e257e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089756 Jan 22 21:18:14.197467 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2683/5624] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:14.222621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-64ddbda4-1c7c-4fa8-97dc-ca33b562e6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:14.223327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-64ddbda4-1c7c-4fa8-97dc-ca33b562e6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:14.246110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64ddbda4-1c7c-4fa8-97dc-ca33b562e6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:14.246566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64ddbda4-1c7c-4fa8-97dc-ca33b562e6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:14.247368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64ddbda4-1c7c-4fa8-97dc-ca33b562e6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:14.247808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64ddbda4-1c7c-4fa8-97dc-ca33b562e6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:14.250178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d91c70e1-259f-4e67-bab9-dc6684f94aa5 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:14.270224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d91c70e1-259f-4e67-bab9-dc6684f94aa5 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:14.272218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d91c70e1-259f-4e67-bab9-dc6684f94aa5 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:14.273649 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d91c70e1-259f-4e67-bab9-dc6684f94aa5 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1316 microversion: 2.21 time: 0.157537 Jan 22 21:18:14.277674 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2942/5625] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:14 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:14.285444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eb05530b-f0d8-46c7-bdd8-2d6c5b49b3df tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:14.287316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eb05530b-f0d8-46c7-bdd8-2d6c5b49b3df tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:14.313575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb05530b-f0d8-46c7-bdd8-2d6c5b49b3df tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:14.313575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb05530b-f0d8-46c7-bdd8-2d6c5b49b3df tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:14.313575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb05530b-f0d8-46c7-bdd8-2d6c5b49b3df tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:14.313575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb05530b-f0d8-46c7-bdd8-2d6c5b49b3df tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:14.369997 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eb05530b-f0d8-46c7-bdd8-2d6c5b49b3df tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.090599 Jan 22 21:18:14.373804 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2943/5626] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:14 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:14.501667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f6d29e8-df5f-43de-b690-52f87cebb4e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:14.505235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8f6d29e8-df5f-43de-b690-52f87cebb4e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:14.514306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f6d29e8-df5f-43de-b690-52f87cebb4e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:14.515128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f6d29e8-df5f-43de-b690-52f87cebb4e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:14.516662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f6d29e8-df5f-43de-b690-52f87cebb4e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:14.517333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f6d29e8-df5f-43de-b690-52f87cebb4e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:14.821637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8f6d29e8-df5f-43de-b690-52f87cebb4e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:14.829736 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8f6d29e8-df5f-43de-b690-52f87cebb4e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.332997 Jan 22 21:18:14.830331 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2944/5627] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:14 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:15.185874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-64ddbda4-1c7c-4fa8-97dc-ca33b562e6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:15.201317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-64ddbda4-1c7c-4fa8-97dc-ca33b562e6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:15.205395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-64ddbda4-1c7c-4fa8-97dc-ca33b562e6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:15.207024 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-64ddbda4-1c7c-4fa8-97dc-ca33b562e6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.993034 Jan 22 21:18:15.208401 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2684/5628] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:14 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:15.294436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c0ad64d1-f92a-40d9-8dcf-7b5e7df6bdae tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:15.295684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c0ad64d1-f92a-40d9-8dcf-7b5e7df6bdae tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:15.303774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0ad64d1-f92a-40d9-8dcf-7b5e7df6bdae tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:15.304545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0ad64d1-f92a-40d9-8dcf-7b5e7df6bdae tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:15.305605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0ad64d1-f92a-40d9-8dcf-7b5e7df6bdae tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:15.306239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0ad64d1-f92a-40d9-8dcf-7b5e7df6bdae tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:15.382796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1fd57fd2-2be7-4831-8a73-73fe430299e6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:15.384028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1fd57fd2-2be7-4831-8a73-73fe430299e6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:15.397422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fd57fd2-2be7-4831-8a73-73fe430299e6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:15.398333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fd57fd2-2be7-4831-8a73-73fe430299e6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:15.399337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fd57fd2-2be7-4831-8a73-73fe430299e6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:15.401998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1fd57fd2-2be7-4831-8a73-73fe430299e6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:15.461993 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1fd57fd2-2be7-4831-8a73-73fe430299e6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.082056 Jan 22 21:18:15.463472 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2685/5629] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:15 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:15.767220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c0ad64d1-f92a-40d9-8dcf-7b5e7df6bdae tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:15.788698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c0ad64d1-f92a-40d9-8dcf-7b5e7df6bdae tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:15.815821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c0ad64d1-f92a-40d9-8dcf-7b5e7df6bdae tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:15.817469 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c0ad64d1-f92a-40d9-8dcf-7b5e7df6bdae tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1358 microversion: 2.21 time: 0.526542 Jan 22 21:18:15.818110 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2945/5630] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:15 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1358 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:15.874350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-842b139e-eee0-4108-be4c-9cb67f7bf1ee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:15.874350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-842b139e-eee0-4108-be4c-9cb67f7bf1ee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:15.874350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-842b139e-eee0-4108-be4c-9cb67f7bf1ee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:15.874350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-842b139e-eee0-4108-be4c-9cb67f7bf1ee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:15.874350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-842b139e-eee0-4108-be4c-9cb67f7bf1ee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:15.874350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-842b139e-eee0-4108-be4c-9cb67f7bf1ee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:16.228724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5610a268-61cd-4d43-b930-446f9f9439ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:16.229870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5610a268-61cd-4d43-b930-446f9f9439ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:16.238014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5610a268-61cd-4d43-b930-446f9f9439ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:16.241886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5610a268-61cd-4d43-b930-446f9f9439ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:16.242744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5610a268-61cd-4d43-b930-446f9f9439ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:16.244989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5610a268-61cd-4d43-b930-446f9f9439ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:16.371587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-842b139e-eee0-4108-be4c-9cb67f7bf1ee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:16.380611 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-842b139e-eee0-4108-be4c-9cb67f7bf1ee tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1516 microversion: 2.1 time: 0.537224 Jan 22 21:18:16.381955 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2686/5631] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:15 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1516 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:16.480268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ad60726-c8ac-42a0-a3b6-d1cc179b22d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:16.480268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1ad60726-c8ac-42a0-a3b6-d1cc179b22d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:16.483360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ad60726-c8ac-42a0-a3b6-d1cc179b22d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:16.483836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ad60726-c8ac-42a0-a3b6-d1cc179b22d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:16.485365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ad60726-c8ac-42a0-a3b6-d1cc179b22d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:16.485829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ad60726-c8ac-42a0-a3b6-d1cc179b22d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:16.528589 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1ad60726-c8ac-42a0-a3b6-d1cc179b22d4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.057751 Jan 22 21:18:16.529731 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2687/5632] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:16 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:18:16.683919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-15a68fb1-0147-41e4-a06a-7f29bfdae764 req-dd791926-8264-4c98-9d76-122a920ec524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "tag": "a9f0a176-56d8-4260-a888-954dfaa6e694"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:16.685321 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:16.685321 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:18:16.704828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-15a68fb1-0147-41e4-a06a-7f29bfdae764 req-dd791926-8264-4c98-9d76-122a920ec524 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:16.706367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-15a68fb1-0147-41e4-a06a-7f29bfdae764 req-dd791926-8264-4c98-9d76-122a920ec524 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:16.742913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5610a268-61cd-4d43-b930-446f9f9439ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:16.743479 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-15a68fb1-0147-41e4-a06a-7f29bfdae764 req-dd791926-8264-4c98-9d76-122a920ec524 service nova] Creating event network-changed:a9f0a176-56d8-4260-a888-954dfaa6e694 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:18:16.751880 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-15a68fb1-0147-41e4-a06a-7f29bfdae764 req-dd791926-8264-4c98-9d76-122a920ec524 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076453 Jan 22 21:18:16.756558 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2688/5633] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:16.758119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5610a268-61cd-4d43-b930-446f9f9439ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:16.758891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5610a268-61cd-4d43-b930-446f9f9439ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:16.760878 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5610a268-61cd-4d43-b930-446f9f9439ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.536878 Jan 22 21:18:16.773428 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2946/5634] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:16 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:16.839478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e8d9c045-40e3-485e-8612-48b366062b1f tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:16.840184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e8d9c045-40e3-485e-8612-48b366062b1f tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:16.848379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8d9c045-40e3-485e-8612-48b366062b1f tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:16.848738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8d9c045-40e3-485e-8612-48b366062b1f tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:16.849777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8d9c045-40e3-485e-8612-48b366062b1f tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:16.850394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8d9c045-40e3-485e-8612-48b366062b1f tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:17.185120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fc98e469-2de3-49f1-ac6c-a99e5b928602 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:17.186521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fc98e469-2de3-49f1-ac6c-a99e5b928602 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:17.197593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc98e469-2de3-49f1-ac6c-a99e5b928602 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:17.198073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc98e469-2de3-49f1-ac6c-a99e5b928602 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:17.198878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc98e469-2de3-49f1-ac6c-a99e5b928602 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:17.199320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc98e469-2de3-49f1-ac6c-a99e5b928602 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:17.261907 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fc98e469-2de3-49f1-ac6c-a99e5b928602 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1/action" status: 200 len: 24575 microversion: 2.1 time: 0.080816 Jan 22 21:18:17.280250 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2947/5635] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:17 2022] POST /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1/action => generated 24575 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:17.401026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-962f6f5e-a356-4f83-a585-a11b1aa131bf tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:17.402317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-962f6f5e-a356-4f83-a585-a11b1aa131bf tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:17.411548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-962f6f5e-a356-4f83-a585-a11b1aa131bf tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:17.412311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-962f6f5e-a356-4f83-a585-a11b1aa131bf tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:17.413352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-962f6f5e-a356-4f83-a585-a11b1aa131bf tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:17.414101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-962f6f5e-a356-4f83-a585-a11b1aa131bf tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:17.836639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e8d9c045-40e3-485e-8612-48b366062b1f tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:17.850307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e8d9c045-40e3-485e-8612-48b366062b1f tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:17.852032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e8d9c045-40e3-485e-8612-48b366062b1f tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:17.853485 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e8d9c045-40e3-485e-8612-48b366062b1f tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1358 microversion: 2.21 time: 1.018345 Jan 22 21:18:17.855513 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2689/5636] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:16 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1358 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:17.880148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-962f6f5e-a356-4f83-a585-a11b1aa131bf tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:17.881220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-17339539-2389-49e2-bdf9-72fd135f0633 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:17.882550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-17339539-2389-49e2-bdf9-72fd135f0633 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:17.894004 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-962f6f5e-a356-4f83-a585-a11b1aa131bf tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1493 microversion: 2.1 time: 0.495866 Jan 22 21:18:17.894783 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2948/5637] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:17 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1493 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:17.897743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17339539-2389-49e2-bdf9-72fd135f0633 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:17.912264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17339539-2389-49e2-bdf9-72fd135f0633 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:17.912264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17339539-2389-49e2-bdf9-72fd135f0633 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:17.912264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17339539-2389-49e2-bdf9-72fd135f0633 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:17.912857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a736ac57-110d-4664-a0cf-12a504b4d3bd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:17.912857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a736ac57-110d-4664-a0cf-12a504b4d3bd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:17.920772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a736ac57-110d-4664-a0cf-12a504b4d3bd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:17.922412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a736ac57-110d-4664-a0cf-12a504b4d3bd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:17.926198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a736ac57-110d-4664-a0cf-12a504b4d3bd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:17.926820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a736ac57-110d-4664-a0cf-12a504b4d3bd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:17.964387 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-17339539-2389-49e2-bdf9-72fd135f0633 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.107147 Jan 22 21:18:17.965664 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2690/5638] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:17 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:17.978231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-203b317f-1fdf-4f39-982b-a56b59da7f15 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:17.978838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-203b317f-1fdf-4f39-982b-a56b59da7f15 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:17.996326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203b317f-1fdf-4f39-982b-a56b59da7f15 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:17.996712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203b317f-1fdf-4f39-982b-a56b59da7f15 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:17.998557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203b317f-1fdf-4f39-982b-a56b59da7f15 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:17.999002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203b317f-1fdf-4f39-982b-a56b59da7f15 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:18.054018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-203b317f-1fdf-4f39-982b-a56b59da7f15 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:18:18.321349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a736ac57-110d-4664-a0cf-12a504b4d3bd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:18.337185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a736ac57-110d-4664-a0cf-12a504b4d3bd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:18.339445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a736ac57-110d-4664-a0cf-12a504b4d3bd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:18.340963 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a736ac57-110d-4664-a0cf-12a504b4d3bd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.444817 Jan 22 21:18:18.346186 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2949/5639] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:17 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:18.378025 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-203b317f-1fdf-4f39-982b-a56b59da7f15 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 204 len: 0 microversion: 2.1 time: 0.405495 Jan 22 21:18:18.379451 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2691/5640] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:18:17 2022] DELETE /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:18:18.396474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fc4379fc-b455-4c2d-bb78-ea8204b46f69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:18.397431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fc4379fc-b455-4c2d-bb78-ea8204b46f69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:18.412307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc4379fc-b455-4c2d-bb78-ea8204b46f69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:18.413079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc4379fc-b455-4c2d-bb78-ea8204b46f69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:18.415152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc4379fc-b455-4c2d-bb78-ea8204b46f69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:18.415787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc4379fc-b455-4c2d-bb78-ea8204b46f69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:18.650680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fc4379fc-b455-4c2d-bb78-ea8204b46f69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:18.663574 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fc4379fc-b455-4c2d-bb78-ea8204b46f69 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1499 microversion: 2.1 time: 0.279337 Jan 22 21:18:18.664171 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2950/5641] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:18 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1499 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:18:18.836168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-efa5a760-8b76-4b53-99d6-65e7559c489f req-7f0fe0c9-0964-44e2-90fc-8095a67df2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15529edc-652d-4c8c-a493-f0dd111c6746", "tag": "aa19c896-c8ba-4f4e-8e35-09b719178cba"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:18.837875 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:18.837875 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:18:18.848330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-efa5a760-8b76-4b53-99d6-65e7559c489f req-7f0fe0c9-0964-44e2-90fc-8095a67df2e0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:18.848896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-efa5a760-8b76-4b53-99d6-65e7559c489f req-7f0fe0c9-0964-44e2-90fc-8095a67df2e0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:18.870800 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-efa5a760-8b76-4b53-99d6-65e7559c489f req-7f0fe0c9-0964-44e2-90fc-8095a67df2e0 service nova] Creating event network-changed:aa19c896-c8ba-4f4e-8e35-09b719178cba for instance 15529edc-652d-4c8c-a493-f0dd111c6746 on nch2-master-1 Jan 22 21:18:18.875173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d9085cb8-97c2-4afd-9dc4-b6c188eb0383 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:18.875920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d9085cb8-97c2-4afd-9dc4-b6c188eb0383 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:18.877214 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-efa5a760-8b76-4b53-99d6-65e7559c489f req-7f0fe0c9-0964-44e2-90fc-8095a67df2e0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051405 Jan 22 21:18:18.878409 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2692/5642] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:18.885640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9085cb8-97c2-4afd-9dc4-b6c188eb0383 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:18.886601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9085cb8-97c2-4afd-9dc4-b6c188eb0383 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:18.887519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9085cb8-97c2-4afd-9dc4-b6c188eb0383 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:18.888071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9085cb8-97c2-4afd-9dc4-b6c188eb0383 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:18.980216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-95ff8469-f267-4eb4-901c-d200a7f2fb6b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:18.981674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-95ff8469-f267-4eb4-901c-d200a7f2fb6b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:19.006207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95ff8469-f267-4eb4-901c-d200a7f2fb6b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:19.008735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95ff8469-f267-4eb4-901c-d200a7f2fb6b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:19.010031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95ff8469-f267-4eb4-901c-d200a7f2fb6b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:19.012432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95ff8469-f267-4eb4-901c-d200a7f2fb6b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:19.080403 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-95ff8469-f267-4eb4-901c-d200a7f2fb6b tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.105268 Jan 22 21:18:19.081143 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2693/5643] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:18 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:19.088846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1710051364", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a953f459-5982-44b7-9e73-c038b6d680f5"}], "security_groups": [{"name": "tempest-securitygroup--2057849664"}], "key_name": "tempest-keypair-713307230", "user_data": "}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:19.112417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d9085cb8-97c2-4afd-9dc4-b6c188eb0383 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:19.123046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d9085cb8-97c2-4afd-9dc4-b6c188eb0383 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:19.125994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d9085cb8-97c2-4afd-9dc4-b6c188eb0383 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:19.127363 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d9085cb8-97c2-4afd-9dc4-b6c188eb0383 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1358 microversion: 2.21 time: 0.257509 Jan 22 21:18:19.128122 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2951/5644] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:18 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:19.233633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] validate_networks() for [('a953f459-5982-44b7-9e73-c038b6d680f5', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:18:19.361666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9c5053af-858b-49a1-971d-53c7f17dbcc6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:19.362288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9c5053af-858b-49a1-971d-53c7f17dbcc6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:19.368627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c5053af-858b-49a1-971d-53c7f17dbcc6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:19.370790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c5053af-858b-49a1-971d-53c7f17dbcc6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:19.370790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c5053af-858b-49a1-971d-53c7f17dbcc6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:19.370790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c5053af-858b-49a1-971d-53c7f17dbcc6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:19.571354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9c5053af-858b-49a1-971d-53c7f17dbcc6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:19.591716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9c5053af-858b-49a1-971d-53c7f17dbcc6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:19.594159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9c5053af-858b-49a1-971d-53c7f17dbcc6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:19.595647 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9c5053af-858b-49a1-971d-53c7f17dbcc6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.237919 Jan 22 21:18:19.596234 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2952/5645] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:19 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:19.682137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a6b2452f-0055-489b-ab23-783ed10a6413 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:19.683088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a6b2452f-0055-489b-ab23-783ed10a6413 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:19.692867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6b2452f-0055-489b-ab23-783ed10a6413 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:19.693692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6b2452f-0055-489b-ab23-783ed10a6413 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:19.695518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6b2452f-0055-489b-ab23-783ed10a6413 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:19.709743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6b2452f-0055-489b-ab23-783ed10a6413 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:20.101280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a6b2452f-0055-489b-ab23-783ed10a6413 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:20.111581 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a6b2452f-0055-489b-ab23-783ed10a6413 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1499 microversion: 2.1 time: 0.433798 Jan 22 21:18:20.112198 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2953/5646] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:19 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1499 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:18:20.133770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2fae22f1-8d63-41f6-a29c-9ef9ac2eaccb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:20.134782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2fae22f1-8d63-41f6-a29c-9ef9ac2eaccb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:20.144997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fae22f1-8d63-41f6-a29c-9ef9ac2eaccb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:20.154296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fae22f1-8d63-41f6-a29c-9ef9ac2eaccb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:20.154296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fae22f1-8d63-41f6-a29c-9ef9ac2eaccb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:20.154296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fae22f1-8d63-41f6-a29c-9ef9ac2eaccb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:20.221400 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2fae22f1-8d63-41f6-a29c-9ef9ac2eaccb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.091460 Jan 22 21:18:20.228255 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2954/5647] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:20 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:20.236393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-00e9dbd3-bf46-4641-ad96-cc4379a26e42 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:20.237161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-00e9dbd3-bf46-4641-ad96-cc4379a26e42 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:20.245660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00e9dbd3-bf46-4641-ad96-cc4379a26e42 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:20.246417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00e9dbd3-bf46-4641-ad96-cc4379a26e42 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:20.248555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00e9dbd3-bf46-4641-ad96-cc4379a26e42 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:20.250285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00e9dbd3-bf46-4641-ad96-cc4379a26e42 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:20.497408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-00e9dbd3-bf46-4641-ad96-cc4379a26e42 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:20.511127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-00e9dbd3-bf46-4641-ad96-cc4379a26e42 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:20.513332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-00e9dbd3-bf46-4641-ad96-cc4379a26e42 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:20.522794 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-00e9dbd3-bf46-4641-ad96-cc4379a26e42 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1358 microversion: 2.21 time: 0.284364 Jan 22 21:18:20.522794 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2955/5648] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:20 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:20.615934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-047e1343-8538-47a9-a15a-fbb743f66eb3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:20.616750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-047e1343-8538-47a9-a15a-fbb743f66eb3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:20.627857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-047e1343-8538-47a9-a15a-fbb743f66eb3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:20.629018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-047e1343-8538-47a9-a15a-fbb743f66eb3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:20.630449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-047e1343-8538-47a9-a15a-fbb743f66eb3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:20.631668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-047e1343-8538-47a9-a15a-fbb743f66eb3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:20.652120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:18:20.655699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:18:20.655699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:18:20.655699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:18:20.655699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:18:20.680291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:20.680762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:20.683043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:20.683043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:20.715498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Getting quotas for project 76ecd70d0be147b59ffbda6d93f73aa6. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:18:20.728684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Getting quotas for user c0be514b27f14d8a9e4fd71b31a6d2e3 and project 76ecd70d0be147b59ffbda6d93f73aa6. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:18:20.761248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:18:20.764219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:18:20.960994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-047e1343-8538-47a9-a15a-fbb743f66eb3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:20.971297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-047e1343-8538-47a9-a15a-fbb743f66eb3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:20.973032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-047e1343-8538-47a9-a15a-fbb743f66eb3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:20.974902 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-047e1343-8538-47a9-a15a-fbb743f66eb3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.363558 Jan 22 21:18:20.976657 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2956/5649] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:20 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:20.979138 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bca59a1d-3eea-4161-949a-25143e8a1e26 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 1.896743 Jan 22 21:18:20.979784 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2694/5650] 10.222.0.100 () {62 vars in 1192 bytes} [Sat Jan 22 21:18:19 2022] POST /compute/v2.1/servers => generated 404 bytes in 1898 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 22 21:18:21.007987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-44fd3ea0-cc60-4352-806e-673ff6e8deb2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:21.008715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-44fd3ea0-cc60-4352-806e-673ff6e8deb2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:21.128545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-44fd3ea0-cc60-4352-806e-673ff6e8deb2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:21.131754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-81280afc-75df-4daa-aacb-d64ea574b27b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:21.132398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-81280afc-75df-4daa-aacb-d64ea574b27b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:21.136354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-44fd3ea0-cc60-4352-806e-673ff6e8deb2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:21.137893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-44fd3ea0-cc60-4352-806e-673ff6e8deb2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:21.149612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81280afc-75df-4daa-aacb-d64ea574b27b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:21.151609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81280afc-75df-4daa-aacb-d64ea574b27b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:21.155115 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-44fd3ea0-cc60-4352-806e-673ff6e8deb2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1285 microversion: 2.20 time: 0.146747 Jan 22 21:18:21.157463 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2957/5651] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:21 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:21.166780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81280afc-75df-4daa-aacb-d64ea574b27b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:21.167261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81280afc-75df-4daa-aacb-d64ea574b27b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:21.235507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4339ea42-c994-43da-a04a-e3a37f7cd7e5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:21.236771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4339ea42-c994-43da-a04a-e3a37f7cd7e5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:21.248395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4339ea42-c994-43da-a04a-e3a37f7cd7e5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:21.254345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4339ea42-c994-43da-a04a-e3a37f7cd7e5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:21.261196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4339ea42-c994-43da-a04a-e3a37f7cd7e5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:21.262005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4339ea42-c994-43da-a04a-e3a37f7cd7e5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:21.314139 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4339ea42-c994-43da-a04a-e3a37f7cd7e5 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.082856 Jan 22 21:18:21.319398 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2958/5652] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:21 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:18:21.401853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-99c0a971-6f04-4e69-ad30-123719a90b9d req-07e1d1a0-5ded-42e3-87ac-23aa80d66d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "tag": "5deaf213-88f0-4d59-9ebc-8825f8699d40"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:21.403426 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:21.403426 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:18:21.423886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-99c0a971-6f04-4e69-ad30-123719a90b9d req-07e1d1a0-5ded-42e3-87ac-23aa80d66d60 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:21.423886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-99c0a971-6f04-4e69-ad30-123719a90b9d req-07e1d1a0-5ded-42e3-87ac-23aa80d66d60 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:21.454168 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-99c0a971-6f04-4e69-ad30-123719a90b9d req-07e1d1a0-5ded-42e3-87ac-23aa80d66d60 service nova] Creating event network-changed:5deaf213-88f0-4d59-9ebc-8825f8699d40 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:18:21.458901 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-99c0a971-6f04-4e69-ad30-123719a90b9d req-07e1d1a0-5ded-42e3-87ac-23aa80d66d60 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061703 Jan 22 21:18:21.459761 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2959/5653] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:18:21.541834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b2129afa-8df2-4ad1-ad36-11bba48b80b8 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:21.542038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b2129afa-8df2-4ad1-ad36-11bba48b80b8 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:21.550110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2129afa-8df2-4ad1-ad36-11bba48b80b8 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:21.550875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2129afa-8df2-4ad1-ad36-11bba48b80b8 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:21.552500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2129afa-8df2-4ad1-ad36-11bba48b80b8 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:21.553151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2129afa-8df2-4ad1-ad36-11bba48b80b8 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:21.815459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b2129afa-8df2-4ad1-ad36-11bba48b80b8 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:21.824695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b2129afa-8df2-4ad1-ad36-11bba48b80b8 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:21.829456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b2129afa-8df2-4ad1-ad36-11bba48b80b8 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:21.836439 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b2129afa-8df2-4ad1-ad36-11bba48b80b8 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1358 microversion: 2.21 time: 0.301646 Jan 22 21:18:21.839070 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2960/5654] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:21 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:21.961800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-81280afc-75df-4daa-aacb-d64ea574b27b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:21.982406 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-81280afc-75df-4daa-aacb-d64ea574b27b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1499 microversion: 2.1 time: 0.854556 Jan 22 21:18:21.984464 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2695/5655] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:21 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1499 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:22.002159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-77e001f1-f8f0-4d55-b408-783b25193cc7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:22.003106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-77e001f1-f8f0-4d55-b408-783b25193cc7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:22.011978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77e001f1-f8f0-4d55-b408-783b25193cc7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:22.012739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77e001f1-f8f0-4d55-b408-783b25193cc7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:22.013821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77e001f1-f8f0-4d55-b408-783b25193cc7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:22.014614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77e001f1-f8f0-4d55-b408-783b25193cc7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:22.176420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-390c0a21-7905-4d76-95fd-5af9f04b2803 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:22.176420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-390c0a21-7905-4d76-95fd-5af9f04b2803 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:22.287486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-390c0a21-7905-4d76-95fd-5af9f04b2803 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:22.304361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-390c0a21-7905-4d76-95fd-5af9f04b2803 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:22.307731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-390c0a21-7905-4d76-95fd-5af9f04b2803 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:22.309231 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-390c0a21-7905-4d76-95fd-5af9f04b2803 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1285 microversion: 2.20 time: 0.138174 Jan 22 21:18:22.317648 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2696/5656] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:22 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:22.335501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5b7598c1-7484-43a3-aa4f-6da4d7052565 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:22.336628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5b7598c1-7484-43a3-aa4f-6da4d7052565 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:22.351018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b7598c1-7484-43a3-aa4f-6da4d7052565 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:22.351776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b7598c1-7484-43a3-aa4f-6da4d7052565 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:22.353365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b7598c1-7484-43a3-aa4f-6da4d7052565 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:22.354727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b7598c1-7484-43a3-aa4f-6da4d7052565 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:22.410766 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5b7598c1-7484-43a3-aa4f-6da4d7052565 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.087801 Jan 22 21:18:22.411825 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2697/5657] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:22 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:22.535141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-77e001f1-f8f0-4d55-b408-783b25193cc7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:22.548509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-77e001f1-f8f0-4d55-b408-783b25193cc7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:22.550220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-77e001f1-f8f0-4d55-b408-783b25193cc7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:22.551421 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-77e001f1-f8f0-4d55-b408-783b25193cc7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.560987 Jan 22 21:18:22.554096 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2961/5658] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:21 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:22.857991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f27f61fc-f7de-4552-a51c-4945340ed62c tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:22.858766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f27f61fc-f7de-4552-a51c-4945340ed62c tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:22.873342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f27f61fc-f7de-4552-a51c-4945340ed62c tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:22.875803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f27f61fc-f7de-4552-a51c-4945340ed62c tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:22.875803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f27f61fc-f7de-4552-a51c-4945340ed62c tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:22.875803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f27f61fc-f7de-4552-a51c-4945340ed62c tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:23.000946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-489cde26-0f32-4424-a937-486817ccfac6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:23.001846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-489cde26-0f32-4424-a937-486817ccfac6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:23.014687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-489cde26-0f32-4424-a937-486817ccfac6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:23.022070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-489cde26-0f32-4424-a937-486817ccfac6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:23.022982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-489cde26-0f32-4424-a937-486817ccfac6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:23.023448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-489cde26-0f32-4424-a937-486817ccfac6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:23.080026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-489cde26-0f32-4424-a937-486817ccfac6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:23.080494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-489cde26-0f32-4424-a937-486817ccfac6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:23.081152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-489cde26-0f32-4424-a937-486817ccfac6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lazy-loading 'fault' on Instance uuid 003afb2c-4163-45fa-8f37-346bd32ffb62 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:18:23.136117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-489cde26-0f32-4424-a937-486817ccfac6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:23.145229 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-489cde26-0f32-4424-a937-486817ccfac6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 200 len: 1309 microversion: 2.1 time: 0.148726 Jan 22 21:18:23.164438 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2962/5659] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:22 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 1309 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:18:23.293338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f27f61fc-f7de-4552-a51c-4945340ed62c tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:23.308145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f27f61fc-f7de-4552-a51c-4945340ed62c tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:23.309735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f27f61fc-f7de-4552-a51c-4945340ed62c tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:23.310917 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f27f61fc-f7de-4552-a51c-4945340ed62c tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1358 microversion: 2.21 time: 0.457110 Jan 22 21:18:23.313203 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2698/5660] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:22 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1358 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:23.329183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dda0b43d-1210-4f95-9531-6f80d794bfea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:23.330917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dda0b43d-1210-4f95-9531-6f80d794bfea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:23.337601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dda0b43d-1210-4f95-9531-6f80d794bfea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:23.338401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dda0b43d-1210-4f95-9531-6f80d794bfea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:23.339446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dda0b43d-1210-4f95-9531-6f80d794bfea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:23.339967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dda0b43d-1210-4f95-9531-6f80d794bfea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:23.424020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c3d55cbd-5d0a-4f16-8555-74736cb77ee9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:23.425275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c3d55cbd-5d0a-4f16-8555-74736cb77ee9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:23.445292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3d55cbd-5d0a-4f16-8555-74736cb77ee9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:23.446210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3d55cbd-5d0a-4f16-8555-74736cb77ee9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:23.447762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3d55cbd-5d0a-4f16-8555-74736cb77ee9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:23.448452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3d55cbd-5d0a-4f16-8555-74736cb77ee9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:23.527428 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c3d55cbd-5d0a-4f16-8555-74736cb77ee9 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.107800 Jan 22 21:18:23.533241 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2699/5661] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:23 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:23.541947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-05e0caf2-5c2a-45a9-9fb0-a1a042c1de61 req-fd4c67af-5dac-4580-84b3-152a81437083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "003afb2c-4163-45fa-8f37-346bd32ffb62", "name": "network-vif-deleted", "tag": "3c7d1f54-9806-4bb5-be24-a5cc055adc17"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:23.543921 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:23.543921 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:18:23.555555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-05e0caf2-5c2a-45a9-9fb0-a1a042c1de61 req-fd4c67af-5dac-4580-84b3-152a81437083 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:23.556317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-05e0caf2-5c2a-45a9-9fb0-a1a042c1de61 req-fd4c67af-5dac-4580-84b3-152a81437083 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:23.571291 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-05e0caf2-5c2a-45a9-9fb0-a1a042c1de61 req-fd4c67af-5dac-4580-84b3-152a81437083 service nova] Creating event network-vif-deleted:3c7d1f54-9806-4bb5-be24-a5cc055adc17 for instance 003afb2c-4163-45fa-8f37-346bd32ffb62 on nch2-master-1 Jan 22 21:18:23.578001 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-05e0caf2-5c2a-45a9-9fb0-a1a042c1de61 req-fd4c67af-5dac-4580-84b3-152a81437083 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039549 Jan 22 21:18:23.578001 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2700/5662] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:23.582261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dda0b43d-1210-4f95-9531-6f80d794bfea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:23.584539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-db736c34-e27b-4dc9-8183-de339edc7d69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:23.585462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-db736c34-e27b-4dc9-8183-de339edc7d69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:23.595658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db736c34-e27b-4dc9-8183-de339edc7d69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:23.596885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db736c34-e27b-4dc9-8183-de339edc7d69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:23.599681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db736c34-e27b-4dc9-8183-de339edc7d69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:23.603018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db736c34-e27b-4dc9-8183-de339edc7d69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:23.607905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dda0b43d-1210-4f95-9531-6f80d794bfea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:23.618084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dda0b43d-1210-4f95-9531-6f80d794bfea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:23.623492 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dda0b43d-1210-4f95-9531-6f80d794bfea tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1337 microversion: 2.20 time: 0.295069 Jan 22 21:18:23.625280 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2963/5663] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:23 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1337 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:23.658838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8ea0a196-7b26-4779-a16d-0b42ad0ab6cd tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:23.659462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8ea0a196-7b26-4779-a16d-0b42ad0ab6cd tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:23.674271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea0a196-7b26-4779-a16d-0b42ad0ab6cd tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:23.675875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea0a196-7b26-4779-a16d-0b42ad0ab6cd tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:23.676718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea0a196-7b26-4779-a16d-0b42ad0ab6cd tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:23.677303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea0a196-7b26-4779-a16d-0b42ad0ab6cd tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:23.940142 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8ea0a196-7b26-4779-a16d-0b42ad0ab6cd tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1836 microversion: 2.1 time: 0.286684 Jan 22 21:18:23.941586 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2964/5664] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:23 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1836 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:24.177539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-158b08d9-b690-4b60-9992-76795f59b83b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:24.178172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-158b08d9-b690-4b60-9992-76795f59b83b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:24.196009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-158b08d9-b690-4b60-9992-76795f59b83b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:24.196490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-158b08d9-b690-4b60-9992-76795f59b83b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:24.197319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-158b08d9-b690-4b60-9992-76795f59b83b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:24.197818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-158b08d9-b690-4b60-9992-76795f59b83b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:24.245960 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-158b08d9-b690-4b60-9992-76795f59b83b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 003afb2c-4163-45fa-8f37-346bd32ffb62 could not be found. Jan 22 21:18:24.246512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-158b08d9-b690-4b60-9992-76795f59b83b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 003afb2c-4163-45fa-8f37-346bd32ffb62 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:18:24.247531 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-158b08d9-b690-4b60-9992-76795f59b83b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 404 len: 111 microversion: 2.1 time: 0.074250 Jan 22 21:18:24.248112 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2965/5665] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:24 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:18:24.320382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-db736c34-e27b-4dc9-8183-de339edc7d69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:24.335109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-48bfdcaa-c0b9-443d-817e-5e27a7477a62 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:24.335727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-48bfdcaa-c0b9-443d-817e-5e27a7477a62 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:24.347460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-db736c34-e27b-4dc9-8183-de339edc7d69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:24.348826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48bfdcaa-c0b9-443d-817e-5e27a7477a62 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:24.349537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48bfdcaa-c0b9-443d-817e-5e27a7477a62 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:24.349693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-db736c34-e27b-4dc9-8183-de339edc7d69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:24.350691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48bfdcaa-c0b9-443d-817e-5e27a7477a62 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:24.351162 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-db736c34-e27b-4dc9-8183-de339edc7d69 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.771689 Jan 22 21:18:24.351329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48bfdcaa-c0b9-443d-817e-5e27a7477a62 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:24.352370 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2701/5666] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:23 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:24.427295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-5cb7deaa-cb89-4899-af4b-ff38c0dc7271 req-b06094dd-d397-422e-894b-dba3d1c77891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15529edc-652d-4c8c-a493-f0dd111c6746", "name": "network-vif-plugged", "status": "completed", "tag": "aa19c896-c8ba-4f4e-8e35-09b719178cba"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:24.428852 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:24.428852 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:18:24.464940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5cb7deaa-cb89-4899-af4b-ff38c0dc7271 req-b06094dd-d397-422e-894b-dba3d1c77891 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:24.466715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5cb7deaa-cb89-4899-af4b-ff38c0dc7271 req-b06094dd-d397-422e-894b-dba3d1c77891 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:24.519043 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-5cb7deaa-cb89-4899-af4b-ff38c0dc7271 req-b06094dd-d397-422e-894b-dba3d1c77891 service nova] Creating event network-vif-plugged:aa19c896-c8ba-4f4e-8e35-09b719178cba for instance 15529edc-652d-4c8c-a493-f0dd111c6746 on nch2-master-1 Jan 22 21:18:24.523493 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-5cb7deaa-cb89-4899-af4b-ff38c0dc7271 req-b06094dd-d397-422e-894b-dba3d1c77891 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100168 Jan 22 21:18:24.524116 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2702/5667] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:18:24.529748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-956775120", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "96cc3928-7569-4c1f-becd-807913ebf734"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:24.626929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] validate_networks() for [('96cc3928-7569-4c1f-becd-807913ebf734', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:18:24.750780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-48bfdcaa-c0b9-443d-817e-5e27a7477a62 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:24.761720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-48bfdcaa-c0b9-443d-817e-5e27a7477a62 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:24.763585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-48bfdcaa-c0b9-443d-817e-5e27a7477a62 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:24.764738 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-48bfdcaa-c0b9-443d-817e-5e27a7477a62 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1358 microversion: 2.21 time: 0.438579 Jan 22 21:18:24.766527 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2966/5668] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:24 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1358 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:24.782319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7d4ac57c-8bbc-4949-9cfc-b5d476a69447 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:24.783739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7d4ac57c-8bbc-4949-9cfc-b5d476a69447 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:24.790276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d4ac57c-8bbc-4949-9cfc-b5d476a69447 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:24.790750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d4ac57c-8bbc-4949-9cfc-b5d476a69447 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:24.791560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d4ac57c-8bbc-4949-9cfc-b5d476a69447 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:24.792722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7d4ac57c-8bbc-4949-9cfc-b5d476a69447 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:24.843434 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7d4ac57c-8bbc-4949-9cfc-b5d476a69447 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.064480 Jan 22 21:18:24.844591 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2967/5669] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:24 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:24.852065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-097ee9db-b19e-4a07-80ee-576ebc217edd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:24.854122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-097ee9db-b19e-4a07-80ee-576ebc217edd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:24.860433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-097ee9db-b19e-4a07-80ee-576ebc217edd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:24.860880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-097ee9db-b19e-4a07-80ee-576ebc217edd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:24.861750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-097ee9db-b19e-4a07-80ee-576ebc217edd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:24.862195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-097ee9db-b19e-4a07-80ee-576ebc217edd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:24.926603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-097ee9db-b19e-4a07-80ee-576ebc217edd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:24.935750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-097ee9db-b19e-4a07-80ee-576ebc217edd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:24.938365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-097ee9db-b19e-4a07-80ee-576ebc217edd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:24.940382 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-097ee9db-b19e-4a07-80ee-576ebc217edd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1343 microversion: 2.20 time: 0.093547 Jan 22 21:18:24.940382 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2968/5670] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:24 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1343 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:25.372148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e3c5ccd-945c-4581-ae5c-f7b0f1d5ce19 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:25.372995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e3c5ccd-945c-4581-ae5c-f7b0f1d5ce19 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:25.384659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e3c5ccd-945c-4581-ae5c-f7b0f1d5ce19 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:25.385372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e3c5ccd-945c-4581-ae5c-f7b0f1d5ce19 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:25.386472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e3c5ccd-945c-4581-ae5c-f7b0f1d5ce19 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:25.387188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e3c5ccd-945c-4581-ae5c-f7b0f1d5ce19 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:25.655122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5e3c5ccd-945c-4581-ae5c-f7b0f1d5ce19 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:25.669179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5e3c5ccd-945c-4581-ae5c-f7b0f1d5ce19 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:25.672929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5e3c5ccd-945c-4581-ae5c-f7b0f1d5ce19 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:25.680595 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e3c5ccd-945c-4581-ae5c-f7b0f1d5ce19 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.306262 Jan 22 21:18:25.680595 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2969/5671] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:25 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:25.680595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5a5ff7c0-7f25-40e0-ac96-51f088b115bb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:25.681421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5a5ff7c0-7f25-40e0-ac96-51f088b115bb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:25.689665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a5ff7c0-7f25-40e0-ac96-51f088b115bb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:25.691010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a5ff7c0-7f25-40e0-ac96-51f088b115bb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:25.693603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a5ff7c0-7f25-40e0-ac96-51f088b115bb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:25.694311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a5ff7c0-7f25-40e0-ac96-51f088b115bb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:25.729449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5a5ff7c0-7f25-40e0-ac96-51f088b115bb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:18:26.025111 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5a5ff7c0-7f25-40e0-ac96-51f088b115bb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "DELETE /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 204 len: 0 microversion: 2.1 time: 0.347916 Jan 22 21:18:26.033032 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2970/5672] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:18:25 2022] DELETE /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:18:26.260998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-ba69909f-943e-47cd-a2e3-774eb2576d24 req-0032f561-015d-4b19-aecb-50d362066561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdde4f64-417f-4c19-ac24-3250a9619db1", "tag": "a1a87111-ee94-490d-8f2e-69e60e3d6517"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:26.263884 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:26.263884 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:18:26.273201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ba69909f-943e-47cd-a2e3-774eb2576d24 req-0032f561-015d-4b19-aecb-50d362066561 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:26.273984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ba69909f-943e-47cd-a2e3-774eb2576d24 req-0032f561-015d-4b19-aecb-50d362066561 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:26.288744 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-ba69909f-943e-47cd-a2e3-774eb2576d24 req-0032f561-015d-4b19-aecb-50d362066561 service nova] Creating event network-changed:a1a87111-ee94-490d-8f2e-69e60e3d6517 for instance cdde4f64-417f-4c19-ac24-3250a9619db1 on nch1-master-1 Jan 22 21:18:26.294663 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-ba69909f-943e-47cd-a2e3-774eb2576d24 req-0032f561-015d-4b19-aecb-50d362066561 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258823 Jan 22 21:18:26.299518 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2971/5673] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:26.317144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8688b837-a1a3-4ace-bcf5-053a09ede019 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:26.319939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8688b837-a1a3-4ace-bcf5-053a09ede019 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:26.328187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8688b837-a1a3-4ace-bcf5-053a09ede019 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:26.337549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8688b837-a1a3-4ace-bcf5-053a09ede019 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:26.337549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8688b837-a1a3-4ace-bcf5-053a09ede019 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:26.337549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8688b837-a1a3-4ace-bcf5-053a09ede019 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:26.447809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:18:26.449578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:18:26.449578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:18:26.449801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:18:26.450068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:18:26.486900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:26.487361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:26.489708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:26.490185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:26.569249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Getting quotas for project 5b1c3aa9e1ae4cc8a5a021434ad4a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:18:26.584077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Getting quotas for user b93108a71872461ea979735a490694a6 and project 5b1c3aa9e1ae4cc8a5a021434ad4a59c. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:18:26.610838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:18:26.613642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:18:26.749994 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-83f16668-963f-44eb-a66d-660fa27253b6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.223593 Jan 22 21:18:26.752811 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2703/5674] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:18:24 2022] POST /compute/v2.1/servers => generated 382 bytes in 2228 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:18:26.759323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-57b142ea-9cd9-4ed5-bb10-c753fb1a4c24 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:26.760377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-57b142ea-9cd9-4ed5-bb10-c753fb1a4c24 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:26.786251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57b142ea-9cd9-4ed5-bb10-c753fb1a4c24 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:26.787244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57b142ea-9cd9-4ed5-bb10-c753fb1a4c24 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:26.788288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57b142ea-9cd9-4ed5-bb10-c753fb1a4c24 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:26.788977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57b142ea-9cd9-4ed5-bb10-c753fb1a4c24 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:26.882048 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-57b142ea-9cd9-4ed5-bb10-c753fb1a4c24 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.127881 Jan 22 21:18:26.885007 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2704/5675] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:26 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:26.899759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab520e7c-078a-45df-8292-8bb40ba33ed5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:26.916537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab520e7c-078a-45df-8292-8bb40ba33ed5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:26.942058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab520e7c-078a-45df-8292-8bb40ba33ed5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:26.944105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab520e7c-078a-45df-8292-8bb40ba33ed5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:26.947039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab520e7c-078a-45df-8292-8bb40ba33ed5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:26.949203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab520e7c-078a-45df-8292-8bb40ba33ed5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:27.133532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab520e7c-078a-45df-8292-8bb40ba33ed5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:27.143750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab520e7c-078a-45df-8292-8bb40ba33ed5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:27.145434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab520e7c-078a-45df-8292-8bb40ba33ed5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:27.146673 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab520e7c-078a-45df-8292-8bb40ba33ed5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1343 microversion: 2.20 time: 0.260150 Jan 22 21:18:27.147242 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2705/5676] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:26 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1343 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:27.160353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-91690444-25df-4bc2-8b50-a83fefc6ab3e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:27.161392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-91690444-25df-4bc2-8b50-a83fefc6ab3e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:27.168876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91690444-25df-4bc2-8b50-a83fefc6ab3e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:27.169624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91690444-25df-4bc2-8b50-a83fefc6ab3e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:27.170616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91690444-25df-4bc2-8b50-a83fefc6ab3e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:27.171799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91690444-25df-4bc2-8b50-a83fefc6ab3e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:27.220572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8688b837-a1a3-4ace-bcf5-053a09ede019 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:27.241130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8688b837-a1a3-4ace-bcf5-053a09ede019 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:27.241130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8688b837-a1a3-4ace-bcf5-053a09ede019 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:27.242705 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8688b837-a1a3-4ace-bcf5-053a09ede019 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1358 microversion: 2.21 time: 0.941759 Jan 22 21:18:27.246020 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2972/5677] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:26 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1358 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:27.254464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-13b2709c-312c-4adf-926f-802b1f39aea9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:27.255209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-13b2709c-312c-4adf-926f-802b1f39aea9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:27.262080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13b2709c-312c-4adf-926f-802b1f39aea9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:27.262750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13b2709c-312c-4adf-926f-802b1f39aea9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:27.263949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13b2709c-312c-4adf-926f-802b1f39aea9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:27.264481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13b2709c-312c-4adf-926f-802b1f39aea9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:27.632335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13b2709c-312c-4adf-926f-802b1f39aea9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:27.643492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13b2709c-312c-4adf-926f-802b1f39aea9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:27.645137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13b2709c-312c-4adf-926f-802b1f39aea9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:27.648942 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-13b2709c-312c-4adf-926f-802b1f39aea9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.401780 Jan 22 21:18:27.649674 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2973/5678] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:27 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:27.655346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1dcd7382-95b3-47d3-af27-06cc2ec8e17a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:27.658735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1dcd7382-95b3-47d3-af27-06cc2ec8e17a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:27.745273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1dcd7382-95b3-47d3-af27-06cc2ec8e17a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:27.768653 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1dcd7382-95b3-47d3-af27-06cc2ec8e17a tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1218 microversion: 2.1 time: 0.106421 Jan 22 21:18:27.770437 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2974/5679] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:27 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:27.898928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-95059652-c5b3-4564-810f-e6573a2bebbd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:27.900588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-95059652-c5b3-4564-810f-e6573a2bebbd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:27.912811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95059652-c5b3-4564-810f-e6573a2bebbd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:27.913349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95059652-c5b3-4564-810f-e6573a2bebbd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:27.914641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95059652-c5b3-4564-810f-e6573a2bebbd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:27.915433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95059652-c5b3-4564-810f-e6573a2bebbd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:27.998874 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-95059652-c5b3-4564-810f-e6573a2bebbd tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.107609 Jan 22 21:18:28.001648 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2975/5680] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:27 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:28.165979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-18476051-c8c1-4307-8582-addbad99f57d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:28.167205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-18476051-c8c1-4307-8582-addbad99f57d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:28.177682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18476051-c8c1-4307-8582-addbad99f57d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:28.178614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18476051-c8c1-4307-8582-addbad99f57d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:28.179746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18476051-c8c1-4307-8582-addbad99f57d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:28.180369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18476051-c8c1-4307-8582-addbad99f57d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:28.201112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-91690444-25df-4bc2-8b50-a83fefc6ab3e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:28.211912 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-91690444-25df-4bc2-8b50-a83fefc6ab3e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1691 microversion: 2.1 time: 1.063270 Jan 22 21:18:28.215729 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2706/5681] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:27 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1691 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:28.265167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0c892d29-15f8-4663-af47-03c0bf4d6d56 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:28.267821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0c892d29-15f8-4663-af47-03c0bf4d6d56 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:28.281861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c892d29-15f8-4663-af47-03c0bf4d6d56 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:28.282319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c892d29-15f8-4663-af47-03c0bf4d6d56 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:28.283566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c892d29-15f8-4663-af47-03c0bf4d6d56 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:28.285975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c892d29-15f8-4663-af47-03c0bf4d6d56 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:28.566054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-18476051-c8c1-4307-8582-addbad99f57d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:28.577753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-18476051-c8c1-4307-8582-addbad99f57d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:28.581342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-18476051-c8c1-4307-8582-addbad99f57d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:28.583609 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-18476051-c8c1-4307-8582-addbad99f57d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1411 microversion: 2.20 time: 0.422014 Jan 22 21:18:28.594954 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2976/5682] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:28 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1411 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:28.681543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6944f892-a74a-4d25-8312-8b3c6ddca3fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:28.687898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6944f892-a74a-4d25-8312-8b3c6ddca3fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:28.698447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6944f892-a74a-4d25-8312-8b3c6ddca3fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:28.701274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6944f892-a74a-4d25-8312-8b3c6ddca3fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:28.703423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6944f892-a74a-4d25-8312-8b3c6ddca3fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:28.705221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6944f892-a74a-4d25-8312-8b3c6ddca3fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:29.117929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0c892d29-15f8-4663-af47-03c0bf4d6d56 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:29.136851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0c892d29-15f8-4663-af47-03c0bf4d6d56 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:29.143703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0c892d29-15f8-4663-af47-03c0bf4d6d56 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:29.149488 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0c892d29-15f8-4663-af47-03c0bf4d6d56 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1550 microversion: 2.21 time: 0.887131 Jan 22 21:18:29.150973 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2707/5683] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:28 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1550 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:29.161067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-80a379c3-c7a0-46f2-a1ab-82c7d4a77ab9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:29.161877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-80a379c3-c7a0-46f2-a1ab-82c7d4a77ab9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:29.177366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80a379c3-c7a0-46f2-a1ab-82c7d4a77ab9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:29.177984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80a379c3-c7a0-46f2-a1ab-82c7d4a77ab9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:29.178919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80a379c3-c7a0-46f2-a1ab-82c7d4a77ab9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:29.179605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80a379c3-c7a0-46f2-a1ab-82c7d4a77ab9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:29.397193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6944f892-a74a-4d25-8312-8b3c6ddca3fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:29.410888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6944f892-a74a-4d25-8312-8b3c6ddca3fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:29.410888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6944f892-a74a-4d25-8312-8b3c6ddca3fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:29.411162 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6944f892-a74a-4d25-8312-8b3c6ddca3fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.744960 Jan 22 21:18:29.423628 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2977/5684] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:28 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:29.441699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d69a188-6e14-4ac0-a415-b70336dc614a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:29.441699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d69a188-6e14-4ac0-a415-b70336dc614a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:29.455415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d69a188-6e14-4ac0-a415-b70336dc614a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:29.455937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d69a188-6e14-4ac0-a415-b70336dc614a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:29.457244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d69a188-6e14-4ac0-a415-b70336dc614a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:29.457811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d69a188-6e14-4ac0-a415-b70336dc614a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:29.524089 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d69a188-6e14-4ac0-a415-b70336dc614a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.098708 Jan 22 21:18:29.524961 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2978/5685] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:29 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:29.533864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d7f8c3a-f33e-4321-b426-af73db68ec12 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:29.534461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d7f8c3a-f33e-4321-b426-af73db68ec12 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:29.541758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d7f8c3a-f33e-4321-b426-af73db68ec12 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:29.542224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d7f8c3a-f33e-4321-b426-af73db68ec12 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:29.543056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d7f8c3a-f33e-4321-b426-af73db68ec12 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:29.543506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d7f8c3a-f33e-4321-b426-af73db68ec12 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:29.574292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d7f8c3a-f33e-4321-b426-af73db68ec12 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:18:29.699884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-80a379c3-c7a0-46f2-a1ab-82c7d4a77ab9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:29.710125 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-80a379c3-c7a0-46f2-a1ab-82c7d4a77ab9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1270 microversion: 2.1 time: 0.557893 Jan 22 21:18:29.719863 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2708/5686] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:29 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1270 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:29.724765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-062af959-11a1-43be-8a32-8bc059b4af7a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:29.725377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-062af959-11a1-43be-8a32-8bc059b4af7a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:29.735214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-062af959-11a1-43be-8a32-8bc059b4af7a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:29.735670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-062af959-11a1-43be-8a32-8bc059b4af7a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:29.736469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-062af959-11a1-43be-8a32-8bc059b4af7a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:29.736910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-062af959-11a1-43be-8a32-8bc059b4af7a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:29.940737 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d7f8c3a-f33e-4321-b426-af73db68ec12 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "DELETE /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 204 len: 0 microversion: 2.21 time: 0.409387 Jan 22 21:18:29.940737 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2979/5687] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:18:29 2022] DELETE /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:18:29.951312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3fe23f78-13c8-423b-bdca-bff72a6f8682 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:29.954148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3fe23f78-13c8-423b-bdca-bff72a6f8682 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:29.978588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fe23f78-13c8-423b-bdca-bff72a6f8682 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:29.980549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fe23f78-13c8-423b-bdca-bff72a6f8682 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:29.981658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fe23f78-13c8-423b-bdca-bff72a6f8682 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:29.982386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fe23f78-13c8-423b-bdca-bff72a6f8682 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:30.258451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3fe23f78-13c8-423b-bdca-bff72a6f8682 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:30.268189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3fe23f78-13c8-423b-bdca-bff72a6f8682 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:30.273929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3fe23f78-13c8-423b-bdca-bff72a6f8682 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:30.273929 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3fe23f78-13c8-423b-bdca-bff72a6f8682 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1411 microversion: 2.20 time: 0.330723 Jan 22 21:18:30.273929 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2980/5688] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:29 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1411 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:30.277616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d01b6a14-663f-4764-908d-c41d70305d5a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:30.278364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d01b6a14-663f-4764-908d-c41d70305d5a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:30.285373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d01b6a14-663f-4764-908d-c41d70305d5a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:30.285994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d01b6a14-663f-4764-908d-c41d70305d5a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:30.287056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d01b6a14-663f-4764-908d-c41d70305d5a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:30.287643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d01b6a14-663f-4764-908d-c41d70305d5a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:30.411297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-062af959-11a1-43be-8a32-8bc059b4af7a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:30.418903 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-062af959-11a1-43be-8a32-8bc059b4af7a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1572 microversion: 2.1 time: 0.698018 Jan 22 21:18:30.419719 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2709/5689] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:29 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1572 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:30.434244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2f0a0aa5-9781-43e1-ad16-0a73de51d53d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:30.443282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2f0a0aa5-9781-43e1-ad16-0a73de51d53d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:30.443282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0a0aa5-9781-43e1-ad16-0a73de51d53d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:30.443282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0a0aa5-9781-43e1-ad16-0a73de51d53d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:30.443282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0a0aa5-9781-43e1-ad16-0a73de51d53d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:30.443848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0a0aa5-9781-43e1-ad16-0a73de51d53d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:30.543267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d01b6a14-663f-4764-908d-c41d70305d5a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:30.554332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d01b6a14-663f-4764-908d-c41d70305d5a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:30.555901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d01b6a14-663f-4764-908d-c41d70305d5a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:30.557133 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d01b6a14-663f-4764-908d-c41d70305d5a tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1556 microversion: 2.21 time: 0.284449 Jan 22 21:18:30.558080 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2981/5690] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:30 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1556 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:30.574089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0cf86a77-3773-4c68-8925-2774e8a8e787 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:30.575085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0cf86a77-3773-4c68-8925-2774e8a8e787 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:30.583324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cf86a77-3773-4c68-8925-2774e8a8e787 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:30.583839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cf86a77-3773-4c68-8925-2774e8a8e787 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:30.584712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cf86a77-3773-4c68-8925-2774e8a8e787 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:30.585233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cf86a77-3773-4c68-8925-2774e8a8e787 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:30.639572 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0cf86a77-3773-4c68-8925-2774e8a8e787 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.078702 Jan 22 21:18:30.643879 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2982/5691] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:30 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:30.647868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-25821818-5fb7-49a8-854c-c93aff141447 req-1e932ec1-b453-47ad-87d7-fe0045c8d387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdde4f64-417f-4c19-ac24-3250a9619db1", "name": "network-vif-deleted", "tag": "a1a87111-ee94-490d-8f2e-69e60e3d6517"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:30.650085 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:30.650085 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:18:30.673624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-25821818-5fb7-49a8-854c-c93aff141447 req-1e932ec1-b453-47ad-87d7-fe0045c8d387 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:30.674101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-25821818-5fb7-49a8-854c-c93aff141447 req-1e932ec1-b453-47ad-87d7-fe0045c8d387 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:30.694704 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-25821818-5fb7-49a8-854c-c93aff141447 req-1e932ec1-b453-47ad-87d7-fe0045c8d387 service nova] Creating event network-vif-deleted:a1a87111-ee94-490d-8f2e-69e60e3d6517 for instance cdde4f64-417f-4c19-ac24-3250a9619db1 on nch1-master-1 Jan 22 21:18:30.701130 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-25821818-5fb7-49a8-854c-c93aff141447 req-1e932ec1-b453-47ad-87d7-fe0045c8d387 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054819 Jan 22 21:18:30.701130 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2983/5692] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:30.762446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-736974d5-e550-48f0-b67a-4bfc5d782d98 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:30.763167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-736974d5-e550-48f0-b67a-4bfc5d782d98 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:30.772741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736974d5-e550-48f0-b67a-4bfc5d782d98 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:30.773456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736974d5-e550-48f0-b67a-4bfc5d782d98 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:30.774503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736974d5-e550-48f0-b67a-4bfc5d782d98 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:30.776898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736974d5-e550-48f0-b67a-4bfc5d782d98 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:30.959386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-736974d5-e550-48f0-b67a-4bfc5d782d98 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:30.982456 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-736974d5-e550-48f0-b67a-4bfc5d782d98 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1276 microversion: 2.1 time: 0.235680 Jan 22 21:18:31.006071 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2984/5693] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:30 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1276 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:31.290382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1cf80c18-80f7-4a23-b236-6c75e97e33fd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:31.291003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1cf80c18-80f7-4a23-b236-6c75e97e33fd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:31.299701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cf80c18-80f7-4a23-b236-6c75e97e33fd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:31.300251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cf80c18-80f7-4a23-b236-6c75e97e33fd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:31.301145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cf80c18-80f7-4a23-b236-6c75e97e33fd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:31.301874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cf80c18-80f7-4a23-b236-6c75e97e33fd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:31.364821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2f0a0aa5-9781-43e1-ad16-0a73de51d53d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:31.376265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2f0a0aa5-9781-43e1-ad16-0a73de51d53d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:31.378158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2f0a0aa5-9781-43e1-ad16-0a73de51d53d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:31.381855 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2f0a0aa5-9781-43e1-ad16-0a73de51d53d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.951426 Jan 22 21:18:31.383262 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2710/5694] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:30 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:31.437052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6f211387-ed57-4c36-9c5f-b30b4d2560c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:31.437922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6f211387-ed57-4c36-9c5f-b30b4d2560c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:31.444281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f211387-ed57-4c36-9c5f-b30b4d2560c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:31.444762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f211387-ed57-4c36-9c5f-b30b4d2560c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:31.445844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f211387-ed57-4c36-9c5f-b30b4d2560c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:31.446357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f211387-ed57-4c36-9c5f-b30b4d2560c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:31.453650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1cf80c18-80f7-4a23-b236-6c75e97e33fd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:31.461965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1cf80c18-80f7-4a23-b236-6c75e97e33fd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:31.470340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1cf80c18-80f7-4a23-b236-6c75e97e33fd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:31.470340 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1cf80c18-80f7-4a23-b236-6c75e97e33fd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1411 microversion: 2.20 time: 0.178183 Jan 22 21:18:31.476472 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2985/5695] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:31 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1411 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:31.497267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f211387-ed57-4c36-9c5f-b30b4d2560c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:31.497800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f211387-ed57-4c36-9c5f-b30b4d2560c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:31.498269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-6f211387-ed57-4c36-9c5f-b30b4d2560c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lazy-loading 'fault' on Instance uuid cdde4f64-417f-4c19-ac24-3250a9619db1 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:18:31.576900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-09400063-93b6-4fbc-ad37-ee1cfac3351d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:31.578386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-09400063-93b6-4fbc-ad37-ee1cfac3351d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:31.585480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09400063-93b6-4fbc-ad37-ee1cfac3351d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:31.586260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09400063-93b6-4fbc-ad37-ee1cfac3351d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:31.589735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09400063-93b6-4fbc-ad37-ee1cfac3351d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:31.590125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09400063-93b6-4fbc-ad37-ee1cfac3351d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:31.710054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6f211387-ed57-4c36-9c5f-b30b4d2560c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:31.718677 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6f211387-ed57-4c36-9c5f-b30b4d2560c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 200 len: 1360 microversion: 2.1 time: 0.285517 Jan 22 21:18:31.731931 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2711/5696] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:31 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 1360 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:18:31.745991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48883ca2-1d2c-48ba-89c4-0636ccc541fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:31.748009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48883ca2-1d2c-48ba-89c4-0636ccc541fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:31.764028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48883ca2-1d2c-48ba-89c4-0636ccc541fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:31.769326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48883ca2-1d2c-48ba-89c4-0636ccc541fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:31.770391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48883ca2-1d2c-48ba-89c4-0636ccc541fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:31.770952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48883ca2-1d2c-48ba-89c4-0636ccc541fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:31.837011 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48883ca2-1d2c-48ba-89c4-0636ccc541fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.113120 Jan 22 21:18:31.841829 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2712/5697] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:31 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:31.939148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-09400063-93b6-4fbc-ad37-ee1cfac3351d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:31.953256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-09400063-93b6-4fbc-ad37-ee1cfac3351d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:31.955954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-09400063-93b6-4fbc-ad37-ee1cfac3351d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:31.957202 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-09400063-93b6-4fbc-ad37-ee1cfac3351d tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1556 microversion: 2.21 time: 0.384359 Jan 22 21:18:31.965551 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2986/5698] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:31 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1556 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:32.016734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5f2c3799-531f-4ade-9345-b9097868edd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:32.018111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5f2c3799-531f-4ade-9345-b9097868edd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:32.025570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f2c3799-531f-4ade-9345-b9097868edd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:32.026293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f2c3799-531f-4ade-9345-b9097868edd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:32.027293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f2c3799-531f-4ade-9345-b9097868edd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:32.027738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f2c3799-531f-4ade-9345-b9097868edd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:32.401591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9c3358fa-65a8-4680-b31e-326c8dfc8686 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:32.402314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9c3358fa-65a8-4680-b31e-326c8dfc8686 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:32.410724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c3358fa-65a8-4680-b31e-326c8dfc8686 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:32.411450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c3358fa-65a8-4680-b31e-326c8dfc8686 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:32.412283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c3358fa-65a8-4680-b31e-326c8dfc8686 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:32.412735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c3358fa-65a8-4680-b31e-326c8dfc8686 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:32.522945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5f2c3799-531f-4ade-9345-b9097868edd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:32.533949 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5f2c3799-531f-4ade-9345-b9097868edd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1276 microversion: 2.1 time: 0.521664 Jan 22 21:18:32.534922 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2713/5699] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:32 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1276 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:32.539915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-19dc1da2-d434-4751-a533-42a31983caca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:32.540974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-19dc1da2-d434-4751-a533-42a31983caca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:32.550179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19dc1da2-d434-4751-a533-42a31983caca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:32.551103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19dc1da2-d434-4751-a533-42a31983caca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:32.552081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19dc1da2-d434-4751-a533-42a31983caca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:32.552588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19dc1da2-d434-4751-a533-42a31983caca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:32.748314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9c3358fa-65a8-4680-b31e-326c8dfc8686 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:32.758896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9c3358fa-65a8-4680-b31e-326c8dfc8686 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:32.775288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9c3358fa-65a8-4680-b31e-326c8dfc8686 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:32.777356 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9c3358fa-65a8-4680-b31e-326c8dfc8686 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.379659 Jan 22 21:18:32.778721 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2987/5700] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:32 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:32.785394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7f9385ba-cf58-4983-8724-b472ba13281f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:32.789074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7f9385ba-cf58-4983-8724-b472ba13281f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: cdde4f64-417f-4c19-ac24-3250a9619db1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:32.805136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f9385ba-cf58-4983-8724-b472ba13281f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:32.816517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f9385ba-cf58-4983-8724-b472ba13281f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:32.818423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f9385ba-cf58-4983-8724-b472ba13281f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:32.819119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f9385ba-cf58-4983-8724-b472ba13281f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:32.853172 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-7f9385ba-cf58-4983-8724-b472ba13281f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] HTTP exception thrown: Instance cdde4f64-417f-4c19-ac24-3250a9619db1 could not be found. Jan 22 21:18:32.858888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7f9385ba-cf58-4983-8724-b472ba13281f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Returning 404 to user: Instance cdde4f64-417f-4c19-ac24-3250a9619db1 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:18:32.862692 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7f9385ba-cf58-4983-8724-b472ba13281f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1" status: 404 len: 111 microversion: 2.1 time: 0.081903 Jan 22 21:18:32.865362 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2988/5701] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:32 2022] GET /compute/v2.1/servers/cdde4f64-417f-4c19-ac24-3250a9619db1 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:18:32.871003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-798a9fd3-b105-4f81-b7f0-bf66d94878c0 req-ea34d119-9048-48ab-a91a-9e26039dcee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89583718-5186-41d5-b5f3-ad8997c3eb59", "tag": "f3926427-e4b0-4ea7-846d-98fa049e0b27"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:32.873274 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:32.873274 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:18:32.885530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-798a9fd3-b105-4f81-b7f0-bf66d94878c0 req-ea34d119-9048-48ab-a91a-9e26039dcee9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:32.887293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-798a9fd3-b105-4f81-b7f0-bf66d94878c0 req-ea34d119-9048-48ab-a91a-9e26039dcee9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:32.899961 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-798a9fd3-b105-4f81-b7f0-bf66d94878c0 req-ea34d119-9048-48ab-a91a-9e26039dcee9 service nova] Creating event network-changed:f3926427-e4b0-4ea7-846d-98fa049e0b27 for instance 89583718-5186-41d5-b5f3-ad8997c3eb59 on nch2-master-1 Jan 22 21:18:32.905794 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-798a9fd3-b105-4f81-b7f0-bf66d94878c0 req-ea34d119-9048-48ab-a91a-9e26039dcee9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038273 Jan 22 21:18:32.906809 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2989/5702] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:32.911958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-348981ff-21c1-416f-bc31-ec67f1550610 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:32.918780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-348981ff-21c1-416f-bc31-ec67f1550610 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:32.933300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-348981ff-21c1-416f-bc31-ec67f1550610 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:32.934176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-348981ff-21c1-416f-bc31-ec67f1550610 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:32.935231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-348981ff-21c1-416f-bc31-ec67f1550610 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:32.935894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-348981ff-21c1-416f-bc31-ec67f1550610 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:33.006357 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-348981ff-21c1-416f-bc31-ec67f1550610 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.098057 Jan 22 21:18:33.007832 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2990/5703] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:32 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:33.013256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-004eafc8-2c15-45c6-8519-2eb0fadb1da7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:33.015092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-004eafc8-2c15-45c6-8519-2eb0fadb1da7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:33.023230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-004eafc8-2c15-45c6-8519-2eb0fadb1da7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:33.023949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-004eafc8-2c15-45c6-8519-2eb0fadb1da7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:33.024939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-004eafc8-2c15-45c6-8519-2eb0fadb1da7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:33.025600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-004eafc8-2c15-45c6-8519-2eb0fadb1da7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:33.408646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-19dc1da2-d434-4751-a533-42a31983caca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:33.438215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-19dc1da2-d434-4751-a533-42a31983caca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:33.440190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-19dc1da2-d434-4751-a533-42a31983caca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:33.442544 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-19dc1da2-d434-4751-a533-42a31983caca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1411 microversion: 2.20 time: 0.906496 Jan 22 21:18:33.447520 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2714/5704] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:32 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1411 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:33.554866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-08a84249-409c-4e3b-8308-3b8c2975f4f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:33.558698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-08a84249-409c-4e3b-8308-3b8c2975f4f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:33.571542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08a84249-409c-4e3b-8308-3b8c2975f4f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:33.572275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08a84249-409c-4e3b-8308-3b8c2975f4f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:33.583062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08a84249-409c-4e3b-8308-3b8c2975f4f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:33.584641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08a84249-409c-4e3b-8308-3b8c2975f4f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:33.674557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-004eafc8-2c15-45c6-8519-2eb0fadb1da7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:33.692283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-004eafc8-2c15-45c6-8519-2eb0fadb1da7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:33.694398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-004eafc8-2c15-45c6-8519-2eb0fadb1da7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:33.696924 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-004eafc8-2c15-45c6-8519-2eb0fadb1da7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1556 microversion: 2.21 time: 0.687076 Jan 22 21:18:33.703211 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2991/5705] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:33 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1556 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:33.798218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1d7821d-6c5d-4d97-9f46-4ba92f1d97d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:33.799660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1d7821d-6c5d-4d97-9f46-4ba92f1d97d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:33.807458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1d7821d-6c5d-4d97-9f46-4ba92f1d97d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:33.808592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1d7821d-6c5d-4d97-9f46-4ba92f1d97d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:33.818949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1d7821d-6c5d-4d97-9f46-4ba92f1d97d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:33.819959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1d7821d-6c5d-4d97-9f46-4ba92f1d97d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:34.238102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1d7821d-6c5d-4d97-9f46-4ba92f1d97d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:34.254516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1d7821d-6c5d-4d97-9f46-4ba92f1d97d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:34.258122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1d7821d-6c5d-4d97-9f46-4ba92f1d97d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:34.259569 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1d7821d-6c5d-4d97-9f46-4ba92f1d97d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.465878 Jan 22 21:18:34.263401 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2992/5706] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:33 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:34.273069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1cc6cf61-4c93-424b-8668-2a339902ba1a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:34.276910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1cc6cf61-4c93-424b-8668-2a339902ba1a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:34.297769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cc6cf61-4c93-424b-8668-2a339902ba1a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:34.298326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cc6cf61-4c93-424b-8668-2a339902ba1a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:34.300710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cc6cf61-4c93-424b-8668-2a339902ba1a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:34.302017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cc6cf61-4c93-424b-8668-2a339902ba1a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:34.365516 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1cc6cf61-4c93-424b-8668-2a339902ba1a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.100542 Jan 22 21:18:34.366408 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2993/5707] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:34 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:34.460860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-acf7fd39-74f2-43e0-ba85-1273c6d9a036 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:34.461670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-acf7fd39-74f2-43e0-ba85-1273c6d9a036 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:34.471179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acf7fd39-74f2-43e0-ba85-1273c6d9a036 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:34.471805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acf7fd39-74f2-43e0-ba85-1273c6d9a036 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:34.472973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acf7fd39-74f2-43e0-ba85-1273c6d9a036 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:34.475879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acf7fd39-74f2-43e0-ba85-1273c6d9a036 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:34.594950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-08a84249-409c-4e3b-8308-3b8c2975f4f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:34.603074 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-08a84249-409c-4e3b-8308-3b8c2975f4f8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1318 microversion: 2.1 time: 1.055108 Jan 22 21:18:34.613243 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2715/5708] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:33 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1318 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:34.720857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f4cb8fea-3a61-41f9-b96b-79e35bce9e07 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:34.721823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f4cb8fea-3a61-41f9-b96b-79e35bce9e07 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:34.729313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4cb8fea-3a61-41f9-b96b-79e35bce9e07 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:34.729824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4cb8fea-3a61-41f9-b96b-79e35bce9e07 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:34.730645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4cb8fea-3a61-41f9-b96b-79e35bce9e07 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:34.731682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4cb8fea-3a61-41f9-b96b-79e35bce9e07 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:34.830528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-acf7fd39-74f2-43e0-ba85-1273c6d9a036 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:34.842254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-acf7fd39-74f2-43e0-ba85-1273c6d9a036 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:34.844904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-acf7fd39-74f2-43e0-ba85-1273c6d9a036 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:34.846518 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-acf7fd39-74f2-43e0-ba85-1273c6d9a036 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1411 microversion: 2.20 time: 0.389657 Jan 22 21:18:34.847738 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2994/5709] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:34 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1411 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:34.899251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f4cb8fea-3a61-41f9-b96b-79e35bce9e07 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:34.910160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f4cb8fea-3a61-41f9-b96b-79e35bce9e07 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:34.912394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f4cb8fea-3a61-41f9-b96b-79e35bce9e07 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ddc507bb7842679bc465847e00ed3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b00237a726f43a680de4033f6bc83be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:34.914260 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f4cb8fea-3a61-41f9-b96b-79e35bce9e07 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 200 len: 1514 microversion: 2.21 time: 0.197934 Jan 22 21:18:34.915016 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2716/5710] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:34 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:34.991244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-f14dfb8b-bb78-4d53-a4eb-e360d98042f3 req-c564609d-24e7-4d17-b64a-1f72ee69b069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15529edc-652d-4c8c-a493-f0dd111c6746", "name": "network-vif-deleted", "tag": "aa19c896-c8ba-4f4e-8e35-09b719178cba"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:34.998324 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:34.998324 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:18:35.003030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f14dfb8b-bb78-4d53-a4eb-e360d98042f3 req-c564609d-24e7-4d17-b64a-1f72ee69b069 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:35.003800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f14dfb8b-bb78-4d53-a4eb-e360d98042f3 req-c564609d-24e7-4d17-b64a-1f72ee69b069 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:35.030644 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f14dfb8b-bb78-4d53-a4eb-e360d98042f3 req-c564609d-24e7-4d17-b64a-1f72ee69b069 service nova] Creating event network-vif-deleted:aa19c896-c8ba-4f4e-8e35-09b719178cba for instance 15529edc-652d-4c8c-a493-f0dd111c6746 on nch2-master-1 Jan 22 21:18:35.041610 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-f14dfb8b-bb78-4d53-a4eb-e360d98042f3 req-c564609d-24e7-4d17-b64a-1f72ee69b069 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055000 Jan 22 21:18:35.044872 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2995/5711] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:35.282078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-56ccd418-732a-43a3-b13a-86b014a71148 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:35.283541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-56ccd418-732a-43a3-b13a-86b014a71148 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:35.321442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56ccd418-732a-43a3-b13a-86b014a71148 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:35.323132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56ccd418-732a-43a3-b13a-86b014a71148 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:35.324466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56ccd418-732a-43a3-b13a-86b014a71148 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:35.325443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56ccd418-732a-43a3-b13a-86b014a71148 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:35.378812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d344cd18-f473-432c-91ee-d8dc23d6c339 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:35.379847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d344cd18-f473-432c-91ee-d8dc23d6c339 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:35.394709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d344cd18-f473-432c-91ee-d8dc23d6c339 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:35.395178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d344cd18-f473-432c-91ee-d8dc23d6c339 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:35.396025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d344cd18-f473-432c-91ee-d8dc23d6c339 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:35.396475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d344cd18-f473-432c-91ee-d8dc23d6c339 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:35.491562 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d344cd18-f473-432c-91ee-d8dc23d6c339 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.116884 Jan 22 21:18:35.497390 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2996/5712] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:35 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:18:35.625784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bbf5f766-7778-4354-bb6a-238670043298 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:35.631376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bbf5f766-7778-4354-bb6a-238670043298 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:35.647175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbf5f766-7778-4354-bb6a-238670043298 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:35.647636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbf5f766-7778-4354-bb6a-238670043298 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:35.648461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbf5f766-7778-4354-bb6a-238670043298 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:35.648908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbf5f766-7778-4354-bb6a-238670043298 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:36.361317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bbf5f766-7778-4354-bb6a-238670043298 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:36.384232 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bbf5f766-7778-4354-bb6a-238670043298 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1318 microversion: 2.1 time: 0.767477 Jan 22 21:18:36.388959 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2997/5713] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:35 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1318 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:18:36.419504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cde5fff9-b591-4920-97c4-f0764139eba6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:36.420244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cde5fff9-b591-4920-97c4-f0764139eba6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:36.437645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cde5fff9-b591-4920-97c4-f0764139eba6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:36.440520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cde5fff9-b591-4920-97c4-f0764139eba6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:36.443239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cde5fff9-b591-4920-97c4-f0764139eba6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:36.443701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cde5fff9-b591-4920-97c4-f0764139eba6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:36.461883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-56ccd418-732a-43a3-b13a-86b014a71148 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:36.478163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-56ccd418-732a-43a3-b13a-86b014a71148 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:36.482046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-56ccd418-732a-43a3-b13a-86b014a71148 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:36.484885 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-56ccd418-732a-43a3-b13a-86b014a71148 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 1.208489 Jan 22 21:18:36.487302 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2717/5714] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:35 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:36.492300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f1104584-77b0-492a-a762-4e250a3e8de6 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:36.493125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f1104584-77b0-492a-a762-4e250a3e8de6 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:36.516863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1104584-77b0-492a-a762-4e250a3e8de6 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:36.517574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1104584-77b0-492a-a762-4e250a3e8de6 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:36.518827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1104584-77b0-492a-a762-4e250a3e8de6 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:36.519497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1104584-77b0-492a-a762-4e250a3e8de6 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:36.548994 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-f1104584-77b0-492a-a762-4e250a3e8de6 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] HTTP exception thrown: Instance 15529edc-652d-4c8c-a493-f0dd111c6746 could not be found. Jan 22 21:18:36.558477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f1104584-77b0-492a-a762-4e250a3e8de6 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Returning 404 to user: Instance 15529edc-652d-4c8c-a493-f0dd111c6746 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:18:36.559841 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f1104584-77b0-492a-a762-4e250a3e8de6 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 404 len: 111 microversion: 2.21 time: 0.071081 Jan 22 21:18:36.560901 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2718/5715] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:36 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:18:36.566432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2dfa4ca6-7143-4e62-b97d-41a425e6a6cb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:36.573529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2dfa4ca6-7143-4e62-b97d-41a425e6a6cb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:36.587452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2dfa4ca6-7143-4e62-b97d-41a425e6a6cb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:36.587923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2dfa4ca6-7143-4e62-b97d-41a425e6a6cb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:36.588893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2dfa4ca6-7143-4e62-b97d-41a425e6a6cb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:36.589175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2dfa4ca6-7143-4e62-b97d-41a425e6a6cb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:36.635544 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2dfa4ca6-7143-4e62-b97d-41a425e6a6cb tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.072427 Jan 22 21:18:36.636735 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2719/5716] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:36 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:36.643168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5778749f-c3c6-428a-b434-ac61131d0ca7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '.version_select at 0x7f1ed4d8bdc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:36.643940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5778749f-c3c6-428a-b434-ac61131d0ca7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:36.651676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5778749f-c3c6-428a-b434-ac61131d0ca7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:36.652275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5778749f-c3c6-428a-b434-ac61131d0ca7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:36.653095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5778749f-c3c6-428a-b434-ac61131d0ca7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:36.653666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5778749f-c3c6-428a-b434-ac61131d0ca7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:36.746765 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5778749f-c3c6-428a-b434-ac61131d0ca7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.108772 Jan 22 21:18:36.747347 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2720/5717] 10.222.0.100 () {60 vars in 1341 bytes} [Sat Jan 22 21:18:36 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746/os-instance-actions => generated 611 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:36.766309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9637ff65-4334-446e-850f-f7153989dec7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:36.767141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9637ff65-4334-446e-850f-f7153989dec7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:36.773915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9637ff65-4334-446e-850f-f7153989dec7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:36.774650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9637ff65-4334-446e-850f-f7153989dec7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:36.775653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9637ff65-4334-446e-850f-f7153989dec7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:36.776414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9637ff65-4334-446e-850f-f7153989dec7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:36.794602 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-9637ff65-4334-446e-850f-f7153989dec7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] HTTP exception thrown: Instance 15529edc-652d-4c8c-a493-f0dd111c6746 could not be found. Jan 22 21:18:36.795721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9637ff65-4334-446e-850f-f7153989dec7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Returning 404 to user: Instance 15529edc-652d-4c8c-a493-f0dd111c6746 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:18:36.797125 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9637ff65-4334-446e-850f-f7153989dec7 tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "DELETE /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 404 len: 111 microversion: 2.21 time: 0.035440 Jan 22 21:18:36.798049 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2721/5718] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:18:36 2022] DELETE /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 22 21:18:36.806382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b2dde6ab-a342-4d7a-9e75-2629c9617eec tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:36.807729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b2dde6ab-a342-4d7a-9e75-2629c9617eec tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] [instance: 15529edc-652d-4c8c-a493-f0dd111c6746] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:36.820772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2dde6ab-a342-4d7a-9e75-2629c9617eec tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:36.821242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2dde6ab-a342-4d7a-9e75-2629c9617eec tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:36.822101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2dde6ab-a342-4d7a-9e75-2629c9617eec tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:36.823188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2dde6ab-a342-4d7a-9e75-2629c9617eec tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:36.843875 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-b2dde6ab-a342-4d7a-9e75-2629c9617eec tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] HTTP exception thrown: Instance 15529edc-652d-4c8c-a493-f0dd111c6746 could not be found. Jan 22 21:18:36.844516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b2dde6ab-a342-4d7a-9e75-2629c9617eec tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] Returning 404 to user: Instance 15529edc-652d-4c8c-a493-f0dd111c6746 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:18:36.845706 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b2dde6ab-a342-4d7a-9e75-2629c9617eec tempest-InstanceActionsV221TestJSON-1819739399 tempest-InstanceActionsV221TestJSON-1819739399-project] 10.222.0.100 "GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746" status: 404 len: 111 microversion: 2.21 time: 0.043489 Jan 22 21:18:36.849756 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2722/5719] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:36 2022] GET /compute/v2.1/servers/15529edc-652d-4c8c-a493-f0dd111c6746 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:18:37.209746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cde5fff9-b591-4920-97c4-f0764139eba6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:37.222702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cde5fff9-b591-4920-97c4-f0764139eba6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:37.225183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cde5fff9-b591-4920-97c4-f0764139eba6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:37.226377 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cde5fff9-b591-4920-97c4-f0764139eba6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1411 microversion: 2.20 time: 0.834677 Jan 22 21:18:37.226956 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2998/5720] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:36 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1411 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:37.406680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3c080702-2cff-4de3-a132-18e5a453f78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:37.407911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3c080702-2cff-4de3-a132-18e5a453f78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:37.418795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c080702-2cff-4de3-a132-18e5a453f78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:37.419275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c080702-2cff-4de3-a132-18e5a453f78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:37.420072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c080702-2cff-4de3-a132-18e5a453f78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:37.421483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c080702-2cff-4de3-a132-18e5a453f78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:37.509624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-6f40c8fd-5e6a-4ff8-a6fa-b1797de051dc req-cfb1da63-1847-4776-996c-08e693a367f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e37baa6-5103-4ac9-99f5-3cb87ecb7be2", "tag": "4106a7ca-c629-490e-8151-691df9c930ba"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:37.513084 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:37.513084 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:18:37.533473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6f40c8fd-5e6a-4ff8-a6fa-b1797de051dc req-cfb1da63-1847-4776-996c-08e693a367f1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:37.534226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6f40c8fd-5e6a-4ff8-a6fa-b1797de051dc req-cfb1da63-1847-4776-996c-08e693a367f1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:37.554292 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-6f40c8fd-5e6a-4ff8-a6fa-b1797de051dc req-cfb1da63-1847-4776-996c-08e693a367f1 service nova] Creating event network-changed:4106a7ca-c629-490e-8151-691df9c930ba for instance 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 on nch1-master-1 Jan 22 21:18:37.563148 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-6f40c8fd-5e6a-4ff8-a6fa-b1797de051dc req-cfb1da63-1847-4776-996c-08e693a367f1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059789 Jan 22 21:18:37.564896 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 2999/5721] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:37.591364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7a0fc572-2d4a-4a21-84f2-d3edc48bd5e7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:37.592456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7a0fc572-2d4a-4a21-84f2-d3edc48bd5e7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:37.605429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a0fc572-2d4a-4a21-84f2-d3edc48bd5e7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:37.606274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a0fc572-2d4a-4a21-84f2-d3edc48bd5e7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:37.607399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a0fc572-2d4a-4a21-84f2-d3edc48bd5e7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:37.608529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a0fc572-2d4a-4a21-84f2-d3edc48bd5e7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:38.051208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3c080702-2cff-4de3-a132-18e5a453f78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:38.059948 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3c080702-2cff-4de3-a132-18e5a453f78e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1318 microversion: 2.1 time: 0.658916 Jan 22 21:18:38.060529 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2723/5722] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:37 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:38.077599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ced3c0f9-9ee6-40ed-889d-ad8168923b35 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:38.078822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ced3c0f9-9ee6-40ed-889d-ad8168923b35 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:38.091527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ced3c0f9-9ee6-40ed-889d-ad8168923b35 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:38.093807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ced3c0f9-9ee6-40ed-889d-ad8168923b35 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:38.095031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ced3c0f9-9ee6-40ed-889d-ad8168923b35 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:38.095653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ced3c0f9-9ee6-40ed-889d-ad8168923b35 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:38.161944 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ced3c0f9-9ee6-40ed-889d-ad8168923b35 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.095217 Jan 22 21:18:38.162827 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2724/5723] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:38 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:38.247470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-38e3f37b-b781-47fd-abd5-2d5843333072 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:38.247808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-38e3f37b-b781-47fd-abd5-2d5843333072 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:38.263905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38e3f37b-b781-47fd-abd5-2d5843333072 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:38.274493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38e3f37b-b781-47fd-abd5-2d5843333072 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:38.275635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38e3f37b-b781-47fd-abd5-2d5843333072 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:38.276253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38e3f37b-b781-47fd-abd5-2d5843333072 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:38.666740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7a0fc572-2d4a-4a21-84f2-d3edc48bd5e7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:38.666740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7a0fc572-2d4a-4a21-84f2-d3edc48bd5e7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:38.666740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7a0fc572-2d4a-4a21-84f2-d3edc48bd5e7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:38.666740 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7a0fc572-2d4a-4a21-84f2-d3edc48bd5e7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.925077 Jan 22 21:18:38.666740 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3000/5724] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:37 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:39.118622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f53637d6-f1fa-4656-9a15-f384066bba25 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:39.118622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f53637d6-f1fa-4656-9a15-f384066bba25 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:39.118622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f53637d6-f1fa-4656-9a15-f384066bba25 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:39.118622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f53637d6-f1fa-4656-9a15-f384066bba25 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:39.118622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f53637d6-f1fa-4656-9a15-f384066bba25 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:39.118622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f53637d6-f1fa-4656-9a15-f384066bba25 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:39.354908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-38e3f37b-b781-47fd-abd5-2d5843333072 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:39.368071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-38e3f37b-b781-47fd-abd5-2d5843333072 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:39.369926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-38e3f37b-b781-47fd-abd5-2d5843333072 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:39.371283 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-38e3f37b-b781-47fd-abd5-2d5843333072 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1411 microversion: 2.20 time: 1.128747 Jan 22 21:18:39.378972 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2725/5725] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:38 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1411 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:39.383906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-203ed630-8629-431c-81b2-1ced502b1b98 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:39.385122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-203ed630-8629-431c-81b2-1ced502b1b98 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:39.400898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203ed630-8629-431c-81b2-1ced502b1b98 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:39.400898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203ed630-8629-431c-81b2-1ced502b1b98 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:39.400898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203ed630-8629-431c-81b2-1ced502b1b98 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:39.400898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-203ed630-8629-431c-81b2-1ced502b1b98 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:39.408391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f53637d6-f1fa-4656-9a15-f384066bba25 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:39.422133 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f53637d6-f1fa-4656-9a15-f384066bba25 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1318 microversion: 2.1 time: 0.345665 Jan 22 21:18:39.435576 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3001/5726] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:39 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:18:39.540529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3e374c0c-2a2c-478e-b7bd-2e27c21bfcd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:39.541301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3e374c0c-2a2c-478e-b7bd-2e27c21bfcd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:39.553801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e374c0c-2a2c-478e-b7bd-2e27c21bfcd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:39.558344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e374c0c-2a2c-478e-b7bd-2e27c21bfcd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:39.559661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e374c0c-2a2c-478e-b7bd-2e27c21bfcd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:39.563028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e374c0c-2a2c-478e-b7bd-2e27c21bfcd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:39.752015 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-203ed630-8629-431c-81b2-1ced502b1b98 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.371406 Jan 22 21:18:39.753347 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2726/5727] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:39 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:40.008868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3e374c0c-2a2c-478e-b7bd-2e27c21bfcd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:40.026212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3e374c0c-2a2c-478e-b7bd-2e27c21bfcd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:40.027871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3e374c0c-2a2c-478e-b7bd-2e27c21bfcd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:40.033240 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3e374c0c-2a2c-478e-b7bd-2e27c21bfcd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.498084 Jan 22 21:18:40.037327 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3002/5728] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:39 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:40.110263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-84013da6-8c1c-47ea-95c1-c3c977aa727e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'create', calling method: .version_select at 0x7f1ed4e02940>, body: {"keypair": {"name": "tempest-keypair-398913025"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:40.151038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-84013da6-8c1c-47ea-95c1-c3c977aa727e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Getting quotas for project d988412c137748b097d3202432cb420c. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:18:40.183239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-84013da6-8c1c-47ea-95c1-c3c977aa727e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Getting quotas for user 7bb293ae35c445c1a091670ad02ce3ed and project d988412c137748b097d3202432cb420c. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:18:40.390640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d570f1a9-9779-48f6-81a1-cdce9104885e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:40.392308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d570f1a9-9779-48f6-81a1-cdce9104885e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:40.414064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d570f1a9-9779-48f6-81a1-cdce9104885e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:40.416634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d570f1a9-9779-48f6-81a1-cdce9104885e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:40.418855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d570f1a9-9779-48f6-81a1-cdce9104885e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:40.422439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d570f1a9-9779-48f6-81a1-cdce9104885e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:40.640683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d570f1a9-9779-48f6-81a1-cdce9104885e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:40.650941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d570f1a9-9779-48f6-81a1-cdce9104885e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:40.662098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d570f1a9-9779-48f6-81a1-cdce9104885e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:40.663614 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d570f1a9-9779-48f6-81a1-cdce9104885e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1411 microversion: 2.20 time: 0.278092 Jan 22 21:18:40.664553 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3003/5729] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:40 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1411 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:40.675211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c73c9df8-01df-478d-afbe-17491db8336b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:40.676500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c73c9df8-01df-478d-afbe-17491db8336b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:40.688408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c73c9df8-01df-478d-afbe-17491db8336b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:40.692504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c73c9df8-01df-478d-afbe-17491db8336b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:40.693636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c73c9df8-01df-478d-afbe-17491db8336b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:40.694426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c73c9df8-01df-478d-afbe-17491db8336b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:40.899883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c73c9df8-01df-478d-afbe-17491db8336b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:40.922526 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c73c9df8-01df-478d-afbe-17491db8336b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1318 microversion: 2.1 time: 0.256639 Jan 22 21:18:40.938061 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3004/5730] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:40 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:40.938328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-84013da6-8c1c-47ea-95c1-c3c977aa727e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Getting quotas for project d988412c137748b097d3202432cb420c. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:18:40.944806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-12b5de94-913d-4473-9d78-8d01907afa88 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:40.953438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-84013da6-8c1c-47ea-95c1-c3c977aa727e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Getting quotas for user 7bb293ae35c445c1a091670ad02ce3ed and project d988412c137748b097d3202432cb420c. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:18:40.954421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-12b5de94-913d-4473-9d78-8d01907afa88 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:40.977683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12b5de94-913d-4473-9d78-8d01907afa88 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:40.978493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12b5de94-913d-4473-9d78-8d01907afa88 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:40.979942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12b5de94-913d-4473-9d78-8d01907afa88 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:40.980840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12b5de94-913d-4473-9d78-8d01907afa88 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:40.989489 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-84013da6-8c1c-47ea-95c1-c3c977aa727e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.028537 Jan 22 21:18:40.990289 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2727/5731] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:18:39 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:41.053431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-51064652-f6cb-4f4f-8658-3f1f4c4fccbd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:41.054311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-51064652-f6cb-4f4f-8658-3f1f4c4fccbd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:41.057594 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-12b5de94-913d-4473-9d78-8d01907afa88 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.127095 Jan 22 21:18:41.061945 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3005/5732] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:40 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:41.065451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51064652-f6cb-4f4f-8658-3f1f4c4fccbd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:41.065963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51064652-f6cb-4f4f-8658-3f1f4c4fccbd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:41.069262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51064652-f6cb-4f4f-8658-3f1f4c4fccbd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:41.069527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51064652-f6cb-4f4f-8658-3f1f4c4fccbd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:41.682615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3f91c504-6ec5-4f57-b7e4-f45a30bfb3cf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:41.683544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3f91c504-6ec5-4f57-b7e4-f45a30bfb3cf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:41.710916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f91c504-6ec5-4f57-b7e4-f45a30bfb3cf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:41.711387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f91c504-6ec5-4f57-b7e4-f45a30bfb3cf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:41.712217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f91c504-6ec5-4f57-b7e4-f45a30bfb3cf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:41.712673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f91c504-6ec5-4f57-b7e4-f45a30bfb3cf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:41.947966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-51064652-f6cb-4f4f-8658-3f1f4c4fccbd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:41.958096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-51064652-f6cb-4f4f-8658-3f1f4c4fccbd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:41.966620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-51064652-f6cb-4f4f-8658-3f1f4c4fccbd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:41.974233 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-51064652-f6cb-4f4f-8658-3f1f4c4fccbd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.925263 Jan 22 21:18:41.975638 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2728/5733] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:41 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:41.989881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-030d9883-66b3-4b86-93a5-aa67ee2d332c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:41.990559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-030d9883-66b3-4b86-93a5-aa67ee2d332c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:42.004101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-030d9883-66b3-4b86-93a5-aa67ee2d332c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:42.004840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-030d9883-66b3-4b86-93a5-aa67ee2d332c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:42.006069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-030d9883-66b3-4b86-93a5-aa67ee2d332c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:42.007910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-030d9883-66b3-4b86-93a5-aa67ee2d332c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:42.352368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-030d9883-66b3-4b86-93a5-aa67ee2d332c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:42.365693 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-030d9883-66b3-4b86-93a5-aa67ee2d332c tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1318 microversion: 2.1 time: 0.386076 Jan 22 21:18:42.367022 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2729/5734] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:41 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:42.378619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c92edad9-5be5-4d09-a8bc-2431cd8bb248 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:42.382467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c92edad9-5be5-4d09-a8bc-2431cd8bb248 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:42.399852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c92edad9-5be5-4d09-a8bc-2431cd8bb248 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:42.400425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c92edad9-5be5-4d09-a8bc-2431cd8bb248 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:42.401535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c92edad9-5be5-4d09-a8bc-2431cd8bb248 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:42.401946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c92edad9-5be5-4d09-a8bc-2431cd8bb248 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:42.446292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3f91c504-6ec5-4f57-b7e4-f45a30bfb3cf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:42.464639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3f91c504-6ec5-4f57-b7e4-f45a30bfb3cf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:42.471144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3f91c504-6ec5-4f57-b7e4-f45a30bfb3cf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:42.475918 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3f91c504-6ec5-4f57-b7e4-f45a30bfb3cf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1411 microversion: 2.20 time: 0.797263 Jan 22 21:18:42.477328 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3006/5735] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:41 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1411 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:42.492768 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c92edad9-5be5-4d09-a8bc-2431cd8bb248 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.119115 Jan 22 21:18:42.492768 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2730/5736] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:42 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:42.856808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-9c41cb4c-ad09-4333-8fc0-9fd49712b7d3 req-cb3a7208-5bf8-4180-9283-0100971234b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89583718-5186-41d5-b5f3-ad8997c3eb59", "name": "network-vif-plugged", "status": "completed", "tag": "f3926427-e4b0-4ea7-846d-98fa049e0b27"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:42.859234 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:42.859234 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:18:42.868508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9c41cb4c-ad09-4333-8fc0-9fd49712b7d3 req-cb3a7208-5bf8-4180-9283-0100971234b4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:42.869168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9c41cb4c-ad09-4333-8fc0-9fd49712b7d3 req-cb3a7208-5bf8-4180-9283-0100971234b4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:42.903727 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-9c41cb4c-ad09-4333-8fc0-9fd49712b7d3 req-cb3a7208-5bf8-4180-9283-0100971234b4 service nova] Creating event network-vif-plugged:f3926427-e4b0-4ea7-846d-98fa049e0b27 for instance 89583718-5186-41d5-b5f3-ad8997c3eb59 on nch2-master-1 Jan 22 21:18:42.914547 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-9c41cb4c-ad09-4333-8fc0-9fd49712b7d3 req-cb3a7208-5bf8-4180-9283-0100971234b4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061502 Jan 22 21:18:42.916143 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3007/5737] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:42.995683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ed4ecce1-8e06-4d5a-b428-15553b1badfb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:42.996535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ed4ecce1-8e06-4d5a-b428-15553b1badfb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:43.005429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed4ecce1-8e06-4d5a-b428-15553b1badfb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:43.006167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed4ecce1-8e06-4d5a-b428-15553b1badfb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:43.007227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed4ecce1-8e06-4d5a-b428-15553b1badfb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:43.007746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed4ecce1-8e06-4d5a-b428-15553b1badfb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:43.385764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6e46c382-d70b-4993-be12-00458a6703b0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:43.387470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6e46c382-d70b-4993-be12-00458a6703b0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:43.399945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e46c382-d70b-4993-be12-00458a6703b0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:43.400469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e46c382-d70b-4993-be12-00458a6703b0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:43.401300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e46c382-d70b-4993-be12-00458a6703b0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:43.401842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e46c382-d70b-4993-be12-00458a6703b0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:43.761531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6e46c382-d70b-4993-be12-00458a6703b0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:43.771818 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6e46c382-d70b-4993-be12-00458a6703b0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1318 microversion: 2.1 time: 0.391378 Jan 22 21:18:43.782937 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3008/5738] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:43 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:43.788735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e1c68346-675a-4f1a-850e-196dfecf01f1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:43.790091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e1c68346-675a-4f1a-850e-196dfecf01f1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:43.803931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1c68346-675a-4f1a-850e-196dfecf01f1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:43.806985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1c68346-675a-4f1a-850e-196dfecf01f1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:43.808000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1c68346-675a-4f1a-850e-196dfecf01f1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:43.809770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1c68346-675a-4f1a-850e-196dfecf01f1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:43.897088 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e1c68346-675a-4f1a-850e-196dfecf01f1 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.111777 Jan 22 21:18:43.899060 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3009/5739] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:43 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:43.911560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e991b863-980f-41e9-8c8c-2972cf55e528 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:43.915007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e991b863-980f-41e9-8c8c-2972cf55e528 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:43.940612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e991b863-980f-41e9-8c8c-2972cf55e528 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:43.941087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e991b863-980f-41e9-8c8c-2972cf55e528 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:43.941948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e991b863-980f-41e9-8c8c-2972cf55e528 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:43.942400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e991b863-980f-41e9-8c8c-2972cf55e528 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:44.137772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e991b863-980f-41e9-8c8c-2972cf55e528 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:44.152202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e991b863-980f-41e9-8c8c-2972cf55e528 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:44.152202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e991b863-980f-41e9-8c8c-2972cf55e528 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:44.152202 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e991b863-980f-41e9-8c8c-2972cf55e528 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1411 microversion: 2.20 time: 0.250753 Jan 22 21:18:44.152202 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3010/5740] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:43 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1411 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:44.157897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ff9b9992-06c7-4da5-9921-4d28d9d7e518 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '.version_select at 0x7f1ed5e5a040>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:44.265645 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ff9b9992-06c7-4da5-9921-4d28d9d7e518 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-164490969" status: 202 len: 0 microversion: 2.1 time: 0.112142 Jan 22 21:18:44.266166 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3011/5741] 10.222.0.100 () {58 vars in 1285 bytes} [Sat Jan 22 21:18:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-164490969 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:18:44.284824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ed4ecce1-8e06-4d5a-b428-15553b1badfb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:44.301995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a56c837-8967-49ab-8aa4-d6ef3a802aff tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'create', calling method: .version_select at 0x7f1ed5dcdee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2119116500"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:44.321721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ed4ecce1-8e06-4d5a-b428-15553b1badfb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:44.331095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ed4ecce1-8e06-4d5a-b428-15553b1badfb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:44.335995 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ed4ecce1-8e06-4d5a-b428-15553b1badfb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 1.345761 Jan 22 21:18:44.349770 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2731/5742] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:42 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:44.349933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-6a56c837-8967-49ab-8aa4-d6ef3a802aff tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:18:44.349933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-6a56c837-8967-49ab-8aa4-d6ef3a802aff tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for user 80aa2e03fde44436844a88a0ccc5d6a6 and project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:18:44.632124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-6a56c837-8967-49ab-8aa4-d6ef3a802aff tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:18:44.650608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-6a56c837-8967-49ab-8aa4-d6ef3a802aff tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for user 80aa2e03fde44436844a88a0ccc5d6a6 and project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:18:44.671745 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a56c837-8967-49ab-8aa4-d6ef3a802aff tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.378312 Jan 22 21:18:44.672651 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3012/5743] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:18:44 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:44.789474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e0fd5857-6002-4790-869f-63718b34adf0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:44.790113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e0fd5857-6002-4790-869f-63718b34adf0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:44.797452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0fd5857-6002-4790-869f-63718b34adf0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:44.797968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0fd5857-6002-4790-869f-63718b34adf0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:44.798780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0fd5857-6002-4790-869f-63718b34adf0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:44.799225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0fd5857-6002-4790-869f-63718b34adf0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:44.910569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e4501212-6ee7-4cc0-adcd-5d670874c0e4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:44.912127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e4501212-6ee7-4cc0-adcd-5d670874c0e4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:44.918146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4501212-6ee7-4cc0-adcd-5d670874c0e4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:44.918824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4501212-6ee7-4cc0-adcd-5d670874c0e4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:44.919675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4501212-6ee7-4cc0-adcd-5d670874c0e4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:44.920797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4501212-6ee7-4cc0-adcd-5d670874c0e4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:44.964833 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e4501212-6ee7-4cc0-adcd-5d670874c0e4 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.058783 Jan 22 21:18:44.968235 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3013/5744] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:44 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:45.172977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-06636806-eb96-40f8-b9a4-5f9ba2608edf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:45.174034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-06636806-eb96-40f8-b9a4-5f9ba2608edf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:45.183065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06636806-eb96-40f8-b9a4-5f9ba2608edf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:45.191983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06636806-eb96-40f8-b9a4-5f9ba2608edf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:45.191983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06636806-eb96-40f8-b9a4-5f9ba2608edf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:45.191983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06636806-eb96-40f8-b9a4-5f9ba2608edf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:45.192306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e0fd5857-6002-4790-869f-63718b34adf0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:45.300344 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e0fd5857-6002-4790-869f-63718b34adf0 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1318 microversion: 2.1 time: 0.514411 Jan 22 21:18:45.301723 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2732/5745] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:44 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:45.375383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0c20393c-e0cd-403f-ab28-6eb4564ef5cc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:45.376322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0c20393c-e0cd-403f-ab28-6eb4564ef5cc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:45.402444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c20393c-e0cd-403f-ab28-6eb4564ef5cc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:45.411567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c20393c-e0cd-403f-ab28-6eb4564ef5cc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:45.411567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c20393c-e0cd-403f-ab28-6eb4564ef5cc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:45.411567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c20393c-e0cd-403f-ab28-6eb4564ef5cc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:45.554474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-06636806-eb96-40f8-b9a4-5f9ba2608edf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:45.573174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-06636806-eb96-40f8-b9a4-5f9ba2608edf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:45.577607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-06636806-eb96-40f8-b9a4-5f9ba2608edf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:45.577607 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-06636806-eb96-40f8-b9a4-5f9ba2608edf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1411 microversion: 2.20 time: 0.409135 Jan 22 21:18:45.590626 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3014/5746] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:45 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1411 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:45.860727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-47278325", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "28582b08-6aaa-4654-93a2-8ea33a056a87"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:45.943265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0c20393c-e0cd-403f-ab28-6eb4564ef5cc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:45.949423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] validate_networks() for [('28582b08-6aaa-4654-93a2-8ea33a056a87', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:18:45.958138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0c20393c-e0cd-403f-ab28-6eb4564ef5cc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:45.959809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0c20393c-e0cd-403f-ab28-6eb4564ef5cc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:45.961007 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0c20393c-e0cd-403f-ab28-6eb4564ef5cc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.596011 Jan 22 21:18:45.967668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2733/5747] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:45 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:45.981838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1004f7fe-5027-46af-b58d-7ae31f1ac0d0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:45.983701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1004f7fe-5027-46af-b58d-7ae31f1ac0d0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:45.990184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1004f7fe-5027-46af-b58d-7ae31f1ac0d0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:45.991972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1004f7fe-5027-46af-b58d-7ae31f1ac0d0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:45.999069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1004f7fe-5027-46af-b58d-7ae31f1ac0d0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:45.999597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1004f7fe-5027-46af-b58d-7ae31f1ac0d0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:46.055931 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1004f7fe-5027-46af-b58d-7ae31f1ac0d0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.079170 Jan 22 21:18:46.059431 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2734/5748] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:45 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:46.318540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9bcbaa5f-8d31-42e8-8522-ad4c61bfc877 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:46.319952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9bcbaa5f-8d31-42e8-8522-ad4c61bfc877 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:46.327969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bcbaa5f-8d31-42e8-8522-ad4c61bfc877 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:46.334095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bcbaa5f-8d31-42e8-8522-ad4c61bfc877 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:46.337023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bcbaa5f-8d31-42e8-8522-ad4c61bfc877 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:46.337023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bcbaa5f-8d31-42e8-8522-ad4c61bfc877 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:46.585892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9bcbaa5f-8d31-42e8-8522-ad4c61bfc877 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:46.598419 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9bcbaa5f-8d31-42e8-8522-ad4c61bfc877 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1318 microversion: 2.1 time: 0.283692 Jan 22 21:18:46.601837 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2735/5749] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:46 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:46.620234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-80c52d3d-0fab-49da-993d-86f535e77c71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:46.620234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-80c52d3d-0fab-49da-993d-86f535e77c71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:46.620234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80c52d3d-0fab-49da-993d-86f535e77c71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:46.620234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80c52d3d-0fab-49da-993d-86f535e77c71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:46.620234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80c52d3d-0fab-49da-993d-86f535e77c71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:46.620234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80c52d3d-0fab-49da-993d-86f535e77c71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:46.789903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-80c52d3d-0fab-49da-993d-86f535e77c71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:46.801810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-80c52d3d-0fab-49da-993d-86f535e77c71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:46.803577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-80c52d3d-0fab-49da-993d-86f535e77c71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:46.805419 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-80c52d3d-0fab-49da-993d-86f535e77c71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1604 microversion: 2.20 time: 0.203871 Jan 22 21:18:46.806095 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2736/5750] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:46 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:46.813378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-926246500", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e6a3e089-8717-4d52-80e8-f2580a1bab02"}], "security_groups": [{"name": "tempest-securitygroup--1246842354"}], "key_name": "tempest-keypair-398913025", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:46.825390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:18:46.827735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:18:46.828813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:18:46.829388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:18:46.830536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:18:46.843477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:46.843971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:46.844877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:46.845644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:46.866863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Getting quotas for project 52fb7d7142184c10aa282c603e7326b4. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:18:46.872875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Getting quotas for user 23ab66c470684aa8928e804e65a691b0 and project 52fb7d7142184c10aa282c603e7326b4. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:18:46.887755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:18:46.894752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:18:46.944558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] validate_networks() for [('e6a3e089-8717-4d52-80e8-f2580a1bab02', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:18:47.074238 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aec7d221-52fa-4f1b-9c36-693bb1cbc4b7 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.393533 Jan 22 21:18:47.081048 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3015/5751] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:18:45 2022] POST /compute/v2.1/servers => generated 382 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:18:47.087663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-71a8ce78-16a6-4bd9-b9c4-28c713ee23b3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:47.088554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-71a8ce78-16a6-4bd9-b9c4-28c713ee23b3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:47.098968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71a8ce78-16a6-4bd9-b9c4-28c713ee23b3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:47.099854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71a8ce78-16a6-4bd9-b9c4-28c713ee23b3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:47.100911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71a8ce78-16a6-4bd9-b9c4-28c713ee23b3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:47.101700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71a8ce78-16a6-4bd9-b9c4-28c713ee23b3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:47.298800 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-71a8ce78-16a6-4bd9-b9c4-28c713ee23b3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.215009 Jan 22 21:18:47.299423 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3016/5752] 10.222.0.100 () {60 vars in 1320 bytes} [Sat Jan 22 21:18:47 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/os-interface => generated 285 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:47.308989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b43ba814-f333-4d1c-a283-f91c9a2336f1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:47.310475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b43ba814-f333-4d1c-a283-f91c9a2336f1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:47.327400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b43ba814-f333-4d1c-a283-f91c9a2336f1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:47.332725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b43ba814-f333-4d1c-a283-f91c9a2336f1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:47.332725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b43ba814-f333-4d1c-a283-f91c9a2336f1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:47.332725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b43ba814-f333-4d1c-a283-f91c9a2336f1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:47.903354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b43ba814-f333-4d1c-a283-f91c9a2336f1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:47.903868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Getting quotas for project d988412c137748b097d3202432cb420c. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:18:47.918530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b43ba814-f333-4d1c-a283-f91c9a2336f1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:47.918530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b43ba814-f333-4d1c-a283-f91c9a2336f1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:47.927724 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b43ba814-f333-4d1c-a283-f91c9a2336f1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.626809 Jan 22 21:18:47.928615 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3017/5753] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:47 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:47.942861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Getting quotas for user 7bb293ae35c445c1a091670ad02ce3ed and project d988412c137748b097d3202432cb420c. Resources: dict_keys(['metadata_items']) {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:18:47.948510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cab13beb-be17-4e4a-b490-c1a2809c415c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:47.949263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cab13beb-be17-4e4a-b490-c1a2809c415c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:47.965949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:18:47.967155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:18:47.967938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cab13beb-be17-4e4a-b490-c1a2809c415c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:47.968409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cab13beb-be17-4e4a-b490-c1a2809c415c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:47.969216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cab13beb-be17-4e4a-b490-c1a2809c415c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:47.969695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cab13beb-be17-4e4a-b490-c1a2809c415c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:47.970020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:18:47.971041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:18:47.972103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:18:47.991059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:47.991898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:47.992982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:47.993722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:48.046989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Getting quotas for project d988412c137748b097d3202432cb420c. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:18:48.063274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Getting quotas for user 7bb293ae35c445c1a091670ad02ce3ed and project d988412c137748b097d3202432cb420c. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:18:48.077658 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cab13beb-be17-4e4a-b490-c1a2809c415c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.141932 Jan 22 21:18:48.082584 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3018/5754] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:47 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:48.089612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8cc797f4-1dd2-40e5-ad4b-24ca6211de91 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:48.090781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8cc797f4-1dd2-40e5-ad4b-24ca6211de91 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:48.103277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:18:48.113293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:18:48.244198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8cc797f4-1dd2-40e5-ad4b-24ca6211de91 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:48.263976 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bae0572a-5311-4837-9ebd-4e767ddd6b77 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 1.455811 Jan 22 21:18:48.266535 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2737/5755] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:18:46 2022] POST /compute/v2.1/servers => generated 411 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:18:48.267984 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8cc797f4-1dd2-40e5-ad4b-24ca6211de91 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1218 microversion: 2.1 time: 0.186674 Jan 22 21:18:48.268695 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3019/5756] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:48 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1218 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:48.272498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b207e749-7382-45a7-b0c0-667422fc225e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:48.273348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b207e749-7382-45a7-b0c0-667422fc225e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:48.281849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b207e749-7382-45a7-b0c0-667422fc225e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:48.282666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b207e749-7382-45a7-b0c0-667422fc225e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:48.284424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b207e749-7382-45a7-b0c0-667422fc225e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:48.285052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-84c0ac19-2af7-4564-9844-ad0995729680 req-076cf1fe-b815-4197-8d91-23e2bf52e494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-plugged", "status": "completed", "tag": "6e0c2428-e53e-4cf5-abde-0f2811b46da4"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:48.285398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b207e749-7382-45a7-b0c0-667422fc225e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:48.286667 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:48.286667 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:18:48.297768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-84c0ac19-2af7-4564-9844-ad0995729680 req-076cf1fe-b815-4197-8d91-23e2bf52e494 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:48.297768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-84c0ac19-2af7-4564-9844-ad0995729680 req-076cf1fe-b815-4197-8d91-23e2bf52e494 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:48.317914 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-84c0ac19-2af7-4564-9844-ad0995729680 req-076cf1fe-b815-4197-8d91-23e2bf52e494 service nova] Creating event network-vif-plugged:6e0c2428-e53e-4cf5-abde-0f2811b46da4 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:18:48.324748 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-84c0ac19-2af7-4564-9844-ad0995729680 req-076cf1fe-b815-4197-8d91-23e2bf52e494 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055019 Jan 22 21:18:48.326113 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3020/5757] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:48.336069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-acdeb90f-00cc-4310-a944-91f422cd00a7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:48.336995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-acdeb90f-00cc-4310-a944-91f422cd00a7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:48.485361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-acdeb90f-00cc-4310-a944-91f422cd00a7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:48.517741 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-acdeb90f-00cc-4310-a944-91f422cd00a7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1280 microversion: 2.1 time: 0.187964 Jan 22 21:18:48.522820 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3021/5758] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:48 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1280 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:48.654219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b207e749-7382-45a7-b0c0-667422fc225e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:48.667524 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b207e749-7382-45a7-b0c0-667422fc225e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1318 microversion: 2.1 time: 0.400748 Jan 22 21:18:48.668812 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2738/5759] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:48 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:48.949228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1505c1e-4971-4442-87db-0ec6c16719da tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:48.950030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1505c1e-4971-4442-87db-0ec6c16719da tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:48.973749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1505c1e-4971-4442-87db-0ec6c16719da tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:48.974218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1505c1e-4971-4442-87db-0ec6c16719da tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:48.975041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1505c1e-4971-4442-87db-0ec6c16719da tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:48.975495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1505c1e-4971-4442-87db-0ec6c16719da tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:49.090731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7a134ff8-9cf3-4d97-892b-119a4c7103b6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:49.092434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7a134ff8-9cf3-4d97-892b-119a4c7103b6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:49.110287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a134ff8-9cf3-4d97-892b-119a4c7103b6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:49.111270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a134ff8-9cf3-4d97-892b-119a4c7103b6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:49.112465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a134ff8-9cf3-4d97-892b-119a4c7103b6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:49.113147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a134ff8-9cf3-4d97-892b-119a4c7103b6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:49.170645 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7a134ff8-9cf3-4d97-892b-119a4c7103b6 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.078606 Jan 22 21:18:49.170645 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2739/5760] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:49 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:18:49.288916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e2ee2200-48a0-45ec-981a-731024247ad6 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:49.289651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e2ee2200-48a0-45ec-981a-731024247ad6 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:49.297688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2ee2200-48a0-45ec-981a-731024247ad6 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:49.299042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2ee2200-48a0-45ec-981a-731024247ad6 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:49.299888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2ee2200-48a0-45ec-981a-731024247ad6 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:49.300520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2ee2200-48a0-45ec-981a-731024247ad6 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:49.330211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1505c1e-4971-4442-87db-0ec6c16719da tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:49.347890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1505c1e-4971-4442-87db-0ec6c16719da tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:49.351405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1505c1e-4971-4442-87db-0ec6c16719da tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:49.354979 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1505c1e-4971-4442-87db-0ec6c16719da tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.410385 Jan 22 21:18:49.356232 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3022/5761] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:48 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:49.396481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dab8d330-090e-4799-931d-93beb9ee995e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:49.411928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dab8d330-090e-4799-931d-93beb9ee995e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:49.417289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e2ee2200-48a0-45ec-981a-731024247ad6 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:49.425677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dab8d330-090e-4799-931d-93beb9ee995e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:49.426163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dab8d330-090e-4799-931d-93beb9ee995e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:49.426503 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e2ee2200-48a0-45ec-981a-731024247ad6 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1270 microversion: 2.1 time: 0.141877 Jan 22 21:18:49.426992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dab8d330-090e-4799-931d-93beb9ee995e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:49.427430 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2740/5762] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:49 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1270 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:18:49.430377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dab8d330-090e-4799-931d-93beb9ee995e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:49.432596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-5707997d-085f-4c6d-b99c-69a81f10eaae req-f9de830f-6477-4cb7-80b5-241f097df4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89583718-5186-41d5-b5f3-ad8997c3eb59", "tag": "f3926427-e4b0-4ea7-846d-98fa049e0b27"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:49.434380 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:49.434380 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:18:49.445028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5707997d-085f-4c6d-b99c-69a81f10eaae req-f9de830f-6477-4cb7-80b5-241f097df4e7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:49.445757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5707997d-085f-4c6d-b99c-69a81f10eaae req-f9de830f-6477-4cb7-80b5-241f097df4e7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:49.459582 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-5707997d-085f-4c6d-b99c-69a81f10eaae req-f9de830f-6477-4cb7-80b5-241f097df4e7 service nova] Creating event network-changed:f3926427-e4b0-4ea7-846d-98fa049e0b27 for instance 89583718-5186-41d5-b5f3-ad8997c3eb59 on nch2-master-1 Jan 22 21:18:49.465429 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-5707997d-085f-4c6d-b99c-69a81f10eaae req-f9de830f-6477-4cb7-80b5-241f097df4e7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036639 Jan 22 21:18:49.466686 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2741/5763] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:49.483788 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dab8d330-090e-4799-931d-93beb9ee995e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 14 microversion: 2.20 time: 0.115236 Jan 22 21:18:49.487270 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3023/5764] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:18:49 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:49.539532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-01da2471-0756-47e3-91dd-36eabcb534de tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:49.540339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-01da2471-0756-47e3-91dd-36eabcb534de tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:49.633643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-01da2471-0756-47e3-91dd-36eabcb534de tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:49.656892 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-01da2471-0756-47e3-91dd-36eabcb534de tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1280 microversion: 2.1 time: 0.123574 Jan 22 21:18:49.670448 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2742/5765] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:49 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1280 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:49.687119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9730b000-052b-474d-bd79-0d42a033a628 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:49.688009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9730b000-052b-474d-bd79-0d42a033a628 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:49.696204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9730b000-052b-474d-bd79-0d42a033a628 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:49.696837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9730b000-052b-474d-bd79-0d42a033a628 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:49.697783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9730b000-052b-474d-bd79-0d42a033a628 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:49.698339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9730b000-052b-474d-bd79-0d42a033a628 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:49.964828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9730b000-052b-474d-bd79-0d42a033a628 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:49.979273 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9730b000-052b-474d-bd79-0d42a033a628 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1318 microversion: 2.1 time: 0.297223 Jan 22 21:18:49.979836 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3024/5766] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:49 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:50.183121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-93b893d1-259f-4e11-8b13-0b62e0158350 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:50.185390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-93b893d1-259f-4e11-8b13-0b62e0158350 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:50.221907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93b893d1-259f-4e11-8b13-0b62e0158350 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:50.223529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93b893d1-259f-4e11-8b13-0b62e0158350 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:50.226385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93b893d1-259f-4e11-8b13-0b62e0158350 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:50.226872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93b893d1-259f-4e11-8b13-0b62e0158350 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:50.289129 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-93b893d1-259f-4e11-8b13-0b62e0158350 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.113957 Jan 22 21:18:50.292753 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2743/5767] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:50 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:18:50.377494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f287b10d-99b1-4b97-aee0-ed8950d4b917 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:50.381194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f287b10d-99b1-4b97-aee0-ed8950d4b917 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:50.391615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f287b10d-99b1-4b97-aee0-ed8950d4b917 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:50.391960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f287b10d-99b1-4b97-aee0-ed8950d4b917 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:50.392783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f287b10d-99b1-4b97-aee0-ed8950d4b917 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:50.402777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-ef334795-6ac7-4a4c-af97-9bf29b73b4da req-919962dc-0fb7-427c-af83-cb81a134e882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-plugged", "status": "completed", "tag": "f1445cec-d592-4347-ab81-b946b09943fa"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:50.405243 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:50.405243 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:18:50.408017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f287b10d-99b1-4b97-aee0-ed8950d4b917 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:50.454845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-ef334795-6ac7-4a4c-af97-9bf29b73b4da req-919962dc-0fb7-427c-af83-cb81a134e882 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:50.455488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-ef334795-6ac7-4a4c-af97-9bf29b73b4da req-919962dc-0fb7-427c-af83-cb81a134e882 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:50.497596 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-ef334795-6ac7-4a4c-af97-9bf29b73b4da req-919962dc-0fb7-427c-af83-cb81a134e882 service nova] Creating event network-vif-plugged:f1445cec-d592-4347-ab81-b946b09943fa for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:18:50.518636 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-ef334795-6ac7-4a4c-af97-9bf29b73b4da req-919962dc-0fb7-427c-af83-cb81a134e882 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116950 Jan 22 21:18:50.519858 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2744/5768] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:18:50.537919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-17915d7f-7572-4f24-bc65-c71f8c90a783 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:50.538514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-17915d7f-7572-4f24-bc65-c71f8c90a783 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:50.548573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17915d7f-7572-4f24-bc65-c71f8c90a783 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:50.554293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17915d7f-7572-4f24-bc65-c71f8c90a783 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:50.555159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17915d7f-7572-4f24-bc65-c71f8c90a783 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:50.555738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17915d7f-7572-4f24-bc65-c71f8c90a783 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:50.755123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-17915d7f-7572-4f24-bc65-c71f8c90a783 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:50.763772 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-17915d7f-7572-4f24-bc65-c71f8c90a783 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1276 microversion: 2.1 time: 0.241619 Jan 22 21:18:50.765353 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2745/5769] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:50 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:50.801839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4bc476bc-927c-4568-aa79-a22530aafa8b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:50.803754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4bc476bc-927c-4568-aa79-a22530aafa8b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:50.827377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bc476bc-927c-4568-aa79-a22530aafa8b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:50.828259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bc476bc-927c-4568-aa79-a22530aafa8b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:50.829427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bc476bc-927c-4568-aa79-a22530aafa8b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:50.830709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bc476bc-927c-4568-aa79-a22530aafa8b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:50.886423 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4bc476bc-927c-4568-aa79-a22530aafa8b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 14 microversion: 2.20 time: 0.119059 Jan 22 21:18:50.887841 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2746/5770] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:18:50 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:50.894035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b09d6fb-b313-4f6f-ae2f-fe0aeca347c9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:50.895531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4b09d6fb-b313-4f6f-ae2f-fe0aeca347c9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:50.906260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b09d6fb-b313-4f6f-ae2f-fe0aeca347c9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:50.906855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b09d6fb-b313-4f6f-ae2f-fe0aeca347c9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:50.907923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b09d6fb-b313-4f6f-ae2f-fe0aeca347c9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:50.909129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b09d6fb-b313-4f6f-ae2f-fe0aeca347c9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:51.063245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4b09d6fb-b313-4f6f-ae2f-fe0aeca347c9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:51.083338 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b09d6fb-b313-4f6f-ae2f-fe0aeca347c9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1332 microversion: 2.1 time: 0.193447 Jan 22 21:18:51.084302 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2747/5771] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:50 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1332 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:51.089793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0584d511-e187-49b5-be1b-3986ae2b6c14 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:51.090707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0584d511-e187-49b5-be1b-3986ae2b6c14 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:51.098046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0584d511-e187-49b5-be1b-3986ae2b6c14 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:51.099175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0584d511-e187-49b5-be1b-3986ae2b6c14 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:51.099675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0584d511-e187-49b5-be1b-3986ae2b6c14 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:51.100193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0584d511-e187-49b5-be1b-3986ae2b6c14 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:51.242586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f287b10d-99b1-4b97-aee0-ed8950d4b917 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:51.256525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f287b10d-99b1-4b97-aee0-ed8950d4b917 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:51.258544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f287b10d-99b1-4b97-aee0-ed8950d4b917 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:51.261395 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f287b10d-99b1-4b97-aee0-ed8950d4b917 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.887154 Jan 22 21:18:51.261395 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3025/5772] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:50 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:51.304370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0f07cd5d-5497-469c-bec2-c35c6fb68976 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:51.307195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0f07cd5d-5497-469c-bec2-c35c6fb68976 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:51.313750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f07cd5d-5497-469c-bec2-c35c6fb68976 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:51.314537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f07cd5d-5497-469c-bec2-c35c6fb68976 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:51.315615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f07cd5d-5497-469c-bec2-c35c6fb68976 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:51.316451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f07cd5d-5497-469c-bec2-c35c6fb68976 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:51.372290 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0f07cd5d-5497-469c-bec2-c35c6fb68976 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.071591 Jan 22 21:18:51.375459 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3026/5773] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:51 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:18:51.758574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0584d511-e187-49b5-be1b-3986ae2b6c14 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:51.770282 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0584d511-e187-49b5-be1b-3986ae2b6c14 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1318 microversion: 2.1 time: 0.683179 Jan 22 21:18:51.771841 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2748/5774] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:51 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1318 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:51.786600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-be80db42-baaa-4fb6-8cbe-268d2bef1916 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:51.787319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-be80db42-baaa-4fb6-8cbe-268d2bef1916 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:51.800145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be80db42-baaa-4fb6-8cbe-268d2bef1916 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:51.800611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be80db42-baaa-4fb6-8cbe-268d2bef1916 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:51.804048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be80db42-baaa-4fb6-8cbe-268d2bef1916 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:51.805106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be80db42-baaa-4fb6-8cbe-268d2bef1916 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:51.898245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a77c33ad-3f37-4e6e-a56e-6a7a245dd6ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:51.907333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a77c33ad-3f37-4e6e-a56e-6a7a245dd6ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:51.914929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a77c33ad-3f37-4e6e-a56e-6a7a245dd6ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:51.917976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a77c33ad-3f37-4e6e-a56e-6a7a245dd6ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:51.922116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a77c33ad-3f37-4e6e-a56e-6a7a245dd6ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:51.923834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a77c33ad-3f37-4e6e-a56e-6a7a245dd6ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:51.980253 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a77c33ad-3f37-4e6e-a56e-6a7a245dd6ce tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 14 microversion: 2.20 time: 0.082864 Jan 22 21:18:51.980253 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2749/5775] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:18:51 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:18:52.021652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-be80db42-baaa-4fb6-8cbe-268d2bef1916 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:52.037570 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-be80db42-baaa-4fb6-8cbe-268d2bef1916 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1276 microversion: 2.1 time: 0.256040 Jan 22 21:18:52.043548 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3027/5776] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:51 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:52.103898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11373de5-4e5d-4bcd-b7b1-aa0c7c9c5bd7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:52.104887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-11373de5-4e5d-4bcd-b7b1-aa0c7c9c5bd7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:52.113782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11373de5-4e5d-4bcd-b7b1-aa0c7c9c5bd7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:52.114579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11373de5-4e5d-4bcd-b7b1-aa0c7c9c5bd7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:52.115631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11373de5-4e5d-4bcd-b7b1-aa0c7c9c5bd7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:52.116303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11373de5-4e5d-4bcd-b7b1-aa0c7c9c5bd7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:52.249304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-11373de5-4e5d-4bcd-b7b1-aa0c7c9c5bd7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:52.272430 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-11373de5-4e5d-4bcd-b7b1-aa0c7c9c5bd7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1338 microversion: 2.1 time: 0.172257 Jan 22 21:18:52.278195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ff6ca836-05f3-40d7-89a4-0037f23fa114 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:52.279117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ff6ca836-05f3-40d7-89a4-0037f23fa114 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:52.279712 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2750/5777] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:52 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1338 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:52.301136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff6ca836-05f3-40d7-89a4-0037f23fa114 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:52.302880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff6ca836-05f3-40d7-89a4-0037f23fa114 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:52.303915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff6ca836-05f3-40d7-89a4-0037f23fa114 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:52.304825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff6ca836-05f3-40d7-89a4-0037f23fa114 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:52.386835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ffa97962-d5d1-4ec5-ad2b-570ab0597b79 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:52.388090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ffa97962-d5d1-4ec5-ad2b-570ab0597b79 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:52.403168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffa97962-d5d1-4ec5-ad2b-570ab0597b79 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:52.403664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffa97962-d5d1-4ec5-ad2b-570ab0597b79 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:52.405947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffa97962-d5d1-4ec5-ad2b-570ab0597b79 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:52.406398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffa97962-d5d1-4ec5-ad2b-570ab0597b79 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:52.461131 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ffa97962-d5d1-4ec5-ad2b-570ab0597b79 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 32645 microversion: 2.1 time: 0.078785 Jan 22 21:18:52.462217 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2751/5778] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:52 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 32645 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:52.579665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-80542386-92fd-43ad-8b41-ee7a959639f3 req-b027c362-f174-4d29-9efa-df638f8c5e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-plugged", "status": "completed", "tag": "da0ef06a-1226-49f4-b8db-7103fe846c99"}, {"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-plugged", "status": "completed", "tag": "cf20b5e5-413a-4b45-9640-028e8825cf06"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:52.581322 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:52.581322 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:18:52.600363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-80542386-92fd-43ad-8b41-ee7a959639f3 req-b027c362-f174-4d29-9efa-df638f8c5e3e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:52.602281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-80542386-92fd-43ad-8b41-ee7a959639f3 req-b027c362-f174-4d29-9efa-df638f8c5e3e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:52.616170 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-80542386-92fd-43ad-8b41-ee7a959639f3 req-b027c362-f174-4d29-9efa-df638f8c5e3e service nova] Creating event network-vif-plugged:da0ef06a-1226-49f4-b8db-7103fe846c99 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:18:52.616998 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-80542386-92fd-43ad-8b41-ee7a959639f3 req-b027c362-f174-4d29-9efa-df638f8c5e3e service nova] Creating event network-vif-plugged:cf20b5e5-413a-4b45-9640-028e8825cf06 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:18:52.624386 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-80542386-92fd-43ad-8b41-ee7a959639f3 req-b027c362-f174-4d29-9efa-df638f8c5e3e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048580 Jan 22 21:18:52.626358 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2752/5779] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:52.788955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7f4edb95-d85e-4dbd-be55-fc9192f5401b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:52.789952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7f4edb95-d85e-4dbd-be55-fc9192f5401b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:52.801755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f4edb95-d85e-4dbd-be55-fc9192f5401b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:52.803036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f4edb95-d85e-4dbd-be55-fc9192f5401b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:52.811364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f4edb95-d85e-4dbd-be55-fc9192f5401b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:52.813244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f4edb95-d85e-4dbd-be55-fc9192f5401b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:52.878877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ff6ca836-05f3-40d7-89a4-0037f23fa114 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:52.903276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ff6ca836-05f3-40d7-89a4-0037f23fa114 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:52.911018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ff6ca836-05f3-40d7-89a4-0037f23fa114 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:52.912712 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ff6ca836-05f3-40d7-89a4-0037f23fa114 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.638236 Jan 22 21:18:52.913904 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3028/5780] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:52 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:52.989238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-67db9d50-de12-47aa-b818-e9241deee92b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:52.990513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-67db9d50-de12-47aa-b818-e9241deee92b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:52.996968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67db9d50-de12-47aa-b818-e9241deee92b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:52.997429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67db9d50-de12-47aa-b818-e9241deee92b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:52.999090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67db9d50-de12-47aa-b818-e9241deee92b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:52.999630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67db9d50-de12-47aa-b818-e9241deee92b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:53.051944 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-67db9d50-de12-47aa-b818-e9241deee92b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 14 microversion: 2.20 time: 0.066297 Jan 22 21:18:53.055470 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3029/5781] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:18:52 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:18:53.062238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-098fa1d2-21c0-440e-9e23-803663589ed3 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:53.064330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-098fa1d2-21c0-440e-9e23-803663589ed3 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:53.086111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-098fa1d2-21c0-440e-9e23-803663589ed3 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:53.086665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-098fa1d2-21c0-440e-9e23-803663589ed3 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:53.087759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-098fa1d2-21c0-440e-9e23-803663589ed3 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:53.088380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-098fa1d2-21c0-440e-9e23-803663589ed3 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:53.168483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7f4edb95-d85e-4dbd-be55-fc9192f5401b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:53.187746 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7f4edb95-d85e-4dbd-be55-fc9192f5401b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1318 microversion: 2.1 time: 0.400700 Jan 22 21:18:53.188241 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2753/5782] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:52 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:18:53.291108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-de6823ed-0c74-4588-b966-1a75aab0d712 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:53.293248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-de6823ed-0c74-4588-b966-1a75aab0d712 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:53.315741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de6823ed-0c74-4588-b966-1a75aab0d712 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:53.316371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de6823ed-0c74-4588-b966-1a75aab0d712 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:53.317386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de6823ed-0c74-4588-b966-1a75aab0d712 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:53.319516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de6823ed-0c74-4588-b966-1a75aab0d712 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:53.620674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-098fa1d2-21c0-440e-9e23-803663589ed3 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:53.630758 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-098fa1d2-21c0-440e-9e23-803663589ed3 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1318 microversion: 2.1 time: 0.573081 Jan 22 21:18:53.632026 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3030/5783] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:53 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1318 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:53.659645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e0994751-4c04-432d-a51e-741792110e0f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:53.661000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e0994751-4c04-432d-a51e-741792110e0f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:53.669333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0994751-4c04-432d-a51e-741792110e0f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:53.670873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0994751-4c04-432d-a51e-741792110e0f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:53.671978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0994751-4c04-432d-a51e-741792110e0f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:53.672654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0994751-4c04-432d-a51e-741792110e0f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:53.689250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-de6823ed-0c74-4588-b966-1a75aab0d712 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:53.703596 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-de6823ed-0c74-4588-b966-1a75aab0d712 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1406 microversion: 2.1 time: 0.417066 Jan 22 21:18:53.713120 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2754/5784] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:53 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1406 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:53.766192 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e0994751-4c04-432d-a51e-741792110e0f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action" status: 200 len: 40795 microversion: 2.1 time: 0.110749 Jan 22 21:18:53.783774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-65211b00-1d06-452b-a108-dac306699479 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:53.785103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-65211b00-1d06-452b-a108-dac306699479 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:53.794039 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3031/5785] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:53 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/action => generated 40795 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:18:53.800196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65211b00-1d06-452b-a108-dac306699479 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:53.805215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65211b00-1d06-452b-a108-dac306699479 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:53.806182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65211b00-1d06-452b-a108-dac306699479 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:53.810148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65211b00-1d06-452b-a108-dac306699479 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:53.858010 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-65211b00-1d06-452b-a108-dac306699479 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/ips" status: 200 len: 145 microversion: 2.1 time: 0.082731 Jan 22 21:18:53.859222 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2755/5786] 10.222.0.100 () {58 vars in 1252 bytes} [Sat Jan 22 21:18:53 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/ips => generated 145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:53.936130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d68b0c1-f09c-414d-a59c-1e2fe676e0ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:53.940610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d68b0c1-f09c-414d-a59c-1e2fe676e0ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:53.949451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d68b0c1-f09c-414d-a59c-1e2fe676e0ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:53.950640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d68b0c1-f09c-414d-a59c-1e2fe676e0ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:53.953142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d68b0c1-f09c-414d-a59c-1e2fe676e0ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:53.954037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d68b0c1-f09c-414d-a59c-1e2fe676e0ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:54.000921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-0fbc7af0-abf5-45b9-a5d8-fa0175013ce5 req-4677ec67-f6a4-460f-9957-1e0128e1a6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b913871-15e3-4b2c-a015-a6d11af6edfd", "tag": "ad576433-f854-429f-a316-8e6e9096015b"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:54.000921 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:54.000921 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:18:54.020223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-0fbc7af0-abf5-45b9-a5d8-fa0175013ce5 req-4677ec67-f6a4-460f-9957-1e0128e1a6d3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:54.020814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-0fbc7af0-abf5-45b9-a5d8-fa0175013ce5 req-4677ec67-f6a4-460f-9957-1e0128e1a6d3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:54.047624 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-0fbc7af0-abf5-45b9-a5d8-fa0175013ce5 req-4677ec67-f6a4-460f-9957-1e0128e1a6d3 service nova] Creating event network-changed:ad576433-f854-429f-a316-8e6e9096015b for instance 6b913871-15e3-4b2c-a015-a6d11af6edfd on nch2-master-1 Jan 22 21:18:54.065181 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-0fbc7af0-abf5-45b9-a5d8-fa0175013ce5 req-4677ec67-f6a4-460f-9957-1e0128e1a6d3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071606 Jan 22 21:18:54.065600 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2756/5787] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:54.077785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-38b6db89-8d2f-46de-948a-12279df746c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:54.086850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-38b6db89-8d2f-46de-948a-12279df746c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:54.087179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38b6db89-8d2f-46de-948a-12279df746c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:54.087893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38b6db89-8d2f-46de-948a-12279df746c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:54.089200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38b6db89-8d2f-46de-948a-12279df746c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:54.090030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38b6db89-8d2f-46de-948a-12279df746c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:54.137862 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-38b6db89-8d2f-46de-948a-12279df746c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 14 microversion: 2.20 time: 0.068334 Jan 22 21:18:54.140527 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2757/5788] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:18:54 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:54.207967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8d52460d-a610-4d07-8fd4-a154f2dcb461 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:54.209357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8d52460d-a610-4d07-8fd4-a154f2dcb461 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:54.220271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d52460d-a610-4d07-8fd4-a154f2dcb461 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:54.222949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d52460d-a610-4d07-8fd4-a154f2dcb461 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:54.224249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d52460d-a610-4d07-8fd4-a154f2dcb461 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:54.225541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d52460d-a610-4d07-8fd4-a154f2dcb461 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:54.605729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8d52460d-a610-4d07-8fd4-a154f2dcb461 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:54.621168 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8d52460d-a610-4d07-8fd4-a154f2dcb461 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1318 microversion: 2.1 time: 0.419975 Jan 22 21:18:54.636778 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2758/5789] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:54 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:54.647736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-8af11e8d-b467-4045-b259-9451fb39b13d req-4f86fa65-0e17-4510-8f90-04487c392946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-plugged", "status": "completed", "tag": "5deaf213-88f0-4d59-9ebc-8825f8699d40"}, {"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-plugged", "status": "completed", "tag": "a9f0a176-56d8-4260-a888-954dfaa6e694"}, {"server_uuid": "6e37baa6-5103-4ac9-99f5-3cb87ecb7be2", "name": "network-vif-plugged", "status": "completed", "tag": "4106a7ca-c629-490e-8151-691df9c930ba"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:54.651188 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:54.651188 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:18:54.663301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8af11e8d-b467-4045-b259-9451fb39b13d req-4f86fa65-0e17-4510-8f90-04487c392946 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:54.664261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8af11e8d-b467-4045-b259-9451fb39b13d req-4f86fa65-0e17-4510-8f90-04487c392946 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:54.681796 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8af11e8d-b467-4045-b259-9451fb39b13d req-4f86fa65-0e17-4510-8f90-04487c392946 service nova] Creating event network-vif-plugged:5deaf213-88f0-4d59-9ebc-8825f8699d40 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:18:54.683246 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8af11e8d-b467-4045-b259-9451fb39b13d req-4f86fa65-0e17-4510-8f90-04487c392946 service nova] Creating event network-vif-plugged:a9f0a176-56d8-4260-a888-954dfaa6e694 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:18:54.684438 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8af11e8d-b467-4045-b259-9451fb39b13d req-4f86fa65-0e17-4510-8f90-04487c392946 service nova] Creating event network-vif-plugged:4106a7ca-c629-490e-8151-691df9c930ba for instance 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 on nch1-master-1 Jan 22 21:18:54.699530 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-8af11e8d-b467-4045-b259-9451fb39b13d req-4f86fa65-0e17-4510-8f90-04487c392946 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.057645 Jan 22 21:18:54.700164 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2759/5790] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:54.707584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e91bd677-f8b1-4fbc-89c2-670ad0a8e882 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:54.708546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e91bd677-f8b1-4fbc-89c2-670ad0a8e882 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:54.731364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e91bd677-f8b1-4fbc-89c2-670ad0a8e882 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:54.732915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e91bd677-f8b1-4fbc-89c2-670ad0a8e882 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:54.735090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e91bd677-f8b1-4fbc-89c2-670ad0a8e882 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:54.735728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e91bd677-f8b1-4fbc-89c2-670ad0a8e882 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:54.783911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0d68b0c1-f09c-414d-a59c-1e2fe676e0ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:54.799732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0d68b0c1-f09c-414d-a59c-1e2fe676e0ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:54.802297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0d68b0c1-f09c-414d-a59c-1e2fe676e0ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:54.803713 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d68b0c1-f09c-414d-a59c-1e2fe676e0ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.874020 Jan 22 21:18:54.818450 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3032/5791] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:53 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:54.828390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d57b3a60-cd8a-4629-94f4-41b10ffc9cbd tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:54.840349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d57b3a60-cd8a-4629-94f4-41b10ffc9cbd tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:54.848723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d57b3a60-cd8a-4629-94f4-41b10ffc9cbd tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:54.850206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d57b3a60-cd8a-4629-94f4-41b10ffc9cbd tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:54.851295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d57b3a60-cd8a-4629-94f4-41b10ffc9cbd tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:54.852926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d57b3a60-cd8a-4629-94f4-41b10ffc9cbd tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:55.237325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d57b3a60-cd8a-4629-94f4-41b10ffc9cbd tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:55.256598 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d57b3a60-cd8a-4629-94f4-41b10ffc9cbd tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1406 microversion: 2.1 time: 0.433844 Jan 22 21:18:55.257548 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3033/5792] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:54 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1406 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:55.274144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1a8b9250-343d-4f20-b62e-3e34242ef444 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:55.276559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1a8b9250-343d-4f20-b62e-3e34242ef444 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:55.324818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a8b9250-343d-4f20-b62e-3e34242ef444 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:55.324818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a8b9250-343d-4f20-b62e-3e34242ef444 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:55.324818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a8b9250-343d-4f20-b62e-3e34242ef444 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:55.324818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a8b9250-343d-4f20-b62e-3e34242ef444 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:55.325254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e91bd677-f8b1-4fbc-89c2-670ad0a8e882 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:55.328621 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e91bd677-f8b1-4fbc-89c2-670ad0a8e882 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1318 microversion: 2.1 time: 0.626223 Jan 22 21:18:55.329416 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2760/5793] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:54 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:55.392546 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1a8b9250-343d-4f20-b62e-3e34242ef444 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 14 microversion: 2.20 time: 0.123015 Jan 22 21:18:55.393919 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3034/5794] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:18:55 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:55.642397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-10a75738-07f6-4aee-884d-080e3c2e47fc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:55.643284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-10a75738-07f6-4aee-884d-080e3c2e47fc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:55.651571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10a75738-07f6-4aee-884d-080e3c2e47fc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:55.660537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10a75738-07f6-4aee-884d-080e3c2e47fc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:55.660537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10a75738-07f6-4aee-884d-080e3c2e47fc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:55.660537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10a75738-07f6-4aee-884d-080e3c2e47fc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:55.822969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d07ddc43-f9d0-496f-ad81-cc285040b32a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:55.824064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d07ddc43-f9d0-496f-ad81-cc285040b32a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:55.832751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d07ddc43-f9d0-496f-ad81-cc285040b32a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:55.833765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d07ddc43-f9d0-496f-ad81-cc285040b32a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:55.834998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d07ddc43-f9d0-496f-ad81-cc285040b32a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:55.835672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d07ddc43-f9d0-496f-ad81-cc285040b32a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:56.267051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-10a75738-07f6-4aee-884d-080e3c2e47fc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:56.278768 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-10a75738-07f6-4aee-884d-080e3c2e47fc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1318 microversion: 2.1 time: 0.641072 Jan 22 21:18:56.289861 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2761/5795] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:55 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1318 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:56.297591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-c37702e1-dc5c-46b7-b7b1-07443eca74b3 req-8aa71309-f270-491f-85fc-a7afb6aa3724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e318c979-4614-4d4f-9412-43d48d1b042b", "tag": "8f6916af-e766-4eb7-96e1-7e81bb9a0a97"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:56.302913 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:56.302913 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:18:56.309149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c37702e1-dc5c-46b7-b7b1-07443eca74b3 req-8aa71309-f270-491f-85fc-a7afb6aa3724 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:56.310838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c37702e1-dc5c-46b7-b7b1-07443eca74b3 req-8aa71309-f270-491f-85fc-a7afb6aa3724 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:56.426761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d07ddc43-f9d0-496f-ad81-cc285040b32a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:56.450074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d07ddc43-f9d0-496f-ad81-cc285040b32a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:56.453173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d07ddc43-f9d0-496f-ad81-cc285040b32a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:56.454791 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d07ddc43-f9d0-496f-ad81-cc285040b32a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 0.635862 Jan 22 21:18:56.456015 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3035/5796] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:55 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:18:56.461608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d4505605-7e91-4f51-9c49-dc1064404f2b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:56.466948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d4505605-7e91-4f51-9c49-dc1064404f2b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:56.467081 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-c37702e1-dc5c-46b7-b7b1-07443eca74b3 req-8aa71309-f270-491f-85fc-a7afb6aa3724 service nova] Creating event network-changed:8f6916af-e766-4eb7-96e1-7e81bb9a0a97 for instance e318c979-4614-4d4f-9412-43d48d1b042b on nch2-master-1 Jan 22 21:18:56.470785 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-c37702e1-dc5c-46b7-b7b1-07443eca74b3 req-8aa71309-f270-491f-85fc-a7afb6aa3724 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179062 Jan 22 21:18:56.471643 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2762/5797] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:56.472158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4505605-7e91-4f51-9c49-dc1064404f2b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:56.472940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4505605-7e91-4f51-9c49-dc1064404f2b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:56.475185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4505605-7e91-4f51-9c49-dc1064404f2b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:56.476230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4505605-7e91-4f51-9c49-dc1064404f2b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:56.481292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b82a79c9-3272-4dc8-be33-3bc178fc1878 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:56.483419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b82a79c9-3272-4dc8-be33-3bc178fc1878 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:56.493673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b82a79c9-3272-4dc8-be33-3bc178fc1878 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:56.495003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b82a79c9-3272-4dc8-be33-3bc178fc1878 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:56.498586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b82a79c9-3272-4dc8-be33-3bc178fc1878 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:56.499604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b82a79c9-3272-4dc8-be33-3bc178fc1878 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:56.776449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b82a79c9-3272-4dc8-be33-3bc178fc1878 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:56.801738 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b82a79c9-3272-4dc8-be33-3bc178fc1878 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1318 microversion: 2.1 time: 0.328251 Jan 22 21:18:56.803845 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2763/5798] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:56 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:56.811317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ae29b01e-d6ce-493f-b4e4-b753e9fb7dd3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:56.812337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ae29b01e-d6ce-493f-b4e4-b753e9fb7dd3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:56.822264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae29b01e-d6ce-493f-b4e4-b753e9fb7dd3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:56.824371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae29b01e-d6ce-493f-b4e4-b753e9fb7dd3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:56.825287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae29b01e-d6ce-493f-b4e4-b753e9fb7dd3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:56.827120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae29b01e-d6ce-493f-b4e4-b753e9fb7dd3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:56.872539 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ae29b01e-d6ce-493f-b4e4-b753e9fb7dd3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 14 microversion: 2.20 time: 0.067212 Jan 22 21:18:56.874330 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2764/5799] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:18:56 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:56.880281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-6fb86df2-a176-4cc5-b0b2-a74ed97344f1 req-cde5855d-366d-4da9-9230-b4a0546a34fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-plugged", "status": "completed", "tag": "d6ad2c1e-3a87-493b-b14b-01230bfd2da6"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:56.882106 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:18:56.882106 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:18:56.891113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6fb86df2-a176-4cc5-b0b2-a74ed97344f1 req-cde5855d-366d-4da9-9230-b4a0546a34fe service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:56.891390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6fb86df2-a176-4cc5-b0b2-a74ed97344f1 req-cde5855d-366d-4da9-9230-b4a0546a34fe service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:56.905946 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-6fb86df2-a176-4cc5-b0b2-a74ed97344f1 req-cde5855d-366d-4da9-9230-b4a0546a34fe service nova] Creating event network-vif-plugged:d6ad2c1e-3a87-493b-b14b-01230bfd2da6 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:18:56.913194 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-6fb86df2-a176-4cc5-b0b2-a74ed97344f1 req-cde5855d-366d-4da9-9230-b4a0546a34fe service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037233 Jan 22 21:18:56.914145 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2765/5800] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:56.920254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-76750aa2-3478-409a-8493-b1b01bad1734 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "502df3ac-dfa4-4ae0-a658-85716a8e4faf"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:56.921898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-76750aa2-3478-409a-8493-b1b01bad1734 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:56.928924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76750aa2-3478-409a-8493-b1b01bad1734 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:56.929822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76750aa2-3478-409a-8493-b1b01bad1734 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:56.930883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76750aa2-3478-409a-8493-b1b01bad1734 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:56.931557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76750aa2-3478-409a-8493-b1b01bad1734 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:57.087787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d4505605-7e91-4f51-9c49-dc1064404f2b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:57.114902 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d4505605-7e91-4f51-9c49-dc1064404f2b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1406 microversion: 2.1 time: 0.655135 Jan 22 21:18:57.116730 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3036/5801] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:56 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1406 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:57.299382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1fd4ce83-19f3-4256-b623-cceca433fc85 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:57.300205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1fd4ce83-19f3-4256-b623-cceca433fc85 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:57.307746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1fd4ce83-19f3-4256-b623-cceca433fc85 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:57.308607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1fd4ce83-19f3-4256-b623-cceca433fc85 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:57.309430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1fd4ce83-19f3-4256-b623-cceca433fc85 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:57.311406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1fd4ce83-19f3-4256-b623-cceca433fc85 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:57.709649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1fd4ce83-19f3-4256-b623-cceca433fc85 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:57.720447 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1fd4ce83-19f3-4256-b623-cceca433fc85 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1504 microversion: 2.1 time: 0.428016 Jan 22 21:18:57.721537 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3037/5802] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:57 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1504 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:57.726782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f784de71-3f1c-46d1-b37b-5c04650b1a34 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:57.727611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f784de71-3f1c-46d1-b37b-5c04650b1a34 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:57.737052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f784de71-3f1c-46d1-b37b-5c04650b1a34 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:57.738468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f784de71-3f1c-46d1-b37b-5c04650b1a34 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:57.739769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f784de71-3f1c-46d1-b37b-5c04650b1a34 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:57.740330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f784de71-3f1c-46d1-b37b-5c04650b1a34 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:58.078592 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-76750aa2-3478-409a-8493-b1b01bad1734 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.162753 Jan 22 21:18:58.087094 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2766/5803] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:18:56 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments => generated 194 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:18:58.111469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8e287829-3f02-4e7d-9b56-32ca08676586 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:58.112309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8e287829-3f02-4e7d-9b56-32ca08676586 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:58.126371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e287829-3f02-4e7d-9b56-32ca08676586 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:58.126791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e287829-3f02-4e7d-9b56-32ca08676586 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:58.131078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e287829-3f02-4e7d-9b56-32ca08676586 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:58.131786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e287829-3f02-4e7d-9b56-32ca08676586 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:58.187826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-8e287829-3f02-4e7d-9b56-32ca08676586 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lazy-loading 'flavor' on Instance uuid 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:18:58.569773 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8e287829-3f02-4e7d-9b56-32ca08676586 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "POST /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2/action" status: 202 len: 0 microversion: 2.1 time: 0.471904 Jan 22 21:18:58.582288 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2767/5804] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:18:58 2022] POST /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:18:58.582288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2f07d629-cf29-42ba-b565-314325651f19 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:58.583831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2f07d629-cf29-42ba-b565-314325651f19 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:58.624472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f07d629-cf29-42ba-b565-314325651f19 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:58.625244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f07d629-cf29-42ba-b565-314325651f19 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:58.627446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f07d629-cf29-42ba-b565-314325651f19 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:58.629761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f07d629-cf29-42ba-b565-314325651f19 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:58.873429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f784de71-3f1c-46d1-b37b-5c04650b1a34 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:58.915607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f784de71-3f1c-46d1-b37b-5c04650b1a34 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:58.924061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f784de71-3f1c-46d1-b37b-5c04650b1a34 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:58.934664 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f784de71-3f1c-46d1-b37b-5c04650b1a34 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1878 microversion: 2.32 time: 1.211792 Jan 22 21:18:58.938002 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3038/5805] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:57 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1878 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:18:58.952865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dd749ac8-1b04-4c64-8210-087f34e788a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:18:58.958293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dd749ac8-1b04-4c64-8210-087f34e788a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:58.974536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd749ac8-1b04-4c64-8210-087f34e788a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:58.976770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd749ac8-1b04-4c64-8210-087f34e788a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:58.977683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd749ac8-1b04-4c64-8210-087f34e788a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:58.980301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd749ac8-1b04-4c64-8210-087f34e788a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:59.103856 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dd749ac8-1b04-4c64-8210-087f34e788a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 16365 microversion: 2.20 time: 0.164164 Jan 22 21:18:59.108107 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3039/5806] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:18:58 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 16365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:18:59.115482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-22a45b37-b7ec-4901-bcac-9922df16b40b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:59.119857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-22a45b37-b7ec-4901-bcac-9922df16b40b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:59.137297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22a45b37-b7ec-4901-bcac-9922df16b40b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:59.139907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22a45b37-b7ec-4901-bcac-9922df16b40b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:59.140910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22a45b37-b7ec-4901-bcac-9922df16b40b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:59.144776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2f07d629-cf29-42ba-b565-314325651f19 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:59.164757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22a45b37-b7ec-4901-bcac-9922df16b40b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:59.168838 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2f07d629-cf29-42ba-b565-314325651f19 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1318 microversion: 2.1 time: 0.596710 Jan 22 21:18:59.175921 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2768/5807] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:58 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:59.203051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c16fb142-d76c-4dde-92f0-cf03e10a9d6b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:59.207353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c16fb142-d76c-4dde-92f0-cf03e10a9d6b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:59.239391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c16fb142-d76c-4dde-92f0-cf03e10a9d6b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:59.239865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c16fb142-d76c-4dde-92f0-cf03e10a9d6b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:59.244009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c16fb142-d76c-4dde-92f0-cf03e10a9d6b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:59.244551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c16fb142-d76c-4dde-92f0-cf03e10a9d6b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:59.778795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c16fb142-d76c-4dde-92f0-cf03e10a9d6b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:59.787901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-22a45b37-b7ec-4901-bcac-9922df16b40b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:18:59.789243 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c16fb142-d76c-4dde-92f0-cf03e10a9d6b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1512 microversion: 2.1 time: 0.611859 Jan 22 21:18:59.791644 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2769/5808] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:59 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1512 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:59.800075 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-22a45b37-b7ec-4901-bcac-9922df16b40b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1406 microversion: 2.1 time: 0.689930 Jan 22 21:18:59.800652 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3040/5809] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:18:59 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1406 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:18:59.956595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f5fa1eea-8e2c-48b0-b1c2-767abb032a35 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:18:59.957220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f5fa1eea-8e2c-48b0-b1c2-767abb032a35 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:18:59.967029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5fa1eea-8e2c-48b0-b1c2-767abb032a35 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:59.967341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5fa1eea-8e2c-48b0-b1c2-767abb032a35 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:18:59.968175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5fa1eea-8e2c-48b0-b1c2-767abb032a35 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:18:59.968625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f5fa1eea-8e2c-48b0-b1c2-767abb032a35 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:00.115823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-927f5e8f-15b1-4ec6-9719-9600c2a759de tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:00.116770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-927f5e8f-15b1-4ec6-9719-9600c2a759de tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:00.127333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-927f5e8f-15b1-4ec6-9719-9600c2a759de tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:00.127803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-927f5e8f-15b1-4ec6-9719-9600c2a759de tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:00.128630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-927f5e8f-15b1-4ec6-9719-9600c2a759de tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:00.129076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-927f5e8f-15b1-4ec6-9719-9600c2a759de tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:00.202325 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-927f5e8f-15b1-4ec6-9719-9600c2a759de tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 16365 microversion: 2.20 time: 0.089664 Jan 22 21:19:00.207843 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3041/5810] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:00 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 16365 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:00.214024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f99de29f-f90b-42a5-88d1-2b6a139c8fac tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:00.215040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f99de29f-f90b-42a5-88d1-2b6a139c8fac tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:00.229672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f99de29f-f90b-42a5-88d1-2b6a139c8fac tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:00.235665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f99de29f-f90b-42a5-88d1-2b6a139c8fac tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:00.235665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f99de29f-f90b-42a5-88d1-2b6a139c8fac tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:00.235665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f99de29f-f90b-42a5-88d1-2b6a139c8fac tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:00.473364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f5fa1eea-8e2c-48b0-b1c2-767abb032a35 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:00.496261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f5fa1eea-8e2c-48b0-b1c2-767abb032a35 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:00.498243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f5fa1eea-8e2c-48b0-b1c2-767abb032a35 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:00.500164 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f5fa1eea-8e2c-48b0-b1c2-767abb032a35 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 2830 microversion: 2.32 time: 0.547451 Jan 22 21:19:00.501301 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2770/5811] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:18:59 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 2830 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:19:00.524794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-074aba67-6d09-441d-b4cb-6cceb0b77c7b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:00.525810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-074aba67-6d09-441d-b4cb-6cceb0b77c7b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:00.535018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-074aba67-6d09-441d-b4cb-6cceb0b77c7b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:00.535921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-074aba67-6d09-441d-b4cb-6cceb0b77c7b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:00.537320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-074aba67-6d09-441d-b4cb-6cceb0b77c7b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:00.538109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-074aba67-6d09-441d-b4cb-6cceb0b77c7b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:00.539596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f99de29f-f90b-42a5-88d1-2b6a139c8fac tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:00.553295 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f99de29f-f90b-42a5-88d1-2b6a139c8fac tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1318 microversion: 2.1 time: 0.343834 Jan 22 21:19:00.553924 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3042/5812] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:00 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:00.774803 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-074aba67-6d09-441d-b4cb-6cceb0b77c7b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.256259 Jan 22 21:19:00.776207 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2771/5813] 10.222.0.100 () {60 vars in 1320 bytes} [Sat Jan 22 21:19:00 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/os-interface => generated 1831 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:19:00.808524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1cab9e2-64b7-44d5-af9e-e022e38fcc35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:00.809435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1cab9e2-64b7-44d5-af9e-e022e38fcc35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:00.816307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ced3e87b-8ae7-44b8-ba1d-bc05dd8dd4fc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:00.816918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ced3e87b-8ae7-44b8-ba1d-bc05dd8dd4fc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:00.829630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ced3e87b-8ae7-44b8-ba1d-bc05dd8dd4fc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:00.830095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ced3e87b-8ae7-44b8-ba1d-bc05dd8dd4fc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:00.832585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1cab9e2-64b7-44d5-af9e-e022e38fcc35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:00.833712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ced3e87b-8ae7-44b8-ba1d-bc05dd8dd4fc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:00.834380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ced3e87b-8ae7-44b8-ba1d-bc05dd8dd4fc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:00.839206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1cab9e2-64b7-44d5-af9e-e022e38fcc35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:00.840372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1cab9e2-64b7-44d5-af9e-e022e38fcc35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:00.841087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1cab9e2-64b7-44d5-af9e-e022e38fcc35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:01.168954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1cab9e2-64b7-44d5-af9e-e022e38fcc35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:01.178706 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1cab9e2-64b7-44d5-af9e-e022e38fcc35 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1495 microversion: 2.1 time: 0.373764 Jan 22 21:19:01.179278 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3043/5814] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:00 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1495 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:01.204014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-826b3750-4be3-4bbd-b852-4fe2f1b97a1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:01.205651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-826b3750-4be3-4bbd-b852-4fe2f1b97a1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:01.217991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-826b3750-4be3-4bbd-b852-4fe2f1b97a1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:01.228968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-826b3750-4be3-4bbd-b852-4fe2f1b97a1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:01.228968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-826b3750-4be3-4bbd-b852-4fe2f1b97a1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:01.228968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-826b3750-4be3-4bbd-b852-4fe2f1b97a1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:01.250110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-826b3750-4be3-4bbd-b852-4fe2f1b97a1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:19:01.298660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ced3e87b-8ae7-44b8-ba1d-bc05dd8dd4fc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:01.323223 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ced3e87b-8ae7-44b8-ba1d-bc05dd8dd4fc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1406 microversion: 2.1 time: 0.510118 Jan 22 21:19:01.324176 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2772/5815] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:00 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1406 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:01.334003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e6fae091-0fc9-4e76-9f9b-df5d451411ad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:01.335347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e6fae091-0fc9-4e76-9f9b-df5d451411ad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:01.353626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6fae091-0fc9-4e76-9f9b-df5d451411ad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:01.353957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6fae091-0fc9-4e76-9f9b-df5d451411ad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:01.357798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6fae091-0fc9-4e76-9f9b-df5d451411ad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:01.357798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6fae091-0fc9-4e76-9f9b-df5d451411ad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:01.426263 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e6fae091-0fc9-4e76-9f9b-df5d451411ad tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 16365 microversion: 2.20 time: 0.099544 Jan 22 21:19:01.432262 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2773/5816] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:01 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 16365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:01.572627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-63f091cc-458b-4a02-98ce-d455d32a9d64 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:01.573297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-63f091cc-458b-4a02-98ce-d455d32a9d64 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:01.588407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63f091cc-458b-4a02-98ce-d455d32a9d64 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:01.589409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63f091cc-458b-4a02-98ce-d455d32a9d64 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:01.590472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63f091cc-458b-4a02-98ce-d455d32a9d64 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:01.593645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63f091cc-458b-4a02-98ce-d455d32a9d64 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:01.661307 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-826b3750-4be3-4bbd-b852-4fe2f1b97a1e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 204 len: 0 microversion: 2.1 time: 0.462365 Jan 22 21:19:01.665449 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3044/5817] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:19:01 2022] DELETE /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:19:01.671029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a73450aa-0807-4a10-a37d-08499d2b07a1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:01.671784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a73450aa-0807-4a10-a37d-08499d2b07a1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:01.682268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a73450aa-0807-4a10-a37d-08499d2b07a1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:01.687343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a73450aa-0807-4a10-a37d-08499d2b07a1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:01.688610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a73450aa-0807-4a10-a37d-08499d2b07a1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:01.689233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a73450aa-0807-4a10-a37d-08499d2b07a1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:02.064975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-63f091cc-458b-4a02-98ce-d455d32a9d64 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:02.073814 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-63f091cc-458b-4a02-98ce-d455d32a9d64 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1318 microversion: 2.1 time: 0.505691 Jan 22 21:19:02.078679 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2774/5818] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:01 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1318 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:02.179617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a73450aa-0807-4a10-a37d-08499d2b07a1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:02.191729 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a73450aa-0807-4a10-a37d-08499d2b07a1 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1501 microversion: 2.1 time: 0.525147 Jan 22 21:19:02.193972 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3045/5819] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:01 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1501 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:02.341691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ecb31403-4098-4361-8700-49d7f8dd5437 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:02.343288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ecb31403-4098-4361-8700-49d7f8dd5437 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:02.363133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecb31403-4098-4361-8700-49d7f8dd5437 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:02.365856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecb31403-4098-4361-8700-49d7f8dd5437 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:02.376750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecb31403-4098-4361-8700-49d7f8dd5437 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:02.383541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecb31403-4098-4361-8700-49d7f8dd5437 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:02.439263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e3f3e92e-44a4-4fc0-a730-5a80e301d889 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:02.440413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e3f3e92e-44a4-4fc0-a730-5a80e301d889 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:02.453403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3f3e92e-44a4-4fc0-a730-5a80e301d889 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:02.458968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3f3e92e-44a4-4fc0-a730-5a80e301d889 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:02.461751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3f3e92e-44a4-4fc0-a730-5a80e301d889 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:02.465522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3f3e92e-44a4-4fc0-a730-5a80e301d889 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:02.545375 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e3f3e92e-44a4-4fc0-a730-5a80e301d889 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 16365 microversion: 2.20 time: 0.109551 Jan 22 21:19:02.546930 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3046/5820] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:02 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 16365 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:02.619020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c55befb5-8006-4e08-84bc-67eafaa430a7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:02.620051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c55befb5-8006-4e08-84bc-67eafaa430a7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:02.628728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c55befb5-8006-4e08-84bc-67eafaa430a7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:02.629534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c55befb5-8006-4e08-84bc-67eafaa430a7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:02.638661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c55befb5-8006-4e08-84bc-67eafaa430a7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:02.638661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c55befb5-8006-4e08-84bc-67eafaa430a7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:02.706226 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c55befb5-8006-4e08-84bc-67eafaa430a7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091245 Jan 22 21:19:02.712613 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3047/5821] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:19:02 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:19:02.718551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f97fb9a9-4ac0-4280-8791-bf082a2bc3fa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:02.720203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f97fb9a9-4ac0-4280-8791-bf082a2bc3fa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:02.728230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f97fb9a9-4ac0-4280-8791-bf082a2bc3fa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:02.728943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f97fb9a9-4ac0-4280-8791-bf082a2bc3fa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:02.730037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f97fb9a9-4ac0-4280-8791-bf082a2bc3fa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:02.730680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f97fb9a9-4ac0-4280-8791-bf082a2bc3fa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:02.779254 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f97fb9a9-4ac0-4280-8791-bf082a2bc3fa tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments/502df3ac-dfa4-4ae0-a658-85716a8e4faf" status: 200 len: 194 microversion: 2.1 time: 0.064654 Jan 22 21:19:02.785406 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3048/5822] 10.222.0.100 () {58 vars in 1417 bytes} [Sat Jan 22 21:19:02 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments/502df3ac-dfa4-4ae0-a658-85716a8e4faf => generated 194 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:03.095219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-27ab25f9-9a88-426b-a221-e8fb917a25fb tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:03.095770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-27ab25f9-9a88-426b-a221-e8fb917a25fb tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:03.110529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27ab25f9-9a88-426b-a221-e8fb917a25fb tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:03.110529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27ab25f9-9a88-426b-a221-e8fb917a25fb tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:03.111317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27ab25f9-9a88-426b-a221-e8fb917a25fb tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:03.118397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27ab25f9-9a88-426b-a221-e8fb917a25fb tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:03.334913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ecb31403-4098-4361-8700-49d7f8dd5437 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:03.354784 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ecb31403-4098-4361-8700-49d7f8dd5437 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1406 microversion: 2.1 time: 1.015613 Jan 22 21:19:03.354784 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2775/5823] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:02 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1406 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:03.361346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a228ed27-9c0d-4c03-b11d-31e56430a3b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:03.362402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a228ed27-9c0d-4c03-b11d-31e56430a3b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:03.370111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a228ed27-9c0d-4c03-b11d-31e56430a3b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:03.371170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a228ed27-9c0d-4c03-b11d-31e56430a3b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:03.373764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a228ed27-9c0d-4c03-b11d-31e56430a3b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:03.374569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a228ed27-9c0d-4c03-b11d-31e56430a3b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:03.846377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a228ed27-9c0d-4c03-b11d-31e56430a3b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:03.861955 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a228ed27-9c0d-4c03-b11d-31e56430a3b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1501 microversion: 2.1 time: 0.507150 Jan 22 21:19:03.864480 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2776/5824] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:03 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1501 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:03.877902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bf1c32fe-3594-4223-866f-2537fe1105a9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:03.880439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bf1c32fe-3594-4223-866f-2537fe1105a9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:03.885946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-27ab25f9-9a88-426b-a221-e8fb917a25fb tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:03.897360 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-27ab25f9-9a88-426b-a221-e8fb917a25fb tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1318 microversion: 2.1 time: 0.806381 Jan 22 21:19:03.897988 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3049/5825] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:03 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1318 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:03.899989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf1c32fe-3594-4223-866f-2537fe1105a9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:03.900536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf1c32fe-3594-4223-866f-2537fe1105a9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:03.904489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf1c32fe-3594-4223-866f-2537fe1105a9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:03.905287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf1c32fe-3594-4223-866f-2537fe1105a9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:03.912332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-39744140-5fca-479a-97ea-dc496fe9a28e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:03.913268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-39744140-5fca-479a-97ea-dc496fe9a28e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:03.941821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39744140-5fca-479a-97ea-dc496fe9a28e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:03.942293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39744140-5fca-479a-97ea-dc496fe9a28e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:03.943112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39744140-5fca-479a-97ea-dc496fe9a28e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:03.943560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39744140-5fca-479a-97ea-dc496fe9a28e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:04.025904 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bf1c32fe-3594-4223-866f-2537fe1105a9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.158124 Jan 22 21:19:04.026741 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2777/5826] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:03 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:04.034876 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-39744140-5fca-479a-97ea-dc496fe9a28e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 14 microversion: 2.32 time: 0.127733 Jan 22 21:19:04.035849 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3050/5827] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:03 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:04.039761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f5a1c577-4ed5-4933-a299-31e7189b8534 req-bc2a3d87-f80a-40a5-b981-dac8ce7afe18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "tag": "f1445cec-d592-4347-ab81-b946b09943fa"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:04.046020 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:04.046020 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:19:04.066198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f5a1c577-4ed5-4933-a299-31e7189b8534 req-bc2a3d87-f80a-40a5-b981-dac8ce7afe18 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:04.067645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f5a1c577-4ed5-4933-a299-31e7189b8534 req-bc2a3d87-f80a-40a5-b981-dac8ce7afe18 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:04.101896 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f5a1c577-4ed5-4933-a299-31e7189b8534 req-bc2a3d87-f80a-40a5-b981-dac8ce7afe18 service nova] Creating event network-changed:f1445cec-d592-4347-ab81-b946b09943fa for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:19:04.134906 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f5a1c577-4ed5-4933-a299-31e7189b8534 req-bc2a3d87-f80a-40a5-b981-dac8ce7afe18 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084987 Jan 22 21:19:04.136016 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2778/5828] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:04.375824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ef6c57e7-e2f4-499a-8b2c-0a3606cdfc69 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:04.376816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ef6c57e7-e2f4-499a-8b2c-0a3606cdfc69 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:04.388555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef6c57e7-e2f4-499a-8b2c-0a3606cdfc69 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:04.389434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef6c57e7-e2f4-499a-8b2c-0a3606cdfc69 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:04.390703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef6c57e7-e2f4-499a-8b2c-0a3606cdfc69 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:04.393094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef6c57e7-e2f4-499a-8b2c-0a3606cdfc69 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:04.401756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1838430077", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "f5f4a4c4-68dc-462a-b7e3-4417f0a0a6b4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2119116500", "security_groups": [{"name": "tempest-secgroup-smoke-1928981448"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:04.639108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] validate_networks() for [('f5f4a4c4-68dc-462a-b7e3-4417f0a0a6b4', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:19:04.649848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ef6c57e7-e2f4-499a-8b2c-0a3606cdfc69 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:04.670237 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ef6c57e7-e2f4-499a-8b2c-0a3606cdfc69 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1406 microversion: 2.1 time: 0.296323 Jan 22 21:19:04.670237 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3051/5829] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:04 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:04.882760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-34e6a323-6174-4e49-b465-3ad356beffc7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:04.884021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-34e6a323-6174-4e49-b465-3ad356beffc7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:04.905928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34e6a323-6174-4e49-b465-3ad356beffc7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:04.908863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34e6a323-6174-4e49-b465-3ad356beffc7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:04.917081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34e6a323-6174-4e49-b465-3ad356beffc7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:04.918498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34e6a323-6174-4e49-b465-3ad356beffc7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:05.004665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-34e6a323-6174-4e49-b465-3ad356beffc7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:05.036741 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-34e6a323-6174-4e49-b465-3ad356beffc7 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1459 microversion: 2.1 time: 0.137838 Jan 22 21:19:05.036741 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3052/5830] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:04 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1459 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:05.041455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c251a1eb-b770-41ed-acc5-635ef91b4d26 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:05.042396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c251a1eb-b770-41ed-acc5-635ef91b4d26 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:05.051502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c251a1eb-b770-41ed-acc5-635ef91b4d26 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:05.052353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c251a1eb-b770-41ed-acc5-635ef91b4d26 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:05.053399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c251a1eb-b770-41ed-acc5-635ef91b4d26 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:05.054211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c251a1eb-b770-41ed-acc5-635ef91b4d26 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:05.280549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c251a1eb-b770-41ed-acc5-635ef91b4d26 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:05.292057 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c251a1eb-b770-41ed-acc5-635ef91b4d26 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1318 microversion: 2.1 time: 0.257415 Jan 22 21:19:05.292653 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3053/5831] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:05 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:05.300723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c0b8b857-2ac3-4ab5-81e2-a81788733c1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:05.301730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c0b8b857-2ac3-4ab5-81e2-a81788733c1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:05.318700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0b8b857-2ac3-4ab5-81e2-a81788733c1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:05.319166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0b8b857-2ac3-4ab5-81e2-a81788733c1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:05.319997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0b8b857-2ac3-4ab5-81e2-a81788733c1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:05.320452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0b8b857-2ac3-4ab5-81e2-a81788733c1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:05.398320 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c0b8b857-2ac3-4ab5-81e2-a81788733c1b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.104209 Jan 22 21:19:05.398999 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3054/5832] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:05 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:05.409617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c4229fe3-c3e8-4f11-b232-8378a7d63dd5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:05.410692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c4229fe3-c3e8-4f11-b232-8378a7d63dd5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:05.420799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4229fe3-c3e8-4f11-b232-8378a7d63dd5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:05.421645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4229fe3-c3e8-4f11-b232-8378a7d63dd5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:05.422647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4229fe3-c3e8-4f11-b232-8378a7d63dd5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:05.423533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4229fe3-c3e8-4f11-b232-8378a7d63dd5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:05.486316 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c4229fe3-c3e8-4f11-b232-8378a7d63dd5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 14 microversion: 2.32 time: 0.080701 Jan 22 21:19:05.487633 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3055/5833] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:05 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:05.616484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:19:05.617074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:19:05.617859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:19:05.618287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:19:05.619239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:19:05.634208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:05.635240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:05.636095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:05.636917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:05.661664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:19:05.667997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for user 80aa2e03fde44436844a88a0ccc5d6a6 and project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:19:05.690293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:19:05.690522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9e4ba1b7-bc5c-404e-a0d5-d5fa548c68c6 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:05.690677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:19:05.690815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9e4ba1b7-bc5c-404e-a0d5-d5fa548c68c6 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:05.697436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e4ba1b7-bc5c-404e-a0d5-d5fa548c68c6 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:05.698319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e4ba1b7-bc5c-404e-a0d5-d5fa548c68c6 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:05.699397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e4ba1b7-bc5c-404e-a0d5-d5fa548c68c6 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:05.699966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e4ba1b7-bc5c-404e-a0d5-d5fa548c68c6 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:05.877459 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a31b706b-786d-4fe4-93e7-6f9dfbb5e768 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.479825 Jan 22 21:19:05.885267 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2779/5834] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:19:04 2022] POST /compute/v2.1/servers => generated 408 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:19:05.888705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-145e5a24-3afc-4b8b-902b-54fac034c745 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4056312-c961-4634-aeac-24ae28be351c"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:05.890440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-145e5a24-3afc-4b8b-902b-54fac034c745 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:05.900118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-145e5a24-3afc-4b8b-902b-54fac034c745 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:05.900927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-145e5a24-3afc-4b8b-902b-54fac034c745 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:05.902463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-145e5a24-3afc-4b8b-902b-54fac034c745 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:05.903063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-145e5a24-3afc-4b8b-902b-54fac034c745 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:05.949652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9e4ba1b7-bc5c-404e-a0d5-d5fa548c68c6 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:05.975790 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9e4ba1b7-bc5c-404e-a0d5-d5fa548c68c6 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1406 microversion: 2.1 time: 0.290915 Jan 22 21:19:05.977805 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3056/5835] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:05 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:05.990852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4f1434be-3d32-4e8f-b01d-f2c494436bb6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:05.991531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4f1434be-3d32-4e8f-b01d-f2c494436bb6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:06.131817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4f1434be-3d32-4e8f-b01d-f2c494436bb6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:06.141323 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4f1434be-3d32-4e8f-b01d-f2c494436bb6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1271 microversion: 2.1 time: 0.162374 Jan 22 21:19:06.144522 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3057/5836] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:05 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:06.153113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-84c72c3f-4a73-449f-9778-af374ed0c5ca tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:06.153828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-84c72c3f-4a73-449f-9778-af374ed0c5ca tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:06.164140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84c72c3f-4a73-449f-9778-af374ed0c5ca tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:06.164673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84c72c3f-4a73-449f-9778-af374ed0c5ca tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:06.165418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84c72c3f-4a73-449f-9778-af374ed0c5ca tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:06.165899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84c72c3f-4a73-449f-9778-af374ed0c5ca tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:06.222825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84c72c3f-4a73-449f-9778-af374ed0c5ca tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:06.229428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84c72c3f-4a73-449f-9778-af374ed0c5ca tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:06.230427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-84c72c3f-4a73-449f-9778-af374ed0c5ca tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lazy-loading 'fault' on Instance uuid 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:19:06.292052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-84c72c3f-4a73-449f-9778-af374ed0c5ca tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b93108a71872461ea979735a490694a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1c3aa9e1ae4cc8a5a021434ad4a59c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:06.300842 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-84c72c3f-4a73-449f-9778-af374ed0c5ca tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 200 len: 1308 microversion: 2.1 time: 0.154989 Jan 22 21:19:06.301725 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3058/5837] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:06 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 1308 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:06.308878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-8788c0bf-a504-475f-a4c0-6c44fa404461 req-1b75b924-8175-4c0c-a68b-76daaffd2ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e37baa6-5103-4ac9-99f5-3cb87ecb7be2", "name": "network-vif-deleted", "tag": "4106a7ca-c629-490e-8151-691df9c930ba"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:06.311010 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:06.311010 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:19:06.319874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8788c0bf-a504-475f-a4c0-6c44fa404461 req-1b75b924-8175-4c0c-a68b-76daaffd2ed6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:06.320581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8788c0bf-a504-475f-a4c0-6c44fa404461 req-1b75b924-8175-4c0c-a68b-76daaffd2ed6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:06.333218 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-8788c0bf-a504-475f-a4c0-6c44fa404461 req-1b75b924-8175-4c0c-a68b-76daaffd2ed6 service nova] Creating event network-vif-deleted:4106a7ca-c629-490e-8151-691df9c930ba for instance 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 on nch1-master-1 Jan 22 21:19:06.339112 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-8788c0bf-a504-475f-a4c0-6c44fa404461 req-1b75b924-8175-4c0c-a68b-76daaffd2ed6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036019 Jan 22 21:19:06.340608 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3059/5838] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:06.349162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3554a769-aa85-406a-a852-58aa20f2e11f tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:06.352552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3554a769-aa85-406a-a852-58aa20f2e11f tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:06.367676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3554a769-aa85-406a-a852-58aa20f2e11f tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:06.368134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3554a769-aa85-406a-a852-58aa20f2e11f tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:06.368950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3554a769-aa85-406a-a852-58aa20f2e11f tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:06.369403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3554a769-aa85-406a-a852-58aa20f2e11f tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:06.624720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3554a769-aa85-406a-a852-58aa20f2e11f tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:06.635460 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3554a769-aa85-406a-a852-58aa20f2e11f tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1318 microversion: 2.1 time: 0.292744 Jan 22 21:19:06.636051 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3060/5839] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:06 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:06.655952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-283dbdf6-f66e-4c8d-8a5f-3266ed12785b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:06.657160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-283dbdf6-f66e-4c8d-8a5f-3266ed12785b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:06.663687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-283dbdf6-f66e-4c8d-8a5f-3266ed12785b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:06.664905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-283dbdf6-f66e-4c8d-8a5f-3266ed12785b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:06.665108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-283dbdf6-f66e-4c8d-8a5f-3266ed12785b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:06.665757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-283dbdf6-f66e-4c8d-8a5f-3266ed12785b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:06.742760 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-283dbdf6-f66e-4c8d-8a5f-3266ed12785b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.105432 Jan 22 21:19:06.745344 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3061/5840] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:06 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:06.752627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3bd90911-598b-4dd8-b721-9b1f7ae2db7c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:06.753686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3bd90911-598b-4dd8-b721-9b1f7ae2db7c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:06.761655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3bd90911-598b-4dd8-b721-9b1f7ae2db7c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:06.762319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3bd90911-598b-4dd8-b721-9b1f7ae2db7c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:06.764254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3bd90911-598b-4dd8-b721-9b1f7ae2db7c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:06.764919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3bd90911-598b-4dd8-b721-9b1f7ae2db7c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:06.813110 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3bd90911-598b-4dd8-b721-9b1f7ae2db7c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 14 microversion: 2.32 time: 0.064496 Jan 22 21:19:06.814175 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3062/5841] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:06 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:07.000574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b05aa6fb-cb6a-473c-88dd-36d9be36bb62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:07.000574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b05aa6fb-cb6a-473c-88dd-36d9be36bb62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:07.004370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b05aa6fb-cb6a-473c-88dd-36d9be36bb62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.004823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b05aa6fb-cb6a-473c-88dd-36d9be36bb62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.005844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b05aa6fb-cb6a-473c-88dd-36d9be36bb62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.006523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b05aa6fb-cb6a-473c-88dd-36d9be36bb62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.024740 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-145e5a24-3afc-4b8b-902b-54fac034c745 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.141375 Jan 22 21:19:07.029430 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2780/5842] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:19:05 2022] POST /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments => generated 194 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:07.160539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-baaab229-6337-48cd-82d8-507cbfe55879 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:07.161720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-baaab229-6337-48cd-82d8-507cbfe55879 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:07.169676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baaab229-6337-48cd-82d8-507cbfe55879 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.170187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baaab229-6337-48cd-82d8-507cbfe55879 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.171001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baaab229-6337-48cd-82d8-507cbfe55879 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.171732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baaab229-6337-48cd-82d8-507cbfe55879 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.223282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b05aa6fb-cb6a-473c-88dd-36d9be36bb62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:07.232879 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b05aa6fb-cb6a-473c-88dd-36d9be36bb62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1406 microversion: 2.1 time: 0.241708 Jan 22 21:19:07.233493 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3063/5843] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:06 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:07.256898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-baaab229-6337-48cd-82d8-507cbfe55879 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:07.266581 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-baaab229-6337-48cd-82d8-507cbfe55879 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1275 microversion: 2.1 time: 0.111723 Jan 22 21:19:07.268022 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2781/5844] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:07 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1275 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:07.324163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6c594ece-45b5-4a6d-8ea4-990564cf0fff tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:07.324163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6c594ece-45b5-4a6d-8ea4-990564cf0fff tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:07.331844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c594ece-45b5-4a6d-8ea4-990564cf0fff tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.332309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c594ece-45b5-4a6d-8ea4-990564cf0fff tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.333128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c594ece-45b5-4a6d-8ea4-990564cf0fff tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.346295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c594ece-45b5-4a6d-8ea4-990564cf0fff tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.372695 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-6c594ece-45b5-4a6d-8ea4-990564cf0fff tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 could not be found. Jan 22 21:19:07.373332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6c594ece-45b5-4a6d-8ea4-990564cf0fff tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:07.386724 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6c594ece-45b5-4a6d-8ea4-990564cf0fff tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 404 len: 111 microversion: 2.1 time: 0.070606 Jan 22 21:19:07.387503 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3064/5845] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:07 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:07.405037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8232ae90-7ee0-4eb7-9c7f-4aa4f2266803 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:07.405037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8232ae90-7ee0-4eb7-9c7f-4aa4f2266803 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:07.409981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8232ae90-7ee0-4eb7-9c7f-4aa4f2266803 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.410447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8232ae90-7ee0-4eb7-9c7f-4aa4f2266803 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.411257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8232ae90-7ee0-4eb7-9c7f-4aa4f2266803 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.411709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8232ae90-7ee0-4eb7-9c7f-4aa4f2266803 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.430476 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-8232ae90-7ee0-4eb7-9c7f-4aa4f2266803 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 could not be found. Jan 22 21:19:07.430476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8232ae90-7ee0-4eb7-9c7f-4aa4f2266803 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:07.430476 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8232ae90-7ee0-4eb7-9c7f-4aa4f2266803 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 404 len: 111 microversion: 2.1 time: 0.030550 Jan 22 21:19:07.430476 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2782/5846] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:19:07 2022] DELETE /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:07.438466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6d53990e-3ee0-419d-b866-760e30dfe0b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:07.439274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6d53990e-3ee0-419d-b866-760e30dfe0b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:07.447008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d53990e-3ee0-419d-b866-760e30dfe0b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.447675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d53990e-3ee0-419d-b866-760e30dfe0b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.449428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d53990e-3ee0-419d-b866-760e30dfe0b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.450675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d53990e-3ee0-419d-b866-760e30dfe0b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.467244 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-6d53990e-3ee0-419d-b866-760e30dfe0b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 could not be found. Jan 22 21:19:07.469055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6d53990e-3ee0-419d-b866-760e30dfe0b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:07.470128 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6d53990e-3ee0-419d-b866-760e30dfe0b9 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2" status: 404 len: 111 microversion: 2.1 time: 0.037458 Jan 22 21:19:07.473534 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3065/5847] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:07 2022] GET /compute/v2.1/servers/6e37baa6-5103-4ac9-99f5-3cb87ecb7be2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:19:07.484991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-de69e8ee-045d-4163-b41d-8de2f9d38aac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:07.486429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-de69e8ee-045d-4163-b41d-8de2f9d38aac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:07.501639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de69e8ee-045d-4163-b41d-8de2f9d38aac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.502364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de69e8ee-045d-4163-b41d-8de2f9d38aac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.503339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de69e8ee-045d-4163-b41d-8de2f9d38aac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.503946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de69e8ee-045d-4163-b41d-8de2f9d38aac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.520497 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-de69e8ee-045d-4163-b41d-8de2f9d38aac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 003afb2c-4163-45fa-8f37-346bd32ffb62 could not be found. Jan 22 21:19:07.521638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-de69e8ee-045d-4163-b41d-8de2f9d38aac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 003afb2c-4163-45fa-8f37-346bd32ffb62 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:07.522704 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-de69e8ee-045d-4163-b41d-8de2f9d38aac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 404 len: 111 microversion: 2.1 time: 0.045073 Jan 22 21:19:07.523492 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2783/5848] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:19:07 2022] DELETE /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:07.539071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7714310f-02ef-4de0-ab77-4fb49b412959 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:07.539071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7714310f-02ef-4de0-ab77-4fb49b412959 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 003afb2c-4163-45fa-8f37-346bd32ffb62] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:07.549162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7714310f-02ef-4de0-ab77-4fb49b412959 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.550681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7714310f-02ef-4de0-ab77-4fb49b412959 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.553043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7714310f-02ef-4de0-ab77-4fb49b412959 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.553955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7714310f-02ef-4de0-ab77-4fb49b412959 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.608539 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-7714310f-02ef-4de0-ab77-4fb49b412959 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 003afb2c-4163-45fa-8f37-346bd32ffb62 could not be found. Jan 22 21:19:07.611289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7714310f-02ef-4de0-ab77-4fb49b412959 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 003afb2c-4163-45fa-8f37-346bd32ffb62 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:07.613013 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7714310f-02ef-4de0-ab77-4fb49b412959 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62" status: 404 len: 111 microversion: 2.1 time: 0.084993 Jan 22 21:19:07.614418 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3066/5849] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:07 2022] GET /compute/v2.1/servers/003afb2c-4163-45fa-8f37-346bd32ffb62 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:07.624390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e4a2afe3-5732-4d4a-8dc5-85f9fd7ca5e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:07.625531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e4a2afe3-5732-4d4a-8dc5-85f9fd7ca5e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:07.632743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4a2afe3-5732-4d4a-8dc5-85f9fd7ca5e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.634662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4a2afe3-5732-4d4a-8dc5-85f9fd7ca5e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.641964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4a2afe3-5732-4d4a-8dc5-85f9fd7ca5e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.642792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4a2afe3-5732-4d4a-8dc5-85f9fd7ca5e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.659078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-903fafec-56d4-4ff4-b900-099e1db66cb0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:07.664016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-903fafec-56d4-4ff4-b900-099e1db66cb0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:07.672967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-903fafec-56d4-4ff4-b900-099e1db66cb0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.673811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-903fafec-56d4-4ff4-b900-099e1db66cb0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.674881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-903fafec-56d4-4ff4-b900-099e1db66cb0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.677176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-903fafec-56d4-4ff4-b900-099e1db66cb0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.695301 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-e4a2afe3-5732-4d4a-8dc5-85f9fd7ca5e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 94caeb9b-99d6-4bf0-afa1-14362bcefed1 could not be found. Jan 22 21:19:07.696496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e4a2afe3-5732-4d4a-8dc5-85f9fd7ca5e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 94caeb9b-99d6-4bf0-afa1-14362bcefed1 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:07.697712 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e4a2afe3-5732-4d4a-8dc5-85f9fd7ca5e5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 404 len: 111 microversion: 2.1 time: 0.079471 Jan 22 21:19:07.698946 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2784/5850] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:19:07 2022] DELETE /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:19:07.708649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-23db1e31-1c7b-44c0-a1fc-3626b1a4016e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:07.709840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-23db1e31-1c7b-44c0-a1fc-3626b1a4016e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 94caeb9b-99d6-4bf0-afa1-14362bcefed1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:07.719570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23db1e31-1c7b-44c0-a1fc-3626b1a4016e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.720626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23db1e31-1c7b-44c0-a1fc-3626b1a4016e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.722327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23db1e31-1c7b-44c0-a1fc-3626b1a4016e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.722959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23db1e31-1c7b-44c0-a1fc-3626b1a4016e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.767433 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-23db1e31-1c7b-44c0-a1fc-3626b1a4016e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 94caeb9b-99d6-4bf0-afa1-14362bcefed1 could not be found. Jan 22 21:19:07.768305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-23db1e31-1c7b-44c0-a1fc-3626b1a4016e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 94caeb9b-99d6-4bf0-afa1-14362bcefed1 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:07.769189 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-23db1e31-1c7b-44c0-a1fc-3626b1a4016e tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1" status: 404 len: 111 microversion: 2.1 time: 0.065627 Jan 22 21:19:07.773653 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2785/5851] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:07 2022] GET /compute/v2.1/servers/94caeb9b-99d6-4bf0-afa1-14362bcefed1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:07.788136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5d571ab1-fcb4-447c-b925-81c0a93f73eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:07.790981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5d571ab1-fcb4-447c-b925-81c0a93f73eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:07.814018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d571ab1-fcb4-447c-b925-81c0a93f73eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.814593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d571ab1-fcb4-447c-b925-81c0a93f73eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.817059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d571ab1-fcb4-447c-b925-81c0a93f73eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.817858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d571ab1-fcb4-447c-b925-81c0a93f73eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.897455 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5d571ab1-fcb4-447c-b925-81c0a93f73eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.122193 Jan 22 21:19:07.901548 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2786/5852] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:07 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:07.903919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f06f1485-f451-417b-b483-7b48ec41defc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:07.904929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f06f1485-f451-417b-b483-7b48ec41defc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:07.912656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06f1485-f451-417b-b483-7b48ec41defc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.913127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06f1485-f451-417b-b483-7b48ec41defc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.913962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06f1485-f451-417b-b483-7b48ec41defc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.914408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06f1485-f451-417b-b483-7b48ec41defc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.940391 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-f06f1485-f451-417b-b483-7b48ec41defc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 1ec4d907-48d2-48e9-8c9a-63dea188dab0 could not be found. Jan 22 21:19:07.941047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f06f1485-f451-417b-b483-7b48ec41defc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 1ec4d907-48d2-48e9-8c9a-63dea188dab0 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:07.942590 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f06f1485-f451-417b-b483-7b48ec41defc tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 404 len: 111 microversion: 2.1 time: 0.042608 Jan 22 21:19:07.942590 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2787/5853] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:19:07 2022] DELETE /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:07.949413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ad1ed3f8-a34e-4aa8-bbde-57ed5d128923 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:07.952696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ad1ed3f8-a34e-4aa8-bbde-57ed5d128923 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:07.959666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad1ed3f8-a34e-4aa8-bbde-57ed5d128923 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.960470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad1ed3f8-a34e-4aa8-bbde-57ed5d128923 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.961123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad1ed3f8-a34e-4aa8-bbde-57ed5d128923 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:07.962579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad1ed3f8-a34e-4aa8-bbde-57ed5d128923 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:07.976730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-903fafec-56d4-4ff4-b900-099e1db66cb0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:07.990786 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-903fafec-56d4-4ff4-b900-099e1db66cb0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1318 microversion: 2.1 time: 0.340081 Jan 22 21:19:07.992026 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3067/5854] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:07 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:07.997352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-022640f2-a762-4f5d-82ab-a69cb459f47e req-4b20cef1-5e86-4659-9d6a-d44581dc6d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b913871-15e3-4b2c-a015-a6d11af6edfd", "name": "network-vif-plugged", "status": "completed", "tag": "ad576433-f854-429f-a316-8e6e9096015b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:08.000073 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:08.000073 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:19:08.010536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-022640f2-a762-4f5d-82ab-a69cb459f47e req-4b20cef1-5e86-4659-9d6a-d44581dc6d2f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:08.011241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-022640f2-a762-4f5d-82ab-a69cb459f47e req-4b20cef1-5e86-4659-9d6a-d44581dc6d2f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:08.011818 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ad1ed3f8-a34e-4aa8-bbde-57ed5d128923 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 14 microversion: 2.32 time: 0.067236 Jan 22 21:19:08.015336 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2788/5855] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:07 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:08.037881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-25e8e6ab-716f-4f13-8c67-05c9fd9be2c8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:08.038713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-25e8e6ab-716f-4f13-8c67-05c9fd9be2c8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 1ec4d907-48d2-48e9-8c9a-63dea188dab0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:08.046128 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-022640f2-a762-4f5d-82ab-a69cb459f47e req-4b20cef1-5e86-4659-9d6a-d44581dc6d2f service nova] Creating event network-vif-plugged:ad576433-f854-429f-a316-8e6e9096015b for instance 6b913871-15e3-4b2c-a015-a6d11af6edfd on nch2-master-1 Jan 22 21:19:08.052731 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-022640f2-a762-4f5d-82ab-a69cb459f47e req-4b20cef1-5e86-4659-9d6a-d44581dc6d2f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059404 Jan 22 21:19:08.052932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25e8e6ab-716f-4f13-8c67-05c9fd9be2c8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:08.053357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25e8e6ab-716f-4f13-8c67-05c9fd9be2c8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:08.054144 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3068/5856] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:08.054274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25e8e6ab-716f-4f13-8c67-05c9fd9be2c8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:08.058164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25e8e6ab-716f-4f13-8c67-05c9fd9be2c8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:08.115640 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-25e8e6ab-716f-4f13-8c67-05c9fd9be2c8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 1ec4d907-48d2-48e9-8c9a-63dea188dab0 could not be found. Jan 22 21:19:08.116641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-25e8e6ab-716f-4f13-8c67-05c9fd9be2c8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 1ec4d907-48d2-48e9-8c9a-63dea188dab0 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:08.118160 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-25e8e6ab-716f-4f13-8c67-05c9fd9be2c8 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0" status: 404 len: 111 microversion: 2.1 time: 0.103203 Jan 22 21:19:08.119192 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2789/5857] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:08 2022] GET /compute/v2.1/servers/1ec4d907-48d2-48e9-8c9a-63dea188dab0 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:08.133160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e4db876b-e4bd-4cc5-bb6a-922de08b20ac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:08.133829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e4db876b-e4bd-4cc5-bb6a-922de08b20ac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: daeb01c3-b726-42b0-bd38-001d83d6a716] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:08.142428 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-e4db876b-e4bd-4cc5-bb6a-922de08b20ac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance daeb01c3-b726-42b0-bd38-001d83d6a716 could not be found. Jan 22 21:19:08.143335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e4db876b-e4bd-4cc5-bb6a-922de08b20ac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance daeb01c3-b726-42b0-bd38-001d83d6a716 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:08.145169 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e4db876b-e4bd-4cc5-bb6a-922de08b20ac tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/daeb01c3-b726-42b0-bd38-001d83d6a716" status: 404 len: 111 microversion: 2.1 time: 0.020987 Jan 22 21:19:08.146283 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3069/5858] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:19:08 2022] DELETE /compute/v2.1/servers/daeb01c3-b726-42b0-bd38-001d83d6a716 => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:08.155080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b6f31b8f-5bb0-4f35-adf2-22aee47a2fb5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:08.156103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b6f31b8f-5bb0-4f35-adf2-22aee47a2fb5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: daeb01c3-b726-42b0-bd38-001d83d6a716] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:08.164763 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-b6f31b8f-5bb0-4f35-adf2-22aee47a2fb5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance daeb01c3-b726-42b0-bd38-001d83d6a716 could not be found. Jan 22 21:19:08.165391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b6f31b8f-5bb0-4f35-adf2-22aee47a2fb5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance daeb01c3-b726-42b0-bd38-001d83d6a716 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:08.166431 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b6f31b8f-5bb0-4f35-adf2-22aee47a2fb5 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/daeb01c3-b726-42b0-bd38-001d83d6a716" status: 404 len: 111 microversion: 2.1 time: 0.015425 Jan 22 21:19:08.167466 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2790/5859] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:08 2022] GET /compute/v2.1/servers/daeb01c3-b726-42b0-bd38-001d83d6a716 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:08.250457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-86831002-45c6-43c8-b1a7-144bcb99341e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:08.251334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-86831002-45c6-43c8-b1a7-144bcb99341e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:08.263115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86831002-45c6-43c8-b1a7-144bcb99341e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:08.265026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86831002-45c6-43c8-b1a7-144bcb99341e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:08.271621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86831002-45c6-43c8-b1a7-144bcb99341e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:08.271621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86831002-45c6-43c8-b1a7-144bcb99341e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:08.288179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3e7694b8-f3a6-4e4b-ae96-a6d54aa2913d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:08.300364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3e7694b8-f3a6-4e4b-ae96-a6d54aa2913d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:08.311887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e7694b8-f3a6-4e4b-ae96-a6d54aa2913d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:08.312348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e7694b8-f3a6-4e4b-ae96-a6d54aa2913d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:08.313161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e7694b8-f3a6-4e4b-ae96-a6d54aa2913d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:08.313642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e7694b8-f3a6-4e4b-ae96-a6d54aa2913d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:08.511605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3e7694b8-f3a6-4e4b-ae96-a6d54aa2913d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:08.538639 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3e7694b8-f3a6-4e4b-ae96-a6d54aa2913d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1323 microversion: 2.1 time: 0.256319 Jan 22 21:19:08.541166 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2791/5860] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:08 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1323 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:08.574947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-86831002-45c6-43c8-b1a7-144bcb99341e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:08.584492 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-86831002-45c6-43c8-b1a7-144bcb99341e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1406 microversion: 2.1 time: 0.338802 Jan 22 21:19:08.585377 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3070/5861] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:08 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:08.910930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f439cb1b-0c8b-4e5f-a0e9-6f8de4185f20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:08.912043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f439cb1b-0c8b-4e5f-a0e9-6f8de4185f20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:08.920798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f439cb1b-0c8b-4e5f-a0e9-6f8de4185f20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:08.921349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f439cb1b-0c8b-4e5f-a0e9-6f8de4185f20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:08.922817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f439cb1b-0c8b-4e5f-a0e9-6f8de4185f20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:08.923328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f439cb1b-0c8b-4e5f-a0e9-6f8de4185f20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:08.973250 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f439cb1b-0c8b-4e5f-a0e9-6f8de4185f20 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.067856 Jan 22 21:19:08.974351 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2792/5862] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:08 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:09.007963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-595aa752-41b5-4e53-9903-ddb806effe5d tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:09.013254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-595aa752-41b5-4e53-9903-ddb806effe5d tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:09.018711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-595aa752-41b5-4e53-9903-ddb806effe5d tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:09.020375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-595aa752-41b5-4e53-9903-ddb806effe5d tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:09.023015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-595aa752-41b5-4e53-9903-ddb806effe5d tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:09.023452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-595aa752-41b5-4e53-9903-ddb806effe5d tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:09.025393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9dd5d5ca-f928-4611-82dc-91e937f53d27 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:09.031844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9dd5d5ca-f928-4611-82dc-91e937f53d27 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:09.076685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9dd5d5ca-f928-4611-82dc-91e937f53d27 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:09.077389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9dd5d5ca-f928-4611-82dc-91e937f53d27 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:09.087257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9dd5d5ca-f928-4611-82dc-91e937f53d27 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:09.087517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9dd5d5ca-f928-4611-82dc-91e937f53d27 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:09.176443 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9dd5d5ca-f928-4611-82dc-91e937f53d27 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 14 microversion: 2.32 time: 0.156689 Jan 22 21:19:09.179606 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2793/5863] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:09 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:09.429946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-595aa752-41b5-4e53-9903-ddb806effe5d tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:09.441951 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-595aa752-41b5-4e53-9903-ddb806effe5d tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1318 microversion: 2.1 time: 0.437379 Jan 22 21:19:09.442953 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3071/5864] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:09 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:09.558996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-da38ecf1-db1b-47e0-9d76-42ce49e14995 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:09.559787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-da38ecf1-db1b-47e0-9d76-42ce49e14995 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:09.583989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da38ecf1-db1b-47e0-9d76-42ce49e14995 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:09.584458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da38ecf1-db1b-47e0-9d76-42ce49e14995 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:09.585296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da38ecf1-db1b-47e0-9d76-42ce49e14995 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:09.595507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da38ecf1-db1b-47e0-9d76-42ce49e14995 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:09.602124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b88095f-b9f9-4d94-95df-e77885d6bffe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:09.603020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6b88095f-b9f9-4d94-95df-e77885d6bffe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:09.627025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b88095f-b9f9-4d94-95df-e77885d6bffe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:09.629478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b88095f-b9f9-4d94-95df-e77885d6bffe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:09.630336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b88095f-b9f9-4d94-95df-e77885d6bffe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:09.631423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b88095f-b9f9-4d94-95df-e77885d6bffe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:09.717039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-da38ecf1-db1b-47e0-9d76-42ce49e14995 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:09.745938 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-da38ecf1-db1b-47e0-9d76-42ce49e14995 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1329 microversion: 2.1 time: 0.190183 Jan 22 21:19:09.749148 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2794/5865] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:09 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1329 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:09.890945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6b88095f-b9f9-4d94-95df-e77885d6bffe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:09.904604 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b88095f-b9f9-4d94-95df-e77885d6bffe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1406 microversion: 2.1 time: 0.305320 Jan 22 21:19:09.907279 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3072/5866] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:09 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1406 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:09.986721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c09afe9a-47e5-40b9-bf1d-a85113ef8e6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:09.988335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c09afe9a-47e5-40b9-bf1d-a85113ef8e6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:10.004055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c09afe9a-47e5-40b9-bf1d-a85113ef8e6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:10.004735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c09afe9a-47e5-40b9-bf1d-a85113ef8e6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:10.006642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c09afe9a-47e5-40b9-bf1d-a85113ef8e6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:10.008647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c09afe9a-47e5-40b9-bf1d-a85113ef8e6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:10.096296 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c09afe9a-47e5-40b9-bf1d-a85113ef8e6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.113501 Jan 22 21:19:10.104350 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2795/5867] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:09 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:10.189197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-36772605-e542-4d39-a0aa-4fa59551f2dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:10.191700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-36772605-e542-4d39-a0aa-4fa59551f2dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:10.203856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36772605-e542-4d39-a0aa-4fa59551f2dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:10.204738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36772605-e542-4d39-a0aa-4fa59551f2dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:10.212914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36772605-e542-4d39-a0aa-4fa59551f2dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:10.212914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36772605-e542-4d39-a0aa-4fa59551f2dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:10.280858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-c2c37441-00c8-4718-a7f5-bbc219fed352 req-71477ba4-91bf-4e87-8097-3af33fd9bc50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e318c979-4614-4d4f-9412-43d48d1b042b", "name": "network-vif-plugged", "status": "completed", "tag": "8f6916af-e766-4eb7-96e1-7e81bb9a0a97"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:10.282005 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:10.282005 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:19:10.303687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c2c37441-00c8-4718-a7f5-bbc219fed352 req-71477ba4-91bf-4e87-8097-3af33fd9bc50 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:10.303687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c2c37441-00c8-4718-a7f5-bbc219fed352 req-71477ba4-91bf-4e87-8097-3af33fd9bc50 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:10.314444 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-36772605-e542-4d39-a0aa-4fa59551f2dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 14 microversion: 2.32 time: 0.130273 Jan 22 21:19:10.318553 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3073/5868] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:10 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:10.323697 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-c2c37441-00c8-4718-a7f5-bbc219fed352 req-71477ba4-91bf-4e87-8097-3af33fd9bc50 service nova] Creating event network-vif-plugged:8f6916af-e766-4eb7-96e1-7e81bb9a0a97 for instance e318c979-4614-4d4f-9412-43d48d1b042b on nch2-master-1 Jan 22 21:19:10.334562 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-c2c37441-00c8-4718-a7f5-bbc219fed352 req-71477ba4-91bf-4e87-8097-3af33fd9bc50 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059743 Jan 22 21:19:10.335853 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2796/5869] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:10.466224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-737b936c-af40-417d-bf1d-9c11d279224a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:10.467796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-737b936c-af40-417d-bf1d-9c11d279224a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:10.477158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-737b936c-af40-417d-bf1d-9c11d279224a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:10.478981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-737b936c-af40-417d-bf1d-9c11d279224a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:10.480257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-737b936c-af40-417d-bf1d-9c11d279224a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:10.480941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-737b936c-af40-417d-bf1d-9c11d279224a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:10.768045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1e386751-0340-479f-b193-c41ce053365e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:10.768963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1e386751-0340-479f-b193-c41ce053365e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:10.771245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-737b936c-af40-417d-bf1d-9c11d279224a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:10.776058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e386751-0340-479f-b193-c41ce053365e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:10.776815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e386751-0340-479f-b193-c41ce053365e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:10.777925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e386751-0340-479f-b193-c41ce053365e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:10.778913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e386751-0340-479f-b193-c41ce053365e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:10.779898 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-737b936c-af40-417d-bf1d-9c11d279224a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1505 microversion: 2.1 time: 0.323041 Jan 22 21:19:10.792185 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3074/5870] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:10 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:10.797955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ae5067d-46f9-4d09-bff3-c97dbe712dd8 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:10.798691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1ae5067d-46f9-4d09-bff3-c97dbe712dd8 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:10.811911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ae5067d-46f9-4d09-bff3-c97dbe712dd8 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:10.812884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ae5067d-46f9-4d09-bff3-c97dbe712dd8 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:10.813786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ae5067d-46f9-4d09-bff3-c97dbe712dd8 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:10.814245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ae5067d-46f9-4d09-bff3-c97dbe712dd8 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:10.962483 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ae5067d-46f9-4d09-bff3-c97dbe712dd8 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.168422 Jan 22 21:19:10.963168 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3075/5871] 10.222.0.100 () {58 vars in 1300 bytes} [Sat Jan 22 21:19:10 2022] DELETE /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd/os-server-password => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:19:10.970215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ef2a52fe-ef54-4853-b19f-127c6b66e657 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:10.971425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ef2a52fe-ef54-4853-b19f-127c6b66e657 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:10.977073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef2a52fe-ef54-4853-b19f-127c6b66e657 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:10.977562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef2a52fe-ef54-4853-b19f-127c6b66e657 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:10.978378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef2a52fe-ef54-4853-b19f-127c6b66e657 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:10.978840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef2a52fe-ef54-4853-b19f-127c6b66e657 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:10.999854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1e386751-0340-479f-b193-c41ce053365e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:11.022964 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1e386751-0340-479f-b193-c41ce053365e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1397 microversion: 2.1 time: 0.260885 Jan 22 21:19:11.023551 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2797/5872] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:10 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1397 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:11.034849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f6c5d0e1-d7fb-4115-9c4a-5de52820416b tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:11.035420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f6c5d0e1-d7fb-4115-9c4a-5de52820416b tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:11.044845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6c5d0e1-d7fb-4115-9c4a-5de52820416b tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:11.045812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6c5d0e1-d7fb-4115-9c4a-5de52820416b tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:11.047260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6c5d0e1-d7fb-4115-9c4a-5de52820416b tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:11.047729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6c5d0e1-d7fb-4115-9c4a-5de52820416b tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:11.106003 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f6c5d0e1-d7fb-4115-9c4a-5de52820416b tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.077372 Jan 22 21:19:11.109414 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2798/5873] 10.222.0.100 () {58 vars in 1297 bytes} [Sat Jan 22 21:19:11 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd/os-server-password => generated 16 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:19:11.116787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-99f00e89-0280-4306-a5ee-5250922a21f1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:11.118382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-99f00e89-0280-4306-a5ee-5250922a21f1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:11.125738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99f00e89-0280-4306-a5ee-5250922a21f1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:11.126624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99f00e89-0280-4306-a5ee-5250922a21f1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:11.128481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99f00e89-0280-4306-a5ee-5250922a21f1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:11.129200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99f00e89-0280-4306-a5ee-5250922a21f1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:11.213700 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-99f00e89-0280-4306-a5ee-5250922a21f1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.102467 Jan 22 21:19:11.214384 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2799/5874] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:11 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:11.233777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-43f0470c-b369-4536-991b-900813c31cf5 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:11.234661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-43f0470c-b369-4536-991b-900813c31cf5 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:11.244751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43f0470c-b369-4536-991b-900813c31cf5 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:11.248317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43f0470c-b369-4536-991b-900813c31cf5 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:11.248317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43f0470c-b369-4536-991b-900813c31cf5 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:11.248317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43f0470c-b369-4536-991b-900813c31cf5 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:11.291504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-43f0470c-b369-4536-991b-900813c31cf5 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:19:11.307866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ef2a52fe-ef54-4853-b19f-127c6b66e657 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:11.323083 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ef2a52fe-ef54-4853-b19f-127c6b66e657 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1406 microversion: 2.1 time: 0.355633 Jan 22 21:19:11.326338 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3076/5875] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:10 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:11.338383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6cfd50b8-473c-4ddc-9868-137569ba058d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:11.343778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6cfd50b8-473c-4ddc-9868-137569ba058d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:11.358969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6cfd50b8-473c-4ddc-9868-137569ba058d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:11.359578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6cfd50b8-473c-4ddc-9868-137569ba058d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:11.360719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6cfd50b8-473c-4ddc-9868-137569ba058d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:11.361312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6cfd50b8-473c-4ddc-9868-137569ba058d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:11.428478 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6cfd50b8-473c-4ddc-9868-137569ba058d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 14 microversion: 2.32 time: 0.100556 Jan 22 21:19:11.429551 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3077/5876] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:11 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:11.662574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-8358de17-f864-4f62-9ec1-a8b0b39b9a22 req-112914c7-35a8-45f0-99fe-04019b31dcd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60f5752-e3a2-40ea-97fe-c98ebb12e4f7", "tag": "3b4b9042-2ab2-4731-b9ee-9b33a072ec37"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:11.664819 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:11.664819 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:19:11.680726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8358de17-f864-4f62-9ec1-a8b0b39b9a22 req-112914c7-35a8-45f0-99fe-04019b31dcd1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:11.681391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8358de17-f864-4f62-9ec1-a8b0b39b9a22 req-112914c7-35a8-45f0-99fe-04019b31dcd1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:11.692792 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-43f0470c-b369-4536-991b-900813c31cf5 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 204 len: 0 microversion: 2.1 time: 0.469432 Jan 22 21:19:11.693933 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2800/5877] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:19:11 2022] DELETE /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:19:11.706135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48a882cc-d789-42c9-a046-c16192128361 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:11.706916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48a882cc-d789-42c9-a046-c16192128361 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:11.712438 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-8358de17-f864-4f62-9ec1-a8b0b39b9a22 req-112914c7-35a8-45f0-99fe-04019b31dcd1 service nova] Creating event network-changed:3b4b9042-2ab2-4731-b9ee-9b33a072ec37 for instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 on nch1-master-1 Jan 22 21:19:11.717693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48a882cc-d789-42c9-a046-c16192128361 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:11.718354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48a882cc-d789-42c9-a046-c16192128361 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:11.720079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48a882cc-d789-42c9-a046-c16192128361 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:11.720600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48a882cc-d789-42c9-a046-c16192128361 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:11.725277 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-8358de17-f864-4f62-9ec1-a8b0b39b9a22 req-112914c7-35a8-45f0-99fe-04019b31dcd1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067282 Jan 22 21:19:11.728471 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3078/5878] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:19:12.046240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1986b726-fd2a-4775-b662-bd424900200c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:12.046813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1986b726-fd2a-4775-b662-bd424900200c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:12.056315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1986b726-fd2a-4775-b662-bd424900200c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:12.060471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1986b726-fd2a-4775-b662-bd424900200c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:12.061767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1986b726-fd2a-4775-b662-bd424900200c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:12.064794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1986b726-fd2a-4775-b662-bd424900200c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:12.109157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-48a882cc-d789-42c9-a046-c16192128361 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:12.126150 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48a882cc-d789-42c9-a046-c16192128361 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1511 microversion: 2.1 time: 0.426896 Jan 22 21:19:12.137417 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2801/5879] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:11 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:12.228775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b7e2c887-c379-4b51-a36e-6b5b378be4ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:12.230742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b7e2c887-c379-4b51-a36e-6b5b378be4ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:12.240118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7e2c887-c379-4b51-a36e-6b5b378be4ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:12.257818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7e2c887-c379-4b51-a36e-6b5b378be4ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:12.261795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7e2c887-c379-4b51-a36e-6b5b378be4ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:12.264134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7e2c887-c379-4b51-a36e-6b5b378be4ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:12.324733 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b7e2c887-c379-4b51-a36e-6b5b378be4ec tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.102113 Jan 22 21:19:12.325447 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2802/5880] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:12 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:12.351685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b0b568f9-d179-4df0-b9d2-a9669c969b8e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:12.351915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1986b726-fd2a-4775-b662-bd424900200c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:12.353218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b0b568f9-d179-4df0-b9d2-a9669c969b8e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:12.361734 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1986b726-fd2a-4775-b662-bd424900200c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1397 microversion: 2.1 time: 0.324255 Jan 22 21:19:12.362134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0b568f9-d179-4df0-b9d2-a9669c969b8e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:12.362331 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3079/5881] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:12 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1397 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:12.372014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0b568f9-d179-4df0-b9d2-a9669c969b8e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:12.373711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0b568f9-d179-4df0-b9d2-a9669c969b8e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:12.374412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0b568f9-d179-4df0-b9d2-a9669c969b8e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:12.440429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d1f427d9-444d-432c-974d-4cb306cf3000 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:12.441481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d1f427d9-444d-432c-974d-4cb306cf3000 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:12.452864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1f427d9-444d-432c-974d-4cb306cf3000 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:12.452864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1f427d9-444d-432c-974d-4cb306cf3000 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:12.452864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1f427d9-444d-432c-974d-4cb306cf3000 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:12.452864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1f427d9-444d-432c-974d-4cb306cf3000 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:12.521629 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d1f427d9-444d-432c-974d-4cb306cf3000 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 14 microversion: 2.32 time: 0.084465 Jan 22 21:19:12.527284 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3080/5882] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:12 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:12.679105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-58c9ab51-1c01-438a-ba5d-f03fb38202a2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:12.683520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-58c9ab51-1c01-438a-ba5d-f03fb38202a2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:12.690863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58c9ab51-1c01-438a-ba5d-f03fb38202a2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:12.691553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58c9ab51-1c01-438a-ba5d-f03fb38202a2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:12.695007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58c9ab51-1c01-438a-ba5d-f03fb38202a2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:12.695007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58c9ab51-1c01-438a-ba5d-f03fb38202a2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:12.709408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b0b568f9-d179-4df0-b9d2-a9669c969b8e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:12.722287 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b0b568f9-d179-4df0-b9d2-a9669c969b8e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1592 microversion: 2.1 time: 0.382847 Jan 22 21:19:12.725338 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2803/5883] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:12 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1592 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:12.739850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-50a453dc-a167-4c15-87d8-d82f4295d7bb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:12.749003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-50a453dc-a167-4c15-87d8-d82f4295d7bb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:12.766309 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-58c9ab51-1c01-438a-ba5d-f03fb38202a2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.090876 Jan 22 21:19:12.768344 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3081/5884] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:19:12 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments => generated 371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:12.769100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50a453dc-a167-4c15-87d8-d82f4295d7bb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:12.769100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50a453dc-a167-4c15-87d8-d82f4295d7bb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:12.771004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50a453dc-a167-4c15-87d8-d82f4295d7bb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:12.771491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50a453dc-a167-4c15-87d8-d82f4295d7bb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:12.952898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c36e7ab9-4cfb-4a9d-8c47-3ffa08743946 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:12.954033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c36e7ab9-4cfb-4a9d-8c47-3ffa08743946 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:12.976676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c36e7ab9-4cfb-4a9d-8c47-3ffa08743946 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:12.978499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c36e7ab9-4cfb-4a9d-8c47-3ffa08743946 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:12.980488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c36e7ab9-4cfb-4a9d-8c47-3ffa08743946 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:12.980943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c36e7ab9-4cfb-4a9d-8c47-3ffa08743946 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:13.011439 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-50a453dc-a167-4c15-87d8-d82f4295d7bb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.275553 Jan 22 21:19:13.012988 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2804/5885] 10.222.0.100 () {58 vars in 1279 bytes} [Sat Jan 22 21:19:12 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/os-interface => generated 284 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:19:13.058354 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c36e7ab9-4cfb-4a9d-8c47-3ffa08743946 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments/502df3ac-dfa4-4ae0-a658-85716a8e4faf" status: 200 len: 194 microversion: 2.1 time: 0.110521 Jan 22 21:19:13.059573 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3082/5886] 10.222.0.100 () {58 vars in 1417 bytes} [Sat Jan 22 21:19:12 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments/502df3ac-dfa4-4ae0-a658-85716a8e4faf => generated 194 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:13.069298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-108b67ed-b2a5-40ac-977f-06a4a1ea54d7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:13.071628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-108b67ed-b2a5-40ac-977f-06a4a1ea54d7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:13.082615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-108b67ed-b2a5-40ac-977f-06a4a1ea54d7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:13.083751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-108b67ed-b2a5-40ac-977f-06a4a1ea54d7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:13.084576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-108b67ed-b2a5-40ac-977f-06a4a1ea54d7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:13.085024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-108b67ed-b2a5-40ac-977f-06a4a1ea54d7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:13.144128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-996f34ed-dc8b-4ec0-8406-f8f20553d771 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:13.144743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-996f34ed-dc8b-4ec0-8406-f8f20553d771 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:13.151627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-996f34ed-dc8b-4ec0-8406-f8f20553d771 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:13.152095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-996f34ed-dc8b-4ec0-8406-f8f20553d771 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:13.153961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-996f34ed-dc8b-4ec0-8406-f8f20553d771 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:13.154723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-996f34ed-dc8b-4ec0-8406-f8f20553d771 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:13.212223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-108b67ed-b2a5-40ac-977f-06a4a1ea54d7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lazy-loading 'services' on Instance uuid 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:19:13.432573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-996f34ed-dc8b-4ec0-8406-f8f20553d771 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:13.448256 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-996f34ed-dc8b-4ec0-8406-f8f20553d771 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1511 microversion: 2.1 time: 0.308397 Jan 22 21:19:13.452283 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3083/5887] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:13 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1511 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:13.457667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bad099ce-7983-4801-910f-e10c664cc12b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:13.458855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bad099ce-7983-4801-910f-e10c664cc12b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:13.467022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bad099ce-7983-4801-910f-e10c664cc12b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:13.472129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bad099ce-7983-4801-910f-e10c664cc12b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:13.472129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bad099ce-7983-4801-910f-e10c664cc12b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:13.472129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bad099ce-7983-4801-910f-e10c664cc12b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:13.477988 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-108b67ed-b2a5-40ac-977f-06a4a1ea54d7 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments/502df3ac-dfa4-4ae0-a658-85716a8e4faf" status: 202 len: 0 microversion: 2.1 time: 0.412303 Jan 22 21:19:13.479206 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2805/5888] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 21:19:13 2022] DELETE /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments/502df3ac-dfa4-4ae0-a658-85716a8e4faf => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:13.498130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb017ac6-554b-49b7-9f0a-7f4bae4fd9aa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:13.499170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb017ac6-554b-49b7-9f0a-7f4bae4fd9aa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:13.509144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb017ac6-554b-49b7-9f0a-7f4bae4fd9aa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:13.510200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb017ac6-554b-49b7-9f0a-7f4bae4fd9aa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:13.511389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb017ac6-554b-49b7-9f0a-7f4bae4fd9aa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:13.512970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb017ac6-554b-49b7-9f0a-7f4bae4fd9aa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:13.565101 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bad099ce-7983-4801-910f-e10c664cc12b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.111259 Jan 22 21:19:13.565804 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3084/5889] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:13 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:13.571094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a718684f-2b7f-4da2-91cf-06aff5a63ae8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:13.572100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a718684f-2b7f-4da2-91cf-06aff5a63ae8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:13.581817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a718684f-2b7f-4da2-91cf-06aff5a63ae8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:13.582286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a718684f-2b7f-4da2-91cf-06aff5a63ae8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:13.583096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a718684f-2b7f-4da2-91cf-06aff5a63ae8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:13.583547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a718684f-2b7f-4da2-91cf-06aff5a63ae8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:13.627957 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a718684f-2b7f-4da2-91cf-06aff5a63ae8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 14 microversion: 2.32 time: 0.060287 Jan 22 21:19:13.631615 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3085/5890] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:13 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:14.221814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fb017ac6-554b-49b7-9f0a-7f4bae4fd9aa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:14.235436 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb017ac6-554b-49b7-9f0a-7f4bae4fd9aa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1397 microversion: 2.1 time: 0.754735 Jan 22 21:19:14.236859 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2806/5891] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:13 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1397 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:14.469535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-91d71285-453a-4685-b471-1c506499193a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:14.471331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-91d71285-453a-4685-b471-1c506499193a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:14.481937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91d71285-453a-4685-b471-1c506499193a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:14.481937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91d71285-453a-4685-b471-1c506499193a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:14.482443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91d71285-453a-4685-b471-1c506499193a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:14.483119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91d71285-453a-4685-b471-1c506499193a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:14.587462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f63fd63d-031c-431f-a5d6-c2cfc90e4ddf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:14.595712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f63fd63d-031c-431f-a5d6-c2cfc90e4ddf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:14.615380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f63fd63d-031c-431f-a5d6-c2cfc90e4ddf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:14.616043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f63fd63d-031c-431f-a5d6-c2cfc90e4ddf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:14.617052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f63fd63d-031c-431f-a5d6-c2cfc90e4ddf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:14.617703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f63fd63d-031c-431f-a5d6-c2cfc90e4ddf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:14.669773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-91d71285-453a-4685-b471-1c506499193a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:14.675227 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f63fd63d-031c-431f-a5d6-c2cfc90e4ddf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.095183 Jan 22 21:19:14.676549 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2807/5892] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:14 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:14.683241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7a13e5c5-a761-4ab2-8d9a-efe3b44390eb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:14.685262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7a13e5c5-a761-4ab2-8d9a-efe3b44390eb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:14.688136 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-91d71285-453a-4685-b471-1c506499193a tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1469 microversion: 2.1 time: 0.223385 Jan 22 21:19:14.697162 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3086/5893] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:14 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1469 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:14.702923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a13e5c5-a761-4ab2-8d9a-efe3b44390eb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:14.703395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a13e5c5-a761-4ab2-8d9a-efe3b44390eb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:14.703541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-933dc80f-74aa-4b4a-8b39-17eff861d2f2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:14.704011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-933dc80f-74aa-4b4a-8b39-17eff861d2f2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:14.704225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a13e5c5-a761-4ab2-8d9a-efe3b44390eb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:14.704680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a13e5c5-a761-4ab2-8d9a-efe3b44390eb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:14.729938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-933dc80f-74aa-4b4a-8b39-17eff861d2f2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:14.730245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-933dc80f-74aa-4b4a-8b39-17eff861d2f2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:14.733937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-933dc80f-74aa-4b4a-8b39-17eff861d2f2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:14.738135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-933dc80f-74aa-4b4a-8b39-17eff861d2f2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:14.786621 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7a13e5c5-a761-4ab2-8d9a-efe3b44390eb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 8207 microversion: 2.32 time: 0.106825 Jan 22 21:19:14.787680 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2808/5894] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:14 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 8207 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:19:14.795855 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-933dc80f-74aa-4b4a-8b39-17eff861d2f2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments/b4056312-c961-4634-aeac-24ae28be351c" status: 200 len: 194 microversion: 2.1 time: 0.106049 Jan 22 21:19:14.797118 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3087/5895] 10.222.0.100 () {58 vars in 1417 bytes} [Sat Jan 22 21:19:14 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments/b4056312-c961-4634-aeac-24ae28be351c => generated 194 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:14.799928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-dd85e750-3c48-4a39-9302-aef7928dfd9e req-0d8e57b4-28f7-433c-88ad-0f73422eec18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b913871-15e3-4b2c-a015-a6d11af6edfd", "name": "network-vif-deleted", "tag": "ad576433-f854-429f-a316-8e6e9096015b"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:14.802914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2cf3ed1c-a78f-4db9-ba27-f0bff960b1f9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:14.803203 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:14.803203 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:19:14.804319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2cf3ed1c-a78f-4db9-ba27-f0bff960b1f9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:14.813337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2cf3ed1c-a78f-4db9-ba27-f0bff960b1f9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:14.814135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2cf3ed1c-a78f-4db9-ba27-f0bff960b1f9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:14.814678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-dd85e750-3c48-4a39-9302-aef7928dfd9e req-0d8e57b4-28f7-433c-88ad-0f73422eec18 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:14.815264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-dd85e750-3c48-4a39-9302-aef7928dfd9e req-0d8e57b4-28f7-433c-88ad-0f73422eec18 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:14.815488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2cf3ed1c-a78f-4db9-ba27-f0bff960b1f9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:14.816102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2cf3ed1c-a78f-4db9-ba27-f0bff960b1f9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:14.846249 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-dd85e750-3c48-4a39-9302-aef7928dfd9e req-0d8e57b4-28f7-433c-88ad-0f73422eec18 service nova] Creating event network-vif-deleted:ad576433-f854-429f-a316-8e6e9096015b for instance 6b913871-15e3-4b2c-a015-a6d11af6edfd on nch2-master-1 Jan 22 21:19:14.851491 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-dd85e750-3c48-4a39-9302-aef7928dfd9e req-0d8e57b4-28f7-433c-88ad-0f73422eec18 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061388 Jan 22 21:19:14.852426 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2809/5896] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:14.862153 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2cf3ed1c-a78f-4db9-ba27-f0bff960b1f9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 14 microversion: 2.1 time: 0.063453 Jan 22 21:19:14.865743 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3088/5897] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:14 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:19:14.871178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-c5147646-f2f5-4b50-a5c6-42b23df1bf3c req-ec18081d-1334-44d2-be0c-8fd509bb5a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e318c979-4614-4d4f-9412-43d48d1b042b", "tag": "8f6916af-e766-4eb7-96e1-7e81bb9a0a97"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:14.875564 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:14.875564 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:19:14.878730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c1c6f743-2a76-473f-8da2-15c41021d477 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:14.883917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c1c6f743-2a76-473f-8da2-15c41021d477 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:14.891362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1c6f743-2a76-473f-8da2-15c41021d477 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:14.891826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1c6f743-2a76-473f-8da2-15c41021d477 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:14.892638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1c6f743-2a76-473f-8da2-15c41021d477 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:14.893247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1c6f743-2a76-473f-8da2-15c41021d477 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:14.896007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c5147646-f2f5-4b50-a5c6-42b23df1bf3c req-ec18081d-1334-44d2-be0c-8fd509bb5a82 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:14.896575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c5147646-f2f5-4b50-a5c6-42b23df1bf3c req-ec18081d-1334-44d2-be0c-8fd509bb5a82 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:14.928718 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-c5147646-f2f5-4b50-a5c6-42b23df1bf3c req-ec18081d-1334-44d2-be0c-8fd509bb5a82 service nova] Creating event network-changed:8f6916af-e766-4eb7-96e1-7e81bb9a0a97 for instance e318c979-4614-4d4f-9412-43d48d1b042b on nch2-master-1 Jan 22 21:19:14.938074 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-c5147646-f2f5-4b50-a5c6-42b23df1bf3c req-ec18081d-1334-44d2-be0c-8fd509bb5a82 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073113 Jan 22 21:19:14.940934 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3089/5898] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:15.009046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e1094dd6-768f-4bd5-aed7-70d91b8aafd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:15.009046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e1094dd6-768f-4bd5-aed7-70d91b8aafd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:15.023582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1094dd6-768f-4bd5-aed7-70d91b8aafd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.024239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1094dd6-768f-4bd5-aed7-70d91b8aafd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.025425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1094dd6-768f-4bd5-aed7-70d91b8aafd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.025986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1094dd6-768f-4bd5-aed7-70d91b8aafd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.039384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-c1c6f743-2a76-473f-8da2-15c41021d477 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lazy-loading 'services' on Instance uuid 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:19:15.059551 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-e1094dd6-768f-4bd5-aed7-70d91b8aafd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 29d60673-d54a-4970-8d8f-0419aee033dd could not be found. Jan 22 21:19:15.060544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e1094dd6-768f-4bd5-aed7-70d91b8aafd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 29d60673-d54a-4970-8d8f-0419aee033dd could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:15.070180 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e1094dd6-768f-4bd5-aed7-70d91b8aafd6 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 404 len: 111 microversion: 2.1 time: 0.060128 Jan 22 21:19:15.072490 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3090/5899] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:19:14 2022] DELETE /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:19:15.081002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dc64eb57-0149-4d41-8612-63577ecc8bc3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:15.081652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dc64eb57-0149-4d41-8612-63577ecc8bc3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: 29d60673-d54a-4970-8d8f-0419aee033dd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:15.098650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc64eb57-0149-4d41-8612-63577ecc8bc3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.099122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc64eb57-0149-4d41-8612-63577ecc8bc3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.101985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc64eb57-0149-4d41-8612-63577ecc8bc3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.102460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc64eb57-0149-4d41-8612-63577ecc8bc3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.139738 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-dc64eb57-0149-4d41-8612-63577ecc8bc3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance 29d60673-d54a-4970-8d8f-0419aee033dd could not be found. Jan 22 21:19:15.140409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dc64eb57-0149-4d41-8612-63577ecc8bc3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance 29d60673-d54a-4970-8d8f-0419aee033dd could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:15.141490 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dc64eb57-0149-4d41-8612-63577ecc8bc3 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd" status: 404 len: 111 microversion: 2.1 time: 0.064528 Jan 22 21:19:15.143914 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3091/5900] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:15 2022] GET /compute/v2.1/servers/29d60673-d54a-4970-8d8f-0419aee033dd => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:15.169941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fc2797b1-a3e3-496a-9a4a-ad1a1de6fa89 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:15.170638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fc2797b1-a3e3-496a-9a4a-ad1a1de6fa89 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:15.178883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc2797b1-a3e3-496a-9a4a-ad1a1de6fa89 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.179495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc2797b1-a3e3-496a-9a4a-ad1a1de6fa89 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.181274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc2797b1-a3e3-496a-9a4a-ad1a1de6fa89 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.181274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc2797b1-a3e3-496a-9a4a-ad1a1de6fa89 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.199251 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-fc2797b1-a3e3-496a-9a4a-ad1a1de6fa89 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 could not be found. Jan 22 21:19:15.200060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fc2797b1-a3e3-496a-9a4a-ad1a1de6fa89 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:15.201047 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fc2797b1-a3e3-496a-9a4a-ad1a1de6fa89 tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "DELETE /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 404 len: 111 microversion: 2.1 time: 0.038279 Jan 22 21:19:15.201649 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3092/5901] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:19:15 2022] DELETE /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:15.224778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a7e6a4f4-e6fc-412c-83f3-b7c60c91f03b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:15.225923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a7e6a4f4-e6fc-412c-83f3-b7c60c91f03b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] [instance: dac5148a-6b7f-45bc-aaa2-c3a6f03ab403] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:15.233079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7e6a4f4-e6fc-412c-83f3-b7c60c91f03b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.233645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7e6a4f4-e6fc-412c-83f3-b7c60c91f03b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.234910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7e6a4f4-e6fc-412c-83f3-b7c60c91f03b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.235438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7e6a4f4-e6fc-412c-83f3-b7c60c91f03b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.252587 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-a7e6a4f4-e6fc-412c-83f3-b7c60c91f03b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] HTTP exception thrown: Instance dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 could not be found. Jan 22 21:19:15.253203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a7e6a4f4-e6fc-412c-83f3-b7c60c91f03b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] Returning 404 to user: Instance dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:15.254547 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a7e6a4f4-e6fc-412c-83f3-b7c60c91f03b tempest-DeleteServersTestJSON-1162998405 tempest-DeleteServersTestJSON-1162998405-project] 10.222.0.100 "GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403" status: 404 len: 111 microversion: 2.1 time: 0.048607 Jan 22 21:19:15.255541 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3093/5902] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:15 2022] GET /compute/v2.1/servers/dac5148a-6b7f-45bc-aaa2-c3a6f03ab403 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:19:15.268991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-70c97302-0c89-414f-a525-27840b054108 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:15.271016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-70c97302-0c89-414f-a525-27840b054108 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:15.282672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70c97302-0c89-414f-a525-27840b054108 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.283574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70c97302-0c89-414f-a525-27840b054108 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.283942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70c97302-0c89-414f-a525-27840b054108 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.284392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70c97302-0c89-414f-a525-27840b054108 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.339067 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c1c6f743-2a76-473f-8da2-15c41021d477 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments/b4056312-c961-4634-aeac-24ae28be351c" status: 202 len: 0 microversion: 2.1 time: 0.484644 Jan 22 21:19:15.340484 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2810/5903] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 21:19:14 2022] DELETE /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments/b4056312-c961-4634-aeac-24ae28be351c => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:15.688432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f55595f7-8391-4eae-8dff-743472d93ab7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:15.689646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f55595f7-8391-4eae-8dff-743472d93ab7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:15.690559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-70c97302-0c89-414f-a525-27840b054108 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:15.703053 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-70c97302-0c89-414f-a525-27840b054108 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1397 microversion: 2.1 time: 0.441850 Jan 22 21:19:15.704907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f55595f7-8391-4eae-8dff-743472d93ab7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.705671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f55595f7-8391-4eae-8dff-743472d93ab7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.707197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f55595f7-8391-4eae-8dff-743472d93ab7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.708547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f55595f7-8391-4eae-8dff-743472d93ab7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.714062 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3094/5904] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:15 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1397 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:15.728519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-04378b33-bfc5-4ea3-a64a-a90093e554e0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:15.729163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-04378b33-bfc5-4ea3-a64a-a90093e554e0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:15.743181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04378b33-bfc5-4ea3-a64a-a90093e554e0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.743659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04378b33-bfc5-4ea3-a64a-a90093e554e0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.749334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04378b33-bfc5-4ea3-a64a-a90093e554e0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.749334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04378b33-bfc5-4ea3-a64a-a90093e554e0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.800834 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f55595f7-8391-4eae-8dff-743472d93ab7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.116261 Jan 22 21:19:15.818167 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2811/5905] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:15 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:15.845692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-265f13f6-f0f2-449e-941a-e81c89640fe2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:15.848638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-265f13f6-f0f2-449e-941a-e81c89640fe2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:15.862532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-265f13f6-f0f2-449e-941a-e81c89640fe2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.864042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04378b33-bfc5-4ea3-a64a-a90093e554e0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.864175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-265f13f6-f0f2-449e-941a-e81c89640fe2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.864284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04378b33-bfc5-4ea3-a64a-a90093e554e0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.864389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-265f13f6-f0f2-449e-941a-e81c89640fe2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.864809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-265f13f6-f0f2-449e-941a-e81c89640fe2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.865429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-04378b33-bfc5-4ea3-a64a-a90093e554e0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lazy-loading 'fault' on Instance uuid 6b913871-15e3-4b2c-a015-a6d11af6edfd {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:19:15.922625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-04378b33-bfc5-4ea3-a64a-a90093e554e0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ab66c470684aa8928e804e65a691b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fb7d7142184c10aa282c603e7326b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:15.931762 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-04378b33-bfc5-4ea3-a64a-a90093e554e0 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 200 len: 1308 microversion: 2.1 time: 0.216090 Jan 22 21:19:15.932362 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3095/5906] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:15 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:15.935994 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-265f13f6-f0f2-449e-941a-e81c89640fe2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 8207 microversion: 2.32 time: 0.113380 Jan 22 21:19:15.936786 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2812/5907] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:15 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 8207 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:19:15.939808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9a5234b6-8bae-4fe6-ab89-f2bc84f35a41 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:15.940926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9a5234b6-8bae-4fe6-ab89-f2bc84f35a41 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:15.948012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a5234b6-8bae-4fe6-ab89-f2bc84f35a41 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.948829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a5234b6-8bae-4fe6-ab89-f2bc84f35a41 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:15.949284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a5234b6-8bae-4fe6-ab89-f2bc84f35a41 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:15.951264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a5234b6-8bae-4fe6-ab89-f2bc84f35a41 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:16.000299 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9a5234b6-8bae-4fe6-ab89-f2bc84f35a41 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 14 microversion: 2.1 time: 0.065220 Jan 22 21:19:16.000857 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3096/5908] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:15 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:19:16.564934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-be92fd69-8102-4eb1-885d-aac7f837458c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:16.567326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-be92fd69-8102-4eb1-885d-aac7f837458c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:16.578519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be92fd69-8102-4eb1-885d-aac7f837458c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:16.578980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be92fd69-8102-4eb1-885d-aac7f837458c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:16.579901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be92fd69-8102-4eb1-885d-aac7f837458c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:16.580349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be92fd69-8102-4eb1-885d-aac7f837458c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:16.617946 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-be92fd69-8102-4eb1-885d-aac7f837458c tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059548 Jan 22 21:19:16.618445 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2813/5909] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:19:16 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:19:16.725620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a79f66c0-0f6c-4fa4-ba74-2ef8a63633c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:16.726349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a79f66c0-0f6c-4fa4-ba74-2ef8a63633c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:16.735450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a79f66c0-0f6c-4fa4-ba74-2ef8a63633c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:16.747348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a79f66c0-0f6c-4fa4-ba74-2ef8a63633c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:16.747348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a79f66c0-0f6c-4fa4-ba74-2ef8a63633c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:16.747348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a79f66c0-0f6c-4fa4-ba74-2ef8a63633c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:16.748058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cb4a87aa-0f9d-4076-a81b-2a03cb7b2106 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:16.748311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cb4a87aa-0f9d-4076-a81b-2a03cb7b2106 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:16.765292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb4a87aa-0f9d-4076-a81b-2a03cb7b2106 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:16.767699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb4a87aa-0f9d-4076-a81b-2a03cb7b2106 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:16.769881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb4a87aa-0f9d-4076-a81b-2a03cb7b2106 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:16.771221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb4a87aa-0f9d-4076-a81b-2a03cb7b2106 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:16.809391 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cb4a87aa-0f9d-4076-a81b-2a03cb7b2106 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066895 Jan 22 21:19:16.810593 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2814/5910] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:19:16 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:19:16.828170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5e324a81-e658-4ecb-906b-32e1819ee2e1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:16.830181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5e324a81-e658-4ecb-906b-32e1819ee2e1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:16.841554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e324a81-e658-4ecb-906b-32e1819ee2e1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:16.842495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e324a81-e658-4ecb-906b-32e1819ee2e1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:16.843633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e324a81-e658-4ecb-906b-32e1819ee2e1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:16.844409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e324a81-e658-4ecb-906b-32e1819ee2e1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:16.906222 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5e324a81-e658-4ecb-906b-32e1819ee2e1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.083167 Jan 22 21:19:16.906943 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2815/5911] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:16 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:16.915770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a01062e6-5bf0-4c5e-8463-0defa65230c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:16.915770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a01062e6-5bf0-4c5e-8463-0defa65230c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:16.922052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a01062e6-5bf0-4c5e-8463-0defa65230c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:16.922520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a01062e6-5bf0-4c5e-8463-0defa65230c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:16.923434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a01062e6-5bf0-4c5e-8463-0defa65230c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:16.923832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a01062e6-5bf0-4c5e-8463-0defa65230c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:16.961214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a01062e6-5bf0-4c5e-8463-0defa65230c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:19:17.092006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a79f66c0-0f6c-4fa4-ba74-2ef8a63633c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:17.102343 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a79f66c0-0f6c-4fa4-ba74-2ef8a63633c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1397 microversion: 2.1 time: 0.385723 Jan 22 21:19:17.121757 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3097/5912] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:16 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1397 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:17.130896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-741e04ef-e4e5-4e8b-9805-bc2bc1aaf58d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:17.131863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-741e04ef-e4e5-4e8b-9805-bc2bc1aaf58d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:17.142686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-741e04ef-e4e5-4e8b-9805-bc2bc1aaf58d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:17.143149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-741e04ef-e4e5-4e8b-9805-bc2bc1aaf58d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:17.143973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-741e04ef-e4e5-4e8b-9805-bc2bc1aaf58d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:17.144472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-741e04ef-e4e5-4e8b-9805-bc2bc1aaf58d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:17.230603 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-741e04ef-e4e5-4e8b-9805-bc2bc1aaf58d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 16398 microversion: 2.32 time: 0.105619 Jan 22 21:19:17.240089 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3098/5913] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:17 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 16398 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:17.282351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cfaa8f17-2f8e-49bf-9238-2454be5ce768 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:17.285229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cfaa8f17-2f8e-49bf-9238-2454be5ce768 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] [instance: 6b913871-15e3-4b2c-a015-a6d11af6edfd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:17.299374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfaa8f17-2f8e-49bf-9238-2454be5ce768 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:17.299925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfaa8f17-2f8e-49bf-9238-2454be5ce768 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:17.300831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfaa8f17-2f8e-49bf-9238-2454be5ce768 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:17.301360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfaa8f17-2f8e-49bf-9238-2454be5ce768 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:17.320316 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-cfaa8f17-2f8e-49bf-9238-2454be5ce768 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] HTTP exception thrown: Instance 6b913871-15e3-4b2c-a015-a6d11af6edfd could not be found. Jan 22 21:19:17.320859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cfaa8f17-2f8e-49bf-9238-2454be5ce768 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] Returning 404 to user: Instance 6b913871-15e3-4b2c-a015-a6d11af6edfd could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:17.321740 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cfaa8f17-2f8e-49bf-9238-2454be5ce768 tempest-ServerPasswordTestJSON-1705053556 tempest-ServerPasswordTestJSON-1705053556-project] 10.222.0.100 "GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd" status: 404 len: 111 microversion: 2.1 time: 0.077920 Jan 22 21:19:17.330845 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3099/5914] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:17 2022] GET /compute/v2.1/servers/6b913871-15e3-4b2c-a015-a6d11af6edfd => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:17.343498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dc9736ff-df78-46cc-aa96-da7d01c4528d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:17.347200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dc9736ff-df78-46cc-aa96-da7d01c4528d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:17.355038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc9736ff-df78-46cc-aa96-da7d01c4528d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:17.356349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc9736ff-df78-46cc-aa96-da7d01c4528d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:17.357465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc9736ff-df78-46cc-aa96-da7d01c4528d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:17.358197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc9736ff-df78-46cc-aa96-da7d01c4528d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:17.400499 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a01062e6-5bf0-4c5e-8463-0defa65230c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 204 len: 0 microversion: 2.1 time: 0.489351 Jan 22 21:19:17.401334 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2816/5915] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:19:16 2022] DELETE /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:19:17.410588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9e3a77ef-7d2e-4141-9c68-d400901806c0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:17.411481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9e3a77ef-7d2e-4141-9c68-d400901806c0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:17.418419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e3a77ef-7d2e-4141-9c68-d400901806c0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:17.419102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e3a77ef-7d2e-4141-9c68-d400901806c0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:17.420090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e3a77ef-7d2e-4141-9c68-d400901806c0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:17.420547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e3a77ef-7d2e-4141-9c68-d400901806c0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:17.421271 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dc9736ff-df78-46cc-aa96-da7d01c4528d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 14 microversion: 2.1 time: 0.083099 Jan 22 21:19:17.426469 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3100/5916] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:17 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:19:17.686929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9e3a77ef-7d2e-4141-9c68-d400901806c0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:17.702488 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9e3a77ef-7d2e-4141-9c68-d400901806c0 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1677 microversion: 2.1 time: 0.295913 Jan 22 21:19:17.705928 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2817/5917] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:17 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1677 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:17.926509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6751e44d-3ee9-4ec6-91fd-a05a48afe7df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:17.927523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6751e44d-3ee9-4ec6-91fd-a05a48afe7df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:17.946527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6751e44d-3ee9-4ec6-91fd-a05a48afe7df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:17.947105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6751e44d-3ee9-4ec6-91fd-a05a48afe7df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:17.948205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6751e44d-3ee9-4ec6-91fd-a05a48afe7df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:17.948559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6751e44d-3ee9-4ec6-91fd-a05a48afe7df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:17.991271 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6751e44d-3ee9-4ec6-91fd-a05a48afe7df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.069571 Jan 22 21:19:17.991937 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3101/5918] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:17 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:18.120141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8f7c5733-12cb-4e93-8e71-aa656a254421 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:18.120896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8f7c5733-12cb-4e93-8e71-aa656a254421 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:18.129269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f7c5733-12cb-4e93-8e71-aa656a254421 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:18.138458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f7c5733-12cb-4e93-8e71-aa656a254421 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:18.138458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f7c5733-12cb-4e93-8e71-aa656a254421 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:18.138458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f7c5733-12cb-4e93-8e71-aa656a254421 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:18.248454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bb9e7894-c033-4216-b5a1-4bb3ad1a82c7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:18.249823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bb9e7894-c033-4216-b5a1-4bb3ad1a82c7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:18.257233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb9e7894-c033-4216-b5a1-4bb3ad1a82c7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:18.257736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb9e7894-c033-4216-b5a1-4bb3ad1a82c7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:18.258677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb9e7894-c033-4216-b5a1-4bb3ad1a82c7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:18.259116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb9e7894-c033-4216-b5a1-4bb3ad1a82c7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:18.299243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8f7c5733-12cb-4e93-8e71-aa656a254421 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:18.304813 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bb9e7894-c033-4216-b5a1-4bb3ad1a82c7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 16398 microversion: 2.32 time: 0.061198 Jan 22 21:19:18.305645 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3102/5919] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:18 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 16398 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:18.307151 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8f7c5733-12cb-4e93-8e71-aa656a254421 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1397 microversion: 2.1 time: 0.190780 Jan 22 21:19:18.307723 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2818/5920] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:18 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1397 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:18.432862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-01232308-31b7-403f-888e-79574f8a29db tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:18.435136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-01232308-31b7-403f-888e-79574f8a29db tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:18.442050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01232308-31b7-403f-888e-79574f8a29db tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:18.442505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01232308-31b7-403f-888e-79574f8a29db tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:18.443282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01232308-31b7-403f-888e-79574f8a29db tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:18.443724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01232308-31b7-403f-888e-79574f8a29db tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:18.483273 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-01232308-31b7-403f-888e-79574f8a29db tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 14 microversion: 2.1 time: 0.054428 Jan 22 21:19:18.485662 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3103/5921] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:18 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:19:18.726698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c6d759cc-a99b-412b-893f-4ac736660400 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:18.727261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c6d759cc-a99b-412b-893f-4ac736660400 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:18.735552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6d759cc-a99b-412b-893f-4ac736660400 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:18.736026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6d759cc-a99b-412b-893f-4ac736660400 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:18.736841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6d759cc-a99b-412b-893f-4ac736660400 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:18.737297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6d759cc-a99b-412b-893f-4ac736660400 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:18.980127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c6d759cc-a99b-412b-893f-4ac736660400 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:18.989104 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c6d759cc-a99b-412b-893f-4ac736660400 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1677 microversion: 2.1 time: 0.270100 Jan 22 21:19:18.989717 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2819/5922] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:18 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1677 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:19.003480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9e70cea5-38b0-4829-b3c0-cd35d78ce224 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:19.004456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9e70cea5-38b0-4829-b3c0-cd35d78ce224 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:19.012950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e70cea5-38b0-4829-b3c0-cd35d78ce224 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:19.013645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e70cea5-38b0-4829-b3c0-cd35d78ce224 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:19.015013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e70cea5-38b0-4829-b3c0-cd35d78ce224 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:19.015013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e70cea5-38b0-4829-b3c0-cd35d78ce224 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:19.060823 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9e70cea5-38b0-4829-b3c0-cd35d78ce224 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.061006 Jan 22 21:19:19.065226 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3104/5923] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:18 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:19.316491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-321a41cb-e24e-48b1-a322-5fbdb7192670 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:19.317566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-321a41cb-e24e-48b1-a322-5fbdb7192670 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:19.325449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7b27bc3a-ae17-4ddd-88b0-633ddb146efd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:19.326590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7b27bc3a-ae17-4ddd-88b0-633ddb146efd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:19.335850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b27bc3a-ae17-4ddd-88b0-633ddb146efd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:19.339739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-321a41cb-e24e-48b1-a322-5fbdb7192670 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:19.340497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-321a41cb-e24e-48b1-a322-5fbdb7192670 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:19.341754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-321a41cb-e24e-48b1-a322-5fbdb7192670 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:19.342955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b27bc3a-ae17-4ddd-88b0-633ddb146efd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:19.344046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-321a41cb-e24e-48b1-a322-5fbdb7192670 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:19.344785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b27bc3a-ae17-4ddd-88b0-633ddb146efd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:19.346379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b27bc3a-ae17-4ddd-88b0-633ddb146efd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:19.409520 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-321a41cb-e24e-48b1-a322-5fbdb7192670 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 16398 microversion: 2.32 time: 0.096611 Jan 22 21:19:19.410397 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2820/5924] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:19 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 16398 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:19.502166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b75acc4d-00eb-42a6-b318-e1f041af297c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:19.503226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b75acc4d-00eb-42a6-b318-e1f041af297c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:19.518944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b75acc4d-00eb-42a6-b318-e1f041af297c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:19.519627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b75acc4d-00eb-42a6-b318-e1f041af297c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:19.520641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b75acc4d-00eb-42a6-b318-e1f041af297c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:19.521267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b75acc4d-00eb-42a6-b318-e1f041af297c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:19.581266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7b27bc3a-ae17-4ddd-88b0-633ddb146efd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:19.587017 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b75acc4d-00eb-42a6-b318-e1f041af297c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 14 microversion: 2.1 time: 0.087081 Jan 22 21:19:19.588692 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2821/5925] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:19 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:19:19.600262 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7b27bc3a-ae17-4ddd-88b0-633ddb146efd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1397 microversion: 2.1 time: 0.279503 Jan 22 21:19:19.603692 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3105/5926] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:19 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1397 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:19.818207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-8b864bcb-0554-4a57-8066-2d19e14af366 req-53ce46e1-ad30-4abb-b2c5-9b31d32c0f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60f5752-e3a2-40ea-97fe-c98ebb12e4f7", "name": "network-vif-plugged", "status": "completed", "tag": "3b4b9042-2ab2-4731-b9ee-9b33a072ec37"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:19.820833 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:19.820833 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:19:19.834759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8b864bcb-0554-4a57-8066-2d19e14af366 req-53ce46e1-ad30-4abb-b2c5-9b31d32c0f25 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:19.835568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8b864bcb-0554-4a57-8066-2d19e14af366 req-53ce46e1-ad30-4abb-b2c5-9b31d32c0f25 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:19.856706 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8b864bcb-0554-4a57-8066-2d19e14af366 req-53ce46e1-ad30-4abb-b2c5-9b31d32c0f25 service nova] Creating event network-vif-plugged:3b4b9042-2ab2-4731-b9ee-9b33a072ec37 for instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 on nch1-master-1 Jan 22 21:19:19.862959 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-8b864bcb-0554-4a57-8066-2d19e14af366 req-53ce46e1-ad30-4abb-b2c5-9b31d32c0f25 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049306 Jan 22 21:19:19.864460 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2822/5927] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:20.011954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0f119ebe-1b9a-4a78-bf00-8175959e2f1a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:20.012926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0f119ebe-1b9a-4a78-bf00-8175959e2f1a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:20.035601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f119ebe-1b9a-4a78-bf00-8175959e2f1a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:20.040727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f119ebe-1b9a-4a78-bf00-8175959e2f1a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:20.040727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f119ebe-1b9a-4a78-bf00-8175959e2f1a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:20.042212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f119ebe-1b9a-4a78-bf00-8175959e2f1a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:20.086690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a007014-6fa5-42fb-bd06-9cd074928b3e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:20.093340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9a007014-6fa5-42fb-bd06-9cd074928b3e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:20.124666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a007014-6fa5-42fb-bd06-9cd074928b3e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:20.127455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a007014-6fa5-42fb-bd06-9cd074928b3e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:20.130454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a007014-6fa5-42fb-bd06-9cd074928b3e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:20.131143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a007014-6fa5-42fb-bd06-9cd074928b3e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:20.206313 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a007014-6fa5-42fb-bd06-9cd074928b3e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.137384 Jan 22 21:19:20.207561 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2823/5928] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:20 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:20.382315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0f119ebe-1b9a-4a78-bf00-8175959e2f1a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:20.397227 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0f119ebe-1b9a-4a78-bf00-8175959e2f1a tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1677 microversion: 2.1 time: 0.393534 Jan 22 21:19:20.398427 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3106/5929] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:20 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1677 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:20.421980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e86a245f-ff11-4683-ac24-564fd5c626b4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:20.423538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e86a245f-ff11-4683-ac24-564fd5c626b4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:20.445057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e86a245f-ff11-4683-ac24-564fd5c626b4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:20.445722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e86a245f-ff11-4683-ac24-564fd5c626b4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:20.447215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e86a245f-ff11-4683-ac24-564fd5c626b4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:20.447697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e86a245f-ff11-4683-ac24-564fd5c626b4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:20.522879 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e86a245f-ff11-4683-ac24-564fd5c626b4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 16398 microversion: 2.32 time: 0.105286 Jan 22 21:19:20.524476 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2824/5930] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:20 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 16398 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:20.598422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9d27c565-2d24-4476-be88-6d71a307ae8d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:20.599556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9d27c565-2d24-4476-be88-6d71a307ae8d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:20.606407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d27c565-2d24-4476-be88-6d71a307ae8d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:20.609429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d27c565-2d24-4476-be88-6d71a307ae8d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:20.610573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d27c565-2d24-4476-be88-6d71a307ae8d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:20.611956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d27c565-2d24-4476-be88-6d71a307ae8d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:20.618466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c2fe7f07-94fe-43ac-94ca-5782f73a4e2d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:20.620644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c2fe7f07-94fe-43ac-94ca-5782f73a4e2d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:20.637895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2fe7f07-94fe-43ac-94ca-5782f73a4e2d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:20.638540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2fe7f07-94fe-43ac-94ca-5782f73a4e2d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:20.639564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2fe7f07-94fe-43ac-94ca-5782f73a4e2d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:20.644596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2fe7f07-94fe-43ac-94ca-5782f73a4e2d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:20.712729 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9d27c565-2d24-4476-be88-6d71a307ae8d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 14 microversion: 2.1 time: 0.118164 Jan 22 21:19:20.719037 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3107/5931] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:20 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:19:20.830067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-29a48d11-7c8b-42d8-ab0a-e749bab1e391 req-bdbed60b-21df-4165-a3df-3144172a4f08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b", "name": "network-vif-deleted", "tag": "9337e9b6-78b2-48c1-b58f-3cf24e8cbbb5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:20.831666 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:20.831666 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:19:20.850840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-29a48d11-7c8b-42d8-ab0a-e749bab1e391 req-bdbed60b-21df-4165-a3df-3144172a4f08 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:20.852517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-29a48d11-7c8b-42d8-ab0a-e749bab1e391 req-bdbed60b-21df-4165-a3df-3144172a4f08 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:20.878868 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-29a48d11-7c8b-42d8-ab0a-e749bab1e391 req-bdbed60b-21df-4165-a3df-3144172a4f08 service nova] Creating event network-vif-deleted:9337e9b6-78b2-48c1-b58f-3cf24e8cbbb5 for instance 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b on nch1-master-1 Jan 22 21:19:20.885543 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-29a48d11-7c8b-42d8-ab0a-e749bab1e391 req-bdbed60b-21df-4165-a3df-3144172a4f08 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059521 Jan 22 21:19:20.888134 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3108/5932] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:20.965656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c2fe7f07-94fe-43ac-94ca-5782f73a4e2d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:20.975402 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c2fe7f07-94fe-43ac-94ca-5782f73a4e2d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1397 microversion: 2.1 time: 0.361772 Jan 22 21:19:20.985570 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2825/5933] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:20 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1397 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:21.232332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aaebc1ae-cedb-44c0-8dac-d47df95335d2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:21.245568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aaebc1ae-cedb-44c0-8dac-d47df95335d2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:21.269199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aaebc1ae-cedb-44c0-8dac-d47df95335d2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:21.269943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aaebc1ae-cedb-44c0-8dac-d47df95335d2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:21.271011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aaebc1ae-cedb-44c0-8dac-d47df95335d2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:21.271674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aaebc1ae-cedb-44c0-8dac-d47df95335d2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:21.334007 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aaebc1ae-cedb-44c0-8dac-d47df95335d2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.116129 Jan 22 21:19:21.335989 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3109/5934] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:21 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:21.418596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7d65a050-6d87-485f-9909-e4f94d38e735 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:21.419351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7d65a050-6d87-485f-9909-e4f94d38e735 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:21.430772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d65a050-6d87-485f-9909-e4f94d38e735 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:21.431471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d65a050-6d87-485f-9909-e4f94d38e735 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:21.432743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d65a050-6d87-485f-9909-e4f94d38e735 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:21.433350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d65a050-6d87-485f-9909-e4f94d38e735 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:21.485721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d65a050-6d87-485f-9909-e4f94d38e735 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:21.486185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d65a050-6d87-485f-9909-e4f94d38e735 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:21.486862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-7d65a050-6d87-485f-9909-e4f94d38e735 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lazy-loading 'fault' on Instance uuid 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:19:21.534835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7d65a050-6d87-485f-9909-e4f94d38e735 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05463958163742cb8907fff532940f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a102ec3753465793d2bd70ee845e09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:21.545152 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7d65a050-6d87-485f-9909-e4f94d38e735 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 200 len: 1331 microversion: 2.1 time: 0.132793 Jan 22 21:19:21.547361 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2826/5935] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:21 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 1331 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:21.552703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-838839bb-d93d-4dbc-b700-a0f91c26a22c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:21.553883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-838839bb-d93d-4dbc-b700-a0f91c26a22c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:21.575394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-838839bb-d93d-4dbc-b700-a0f91c26a22c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:21.581336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-838839bb-d93d-4dbc-b700-a0f91c26a22c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:21.581336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-838839bb-d93d-4dbc-b700-a0f91c26a22c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:21.581336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-838839bb-d93d-4dbc-b700-a0f91c26a22c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:21.655391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1731878382", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "df1d8d00-51c1-4997-9bea-4ff8a64f752c"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:21.680000 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-838839bb-d93d-4dbc-b700-a0f91c26a22c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.130945 Jan 22 21:19:21.680711 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2827/5936] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:21 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:21.728306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1a6162ce-eb63-434c-898b-74a5bddcad9f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:21.729330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1a6162ce-eb63-434c-898b-74a5bddcad9f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:21.743692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a6162ce-eb63-434c-898b-74a5bddcad9f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:21.745695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] validate_networks() for [('df1d8d00-51c1-4997-9bea-4ff8a64f752c', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:19:21.748644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a6162ce-eb63-434c-898b-74a5bddcad9f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:21.749538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a6162ce-eb63-434c-898b-74a5bddcad9f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:21.752348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a6162ce-eb63-434c-898b-74a5bddcad9f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:21.836282 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1a6162ce-eb63-434c-898b-74a5bddcad9f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 14 microversion: 2.1 time: 0.112026 Jan 22 21:19:21.839669 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2828/5937] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:21 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:19:21.994237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b80aae42-b727-4398-b9e3-03e0d80ec21a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:22.001365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b80aae42-b727-4398-b9e3-03e0d80ec21a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:22.008131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b80aae42-b727-4398-b9e3-03e0d80ec21a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:22.008637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b80aae42-b727-4398-b9e3-03e0d80ec21a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:22.009926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b80aae42-b727-4398-b9e3-03e0d80ec21a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:22.010619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b80aae42-b727-4398-b9e3-03e0d80ec21a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:22.276422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b80aae42-b727-4398-b9e3-03e0d80ec21a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:22.288948 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b80aae42-b727-4398-b9e3-03e0d80ec21a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1568 microversion: 2.1 time: 0.299344 Jan 22 21:19:22.291204 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2829/5938] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:21 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1568 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:22.307219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-22eedb1e-a6b0-44d1-9b42-979a0e1d382e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:22.307922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-22eedb1e-a6b0-44d1-9b42-979a0e1d382e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:22.319119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22eedb1e-a6b0-44d1-9b42-979a0e1d382e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:22.319667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22eedb1e-a6b0-44d1-9b42-979a0e1d382e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:22.320927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22eedb1e-a6b0-44d1-9b42-979a0e1d382e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:22.325286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22eedb1e-a6b0-44d1-9b42-979a0e1d382e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:22.394700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:19:22.395199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:19:22.395610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:19:22.396030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:19:22.396456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:19:22.406252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:22.406716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:22.407549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:22.407999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:22.427326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Getting quotas for project 28fc33994d4c48aea2dbcc875885357a. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:19:22.433030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Getting quotas for user 14eee35455ce441bbd47cc4fcfc2d571 and project 28fc33994d4c48aea2dbcc875885357a. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:19:22.447143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:19:22.450557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:19:22.486481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-22eedb1e-a6b0-44d1-9b42-979a0e1d382e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:22.495315 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-22eedb1e-a6b0-44d1-9b42-979a0e1d382e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1568 microversion: 2.1 time: 0.191154 Jan 22 21:19:22.496152 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2830/5939] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:22 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:22.501445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7ce47cf9-b7e1-41ef-8410-f2fc28cc09d8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:22.502588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7ce47cf9-b7e1-41ef-8410-f2fc28cc09d8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:22.510508 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ce47cf9-b7e1-41ef-8410-f2fc28cc09d8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:22.510976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ce47cf9-b7e1-41ef-8410-f2fc28cc09d8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:22.512320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ce47cf9-b7e1-41ef-8410-f2fc28cc09d8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:22.512764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ce47cf9-b7e1-41ef-8410-f2fc28cc09d8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:22.578682 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7ce47cf9-b7e1-41ef-8410-f2fc28cc09d8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.068949 Jan 22 21:19:22.578682 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2831/5940] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:22 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:22.578682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-121f4fd8-620a-416a-ad26-a6b509145ae2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:22.578682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-121f4fd8-620a-416a-ad26-a6b509145ae2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:22.583604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-121f4fd8-620a-416a-ad26-a6b509145ae2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:22.584067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-121f4fd8-620a-416a-ad26-a6b509145ae2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:22.584884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-121f4fd8-620a-416a-ad26-a6b509145ae2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:22.585329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-121f4fd8-620a-416a-ad26-a6b509145ae2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:22.601532 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-121f4fd8-620a-416a-ad26-a6b509145ae2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] HTTP exception thrown: Instance 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b could not be found. Jan 22 21:19:22.602160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-121f4fd8-620a-416a-ad26-a6b509145ae2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Returning 404 to user: Instance 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:22.603101 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-121f4fd8-620a-416a-ad26-a6b509145ae2 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 404 len: 111 microversion: 2.1 time: 0.033021 Jan 22 21:19:22.603667 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2832/5941] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:22 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:22.613982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1406f0e3-90fe-47a7-989c-31193cf97e83 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '.version_select at 0x7f1ed5d438b0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:22.655704 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7f11f4af-d31b-4dc5-82f7-f47b32c02f9e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.241752 Jan 22 21:19:22.656796 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3110/5942] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:19:21 2022] POST /compute/v2.1/servers => generated 382 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:19:22.696876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a25745ce-a1d9-46ea-8bd9-3bcbb9d5b084 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:22.700629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a25745ce-a1d9-46ea-8bd9-3bcbb9d5b084 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:22.714620 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1406f0e3-90fe-47a7-989c-31193cf97e83 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1892142365" status: 202 len: 0 microversion: 2.1 time: 0.104104 Jan 22 21:19:22.719219 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2833/5943] 10.222.0.100 () {58 vars in 1225 bytes} [Sat Jan 22 21:19:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1892142365 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:22.743252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a25745ce-a1d9-46ea-8bd9-3bcbb9d5b084 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:22.743833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a25745ce-a1d9-46ea-8bd9-3bcbb9d5b084 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:22.747396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a25745ce-a1d9-46ea-8bd9-3bcbb9d5b084 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:22.750665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a25745ce-a1d9-46ea-8bd9-3bcbb9d5b084 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:22.806292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2005317525", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "df1d8d00-51c1-4997-9bea-4ff8a64f752c"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:22.885669 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a25745ce-a1d9-46ea-8bd9-3bcbb9d5b084 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.195962 Jan 22 21:19:22.886357 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3111/5944] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:22 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:22.898253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e7e447cb-6cf2-47cc-9391-6c0174d7ce21 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:22.899296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e7e447cb-6cf2-47cc-9391-6c0174d7ce21 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:22.913252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7e447cb-6cf2-47cc-9391-6c0174d7ce21 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:22.913737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7e447cb-6cf2-47cc-9391-6c0174d7ce21 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:22.936562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] validate_networks() for [('df1d8d00-51c1-4997-9bea-4ff8a64f752c', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:19:22.938208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7e447cb-6cf2-47cc-9391-6c0174d7ce21 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:22.942402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7e447cb-6cf2-47cc-9391-6c0174d7ce21 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:23.021193 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e7e447cb-6cf2-47cc-9391-6c0174d7ce21 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 14 microversion: 2.1 time: 0.132815 Jan 22 21:19:23.022913 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3112/5945] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:22 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:19:23.581007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab3e7c1f-b971-488e-88d1-051813b2a184 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:23.582134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ab3e7c1f-b971-488e-88d1-051813b2a184 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:23.590413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab3e7c1f-b971-488e-88d1-051813b2a184 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:23.591205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab3e7c1f-b971-488e-88d1-051813b2a184 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:23.592274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab3e7c1f-b971-488e-88d1-051813b2a184 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:23.592725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab3e7c1f-b971-488e-88d1-051813b2a184 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:23.658348 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab3e7c1f-b971-488e-88d1-051813b2a184 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.083066 Jan 22 21:19:23.659799 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3113/5946] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:23 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:23.904500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c59f02c3-e419-4bbc-b129-5ffdadff5a0e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:23.906289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c59f02c3-e419-4bbc-b129-5ffdadff5a0e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:23.922418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c59f02c3-e419-4bbc-b129-5ffdadff5a0e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:23.926102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c59f02c3-e419-4bbc-b129-5ffdadff5a0e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:23.927278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c59f02c3-e419-4bbc-b129-5ffdadff5a0e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:23.928607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c59f02c3-e419-4bbc-b129-5ffdadff5a0e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:24.039383 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c59f02c3-e419-4bbc-b129-5ffdadff5a0e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.143250 Jan 22 21:19:24.041658 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3114/5947] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:23 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:24.050833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-654044ba-d031-45ad-8684-5f4b3dff46b4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:24.052330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-654044ba-d031-45ad-8684-5f4b3dff46b4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:24.066761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-654044ba-d031-45ad-8684-5f4b3dff46b4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:24.067601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-654044ba-d031-45ad-8684-5f4b3dff46b4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:24.069854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-654044ba-d031-45ad-8684-5f4b3dff46b4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:24.070557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-654044ba-d031-45ad-8684-5f4b3dff46b4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:24.127413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:19:24.128056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:19:24.128505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:19:24.129127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:19:24.129768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:19:24.160805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:24.165682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:24.166976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:24.170460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:24.176170 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-654044ba-d031-45ad-8684-5f4b3dff46b4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 14 microversion: 2.1 time: 0.130915 Jan 22 21:19:24.178666 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3115/5948] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:24 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:19:24.224619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Getting quotas for project 28fc33994d4c48aea2dbcc875885357a. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:19:24.237877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Getting quotas for user 14eee35455ce441bbd47cc4fcfc2d571 and project 28fc33994d4c48aea2dbcc875885357a. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:19:24.251426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e304d4d4-80a6-4ab3-b1b0-bcdfb38053fb tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] Calling method '.version_select at 0x7f1ed5d410d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:24.279059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:19:24.282099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 7ee0c106-5a38-4a21-80cc-30bd74c900a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:19:24.319604 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e304d4d4-80a6-4ab3-b1b0-bcdfb38053fb tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/67cf73cc-3775-43c7-8d2e-5adf11338c15" status: 200 len: 344 microversion: 2.1 time: 0.073921 Jan 22 21:19:24.320777 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3116/5949] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:19:24 2022] GET /compute/v2.1/os-volumes/67cf73cc-3775-43c7-8d2e-5adf11338c15 => generated 344 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:24.551178 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-81b0d1a1-1bbe-4073-9e7c-f7de6bbb31b3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.749726 Jan 22 21:19:24.553985 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2834/5950] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:19:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 1754 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:19:24.655719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-286688637", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "451", "networks": [{"uuid": "df1d8d00-51c1-4997-9bea-4ff8a64f752c"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:24.670795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0dbd6945-6303-447d-b50a-254b8d3cd6a0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:24.672362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0dbd6945-6303-447d-b50a-254b8d3cd6a0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:24.682346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dbd6945-6303-447d-b50a-254b8d3cd6a0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:24.686156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dbd6945-6303-447d-b50a-254b8d3cd6a0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:24.687061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dbd6945-6303-447d-b50a-254b8d3cd6a0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:24.688207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dbd6945-6303-447d-b50a-254b8d3cd6a0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:24.740221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] validate_networks() for [('df1d8d00-51c1-4997-9bea-4ff8a64f752c', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:19:24.769682 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0dbd6945-6303-447d-b50a-254b8d3cd6a0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.100926 Jan 22 21:19:24.774532 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2835/5951] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:24 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:25.070324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-883547fe-2c24-4a3f-8739-c2755949e5be tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:25.071445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-883547fe-2c24-4a3f-8739-c2755949e5be tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:25.095837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-883547fe-2c24-4a3f-8739-c2755949e5be tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:25.098160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-883547fe-2c24-4a3f-8739-c2755949e5be tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:25.102600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-883547fe-2c24-4a3f-8739-c2755949e5be tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:25.106414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-883547fe-2c24-4a3f-8739-c2755949e5be tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:25.197308 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-883547fe-2c24-4a3f-8739-c2755949e5be tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.147724 Jan 22 21:19:25.198607 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2836/5952] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:25 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:25.204531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dcf5d119-2a13-4364-9daf-fd0ae3317a19 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:25.210882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dcf5d119-2a13-4364-9daf-fd0ae3317a19 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:25.227997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcf5d119-2a13-4364-9daf-fd0ae3317a19 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:25.233432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcf5d119-2a13-4364-9daf-fd0ae3317a19 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:25.234605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcf5d119-2a13-4364-9daf-fd0ae3317a19 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:25.235235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcf5d119-2a13-4364-9daf-fd0ae3317a19 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:25.340930 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dcf5d119-2a13-4364-9daf-fd0ae3317a19 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 8205 microversion: 2.1 time: 0.140073 Jan 22 21:19:25.342260 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2837/5953] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:25 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 8205 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:25.783705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-89aee188-fd20-4360-abfd-b804f7ba03ca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:25.795167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-89aee188-fd20-4360-abfd-b804f7ba03ca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:25.815619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89aee188-fd20-4360-abfd-b804f7ba03ca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:25.816815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89aee188-fd20-4360-abfd-b804f7ba03ca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:25.822004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89aee188-fd20-4360-abfd-b804f7ba03ca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:25.822327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89aee188-fd20-4360-abfd-b804f7ba03ca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:25.910606 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-89aee188-fd20-4360-abfd-b804f7ba03ca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.131417 Jan 22 21:19:25.911281 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2838/5954] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:25 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:26.212024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3642883d-e488-41e8-9c73-ee4aceefda03 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:26.214160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3642883d-e488-41e8-9c73-ee4aceefda03 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:26.228632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3642883d-e488-41e8-9c73-ee4aceefda03 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:26.231274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3642883d-e488-41e8-9c73-ee4aceefda03 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:26.235571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3642883d-e488-41e8-9c73-ee4aceefda03 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:26.236391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3642883d-e488-41e8-9c73-ee4aceefda03 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:26.284333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:19:26.284333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:19:26.284333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:19:26.284333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:19:26.284333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:19:26.284333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:26.284333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:26.286150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:26.286698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:26.319570 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3642883d-e488-41e8-9c73-ee4aceefda03 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.113119 Jan 22 21:19:26.321145 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2839/5955] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:26 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:26.324707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Getting quotas for project 28fc33994d4c48aea2dbcc875885357a. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:19:26.334638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Getting quotas for user 14eee35455ce441bbd47cc4fcfc2d571 and project 28fc33994d4c48aea2dbcc875885357a. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:19:26.346015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:19:26.349809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:19:26.352793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fc18420e-8c3e-47aa-87c9-79c05c6d2a10 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:26.354344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fc18420e-8c3e-47aa-87c9-79c05c6d2a10 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:26.369104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc18420e-8c3e-47aa-87c9-79c05c6d2a10 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:26.377972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc18420e-8c3e-47aa-87c9-79c05c6d2a10 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:26.377972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc18420e-8c3e-47aa-87c9-79c05c6d2a10 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:26.377972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc18420e-8c3e-47aa-87c9-79c05c6d2a10 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:26.448100 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fc18420e-8c3e-47aa-87c9-79c05c6d2a10 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 16385 microversion: 2.1 time: 0.099179 Jan 22 21:19:26.452335 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2840/5956] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:26 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 16385 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:26.629712 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3dde2554-3d6c-4ce6-8540-67cf59662c9f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.979630 Jan 22 21:19:26.631499 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3117/5957] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:19:24 2022] POST /compute/v2.1/servers => generated 382 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:19:26.642125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-08537354-13bd-4136-9fb4-a82eaaa4c0db tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:26.643223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-08537354-13bd-4136-9fb4-a82eaaa4c0db tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:26.808975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-08537354-13bd-4136-9fb4-a82eaaa4c0db tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:26.819688 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-08537354-13bd-4136-9fb4-a82eaaa4c0db tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1224 microversion: 2.1 time: 0.180717 Jan 22 21:19:26.834403 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2841/5958] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:26 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1224 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:26.927677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0de5f04c-39b4-4e10-91ff-57a5cbab07d5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:26.929046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0de5f04c-39b4-4e10-91ff-57a5cbab07d5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:26.951128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0de5f04c-39b4-4e10-91ff-57a5cbab07d5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:26.956658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0de5f04c-39b4-4e10-91ff-57a5cbab07d5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:26.956658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0de5f04c-39b4-4e10-91ff-57a5cbab07d5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:26.956658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0de5f04c-39b4-4e10-91ff-57a5cbab07d5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:27.028681 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0de5f04c-39b4-4e10-91ff-57a5cbab07d5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.110578 Jan 22 21:19:27.034801 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3118/5959] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:26 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:27.332595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dcc6b5d3-d987-49cd-8336-754ee895945a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:27.333597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dcc6b5d3-d987-49cd-8336-754ee895945a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:27.345634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcc6b5d3-d987-49cd-8336-754ee895945a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:27.348613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcc6b5d3-d987-49cd-8336-754ee895945a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:27.349376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcc6b5d3-d987-49cd-8336-754ee895945a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:27.352453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcc6b5d3-d987-49cd-8336-754ee895945a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:27.429355 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dcc6b5d3-d987-49cd-8336-754ee895945a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.101116 Jan 22 21:19:27.435207 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2842/5960] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:27 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:27.467441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-960a9256-ea81-414d-8e4e-dfd43315d306 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:27.469834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-15536fe6-5cf1-4669-8a31-4a8f98eafa10 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:27.470678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-15536fe6-5cf1-4669-8a31-4a8f98eafa10 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:27.473403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-960a9256-ea81-414d-8e4e-dfd43315d306 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:27.482027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15536fe6-5cf1-4669-8a31-4a8f98eafa10 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:27.482027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15536fe6-5cf1-4669-8a31-4a8f98eafa10 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:27.490360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15536fe6-5cf1-4669-8a31-4a8f98eafa10 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:27.490360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15536fe6-5cf1-4669-8a31-4a8f98eafa10 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:27.562296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-960a9256-ea81-414d-8e4e-dfd43315d306 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:27.565772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-960a9256-ea81-414d-8e4e-dfd43315d306 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:27.570980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-960a9256-ea81-414d-8e4e-dfd43315d306 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:27.570980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-960a9256-ea81-414d-8e4e-dfd43315d306 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:27.643684 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-960a9256-ea81-414d-8e4e-dfd43315d306 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 16385 microversion: 2.1 time: 0.183810 Jan 22 21:19:27.649945 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3119/5961] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:27 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 16385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:27.659199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-e8b3b03a-4e2d-4f4b-b901-251912302ea8 req-18d11be3-aa2e-4a04-8fa7-51e5f53f17f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60f5752-e3a2-40ea-97fe-c98ebb12e4f7", "tag": "3b4b9042-2ab2-4731-b9ee-9b33a072ec37"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:27.662524 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:27.662524 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:19:27.678701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e8b3b03a-4e2d-4f4b-b901-251912302ea8 req-18d11be3-aa2e-4a04-8fa7-51e5f53f17f2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:27.679500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e8b3b03a-4e2d-4f4b-b901-251912302ea8 req-18d11be3-aa2e-4a04-8fa7-51e5f53f17f2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:27.699926 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-e8b3b03a-4e2d-4f4b-b901-251912302ea8 req-18d11be3-aa2e-4a04-8fa7-51e5f53f17f2 service nova] Creating event network-changed:3b4b9042-2ab2-4731-b9ee-9b33a072ec37 for instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 on nch1-master-1 Jan 22 21:19:27.711827 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-e8b3b03a-4e2d-4f4b-b901-251912302ea8 req-18d11be3-aa2e-4a04-8fa7-51e5f53f17f2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066046 Jan 22 21:19:27.712938 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3120/5962] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:27.841790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9aa49903-018c-437f-ab72-20212a6665b2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:27.842549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9aa49903-018c-437f-ab72-20212a6665b2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:28.194505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-15536fe6-5cf1-4669-8a31-4a8f98eafa10 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:28.203669 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-15536fe6-5cf1-4669-8a31-4a8f98eafa10 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1568 microversion: 2.1 time: 0.738616 Jan 22 21:19:28.219667 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2843/5963] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:27 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1568 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:28.226735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0627ea11-268d-4101-a9cc-33286d01e95a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:28.227671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0627ea11-268d-4101-a9cc-33286d01e95a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:28.239253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9aa49903-018c-437f-ab72-20212a6665b2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:28.248642 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9aa49903-018c-437f-ab72-20212a6665b2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1224 microversion: 2.1 time: 0.412017 Jan 22 21:19:28.262743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0627ea11-268d-4101-a9cc-33286d01e95a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:28.269274 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3121/5964] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:27 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1224 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:28.269935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0627ea11-268d-4101-a9cc-33286d01e95a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:28.269935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0627ea11-268d-4101-a9cc-33286d01e95a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:28.269935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0627ea11-268d-4101-a9cc-33286d01e95a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:28.335175 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0627ea11-268d-4101-a9cc-33286d01e95a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.113479 Jan 22 21:19:28.339197 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2844/5965] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:28 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:28.447642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7f1e8ba7-7e48-45d9-a0f7-2f47c8bc4442 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:28.449764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7f1e8ba7-7e48-45d9-a0f7-2f47c8bc4442 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:28.463384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f1e8ba7-7e48-45d9-a0f7-2f47c8bc4442 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:28.469543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f1e8ba7-7e48-45d9-a0f7-2f47c8bc4442 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:28.471201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f1e8ba7-7e48-45d9-a0f7-2f47c8bc4442 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:28.472070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f1e8ba7-7e48-45d9-a0f7-2f47c8bc4442 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:28.558515 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7f1e8ba7-7e48-45d9-a0f7-2f47c8bc4442 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.118240 Jan 22 21:19:28.563957 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3122/5966] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:28 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:28.668637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-103c16ca-e633-4c96-8f1c-d354f6d413ea tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:28.668637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-103c16ca-e633-4c96-8f1c-d354f6d413ea tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:28.688354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-103c16ca-e633-4c96-8f1c-d354f6d413ea tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:28.697360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-103c16ca-e633-4c96-8f1c-d354f6d413ea tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:28.697360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-103c16ca-e633-4c96-8f1c-d354f6d413ea tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:28.697360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-103c16ca-e633-4c96-8f1c-d354f6d413ea tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:28.795791 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-103c16ca-e633-4c96-8f1c-d354f6d413ea tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 16385 microversion: 2.1 time: 0.139220 Jan 22 21:19:28.800029 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2845/5967] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:28 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 16385 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:29.282597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-48343415-b663-4634-9be8-670c2d597e0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:29.283306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-48343415-b663-4634-9be8-670c2d597e0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:29.298999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48343415-b663-4634-9be8-670c2d597e0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:29.299522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48343415-b663-4634-9be8-670c2d597e0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:29.300557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48343415-b663-4634-9be8-670c2d597e0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:29.300839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48343415-b663-4634-9be8-670c2d597e0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:29.350781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3f9fd8c7-d2b1-4bd1-8c19-75256ec9166d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:29.352469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3f9fd8c7-d2b1-4bd1-8c19-75256ec9166d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:29.362151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f9fd8c7-d2b1-4bd1-8c19-75256ec9166d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:29.362897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f9fd8c7-d2b1-4bd1-8c19-75256ec9166d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:29.364029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f9fd8c7-d2b1-4bd1-8c19-75256ec9166d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:29.364830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f9fd8c7-d2b1-4bd1-8c19-75256ec9166d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:29.439510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-48343415-b663-4634-9be8-670c2d597e0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:29.456102 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-48343415-b663-4634-9be8-670c2d597e0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1276 microversion: 2.1 time: 0.178446 Jan 22 21:19:29.456732 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3123/5968] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:29 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:29.462332 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3f9fd8c7-d2b1-4bd1-8c19-75256ec9166d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.115605 Jan 22 21:19:29.479493 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2846/5969] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:29 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:29.578752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4dcaeb1d-2ac3-4ae6-81bf-ac81841ae9c4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:29.580376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4dcaeb1d-2ac3-4ae6-81bf-ac81841ae9c4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:29.592197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dcaeb1d-2ac3-4ae6-81bf-ac81841ae9c4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:29.597148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dcaeb1d-2ac3-4ae6-81bf-ac81841ae9c4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:29.605345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dcaeb1d-2ac3-4ae6-81bf-ac81841ae9c4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:29.605345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dcaeb1d-2ac3-4ae6-81bf-ac81841ae9c4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:29.677015 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4dcaeb1d-2ac3-4ae6-81bf-ac81841ae9c4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.109095 Jan 22 21:19:29.678394 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3124/5970] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:29 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:29.820833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb01554c-2246-4baf-b2f6-f6f650665cad tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:29.821970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb01554c-2246-4baf-b2f6-f6f650665cad tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:29.832152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3f14685-c2bc-415a-8458-d9bf68fc47ce tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] Calling method '.version_select at 0x7f1ed58ba8b0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:29.832485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb01554c-2246-4baf-b2f6-f6f650665cad tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:29.833140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb01554c-2246-4baf-b2f6-f6f650665cad tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:29.834153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb01554c-2246-4baf-b2f6-f6f650665cad tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:29.834767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb01554c-2246-4baf-b2f6-f6f650665cad tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:29.920699 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb01554c-2246-4baf-b2f6-f6f650665cad tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 16385 microversion: 2.1 time: 0.115298 Jan 22 21:19:29.923985 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2847/5971] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:29 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 16385 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:29.929239 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d3f14685-c2bc-415a-8458-d9bf68fc47ce tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/32a061d7-dc07-4f80-9b18-9d349eb2f208" status: 200 len: 343 microversion: 2.1 time: 0.101809 Jan 22 21:19:29.934650 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3125/5972] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:19:29 2022] GET /compute/v2.1/os-volumes/32a061d7-dc07-4f80-9b18-9d349eb2f208 => generated 343 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:30.476204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cf91851f-8ba7-42bd-ba79-fedf612d869b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:30.476806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d2d95907-518b-4061-8741-a1c84ecccd47 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:30.478393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d2d95907-518b-4061-8741-a1c84ecccd47 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:30.479106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cf91851f-8ba7-42bd-ba79-fedf612d869b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:30.495136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2d95907-518b-4061-8741-a1c84ecccd47 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:30.495607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2d95907-518b-4061-8741-a1c84ecccd47 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:30.497285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2d95907-518b-4061-8741-a1c84ecccd47 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:30.497874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2d95907-518b-4061-8741-a1c84ecccd47 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:30.505969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf91851f-8ba7-42bd-ba79-fedf612d869b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:30.507757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf91851f-8ba7-42bd-ba79-fedf612d869b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:30.526661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf91851f-8ba7-42bd-ba79-fedf612d869b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:30.527505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf91851f-8ba7-42bd-ba79-fedf612d869b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:30.620016 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d2d95907-518b-4061-8741-a1c84ecccd47 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.147689 Jan 22 21:19:30.627722 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2848/5973] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:30 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:30.693385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a8411fc2-d853-458f-9810-91499bfd99d5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:30.698239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a8411fc2-d853-458f-9810-91499bfd99d5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:30.713496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8411fc2-d853-458f-9810-91499bfd99d5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:30.716889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8411fc2-d853-458f-9810-91499bfd99d5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:30.718357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8411fc2-d853-458f-9810-91499bfd99d5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:30.719371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8411fc2-d853-458f-9810-91499bfd99d5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:30.782059 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a8411fc2-d853-458f-9810-91499bfd99d5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.095430 Jan 22 21:19:30.790827 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2849/5974] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:30 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:30.790970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cf91851f-8ba7-42bd-ba79-fedf612d869b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:30.798820 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cf91851f-8ba7-42bd-ba79-fedf612d869b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1282 microversion: 2.1 time: 0.326880 Jan 22 21:19:30.801862 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3126/5975] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:30 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1282 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:30.836944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-1d1f5507-b7f6-4a7c-8f3a-a11704cbab6e req-0ff56e75-4d87-4398-9932-8a16c9fc4d15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de", "tag": "561a37ef-90a7-4719-b61e-d12c48eeb371"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:30.842646 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:30.842646 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:19:30.861274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1d1f5507-b7f6-4a7c-8f3a-a11704cbab6e req-0ff56e75-4d87-4398-9932-8a16c9fc4d15 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:30.871758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1d1f5507-b7f6-4a7c-8f3a-a11704cbab6e req-0ff56e75-4d87-4398-9932-8a16c9fc4d15 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:30.892742 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-1d1f5507-b7f6-4a7c-8f3a-a11704cbab6e req-0ff56e75-4d87-4398-9932-8a16c9fc4d15 service nova] Creating event network-changed:561a37ef-90a7-4719-b61e-d12c48eeb371 for instance 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de on nch2-master-1 Jan 22 21:19:30.898446 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-1d1f5507-b7f6-4a7c-8f3a-a11704cbab6e req-0ff56e75-4d87-4398-9932-8a16c9fc4d15 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068805 Jan 22 21:19:30.899640 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2850/5976] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:30.937904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5a8a846e-a7e3-4222-96a2-b45946219648 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:30.938855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5a8a846e-a7e3-4222-96a2-b45946219648 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:30.960181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a8a846e-a7e3-4222-96a2-b45946219648 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:30.965584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a8a846e-a7e3-4222-96a2-b45946219648 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:30.965584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a8a846e-a7e3-4222-96a2-b45946219648 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:30.965584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a8a846e-a7e3-4222-96a2-b45946219648 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:31.025706 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5a8a846e-a7e3-4222-96a2-b45946219648 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.094842 Jan 22 21:19:31.026388 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3127/5977] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:30 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:31.635968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fda3defe-6d3b-418c-b10e-911c9fbaac7b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:31.637802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fda3defe-6d3b-418c-b10e-911c9fbaac7b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:31.656619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fda3defe-6d3b-418c-b10e-911c9fbaac7b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:31.664465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fda3defe-6d3b-418c-b10e-911c9fbaac7b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:31.665454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fda3defe-6d3b-418c-b10e-911c9fbaac7b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:31.666238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fda3defe-6d3b-418c-b10e-911c9fbaac7b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:31.722171 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fda3defe-6d3b-418c-b10e-911c9fbaac7b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.090261 Jan 22 21:19:31.723091 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2851/5978] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:31 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:31.796529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e135662b-a637-4b28-aa3d-b963beae229b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:31.798322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e135662b-a637-4b28-aa3d-b963beae229b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:31.807029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e135662b-a637-4b28-aa3d-b963beae229b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:31.807728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e135662b-a637-4b28-aa3d-b963beae229b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:31.809788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e135662b-a637-4b28-aa3d-b963beae229b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:31.810348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e135662b-a637-4b28-aa3d-b963beae229b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:31.822725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b3e41df5-f048-44e0-8e4c-cde79684470d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:31.834341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b3e41df5-f048-44e0-8e4c-cde79684470d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:31.837856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3e41df5-f048-44e0-8e4c-cde79684470d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:31.840654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3e41df5-f048-44e0-8e4c-cde79684470d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:31.845156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3e41df5-f048-44e0-8e4c-cde79684470d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:31.845918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3e41df5-f048-44e0-8e4c-cde79684470d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:31.890390 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e135662b-a637-4b28-aa3d-b963beae229b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.099210 Jan 22 21:19:31.896017 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3128/5979] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:31 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:31.966375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b3e41df5-f048-44e0-8e4c-cde79684470d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:31.996540 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b3e41df5-f048-44e0-8e4c-cde79684470d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1282 microversion: 2.1 time: 0.175991 Jan 22 21:19:32.000794 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2852/5980] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:31 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:32.038149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d69592a2-5692-4db4-abc6-eb5b4cd17400 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:32.039435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d69592a2-5692-4db4-abc6-eb5b4cd17400 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:32.047556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d69592a2-5692-4db4-abc6-eb5b4cd17400 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:32.048271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d69592a2-5692-4db4-abc6-eb5b4cd17400 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:32.049341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d69592a2-5692-4db4-abc6-eb5b4cd17400 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:32.049974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d69592a2-5692-4db4-abc6-eb5b4cd17400 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:32.095977 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d69592a2-5692-4db4-abc6-eb5b4cd17400 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.061583 Jan 22 21:19:32.115705 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3129/5981] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:32 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:32.734571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-515f4d7e-ebcb-46c7-9d9e-dc3efb197dae tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:32.736206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-515f4d7e-ebcb-46c7-9d9e-dc3efb197dae tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:32.743746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-515f4d7e-ebcb-46c7-9d9e-dc3efb197dae tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:32.744475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-515f4d7e-ebcb-46c7-9d9e-dc3efb197dae tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:32.745385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-515f4d7e-ebcb-46c7-9d9e-dc3efb197dae tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:32.746633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-515f4d7e-ebcb-46c7-9d9e-dc3efb197dae tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:32.793742 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-515f4d7e-ebcb-46c7-9d9e-dc3efb197dae tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.063077 Jan 22 21:19:32.794715 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2853/5982] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:32 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:32.903386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-736a6eb9-af38-4c08-9849-f7f9cb053d4b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:32.904582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-736a6eb9-af38-4c08-9849-f7f9cb053d4b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:32.913856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736a6eb9-af38-4c08-9849-f7f9cb053d4b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:32.914318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736a6eb9-af38-4c08-9849-f7f9cb053d4b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:32.915120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736a6eb9-af38-4c08-9849-f7f9cb053d4b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:32.915566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-736a6eb9-af38-4c08-9849-f7f9cb053d4b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:32.963365 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-736a6eb9-af38-4c08-9849-f7f9cb053d4b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.062773 Jan 22 21:19:32.963365 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3130/5983] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:32 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:33.016838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fba8cebc-7e70-4592-a7ed-0b8798125c0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:33.018052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fba8cebc-7e70-4592-a7ed-0b8798125c0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:33.027305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fba8cebc-7e70-4592-a7ed-0b8798125c0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:33.028217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fba8cebc-7e70-4592-a7ed-0b8798125c0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:33.029397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fba8cebc-7e70-4592-a7ed-0b8798125c0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:33.029866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fba8cebc-7e70-4592-a7ed-0b8798125c0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:33.110915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aa7915c8-fa92-4e67-a10c-92711afab1fb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:33.114721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aa7915c8-fa92-4e67-a10c-92711afab1fb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:33.125431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa7915c8-fa92-4e67-a10c-92711afab1fb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:33.126478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa7915c8-fa92-4e67-a10c-92711afab1fb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:33.127613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa7915c8-fa92-4e67-a10c-92711afab1fb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:33.128278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa7915c8-fa92-4e67-a10c-92711afab1fb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:33.182084 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aa7915c8-fa92-4e67-a10c-92711afab1fb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.073099 Jan 22 21:19:33.182084 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3131/5984] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:33 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:33.190143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-46a3b31e-ec1a-404d-908b-d14fcc77d8e4 tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] Calling method '.version_select at 0x7f1ed5dccd30>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:33.275173 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-46a3b31e-ec1a-404d-908b-d14fcc77d8e4 tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/1314a309-9a37-47c7-a3bc-ae925af497dd" status: 200 len: 343 microversion: 2.1 time: 0.089761 Jan 22 21:19:33.278054 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3132/5985] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:19:33 2022] GET /compute/v2.1/os-volumes/1314a309-9a37-47c7-a3bc-ae925af497dd => generated 343 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:33.289633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9ebf04df-a4d4-43e0-b143-e07a11df28ea tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] Calling method '.version_select at 0x7f1edae241f0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:33.302556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fba8cebc-7e70-4592-a7ed-0b8798125c0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:33.312451 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fba8cebc-7e70-4592-a7ed-0b8798125c0c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1324 microversion: 2.1 time: 0.299953 Jan 22 21:19:33.316790 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2854/5986] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:33 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:33.403283 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9ebf04df-a4d4-43e0-b143-e07a11df28ea tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] 10.222.0.100 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.117528 Jan 22 21:19:33.403921 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3133/5987] 10.222.0.100 () {58 vars in 1138 bytes} [Sat Jan 22 21:19:33 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:33.415922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5dafa03c-c1c4-4bba-816c-51bc265c93fd tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] Calling method '.version_select at 0x7f1ed517f790>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:33.552221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-73ed8a58-8ee5-42ee-9bc4-824645204cdd req-42fe49bc-9fb4-4ae9-bf61-73c88e476991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee0c106-5a38-4a21-80cc-30bd74c900a3", "tag": "ea59a8f9-70b4-488a-9967-b0f8c4efb0a6"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:33.556398 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:33.556398 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:19:33.575991 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5dafa03c-c1c4-4bba-816c-51bc265c93fd tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] 10.222.0.100 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.163778 Jan 22 21:19:33.576611 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2855/5988] 10.222.0.100 () {58 vars in 1153 bytes} [Sat Jan 22 21:19:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:33.581060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-73ed8a58-8ee5-42ee-9bc4-824645204cdd req-42fe49bc-9fb4-4ae9-bf61-73c88e476991 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:33.589656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-73ed8a58-8ee5-42ee-9bc4-824645204cdd req-42fe49bc-9fb4-4ae9-bf61-73c88e476991 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:33.589814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-86c6eed6-4e1c-490b-a628-cdcbb5a8cffa tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] Calling method '.version_select at 0x7f1ed5490310>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:33.671016 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-73ed8a58-8ee5-42ee-9bc4-824645204cdd req-42fe49bc-9fb4-4ae9-bf61-73c88e476991 service nova] Creating event network-changed:ea59a8f9-70b4-488a-9967-b0f8c4efb0a6 for instance 7ee0c106-5a38-4a21-80cc-30bd74c900a3 on nch2-master-1 Jan 22 21:19:33.681630 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-73ed8a58-8ee5-42ee-9bc4-824645204cdd req-42fe49bc-9fb4-4ae9-bf61-73c88e476991 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137573 Jan 22 21:19:33.685917 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3134/5989] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:33.746775 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-86c6eed6-4e1c-490b-a628-cdcbb5a8cffa tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] 10.222.0.100 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.161316 Jan 22 21:19:33.747524 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2856/5990] 10.222.0.100 () {58 vars in 1138 bytes} [Sat Jan 22 21:19:33 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:33.759734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ef7f90b1-ae73-425b-a4d0-920c92439a29 tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] Calling method '.version_select at 0x7f1ed58badc0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:33.806633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6431f54f-6bee-4e07-a5e1-08127fed2266 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:33.808703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6431f54f-6bee-4e07-a5e1-08127fed2266 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:33.815993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6431f54f-6bee-4e07-a5e1-08127fed2266 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:33.816809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6431f54f-6bee-4e07-a5e1-08127fed2266 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:33.818067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6431f54f-6bee-4e07-a5e1-08127fed2266 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:33.818822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6431f54f-6bee-4e07-a5e1-08127fed2266 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:33.849124 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ef7f90b1-ae73-425b-a4d0-920c92439a29 tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] 10.222.0.100 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.093792 Jan 22 21:19:33.849749 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3135/5991] 10.222.0.100 () {58 vars in 1171 bytes} [Sat Jan 22 21:19:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:33.862913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-022396f4-48cc-460d-9f00-58de837f07f2 tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] Calling method '.version_select at 0x7f1ed5dcd0d0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:33.907070 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6431f54f-6bee-4e07-a5e1-08127fed2266 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.101696 Jan 22 21:19:33.916308 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2857/5992] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:33 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:33.945173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-e6cd8a80-892a-49cf-befb-fd1841fd60aa req-3cb5f9d0-f4e9-4bd2-8d5b-2dfac0d8c0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b0efe4d-c48f-4017-9af1-74a39c02c424", "tag": "6e4f5f57-8860-4711-bafb-033afa8d0600"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:33.946754 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:33.946754 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:19:33.961021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e6cd8a80-892a-49cf-befb-fd1841fd60aa req-3cb5f9d0-f4e9-4bd2-8d5b-2dfac0d8c0e0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:33.961542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e6cd8a80-892a-49cf-befb-fd1841fd60aa req-3cb5f9d0-f4e9-4bd2-8d5b-2dfac0d8c0e0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:33.990400 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-e6cd8a80-892a-49cf-befb-fd1841fd60aa req-3cb5f9d0-f4e9-4bd2-8d5b-2dfac0d8c0e0 service nova] Creating event network-changed:6e4f5f57-8860-4711-bafb-033afa8d0600 for instance 9b0efe4d-c48f-4017-9af1-74a39c02c424 on nch1-master-1 Jan 22 21:19:33.996553 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-e6cd8a80-892a-49cf-befb-fd1841fd60aa req-3cb5f9d0-f4e9-4bd2-8d5b-2dfac0d8c0e0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054755 Jan 22 21:19:33.997971 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2858/5993] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:19:34.004180 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-022396f4-48cc-460d-9f00-58de837f07f2 tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.145464 Jan 22 21:19:34.004951 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3136/5994] 10.222.0.100 () {58 vars in 1174 bytes} [Sat Jan 22 21:19:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:19:34.020016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2d8bd045-cd55-475a-9f9e-4516e8456525 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:34.021319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2d8bd045-cd55-475a-9f9e-4516e8456525 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:34.022014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-533dfe5d-1093-4513-b1e4-a1d12793454a tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] Calling method '.version_select at 0x7f1edae24550>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:34.040457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d8bd045-cd55-475a-9f9e-4516e8456525 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:34.041927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d8bd045-cd55-475a-9f9e-4516e8456525 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:34.043600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d8bd045-cd55-475a-9f9e-4516e8456525 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:34.044499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d8bd045-cd55-475a-9f9e-4516e8456525 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:34.102243 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2d8bd045-cd55-475a-9f9e-4516e8456525 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.102435 Jan 22 21:19:34.109296 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2859/5995] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:33 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:34.135328 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-533dfe5d-1093-4513-b1e4-a1d12793454a tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.119824 Jan 22 21:19:34.136855 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3137/5996] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:19:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:34.156843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e94fa427-7aee-4f1d-b13f-1baf45a80032 tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] Calling method '.version_select at 0x7f1ed5cf9790>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:34.189927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f03b516f-d1dc-4ad9-9b3d-cee9bde79b41 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:34.195396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f03b516f-d1dc-4ad9-9b3d-cee9bde79b41 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:34.205024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f03b516f-d1dc-4ad9-9b3d-cee9bde79b41 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:34.206686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f03b516f-d1dc-4ad9-9b3d-cee9bde79b41 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:34.207770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f03b516f-d1dc-4ad9-9b3d-cee9bde79b41 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:34.209304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f03b516f-d1dc-4ad9-9b3d-cee9bde79b41 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:34.286173 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f03b516f-d1dc-4ad9-9b3d-cee9bde79b41 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.100339 Jan 22 21:19:34.291747 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3138/5997] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:34 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:34.297350 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e94fa427-7aee-4f1d-b13f-1baf45a80032 tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.152145 Jan 22 21:19:34.306074 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2860/5998] 10.222.0.100 () {58 vars in 1192 bytes} [Sat Jan 22 21:19:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 346 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:34.312109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4d46a7ff-80ef-45a9-ba75-1236a578830e tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] Calling method '.version_select at 0x7f1edae18040>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:34.336711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f502fe34-9c39-470a-bb6d-8f9e59d161df tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:34.337909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f502fe34-9c39-470a-bb6d-8f9e59d161df tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:34.346114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f502fe34-9c39-470a-bb6d-8f9e59d161df tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:34.346874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f502fe34-9c39-470a-bb6d-8f9e59d161df tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:34.348102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f502fe34-9c39-470a-bb6d-8f9e59d161df tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:34.348711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f502fe34-9c39-470a-bb6d-8f9e59d161df tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:34.425707 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4d46a7ff-80ef-45a9-ba75-1236a578830e tempest-VolumesTestJSON-1122461044 tempest-VolumesTestJSON-1122461044-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.118518 Jan 22 21:19:34.426579 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3139/5999] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:19:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:34.645801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f502fe34-9c39-470a-bb6d-8f9e59d161df tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:34.656552 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f502fe34-9c39-470a-bb6d-8f9e59d161df tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1324 microversion: 2.1 time: 0.327796 Jan 22 21:19:34.657140 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2861/6000] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:34 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:34.926850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1e16e65c-50eb-4573-9a64-bcf8fb444e21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:34.928510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1e16e65c-50eb-4573-9a64-bcf8fb444e21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:34.941309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e16e65c-50eb-4573-9a64-bcf8fb444e21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:34.942112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e16e65c-50eb-4573-9a64-bcf8fb444e21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:34.943263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e16e65c-50eb-4573-9a64-bcf8fb444e21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:34.944702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e16e65c-50eb-4573-9a64-bcf8fb444e21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:34.999947 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1e16e65c-50eb-4573-9a64-bcf8fb444e21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.081025 Jan 22 21:19:35.000614 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3140/6001] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:34 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:35.117346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-16a0434f-d170-44d9-a15d-1068ab5ad3db tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:35.119058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-16a0434f-d170-44d9-a15d-1068ab5ad3db tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:35.143988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16a0434f-d170-44d9-a15d-1068ab5ad3db tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:35.144458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16a0434f-d170-44d9-a15d-1068ab5ad3db tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:35.145423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16a0434f-d170-44d9-a15d-1068ab5ad3db tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:35.145818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16a0434f-d170-44d9-a15d-1068ab5ad3db tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:35.205804 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-16a0434f-d170-44d9-a15d-1068ab5ad3db tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.089143 Jan 22 21:19:35.205804 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2862/6002] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:35 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:35.300340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c7915ba9-09f2-48c0-98e0-fa6d7fc1ddcc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:35.301177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c7915ba9-09f2-48c0-98e0-fa6d7fc1ddcc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:35.309103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7915ba9-09f2-48c0-98e0-fa6d7fc1ddcc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:35.309957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7915ba9-09f2-48c0-98e0-fa6d7fc1ddcc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:35.310762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7915ba9-09f2-48c0-98e0-fa6d7fc1ddcc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:35.311201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7915ba9-09f2-48c0-98e0-fa6d7fc1ddcc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:35.376375 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c7915ba9-09f2-48c0-98e0-fa6d7fc1ddcc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.080319 Jan 22 21:19:35.377314 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3141/6003] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:35 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:35.673926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9192fbd5-ebaa-4ece-a572-6b73519fc81b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:35.674627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9192fbd5-ebaa-4ece-a572-6b73519fc81b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:35.682068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9192fbd5-ebaa-4ece-a572-6b73519fc81b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:35.682531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9192fbd5-ebaa-4ece-a572-6b73519fc81b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:35.684384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9192fbd5-ebaa-4ece-a572-6b73519fc81b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:35.684941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9192fbd5-ebaa-4ece-a572-6b73519fc81b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:35.884866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9192fbd5-ebaa-4ece-a572-6b73519fc81b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:35.893073 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9192fbd5-ebaa-4ece-a572-6b73519fc81b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1324 microversion: 2.1 time: 0.223470 Jan 22 21:19:35.893806 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2863/6004] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:35 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1324 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:36.013069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a188bc83-2037-4b9e-9d37-df27067e2c09 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:36.014261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a188bc83-2037-4b9e-9d37-df27067e2c09 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:36.021753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a188bc83-2037-4b9e-9d37-df27067e2c09 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:36.022404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a188bc83-2037-4b9e-9d37-df27067e2c09 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:36.023262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a188bc83-2037-4b9e-9d37-df27067e2c09 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:36.023715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a188bc83-2037-4b9e-9d37-df27067e2c09 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:36.063098 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a188bc83-2037-4b9e-9d37-df27067e2c09 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.054720 Jan 22 21:19:36.066860 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3142/6005] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:36 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:36.212249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6682b2c9-9d8c-43da-af43-0aed0001a280 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:36.213183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6682b2c9-9d8c-43da-af43-0aed0001a280 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:36.220892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6682b2c9-9d8c-43da-af43-0aed0001a280 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:36.224590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6682b2c9-9d8c-43da-af43-0aed0001a280 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:36.224590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6682b2c9-9d8c-43da-af43-0aed0001a280 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:36.224590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6682b2c9-9d8c-43da-af43-0aed0001a280 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:36.267808 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6682b2c9-9d8c-43da-af43-0aed0001a280 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.059173 Jan 22 21:19:36.271928 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2864/6006] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:36 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:36.393239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-80b6c876-8cf8-4c81-a4f2-7f31ba231100 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:36.394229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-80b6c876-8cf8-4c81-a4f2-7f31ba231100 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:36.403330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80b6c876-8cf8-4c81-a4f2-7f31ba231100 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:36.403787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80b6c876-8cf8-4c81-a4f2-7f31ba231100 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:36.404798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80b6c876-8cf8-4c81-a4f2-7f31ba231100 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:36.407260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80b6c876-8cf8-4c81-a4f2-7f31ba231100 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:36.475881 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-80b6c876-8cf8-4c81-a4f2-7f31ba231100 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.089078 Jan 22 21:19:36.479785 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3143/6007] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:36 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:36.916229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-403303c3-5769-4f44-ab21-103599bf62e2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:36.916995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-403303c3-5769-4f44-ab21-103599bf62e2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:36.924883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-403303c3-5769-4f44-ab21-103599bf62e2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:36.925327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-403303c3-5769-4f44-ab21-103599bf62e2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:36.926185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-403303c3-5769-4f44-ab21-103599bf62e2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:36.927292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-403303c3-5769-4f44-ab21-103599bf62e2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:37.069082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-403303c3-5769-4f44-ab21-103599bf62e2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:37.077341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3a956180-62ec-4ad7-967b-c0e2735b8d89 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:37.078383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3a956180-62ec-4ad7-967b-c0e2735b8d89 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:37.079737 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-403303c3-5769-4f44-ab21-103599bf62e2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1324 microversion: 2.1 time: 0.173313 Jan 22 21:19:37.080321 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2865/6008] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:36 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1324 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:37.085847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a956180-62ec-4ad7-967b-c0e2735b8d89 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:37.086305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a956180-62ec-4ad7-967b-c0e2735b8d89 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:37.087102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a956180-62ec-4ad7-967b-c0e2735b8d89 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:37.087545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a956180-62ec-4ad7-967b-c0e2735b8d89 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:37.131566 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3a956180-62ec-4ad7-967b-c0e2735b8d89 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.058446 Jan 22 21:19:37.137282 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3144/6009] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:37 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:37.279906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-73a63728-b2cc-474e-8f3f-cadadccd1028 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:37.281775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-73a63728-b2cc-474e-8f3f-cadadccd1028 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:37.289455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73a63728-b2cc-474e-8f3f-cadadccd1028 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:37.289940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73a63728-b2cc-474e-8f3f-cadadccd1028 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:37.290944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73a63728-b2cc-474e-8f3f-cadadccd1028 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:37.291585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73a63728-b2cc-474e-8f3f-cadadccd1028 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:37.336664 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-73a63728-b2cc-474e-8f3f-cadadccd1028 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.060415 Jan 22 21:19:37.337338 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2866/6010] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:37 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:37.488106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-58c0f70c-9c27-4be6-bf57-84c77cc74404 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:37.489122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-58c0f70c-9c27-4be6-bf57-84c77cc74404 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:37.496623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58c0f70c-9c27-4be6-bf57-84c77cc74404 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:37.497090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58c0f70c-9c27-4be6-bf57-84c77cc74404 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:37.497922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58c0f70c-9c27-4be6-bf57-84c77cc74404 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:37.498417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58c0f70c-9c27-4be6-bf57-84c77cc74404 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:37.546882 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-58c0f70c-9c27-4be6-bf57-84c77cc74404 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.062646 Jan 22 21:19:37.550566 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3145/6011] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:37 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:38.097393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8c6100db-3193-4dab-b37f-bbe564ba0f93 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:38.098071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8c6100db-3193-4dab-b37f-bbe564ba0f93 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:38.106625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c6100db-3193-4dab-b37f-bbe564ba0f93 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:38.107088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c6100db-3193-4dab-b37f-bbe564ba0f93 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:38.107906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c6100db-3193-4dab-b37f-bbe564ba0f93 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:38.108355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c6100db-3193-4dab-b37f-bbe564ba0f93 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:38.155633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3fbb0553-24a0-4880-b75d-6beb0a6e522c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:38.156791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3fbb0553-24a0-4880-b75d-6beb0a6e522c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:38.166824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fbb0553-24a0-4880-b75d-6beb0a6e522c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:38.167954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fbb0553-24a0-4880-b75d-6beb0a6e522c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:38.169087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fbb0553-24a0-4880-b75d-6beb0a6e522c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:38.169650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3fbb0553-24a0-4880-b75d-6beb0a6e522c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:38.220833 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3fbb0553-24a0-4880-b75d-6beb0a6e522c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.079698 Jan 22 21:19:38.221541 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3146/6012] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:38 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:38.275467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8c6100db-3193-4dab-b37f-bbe564ba0f93 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:38.287985 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8c6100db-3193-4dab-b37f-bbe564ba0f93 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1324 microversion: 2.1 time: 0.194398 Jan 22 21:19:38.297692 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2867/6013] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:38 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1324 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:38.349899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-da7e4750-b04b-4f8d-92b8-f964fd49c080 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:38.351389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-da7e4750-b04b-4f8d-92b8-f964fd49c080 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:38.359849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da7e4750-b04b-4f8d-92b8-f964fd49c080 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:38.362171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da7e4750-b04b-4f8d-92b8-f964fd49c080 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:38.362171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da7e4750-b04b-4f8d-92b8-f964fd49c080 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:38.362171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da7e4750-b04b-4f8d-92b8-f964fd49c080 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:38.413184 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-da7e4750-b04b-4f8d-92b8-f964fd49c080 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.068295 Jan 22 21:19:38.413978 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3147/6014] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:38 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:38.559078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ec5edbd9-b462-4522-815a-12cd0c2b87b6 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:38.560775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ec5edbd9-b462-4522-815a-12cd0c2b87b6 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:38.576271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec5edbd9-b462-4522-815a-12cd0c2b87b6 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:38.577114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec5edbd9-b462-4522-815a-12cd0c2b87b6 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:38.578271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec5edbd9-b462-4522-815a-12cd0c2b87b6 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:38.578956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec5edbd9-b462-4522-815a-12cd0c2b87b6 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:38.626923 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ec5edbd9-b462-4522-815a-12cd0c2b87b6 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.070397 Jan 22 21:19:38.628418 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2868/6015] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:38 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:39.028663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a8f6f1ed-aeaa-413a-91aa-b78fe03180f5 req-6d86addc-8e17-480c-ba67-2a6d03bf3f22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de", "name": "network-vif-plugged", "status": "completed", "tag": "561a37ef-90a7-4719-b61e-d12c48eeb371"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:39.031496 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:39.031496 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:19:39.043354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a8f6f1ed-aeaa-413a-91aa-b78fe03180f5 req-6d86addc-8e17-480c-ba67-2a6d03bf3f22 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:39.043899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a8f6f1ed-aeaa-413a-91aa-b78fe03180f5 req-6d86addc-8e17-480c-ba67-2a6d03bf3f22 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:39.065957 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a8f6f1ed-aeaa-413a-91aa-b78fe03180f5 req-6d86addc-8e17-480c-ba67-2a6d03bf3f22 service nova] Creating event network-vif-plugged:561a37ef-90a7-4719-b61e-d12c48eeb371 for instance 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de on nch2-master-1 Jan 22 21:19:39.071665 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a8f6f1ed-aeaa-413a-91aa-b78fe03180f5 req-6d86addc-8e17-480c-ba67-2a6d03bf3f22 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048494 Jan 22 21:19:39.072418 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3148/6016] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:19:39.236250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-39d4cd25-b3b9-49a5-92a1-547135597635 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:39.237337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-39d4cd25-b3b9-49a5-92a1-547135597635 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:39.244236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39d4cd25-b3b9-49a5-92a1-547135597635 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:39.244688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39d4cd25-b3b9-49a5-92a1-547135597635 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:39.246338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39d4cd25-b3b9-49a5-92a1-547135597635 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:39.247183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39d4cd25-b3b9-49a5-92a1-547135597635 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:39.310986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c181f114-252f-4921-bd8c-21c4514778f4 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:39.311766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c181f114-252f-4921-bd8c-21c4514778f4 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:39.319397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c181f114-252f-4921-bd8c-21c4514778f4 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:39.319871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c181f114-252f-4921-bd8c-21c4514778f4 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:39.320680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c181f114-252f-4921-bd8c-21c4514778f4 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:39.321131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c181f114-252f-4921-bd8c-21c4514778f4 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:39.505290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-39d4cd25-b3b9-49a5-92a1-547135597635 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.275930 Jan 22 21:19:39.506630 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2869/6017] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:39 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:39.515775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-084dfeab-f383-4d43-91ce-a0bbeeb7ea45 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:39.516965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-084dfeab-f383-4d43-91ce-a0bbeeb7ea45 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:39.524308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-084dfeab-f383-4d43-91ce-a0bbeeb7ea45 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:39.524878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-084dfeab-f383-4d43-91ce-a0bbeeb7ea45 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:39.525726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-084dfeab-f383-4d43-91ce-a0bbeeb7ea45 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:39.526226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-084dfeab-f383-4d43-91ce-a0bbeeb7ea45 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:39.549607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c181f114-252f-4921-bd8c-21c4514778f4 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:39.568362 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c181f114-252f-4921-bd8c-21c4514778f4 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1324 microversion: 2.1 time: 0.266391 Jan 22 21:19:39.570025 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3149/6018] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:39 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1324 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:39.592857 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-084dfeab-f383-4d43-91ce-a0bbeeb7ea45 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.083896 Jan 22 21:19:39.593561 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2870/6019] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:39 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:39.639656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4b32fee3-cc62-47b8-a24d-9f127ac242fb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:39.641233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4b32fee3-cc62-47b8-a24d-9f127ac242fb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:39.647933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b32fee3-cc62-47b8-a24d-9f127ac242fb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:39.648652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b32fee3-cc62-47b8-a24d-9f127ac242fb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:39.649772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b32fee3-cc62-47b8-a24d-9f127ac242fb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:39.650382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b32fee3-cc62-47b8-a24d-9f127ac242fb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:39.705640 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4b32fee3-cc62-47b8-a24d-9f127ac242fb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.070175 Jan 22 21:19:39.709442 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3150/6020] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:39 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:40.518148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ae90c511-bff6-4732-8224-988d07c18153 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:40.519199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ae90c511-bff6-4732-8224-988d07c18153 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:40.526902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae90c511-bff6-4732-8224-988d07c18153 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:40.527396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae90c511-bff6-4732-8224-988d07c18153 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:40.528190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae90c511-bff6-4732-8224-988d07c18153 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:40.528634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae90c511-bff6-4732-8224-988d07c18153 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:40.588296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b2a7cd78-150c-4978-bc36-2ddab233b643 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:40.589024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b2a7cd78-150c-4978-bc36-2ddab233b643 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:40.596450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2a7cd78-150c-4978-bc36-2ddab233b643 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:40.597271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2a7cd78-150c-4978-bc36-2ddab233b643 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:40.598127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2a7cd78-150c-4978-bc36-2ddab233b643 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:40.598577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2a7cd78-150c-4978-bc36-2ddab233b643 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:40.612154 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ae90c511-bff6-4732-8224-988d07c18153 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.097872 Jan 22 21:19:40.616983 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2871/6021] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:40 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:40.621022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b7d09eb2-ac53-4ddb-bb15-3514ddc0f4ad tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:40.622528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b7d09eb2-ac53-4ddb-bb15-3514ddc0f4ad tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:40.630269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7d09eb2-ac53-4ddb-bb15-3514ddc0f4ad tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:40.630734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7d09eb2-ac53-4ddb-bb15-3514ddc0f4ad tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:40.631621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7d09eb2-ac53-4ddb-bb15-3514ddc0f4ad tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:40.632153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7d09eb2-ac53-4ddb-bb15-3514ddc0f4ad tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:40.687320 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b7d09eb2-ac53-4ddb-bb15-3514ddc0f4ad tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.071212 Jan 22 21:19:40.689103 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2872/6022] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:40 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:40.717634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-253556dd-f773-49b1-b51e-3ec991705812 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:40.718668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-253556dd-f773-49b1-b51e-3ec991705812 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:40.726980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-253556dd-f773-49b1-b51e-3ec991705812 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:40.727484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-253556dd-f773-49b1-b51e-3ec991705812 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:40.728488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-253556dd-f773-49b1-b51e-3ec991705812 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:40.729140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-253556dd-f773-49b1-b51e-3ec991705812 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:40.782355 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-253556dd-f773-49b1-b51e-3ec991705812 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.069083 Jan 22 21:19:40.784759 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2873/6023] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:40 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:19:40.801790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b2a7cd78-150c-4978-bc36-2ddab233b643 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:40.820048 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b2a7cd78-150c-4978-bc36-2ddab233b643 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1324 microversion: 2.1 time: 0.228785 Jan 22 21:19:40.820048 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3151/6024] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:40 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1324 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:41.088426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-bc59187e-2c08-4737-aaf5-eb13d8ad4060 req-beb6cadd-b071-4a36-bd95-e8e12c6c191d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b0efe4d-c48f-4017-9af1-74a39c02c424", "name": "network-vif-plugged", "status": "completed", "tag": "6e4f5f57-8860-4711-bafb-033afa8d0600"}, {"server_uuid": "7ee0c106-5a38-4a21-80cc-30bd74c900a3", "name": "network-vif-plugged", "status": "completed", "tag": "ea59a8f9-70b4-488a-9967-b0f8c4efb0a6"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:41.090309 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:41.090309 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:19:41.099111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bc59187e-2c08-4737-aaf5-eb13d8ad4060 req-beb6cadd-b071-4a36-bd95-e8e12c6c191d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:41.099562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bc59187e-2c08-4737-aaf5-eb13d8ad4060 req-beb6cadd-b071-4a36-bd95-e8e12c6c191d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:41.112963 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-bc59187e-2c08-4737-aaf5-eb13d8ad4060 req-beb6cadd-b071-4a36-bd95-e8e12c6c191d service nova] Creating event network-vif-plugged:6e4f5f57-8860-4711-bafb-033afa8d0600 for instance 9b0efe4d-c48f-4017-9af1-74a39c02c424 on nch1-master-1 Jan 22 21:19:41.113486 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-bc59187e-2c08-4737-aaf5-eb13d8ad4060 req-beb6cadd-b071-4a36-bd95-e8e12c6c191d service nova] Creating event network-vif-plugged:ea59a8f9-70b4-488a-9967-b0f8c4efb0a6 for instance 7ee0c106-5a38-4a21-80cc-30bd74c900a3 on nch2-master-1 Jan 22 21:19:41.122249 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-bc59187e-2c08-4737-aaf5-eb13d8ad4060 req-beb6cadd-b071-4a36-bd95-e8e12c6c191d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038331 Jan 22 21:19:41.122894 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2874/6025] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:41.625214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-15bf3118-8041-459b-95aa-c1e28df85f8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:41.626205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-15bf3118-8041-459b-95aa-c1e28df85f8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:41.634539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15bf3118-8041-459b-95aa-c1e28df85f8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:41.634998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15bf3118-8041-459b-95aa-c1e28df85f8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:41.635787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15bf3118-8041-459b-95aa-c1e28df85f8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:41.636984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15bf3118-8041-459b-95aa-c1e28df85f8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:41.676617 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-15bf3118-8041-459b-95aa-c1e28df85f8a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.055892 Jan 22 21:19:41.677545 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3152/6026] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:41 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:41.701789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-54653a05-4ac6-4216-b355-f8bfbd866bf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:41.702728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-54653a05-4ac6-4216-b355-f8bfbd866bf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:41.709057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54653a05-4ac6-4216-b355-f8bfbd866bf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:41.709743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54653a05-4ac6-4216-b355-f8bfbd866bf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:41.711163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54653a05-4ac6-4216-b355-f8bfbd866bf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:41.711618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54653a05-4ac6-4216-b355-f8bfbd866bf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:41.753929 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-54653a05-4ac6-4216-b355-f8bfbd866bf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.058333 Jan 22 21:19:41.754875 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2875/6027] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:41 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:41.795075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2cc1da21-a0fc-4a45-9b59-05274f33882e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:41.796093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2cc1da21-a0fc-4a45-9b59-05274f33882e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:41.803363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2cc1da21-a0fc-4a45-9b59-05274f33882e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:41.803833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2cc1da21-a0fc-4a45-9b59-05274f33882e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:41.804637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2cc1da21-a0fc-4a45-9b59-05274f33882e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:41.805087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2cc1da21-a0fc-4a45-9b59-05274f33882e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:41.845012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-93dc2ec8-842f-4abc-bbe0-13da510fb5a9 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:41.845774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-93dc2ec8-842f-4abc-bbe0-13da510fb5a9 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:41.848555 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2cc1da21-a0fc-4a45-9b59-05274f33882e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.057408 Jan 22 21:19:41.849230 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3153/6028] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:41 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:41.856740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93dc2ec8-842f-4abc-bbe0-13da510fb5a9 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:41.857203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93dc2ec8-842f-4abc-bbe0-13da510fb5a9 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:41.858041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93dc2ec8-842f-4abc-bbe0-13da510fb5a9 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:41.858492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93dc2ec8-842f-4abc-bbe0-13da510fb5a9 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:41.996536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-93dc2ec8-842f-4abc-bbe0-13da510fb5a9 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:42.008199 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-93dc2ec8-842f-4abc-bbe0-13da510fb5a9 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1324 microversion: 2.1 time: 0.166911 Jan 22 21:19:42.009246 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2876/6029] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:41 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1324 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:42.689422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c5490725-334a-4c45-b016-401a10376c39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:42.690493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c5490725-334a-4c45-b016-401a10376c39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:42.697983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5490725-334a-4c45-b016-401a10376c39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:42.699056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5490725-334a-4c45-b016-401a10376c39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:42.699976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5490725-334a-4c45-b016-401a10376c39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:42.700466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5490725-334a-4c45-b016-401a10376c39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:42.746772 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c5490725-334a-4c45-b016-401a10376c39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.061419 Jan 22 21:19:42.747795 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3154/6030] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:42 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:42.767266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9cee9409-8a7b-46f0-a50b-19dd88e1204b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:42.768376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9cee9409-8a7b-46f0-a50b-19dd88e1204b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:42.778259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9cee9409-8a7b-46f0-a50b-19dd88e1204b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:42.781345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9cee9409-8a7b-46f0-a50b-19dd88e1204b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:42.781345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9cee9409-8a7b-46f0-a50b-19dd88e1204b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:42.781345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9cee9409-8a7b-46f0-a50b-19dd88e1204b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:42.829634 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9cee9409-8a7b-46f0-a50b-19dd88e1204b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.066467 Jan 22 21:19:42.830492 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2877/6031] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:42 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:42.863003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dae5f49d-5072-4ef9-bc9d-2b63192b5b79 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:42.864120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dae5f49d-5072-4ef9-bc9d-2b63192b5b79 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:42.874876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dae5f49d-5072-4ef9-bc9d-2b63192b5b79 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:42.875341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dae5f49d-5072-4ef9-bc9d-2b63192b5b79 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:42.876147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dae5f49d-5072-4ef9-bc9d-2b63192b5b79 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:42.876585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dae5f49d-5072-4ef9-bc9d-2b63192b5b79 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:42.922488 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dae5f49d-5072-4ef9-bc9d-2b63192b5b79 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.064987 Jan 22 21:19:42.923157 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3155/6032] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:42 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:43.032619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-08cb4570-2b1e-420a-a56b-59df8475ad61 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:43.033797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-08cb4570-2b1e-420a-a56b-59df8475ad61 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:43.053881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08cb4570-2b1e-420a-a56b-59df8475ad61 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:43.054343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08cb4570-2b1e-420a-a56b-59df8475ad61 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:43.055224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08cb4570-2b1e-420a-a56b-59df8475ad61 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:43.062184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08cb4570-2b1e-420a-a56b-59df8475ad61 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:43.270928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-08cb4570-2b1e-420a-a56b-59df8475ad61 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:43.281847 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-08cb4570-2b1e-420a-a56b-59df8475ad61 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1515 microversion: 2.1 time: 0.255222 Jan 22 21:19:43.282430 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2878/6033] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:43 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:43.302239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b85af944-7dd6-413a-a7d3-67069837f8ee tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:43.303574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b85af944-7dd6-413a-a7d3-67069837f8ee tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:43.313734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b85af944-7dd6-413a-a7d3-67069837f8ee tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:43.322708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b85af944-7dd6-413a-a7d3-67069837f8ee tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:43.322708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b85af944-7dd6-413a-a7d3-67069837f8ee tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:43.322708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b85af944-7dd6-413a-a7d3-67069837f8ee tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:43.492967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b85af944-7dd6-413a-a7d3-67069837f8ee tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:43.501797 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b85af944-7dd6-413a-a7d3-67069837f8ee tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1517 microversion: 2.1 time: 0.203983 Jan 22 21:19:43.504588 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3156/6034] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:43 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:43.523883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2f0e62ae-d23d-4703-b6f7-50dd96a02e83 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:43.524505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2f0e62ae-d23d-4703-b6f7-50dd96a02e83 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 7ee0c106-5a38-4a21-80cc-30bd74c900a3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:43.532776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0e62ae-d23d-4703-b6f7-50dd96a02e83 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:43.533264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0e62ae-d23d-4703-b6f7-50dd96a02e83 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:43.534279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0e62ae-d23d-4703-b6f7-50dd96a02e83 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:43.534749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0e62ae-d23d-4703-b6f7-50dd96a02e83 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:43.758571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61b1e575-a7df-4948-b336-1a8149fa5fef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:43.760351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-61b1e575-a7df-4948-b336-1a8149fa5fef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:43.769144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61b1e575-a7df-4948-b336-1a8149fa5fef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:43.769855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61b1e575-a7df-4948-b336-1a8149fa5fef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:43.771022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61b1e575-a7df-4948-b336-1a8149fa5fef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:43.771639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61b1e575-a7df-4948-b336-1a8149fa5fef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:43.805961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2f0e62ae-d23d-4703-b6f7-50dd96a02e83 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:43.817120 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61b1e575-a7df-4948-b336-1a8149fa5fef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.062338 Jan 22 21:19:43.819012 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2f0e62ae-d23d-4703-b6f7-50dd96a02e83 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3" status: 200 len: 1517 microversion: 2.1 time: 0.301056 Jan 22 21:19:43.819610 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2879/6035] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:43 2022] GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3 => generated 1517 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:43.821078 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3157/6036] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:43 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:43.836709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f2acae39-7c83-46d9-9753-7a59660db2aa tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:43.841969 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:43.841969 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:19:43.843725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-621239fe-ff67-4777-8b8f-cef25ff3fe93 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:43.844582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f2acae39-7c83-46d9-9753-7a59660db2aa tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:43.844975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-621239fe-ff67-4777-8b8f-cef25ff3fe93 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:43.845567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f2acae39-7c83-46d9-9753-7a59660db2aa tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:19:43.852274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-621239fe-ff67-4777-8b8f-cef25ff3fe93 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:43.853140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-621239fe-ff67-4777-8b8f-cef25ff3fe93 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:43.854423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-621239fe-ff67-4777-8b8f-cef25ff3fe93 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:43.856171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-621239fe-ff67-4777-8b8f-cef25ff3fe93 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:43.861941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2acae39-7c83-46d9-9753-7a59660db2aa tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:43.862406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2acae39-7c83-46d9-9753-7a59660db2aa tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:43.863232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2acae39-7c83-46d9-9753-7a59660db2aa tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:43.863679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2acae39-7c83-46d9-9753-7a59660db2aa tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:43.904237 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-621239fe-ff67-4777-8b8f-cef25ff3fe93 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.066749 Jan 22 21:19:43.904821 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3158/6037] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:43 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:43.939218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c49ad0eb-d1b4-4ae3-98d4-030ba626080e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:43.942048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c49ad0eb-d1b4-4ae3-98d4-030ba626080e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:43.949297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c49ad0eb-d1b4-4ae3-98d4-030ba626080e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:43.949787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c49ad0eb-d1b4-4ae3-98d4-030ba626080e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:43.951092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c49ad0eb-d1b4-4ae3-98d4-030ba626080e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:43.951617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c49ad0eb-d1b4-4ae3-98d4-030ba626080e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:43.961319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-f2acae39-7c83-46d9-9753-7a59660db2aa tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:19:44.004529 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c49ad0eb-d1b4-4ae3-98d4-030ba626080e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.065867 Jan 22 21:19:44.009261 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3159/6038] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:43 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:44.088388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f2acae39-7c83-46d9-9753-7a59660db2aa tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:44.095788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2acae39-7c83-46d9-9753-7a59660db2aa tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:44.096355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2acae39-7c83-46d9-9753-7a59660db2aa tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:44.243068 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f2acae39-7c83-46d9-9753-7a59660db2aa tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1518 microversion: 2.1 time: 0.411138 Jan 22 21:19:44.244277 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2880/6039] 10.222.0.100 () {58 vars in 1171 bytes} [Sat Jan 22 21:19:43 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1518 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:44.264863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ea59b650-6217-4038-8a74-93a48bc2d9d5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:44.270223 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:44.270223 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:19:44.271757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ea59b650-6217-4038-8a74-93a48bc2d9d5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:44.272872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ea59b650-6217-4038-8a74-93a48bc2d9d5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1731878382', 'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:19:44.280641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea59b650-6217-4038-8a74-93a48bc2d9d5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:44.281399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea59b650-6217-4038-8a74-93a48bc2d9d5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:44.282456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea59b650-6217-4038-8a74-93a48bc2d9d5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:44.283089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea59b650-6217-4038-8a74-93a48bc2d9d5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:44.398045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-ea59b650-6217-4038-8a74-93a48bc2d9d5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:19:44.482605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ea59b650-6217-4038-8a74-93a48bc2d9d5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:44.490881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea59b650-6217-4038-8a74-93a48bc2d9d5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:44.491354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea59b650-6217-4038-8a74-93a48bc2d9d5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:44.723121 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ea59b650-6217-4038-8a74-93a48bc2d9d5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1731878382" status: 200 len: 1520 microversion: 2.1 time: 0.462700 Jan 22 21:19:44.724841 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3160/6040] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:19:44 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1731878382 => generated 1520 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:44.744267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d1e4bace-16da-4f91-be28-584d9dd1ffb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:44.747882 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:44.747882 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:19:44.749146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d1e4bace-16da-4f91-be28-584d9dd1ffb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:44.750006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d1e4bace-16da-4f91-be28-584d9dd1ffb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:19:44.756010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1e4bace-16da-4f91-be28-584d9dd1ffb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:44.756699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1e4bace-16da-4f91-be28-584d9dd1ffb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:44.757864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1e4bace-16da-4f91-be28-584d9dd1ffb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:44.758509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1e4bace-16da-4f91-be28-584d9dd1ffb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:44.831424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7cfa2062-b0c6-4ce2-ac1d-6b1bb191fd6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:44.833158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7cfa2062-b0c6-4ce2-ac1d-6b1bb191fd6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:44.841364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cfa2062-b0c6-4ce2-ac1d-6b1bb191fd6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:44.842157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cfa2062-b0c6-4ce2-ac1d-6b1bb191fd6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:44.843175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cfa2062-b0c6-4ce2-ac1d-6b1bb191fd6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:44.844046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cfa2062-b0c6-4ce2-ac1d-6b1bb191fd6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:44.891578 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7cfa2062-b0c6-4ce2-ac1d-6b1bb191fd6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.063173 Jan 22 21:19:44.893541 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3161/6041] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:44 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:44.898558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-d1e4bace-16da-4f91-be28-584d9dd1ffb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:19:44.920806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f889ae48-7fdb-4bcc-9232-2a624416bfc2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:44.922534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f889ae48-7fdb-4bcc-9232-2a624416bfc2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:44.930060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f889ae48-7fdb-4bcc-9232-2a624416bfc2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:44.930943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f889ae48-7fdb-4bcc-9232-2a624416bfc2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:44.932083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f889ae48-7fdb-4bcc-9232-2a624416bfc2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:44.934067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f889ae48-7fdb-4bcc-9232-2a624416bfc2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:44.985897 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f889ae48-7fdb-4bcc-9232-2a624416bfc2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.070309 Jan 22 21:19:44.986574 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3162/6042] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:44 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:44.993018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d1e4bace-16da-4f91-be28-584d9dd1ffb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:45.000768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1e4bace-16da-4f91-be28-584d9dd1ffb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.001443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1e4bace-16da-4f91-be28-584d9dd1ffb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.017724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-438b045b-248e-4bf6-afed-7f01140b6763 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:45.019126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-438b045b-248e-4bf6-afed-7f01140b6763 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:45.027596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-438b045b-248e-4bf6-afed-7f01140b6763 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.028554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-438b045b-248e-4bf6-afed-7f01140b6763 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.029586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-438b045b-248e-4bf6-afed-7f01140b6763 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.030204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-438b045b-248e-4bf6-afed-7f01140b6763 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.083347 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-438b045b-248e-4bf6-afed-7f01140b6763 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.069497 Jan 22 21:19:45.084416 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3163/6043] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:45 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:19:45.170559 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d1e4bace-16da-4f91-be28-584d9dd1ffb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4532 microversion: 2.1 time: 0.430662 Jan 22 21:19:45.171561 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2881/6044] 10.222.0.100 () {58 vars in 1177 bytes} [Sat Jan 22 21:19:44 2022] GET /compute/v2.1/servers/detail?status=active => generated 4532 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:45.191739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-079e015d-2d72-45dc-ba9d-cf20e806e409 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:45.201424 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:45.201424 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:19:45.201424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-079e015d-2d72-45dc-ba9d-cf20e806e409 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:45.201424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.compute.servers [None req-079e015d-2d72-45dc-ba9d-cf20e806e409 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Removing options 'limit' from query {{(pid=137032) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Jan 22 21:19:45.201424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-079e015d-2d72-45dc-ba9d-cf20e806e409 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:19:45.212866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-079e015d-2d72-45dc-ba9d-cf20e806e409 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.213326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-079e015d-2d72-45dc-ba9d-cf20e806e409 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.218870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-079e015d-2d72-45dc-ba9d-cf20e806e409 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.220726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-079e015d-2d72-45dc-ba9d-cf20e806e409 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.261631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-079e015d-2d72-45dc-ba9d-cf20e806e409 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:45.268822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-079e015d-2d72-45dc-ba9d-cf20e806e409 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.269272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-079e015d-2d72-45dc-ba9d-cf20e806e409 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.568437 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-079e015d-2d72-45dc-ba9d-cf20e806e409 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1665 microversion: 2.1 time: 0.380661 Jan 22 21:19:45.573142 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3164/6045] 10.222.0.100 () {58 vars in 1165 bytes} [Sat Jan 22 21:19:45 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1665 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:45.587926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-67f8f418-079c-4395-bc6a-5b61e9ba6671 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:45.591548 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:45.591548 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:19:45.592945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-67f8f418-079c-4395-bc6a-5b61e9ba6671 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:45.594011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-67f8f418-079c-4395-bc6a-5b61e9ba6671 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:19:45.599568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67f8f418-079c-4395-bc6a-5b61e9ba6671 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.600373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67f8f418-079c-4395-bc6a-5b61e9ba6671 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.601469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67f8f418-079c-4395-bc6a-5b61e9ba6671 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.602174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67f8f418-079c-4395-bc6a-5b61e9ba6671 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.634234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-67f8f418-079c-4395-bc6a-5b61e9ba6671 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:19:45.667577 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-67f8f418-079c-4395-bc6a-5b61e9ba6671 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers?status=active" status: 200 len: 1017 microversion: 2.1 time: 0.083095 Jan 22 21:19:45.668500 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2882/6046] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:19:45 2022] GET /compute/v2.1/servers?status=active => generated 1017 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:45.680635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ede07694-2ddb-4709-b724-175f7eed3f2f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:45.685735 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:45.685735 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:19:45.689888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ede07694-2ddb-4709-b724-175f7eed3f2f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:45.689888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.compute.servers [None req-ede07694-2ddb-4709-b724-175f7eed3f2f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Removing options 'limit' from query {{(pid=137032) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Jan 22 21:19:45.689888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ede07694-2ddb-4709-b724-175f7eed3f2f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:19:45.694608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ede07694-2ddb-4709-b724-175f7eed3f2f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.695071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ede07694-2ddb-4709-b724-175f7eed3f2f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.695962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ede07694-2ddb-4709-b724-175f7eed3f2f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.696343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ede07694-2ddb-4709-b724-175f7eed3f2f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.724442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-ede07694-2ddb-4709-b724-175f7eed3f2f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:19:45.754246 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ede07694-2ddb-4709-b724-175f7eed3f2f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1017 microversion: 2.1 time: 0.078003 Jan 22 21:19:45.754772 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3165/6047] 10.222.0.100 () {58 vars in 1154 bytes} [Sat Jan 22 21:19:45 2022] GET /compute/v2.1/servers?limit=100000 => generated 1017 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:45.765662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-923792d7-cf1f-4cf2-bf5e-291a2a15b3e6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:45.768725 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:45.768725 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:19:45.769743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-923792d7-cf1f-4cf2-bf5e-291a2a15b3e6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:45.770400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-923792d7-cf1f-4cf2-bf5e-291a2a15b3e6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:19:45.776126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-923792d7-cf1f-4cf2-bf5e-291a2a15b3e6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.781634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-923792d7-cf1f-4cf2-bf5e-291a2a15b3e6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.781634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-923792d7-cf1f-4cf2-bf5e-291a2a15b3e6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.781634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-923792d7-cf1f-4cf2-bf5e-291a2a15b3e6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.804975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-923792d7-cf1f-4cf2-bf5e-291a2a15b3e6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:19:45.834519 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-923792d7-cf1f-4cf2-bf5e-291a2a15b3e6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 1017 microversion: 2.1 time: 0.072461 Jan 22 21:19:45.838523 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2883/6048] 10.222.0.100 () {58 vars in 1129 bytes} [Sat Jan 22 21:19:45 2022] GET /compute/v2.1/servers => generated 1017 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:45.847496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5422059c-f0a5-4159-b6c9-971b26bb7553 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:45.851215 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:45.851215 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:19:45.852327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5422059c-f0a5-4159-b6c9-971b26bb7553 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:45.853005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5422059c-f0a5-4159-b6c9-971b26bb7553 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:19:45.866024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5422059c-f0a5-4159-b6c9-971b26bb7553 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.866494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5422059c-f0a5-4159-b6c9-971b26bb7553 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.867338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5422059c-f0a5-4159-b6c9-971b26bb7553 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.867803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5422059c-f0a5-4159-b6c9-971b26bb7553 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.904394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4ab1477c-a821-45cb-86c6-489de0c2c378 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:45.905300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4ab1477c-a821-45cb-86c6-489de0c2c378 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:45.912566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ab1477c-a821-45cb-86c6-489de0c2c378 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.913166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ab1477c-a821-45cb-86c6-489de0c2c378 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.915245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ab1477c-a821-45cb-86c6-489de0c2c378 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:45.915245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ab1477c-a821-45cb-86c6-489de0c2c378 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:45.957789 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4ab1477c-a821-45cb-86c6-489de0c2c378 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.057446 Jan 22 21:19:45.961693 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2884/6049] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:45 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:45.968984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-5422059c-f0a5-4159-b6c9-971b26bb7553 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:19:46.000948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-27ca7194-75e2-4cb8-8e34-e29606a165ae tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:46.002126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-27ca7194-75e2-4cb8-8e34-e29606a165ae tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:46.013038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27ca7194-75e2-4cb8-8e34-e29606a165ae tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.013576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27ca7194-75e2-4cb8-8e34-e29606a165ae tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.014524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27ca7194-75e2-4cb8-8e34-e29606a165ae tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.015029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27ca7194-75e2-4cb8-8e34-e29606a165ae tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.035092 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5422059c-f0a5-4159-b6c9-971b26bb7553 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 347 microversion: 2.1 time: 0.191802 Jan 22 21:19:46.035994 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3166/6050] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:19:45 2022] GET /compute/v2.1/servers?flavor=451 => generated 347 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:46.048553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-18ce2c39-2e0e-49b9-b2fa-46f1f06ce4ca tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:46.052997 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:46.052997 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:19:46.053611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-18ce2c39-2e0e-49b9-b2fa-46f1f06ce4ca tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:46.054071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.compute.servers [None req-18ce2c39-2e0e-49b9-b2fa-46f1f06ce4ca tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Removing options 'limit' from query {{(pid=137032) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Jan 22 21:19:46.054736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-18ce2c39-2e0e-49b9-b2fa-46f1f06ce4ca tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:19:46.061888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18ce2c39-2e0e-49b9-b2fa-46f1f06ce4ca tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.062346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18ce2c39-2e0e-49b9-b2fa-46f1f06ce4ca tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.063369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18ce2c39-2e0e-49b9-b2fa-46f1f06ce4ca tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.063814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18ce2c39-2e0e-49b9-b2fa-46f1f06ce4ca tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.081037 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-27ca7194-75e2-4cb8-8e34-e29606a165ae tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.086597 Jan 22 21:19:46.083194 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2885/6051] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:45 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:46.095860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-23b77101-3112-44cd-a7d1-dd037aadcc80 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:46.097468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-23b77101-3112-44cd-a7d1-dd037aadcc80 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:46.106072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23b77101-3112-44cd-a7d1-dd037aadcc80 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.107025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23b77101-3112-44cd-a7d1-dd037aadcc80 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.108312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23b77101-3112-44cd-a7d1-dd037aadcc80 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.109026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23b77101-3112-44cd-a7d1-dd037aadcc80 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.111430 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-18ce2c39-2e0e-49b9-b2fa-46f1f06ce4ca tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers?limit=1" status: 200 len: 487 microversion: 2.1 time: 0.066943 Jan 22 21:19:46.121681 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3167/6052] 10.222.0.100 () {58 vars in 1144 bytes} [Sat Jan 22 21:19:46 2022] GET /compute/v2.1/servers?limit=1 => generated 487 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:46.127482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-95535ed0-f3f4-4099-a0ac-7b04b933afb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:46.131259 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:19:46.131259 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:19:46.132305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-95535ed0-f3f4-4099-a0ac-7b04b933afb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:46.132982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-95535ed0-f3f4-4099-a0ac-7b04b933afb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1731878382', 'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:19:46.139223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95535ed0-f3f4-4099-a0ac-7b04b933afb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.139678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95535ed0-f3f4-4099-a0ac-7b04b933afb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.140636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95535ed0-f3f4-4099-a0ac-7b04b933afb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.141092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95535ed0-f3f4-4099-a0ac-7b04b933afb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.159756 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-23b77101-3112-44cd-a7d1-dd037aadcc80 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.067450 Jan 22 21:19:46.160458 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2886/6053] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:46 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:19:46.238229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-95535ed0-f3f4-4099-a0ac-7b04b933afb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:19:46.297080 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-95535ed0-f3f4-4099-a0ac-7b04b933afb8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1731878382" status: 200 len: 348 microversion: 2.1 time: 0.174168 Jan 22 21:19:46.297700 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3168/6054] 10.222.0.100 () {58 vars in 1246 bytes} [Sat Jan 22 21:19:46 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1731878382 => generated 348 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:19:46.303898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-be6c8a60-ff11-456f-9f9d-7ddffd7723c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:46.304495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-be6c8a60-ff11-456f-9f9d-7ddffd7723c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:46.309496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c90a1f3a-96ca-427f-8967-dabd21cbc560 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:46.313081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be6c8a60-ff11-456f-9f9d-7ddffd7723c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.313619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be6c8a60-ff11-456f-9f9d-7ddffd7723c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.314426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be6c8a60-ff11-456f-9f9d-7ddffd7723c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.314873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be6c8a60-ff11-456f-9f9d-7ddffd7723c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.315618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c90a1f3a-96ca-427f-8967-dabd21cbc560 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.316081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c90a1f3a-96ca-427f-8967-dabd21cbc560 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.333053 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-be6c8a60-ff11-456f-9f9d-7ddffd7723c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] HTTP exception thrown: Instance 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b could not be found. Jan 22 21:19:46.333725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-be6c8a60-ff11-456f-9f9d-7ddffd7723c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Returning 404 to user: Instance 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:46.334590 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-be6c8a60-ff11-456f-9f9d-7ddffd7723c8 tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 404 len: 111 microversion: 2.1 time: 0.034719 Jan 22 21:19:46.335198 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2887/6055] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:19:46 2022] DELETE /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:46.343284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9adb0e9f-8934-43fa-81b2-af6fe780f27f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:46.343996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9adb0e9f-8934-43fa-81b2-af6fe780f27f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:46.344117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c90a1f3a-96ca-427f-8967-dabd21cbc560 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Going to try to stop instance {{(pid=137032) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 22 21:19:46.352339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9adb0e9f-8934-43fa-81b2-af6fe780f27f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.355291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9adb0e9f-8934-43fa-81b2-af6fe780f27f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.355291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9adb0e9f-8934-43fa-81b2-af6fe780f27f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.355291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9adb0e9f-8934-43fa-81b2-af6fe780f27f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.368985 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-9adb0e9f-8934-43fa-81b2-af6fe780f27f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] HTTP exception thrown: Instance 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b could not be found. Jan 22 21:19:46.369721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9adb0e9f-8934-43fa-81b2-af6fe780f27f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Returning 404 to user: Instance 8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:46.371485 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9adb0e9f-8934-43fa-81b2-af6fe780f27f tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b" status: 404 len: 111 microversion: 2.1 time: 0.031872 Jan 22 21:19:46.377594 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2888/6056] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:46 2022] GET /compute/v2.1/servers/8c827c1d-56e6-49cd-8ba5-7a6fb7357f3b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:19:46.574097 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c90a1f3a-96ca-427f-8967-dabd21cbc560 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "POST /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de/action" status: 202 len: 0 microversion: 2.1 time: 0.268552 Jan 22 21:19:46.578036 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3169/6057] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:46 2022] POST /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:46.583207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96858499-048d-466f-b24e-45f9a7a5fe43 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:46.583835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96858499-048d-466f-b24e-45f9a7a5fe43 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:46.591780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96858499-048d-466f-b24e-45f9a7a5fe43 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.592239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96858499-048d-466f-b24e-45f9a7a5fe43 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.593208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96858499-048d-466f-b24e-45f9a7a5fe43 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.593730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96858499-048d-466f-b24e-45f9a7a5fe43 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.800413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-96858499-048d-466f-b24e-45f9a7a5fe43 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:46.803640 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96858499-048d-466f-b24e-45f9a7a5fe43 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.224010 Jan 22 21:19:46.804985 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2889/6058] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:46 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:46.970433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a575b3e1-17c5-48d5-9103-f10fadd5b99e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:46.972260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a575b3e1-17c5-48d5-9103-f10fadd5b99e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:46.979342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a575b3e1-17c5-48d5-9103-f10fadd5b99e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.979342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a575b3e1-17c5-48d5-9103-f10fadd5b99e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:46.980317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a575b3e1-17c5-48d5-9103-f10fadd5b99e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:46.980850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a575b3e1-17c5-48d5-9103-f10fadd5b99e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:47.032570 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a575b3e1-17c5-48d5-9103-f10fadd5b99e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.065817 Jan 22 21:19:47.033777 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3170/6059] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:46 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:47.095267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c08f3cc2-38ef-4a6b-b425-4631e1599589 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:47.096113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c08f3cc2-38ef-4a6b-b425-4631e1599589 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:47.103010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c08f3cc2-38ef-4a6b-b425-4631e1599589 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:47.103466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c08f3cc2-38ef-4a6b-b425-4631e1599589 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:47.104278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c08f3cc2-38ef-4a6b-b425-4631e1599589 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:47.105622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c08f3cc2-38ef-4a6b-b425-4631e1599589 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:47.153882 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c08f3cc2-38ef-4a6b-b425-4631e1599589 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.062491 Jan 22 21:19:47.154572 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2890/6060] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:47 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:47.172162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d0d4bfe2-9442-4bb9-8562-54fba3faa6a9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:47.174147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d0d4bfe2-9442-4bb9-8562-54fba3faa6a9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:47.181617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0d4bfe2-9442-4bb9-8562-54fba3faa6a9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:47.182070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0d4bfe2-9442-4bb9-8562-54fba3faa6a9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:47.183956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0d4bfe2-9442-4bb9-8562-54fba3faa6a9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:47.183956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0d4bfe2-9442-4bb9-8562-54fba3faa6a9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:47.225165 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d0d4bfe2-9442-4bb9-8562-54fba3faa6a9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.057213 Jan 22 21:19:47.229082 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3171/6061] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:47 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:47.822156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e95ef723-cc78-4f09-98fd-335879366d96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:47.822866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e95ef723-cc78-4f09-98fd-335879366d96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:47.829762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e95ef723-cc78-4f09-98fd-335879366d96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:47.836522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e95ef723-cc78-4f09-98fd-335879366d96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:47.836522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e95ef723-cc78-4f09-98fd-335879366d96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:47.836522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e95ef723-cc78-4f09-98fd-335879366d96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:47.973677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e95ef723-cc78-4f09-98fd-335879366d96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:47.981355 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e95ef723-cc78-4f09-98fd-335879366d96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.163622 Jan 22 21:19:47.982226 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2891/6062] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:47 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:48.044948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c1241c51-a8e4-42a3-afb0-8ddd3a86a065 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:48.045980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c1241c51-a8e4-42a3-afb0-8ddd3a86a065 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:48.054300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1241c51-a8e4-42a3-afb0-8ddd3a86a065 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:48.055876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1241c51-a8e4-42a3-afb0-8ddd3a86a065 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:48.056674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1241c51-a8e4-42a3-afb0-8ddd3a86a065 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:48.057114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1241c51-a8e4-42a3-afb0-8ddd3a86a065 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:48.099322 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c1241c51-a8e4-42a3-afb0-8ddd3a86a065 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.058444 Jan 22 21:19:48.099998 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3172/6063] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:48 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:48.165904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ba8cf34-cf27-4c44-90fa-ee9ca8f53fe1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:48.166874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ba8cf34-cf27-4c44-90fa-ee9ca8f53fe1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:48.179756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ba8cf34-cf27-4c44-90fa-ee9ca8f53fe1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:48.180227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ba8cf34-cf27-4c44-90fa-ee9ca8f53fe1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:48.181040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ba8cf34-cf27-4c44-90fa-ee9ca8f53fe1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:48.181729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ba8cf34-cf27-4c44-90fa-ee9ca8f53fe1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:48.224279 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ba8cf34-cf27-4c44-90fa-ee9ca8f53fe1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.061793 Jan 22 21:19:48.224961 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2892/6064] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:48 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:48.237364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f7bb0f9d-cdd7-4f16-95c4-4248740a7398 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:48.238513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f7bb0f9d-cdd7-4f16-95c4-4248740a7398 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:48.246367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7bb0f9d-cdd7-4f16-95c4-4248740a7398 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:48.246843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7bb0f9d-cdd7-4f16-95c4-4248740a7398 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:48.247661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7bb0f9d-cdd7-4f16-95c4-4248740a7398 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:48.248114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f7bb0f9d-cdd7-4f16-95c4-4248740a7398 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:48.296024 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f7bb0f9d-cdd7-4f16-95c4-4248740a7398 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.063247 Jan 22 21:19:48.297550 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3173/6065] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:48 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:48.964624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aeb50ebb-1507-47d3-8a7c-150ef9fd5c4b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:48.966002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aeb50ebb-1507-47d3-8a7c-150ef9fd5c4b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:48.975444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aeb50ebb-1507-47d3-8a7c-150ef9fd5c4b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:48.979141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aeb50ebb-1507-47d3-8a7c-150ef9fd5c4b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:48.979141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aeb50ebb-1507-47d3-8a7c-150ef9fd5c4b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:48.979141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aeb50ebb-1507-47d3-8a7c-150ef9fd5c4b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:48.999646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0b99fc7b-cdd7-40a1-bcd0-7597ef28bbe2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:49.000344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0b99fc7b-cdd7-40a1-bcd0-7597ef28bbe2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:49.012420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b99fc7b-cdd7-40a1-bcd0-7597ef28bbe2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:49.012982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b99fc7b-cdd7-40a1-bcd0-7597ef28bbe2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:49.014245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b99fc7b-cdd7-40a1-bcd0-7597ef28bbe2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:49.014767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b99fc7b-cdd7-40a1-bcd0-7597ef28bbe2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:49.044757 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aeb50ebb-1507-47d3-8a7c-150ef9fd5c4b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7/action" status: 200 len: 24563 microversion: 2.1 time: 0.085248 Jan 22 21:19:49.045443 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2893/6066] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:48 2022] POST /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7/action => generated 24563 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:49.115458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-faa1b649-6fee-44b8-a5a2-505a9583cca6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:49.116641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-faa1b649-6fee-44b8-a5a2-505a9583cca6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:49.132609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-faa1b649-6fee-44b8-a5a2-505a9583cca6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:49.133665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-faa1b649-6fee-44b8-a5a2-505a9583cca6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:49.139435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-faa1b649-6fee-44b8-a5a2-505a9583cca6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:49.139435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-faa1b649-6fee-44b8-a5a2-505a9583cca6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:49.192024 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-faa1b649-6fee-44b8-a5a2-505a9583cca6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.083183 Jan 22 21:19:49.194194 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2894/6067] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:49 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:49.210488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0b99fc7b-cdd7-40a1-bcd0-7597ef28bbe2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:49.219648 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0b99fc7b-cdd7-40a1-bcd0-7597ef28bbe2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.224600 Jan 22 21:19:49.220335 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3174/6068] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:48 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:49.239157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9916708c-c34d-4156-9a90-fd85e762c82e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:49.240214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9916708c-c34d-4156-9a90-fd85e762c82e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:49.247868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9916708c-c34d-4156-9a90-fd85e762c82e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:49.248329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9916708c-c34d-4156-9a90-fd85e762c82e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:49.249456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9916708c-c34d-4156-9a90-fd85e762c82e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:49.250282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9916708c-c34d-4156-9a90-fd85e762c82e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:49.302154 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9916708c-c34d-4156-9a90-fd85e762c82e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.067534 Jan 22 21:19:49.306157 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2895/6069] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:49 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:49.309542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f35b8da-4400-4694-bdd3-05a9962cbecc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:49.310475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8f35b8da-4400-4694-bdd3-05a9962cbecc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:49.316923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f35b8da-4400-4694-bdd3-05a9962cbecc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:49.317388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f35b8da-4400-4694-bdd3-05a9962cbecc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:49.318361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f35b8da-4400-4694-bdd3-05a9962cbecc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:49.318837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f35b8da-4400-4694-bdd3-05a9962cbecc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:49.359065 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8f35b8da-4400-4694-bdd3-05a9962cbecc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.055006 Jan 22 21:19:49.359711 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3175/6070] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:49 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:19:50.206098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e52687aa-235a-45af-b47d-a1453f723933 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:50.207210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e52687aa-235a-45af-b47d-a1453f723933 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:50.215745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e52687aa-235a-45af-b47d-a1453f723933 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:50.216205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e52687aa-235a-45af-b47d-a1453f723933 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:50.217002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e52687aa-235a-45af-b47d-a1453f723933 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:50.217569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e52687aa-235a-45af-b47d-a1453f723933 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:50.239464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-517ac98d-36e6-4988-84f4-272d085835c3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:50.240550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-517ac98d-36e6-4988-84f4-272d085835c3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:50.249555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-517ac98d-36e6-4988-84f4-272d085835c3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:50.250624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-517ac98d-36e6-4988-84f4-272d085835c3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:50.251668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-517ac98d-36e6-4988-84f4-272d085835c3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:50.252439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-517ac98d-36e6-4988-84f4-272d085835c3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:50.268774 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e52687aa-235a-45af-b47d-a1453f723933 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.066586 Jan 22 21:19:50.271856 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2896/6071] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:50 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:50.321881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f1879e9a-9a8e-45c2-beed-93114988acee tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:50.324957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f1879e9a-9a8e-45c2-beed-93114988acee tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:50.333968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1879e9a-9a8e-45c2-beed-93114988acee tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:50.335035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1879e9a-9a8e-45c2-beed-93114988acee tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:50.336478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1879e9a-9a8e-45c2-beed-93114988acee tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:50.337914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1879e9a-9a8e-45c2-beed-93114988acee tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:50.405161 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f1879e9a-9a8e-45c2-beed-93114988acee tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.093475 Jan 22 21:19:50.409720 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2897/6072] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:50 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:50.412811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-90ea8e45-5fcb-425f-87aa-233fd375ea8a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:50.414158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-90ea8e45-5fcb-425f-87aa-233fd375ea8a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:50.421591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90ea8e45-5fcb-425f-87aa-233fd375ea8a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:50.422136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90ea8e45-5fcb-425f-87aa-233fd375ea8a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:50.423015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90ea8e45-5fcb-425f-87aa-233fd375ea8a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:50.423532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90ea8e45-5fcb-425f-87aa-233fd375ea8a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:50.470075 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-90ea8e45-5fcb-425f-87aa-233fd375ea8a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.062476 Jan 22 21:19:50.471812 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2898/6073] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:50 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:50.573957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-517ac98d-36e6-4988-84f4-272d085835c3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:50.585617 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-517ac98d-36e6-4988-84f4-272d085835c3 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.350095 Jan 22 21:19:50.586212 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3176/6074] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:50 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:51.283786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c98da71e-f71b-4463-b3ba-e52b3966710b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:51.284921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c98da71e-f71b-4463-b3ba-e52b3966710b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:51.293540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c98da71e-f71b-4463-b3ba-e52b3966710b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:51.293992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c98da71e-f71b-4463-b3ba-e52b3966710b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:51.294843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c98da71e-f71b-4463-b3ba-e52b3966710b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:51.295281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c98da71e-f71b-4463-b3ba-e52b3966710b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:51.343094 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c98da71e-f71b-4463-b3ba-e52b3966710b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.063426 Jan 22 21:19:51.343765 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2899/6075] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:51 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:51.417418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6062759d-90dc-457d-9180-369bf3ccdda6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:51.418359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6062759d-90dc-457d-9180-369bf3ccdda6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:51.425996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6062759d-90dc-457d-9180-369bf3ccdda6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:51.426454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6062759d-90dc-457d-9180-369bf3ccdda6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:51.427269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6062759d-90dc-457d-9180-369bf3ccdda6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:51.427710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6062759d-90dc-457d-9180-369bf3ccdda6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:51.471148 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6062759d-90dc-457d-9180-369bf3ccdda6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.058031 Jan 22 21:19:51.471806 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3177/6076] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:51 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:51.483650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4a733d48-2f20-4653-8d74-156547bf6619 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:51.484935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4a733d48-2f20-4653-8d74-156547bf6619 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:51.492072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a733d48-2f20-4653-8d74-156547bf6619 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:51.492527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a733d48-2f20-4653-8d74-156547bf6619 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:51.493318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a733d48-2f20-4653-8d74-156547bf6619 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:51.493784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a733d48-2f20-4653-8d74-156547bf6619 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:51.537761 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4a733d48-2f20-4653-8d74-156547bf6619 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.059250 Jan 22 21:19:51.538665 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2900/6077] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:51 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:19:51.603141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2f248e4a-4153-41da-93dc-7894ae1e1a28 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:51.603832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2f248e4a-4153-41da-93dc-7894ae1e1a28 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:51.611612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f248e4a-4153-41da-93dc-7894ae1e1a28 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:51.612067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f248e4a-4153-41da-93dc-7894ae1e1a28 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:51.612853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f248e4a-4153-41da-93dc-7894ae1e1a28 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:51.613298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f248e4a-4153-41da-93dc-7894ae1e1a28 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:51.744354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2f248e4a-4153-41da-93dc-7894ae1e1a28 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:51.753088 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2f248e4a-4153-41da-93dc-7894ae1e1a28 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.153999 Jan 22 21:19:51.754078 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3178/6078] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:51 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:52.355377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7839820f-0747-4ffc-8752-3ae6a84ac5ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:52.356401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7839820f-0747-4ffc-8752-3ae6a84ac5ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:52.363687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7839820f-0747-4ffc-8752-3ae6a84ac5ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:52.364256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7839820f-0747-4ffc-8752-3ae6a84ac5ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:52.365051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7839820f-0747-4ffc-8752-3ae6a84ac5ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:52.365487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7839820f-0747-4ffc-8752-3ae6a84ac5ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:52.405772 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7839820f-0747-4ffc-8752-3ae6a84ac5ba tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.054380 Jan 22 21:19:52.406439 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2901/6079] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:52 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:52.485979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9bf83756-a7fb-40b3-89d6-6f26a7a2af4c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:52.487597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9bf83756-a7fb-40b3-89d6-6f26a7a2af4c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:52.497884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bf83756-a7fb-40b3-89d6-6f26a7a2af4c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:52.498346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bf83756-a7fb-40b3-89d6-6f26a7a2af4c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:52.499263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bf83756-a7fb-40b3-89d6-6f26a7a2af4c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:52.499591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9bf83756-a7fb-40b3-89d6-6f26a7a2af4c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:52.542572 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9bf83756-a7fb-40b3-89d6-6f26a7a2af4c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.061605 Jan 22 21:19:52.543489 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3179/6080] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:52 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:52.555140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-520643b0-26d0-497d-888c-3e16684d6357 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:52.556167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-520643b0-26d0-497d-888c-3e16684d6357 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:52.563575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-520643b0-26d0-497d-888c-3e16684d6357 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:52.564031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-520643b0-26d0-497d-888c-3e16684d6357 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:52.565054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-520643b0-26d0-497d-888c-3e16684d6357 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:52.565522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-520643b0-26d0-497d-888c-3e16684d6357 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:52.617996 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-520643b0-26d0-497d-888c-3e16684d6357 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.066736 Jan 22 21:19:52.618970 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2902/6081] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:52 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:19:52.771640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-755c244d-cd67-4913-bf15-34491b083352 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:52.772345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-755c244d-cd67-4913-bf15-34491b083352 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:52.780685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-755c244d-cd67-4913-bf15-34491b083352 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:52.781137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-755c244d-cd67-4913-bf15-34491b083352 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:52.781993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-755c244d-cd67-4913-bf15-34491b083352 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:52.782437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-755c244d-cd67-4913-bf15-34491b083352 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:53.096075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-755c244d-cd67-4913-bf15-34491b083352 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:53.108444 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-755c244d-cd67-4913-bf15-34491b083352 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.341712 Jan 22 21:19:53.109027 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3180/6082] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:52 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:53.420222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2ca2ba07-8a66-4e3d-b4b3-434b923bf84c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:53.421480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2ca2ba07-8a66-4e3d-b4b3-434b923bf84c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:53.429360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ca2ba07-8a66-4e3d-b4b3-434b923bf84c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:53.429931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ca2ba07-8a66-4e3d-b4b3-434b923bf84c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:53.430835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ca2ba07-8a66-4e3d-b4b3-434b923bf84c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:53.431341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ca2ba07-8a66-4e3d-b4b3-434b923bf84c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:53.481553 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2ca2ba07-8a66-4e3d-b4b3-434b923bf84c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 24534 microversion: 2.20 time: 0.067369 Jan 22 21:19:53.487163 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2903/6083] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:53 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 24534 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:53.553720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ca8a8e7c-ce8d-4de4-8c71-a2fe6a3c7624 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:53.556003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ca8a8e7c-ce8d-4de4-8c71-a2fe6a3c7624 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:53.563409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca8a8e7c-ce8d-4de4-8c71-a2fe6a3c7624 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:53.563863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca8a8e7c-ce8d-4de4-8c71-a2fe6a3c7624 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:53.564658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca8a8e7c-ce8d-4de4-8c71-a2fe6a3c7624 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:53.565295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca8a8e7c-ce8d-4de4-8c71-a2fe6a3c7624 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:53.609663 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ca8a8e7c-ce8d-4de4-8c71-a2fe6a3c7624 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.059454 Jan 22 21:19:53.613527 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3181/6084] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:53 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:53.631043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-42e9ce73-9b5b-4529-bde4-c4a80e53bdc9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:53.634964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-42e9ce73-9b5b-4529-bde4-c4a80e53bdc9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:53.640899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42e9ce73-9b5b-4529-bde4-c4a80e53bdc9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:53.641421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42e9ce73-9b5b-4529-bde4-c4a80e53bdc9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:53.642327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42e9ce73-9b5b-4529-bde4-c4a80e53bdc9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:53.642978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42e9ce73-9b5b-4529-bde4-c4a80e53bdc9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:53.692762 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-42e9ce73-9b5b-4529-bde4-c4a80e53bdc9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.065774 Jan 22 21:19:53.693448 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2904/6085] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:53 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:54.131285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dc3a3059-c7de-4a63-bdbc-137adb872355 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:54.131998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dc3a3059-c7de-4a63-bdbc-137adb872355 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:54.141517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc3a3059-c7de-4a63-bdbc-137adb872355 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:54.143401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc3a3059-c7de-4a63-bdbc-137adb872355 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:54.148431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc3a3059-c7de-4a63-bdbc-137adb872355 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:54.148999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc3a3059-c7de-4a63-bdbc-137adb872355 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:54.502733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4a2abf3f-bceb-43dc-a001-ce2ffe88804d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:54.505247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4a2abf3f-bceb-43dc-a001-ce2ffe88804d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:54.516496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a2abf3f-bceb-43dc-a001-ce2ffe88804d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:54.517012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a2abf3f-bceb-43dc-a001-ce2ffe88804d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:54.530098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dc3a3059-c7de-4a63-bdbc-137adb872355 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:54.534497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a2abf3f-bceb-43dc-a001-ce2ffe88804d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:54.535042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a2abf3f-bceb-43dc-a001-ce2ffe88804d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:54.541001 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dc3a3059-c7de-4a63-bdbc-137adb872355 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.416400 Jan 22 21:19:54.543920 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3182/6086] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:54 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:54.611945 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4a2abf3f-bceb-43dc-a001-ce2ffe88804d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.117121 Jan 22 21:19:54.612619 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2905/6087] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:54 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:54.621967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-819c01ee-d024-4f88-91d2-211e35c2bc26 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:54.627324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-819c01ee-d024-4f88-91d2-211e35c2bc26 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:54.629908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-819c01ee-d024-4f88-91d2-211e35c2bc26 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:54.630364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-819c01ee-d024-4f88-91d2-211e35c2bc26 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:54.631146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-819c01ee-d024-4f88-91d2-211e35c2bc26 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:54.631590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-819c01ee-d024-4f88-91d2-211e35c2bc26 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:54.680051 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-819c01ee-d024-4f88-91d2-211e35c2bc26 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.062253 Jan 22 21:19:54.680711 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3183/6088] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:54 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:54.706591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6e40b6dd-3878-4f61-9330-3eeb460cea0c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:54.708187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6e40b6dd-3878-4f61-9330-3eeb460cea0c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:54.719697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e40b6dd-3878-4f61-9330-3eeb460cea0c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:54.720159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e40b6dd-3878-4f61-9330-3eeb460cea0c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:54.720963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e40b6dd-3878-4f61-9330-3eeb460cea0c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:54.721399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e40b6dd-3878-4f61-9330-3eeb460cea0c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:54.771762 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6e40b6dd-3878-4f61-9330-3eeb460cea0c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.070033 Jan 22 21:19:54.773351 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2906/6089] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:54 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:55.561540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9675720a-ed12-4721-8bbc-669eb7c69ed2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:55.562804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9675720a-ed12-4721-8bbc-669eb7c69ed2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:55.570109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9675720a-ed12-4721-8bbc-669eb7c69ed2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:55.570637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9675720a-ed12-4721-8bbc-669eb7c69ed2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:55.571497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9675720a-ed12-4721-8bbc-669eb7c69ed2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:55.572079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9675720a-ed12-4721-8bbc-669eb7c69ed2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:55.623490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-16c991bb-8ee9-4414-9a0c-661f18086b71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:55.624681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-16c991bb-8ee9-4414-9a0c-661f18086b71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:55.632107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16c991bb-8ee9-4414-9a0c-661f18086b71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:55.632555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16c991bb-8ee9-4414-9a0c-661f18086b71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:55.633338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16c991bb-8ee9-4414-9a0c-661f18086b71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:55.633802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16c991bb-8ee9-4414-9a0c-661f18086b71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:55.689101 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-16c991bb-8ee9-4414-9a0c-661f18086b71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.069598 Jan 22 21:19:55.690490 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2907/6090] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:55 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:19:55.694872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fcee46c7-8eac-4f4f-a33a-70eed2b81845 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:55.695874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fcee46c7-8eac-4f4f-a33a-70eed2b81845 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:55.703817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcee46c7-8eac-4f4f-a33a-70eed2b81845 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:55.704563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcee46c7-8eac-4f4f-a33a-70eed2b81845 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:55.705745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcee46c7-8eac-4f4f-a33a-70eed2b81845 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:55.706197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcee46c7-8eac-4f4f-a33a-70eed2b81845 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:55.754919 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fcee46c7-8eac-4f4f-a33a-70eed2b81845 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.063617 Jan 22 21:19:55.755620 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2908/6091] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:55 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:55.783215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9675720a-ed12-4721-8bbc-669eb7c69ed2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:55.784097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-82287ecf-7d8b-4339-b556-f937ccff1f85 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:55.785097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-82287ecf-7d8b-4339-b556-f937ccff1f85 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:55.793482 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9675720a-ed12-4721-8bbc-669eb7c69ed2 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.236946 Jan 22 21:19:55.794350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82287ecf-7d8b-4339-b556-f937ccff1f85 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:55.796758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82287ecf-7d8b-4339-b556-f937ccff1f85 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:55.796758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82287ecf-7d8b-4339-b556-f937ccff1f85 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:55.796758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82287ecf-7d8b-4339-b556-f937ccff1f85 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:55.797893 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3184/6092] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:55 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:55.843370 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-82287ecf-7d8b-4339-b556-f937ccff1f85 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.063190 Jan 22 21:19:55.844236 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2909/6093] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:55 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:19:56.145547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e15b9a68-b956-465c-bc34-95739dd467fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:56.146067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e15b9a68-b956-465c-bc34-95739dd467fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:56.159885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e15b9a68-b956-465c-bc34-95739dd467fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:56.161393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e15b9a68-b956-465c-bc34-95739dd467fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:56.162303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e15b9a68-b956-465c-bc34-95739dd467fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:56.163059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e15b9a68-b956-465c-bc34-95739dd467fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:56.189253 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-e15b9a68-b956-465c-bc34-95739dd467fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] HTTP exception thrown: Instance 3b3e8847-08c7-4122-914b-d4650821edcc could not be found. Jan 22 21:19:56.190675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e15b9a68-b956-465c-bc34-95739dd467fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Returning 404 to user: Instance 3b3e8847-08c7-4122-914b-d4650821edcc could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:56.191629 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e15b9a68-b956-465c-bc34-95739dd467fc tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "DELETE /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 404 len: 111 microversion: 2.1 time: 0.049922 Jan 22 21:19:56.193177 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3185/6094] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:19:56 2022] DELETE /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:56.202272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c52f8886-aa04-415b-9064-171e7e43bd0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:56.203405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c52f8886-aa04-415b-9064-171e7e43bd0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] [instance: 3b3e8847-08c7-4122-914b-d4650821edcc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:56.211669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c52f8886-aa04-415b-9064-171e7e43bd0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:56.214246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c52f8886-aa04-415b-9064-171e7e43bd0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:56.214246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c52f8886-aa04-415b-9064-171e7e43bd0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:56.214750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c52f8886-aa04-415b-9064-171e7e43bd0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:56.244606 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-c52f8886-aa04-415b-9064-171e7e43bd0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] HTTP exception thrown: Instance 3b3e8847-08c7-4122-914b-d4650821edcc could not be found. Jan 22 21:19:56.246372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c52f8886-aa04-415b-9064-171e7e43bd0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] Returning 404 to user: Instance 3b3e8847-08c7-4122-914b-d4650821edcc could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:19:56.247566 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c52f8886-aa04-415b-9064-171e7e43bd0e tempest-AttachVolumeTestJSON-815334161 tempest-AttachVolumeTestJSON-815334161-project] 10.222.0.100 "GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc" status: 404 len: 111 microversion: 2.1 time: 0.050353 Jan 22 21:19:56.248726 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2910/6095] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:56 2022] GET /compute/v2.1/servers/3b3e8847-08c7-4122-914b-d4650821edcc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:19:56.702829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7a783a1c-f642-4c25-8cb2-b0750b240009 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:56.704604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7a783a1c-f642-4c25-8cb2-b0750b240009 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:56.711876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a783a1c-f642-4c25-8cb2-b0750b240009 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:56.713739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a783a1c-f642-4c25-8cb2-b0750b240009 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:56.713739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a783a1c-f642-4c25-8cb2-b0750b240009 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:56.713739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a783a1c-f642-4c25-8cb2-b0750b240009 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:56.767479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-56999381-1916-4cc8-bda5-15349dbfa5d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:56.768467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-56999381-1916-4cc8-bda5-15349dbfa5d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:56.779666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56999381-1916-4cc8-bda5-15349dbfa5d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:56.780441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56999381-1916-4cc8-bda5-15349dbfa5d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:56.781694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56999381-1916-4cc8-bda5-15349dbfa5d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:56.786376 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7a783a1c-f642-4c25-8cb2-b0750b240009 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.083139 Jan 22 21:19:56.786860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56999381-1916-4cc8-bda5-15349dbfa5d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:56.787408 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3186/6096] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:56 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:56.812120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-081c42e9-0f3f-4547-bc3b-3026a97339bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:56.813362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-081c42e9-0f3f-4547-bc3b-3026a97339bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:56.829986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-081c42e9-0f3f-4547-bc3b-3026a97339bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:56.830614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-081c42e9-0f3f-4547-bc3b-3026a97339bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:56.831548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-081c42e9-0f3f-4547-bc3b-3026a97339bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:56.832090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-081c42e9-0f3f-4547-bc3b-3026a97339bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:56.855931 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-56999381-1916-4cc8-bda5-15349dbfa5d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.091805 Jan 22 21:19:56.856562 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2911/6097] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:56 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:56.866771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-db0311fe-b96b-4331-91e8-50f44aef699e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:56.868119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-db0311fe-b96b-4331-91e8-50f44aef699e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:56.876284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db0311fe-b96b-4331-91e8-50f44aef699e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:56.877007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db0311fe-b96b-4331-91e8-50f44aef699e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:56.878021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db0311fe-b96b-4331-91e8-50f44aef699e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:56.878635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db0311fe-b96b-4331-91e8-50f44aef699e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:56.924928 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-db0311fe-b96b-4331-91e8-50f44aef699e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.066753 Jan 22 21:19:56.925626 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2912/6098] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:56 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:57.020732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-081c42e9-0f3f-4547-bc3b-3026a97339bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:57.029194 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-081c42e9-0f3f-4547-bc3b-3026a97339bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.222368 Jan 22 21:19:57.029892 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3187/6099] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:56 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:19:57.796418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-af8d6dee-a341-4a58-962c-3e3bbd65b4a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:57.802263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-af8d6dee-a341-4a58-962c-3e3bbd65b4a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:57.805912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af8d6dee-a341-4a58-962c-3e3bbd65b4a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:57.806584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af8d6dee-a341-4a58-962c-3e3bbd65b4a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:57.808753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af8d6dee-a341-4a58-962c-3e3bbd65b4a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:57.809813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af8d6dee-a341-4a58-962c-3e3bbd65b4a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:57.862676 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-af8d6dee-a341-4a58-962c-3e3bbd65b4a2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.069537 Jan 22 21:19:57.870706 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2913/6100] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:57 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:57.879732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-89704a6c-2d4e-4ceb-8ebf-385bb14acc72 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:57.882174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-89704a6c-2d4e-4ceb-8ebf-385bb14acc72 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:57.897954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89704a6c-2d4e-4ceb-8ebf-385bb14acc72 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:57.898627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89704a6c-2d4e-4ceb-8ebf-385bb14acc72 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:57.900002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89704a6c-2d4e-4ceb-8ebf-385bb14acc72 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:57.900800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89704a6c-2d4e-4ceb-8ebf-385bb14acc72 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:57.942214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-438fd74f-3b15-4e6c-8cc7-d764cfc3093e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:57.943852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-438fd74f-3b15-4e6c-8cc7-d764cfc3093e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:57.953136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-438fd74f-3b15-4e6c-8cc7-d764cfc3093e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:57.953625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-438fd74f-3b15-4e6c-8cc7-d764cfc3093e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:57.954500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-438fd74f-3b15-4e6c-8cc7-d764cfc3093e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:57.954950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-438fd74f-3b15-4e6c-8cc7-d764cfc3093e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:57.973496 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-89704a6c-2d4e-4ceb-8ebf-385bb14acc72 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.102142 Jan 22 21:19:57.977576 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3188/6101] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:57 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:58.048638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74634590-3ce0-4a5a-a2ca-53fc08b08c96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:58.049578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-74634590-3ce0-4a5a-a2ca-53fc08b08c96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:58.068579 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-438fd74f-3b15-4e6c-8cc7-d764cfc3093e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.131715 Jan 22 21:19:58.074566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74634590-3ce0-4a5a-a2ca-53fc08b08c96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:58.074566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74634590-3ce0-4a5a-a2ca-53fc08b08c96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:58.074566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74634590-3ce0-4a5a-a2ca-53fc08b08c96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:58.074566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74634590-3ce0-4a5a-a2ca-53fc08b08c96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:58.089166 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2914/6102] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:57 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:58.737215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-74634590-3ce0-4a5a-a2ca-53fc08b08c96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:19:58.754019 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-74634590-3ce0-4a5a-a2ca-53fc08b08c96 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.710995 Jan 22 21:19:58.758499 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3189/6103] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:58 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:19:58.887058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a3392023-7b00-4668-9ad5-cb8adc925765 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:58.892293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a3392023-7b00-4668-9ad5-cb8adc925765 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:58.901160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3392023-7b00-4668-9ad5-cb8adc925765 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:58.902037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3392023-7b00-4668-9ad5-cb8adc925765 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:58.904085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3392023-7b00-4668-9ad5-cb8adc925765 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:58.904759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3392023-7b00-4668-9ad5-cb8adc925765 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:58.960448 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a3392023-7b00-4668-9ad5-cb8adc925765 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.085713 Jan 22 21:19:58.969751 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2915/6104] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:58 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:58.991078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-32a1ab76-21cb-4b83-afc9-d561f0e303a5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:58.992014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-32a1ab76-21cb-4b83-afc9-d561f0e303a5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:59.006877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32a1ab76-21cb-4b83-afc9-d561f0e303a5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:59.007714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32a1ab76-21cb-4b83-afc9-d561f0e303a5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:59.012798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32a1ab76-21cb-4b83-afc9-d561f0e303a5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:59.012798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32a1ab76-21cb-4b83-afc9-d561f0e303a5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:59.064039 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-32a1ab76-21cb-4b83-afc9-d561f0e303a5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.076286 Jan 22 21:19:59.066219 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3190/6105] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:19:58 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:19:59.081360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-872159a2-cd36-4c86-a377-a55d50fe58a4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:19:59.081895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-872159a2-cd36-4c86-a377-a55d50fe58a4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:59.089841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-872159a2-cd36-4c86-a377-a55d50fe58a4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:59.090301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-872159a2-cd36-4c86-a377-a55d50fe58a4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:59.091113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-872159a2-cd36-4c86-a377-a55d50fe58a4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:59.091554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-872159a2-cd36-4c86-a377-a55d50fe58a4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:59.156770 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-872159a2-cd36-4c86-a377-a55d50fe58a4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.079840 Jan 22 21:19:59.161141 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2916/6106] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:19:59 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:19:59.773490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f78753d5-488e-48cf-a3c0-d46e44e8cf60 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:59.774029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f78753d5-488e-48cf-a3c0-d46e44e8cf60 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:59.782218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f78753d5-488e-48cf-a3c0-d46e44e8cf60 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:59.782675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f78753d5-488e-48cf-a3c0-d46e44e8cf60 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:59.783618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f78753d5-488e-48cf-a3c0-d46e44e8cf60 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:59.784183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f78753d5-488e-48cf-a3c0-d46e44e8cf60 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:59.976507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1f131913-63b5-4ad7-9c38-ca3bc0df64bc tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:19:59.980314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1f131913-63b5-4ad7-9c38-ca3bc0df64bc tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:19:59.987564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f131913-63b5-4ad7-9c38-ca3bc0df64bc tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:59.988671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f131913-63b5-4ad7-9c38-ca3bc0df64bc tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:19:59.989841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f131913-63b5-4ad7-9c38-ca3bc0df64bc tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:19:59.990355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f131913-63b5-4ad7-9c38-ca3bc0df64bc tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:00.031071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f78753d5-488e-48cf-a3c0-d46e44e8cf60 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:00.038870 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f78753d5-488e-48cf-a3c0-d46e44e8cf60 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.270627 Jan 22 21:20:00.042621 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3191/6107] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:59 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:00.053271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a9a12b66-3208-4aa8-a320-763d289e3981 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:00.054366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a9a12b66-3208-4aa8-a320-763d289e3981 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:00.067999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9a12b66-3208-4aa8-a320-763d289e3981 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:00.071777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9a12b66-3208-4aa8-a320-763d289e3981 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:00.073941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9a12b66-3208-4aa8-a320-763d289e3981 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:00.074407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9a12b66-3208-4aa8-a320-763d289e3981 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:00.134789 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a9a12b66-3208-4aa8-a320-763d289e3981 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.089987 Jan 22 21:20:00.136446 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3192/6108] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:00 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:00.149343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5518b582-0a13-42f2-bfab-d3d6fac10ed6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:00.151907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5518b582-0a13-42f2-bfab-d3d6fac10ed6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:00.164776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5518b582-0a13-42f2-bfab-d3d6fac10ed6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:00.167408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5518b582-0a13-42f2-bfab-d3d6fac10ed6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:00.168595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5518b582-0a13-42f2-bfab-d3d6fac10ed6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:00.169264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5518b582-0a13-42f2-bfab-d3d6fac10ed6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:00.234608 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5518b582-0a13-42f2-bfab-d3d6fac10ed6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.091550 Jan 22 21:20:00.235341 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3193/6109] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:00 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:00.241113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d505be7a-a772-4d3e-9719-7947f43d8040 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:00.242498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d505be7a-a772-4d3e-9719-7947f43d8040 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:00.250046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d505be7a-a772-4d3e-9719-7947f43d8040 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:00.251588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d505be7a-a772-4d3e-9719-7947f43d8040 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:00.252658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d505be7a-a772-4d3e-9719-7947f43d8040 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:00.253115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d505be7a-a772-4d3e-9719-7947f43d8040 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:00.323567 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d505be7a-a772-4d3e-9719-7947f43d8040 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.085889 Jan 22 21:20:00.326369 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3194/6110] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:00 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:00.404575 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1f131913-63b5-4ad7-9c38-ca3bc0df64bc tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1837 microversion: 2.1 time: 0.435726 Jan 22 21:20:00.405098 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2917/6111] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:19:59 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1837 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:20:00.421782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fd1895ea-53cf-4841-9ccd-6a96c3e63800 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:00.422489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fd1895ea-53cf-4841-9ccd-6a96c3e63800 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:00.429326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd1895ea-53cf-4841-9ccd-6a96c3e63800 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:00.429820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd1895ea-53cf-4841-9ccd-6a96c3e63800 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:00.430610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd1895ea-53cf-4841-9ccd-6a96c3e63800 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:00.431056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd1895ea-53cf-4841-9ccd-6a96c3e63800 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:00.732789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fd1895ea-53cf-4841-9ccd-6a96c3e63800 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:00.743210 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fd1895ea-53cf-4841-9ccd-6a96c3e63800 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1686 microversion: 2.1 time: 0.325575 Jan 22 21:20:00.743812 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3195/6112] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:00 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1686 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:20:00.993302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2ed1f53b-85c8-4a52-83c7-462349170de6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:00.995562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2ed1f53b-85c8-4a52-83c7-462349170de6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:01.004309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ed1f53b-85c8-4a52-83c7-462349170de6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:01.004960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ed1f53b-85c8-4a52-83c7-462349170de6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:01.006075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ed1f53b-85c8-4a52-83c7-462349170de6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:01.006635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ed1f53b-85c8-4a52-83c7-462349170de6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:01.056540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f921e5ed-a4c5-41a2-b0b2-f4aabbf50740 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:01.060629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f921e5ed-a4c5-41a2-b0b2-f4aabbf50740 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:01.066297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f921e5ed-a4c5-41a2-b0b2-f4aabbf50740 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:01.069006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f921e5ed-a4c5-41a2-b0b2-f4aabbf50740 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:01.070180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f921e5ed-a4c5-41a2-b0b2-f4aabbf50740 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:01.070888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f921e5ed-a4c5-41a2-b0b2-f4aabbf50740 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:01.086915 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2ed1f53b-85c8-4a52-83c7-462349170de6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7/action" status: 200 len: 32629 microversion: 2.1 time: 0.098607 Jan 22 21:20:01.089873 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2918/6113] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:00 2022] POST /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7/action => generated 32629 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:01.148366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-778d81a5-abbb-4ea3-971c-b9d66bedb7f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:01.150369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-778d81a5-abbb-4ea3-971c-b9d66bedb7f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:01.157604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-778d81a5-abbb-4ea3-971c-b9d66bedb7f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:01.158143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-778d81a5-abbb-4ea3-971c-b9d66bedb7f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:01.159236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-778d81a5-abbb-4ea3-971c-b9d66bedb7f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:01.159843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-778d81a5-abbb-4ea3-971c-b9d66bedb7f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:01.210254 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-778d81a5-abbb-4ea3-971c-b9d66bedb7f7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.065987 Jan 22 21:20:01.211706 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2919/6114] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:01 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:01.255023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cd8be40c-ac41-4493-b79a-884d579749be tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:01.256158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cd8be40c-ac41-4493-b79a-884d579749be tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:01.264974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd8be40c-ac41-4493-b79a-884d579749be tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:01.265427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd8be40c-ac41-4493-b79a-884d579749be tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:01.276504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd8be40c-ac41-4493-b79a-884d579749be tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:01.276504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd8be40c-ac41-4493-b79a-884d579749be tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:01.316699 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cd8be40c-ac41-4493-b79a-884d579749be tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.070820 Jan 22 21:20:01.320862 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2920/6115] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:01 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:01.325546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-81e63481-10ca-4c64-bd28-e9fc34ab6b78 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:01.326212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-81e63481-10ca-4c64-bd28-e9fc34ab6b78 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:01.334603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81e63481-10ca-4c64-bd28-e9fc34ab6b78 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:01.335062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81e63481-10ca-4c64-bd28-e9fc34ab6b78 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:01.335932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81e63481-10ca-4c64-bd28-e9fc34ab6b78 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:01.336690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81e63481-10ca-4c64-bd28-e9fc34ab6b78 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:01.350823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f921e5ed-a4c5-41a2-b0b2-f4aabbf50740 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:01.376970 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f921e5ed-a4c5-41a2-b0b2-f4aabbf50740 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.311225 Jan 22 21:20:01.376970 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3196/6116] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:01 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:01.376970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4bf8e8c1-c566-4847-877f-8b37b176e843 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:01.376970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4bf8e8c1-c566-4847-877f-8b37b176e843 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:01.388032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bf8e8c1-c566-4847-877f-8b37b176e843 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:01.388417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bf8e8c1-c566-4847-877f-8b37b176e843 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:01.390455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bf8e8c1-c566-4847-877f-8b37b176e843 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:01.391308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bf8e8c1-c566-4847-877f-8b37b176e843 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:01.401089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-81e63481-10ca-4c64-bd28-e9fc34ab6b78 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '98251eaa4d0c423d8cc89e9e94960b11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee8a2d1cf924036b1c35d2972d42163', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:01.402904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-81e63481-10ca-4c64-bd28-e9fc34ab6b78 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] flavor_id is None. Assuming migration. {{(pid=137033) resize /opt/stack/nova/nova/compute/api.py:4073}} Jan 22 21:20:01.413999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-81e63481-10ca-4c64-bd28-e9fc34ab6b78 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137033) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 21:20:01.437199 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4bf8e8c1-c566-4847-877f-8b37b176e843 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.071661 Jan 22 21:20:01.441152 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3197/6117] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:01 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:01.839044 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-81e63481-10ca-4c64-bd28-e9fc34ab6b78 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7/action" status: 202 len: 0 microversion: 2.1 time: 0.517886 Jan 22 21:20:01.839791 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2921/6118] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:01 2022] POST /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:01.849309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a5d784b-1a2b-4aef-97e0-8b4d7d8d7906 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:01.855379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a5d784b-1a2b-4aef-97e0-8b4d7d8d7906 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:01.864582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a5d784b-1a2b-4aef-97e0-8b4d7d8d7906 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:01.866189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a5d784b-1a2b-4aef-97e0-8b4d7d8d7906 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:01.867471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a5d784b-1a2b-4aef-97e0-8b4d7d8d7906 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:01.868440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a5d784b-1a2b-4aef-97e0-8b4d7d8d7906 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:02.032960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6a5d784b-1a2b-4aef-97e0-8b4d7d8d7906 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:02.043939 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a5d784b-1a2b-4aef-97e0-8b4d7d8d7906 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1695 microversion: 2.1 time: 0.199161 Jan 22 21:20:02.050001 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3198/6119] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:01 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1695 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:02.225846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-88e9869a-2dd2-407b-a7b7-9db24353b95d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:02.226862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-88e9869a-2dd2-407b-a7b7-9db24353b95d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:02.239269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88e9869a-2dd2-407b-a7b7-9db24353b95d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:02.254422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88e9869a-2dd2-407b-a7b7-9db24353b95d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:02.255300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88e9869a-2dd2-407b-a7b7-9db24353b95d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:02.255754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88e9869a-2dd2-407b-a7b7-9db24353b95d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:02.319107 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-88e9869a-2dd2-407b-a7b7-9db24353b95d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.098123 Jan 22 21:20:02.320980 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2922/6120] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:02 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:02.330149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-422b895d-21e1-4af4-a600-b73806e35960 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:02.331433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-422b895d-21e1-4af4-a600-b73806e35960 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:02.339293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-422b895d-21e1-4af4-a600-b73806e35960 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:02.339772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-422b895d-21e1-4af4-a600-b73806e35960 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:02.340578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-422b895d-21e1-4af4-a600-b73806e35960 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:02.341791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-422b895d-21e1-4af4-a600-b73806e35960 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:02.394899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-81c6ecf1-6c65-45e0-b47d-9f2ec4e80ff7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:02.395621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-81c6ecf1-6c65-45e0-b47d-9f2ec4e80ff7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:02.396819 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-422b895d-21e1-4af4-a600-b73806e35960 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.070777 Jan 22 21:20:02.401816 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3199/6121] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:02 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:02.408933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81c6ecf1-6c65-45e0-b47d-9f2ec4e80ff7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:02.409811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81c6ecf1-6c65-45e0-b47d-9f2ec4e80ff7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:02.411656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81c6ecf1-6c65-45e0-b47d-9f2ec4e80ff7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:02.412915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81c6ecf1-6c65-45e0-b47d-9f2ec4e80ff7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:02.450307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2c4ca4f4-0061-4648-a065-6678f6bc71aa tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:02.451602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2c4ca4f4-0061-4648-a065-6678f6bc71aa tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:02.461187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c4ca4f4-0061-4648-a065-6678f6bc71aa tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:02.465089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c4ca4f4-0061-4648-a065-6678f6bc71aa tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:02.469689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c4ca4f4-0061-4648-a065-6678f6bc71aa tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:02.470213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c4ca4f4-0061-4648-a065-6678f6bc71aa tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:02.557132 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2c4ca4f4-0061-4648-a065-6678f6bc71aa tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.109322 Jan 22 21:20:02.559401 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3200/6122] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:02 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:20:02.719638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-81c6ecf1-6c65-45e0-b47d-9f2ec4e80ff7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:02.729767 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-81c6ecf1-6c65-45e0-b47d-9f2ec4e80ff7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.347836 Jan 22 21:20:02.738062 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2923/6123] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:02 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:20:03.062679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-29f70381-7f8f-4202-b24c-4fafe0c41e8c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:03.063563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-29f70381-7f8f-4202-b24c-4fafe0c41e8c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:03.082611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29f70381-7f8f-4202-b24c-4fafe0c41e8c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:03.083405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29f70381-7f8f-4202-b24c-4fafe0c41e8c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:03.089169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29f70381-7f8f-4202-b24c-4fafe0c41e8c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:03.089169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29f70381-7f8f-4202-b24c-4fafe0c41e8c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:03.338086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d13bcd50-fa1a-429a-8fd3-7dac643b4945 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:03.340374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d13bcd50-fa1a-429a-8fd3-7dac643b4945 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:03.365079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d13bcd50-fa1a-429a-8fd3-7dac643b4945 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:03.367260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d13bcd50-fa1a-429a-8fd3-7dac643b4945 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:03.368777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d13bcd50-fa1a-429a-8fd3-7dac643b4945 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:03.369945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d13bcd50-fa1a-429a-8fd3-7dac643b4945 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:03.445586 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d13bcd50-fa1a-429a-8fd3-7dac643b4945 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.115634 Jan 22 21:20:03.447354 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2924/6124] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:03 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:03.454305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-80cfe7ce-56a8-4d70-bed7-50431d9fa8a8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:03.456008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-80cfe7ce-56a8-4d70-bed7-50431d9fa8a8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:03.465719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80cfe7ce-56a8-4d70-bed7-50431d9fa8a8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:03.466249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80cfe7ce-56a8-4d70-bed7-50431d9fa8a8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:03.467124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80cfe7ce-56a8-4d70-bed7-50431d9fa8a8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:03.467894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80cfe7ce-56a8-4d70-bed7-50431d9fa8a8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:03.504601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-29f70381-7f8f-4202-b24c-4fafe0c41e8c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:03.531987 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-29f70381-7f8f-4202-b24c-4fafe0c41e8c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1695 microversion: 2.1 time: 0.455503 Jan 22 21:20:03.533024 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3201/6125] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:03 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1695 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:03.570057 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-80cfe7ce-56a8-4d70-bed7-50431d9fa8a8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.119995 Jan 22 21:20:03.576566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e2c766c-3ba9-414c-82f7-88ca54401b25 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:03.576753 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2925/6126] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:03 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:03.576885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e2c766c-3ba9-414c-82f7-88ca54401b25 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:03.592223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e2c766c-3ba9-414c-82f7-88ca54401b25 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:03.593120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e2c766c-3ba9-414c-82f7-88ca54401b25 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:03.600374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e2c766c-3ba9-414c-82f7-88ca54401b25 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:03.600374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e2c766c-3ba9-414c-82f7-88ca54401b25 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:03.673734 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e2c766c-3ba9-414c-82f7-88ca54401b25 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.106051 Jan 22 21:20:03.676756 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3202/6127] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:03 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:03.748793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-439120b2-bd93-410f-b0f4-864252cd6ecb tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:03.750173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-439120b2-bd93-410f-b0f4-864252cd6ecb tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:03.767542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-439120b2-bd93-410f-b0f4-864252cd6ecb tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:03.770067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-439120b2-bd93-410f-b0f4-864252cd6ecb tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:03.771098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-439120b2-bd93-410f-b0f4-864252cd6ecb tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:03.774857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-439120b2-bd93-410f-b0f4-864252cd6ecb tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:04.126431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-439120b2-bd93-410f-b0f4-864252cd6ecb tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:04.134736 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-439120b2-bd93-410f-b0f4-864252cd6ecb tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.391294 Jan 22 21:20:04.136239 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2926/6128] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:03 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:04.465114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-57b1faa6-ad3f-4d23-ae84-6eeff2e5b482 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:04.466679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-57b1faa6-ad3f-4d23-ae84-6eeff2e5b482 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:04.479203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57b1faa6-ad3f-4d23-ae84-6eeff2e5b482 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:04.479663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57b1faa6-ad3f-4d23-ae84-6eeff2e5b482 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:04.480476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57b1faa6-ad3f-4d23-ae84-6eeff2e5b482 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:04.481010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57b1faa6-ad3f-4d23-ae84-6eeff2e5b482 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:04.533405 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-57b1faa6-ad3f-4d23-ae84-6eeff2e5b482 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.072243 Jan 22 21:20:04.537481 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3203/6129] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:04 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:04.550347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6ef73002-057e-4060-b75a-cc95e603b0a5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:04.551163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6ef73002-057e-4060-b75a-cc95e603b0a5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:04.564019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ef73002-057e-4060-b75a-cc95e603b0a5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:04.564719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ef73002-057e-4060-b75a-cc95e603b0a5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:04.565729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ef73002-057e-4060-b75a-cc95e603b0a5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:04.567347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ef73002-057e-4060-b75a-cc95e603b0a5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:04.585456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d1924cfe-745e-4cf9-a5f7-8fc33da150dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:04.589840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d1924cfe-745e-4cf9-a5f7-8fc33da150dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:04.623417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1924cfe-745e-4cf9-a5f7-8fc33da150dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:04.623989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1924cfe-745e-4cf9-a5f7-8fc33da150dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:04.625151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1924cfe-745e-4cf9-a5f7-8fc33da150dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:04.625771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1924cfe-745e-4cf9-a5f7-8fc33da150dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:04.683748 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d1924cfe-745e-4cf9-a5f7-8fc33da150dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.104021 Jan 22 21:20:04.687794 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3204/6130] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:04 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:04.827960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19f96ec2-1b8c-4c0e-a72c-14433ba01758 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] Action: 'create', calling method: .version_select at 0x7f1ed4fae5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1042045614", "metadata": {"Type": "work"}}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:04.829373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19f96ec2-1b8c-4c0e-a72c-14433ba01758 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:20:04.830313 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19f96ec2-1b8c-4c0e-a72c-14433ba01758 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.144825 Jan 22 21:20:04.831066 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3205/6131] 10.222.0.100 () {60 vars in 1160 bytes} [Sat Jan 22 21:20:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:20:04.840810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5a8beed5-fcf7-4e04-8f88-e8898db8d1d9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:04.841941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5a8beed5-fcf7-4e04-8f88-e8898db8d1d9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:04.849036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a8beed5-fcf7-4e04-8f88-e8898db8d1d9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:04.849738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a8beed5-fcf7-4e04-8f88-e8898db8d1d9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:04.850651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a8beed5-fcf7-4e04-8f88-e8898db8d1d9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:04.851192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a8beed5-fcf7-4e04-8f88-e8898db8d1d9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:04.909793 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5a8beed5-fcf7-4e04-8f88-e8898db8d1d9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.074272 Jan 22 21:20:04.913876 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3206/6132] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:04 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:04.919286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2f6af9eb-a930-44af-b736-f9fadbae5928 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] Action: 'create', calling method: .version_select at 0x7f1ed4f3f940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-575625862", "metadata": {"Type": "work"}}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:04.920601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2f6af9eb-a930-44af-b736-f9fadbae5928 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:20:04.921640 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2f6af9eb-a930-44af-b736-f9fadbae5928 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008806 Jan 22 21:20:04.922244 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3207/6133] 10.222.0.100 () {60 vars in 1160 bytes} [Sat Jan 22 21:20:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:20:04.934349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-88fa74f6-3bf3-4f6a-9f80-9652c1f7fa36 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] Action: 'create', calling method: .version_select at 0x7f1ed4faeaf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-667179934", "metadata": {"Type": "work"}}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:04.935520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-88fa74f6-3bf3-4f6a-9f80-9652c1f7fa36 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:20:04.936334 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-88fa74f6-3bf3-4f6a-9f80-9652c1f7fa36 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007892 Jan 22 21:20:04.936872 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3208/6134] 10.222.0.100 () {60 vars in 1160 bytes} [Sat Jan 22 21:20:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:20:04.950567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fe7de45f-7665-4d69-88a9-31d14d8fd422 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] Calling method '.version_select at 0x7f1ed58ba3a0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:04.982276 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-fe7de45f-7665-4d69-88a9-31d14d8fd422 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] HTTP exception thrown: Volume tempest-invalid-20673593 could not be found. Jan 22 21:20:04.982892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fe7de45f-7665-4d69-88a9-31d14d8fd422 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] Returning 404 to user: Volume tempest-invalid-20673593 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:20:04.983932 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fe7de45f-7665-4d69-88a9-31d14d8fd422 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/tempest-invalid-20673593" status: 404 len: 97 microversion: 2.1 time: 0.038808 Jan 22 21:20:04.989988 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3209/6135] 10.222.0.100 () {58 vars in 1216 bytes} [Sat Jan 22 21:20:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-20673593 => generated 97 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:20:04.997569 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-55884069-6d23-4f71-8078-08361424657b tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005280 Jan 22 21:20:04.998091 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3210/6136] 10.222.0.100 () {58 vars in 1144 bytes} [Sat Jan 22 21:20:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 22 21:20:05.010868 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-697c090b-f21f-44f8-a2d9-950b4662def0 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004080 Jan 22 21:20:05.011477 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3211/6137] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:20:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 22 21:20:05.021860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d6a6f14c-ec74-41d8-9589-560513fbb73a tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] Calling method '.version_select at 0x7f1ed4fa9af0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:05.054697 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-d6a6f14c-ec74-41d8-9589-560513fbb73a tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] HTTP exception thrown: Volume 0403f436-8620-4e7b-ba66-ca2a0092029c could not be found. Jan 22 21:20:05.055325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d6a6f14c-ec74-41d8-9589-560513fbb73a tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] Returning 404 to user: Volume 0403f436-8620-4e7b-ba66-ca2a0092029c could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:20:05.056205 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d6a6f14c-ec74-41d8-9589-560513fbb73a tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/0403f436-8620-4e7b-ba66-ca2a0092029c" status: 404 len: 109 microversion: 2.1 time: 0.039157 Jan 22 21:20:05.057404 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3212/6138] 10.222.0.100 () {58 vars in 1252 bytes} [Sat Jan 22 21:20:05 2022] DELETE /compute/v2.1/os-volumes/0403f436-8620-4e7b-ba66-ca2a0092029c => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:20:05.066732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3fb1ff95-8e86-4c70-88bf-57b58222d575 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] Calling method '.version_select at 0x7f1ed5855ca0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:05.094277 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-3fb1ff95-8e86-4c70-88bf-57b58222d575 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] HTTP exception thrown: Volume a643fb26-f227-4fbd-9c68-a325e2b70c2b could not be found. Jan 22 21:20:05.094967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3fb1ff95-8e86-4c70-88bf-57b58222d575 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] Returning 404 to user: Volume a643fb26-f227-4fbd-9c68-a325e2b70c2b could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:20:05.096424 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3fb1ff95-8e86-4c70-88bf-57b58222d575 tempest-VolumesNegativeTest-710476183 tempest-VolumesNegativeTest-710476183-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/a643fb26-f227-4fbd-9c68-a325e2b70c2b" status: 404 len: 109 microversion: 2.1 time: 0.032712 Jan 22 21:20:05.097163 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3213/6139] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:20:05 2022] GET /compute/v2.1/os-volumes/a643fb26-f227-4fbd-9c68-a325e2b70c2b => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:20:05.154575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61fcec74-75f0-435e-9314-fffa0bf49615 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:05.155686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-61fcec74-75f0-435e-9314-fffa0bf49615 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:05.163231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61fcec74-75f0-435e-9314-fffa0bf49615 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:05.163947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61fcec74-75f0-435e-9314-fffa0bf49615 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:05.164861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61fcec74-75f0-435e-9314-fffa0bf49615 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:05.165414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61fcec74-75f0-435e-9314-fffa0bf49615 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:05.172086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6ef73002-057e-4060-b75a-cc95e603b0a5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:05.182284 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6ef73002-057e-4060-b75a-cc95e603b0a5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1695 microversion: 2.1 time: 0.634219 Jan 22 21:20:05.204998 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2927/6140] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:04 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1695 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:20:05.383535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-61fcec74-75f0-435e-9314-fffa0bf49615 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:05.392922 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61fcec74-75f0-435e-9314-fffa0bf49615 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.244155 Jan 22 21:20:05.393778 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3214/6141] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:05 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:05.545035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-efdde744-6818-40f5-8758-62f4fb663f39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:05.546078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-efdde744-6818-40f5-8758-62f4fb663f39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:05.552259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efdde744-6818-40f5-8758-62f4fb663f39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:05.552850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efdde744-6818-40f5-8758-62f4fb663f39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:05.553545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efdde744-6818-40f5-8758-62f4fb663f39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:05.554048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efdde744-6818-40f5-8758-62f4fb663f39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:05.604801 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-efdde744-6818-40f5-8758-62f4fb663f39 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.063633 Jan 22 21:20:05.605756 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2928/6142] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:05 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:05.695439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-27606c52-27df-4efb-b1d2-c669df9703b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:05.697304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-27606c52-27df-4efb-b1d2-c669df9703b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:05.731141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27606c52-27df-4efb-b1d2-c669df9703b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:05.731610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27606c52-27df-4efb-b1d2-c669df9703b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:05.742622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27606c52-27df-4efb-b1d2-c669df9703b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:05.743466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-27606c52-27df-4efb-b1d2-c669df9703b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:05.836951 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-27606c52-27df-4efb-b1d2-c669df9703b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.141843 Jan 22 21:20:05.837654 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3215/6143] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:05 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:05.923053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-652b1daf-55ab-4803-b8fa-6f05b65c70a3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:05.924275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-652b1daf-55ab-4803-b8fa-6f05b65c70a3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:05.933982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-652b1daf-55ab-4803-b8fa-6f05b65c70a3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:05.934624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-652b1daf-55ab-4803-b8fa-6f05b65c70a3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:05.935477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-652b1daf-55ab-4803-b8fa-6f05b65c70a3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:05.935850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-652b1daf-55ab-4803-b8fa-6f05b65c70a3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:05.984672 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-652b1daf-55ab-4803-b8fa-6f05b65c70a3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.066360 Jan 22 21:20:05.985545 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2929/6144] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:05 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:06.211369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-959fe8cd-e5b8-484d-97d0-6ac1ad76864b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:06.212118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-959fe8cd-e5b8-484d-97d0-6ac1ad76864b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:06.219374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-959fe8cd-e5b8-484d-97d0-6ac1ad76864b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:06.219822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-959fe8cd-e5b8-484d-97d0-6ac1ad76864b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:06.220603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-959fe8cd-e5b8-484d-97d0-6ac1ad76864b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:06.221044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-959fe8cd-e5b8-484d-97d0-6ac1ad76864b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:06.411543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a11eb0ab-5e1b-4b79-b84e-19b85fc13d64 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:06.412249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a11eb0ab-5e1b-4b79-b84e-19b85fc13d64 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:06.421240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a11eb0ab-5e1b-4b79-b84e-19b85fc13d64 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:06.421240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a11eb0ab-5e1b-4b79-b84e-19b85fc13d64 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:06.421457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a11eb0ab-5e1b-4b79-b84e-19b85fc13d64 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:06.421878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a11eb0ab-5e1b-4b79-b84e-19b85fc13d64 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:06.456216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-959fe8cd-e5b8-484d-97d0-6ac1ad76864b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:06.483741 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-959fe8cd-e5b8-484d-97d0-6ac1ad76864b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1695 microversion: 2.1 time: 0.276597 Jan 22 21:20:06.494407 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3216/6145] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:06 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1695 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:06.576548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a11eb0ab-5e1b-4b79-b84e-19b85fc13d64 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:06.584297 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a11eb0ab-5e1b-4b79-b84e-19b85fc13d64 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.177151 Jan 22 21:20:06.584868 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2930/6146] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:06 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:20:06.616070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4ecff73b-ed7f-4577-9ee5-e7df19b185c9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:06.616977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4ecff73b-ed7f-4577-9ee5-e7df19b185c9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:06.623516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ecff73b-ed7f-4577-9ee5-e7df19b185c9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:06.623978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ecff73b-ed7f-4577-9ee5-e7df19b185c9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:06.624772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ecff73b-ed7f-4577-9ee5-e7df19b185c9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:06.625218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ecff73b-ed7f-4577-9ee5-e7df19b185c9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:06.669882 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4ecff73b-ed7f-4577-9ee5-e7df19b185c9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.057300 Jan 22 21:20:06.670832 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3217/6147] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:06 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:06.855221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1611129d-fb1b-433c-857a-9048107660c5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:06.856184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1611129d-fb1b-433c-857a-9048107660c5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:06.865308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1611129d-fb1b-433c-857a-9048107660c5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:06.869345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1611129d-fb1b-433c-857a-9048107660c5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:06.869345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1611129d-fb1b-433c-857a-9048107660c5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:06.869345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1611129d-fb1b-433c-857a-9048107660c5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:06.928109 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1611129d-fb1b-433c-857a-9048107660c5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.076640 Jan 22 21:20:06.929339 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2931/6148] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:06 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:07.004132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7ac627d2-65c3-40a1-8749-a69d7f015913 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:07.004132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7ac627d2-65c3-40a1-8749-a69d7f015913 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:07.006816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ac627d2-65c3-40a1-8749-a69d7f015913 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:07.007263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ac627d2-65c3-40a1-8749-a69d7f015913 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:07.008444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ac627d2-65c3-40a1-8749-a69d7f015913 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:07.009110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ac627d2-65c3-40a1-8749-a69d7f015913 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:07.309684 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7ac627d2-65c3-40a1-8749-a69d7f015913 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.316687 Jan 22 21:20:07.310318 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3218/6149] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:06 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:07.501558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-87a81ad8-e1cc-4104-be5e-30f5aed10ca0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:07.502180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-87a81ad8-e1cc-4104-be5e-30f5aed10ca0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:07.509168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87a81ad8-e1cc-4104-be5e-30f5aed10ca0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:07.511607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87a81ad8-e1cc-4104-be5e-30f5aed10ca0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:07.512788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87a81ad8-e1cc-4104-be5e-30f5aed10ca0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:07.513469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87a81ad8-e1cc-4104-be5e-30f5aed10ca0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:07.603264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-33104bb5-026a-4587-bcab-d1f485bebf5c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:07.604253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-33104bb5-026a-4587-bcab-d1f485bebf5c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:07.613030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33104bb5-026a-4587-bcab-d1f485bebf5c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:07.617846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33104bb5-026a-4587-bcab-d1f485bebf5c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:07.623306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33104bb5-026a-4587-bcab-d1f485bebf5c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:07.623791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33104bb5-026a-4587-bcab-d1f485bebf5c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:07.794347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-87a81ad8-e1cc-4104-be5e-30f5aed10ca0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:07.803251 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-87a81ad8-e1cc-4104-be5e-30f5aed10ca0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1700 microversion: 2.1 time: 0.306240 Jan 22 21:20:07.804160 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2932/6150] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:07 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1700 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:07.810701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fc324c38-a9e0-459e-9034-193ed4a88173 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:07.811658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fc324c38-a9e0-459e-9034-193ed4a88173 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:07.823393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc324c38-a9e0-459e-9034-193ed4a88173 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:07.823867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc324c38-a9e0-459e-9034-193ed4a88173 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:07.826434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc324c38-a9e0-459e-9034-193ed4a88173 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:07.826893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc324c38-a9e0-459e-9034-193ed4a88173 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:07.894856 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fc324c38-a9e0-459e-9034-193ed4a88173 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.089170 Jan 22 21:20:07.898535 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2933/6151] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:07 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:07.948835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96e0056d-f853-44b7-be0f-7108ddd4b483 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:07.969664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96e0056d-f853-44b7-be0f-7108ddd4b483 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:07.985971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96e0056d-f853-44b7-be0f-7108ddd4b483 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:07.986536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96e0056d-f853-44b7-be0f-7108ddd4b483 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:07.987597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96e0056d-f853-44b7-be0f-7108ddd4b483 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:07.988560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96e0056d-f853-44b7-be0f-7108ddd4b483 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:08.029378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-33104bb5-026a-4587-bcab-d1f485bebf5c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:08.031655 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-33104bb5-026a-4587-bcab-d1f485bebf5c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.430405 Jan 22 21:20:08.040283 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3219/6152] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:07 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:08.073375 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96e0056d-f853-44b7-be0f-7108ddd4b483 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.132980 Jan 22 21:20:08.077810 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2934/6153] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:07 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:08.320658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8631d1c0-0ce5-4286-9c56-96b2e64d5142 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:08.325762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8631d1c0-0ce5-4286-9c56-96b2e64d5142 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:08.339677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8631d1c0-0ce5-4286-9c56-96b2e64d5142 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:08.344503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8631d1c0-0ce5-4286-9c56-96b2e64d5142 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:08.346510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8631d1c0-0ce5-4286-9c56-96b2e64d5142 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:08.347532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8631d1c0-0ce5-4286-9c56-96b2e64d5142 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:08.414409 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8631d1c0-0ce5-4286-9c56-96b2e64d5142 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.097168 Jan 22 21:20:08.415446 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3220/6154] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:08 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:08.821447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-803141b8-89a1-469b-b646-5c8df4e55eb1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:08.822391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-803141b8-89a1-469b-b646-5c8df4e55eb1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:08.830551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-803141b8-89a1-469b-b646-5c8df4e55eb1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:08.831480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-803141b8-89a1-469b-b646-5c8df4e55eb1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:08.832428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-803141b8-89a1-469b-b646-5c8df4e55eb1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:08.832874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-803141b8-89a1-469b-b646-5c8df4e55eb1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:08.908959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-06177120-f147-4eda-ad05-0ef370c18762 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:08.909990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-06177120-f147-4eda-ad05-0ef370c18762 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:08.926080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06177120-f147-4eda-ad05-0ef370c18762 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:08.926918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06177120-f147-4eda-ad05-0ef370c18762 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:08.927745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06177120-f147-4eda-ad05-0ef370c18762 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:08.928384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06177120-f147-4eda-ad05-0ef370c18762 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:08.981082 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-06177120-f147-4eda-ad05-0ef370c18762 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.076203 Jan 22 21:20:08.991147 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3221/6155] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:08 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:09.043262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-803141b8-89a1-469b-b646-5c8df4e55eb1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:09.047293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ff06d287-75ff-43dd-a2d7-75e45071d197 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:09.048046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ff06d287-75ff-43dd-a2d7-75e45071d197 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:09.051588 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-803141b8-89a1-469b-b646-5c8df4e55eb1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1700 microversion: 2.1 time: 0.234162 Jan 22 21:20:09.053458 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2935/6156] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:08 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1700 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:09.072742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff06d287-75ff-43dd-a2d7-75e45071d197 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:09.073228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff06d287-75ff-43dd-a2d7-75e45071d197 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:09.074080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff06d287-75ff-43dd-a2d7-75e45071d197 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:09.074539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff06d287-75ff-43dd-a2d7-75e45071d197 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:09.088262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-be143308-ca28-4e4c-85ee-66ab07c0fac6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:09.089284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-be143308-ca28-4e4c-85ee-66ab07c0fac6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:09.096627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be143308-ca28-4e4c-85ee-66ab07c0fac6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:09.097095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be143308-ca28-4e4c-85ee-66ab07c0fac6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:09.098139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be143308-ca28-4e4c-85ee-66ab07c0fac6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:09.098769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be143308-ca28-4e4c-85ee-66ab07c0fac6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:09.204881 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-be143308-ca28-4e4c-85ee-66ab07c0fac6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.120610 Jan 22 21:20:09.209874 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2936/6157] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:09 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:09.391129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ff06d287-75ff-43dd-a2d7-75e45071d197 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:09.405283 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ff06d287-75ff-43dd-a2d7-75e45071d197 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.362433 Jan 22 21:20:09.415371 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3222/6158] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:09 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:20:09.427516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2c0843ce-ff64-42f5-ae49-d2e272bc663c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:09.428589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2c0843ce-ff64-42f5-ae49-d2e272bc663c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:09.455280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c0843ce-ff64-42f5-ae49-d2e272bc663c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:09.458546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c0843ce-ff64-42f5-ae49-d2e272bc663c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:09.460522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c0843ce-ff64-42f5-ae49-d2e272bc663c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:09.462183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c0843ce-ff64-42f5-ae49-d2e272bc663c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:09.529201 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2c0843ce-ff64-42f5-ae49-d2e272bc663c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.105666 Jan 22 21:20:09.530274 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2937/6159] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:09 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:09.999084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0ece2d4a-57e9-4fcf-a4cb-c51206ff6ca8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:10.000031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0ece2d4a-57e9-4fcf-a4cb-c51206ff6ca8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:10.012411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ece2d4a-57e9-4fcf-a4cb-c51206ff6ca8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:10.013100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ece2d4a-57e9-4fcf-a4cb-c51206ff6ca8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:10.014220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ece2d4a-57e9-4fcf-a4cb-c51206ff6ca8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:10.014870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ece2d4a-57e9-4fcf-a4cb-c51206ff6ca8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:10.072205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f54348d-0ede-401d-b0f1-a5596ab851f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:10.072205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9f54348d-0ede-401d-b0f1-a5596ab851f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:10.082385 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0ece2d4a-57e9-4fcf-a4cb-c51206ff6ca8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.077969 Jan 22 21:20:10.085404 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3223/6160] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:09 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:10.101093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f54348d-0ede-401d-b0f1-a5596ab851f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:10.102479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f54348d-0ede-401d-b0f1-a5596ab851f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:10.102479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f54348d-0ede-401d-b0f1-a5596ab851f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:10.102852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f54348d-0ede-401d-b0f1-a5596ab851f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:10.217897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-87f01ccf-03ab-4df1-978e-c114fbfc704d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:10.222058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-87f01ccf-03ab-4df1-978e-c114fbfc704d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:10.232153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87f01ccf-03ab-4df1-978e-c114fbfc704d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:10.233157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87f01ccf-03ab-4df1-978e-c114fbfc704d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:10.239165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87f01ccf-03ab-4df1-978e-c114fbfc704d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:10.240587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87f01ccf-03ab-4df1-978e-c114fbfc704d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:10.303557 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-87f01ccf-03ab-4df1-978e-c114fbfc704d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.089840 Jan 22 21:20:10.304776 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3224/6161] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:10 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:10.425433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d83dd9df-0804-48d9-8079-5edb6d21acf6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:10.426908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d83dd9df-0804-48d9-8079-5edb6d21acf6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:10.437296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d83dd9df-0804-48d9-8079-5edb6d21acf6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:10.437892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d83dd9df-0804-48d9-8079-5edb6d21acf6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:10.440380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d83dd9df-0804-48d9-8079-5edb6d21acf6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:10.440380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d83dd9df-0804-48d9-8079-5edb6d21acf6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:10.461230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9f54348d-0ede-401d-b0f1-a5596ab851f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:10.468326 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9f54348d-0ede-401d-b0f1-a5596ab851f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1700 microversion: 2.1 time: 0.403260 Jan 22 21:20:10.469299 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2938/6162] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:10 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1700 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:10.545688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b3ce80b3-b225-43a4-8b2b-e1fd63f4dbc8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:10.546927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b3ce80b3-b225-43a4-8b2b-e1fd63f4dbc8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:10.560490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3ce80b3-b225-43a4-8b2b-e1fd63f4dbc8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:10.561312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3ce80b3-b225-43a4-8b2b-e1fd63f4dbc8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:10.562511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3ce80b3-b225-43a4-8b2b-e1fd63f4dbc8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:10.563122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3ce80b3-b225-43a4-8b2b-e1fd63f4dbc8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:10.633296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d83dd9df-0804-48d9-8079-5edb6d21acf6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:10.642149 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d83dd9df-0804-48d9-8079-5edb6d21acf6 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.222651 Jan 22 21:20:10.655277 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b3ce80b3-b225-43a4-8b2b-e1fd63f4dbc8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.105292 Jan 22 21:20:10.655277 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2939/6163] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:10 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:20:10.655874 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3225/6164] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:10 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:11.097467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c5f2dd9e-5826-4a6b-b6b1-b35dd1a6ec23 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:11.098507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c5f2dd9e-5826-4a6b-b6b1-b35dd1a6ec23 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:11.106749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5f2dd9e-5826-4a6b-b6b1-b35dd1a6ec23 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:11.107213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5f2dd9e-5826-4a6b-b6b1-b35dd1a6ec23 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:11.108012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5f2dd9e-5826-4a6b-b6b1-b35dd1a6ec23 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:11.108463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5f2dd9e-5826-4a6b-b6b1-b35dd1a6ec23 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:11.155545 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c5f2dd9e-5826-4a6b-b6b1-b35dd1a6ec23 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.061268 Jan 22 21:20:11.156772 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2940/6165] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:11 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:11.317107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c79e0aa1-c1c0-43a9-aa5b-9cd3e4fbd4b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:11.318370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c79e0aa1-c1c0-43a9-aa5b-9cd3e4fbd4b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:11.326449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c79e0aa1-c1c0-43a9-aa5b-9cd3e4fbd4b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:11.327223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c79e0aa1-c1c0-43a9-aa5b-9cd3e4fbd4b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:11.328120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c79e0aa1-c1c0-43a9-aa5b-9cd3e4fbd4b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:11.328642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c79e0aa1-c1c0-43a9-aa5b-9cd3e4fbd4b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:11.377233 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c79e0aa1-c1c0-43a9-aa5b-9cd3e4fbd4b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.063507 Jan 22 21:20:11.378077 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3226/6166] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:11 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:11.486052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-88675360-83e1-4fee-b8eb-61f71c96ff95 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:11.486747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-88675360-83e1-4fee-b8eb-61f71c96ff95 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:11.496234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88675360-83e1-4fee-b8eb-61f71c96ff95 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:11.496698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88675360-83e1-4fee-b8eb-61f71c96ff95 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:11.497682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88675360-83e1-4fee-b8eb-61f71c96ff95 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:11.498123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88675360-83e1-4fee-b8eb-61f71c96ff95 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:11.672744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b673714-cac3-42d4-8eeb-12ea508b4427 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:11.674793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b673714-cac3-42d4-8eeb-12ea508b4427 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:11.684214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b673714-cac3-42d4-8eeb-12ea508b4427 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:11.684977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b673714-cac3-42d4-8eeb-12ea508b4427 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:11.686369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b673714-cac3-42d4-8eeb-12ea508b4427 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:11.686819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b673714-cac3-42d4-8eeb-12ea508b4427 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:11.707922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-88675360-83e1-4fee-b8eb-61f71c96ff95 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:11.717687 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-88675360-83e1-4fee-b8eb-61f71c96ff95 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1700 microversion: 2.1 time: 0.235927 Jan 22 21:20:11.718520 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2941/6167] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:11 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1700 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:11.730459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ccf13b5-69a8-4231-bcb3-95edcc28134f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:11.731096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ccf13b5-69a8-4231-bcb3-95edcc28134f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:11.736978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ccf13b5-69a8-4231-bcb3-95edcc28134f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:11.737476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ccf13b5-69a8-4231-bcb3-95edcc28134f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:11.738456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ccf13b5-69a8-4231-bcb3-95edcc28134f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:11.738918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ccf13b5-69a8-4231-bcb3-95edcc28134f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:11.763602 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b673714-cac3-42d4-8eeb-12ea508b4427 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.092401 Jan 22 21:20:11.769755 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3227/6168] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:11 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:11.902681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8ccf13b5-69a8-4231-bcb3-95edcc28134f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:11.910842 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ccf13b5-69a8-4231-bcb3-95edcc28134f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1527 microversion: 2.1 time: 0.187968 Jan 22 21:20:11.912030 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2942/6169] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:11 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1527 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:12.169114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-193e1dee-b623-4f83-bda8-6676b1e9f70f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:12.170220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-193e1dee-b623-4f83-bda8-6676b1e9f70f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:12.177276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-193e1dee-b623-4f83-bda8-6676b1e9f70f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:12.177799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-193e1dee-b623-4f83-bda8-6676b1e9f70f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:12.178607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-193e1dee-b623-4f83-bda8-6676b1e9f70f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:12.179053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-193e1dee-b623-4f83-bda8-6676b1e9f70f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:12.235525 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-193e1dee-b623-4f83-bda8-6676b1e9f70f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.068984 Jan 22 21:20:12.236286 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3228/6170] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:12 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:12.398151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d0c6ad35-b520-42eb-a722-fdc638ff11a9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:12.399191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d0c6ad35-b520-42eb-a722-fdc638ff11a9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:12.407318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0c6ad35-b520-42eb-a722-fdc638ff11a9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:12.407776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0c6ad35-b520-42eb-a722-fdc638ff11a9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:12.408658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0c6ad35-b520-42eb-a722-fdc638ff11a9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:12.409155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0c6ad35-b520-42eb-a722-fdc638ff11a9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:12.452240 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d0c6ad35-b520-42eb-a722-fdc638ff11a9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.060049 Jan 22 21:20:12.456542 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2943/6171] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:12 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:12.736353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17c17d70-dc12-4716-8e61-87acdb9e5aab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:12.737064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17c17d70-dc12-4716-8e61-87acdb9e5aab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:12.745548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17c17d70-dc12-4716-8e61-87acdb9e5aab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:12.747260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17c17d70-dc12-4716-8e61-87acdb9e5aab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:12.747384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17c17d70-dc12-4716-8e61-87acdb9e5aab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:12.747783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17c17d70-dc12-4716-8e61-87acdb9e5aab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:12.778688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0c35f782-d906-4306-9ab4-021dd8beda7c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:12.779700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0c35f782-d906-4306-9ab4-021dd8beda7c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:12.788110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c35f782-d906-4306-9ab4-021dd8beda7c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:12.788573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c35f782-d906-4306-9ab4-021dd8beda7c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:12.789376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c35f782-d906-4306-9ab4-021dd8beda7c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:12.789869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c35f782-d906-4306-9ab4-021dd8beda7c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:12.844656 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0c35f782-d906-4306-9ab4-021dd8beda7c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.071022 Jan 22 21:20:12.845348 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2944/6172] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:12 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:12.928667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ddb8e1c-bf44-4a0c-90cc-ec08571c3379 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:12.929379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3ddb8e1c-bf44-4a0c-90cc-ec08571c3379 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:12.937734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ddb8e1c-bf44-4a0c-90cc-ec08571c3379 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:12.938195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ddb8e1c-bf44-4a0c-90cc-ec08571c3379 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:12.939012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ddb8e1c-bf44-4a0c-90cc-ec08571c3379 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:12.939460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ddb8e1c-bf44-4a0c-90cc-ec08571c3379 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:13.068987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-17c17d70-dc12-4716-8e61-87acdb9e5aab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:13.082647 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17c17d70-dc12-4716-8e61-87acdb9e5aab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1700 microversion: 2.1 time: 0.351028 Jan 22 21:20:13.093751 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3229/6173] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:12 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1700 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:13.150936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3ddb8e1c-bf44-4a0c-90cc-ec08571c3379 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:13.166690 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3ddb8e1c-bf44-4a0c-90cc-ec08571c3379 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1504 microversion: 2.1 time: 0.238999 Jan 22 21:20:13.177590 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2945/6174] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:12 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:20:13.185641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-917d1bad-9fef-40b4-abad-2f6f0a295ce1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:13.190477 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:13.190477 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:20:13.191910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-917d1bad-9fef-40b4-abad-2f6f0a295ce1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:13.193388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-917d1bad-9fef-40b4-abad-2f6f0a295ce1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:20:13.201263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-917d1bad-9fef-40b4-abad-2f6f0a295ce1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:13.202075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-917d1bad-9fef-40b4-abad-2f6f0a295ce1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:13.203162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-917d1bad-9fef-40b4-abad-2f6f0a295ce1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:13.203694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-917d1bad-9fef-40b4-abad-2f6f0a295ce1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:13.250369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3a7823b3-25d7-4980-a99d-c212547f6b48 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:13.251664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3a7823b3-25d7-4980-a99d-c212547f6b48 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:13.268566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a7823b3-25d7-4980-a99d-c212547f6b48 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:13.269036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a7823b3-25d7-4980-a99d-c212547f6b48 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:13.269912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a7823b3-25d7-4980-a99d-c212547f6b48 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:13.270358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a7823b3-25d7-4980-a99d-c212547f6b48 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:13.330537 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3a7823b3-25d7-4980-a99d-c212547f6b48 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.085379 Jan 22 21:20:13.331215 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2946/6175] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:13 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:13.339659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-917d1bad-9fef-40b4-abad-2f6f0a295ce1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:20:13.403199 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-917d1bad-9fef-40b4-abad-2f6f0a295ce1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 348 microversion: 2.1 time: 0.223609 Jan 22 21:20:13.404193 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3230/6176] 10.222.0.100 () {58 vars in 1158 bytes} [Sat Jan 22 21:20:13 2022] GET /compute/v2.1/servers?status=shutoff => generated 348 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:20:13.414746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-51c937b0-02af-47ad-86bf-ea78ec0240d0 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:13.427332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51c937b0-02af-47ad-86bf-ea78ec0240d0 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:13.428173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51c937b0-02af-47ad-86bf-ea78ec0240d0 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:13.466203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8ebb6b3d-8687-444a-9829-1381a2f7caaf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:13.468150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8ebb6b3d-8687-444a-9829-1381a2f7caaf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:13.474329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-51c937b0-02af-47ad-86bf-ea78ec0240d0 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Going to try to start instance {{(pid=137033) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 22 21:20:13.484366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b3d-8687-444a-9829-1381a2f7caaf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:13.485784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b3d-8687-444a-9829-1381a2f7caaf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:13.486645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b3d-8687-444a-9829-1381a2f7caaf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:13.487112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ebb6b3d-8687-444a-9829-1381a2f7caaf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:13.564051 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8ebb6b3d-8687-444a-9829-1381a2f7caaf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.103144 Jan 22 21:20:13.565257 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3231/6177] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:13 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:13.713109 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-51c937b0-02af-47ad-86bf-ea78ec0240d0 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "POST /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de/action" status: 202 len: 0 microversion: 2.1 time: 0.301082 Jan 22 21:20:13.716182 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2947/6178] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:13 2022] POST /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:13.726044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e1e20476-ff29-436f-b2f8-37bcf6551952 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:13.726680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e1e20476-ff29-436f-b2f8-37bcf6551952 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:13.737772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1e20476-ff29-436f-b2f8-37bcf6551952 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:13.739047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1e20476-ff29-436f-b2f8-37bcf6551952 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:13.740965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1e20476-ff29-436f-b2f8-37bcf6551952 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:13.741846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1e20476-ff29-436f-b2f8-37bcf6551952 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:13.860394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7f2e4e11-77b4-4fc4-bc73-7f94a78e2f67 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:13.861447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7f2e4e11-77b4-4fc4-bc73-7f94a78e2f67 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:13.872637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f2e4e11-77b4-4fc4-bc73-7f94a78e2f67 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:13.873968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f2e4e11-77b4-4fc4-bc73-7f94a78e2f67 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:13.874266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f2e4e11-77b4-4fc4-bc73-7f94a78e2f67 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:13.874723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f2e4e11-77b4-4fc4-bc73-7f94a78e2f67 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:13.924765 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7f2e4e11-77b4-4fc4-bc73-7f94a78e2f67 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.071603 Jan 22 21:20:13.929016 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2948/6179] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:13 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:20:14.065232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e1e20476-ff29-436f-b2f8-37bcf6551952 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:14.073652 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e1e20476-ff29-436f-b2f8-37bcf6551952 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1513 microversion: 2.1 time: 0.352799 Jan 22 21:20:14.074229 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3232/6180] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:13 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1513 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:14.101796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-486ce1d5-4d07-465b-93ee-2ba799a2e157 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:14.103930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-486ce1d5-4d07-465b-93ee-2ba799a2e157 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:14.111305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-486ce1d5-4d07-465b-93ee-2ba799a2e157 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:14.111756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-486ce1d5-4d07-465b-93ee-2ba799a2e157 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:14.112549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-486ce1d5-4d07-465b-93ee-2ba799a2e157 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:14.112991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-486ce1d5-4d07-465b-93ee-2ba799a2e157 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:14.326664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-486ce1d5-4d07-465b-93ee-2ba799a2e157 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:14.340441 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-486ce1d5-4d07-465b-93ee-2ba799a2e157 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1700 microversion: 2.1 time: 0.242251 Jan 22 21:20:14.341573 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2949/6181] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:14 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1700 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:20:14.362839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-04d02bad-6c98-4e6b-ae63-b273ded83b69 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:14.366145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-04d02bad-6c98-4e6b-ae63-b273ded83b69 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:14.388351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04d02bad-6c98-4e6b-ae63-b273ded83b69 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:14.389196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04d02bad-6c98-4e6b-ae63-b273ded83b69 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:14.391065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04d02bad-6c98-4e6b-ae63-b273ded83b69 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:14.392348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04d02bad-6c98-4e6b-ae63-b273ded83b69 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:14.452954 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-04d02bad-6c98-4e6b-ae63-b273ded83b69 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.095396 Jan 22 21:20:14.453670 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3233/6182] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:14 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:14.577271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f6d36963-dfe4-4eef-b109-50332296f8a9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:14.578264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f6d36963-dfe4-4eef-b109-50332296f8a9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:14.586077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6d36963-dfe4-4eef-b109-50332296f8a9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:14.586538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6d36963-dfe4-4eef-b109-50332296f8a9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:14.587389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6d36963-dfe4-4eef-b109-50332296f8a9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:14.592847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6d36963-dfe4-4eef-b109-50332296f8a9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:14.669324 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f6d36963-dfe4-4eef-b109-50332296f8a9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.095779 Jan 22 21:20:14.670050 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2950/6183] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:14 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:14.944418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ecb0fe56-6764-4392-9dfb-f45b41984186 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:14.951316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ecb0fe56-6764-4392-9dfb-f45b41984186 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:14.970915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ecb0fe56-6764-4392-9dfb-f45b41984186 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:14.970915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ecb0fe56-6764-4392-9dfb-f45b41984186 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:14.970915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ecb0fe56-6764-4392-9dfb-f45b41984186 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:14.970915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ecb0fe56-6764-4392-9dfb-f45b41984186 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:15.014738 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ecb0fe56-6764-4392-9dfb-f45b41984186 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.078283 Jan 22 21:20:15.018770 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3234/6184] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:14 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:15.106873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ede4ccb-0b5b-4c42-ad1c-91d86f095802 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:15.107603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ede4ccb-0b5b-4c42-ad1c-91d86f095802 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:15.115388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ede4ccb-0b5b-4c42-ad1c-91d86f095802 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:15.115842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ede4ccb-0b5b-4c42-ad1c-91d86f095802 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:15.116640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ede4ccb-0b5b-4c42-ad1c-91d86f095802 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:15.117605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ede4ccb-0b5b-4c42-ad1c-91d86f095802 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:15.301912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8ede4ccb-0b5b-4c42-ad1c-91d86f095802 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:15.311011 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ede4ccb-0b5b-4c42-ad1c-91d86f095802 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1513 microversion: 2.1 time: 0.208145 Jan 22 21:20:15.311603 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2951/6185] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:15 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:15.365858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-73a59fad-d5cb-4242-8faf-e9e1ea2da76a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:15.366577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-73a59fad-d5cb-4242-8faf-e9e1ea2da76a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:15.380691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73a59fad-d5cb-4242-8faf-e9e1ea2da76a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:15.381164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73a59fad-d5cb-4242-8faf-e9e1ea2da76a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:15.382000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73a59fad-d5cb-4242-8faf-e9e1ea2da76a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:15.382831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73a59fad-d5cb-4242-8faf-e9e1ea2da76a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:15.465878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aa7142f9-79bf-43c6-95db-aea60c1fd392 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:15.466802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aa7142f9-79bf-43c6-95db-aea60c1fd392 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:15.485528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa7142f9-79bf-43c6-95db-aea60c1fd392 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:15.486146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa7142f9-79bf-43c6-95db-aea60c1fd392 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:15.487163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa7142f9-79bf-43c6-95db-aea60c1fd392 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:15.487788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa7142f9-79bf-43c6-95db-aea60c1fd392 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:15.540121 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aa7142f9-79bf-43c6-95db-aea60c1fd392 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.078423 Jan 22 21:20:15.543227 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2952/6186] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:15 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:15.611997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-73a59fad-d5cb-4242-8faf-e9e1ea2da76a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:15.620083 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-73a59fad-d5cb-4242-8faf-e9e1ea2da76a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1700 microversion: 2.1 time: 0.259705 Jan 22 21:20:15.620768 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3235/6187] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:15 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1700 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:20:15.683638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cdcfa453-a299-4bbb-8db1-4d6130050315 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:15.684998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cdcfa453-a299-4bbb-8db1-4d6130050315 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:15.692514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdcfa453-a299-4bbb-8db1-4d6130050315 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:15.692975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdcfa453-a299-4bbb-8db1-4d6130050315 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:15.694096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdcfa453-a299-4bbb-8db1-4d6130050315 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:15.694584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdcfa453-a299-4bbb-8db1-4d6130050315 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:15.748571 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cdcfa453-a299-4bbb-8db1-4d6130050315 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.069026 Jan 22 21:20:15.749539 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2953/6188] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:15 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:16.027000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-58dc40e4-5c28-4332-a030-b582217f89f2 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:16.028531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-58dc40e4-5c28-4332-a030-b582217f89f2 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:16.041978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58dc40e4-5c28-4332-a030-b582217f89f2 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.041978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58dc40e4-5c28-4332-a030-b582217f89f2 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.041978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58dc40e4-5c28-4332-a030-b582217f89f2 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.041978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58dc40e4-5c28-4332-a030-b582217f89f2 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.093557 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-58dc40e4-5c28-4332-a030-b582217f89f2 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.069295 Jan 22 21:20:16.094835 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3236/6189] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:16 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:20:16.329194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6ced0f52-d862-49c3-97ea-9af1f32f563f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:16.340291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6ced0f52-d862-49c3-97ea-9af1f32f563f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:16.340291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ced0f52-d862-49c3-97ea-9af1f32f563f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.340291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ced0f52-d862-49c3-97ea-9af1f32f563f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.340291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ced0f52-d862-49c3-97ea-9af1f32f563f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.340291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ced0f52-d862-49c3-97ea-9af1f32f563f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.503734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6ced0f52-d862-49c3-97ea-9af1f32f563f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:16.514308 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6ced0f52-d862-49c3-97ea-9af1f32f563f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1517 microversion: 2.1 time: 0.189384 Jan 22 21:20:16.515060 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2954/6190] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:16 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:16.534737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-feeb2f12-8ee0-4743-a491-20e473b01460 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:16.539067 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:16.539067 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:20:16.540365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-feeb2f12-8ee0-4743-a491-20e473b01460 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:16.540937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.compute.servers [None req-feeb2f12-8ee0-4743-a491-20e473b01460 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Removing options 'limit' from query {{(pid=137032) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Jan 22 21:20:16.541894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-feeb2f12-8ee0-4743-a491-20e473b01460 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:20:16.543358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-feeb2f12-8ee0-4743-a491-20e473b01460 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.543973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-feeb2f12-8ee0-4743-a491-20e473b01460 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.544932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-feeb2f12-8ee0-4743-a491-20e473b01460 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.545494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-feeb2f12-8ee0-4743-a491-20e473b01460 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.547950 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-feeb2f12-8ee0-4743-a491-20e473b01460 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.017938 Jan 22 21:20:16.548821 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3237/6191] 10.222.0.100 () {58 vars in 1144 bytes} [Sat Jan 22 21:20:16 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:20:16.553439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-496a50bd-7a19-4920-a42d-e5a532e53bd6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:16.559432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-496a50bd-7a19-4920-a42d-e5a532e53bd6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:16.563201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-76336d04-fad0-46df-9725-dbc028162df0 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:16.563696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-496a50bd-7a19-4920-a42d-e5a532e53bd6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.563878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-76336d04-fad0-46df-9725-dbc028162df0 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:16.564175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-496a50bd-7a19-4920-a42d-e5a532e53bd6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.564990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-496a50bd-7a19-4920-a42d-e5a532e53bd6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.565728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-496a50bd-7a19-4920-a42d-e5a532e53bd6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.573038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76336d04-fad0-46df-9725-dbc028162df0 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.573539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76336d04-fad0-46df-9725-dbc028162df0 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.574725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76336d04-fad0-46df-9725-dbc028162df0 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.575438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76336d04-fad0-46df-9725-dbc028162df0 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.614967 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-496a50bd-7a19-4920-a42d-e5a532e53bd6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.064775 Jan 22 21:20:16.619000 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2955/6192] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:16 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:16.638239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cf841dae-f34b-40d0-a3bd-c0c05731beae tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:16.639063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cf841dae-f34b-40d0-a3bd-c0c05731beae tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:16.647164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf841dae-f34b-40d0-a3bd-c0c05731beae tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.654694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf841dae-f34b-40d0-a3bd-c0c05731beae tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.654694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf841dae-f34b-40d0-a3bd-c0c05731beae tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.654694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf841dae-f34b-40d0-a3bd-c0c05731beae tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.752393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-76336d04-fad0-46df-9725-dbc028162df0 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:16.763644 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-76336d04-fad0-46df-9725-dbc028162df0 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1517 microversion: 2.1 time: 0.205713 Jan 22 21:20:16.767490 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3238/6193] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:16 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:20:16.769597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cc17d846-b5c0-4e5b-b787-9f0552a74f6f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:16.770518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cc17d846-b5c0-4e5b-b787-9f0552a74f6f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:16.780005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc17d846-b5c0-4e5b-b787-9f0552a74f6f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.780472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc17d846-b5c0-4e5b-b787-9f0552a74f6f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.781273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc17d846-b5c0-4e5b-b787-9f0552a74f6f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.781764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc17d846-b5c0-4e5b-b787-9f0552a74f6f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.855329 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cc17d846-b5c0-4e5b-b787-9f0552a74f6f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.089665 Jan 22 21:20:16.857136 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3239/6194] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:16 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:16.863508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0de74b5f-3b6c-4842-9002-e12bd415a955 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:16.865325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0de74b5f-3b6c-4842-9002-e12bd415a955 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 7ee0c106-5a38-4a21-80cc-30bd74c900a3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:16.870128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cf841dae-f34b-40d0-a3bd-c0c05731beae tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:16.882369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0de74b5f-3b6c-4842-9002-e12bd415a955 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.882369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0de74b5f-3b6c-4842-9002-e12bd415a955 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.882369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0de74b5f-3b6c-4842-9002-e12bd415a955 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:16.882369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0de74b5f-3b6c-4842-9002-e12bd415a955 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:16.882800 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cf841dae-f34b-40d0-a3bd-c0c05731beae tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1700 microversion: 2.1 time: 0.248216 Jan 22 21:20:16.882800 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2956/6195] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:16 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1700 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:17.039782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0de74b5f-3b6c-4842-9002-e12bd415a955 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:17.048388 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0de74b5f-3b6c-4842-9002-e12bd415a955 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3" status: 200 len: 1517 microversion: 2.1 time: 0.189315 Jan 22 21:20:17.048961 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3240/6196] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:16 2022] GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3 => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:17.066814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dfcfb50a-f75a-4eb1-9fb6-04e8a31416ce tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:17.066814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dfcfb50a-f75a-4eb1-9fb6-04e8a31416ce tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:17.073636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfcfb50a-f75a-4eb1-9fb6-04e8a31416ce tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.074095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfcfb50a-f75a-4eb1-9fb6-04e8a31416ce tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:17.074889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfcfb50a-f75a-4eb1-9fb6-04e8a31416ce tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.075332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfcfb50a-f75a-4eb1-9fb6-04e8a31416ce tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:17.121100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-64713b47-56d7-4b51-aa8e-5f8a0bf7ddca tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:17.125568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-64713b47-56d7-4b51-aa8e-5f8a0bf7ddca tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:17.136968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64713b47-56d7-4b51-aa8e-5f8a0bf7ddca tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.137441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64713b47-56d7-4b51-aa8e-5f8a0bf7ddca tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:17.138655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64713b47-56d7-4b51-aa8e-5f8a0bf7ddca tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.139138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64713b47-56d7-4b51-aa8e-5f8a0bf7ddca tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:17.194352 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-64713b47-56d7-4b51-aa8e-5f8a0bf7ddca tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.086406 Jan 22 21:20:17.195567 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3241/6197] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:17 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:17.329287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dfcfb50a-f75a-4eb1-9fb6-04e8a31416ce tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:17.339864 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dfcfb50a-f75a-4eb1-9fb6-04e8a31416ce tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1515 microversion: 2.1 time: 0.278713 Jan 22 21:20:17.341464 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2957/6198] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:17 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1515 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:17.357347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-44eb0169-b935-44c1-92ee-095dfaa819dc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:17.361559 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:17.361559 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:20:17.362196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-44eb0169-b935-44c1-92ee-095dfaa819dc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:17.362956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-44eb0169-b935-44c1-92ee-095dfaa819dc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:20:17.451667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44eb0169-b935-44c1-92ee-095dfaa819dc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.452221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44eb0169-b935-44c1-92ee-095dfaa819dc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:17.453142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44eb0169-b935-44c1-92ee-095dfaa819dc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.453700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44eb0169-b935-44c1-92ee-095dfaa819dc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:17.573804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-44eb0169-b935-44c1-92ee-095dfaa819dc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:20:17.638461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d230666c-a42f-488e-97b4-7d93991da491 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:17.639397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d230666c-a42f-488e-97b4-7d93991da491 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:17.649135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d230666c-a42f-488e-97b4-7d93991da491 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.649978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d230666c-a42f-488e-97b4-7d93991da491 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:17.656139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d230666c-a42f-488e-97b4-7d93991da491 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.656916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d230666c-a42f-488e-97b4-7d93991da491 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:17.680414 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-44eb0169-b935-44c1-92ee-095dfaa819dc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 348 microversion: 2.1 time: 0.327620 Jan 22 21:20:17.682859 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3242/6199] 10.222.0.100 () {58 vars in 1158 bytes} [Sat Jan 22 21:20:17 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 348 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:20:17.695413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-57a259b1-effa-4907-b9b3-c1d91824f9c7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:17.696428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-57a259b1-effa-4907-b9b3-c1d91824f9c7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:17.704798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57a259b1-effa-4907-b9b3-c1d91824f9c7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.705345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57a259b1-effa-4907-b9b3-c1d91824f9c7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:17.706300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57a259b1-effa-4907-b9b3-c1d91824f9c7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.706872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57a259b1-effa-4907-b9b3-c1d91824f9c7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:17.715951 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d230666c-a42f-488e-97b4-7d93991da491 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.081470 Jan 22 21:20:17.717215 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2958/6200] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:17 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:17.870797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d3147502-99b8-47e1-9ba5-8aea7bd3eeea tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:17.871830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d3147502-99b8-47e1-9ba5-8aea7bd3eeea tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:17.884976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3147502-99b8-47e1-9ba5-8aea7bd3eeea tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.885468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3147502-99b8-47e1-9ba5-8aea7bd3eeea tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:17.886306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3147502-99b8-47e1-9ba5-8aea7bd3eeea tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.886855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3147502-99b8-47e1-9ba5-8aea7bd3eeea tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:17.902417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-57a259b1-effa-4907-b9b3-c1d91824f9c7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:17.910404 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-57a259b1-effa-4907-b9b3-c1d91824f9c7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1517 microversion: 2.1 time: 0.219163 Jan 22 21:20:17.912696 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3243/6201] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:17 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1517 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:17.928820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-949a7bb7-a0e4-49d4-8f86-6fa8f699fc85 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:17.929456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-949a7bb7-a0e4-49d4-8f86-6fa8f699fc85 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:17.938046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-949a7bb7-a0e4-49d4-8f86-6fa8f699fc85 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.938808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-949a7bb7-a0e4-49d4-8f86-6fa8f699fc85 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:17.939799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-949a7bb7-a0e4-49d4-8f86-6fa8f699fc85 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.940813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-949a7bb7-a0e4-49d4-8f86-6fa8f699fc85 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:17.972142 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d3147502-99b8-47e1-9ba5-8aea7bd3eeea tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.106943 Jan 22 21:20:17.977138 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2959/6202] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:17 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:17.983713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2fa088c7-7303-49c6-bd6c-6885f7cd68bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:17.984662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2fa088c7-7303-49c6-bd6c-6885f7cd68bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 7ee0c106-5a38-4a21-80cc-30bd74c900a3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:17.994443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fa088c7-7303-49c6-bd6c-6885f7cd68bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.999429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fa088c7-7303-49c6-bd6c-6885f7cd68bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:17.999429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fa088c7-7303-49c6-bd6c-6885f7cd68bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:17.999429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fa088c7-7303-49c6-bd6c-6885f7cd68bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:18.190664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-949a7bb7-a0e4-49d4-8f86-6fa8f699fc85 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:18.206581 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-949a7bb7-a0e4-49d4-8f86-6fa8f699fc85 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1700 microversion: 2.1 time: 0.282114 Jan 22 21:20:18.207368 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3244/6203] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:17 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1700 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:18.213184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c6f9228c-1e4a-4cda-9e36-c20f9db9445c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:18.214746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c6f9228c-1e4a-4cda-9e36-c20f9db9445c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:18.222458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6f9228c-1e4a-4cda-9e36-c20f9db9445c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:18.223202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6f9228c-1e4a-4cda-9e36-c20f9db9445c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:18.224395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6f9228c-1e4a-4cda-9e36-c20f9db9445c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:18.225207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6f9228c-1e4a-4cda-9e36-c20f9db9445c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:18.293120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2fa088c7-7303-49c6-bd6c-6885f7cd68bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:18.301823 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2fa088c7-7303-49c6-bd6c-6885f7cd68bd tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3" status: 200 len: 1517 microversion: 2.1 time: 0.323296 Jan 22 21:20:18.302416 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2960/6204] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:17 2022] GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3 => generated 1517 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:18.307478 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c6f9228c-1e4a-4cda-9e36-c20f9db9445c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.097773 Jan 22 21:20:18.313873 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3245/6205] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:18 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:18.326928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7ea00943-9b81-4b91-b181-fb26b7965c47 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:18.327548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7ea00943-9b81-4b91-b181-fb26b7965c47 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:18.333943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ea00943-9b81-4b91-b181-fb26b7965c47 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:18.334397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ea00943-9b81-4b91-b181-fb26b7965c47 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:18.335491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ea00943-9b81-4b91-b181-fb26b7965c47 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:18.336046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ea00943-9b81-4b91-b181-fb26b7965c47 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:18.511443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7ea00943-9b81-4b91-b181-fb26b7965c47 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:18.526907 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7ea00943-9b81-4b91-b181-fb26b7965c47 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1515 microversion: 2.1 time: 0.197123 Jan 22 21:20:18.527636 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2961/6206] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:18 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:18.552027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-65d0a7bd-1044-4dc1-9c53-980da4a7479c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:18.552027 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:18.552027 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:20:18.552027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-65d0a7bd-1044-4dc1-9c53-980da4a7479c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:18.552027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-65d0a7bd-1044-4dc1-9c53-980da4a7479c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:20:18.557820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65d0a7bd-1044-4dc1-9c53-980da4a7479c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:18.558427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65d0a7bd-1044-4dc1-9c53-980da4a7479c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:18.559561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65d0a7bd-1044-4dc1-9c53-980da4a7479c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:18.560113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65d0a7bd-1044-4dc1-9c53-980da4a7479c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:18.636041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-65d0a7bd-1044-4dc1-9c53-980da4a7479c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:20:18.717358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-65d0a7bd-1044-4dc1-9c53-980da4a7479c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:18.730209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-958e0ab4-ef38-4b94-8160-ddf8e5d2639b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:18.731413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-958e0ab4-ef38-4b94-8160-ddf8e5d2639b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:18.741288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-958e0ab4-ef38-4b94-8160-ddf8e5d2639b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:18.745942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-958e0ab4-ef38-4b94-8160-ddf8e5d2639b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:18.751033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-958e0ab4-ef38-4b94-8160-ddf8e5d2639b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:18.751033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-958e0ab4-ef38-4b94-8160-ddf8e5d2639b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:18.751615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65d0a7bd-1044-4dc1-9c53-980da4a7479c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:18.752098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65d0a7bd-1044-4dc1-9c53-980da4a7479c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:18.818817 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-958e0ab4-ef38-4b94-8160-ddf8e5d2639b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.094017 Jan 22 21:20:18.819753 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2962/6207] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:18 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:18.926868 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-65d0a7bd-1044-4dc1-9c53-980da4a7479c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/detail" status: 200 len: 4532 microversion: 2.1 time: 0.387735 Jan 22 21:20:18.927476 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3246/6208] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:20:18 2022] GET /compute/v2.1/servers/detail => generated 4532 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:18.951223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-102b8b94-3d0c-4ae0-96f6-a16341f7c2cc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:18.955823 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:18.955823 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:20:18.960020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-102b8b94-3d0c-4ae0-96f6-a16341f7c2cc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:18.961036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-102b8b94-3d0c-4ae0-96f6-a16341f7c2cc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:20:18.989734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cba48aa6-989b-473c-8e21-0bb7d8acfd7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:18.991461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cba48aa6-989b-473c-8e21-0bb7d8acfd7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:19.003942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cba48aa6-989b-473c-8e21-0bb7d8acfd7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.010885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cba48aa6-989b-473c-8e21-0bb7d8acfd7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:19.010885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cba48aa6-989b-473c-8e21-0bb7d8acfd7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.010885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cba48aa6-989b-473c-8e21-0bb7d8acfd7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:19.055298 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cba48aa6-989b-473c-8e21-0bb7d8acfd7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.074341 Jan 22 21:20:19.056347 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3247/6209] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:18 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:19.193844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-102b8b94-3d0c-4ae0-96f6-a16341f7c2cc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.197201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-102b8b94-3d0c-4ae0-96f6-a16341f7c2cc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:19.198376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-102b8b94-3d0c-4ae0-96f6-a16341f7c2cc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.199246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-102b8b94-3d0c-4ae0-96f6-a16341f7c2cc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:19.224942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-036b2681-e91b-4a31-aae1-588d0c03c5fa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:19.228723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-036b2681-e91b-4a31-aae1-588d0c03c5fa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:19.237392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-036b2681-e91b-4a31-aae1-588d0c03c5fa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.248573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-036b2681-e91b-4a31-aae1-588d0c03c5fa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:19.249638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-036b2681-e91b-4a31-aae1-588d0c03c5fa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.250375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-036b2681-e91b-4a31-aae1-588d0c03c5fa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:19.360657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-102b8b94-3d0c-4ae0-96f6-a16341f7c2cc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:20:19.450947 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-102b8b94-3d0c-4ae0-96f6-a16341f7c2cc tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1017 microversion: 2.1 time: 0.504298 Jan 22 21:20:19.453637 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2963/6210] 10.222.0.100 () {58 vars in 1154 bytes} [Sat Jan 22 21:20:18 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1017 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:19.453791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-036b2681-e91b-4a31-aae1-588d0c03c5fa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:19.457478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-08f2495f-b062-4bcc-aef8-7ea0541924ab tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:19.458780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-08f2495f-b062-4bcc-aef8-7ea0541924ab tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:19.464675 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-036b2681-e91b-4a31-aae1-588d0c03c5fa tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1700 microversion: 2.1 time: 0.243893 Jan 22 21:20:19.465416 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3248/6211] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:19 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1700 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:19.467612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08f2495f-b062-4bcc-aef8-7ea0541924ab tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.477087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08f2495f-b062-4bcc-aef8-7ea0541924ab tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:19.477087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08f2495f-b062-4bcc-aef8-7ea0541924ab tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.477087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08f2495f-b062-4bcc-aef8-7ea0541924ab tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:19.477458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17d6f7d5-4cd8-4fa2-8bee-8da0b1576081 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:19.477458 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:19.477458 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:20:19.477458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-17d6f7d5-4cd8-4fa2-8bee-8da0b1576081 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:19.477458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17d6f7d5-4cd8-4fa2-8bee-8da0b1576081 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:20:19.488270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17d6f7d5-4cd8-4fa2-8bee-8da0b1576081 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.488898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17d6f7d5-4cd8-4fa2-8bee-8da0b1576081 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:19.491829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17d6f7d5-4cd8-4fa2-8bee-8da0b1576081 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.494054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17d6f7d5-4cd8-4fa2-8bee-8da0b1576081 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:19.528106 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-08f2495f-b062-4bcc-aef8-7ea0541924ab tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.066455 Jan 22 21:20:19.528106 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2964/6212] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:19 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:19.632061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-17d6f7d5-4cd8-4fa2-8bee-8da0b1576081 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:20:19.715090 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17d6f7d5-4cd8-4fa2-8bee-8da0b1576081 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1017 microversion: 2.1 time: 0.248374 Jan 22 21:20:19.725674 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3249/6213] 10.222.0.100 () {58 vars in 1216 bytes} [Sat Jan 22 21:20:19 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1017 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:19.727538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-42f120a1-333e-4285-804a-63a5de9c5291 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:19.732762 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:19.732762 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:20:19.733915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-42f120a1-333e-4285-804a-63a5de9c5291 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:19.734891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-42f120a1-333e-4285-804a-63a5de9c5291 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:20:19.741378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42f120a1-333e-4285-804a-63a5de9c5291 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.742136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42f120a1-333e-4285-804a-63a5de9c5291 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:19.742947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42f120a1-333e-4285-804a-63a5de9c5291 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.743447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42f120a1-333e-4285-804a-63a5de9c5291 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:19.832701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f0205c7-5734-4967-92a8-b154c57a5f25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:19.834010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f0205c7-5734-4967-92a8-b154c57a5f25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:19.836279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-42f120a1-333e-4285-804a-63a5de9c5291 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:20:19.841314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f0205c7-5734-4967-92a8-b154c57a5f25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.842090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f0205c7-5734-4967-92a8-b154c57a5f25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:19.843560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f0205c7-5734-4967-92a8-b154c57a5f25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.844205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f0205c7-5734-4967-92a8-b154c57a5f25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:19.894828 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f0205c7-5734-4967-92a8-b154c57a5f25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.066195 Jan 22 21:20:19.895963 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3250/6214] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:19 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:19.929485 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-42f120a1-333e-4285-804a-63a5de9c5291 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1017 microversion: 2.1 time: 0.206288 Jan 22 21:20:19.930485 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2965/6215] 10.222.0.100 () {58 vars in 1200 bytes} [Sat Jan 22 21:20:19 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1017 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:19.943267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74d6c9c8-5a3f-4f18-99ce-445cb4966cf5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:19.948657 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:19.948657 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:20:19.955615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-74d6c9c8-5a3f-4f18-99ce-445cb4966cf5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:19.956773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-74d6c9c8-5a3f-4f18-99ce-445cb4966cf5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'name': '1731878382', 'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:20:19.965564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74d6c9c8-5a3f-4f18-99ce-445cb4966cf5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.966629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74d6c9c8-5a3f-4f18-99ce-445cb4966cf5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:19.969150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74d6c9c8-5a3f-4f18-99ce-445cb4966cf5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:19.970019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74d6c9c8-5a3f-4f18-99ce-445cb4966cf5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:20.068544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1d03ff1d-5a70-49cf-849d-412ef7db8f18 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:20.069976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1d03ff1d-5a70-49cf-849d-412ef7db8f18 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:20.078194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-74d6c9c8-5a3f-4f18-99ce-445cb4966cf5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:20:20.079532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d03ff1d-5a70-49cf-849d-412ef7db8f18 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:20.080409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d03ff1d-5a70-49cf-849d-412ef7db8f18 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:20.081477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d03ff1d-5a70-49cf-849d-412ef7db8f18 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:20.082283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d03ff1d-5a70-49cf-849d-412ef7db8f18 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:20.136296 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1d03ff1d-5a70-49cf-849d-412ef7db8f18 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.072263 Jan 22 21:20:20.139574 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2966/6216] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:20 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:20.151000 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-74d6c9c8-5a3f-4f18-99ce-445cb4966cf5 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers?name=1731878382" status: 200 len: 348 microversion: 2.1 time: 0.212388 Jan 22 21:20:20.151560 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3251/6217] 10.222.0.100 () {58 vars in 1160 bytes} [Sat Jan 22 21:20:19 2022] GET /compute/v2.1/servers?name=1731878382 => generated 348 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:20:20.167297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7aac2614-a056-4222-849f-63fdd0212e90 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:20.167297 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:20.167297 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:20:20.168235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7aac2614-a056-4222-849f-63fdd0212e90 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:20.168988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7aac2614-a056-4222-849f-63fdd0212e90 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:20:20.175311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7aac2614-a056-4222-849f-63fdd0212e90 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:20.175764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7aac2614-a056-4222-849f-63fdd0212e90 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:20.176580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7aac2614-a056-4222-849f-63fdd0212e90 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:20.177022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7aac2614-a056-4222-849f-63fdd0212e90 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:20.299450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-7aac2614-a056-4222-849f-63fdd0212e90 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:20:20.407063 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7aac2614-a056-4222-849f-63fdd0212e90 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1017 microversion: 2.1 time: 0.246204 Jan 22 21:20:20.418512 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2967/6218] 10.222.0.100 () {58 vars in 1158 bytes} [Sat Jan 22 21:20:20 2022] GET /compute/v2.1/servers?name=-instance => generated 1017 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:20.428923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ae5c153a-3290-42b3-b62e-84070626c821 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:20.435950 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:20.435950 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:20:20.446978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ae5c153a-3290-42b3-b62e-84070626c821 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:20.448608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ae5c153a-3290-42b3-b62e-84070626c821 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-173187838', 'deleted': False, 'project_id': '28fc33994d4c48aea2dbcc875885357a'} {{(pid=137032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:20:20.465068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae5c153a-3290-42b3-b62e-84070626c821 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:20.468612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae5c153a-3290-42b3-b62e-84070626c821 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:20.470337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae5c153a-3290-42b3-b62e-84070626c821 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:20.473619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae5c153a-3290-42b3-b62e-84070626c821 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:20.485292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5625a85a-234a-448e-ba8c-13857a0e5e00 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:20.487532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5625a85a-234a-448e-ba8c-13857a0e5e00 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:20.498589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5625a85a-234a-448e-ba8c-13857a0e5e00 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:20.499056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5625a85a-234a-448e-ba8c-13857a0e5e00 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:20.499868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5625a85a-234a-448e-ba8c-13857a0e5e00 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:20.500310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5625a85a-234a-448e-ba8c-13857a0e5e00 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:20.637573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.multi_cell_list [None req-ae5c153a-3290-42b3-b62e-84070626c821 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:20:20.717257 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ae5c153a-3290-42b3-b62e-84070626c821 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-173187838" status: 200 len: 348 microversion: 2.1 time: 0.291646 Jan 22 21:20:20.718463 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3252/6219] 10.222.0.100 () {58 vars in 1232 bytes} [Sat Jan 22 21:20:20 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-173187838 => generated 348 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:20:20.724665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-56308de8-153c-4220-89da-e4e2b440920c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:20.726341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-56308de8-153c-4220-89da-e4e2b440920c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:20.735290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56308de8-153c-4220-89da-e4e2b440920c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:20.736366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56308de8-153c-4220-89da-e4e2b440920c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:20.737713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56308de8-153c-4220-89da-e4e2b440920c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:20.738546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56308de8-153c-4220-89da-e4e2b440920c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:20.802461 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-56308de8-153c-4220-89da-e4e2b440920c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.074522 Jan 22 21:20:20.808430 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3253/6220] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:20 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:20.814593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ca887ed5-3581-4e72-adb1-2c73b0463fc1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:20.815341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ca887ed5-3581-4e72-adb1-2c73b0463fc1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:20.825808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca887ed5-3581-4e72-adb1-2c73b0463fc1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:20.833312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca887ed5-3581-4e72-adb1-2c73b0463fc1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:20.833312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca887ed5-3581-4e72-adb1-2c73b0463fc1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:20.833312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca887ed5-3581-4e72-adb1-2c73b0463fc1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:20.860260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ca887ed5-3581-4e72-adb1-2c73b0463fc1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:20:21.229381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5625a85a-234a-448e-ba8c-13857a0e5e00 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:21.240161 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5625a85a-234a-448e-ba8c-13857a0e5e00 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1700 microversion: 2.1 time: 0.759209 Jan 22 21:20:21.242216 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2968/6221] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:20 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1700 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:21.253215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-95eb4eee-b1a5-4fc5-bf92-74b81c10d8ca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:21.257074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-95eb4eee-b1a5-4fc5-bf92-74b81c10d8ca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:21.267801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95eb4eee-b1a5-4fc5-bf92-74b81c10d8ca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:21.268570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95eb4eee-b1a5-4fc5-bf92-74b81c10d8ca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:21.269970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95eb4eee-b1a5-4fc5-bf92-74b81c10d8ca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:21.270592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95eb4eee-b1a5-4fc5-bf92-74b81c10d8ca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:21.274028 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ca887ed5-3581-4e72-adb1-2c73b0463fc1 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "DELETE /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 204 len: 0 microversion: 2.1 time: 0.463897 Jan 22 21:20:21.281936 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3254/6222] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:20:20 2022] DELETE /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:20:21.288718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e197bbe2-c158-4f75-8848-f6fb2c799557 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:21.289766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e197bbe2-c158-4f75-8848-f6fb2c799557 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:21.304674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e197bbe2-c158-4f75-8848-f6fb2c799557 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:21.309005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e197bbe2-c158-4f75-8848-f6fb2c799557 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:21.310013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e197bbe2-c158-4f75-8848-f6fb2c799557 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:21.310574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e197bbe2-c158-4f75-8848-f6fb2c799557 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:21.320321 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-95eb4eee-b1a5-4fc5-bf92-74b81c10d8ca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.071648 Jan 22 21:20:21.326853 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2969/6223] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:21 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:21.328836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cec39c60-0508-41fc-882d-fcb2e5730318 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:21.329626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cec39c60-0508-41fc-882d-fcb2e5730318 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:21.339326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cec39c60-0508-41fc-882d-fcb2e5730318 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:21.342566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cec39c60-0508-41fc-882d-fcb2e5730318 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:21.347414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cec39c60-0508-41fc-882d-fcb2e5730318 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:21.354116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cec39c60-0508-41fc-882d-fcb2e5730318 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:21.377392 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e197bbe2-c158-4f75-8848-f6fb2c799557 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.093933 Jan 22 21:20:21.379641 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3255/6224] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:21 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:21.571022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cec39c60-0508-41fc-882d-fcb2e5730318 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:21.590438 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cec39c60-0508-41fc-882d-fcb2e5730318 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1521 microversion: 2.1 time: 0.266372 Jan 22 21:20:21.595694 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2970/6225] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:21 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:21.814964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-09d26ae4-ffde-4980-ab1d-bb83f4d52b35 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:21.815967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-09d26ae4-ffde-4980-ab1d-bb83f4d52b35 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:21.824407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09d26ae4-ffde-4980-ab1d-bb83f4d52b35 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:21.824993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09d26ae4-ffde-4980-ab1d-bb83f4d52b35 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:21.825913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09d26ae4-ffde-4980-ab1d-bb83f4d52b35 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:21.826353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09d26ae4-ffde-4980-ab1d-bb83f4d52b35 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:21.867017 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-09d26ae4-ffde-4980-ab1d-bb83f4d52b35 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.056061 Jan 22 21:20:21.867666 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3256/6226] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:21 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:22.260033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2eb5e98e-ed58-4a4b-9d05-b4de6e86e0a9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:22.260654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2eb5e98e-ed58-4a4b-9d05-b4de6e86e0a9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:22.278730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eb5e98e-ed58-4a4b-9d05-b4de6e86e0a9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:22.279275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eb5e98e-ed58-4a4b-9d05-b4de6e86e0a9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:22.280369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eb5e98e-ed58-4a4b-9d05-b4de6e86e0a9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:22.281274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eb5e98e-ed58-4a4b-9d05-b4de6e86e0a9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:22.334247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8ed9ca54-2ce6-4382-97e7-7aeb36559dd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:22.335780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8ed9ca54-2ce6-4382-97e7-7aeb36559dd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:22.348869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ed9ca54-2ce6-4382-97e7-7aeb36559dd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:22.349254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ed9ca54-2ce6-4382-97e7-7aeb36559dd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:22.350101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ed9ca54-2ce6-4382-97e7-7aeb36559dd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:22.350547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ed9ca54-2ce6-4382-97e7-7aeb36559dd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:22.394452 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8ed9ca54-2ce6-4382-97e7-7aeb36559dd5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.064062 Jan 22 21:20:22.397846 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3257/6227] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:22 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:22.403765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-878c784f-1a32-40d1-89c1-3d570f18b936 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:22.404887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-878c784f-1a32-40d1-89c1-3d570f18b936 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:22.414965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-878c784f-1a32-40d1-89c1-3d570f18b936 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:22.415461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-878c784f-1a32-40d1-89c1-3d570f18b936 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:22.416335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-878c784f-1a32-40d1-89c1-3d570f18b936 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:22.416781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-878c784f-1a32-40d1-89c1-3d570f18b936 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:22.472465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2eb5e98e-ed58-4a4b-9d05-b4de6e86e0a9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:22.473848 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-878c784f-1a32-40d1-89c1-3d570f18b936 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.077313 Jan 22 21:20:22.474620 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3258/6228] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:22 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:22.481952 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2eb5e98e-ed58-4a4b-9d05-b4de6e86e0a9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1700 microversion: 2.1 time: 0.225658 Jan 22 21:20:22.482481 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2971/6229] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:22 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1700 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:22.617982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8c894cfd-251d-406a-97e2-054fd42cdfab tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:22.619864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8c894cfd-251d-406a-97e2-054fd42cdfab tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:22.632159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c894cfd-251d-406a-97e2-054fd42cdfab tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:22.635093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c894cfd-251d-406a-97e2-054fd42cdfab tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:22.636542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c894cfd-251d-406a-97e2-054fd42cdfab tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:22.637342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c894cfd-251d-406a-97e2-054fd42cdfab tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:22.859630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8c894cfd-251d-406a-97e2-054fd42cdfab tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:22.868851 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8c894cfd-251d-406a-97e2-054fd42cdfab tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1521 microversion: 2.1 time: 0.259580 Jan 22 21:20:22.870399 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3259/6230] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:22 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:22.885692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cbac79ca-12aa-45a0-8bdf-bdb8eea6a2c0 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:22.885692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cbac79ca-12aa-45a0-8bdf-bdb8eea6a2c0 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:22.889822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbac79ca-12aa-45a0-8bdf-bdb8eea6a2c0 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:22.907033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbac79ca-12aa-45a0-8bdf-bdb8eea6a2c0 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:22.912711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbac79ca-12aa-45a0-8bdf-bdb8eea6a2c0 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:22.912711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbac79ca-12aa-45a0-8bdf-bdb8eea6a2c0 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:23.000430 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cbac79ca-12aa-45a0-8bdf-bdb8eea6a2c0 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.124675 Jan 22 21:20:23.001533 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2972/6231] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:22 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:23.406673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19546fb5-d046-4128-9c2d-d2634a3a2fed tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:23.407515 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-19546fb5-d046-4128-9c2d-d2634a3a2fed tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:23.418446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19546fb5-d046-4128-9c2d-d2634a3a2fed tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:23.422036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19546fb5-d046-4128-9c2d-d2634a3a2fed tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:23.422036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19546fb5-d046-4128-9c2d-d2634a3a2fed tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:23.422036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19546fb5-d046-4128-9c2d-d2634a3a2fed tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:23.490573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85498cce-63a2-44b5-95be-fab2ee29e9b2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:23.490573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85498cce-63a2-44b5-95be-fab2ee29e9b2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:23.535721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85498cce-63a2-44b5-95be-fab2ee29e9b2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:23.536190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85498cce-63a2-44b5-95be-fab2ee29e9b2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:23.537020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85498cce-63a2-44b5-95be-fab2ee29e9b2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:23.537544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85498cce-63a2-44b5-95be-fab2ee29e9b2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:23.570574 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19546fb5-d046-4128-9c2d-d2634a3a2fed tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.168067 Jan 22 21:20:23.574124 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3260/6232] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:23 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:23.585991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2a7b15cc-b623-421b-bf01-e740a746089f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:23.589943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2a7b15cc-b623-421b-bf01-e740a746089f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:23.620296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a7b15cc-b623-421b-bf01-e740a746089f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:23.620773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a7b15cc-b623-421b-bf01-e740a746089f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:23.621629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a7b15cc-b623-421b-bf01-e740a746089f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:23.622082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a7b15cc-b623-421b-bf01-e740a746089f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:23.673693 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-85498cce-63a2-44b5-95be-fab2ee29e9b2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.190881 Jan 22 21:20:23.676539 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2973/6233] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:23 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:24.230720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-d699873f-6aec-4709-92db-d73936a219e6 req-ce28cdb8-e978-4f0e-a2c1-89605d3f08f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b0efe4d-c48f-4017-9af1-74a39c02c424", "name": "network-vif-deleted", "tag": "6e4f5f57-8860-4711-bafb-033afa8d0600"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:24.244440 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:24.244440 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:20:24.253103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d699873f-6aec-4709-92db-d73936a219e6 req-ce28cdb8-e978-4f0e-a2c1-89605d3f08f1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:24.254535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d699873f-6aec-4709-92db-d73936a219e6 req-ce28cdb8-e978-4f0e-a2c1-89605d3f08f1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:24.276566 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-d699873f-6aec-4709-92db-d73936a219e6 req-ce28cdb8-e978-4f0e-a2c1-89605d3f08f1 service nova] Creating event network-vif-deleted:6e4f5f57-8860-4711-bafb-033afa8d0600 for instance 9b0efe4d-c48f-4017-9af1-74a39c02c424 on nch1-master-1 Jan 22 21:20:24.284678 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-d699873f-6aec-4709-92db-d73936a219e6 req-ce28cdb8-e978-4f0e-a2c1-89605d3f08f1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.476442 Jan 22 21:20:24.286082 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2974/6234] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:20:24.293486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f8f68950-bf59-4e96-b559-c66f50daa90c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:24.294461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f8f68950-bf59-4e96-b559-c66f50daa90c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:24.303237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8f68950-bf59-4e96-b559-c66f50daa90c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:24.303983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8f68950-bf59-4e96-b559-c66f50daa90c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:24.307681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8f68950-bf59-4e96-b559-c66f50daa90c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:24.307681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8f68950-bf59-4e96-b559-c66f50daa90c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:24.410178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8f68950-bf59-4e96-b559-c66f50daa90c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:24.411090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8f68950-bf59-4e96-b559-c66f50daa90c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:24.413575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-f8f68950-bf59-4e96-b559-c66f50daa90c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lazy-loading 'fault' on Instance uuid 9b0efe4d-c48f-4017-9af1-74a39c02c424 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:20:24.442593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2a7b15cc-b623-421b-bf01-e740a746089f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:24.454035 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2a7b15cc-b623-421b-bf01-e740a746089f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1700 microversion: 2.1 time: 0.878131 Jan 22 21:20:24.457850 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3261/6235] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:23 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1700 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:24.479880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d6a278dd-f099-41bf-8535-8f8175d70d31 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:24.480832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d6a278dd-f099-41bf-8535-8f8175d70d31 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:24.503561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f8f68950-bf59-4e96-b559-c66f50daa90c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:24.507628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6a278dd-f099-41bf-8535-8f8175d70d31 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:24.508095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6a278dd-f099-41bf-8535-8f8175d70d31 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:24.511427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6a278dd-f099-41bf-8535-8f8175d70d31 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:24.511890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6a278dd-f099-41bf-8535-8f8175d70d31 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:24.527869 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f8f68950-bf59-4e96-b559-c66f50daa90c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 200 len: 1314 microversion: 2.1 time: 0.238943 Jan 22 21:20:24.530047 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2975/6236] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:24 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:24.591586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48230b5c-f901-4b26-b504-8a11be23d8a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:24.594338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48230b5c-f901-4b26-b504-8a11be23d8a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:24.606457 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d6a278dd-f099-41bf-8535-8f8175d70d31 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.147250 Jan 22 21:20:24.607112 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3262/6237] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:24 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:24.618406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48230b5c-f901-4b26-b504-8a11be23d8a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:24.625022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48230b5c-f901-4b26-b504-8a11be23d8a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:24.625022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48230b5c-f901-4b26-b504-8a11be23d8a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:24.625022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48230b5c-f901-4b26-b504-8a11be23d8a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:24.671980 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48230b5c-f901-4b26-b504-8a11be23d8a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.088834 Jan 22 21:20:24.674800 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2976/6238] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:24 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:24.687037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19074d5e-0dfe-437f-b1b3-794f7afadd73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:24.688047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-19074d5e-0dfe-437f-b1b3-794f7afadd73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:24.701667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19074d5e-0dfe-437f-b1b3-794f7afadd73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:24.702134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19074d5e-0dfe-437f-b1b3-794f7afadd73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:24.706048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19074d5e-0dfe-437f-b1b3-794f7afadd73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:24.706502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19074d5e-0dfe-437f-b1b3-794f7afadd73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:24.809806 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19074d5e-0dfe-437f-b1b3-794f7afadd73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.128891 Jan 22 21:20:24.810822 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3263/6239] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:24 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:25.473157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b3260761-fb52-44a4-8b8c-a576fcab88e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:25.479095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b3260761-fb52-44a4-8b8c-a576fcab88e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:25.497861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3260761-fb52-44a4-8b8c-a576fcab88e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:25.498655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3260761-fb52-44a4-8b8c-a576fcab88e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:25.501411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3260761-fb52-44a4-8b8c-a576fcab88e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:25.501411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3260761-fb52-44a4-8b8c-a576fcab88e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:25.551039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4ce578fa-9879-4964-a711-a754d776dd8c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:25.551747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4ce578fa-9879-4964-a711-a754d776dd8c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 9b0efe4d-c48f-4017-9af1-74a39c02c424] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:25.564758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ce578fa-9879-4964-a711-a754d776dd8c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:25.565195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ce578fa-9879-4964-a711-a754d776dd8c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:25.572685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ce578fa-9879-4964-a711-a754d776dd8c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:25.583080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ce578fa-9879-4964-a711-a754d776dd8c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:25.629548 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-4ce578fa-9879-4964-a711-a754d776dd8c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] HTTP exception thrown: Instance 9b0efe4d-c48f-4017-9af1-74a39c02c424 could not be found. Jan 22 21:20:25.638275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4ce578fa-9879-4964-a711-a754d776dd8c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Returning 404 to user: Instance 9b0efe4d-c48f-4017-9af1-74a39c02c424 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:20:25.639283 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4ce578fa-9879-4964-a711-a754d776dd8c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424" status: 404 len: 111 microversion: 2.1 time: 0.093737 Jan 22 21:20:25.640140 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3264/6240] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:25 2022] GET /compute/v2.1/servers/9b0efe4d-c48f-4017-9af1-74a39c02c424 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:20:25.645299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f61b169-6e38-429e-85b6-8a1b5e0bcea8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:25.646793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f61b169-6e38-429e-85b6-8a1b5e0bcea8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:25.667007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f61b169-6e38-429e-85b6-8a1b5e0bcea8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:25.667007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f61b169-6e38-429e-85b6-8a1b5e0bcea8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:25.667007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f61b169-6e38-429e-85b6-8a1b5e0bcea8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:25.667007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f61b169-6e38-429e-85b6-8a1b5e0bcea8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:25.742496 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f61b169-6e38-429e-85b6-8a1b5e0bcea8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.100823 Jan 22 21:20:25.744434 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3265/6241] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:25 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:25.751844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4485439e-e1c3-47ed-8ed1-fb53a4cd6d4d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:25.752716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4485439e-e1c3-47ed-8ed1-fb53a4cd6d4d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 7ee0c106-5a38-4a21-80cc-30bd74c900a3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:25.760944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4485439e-e1c3-47ed-8ed1-fb53a4cd6d4d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:25.761757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4485439e-e1c3-47ed-8ed1-fb53a4cd6d4d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:25.762778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4485439e-e1c3-47ed-8ed1-fb53a4cd6d4d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:25.763400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4485439e-e1c3-47ed-8ed1-fb53a4cd6d4d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:25.797077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4485439e-e1c3-47ed-8ed1-fb53a4cd6d4d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 7ee0c106-5a38-4a21-80cc-30bd74c900a3] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:20:25.864414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b3260761-fb52-44a4-8b8c-a576fcab88e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:25.877305 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b3260761-fb52-44a4-8b8c-a576fcab88e5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1699 microversion: 2.1 time: 0.406404 Jan 22 21:20:25.889846 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2977/6242] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:25 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1699 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:25.895219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cc4fbc2a-047c-4db5-bb4d-6a0033715a8d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:25.901274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cc4fbc2a-047c-4db5-bb4d-6a0033715a8d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:25.908235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc4fbc2a-047c-4db5-bb4d-6a0033715a8d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:25.908994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc4fbc2a-047c-4db5-bb4d-6a0033715a8d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:25.912355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc4fbc2a-047c-4db5-bb4d-6a0033715a8d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:25.912928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc4fbc2a-047c-4db5-bb4d-6a0033715a8d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:25.965011 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cc4fbc2a-047c-4db5-bb4d-6a0033715a8d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.073225 Jan 22 21:20:25.965719 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2978/6243] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:25 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:25.971318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a49f09e8-6de0-4abf-afe6-2d20be9e7ef8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:25.972371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a49f09e8-6de0-4abf-afe6-2d20be9e7ef8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:25.980899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a49f09e8-6de0-4abf-afe6-2d20be9e7ef8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:25.981591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a49f09e8-6de0-4abf-afe6-2d20be9e7ef8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:25.982395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a49f09e8-6de0-4abf-afe6-2d20be9e7ef8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:25.982834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a49f09e8-6de0-4abf-afe6-2d20be9e7ef8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:26.034136 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a49f09e8-6de0-4abf-afe6-2d20be9e7ef8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.066255 Jan 22 21:20:26.035981 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2979/6244] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:25 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:26.043527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-abd19809-1d72-484c-87bf-b0e6ed2f098d req-62fe7379-e6d8-4bd3-acc0-17ebf9c16580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60f5752-e3a2-40ea-97fe-c98ebb12e4f7", "name": "network-vif-unplugged", "status": "completed", "tag": "3b4b9042-2ab2-4731-b9ee-9b33a072ec37"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:26.045656 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:26.045656 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:20:26.055009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-abd19809-1d72-484c-87bf-b0e6ed2f098d req-62fe7379-e6d8-4bd3-acc0-17ebf9c16580 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:26.058943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-abd19809-1d72-484c-87bf-b0e6ed2f098d req-62fe7379-e6d8-4bd3-acc0-17ebf9c16580 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:26.078264 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-abd19809-1d72-484c-87bf-b0e6ed2f098d req-62fe7379-e6d8-4bd3-acc0-17ebf9c16580 service nova] Creating event network-vif-unplugged:3b4b9042-2ab2-4731-b9ee-9b33a072ec37 for instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 on nch2-master-1 Jan 22 21:20:26.085755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-abd19809-1d72-484c-87bf-b0e6ed2f098d req-62fe7379-e6d8-4bd3-acc0-17ebf9c16580 service nova] Instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:20:26.107579 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-abd19809-1d72-484c-87bf-b0e6ed2f098d req-62fe7379-e6d8-4bd3-acc0-17ebf9c16580 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070488 Jan 22 21:20:26.108961 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2980/6245] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:20:26.205110 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4485439e-e1c3-47ed-8ed1-fb53a4cd6d4d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3" status: 204 len: 0 microversion: 2.1 time: 0.459040 Jan 22 21:20:26.205748 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3266/6246] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:20:25 2022] DELETE /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:20:26.216200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b9a1bbe0-df8a-4945-91a4-7d7229428722 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:26.216929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b9a1bbe0-df8a-4945-91a4-7d7229428722 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 7ee0c106-5a38-4a21-80cc-30bd74c900a3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:26.228121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9a1bbe0-df8a-4945-91a4-7d7229428722 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:26.228121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9a1bbe0-df8a-4945-91a4-7d7229428722 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:26.228383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9a1bbe0-df8a-4945-91a4-7d7229428722 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:26.228915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9a1bbe0-df8a-4945-91a4-7d7229428722 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:26.510375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b9a1bbe0-df8a-4945-91a4-7d7229428722 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:26.518813 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b9a1bbe0-df8a-4945-91a4-7d7229428722 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3" status: 200 len: 1523 microversion: 2.1 time: 0.308332 Jan 22 21:20:26.528835 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2981/6247] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:26 2022] GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3 => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:26.756504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6560d86-3c51-45f4-b319-7d7e855e290d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:26.757605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b6560d86-3c51-45f4-b319-7d7e855e290d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:26.767619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6560d86-3c51-45f4-b319-7d7e855e290d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:26.768410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6560d86-3c51-45f4-b319-7d7e855e290d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:26.769210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6560d86-3c51-45f4-b319-7d7e855e290d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:26.769690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6560d86-3c51-45f4-b319-7d7e855e290d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:26.839432 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b6560d86-3c51-45f4-b319-7d7e855e290d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.087083 Jan 22 21:20:26.845606 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3267/6248] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:26 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:26.896251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-58cd6470-61da-40cb-b81c-d371cd251974 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:26.897471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-58cd6470-61da-40cb-b81c-d371cd251974 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:26.912919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58cd6470-61da-40cb-b81c-d371cd251974 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:26.913652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58cd6470-61da-40cb-b81c-d371cd251974 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:26.914626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58cd6470-61da-40cb-b81c-d371cd251974 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:26.915780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58cd6470-61da-40cb-b81c-d371cd251974 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:26.981967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5412ebd1-ffdc-470a-964b-7595829fe8ef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:26.990958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5412ebd1-ffdc-470a-964b-7595829fe8ef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:27.022869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5412ebd1-ffdc-470a-964b-7595829fe8ef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:27.027222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5412ebd1-ffdc-470a-964b-7595829fe8ef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:27.027222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5412ebd1-ffdc-470a-964b-7595829fe8ef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:27.027222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5412ebd1-ffdc-470a-964b-7595829fe8ef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:27.106449 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5412ebd1-ffdc-470a-964b-7595829fe8ef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.130823 Jan 22 21:20:27.108704 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3268/6249] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:26 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:27.114739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-469c33cc-932f-4008-b65e-9e195b51d589 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:27.115986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-469c33cc-932f-4008-b65e-9e195b51d589 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:27.123740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-469c33cc-932f-4008-b65e-9e195b51d589 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:27.131399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-469c33cc-932f-4008-b65e-9e195b51d589 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:27.131399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-469c33cc-932f-4008-b65e-9e195b51d589 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:27.131399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-469c33cc-932f-4008-b65e-9e195b51d589 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:27.153089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-58cd6470-61da-40cb-b81c-d371cd251974 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:27.161239 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-58cd6470-61da-40cb-b81c-d371cd251974 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1699 microversion: 2.1 time: 0.268755 Jan 22 21:20:27.161848 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2982/6250] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:26 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1699 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:27.179439 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-469c33cc-932f-4008-b65e-9e195b51d589 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.068706 Jan 22 21:20:27.180207 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3269/6251] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:27 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:27.535919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-70f273c2-0187-43c9-bb23-d8e884d8baec tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:27.536860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-70f273c2-0187-43c9-bb23-d8e884d8baec tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 7ee0c106-5a38-4a21-80cc-30bd74c900a3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:27.545768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70f273c2-0187-43c9-bb23-d8e884d8baec tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:27.546552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70f273c2-0187-43c9-bb23-d8e884d8baec tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:27.547926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70f273c2-0187-43c9-bb23-d8e884d8baec tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:27.548573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70f273c2-0187-43c9-bb23-d8e884d8baec tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:27.754095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-70f273c2-0187-43c9-bb23-d8e884d8baec tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:27.763294 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-70f273c2-0187-43c9-bb23-d8e884d8baec tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3" status: 200 len: 1523 microversion: 2.1 time: 0.230882 Jan 22 21:20:27.763893 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2983/6252] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:27 2022] GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:27.855656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ec6997d0-8892-4747-a1cb-904732a623fe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:27.857641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ec6997d0-8892-4747-a1cb-904732a623fe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:27.875542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec6997d0-8892-4747-a1cb-904732a623fe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:27.876341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec6997d0-8892-4747-a1cb-904732a623fe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:27.879850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec6997d0-8892-4747-a1cb-904732a623fe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:27.880537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec6997d0-8892-4747-a1cb-904732a623fe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:27.936890 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ec6997d0-8892-4747-a1cb-904732a623fe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.086020 Jan 22 21:20:27.945205 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3270/6253] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:27 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:28.119425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d622792-692f-4a47-b110-4cdd8dcc57e8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:28.120583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d622792-692f-4a47-b110-4cdd8dcc57e8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:28.131826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d622792-692f-4a47-b110-4cdd8dcc57e8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:28.132285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d622792-692f-4a47-b110-4cdd8dcc57e8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:28.133096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d622792-692f-4a47-b110-4cdd8dcc57e8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:28.133583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d622792-692f-4a47-b110-4cdd8dcc57e8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:28.174801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-722efc6a-75ab-4f80-b4ce-51b3fcdb4cb4 req-5690cf20-ac30-46eb-acbb-5b0ab6e1268d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60f5752-e3a2-40ea-97fe-c98ebb12e4f7", "tag": "3b4b9042-2ab2-4731-b9ee-9b33a072ec37"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:28.176467 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:28.176467 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:20:28.203731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-722efc6a-75ab-4f80-b4ce-51b3fcdb4cb4 req-5690cf20-ac30-46eb-acbb-5b0ab6e1268d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:28.206647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-722efc6a-75ab-4f80-b4ce-51b3fcdb4cb4 req-5690cf20-ac30-46eb-acbb-5b0ab6e1268d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:28.210525 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d622792-692f-4a47-b110-4cdd8dcc57e8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.095009 Jan 22 21:20:28.217224 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2984/6254] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:28 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:28.232588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-473b0822-6b67-48ee-a033-6410a35d500c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:28.236462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-473b0822-6b67-48ee-a033-6410a35d500c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:28.249912 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-722efc6a-75ab-4f80-b4ce-51b3fcdb4cb4 req-5690cf20-ac30-46eb-acbb-5b0ab6e1268d service nova] Creating event network-changed:3b4b9042-2ab2-4731-b9ee-9b33a072ec37 for instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 on nch2-master-1 Jan 22 21:20:28.256945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-473b0822-6b67-48ee-a033-6410a35d500c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:28.257267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-473b0822-6b67-48ee-a033-6410a35d500c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:28.259268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-473b0822-6b67-48ee-a033-6410a35d500c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:28.262074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-473b0822-6b67-48ee-a033-6410a35d500c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:28.266813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-722efc6a-75ab-4f80-b4ce-51b3fcdb4cb4 req-5690cf20-ac30-46eb-acbb-5b0ab6e1268d service nova] Instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:20:28.302820 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-722efc6a-75ab-4f80-b4ce-51b3fcdb4cb4 req-5690cf20-ac30-46eb-acbb-5b0ab6e1268d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129173 Jan 22 21:20:28.303547 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3271/6255] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:20:28.321877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5fdef9ef-0d53-4af3-8a16-70a8f2048289 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:28.329769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5fdef9ef-0d53-4af3-8a16-70a8f2048289 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:28.344113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5fdef9ef-0d53-4af3-8a16-70a8f2048289 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:28.349659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5fdef9ef-0d53-4af3-8a16-70a8f2048289 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:28.350778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5fdef9ef-0d53-4af3-8a16-70a8f2048289 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:28.355899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5fdef9ef-0d53-4af3-8a16-70a8f2048289 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:28.438151 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5fdef9ef-0d53-4af3-8a16-70a8f2048289 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.131345 Jan 22 21:20:28.441555 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3272/6256] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:28 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:28.758010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-473b0822-6b67-48ee-a033-6410a35d500c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:28.776592 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-473b0822-6b67-48ee-a033-6410a35d500c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1699 microversion: 2.1 time: 0.553403 Jan 22 21:20:28.778435 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2985/6257] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:28 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1699 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:28.782654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1aa777f9-9288-43dc-81ac-3ffd94e6206b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:28.782654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1aa777f9-9288-43dc-81ac-3ffd94e6206b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 7ee0c106-5a38-4a21-80cc-30bd74c900a3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:28.799124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1aa777f9-9288-43dc-81ac-3ffd94e6206b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:28.799598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1aa777f9-9288-43dc-81ac-3ffd94e6206b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:28.800431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1aa777f9-9288-43dc-81ac-3ffd94e6206b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:28.800882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1aa777f9-9288-43dc-81ac-3ffd94e6206b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:28.949992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4d632960-d4c9-4948-ba3e-d845b3a8391d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:28.951619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4d632960-d4c9-4948-ba3e-d845b3a8391d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:28.960572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d632960-d4c9-4948-ba3e-d845b3a8391d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:28.962449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d632960-d4c9-4948-ba3e-d845b3a8391d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:28.963640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d632960-d4c9-4948-ba3e-d845b3a8391d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:28.964512 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d632960-d4c9-4948-ba3e-d845b3a8391d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:28.997945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1aa777f9-9288-43dc-81ac-3ffd94e6206b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:29.014867 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1aa777f9-9288-43dc-81ac-3ffd94e6206b tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3" status: 200 len: 1481 microversion: 2.1 time: 0.236962 Jan 22 21:20:29.015754 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3273/6258] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:28 2022] GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3 => generated 1481 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:29.062341 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4d632960-d4c9-4948-ba3e-d845b3a8391d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 24552 microversion: 2.1 time: 0.117179 Jan 22 21:20:29.064423 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2986/6259] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:28 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 24552 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:29.175348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-0b50500f-80d0-44f5-9692-27172d3fac6a req-88edad7e-f852-4a0a-90c4-ae287ccef73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee0c106-5a38-4a21-80cc-30bd74c900a3", "name": "network-vif-deleted", "tag": "ea59a8f9-70b4-488a-9967-b0f8c4efb0a6"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:29.178329 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:29.178329 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:20:29.219647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0b50500f-80d0-44f5-9692-27172d3fac6a req-88edad7e-f852-4a0a-90c4-ae287ccef73c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:29.220173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0b50500f-80d0-44f5-9692-27172d3fac6a req-88edad7e-f852-4a0a-90c4-ae287ccef73c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:29.232092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5d92852f-96e2-40c3-9b09-f66ee9b2221b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:29.234094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5d92852f-96e2-40c3-9b09-f66ee9b2221b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:29.252460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d92852f-96e2-40c3-9b09-f66ee9b2221b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:29.266521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d92852f-96e2-40c3-9b09-f66ee9b2221b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:29.266521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d92852f-96e2-40c3-9b09-f66ee9b2221b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:29.266934 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-0b50500f-80d0-44f5-9692-27172d3fac6a req-88edad7e-f852-4a0a-90c4-ae287ccef73c service nova] Creating event network-vif-deleted:ea59a8f9-70b4-488a-9967-b0f8c4efb0a6 for instance 7ee0c106-5a38-4a21-80cc-30bd74c900a3 on nch2-master-1 Jan 22 21:20:29.267031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d92852f-96e2-40c3-9b09-f66ee9b2221b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:29.281307 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-0b50500f-80d0-44f5-9692-27172d3fac6a req-88edad7e-f852-4a0a-90c4-ae287ccef73c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107427 Jan 22 21:20:29.283808 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3274/6260] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:20:29.318808 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5d92852f-96e2-40c3-9b09-f66ee9b2221b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.096094 Jan 22 21:20:29.320481 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2987/6261] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:29 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:29.451301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-83202847-6b0c-4cdd-8b84-c89ddcc52467 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:29.452997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-83202847-6b0c-4cdd-8b84-c89ddcc52467 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:29.470132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83202847-6b0c-4cdd-8b84-c89ddcc52467 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:29.479097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83202847-6b0c-4cdd-8b84-c89ddcc52467 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:29.482316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83202847-6b0c-4cdd-8b84-c89ddcc52467 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:29.485196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83202847-6b0c-4cdd-8b84-c89ddcc52467 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:29.596963 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-83202847-6b0c-4cdd-8b84-c89ddcc52467 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.149863 Jan 22 21:20:29.598283 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3275/6262] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:29 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:29.799618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-797de771-16c4-4fa3-b452-4215d77de5e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:29.801937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-797de771-16c4-4fa3-b452-4215d77de5e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:29.830924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-797de771-16c4-4fa3-b452-4215d77de5e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:29.833081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-797de771-16c4-4fa3-b452-4215d77de5e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:29.834489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-797de771-16c4-4fa3-b452-4215d77de5e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:29.835648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-797de771-16c4-4fa3-b452-4215d77de5e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:30.289704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1283a39e-b09f-4111-8429-42663e6ac2a8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:30.289704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1283a39e-b09f-4111-8429-42663e6ac2a8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 7ee0c106-5a38-4a21-80cc-30bd74c900a3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:30.289704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1283a39e-b09f-4111-8429-42663e6ac2a8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:30.289704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1283a39e-b09f-4111-8429-42663e6ac2a8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:30.289704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1283a39e-b09f-4111-8429-42663e6ac2a8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:30.289704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1283a39e-b09f-4111-8429-42663e6ac2a8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:30.289704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1283a39e-b09f-4111-8429-42663e6ac2a8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:30.289704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1283a39e-b09f-4111-8429-42663e6ac2a8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:30.289704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-1283a39e-b09f-4111-8429-42663e6ac2a8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lazy-loading 'fault' on Instance uuid 7ee0c106-5a38-4a21-80cc-30bd74c900a3 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:20:30.300157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-797de771-16c4-4fa3-b452-4215d77de5e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:30.300157 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-797de771-16c4-4fa3-b452-4215d77de5e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.454443 Jan 22 21:20:30.300157 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2988/6263] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:29 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1697 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:30.300157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d5e14280-6a96-41b8-8cb0-3e3e7d89d56a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:30.300157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d5e14280-6a96-41b8-8cb0-3e3e7d89d56a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:30.300157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5e14280-6a96-41b8-8cb0-3e3e7d89d56a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:30.300157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5e14280-6a96-41b8-8cb0-3e3e7d89d56a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:30.300157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5e14280-6a96-41b8-8cb0-3e3e7d89d56a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:30.300157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5e14280-6a96-41b8-8cb0-3e3e7d89d56a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:30.343703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1283a39e-b09f-4111-8429-42663e6ac2a8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:30.385572 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1283a39e-b09f-4111-8429-42663e6ac2a8 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3" status: 200 len: 1315 microversion: 2.1 time: 0.335871 Jan 22 21:20:30.385572 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3276/6264] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:30 2022] GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:20:30.385572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1c899450-de7f-4616-9e13-0de75eb24b85 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:30.385572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1c899450-de7f-4616-9e13-0de75eb24b85 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:30.385572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c899450-de7f-4616-9e13-0de75eb24b85 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:30.385572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c899450-de7f-4616-9e13-0de75eb24b85 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:30.385572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c899450-de7f-4616-9e13-0de75eb24b85 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:30.385572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c899450-de7f-4616-9e13-0de75eb24b85 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:30.386554 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d5e14280-6a96-41b8-8cb0-3e3e7d89d56a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.131902 Jan 22 21:20:30.386554 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2989/6265] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:30 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:30.440191 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1c899450-de7f-4616-9e13-0de75eb24b85 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.072931 Jan 22 21:20:30.441072 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3277/6266] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:30 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:30.616961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-122ec5a2-ad69-4e1b-968e-0c1e0e890cbb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:30.618134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-122ec5a2-ad69-4e1b-968e-0c1e0e890cbb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:30.642139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-122ec5a2-ad69-4e1b-968e-0c1e0e890cbb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:30.643141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-122ec5a2-ad69-4e1b-968e-0c1e0e890cbb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:30.646531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-122ec5a2-ad69-4e1b-968e-0c1e0e890cbb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:30.646994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-122ec5a2-ad69-4e1b-968e-0c1e0e890cbb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:30.709984 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-122ec5a2-ad69-4e1b-968e-0c1e0e890cbb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.098800 Jan 22 21:20:30.712818 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2990/6267] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:30 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:31.288401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dacce900-a0f6-4401-b477-ea2dc8660adc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:31.289173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dacce900-a0f6-4401-b477-ea2dc8660adc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:31.318521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dacce900-a0f6-4401-b477-ea2dc8660adc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:31.323050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dacce900-a0f6-4401-b477-ea2dc8660adc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:31.323933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dacce900-a0f6-4401-b477-ea2dc8660adc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:31.325272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dacce900-a0f6-4401-b477-ea2dc8660adc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:31.400739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2422e41d-bc47-402f-9683-0afe83dfe81c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:31.400739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2422e41d-bc47-402f-9683-0afe83dfe81c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:31.408366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2422e41d-bc47-402f-9683-0afe83dfe81c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:31.408831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2422e41d-bc47-402f-9683-0afe83dfe81c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:31.409670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2422e41d-bc47-402f-9683-0afe83dfe81c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:31.410446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2422e41d-bc47-402f-9683-0afe83dfe81c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:31.466898 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2422e41d-bc47-402f-9683-0afe83dfe81c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.073725 Jan 22 21:20:31.467976 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2991/6268] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:31 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:31.483157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-90f8e830-d221-44a6-8c23-3f0953984a54 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:31.484985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-90f8e830-d221-44a6-8c23-3f0953984a54 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 7ee0c106-5a38-4a21-80cc-30bd74c900a3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:31.494150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90f8e830-d221-44a6-8c23-3f0953984a54 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:31.495515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90f8e830-d221-44a6-8c23-3f0953984a54 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:31.497021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90f8e830-d221-44a6-8c23-3f0953984a54 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:31.497657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90f8e830-d221-44a6-8c23-3f0953984a54 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:31.522706 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-90f8e830-d221-44a6-8c23-3f0953984a54 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] HTTP exception thrown: Instance 7ee0c106-5a38-4a21-80cc-30bd74c900a3 could not be found. Jan 22 21:20:31.523526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-90f8e830-d221-44a6-8c23-3f0953984a54 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Returning 404 to user: Instance 7ee0c106-5a38-4a21-80cc-30bd74c900a3 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:20:31.528481 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-90f8e830-d221-44a6-8c23-3f0953984a54 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3" status: 404 len: 111 microversion: 2.1 time: 0.058289 Jan 22 21:20:31.531001 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2992/6269] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:31 2022] GET /compute/v2.1/servers/7ee0c106-5a38-4a21-80cc-30bd74c900a3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:20:31.544165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-30d57600-dc8e-418b-bffa-c2726d7e3880 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:31.547464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-30d57600-dc8e-418b-bffa-c2726d7e3880 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:31.559059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30d57600-dc8e-418b-bffa-c2726d7e3880 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:31.565976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30d57600-dc8e-418b-bffa-c2726d7e3880 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:31.565976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30d57600-dc8e-418b-bffa-c2726d7e3880 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:31.565976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30d57600-dc8e-418b-bffa-c2726d7e3880 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:31.627709 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-30d57600-dc8e-418b-bffa-c2726d7e3880 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.095326 Jan 22 21:20:31.631977 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2993/6270] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:31 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:31.645811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5c68f4a1-8883-4a6a-92f9-1f2be352536f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:31.646916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5c68f4a1-8883-4a6a-92f9-1f2be352536f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:31.656724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c68f4a1-8883-4a6a-92f9-1f2be352536f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:31.657426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c68f4a1-8883-4a6a-92f9-1f2be352536f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:31.658987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c68f4a1-8883-4a6a-92f9-1f2be352536f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:31.659572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c68f4a1-8883-4a6a-92f9-1f2be352536f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:31.703693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5c68f4a1-8883-4a6a-92f9-1f2be352536f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:20:31.764918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dacce900-a0f6-4401-b477-ea2dc8660adc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:31.776439 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dacce900-a0f6-4401-b477-ea2dc8660adc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.511332 Jan 22 21:20:31.787566 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3278/6271] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:31 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1697 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:31.798521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8aad8bd6-e463-4051-b1e3-c062456654d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:31.799726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8aad8bd6-e463-4051-b1e3-c062456654d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:31.808860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8aad8bd6-e463-4051-b1e3-c062456654d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:31.809311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8aad8bd6-e463-4051-b1e3-c062456654d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:31.810987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8aad8bd6-e463-4051-b1e3-c062456654d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:31.811637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8aad8bd6-e463-4051-b1e3-c062456654d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:31.888485 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8aad8bd6-e463-4051-b1e3-c062456654d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.099504 Jan 22 21:20:31.892476 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3279/6272] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:31 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:32.272309 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5c68f4a1-8883-4a6a-92f9-1f2be352536f tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 204 len: 0 microversion: 2.1 time: 0.637141 Jan 22 21:20:32.275083 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2994/6273] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:20:31 2022] DELETE /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:20:32.290987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a1b3d399-f33f-4ba6-987e-45cb17fb8ea7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:32.291747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a1b3d399-f33f-4ba6-987e-45cb17fb8ea7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:32.309412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1b3d399-f33f-4ba6-987e-45cb17fb8ea7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:32.310992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1b3d399-f33f-4ba6-987e-45cb17fb8ea7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:32.312836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1b3d399-f33f-4ba6-987e-45cb17fb8ea7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:32.313371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1b3d399-f33f-4ba6-987e-45cb17fb8ea7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:32.479812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-69805741-7f0a-4964-9fdc-db18655c0569 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:32.481024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-69805741-7f0a-4964-9fdc-db18655c0569 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:32.495220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69805741-7f0a-4964-9fdc-db18655c0569 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:32.495967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69805741-7f0a-4964-9fdc-db18655c0569 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:32.496967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69805741-7f0a-4964-9fdc-db18655c0569 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:32.497636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69805741-7f0a-4964-9fdc-db18655c0569 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:32.565612 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-69805741-7f0a-4964-9fdc-db18655c0569 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.089915 Jan 22 21:20:32.569685 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2995/6274] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:32 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:32.615440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a1b3d399-f33f-4ba6-987e-45cb17fb8ea7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:32.626358 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a1b3d399-f33f-4ba6-987e-45cb17fb8ea7 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1523 microversion: 2.1 time: 0.346453 Jan 22 21:20:32.642829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ab61c07-40c0-4635-9118-6be7861380c0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:32.643838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ab61c07-40c0-4635-9118-6be7861380c0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:32.647193 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3280/6275] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:32 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:32.662940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab61c07-40c0-4635-9118-6be7861380c0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:32.665549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab61c07-40c0-4635-9118-6be7861380c0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:32.667548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab61c07-40c0-4635-9118-6be7861380c0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:32.670071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab61c07-40c0-4635-9118-6be7861380c0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:32.751922 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ab61c07-40c0-4635-9118-6be7861380c0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.114941 Jan 22 21:20:32.754393 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2996/6276] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:32 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:32.798433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-00075ba0-5b73-4bb1-a088-53a5361928a6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:32.799476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-00075ba0-5b73-4bb1-a088-53a5361928a6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:32.807578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00075ba0-5b73-4bb1-a088-53a5361928a6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:32.808431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00075ba0-5b73-4bb1-a088-53a5361928a6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:32.809398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00075ba0-5b73-4bb1-a088-53a5361928a6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:32.810065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00075ba0-5b73-4bb1-a088-53a5361928a6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:32.901174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ac4a52d-612f-4c0c-85f0-d9c07298220f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:32.902493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ac4a52d-612f-4c0c-85f0-d9c07298220f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:32.914215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ac4a52d-612f-4c0c-85f0-d9c07298220f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:32.914215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ac4a52d-612f-4c0c-85f0-d9c07298220f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:32.914215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ac4a52d-612f-4c0c-85f0-d9c07298220f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:32.914215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ac4a52d-612f-4c0c-85f0-d9c07298220f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:32.965673 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ac4a52d-612f-4c0c-85f0-d9c07298220f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.069048 Jan 22 21:20:32.967268 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2997/6277] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:32 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:33.049218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-00075ba0-5b73-4bb1-a088-53a5361928a6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:33.057612 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-00075ba0-5b73-4bb1-a088-53a5361928a6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1697 microversion: 2.1 time: 0.267946 Jan 22 21:20:33.058218 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3281/6278] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:32 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1697 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:33.582561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cdb25567-0240-44dd-8bfc-3ff7cdab5865 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:33.584214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cdb25567-0240-44dd-8bfc-3ff7cdab5865 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:33.597625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdb25567-0240-44dd-8bfc-3ff7cdab5865 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:33.598468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdb25567-0240-44dd-8bfc-3ff7cdab5865 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:33.599475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdb25567-0240-44dd-8bfc-3ff7cdab5865 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:33.599919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdb25567-0240-44dd-8bfc-3ff7cdab5865 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:33.650577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-32add986-90a2-4a19-8944-e3cd42b6bf1d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:33.652085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-32add986-90a2-4a19-8944-e3cd42b6bf1d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:33.660992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32add986-90a2-4a19-8944-e3cd42b6bf1d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:33.661651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32add986-90a2-4a19-8944-e3cd42b6bf1d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:33.663241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32add986-90a2-4a19-8944-e3cd42b6bf1d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:33.663876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-32add986-90a2-4a19-8944-e3cd42b6bf1d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:33.715575 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cdb25567-0240-44dd-8bfc-3ff7cdab5865 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.138772 Jan 22 21:20:33.723061 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2998/6279] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:33 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:33.767601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ebe2ec3-bfb3-4634-a2f9-5b382c71e2e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:33.769315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3ebe2ec3-bfb3-4634-a2f9-5b382c71e2e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:33.781789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ebe2ec3-bfb3-4634-a2f9-5b382c71e2e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:33.783621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ebe2ec3-bfb3-4634-a2f9-5b382c71e2e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:33.788134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ebe2ec3-bfb3-4634-a2f9-5b382c71e2e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:33.792295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ebe2ec3-bfb3-4634-a2f9-5b382c71e2e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:33.857437 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3ebe2ec3-bfb3-4634-a2f9-5b382c71e2e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.094186 Jan 22 21:20:33.858870 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 2999/6280] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:33 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:33.933596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-32add986-90a2-4a19-8944-e3cd42b6bf1d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:33.939875 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-32add986-90a2-4a19-8944-e3cd42b6bf1d tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1523 microversion: 2.1 time: 0.297006 Jan 22 21:20:33.940713 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3282/6281] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:33 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1523 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:33.983120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8e7025f4-b57f-4b4a-91c4-7d869f932ba3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:33.984224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8e7025f4-b57f-4b4a-91c4-7d869f932ba3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:33.991762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e7025f4-b57f-4b4a-91c4-7d869f932ba3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:33.992270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e7025f4-b57f-4b4a-91c4-7d869f932ba3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:33.993741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e7025f4-b57f-4b4a-91c4-7d869f932ba3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:33.994255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e7025f4-b57f-4b4a-91c4-7d869f932ba3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:34.079648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-78a9d1e2-68dd-4300-ad73-1b7948d2ed88 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:34.085256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-78a9d1e2-68dd-4300-ad73-1b7948d2ed88 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:34.103686 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8e7025f4-b57f-4b4a-91c4-7d869f932ba3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.124760 Jan 22 21:20:34.105387 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3000/6282] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:33 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:34.114878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78a9d1e2-68dd-4300-ad73-1b7948d2ed88 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:34.115342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78a9d1e2-68dd-4300-ad73-1b7948d2ed88 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:34.116165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78a9d1e2-68dd-4300-ad73-1b7948d2ed88 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:34.124946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78a9d1e2-68dd-4300-ad73-1b7948d2ed88 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:34.733057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb948d56-0460-4c61-b21e-2f28b381bf62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:34.734661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb948d56-0460-4c61-b21e-2f28b381bf62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:34.769915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb948d56-0460-4c61-b21e-2f28b381bf62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:34.773096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb948d56-0460-4c61-b21e-2f28b381bf62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:34.776297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb948d56-0460-4c61-b21e-2f28b381bf62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:34.778118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb948d56-0460-4c61-b21e-2f28b381bf62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:34.878149 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb948d56-0460-4c61-b21e-2f28b381bf62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.151013 Jan 22 21:20:34.879884 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3001/6283] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:34 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:20:34.886018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-940e8dac-0a84-45e3-acd7-eac524b40ecd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:34.892293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-940e8dac-0a84-45e3-acd7-eac524b40ecd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:34.908793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-940e8dac-0a84-45e3-acd7-eac524b40ecd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:34.909496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-940e8dac-0a84-45e3-acd7-eac524b40ecd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:34.917849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-940e8dac-0a84-45e3-acd7-eac524b40ecd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:34.918546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-940e8dac-0a84-45e3-acd7-eac524b40ecd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:34.941524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-78a9d1e2-68dd-4300-ad73-1b7948d2ed88 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:34.962602 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-78a9d1e2-68dd-4300-ad73-1b7948d2ed88 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1694 microversion: 2.1 time: 0.889454 Jan 22 21:20:34.966104 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3283/6284] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:34 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1694 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:34.977045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c4be4e87-8c9e-4f1b-999a-dac7c585a15e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:34.979227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c4be4e87-8c9e-4f1b-999a-dac7c585a15e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:34.995053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4be4e87-8c9e-4f1b-999a-dac7c585a15e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:34.998576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4be4e87-8c9e-4f1b-999a-dac7c585a15e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:34.999713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4be4e87-8c9e-4f1b-999a-dac7c585a15e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:35.002706 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-940e8dac-0a84-45e3-acd7-eac524b40ecd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.121208 Jan 22 21:20:35.003374 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3002/6285] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:34 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:35.004223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4be4e87-8c9e-4f1b-999a-dac7c585a15e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:35.010412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-34b8a38e-2a9c-4dc2-b5b5-d49f69ed9adb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:35.014190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-34b8a38e-2a9c-4dc2-b5b5-d49f69ed9adb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:35.031001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34b8a38e-2a9c-4dc2-b5b5-d49f69ed9adb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:35.033802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34b8a38e-2a9c-4dc2-b5b5-d49f69ed9adb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:35.034886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34b8a38e-2a9c-4dc2-b5b5-d49f69ed9adb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:35.037083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34b8a38e-2a9c-4dc2-b5b5-d49f69ed9adb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:35.550404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c4be4e87-8c9e-4f1b-999a-dac7c585a15e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:35.560030 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c4be4e87-8c9e-4f1b-999a-dac7c585a15e tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1523 microversion: 2.1 time: 0.592590 Jan 22 21:20:35.576042 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3284/6286] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:34 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1523 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:35.577897 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-34b8a38e-2a9c-4dc2-b5b5-d49f69ed9adb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7/action" status: 202 len: 0 microversion: 2.1 time: 0.571278 Jan 22 21:20:35.582785 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3003/6287] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:35 2022] POST /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:35.599890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f1dfc998-cfc8-43d5-87ae-a95f43897267 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:35.603268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f422b395-c3ed-422d-9baf-a5fff45c7ae8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:35.606796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f422b395-c3ed-422d-9baf-a5fff45c7ae8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:35.620488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f422b395-c3ed-422d-9baf-a5fff45c7ae8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:35.623004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f1dfc998-cfc8-43d5-87ae-a95f43897267 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:35.623151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f422b395-c3ed-422d-9baf-a5fff45c7ae8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:35.625426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f422b395-c3ed-422d-9baf-a5fff45c7ae8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:35.626446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f422b395-c3ed-422d-9baf-a5fff45c7ae8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:35.641660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1dfc998-cfc8-43d5-87ae-a95f43897267 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:35.641775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1dfc998-cfc8-43d5-87ae-a95f43897267 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:35.642988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1dfc998-cfc8-43d5-87ae-a95f43897267 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:35.643504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1dfc998-cfc8-43d5-87ae-a95f43897267 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:35.774813 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f422b395-c3ed-422d-9baf-a5fff45c7ae8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.196565 Jan 22 21:20:35.779723 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3285/6288] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:35 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:35.900336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4a654e8a-bf8b-4362-bbee-3fb24022aa18 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:35.901363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4a654e8a-bf8b-4362-bbee-3fb24022aa18 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:35.927003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a654e8a-bf8b-4362-bbee-3fb24022aa18 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:35.929546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a654e8a-bf8b-4362-bbee-3fb24022aa18 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:35.936020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a654e8a-bf8b-4362-bbee-3fb24022aa18 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:35.941680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a654e8a-bf8b-4362-bbee-3fb24022aa18 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:36.058896 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4a654e8a-bf8b-4362-bbee-3fb24022aa18 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.171365 Jan 22 21:20:36.063969 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3286/6289] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:35 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:36.071346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-8f1a7d6f-1adc-471b-8bcc-5a78ed94995e req-7394f354-f665-4d8f-9379-295fcd95241e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de", "name": "network-vif-deleted", "tag": "561a37ef-90a7-4719-b61e-d12c48eeb371"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:36.072844 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:36.072844 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:20:36.113712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8f1a7d6f-1adc-471b-8bcc-5a78ed94995e req-7394f354-f665-4d8f-9379-295fcd95241e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:36.114173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8f1a7d6f-1adc-471b-8bcc-5a78ed94995e req-7394f354-f665-4d8f-9379-295fcd95241e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:36.143618 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-8f1a7d6f-1adc-471b-8bcc-5a78ed94995e req-7394f354-f665-4d8f-9379-295fcd95241e service nova] Creating event network-vif-deleted:561a37ef-90a7-4719-b61e-d12c48eeb371 for instance 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de on nch2-master-1 Jan 22 21:20:36.159934 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-8f1a7d6f-1adc-471b-8bcc-5a78ed94995e req-7394f354-f665-4d8f-9379-295fcd95241e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094385 Jan 22 21:20:36.172540 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3287/6290] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:20:36.212281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-837ad49e-0518-43e3-b47c-4742e2f64358 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:36.213686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-837ad49e-0518-43e3-b47c-4742e2f64358 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:36.258874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-837ad49e-0518-43e3-b47c-4742e2f64358 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:36.259752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-837ad49e-0518-43e3-b47c-4742e2f64358 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:36.276952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-837ad49e-0518-43e3-b47c-4742e2f64358 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:36.278115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-837ad49e-0518-43e3-b47c-4742e2f64358 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:36.354435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f1dfc998-cfc8-43d5-87ae-a95f43897267 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:36.372034 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f1dfc998-cfc8-43d5-87ae-a95f43897267 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1693 microversion: 2.1 time: 0.787826 Jan 22 21:20:36.373376 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3004/6291] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:35 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1693 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:36.393724 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-837ad49e-0518-43e3-b47c-4742e2f64358 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.215352 Jan 22 21:20:36.394476 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3288/6292] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:36 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:36.582929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-380bc628-cad1-440c-a4c9-008f1087c26c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:36.583810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-380bc628-cad1-440c-a4c9-008f1087c26c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:36.596950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-380bc628-cad1-440c-a4c9-008f1087c26c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:36.598404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-380bc628-cad1-440c-a4c9-008f1087c26c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:36.602624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-380bc628-cad1-440c-a4c9-008f1087c26c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:36.604603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-380bc628-cad1-440c-a4c9-008f1087c26c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:36.672214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-380bc628-cad1-440c-a4c9-008f1087c26c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:36.672884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-380bc628-cad1-440c-a4c9-008f1087c26c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:36.673637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-380bc628-cad1-440c-a4c9-008f1087c26c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lazy-loading 'fault' on Instance uuid 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:20:36.762670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-380bc628-cad1-440c-a4c9-008f1087c26c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14eee35455ce441bbd47cc4fcfc2d571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28fc33994d4c48aea2dbcc875885357a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:36.772870 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-380bc628-cad1-440c-a4c9-008f1087c26c tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 200 len: 1315 microversion: 2.1 time: 0.195277 Jan 22 21:20:36.774680 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3005/6293] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:36 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:36.792444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7c752b68-f44b-439b-a65f-654153f608d0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:36.793754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7c752b68-f44b-439b-a65f-654153f608d0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:36.813363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c752b68-f44b-439b-a65f-654153f608d0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:36.814037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c752b68-f44b-439b-a65f-654153f608d0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:36.815230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c752b68-f44b-439b-a65f-654153f608d0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:36.815865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c752b68-f44b-439b-a65f-654153f608d0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:36.919398 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7c752b68-f44b-439b-a65f-654153f608d0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.132200 Jan 22 21:20:36.920057 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3289/6294] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:36 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:37.071108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-033c4ac8-f691-4d11-8161-cfcd85ed2a1e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:37.072138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-033c4ac8-f691-4d11-8161-cfcd85ed2a1e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:37.082125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-033c4ac8-f691-4d11-8161-cfcd85ed2a1e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:37.084915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-033c4ac8-f691-4d11-8161-cfcd85ed2a1e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:37.084915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-033c4ac8-f691-4d11-8161-cfcd85ed2a1e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:37.088526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-033c4ac8-f691-4d11-8161-cfcd85ed2a1e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:37.170429 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-033c4ac8-f691-4d11-8161-cfcd85ed2a1e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.102537 Jan 22 21:20:37.171218 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3006/6295] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:37 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:37.397194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dde0657a-f2be-4b14-870b-78d82a6f3213 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:37.398025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dde0657a-f2be-4b14-870b-78d82a6f3213 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:37.407530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cac15d52-4aa8-4bcc-abb7-766e84aee1c4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:37.409232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cac15d52-4aa8-4bcc-abb7-766e84aee1c4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:37.436748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dde0657a-f2be-4b14-870b-78d82a6f3213 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:37.442524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cac15d52-4aa8-4bcc-abb7-766e84aee1c4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:37.443364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cac15d52-4aa8-4bcc-abb7-766e84aee1c4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:37.444069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dde0657a-f2be-4b14-870b-78d82a6f3213 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:37.445140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cac15d52-4aa8-4bcc-abb7-766e84aee1c4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:37.449652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cac15d52-4aa8-4bcc-abb7-766e84aee1c4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:37.450461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dde0657a-f2be-4b14-870b-78d82a6f3213 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:37.454333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dde0657a-f2be-4b14-870b-78d82a6f3213 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:37.570451 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cac15d52-4aa8-4bcc-abb7-766e84aee1c4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.167313 Jan 22 21:20:37.572539 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3007/6296] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:37 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:37.792125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1728f752-dab0-4fa1-aea2-33807107e791 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:37.792839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1728f752-dab0-4fa1-aea2-33807107e791 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] [instance: 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:37.804425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1728f752-dab0-4fa1-aea2-33807107e791 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:37.804762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1728f752-dab0-4fa1-aea2-33807107e791 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:37.805708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1728f752-dab0-4fa1-aea2-33807107e791 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:37.806418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1728f752-dab0-4fa1-aea2-33807107e791 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:37.842365 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-1728f752-dab0-4fa1-aea2-33807107e791 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] HTTP exception thrown: Instance 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de could not be found. Jan 22 21:20:37.843088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1728f752-dab0-4fa1-aea2-33807107e791 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] Returning 404 to user: Instance 8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:20:37.843844 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1728f752-dab0-4fa1-aea2-33807107e791 tempest-ListServerFiltersTestJSON-1565971494 tempest-ListServerFiltersTestJSON-1565971494-project] 10.222.0.100 "GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de" status: 404 len: 111 microversion: 2.1 time: 0.056623 Jan 22 21:20:37.844419 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3008/6297] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:37 2022] GET /compute/v2.1/servers/8cedf9f6-3a54-4a2e-86bf-19ae4cabe1de => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:20:37.912067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dde0657a-f2be-4b14-870b-78d82a6f3213 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:37.928918 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dde0657a-f2be-4b14-870b-78d82a6f3213 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1693 microversion: 2.1 time: 0.537586 Jan 22 21:20:37.938663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-14698e0d-3c73-4e28-a27d-56ea74ce6242 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:37.940047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-14698e0d-3c73-4e28-a27d-56ea74ce6242 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:37.946581 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3290/6298] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:37 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1693 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:37.957359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14698e0d-3c73-4e28-a27d-56ea74ce6242 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:37.958206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14698e0d-3c73-4e28-a27d-56ea74ce6242 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:37.959291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14698e0d-3c73-4e28-a27d-56ea74ce6242 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:37.959764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14698e0d-3c73-4e28-a27d-56ea74ce6242 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:38.033266 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-14698e0d-3c73-4e28-a27d-56ea74ce6242 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.098658 Jan 22 21:20:38.033944 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3009/6299] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:37 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:38.186264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-af2a1f43-8b9a-4c33-855b-b3a936fc3a9b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:38.187550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-af2a1f43-8b9a-4c33-855b-b3a936fc3a9b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:38.242016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af2a1f43-8b9a-4c33-855b-b3a936fc3a9b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:38.243412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af2a1f43-8b9a-4c33-855b-b3a936fc3a9b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:38.246461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af2a1f43-8b9a-4c33-855b-b3a936fc3a9b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:38.246908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af2a1f43-8b9a-4c33-855b-b3a936fc3a9b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:38.322700 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-af2a1f43-8b9a-4c33-855b-b3a936fc3a9b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.143306 Jan 22 21:20:38.323744 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3010/6300] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:38 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:38.383690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-83cf878f-e509-4e8f-853f-789194f64c05 req-8540037e-f77a-4aa7-a65a-4434013839b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60f5752-e3a2-40ea-97fe-c98ebb12e4f7", "name": "network-vif-plugged", "status": "completed", "tag": "3b4b9042-2ab2-4731-b9ee-9b33a072ec37"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:38.385677 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:38.385677 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:20:38.405382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-83cf878f-e509-4e8f-853f-789194f64c05 req-8540037e-f77a-4aa7-a65a-4434013839b8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:38.406023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-83cf878f-e509-4e8f-853f-789194f64c05 req-8540037e-f77a-4aa7-a65a-4434013839b8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:38.436227 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-83cf878f-e509-4e8f-853f-789194f64c05 req-8540037e-f77a-4aa7-a65a-4434013839b8 service nova] Creating event network-vif-plugged:3b4b9042-2ab2-4731-b9ee-9b33a072ec37 for instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 on nch2-master-1 Jan 22 21:20:38.457031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-83cf878f-e509-4e8f-853f-789194f64c05 req-8540037e-f77a-4aa7-a65a-4434013839b8 service nova] Instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:20:38.471235 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-83cf878f-e509-4e8f-853f-789194f64c05 req-8540037e-f77a-4aa7-a65a-4434013839b8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.410380 Jan 22 21:20:38.472392 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3291/6301] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:20:38.587816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8293100e-abd0-4a5e-b593-327aac316c7a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:38.588893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8293100e-abd0-4a5e-b593-327aac316c7a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:38.604490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8293100e-abd0-4a5e-b593-327aac316c7a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:38.605587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8293100e-abd0-4a5e-b593-327aac316c7a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:38.608227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8293100e-abd0-4a5e-b593-327aac316c7a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:38.608984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8293100e-abd0-4a5e-b593-327aac316c7a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:38.687120 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8293100e-abd0-4a5e-b593-327aac316c7a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.106286 Jan 22 21:20:38.689412 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3011/6302] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:38 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:38.952965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e85cd734-ec02-4ecb-b53a-0875ee849055 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:38.953913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e85cd734-ec02-4ecb-b53a-0875ee849055 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:38.963020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e85cd734-ec02-4ecb-b53a-0875ee849055 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:38.964935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e85cd734-ec02-4ecb-b53a-0875ee849055 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:38.970103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e85cd734-ec02-4ecb-b53a-0875ee849055 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:38.970630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e85cd734-ec02-4ecb-b53a-0875ee849055 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:39.057420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e7bafb48-0063-4a04-aab6-183c2bf7d553 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:39.059515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e7bafb48-0063-4a04-aab6-183c2bf7d553 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:39.072760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7bafb48-0063-4a04-aab6-183c2bf7d553 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:39.073720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7bafb48-0063-4a04-aab6-183c2bf7d553 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:39.074805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7bafb48-0063-4a04-aab6-183c2bf7d553 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:39.075449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7bafb48-0063-4a04-aab6-183c2bf7d553 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:39.174320 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e7bafb48-0063-4a04-aab6-183c2bf7d553 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.132392 Jan 22 21:20:39.176053 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3012/6303] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:39 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:39.342411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-43ad979b-0d03-4829-9f6e-97ebbdc76029 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:39.343999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-43ad979b-0d03-4829-9f6e-97ebbdc76029 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:39.376390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43ad979b-0d03-4829-9f6e-97ebbdc76029 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:39.380762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43ad979b-0d03-4829-9f6e-97ebbdc76029 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:39.384928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43ad979b-0d03-4829-9f6e-97ebbdc76029 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:39.386180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43ad979b-0d03-4829-9f6e-97ebbdc76029 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:39.467369 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-43ad979b-0d03-4829-9f6e-97ebbdc76029 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.134820 Jan 22 21:20:39.468789 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3013/6304] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:39 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:20:39.709658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0138739e-9ed0-4822-af53-51c3aeab33d1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:39.712196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0138739e-9ed0-4822-af53-51c3aeab33d1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:39.729217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0138739e-9ed0-4822-af53-51c3aeab33d1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:39.732340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0138739e-9ed0-4822-af53-51c3aeab33d1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:39.733385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0138739e-9ed0-4822-af53-51c3aeab33d1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:39.733994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0138739e-9ed0-4822-af53-51c3aeab33d1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:39.793736 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0138739e-9ed0-4822-af53-51c3aeab33d1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.095282 Jan 22 21:20:39.794607 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3014/6305] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:39 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:39.814892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e85cd734-ec02-4ecb-b53a-0875ee849055 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:39.823795 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e85cd734-ec02-4ecb-b53a-0875ee849055 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1693 microversion: 2.1 time: 0.874677 Jan 22 21:20:39.824322 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3292/6306] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:38 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1693 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:40.193899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-33ebeaa9-8d10-4ab4-8d47-732eb19d3141 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:40.193899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-33ebeaa9-8d10-4ab4-8d47-732eb19d3141 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:40.204502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33ebeaa9-8d10-4ab4-8d47-732eb19d3141 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:40.206546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33ebeaa9-8d10-4ab4-8d47-732eb19d3141 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:40.207475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33ebeaa9-8d10-4ab4-8d47-732eb19d3141 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:40.213395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33ebeaa9-8d10-4ab4-8d47-732eb19d3141 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:40.311030 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-33ebeaa9-8d10-4ab4-8d47-732eb19d3141 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.126728 Jan 22 21:20:40.313023 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3015/6307] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:40 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:40.482797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2718c998-0a17-43e3-b224-f2fd1f9d5adc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:40.484752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2718c998-0a17-43e3-b224-f2fd1f9d5adc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:40.495629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2718c998-0a17-43e3-b224-f2fd1f9d5adc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:40.501818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2718c998-0a17-43e3-b224-f2fd1f9d5adc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:40.503850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2718c998-0a17-43e3-b224-f2fd1f9d5adc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:40.510492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2718c998-0a17-43e3-b224-f2fd1f9d5adc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:40.591499 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2718c998-0a17-43e3-b224-f2fd1f9d5adc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.116488 Jan 22 21:20:40.592163 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3293/6308] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:40 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:20:40.812844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d2004d9-0803-446a-ab72-27420afa7785 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:40.814506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d2004d9-0803-446a-ab72-27420afa7785 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:40.830117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d2004d9-0803-446a-ab72-27420afa7785 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:40.830920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d2004d9-0803-446a-ab72-27420afa7785 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:40.831917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d2004d9-0803-446a-ab72-27420afa7785 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:40.832545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d2004d9-0803-446a-ab72-27420afa7785 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:40.843869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-964c2552-fdb5-414f-a013-c6a9f296311d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:40.849119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-964c2552-fdb5-414f-a013-c6a9f296311d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:40.861733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-964c2552-fdb5-414f-a013-c6a9f296311d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:40.863804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-964c2552-fdb5-414f-a013-c6a9f296311d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:40.864816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-964c2552-fdb5-414f-a013-c6a9f296311d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:40.866022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-964c2552-fdb5-414f-a013-c6a9f296311d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:40.929147 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d2004d9-0803-446a-ab72-27420afa7785 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.120557 Jan 22 21:20:40.933043 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3016/6309] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:40 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:41.099343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-964c2552-fdb5-414f-a013-c6a9f296311d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:41.121468 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-964c2552-fdb5-414f-a013-c6a9f296311d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1693 microversion: 2.1 time: 0.275513 Jan 22 21:20:41.122761 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3294/6310] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:40 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1693 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:41.326340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a6192d9e-56fd-4fe3-9020-4bf0aaf2ab5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:41.328044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a6192d9e-56fd-4fe3-9020-4bf0aaf2ab5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:41.349428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6192d9e-56fd-4fe3-9020-4bf0aaf2ab5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:41.350443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6192d9e-56fd-4fe3-9020-4bf0aaf2ab5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:41.353039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6192d9e-56fd-4fe3-9020-4bf0aaf2ab5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:41.354232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6192d9e-56fd-4fe3-9020-4bf0aaf2ab5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:41.488594 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a6192d9e-56fd-4fe3-9020-4bf0aaf2ab5d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.168338 Jan 22 21:20:41.489797 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3017/6311] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:41 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:41.603660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9df8aaf4-7318-46c6-b481-6ec26a68313c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:41.604588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9df8aaf4-7318-46c6-b481-6ec26a68313c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:41.611721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9df8aaf4-7318-46c6-b481-6ec26a68313c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:41.612424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9df8aaf4-7318-46c6-b481-6ec26a68313c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:41.613449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9df8aaf4-7318-46c6-b481-6ec26a68313c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:41.614091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9df8aaf4-7318-46c6-b481-6ec26a68313c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:41.712023 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9df8aaf4-7318-46c6-b481-6ec26a68313c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.112355 Jan 22 21:20:41.719849 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3295/6312] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:41 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:41.942533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bde48482-ee2b-4dd9-8808-0b2d3d48c150 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:41.943557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bde48482-ee2b-4dd9-8808-0b2d3d48c150 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:41.964293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bde48482-ee2b-4dd9-8808-0b2d3d48c150 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:41.964761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bde48482-ee2b-4dd9-8808-0b2d3d48c150 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:41.968009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bde48482-ee2b-4dd9-8808-0b2d3d48c150 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:41.968509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bde48482-ee2b-4dd9-8808-0b2d3d48c150 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:42.055794 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bde48482-ee2b-4dd9-8808-0b2d3d48c150 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.117459 Jan 22 21:20:42.064222 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3018/6313] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:41 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:42.139532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cb500f2b-9327-4fda-b4c7-3e48bd0e6c31 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:42.140884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cb500f2b-9327-4fda-b4c7-3e48bd0e6c31 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:42.148080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb500f2b-9327-4fda-b4c7-3e48bd0e6c31 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:42.148823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb500f2b-9327-4fda-b4c7-3e48bd0e6c31 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:42.149892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb500f2b-9327-4fda-b4c7-3e48bd0e6c31 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:42.150547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb500f2b-9327-4fda-b4c7-3e48bd0e6c31 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:42.286961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-01467030-75c2-4f7e-9719-3e011869008f req-1cdb54fb-aa20-43ee-a2e4-422f78b27890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60f5752-e3a2-40ea-97fe-c98ebb12e4f7", "name": "network-vif-unplugged", "status": "completed", "tag": "3b4b9042-2ab2-4731-b9ee-9b33a072ec37"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:42.291370 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:42.291370 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:20:42.314167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-01467030-75c2-4f7e-9719-3e011869008f req-1cdb54fb-aa20-43ee-a2e4-422f78b27890 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:42.314844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-01467030-75c2-4f7e-9719-3e011869008f req-1cdb54fb-aa20-43ee-a2e4-422f78b27890 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:42.329733 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-01467030-75c2-4f7e-9719-3e011869008f req-1cdb54fb-aa20-43ee-a2e4-422f78b27890 service nova] Creating event network-vif-unplugged:3b4b9042-2ab2-4731-b9ee-9b33a072ec37 for instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 on nch1-master-1 Jan 22 21:20:42.339608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-01467030-75c2-4f7e-9719-3e011869008f req-1cdb54fb-aa20-43ee-a2e4-422f78b27890 service nova] Instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:20:42.350202 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-01467030-75c2-4f7e-9719-3e011869008f req-1cdb54fb-aa20-43ee-a2e4-422f78b27890 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072329 Jan 22 21:20:42.351035 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3019/6314] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:20:42.501493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-990356e8-9fe1-4b88-a888-cc7574bbfc9c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:42.502604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-990356e8-9fe1-4b88-a888-cc7574bbfc9c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:42.517553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-990356e8-9fe1-4b88-a888-cc7574bbfc9c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:42.519960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-990356e8-9fe1-4b88-a888-cc7574bbfc9c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:42.519960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-990356e8-9fe1-4b88-a888-cc7574bbfc9c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:42.519960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-990356e8-9fe1-4b88-a888-cc7574bbfc9c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:42.612110 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-990356e8-9fe1-4b88-a888-cc7574bbfc9c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.113364 Jan 22 21:20:42.614428 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3020/6315] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:42 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:42.709234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cb500f2b-9327-4fda-b4c7-3e48bd0e6c31 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:42.722853 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cb500f2b-9327-4fda-b4c7-3e48bd0e6c31 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1693 microversion: 2.1 time: 0.587238 Jan 22 21:20:42.723939 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3296/6316] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:42 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1693 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:42.726144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-84e3ac11-4490-409b-890e-add46c84ce23 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:42.729543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-84e3ac11-4490-409b-890e-add46c84ce23 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:42.748500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84e3ac11-4490-409b-890e-add46c84ce23 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:42.753240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84e3ac11-4490-409b-890e-add46c84ce23 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:42.754344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84e3ac11-4490-409b-890e-add46c84ce23 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:42.757615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-84e3ac11-4490-409b-890e-add46c84ce23 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:42.852290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-84e3ac11-4490-409b-890e-add46c84ce23 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.129277 Jan 22 21:20:42.855110 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3021/6317] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:42 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:20:43.075681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f934fde-f73e-4fb6-bbc7-cf4f19846d5f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:43.080683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8f934fde-f73e-4fb6-bbc7-cf4f19846d5f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:43.089976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f934fde-f73e-4fb6-bbc7-cf4f19846d5f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:43.090775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f934fde-f73e-4fb6-bbc7-cf4f19846d5f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:43.091497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f934fde-f73e-4fb6-bbc7-cf4f19846d5f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:43.092054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f934fde-f73e-4fb6-bbc7-cf4f19846d5f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:43.147550 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8f934fde-f73e-4fb6-bbc7-cf4f19846d5f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.075522 Jan 22 21:20:43.150177 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3297/6318] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:43 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:43.625714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-923e04dc-37a9-465e-adf0-d9a78145b24e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:43.626742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-923e04dc-37a9-465e-adf0-d9a78145b24e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:43.644845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-923e04dc-37a9-465e-adf0-d9a78145b24e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:43.644845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-923e04dc-37a9-465e-adf0-d9a78145b24e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:43.644845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-923e04dc-37a9-465e-adf0-d9a78145b24e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:43.644845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-923e04dc-37a9-465e-adf0-d9a78145b24e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:43.743860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-81113fbe-1b01-4a20-a9c1-5adca7b12f1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:43.744731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-81113fbe-1b01-4a20-a9c1-5adca7b12f1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:43.772386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81113fbe-1b01-4a20-a9c1-5adca7b12f1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:43.781559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81113fbe-1b01-4a20-a9c1-5adca7b12f1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:43.783097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81113fbe-1b01-4a20-a9c1-5adca7b12f1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:43.788155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81113fbe-1b01-4a20-a9c1-5adca7b12f1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:43.803444 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-923e04dc-37a9-465e-adf0-d9a78145b24e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.181205 Jan 22 21:20:43.805566 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3022/6319] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:43 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:43.866919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8e3de188-1933-41b2-a3f1-d2dca34f2cf8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:43.868902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8e3de188-1933-41b2-a3f1-d2dca34f2cf8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:43.887014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e3de188-1933-41b2-a3f1-d2dca34f2cf8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:43.887756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e3de188-1933-41b2-a3f1-d2dca34f2cf8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:43.893304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e3de188-1933-41b2-a3f1-d2dca34f2cf8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:43.893304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e3de188-1933-41b2-a3f1-d2dca34f2cf8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:43.978943 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8e3de188-1933-41b2-a3f1-d2dca34f2cf8 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.116336 Jan 22 21:20:43.985739 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3023/6320] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:43 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:20:44.118701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-81113fbe-1b01-4a20-a9c1-5adca7b12f1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:44.140112 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-81113fbe-1b01-4a20-a9c1-5adca7b12f1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1693 microversion: 2.1 time: 0.401810 Jan 22 21:20:44.146423 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3298/6321] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:43 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1693 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:44.164753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab9e88b2-0bf3-4fca-86cc-1dd97c97f82b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:44.167706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab9e88b2-0bf3-4fca-86cc-1dd97c97f82b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:44.182185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab9e88b2-0bf3-4fca-86cc-1dd97c97f82b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:44.183561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab9e88b2-0bf3-4fca-86cc-1dd97c97f82b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:44.189386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab9e88b2-0bf3-4fca-86cc-1dd97c97f82b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:44.191001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab9e88b2-0bf3-4fca-86cc-1dd97c97f82b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:44.273737 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab9e88b2-0bf3-4fca-86cc-1dd97c97f82b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.112954 Jan 22 21:20:44.280056 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3024/6322] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:44 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:44.412715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-d90ebfd4-c060-4119-8015-1f0dfb18f522 req-664f1d72-a93b-47f1-8ed9-23675b9cf177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60f5752-e3a2-40ea-97fe-c98ebb12e4f7", "tag": "3b4b9042-2ab2-4731-b9ee-9b33a072ec37"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:44.416028 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:44.416028 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:20:44.429820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d90ebfd4-c060-4119-8015-1f0dfb18f522 req-664f1d72-a93b-47f1-8ed9-23675b9cf177 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:44.431395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d90ebfd4-c060-4119-8015-1f0dfb18f522 req-664f1d72-a93b-47f1-8ed9-23675b9cf177 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:44.474345 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d90ebfd4-c060-4119-8015-1f0dfb18f522 req-664f1d72-a93b-47f1-8ed9-23675b9cf177 service nova] Creating event network-changed:3b4b9042-2ab2-4731-b9ee-9b33a072ec37 for instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 on nch1-master-1 Jan 22 21:20:44.482769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-d90ebfd4-c060-4119-8015-1f0dfb18f522 req-664f1d72-a93b-47f1-8ed9-23675b9cf177 service nova] Instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:20:44.523781 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-d90ebfd4-c060-4119-8015-1f0dfb18f522 req-664f1d72-a93b-47f1-8ed9-23675b9cf177 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117229 Jan 22 21:20:44.530953 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3299/6323] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:20:44.825672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-526a2087-e820-4da9-8d8b-88e2bab697ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:44.828293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-526a2087-e820-4da9-8d8b-88e2bab697ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:44.838920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-526a2087-e820-4da9-8d8b-88e2bab697ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:44.839721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-526a2087-e820-4da9-8d8b-88e2bab697ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:44.840751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-526a2087-e820-4da9-8d8b-88e2bab697ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:44.841591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-526a2087-e820-4da9-8d8b-88e2bab697ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:44.909014 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-526a2087-e820-4da9-8d8b-88e2bab697ba tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.091915 Jan 22 21:20:44.910641 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3025/6324] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:44 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:44.994073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b38f87cc-1bed-4130-8b50-fd7c62b31a36 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:44.995514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b38f87cc-1bed-4130-8b50-fd7c62b31a36 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:45.002275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b38f87cc-1bed-4130-8b50-fd7c62b31a36 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:45.002961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b38f87cc-1bed-4130-8b50-fd7c62b31a36 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:45.003923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b38f87cc-1bed-4130-8b50-fd7c62b31a36 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:45.004513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b38f87cc-1bed-4130-8b50-fd7c62b31a36 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:45.068858 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b38f87cc-1bed-4130-8b50-fd7c62b31a36 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.079991 Jan 22 21:20:45.070898 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3300/6325] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:44 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:45.168771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c42b73c1-2462-4f1d-af89-370800f53eb3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:45.169678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c42b73c1-2462-4f1d-af89-370800f53eb3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:45.177576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c42b73c1-2462-4f1d-af89-370800f53eb3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:45.178240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c42b73c1-2462-4f1d-af89-370800f53eb3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:45.179182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c42b73c1-2462-4f1d-af89-370800f53eb3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:45.180311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c42b73c1-2462-4f1d-af89-370800f53eb3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:45.288540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cc45cb84-6042-4f1a-81bb-483d51b8ec6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:45.290960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cc45cb84-6042-4f1a-81bb-483d51b8ec6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:45.304060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc45cb84-6042-4f1a-81bb-483d51b8ec6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:45.304698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc45cb84-6042-4f1a-81bb-483d51b8ec6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:45.306254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc45cb84-6042-4f1a-81bb-483d51b8ec6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:45.311720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc45cb84-6042-4f1a-81bb-483d51b8ec6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:45.362323 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cc45cb84-6042-4f1a-81bb-483d51b8ec6c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.078672 Jan 22 21:20:45.363272 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3301/6326] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:45 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:45.685102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c42b73c1-2462-4f1d-af89-370800f53eb3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:45.696782 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c42b73c1-2462-4f1d-af89-370800f53eb3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1693 microversion: 2.1 time: 0.536488 Jan 22 21:20:45.697431 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3026/6327] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:45 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1693 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:45.921747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad87d079-5470-4130-a5d3-3bbf2d07164c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:45.922749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad87d079-5470-4130-a5d3-3bbf2d07164c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:45.930705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad87d079-5470-4130-a5d3-3bbf2d07164c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:45.931671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad87d079-5470-4130-a5d3-3bbf2d07164c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:45.932625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad87d079-5470-4130-a5d3-3bbf2d07164c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:45.933212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad87d079-5470-4130-a5d3-3bbf2d07164c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:46.000295 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad87d079-5470-4130-a5d3-3bbf2d07164c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.082584 Jan 22 21:20:46.000959 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3302/6328] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:45 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:46.083266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4076bbaf-5260-42e4-8039-8fad13267c46 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:46.084802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4076bbaf-5260-42e4-8039-8fad13267c46 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:46.095825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4076bbaf-5260-42e4-8039-8fad13267c46 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:46.096445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4076bbaf-5260-42e4-8039-8fad13267c46 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:46.097425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4076bbaf-5260-42e4-8039-8fad13267c46 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:46.098274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4076bbaf-5260-42e4-8039-8fad13267c46 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:46.187541 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4076bbaf-5260-42e4-8039-8fad13267c46 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.108572 Jan 22 21:20:46.190942 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3027/6329] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:46 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:46.376030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-753bf530-2972-4c67-ab00-291171ad3128 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:46.377046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-753bf530-2972-4c67-ab00-291171ad3128 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:46.388234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-753bf530-2972-4c67-ab00-291171ad3128 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:46.388709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-753bf530-2972-4c67-ab00-291171ad3128 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:46.393700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-753bf530-2972-4c67-ab00-291171ad3128 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:46.398102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-753bf530-2972-4c67-ab00-291171ad3128 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:46.454703 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-753bf530-2972-4c67-ab00-291171ad3128 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.082733 Jan 22 21:20:46.457203 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3303/6330] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:46 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:46.715030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a03548a-6d71-4b5c-b521-afa8faf790c5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:46.715749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9a03548a-6d71-4b5c-b521-afa8faf790c5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:46.725086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a03548a-6d71-4b5c-b521-afa8faf790c5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:46.725615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a03548a-6d71-4b5c-b521-afa8faf790c5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:46.727053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a03548a-6d71-4b5c-b521-afa8faf790c5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:46.730569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a03548a-6d71-4b5c-b521-afa8faf790c5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:47.015053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6f326eee-ebdb-448f-af07-dd9898aedd70 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:47.016132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6f326eee-ebdb-448f-af07-dd9898aedd70 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:47.028403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f326eee-ebdb-448f-af07-dd9898aedd70 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:47.029101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f326eee-ebdb-448f-af07-dd9898aedd70 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:47.031502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f326eee-ebdb-448f-af07-dd9898aedd70 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:47.031502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f326eee-ebdb-448f-af07-dd9898aedd70 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:47.093120 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6f326eee-ebdb-448f-af07-dd9898aedd70 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.082632 Jan 22 21:20:47.094468 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3304/6331] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:47 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:47.138022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9a03548a-6d71-4b5c-b521-afa8faf790c5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:47.147335 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a03548a-6d71-4b5c-b521-afa8faf790c5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1693 microversion: 2.1 time: 0.437470 Jan 22 21:20:47.161637 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3028/6332] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:46 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1693 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:47.204534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cd3ffa67-2266-43ea-b76a-2fc9a313de32 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:47.205815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cd3ffa67-2266-43ea-b76a-2fc9a313de32 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:47.215469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd3ffa67-2266-43ea-b76a-2fc9a313de32 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:47.215935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd3ffa67-2266-43ea-b76a-2fc9a313de32 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:47.216909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd3ffa67-2266-43ea-b76a-2fc9a313de32 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:47.217458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd3ffa67-2266-43ea-b76a-2fc9a313de32 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:47.264889 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cd3ffa67-2266-43ea-b76a-2fc9a313de32 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.066608 Jan 22 21:20:47.265584 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3305/6333] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:47 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:47.471708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d04eb72a-dc00-4c13-8ae9-8290a56c0050 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:47.472647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d04eb72a-dc00-4c13-8ae9-8290a56c0050 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:47.496308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d04eb72a-dc00-4c13-8ae9-8290a56c0050 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:47.496769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d04eb72a-dc00-4c13-8ae9-8290a56c0050 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:47.500984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d04eb72a-dc00-4c13-8ae9-8290a56c0050 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:47.501673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d04eb72a-dc00-4c13-8ae9-8290a56c0050 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:47.585161 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d04eb72a-dc00-4c13-8ae9-8290a56c0050 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.120576 Jan 22 21:20:47.588670 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3029/6334] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:47 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:48.109070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-974e00fe-2e75-4bde-aa2e-789bfdb6997e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:48.110703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-974e00fe-2e75-4bde-aa2e-789bfdb6997e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:48.127905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-974e00fe-2e75-4bde-aa2e-789bfdb6997e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:48.133986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-974e00fe-2e75-4bde-aa2e-789bfdb6997e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:48.135574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-974e00fe-2e75-4bde-aa2e-789bfdb6997e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:48.136465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-974e00fe-2e75-4bde-aa2e-789bfdb6997e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:48.156475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-410473798", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "16c53b7e-a7fb-4102-944c-7c89ad464582"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:48.250892 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-974e00fe-2e75-4bde-aa2e-789bfdb6997e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.149666 Jan 22 21:20:48.254729 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3030/6335] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:48 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:48.257254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8c9f411a-c5e9-4fbf-929e-f192131f2d46 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:48.258072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8c9f411a-c5e9-4fbf-929e-f192131f2d46 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:48.277862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c9f411a-c5e9-4fbf-929e-f192131f2d46 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:48.278320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c9f411a-c5e9-4fbf-929e-f192131f2d46 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:48.279178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c9f411a-c5e9-4fbf-929e-f192131f2d46 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:48.279617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c9f411a-c5e9-4fbf-929e-f192131f2d46 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:48.304254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] validate_networks() for [('16c53b7e-a7fb-4102-944c-7c89ad464582', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:20:49.132658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8c9f411a-c5e9-4fbf-929e-f192131f2d46 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:49.161546 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8c9f411a-c5e9-4fbf-929e-f192131f2d46 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1693 microversion: 2.1 time: 0.907625 Jan 22 21:20:49.162901 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3031/6336] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:48 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1693 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:49.178031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c03768b2-54d5-4c75-9261-621955e55ac9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:49.181348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c03768b2-54d5-4c75-9261-621955e55ac9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:49.196700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c03768b2-54d5-4c75-9261-621955e55ac9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:49.199994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c03768b2-54d5-4c75-9261-621955e55ac9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:49.201038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c03768b2-54d5-4c75-9261-621955e55ac9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:49.202459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c03768b2-54d5-4c75-9261-621955e55ac9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:49.342102 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c03768b2-54d5-4c75-9261-621955e55ac9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.175354 Jan 22 21:20:49.344613 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3032/6337] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:49 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:49.367814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48090ca5-ae75-4e47-9740-bda885416baa tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:49.370568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48090ca5-ae75-4e47-9740-bda885416baa tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:49.395856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48090ca5-ae75-4e47-9740-bda885416baa tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:49.402772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48090ca5-ae75-4e47-9740-bda885416baa tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:49.402772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48090ca5-ae75-4e47-9740-bda885416baa tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:49.402772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48090ca5-ae75-4e47-9740-bda885416baa tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:49.486106 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48090ca5-ae75-4e47-9740-bda885416baa tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.139383 Jan 22 21:20:49.490727 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3033/6338] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:49 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:49.496747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9bbee20c-bc18-42d9-9c1e-d181316960ee tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:49.497905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9bbee20c-bc18-42d9-9c1e-d181316960ee tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:49.502019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:20:49.503200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:20:49.505112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bbee20c-bc18-42d9-9c1e-d181316960ee tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:49.505779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bbee20c-bc18-42d9-9c1e-d181316960ee tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:49.506267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:20:49.506858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:20:49.507067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bbee20c-bc18-42d9-9c1e-d181316960ee tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:49.508186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bbee20c-bc18-42d9-9c1e-d181316960ee tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:49.508298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:20:49.538534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:49.542088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:49.543379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:49.544699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:49.596257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Getting quotas for project 244ce0b0dfa143f0ac03979238985231. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:20:49.615906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Getting quotas for user 73c362b21cfa45dc8087857e5f3c84ce and project 244ce0b0dfa143f0ac03979238985231. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:20:49.638313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:20:49.639878 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9bbee20c-bc18-42d9-9c1e-d181316960ee tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.147051 Jan 22 21:20:49.640847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:20:49.642809 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3034/6339] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:49 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:49.788877 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-89af3f61-27eb-4672-8769-d1bfdeb75032 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.029939 Jan 22 21:20:49.794710 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3306/6340] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:20:47 2022] POST /compute/v2.1/servers => generated 382 bytes in 2037 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:20:49.819542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5cdbd8d8-80b2-4907-b9ed-2b087713604c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:49.819542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5cdbd8d8-80b2-4907-b9ed-2b087713604c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:50.184009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-671f0b91-1080-445c-80c7-e8fa5ea2eea8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:50.186321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-671f0b91-1080-445c-80c7-e8fa5ea2eea8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:50.208377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-671f0b91-1080-445c-80c7-e8fa5ea2eea8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:50.213545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-671f0b91-1080-445c-80c7-e8fa5ea2eea8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:50.227375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-671f0b91-1080-445c-80c7-e8fa5ea2eea8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:50.227375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-671f0b91-1080-445c-80c7-e8fa5ea2eea8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:50.529541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5cdbd8d8-80b2-4907-b9ed-2b087713604c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c362b21cfa45dc8087857e5f3c84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244ce0b0dfa143f0ac03979238985231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:50.536725 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5cdbd8d8-80b2-4907-b9ed-2b087713604c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 200 len: 1227 microversion: 2.1 time: 0.739150 Jan 22 21:20:50.539338 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3035/6341] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:49 2022] GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 1227 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:50.541383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-671f0b91-1080-445c-80c7-e8fa5ea2eea8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:50.562163 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-671f0b91-1080-445c-80c7-e8fa5ea2eea8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1686 microversion: 2.1 time: 0.383010 Jan 22 21:20:50.562817 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3307/6342] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:50 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1686 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:50.578182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-04374c1e-ea86-4451-8857-b9eec32039b3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:50.579648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-04374c1e-ea86-4451-8857-b9eec32039b3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:50.583203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6815b99c-38d0-4030-a10c-5335e77f6c59 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:50.584592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6815b99c-38d0-4030-a10c-5335e77f6c59 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:50.593824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6815b99c-38d0-4030-a10c-5335e77f6c59 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:50.594677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6815b99c-38d0-4030-a10c-5335e77f6c59 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:50.595929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6815b99c-38d0-4030-a10c-5335e77f6c59 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:50.596536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6815b99c-38d0-4030-a10c-5335e77f6c59 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:50.615011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04374c1e-ea86-4451-8857-b9eec32039b3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:50.628068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04374c1e-ea86-4451-8857-b9eec32039b3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:50.629614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04374c1e-ea86-4451-8857-b9eec32039b3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:50.632178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04374c1e-ea86-4451-8857-b9eec32039b3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:50.685879 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6815b99c-38d0-4030-a10c-5335e77f6c59 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.100806 Jan 22 21:20:50.687171 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3308/6343] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:50 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:50.693138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3469615-df62-4c93-b270-f59586e81519 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:50.697605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d3469615-df62-4c93-b270-f59586e81519 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:50.705204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3469615-df62-4c93-b270-f59586e81519 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:50.707650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3469615-df62-4c93-b270-f59586e81519 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:50.708735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3469615-df62-4c93-b270-f59586e81519 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:50.709360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3469615-df62-4c93-b270-f59586e81519 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:50.716290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-04374c1e-ea86-4451-8857-b9eec32039b3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.173543 Jan 22 21:20:50.717155 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3036/6344] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:50 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:50.764556 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d3469615-df62-4c93-b270-f59586e81519 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.075840 Jan 22 21:20:50.765244 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3309/6345] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:50 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:51.558628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6b17af60-5eab-44a8-9c4c-d724b176f442 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:51.560514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6b17af60-5eab-44a8-9c4c-d724b176f442 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:51.627960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6b17af60-5eab-44a8-9c4c-d724b176f442 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c362b21cfa45dc8087857e5f3c84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244ce0b0dfa143f0ac03979238985231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:51.635786 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6b17af60-5eab-44a8-9c4c-d724b176f442 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 200 len: 1227 microversion: 2.1 time: 0.082781 Jan 22 21:20:51.636382 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3037/6346] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:51 2022] GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 1227 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:20:51.699159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ce623cca-8fbd-4e4f-a784-dbf2feaa2b9a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:51.701049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ce623cca-8fbd-4e4f-a784-dbf2feaa2b9a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:51.713712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce623cca-8fbd-4e4f-a784-dbf2feaa2b9a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:51.714662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce623cca-8fbd-4e4f-a784-dbf2feaa2b9a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:51.715838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce623cca-8fbd-4e4f-a784-dbf2feaa2b9a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:51.717066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce623cca-8fbd-4e4f-a784-dbf2feaa2b9a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:51.735546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b5ee62f2-1933-4cc8-9784-9af3acaf832d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:51.737230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b5ee62f2-1933-4cc8-9784-9af3acaf832d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:51.765659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5ee62f2-1933-4cc8-9784-9af3acaf832d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:51.768582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5ee62f2-1933-4cc8-9784-9af3acaf832d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:51.770362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5ee62f2-1933-4cc8-9784-9af3acaf832d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:51.770814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5ee62f2-1933-4cc8-9784-9af3acaf832d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:51.774675 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ce623cca-8fbd-4e4f-a784-dbf2feaa2b9a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.080565 Jan 22 21:20:51.779776 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3310/6347] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:51 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:51.792325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-93e54c09-f1a5-418a-a4e0-ba5ac137b00e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:51.792325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-93e54c09-f1a5-418a-a4e0-ba5ac137b00e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:51.799115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93e54c09-f1a5-418a-a4e0-ba5ac137b00e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:51.799810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93e54c09-f1a5-418a-a4e0-ba5ac137b00e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:51.801093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93e54c09-f1a5-418a-a4e0-ba5ac137b00e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:51.801732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93e54c09-f1a5-418a-a4e0-ba5ac137b00e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:51.841463 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b5ee62f2-1933-4cc8-9784-9af3acaf832d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.116433 Jan 22 21:20:51.842317 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3038/6348] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:51 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:20:51.865026 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-93e54c09-f1a5-418a-a4e0-ba5ac137b00e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.082930 Jan 22 21:20:51.865717 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3311/6349] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:51 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:52.355003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-a97e91b4-5f4e-4710-8de2-c0c86a910dbf req-b47e177b-adbf-4b88-bd1e-ca8dbfd101a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60f5752-e3a2-40ea-97fe-c98ebb12e4f7", "name": "network-vif-plugged", "status": "completed", "tag": "3b4b9042-2ab2-4731-b9ee-9b33a072ec37"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:52.356913 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:52.356913 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:20:52.366656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a97e91b4-5f4e-4710-8de2-c0c86a910dbf req-b47e177b-adbf-4b88-bd1e-ca8dbfd101a9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:52.367943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a97e91b4-5f4e-4710-8de2-c0c86a910dbf req-b47e177b-adbf-4b88-bd1e-ca8dbfd101a9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:52.398705 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-a97e91b4-5f4e-4710-8de2-c0c86a910dbf req-b47e177b-adbf-4b88-bd1e-ca8dbfd101a9 service nova] Creating event network-vif-plugged:3b4b9042-2ab2-4731-b9ee-9b33a072ec37 for instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 on nch1-master-1 Jan 22 21:20:52.405133 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-a97e91b4-5f4e-4710-8de2-c0c86a910dbf req-b47e177b-adbf-4b88-bd1e-ca8dbfd101a9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054748 Jan 22 21:20:52.406329 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3039/6350] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:20:52.654103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-52497f5c-6f6f-4970-befd-b5c37b3d4332 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:52.655326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-52497f5c-6f6f-4970-befd-b5c37b3d4332 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:52.662541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52497f5c-6f6f-4970-befd-b5c37b3d4332 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:52.663351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52497f5c-6f6f-4970-befd-b5c37b3d4332 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:52.665451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52497f5c-6f6f-4970-befd-b5c37b3d4332 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:52.666120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52497f5c-6f6f-4970-befd-b5c37b3d4332 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:52.787600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-52497f5c-6f6f-4970-befd-b5c37b3d4332 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c362b21cfa45dc8087857e5f3c84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244ce0b0dfa143f0ac03979238985231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:52.797346 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-52497f5c-6f6f-4970-befd-b5c37b3d4332 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 200 len: 1279 microversion: 2.1 time: 0.148659 Jan 22 21:20:52.798923 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3312/6351] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:52 2022] GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 1279 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:52.807413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d8247b0-e256-4f66-9198-163c443caeca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:52.808477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d8247b0-e256-4f66-9198-163c443caeca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:52.816978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d8247b0-e256-4f66-9198-163c443caeca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:52.824522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d8247b0-e256-4f66-9198-163c443caeca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:52.824522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d8247b0-e256-4f66-9198-163c443caeca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:52.824522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d8247b0-e256-4f66-9198-163c443caeca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:52.854598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b9477ef4-05db-4d98-bd0d-264289bcecc2 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:52.857006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b9477ef4-05db-4d98-bd0d-264289bcecc2 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:52.877880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9477ef4-05db-4d98-bd0d-264289bcecc2 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:52.878583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9477ef4-05db-4d98-bd0d-264289bcecc2 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:52.880795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9477ef4-05db-4d98-bd0d-264289bcecc2 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:52.881581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9477ef4-05db-4d98-bd0d-264289bcecc2 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:52.890327 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d8247b0-e256-4f66-9198-163c443caeca tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.105565 Jan 22 21:20:52.890989 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3040/6352] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:52 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:52.903533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2270e8b7-69d3-4742-8b98-bb8f37cc28b4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:52.908779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2270e8b7-69d3-4742-8b98-bb8f37cc28b4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:52.920948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2270e8b7-69d3-4742-8b98-bb8f37cc28b4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:52.922264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2270e8b7-69d3-4742-8b98-bb8f37cc28b4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:52.923186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2270e8b7-69d3-4742-8b98-bb8f37cc28b4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:52.923749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2270e8b7-69d3-4742-8b98-bb8f37cc28b4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:52.945860 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b9477ef4-05db-4d98-bd0d-264289bcecc2 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.095827 Jan 22 21:20:52.947341 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3313/6353] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:52 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:52.994443 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2270e8b7-69d3-4742-8b98-bb8f37cc28b4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.099828 Jan 22 21:20:52.997544 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3041/6354] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:52 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:53.817686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-030197dc-bcf6-4899-ad2d-3b008884e21c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:53.822222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-030197dc-bcf6-4899-ad2d-3b008884e21c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:53.832744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-030197dc-bcf6-4899-ad2d-3b008884e21c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:53.833524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-030197dc-bcf6-4899-ad2d-3b008884e21c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:53.835943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-030197dc-bcf6-4899-ad2d-3b008884e21c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:53.836681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-030197dc-bcf6-4899-ad2d-3b008884e21c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:53.903490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-289fdfc0-5220-4994-ab33-8c5407a7d539 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:53.904507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-289fdfc0-5220-4994-ab33-8c5407a7d539 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:53.922389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-289fdfc0-5220-4994-ab33-8c5407a7d539 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:53.923155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-289fdfc0-5220-4994-ab33-8c5407a7d539 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:53.924139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-289fdfc0-5220-4994-ab33-8c5407a7d539 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:53.924756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-289fdfc0-5220-4994-ab33-8c5407a7d539 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:53.983740 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-289fdfc0-5220-4994-ab33-8c5407a7d539 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.084002 Jan 22 21:20:53.985057 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3042/6355] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:53 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:53.992645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-030197dc-bcf6-4899-ad2d-3b008884e21c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c362b21cfa45dc8087857e5f3c84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244ce0b0dfa143f0ac03979238985231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:53.995043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-67d2858f-c3ba-414c-a6ac-d8c1d5e261ef tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:53.996269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-67d2858f-c3ba-414c-a6ac-d8c1d5e261ef tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:54.002643 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-030197dc-bcf6-4899-ad2d-3b008884e21c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 200 len: 1297 microversion: 2.1 time: 0.191379 Jan 22 21:20:54.006790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67d2858f-c3ba-414c-a6ac-d8c1d5e261ef tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:54.008200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67d2858f-c3ba-414c-a6ac-d8c1d5e261ef tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:54.010042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67d2858f-c3ba-414c-a6ac-d8c1d5e261ef tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:54.010665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67d2858f-c3ba-414c-a6ac-d8c1d5e261ef tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:54.013132 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3314/6356] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:53 2022] GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 1297 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:20:54.021579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-24dc6b81-59d5-44c8-8881-76aa83e211ac tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:54.032288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-24dc6b81-59d5-44c8-8881-76aa83e211ac tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:54.040629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24dc6b81-59d5-44c8-8881-76aa83e211ac tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:54.045134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24dc6b81-59d5-44c8-8881-76aa83e211ac tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:54.046290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24dc6b81-59d5-44c8-8881-76aa83e211ac tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:54.051415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24dc6b81-59d5-44c8-8881-76aa83e211ac tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:54.079398 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-67d2858f-c3ba-414c-a6ac-d8c1d5e261ef tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.092506 Jan 22 21:20:54.083123 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3043/6357] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:53 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:54.138470 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-24dc6b81-59d5-44c8-8881-76aa83e211ac tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.124233 Jan 22 21:20:54.139392 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3315/6358] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:54 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:54.998870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4ef8fb47-5474-4e9c-994e-ace1f876e27d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:55.000090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4ef8fb47-5474-4e9c-994e-ace1f876e27d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:55.008197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ef8fb47-5474-4e9c-994e-ace1f876e27d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:55.008657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ef8fb47-5474-4e9c-994e-ace1f876e27d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:55.009758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ef8fb47-5474-4e9c-994e-ace1f876e27d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:55.010257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ef8fb47-5474-4e9c-994e-ace1f876e27d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:55.030412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-69865ba5-a503-4687-ab89-698a724403b0 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:55.031702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-69865ba5-a503-4687-ab89-698a724403b0 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:55.039951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69865ba5-a503-4687-ab89-698a724403b0 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:55.040681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69865ba5-a503-4687-ab89-698a724403b0 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:55.041583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69865ba5-a503-4687-ab89-698a724403b0 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:55.042037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69865ba5-a503-4687-ab89-698a724403b0 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:55.053004 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4ef8fb47-5474-4e9c-994e-ace1f876e27d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.060950 Jan 22 21:20:55.059432 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3044/6359] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:54 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:55.092540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-12fdba3f-448d-4a5f-910c-2a17fccc80a3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:55.093557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-12fdba3f-448d-4a5f-910c-2a17fccc80a3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:55.100745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12fdba3f-448d-4a5f-910c-2a17fccc80a3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:55.101843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12fdba3f-448d-4a5f-910c-2a17fccc80a3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:55.102644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12fdba3f-448d-4a5f-910c-2a17fccc80a3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:55.103080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12fdba3f-448d-4a5f-910c-2a17fccc80a3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:55.197278 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-12fdba3f-448d-4a5f-910c-2a17fccc80a3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.108515 Jan 22 21:20:55.205982 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3045/6360] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:55 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:55.221781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-038a48d4-c962-4bbf-9fda-1c3a460def28 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:55.221978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-038a48d4-c962-4bbf-9fda-1c3a460def28 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:55.235106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-038a48d4-c962-4bbf-9fda-1c3a460def28 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:55.235810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-038a48d4-c962-4bbf-9fda-1c3a460def28 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:55.236823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-038a48d4-c962-4bbf-9fda-1c3a460def28 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:55.237454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-038a48d4-c962-4bbf-9fda-1c3a460def28 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:55.294612 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-038a48d4-c962-4bbf-9fda-1c3a460def28 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.086291 Jan 22 21:20:55.295844 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3046/6361] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:55 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:55.298583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-69865ba5-a503-4687-ab89-698a724403b0 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c362b21cfa45dc8087857e5f3c84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244ce0b0dfa143f0ac03979238985231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:55.307891 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-69865ba5-a503-4687-ab89-698a724403b0 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 200 len: 1327 microversion: 2.1 time: 0.281379 Jan 22 21:20:55.317661 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3316/6362] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:55 2022] GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 1327 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:56.065728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-88a59ef3-d331-4c8f-b5e2-d48b26e87779 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:56.066962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-88a59ef3-d331-4c8f-b5e2-d48b26e87779 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:56.076961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88a59ef3-d331-4c8f-b5e2-d48b26e87779 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:56.077929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88a59ef3-d331-4c8f-b5e2-d48b26e87779 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:56.078901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88a59ef3-d331-4c8f-b5e2-d48b26e87779 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:56.079502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88a59ef3-d331-4c8f-b5e2-d48b26e87779 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:56.151542 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-88a59ef3-d331-4c8f-b5e2-d48b26e87779 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.089048 Jan 22 21:20:56.155994 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3047/6363] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:56 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:56.209845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3392dd88-16e0-444f-b9aa-8be767cc3419 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:56.212068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3392dd88-16e0-444f-b9aa-8be767cc3419 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:56.228574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3392dd88-16e0-444f-b9aa-8be767cc3419 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:56.231498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3392dd88-16e0-444f-b9aa-8be767cc3419 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:56.232570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3392dd88-16e0-444f-b9aa-8be767cc3419 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:56.236042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3392dd88-16e0-444f-b9aa-8be767cc3419 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:56.312853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11c8ceea-7d38-46cc-92e9-da9be3d61a08 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:56.314399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-11c8ceea-7d38-46cc-92e9-da9be3d61a08 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:56.329817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c8ceea-7d38-46cc-92e9-da9be3d61a08 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:56.330056 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3392dd88-16e0-444f-b9aa-8be767cc3419 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.124569 Jan 22 21:20:56.330820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c8ceea-7d38-46cc-92e9-da9be3d61a08 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:56.333075 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3317/6364] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:56 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:56.334270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c8ceea-7d38-46cc-92e9-da9be3d61a08 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:56.335090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c8ceea-7d38-46cc-92e9-da9be3d61a08 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:56.342683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8d31f264-8ebc-4a19-8253-0b0287fed890 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:56.344811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8d31f264-8ebc-4a19-8253-0b0287fed890 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:56.364171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d31f264-8ebc-4a19-8253-0b0287fed890 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:56.368170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d31f264-8ebc-4a19-8253-0b0287fed890 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:56.370543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d31f264-8ebc-4a19-8253-0b0287fed890 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:56.371232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d31f264-8ebc-4a19-8253-0b0287fed890 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:56.399286 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-11c8ceea-7d38-46cc-92e9-da9be3d61a08 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.094875 Jan 22 21:20:56.399976 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3048/6365] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:56 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:56.660160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8d31f264-8ebc-4a19-8253-0b0287fed890 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c362b21cfa45dc8087857e5f3c84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244ce0b0dfa143f0ac03979238985231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:56.684489 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8d31f264-8ebc-4a19-8253-0b0287fed890 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 200 len: 1327 microversion: 2.1 time: 0.347035 Jan 22 21:20:56.687666 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3318/6366] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:56 2022] GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 1327 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:56.874728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-ab41936c-ee1a-47ee-b9e7-8032d255d7a4 req-9b7889c6-8617-4c45-835a-085a63da1d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "389fcfe0-1727-4422-bf51-4fa7e3e303b9", "tag": "8e1d2b7b-b942-4b1e-90a0-765199071d47"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:56.877011 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:20:56.877011 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:20:56.892801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-ab41936c-ee1a-47ee-b9e7-8032d255d7a4 req-9b7889c6-8617-4c45-835a-085a63da1d4f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:56.895628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-ab41936c-ee1a-47ee-b9e7-8032d255d7a4 req-9b7889c6-8617-4c45-835a-085a63da1d4f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:56.914727 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-ab41936c-ee1a-47ee-b9e7-8032d255d7a4 req-9b7889c6-8617-4c45-835a-085a63da1d4f service nova] Creating event network-changed:8e1d2b7b-b942-4b1e-90a0-765199071d47 for instance 389fcfe0-1727-4422-bf51-4fa7e3e303b9 on nch1-master-1 Jan 22 21:20:56.925104 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-ab41936c-ee1a-47ee-b9e7-8032d255d7a4 req-9b7889c6-8617-4c45-835a-085a63da1d4f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054622 Jan 22 21:20:56.926110 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3049/6367] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:20:57.167512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-873305a5-50c2-4828-83d0-4d0203e305c2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:57.172218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-873305a5-50c2-4828-83d0-4d0203e305c2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:57.190168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-873305a5-50c2-4828-83d0-4d0203e305c2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:57.191271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-873305a5-50c2-4828-83d0-4d0203e305c2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:57.192762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-873305a5-50c2-4828-83d0-4d0203e305c2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:57.193527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-873305a5-50c2-4828-83d0-4d0203e305c2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:57.256270 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-873305a5-50c2-4828-83d0-4d0203e305c2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.095964 Jan 22 21:20:57.258489 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3319/6368] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:57 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:57.346028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1d411e13-749d-408e-a65d-cabed4b3644f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:57.347134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1d411e13-749d-408e-a65d-cabed4b3644f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:57.353594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d411e13-749d-408e-a65d-cabed4b3644f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:57.354017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d411e13-749d-408e-a65d-cabed4b3644f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:57.354822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d411e13-749d-408e-a65d-cabed4b3644f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:57.355276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d411e13-749d-408e-a65d-cabed4b3644f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:57.403174 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1d411e13-749d-408e-a65d-cabed4b3644f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.061284 Jan 22 21:20:57.404792 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3050/6369] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:57 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:57.414987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5015e9fb-b02c-4dcf-bfa1-fa8ccd449889 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:57.416497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5015e9fb-b02c-4dcf-bfa1-fa8ccd449889 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:57.424604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5015e9fb-b02c-4dcf-bfa1-fa8ccd449889 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:57.425557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5015e9fb-b02c-4dcf-bfa1-fa8ccd449889 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:57.426770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5015e9fb-b02c-4dcf-bfa1-fa8ccd449889 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:57.428509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5015e9fb-b02c-4dcf-bfa1-fa8ccd449889 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:57.481604 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5015e9fb-b02c-4dcf-bfa1-fa8ccd449889 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.069809 Jan 22 21:20:57.484409 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3320/6370] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:57 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:57.705045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-307a0106-dfe6-4524-be6c-c26d7be04367 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:57.706200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-307a0106-dfe6-4524-be6c-c26d7be04367 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:57.720153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-307a0106-dfe6-4524-be6c-c26d7be04367 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:57.720623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-307a0106-dfe6-4524-be6c-c26d7be04367 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:57.721451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-307a0106-dfe6-4524-be6c-c26d7be04367 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:57.722739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-307a0106-dfe6-4524-be6c-c26d7be04367 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:58.268815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9654a6d9-59e4-40b7-b484-19523e17ee2d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:58.270432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9654a6d9-59e4-40b7-b484-19523e17ee2d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:58.279180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9654a6d9-59e4-40b7-b484-19523e17ee2d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:58.282308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9654a6d9-59e4-40b7-b484-19523e17ee2d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:58.283292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9654a6d9-59e4-40b7-b484-19523e17ee2d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:58.287926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9654a6d9-59e4-40b7-b484-19523e17ee2d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:58.344456 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9654a6d9-59e4-40b7-b484-19523e17ee2d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.079508 Jan 22 21:20:58.345359 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3321/6371] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:58 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:58.417974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-80ecacd3-5064-428e-84f3-4163f6c139e5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:58.419069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-80ecacd3-5064-428e-84f3-4163f6c139e5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:58.438293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80ecacd3-5064-428e-84f3-4163f6c139e5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:58.438871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80ecacd3-5064-428e-84f3-4163f6c139e5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:58.442187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80ecacd3-5064-428e-84f3-4163f6c139e5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:58.442767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80ecacd3-5064-428e-84f3-4163f6c139e5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:58.507621 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-80ecacd3-5064-428e-84f3-4163f6c139e5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.094920 Jan 22 21:20:58.508953 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3322/6372] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:58 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:58.515464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d47f2aa-ace0-438e-8851-0b2539fadc7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:58.516690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d47f2aa-ace0-438e-8851-0b2539fadc7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:58.524038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-307a0106-dfe6-4524-be6c-c26d7be04367 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c362b21cfa45dc8087857e5f3c84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244ce0b0dfa143f0ac03979238985231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:20:58.526646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d47f2aa-ace0-438e-8851-0b2539fadc7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:58.527427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d47f2aa-ace0-438e-8851-0b2539fadc7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:58.529124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d47f2aa-ace0-438e-8851-0b2539fadc7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:58.529778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d47f2aa-ace0-438e-8851-0b2539fadc7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:58.536302 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-307a0106-dfe6-4524-be6c-c26d7be04367 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 200 len: 1327 microversion: 2.1 time: 0.833825 Jan 22 21:20:58.541491 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3051/6373] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:57 2022] GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 1327 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:20:58.583695 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d47f2aa-ace0-438e-8851-0b2539fadc7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.072895 Jan 22 21:20:58.586734 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3323/6374] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:58 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:20:59.357720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff140d14-aac3-4d0a-8831-06b979d5ebd3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:59.358737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ff140d14-aac3-4d0a-8831-06b979d5ebd3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:59.367114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff140d14-aac3-4d0a-8831-06b979d5ebd3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:59.367897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff140d14-aac3-4d0a-8831-06b979d5ebd3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:59.368704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff140d14-aac3-4d0a-8831-06b979d5ebd3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:59.369145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff140d14-aac3-4d0a-8831-06b979d5ebd3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:59.411749 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff140d14-aac3-4d0a-8831-06b979d5ebd3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.058121 Jan 22 21:20:59.412710 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3052/6375] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:59 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:20:59.520438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-038d3eb9-0cee-4838-b7c5-665f112d8cdb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:59.522087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-038d3eb9-0cee-4838-b7c5-665f112d8cdb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:59.529722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-038d3eb9-0cee-4838-b7c5-665f112d8cdb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:59.532773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-038d3eb9-0cee-4838-b7c5-665f112d8cdb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:59.532773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-038d3eb9-0cee-4838-b7c5-665f112d8cdb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:59.532773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-038d3eb9-0cee-4838-b7c5-665f112d8cdb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:59.554928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4683c134-7176-463e-b4a1-16b5297a94a3 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:20:59.556717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4683c134-7176-463e-b4a1-16b5297a94a3 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:59.564564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4683c134-7176-463e-b4a1-16b5297a94a3 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:59.565475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4683c134-7176-463e-b4a1-16b5297a94a3 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:59.566565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4683c134-7176-463e-b4a1-16b5297a94a3 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:59.567043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4683c134-7176-463e-b4a1-16b5297a94a3 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:59.580574 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-038d3eb9-0cee-4838-b7c5-665f112d8cdb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.063719 Jan 22 21:20:59.582305 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3324/6376] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:20:59 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:20:59.602644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f079fbc8-2019-4fb5-a73c-3937b6d98405 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:20:59.604028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f079fbc8-2019-4fb5-a73c-3937b6d98405 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:20:59.611980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f079fbc8-2019-4fb5-a73c-3937b6d98405 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:59.612511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f079fbc8-2019-4fb5-a73c-3937b6d98405 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:59.613319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f079fbc8-2019-4fb5-a73c-3937b6d98405 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:20:59.614006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f079fbc8-2019-4fb5-a73c-3937b6d98405 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:20:59.659795 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f079fbc8-2019-4fb5-a73c-3937b6d98405 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.065090 Jan 22 21:20:59.660479 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3325/6377] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:20:59 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:00.383373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4683c134-7176-463e-b4a1-16b5297a94a3 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c362b21cfa45dc8087857e5f3c84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244ce0b0dfa143f0ac03979238985231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:00.395007 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4683c134-7176-463e-b4a1-16b5297a94a3 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 200 len: 1327 microversion: 2.1 time: 0.844536 Jan 22 21:21:00.396208 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3053/6378] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:20:59 2022] GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 1327 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:00.428434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6e12286-6772-47cd-aa23-9f835cb599b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:00.429955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b6e12286-6772-47cd-aa23-9f835cb599b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:00.439740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6e12286-6772-47cd-aa23-9f835cb599b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:00.440495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6e12286-6772-47cd-aa23-9f835cb599b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:00.442037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6e12286-6772-47cd-aa23-9f835cb599b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:00.442730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6e12286-6772-47cd-aa23-9f835cb599b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:00.505646 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b6e12286-6772-47cd-aa23-9f835cb599b0 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.083563 Jan 22 21:21:00.506718 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3326/6379] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:00 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:00.592182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-34827070-21a5-4730-aa7c-340e53412f2f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:00.593217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-34827070-21a5-4730-aa7c-340e53412f2f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:00.605309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34827070-21a5-4730-aa7c-340e53412f2f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:00.605309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34827070-21a5-4730-aa7c-340e53412f2f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:00.605309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34827070-21a5-4730-aa7c-340e53412f2f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:00.605309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34827070-21a5-4730-aa7c-340e53412f2f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:00.647457 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-34827070-21a5-4730-aa7c-340e53412f2f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.058800 Jan 22 21:21:00.651059 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3054/6380] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:00 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:00.674299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f9428abf-175b-40a9-9637-8126d85038d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:00.675774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f9428abf-175b-40a9-9637-8126d85038d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:00.684828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9428abf-175b-40a9-9637-8126d85038d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:00.685403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9428abf-175b-40a9-9637-8126d85038d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:00.686311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9428abf-175b-40a9-9637-8126d85038d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:00.686969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9428abf-175b-40a9-9637-8126d85038d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:00.741850 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f9428abf-175b-40a9-9637-8126d85038d8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.072777 Jan 22 21:21:00.743185 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3327/6381] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:00 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:01.412004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d01dd357-b55d-4738-adfb-4576cd2bbe39 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:01.418034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d01dd357-b55d-4738-adfb-4576cd2bbe39 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:01.420458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d01dd357-b55d-4738-adfb-4576cd2bbe39 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:01.420923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d01dd357-b55d-4738-adfb-4576cd2bbe39 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:01.421930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d01dd357-b55d-4738-adfb-4576cd2bbe39 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:01.422201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d01dd357-b55d-4738-adfb-4576cd2bbe39 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:01.519919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-304a8e50-3740-440a-87ae-9bd20bccdfc3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:01.521556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-304a8e50-3740-440a-87ae-9bd20bccdfc3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:01.547921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-304a8e50-3740-440a-87ae-9bd20bccdfc3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:01.547921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-304a8e50-3740-440a-87ae-9bd20bccdfc3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:01.547921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-304a8e50-3740-440a-87ae-9bd20bccdfc3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:01.547921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-304a8e50-3740-440a-87ae-9bd20bccdfc3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:01.593250 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-304a8e50-3740-440a-87ae-9bd20bccdfc3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.077908 Jan 22 21:21:01.603857 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3328/6382] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:01 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:01.670970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-392d2183-c410-446a-be61-b061eb838d3a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:01.672033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-392d2183-c410-446a-be61-b061eb838d3a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:01.688454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-392d2183-c410-446a-be61-b061eb838d3a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:01.691484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-392d2183-c410-446a-be61-b061eb838d3a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:01.691484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-392d2183-c410-446a-be61-b061eb838d3a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:01.691484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-392d2183-c410-446a-be61-b061eb838d3a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:01.750395 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-392d2183-c410-446a-be61-b061eb838d3a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.085495 Jan 22 21:21:01.751355 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3329/6383] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:01 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:01.758536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f711aca-d89a-4239-b048-b1526b8fec74 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:01.760210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f711aca-d89a-4239-b048-b1526b8fec74 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:01.768477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f711aca-d89a-4239-b048-b1526b8fec74 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:01.770091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f711aca-d89a-4239-b048-b1526b8fec74 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:01.771855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f711aca-d89a-4239-b048-b1526b8fec74 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:01.771855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f711aca-d89a-4239-b048-b1526b8fec74 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:01.840827 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f711aca-d89a-4239-b048-b1526b8fec74 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.087786 Jan 22 21:21:01.841555 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3330/6384] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:01 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:01.937886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d01dd357-b55d-4738-adfb-4576cd2bbe39 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c362b21cfa45dc8087857e5f3c84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244ce0b0dfa143f0ac03979238985231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:01.949962 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d01dd357-b55d-4738-adfb-4576cd2bbe39 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 200 len: 1327 microversion: 2.1 time: 0.542071 Jan 22 21:21:01.951374 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3055/6385] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:01 2022] GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 1327 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:02.499379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-14c61fba-0764-4d6c-9d0b-9af0c6e48601 req-9618c8a5-8884-4a0c-b42a-7a83f019d649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "389fcfe0-1727-4422-bf51-4fa7e3e303b9", "name": "network-vif-plugged", "status": "completed", "tag": "8e1d2b7b-b942-4b1e-90a0-765199071d47"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:02.501998 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:21:02.501998 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:21:02.517395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-14c61fba-0764-4d6c-9d0b-9af0c6e48601 req-9618c8a5-8884-4a0c-b42a-7a83f019d649 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:02.518573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-14c61fba-0764-4d6c-9d0b-9af0c6e48601 req-9618c8a5-8884-4a0c-b42a-7a83f019d649 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:02.544040 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-14c61fba-0764-4d6c-9d0b-9af0c6e48601 req-9618c8a5-8884-4a0c-b42a-7a83f019d649 service nova] Creating event network-vif-plugged:8e1d2b7b-b942-4b1e-90a0-765199071d47 for instance 389fcfe0-1727-4422-bf51-4fa7e3e303b9 on nch1-master-1 Jan 22 21:21:02.554574 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-14c61fba-0764-4d6c-9d0b-9af0c6e48601 req-9618c8a5-8884-4a0c-b42a-7a83f019d649 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058372 Jan 22 21:21:02.557375 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3331/6386] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:21:02.605411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ea229011-273e-418e-93f1-042aa8bae150 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:02.606486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ea229011-273e-418e-93f1-042aa8bae150 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:02.615250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea229011-273e-418e-93f1-042aa8bae150 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:02.615715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea229011-273e-418e-93f1-042aa8bae150 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:02.617413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea229011-273e-418e-93f1-042aa8bae150 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:02.618315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea229011-273e-418e-93f1-042aa8bae150 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:02.670119 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ea229011-273e-418e-93f1-042aa8bae150 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.069300 Jan 22 21:21:02.671684 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3056/6387] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:02 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:02.766273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2ef2ff13-af11-4139-861f-414ff4d57f03 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:02.771199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2ef2ff13-af11-4139-861f-414ff4d57f03 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:02.779321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ef2ff13-af11-4139-861f-414ff4d57f03 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:02.780040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ef2ff13-af11-4139-861f-414ff4d57f03 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:02.781413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ef2ff13-af11-4139-861f-414ff4d57f03 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:02.782236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ef2ff13-af11-4139-861f-414ff4d57f03 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:02.843316 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2ef2ff13-af11-4139-861f-414ff4d57f03 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.083100 Jan 22 21:21:02.844144 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3332/6388] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:02 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:02.858243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6428045e-cf16-47b3-a832-b70865de7eed tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:02.859375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6428045e-cf16-47b3-a832-b70865de7eed tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:02.868908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6428045e-cf16-47b3-a832-b70865de7eed tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:02.869759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6428045e-cf16-47b3-a832-b70865de7eed tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:02.870826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6428045e-cf16-47b3-a832-b70865de7eed tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:02.872674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6428045e-cf16-47b3-a832-b70865de7eed tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:02.961394 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6428045e-cf16-47b3-a832-b70865de7eed tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.102197 Jan 22 21:21:02.968615 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3057/6389] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:02 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:02.971183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-051e4e15-cb57-4de2-827a-5ecd82f5435a tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:02.972334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-051e4e15-cb57-4de2-827a-5ecd82f5435a tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:02.981233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-051e4e15-cb57-4de2-827a-5ecd82f5435a tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:02.985052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-051e4e15-cb57-4de2-827a-5ecd82f5435a tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:02.985052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-051e4e15-cb57-4de2-827a-5ecd82f5435a tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:02.985052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-051e4e15-cb57-4de2-827a-5ecd82f5435a tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:03.230272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-051e4e15-cb57-4de2-827a-5ecd82f5435a tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c362b21cfa45dc8087857e5f3c84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244ce0b0dfa143f0ac03979238985231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:03.237816 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-051e4e15-cb57-4de2-827a-5ecd82f5435a tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 200 len: 1327 microversion: 2.1 time: 0.272604 Jan 22 21:21:03.238704 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3333/6390] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:02 2022] GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 1327 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:03.682509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6627a2d7-44a1-4d84-9110-c5d43fe8fc17 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:03.683396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6627a2d7-44a1-4d84-9110-c5d43fe8fc17 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:03.690977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6627a2d7-44a1-4d84-9110-c5d43fe8fc17 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:03.691441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6627a2d7-44a1-4d84-9110-c5d43fe8fc17 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:03.692239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6627a2d7-44a1-4d84-9110-c5d43fe8fc17 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:03.692680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6627a2d7-44a1-4d84-9110-c5d43fe8fc17 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:03.735694 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6627a2d7-44a1-4d84-9110-c5d43fe8fc17 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.058090 Jan 22 21:21:03.736355 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3058/6391] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:03 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:03.855354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-afda0f90-e5e9-4d53-a406-7ca7e5ec400f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:03.856227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-afda0f90-e5e9-4d53-a406-7ca7e5ec400f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:03.872701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afda0f90-e5e9-4d53-a406-7ca7e5ec400f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:03.873168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afda0f90-e5e9-4d53-a406-7ca7e5ec400f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:03.874004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afda0f90-e5e9-4d53-a406-7ca7e5ec400f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:03.874449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afda0f90-e5e9-4d53-a406-7ca7e5ec400f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:03.925855 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-afda0f90-e5e9-4d53-a406-7ca7e5ec400f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.074025 Jan 22 21:21:03.927747 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3334/6392] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:03 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:03.973761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-21fbc914-3406-4991-adfd-cac61a4e8025 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:03.974811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-21fbc914-3406-4991-adfd-cac61a4e8025 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:03.982829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21fbc914-3406-4991-adfd-cac61a4e8025 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:03.983793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21fbc914-3406-4991-adfd-cac61a4e8025 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:03.984598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21fbc914-3406-4991-adfd-cac61a4e8025 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:03.985050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21fbc914-3406-4991-adfd-cac61a4e8025 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:04.049225 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-21fbc914-3406-4991-adfd-cac61a4e8025 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.081955 Jan 22 21:21:04.050274 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3059/6393] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:03 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:04.257884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-101c1f12-ab3a-4312-9651-f84296bb0f41 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:04.258994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-101c1f12-ab3a-4312-9651-f84296bb0f41 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:04.270001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-101c1f12-ab3a-4312-9651-f84296bb0f41 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:04.275764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-101c1f12-ab3a-4312-9651-f84296bb0f41 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:04.275764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-101c1f12-ab3a-4312-9651-f84296bb0f41 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:04.275764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-101c1f12-ab3a-4312-9651-f84296bb0f41 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:04.751003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-34559542-5ef2-4e72-9c27-50daff8f56c1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:04.752405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-34559542-5ef2-4e72-9c27-50daff8f56c1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:04.764986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34559542-5ef2-4e72-9c27-50daff8f56c1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:04.767179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34559542-5ef2-4e72-9c27-50daff8f56c1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:04.770047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34559542-5ef2-4e72-9c27-50daff8f56c1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:04.770778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34559542-5ef2-4e72-9c27-50daff8f56c1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:04.831290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-34559542-5ef2-4e72-9c27-50daff8f56c1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.086310 Jan 22 21:21:04.832613 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3060/6394] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:04 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:04.881316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-101c1f12-ab3a-4312-9651-f84296bb0f41 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c362b21cfa45dc8087857e5f3c84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244ce0b0dfa143f0ac03979238985231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:04.894880 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-101c1f12-ab3a-4312-9651-f84296bb0f41 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 200 len: 1524 microversion: 2.1 time: 0.642236 Jan 22 21:21:04.895769 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3335/6395] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:04 2022] GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 1524 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:04.939864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c0ed5eb4-25ee-4651-866c-4e6d10a4d1bb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:04.941056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c0ed5eb4-25ee-4651-866c-4e6d10a4d1bb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:04.951484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0ed5eb4-25ee-4651-866c-4e6d10a4d1bb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:04.951940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0ed5eb4-25ee-4651-866c-4e6d10a4d1bb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:04.954020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0ed5eb4-25ee-4651-866c-4e6d10a4d1bb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:04.954863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0ed5eb4-25ee-4651-866c-4e6d10a4d1bb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:05.018737 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c0ed5eb4-25ee-4651-866c-4e6d10a4d1bb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.083684 Jan 22 21:21:05.020110 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3061/6396] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:04 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:05.060580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a3cb085a-6c69-49b0-a4ee-5e9393307dcf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:05.063512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a3cb085a-6c69-49b0-a4ee-5e9393307dcf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:05.074299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3cb085a-6c69-49b0-a4ee-5e9393307dcf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:05.074299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3cb085a-6c69-49b0-a4ee-5e9393307dcf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:05.074299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3cb085a-6c69-49b0-a4ee-5e9393307dcf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:05.074299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3cb085a-6c69-49b0-a4ee-5e9393307dcf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:05.079894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3fcf87b8-64e5-4528-bf27-793ad4466ebb tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-251783253", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "16c53b7e-a7fb-4102-944c-7c89ad464582"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:05.081916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3fcf87b8-64e5-4528-bf27-793ad4466ebb tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:21:05.083087 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3fcf87b8-64e5-4528-bf27-793ad4466ebb tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.007431 Jan 22 21:21:05.091327 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3062/6397] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:21:05 2022] POST /compute/v2.1/servers => generated 175 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 22 21:21:05.097925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1447def0-bf30-4213-bcb2-69b2b4a56d8c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:05.098547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1447def0-bf30-4213-bcb2-69b2b4a56d8c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: ffeef5f6-6c05-412b-8d3c-640e5b824335] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:05.108249 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-1447def0-bf30-4213-bcb2-69b2b4a56d8c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] HTTP exception thrown: Instance ffeef5f6-6c05-412b-8d3c-640e5b824335 could not be found. Jan 22 21:21:05.108905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1447def0-bf30-4213-bcb2-69b2b4a56d8c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Returning 404 to user: Instance ffeef5f6-6c05-412b-8d3c-640e5b824335 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:21:05.109959 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1447def0-bf30-4213-bcb2-69b2b4a56d8c tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/ffeef5f6-6c05-412b-8d3c-640e5b824335/metadata" status: 404 len: 111 microversion: 2.1 time: 0.017092 Jan 22 21:21:05.123987 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3063/6398] 10.222.0.100 () {58 vars in 1267 bytes} [Sat Jan 22 21:21:05 2022] GET /compute/v2.1/servers/ffeef5f6-6c05-412b-8d3c-640e5b824335/metadata => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:21:05.139810 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a3cb085a-6c69-49b0-a4ee-5e9393307dcf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.082669 Jan 22 21:21:05.145137 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3336/6399] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:05 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:05.171393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-009116b7-9eaa-4a8c-b817-eaf78bdc8504 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1212950328", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "16c53b7e-a7fb-4102-944c-7c89ad464582"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:05.172809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-009116b7-9eaa-4a8c-b817-eaf78bdc8504 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:21:05.173652 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-009116b7-9eaa-4a8c-b817-eaf78bdc8504 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.009810 Jan 22 21:21:05.174269 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3064/6400] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:21:05 2022] POST /compute/v2.1/servers => generated 687 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:21:05.231449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-35cefee2-019a-4bfc-a1db-1db797e69144 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1599345394", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "16c53b7e-a7fb-4102-944c-7c89ad464582"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:05.232885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-35cefee2-019a-4bfc-a1db-1db797e69144 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:21:05.233726 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-35cefee2-019a-4bfc-a1db-1db797e69144 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.006472 Jan 22 21:21:05.234252 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3337/6401] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:21:05 2022] POST /compute/v2.1/servers => generated 689 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:21:05.282122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fddd747b-2556-4656-9732-cf72078a540a tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-920028992", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "16c53b7e-a7fb-4102-944c-7c89ad464582"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:05.284237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fddd747b-2556-4656-9732-cf72078a540a tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:21:05.285051 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fddd747b-2556-4656-9732-cf72078a540a tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.007230 Jan 22 21:21:05.285599 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3065/6402] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:21:05 2022] POST /compute/v2.1/servers => generated 1197 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jan 22 21:21:05.345128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f248be08-4364-4408-ae49-add0a01c1fd8 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-21642279", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "16c53b7e-a7fb-4102-944c-7c89ad464582"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:05.351896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f248be08-4364-4408-ae49-add0a01c1fd8 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:21:05.353891 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f248be08-4364-4408-ae49-add0a01c1fd8 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.020010 Jan 22 21:21:05.354724 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3338/6403] 10.222.0.100 () {60 vars in 1152 bytes} [Sat Jan 22 21:21:05 2022] POST /compute/v2.1/servers => generated 2221 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jan 22 21:21:05.366848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-818367fb-ca7f-4312-95e5-e0252b536d87 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:05.367449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-818367fb-ca7f-4312-95e5-e0252b536d87 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: e3790db0-8b98-4f31-a59f-cf89ad12879d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:05.374343 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-818367fb-ca7f-4312-95e5-e0252b536d87 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] HTTP exception thrown: Instance e3790db0-8b98-4f31-a59f-cf89ad12879d could not be found. Jan 22 21:21:05.375089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-818367fb-ca7f-4312-95e5-e0252b536d87 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Returning 404 to user: Instance e3790db0-8b98-4f31-a59f-cf89ad12879d could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:21:05.376595 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-818367fb-ca7f-4312-95e5-e0252b536d87 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/e3790db0-8b98-4f31-a59f-cf89ad12879d/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.014624 Jan 22 21:21:05.379030 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3066/6404] 10.222.0.100 () {58 vars in 1285 bytes} [Sat Jan 22 21:21:05 2022] GET /compute/v2.1/servers/e3790db0-8b98-4f31-a59f-cf89ad12879d/metadata/test2 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:21:05.394516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-68603872-f78f-4b3b-9872-c6f5bf1fad6e tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:05.395471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-68603872-f78f-4b3b-9872-c6f5bf1fad6e tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:05.405557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-68603872-f78f-4b3b-9872-c6f5bf1fad6e tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:05.406120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-68603872-f78f-4b3b-9872-c6f5bf1fad6e tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:05.407113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-68603872-f78f-4b3b-9872-c6f5bf1fad6e tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:05.407824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-68603872-f78f-4b3b-9872-c6f5bf1fad6e tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:05.434777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-68603872-f78f-4b3b-9872-c6f5bf1fad6e tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:21:05.695411 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-68603872-f78f-4b3b-9872-c6f5bf1fad6e tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "DELETE /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 204 len: 0 microversion: 2.1 time: 0.305456 Jan 22 21:21:05.695923 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3339/6405] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:21:05 2022] DELETE /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:21:05.703841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8af837e6-8dc8-4309-8391-fc5bc57a074f tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:05.710935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8af837e6-8dc8-4309-8391-fc5bc57a074f tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:05.712725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8af837e6-8dc8-4309-8391-fc5bc57a074f tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:05.713242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8af837e6-8dc8-4309-8391-fc5bc57a074f tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:05.714152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8af837e6-8dc8-4309-8391-fc5bc57a074f tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:05.714622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8af837e6-8dc8-4309-8391-fc5bc57a074f tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:05.844501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-174d9742-c783-4ae4-8e88-f4f9d05d79f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:05.846028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-174d9742-c783-4ae4-8e88-f4f9d05d79f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:05.854905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-174d9742-c783-4ae4-8e88-f4f9d05d79f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:05.855358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-174d9742-c783-4ae4-8e88-f4f9d05d79f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:05.856506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-174d9742-c783-4ae4-8e88-f4f9d05d79f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:05.856944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-174d9742-c783-4ae4-8e88-f4f9d05d79f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:05.897583 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-174d9742-c783-4ae4-8e88-f4f9d05d79f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.057090 Jan 22 21:21:05.898510 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3340/6406] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:05 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:05.989740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8af837e6-8dc8-4309-8391-fc5bc57a074f tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c362b21cfa45dc8087857e5f3c84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244ce0b0dfa143f0ac03979238985231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:05.997377 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8af837e6-8dc8-4309-8391-fc5bc57a074f tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 200 len: 1530 microversion: 2.1 time: 0.297355 Jan 22 21:21:05.997980 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3067/6407] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:05 2022] GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 1530 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:06.032055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-71d1b207-ffd9-4e56-8365-0a3b505b83c5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:06.033149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-71d1b207-ffd9-4e56-8365-0a3b505b83c5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:06.041073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71d1b207-ffd9-4e56-8365-0a3b505b83c5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:06.041596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71d1b207-ffd9-4e56-8365-0a3b505b83c5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:06.042378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71d1b207-ffd9-4e56-8365-0a3b505b83c5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:06.042811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71d1b207-ffd9-4e56-8365-0a3b505b83c5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:06.088883 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-71d1b207-ffd9-4e56-8365-0a3b505b83c5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.060823 Jan 22 21:21:06.089819 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3341/6408] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:06 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:06.151871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-61f30ab3-6fe4-4442-a69b-0f723097da66 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:06.152943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-61f30ab3-6fe4-4442-a69b-0f723097da66 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:06.160831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61f30ab3-6fe4-4442-a69b-0f723097da66 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:06.161355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61f30ab3-6fe4-4442-a69b-0f723097da66 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:06.162248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61f30ab3-6fe4-4442-a69b-0f723097da66 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:06.164271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61f30ab3-6fe4-4442-a69b-0f723097da66 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:06.212466 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-61f30ab3-6fe4-4442-a69b-0f723097da66 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.064574 Jan 22 21:21:06.216360 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3068/6409] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:06 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:06.912297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-12466bae-71a3-4abb-98c5-24f172ff9456 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:06.914468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-12466bae-71a3-4abb-98c5-24f172ff9456 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:06.923760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12466bae-71a3-4abb-98c5-24f172ff9456 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:06.924482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12466bae-71a3-4abb-98c5-24f172ff9456 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:06.935365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12466bae-71a3-4abb-98c5-24f172ff9456 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:06.935365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12466bae-71a3-4abb-98c5-24f172ff9456 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:06.992043 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-12466bae-71a3-4abb-98c5-24f172ff9456 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.081374 Jan 22 21:21:06.992043 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3342/6410] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:06 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:07.015627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e4044899-b2b2-4e55-9204-00d3e5bf5bc1 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:07.016488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e4044899-b2b2-4e55-9204-00d3e5bf5bc1 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:07.025031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4044899-b2b2-4e55-9204-00d3e5bf5bc1 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:07.025319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4044899-b2b2-4e55-9204-00d3e5bf5bc1 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:07.026340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4044899-b2b2-4e55-9204-00d3e5bf5bc1 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:07.026787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e4044899-b2b2-4e55-9204-00d3e5bf5bc1 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:07.102629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-28463857-c7f1-4b26-ba45-2cac1f169488 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:07.103959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-28463857-c7f1-4b26-ba45-2cac1f169488 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:07.111502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28463857-c7f1-4b26-ba45-2cac1f169488 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:07.111968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28463857-c7f1-4b26-ba45-2cac1f169488 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:07.112759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28463857-c7f1-4b26-ba45-2cac1f169488 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:07.122076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28463857-c7f1-4b26-ba45-2cac1f169488 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:07.181899 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-28463857-c7f1-4b26-ba45-2cac1f169488 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.084651 Jan 22 21:21:07.182633 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3343/6411] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:07 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:21:07.227343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b67d8cb4-a11d-4f40-a000-974098869323 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:07.228895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b67d8cb4-a11d-4f40-a000-974098869323 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:07.236869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b67d8cb4-a11d-4f40-a000-974098869323 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:07.238615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b67d8cb4-a11d-4f40-a000-974098869323 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:07.238615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b67d8cb4-a11d-4f40-a000-974098869323 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:07.238941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b67d8cb4-a11d-4f40-a000-974098869323 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:07.301229 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b67d8cb4-a11d-4f40-a000-974098869323 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.073484 Jan 22 21:21:07.306908 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3344/6412] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:07 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:07.339010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e4044899-b2b2-4e55-9204-00d3e5bf5bc1 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c362b21cfa45dc8087857e5f3c84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244ce0b0dfa143f0ac03979238985231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:07.348192 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e4044899-b2b2-4e55-9204-00d3e5bf5bc1 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 200 len: 1530 microversion: 2.1 time: 0.336629 Jan 22 21:21:07.348913 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3069/6413] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:07 2022] GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 1530 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:07.969629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-439ef7bd-016b-417d-b50b-0a13e0ab16f4 req-3004b858-5099-4b1d-874a-334652b9ad68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "389fcfe0-1727-4422-bf51-4fa7e3e303b9", "name": "network-vif-deleted", "tag": "8e1d2b7b-b942-4b1e-90a0-765199071d47"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:07.972123 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:21:07.972123 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:21:07.982699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-439ef7bd-016b-417d-b50b-0a13e0ab16f4 req-3004b858-5099-4b1d-874a-334652b9ad68 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:07.991003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-439ef7bd-016b-417d-b50b-0a13e0ab16f4 req-3004b858-5099-4b1d-874a-334652b9ad68 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:08.002625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bbc32477-4c44-4ae3-859e-8abfaea6fec1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:08.003594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bbc32477-4c44-4ae3-859e-8abfaea6fec1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:08.009678 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-439ef7bd-016b-417d-b50b-0a13e0ab16f4 req-3004b858-5099-4b1d-874a-334652b9ad68 service nova] Creating event network-vif-deleted:8e1d2b7b-b942-4b1e-90a0-765199071d47 for instance 389fcfe0-1727-4422-bf51-4fa7e3e303b9 on nch1-master-1 Jan 22 21:21:08.013265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbc32477-4c44-4ae3-859e-8abfaea6fec1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:08.014210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbc32477-4c44-4ae3-859e-8abfaea6fec1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:08.015285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbc32477-4c44-4ae3-859e-8abfaea6fec1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:08.015630 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-439ef7bd-016b-417d-b50b-0a13e0ab16f4 req-3004b858-5099-4b1d-874a-334652b9ad68 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050108 Jan 22 21:21:08.016707 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3345/6414] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:21:08.019186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbc32477-4c44-4ae3-859e-8abfaea6fec1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:08.063754 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bbc32477-4c44-4ae3-859e-8abfaea6fec1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.063324 Jan 22 21:21:08.063754 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3070/6415] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:07 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:08.197693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9674169b-4907-49ae-8551-2a2b11421c29 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:08.198741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9674169b-4907-49ae-8551-2a2b11421c29 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:08.206779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9674169b-4907-49ae-8551-2a2b11421c29 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:08.207709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9674169b-4907-49ae-8551-2a2b11421c29 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:08.208412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9674169b-4907-49ae-8551-2a2b11421c29 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:08.208864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9674169b-4907-49ae-8551-2a2b11421c29 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:08.249938 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9674169b-4907-49ae-8551-2a2b11421c29 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.057079 Jan 22 21:21:08.250575 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3346/6416] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:08 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:08.315604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-64c674af-8dfc-4546-a18d-eaf941b31e07 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:08.316868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-64c674af-8dfc-4546-a18d-eaf941b31e07 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:08.329774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64c674af-8dfc-4546-a18d-eaf941b31e07 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:08.329774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64c674af-8dfc-4546-a18d-eaf941b31e07 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:08.329774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64c674af-8dfc-4546-a18d-eaf941b31e07 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:08.329774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64c674af-8dfc-4546-a18d-eaf941b31e07 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:08.371007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7436691c-078d-4ccf-9f42-a8142143fd02 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:08.372029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7436691c-078d-4ccf-9f42-a8142143fd02 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:08.384838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7436691c-078d-4ccf-9f42-a8142143fd02 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:08.385593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7436691c-078d-4ccf-9f42-a8142143fd02 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:08.386598 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-64c674af-8dfc-4546-a18d-eaf941b31e07 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.076009 Jan 22 21:21:08.387095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7436691c-078d-4ccf-9f42-a8142143fd02 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:08.387823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7436691c-078d-4ccf-9f42-a8142143fd02 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:08.389236 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3071/6417] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:08 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:08.435299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7436691c-078d-4ccf-9f42-a8142143fd02 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:08.435968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7436691c-078d-4ccf-9f42-a8142143fd02 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:08.436924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-7436691c-078d-4ccf-9f42-a8142143fd02 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lazy-loading 'fault' on Instance uuid 389fcfe0-1727-4422-bf51-4fa7e3e303b9 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:21:08.493890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7436691c-078d-4ccf-9f42-a8142143fd02 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c362b21cfa45dc8087857e5f3c84ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244ce0b0dfa143f0ac03979238985231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:08.501399 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7436691c-078d-4ccf-9f42-a8142143fd02 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 200 len: 1317 microversion: 2.1 time: 0.138390 Jan 22 21:21:08.502088 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3347/6418] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:08 2022] GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:09.074921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0955f061-c738-4fc4-ac86-027b9bee6938 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:09.076264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0955f061-c738-4fc4-ac86-027b9bee6938 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:09.084032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0955f061-c738-4fc4-ac86-027b9bee6938 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:09.084527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0955f061-c738-4fc4-ac86-027b9bee6938 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:09.086051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0955f061-c738-4fc4-ac86-027b9bee6938 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:09.086732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0955f061-c738-4fc4-ac86-027b9bee6938 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:09.133235 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0955f061-c738-4fc4-ac86-027b9bee6938 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.062304 Jan 22 21:21:09.137293 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3072/6419] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:09 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:09.262137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e7edf300-64c7-4e6b-b91d-9679a8073199 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:09.263300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e7edf300-64c7-4e6b-b91d-9679a8073199 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:09.270632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7edf300-64c7-4e6b-b91d-9679a8073199 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:09.271084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7edf300-64c7-4e6b-b91d-9679a8073199 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:09.272559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7edf300-64c7-4e6b-b91d-9679a8073199 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:09.273483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7edf300-64c7-4e6b-b91d-9679a8073199 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:09.338683 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e7edf300-64c7-4e6b-b91d-9679a8073199 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.076779 Jan 22 21:21:09.338683 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3348/6420] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:09 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:21:09.401625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-544ddae7-1c18-4d0b-aebe-51d6aad28921 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:09.402929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-544ddae7-1c18-4d0b-aebe-51d6aad28921 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:09.410492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-544ddae7-1c18-4d0b-aebe-51d6aad28921 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:09.411036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-544ddae7-1c18-4d0b-aebe-51d6aad28921 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:09.411874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-544ddae7-1c18-4d0b-aebe-51d6aad28921 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:09.412456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-544ddae7-1c18-4d0b-aebe-51d6aad28921 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:09.471106 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-544ddae7-1c18-4d0b-aebe-51d6aad28921 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.074166 Jan 22 21:21:09.474933 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3073/6421] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:09 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:09.519073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-79293c8e-e7bf-4ca9-b761-bb748a154802 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:09.520052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-79293c8e-e7bf-4ca9-b761-bb748a154802 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] [instance: 389fcfe0-1727-4422-bf51-4fa7e3e303b9] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:09.527274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79293c8e-e7bf-4ca9-b761-bb748a154802 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:09.527979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79293c8e-e7bf-4ca9-b761-bb748a154802 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:09.528857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79293c8e-e7bf-4ca9-b761-bb748a154802 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:09.529583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79293c8e-e7bf-4ca9-b761-bb748a154802 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:09.561172 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-79293c8e-e7bf-4ca9-b761-bb748a154802 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] HTTP exception thrown: Instance 389fcfe0-1727-4422-bf51-4fa7e3e303b9 could not be found. Jan 22 21:21:09.570209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-79293c8e-e7bf-4ca9-b761-bb748a154802 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] Returning 404 to user: Instance 389fcfe0-1727-4422-bf51-4fa7e3e303b9 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:21:09.571341 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-79293c8e-e7bf-4ca9-b761-bb748a154802 tempest-ServerMetadataNegativeTestJSON-2031525589 tempest-ServerMetadataNegativeTestJSON-2031525589-project] 10.222.0.100 "GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9" status: 404 len: 111 microversion: 2.1 time: 0.056856 Jan 22 21:21:09.575187 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3349/6422] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:09 2022] GET /compute/v2.1/servers/389fcfe0-1727-4422-bf51-4fa7e3e303b9 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:21:10.145788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-54415bb6-89c4-4d19-a2c4-a0d13b189713 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:10.147649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-54415bb6-89c4-4d19-a2c4-a0d13b189713 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:10.155910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54415bb6-89c4-4d19-a2c4-a0d13b189713 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:10.156375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54415bb6-89c4-4d19-a2c4-a0d13b189713 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:10.157198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54415bb6-89c4-4d19-a2c4-a0d13b189713 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:10.157677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54415bb6-89c4-4d19-a2c4-a0d13b189713 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:10.217838 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-54415bb6-89c4-4d19-a2c4-a0d13b189713 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.076868 Jan 22 21:21:10.220072 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3074/6423] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:10 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:10.348032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2b9d3292-7fe9-4980-83bc-662824428986 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:10.349687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2b9d3292-7fe9-4980-83bc-662824428986 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:10.357781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b9d3292-7fe9-4980-83bc-662824428986 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:10.358552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b9d3292-7fe9-4980-83bc-662824428986 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:10.359712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b9d3292-7fe9-4980-83bc-662824428986 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:10.360340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b9d3292-7fe9-4980-83bc-662824428986 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:10.421474 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2b9d3292-7fe9-4980-83bc-662824428986 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.077187 Jan 22 21:21:10.422156 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3350/6424] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:10 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:10.485137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e8dbd5b4-13bb-45d7-8ead-6ac52edee6b7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:10.490602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e8dbd5b4-13bb-45d7-8ead-6ac52edee6b7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:10.499225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8dbd5b4-13bb-45d7-8ead-6ac52edee6b7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:10.500957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8dbd5b4-13bb-45d7-8ead-6ac52edee6b7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:10.502401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8dbd5b4-13bb-45d7-8ead-6ac52edee6b7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:10.503445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8dbd5b4-13bb-45d7-8ead-6ac52edee6b7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:10.560993 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e8dbd5b4-13bb-45d7-8ead-6ac52edee6b7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.080831 Jan 22 21:21:10.569407 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3075/6425] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:10 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:11.231356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c195577b-232b-489f-8ae9-d212f3deec5c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:11.232723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c195577b-232b-489f-8ae9-d212f3deec5c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:11.241666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c195577b-232b-489f-8ae9-d212f3deec5c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:11.242156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c195577b-232b-489f-8ae9-d212f3deec5c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:11.242969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c195577b-232b-489f-8ae9-d212f3deec5c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:11.243414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c195577b-232b-489f-8ae9-d212f3deec5c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:11.284542 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c195577b-232b-489f-8ae9-d212f3deec5c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.057154 Jan 22 21:21:11.285346 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3351/6426] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:11 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:11.437781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2de35d68-97e6-4566-b1b1-2565f522bbda tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:11.438811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2de35d68-97e6-4566-b1b1-2565f522bbda tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:11.447181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2de35d68-97e6-4566-b1b1-2565f522bbda tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:11.447640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2de35d68-97e6-4566-b1b1-2565f522bbda tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:11.448485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2de35d68-97e6-4566-b1b1-2565f522bbda tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:11.448941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2de35d68-97e6-4566-b1b1-2565f522bbda tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:11.495062 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2de35d68-97e6-4566-b1b1-2565f522bbda tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.061177 Jan 22 21:21:11.495731 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3076/6427] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:11 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:21:11.575044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-73590c4d-ffdd-41ea-a77f-e413c34ba033 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:11.576456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-73590c4d-ffdd-41ea-a77f-e413c34ba033 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:11.583984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73590c4d-ffdd-41ea-a77f-e413c34ba033 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:11.590890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73590c4d-ffdd-41ea-a77f-e413c34ba033 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:11.590890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73590c4d-ffdd-41ea-a77f-e413c34ba033 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:11.590890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73590c4d-ffdd-41ea-a77f-e413c34ba033 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:11.640620 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-73590c4d-ffdd-41ea-a77f-e413c34ba033 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.069517 Jan 22 21:21:11.641658 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3352/6428] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:11 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:12.306610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3c38c260-42f8-4f67-bcf8-9cb061647f37 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:12.309397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3c38c260-42f8-4f67-bcf8-9cb061647f37 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:12.316380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c38c260-42f8-4f67-bcf8-9cb061647f37 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:12.316853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c38c260-42f8-4f67-bcf8-9cb061647f37 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:12.317771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c38c260-42f8-4f67-bcf8-9cb061647f37 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:12.318416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c38c260-42f8-4f67-bcf8-9cb061647f37 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:12.361867 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3c38c260-42f8-4f67-bcf8-9cb061647f37 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.062092 Jan 22 21:21:12.362714 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3077/6429] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:12 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:12.508154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8220c073-46cc-4fe8-9c48-23c3d526154e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:12.509171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8220c073-46cc-4fe8-9c48-23c3d526154e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:12.516278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8220c073-46cc-4fe8-9c48-23c3d526154e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:12.517204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8220c073-46cc-4fe8-9c48-23c3d526154e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:12.518249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8220c073-46cc-4fe8-9c48-23c3d526154e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:12.518898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8220c073-46cc-4fe8-9c48-23c3d526154e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:12.563166 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8220c073-46cc-4fe8-9c48-23c3d526154e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.059459 Jan 22 21:21:12.563903 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3353/6430] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:12 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:12.652932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-79c11384-eeef-47d3-a151-478f5708f196 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:12.653975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-79c11384-eeef-47d3-a151-478f5708f196 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:12.661368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79c11384-eeef-47d3-a151-478f5708f196 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:12.662015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79c11384-eeef-47d3-a151-478f5708f196 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:12.663454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79c11384-eeef-47d3-a151-478f5708f196 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:12.663904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79c11384-eeef-47d3-a151-478f5708f196 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:12.706976 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-79c11384-eeef-47d3-a151-478f5708f196 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.057990 Jan 22 21:21:12.707632 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3078/6431] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:12 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:13.382581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4a7669d4-944e-4116-97ad-e9f5b38c5864 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:13.383861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4a7669d4-944e-4116-97ad-e9f5b38c5864 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:13.405900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a7669d4-944e-4116-97ad-e9f5b38c5864 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:13.407561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a7669d4-944e-4116-97ad-e9f5b38c5864 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:13.411810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a7669d4-944e-4116-97ad-e9f5b38c5864 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:13.413014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a7669d4-944e-4116-97ad-e9f5b38c5864 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:13.495718 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4a7669d4-944e-4116-97ad-e9f5b38c5864 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.124523 Jan 22 21:21:13.496693 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3354/6432] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:13 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:13.579911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2cd98153-a5ae-4bed-9b55-929295f9fe31 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:13.580843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2cd98153-a5ae-4bed-9b55-929295f9fe31 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:13.594630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cd98153-a5ae-4bed-9b55-929295f9fe31 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:13.599303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cd98153-a5ae-4bed-9b55-929295f9fe31 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:13.607152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cd98153-a5ae-4bed-9b55-929295f9fe31 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:13.607793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cd98153-a5ae-4bed-9b55-929295f9fe31 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:13.673054 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2cd98153-a5ae-4bed-9b55-929295f9fe31 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.095000 Jan 22 21:21:13.676134 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3079/6433] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:13 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:13.721135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5543ca34-41fe-4519-9e01-37c6c72bf2d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:13.722023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5543ca34-41fe-4519-9e01-37c6c72bf2d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:13.730693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5543ca34-41fe-4519-9e01-37c6c72bf2d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:13.730874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5543ca34-41fe-4519-9e01-37c6c72bf2d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:13.731857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5543ca34-41fe-4519-9e01-37c6c72bf2d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:13.732657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5543ca34-41fe-4519-9e01-37c6c72bf2d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:13.783382 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5543ca34-41fe-4519-9e01-37c6c72bf2d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.066824 Jan 22 21:21:13.784341 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3355/6434] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:13 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:14.519045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cfff01b0-4ef6-465b-885d-60d66d17fc9c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:14.520014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cfff01b0-4ef6-465b-885d-60d66d17fc9c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:14.529065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfff01b0-4ef6-465b-885d-60d66d17fc9c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:14.529617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfff01b0-4ef6-465b-885d-60d66d17fc9c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:14.530413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfff01b0-4ef6-465b-885d-60d66d17fc9c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:14.531011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfff01b0-4ef6-465b-885d-60d66d17fc9c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:14.601264 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cfff01b0-4ef6-465b-885d-60d66d17fc9c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.091507 Jan 22 21:21:14.603285 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3080/6435] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:14 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:14.687541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6ceade40-b721-4b96-98a4-cb02e2b6badb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:14.689310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6ceade40-b721-4b96-98a4-cb02e2b6badb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:14.700916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ceade40-b721-4b96-98a4-cb02e2b6badb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:14.701915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ceade40-b721-4b96-98a4-cb02e2b6badb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:14.703010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ceade40-b721-4b96-98a4-cb02e2b6badb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:14.703863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ceade40-b721-4b96-98a4-cb02e2b6badb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:14.778949 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6ceade40-b721-4b96-98a4-cb02e2b6badb tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.094768 Jan 22 21:21:14.784463 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3356/6436] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:14 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:14.800697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b339b17-076c-48ca-904e-15c086dff201 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:14.801987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6b339b17-076c-48ca-904e-15c086dff201 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:14.816260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b339b17-076c-48ca-904e-15c086dff201 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:14.816965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b339b17-076c-48ca-904e-15c086dff201 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:14.818159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b339b17-076c-48ca-904e-15c086dff201 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:14.818867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b339b17-076c-48ca-904e-15c086dff201 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:14.878690 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b339b17-076c-48ca-904e-15c086dff201 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.084334 Jan 22 21:21:14.878690 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3357/6437] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:14 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:14.935565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-31e8577f-cedc-4509-99f6-1cf0d99b7aab tempest-ComputeTenantNetworksTest-585769027 tempest-ComputeTenantNetworksTest-585769027-project] Calling method '.version_select at 0x7f1ed4d8b0d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:15.275653 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-31e8577f-cedc-4509-99f6-1cf0d99b7aab tempest-ComputeTenantNetworksTest-585769027 tempest-ComputeTenantNetworksTest-585769027-project] 10.222.0.100 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.534632 Jan 22 21:21:15.276333 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3081/6438] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 21:21:14 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:21:15.286544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08ec0c35-f414-4ea8-99cb-0933f7708082 tempest-ComputeTenantNetworksTest-585769027 tempest-ComputeTenantNetworksTest-585769027-project] Calling method '.version_select at 0x7f1ed5d4f310>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:15.429484 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-08ec0c35-f414-4ea8-99cb-0933f7708082 tempest-ComputeTenantNetworksTest-585769027 tempest-ComputeTenantNetworksTest-585769027-project] 10.222.0.100 "GET /compute/v2.1/os-tenant-networks/3c1b12b8-5fca-44a6-aa5b-2f1c0a572e34" status: 200 len: 140 microversion: 2.1 time: 0.145544 Jan 22 21:21:15.435538 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3358/6439] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 21:21:15 2022] GET /compute/v2.1/os-tenant-networks/3c1b12b8-5fca-44a6-aa5b-2f1c0a572e34 => generated 140 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:21:15.619219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bb89de53-2f5c-41a2-b3b0-ef88cf84d4d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:15.620862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bb89de53-2f5c-41a2-b3b0-ef88cf84d4d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:15.632086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb89de53-2f5c-41a2-b3b0-ef88cf84d4d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:15.632850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb89de53-2f5c-41a2-b3b0-ef88cf84d4d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:15.636466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb89de53-2f5c-41a2-b3b0-ef88cf84d4d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:15.641016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb89de53-2f5c-41a2-b3b0-ef88cf84d4d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:15.706726 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bb89de53-2f5c-41a2-b3b0-ef88cf84d4d4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.096680 Jan 22 21:21:15.708027 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3082/6440] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:15 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:15.797738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3dfc3e98-592d-4ebf-a086-d12930be3f79 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:15.800522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3dfc3e98-592d-4ebf-a086-d12930be3f79 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:15.812860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dfc3e98-592d-4ebf-a086-d12930be3f79 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:15.813815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dfc3e98-592d-4ebf-a086-d12930be3f79 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:15.829617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dfc3e98-592d-4ebf-a086-d12930be3f79 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:15.841164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3dfc3e98-592d-4ebf-a086-d12930be3f79 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:15.890627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8dd273f7-7cc1-434a-b447-50d7c0a4afb1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:15.891787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8dd273f7-7cc1-434a-b447-50d7c0a4afb1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:15.919424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd273f7-7cc1-434a-b447-50d7c0a4afb1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:15.921945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd273f7-7cc1-434a-b447-50d7c0a4afb1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:15.923027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd273f7-7cc1-434a-b447-50d7c0a4afb1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:15.932029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8dd273f7-7cc1-434a-b447-50d7c0a4afb1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:15.936631 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3dfc3e98-592d-4ebf-a086-d12930be3f79 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.149102 Jan 22 21:21:15.937784 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3359/6441] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:15 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:21:16.029783 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8dd273f7-7cc1-434a-b447-50d7c0a4afb1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.143402 Jan 22 21:21:16.034485 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3083/6442] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:15 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:16.721474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-01b7c275-e653-42af-9d1a-dbb23103e2eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:16.722525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-01b7c275-e653-42af-9d1a-dbb23103e2eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:16.731420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01b7c275-e653-42af-9d1a-dbb23103e2eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:16.732152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01b7c275-e653-42af-9d1a-dbb23103e2eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:16.733136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01b7c275-e653-42af-9d1a-dbb23103e2eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:16.733767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01b7c275-e653-42af-9d1a-dbb23103e2eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:16.782107 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-01b7c275-e653-42af-9d1a-dbb23103e2eb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.065209 Jan 22 21:21:16.783845 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3360/6443] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:16 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:16.950175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4998ff86-64f3-4606-b39e-7a6212739c1a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:16.951315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4998ff86-64f3-4606-b39e-7a6212739c1a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:16.958759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4998ff86-64f3-4606-b39e-7a6212739c1a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:16.959383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4998ff86-64f3-4606-b39e-7a6212739c1a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:16.960995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4998ff86-64f3-4606-b39e-7a6212739c1a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:16.961744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4998ff86-64f3-4606-b39e-7a6212739c1a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:17.020853 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4998ff86-64f3-4606-b39e-7a6212739c1a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.074819 Jan 22 21:21:17.026759 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3084/6444] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:16 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:17.042779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d2ef757-aa4c-4d79-b3e6-ea390f3bacf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:17.044408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d2ef757-aa4c-4d79-b3e6-ea390f3bacf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:17.052412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d2ef757-aa4c-4d79-b3e6-ea390f3bacf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:17.061722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d2ef757-aa4c-4d79-b3e6-ea390f3bacf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:17.061722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d2ef757-aa4c-4d79-b3e6-ea390f3bacf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:17.061722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d2ef757-aa4c-4d79-b3e6-ea390f3bacf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:17.117304 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d2ef757-aa4c-4d79-b3e6-ea390f3bacf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.075952 Jan 22 21:21:17.120255 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3361/6445] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:17 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:17.349407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cfa2f480-4174-4e55-81ab-961d80ea8a97 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:17.351413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cfa2f480-4174-4e55-81ab-961d80ea8a97 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:17.366327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfa2f480-4174-4e55-81ab-961d80ea8a97 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:17.367522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfa2f480-4174-4e55-81ab-961d80ea8a97 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:17.368857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfa2f480-4174-4e55-81ab-961d80ea8a97 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:17.370467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cfa2f480-4174-4e55-81ab-961d80ea8a97 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:17.449025 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cfa2f480-4174-4e55-81ab-961d80ea8a97 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7/action" status: 200 len: 63193 microversion: 2.1 time: 0.103734 Jan 22 21:21:17.451678 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3085/6446] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:17 2022] POST /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7/action => generated 63193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:17.798737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-459a809e-61f8-4780-b451-b32a64324cc4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:17.800100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-459a809e-61f8-4780-b451-b32a64324cc4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:17.807828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-459a809e-61f8-4780-b451-b32a64324cc4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:17.808285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-459a809e-61f8-4780-b451-b32a64324cc4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:17.809583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-459a809e-61f8-4780-b451-b32a64324cc4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:17.810328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-459a809e-61f8-4780-b451-b32a64324cc4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:17.865639 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-459a809e-61f8-4780-b451-b32a64324cc4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.065193 Jan 22 21:21:17.865639 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3362/6447] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:17 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:18.038031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c53bdb4d-d288-4fb4-abf0-a6b06d2cfb86 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:18.040330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c53bdb4d-d288-4fb4-abf0-a6b06d2cfb86 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:18.059169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c53bdb4d-d288-4fb4-abf0-a6b06d2cfb86 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:18.060325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c53bdb4d-d288-4fb4-abf0-a6b06d2cfb86 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:18.062173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c53bdb4d-d288-4fb4-abf0-a6b06d2cfb86 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:18.065724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c53bdb4d-d288-4fb4-abf0-a6b06d2cfb86 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:18.134105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e27c78cf-9201-4909-95af-85e1c2af2a5a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:18.135034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e27c78cf-9201-4909-95af-85e1c2af2a5a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:18.143426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e27c78cf-9201-4909-95af-85e1c2af2a5a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:18.143887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e27c78cf-9201-4909-95af-85e1c2af2a5a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:18.144696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e27c78cf-9201-4909-95af-85e1c2af2a5a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:18.145146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e27c78cf-9201-4909-95af-85e1c2af2a5a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:18.173394 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c53bdb4d-d288-4fb4-abf0-a6b06d2cfb86 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.141849 Jan 22 21:21:18.183022 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3086/6448] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:18 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:18.243260 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e27c78cf-9201-4909-95af-85e1c2af2a5a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.117331 Jan 22 21:21:18.245048 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3363/6449] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:18 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:18.872255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a0a2c8df-69e9-479d-adb1-c5ecb293cfff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:18.881114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a0a2c8df-69e9-479d-adb1-c5ecb293cfff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:18.891705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0a2c8df-69e9-479d-adb1-c5ecb293cfff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:18.892615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0a2c8df-69e9-479d-adb1-c5ecb293cfff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:18.897397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0a2c8df-69e9-479d-adb1-c5ecb293cfff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:18.897998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0a2c8df-69e9-479d-adb1-c5ecb293cfff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:18.968557 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a0a2c8df-69e9-479d-adb1-c5ecb293cfff tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.100448 Jan 22 21:21:18.969335 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3087/6450] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:18 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:19.195271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7feda1b4-9185-47b6-8614-417e3be151af tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:19.195271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7feda1b4-9185-47b6-8614-417e3be151af tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:19.213095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7feda1b4-9185-47b6-8614-417e3be151af tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:19.213743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7feda1b4-9185-47b6-8614-417e3be151af tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:19.216578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7feda1b4-9185-47b6-8614-417e3be151af tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:19.222048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7feda1b4-9185-47b6-8614-417e3be151af tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:19.256730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-52927c74-f374-43ff-845f-40a7cf4aede0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:19.259013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-52927c74-f374-43ff-845f-40a7cf4aede0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:19.273947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52927c74-f374-43ff-845f-40a7cf4aede0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:19.275335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52927c74-f374-43ff-845f-40a7cf4aede0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:19.276693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52927c74-f374-43ff-845f-40a7cf4aede0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:19.278140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52927c74-f374-43ff-845f-40a7cf4aede0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:19.281699 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7feda1b4-9185-47b6-8614-417e3be151af tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.094722 Jan 22 21:21:19.286889 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3364/6451] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:19 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:19.349131 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-52927c74-f374-43ff-845f-40a7cf4aede0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.096764 Jan 22 21:21:19.354576 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3088/6452] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:19 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:19.981848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e03d7b9f-a41b-4ec5-81c1-85ef8a3637bd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:19.983833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e03d7b9f-a41b-4ec5-81c1-85ef8a3637bd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:20.001748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e03d7b9f-a41b-4ec5-81c1-85ef8a3637bd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:20.002780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e03d7b9f-a41b-4ec5-81c1-85ef8a3637bd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:20.015344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e03d7b9f-a41b-4ec5-81c1-85ef8a3637bd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:20.015819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e03d7b9f-a41b-4ec5-81c1-85ef8a3637bd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:20.093197 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e03d7b9f-a41b-4ec5-81c1-85ef8a3637bd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.115645 Jan 22 21:21:20.097760 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3365/6453] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:19 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:20.303691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-466b2947-5d65-4a2d-844c-449f33129ad3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:20.306481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-466b2947-5d65-4a2d-844c-449f33129ad3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:20.320769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-466b2947-5d65-4a2d-844c-449f33129ad3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:20.321537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-466b2947-5d65-4a2d-844c-449f33129ad3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:20.324689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-466b2947-5d65-4a2d-844c-449f33129ad3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:20.326705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-466b2947-5d65-4a2d-844c-449f33129ad3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:20.364155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1084ad4-7150-45dd-a103-aeadb60cd42f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:20.367086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1084ad4-7150-45dd-a103-aeadb60cd42f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:20.393949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1084ad4-7150-45dd-a103-aeadb60cd42f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:20.394569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1084ad4-7150-45dd-a103-aeadb60cd42f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:20.395493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1084ad4-7150-45dd-a103-aeadb60cd42f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:20.402136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1084ad4-7150-45dd-a103-aeadb60cd42f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:20.464097 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1084ad4-7150-45dd-a103-aeadb60cd42f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.104830 Jan 22 21:21:20.465168 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-466b2947-5d65-4a2d-844c-449f33129ad3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.172027 Jan 22 21:21:20.465586 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3366/6454] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:20 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:20.468526 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3089/6455] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:20 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:21.111521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-28bfcd03-c0c7-41fc-9a25-bb9fbb18a43f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:21.112528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-28bfcd03-c0c7-41fc-9a25-bb9fbb18a43f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:21.120190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28bfcd03-c0c7-41fc-9a25-bb9fbb18a43f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:21.120837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28bfcd03-c0c7-41fc-9a25-bb9fbb18a43f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:21.121819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28bfcd03-c0c7-41fc-9a25-bb9fbb18a43f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:21.122509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28bfcd03-c0c7-41fc-9a25-bb9fbb18a43f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:21.207717 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-28bfcd03-c0c7-41fc-9a25-bb9fbb18a43f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.099308 Jan 22 21:21:21.212322 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3367/6456] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:21 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:21.480799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b582b152-fe3f-4f44-8652-edec2efdfd8b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:21.481447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0965a49c-cc93-40dd-97e2-9ea312449891 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:21.482521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b582b152-fe3f-4f44-8652-edec2efdfd8b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:21.482627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0965a49c-cc93-40dd-97e2-9ea312449891 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:21.489675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b582b152-fe3f-4f44-8652-edec2efdfd8b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:21.490886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b582b152-fe3f-4f44-8652-edec2efdfd8b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:21.497000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0965a49c-cc93-40dd-97e2-9ea312449891 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:21.502553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0965a49c-cc93-40dd-97e2-9ea312449891 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:21.504487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b582b152-fe3f-4f44-8652-edec2efdfd8b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:21.504954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b582b152-fe3f-4f44-8652-edec2efdfd8b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:21.508770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0965a49c-cc93-40dd-97e2-9ea312449891 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:21.509464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0965a49c-cc93-40dd-97e2-9ea312449891 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:21.564038 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0965a49c-cc93-40dd-97e2-9ea312449891 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.086946 Jan 22 21:21:21.567234 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3090/6457] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:21 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:21.614939 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b582b152-fe3f-4f44-8652-edec2efdfd8b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.137813 Jan 22 21:21:21.617055 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3368/6458] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:21 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:22.221724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5a499ce5-753a-41f9-81b5-2964f34a18bc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:22.232910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5a499ce5-753a-41f9-81b5-2964f34a18bc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:22.241488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a499ce5-753a-41f9-81b5-2964f34a18bc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:22.243045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a499ce5-753a-41f9-81b5-2964f34a18bc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:22.244074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a499ce5-753a-41f9-81b5-2964f34a18bc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:22.244762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a499ce5-753a-41f9-81b5-2964f34a18bc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:22.307408 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5a499ce5-753a-41f9-81b5-2964f34a18bc tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.090206 Jan 22 21:21:22.308198 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3091/6459] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:22 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:22.578575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0558e2fc-cc20-43ea-9cbf-0140972e885e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:22.581358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0558e2fc-cc20-43ea-9cbf-0140972e885e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:22.597283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0558e2fc-cc20-43ea-9cbf-0140972e885e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:22.599544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0558e2fc-cc20-43ea-9cbf-0140972e885e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:22.603860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0558e2fc-cc20-43ea-9cbf-0140972e885e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:22.604370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0558e2fc-cc20-43ea-9cbf-0140972e885e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:22.628894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-527746c3-a104-4ec1-ac42-dcc68c17f7b5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:22.629933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-527746c3-a104-4ec1-ac42-dcc68c17f7b5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:22.655994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-527746c3-a104-4ec1-ac42-dcc68c17f7b5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:22.656457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-527746c3-a104-4ec1-ac42-dcc68c17f7b5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:22.657279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-527746c3-a104-4ec1-ac42-dcc68c17f7b5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:22.657782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-527746c3-a104-4ec1-ac42-dcc68c17f7b5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:22.700036 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0558e2fc-cc20-43ea-9cbf-0140972e885e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.122549 Jan 22 21:21:22.701274 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3369/6460] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:22 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:22.734306 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-527746c3-a104-4ec1-ac42-dcc68c17f7b5 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.108910 Jan 22 21:21:22.735369 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3092/6461] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:22 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:21:22.843908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-408165845", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "450276e4-b8c9-4322-9dd8-f1637d2b1ee8"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:22.919411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] validate_networks() for [('450276e4-b8c9-4322-9dd8-f1637d2b1ee8', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:21:23.323726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8b1e15c0-cd83-4a0a-bcc9-3808373d3d91 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:23.325848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8b1e15c0-cd83-4a0a-bcc9-3808373d3d91 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:23.336803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b1e15c0-cd83-4a0a-bcc9-3808373d3d91 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:23.337462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b1e15c0-cd83-4a0a-bcc9-3808373d3d91 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:23.338431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b1e15c0-cd83-4a0a-bcc9-3808373d3d91 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:23.339017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b1e15c0-cd83-4a0a-bcc9-3808373d3d91 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:23.398710 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8b1e15c0-cd83-4a0a-bcc9-3808373d3d91 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.082865 Jan 22 21:21:23.399883 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3093/6462] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:23 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:23.712913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3cae02c0-65a7-45bf-956f-f1474649fd7a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:23.714081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3cae02c0-65a7-45bf-956f-f1474649fd7a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:23.727817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cae02c0-65a7-45bf-956f-f1474649fd7a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:23.728378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cae02c0-65a7-45bf-956f-f1474649fd7a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:23.729216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cae02c0-65a7-45bf-956f-f1474649fd7a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:23.734191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cae02c0-65a7-45bf-956f-f1474649fd7a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:23.795213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:21:23.795709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:21:23.796122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:21:23.796543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:21:23.796965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:21:23.808611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:23.809072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:23.810107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:23.810562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:23.812779 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3cae02c0-65a7-45bf-956f-f1474649fd7a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.104408 Jan 22 21:21:23.813540 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3094/6463] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:23 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:23.828990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-89d62536-25da-4816-8e7c-0592aad80210 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:23.830051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-89d62536-25da-4816-8e7c-0592aad80210 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:23.833331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Getting quotas for project 063a9e2a155241a3bf27e7d1b16d0419. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:21:23.840038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89d62536-25da-4816-8e7c-0592aad80210 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:23.840495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89d62536-25da-4816-8e7c-0592aad80210 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:23.841341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89d62536-25da-4816-8e7c-0592aad80210 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:23.842140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89d62536-25da-4816-8e7c-0592aad80210 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:23.844748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Getting quotas for user b9ea4bd8d1d94d6a8e41b26da41bd6fc and project 063a9e2a155241a3bf27e7d1b16d0419. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:21:23.872735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:21:23.877124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:21:23.892666 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-89d62536-25da-4816-8e7c-0592aad80210 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.077698 Jan 22 21:21:23.893328 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3095/6464] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:23 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:24.031470 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a9eefd32-b6e5-441e-ae6a-5ae79e4385ad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.328810 Jan 22 21:21:24.032775 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3370/6465] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:21:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 1331 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:21:24.057708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9ab4dff5-1fcb-4146-8946-a6583c79471c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:24.059252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9ab4dff5-1fcb-4146-8946-a6583c79471c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:24.161356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9ab4dff5-1fcb-4146-8946-a6583c79471c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:24.170976 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9ab4dff5-1fcb-4146-8946-a6583c79471c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1221 microversion: 2.1 time: 0.129575 Jan 22 21:21:24.171940 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3371/6466] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:24 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1221 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:24.383915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0c7508f8-e077-4317-a5e0-ed85d4ab2c2a tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:24.384921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0c7508f8-e077-4317-a5e0-ed85d4ab2c2a tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:24.395403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c7508f8-e077-4317-a5e0-ed85d4ab2c2a tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:24.395929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c7508f8-e077-4317-a5e0-ed85d4ab2c2a tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:24.397402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c7508f8-e077-4317-a5e0-ed85d4ab2c2a tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:24.397884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c7508f8-e077-4317-a5e0-ed85d4ab2c2a tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:24.411675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0bb94dc4-dfcd-4929-ba2b-1126fe8dc532 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:24.412867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0bb94dc4-dfcd-4929-ba2b-1126fe8dc532 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:24.425060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bb94dc4-dfcd-4929-ba2b-1126fe8dc532 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:24.425540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bb94dc4-dfcd-4929-ba2b-1126fe8dc532 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:24.429164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bb94dc4-dfcd-4929-ba2b-1126fe8dc532 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:24.434283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bb94dc4-dfcd-4929-ba2b-1126fe8dc532 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:24.481566 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0bb94dc4-dfcd-4929-ba2b-1126fe8dc532 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.074106 Jan 22 21:21:24.485685 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3372/6467] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:24 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:24.832317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0309b6d6-99e6-400c-ad9b-c9150f5b85e4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:24.833399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0309b6d6-99e6-400c-ad9b-c9150f5b85e4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:24.854381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0309b6d6-99e6-400c-ad9b-c9150f5b85e4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:24.855086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0309b6d6-99e6-400c-ad9b-c9150f5b85e4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:24.857777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0309b6d6-99e6-400c-ad9b-c9150f5b85e4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:24.857777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0309b6d6-99e6-400c-ad9b-c9150f5b85e4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:24.919935 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0309b6d6-99e6-400c-ad9b-c9150f5b85e4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.097703 Jan 22 21:21:24.922045 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3373/6468] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:24 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:24.931402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d506af30-11ec-404c-bd2f-323a404b59c1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:24.932718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d506af30-11ec-404c-bd2f-323a404b59c1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:24.940421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d506af30-11ec-404c-bd2f-323a404b59c1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:24.941073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d506af30-11ec-404c-bd2f-323a404b59c1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:24.942089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d506af30-11ec-404c-bd2f-323a404b59c1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:24.942667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d506af30-11ec-404c-bd2f-323a404b59c1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:24.998221 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d506af30-11ec-404c-bd2f-323a404b59c1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.070967 Jan 22 21:21:24.998894 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3374/6469] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:24 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:25.050681 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0c7508f8-e077-4317-a5e0-ed85d4ab2c2a tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1837 microversion: 2.1 time: 1.148829 Jan 22 21:21:25.051434 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3096/6470] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:23 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1837 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:25.191520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9993a3ce-f53e-4741-b617-cf27cd6851fb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:25.204729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9993a3ce-f53e-4741-b617-cf27cd6851fb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:25.270334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9993a3ce-f53e-4741-b617-cf27cd6851fb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:25.280292 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9993a3ce-f53e-4741-b617-cf27cd6851fb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1221 microversion: 2.1 time: 0.094313 Jan 22 21:21:25.290077 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3375/6471] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:25 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:25.493920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5849dc1f-1e38-4897-beac-f0ea8c627be5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:25.495263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5849dc1f-1e38-4897-beac-f0ea8c627be5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:25.502139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5849dc1f-1e38-4897-beac-f0ea8c627be5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:25.502603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5849dc1f-1e38-4897-beac-f0ea8c627be5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:25.503825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5849dc1f-1e38-4897-beac-f0ea8c627be5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:25.504684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5849dc1f-1e38-4897-beac-f0ea8c627be5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:25.584799 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5849dc1f-1e38-4897-beac-f0ea8c627be5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.088885 Jan 22 21:21:25.584799 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3097/6472] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:25 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:25.933363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c6dc99dc-3563-44c7-9c78-4efc33acf7ac tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:25.934327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c6dc99dc-3563-44c7-9c78-4efc33acf7ac tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:25.947368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6dc99dc-3563-44c7-9c78-4efc33acf7ac tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:25.949976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6dc99dc-3563-44c7-9c78-4efc33acf7ac tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:25.951038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6dc99dc-3563-44c7-9c78-4efc33acf7ac tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:25.951628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6dc99dc-3563-44c7-9c78-4efc33acf7ac tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:26.015709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b238902-050b-4718-bc11-91910f7cc59d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:26.016946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4b238902-050b-4718-bc11-91910f7cc59d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:26.028027 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c6dc99dc-3563-44c7-9c78-4efc33acf7ac tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.098191 Jan 22 21:21:26.028504 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3376/6473] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:25 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:26.031882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b238902-050b-4718-bc11-91910f7cc59d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:26.032884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b238902-050b-4718-bc11-91910f7cc59d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:26.034082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b238902-050b-4718-bc11-91910f7cc59d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:26.034487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b238902-050b-4718-bc11-91910f7cc59d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:26.092927 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b238902-050b-4718-bc11-91910f7cc59d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.084135 Jan 22 21:21:26.105683 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3098/6474] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:26 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:26.300951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-171cece8-3087-4685-8caa-c75dd1b1f816 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:26.305788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-171cece8-3087-4685-8caa-c75dd1b1f816 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:26.336025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-171cece8-3087-4685-8caa-c75dd1b1f816 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:26.337625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-171cece8-3087-4685-8caa-c75dd1b1f816 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:26.338664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-171cece8-3087-4685-8caa-c75dd1b1f816 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:26.344666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-171cece8-3087-4685-8caa-c75dd1b1f816 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:26.455499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-171cece8-3087-4685-8caa-c75dd1b1f816 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:26.472356 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-171cece8-3087-4685-8caa-c75dd1b1f816 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1273 microversion: 2.1 time: 0.177958 Jan 22 21:21:26.476713 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3377/6475] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:26 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:26.558997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b97f4290-a10f-4d28-acba-7438befaf051 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:26.560300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-7f1e8f2e-20bb-40f2-8c46-67beb29b7e60 req-4b34fbfe-99d7-4b14-9101-3b535deb609b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60f5752-e3a2-40ea-97fe-c98ebb12e4f7", "tag": "3b4b9042-2ab2-4731-b9ee-9b33a072ec37"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:26.561106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b97f4290-a10f-4d28-acba-7438befaf051 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:26.564893 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:21:26.564893 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:21:26.585967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b97f4290-a10f-4d28-acba-7438befaf051 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:26.588671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7f1e8f2e-20bb-40f2-8c46-67beb29b7e60 req-4b34fbfe-99d7-4b14-9101-3b535deb609b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:26.588899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b97f4290-a10f-4d28-acba-7438befaf051 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:26.589906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b97f4290-a10f-4d28-acba-7438befaf051 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:26.590448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b97f4290-a10f-4d28-acba-7438befaf051 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:26.591037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7f1e8f2e-20bb-40f2-8c46-67beb29b7e60 req-4b34fbfe-99d7-4b14-9101-3b535deb609b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:26.620726 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-7f1e8f2e-20bb-40f2-8c46-67beb29b7e60 req-4b34fbfe-99d7-4b14-9101-3b535deb609b service nova] Creating event network-changed:3b4b9042-2ab2-4731-b9ee-9b33a072ec37 for instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 on nch1-master-1 Jan 22 21:21:26.631478 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-7f1e8f2e-20bb-40f2-8c46-67beb29b7e60 req-4b34fbfe-99d7-4b14-9101-3b535deb609b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077093 Jan 22 21:21:26.635161 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3378/6476] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:21:26.657381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5273a56e-ab72-4ea6-a9bd-e34adb9b5691 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:26.680800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5273a56e-ab72-4ea6-a9bd-e34adb9b5691 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:26.694711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b97f4290-a10f-4d28-acba-7438befaf051 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:21:26.708779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5273a56e-ab72-4ea6-a9bd-e34adb9b5691 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:26.715759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5273a56e-ab72-4ea6-a9bd-e34adb9b5691 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:26.716787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5273a56e-ab72-4ea6-a9bd-e34adb9b5691 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:26.719987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5273a56e-ab72-4ea6-a9bd-e34adb9b5691 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:26.816126 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5273a56e-ab72-4ea6-a9bd-e34adb9b5691 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.170462 Jan 22 21:21:26.825283 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3379/6477] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:26 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:27.042468 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b97f4290-a10f-4d28-acba-7438befaf051 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "DELETE /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 204 len: 0 microversion: 2.1 time: 0.492897 Jan 22 21:21:27.047226 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3099/6478] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:21:26 2022] DELETE /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:21:27.053672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b79b4816-5cd3-4512-96aa-709e1b156e76 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:27.056016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b79b4816-5cd3-4512-96aa-709e1b156e76 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:27.062088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-50fe6f47-d97c-4582-8b93-024adbaec9c6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:27.063704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-50fe6f47-d97c-4582-8b93-024adbaec9c6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:27.076606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b79b4816-5cd3-4512-96aa-709e1b156e76 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:27.079060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b79b4816-5cd3-4512-96aa-709e1b156e76 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:27.082523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50fe6f47-d97c-4582-8b93-024adbaec9c6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:27.083021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50fe6f47-d97c-4582-8b93-024adbaec9c6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:27.084263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50fe6f47-d97c-4582-8b93-024adbaec9c6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:27.087030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b79b4816-5cd3-4512-96aa-709e1b156e76 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:27.087245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b79b4816-5cd3-4512-96aa-709e1b156e76 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:27.090690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50fe6f47-d97c-4582-8b93-024adbaec9c6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:27.157609 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b79b4816-5cd3-4512-96aa-709e1b156e76 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.121896 Jan 22 21:21:27.158723 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3380/6479] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:27 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:27.164634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-71c29e7a-444f-42a7-a86b-720ca93e2f32 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:27.166750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-71c29e7a-444f-42a7-a86b-720ca93e2f32 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:27.175175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71c29e7a-444f-42a7-a86b-720ca93e2f32 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:27.175924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71c29e7a-444f-42a7-a86b-720ca93e2f32 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:27.176911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71c29e7a-444f-42a7-a86b-720ca93e2f32 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:27.177761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71c29e7a-444f-42a7-a86b-720ca93e2f32 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:27.223593 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-71c29e7a-444f-42a7-a86b-720ca93e2f32 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.063159 Jan 22 21:21:27.229255 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3381/6480] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:27 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:27.496390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-06b552a7-213e-4e7c-a107-98f8431b658b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:27.497535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-06b552a7-213e-4e7c-a107-98f8431b658b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:27.504886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06b552a7-213e-4e7c-a107-98f8431b658b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:27.505632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06b552a7-213e-4e7c-a107-98f8431b658b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:27.507148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06b552a7-213e-4e7c-a107-98f8431b658b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:27.507603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06b552a7-213e-4e7c-a107-98f8431b658b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:27.595033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-06b552a7-213e-4e7c-a107-98f8431b658b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:27.607214 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-06b552a7-213e-4e7c-a107-98f8431b658b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1291 microversion: 2.1 time: 0.114215 Jan 22 21:21:27.617573 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3382/6481] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:27 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1291 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:21:27.828718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-94ff2e65-ae93-4d81-aa4a-54ea176b6b00 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:27.829785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-94ff2e65-ae93-4d81-aa4a-54ea176b6b00 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:27.836500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94ff2e65-ae93-4d81-aa4a-54ea176b6b00 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:27.837020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94ff2e65-ae93-4d81-aa4a-54ea176b6b00 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:27.837856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94ff2e65-ae93-4d81-aa4a-54ea176b6b00 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:27.838303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94ff2e65-ae93-4d81-aa4a-54ea176b6b00 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:27.882503 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-94ff2e65-ae93-4d81-aa4a-54ea176b6b00 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 32606 microversion: 2.20 time: 0.057456 Jan 22 21:21:27.883668 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3383/6482] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:27 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 32606 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:28.101352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-50fe6f47-d97c-4582-8b93-024adbaec9c6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:28.109805 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-50fe6f47-d97c-4582-8b93-024adbaec9c6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1692 microversion: 2.1 time: 1.059787 Jan 22 21:21:28.110386 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3100/6483] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:27 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1692 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:28.170831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c221ea1c-2543-4352-807b-21c230584a09 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:28.172187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c221ea1c-2543-4352-807b-21c230584a09 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:28.181557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c221ea1c-2543-4352-807b-21c230584a09 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:28.182458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c221ea1c-2543-4352-807b-21c230584a09 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:28.183714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c221ea1c-2543-4352-807b-21c230584a09 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:28.184219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c221ea1c-2543-4352-807b-21c230584a09 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:28.236280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eb7b0966-c04e-4610-9c4a-1e15e21ced59 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:28.237537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eb7b0966-c04e-4610-9c4a-1e15e21ced59 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:28.242158 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c221ea1c-2543-4352-807b-21c230584a09 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.075351 Jan 22 21:21:28.245661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb7b0966-c04e-4610-9c4a-1e15e21ced59 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:28.246469 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3384/6484] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:28 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:28.247344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb7b0966-c04e-4610-9c4a-1e15e21ced59 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:28.248394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb7b0966-c04e-4610-9c4a-1e15e21ced59 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:28.249001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb7b0966-c04e-4610-9c4a-1e15e21ced59 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:28.294241 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eb7b0966-c04e-4610-9c4a-1e15e21ced59 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.061136 Jan 22 21:21:28.295349 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3101/6485] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:28 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:21:28.614175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c29c2f7b-a1ac-4eb0-bd63-8fc8b71ef262 tempest-PortsAdminExtendedAttrsTestJSON-1638247352 tempest-PortsAdminExtendedAttrsTestJSON-1638247352-project-admin] Calling method '.version_select at 0x7f1ed5d4f430>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:28.615332 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:21:28.615332 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:21:28.617358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c29c2f7b-a1ac-4eb0-bd63-8fc8b71ef262 tempest-PortsAdminExtendedAttrsTestJSON-1638247352 tempest-PortsAdminExtendedAttrsTestJSON-1638247352-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:28.617906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c29c2f7b-a1ac-4eb0-bd63-8fc8b71ef262 tempest-PortsAdminExtendedAttrsTestJSON-1638247352 tempest-PortsAdminExtendedAttrsTestJSON-1638247352-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:28.636292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-65b955b3-951c-44ed-b9e9-99a070565a75 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:28.638332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-65b955b3-951c-44ed-b9e9-99a070565a75 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:28.644957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c29c2f7b-a1ac-4eb0-bd63-8fc8b71ef262 tempest-PortsAdminExtendedAttrsTestJSON-1638247352 tempest-PortsAdminExtendedAttrsTestJSON-1638247352-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:28.645671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c29c2f7b-a1ac-4eb0-bd63-8fc8b71ef262 tempest-PortsAdminExtendedAttrsTestJSON-1638247352 tempest-PortsAdminExtendedAttrsTestJSON-1638247352-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:28.653300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65b955b3-951c-44ed-b9e9-99a070565a75 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:28.654082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65b955b3-951c-44ed-b9e9-99a070565a75 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:28.655338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65b955b3-951c-44ed-b9e9-99a070565a75 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:28.656291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65b955b3-951c-44ed-b9e9-99a070565a75 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:28.661704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c29c2f7b-a1ac-4eb0-bd63-8fc8b71ef262 tempest-PortsAdminExtendedAttrsTestJSON-1638247352 tempest-PortsAdminExtendedAttrsTestJSON-1638247352-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:28.662642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c29c2f7b-a1ac-4eb0-bd63-8fc8b71ef262 tempest-PortsAdminExtendedAttrsTestJSON-1638247352 tempest-PortsAdminExtendedAttrsTestJSON-1638247352-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:28.669695 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c29c2f7b-a1ac-4eb0-bd63-8fc8b71ef262 tempest-PortsAdminExtendedAttrsTestJSON-1638247352 tempest-PortsAdminExtendedAttrsTestJSON-1638247352-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.192172 Jan 22 21:21:28.670499 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3385/6486] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:21:28 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:21:28.800131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-65b955b3-951c-44ed-b9e9-99a070565a75 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:28.808899 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-65b955b3-951c-44ed-b9e9-99a070565a75 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1279 microversion: 2.1 time: 0.180902 Jan 22 21:21:28.809807 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3102/6487] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:28 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1279 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:28.895186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0ada2e4d-5364-49f7-b03e-bfb33e43ef71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:28.896738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0ada2e4d-5364-49f7-b03e-bfb33e43ef71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:28.904342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ada2e4d-5364-49f7-b03e-bfb33e43ef71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:28.905188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ada2e4d-5364-49f7-b03e-bfb33e43ef71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:28.906492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ada2e4d-5364-49f7-b03e-bfb33e43ef71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:28.910223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ada2e4d-5364-49f7-b03e-bfb33e43ef71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:28.998819 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0ada2e4d-5364-49f7-b03e-bfb33e43ef71 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 200 len: 40758 microversion: 2.20 time: 0.106762 Jan 22 21:21:29.001534 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3386/6488] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:28 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 40758 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:29.011426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f33eec11-2675-464b-9f81-0bc9c22cde75 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:29.011548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f33eec11-2675-464b-9f81-0bc9c22cde75 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:29.018606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f33eec11-2675-464b-9f81-0bc9c22cde75 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:29.019064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f33eec11-2675-464b-9f81-0bc9c22cde75 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:29.019881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f33eec11-2675-464b-9f81-0bc9c22cde75 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:29.020335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f33eec11-2675-464b-9f81-0bc9c22cde75 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:29.060975 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f33eec11-2675-464b-9f81-0bc9c22cde75 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/ips" status: 200 len: 153 microversion: 2.20 time: 0.053977 Jan 22 21:21:29.067148 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3103/6489] 10.222.0.100 () {60 vars in 1293 bytes} [Sat Jan 22 21:21:29 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/ips => generated 153 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:29.128377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-999d74df-51b5-4afc-8573-03faa0db2f50 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:29.129944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-999d74df-51b5-4afc-8573-03faa0db2f50 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:29.144608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-999d74df-51b5-4afc-8573-03faa0db2f50 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:29.145077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-999d74df-51b5-4afc-8573-03faa0db2f50 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:29.145938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-999d74df-51b5-4afc-8573-03faa0db2f50 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:29.147147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-999d74df-51b5-4afc-8573-03faa0db2f50 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:29.260034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e0f3c8cd-48aa-4a2c-85a9-f7b6dd03523e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:29.261035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e0f3c8cd-48aa-4a2c-85a9-f7b6dd03523e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:29.275625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0f3c8cd-48aa-4a2c-85a9-f7b6dd03523e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:29.276104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0f3c8cd-48aa-4a2c-85a9-f7b6dd03523e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:29.279131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0f3c8cd-48aa-4a2c-85a9-f7b6dd03523e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:29.282809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0f3c8cd-48aa-4a2c-85a9-f7b6dd03523e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:29.367644 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e0f3c8cd-48aa-4a2c-85a9-f7b6dd03523e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.110670 Jan 22 21:21:29.369714 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3104/6490] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:29 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:29.377496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3766d20e-61ab-45a7-9753-58f17f7ab840 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:29.378944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3766d20e-61ab-45a7-9753-58f17f7ab840 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:29.398436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3766d20e-61ab-45a7-9753-58f17f7ab840 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:29.398906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3766d20e-61ab-45a7-9753-58f17f7ab840 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:29.402885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3766d20e-61ab-45a7-9753-58f17f7ab840 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:29.405081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3766d20e-61ab-45a7-9753-58f17f7ab840 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:29.471791 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3766d20e-61ab-45a7-9753-58f17f7ab840 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.099383 Jan 22 21:21:29.473793 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3105/6491] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:29 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:29.601165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-999d74df-51b5-4afc-8573-03faa0db2f50 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:29.614038 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-999d74df-51b5-4afc-8573-03faa0db2f50 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1692 microversion: 2.1 time: 0.489780 Jan 22 21:21:29.615417 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3387/6492] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:29 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1692 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:29.832314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0a13027e-f183-4350-b916-a51a15db1d8d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:29.835024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0a13027e-f183-4350-b916-a51a15db1d8d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:29.861898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a13027e-f183-4350-b916-a51a15db1d8d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:29.863047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a13027e-f183-4350-b916-a51a15db1d8d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:29.864613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a13027e-f183-4350-b916-a51a15db1d8d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:29.865304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a13027e-f183-4350-b916-a51a15db1d8d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:30.379372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b972a328-8c23-4fec-b083-af38ac6ed6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:30.381247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b972a328-8c23-4fec-b083-af38ac6ed6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:30.393400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b972a328-8c23-4fec-b083-af38ac6ed6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:30.393978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b972a328-8c23-4fec-b083-af38ac6ed6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:30.395058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b972a328-8c23-4fec-b083-af38ac6ed6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:30.395672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b972a328-8c23-4fec-b083-af38ac6ed6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:30.463930 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b972a328-8c23-4fec-b083-af38ac6ed6c2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.088326 Jan 22 21:21:30.465929 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3388/6493] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:30 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:30.484770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dffd2eaf-f433-404c-bc78-02468588dde9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:30.486322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dffd2eaf-f433-404c-bc78-02468588dde9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:30.494936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dffd2eaf-f433-404c-bc78-02468588dde9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:30.495406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dffd2eaf-f433-404c-bc78-02468588dde9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:30.496485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dffd2eaf-f433-404c-bc78-02468588dde9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:30.497088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dffd2eaf-f433-404c-bc78-02468588dde9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:30.545915 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dffd2eaf-f433-404c-bc78-02468588dde9 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.065103 Jan 22 21:21:30.547570 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3389/6494] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:30 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:30.638899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0a13027e-f183-4350-b916-a51a15db1d8d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:30.644550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e56b2048-765f-4855-b6c2-3e0f4adcccf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:30.645324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e56b2048-765f-4855-b6c2-3e0f4adcccf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:30.647466 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0a13027e-f183-4350-b916-a51a15db1d8d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1321 microversion: 2.1 time: 0.823628 Jan 22 21:21:30.648071 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3106/6495] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:29 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1321 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:30.687048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e56b2048-765f-4855-b6c2-3e0f4adcccf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:30.687685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e56b2048-765f-4855-b6c2-3e0f4adcccf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:30.688524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e56b2048-765f-4855-b6c2-3e0f4adcccf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:30.688978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e56b2048-765f-4855-b6c2-3e0f4adcccf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:30.827494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e56b2048-765f-4855-b6c2-3e0f4adcccf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:30.836741 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e56b2048-765f-4855-b6c2-3e0f4adcccf1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1506 microversion: 2.1 time: 0.200187 Jan 22 21:21:30.838135 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3390/6496] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:30 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:30.896705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-12912289-3651-43b3-9edd-6c91296bdb0d req-63f84bb8-e287-4c2d-9ffb-dbc2a1cff4c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60f5752-e3a2-40ea-97fe-c98ebb12e4f7", "name": "network-vif-deleted", "tag": "3b4b9042-2ab2-4731-b9ee-9b33a072ec37"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:30.896705 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:21:30.896705 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:21:30.902761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-12912289-3651-43b3-9edd-6c91296bdb0d req-63f84bb8-e287-4c2d-9ffb-dbc2a1cff4c1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:30.903460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-12912289-3651-43b3-9edd-6c91296bdb0d req-63f84bb8-e287-4c2d-9ffb-dbc2a1cff4c1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:30.929545 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-12912289-3651-43b3-9edd-6c91296bdb0d req-63f84bb8-e287-4c2d-9ffb-dbc2a1cff4c1 service nova] Creating event network-vif-deleted:3b4b9042-2ab2-4731-b9ee-9b33a072ec37 for instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 on nch1-master-1 Jan 22 21:21:30.943943 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-12912289-3651-43b3-9edd-6c91296bdb0d req-63f84bb8-e287-4c2d-9ffb-dbc2a1cff4c1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054294 Jan 22 21:21:30.949076 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3107/6497] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:21:31.477664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7b982ff2-3ed8-4d48-be6f-264c2d806bf0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:31.478626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7b982ff2-3ed8-4d48-be6f-264c2d806bf0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:31.494832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b982ff2-3ed8-4d48-be6f-264c2d806bf0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:31.495304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b982ff2-3ed8-4d48-be6f-264c2d806bf0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:31.496139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b982ff2-3ed8-4d48-be6f-264c2d806bf0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:31.496582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b982ff2-3ed8-4d48-be6f-264c2d806bf0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:31.542145 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7b982ff2-3ed8-4d48-be6f-264c2d806bf0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.069137 Jan 22 21:21:31.546117 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3391/6498] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:31 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:31.559760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-750dbf2c-0d78-4131-a0ef-e4e7064cccb4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:31.560962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-750dbf2c-0d78-4131-a0ef-e4e7064cccb4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:31.569278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-750dbf2c-0d78-4131-a0ef-e4e7064cccb4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:31.569934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-750dbf2c-0d78-4131-a0ef-e4e7064cccb4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:31.570895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-750dbf2c-0d78-4131-a0ef-e4e7064cccb4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:31.571489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-750dbf2c-0d78-4131-a0ef-e4e7064cccb4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:31.615190 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-750dbf2c-0d78-4131-a0ef-e4e7064cccb4 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.059653 Jan 22 21:21:31.616099 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3108/6499] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:31 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:21:31.665222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-424f69ba-03a1-4b41-b7af-215e510150a5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:31.666577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-424f69ba-03a1-4b41-b7af-215e510150a5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:31.674344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-424f69ba-03a1-4b41-b7af-215e510150a5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:31.675013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-424f69ba-03a1-4b41-b7af-215e510150a5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:31.680020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-424f69ba-03a1-4b41-b7af-215e510150a5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:31.680020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-424f69ba-03a1-4b41-b7af-215e510150a5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:31.870676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f1474afd-1569-46b1-ae5b-638712349ab2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:31.872861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f1474afd-1569-46b1-ae5b-638712349ab2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:31.976651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1474afd-1569-46b1-ae5b-638712349ab2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:31.976651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1474afd-1569-46b1-ae5b-638712349ab2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:31.976651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1474afd-1569-46b1-ae5b-638712349ab2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:31.976651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1474afd-1569-46b1-ae5b-638712349ab2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:31.978434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-424f69ba-03a1-4b41-b7af-215e510150a5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:31.978434 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-424f69ba-03a1-4b41-b7af-215e510150a5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1321 microversion: 2.1 time: 0.310158 Jan 22 21:21:31.978434 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3392/6500] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:31 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:32.070708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1474afd-1569-46b1-ae5b-638712349ab2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:32.070708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1474afd-1569-46b1-ae5b-638712349ab2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:32.070708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-f1474afd-1569-46b1-ae5b-638712349ab2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lazy-loading 'fault' on Instance uuid d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:21:32.125709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f1474afd-1569-46b1-ae5b-638712349ab2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:32.139928 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f1474afd-1569-46b1-ae5b-638712349ab2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 200 len: 1361 microversion: 2.1 time: 0.285857 Jan 22 21:21:32.144400 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3109/6501] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:31 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 1361 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:32.557385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-04e1eb34-96bd-4a07-a5cb-969534e49d5b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:32.559694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-04e1eb34-96bd-4a07-a5cb-969534e49d5b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:32.582110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04e1eb34-96bd-4a07-a5cb-969534e49d5b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:32.582605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04e1eb34-96bd-4a07-a5cb-969534e49d5b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:32.583413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04e1eb34-96bd-4a07-a5cb-969534e49d5b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:32.584557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04e1eb34-96bd-4a07-a5cb-969534e49d5b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:32.630844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ae0eeb5-e082-407f-b660-e80362d1233c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:32.632070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1ae0eeb5-e082-407f-b660-e80362d1233c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:32.653342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ae0eeb5-e082-407f-b660-e80362d1233c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:32.656491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ae0eeb5-e082-407f-b660-e80362d1233c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:32.661840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ae0eeb5-e082-407f-b660-e80362d1233c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:32.663437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ae0eeb5-e082-407f-b660-e80362d1233c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:32.720293 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-04e1eb34-96bd-4a07-a5cb-969534e49d5b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.169531 Jan 22 21:21:32.727350 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3393/6502] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:32 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:32.784701 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1ae0eeb5-e082-407f-b660-e80362d1233c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.151358 Jan 22 21:21:32.784701 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3110/6503] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:32 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:21:32.954763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-40a00ec2-6393-48f5-8996-e1a40ae7a764 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:32.955631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-40a00ec2-6393-48f5-8996-e1a40ae7a764 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:32.962774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40a00ec2-6393-48f5-8996-e1a40ae7a764 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:32.963499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40a00ec2-6393-48f5-8996-e1a40ae7a764 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:32.964301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40a00ec2-6393-48f5-8996-e1a40ae7a764 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:32.964739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40a00ec2-6393-48f5-8996-e1a40ae7a764 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:32.992570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-40a00ec2-6393-48f5-8996-e1a40ae7a764 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lazy-loading 'flavor' on Instance uuid 89583718-5186-41d5-b5f3-ad8997c3eb59 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:21:32.995330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-98134118-18ec-4cd0-9603-466d2aba17d7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:32.996868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-98134118-18ec-4cd0-9603-466d2aba17d7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:33.010547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98134118-18ec-4cd0-9603-466d2aba17d7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:33.011153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98134118-18ec-4cd0-9603-466d2aba17d7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:33.013295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98134118-18ec-4cd0-9603-466d2aba17d7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:33.015354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-98134118-18ec-4cd0-9603-466d2aba17d7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:33.582090 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-40a00ec2-6393-48f5-8996-e1a40ae7a764 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 202 len: 0 microversion: 2.20 time: 0.633599 Jan 22 21:21:33.584353 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3394/6504] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:32 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:21:33.602926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-e709b1c5-be75-4cc9-acf6-508a4b6db4c7 req-66bd5dd5-4ef3-4d53-a032-708597ce71c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1333f8b7-c8db-487d-b9e6-b5452b4bae48", "tag": "d5898bbb-29a7-4212-9028-982ac355edf5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:33.631327 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:21:33.631327 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:21:33.648982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e709b1c5-be75-4cc9-acf6-508a4b6db4c7 req-66bd5dd5-4ef3-4d53-a032-708597ce71c8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:33.651579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e709b1c5-be75-4cc9-acf6-508a4b6db4c7 req-66bd5dd5-4ef3-4d53-a032-708597ce71c8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:33.681114 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-e709b1c5-be75-4cc9-acf6-508a4b6db4c7 req-66bd5dd5-4ef3-4d53-a032-708597ce71c8 service nova] Creating event network-changed:d5898bbb-29a7-4212-9028-982ac355edf5 for instance 1333f8b7-c8db-487d-b9e6-b5452b4bae48 on nch1-master-1 Jan 22 21:21:33.694768 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-e709b1c5-be75-4cc9-acf6-508a4b6db4c7 req-66bd5dd5-4ef3-4d53-a032-708597ce71c8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103808 Jan 22 21:21:33.697288 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3395/6505] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:21:33.702563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-98134118-18ec-4cd0-9603-466d2aba17d7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:33.716065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-da1f92ee-488c-4dc0-b3e8-b6adb0fff4b0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:33.717334 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-98134118-18ec-4cd0-9603-466d2aba17d7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1321 microversion: 2.1 time: 0.731122 Jan 22 21:21:33.717772 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3111/6506] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:32 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1321 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:33.727455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-da1f92ee-488c-4dc0-b3e8-b6adb0fff4b0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: d60f5752-e3a2-40ea-97fe-c98ebb12e4f7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:33.730904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-61dc1d85-a7e3-4640-a23c-705998881a21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:33.731527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-61dc1d85-a7e3-4640-a23c-705998881a21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:33.743697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da1f92ee-488c-4dc0-b3e8-b6adb0fff4b0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:33.745096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61dc1d85-a7e3-4640-a23c-705998881a21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:33.749071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61dc1d85-a7e3-4640-a23c-705998881a21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:33.749071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61dc1d85-a7e3-4640-a23c-705998881a21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:33.749071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61dc1d85-a7e3-4640-a23c-705998881a21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:33.749361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da1f92ee-488c-4dc0-b3e8-b6adb0fff4b0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:33.749361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da1f92ee-488c-4dc0-b3e8-b6adb0fff4b0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:33.749361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da1f92ee-488c-4dc0-b3e8-b6adb0fff4b0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:33.787957 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-da1f92ee-488c-4dc0-b3e8-b6adb0fff4b0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] HTTP exception thrown: Instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 could not be found. Jan 22 21:21:33.794307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-da1f92ee-488c-4dc0-b3e8-b6adb0fff4b0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Returning 404 to user: Instance d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:21:33.795196 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-da1f92ee-488c-4dc0-b3e8-b6adb0fff4b0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7" status: 404 len: 111 microversion: 2.1 time: 0.095969 Jan 22 21:21:33.795787 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3396/6507] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:33 2022] GET /compute/v2.1/servers/d60f5752-e3a2-40ea-97fe-c98ebb12e4f7 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:21:33.805180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-80af97c5-7da0-49d8-bc8f-b37423cf3983 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:33.808062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-80af97c5-7da0-49d8-bc8f-b37423cf3983 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:33.813750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80af97c5-7da0-49d8-bc8f-b37423cf3983 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:33.814413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80af97c5-7da0-49d8-bc8f-b37423cf3983 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:33.815643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80af97c5-7da0-49d8-bc8f-b37423cf3983 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:33.816874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80af97c5-7da0-49d8-bc8f-b37423cf3983 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:33.870296 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-80af97c5-7da0-49d8-bc8f-b37423cf3983 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.073174 Jan 22 21:21:33.875324 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3397/6508] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:33 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:33.881980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8a243ef4-f9c2-49e4-8a87-b630cc6db836 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:33.883368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8a243ef4-f9c2-49e4-8a87-b630cc6db836 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:33.891054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a243ef4-f9c2-49e4-8a87-b630cc6db836 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:33.891550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a243ef4-f9c2-49e4-8a87-b630cc6db836 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:33.892345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a243ef4-f9c2-49e4-8a87-b630cc6db836 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:33.892916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a243ef4-f9c2-49e4-8a87-b630cc6db836 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:33.935790 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8a243ef4-f9c2-49e4-8a87-b630cc6db836 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.058601 Jan 22 21:21:33.936899 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3398/6509] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:33 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:34.096729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-61dc1d85-a7e3-4640-a23c-705998881a21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:34.109880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-61dc1d85-a7e3-4640-a23c-705998881a21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:34.112271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-61dc1d85-a7e3-4640-a23c-705998881a21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:34.113729 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-61dc1d85-a7e3-4640-a23c-705998881a21 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1729 microversion: 2.20 time: 0.394813 Jan 22 21:21:34.114874 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3112/6510] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:33 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1729 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:21:34.737643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-54690b73-70fa-47fc-a2b9-528b9103d61d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:34.738361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-54690b73-70fa-47fc-a2b9-528b9103d61d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:34.752506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54690b73-70fa-47fc-a2b9-528b9103d61d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:34.753187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54690b73-70fa-47fc-a2b9-528b9103d61d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:34.753988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54690b73-70fa-47fc-a2b9-528b9103d61d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:34.754627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54690b73-70fa-47fc-a2b9-528b9103d61d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:34.883182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ef79e23b-bd6f-46f9-bb3e-04479fb7ea1c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:34.884423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ef79e23b-bd6f-46f9-bb3e-04479fb7ea1c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:34.889859 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:21:34.890043 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 21:21:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 (ip 10.222.0.100) !!! Jan 22 21:21:34.893931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef79e23b-bd6f-46f9-bb3e-04479fb7ea1c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:34.894552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef79e23b-bd6f-46f9-bb3e-04479fb7ea1c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:34.895899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef79e23b-bd6f-46f9-bb3e-04479fb7ea1c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:34.896774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef79e23b-bd6f-46f9-bb3e-04479fb7ea1c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:34.964782 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ef79e23b-bd6f-46f9-bb3e-04479fb7ea1c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.085829 Jan 22 21:21:34.966355 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3113/6511] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:34 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:34.981636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a9ebdc86-7a6e-4d85-8643-85cbb6ab7669 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:34.981636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a9ebdc86-7a6e-4d85-8643-85cbb6ab7669 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:34.986935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ebdc86-7a6e-4d85-8643-85cbb6ab7669 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:34.987534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ebdc86-7a6e-4d85-8643-85cbb6ab7669 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:34.988359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ebdc86-7a6e-4d85-8643-85cbb6ab7669 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:34.989439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ebdc86-7a6e-4d85-8643-85cbb6ab7669 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:35.043077 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a9ebdc86-7a6e-4d85-8643-85cbb6ab7669 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.074835 Jan 22 21:21:35.043998 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3114/6512] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:34 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:35.133340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-de9da445-183f-4c51-9c07-540cf7d51f80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:35.134823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-de9da445-183f-4c51-9c07-540cf7d51f80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:35.143816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-54690b73-70fa-47fc-a2b9-528b9103d61d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:35.155906 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-54690b73-70fa-47fc-a2b9-528b9103d61d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1321 microversion: 2.1 time: 0.422909 Jan 22 21:21:35.156786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de9da445-183f-4c51-9c07-540cf7d51f80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:35.157428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de9da445-183f-4c51-9c07-540cf7d51f80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:35.158434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de9da445-183f-4c51-9c07-540cf7d51f80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:35.160487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-de9da445-183f-4c51-9c07-540cf7d51f80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:35.161194 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3399/6513] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:34 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:35.459909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-de9da445-183f-4c51-9c07-540cf7d51f80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:35.469448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-de9da445-183f-4c51-9c07-540cf7d51f80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:35.473832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-de9da445-183f-4c51-9c07-540cf7d51f80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:35.475410 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-de9da445-183f-4c51-9c07-540cf7d51f80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1729 microversion: 2.20 time: 0.346987 Jan 22 21:21:35.476194 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3115/6514] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:35 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1729 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:21:35.976597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2a128411-0784-4ead-852c-4bae05f1b94a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:35.977702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2a128411-0784-4ead-852c-4bae05f1b94a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:35.984529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a128411-0784-4ead-852c-4bae05f1b94a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:35.984994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a128411-0784-4ead-852c-4bae05f1b94a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:35.985825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a128411-0784-4ead-852c-4bae05f1b94a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:35.986311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a128411-0784-4ead-852c-4bae05f1b94a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:36.029562 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2a128411-0784-4ead-852c-4bae05f1b94a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.056763 Jan 22 21:21:36.030396 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3400/6515] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:35 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:36.055826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-073e62d6-2614-41b0-a0ab-fe70f78ab39d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:36.056765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-073e62d6-2614-41b0-a0ab-fe70f78ab39d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:36.066728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-073e62d6-2614-41b0-a0ab-fe70f78ab39d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:36.067200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-073e62d6-2614-41b0-a0ab-fe70f78ab39d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:36.068029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-073e62d6-2614-41b0-a0ab-fe70f78ab39d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:36.068484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-073e62d6-2614-41b0-a0ab-fe70f78ab39d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:36.126973 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-073e62d6-2614-41b0-a0ab-fe70f78ab39d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.075039 Jan 22 21:21:36.127319 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3116/6516] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:36 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:36.180985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0923fb70-2ed6-443e-9b1b-a9f36802b86e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:36.181721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0923fb70-2ed6-443e-9b1b-a9f36802b86e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:36.189621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0923fb70-2ed6-443e-9b1b-a9f36802b86e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:36.189981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0923fb70-2ed6-443e-9b1b-a9f36802b86e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:36.190991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0923fb70-2ed6-443e-9b1b-a9f36802b86e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:36.191609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0923fb70-2ed6-443e-9b1b-a9f36802b86e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:36.501703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c7a19bae-4fb4-4763-a4f1-2602e2e7719e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:36.501703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c7a19bae-4fb4-4763-a4f1-2602e2e7719e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:36.509678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7a19bae-4fb4-4763-a4f1-2602e2e7719e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:36.510482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7a19bae-4fb4-4763-a4f1-2602e2e7719e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:36.511618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7a19bae-4fb4-4763-a4f1-2602e2e7719e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:36.512172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7a19bae-4fb4-4763-a4f1-2602e2e7719e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:36.730023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0923fb70-2ed6-443e-9b1b-a9f36802b86e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:36.737315 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0923fb70-2ed6-443e-9b1b-a9f36802b86e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1321 microversion: 2.1 time: 0.564305 Jan 22 21:21:36.737920 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3401/6517] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:36 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1321 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:36.800820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c7a19bae-4fb4-4763-a4f1-2602e2e7719e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:36.810871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c7a19bae-4fb4-4763-a4f1-2602e2e7719e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:36.812173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c7a19bae-4fb4-4763-a4f1-2602e2e7719e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:36.813376 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c7a19bae-4fb4-4763-a4f1-2602e2e7719e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1729 microversion: 2.20 time: 0.322581 Jan 22 21:21:36.813995 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3117/6518] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:36 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1729 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:21:37.042063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-046204e6-51e1-40d3-b117-f5f68a5b7d5b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:37.043001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-046204e6-51e1-40d3-b117-f5f68a5b7d5b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:37.060671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-046204e6-51e1-40d3-b117-f5f68a5b7d5b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:37.061211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-046204e6-51e1-40d3-b117-f5f68a5b7d5b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:37.062039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-046204e6-51e1-40d3-b117-f5f68a5b7d5b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:37.062489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-046204e6-51e1-40d3-b117-f5f68a5b7d5b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:37.139280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85f9e6aa-d648-4c24-85d9-34bb5ee993f7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:37.144116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85f9e6aa-d648-4c24-85d9-34bb5ee993f7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:37.163758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85f9e6aa-d648-4c24-85d9-34bb5ee993f7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:37.164227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85f9e6aa-d648-4c24-85d9-34bb5ee993f7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:37.165045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85f9e6aa-d648-4c24-85d9-34bb5ee993f7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:37.165492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85f9e6aa-d648-4c24-85d9-34bb5ee993f7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:37.166197 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-046204e6-51e1-40d3-b117-f5f68a5b7d5b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.126880 Jan 22 21:21:37.167656 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3402/6519] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:37 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:37.227502 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-85f9e6aa-d648-4c24-85d9-34bb5ee993f7 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.091635 Jan 22 21:21:37.229329 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3118/6520] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:37 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:37.757959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61feea0d-f278-413b-aced-166b8eae6030 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:37.759584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-61feea0d-f278-413b-aced-166b8eae6030 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:37.779200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61feea0d-f278-413b-aced-166b8eae6030 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:37.779817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61feea0d-f278-413b-aced-166b8eae6030 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:37.781232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61feea0d-f278-413b-aced-166b8eae6030 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:37.782984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61feea0d-f278-413b-aced-166b8eae6030 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:37.833931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-af796b28-e585-44e3-a76d-96aa94f5bd74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:37.835542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-af796b28-e585-44e3-a76d-96aa94f5bd74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:37.845092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af796b28-e585-44e3-a76d-96aa94f5bd74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:37.851354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af796b28-e585-44e3-a76d-96aa94f5bd74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:37.852544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af796b28-e585-44e3-a76d-96aa94f5bd74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:37.853207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af796b28-e585-44e3-a76d-96aa94f5bd74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:38.136702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-61feea0d-f278-413b-aced-166b8eae6030 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:38.153056 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61feea0d-f278-413b-aced-166b8eae6030 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1321 microversion: 2.1 time: 0.400355 Jan 22 21:21:38.153999 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3403/6521] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:37 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:38.181654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3f360956-051e-4a5d-88b2-fd8ca5a4039b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:38.183273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3f360956-051e-4a5d-88b2-fd8ca5a4039b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:38.201181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f360956-051e-4a5d-88b2-fd8ca5a4039b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:38.202343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f360956-051e-4a5d-88b2-fd8ca5a4039b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:38.203424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f360956-051e-4a5d-88b2-fd8ca5a4039b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:38.204022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f360956-051e-4a5d-88b2-fd8ca5a4039b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:38.316148 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3f360956-051e-4a5d-88b2-fd8ca5a4039b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.135898 Jan 22 21:21:38.318983 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3404/6522] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:38 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:38.326673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c7bf24cb-3c8b-4af2-813b-4de013e6ef45 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:38.327934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c7bf24cb-3c8b-4af2-813b-4de013e6ef45 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:38.356340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7bf24cb-3c8b-4af2-813b-4de013e6ef45 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:38.356900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7bf24cb-3c8b-4af2-813b-4de013e6ef45 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:38.357803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7bf24cb-3c8b-4af2-813b-4de013e6ef45 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:38.364915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7bf24cb-3c8b-4af2-813b-4de013e6ef45 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:38.452126 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c7bf24cb-3c8b-4af2-813b-4de013e6ef45 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.129531 Jan 22 21:21:38.458135 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3405/6523] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:38 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:38.517309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-af796b28-e585-44e3-a76d-96aa94f5bd74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:38.541951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-af796b28-e585-44e3-a76d-96aa94f5bd74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:38.543511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-af796b28-e585-44e3-a76d-96aa94f5bd74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:38.544709 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-af796b28-e585-44e3-a76d-96aa94f5bd74 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1729 microversion: 2.20 time: 0.716182 Jan 22 21:21:38.545279 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3119/6524] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:37 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1729 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:21:38.810013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-f9a422ba-0c90-405b-8687-1c8468de65d4 req-4e7d9ec5-1ba6-4216-9e1e-b57b19e04780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1333f8b7-c8db-487d-b9e6-b5452b4bae48", "name": "network-vif-plugged", "status": "completed", "tag": "d5898bbb-29a7-4212-9028-982ac355edf5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:38.812792 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:21:38.812792 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:21:38.823125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f9a422ba-0c90-405b-8687-1c8468de65d4 req-4e7d9ec5-1ba6-4216-9e1e-b57b19e04780 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:38.823981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f9a422ba-0c90-405b-8687-1c8468de65d4 req-4e7d9ec5-1ba6-4216-9e1e-b57b19e04780 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:38.835347 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f9a422ba-0c90-405b-8687-1c8468de65d4 req-4e7d9ec5-1ba6-4216-9e1e-b57b19e04780 service nova] Creating event network-vif-plugged:d5898bbb-29a7-4212-9028-982ac355edf5 for instance 1333f8b7-c8db-487d-b9e6-b5452b4bae48 on nch1-master-1 Jan 22 21:21:38.840138 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-f9a422ba-0c90-405b-8687-1c8468de65d4 req-4e7d9ec5-1ba6-4216-9e1e-b57b19e04780 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036454 Jan 22 21:21:38.841431 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3406/6525] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:21:39.170106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3dda0c71-0874-466c-a75f-0d7f19aaf0de tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:39.175116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3dda0c71-0874-466c-a75f-0d7f19aaf0de tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:39.182502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3dda0c71-0874-466c-a75f-0d7f19aaf0de tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:39.182502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3dda0c71-0874-466c-a75f-0d7f19aaf0de tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:39.183176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3dda0c71-0874-466c-a75f-0d7f19aaf0de tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:39.183626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3dda0c71-0874-466c-a75f-0d7f19aaf0de tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:39.331424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cb9558c2-deb6-41cd-8cd1-1c3fd150ca27 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:39.333784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cb9558c2-deb6-41cd-8cd1-1c3fd150ca27 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:39.357372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb9558c2-deb6-41cd-8cd1-1c3fd150ca27 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:39.357372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb9558c2-deb6-41cd-8cd1-1c3fd150ca27 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:39.357372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb9558c2-deb6-41cd-8cd1-1c3fd150ca27 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:39.357372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb9558c2-deb6-41cd-8cd1-1c3fd150ca27 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:39.421316 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cb9558c2-deb6-41cd-8cd1-1c3fd150ca27 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.096037 Jan 22 21:21:39.428073 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3407/6526] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:39 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:39.465989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5c8d0dfe-3d16-45a9-874e-770ae18b0f6b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:39.467811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5c8d0dfe-3d16-45a9-874e-770ae18b0f6b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:39.478272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c8d0dfe-3d16-45a9-874e-770ae18b0f6b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:39.479726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c8d0dfe-3d16-45a9-874e-770ae18b0f6b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:39.490468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c8d0dfe-3d16-45a9-874e-770ae18b0f6b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:39.490468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c8d0dfe-3d16-45a9-874e-770ae18b0f6b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:39.530921 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5c8d0dfe-3d16-45a9-874e-770ae18b0f6b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.068969 Jan 22 21:21:39.532070 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3408/6527] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:39 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:21:39.564448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-79b570a9-6067-4439-bf26-a5ccc2515fc1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:39.565064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-79b570a9-6067-4439-bf26-a5ccc2515fc1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:39.573288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79b570a9-6067-4439-bf26-a5ccc2515fc1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:39.576990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79b570a9-6067-4439-bf26-a5ccc2515fc1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:39.576990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79b570a9-6067-4439-bf26-a5ccc2515fc1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:39.576990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79b570a9-6067-4439-bf26-a5ccc2515fc1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:40.033767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3dda0c71-0874-466c-a75f-0d7f19aaf0de tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:40.043988 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3dda0c71-0874-466c-a75f-0d7f19aaf0de tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1321 microversion: 2.1 time: 0.877462 Jan 22 21:21:40.046259 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3120/6528] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:39 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1321 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:40.103619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-79b570a9-6067-4439-bf26-a5ccc2515fc1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:40.112402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-79b570a9-6067-4439-bf26-a5ccc2515fc1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:40.117255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-79b570a9-6067-4439-bf26-a5ccc2515fc1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:40.118679 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-79b570a9-6067-4439-bf26-a5ccc2515fc1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1729 microversion: 2.20 time: 0.558351 Jan 22 21:21:40.129372 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3409/6529] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:39 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1729 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:21:40.439843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9631ba92-1b76-40e1-977c-213a3f17c4ce tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:40.439843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9631ba92-1b76-40e1-977c-213a3f17c4ce tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:40.447220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9631ba92-1b76-40e1-977c-213a3f17c4ce tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:40.447967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9631ba92-1b76-40e1-977c-213a3f17c4ce tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:40.449133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9631ba92-1b76-40e1-977c-213a3f17c4ce tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:40.449825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9631ba92-1b76-40e1-977c-213a3f17c4ce tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:40.494970 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9631ba92-1b76-40e1-977c-213a3f17c4ce tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.059903 Jan 22 21:21:40.496091 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3121/6530] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:40 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:40.544008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3f0dbed0-d509-4d5d-a004-5b99b4cbc724 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:40.545347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3f0dbed0-d509-4d5d-a004-5b99b4cbc724 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:40.554650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f0dbed0-d509-4d5d-a004-5b99b4cbc724 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:40.555528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f0dbed0-d509-4d5d-a004-5b99b4cbc724 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:40.556362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f0dbed0-d509-4d5d-a004-5b99b4cbc724 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:40.556816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f0dbed0-d509-4d5d-a004-5b99b4cbc724 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:40.629301 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3f0dbed0-d509-4d5d-a004-5b99b4cbc724 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.089501 Jan 22 21:21:40.632638 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3410/6531] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:40 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:41.062088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-88628d0b-6f36-428a-9e60-4c0787a412ce tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:41.062088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-88628d0b-6f36-428a-9e60-4c0787a412ce tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:41.068656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88628d0b-6f36-428a-9e60-4c0787a412ce tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:41.069431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88628d0b-6f36-428a-9e60-4c0787a412ce tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:41.070447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88628d0b-6f36-428a-9e60-4c0787a412ce tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:41.071043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88628d0b-6f36-428a-9e60-4c0787a412ce tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:41.139002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1607a999-9e68-492b-a8ad-b48aa7fe733f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:41.139614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1607a999-9e68-492b-a8ad-b48aa7fe733f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:41.150172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1607a999-9e68-492b-a8ad-b48aa7fe733f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:41.150636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1607a999-9e68-492b-a8ad-b48aa7fe733f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:41.151451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1607a999-9e68-492b-a8ad-b48aa7fe733f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:41.151893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1607a999-9e68-492b-a8ad-b48aa7fe733f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:41.300982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-88628d0b-6f36-428a-9e60-4c0787a412ce tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:41.324750 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-88628d0b-6f36-428a-9e60-4c0787a412ce tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1511 microversion: 2.1 time: 0.267830 Jan 22 21:21:41.325810 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3122/6532] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:41 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:41.336877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-be040126-3e40-4b35-a83a-0c19d6026b19 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '.version_select at 0x7f1ed4a68f70>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:41.440794 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-be040126-3e40-4b35-a83a-0c19d6026b19 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2119116500" status: 202 len: 0 microversion: 2.1 time: 0.112986 Jan 22 21:21:41.449320 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3123/6533] 10.222.0.100 () {58 vars in 1288 bytes} [Sat Jan 22 21:21:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2119116500 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:41.481860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-55d315e1-d1e7-41c0-9908-2012b6a04916 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'create', calling method: .version_select at 0x7f1ed658a4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-69235120"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:41.511463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-55d315e1-d1e7-41c0-9908-2012b6a04916 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:21:41.511463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-55d315e1-d1e7-41c0-9908-2012b6a04916 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for user 80aa2e03fde44436844a88a0ccc5d6a6 and project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:21:41.531705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1607a999-9e68-492b-a8ad-b48aa7fe733f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:41.562374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1607a999-9e68-492b-a8ad-b48aa7fe733f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:41.569078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1607a999-9e68-492b-a8ad-b48aa7fe733f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:41.577540 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1607a999-9e68-492b-a8ad-b48aa7fe733f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1729 microversion: 2.20 time: 0.438413 Jan 22 21:21:41.577540 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3411/6534] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:41 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1729 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:21:41.592684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dc328f81-0c4d-429e-b562-509ba8f8612e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:41.595203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dc328f81-0c4d-429e-b562-509ba8f8612e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:41.615883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc328f81-0c4d-429e-b562-509ba8f8612e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:41.619935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc328f81-0c4d-429e-b562-509ba8f8612e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:41.620822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc328f81-0c4d-429e-b562-509ba8f8612e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:41.624121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc328f81-0c4d-429e-b562-509ba8f8612e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:41.727634 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dc328f81-0c4d-429e-b562-509ba8f8612e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.149472 Jan 22 21:21:41.729423 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3412/6535] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:41 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:41.736360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e437f24e-a02e-4e6d-bc7e-0f3d406fba6d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:41.737607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e437f24e-a02e-4e6d-bc7e-0f3d406fba6d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:41.748508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e437f24e-a02e-4e6d-bc7e-0f3d406fba6d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:41.750278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e437f24e-a02e-4e6d-bc7e-0f3d406fba6d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:41.750278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e437f24e-a02e-4e6d-bc7e-0f3d406fba6d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:41.751809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e437f24e-a02e-4e6d-bc7e-0f3d406fba6d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:41.782458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-55d315e1-d1e7-41c0-9908-2012b6a04916 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:21:41.794229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-55d315e1-d1e7-41c0-9908-2012b6a04916 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for user 80aa2e03fde44436844a88a0ccc5d6a6 and project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:21:41.829742 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e437f24e-a02e-4e6d-bc7e-0f3d406fba6d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.093068 Jan 22 21:21:41.830858 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3413/6536] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:41 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:41.842808 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-55d315e1-d1e7-41c0-9908-2012b6a04916 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.365893 Jan 22 21:21:41.846187 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3124/6537] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:21:41 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:21:42.599209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61d0b853-576d-486c-85ce-890fe544db92 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:42.599209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-61d0b853-576d-486c-85ce-890fe544db92 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:42.609949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61d0b853-576d-486c-85ce-890fe544db92 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:42.612476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61d0b853-576d-486c-85ce-890fe544db92 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:42.613446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61d0b853-576d-486c-85ce-890fe544db92 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:42.615534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61d0b853-576d-486c-85ce-890fe544db92 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:42.741271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e53de3fe-ad28-4610-b8a1-476481d6252f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:42.743039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e53de3fe-ad28-4610-b8a1-476481d6252f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:42.750276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e53de3fe-ad28-4610-b8a1-476481d6252f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:42.750890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e53de3fe-ad28-4610-b8a1-476481d6252f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:42.752038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e53de3fe-ad28-4610-b8a1-476481d6252f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:42.752678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e53de3fe-ad28-4610-b8a1-476481d6252f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:42.813459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-61d0b853-576d-486c-85ce-890fe544db92 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:42.816596 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e53de3fe-ad28-4610-b8a1-476481d6252f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.080669 Jan 22 21:21:42.820777 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3125/6538] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:42 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:42.825609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-61d0b853-576d-486c-85ce-890fe544db92 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:42.825609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-61d0b853-576d-486c-85ce-890fe544db92 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:42.826392 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61d0b853-576d-486c-85ce-890fe544db92 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1729 microversion: 2.20 time: 0.236269 Jan 22 21:21:42.838024 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3414/6539] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:42 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1729 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:21:42.849970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-113cd8c8-5be5-4934-84fb-a1f131abb8a1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:42.855550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-113cd8c8-5be5-4934-84fb-a1f131abb8a1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:42.858598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-113cd8c8-5be5-4934-84fb-a1f131abb8a1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:42.859075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-113cd8c8-5be5-4934-84fb-a1f131abb8a1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:42.860306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-113cd8c8-5be5-4934-84fb-a1f131abb8a1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:42.860765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-113cd8c8-5be5-4934-84fb-a1f131abb8a1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:42.906659 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-113cd8c8-5be5-4934-84fb-a1f131abb8a1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.068087 Jan 22 21:21:42.908214 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3126/6540] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:42 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:43.828935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4b74c815-61e0-4f03-b6f4-13c662483163 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:43.829957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4b74c815-61e0-4f03-b6f4-13c662483163 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:43.841899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b74c815-61e0-4f03-b6f4-13c662483163 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:43.845151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b74c815-61e0-4f03-b6f4-13c662483163 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:43.847825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8cd7d8ec-3700-4ea2-b145-5908b6dc894f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:43.849717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8cd7d8ec-3700-4ea2-b145-5908b6dc894f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:43.850598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b74c815-61e0-4f03-b6f4-13c662483163 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:43.851111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b74c815-61e0-4f03-b6f4-13c662483163 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:43.861187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cd7d8ec-3700-4ea2-b145-5908b6dc894f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:43.861758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cd7d8ec-3700-4ea2-b145-5908b6dc894f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:43.862547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cd7d8ec-3700-4ea2-b145-5908b6dc894f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:43.862998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8cd7d8ec-3700-4ea2-b145-5908b6dc894f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:43.931018 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4b74c815-61e0-4f03-b6f4-13c662483163 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.093316 Jan 22 21:21:43.932081 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3415/6541] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:43 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:43.942965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-454d34ba-80f6-42a6-bcc2-570257bfa0b0 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:43.946791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-454d34ba-80f6-42a6-bcc2-570257bfa0b0 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:43.965267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-454d34ba-80f6-42a6-bcc2-570257bfa0b0 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:43.970101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-454d34ba-80f6-42a6-bcc2-570257bfa0b0 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:43.971227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-454d34ba-80f6-42a6-bcc2-570257bfa0b0 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:43.971689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-454d34ba-80f6-42a6-bcc2-570257bfa0b0 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:44.054326 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-454d34ba-80f6-42a6-bcc2-570257bfa0b0 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.119744 Jan 22 21:21:44.056555 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3416/6542] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:43 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:44.274752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8cd7d8ec-3700-4ea2-b145-5908b6dc894f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:44.283491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-480981cf-cd6d-4f3d-a2fd-3525d6c56295 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60b38738-e71a-4465-8224-7dd4972ee31c"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:44.284916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-480981cf-cd6d-4f3d-a2fd-3525d6c56295 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:44.288602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8cd7d8ec-3700-4ea2-b145-5908b6dc894f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:44.290443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8cd7d8ec-3700-4ea2-b145-5908b6dc894f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:44.291830 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8cd7d8ec-3700-4ea2-b145-5908b6dc894f tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1729 microversion: 2.20 time: 0.448411 Jan 22 21:21:44.305599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-480981cf-cd6d-4f3d-a2fd-3525d6c56295 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:44.308066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-480981cf-cd6d-4f3d-a2fd-3525d6c56295 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:44.308066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-480981cf-cd6d-4f3d-a2fd-3525d6c56295 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:44.308066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-480981cf-cd6d-4f3d-a2fd-3525d6c56295 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:44.310214 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3127/6543] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:43 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1729 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:21:44.945334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c76fa2d2-12d7-4085-8ae6-f13db7d67381 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:44.946289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c76fa2d2-12d7-4085-8ae6-f13db7d67381 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:44.954095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c76fa2d2-12d7-4085-8ae6-f13db7d67381 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:44.954545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c76fa2d2-12d7-4085-8ae6-f13db7d67381 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:44.955333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c76fa2d2-12d7-4085-8ae6-f13db7d67381 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:44.955797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c76fa2d2-12d7-4085-8ae6-f13db7d67381 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:45.006345 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c76fa2d2-12d7-4085-8ae6-f13db7d67381 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.064106 Jan 22 21:21:45.007184 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3128/6544] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:44 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:45.066511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-35ab7c09-c3a9-41f9-be2c-4261f5980fad tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:45.068134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-35ab7c09-c3a9-41f9-be2c-4261f5980fad tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:45.075297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35ab7c09-c3a9-41f9-be2c-4261f5980fad tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:45.075687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35ab7c09-c3a9-41f9-be2c-4261f5980fad tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:45.076540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35ab7c09-c3a9-41f9-be2c-4261f5980fad tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:45.076987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35ab7c09-c3a9-41f9-be2c-4261f5980fad tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:45.142830 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-35ab7c09-c3a9-41f9-be2c-4261f5980fad tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.080165 Jan 22 21:21:45.147846 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3129/6545] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:45 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:21:45.315969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1554a6fb-f957-4b79-9e2b-e18de27ce484 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:45.316671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1554a6fb-f957-4b79-9e2b-e18de27ce484 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:45.334083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1554a6fb-f957-4b79-9e2b-e18de27ce484 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:45.334442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1554a6fb-f957-4b79-9e2b-e18de27ce484 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:45.336443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1554a6fb-f957-4b79-9e2b-e18de27ce484 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:45.336912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1554a6fb-f957-4b79-9e2b-e18de27ce484 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:45.360588 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-480981cf-cd6d-4f3d-a2fd-3525d6c56295 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "POST /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.081280 Jan 22 21:21:45.366452 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3417/6546] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:21:44 2022] POST /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48/os-volume_attachments => generated 194 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:21:45.861668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1554a6fb-f957-4b79-9e2b-e18de27ce484 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:45.875079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1554a6fb-f957-4b79-9e2b-e18de27ce484 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:45.879355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1554a6fb-f957-4b79-9e2b-e18de27ce484 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:45.885692 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1554a6fb-f957-4b79-9e2b-e18de27ce484 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1750 microversion: 2.20 time: 0.572272 Jan 22 21:21:45.900597 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3130/6547] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:45 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1750 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:21:46.019591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-543e4bfc-79c5-4251-ba85-acea71639791 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:46.021419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-543e4bfc-79c5-4251-ba85-acea71639791 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:46.044382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-543e4bfc-79c5-4251-ba85-acea71639791 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:46.047802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-543e4bfc-79c5-4251-ba85-acea71639791 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:46.048834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-543e4bfc-79c5-4251-ba85-acea71639791 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:46.056744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-543e4bfc-79c5-4251-ba85-acea71639791 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:46.140558 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-543e4bfc-79c5-4251-ba85-acea71639791 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.125812 Jan 22 21:21:46.141935 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3418/6548] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:46 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:46.157253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6621402b-9133-4ce5-af16-75a1ee28c53f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:46.159297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6621402b-9133-4ce5-af16-75a1ee28c53f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:46.175572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6621402b-9133-4ce5-af16-75a1ee28c53f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:46.176075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6621402b-9133-4ce5-af16-75a1ee28c53f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:46.177472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6621402b-9133-4ce5-af16-75a1ee28c53f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:46.182657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6621402b-9133-4ce5-af16-75a1ee28c53f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:46.273685 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6621402b-9133-4ce5-af16-75a1ee28c53f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.113436 Jan 22 21:21:46.276064 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3131/6549] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:46 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:46.912836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08eccc54-3e81-4085-a704-3ee1abcbf55a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:46.917159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-08eccc54-3e81-4085-a704-3ee1abcbf55a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:46.941478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08eccc54-3e81-4085-a704-3ee1abcbf55a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:46.943527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08eccc54-3e81-4085-a704-3ee1abcbf55a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:46.950142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08eccc54-3e81-4085-a704-3ee1abcbf55a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:46.951253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08eccc54-3e81-4085-a704-3ee1abcbf55a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:47.156094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d3998a37-b571-42bb-b569-824de72c1ce2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:47.157811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d3998a37-b571-42bb-b569-824de72c1ce2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:47.173817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3998a37-b571-42bb-b569-824de72c1ce2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:47.175076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3998a37-b571-42bb-b569-824de72c1ce2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:47.178787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3998a37-b571-42bb-b569-824de72c1ce2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:47.179486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3998a37-b571-42bb-b569-824de72c1ce2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:47.252167 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d3998a37-b571-42bb-b569-824de72c1ce2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.102133 Jan 22 21:21:47.255109 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3132/6550] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:47 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:47.291721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ad9f4030-b09e-4b6a-9a02-42ba7776921d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:47.293662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ad9f4030-b09e-4b6a-9a02-42ba7776921d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:47.300492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-08eccc54-3e81-4085-a704-3ee1abcbf55a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:47.306242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad9f4030-b09e-4b6a-9a02-42ba7776921d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:47.307701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad9f4030-b09e-4b6a-9a02-42ba7776921d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:47.308700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad9f4030-b09e-4b6a-9a02-42ba7776921d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:47.310413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad9f4030-b09e-4b6a-9a02-42ba7776921d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:47.314762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-08eccc54-3e81-4085-a704-3ee1abcbf55a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:47.318241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-08eccc54-3e81-4085-a704-3ee1abcbf55a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:47.319875 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-08eccc54-3e81-4085-a704-3ee1abcbf55a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1750 microversion: 2.20 time: 0.420440 Jan 22 21:21:47.321136 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3419/6551] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:46 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1750 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:21:47.370637 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ad9f4030-b09e-4b6a-9a02-42ba7776921d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.086638 Jan 22 21:21:47.378003 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3133/6552] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:47 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:21:47.651616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-7f7714db-6113-46b2-9382-a2ef90acb6df req-dbcf2f7b-bfae-4204-9ec5-60c2ccd5d2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89583718-5186-41d5-b5f3-ad8997c3eb59", "name": "network-vif-plugged", "status": "completed", "tag": "f3926427-e4b0-4ea7-846d-98fa049e0b27"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:47.653312 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:21:47.653312 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:21:47.664055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7f7714db-6113-46b2-9382-a2ef90acb6df req-dbcf2f7b-bfae-4204-9ec5-60c2ccd5d2ef service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:47.665684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7f7714db-6113-46b2-9382-a2ef90acb6df req-dbcf2f7b-bfae-4204-9ec5-60c2ccd5d2ef service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:47.692915 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-7f7714db-6113-46b2-9382-a2ef90acb6df req-dbcf2f7b-bfae-4204-9ec5-60c2ccd5d2ef service nova] Creating event network-vif-plugged:f3926427-e4b0-4ea7-846d-98fa049e0b27 for instance 89583718-5186-41d5-b5f3-ad8997c3eb59 on nch2-master-1 Jan 22 21:21:47.700597 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-7f7714db-6113-46b2-9382-a2ef90acb6df req-dbcf2f7b-bfae-4204-9ec5-60c2ccd5d2ef service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052057 Jan 22 21:21:47.702068 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3420/6553] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:21:48.266237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bd93a1e1-1f2e-421f-82ff-2745710af3a5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:48.267915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bd93a1e1-1f2e-421f-82ff-2745710af3a5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:48.278436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd93a1e1-1f2e-421f-82ff-2745710af3a5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:48.279134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd93a1e1-1f2e-421f-82ff-2745710af3a5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:48.284999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd93a1e1-1f2e-421f-82ff-2745710af3a5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:48.284999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd93a1e1-1f2e-421f-82ff-2745710af3a5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:48.343012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-82fd2774-e357-4ee8-ba76-5671e89a1a72 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:48.344321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-82fd2774-e357-4ee8-ba76-5671e89a1a72 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:48.354991 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bd93a1e1-1f2e-421f-82ff-2745710af3a5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.091488 Jan 22 21:21:48.358360 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3134/6554] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:48 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:48.367836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82fd2774-e357-4ee8-ba76-5671e89a1a72 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:48.368354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82fd2774-e357-4ee8-ba76-5671e89a1a72 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:48.369411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82fd2774-e357-4ee8-ba76-5671e89a1a72 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:48.370056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82fd2774-e357-4ee8-ba76-5671e89a1a72 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:48.392653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d442aa99-3ffb-4391-88c9-dbc40839c46f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:48.393736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d442aa99-3ffb-4391-88c9-dbc40839c46f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:48.408389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d442aa99-3ffb-4391-88c9-dbc40839c46f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:48.413869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d442aa99-3ffb-4391-88c9-dbc40839c46f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:48.415049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d442aa99-3ffb-4391-88c9-dbc40839c46f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:48.415678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d442aa99-3ffb-4391-88c9-dbc40839c46f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:48.466850 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d442aa99-3ffb-4391-88c9-dbc40839c46f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.083697 Jan 22 21:21:48.467880 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3135/6555] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:48 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:48.693030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-82fd2774-e357-4ee8-ba76-5671e89a1a72 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:48.702077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-82fd2774-e357-4ee8-ba76-5671e89a1a72 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:48.703597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-82fd2774-e357-4ee8-ba76-5671e89a1a72 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:48.704789 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-82fd2774-e357-4ee8-ba76-5671e89a1a72 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1750 microversion: 2.20 time: 0.368984 Jan 22 21:21:48.715598 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3421/6556] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:48 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1750 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:21:49.371300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0fa8dc01-d544-4e75-9149-c69cdfa02f3a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:49.372356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0fa8dc01-d544-4e75-9149-c69cdfa02f3a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:49.381863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fa8dc01-d544-4e75-9149-c69cdfa02f3a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:49.382323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fa8dc01-d544-4e75-9149-c69cdfa02f3a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:49.383338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fa8dc01-d544-4e75-9149-c69cdfa02f3a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:49.384355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fa8dc01-d544-4e75-9149-c69cdfa02f3a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:49.442170 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0fa8dc01-d544-4e75-9149-c69cdfa02f3a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.075725 Jan 22 21:21:49.443603 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3136/6557] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:49 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:49.479829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7f3449a7-0af9-4b07-a0f9-b270f8209b7d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:49.481316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7f3449a7-0af9-4b07-a0f9-b270f8209b7d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:49.495056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f3449a7-0af9-4b07-a0f9-b270f8209b7d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:49.495533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f3449a7-0af9-4b07-a0f9-b270f8209b7d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:49.498468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f3449a7-0af9-4b07-a0f9-b270f8209b7d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:49.500424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f3449a7-0af9-4b07-a0f9-b270f8209b7d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:49.568123 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7f3449a7-0af9-4b07-a0f9-b270f8209b7d tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.091048 Jan 22 21:21:49.569843 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3422/6558] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:49 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:49.732108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-445c2e4e-8868-4d78-b372-c32c6ebee849 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:49.732847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-445c2e4e-8868-4d78-b372-c32c6ebee849 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:49.749906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-445c2e4e-8868-4d78-b372-c32c6ebee849 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:49.750377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-445c2e4e-8868-4d78-b372-c32c6ebee849 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:49.753203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-445c2e4e-8868-4d78-b372-c32c6ebee849 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:49.781324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-445c2e4e-8868-4d78-b372-c32c6ebee849 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:49.989083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1781878567", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "450276e4-b8c9-4322-9dd8-f1637d2b1ee8"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:50.061914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] validate_networks() for [('450276e4-b8c9-4322-9dd8-f1637d2b1ee8', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:21:50.136316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-445c2e4e-8868-4d78-b372-c32c6ebee849 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:50.148180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-445c2e4e-8868-4d78-b372-c32c6ebee849 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:50.155178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-445c2e4e-8868-4d78-b372-c32c6ebee849 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:50.156754 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-445c2e4e-8868-4d78-b372-c32c6ebee849 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1750 microversion: 2.20 time: 0.430801 Jan 22 21:21:50.157846 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3137/6559] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:49 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1750 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:21:50.455652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-92deff6c-bb86-4de7-9941-1e2432abfa13 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:50.455652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-92deff6c-bb86-4de7-9941-1e2432abfa13 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:50.461799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92deff6c-bb86-4de7-9941-1e2432abfa13 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:50.462263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92deff6c-bb86-4de7-9941-1e2432abfa13 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:50.463059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92deff6c-bb86-4de7-9941-1e2432abfa13 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:50.463512 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92deff6c-bb86-4de7-9941-1e2432abfa13 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:50.544578 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-92deff6c-bb86-4de7-9941-1e2432abfa13 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.094445 Jan 22 21:21:50.545226 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3138/6560] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:50 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:50.581307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1b7875ec-d7ee-434b-8678-f02ccf9ff9fe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:50.582479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1b7875ec-d7ee-434b-8678-f02ccf9ff9fe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:50.591029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b7875ec-d7ee-434b-8678-f02ccf9ff9fe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:50.592204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b7875ec-d7ee-434b-8678-f02ccf9ff9fe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:50.595750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b7875ec-d7ee-434b-8678-f02ccf9ff9fe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:50.597299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b7875ec-d7ee-434b-8678-f02ccf9ff9fe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:50.698979 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1b7875ec-d7ee-434b-8678-f02ccf9ff9fe tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.121320 Jan 22 21:21:50.704525 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3139/6561] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:50 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:51.158107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:21:51.159545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:21:51.160365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:21:51.162032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:21:51.162816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:21:51.190967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:51.191630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:51.193124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:51.193811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:51.197222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b8474ed9-398d-466c-b98e-80125e65b078 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:51.199368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b8474ed9-398d-466c-b98e-80125e65b078 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:51.214381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Getting quotas for project 063a9e2a155241a3bf27e7d1b16d0419. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:21:51.223623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Getting quotas for user b9ea4bd8d1d94d6a8e41b26da41bd6fc and project 063a9e2a155241a3bf27e7d1b16d0419. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:21:51.227598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8474ed9-398d-466c-b98e-80125e65b078 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:51.231164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8474ed9-398d-466c-b98e-80125e65b078 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:51.234057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8474ed9-398d-466c-b98e-80125e65b078 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:51.234754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b8474ed9-398d-466c-b98e-80125e65b078 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:51.237192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:21:51.251700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:21:51.501893 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-437e6f67-5d05-48da-ae7d-6e78eb568f64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.518413 Jan 22 21:21:51.502866 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3423/6562] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:21:49 2022] POST /compute/v2.1/servers => generated 382 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:21:51.513561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b8474ed9-398d-466c-b98e-80125e65b078 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:51.514795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1f0de6dd-5708-458e-9cf7-d313ffb6268b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:51.516380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1f0de6dd-5708-458e-9cf7-d313ffb6268b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:51.525063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b8474ed9-398d-466c-b98e-80125e65b078 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:51.526646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b8474ed9-398d-466c-b98e-80125e65b078 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:51.532344 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b8474ed9-398d-466c-b98e-80125e65b078 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1750 microversion: 2.20 time: 0.359581 Jan 22 21:21:51.535862 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3140/6563] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:51 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1750 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:21:51.563709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c499096b-7681-4b99-a65d-c144bddbfedb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:51.565165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c499096b-7681-4b99-a65d-c144bddbfedb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:51.584931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c499096b-7681-4b99-a65d-c144bddbfedb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:51.586928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c499096b-7681-4b99-a65d-c144bddbfedb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:51.587945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c499096b-7681-4b99-a65d-c144bddbfedb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:51.590085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c499096b-7681-4b99-a65d-c144bddbfedb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:51.664011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1f0de6dd-5708-458e-9cf7-d313ffb6268b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:51.679825 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1f0de6dd-5708-458e-9cf7-d313ffb6268b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1222 microversion: 2.1 time: 0.167781 Jan 22 21:21:51.680030 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c499096b-7681-4b99-a65d-c144bddbfedb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.121292 Jan 22 21:21:51.683978 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3424/6564] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:51 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1222 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:21:51.684895 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3141/6565] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:51 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:21:51.715649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-10f914c4-7d6c-475c-b564-801c3d947c4a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:51.715649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-10f914c4-7d6c-475c-b564-801c3d947c4a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:51.732305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10f914c4-7d6c-475c-b564-801c3d947c4a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:51.732843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10f914c4-7d6c-475c-b564-801c3d947c4a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:51.733758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10f914c4-7d6c-475c-b564-801c3d947c4a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:51.740756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10f914c4-7d6c-475c-b564-801c3d947c4a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:51.844214 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-10f914c4-7d6c-475c-b564-801c3d947c4a tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.133955 Jan 22 21:21:51.844394 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3425/6566] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:51 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:52.558059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fbdd6d56-6206-4ac3-b445-fa66a1ed4e6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:52.559583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fbdd6d56-6206-4ac3-b445-fa66a1ed4e6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:52.574521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbdd6d56-6206-4ac3-b445-fa66a1ed4e6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:52.575654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbdd6d56-6206-4ac3-b445-fa66a1ed4e6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:52.577848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbdd6d56-6206-4ac3-b445-fa66a1ed4e6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:52.578639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbdd6d56-6206-4ac3-b445-fa66a1ed4e6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:52.696054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c0b4f490-b709-4dc6-9ed3-7532cb8f65b7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:52.697140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c0b4f490-b709-4dc6-9ed3-7532cb8f65b7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:52.721321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0b4f490-b709-4dc6-9ed3-7532cb8f65b7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:52.721321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0b4f490-b709-4dc6-9ed3-7532cb8f65b7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:52.722154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0b4f490-b709-4dc6-9ed3-7532cb8f65b7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:52.723907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0b4f490-b709-4dc6-9ed3-7532cb8f65b7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:52.818520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fbdd6d56-6206-4ac3-b445-fa66a1ed4e6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:52.820189 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c0b4f490-b709-4dc6-9ed3-7532cb8f65b7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.131299 Jan 22 21:21:52.821074 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3426/6567] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:52 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:52.828952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5409c449-d1d3-4c1e-a4fb-9045fda33759 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:52.831297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fbdd6d56-6206-4ac3-b445-fa66a1ed4e6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:52.832263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5409c449-d1d3-4c1e-a4fb-9045fda33759 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:52.843267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fbdd6d56-6206-4ac3-b445-fa66a1ed4e6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:52.844772 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fbdd6d56-6206-4ac3-b445-fa66a1ed4e6a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1745 microversion: 2.20 time: 0.294648 Jan 22 21:21:52.871891 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3142/6568] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:52 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1745 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:21:52.885074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eae99096-3bf8-4647-9c12-e678e5bddb4f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:52.890844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eae99096-3bf8-4647-9c12-e678e5bddb4f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:52.905529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eae99096-3bf8-4647-9c12-e678e5bddb4f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:52.907705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eae99096-3bf8-4647-9c12-e678e5bddb4f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:52.909093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eae99096-3bf8-4647-9c12-e678e5bddb4f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:52.911091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eae99096-3bf8-4647-9c12-e678e5bddb4f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:52.971461 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eae99096-3bf8-4647-9c12-e678e5bddb4f tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.097667 Jan 22 21:21:52.972956 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3143/6569] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:52 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:53.465922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5409c449-d1d3-4c1e-a4fb-9045fda33759 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:53.475324 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5409c449-d1d3-4c1e-a4fb-9045fda33759 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1222 microversion: 2.1 time: 0.652207 Jan 22 21:21:53.476534 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3427/6570] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:52 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1222 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:21:53.839258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ad98bf1d-ea04-4b4a-a11b-81b2cb02df38 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:53.842302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ad98bf1d-ea04-4b4a-a11b-81b2cb02df38 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:53.858853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad98bf1d-ea04-4b4a-a11b-81b2cb02df38 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:53.860763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad98bf1d-ea04-4b4a-a11b-81b2cb02df38 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:53.864769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad98bf1d-ea04-4b4a-a11b-81b2cb02df38 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:53.867482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad98bf1d-ea04-4b4a-a11b-81b2cb02df38 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:53.872824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b7f12587-db66-43f6-8d7a-b97c3c648c94 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:53.873481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b7f12587-db66-43f6-8d7a-b97c3c648c94 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:53.904312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7f12587-db66-43f6-8d7a-b97c3c648c94 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:53.905198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7f12587-db66-43f6-8d7a-b97c3c648c94 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:53.912793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7f12587-db66-43f6-8d7a-b97c3c648c94 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:53.915609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7f12587-db66-43f6-8d7a-b97c3c648c94 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:54.010203 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ad98bf1d-ea04-4b4a-a11b-81b2cb02df38 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.180332 Jan 22 21:21:54.011120 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3144/6571] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:53 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:54.018356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5f15157d-faab-4f12-999b-bcc998e65c60 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:54.022843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5f15157d-faab-4f12-999b-bcc998e65c60 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:54.045412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f15157d-faab-4f12-999b-bcc998e65c60 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:54.046075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f15157d-faab-4f12-999b-bcc998e65c60 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:54.047211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f15157d-faab-4f12-999b-bcc998e65c60 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:54.048284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f15157d-faab-4f12-999b-bcc998e65c60 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:54.115709 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5f15157d-faab-4f12-999b-bcc998e65c60 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.100983 Jan 22 21:21:54.116652 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3145/6572] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:54 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:54.493309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a5fec5fa-b57f-4142-848f-5308227eedaf tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:54.505988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a5fec5fa-b57f-4142-848f-5308227eedaf tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:54.522506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5fec5fa-b57f-4142-848f-5308227eedaf tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:54.523205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5fec5fa-b57f-4142-848f-5308227eedaf tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:54.524559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5fec5fa-b57f-4142-848f-5308227eedaf tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:54.526930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5fec5fa-b57f-4142-848f-5308227eedaf tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:54.649489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a5fec5fa-b57f-4142-848f-5308227eedaf tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:54.662555 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a5fec5fa-b57f-4142-848f-5308227eedaf tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1274 microversion: 2.1 time: 0.172920 Jan 22 21:21:54.663746 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3146/6573] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:54 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1274 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:21:55.024710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1f634a57-7d77-4860-ab84-7a9f6fd35133 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:55.026546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1f634a57-7d77-4860-ab84-7a9f6fd35133 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:55.062480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f634a57-7d77-4860-ab84-7a9f6fd35133 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:55.065661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f634a57-7d77-4860-ab84-7a9f6fd35133 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:55.066798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f634a57-7d77-4860-ab84-7a9f6fd35133 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:55.070997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f634a57-7d77-4860-ab84-7a9f6fd35133 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:55.266358 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1f634a57-7d77-4860-ab84-7a9f6fd35133 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.246613 Jan 22 21:21:55.272899 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3147/6574] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:55 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:55.300131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-32e3e66c-23f2-4fd6-afb4-5cf1ef0578e1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:55.304694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-32e3e66c-23f2-4fd6-afb4-5cf1ef0578e1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:55.340182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32e3e66c-23f2-4fd6-afb4-5cf1ef0578e1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:55.346388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32e3e66c-23f2-4fd6-afb4-5cf1ef0578e1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:55.355571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32e3e66c-23f2-4fd6-afb4-5cf1ef0578e1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:55.358243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32e3e66c-23f2-4fd6-afb4-5cf1ef0578e1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:55.515155 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-32e3e66c-23f2-4fd6-afb4-5cf1ef0578e1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.238415 Jan 22 21:21:55.519682 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3148/6575] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:55 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:55.686599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9b3757e0-1c81-4747-a900-d1114fa5b8d0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:55.687531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9b3757e0-1c81-4747-a900-d1114fa5b8d0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:55.709730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b3757e0-1c81-4747-a900-d1114fa5b8d0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:55.711808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b3757e0-1c81-4747-a900-d1114fa5b8d0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:55.712925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b3757e0-1c81-4747-a900-d1114fa5b8d0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:55.713649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b3757e0-1c81-4747-a900-d1114fa5b8d0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:55.819964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b7f12587-db66-43f6-8d7a-b97c3c648c94 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:55.847150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b7f12587-db66-43f6-8d7a-b97c3c648c94 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:55.861135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b7f12587-db66-43f6-8d7a-b97c3c648c94 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:55.870672 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b7f12587-db66-43f6-8d7a-b97c3c648c94 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1745 microversion: 2.20 time: 1.996988 Jan 22 21:21:55.878971 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3428/6576] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:53 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1745 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:21:56.295087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8ea3ecde-ee29-4d78-908f-bc6c356db4d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:56.296552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8ea3ecde-ee29-4d78-908f-bc6c356db4d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:56.404347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea3ecde-ee29-4d78-908f-bc6c356db4d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:56.413950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea3ecde-ee29-4d78-908f-bc6c356db4d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:56.424595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea3ecde-ee29-4d78-908f-bc6c356db4d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:56.444780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea3ecde-ee29-4d78-908f-bc6c356db4d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:56.609446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9b3757e0-1c81-4747-a900-d1114fa5b8d0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:56.619478 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9b3757e0-1c81-4747-a900-d1114fa5b8d0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1280 microversion: 2.1 time: 0.937539 Jan 22 21:21:56.635458 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3149/6577] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:55 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1280 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:21:56.648360 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8ea3ecde-ee29-4d78-908f-bc6c356db4d9 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.372697 Jan 22 21:21:56.649032 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3429/6578] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:56 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:56.672303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-06571326-8336-4c32-b4e1-6a91a9898724 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:56.675628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-06571326-8336-4c32-b4e1-6a91a9898724 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:56.707673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06571326-8336-4c32-b4e1-6a91a9898724 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:56.716344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06571326-8336-4c32-b4e1-6a91a9898724 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:56.726714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06571326-8336-4c32-b4e1-6a91a9898724 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:56.727739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06571326-8336-4c32-b4e1-6a91a9898724 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:56.883850 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-06571326-8336-4c32-b4e1-6a91a9898724 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.244471 Jan 22 21:21:56.891343 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3150/6579] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:56 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:56.897770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ea11430b-a625-43bf-94f7-62a5c6d77ba7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:56.898490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ea11430b-a625-43bf-94f7-62a5c6d77ba7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:56.916646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea11430b-a625-43bf-94f7-62a5c6d77ba7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:56.920768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea11430b-a625-43bf-94f7-62a5c6d77ba7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:56.930108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea11430b-a625-43bf-94f7-62a5c6d77ba7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:56.930860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea11430b-a625-43bf-94f7-62a5c6d77ba7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:57.649957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-39c630de-d0db-4bae-8322-3de839d6db9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:57.650664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-39c630de-d0db-4bae-8322-3de839d6db9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:57.667246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39c630de-d0db-4bae-8322-3de839d6db9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:57.669247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39c630de-d0db-4bae-8322-3de839d6db9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:57.672984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39c630de-d0db-4bae-8322-3de839d6db9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:57.675897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39c630de-d0db-4bae-8322-3de839d6db9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:58.524373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ea11430b-a625-43bf-94f7-62a5c6d77ba7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:58.539802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ea11430b-a625-43bf-94f7-62a5c6d77ba7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:58.542991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ea11430b-a625-43bf-94f7-62a5c6d77ba7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:58.546450 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ea11430b-a625-43bf-94f7-62a5c6d77ba7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1745 microversion: 2.20 time: 1.652498 Jan 22 21:21:58.567118 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3430/6580] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:56 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1745 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:21:58.570429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8d13724d-ebf3-4708-9947-f040a4822ea2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:58.576623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8d13724d-ebf3-4708-9947-f040a4822ea2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:58.592740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d13724d-ebf3-4708-9947-f040a4822ea2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:58.593681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d13724d-ebf3-4708-9947-f040a4822ea2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:58.594690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d13724d-ebf3-4708-9947-f040a4822ea2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:58.595293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d13724d-ebf3-4708-9947-f040a4822ea2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:58.652422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-39c630de-d0db-4bae-8322-3de839d6db9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:21:58.660897 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8d13724d-ebf3-4708-9947-f040a4822ea2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.094888 Jan 22 21:21:58.664851 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3431/6581] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:58 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:58.677445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-16650bdd-2fb2-4393-9284-9ab778543e6b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:58.682501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-16650bdd-2fb2-4393-9284-9ab778543e6b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:58.685121 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-39c630de-d0db-4bae-8322-3de839d6db9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1322 microversion: 2.1 time: 1.041048 Jan 22 21:21:58.689954 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3151/6582] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:57 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1322 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:21:58.709291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16650bdd-2fb2-4393-9284-9ab778543e6b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:58.713608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16650bdd-2fb2-4393-9284-9ab778543e6b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:58.715849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16650bdd-2fb2-4393-9284-9ab778543e6b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:58.716323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16650bdd-2fb2-4393-9284-9ab778543e6b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:58.848533 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-16650bdd-2fb2-4393-9284-9ab778543e6b tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 32619 microversion: 2.1 time: 0.181154 Jan 22 21:21:58.854536 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3432/6583] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:21:58 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 32619 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:21:59.540825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-907eb4fd-b461-4ecf-ac0b-9d7058feaee2 req-fd2d4d88-df41-4ce5-afc5-2db21a7df98b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6316a4f8-60dc-49da-98c2-3395f338f324", "tag": "b990c73c-2a43-4448-af8b-ba36388255b7"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:59.542515 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:21:59.542515 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:21:59.559672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-907eb4fd-b461-4ecf-ac0b-9d7058feaee2 req-fd2d4d88-df41-4ce5-afc5-2db21a7df98b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:59.569838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-13d555e9-d965-47a4-8a73-a7152aeab8f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:59.570546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-13d555e9-d965-47a4-8a73-a7152aeab8f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:59.574833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-907eb4fd-b461-4ecf-ac0b-9d7058feaee2 req-fd2d4d88-df41-4ce5-afc5-2db21a7df98b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:59.605832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13d555e9-d965-47a4-8a73-a7152aeab8f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:59.606433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13d555e9-d965-47a4-8a73-a7152aeab8f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:59.607317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13d555e9-d965-47a4-8a73-a7152aeab8f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:59.608183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13d555e9-d965-47a4-8a73-a7152aeab8f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:59.635180 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-907eb4fd-b461-4ecf-ac0b-9d7058feaee2 req-fd2d4d88-df41-4ce5-afc5-2db21a7df98b service nova] Creating event network-changed:b990c73c-2a43-4448-af8b-ba36388255b7 for instance 6316a4f8-60dc-49da-98c2-3395f338f324 on nch2-master-1 Jan 22 21:21:59.649395 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-907eb4fd-b461-4ecf-ac0b-9d7058feaee2 req-fd2d4d88-df41-4ce5-afc5-2db21a7df98b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115415 Jan 22 21:21:59.652666 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3152/6584] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:21:59.675380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4f76e77b-aea4-47f0-968d-36e67a00e568 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:21:59.677262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4f76e77b-aea4-47f0-968d-36e67a00e568 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:59.690203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f76e77b-aea4-47f0-968d-36e67a00e568 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:59.695519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f76e77b-aea4-47f0-968d-36e67a00e568 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:59.696635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f76e77b-aea4-47f0-968d-36e67a00e568 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:59.697195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f76e77b-aea4-47f0-968d-36e67a00e568 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:59.785179 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4f76e77b-aea4-47f0-968d-36e67a00e568 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.115421 Jan 22 21:21:59.787807 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3153/6585] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:21:59 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:21:59.794583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-efa0c4d8-d38f-4a4f-97d4-50c3dac99ea1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:21:59.795511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-efa0c4d8-d38f-4a4f-97d4-50c3dac99ea1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:21:59.814514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efa0c4d8-d38f-4a4f-97d4-50c3dac99ea1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:59.815232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efa0c4d8-d38f-4a4f-97d4-50c3dac99ea1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:21:59.816209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efa0c4d8-d38f-4a4f-97d4-50c3dac99ea1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:21:59.823386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efa0c4d8-d38f-4a4f-97d4-50c3dac99ea1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:00.327694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-efa0c4d8-d38f-4a4f-97d4-50c3dac99ea1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:00.336886 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-efa0c4d8-d38f-4a4f-97d4-50c3dac99ea1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1322 microversion: 2.1 time: 0.547663 Jan 22 21:22:00.351222 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3154/6586] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:21:59 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1322 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:00.357820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee00f566-44b1-404b-acb4-03a3833dd9fc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:00.358772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ee00f566-44b1-404b-acb4-03a3833dd9fc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:00.376834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee00f566-44b1-404b-acb4-03a3833dd9fc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:00.377299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee00f566-44b1-404b-acb4-03a3833dd9fc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:00.378138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee00f566-44b1-404b-acb4-03a3833dd9fc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:00.378585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee00f566-44b1-404b-acb4-03a3833dd9fc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:00.496371 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee00f566-44b1-404b-acb4-03a3833dd9fc tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action" status: 200 len: 40771 microversion: 2.1 time: 0.145352 Jan 22 21:22:00.497629 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3155/6587] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:22:00 2022] POST /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b/action => generated 40771 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:22:00.510883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e9982634-7715-4408-8fac-ee22fdc77ad1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:00.511606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e9982634-7715-4408-8fac-ee22fdc77ad1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:00.529787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9982634-7715-4408-8fac-ee22fdc77ad1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:00.538724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9982634-7715-4408-8fac-ee22fdc77ad1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:00.544157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9982634-7715-4408-8fac-ee22fdc77ad1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:00.544157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9982634-7715-4408-8fac-ee22fdc77ad1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:00.596393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13d555e9-d965-47a4-8a73-a7152aeab8f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:00.612845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13d555e9-d965-47a4-8a73-a7152aeab8f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:00.615069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13d555e9-d965-47a4-8a73-a7152aeab8f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:00.624382 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-13d555e9-d965-47a4-8a73-a7152aeab8f8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1745 microversion: 2.20 time: 1.053231 Jan 22 21:22:00.634602 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3433/6588] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:21:59 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1745 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:22:00.797453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5db5f00a-8715-468d-be79-3e76f51c91c3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:00.798507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5db5f00a-8715-468d-be79-3e76f51c91c3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:00.824306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5db5f00a-8715-468d-be79-3e76f51c91c3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:00.824990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5db5f00a-8715-468d-be79-3e76f51c91c3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:00.825829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5db5f00a-8715-468d-be79-3e76f51c91c3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:00.826269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5db5f00a-8715-468d-be79-3e76f51c91c3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:00.914879 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5db5f00a-8715-468d-be79-3e76f51c91c3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.120960 Jan 22 21:22:00.920378 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3434/6589] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:00 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:22:01.188637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e9982634-7715-4408-8fac-ee22fdc77ad1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:01.221460 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e9982634-7715-4408-8fac-ee22fdc77ad1 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1710 microversion: 2.1 time: 0.715614 Jan 22 21:22:01.222025 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3156/6590] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:00 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1710 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:01.366312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a59f754a-c1c6-449c-9269-925f72b3ae63 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:01.367651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a59f754a-c1c6-449c-9269-925f72b3ae63 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:01.375789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a59f754a-c1c6-449c-9269-925f72b3ae63 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:01.376628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a59f754a-c1c6-449c-9269-925f72b3ae63 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:01.377938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a59f754a-c1c6-449c-9269-925f72b3ae63 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:01.378614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a59f754a-c1c6-449c-9269-925f72b3ae63 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:01.652250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-83f73ce5-6cd9-42c5-84b1-ed7ee2fe6e81 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:01.653645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-83f73ce5-6cd9-42c5-84b1-ed7ee2fe6e81 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:01.677921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83f73ce5-6cd9-42c5-84b1-ed7ee2fe6e81 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:01.681742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83f73ce5-6cd9-42c5-84b1-ed7ee2fe6e81 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:01.681742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83f73ce5-6cd9-42c5-84b1-ed7ee2fe6e81 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:01.681742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83f73ce5-6cd9-42c5-84b1-ed7ee2fe6e81 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:02.545599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a59f754a-c1c6-449c-9269-925f72b3ae63 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:02.561931 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a59f754a-c1c6-449c-9269-925f72b3ae63 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1322 microversion: 2.1 time: 1.204651 Jan 22 21:22:02.564889 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3435/6591] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:01 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1322 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:02.578236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b132c0eb-4403-41b9-99af-ae966df05b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:02.588753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b132c0eb-4403-41b9-99af-ae966df05b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:02.608763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b132c0eb-4403-41b9-99af-ae966df05b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:02.609381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b132c0eb-4403-41b9-99af-ae966df05b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:02.612281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b132c0eb-4403-41b9-99af-ae966df05b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:02.617121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b132c0eb-4403-41b9-99af-ae966df05b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:02.704573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-83f73ce5-6cd9-42c5-84b1-ed7ee2fe6e81 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:02.709443 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b132c0eb-4403-41b9-99af-ae966df05b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.142188 Jan 22 21:22:02.710642 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3436/6592] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:02 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:02.718758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-125469512", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "46e4c057-a7a9-4d8b-9756-82e1733390a9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-69235120", "security_groups": [{"name": "tempest-secgroup-smoke-579620805"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:02.724597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-83f73ce5-6cd9-42c5-84b1-ed7ee2fe6e81 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:02.732941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-83f73ce5-6cd9-42c5-84b1-ed7ee2fe6e81 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:02.734907 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-83f73ce5-6cd9-42c5-84b1-ed7ee2fe6e81 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1745 microversion: 2.20 time: 1.086432 Jan 22 21:22:02.737390 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3157/6593] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:01 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1745 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:22:02.755105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-10a1f3de-a2c6-436a-88c3-a92d3f9ba9ce tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:02.762964 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:22:02.762964 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:22:02.767161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-10a1f3de-a2c6-436a-88c3-a92d3f9ba9ce tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:02.768253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-10a1f3de-a2c6-436a-88c3-a92d3f9ba9ce tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Searching by: {'deleted': False, 'project_id': 'd988412c137748b097d3202432cb420c'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:22:02.782470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10a1f3de-a2c6-436a-88c3-a92d3f9ba9ce tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:02.786371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10a1f3de-a2c6-436a-88c3-a92d3f9ba9ce tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:02.788580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10a1f3de-a2c6-436a-88c3-a92d3f9ba9ce tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:02.789054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-10a1f3de-a2c6-436a-88c3-a92d3f9ba9ce tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:02.844073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-10a1f3de-a2c6-436a-88c3-a92d3f9ba9ce tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:22:02.921196 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-10a1f3de-a2c6-436a-88c3-a92d3f9ba9ce tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.180769 Jan 22 21:22:02.923916 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3158/6594] 10.222.0.100 () {58 vars in 1129 bytes} [Sat Jan 22 21:22:02 2022] GET /compute/v2.1/servers => generated 341 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:22:02.936905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-21a2534f-4ce5-42f1-9d82-6b76b7d77d62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:02.943986 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:22:02.943986 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:22:02.949364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-21a2534f-4ce5-42f1-9d82-6b76b7d77d62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:02.952016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-21a2534f-4ce5-42f1-9d82-6b76b7d77d62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Searching by: {'deleted': False, 'project_id': 'd988412c137748b097d3202432cb420c'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 21:22:02.971007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21a2534f-4ce5-42f1-9d82-6b76b7d77d62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:02.971669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21a2534f-4ce5-42f1-9d82-6b76b7d77d62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:02.980470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21a2534f-4ce5-42f1-9d82-6b76b7d77d62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:02.982393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21a2534f-4ce5-42f1-9d82-6b76b7d77d62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:03.061792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-21a2534f-4ce5-42f1-9d82-6b76b7d77d62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 21:22:03.117243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-21a2534f-4ce5-42f1-9d82-6b76b7d77d62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:03.132070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21a2534f-4ce5-42f1-9d82-6b76b7d77d62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:03.132755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21a2534f-4ce5-42f1-9d82-6b76b7d77d62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:03.309448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] validate_networks() for [('46e4c057-a7a9-4d8b-9756-82e1733390a9', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:22:03.578142 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-21a2534f-4ce5-42f1-9d82-6b76b7d77d62 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.642294 Jan 22 21:22:03.593985 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3159/6595] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:22:02 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:22:03.600275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-60e1b3a1-65d4-4823-b55d-9ec652fd07c8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:03.601529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-60e1b3a1-65d4-4823-b55d-9ec652fd07c8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:03.610686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60e1b3a1-65d4-4823-b55d-9ec652fd07c8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:03.611162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60e1b3a1-65d4-4823-b55d-9ec652fd07c8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:03.612517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60e1b3a1-65d4-4823-b55d-9ec652fd07c8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:03.613022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60e1b3a1-65d4-4823-b55d-9ec652fd07c8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:04.448568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-60e1b3a1-65d4-4823-b55d-9ec652fd07c8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:04.465222 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-60e1b3a1-65d4-4823-b55d-9ec652fd07c8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1322 microversion: 2.1 time: 0.869865 Jan 22 21:22:04.488901 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3160/6596] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:03 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1322 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:04.515137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bb4ecb19-0057-4b21-a017-52413e81879e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:04.541459 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bb4ecb19-0057-4b21-a017-52413e81879e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/flavors/452" status: 200 len: 372 microversion: 2.1 time: 0.032143 Jan 22 21:22:04.553747 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3161/6597] 10.222.0.100 () {58 vars in 1141 bytes} [Sat Jan 22 21:22:04 2022] GET /compute/v2.1/flavors/452 => generated 372 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:22:04.555469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a27bbad5-a57a-4d5a-8362-70ce6f126468 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:04.556672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a27bbad5-a57a-4d5a-8362-70ce6f126468 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:04.570351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a27bbad5-a57a-4d5a-8362-70ce6f126468 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:04.584733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a27bbad5-a57a-4d5a-8362-70ce6f126468 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:04.585666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a27bbad5-a57a-4d5a-8362-70ce6f126468 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:04.586190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a27bbad5-a57a-4d5a-8362-70ce6f126468 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:04.676219 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a27bbad5-a57a-4d5a-8362-70ce6f126468 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.124298 Jan 22 21:22:04.683824 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3162/6598] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:04 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:04.697939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-332f0b41-774d-463e-9c23-3e3655894f32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:04.698989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-332f0b41-774d-463e-9c23-3e3655894f32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:04.720639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-332f0b41-774d-463e-9c23-3e3655894f32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:04.721115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-332f0b41-774d-463e-9c23-3e3655894f32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:04.721978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-332f0b41-774d-463e-9c23-3e3655894f32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:04.733012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-332f0b41-774d-463e-9c23-3e3655894f32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:05.485350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:22:05.485923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:22:05.486509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:22:05.487285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:22:05.488012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:22:05.526397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:05.527704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:05.529629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:05.530613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:05.551307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-332f0b41-774d-463e-9c23-3e3655894f32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:05.575253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-332f0b41-774d-463e-9c23-3e3655894f32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:05.585451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-332f0b41-774d-463e-9c23-3e3655894f32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:05.590882 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-332f0b41-774d-463e-9c23-3e3655894f32 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1745 microversion: 2.20 time: 0.906550 Jan 22 21:22:05.597983 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3163/6599] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:04 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1745 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:05.623705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ffeabbb2-8ab2-429c-957c-713f1a563730 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:05.627356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ffeabbb2-8ab2-429c-957c-713f1a563730 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:05.647016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffeabbb2-8ab2-429c-957c-713f1a563730 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:05.652474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffeabbb2-8ab2-429c-957c-713f1a563730 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:05.655367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:22:05.661567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffeabbb2-8ab2-429c-957c-713f1a563730 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:05.662078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffeabbb2-8ab2-429c-957c-713f1a563730 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:05.676682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for user 80aa2e03fde44436844a88a0ccc5d6a6 and project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:22:05.740276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:22:05.750714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:22:05.778104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ffeabbb2-8ab2-429c-957c-713f1a563730 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:22:06.043717 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1b3532d5-89f1-4e6e-995c-8ca96c454018 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.328030 Jan 22 21:22:06.044778 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3437/6600] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:22:02 2022] POST /compute/v2.1/servers => generated 407 bytes in 3334 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:22:06.089268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8bdc56be-5b03-49e7-87ee-b6eed5fc7cfb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:06.101139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8bdc56be-5b03-49e7-87ee-b6eed5fc7cfb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:06.143100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bdc56be-5b03-49e7-87ee-b6eed5fc7cfb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:06.145020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bdc56be-5b03-49e7-87ee-b6eed5fc7cfb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:06.147935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bdc56be-5b03-49e7-87ee-b6eed5fc7cfb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:06.149265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bdc56be-5b03-49e7-87ee-b6eed5fc7cfb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:06.285611 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ffeabbb2-8ab2-429c-957c-713f1a563730 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "DELETE /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 204 len: 0 microversion: 2.1 time: 0.683035 Jan 22 21:22:06.285611 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3164/6601] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:22:05 2022] DELETE /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 0 bytes in 685 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:22:06.292009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7cbeff76-82a8-4ca5-b5e0-f00c8a65729b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:06.295825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7cbeff76-82a8-4ca5-b5e0-f00c8a65729b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:06.317360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cbeff76-82a8-4ca5-b5e0-f00c8a65729b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:06.324459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cbeff76-82a8-4ca5-b5e0-f00c8a65729b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:06.326634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cbeff76-82a8-4ca5-b5e0-f00c8a65729b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:06.329732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cbeff76-82a8-4ca5-b5e0-f00c8a65729b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:06.463219 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7cbeff76-82a8-4ca5-b5e0-f00c8a65729b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.168407 Jan 22 21:22:06.464776 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3165/6602] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:06 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:06.475421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-68624182-2a03-40df-9e61-9ad4252ec1e6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:06.476958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-68624182-2a03-40df-9e61-9ad4252ec1e6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:06.635012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-68624182-2a03-40df-9e61-9ad4252ec1e6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:06.651186 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-68624182-2a03-40df-9e61-9ad4252ec1e6 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1268 microversion: 2.1 time: 0.184892 Jan 22 21:22:06.659455 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3166/6603] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:06 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:06.673893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0f477a25-765f-4b38-aaab-b960e679c72e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:06.674572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0f477a25-765f-4b38-aaab-b960e679c72e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:06.698064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f477a25-765f-4b38-aaab-b960e679c72e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:06.698534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f477a25-765f-4b38-aaab-b960e679c72e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:06.699356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f477a25-765f-4b38-aaab-b960e679c72e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:06.699808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f477a25-765f-4b38-aaab-b960e679c72e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:06.738954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8bdc56be-5b03-49e7-87ee-b6eed5fc7cfb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:06.761087 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8bdc56be-5b03-49e7-87ee-b6eed5fc7cfb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1322 microversion: 2.1 time: 0.692244 Jan 22 21:22:06.762657 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3438/6604] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:06 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1322 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:06.786239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-36c7abf0-91c7-410d-a3f7-362c577e97f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:06.787103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-36c7abf0-91c7-410d-a3f7-362c577e97f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:06.807704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36c7abf0-91c7-410d-a3f7-362c577e97f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:06.808440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36c7abf0-91c7-410d-a3f7-362c577e97f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:06.809436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36c7abf0-91c7-410d-a3f7-362c577e97f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:06.810275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36c7abf0-91c7-410d-a3f7-362c577e97f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:07.138277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-36c7abf0-91c7-410d-a3f7-362c577e97f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:07.152315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-36c7abf0-91c7-410d-a3f7-362c577e97f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:07.157071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-36c7abf0-91c7-410d-a3f7-362c577e97f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:07.158847 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-36c7abf0-91c7-410d-a3f7-362c577e97f3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1745 microversion: 2.20 time: 0.393795 Jan 22 21:22:07.159458 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3439/6605] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:06 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1745 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:07.405457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0f477a25-765f-4b38-aaab-b960e679c72e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:07.433014 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0f477a25-765f-4b38-aaab-b960e679c72e tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1716 microversion: 2.1 time: 0.772060 Jan 22 21:22:07.434063 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3167/6606] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:06 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1716 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:07.476371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ece5c48-072f-43e8-80ee-dccf9a8e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:07.477727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1ece5c48-072f-43e8-80ee-dccf9a8e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:07.494916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ece5c48-072f-43e8-80ee-dccf9a8e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:07.501247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ece5c48-072f-43e8-80ee-dccf9a8e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:07.501247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ece5c48-072f-43e8-80ee-dccf9a8e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:07.501247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ece5c48-072f-43e8-80ee-dccf9a8e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:07.606892 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ece5c48-072f-43e8-80ee-dccf9a8e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.134994 Jan 22 21:22:07.607603 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3440/6607] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:07 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:07.668712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d92722d2-ac33-41d4-b330-04583ad65e53 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:07.669338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d92722d2-ac33-41d4-b330-04583ad65e53 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:07.683184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d92722d2-ac33-41d4-b330-04583ad65e53 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:07.683648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d92722d2-ac33-41d4-b330-04583ad65e53 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:07.684478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d92722d2-ac33-41d4-b330-04583ad65e53 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:07.684923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d92722d2-ac33-41d4-b330-04583ad65e53 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:07.779719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7fb42031-6a9a-42fc-9809-a6fdab825954 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:07.783783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7fb42031-6a9a-42fc-9809-a6fdab825954 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:07.809657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fb42031-6a9a-42fc-9809-a6fdab825954 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:07.810161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fb42031-6a9a-42fc-9809-a6fdab825954 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:07.811022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fb42031-6a9a-42fc-9809-a6fdab825954 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:07.811781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fb42031-6a9a-42fc-9809-a6fdab825954 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:07.822636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d92722d2-ac33-41d4-b330-04583ad65e53 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:07.838304 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d92722d2-ac33-41d4-b330-04583ad65e53 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1272 microversion: 2.1 time: 0.173518 Jan 22 21:22:07.838905 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3168/6608] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:07 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:08.129129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7fb42031-6a9a-42fc-9809-a6fdab825954 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:08.140996 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7fb42031-6a9a-42fc-9809-a6fdab825954 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1322 microversion: 2.1 time: 0.364754 Jan 22 21:22:08.150645 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3441/6609] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:07 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:22:08.184836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-02fc2214-2bf6-4395-b60d-5717b950a531 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:08.186060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-02fc2214-2bf6-4395-b60d-5717b950a531 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:08.211659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-02fc2214-2bf6-4395-b60d-5717b950a531 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:08.220621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-02fc2214-2bf6-4395-b60d-5717b950a531 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:08.228410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-02fc2214-2bf6-4395-b60d-5717b950a531 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:08.234203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-02fc2214-2bf6-4395-b60d-5717b950a531 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:08.453591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5ed0a6f6-961a-42cf-a571-06f5df62d359 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:08.454675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5ed0a6f6-961a-42cf-a571-06f5df62d359 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:08.473217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ed0a6f6-961a-42cf-a571-06f5df62d359 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:08.474493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ed0a6f6-961a-42cf-a571-06f5df62d359 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:08.478652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ed0a6f6-961a-42cf-a571-06f5df62d359 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:08.480050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ed0a6f6-961a-42cf-a571-06f5df62d359 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:08.757107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5ed0a6f6-961a-42cf-a571-06f5df62d359 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:08.766022 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5ed0a6f6-961a-42cf-a571-06f5df62d359 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1716 microversion: 2.1 time: 0.316502 Jan 22 21:22:08.768267 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3442/6610] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:08 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1716 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:08.774932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ea112554-6e25-47c8-8cd3-f6a8264dd8ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:08.776287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ea112554-6e25-47c8-8cd3-f6a8264dd8ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:08.784276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea112554-6e25-47c8-8cd3-f6a8264dd8ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:08.786103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea112554-6e25-47c8-8cd3-f6a8264dd8ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:08.787134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea112554-6e25-47c8-8cd3-f6a8264dd8ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:08.787745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea112554-6e25-47c8-8cd3-f6a8264dd8ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:08.836845 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ea112554-6e25-47c8-8cd3-f6a8264dd8ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.067103 Jan 22 21:22:08.841809 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3443/6611] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:08 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:08.863559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c0f0599a-aee1-4f9e-b474-cee62096f6a0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:08.872377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c0f0599a-aee1-4f9e-b474-cee62096f6a0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:08.895920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0f0599a-aee1-4f9e-b474-cee62096f6a0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:08.903653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0f0599a-aee1-4f9e-b474-cee62096f6a0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:08.904904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0f0599a-aee1-4f9e-b474-cee62096f6a0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:08.905628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0f0599a-aee1-4f9e-b474-cee62096f6a0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:08.915931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-02fc2214-2bf6-4395-b60d-5717b950a531 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:08.932967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-02fc2214-2bf6-4395-b60d-5717b950a531 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:08.940380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-02fc2214-2bf6-4395-b60d-5717b950a531 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:08.940380 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-02fc2214-2bf6-4395-b60d-5717b950a531 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1745 microversion: 2.20 time: 0.765780 Jan 22 21:22:08.940380 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3169/6612] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:08 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1745 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:08.968368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f60ccff3-86be-4b4c-89b6-97e170824833 req-51b5a375-9d20-4c10-8f15-ac78c33dc9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6316a4f8-60dc-49da-98c2-3395f338f324", "name": "network-vif-plugged", "status": "completed", "tag": "b990c73c-2a43-4448-af8b-ba36388255b7"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:08.972981 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:22:08.972981 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:22:09.006242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f60ccff3-86be-4b4c-89b6-97e170824833 req-51b5a375-9d20-4c10-8f15-ac78c33dc9ad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:09.006970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f60ccff3-86be-4b4c-89b6-97e170824833 req-51b5a375-9d20-4c10-8f15-ac78c33dc9ad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:09.034420 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f60ccff3-86be-4b4c-89b6-97e170824833 req-51b5a375-9d20-4c10-8f15-ac78c33dc9ad service nova] Creating event network-vif-plugged:b990c73c-2a43-4448-af8b-ba36388255b7 for instance 6316a4f8-60dc-49da-98c2-3395f338f324 on nch2-master-1 Jan 22 21:22:09.048663 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f60ccff3-86be-4b4c-89b6-97e170824833 req-51b5a375-9d20-4c10-8f15-ac78c33dc9ad service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092214 Jan 22 21:22:09.049594 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3170/6613] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:22:09.108158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c0f0599a-aee1-4f9e-b474-cee62096f6a0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:09.119240 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c0f0599a-aee1-4f9e-b474-cee62096f6a0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1320 microversion: 2.1 time: 0.265802 Jan 22 21:22:09.124831 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3444/6614] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:08 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1320 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:09.160914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3159be42-9015-4310-8781-0e8649a7ca9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:09.161993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3159be42-9015-4310-8781-0e8649a7ca9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:09.179379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3159be42-9015-4310-8781-0e8649a7ca9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:09.179379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3159be42-9015-4310-8781-0e8649a7ca9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:09.183009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3159be42-9015-4310-8781-0e8649a7ca9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:09.184502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3159be42-9015-4310-8781-0e8649a7ca9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:09.800123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-527cf04b-ca67-4cbb-a6f9-a5c6e8c39302 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:09.806292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-527cf04b-ca67-4cbb-a6f9-a5c6e8c39302 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:09.824573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-527cf04b-ca67-4cbb-a6f9-a5c6e8c39302 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:09.824915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-527cf04b-ca67-4cbb-a6f9-a5c6e8c39302 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:09.832612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-527cf04b-ca67-4cbb-a6f9-a5c6e8c39302 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:09.833289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-527cf04b-ca67-4cbb-a6f9-a5c6e8c39302 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:10.061343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-527cf04b-ca67-4cbb-a6f9-a5c6e8c39302 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:10.076909 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-527cf04b-ca67-4cbb-a6f9-a5c6e8c39302 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1716 microversion: 2.1 time: 0.286991 Jan 22 21:22:10.092835 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3445/6615] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:09 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1716 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:10.115366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b144a0bf-9d69-4d24-8a96-5ba58977f162 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:10.122693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b144a0bf-9d69-4d24-8a96-5ba58977f162 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:10.143194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b144a0bf-9d69-4d24-8a96-5ba58977f162 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:10.143760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b144a0bf-9d69-4d24-8a96-5ba58977f162 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:10.145230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b144a0bf-9d69-4d24-8a96-5ba58977f162 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:10.147448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b144a0bf-9d69-4d24-8a96-5ba58977f162 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:10.214665 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b144a0bf-9d69-4d24-8a96-5ba58977f162 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.119718 Jan 22 21:22:10.215624 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3446/6616] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:10 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:10.221972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17179fca-5312-4a08-8a38-cebb43a1a96a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:10.225682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17179fca-5312-4a08-8a38-cebb43a1a96a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:10.231470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17179fca-5312-4a08-8a38-cebb43a1a96a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:10.233458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17179fca-5312-4a08-8a38-cebb43a1a96a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:10.234643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17179fca-5312-4a08-8a38-cebb43a1a96a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:10.235244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17179fca-5312-4a08-8a38-cebb43a1a96a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:10.468698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-17179fca-5312-4a08-8a38-cebb43a1a96a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:10.485699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-17179fca-5312-4a08-8a38-cebb43a1a96a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:10.501528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-17179fca-5312-4a08-8a38-cebb43a1a96a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:10.518158 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17179fca-5312-4a08-8a38-cebb43a1a96a tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1745 microversion: 2.20 time: 0.301053 Jan 22 21:22:10.518792 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3447/6617] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:10 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1745 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:10.525698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3159be42-9015-4310-8781-0e8649a7ca9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:10.533039 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3159be42-9015-4310-8781-0e8649a7ca9c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1322 microversion: 2.1 time: 1.377037 Jan 22 21:22:10.536587 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3171/6618] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:09 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1322 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:10.559679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-56d37664-dd11-44c5-a906-51e19776acb7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:10.560314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-56d37664-dd11-44c5-a906-51e19776acb7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:10.580063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56d37664-dd11-44c5-a906-51e19776acb7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:10.580765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56d37664-dd11-44c5-a906-51e19776acb7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:10.582484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56d37664-dd11-44c5-a906-51e19776acb7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:10.586662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56d37664-dd11-44c5-a906-51e19776acb7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:10.766074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-56d37664-dd11-44c5-a906-51e19776acb7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:10.800207 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-56d37664-dd11-44c5-a906-51e19776acb7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1326 microversion: 2.1 time: 0.273768 Jan 22 21:22:10.803420 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3448/6619] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:10 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1326 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:11.098131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a33cf0bf-f2da-4d2a-acb6-be3fef2a1a4c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:11.098761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a33cf0bf-f2da-4d2a-acb6-be3fef2a1a4c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:11.114081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a33cf0bf-f2da-4d2a-acb6-be3fef2a1a4c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:11.114746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a33cf0bf-f2da-4d2a-acb6-be3fef2a1a4c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:11.115733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a33cf0bf-f2da-4d2a-acb6-be3fef2a1a4c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:11.116338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a33cf0bf-f2da-4d2a-acb6-be3fef2a1a4c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:11.228194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6bfa7e45-4402-4744-a7db-ab6a3bae73d6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:11.243979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6bfa7e45-4402-4744-a7db-ab6a3bae73d6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:11.252276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bfa7e45-4402-4744-a7db-ab6a3bae73d6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:11.262239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bfa7e45-4402-4744-a7db-ab6a3bae73d6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:11.263197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bfa7e45-4402-4744-a7db-ab6a3bae73d6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:11.270263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bfa7e45-4402-4744-a7db-ab6a3bae73d6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:11.340752 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6bfa7e45-4402-4744-a7db-ab6a3bae73d6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.118232 Jan 22 21:22:11.342209 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3449/6620] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:11 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:11.541486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-befee537-a402-453c-adb0-f4851bad6e7e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:11.543580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-befee537-a402-453c-adb0-f4851bad6e7e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:11.565693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-befee537-a402-453c-adb0-f4851bad6e7e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:11.567774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-befee537-a402-453c-adb0-f4851bad6e7e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:11.568832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-befee537-a402-453c-adb0-f4851bad6e7e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:11.569434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-befee537-a402-453c-adb0-f4851bad6e7e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:11.876102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a33cf0bf-f2da-4d2a-acb6-be3fef2a1a4c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:11.887093 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a33cf0bf-f2da-4d2a-acb6-be3fef2a1a4c tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1716 microversion: 2.1 time: 0.794513 Jan 22 21:22:11.888187 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3172/6621] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:11 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1716 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:11.903469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9edc153a-5f45-476d-8a55-516db9520a2f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:11.904320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9edc153a-5f45-476d-8a55-516db9520a2f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:11.914306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9edc153a-5f45-476d-8a55-516db9520a2f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:11.914984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9edc153a-5f45-476d-8a55-516db9520a2f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:11.916768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9edc153a-5f45-476d-8a55-516db9520a2f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:11.917384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9edc153a-5f45-476d-8a55-516db9520a2f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:12.282453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-befee537-a402-453c-adb0-f4851bad6e7e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:12.295986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-befee537-a402-453c-adb0-f4851bad6e7e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:12.304023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-befee537-a402-453c-adb0-f4851bad6e7e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:12.313111 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-befee537-a402-453c-adb0-f4851bad6e7e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1745 microversion: 2.20 time: 0.769049 Jan 22 21:22:12.313111 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3450/6622] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:11 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1745 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:22:12.318216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7c98b22f-4e17-4e58-a83d-99687d0e663a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:12.323718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7c98b22f-4e17-4e58-a83d-99687d0e663a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:12.336173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c98b22f-4e17-4e58-a83d-99687d0e663a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:12.339574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c98b22f-4e17-4e58-a83d-99687d0e663a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:12.340672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c98b22f-4e17-4e58-a83d-99687d0e663a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:12.344958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c98b22f-4e17-4e58-a83d-99687d0e663a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:12.452291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7c98b22f-4e17-4e58-a83d-99687d0e663a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:12.468154 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7c98b22f-4e17-4e58-a83d-99687d0e663a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1326 microversion: 2.1 time: 0.160263 Jan 22 21:22:12.470399 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3451/6623] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:12 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1326 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:12.569638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9edc153a-5f45-476d-8a55-516db9520a2f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:12.582390 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9edc153a-5f45-476d-8a55-516db9520a2f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1513 microversion: 2.1 time: 0.692368 Jan 22 21:22:12.589622 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3173/6624] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:11 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1513 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:12.599899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-2665fc0a-30ad-4a5d-ad68-4a68d8a6638b req-8034fcb4-5536-4564-9ccd-a0fdd82b0394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e318c979-4614-4d4f-9412-43d48d1b042b", "name": "network-vif-deleted", "tag": "8f6916af-e766-4eb7-96e1-7e81bb9a0a97"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:12.607105 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:22:12.607105 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:22:12.636569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2665fc0a-30ad-4a5d-ad68-4a68d8a6638b req-8034fcb4-5536-4564-9ccd-a0fdd82b0394 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:12.639455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2665fc0a-30ad-4a5d-ad68-4a68d8a6638b req-8034fcb4-5536-4564-9ccd-a0fdd82b0394 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:12.699187 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-2665fc0a-30ad-4a5d-ad68-4a68d8a6638b req-8034fcb4-5536-4564-9ccd-a0fdd82b0394 service nova] Creating event network-vif-deleted:8f6916af-e766-4eb7-96e1-7e81bb9a0a97 for instance e318c979-4614-4d4f-9412-43d48d1b042b on nch2-master-1 Jan 22 21:22:12.714173 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-2665fc0a-30ad-4a5d-ad68-4a68d8a6638b req-8034fcb4-5536-4564-9ccd-a0fdd82b0394 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117037 Jan 22 21:22:12.716094 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3174/6625] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:22:12.738541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6450826d-1dd4-4aae-8c13-97479f2a5b7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60b38738-e71a-4465-8224-7dd4972ee31c"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:12.738541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6450826d-1dd4-4aae-8c13-97479f2a5b7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:12.747560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6450826d-1dd4-4aae-8c13-97479f2a5b7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:12.750076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6450826d-1dd4-4aae-8c13-97479f2a5b7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:12.752016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6450826d-1dd4-4aae-8c13-97479f2a5b7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:12.755008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6450826d-1dd4-4aae-8c13-97479f2a5b7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:12.932942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7f4eeb52-a1a5-467c-b794-d1042f892bcd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:12.934780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7f4eeb52-a1a5-467c-b794-d1042f892bcd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:12.943980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f4eeb52-a1a5-467c-b794-d1042f892bcd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:12.944728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f4eeb52-a1a5-467c-b794-d1042f892bcd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:12.945877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f4eeb52-a1a5-467c-b794-d1042f892bcd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:12.946813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f4eeb52-a1a5-467c-b794-d1042f892bcd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:12.997050 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-6450826d-1dd4-4aae-8c13-97479f2a5b7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] HTTP exception thrown: Invalid volume: volume 60b38738-e71a-4465-8224-7dd4972ee31c is already attached to instances: 1333f8b7-c8db-487d-b9e6-b5452b4bae48 Jan 22 21:22:12.998539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6450826d-1dd4-4aae-8c13-97479f2a5b7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Returning 400 to user: Invalid volume: volume 60b38738-e71a-4465-8224-7dd4972ee31c is already attached to instances: 1333f8b7-c8db-487d-b9e6-b5452b4bae48 {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:22:12.999792 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6450826d-1dd4-4aae-8c13-97479f2a5b7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "POST /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.282367 Jan 22 21:22:13.003997 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3175/6626] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:22:12 2022] POST /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324/os-volume_attachments => generated 174 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:22:13.006119 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7f4eeb52-a1a5-467c-b794-d1042f892bcd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.530617 Jan 22 21:22:13.008564 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3452/6627] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:12 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:13.024208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0ed8321f-e82d-4385-8601-5e385cee4dd3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:13.036151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0ed8321f-e82d-4385-8601-5e385cee4dd3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:13.053574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ed8321f-e82d-4385-8601-5e385cee4dd3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:13.055723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ed8321f-e82d-4385-8601-5e385cee4dd3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:13.056849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ed8321f-e82d-4385-8601-5e385cee4dd3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:13.063226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ed8321f-e82d-4385-8601-5e385cee4dd3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:13.120661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ed8321f-e82d-4385-8601-5e385cee4dd3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:13.121370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ed8321f-e82d-4385-8601-5e385cee4dd3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:13.122107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-0ed8321f-e82d-4385-8601-5e385cee4dd3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lazy-loading 'fault' on Instance uuid e318c979-4614-4d4f-9412-43d48d1b042b {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:22:13.130002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-abc8d6b8-6e15-477b-9637-e8562135acf7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:13.130590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-abc8d6b8-6e15-477b-9637-e8562135acf7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:13.140062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abc8d6b8-6e15-477b-9637-e8562135acf7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:13.140517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abc8d6b8-6e15-477b-9637-e8562135acf7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:13.141347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abc8d6b8-6e15-477b-9637-e8562135acf7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:13.152635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abc8d6b8-6e15-477b-9637-e8562135acf7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:13.395713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-abc8d6b8-6e15-477b-9637-e8562135acf7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lazy-loading 'services' on Instance uuid 1333f8b7-c8db-487d-b9e6-b5452b4bae48 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:22:13.445418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0ed8321f-e82d-4385-8601-5e385cee4dd3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bb293ae35c445c1a091670ad02ce3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd988412c137748b097d3202432cb420c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:13.455123 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0ed8321f-e82d-4385-8601-5e385cee4dd3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 200 len: 1370 microversion: 2.1 time: 0.449684 Jan 22 21:22:13.462875 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3176/6628] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:13 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 1370 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:13.510257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fe18446b-31dc-4afc-9832-0cdf9636ef80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:13.510903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fe18446b-31dc-4afc-9832-0cdf9636ef80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:13.522062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe18446b-31dc-4afc-9832-0cdf9636ef80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:13.522803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe18446b-31dc-4afc-9832-0cdf9636ef80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:13.555200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe18446b-31dc-4afc-9832-0cdf9636ef80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:13.560189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe18446b-31dc-4afc-9832-0cdf9636ef80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:13.784051 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-abc8d6b8-6e15-477b-9637-e8562135acf7 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48/os-volume_attachments/60b38738-e71a-4465-8224-7dd4972ee31c" status: 202 len: 0 microversion: 2.1 time: 0.658737 Jan 22 21:22:13.787296 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3453/6629] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 21:22:13 2022] DELETE /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48/os-volume_attachments/60b38738-e71a-4465-8224-7dd4972ee31c => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:13.797806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6dd120fc-e6ee-4082-8c33-565f5e5ce2e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:13.798922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6dd120fc-e6ee-4082-8c33-565f5e5ce2e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:13.817233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6dd120fc-e6ee-4082-8c33-565f5e5ce2e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:13.818072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6dd120fc-e6ee-4082-8c33-565f5e5ce2e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:13.819052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6dd120fc-e6ee-4082-8c33-565f5e5ce2e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:13.826761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6dd120fc-e6ee-4082-8c33-565f5e5ce2e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:14.800557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6dd120fc-e6ee-4082-8c33-565f5e5ce2e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:14.818352 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6dd120fc-e6ee-4082-8c33-565f5e5ce2e8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1393 microversion: 2.1 time: 1.029778 Jan 22 21:22:14.819613 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3454/6630] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:13 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1393 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:14.825027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-56f45626-a193-4d04-9557-144ea2c2ad9a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:14.826379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-56f45626-a193-4d04-9557-144ea2c2ad9a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:14.838402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56f45626-a193-4d04-9557-144ea2c2ad9a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:14.839647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56f45626-a193-4d04-9557-144ea2c2ad9a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:14.841823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56f45626-a193-4d04-9557-144ea2c2ad9a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:14.843024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56f45626-a193-4d04-9557-144ea2c2ad9a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:14.916962 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-56f45626-a193-4d04-9557-144ea2c2ad9a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095916 Jan 22 21:22:14.917587 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3455/6631] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:22:14 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:22:14.922362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74156e7b-bd41-4b0a-a933-c67132441c9d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:14.924775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-74156e7b-bd41-4b0a-a933-c67132441c9d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:14.943572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74156e7b-bd41-4b0a-a933-c67132441c9d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:14.945116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74156e7b-bd41-4b0a-a933-c67132441c9d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:14.946964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74156e7b-bd41-4b0a-a933-c67132441c9d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:14.948191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74156e7b-bd41-4b0a-a933-c67132441c9d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:14.986348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fe18446b-31dc-4afc-9832-0cdf9636ef80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:15.000555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fe18446b-31dc-4afc-9832-0cdf9636ef80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:15.004085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fe18446b-31dc-4afc-9832-0cdf9636ef80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:15.006344 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fe18446b-31dc-4afc-9832-0cdf9636ef80 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1745 microversion: 2.20 time: 1.536034 Jan 22 21:22:15.007340 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3177/6632] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:13 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1745 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:15.015677 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-74156e7b-bd41-4b0a-a933-c67132441c9d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.096589 Jan 22 21:22:15.017223 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3456/6633] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:14 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:15.024322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4f1d9b92-e2ee-4d3c-bf8d-beb6158fc642 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:15.028983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4f1d9b92-e2ee-4d3c-bf8d-beb6158fc642 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] [instance: e318c979-4614-4d4f-9412-43d48d1b042b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:15.038788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f1d9b92-e2ee-4d3c-bf8d-beb6158fc642 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:15.039597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f1d9b92-e2ee-4d3c-bf8d-beb6158fc642 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:15.040650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f1d9b92-e2ee-4d3c-bf8d-beb6158fc642 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:15.041361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f1d9b92-e2ee-4d3c-bf8d-beb6158fc642 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:15.071035 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-4f1d9b92-e2ee-4d3c-bf8d-beb6158fc642 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] HTTP exception thrown: Instance e318c979-4614-4d4f-9412-43d48d1b042b could not be found. Jan 22 21:22:15.071902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4f1d9b92-e2ee-4d3c-bf8d-beb6158fc642 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Returning 404 to user: Instance e318c979-4614-4d4f-9412-43d48d1b042b could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:22:15.073101 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4f1d9b92-e2ee-4d3c-bf8d-beb6158fc642 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b" status: 404 len: 111 microversion: 2.1 time: 0.064608 Jan 22 21:22:15.075317 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3178/6634] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:15 2022] GET /compute/v2.1/servers/e318c979-4614-4d4f-9412-43d48d1b042b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:22:15.090480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2c8d5b77-d730-4818-9534-223c239c38e3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] Calling method '.version_select at 0x7f1ed5d694c0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:15.229840 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2c8d5b77-d730-4818-9534-223c239c38e3 tempest-ServersTestManualDisk-388742779 tempest-ServersTestManualDisk-388742779-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-398913025" status: 202 len: 0 microversion: 2.1 time: 0.149287 Jan 22 21:22:15.233528 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3457/6635] 10.222.0.100 () {58 vars in 1222 bytes} [Sat Jan 22 21:22:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-398913025 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:15.834798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-21ce92f5-810d-486c-9f29-03e4f95a3069 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:15.835764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-21ce92f5-810d-486c-9f29-03e4f95a3069 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:15.853374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21ce92f5-810d-486c-9f29-03e4f95a3069 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:15.853917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21ce92f5-810d-486c-9f29-03e4f95a3069 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:15.854781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21ce92f5-810d-486c-9f29-03e4f95a3069 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:15.855287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21ce92f5-810d-486c-9f29-03e4f95a3069 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:15.933093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-11de237b-1368-49b0-8c8d-3c553e987774 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:15.934889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-11de237b-1368-49b0-8c8d-3c553e987774 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:15.958297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11de237b-1368-49b0-8c8d-3c553e987774 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:15.958297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11de237b-1368-49b0-8c8d-3c553e987774 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:15.958297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11de237b-1368-49b0-8c8d-3c553e987774 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:15.958297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11de237b-1368-49b0-8c8d-3c553e987774 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:16.010346 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-11de237b-1368-49b0-8c8d-3c553e987774 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083019 Jan 22 21:22:16.012219 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3458/6636] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:22:15 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:22:16.034296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-38007da9-f25b-4c46-a3a1-38c3e1d55810 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:16.038210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-38007da9-f25b-4c46-a3a1-38c3e1d55810 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:16.047177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38007da9-f25b-4c46-a3a1-38c3e1d55810 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:16.048216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38007da9-f25b-4c46-a3a1-38c3e1d55810 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:16.049651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38007da9-f25b-4c46-a3a1-38c3e1d55810 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:16.051281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38007da9-f25b-4c46-a3a1-38c3e1d55810 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:16.114731 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-38007da9-f25b-4c46-a3a1-38c3e1d55810 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.085510 Jan 22 21:22:16.119836 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3459/6637] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:16 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:16.128989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1c84d66-68ec-44f2-9d2e-562d45a9f419 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:16.131267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1c84d66-68ec-44f2-9d2e-562d45a9f419 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:16.148232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1c84d66-68ec-44f2-9d2e-562d45a9f419 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:16.148232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1c84d66-68ec-44f2-9d2e-562d45a9f419 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:16.148232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1c84d66-68ec-44f2-9d2e-562d45a9f419 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:16.148232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1c84d66-68ec-44f2-9d2e-562d45a9f419 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:16.511081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1c84d66-68ec-44f2-9d2e-562d45a9f419 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:16.527581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1c84d66-68ec-44f2-9d2e-562d45a9f419 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:16.536190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1c84d66-68ec-44f2-9d2e-562d45a9f419 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:16.544168 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1c84d66-68ec-44f2-9d2e-562d45a9f419 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1745 microversion: 2.20 time: 0.422741 Jan 22 21:22:16.547191 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3460/6638] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:16 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1745 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:16.557741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1201577929", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "450276e4-b8c9-4322-9dd8-f1637d2b1ee8"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:16.661676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] validate_networks() for [('450276e4-b8c9-4322-9dd8-f1637d2b1ee8', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:22:16.724143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-21ce92f5-810d-486c-9f29-03e4f95a3069 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:16.735414 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-21ce92f5-810d-486c-9f29-03e4f95a3069 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1393 microversion: 2.1 time: 0.904387 Jan 22 21:22:16.736728 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3179/6639] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:15 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1393 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:16.743113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-2dab9c52-3cc0-4165-bd61-617336f4f615 req-e4663a3e-7738-46b1-a5b2-8e2955550fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12be9a2-2532-4441-94d7-1e38912ebaef", "tag": "072275f1-ea9f-46b7-8332-4cc1cf1c51f3"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:16.745283 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:22:16.745283 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:22:16.760801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2dab9c52-3cc0-4165-bd61-617336f4f615 req-e4663a3e-7738-46b1-a5b2-8e2955550fa4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:16.761606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2dab9c52-3cc0-4165-bd61-617336f4f615 req-e4663a3e-7738-46b1-a5b2-8e2955550fa4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:16.804456 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-2dab9c52-3cc0-4165-bd61-617336f4f615 req-e4663a3e-7738-46b1-a5b2-8e2955550fa4 service nova] Creating event network-changed:072275f1-ea9f-46b7-8332-4cc1cf1c51f3 for instance a12be9a2-2532-4441-94d7-1e38912ebaef on nch1-master-1 Jan 22 21:22:16.820249 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-2dab9c52-3cc0-4165-bd61-617336f4f615 req-e4663a3e-7738-46b1-a5b2-8e2955550fa4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081002 Jan 22 21:22:16.822583 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3180/6640] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:22:17.134971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-da62ce15-aa23-4632-a4b0-97063f78c6bf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:17.136239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-da62ce15-aa23-4632-a4b0-97063f78c6bf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:17.145681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da62ce15-aa23-4632-a4b0-97063f78c6bf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:17.146240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da62ce15-aa23-4632-a4b0-97063f78c6bf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:17.147210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da62ce15-aa23-4632-a4b0-97063f78c6bf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:17.147728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da62ce15-aa23-4632-a4b0-97063f78c6bf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:17.199707 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-da62ce15-aa23-4632-a4b0-97063f78c6bf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.074579 Jan 22 21:22:17.204773 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3181/6641] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:17 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:17.423512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:22:17.426114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:22:17.428227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:22:17.428950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:22:17.429595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:22:17.443367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:17.444177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:17.445356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:17.446608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:17.495065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Getting quotas for project 063a9e2a155241a3bf27e7d1b16d0419. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:22:17.517054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Getting quotas for user b9ea4bd8d1d94d6a8e41b26da41bd6fc and project 063a9e2a155241a3bf27e7d1b16d0419. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:22:17.562802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:22:17.562802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:22:17.571436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e7bab83f-d63b-46f5-93cb-845ed2599020 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:17.572470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e7bab83f-d63b-46f5-93cb-845ed2599020 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:17.593391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7bab83f-d63b-46f5-93cb-845ed2599020 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:17.594107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7bab83f-d63b-46f5-93cb-845ed2599020 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:17.595071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7bab83f-d63b-46f5-93cb-845ed2599020 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:17.596485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7bab83f-d63b-46f5-93cb-845ed2599020 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:17.744721 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-64a289d0-ee2c-4ce8-88c8-acb85b48646c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.196288 Jan 22 21:22:17.745702 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3461/6642] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:22:16 2022] POST /compute/v2.1/servers => generated 382 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:22:17.753822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0787430b-8884-4023-aa15-cb0103d1cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:17.754730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0787430b-8884-4023-aa15-cb0103d1cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:17.771355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0787430b-8884-4023-aa15-cb0103d1cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:17.772075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0787430b-8884-4023-aa15-cb0103d1cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:17.773058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0787430b-8884-4023-aa15-cb0103d1cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:17.773788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0787430b-8884-4023-aa15-cb0103d1cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:18.390585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0787430b-8884-4023-aa15-cb0103d1cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:18.399884 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0787430b-8884-4023-aa15-cb0103d1cc03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1393 microversion: 2.1 time: 0.650244 Jan 22 21:22:18.415566 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3462/6643] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:17 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1393 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:18.418958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f09e7ecc-9f19-40a0-8f24-48963bd7455b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:18.420348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f09e7ecc-9f19-40a0-8f24-48963bd7455b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:18.561100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f09e7ecc-9f19-40a0-8f24-48963bd7455b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:18.574120 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f09e7ecc-9f19-40a0-8f24-48963bd7455b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1222 microversion: 2.1 time: 0.156005 Jan 22 21:22:18.575344 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3463/6644] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:18 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:18.582212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2a086e3b-a4d1-428a-afc4-9b27faa28542 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:18.593767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2a086e3b-a4d1-428a-afc4-9b27faa28542 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:18.602550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a086e3b-a4d1-428a-afc4-9b27faa28542 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:18.606180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a086e3b-a4d1-428a-afc4-9b27faa28542 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:18.611232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a086e3b-a4d1-428a-afc4-9b27faa28542 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:18.611846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a086e3b-a4d1-428a-afc4-9b27faa28542 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:18.746745 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2a086e3b-a4d1-428a-afc4-9b27faa28542 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.169768 Jan 22 21:22:18.755166 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3464/6645] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:18 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:19.132379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e7bab83f-d63b-46f5-93cb-845ed2599020 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:19.148022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e7bab83f-d63b-46f5-93cb-845ed2599020 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:19.152775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e7bab83f-d63b-46f5-93cb-845ed2599020 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:19.168890 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e7bab83f-d63b-46f5-93cb-845ed2599020 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1745 microversion: 2.20 time: 1.599878 Jan 22 21:22:19.170172 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3182/6646] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:17 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1745 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:22:19.424082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-18555610-13ff-4d42-b567-f33897acbe4c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:19.424905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-18555610-13ff-4d42-b567-f33897acbe4c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:19.438477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18555610-13ff-4d42-b567-f33897acbe4c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:19.438477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18555610-13ff-4d42-b567-f33897acbe4c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:19.438964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18555610-13ff-4d42-b567-f33897acbe4c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:19.439652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-18555610-13ff-4d42-b567-f33897acbe4c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:19.593085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-74202379-9329-4327-a834-bdc5e6f38cad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:19.599763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-74202379-9329-4327-a834-bdc5e6f38cad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:19.612711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74202379-9329-4327-a834-bdc5e6f38cad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:19.613480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74202379-9329-4327-a834-bdc5e6f38cad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:19.620398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74202379-9329-4327-a834-bdc5e6f38cad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:19.622230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74202379-9329-4327-a834-bdc5e6f38cad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:19.760910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-74202379-9329-4327-a834-bdc5e6f38cad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:19.772450 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-74202379-9329-4327-a834-bdc5e6f38cad tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1226 microversion: 2.1 time: 0.183762 Jan 22 21:22:19.773614 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3183/6647] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:19 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1226 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:22:19.789212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0bd427ec-a163-4952-9bc3-15bfaa7b7d73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:19.789647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0bd427ec-a163-4952-9bc3-15bfaa7b7d73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:19.800198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0bd427ec-a163-4952-9bc3-15bfaa7b7d73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:19.801031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0bd427ec-a163-4952-9bc3-15bfaa7b7d73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:19.802339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0bd427ec-a163-4952-9bc3-15bfaa7b7d73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:19.823629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0bd427ec-a163-4952-9bc3-15bfaa7b7d73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:19.893516 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0bd427ec-a163-4952-9bc3-15bfaa7b7d73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.118219 Jan 22 21:22:19.913180 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3184/6648] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:19 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:20.037756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-18555610-13ff-4d42-b567-f33897acbe4c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:20.048883 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-18555610-13ff-4d42-b567-f33897acbe4c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1393 microversion: 2.1 time: 0.630527 Jan 22 21:22:20.060361 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3465/6649] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:19 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1393 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:20.188739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7986b978-ae89-4dc9-a25d-9dcdbd2af20b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:20.189452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7986b978-ae89-4dc9-a25d-9dcdbd2af20b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:20.205963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7986b978-ae89-4dc9-a25d-9dcdbd2af20b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:20.207695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7986b978-ae89-4dc9-a25d-9dcdbd2af20b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:20.208939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7986b978-ae89-4dc9-a25d-9dcdbd2af20b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:20.213715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7986b978-ae89-4dc9-a25d-9dcdbd2af20b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:20.657543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7986b978-ae89-4dc9-a25d-9dcdbd2af20b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:20.679038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7986b978-ae89-4dc9-a25d-9dcdbd2af20b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:20.680813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7986b978-ae89-4dc9-a25d-9dcdbd2af20b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:20.682912 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7986b978-ae89-4dc9-a25d-9dcdbd2af20b tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1745 microversion: 2.20 time: 0.497842 Jan 22 21:22:20.710578 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3185/6650] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:20 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1745 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:20.800104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eaa2104b-01b5-4704-a7d2-f150cb951cc5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:20.800969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eaa2104b-01b5-4704-a7d2-f150cb951cc5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:20.810726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eaa2104b-01b5-4704-a7d2-f150cb951cc5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:20.811454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eaa2104b-01b5-4704-a7d2-f150cb951cc5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:20.813055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eaa2104b-01b5-4704-a7d2-f150cb951cc5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:20.813734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eaa2104b-01b5-4704-a7d2-f150cb951cc5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:20.925989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bf8330b5-a992-44dc-9400-a7c442593510 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:20.925989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bf8330b5-a992-44dc-9400-a7c442593510 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:20.945220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf8330b5-a992-44dc-9400-a7c442593510 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:20.945996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf8330b5-a992-44dc-9400-a7c442593510 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:20.948852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf8330b5-a992-44dc-9400-a7c442593510 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:20.950537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf8330b5-a992-44dc-9400-a7c442593510 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:21.028156 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bf8330b5-a992-44dc-9400-a7c442593510 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.112278 Jan 22 21:22:21.032181 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3186/6651] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:20 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:22:21.077859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2c40d94a-e0a3-4f5c-b6aa-ec52f42968de tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:21.077859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2c40d94a-e0a3-4f5c-b6aa-ec52f42968de tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:21.087307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-eaa2104b-01b5-4704-a7d2-f150cb951cc5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:21.099056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c40d94a-e0a3-4f5c-b6aa-ec52f42968de tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:21.099521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c40d94a-e0a3-4f5c-b6aa-ec52f42968de tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:21.104406 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eaa2104b-01b5-4704-a7d2-f150cb951cc5 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1282 microversion: 2.1 time: 0.314631 Jan 22 21:22:21.107361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c40d94a-e0a3-4f5c-b6aa-ec52f42968de tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:21.107361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c40d94a-e0a3-4f5c-b6aa-ec52f42968de tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:21.107571 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3466/6652] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:20 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1282 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:21.705613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aa73c3d6-0b24-491a-b955-4c462b86b62c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:21.707167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aa73c3d6-0b24-491a-b955-4c462b86b62c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:21.713996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa73c3d6-0b24-491a-b955-4c462b86b62c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:21.714753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa73c3d6-0b24-491a-b955-4c462b86b62c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:21.716048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa73c3d6-0b24-491a-b955-4c462b86b62c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:21.716722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa73c3d6-0b24-491a-b955-4c462b86b62c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:21.722052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2c40d94a-e0a3-4f5c-b6aa-ec52f42968de tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:21.738972 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2c40d94a-e0a3-4f5c-b6aa-ec52f42968de tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1393 microversion: 2.1 time: 0.674425 Jan 22 21:22:21.741475 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3187/6653] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:21 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1393 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:22:22.040818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3e0deab6-fffd-4bd7-a435-34e9fc6023dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:22.042696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3e0deab6-fffd-4bd7-a435-34e9fc6023dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:22.060219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e0deab6-fffd-4bd7-a435-34e9fc6023dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:22.060769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e0deab6-fffd-4bd7-a435-34e9fc6023dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:22.062809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e0deab6-fffd-4bd7-a435-34e9fc6023dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:22.064110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e0deab6-fffd-4bd7-a435-34e9fc6023dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:22.140490 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3e0deab6-fffd-4bd7-a435-34e9fc6023dc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.104035 Jan 22 21:22:22.141661 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3188/6654] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:22 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:22.149791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b1eb79dd-4bcf-46c2-bbb3-affe68642372 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:22.160482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b1eb79dd-4bcf-46c2-bbb3-affe68642372 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:22.171994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1eb79dd-4bcf-46c2-bbb3-affe68642372 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:22.173077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1eb79dd-4bcf-46c2-bbb3-affe68642372 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:22.174142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1eb79dd-4bcf-46c2-bbb3-affe68642372 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:22.175446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1eb79dd-4bcf-46c2-bbb3-affe68642372 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:22.315019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aa73c3d6-0b24-491a-b955-4c462b86b62c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:22.326582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aa73c3d6-0b24-491a-b955-4c462b86b62c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:22.328409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aa73c3d6-0b24-491a-b955-4c462b86b62c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:22.330660 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aa73c3d6-0b24-491a-b955-4c462b86b62c tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1727 microversion: 2.20 time: 0.628302 Jan 22 21:22:22.332878 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3467/6655] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:21 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1727 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:22:22.425814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b1eb79dd-4bcf-46c2-bbb3-affe68642372 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:22.435838 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b1eb79dd-4bcf-46c2-bbb3-affe68642372 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1280 microversion: 2.1 time: 0.292864 Jan 22 21:22:22.437150 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3189/6656] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:22 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1280 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:22.766102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ebc931f6-b75f-4256-9410-04c851dc7e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:22.770340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ebc931f6-b75f-4256-9410-04c851dc7e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:22.803824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebc931f6-b75f-4256-9410-04c851dc7e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:22.804608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebc931f6-b75f-4256-9410-04c851dc7e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:22.806724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebc931f6-b75f-4256-9410-04c851dc7e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:22.808037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebc931f6-b75f-4256-9410-04c851dc7e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:23.152830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-73afc479-f438-48ab-940b-89d5950f0081 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:23.153797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-73afc479-f438-48ab-940b-89d5950f0081 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:23.160819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73afc479-f438-48ab-940b-89d5950f0081 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:23.161289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73afc479-f438-48ab-940b-89d5950f0081 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:23.177289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73afc479-f438-48ab-940b-89d5950f0081 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:23.177978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73afc479-f438-48ab-940b-89d5950f0081 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:23.234497 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-73afc479-f438-48ab-940b-89d5950f0081 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.084924 Jan 22 21:22:23.242386 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3190/6657] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:23 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:23.351341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4e284f21-c046-454e-9fbd-7cc792ec2580 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:23.353040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4e284f21-c046-454e-9fbd-7cc792ec2580 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:23.363968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e284f21-c046-454e-9fbd-7cc792ec2580 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:23.364733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e284f21-c046-454e-9fbd-7cc792ec2580 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:23.366883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e284f21-c046-454e-9fbd-7cc792ec2580 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:23.367539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e284f21-c046-454e-9fbd-7cc792ec2580 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:23.399865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ebc931f6-b75f-4256-9410-04c851dc7e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:23.418252 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ebc931f6-b75f-4256-9410-04c851dc7e83 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1393 microversion: 2.1 time: 0.660401 Jan 22 21:22:23.419469 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3468/6658] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:22 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1393 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:23.466527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d60f031e-1dbd-48df-bdcb-aa6c1a3e92cd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:23.467158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d60f031e-1dbd-48df-bdcb-aa6c1a3e92cd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:23.473899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d60f031e-1dbd-48df-bdcb-aa6c1a3e92cd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:23.474353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d60f031e-1dbd-48df-bdcb-aa6c1a3e92cd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:23.475157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d60f031e-1dbd-48df-bdcb-aa6c1a3e92cd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:23.478080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d60f031e-1dbd-48df-bdcb-aa6c1a3e92cd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:23.777351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4e284f21-c046-454e-9fbd-7cc792ec2580 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:23.797899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4e284f21-c046-454e-9fbd-7cc792ec2580 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:23.797899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4e284f21-c046-454e-9fbd-7cc792ec2580 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:23.797899 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4e284f21-c046-454e-9fbd-7cc792ec2580 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1727 microversion: 2.20 time: 0.450453 Jan 22 21:22:23.799169 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3191/6659] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:23 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1727 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:22:24.144803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d60f031e-1dbd-48df-bdcb-aa6c1a3e92cd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:24.152740 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d60f031e-1dbd-48df-bdcb-aa6c1a3e92cd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1322 microversion: 2.1 time: 0.701755 Jan 22 21:22:24.153337 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3469/6660] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:23 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1322 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:22:24.248883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e7260fe7-f1b3-42f0-aa4e-57c6fa1ac7ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:24.251291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e7260fe7-f1b3-42f0-aa4e-57c6fa1ac7ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:24.254817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-c17d7271-257c-4ea0-8539-042feb8743d2 req-3cd1d74f-c11c-41a8-a049-856748d6eb87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89583718-5186-41d5-b5f3-ad8997c3eb59", "name": "network-vif-unplugged", "status": "completed", "tag": "f3926427-e4b0-4ea7-846d-98fa049e0b27"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:24.256520 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:22:24.256520 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:22:24.263842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7260fe7-f1b3-42f0-aa4e-57c6fa1ac7ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:24.264598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7260fe7-f1b3-42f0-aa4e-57c6fa1ac7ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:24.265662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7260fe7-f1b3-42f0-aa4e-57c6fa1ac7ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:24.267911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7260fe7-f1b3-42f0-aa4e-57c6fa1ac7ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:24.275037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c17d7271-257c-4ea0-8539-042feb8743d2 req-3cd1d74f-c11c-41a8-a049-856748d6eb87 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:24.275037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c17d7271-257c-4ea0-8539-042feb8743d2 req-3cd1d74f-c11c-41a8-a049-856748d6eb87 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:24.296696 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-c17d7271-257c-4ea0-8539-042feb8743d2 req-3cd1d74f-c11c-41a8-a049-856748d6eb87 service nova] Creating event network-vif-unplugged:f3926427-e4b0-4ea7-846d-98fa049e0b27 for instance 89583718-5186-41d5-b5f3-ad8997c3eb59 on nch2-master-1 Jan 22 21:22:24.303676 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-c17d7271-257c-4ea0-8539-042feb8743d2 req-3cd1d74f-c11c-41a8-a049-856748d6eb87 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052673 Jan 22 21:22:24.304912 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3470/6661] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:22:24.354146 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e7260fe7-f1b3-42f0-aa4e-57c6fa1ac7ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.108788 Jan 22 21:22:24.367702 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3192/6662] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:24 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:24.443899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0db01aac-01b4-41f5-8621-e780c3adf982 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:24.446478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0db01aac-01b4-41f5-8621-e780c3adf982 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:24.458125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0db01aac-01b4-41f5-8621-e780c3adf982 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:24.459082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0db01aac-01b4-41f5-8621-e780c3adf982 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:24.460703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0db01aac-01b4-41f5-8621-e780c3adf982 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:24.461366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0db01aac-01b4-41f5-8621-e780c3adf982 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:24.819726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-280d3f92-7b62-44f2-b352-4e3efcd271da tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:24.827049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-280d3f92-7b62-44f2-b352-4e3efcd271da tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:24.844942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-280d3f92-7b62-44f2-b352-4e3efcd271da tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:24.845422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-280d3f92-7b62-44f2-b352-4e3efcd271da tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:24.847770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-280d3f92-7b62-44f2-b352-4e3efcd271da tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:24.848247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-280d3f92-7b62-44f2-b352-4e3efcd271da tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:25.004802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0db01aac-01b4-41f5-8621-e780c3adf982 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:25.021230 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0db01aac-01b4-41f5-8621-e780c3adf982 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1393 microversion: 2.1 time: 0.587974 Jan 22 21:22:25.022254 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3471/6663] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:24 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1393 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:25.175408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0e15107a-69cf-40a9-9a24-436a161a6e82 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:25.175408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0e15107a-69cf-40a9-9a24-436a161a6e82 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:25.182739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e15107a-69cf-40a9-9a24-436a161a6e82 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:25.191971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e15107a-69cf-40a9-9a24-436a161a6e82 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:25.195532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e15107a-69cf-40a9-9a24-436a161a6e82 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:25.195532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e15107a-69cf-40a9-9a24-436a161a6e82 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:25.469302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-280d3f92-7b62-44f2-b352-4e3efcd271da tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:25.481888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-280d3f92-7b62-44f2-b352-4e3efcd271da tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:25.483586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-280d3f92-7b62-44f2-b352-4e3efcd271da tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:25.484911 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-280d3f92-7b62-44f2-b352-4e3efcd271da tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1670 microversion: 2.20 time: 0.671988 Jan 22 21:22:25.485580 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3193/6664] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:24 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1670 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:25.491228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-55089783-62a3-493c-a634-410d40ceefcf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:25.492456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-55089783-62a3-493c-a634-410d40ceefcf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:25.501386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55089783-62a3-493c-a634-410d40ceefcf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:25.502020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55089783-62a3-493c-a634-410d40ceefcf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:25.503997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55089783-62a3-493c-a634-410d40ceefcf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:25.504937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55089783-62a3-493c-a634-410d40ceefcf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:25.572394 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-55089783-62a3-493c-a634-410d40ceefcf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.085281 Jan 22 21:22:25.574577 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3194/6665] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:25 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:25.583375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-89e51857-b649-48c5-b768-3616c29e9ab2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:25.584795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-89e51857-b649-48c5-b768-3616c29e9ab2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:25.592557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89e51857-b649-48c5-b768-3616c29e9ab2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:25.593198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89e51857-b649-48c5-b768-3616c29e9ab2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:25.594107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89e51857-b649-48c5-b768-3616c29e9ab2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:25.594566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89e51857-b649-48c5-b768-3616c29e9ab2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:25.834385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0e15107a-69cf-40a9-9a24-436a161a6e82 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:25.852663 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0e15107a-69cf-40a9-9a24-436a161a6e82 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1322 microversion: 2.1 time: 0.677934 Jan 22 21:22:25.857096 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3472/6666] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:25 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1322 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:22:26.040407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8ea9212a-ca35-42dc-8dc0-04c432f62c47 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:26.041371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8ea9212a-ca35-42dc-8dc0-04c432f62c47 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:26.048955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea9212a-ca35-42dc-8dc0-04c432f62c47 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:26.049750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea9212a-ca35-42dc-8dc0-04c432f62c47 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:26.050718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea9212a-ca35-42dc-8dc0-04c432f62c47 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:26.051376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ea9212a-ca35-42dc-8dc0-04c432f62c47 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:26.721021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8ea9212a-ca35-42dc-8dc0-04c432f62c47 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:26.748345 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8ea9212a-ca35-42dc-8dc0-04c432f62c47 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1393 microversion: 2.1 time: 0.712856 Jan 22 21:22:26.749105 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3473/6667] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:26 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1393 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:22:26.762744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-8b6d73ba-4010-4d17-a090-2e9add38f640 req-8731b1df-3cda-4b8c-9de1-e8d889334fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12be9a2-2532-4441-94d7-1e38912ebaef", "name": "network-vif-plugged", "status": "completed", "tag": "072275f1-ea9f-46b7-8332-4cc1cf1c51f3"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:26.765715 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:22:26.765715 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:22:26.776764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8b6d73ba-4010-4d17-a090-2e9add38f640 req-8731b1df-3cda-4b8c-9de1-e8d889334fd9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:26.777486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8b6d73ba-4010-4d17-a090-2e9add38f640 req-8731b1df-3cda-4b8c-9de1-e8d889334fd9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:26.797146 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-8b6d73ba-4010-4d17-a090-2e9add38f640 req-8731b1df-3cda-4b8c-9de1-e8d889334fd9 service nova] Creating event network-vif-plugged:072275f1-ea9f-46b7-8332-4cc1cf1c51f3 for instance a12be9a2-2532-4441-94d7-1e38912ebaef on nch1-master-1 Jan 22 21:22:26.804394 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-8b6d73ba-4010-4d17-a090-2e9add38f640 req-8731b1df-3cda-4b8c-9de1-e8d889334fd9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051216 Jan 22 21:22:26.805845 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3474/6668] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:22:26.816284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0253a8db-e1ef-42f8-b596-2b822b4370ce tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:26.820659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0253a8db-e1ef-42f8-b596-2b822b4370ce tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:26.845649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0253a8db-e1ef-42f8-b596-2b822b4370ce tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:26.848130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0253a8db-e1ef-42f8-b596-2b822b4370ce tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:26.850328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0253a8db-e1ef-42f8-b596-2b822b4370ce tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:26.851606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0253a8db-e1ef-42f8-b596-2b822b4370ce tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:26.928065 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0253a8db-e1ef-42f8-b596-2b822b4370ce tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.119577 Jan 22 21:22:26.932731 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3475/6669] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:26 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:26.936703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-b80099c9-3935-4e3a-877d-c8b63b2237a4 req-f0dc7ac5-7011-4218-aa04-1ce2fb45d05d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72a8658-ab56-4cad-9ca5-9b053c3de51d", "tag": "c133c4c9-6f72-48b4-baf4-44d21a6e1364"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:26.939385 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:22:26.939385 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:22:26.948658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b80099c9-3935-4e3a-877d-c8b63b2237a4 req-f0dc7ac5-7011-4218-aa04-1ce2fb45d05d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:26.949348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b80099c9-3935-4e3a-877d-c8b63b2237a4 req-f0dc7ac5-7011-4218-aa04-1ce2fb45d05d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:26.965656 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-b80099c9-3935-4e3a-877d-c8b63b2237a4 req-f0dc7ac5-7011-4218-aa04-1ce2fb45d05d service nova] Creating event network-changed:c133c4c9-6f72-48b4-baf4-44d21a6e1364 for instance c72a8658-ab56-4cad-9ca5-9b053c3de51d on nch2-master-1 Jan 22 21:22:26.970620 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-b80099c9-3935-4e3a-877d-c8b63b2237a4 req-f0dc7ac5-7011-4218-aa04-1ce2fb45d05d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039074 Jan 22 21:22:26.971943 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3476/6670] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:22:26.982080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-14b64691-6d1a-4fb0-8b71-e59e7dccf973 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:26.983081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-14b64691-6d1a-4fb0-8b71-e59e7dccf973 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:26.991055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14b64691-6d1a-4fb0-8b71-e59e7dccf973 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:26.991775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14b64691-6d1a-4fb0-8b71-e59e7dccf973 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:26.992844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14b64691-6d1a-4fb0-8b71-e59e7dccf973 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:26.993588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-14b64691-6d1a-4fb0-8b71-e59e7dccf973 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:27.053790 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-89e51857-b649-48c5-b768-3616c29e9ab2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.476760 Jan 22 21:22:27.053790 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3195/6671] 10.222.0.100 () {62 vars in 1368 bytes} [Sat Jan 22 21:22:25 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/os-volume_attachments => generated 188 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:22:27.226009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-88a29350-197f-4c3a-b45f-b61a62bb48ef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:27.226521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-88a29350-197f-4c3a-b45f-b61a62bb48ef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:27.238244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88a29350-197f-4c3a-b45f-b61a62bb48ef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:27.238704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88a29350-197f-4c3a-b45f-b61a62bb48ef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:27.239544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88a29350-197f-4c3a-b45f-b61a62bb48ef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:27.239979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88a29350-197f-4c3a-b45f-b61a62bb48ef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:27.849372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-14b64691-6d1a-4fb0-8b71-e59e7dccf973 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:27.856844 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-14b64691-6d1a-4fb0-8b71-e59e7dccf973 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1322 microversion: 2.1 time: 0.882504 Jan 22 21:22:27.862963 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3477/6672] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:26 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1322 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:27.867721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-333b05eb-4c5a-4e45-b0d3-ffaa945da699 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:27.875142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-333b05eb-4c5a-4e45-b0d3-ffaa945da699 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:27.882673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-333b05eb-4c5a-4e45-b0d3-ffaa945da699 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:27.884452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-333b05eb-4c5a-4e45-b0d3-ffaa945da699 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:27.890688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-333b05eb-4c5a-4e45-b0d3-ffaa945da699 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:27.891552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-333b05eb-4c5a-4e45-b0d3-ffaa945da699 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:27.998856 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-88a29350-197f-4c3a-b45f-b61a62bb48ef tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "DELETE /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/os-volume_attachments/bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489" status: 202 len: 0 microversion: 2.20 time: 0.778008 Jan 22 21:22:28.000151 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3196/6673] 10.222.0.100 () {60 vars in 1461 bytes} [Sat Jan 22 21:22:27 2022] DELETE /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/os-volume_attachments/bcf9e38f-e4c1-4f42-8baf-0eeb0ff77489 => generated 0 bytes in 780 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:22:28.007793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8a9986cb-f77a-4fe4-9768-6d2287ebffdb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:28.010609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8a9986cb-f77a-4fe4-9768-6d2287ebffdb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:28.028179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a9986cb-f77a-4fe4-9768-6d2287ebffdb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:28.029836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a9986cb-f77a-4fe4-9768-6d2287ebffdb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:28.034880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a9986cb-f77a-4fe4-9768-6d2287ebffdb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:28.035654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a9986cb-f77a-4fe4-9768-6d2287ebffdb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:28.109934 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8a9986cb-f77a-4fe4-9768-6d2287ebffdb tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.104132 Jan 22 21:22:28.111294 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3197/6674] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:28 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:28.133664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c5964189-ae0d-48f2-b2bc-dd118c4fb1e6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:28.134352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c5964189-ae0d-48f2-b2bc-dd118c4fb1e6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:28.157100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5964189-ae0d-48f2-b2bc-dd118c4fb1e6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:28.157599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5964189-ae0d-48f2-b2bc-dd118c4fb1e6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:28.161589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5964189-ae0d-48f2-b2bc-dd118c4fb1e6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:28.162154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5964189-ae0d-48f2-b2bc-dd118c4fb1e6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:28.264861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-333b05eb-4c5a-4e45-b0d3-ffaa945da699 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:28.295014 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-333b05eb-4c5a-4e45-b0d3-ffaa945da699 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1393 microversion: 2.1 time: 0.427267 Jan 22 21:22:28.296539 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3478/6675] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:27 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1393 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:28.625541 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c5964189-ae0d-48f2-b2bc-dd118c4fb1e6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action" status: 202 len: 0 microversion: 2.20 time: 0.511993 Jan 22 21:22:28.631491 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3198/6676] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:28 2022] POST /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:22:28.643130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-63ad5de9-0930-41d7-a4ef-c63604e90249 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:28.644473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-63ad5de9-0930-41d7-a4ef-c63604e90249 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:28.665173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63ad5de9-0930-41d7-a4ef-c63604e90249 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:28.671321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63ad5de9-0930-41d7-a4ef-c63604e90249 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:28.671321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63ad5de9-0930-41d7-a4ef-c63604e90249 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:28.671741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63ad5de9-0930-41d7-a4ef-c63604e90249 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:28.883898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6985a459-9102-4481-9b3d-27a0c301926c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:28.885618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6985a459-9102-4481-9b3d-27a0c301926c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:28.907837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6985a459-9102-4481-9b3d-27a0c301926c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:28.912359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6985a459-9102-4481-9b3d-27a0c301926c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:28.919010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6985a459-9102-4481-9b3d-27a0c301926c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:28.923336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6985a459-9102-4481-9b3d-27a0c301926c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:29.114598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-63ad5de9-0930-41d7-a4ef-c63604e90249 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:29.131965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-63ad5de9-0930-41d7-a4ef-c63604e90249 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:29.136703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-63ad5de9-0930-41d7-a4ef-c63604e90249 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:29.138115 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-63ad5de9-0930-41d7-a4ef-c63604e90249 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1678 microversion: 2.20 time: 0.502425 Jan 22 21:22:29.142287 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3479/6677] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:28 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1678 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:29.159087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2103efde-1fd5-4691-b57f-dcf24b00cf52 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:29.160758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2103efde-1fd5-4691-b57f-dcf24b00cf52 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:29.175551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2103efde-1fd5-4691-b57f-dcf24b00cf52 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:29.179168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2103efde-1fd5-4691-b57f-dcf24b00cf52 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:29.185163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2103efde-1fd5-4691-b57f-dcf24b00cf52 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:29.186105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2103efde-1fd5-4691-b57f-dcf24b00cf52 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:29.266635 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2103efde-1fd5-4691-b57f-dcf24b00cf52 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.122427 Jan 22 21:22:29.277949 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3480/6678] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:29 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:29.316995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8da6c564-1709-4414-89e7-b8c4f5946d74 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:29.317738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8da6c564-1709-4414-89e7-b8c4f5946d74 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:29.334032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8da6c564-1709-4414-89e7-b8c4f5946d74 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:29.334760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8da6c564-1709-4414-89e7-b8c4f5946d74 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:29.335590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8da6c564-1709-4414-89e7-b8c4f5946d74 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:29.336039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8da6c564-1709-4414-89e7-b8c4f5946d74 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:29.672201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6985a459-9102-4481-9b3d-27a0c301926c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:29.683428 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6985a459-9102-4481-9b3d-27a0c301926c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1322 microversion: 2.1 time: 0.808551 Jan 22 21:22:29.686864 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3199/6679] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:28 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1322 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:30.003724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8da6c564-1709-4414-89e7-b8c4f5946d74 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:30.014899 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8da6c564-1709-4414-89e7-b8c4f5946d74 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1564 microversion: 2.1 time: 0.703249 Jan 22 21:22:30.016545 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3481/6680] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:29 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1564 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:30.035878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4867e2bc-8f09-449d-bcc7-6e3b4e1d3808 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:30.036939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4867e2bc-8f09-449d-bcc7-6e3b4e1d3808 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:30.046280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4867e2bc-8f09-449d-bcc7-6e3b4e1d3808 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:30.051057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4867e2bc-8f09-449d-bcc7-6e3b4e1d3808 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:30.052259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4867e2bc-8f09-449d-bcc7-6e3b4e1d3808 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:30.058929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4867e2bc-8f09-449d-bcc7-6e3b4e1d3808 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:30.162177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-637614fb-7f89-4aff-8090-642b5a8753ab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:30.162801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-637614fb-7f89-4aff-8090-642b5a8753ab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:30.170922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-637614fb-7f89-4aff-8090-642b5a8753ab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:30.171388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-637614fb-7f89-4aff-8090-642b5a8753ab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:30.172206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-637614fb-7f89-4aff-8090-642b5a8753ab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:30.177772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-637614fb-7f89-4aff-8090-642b5a8753ab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:30.385367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4867e2bc-8f09-449d-bcc7-6e3b4e1d3808 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:30.399594 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4867e2bc-8f09-449d-bcc7-6e3b4e1d3808 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1564 microversion: 2.1 time: 0.366715 Jan 22 21:22:30.414004 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3200/6681] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:30 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1564 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:30.442401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aa930ac5-b4c7-4d3b-bce4-581978306830 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:30.445256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aa930ac5-b4c7-4d3b-bce4-581978306830 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:30.465648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa930ac5-b4c7-4d3b-bce4-581978306830 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:30.470723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa930ac5-b4c7-4d3b-bce4-581978306830 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:30.470723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa930ac5-b4c7-4d3b-bce4-581978306830 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:30.471209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa930ac5-b4c7-4d3b-bce4-581978306830 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:30.543152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-637614fb-7f89-4aff-8090-642b5a8753ab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:30.547822 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aa930ac5-b4c7-4d3b-bce4-581978306830 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.136997 Jan 22 21:22:30.548490 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3201/6682] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:30 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:30.553775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-637614fb-7f89-4aff-8090-642b5a8753ab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:30.561018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-637614fb-7f89-4aff-8090-642b5a8753ab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:30.563218 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-637614fb-7f89-4aff-8090-642b5a8753ab tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1678 microversion: 2.20 time: 0.405715 Jan 22 21:22:30.566095 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3482/6683] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:30 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1678 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:30.717021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cc4f5509-a4ac-4f89-8eff-0ddfc51480d8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:30.718355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cc4f5509-a4ac-4f89-8eff-0ddfc51480d8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:30.741720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc4f5509-a4ac-4f89-8eff-0ddfc51480d8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:30.743938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc4f5509-a4ac-4f89-8eff-0ddfc51480d8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:30.743938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc4f5509-a4ac-4f89-8eff-0ddfc51480d8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:30.747012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc4f5509-a4ac-4f89-8eff-0ddfc51480d8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:31.088153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cc4f5509-a4ac-4f89-8eff-0ddfc51480d8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:31.134222 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cc4f5509-a4ac-4f89-8eff-0ddfc51480d8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1322 microversion: 2.1 time: 0.424734 Jan 22 21:22:31.139443 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3202/6684] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:30 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:31.561435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d4e7167e-7b5e-4bb0-a288-1469c0c5c796 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:31.562482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d4e7167e-7b5e-4bb0-a288-1469c0c5c796 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:31.581098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4e7167e-7b5e-4bb0-a288-1469c0c5c796 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:31.581821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4e7167e-7b5e-4bb0-a288-1469c0c5c796 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:31.582800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4e7167e-7b5e-4bb0-a288-1469c0c5c796 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:31.585256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4e7167e-7b5e-4bb0-a288-1469c0c5c796 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:31.596678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d0b2c5ca-f591-4a87-a83e-c9b28186e722 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:31.596678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d0b2c5ca-f591-4a87-a83e-c9b28186e722 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:31.632126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0b2c5ca-f591-4a87-a83e-c9b28186e722 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:31.632588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0b2c5ca-f591-4a87-a83e-c9b28186e722 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:31.642503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0b2c5ca-f591-4a87-a83e-c9b28186e722 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:31.644446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0b2c5ca-f591-4a87-a83e-c9b28186e722 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:31.650053 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d4e7167e-7b5e-4bb0-a288-1469c0c5c796 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.092604 Jan 22 21:22:31.654128 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3483/6685] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:31 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:32.157072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8a7ff4b6-10d7-4142-acaa-02a2be8b08c2 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:32.158170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8a7ff4b6-10d7-4142-acaa-02a2be8b08c2 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:32.175314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a7ff4b6-10d7-4142-acaa-02a2be8b08c2 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:32.176788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a7ff4b6-10d7-4142-acaa-02a2be8b08c2 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:32.184321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a7ff4b6-10d7-4142-acaa-02a2be8b08c2 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:32.188106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a7ff4b6-10d7-4142-acaa-02a2be8b08c2 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:32.226987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d0b2c5ca-f591-4a87-a83e-c9b28186e722 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:32.236048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d0b2c5ca-f591-4a87-a83e-c9b28186e722 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:32.238405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d0b2c5ca-f591-4a87-a83e-c9b28186e722 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:32.239651 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d0b2c5ca-f591-4a87-a83e-c9b28186e722 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1680 microversion: 2.20 time: 0.659332 Jan 22 21:22:32.258649 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3203/6686] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:31 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1680 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:32.664449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b8cf153-ae00-4f9a-b6a7-146b07e8d1a7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:32.666117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4b8cf153-ae00-4f9a-b6a7-146b07e8d1a7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:32.676303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b8cf153-ae00-4f9a-b6a7-146b07e8d1a7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:32.678057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b8cf153-ae00-4f9a-b6a7-146b07e8d1a7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:32.679345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b8cf153-ae00-4f9a-b6a7-146b07e8d1a7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:32.679973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b8cf153-ae00-4f9a-b6a7-146b07e8d1a7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:32.762739 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b8cf153-ae00-4f9a-b6a7-146b07e8d1a7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.103727 Jan 22 21:22:32.764675 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3204/6687] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:32 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:22:32.945001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8a7ff4b6-10d7-4142-acaa-02a2be8b08c2 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:32.954309 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8a7ff4b6-10d7-4142-acaa-02a2be8b08c2 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1322 microversion: 2.1 time: 0.802724 Jan 22 21:22:32.955203 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3484/6688] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:32 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1322 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:22:33.285344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-915eac0b-4455-438c-abd2-667e2f673a9d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:33.287438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-915eac0b-4455-438c-abd2-667e2f673a9d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:33.309752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-915eac0b-4455-438c-abd2-667e2f673a9d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:33.310228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-915eac0b-4455-438c-abd2-667e2f673a9d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:33.313534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-915eac0b-4455-438c-abd2-667e2f673a9d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:33.316301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-915eac0b-4455-438c-abd2-667e2f673a9d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:33.780173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-056e2aac-2ad1-47cd-8e5e-d15df4c7367d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:33.781169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-056e2aac-2ad1-47cd-8e5e-d15df4c7367d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:33.808137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-056e2aac-2ad1-47cd-8e5e-d15df4c7367d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:33.809411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-056e2aac-2ad1-47cd-8e5e-d15df4c7367d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:33.815529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-056e2aac-2ad1-47cd-8e5e-d15df4c7367d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:33.815529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-056e2aac-2ad1-47cd-8e5e-d15df4c7367d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:33.962664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-915eac0b-4455-438c-abd2-667e2f673a9d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:33.963414 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-056e2aac-2ad1-47cd-8e5e-d15df4c7367d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.174797 Jan 22 21:22:33.963414 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3485/6689] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:33 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:22:33.963835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-915eac0b-4455-438c-abd2-667e2f673a9d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:33.963835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-915eac0b-4455-438c-abd2-667e2f673a9d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:33.973946 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-915eac0b-4455-438c-abd2-667e2f673a9d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 0.696118 Jan 22 21:22:33.975640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9fba26f6-a80e-4c73-9eec-f1a7d2696eef tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:33.984743 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3205/6690] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:33 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:33.985187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9fba26f6-a80e-4c73-9eec-f1a7d2696eef tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:33.996010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fba26f6-a80e-4c73-9eec-f1a7d2696eef tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:33.997623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fba26f6-a80e-4c73-9eec-f1a7d2696eef tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:33.998465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fba26f6-a80e-4c73-9eec-f1a7d2696eef tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:33.998926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fba26f6-a80e-4c73-9eec-f1a7d2696eef tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:34.170508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9fba26f6-a80e-4c73-9eec-f1a7d2696eef tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:34.180922 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9fba26f6-a80e-4c73-9eec-f1a7d2696eef tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1322 microversion: 2.1 time: 0.212361 Jan 22 21:22:34.181539 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3486/6691] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:33 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:34.637626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-dccb30f1-c8cc-46be-9481-217888e90d48 req-ada766bc-0932-406c-9800-27e000c631c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72a8658-ab56-4cad-9ca5-9b053c3de51d", "name": "network-vif-plugged", "status": "completed", "tag": "c133c4c9-6f72-48b4-baf4-44d21a6e1364"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:34.640871 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:22:34.640871 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:22:34.655913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-dccb30f1-c8cc-46be-9481-217888e90d48 req-ada766bc-0932-406c-9800-27e000c631c9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:34.656827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-dccb30f1-c8cc-46be-9481-217888e90d48 req-ada766bc-0932-406c-9800-27e000c631c9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:34.674394 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-dccb30f1-c8cc-46be-9481-217888e90d48 req-ada766bc-0932-406c-9800-27e000c631c9 service nova] Creating event network-vif-plugged:c133c4c9-6f72-48b4-baf4-44d21a6e1364 for instance c72a8658-ab56-4cad-9ca5-9b053c3de51d on nch2-master-1 Jan 22 21:22:34.684710 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-dccb30f1-c8cc-46be-9481-217888e90d48 req-ada766bc-0932-406c-9800-27e000c631c9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054772 Jan 22 21:22:34.686099 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3206/6692] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:22:34.964275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-59225a06-8657-47e9-a336-359da1bd8d0a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:34.965210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-59225a06-8657-47e9-a336-359da1bd8d0a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:34.983246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59225a06-8657-47e9-a336-359da1bd8d0a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:34.986091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59225a06-8657-47e9-a336-359da1bd8d0a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:34.988163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59225a06-8657-47e9-a336-359da1bd8d0a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:34.988730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59225a06-8657-47e9-a336-359da1bd8d0a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:34.996882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-56c8b997-64dd-4ff4-8603-bac90ac990c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:34.997820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-56c8b997-64dd-4ff4-8603-bac90ac990c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:35.007012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56c8b997-64dd-4ff4-8603-bac90ac990c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:35.012783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56c8b997-64dd-4ff4-8603-bac90ac990c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:35.012783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56c8b997-64dd-4ff4-8603-bac90ac990c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:35.012783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56c8b997-64dd-4ff4-8603-bac90ac990c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:35.051544 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-59225a06-8657-47e9-a336-359da1bd8d0a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.092000 Jan 22 21:22:35.055599 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3487/6693] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:34 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:35.137268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-c6b5d411-bb67-4722-bf2b-9a47473bb7ab req-0361a204-1453-44df-a094-a811b780b6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89583718-5186-41d5-b5f3-ad8997c3eb59", "tag": "f3926427-e4b0-4ea7-846d-98fa049e0b27"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:35.139716 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:22:35.139716 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:22:35.149882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c6b5d411-bb67-4722-bf2b-9a47473bb7ab req-0361a204-1453-44df-a094-a811b780b6c8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:35.152685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c6b5d411-bb67-4722-bf2b-9a47473bb7ab req-0361a204-1453-44df-a094-a811b780b6c8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:35.165919 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-c6b5d411-bb67-4722-bf2b-9a47473bb7ab req-0361a204-1453-44df-a094-a811b780b6c8 service nova] Creating event network-changed:f3926427-e4b0-4ea7-846d-98fa049e0b27 for instance 89583718-5186-41d5-b5f3-ad8997c3eb59 on nch1-master-1 Jan 22 21:22:35.171354 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-c6b5d411-bb67-4722-bf2b-9a47473bb7ab req-0361a204-1453-44df-a094-a811b780b6c8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038542 Jan 22 21:22:35.172015 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3488/6694] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:22:35.212576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ba2586f5-2695-44a6-9e45-580277bf4d6a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:35.213496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ba2586f5-2695-44a6-9e45-580277bf4d6a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:35.223309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba2586f5-2695-44a6-9e45-580277bf4d6a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:35.223770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba2586f5-2695-44a6-9e45-580277bf4d6a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:35.224582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba2586f5-2695-44a6-9e45-580277bf4d6a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:35.225716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba2586f5-2695-44a6-9e45-580277bf4d6a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:35.574470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ba2586f5-2695-44a6-9e45-580277bf4d6a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:35.587379 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ba2586f5-2695-44a6-9e45-580277bf4d6a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1322 microversion: 2.1 time: 0.387703 Jan 22 21:22:35.591846 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3489/6695] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:35 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:35.616287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1da09bba-c0af-4044-9a25-fd5fd9cbc3bf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:35.617965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1da09bba-c0af-4044-9a25-fd5fd9cbc3bf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:35.625888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1da09bba-c0af-4044-9a25-fd5fd9cbc3bf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:35.626701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1da09bba-c0af-4044-9a25-fd5fd9cbc3bf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:35.629218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1da09bba-c0af-4044-9a25-fd5fd9cbc3bf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:35.630100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1da09bba-c0af-4044-9a25-fd5fd9cbc3bf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:35.938047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1da09bba-c0af-4044-9a25-fd5fd9cbc3bf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:35.946622 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1da09bba-c0af-4044-9a25-fd5fd9cbc3bf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1564 microversion: 2.1 time: 0.353451 Jan 22 21:22:35.958046 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3490/6696] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:35 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1564 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:35.965046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-d7f020b7-4abb-4698-b480-6241885cdd5c req-e8ab4d06-eb2a-439d-8648-bf844bbb2138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12be9a2-2532-4441-94d7-1e38912ebaef", "tag": "072275f1-ea9f-46b7-8332-4cc1cf1c51f3"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:35.967329 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:22:35.967329 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:22:35.976039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d7f020b7-4abb-4698-b480-6241885cdd5c req-e8ab4d06-eb2a-439d-8648-bf844bbb2138 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:35.976830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d7f020b7-4abb-4698-b480-6241885cdd5c req-e8ab4d06-eb2a-439d-8648-bf844bbb2138 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:35.990705 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d7f020b7-4abb-4698-b480-6241885cdd5c req-e8ab4d06-eb2a-439d-8648-bf844bbb2138 service nova] Creating event network-changed:072275f1-ea9f-46b7-8332-4cc1cf1c51f3 for instance a12be9a2-2532-4441-94d7-1e38912ebaef on nch1-master-1 Jan 22 21:22:35.997944 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-d7f020b7-4abb-4698-b480-6241885cdd5c req-e8ab4d06-eb2a-439d-8648-bf844bbb2138 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037585 Jan 22 21:22:35.999278 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3491/6697] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:22:36.000944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-56c8b997-64dd-4ff4-8603-bac90ac990c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:36.012913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-56c8b997-64dd-4ff4-8603-bac90ac990c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:36.015110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-56c8b997-64dd-4ff4-8603-bac90ac990c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:36.016499 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-56c8b997-64dd-4ff4-8603-bac90ac990c8 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 1.024441 Jan 22 21:22:36.029951 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3207/6698] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:34 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:22:36.063283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a7cf94d3-a75c-4d38-aeaf-816a3850cf10 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:36.065097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a7cf94d3-a75c-4d38-aeaf-816a3850cf10 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:36.085126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7cf94d3-a75c-4d38-aeaf-816a3850cf10 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:36.085407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7cf94d3-a75c-4d38-aeaf-816a3850cf10 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:36.086255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7cf94d3-a75c-4d38-aeaf-816a3850cf10 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:36.086757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7cf94d3-a75c-4d38-aeaf-816a3850cf10 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:36.139179 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a7cf94d3-a75c-4d38-aeaf-816a3850cf10 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.079783 Jan 22 21:22:36.142433 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3492/6699] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:36 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:36.607363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5fe468a9-fdd3-4dfa-b6b0-ad917af0d2a0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:36.608215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5fe468a9-fdd3-4dfa-b6b0-ad917af0d2a0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:36.619412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fe468a9-fdd3-4dfa-b6b0-ad917af0d2a0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:36.620148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fe468a9-fdd3-4dfa-b6b0-ad917af0d2a0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:36.621142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fe468a9-fdd3-4dfa-b6b0-ad917af0d2a0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:36.621776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fe468a9-fdd3-4dfa-b6b0-ad917af0d2a0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:37.037146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0777cf82-847b-4235-a4b7-65e8b6ba7324 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:37.037891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0777cf82-847b-4235-a4b7-65e8b6ba7324 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:37.055907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0777cf82-847b-4235-a4b7-65e8b6ba7324 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:37.056376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0777cf82-847b-4235-a4b7-65e8b6ba7324 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:37.057204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0777cf82-847b-4235-a4b7-65e8b6ba7324 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:37.057682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0777cf82-847b-4235-a4b7-65e8b6ba7324 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:37.215583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5fe468a9-fdd3-4dfa-b6b0-ad917af0d2a0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:37.229337 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5fe468a9-fdd3-4dfa-b6b0-ad917af0d2a0 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1322 microversion: 2.1 time: 0.625606 Jan 22 21:22:37.231092 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3208/6700] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:36 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1322 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:37.242286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bcc8a85b-9be2-4e3d-a12f-9facd25ce2b8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:37.247894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bcc8a85b-9be2-4e3d-a12f-9facd25ce2b8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:37.253898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcc8a85b-9be2-4e3d-a12f-9facd25ce2b8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:37.256785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcc8a85b-9be2-4e3d-a12f-9facd25ce2b8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:37.258354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcc8a85b-9be2-4e3d-a12f-9facd25ce2b8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:37.259092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcc8a85b-9be2-4e3d-a12f-9facd25ce2b8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:37.387965 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bcc8a85b-9be2-4e3d-a12f-9facd25ce2b8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.141567 Jan 22 21:22:37.390734 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3209/6701] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:37 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:37.759645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0777cf82-847b-4235-a4b7-65e8b6ba7324 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:37.772165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0777cf82-847b-4235-a4b7-65e8b6ba7324 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:37.776472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0777cf82-847b-4235-a4b7-65e8b6ba7324 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:37.781686 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0777cf82-847b-4235-a4b7-65e8b6ba7324 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 0.746876 Jan 22 21:22:37.781686 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3493/6702] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:37 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:22:38.248995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f8ce4a87-9039-4a5e-a928-ff5bc1b97688 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:38.249750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f8ce4a87-9039-4a5e-a928-ff5bc1b97688 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:38.275672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8ce4a87-9039-4a5e-a928-ff5bc1b97688 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:38.278821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8ce4a87-9039-4a5e-a928-ff5bc1b97688 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:38.282192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8ce4a87-9039-4a5e-a928-ff5bc1b97688 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:38.282192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8ce4a87-9039-4a5e-a928-ff5bc1b97688 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:38.401561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dcbab141-b556-42dc-8530-12342877fd41 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:38.403270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dcbab141-b556-42dc-8530-12342877fd41 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:38.420653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dcbab141-b556-42dc-8530-12342877fd41 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:38.421370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dcbab141-b556-42dc-8530-12342877fd41 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:38.431565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dcbab141-b556-42dc-8530-12342877fd41 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:38.432394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dcbab141-b556-42dc-8530-12342877fd41 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:38.530988 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dcbab141-b556-42dc-8530-12342877fd41 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.134259 Jan 22 21:22:38.532344 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3494/6703] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:38 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:38.799860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-75836961-400b-4b73-a16b-8e1a504ee4cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:38.800550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-75836961-400b-4b73-a16b-8e1a504ee4cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:38.817168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75836961-400b-4b73-a16b-8e1a504ee4cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:38.820718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75836961-400b-4b73-a16b-8e1a504ee4cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:38.820718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75836961-400b-4b73-a16b-8e1a504ee4cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:38.827250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75836961-400b-4b73-a16b-8e1a504ee4cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:39.059481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f8ce4a87-9039-4a5e-a928-ff5bc1b97688 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:39.068488 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f8ce4a87-9039-4a5e-a928-ff5bc1b97688 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1512 microversion: 2.1 time: 0.824172 Jan 22 21:22:39.085871 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3210/6704] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:38 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1512 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:39.202068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-75836961-400b-4b73-a16b-8e1a504ee4cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:39.223096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-75836961-400b-4b73-a16b-8e1a504ee4cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:39.229229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-75836961-400b-4b73-a16b-8e1a504ee4cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:39.230782 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-75836961-400b-4b73-a16b-8e1a504ee4cd tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 0.435480 Jan 22 21:22:39.236988 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3495/6705] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:38 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:39.544038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3e1938c8-16fd-4003-92b4-8086e79e0086 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:39.544975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3e1938c8-16fd-4003-92b4-8086e79e0086 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:39.562620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e1938c8-16fd-4003-92b4-8086e79e0086 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:39.562620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e1938c8-16fd-4003-92b4-8086e79e0086 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:39.562620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e1938c8-16fd-4003-92b4-8086e79e0086 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:39.562620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e1938c8-16fd-4003-92b4-8086e79e0086 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:39.667539 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3e1938c8-16fd-4003-92b4-8086e79e0086 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.127172 Jan 22 21:22:39.668853 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3211/6706] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:39 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:22:40.256451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e3bf8fbd-0e75-41bd-8f60-7e602dee28fe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:40.259140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e3bf8fbd-0e75-41bd-8f60-7e602dee28fe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:40.299977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3bf8fbd-0e75-41bd-8f60-7e602dee28fe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:40.300503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3bf8fbd-0e75-41bd-8f60-7e602dee28fe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:40.301661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3bf8fbd-0e75-41bd-8f60-7e602dee28fe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:40.302118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3bf8fbd-0e75-41bd-8f60-7e602dee28fe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:40.680760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-713ef61e-9cf2-4bba-8736-44eafc8ba822 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:40.683270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-713ef61e-9cf2-4bba-8736-44eafc8ba822 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:40.699513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-713ef61e-9cf2-4bba-8736-44eafc8ba822 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:40.700925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-713ef61e-9cf2-4bba-8736-44eafc8ba822 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:40.707273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-713ef61e-9cf2-4bba-8736-44eafc8ba822 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:40.707273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-713ef61e-9cf2-4bba-8736-44eafc8ba822 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:40.743053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e3bf8fbd-0e75-41bd-8f60-7e602dee28fe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:40.753075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e3bf8fbd-0e75-41bd-8f60-7e602dee28fe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:40.764910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e3bf8fbd-0e75-41bd-8f60-7e602dee28fe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:40.767061 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e3bf8fbd-0e75-41bd-8f60-7e602dee28fe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 0.516508 Jan 22 21:22:40.768434 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3496/6707] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:40 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:40.863378 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-713ef61e-9cf2-4bba-8736-44eafc8ba822 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.186405 Jan 22 21:22:40.864209 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3212/6708] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:40 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:41.789187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-82d57558-764c-49a7-b88b-f839d5144828 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:41.790500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-82d57558-764c-49a7-b88b-f839d5144828 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:41.812754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82d57558-764c-49a7-b88b-f839d5144828 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:41.814026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82d57558-764c-49a7-b88b-f839d5144828 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:41.815651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82d57558-764c-49a7-b88b-f839d5144828 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:41.816270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82d57558-764c-49a7-b88b-f839d5144828 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:41.878269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-90ff2098-a3e6-451c-b000-8a251533eb32 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:41.879312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-90ff2098-a3e6-451c-b000-8a251533eb32 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:41.896160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90ff2098-a3e6-451c-b000-8a251533eb32 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:41.896632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90ff2098-a3e6-451c-b000-8a251533eb32 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:41.897455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90ff2098-a3e6-451c-b000-8a251533eb32 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:41.902103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90ff2098-a3e6-451c-b000-8a251533eb32 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:42.022585 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-90ff2098-a3e6-451c-b000-8a251533eb32 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.151111 Jan 22 21:22:42.023695 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3213/6709] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:41 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:42.207648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ae7371a-e5d4-48a0-9ac3-3075cc9ab92a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62156b55-9cd2-42c5-94d9-6b135ebd45d1"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:42.208817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ae7371a-e5d4-48a0-9ac3-3075cc9ab92a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:42.217820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ae7371a-e5d4-48a0-9ac3-3075cc9ab92a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:42.225835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ae7371a-e5d4-48a0-9ac3-3075cc9ab92a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:42.225835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ae7371a-e5d4-48a0-9ac3-3075cc9ab92a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:42.225835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ae7371a-e5d4-48a0-9ac3-3075cc9ab92a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:42.598676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-82d57558-764c-49a7-b88b-f839d5144828 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:42.615910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-82d57558-764c-49a7-b88b-f839d5144828 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:42.620168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-82d57558-764c-49a7-b88b-f839d5144828 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:42.632990 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-82d57558-764c-49a7-b88b-f839d5144828 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 0.848843 Jan 22 21:22:42.637203 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3497/6710] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:41 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:43.035499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-548a8692-95a4-45a0-b0a2-52e71d105172 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:43.036449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-548a8692-95a4-45a0-b0a2-52e71d105172 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:43.048279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-548a8692-95a4-45a0-b0a2-52e71d105172 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:43.048945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-548a8692-95a4-45a0-b0a2-52e71d105172 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:43.049801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-548a8692-95a4-45a0-b0a2-52e71d105172 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:43.081435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-548a8692-95a4-45a0-b0a2-52e71d105172 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:43.164010 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-548a8692-95a4-45a0-b0a2-52e71d105172 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.132718 Jan 22 21:22:43.165629 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3498/6711] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:43 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:43.357131 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ae7371a-e5d4-48a0-9ac3-3075cc9ab92a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "POST /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.154490 Jan 22 21:22:43.358782 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3214/6712] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:22:42 2022] POST /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d/os-volume_attachments => generated 194 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:22:43.652860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d833245a-c859-42bd-9395-c74d7940ee25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:43.653515 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d833245a-c859-42bd-9395-c74d7940ee25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:43.671681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d833245a-c859-42bd-9395-c74d7940ee25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:43.671681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d833245a-c859-42bd-9395-c74d7940ee25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:43.679541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d833245a-c859-42bd-9395-c74d7940ee25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:43.679541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d833245a-c859-42bd-9395-c74d7940ee25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:44.177459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee29defb-bdf6-4a6e-8033-7ffaf056d438 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:44.178805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ee29defb-bdf6-4a6e-8033-7ffaf056d438 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:44.203580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee29defb-bdf6-4a6e-8033-7ffaf056d438 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:44.203580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee29defb-bdf6-4a6e-8033-7ffaf056d438 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:44.204132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee29defb-bdf6-4a6e-8033-7ffaf056d438 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:44.204579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee29defb-bdf6-4a6e-8033-7ffaf056d438 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:44.301431 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee29defb-bdf6-4a6e-8033-7ffaf056d438 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.128172 Jan 22 21:22:44.302544 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3215/6713] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:44 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:22:44.311956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d833245a-c859-42bd-9395-c74d7940ee25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:44.339328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d833245a-c859-42bd-9395-c74d7940ee25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:44.344341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d833245a-c859-42bd-9395-c74d7940ee25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:44.346408 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d833245a-c859-42bd-9395-c74d7940ee25 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 0.698004 Jan 22 21:22:44.347548 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3499/6714] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:43 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:45.314441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4d84ea64-a22b-4dfb-ae48-ef695d1bdc22 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:45.316732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4d84ea64-a22b-4dfb-ae48-ef695d1bdc22 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:45.335140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d84ea64-a22b-4dfb-ae48-ef695d1bdc22 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:45.335860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d84ea64-a22b-4dfb-ae48-ef695d1bdc22 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:45.339653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d84ea64-a22b-4dfb-ae48-ef695d1bdc22 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:45.339653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d84ea64-a22b-4dfb-ae48-ef695d1bdc22 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:45.365834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-11681a06-f3f2-4c48-8576-6f860a06e00d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:45.367547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-11681a06-f3f2-4c48-8576-6f860a06e00d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:45.386712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11681a06-f3f2-4c48-8576-6f860a06e00d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:45.391359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11681a06-f3f2-4c48-8576-6f860a06e00d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:45.399441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11681a06-f3f2-4c48-8576-6f860a06e00d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:45.400078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11681a06-f3f2-4c48-8576-6f860a06e00d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:45.465284 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4d84ea64-a22b-4dfb-ae48-ef695d1bdc22 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.155534 Jan 22 21:22:45.468036 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3216/6715] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:45 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:45.875600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-11681a06-f3f2-4c48-8576-6f860a06e00d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:45.886127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-11681a06-f3f2-4c48-8576-6f860a06e00d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:45.895915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-11681a06-f3f2-4c48-8576-6f860a06e00d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:45.906257 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-11681a06-f3f2-4c48-8576-6f860a06e00d tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 0.545384 Jan 22 21:22:45.915989 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3500/6716] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:45 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:22:46.483946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2653e6c7-4f0e-4d19-aad9-b1e5ea7a632f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:46.491872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2653e6c7-4f0e-4d19-aad9-b1e5ea7a632f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:46.533441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2653e6c7-4f0e-4d19-aad9-b1e5ea7a632f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:46.535393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2653e6c7-4f0e-4d19-aad9-b1e5ea7a632f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:46.536941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2653e6c7-4f0e-4d19-aad9-b1e5ea7a632f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:46.537599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2653e6c7-4f0e-4d19-aad9-b1e5ea7a632f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:46.612736 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2653e6c7-4f0e-4d19-aad9-b1e5ea7a632f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.139071 Jan 22 21:22:46.614266 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3217/6717] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:46 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:46.937824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f938a29b-03e1-4ff1-9f7e-24d448e83d38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:46.940245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f938a29b-03e1-4ff1-9f7e-24d448e83d38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:46.956556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f938a29b-03e1-4ff1-9f7e-24d448e83d38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:46.957696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f938a29b-03e1-4ff1-9f7e-24d448e83d38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:46.958933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f938a29b-03e1-4ff1-9f7e-24d448e83d38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:46.959731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f938a29b-03e1-4ff1-9f7e-24d448e83d38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:47.399241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f938a29b-03e1-4ff1-9f7e-24d448e83d38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:47.424313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f938a29b-03e1-4ff1-9f7e-24d448e83d38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:47.429004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f938a29b-03e1-4ff1-9f7e-24d448e83d38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:47.436229 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f938a29b-03e1-4ff1-9f7e-24d448e83d38 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 0.500737 Jan 22 21:22:47.450587 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3501/6718] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:46 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:47.627373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f61989d-e5e7-4356-91af-a0b740ad6505 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:47.633428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9f61989d-e5e7-4356-91af-a0b740ad6505 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:47.646596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f61989d-e5e7-4356-91af-a0b740ad6505 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:47.647940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f61989d-e5e7-4356-91af-a0b740ad6505 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:47.650302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f61989d-e5e7-4356-91af-a0b740ad6505 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:47.651077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f61989d-e5e7-4356-91af-a0b740ad6505 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:47.718700 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9f61989d-e5e7-4356-91af-a0b740ad6505 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.097150 Jan 22 21:22:47.719470 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3218/6719] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:47 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:22:48.477128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-26bdca04-a991-4dbd-9aa9-545a6a99ebf2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:48.477128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-26bdca04-a991-4dbd-9aa9-545a6a99ebf2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:48.477128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26bdca04-a991-4dbd-9aa9-545a6a99ebf2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:48.477128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26bdca04-a991-4dbd-9aa9-545a6a99ebf2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:48.477128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26bdca04-a991-4dbd-9aa9-545a6a99ebf2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:48.477128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26bdca04-a991-4dbd-9aa9-545a6a99ebf2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:48.732906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cbcf43fe-d443-4367-856d-074a65f59393 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:48.733987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cbcf43fe-d443-4367-856d-074a65f59393 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:48.749460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbcf43fe-d443-4367-856d-074a65f59393 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:48.750257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbcf43fe-d443-4367-856d-074a65f59393 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:48.757089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbcf43fe-d443-4367-856d-074a65f59393 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:48.760612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cbcf43fe-d443-4367-856d-074a65f59393 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:49.276096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-26bdca04-a991-4dbd-9aa9-545a6a99ebf2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:49.293668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-26bdca04-a991-4dbd-9aa9-545a6a99ebf2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:49.297495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-26bdca04-a991-4dbd-9aa9-545a6a99ebf2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:49.318551 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-26bdca04-a991-4dbd-9aa9-545a6a99ebf2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 0.867003 Jan 22 21:22:49.334391 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3502/6720] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:48 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:49.344446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6e35831b-bcb5-4402-aa95-48b23f219049 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62156b55-9cd2-42c5-94d9-6b135ebd45d1"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:49.345838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6e35831b-bcb5-4402-aa95-48b23f219049 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:49.379759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e35831b-bcb5-4402-aa95-48b23f219049 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:49.381990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e35831b-bcb5-4402-aa95-48b23f219049 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:49.386907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e35831b-bcb5-4402-aa95-48b23f219049 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:49.388323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e35831b-bcb5-4402-aa95-48b23f219049 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:49.415878 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cbcf43fe-d443-4367-856d-074a65f59393 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.686916 Jan 22 21:22:49.430068 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3219/6721] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:48 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:49.671925 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-6e35831b-bcb5-4402-aa95-48b23f219049 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] HTTP exception thrown: Invalid volume: volume 62156b55-9cd2-42c5-94d9-6b135ebd45d1 is already attached to instances: c72a8658-ab56-4cad-9ca5-9b053c3de51d Jan 22 21:22:49.672547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6e35831b-bcb5-4402-aa95-48b23f219049 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Returning 400 to user: Invalid volume: volume 62156b55-9cd2-42c5-94d9-6b135ebd45d1 is already attached to instances: c72a8658-ab56-4cad-9ca5-9b053c3de51d {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:22:49.673797 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6e35831b-bcb5-4402-aa95-48b23f219049 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "POST /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.344571 Jan 22 21:22:49.676835 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3503/6722] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:22:49 2022] POST /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d/os-volume_attachments => generated 174 bytes in 348 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:22:49.776386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8c58a36f-2517-4c4f-9f84-e1ba9cfb025a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:49.780788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8c58a36f-2517-4c4f-9f84-e1ba9cfb025a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:49.796242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c58a36f-2517-4c4f-9f84-e1ba9cfb025a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:49.797775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c58a36f-2517-4c4f-9f84-e1ba9cfb025a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:49.799027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c58a36f-2517-4c4f-9f84-e1ba9cfb025a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:49.799711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c58a36f-2517-4c4f-9f84-e1ba9cfb025a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:50.080458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-8c58a36f-2517-4c4f-9f84-e1ba9cfb025a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lazy-loading 'services' on Instance uuid c72a8658-ab56-4cad-9ca5-9b053c3de51d {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:22:50.345960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2c0b1fba-c134-457e-8a76-5326f1ff8d86 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:50.346581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2c0b1fba-c134-457e-8a76-5326f1ff8d86 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:50.355183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c0b1fba-c134-457e-8a76-5326f1ff8d86 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:50.356966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c0b1fba-c134-457e-8a76-5326f1ff8d86 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:50.358066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c0b1fba-c134-457e-8a76-5326f1ff8d86 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:50.358677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c0b1fba-c134-457e-8a76-5326f1ff8d86 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:50.555819 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8c58a36f-2517-4c4f-9f84-e1ba9cfb025a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d/os-volume_attachments/62156b55-9cd2-42c5-94d9-6b135ebd45d1" status: 202 len: 0 microversion: 2.1 time: 0.785574 Jan 22 21:22:50.557649 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3220/6723] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 21:22:49 2022] DELETE /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d/os-volume_attachments/62156b55-9cd2-42c5-94d9-6b135ebd45d1 => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:50.604890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-863dd54e-bc70-4a30-a8e6-8924be74373e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:50.609458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-863dd54e-bc70-4a30-a8e6-8924be74373e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:50.656068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-863dd54e-bc70-4a30-a8e6-8924be74373e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:50.659299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-863dd54e-bc70-4a30-a8e6-8924be74373e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:50.662709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-863dd54e-bc70-4a30-a8e6-8924be74373e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:50.664315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-863dd54e-bc70-4a30-a8e6-8924be74373e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:50.732792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2c0b1fba-c134-457e-8a76-5326f1ff8d86 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:50.755436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2c0b1fba-c134-457e-8a76-5326f1ff8d86 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:50.755436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2c0b1fba-c134-457e-8a76-5326f1ff8d86 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:50.755436 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2c0b1fba-c134-457e-8a76-5326f1ff8d86 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 0.411118 Jan 22 21:22:50.755436 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3504/6724] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:50 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:22:50.771625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-15e76210-db15-4146-ae41-87d28fcb737e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:50.772657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-15e76210-db15-4146-ae41-87d28fcb737e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:50.780844 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-863dd54e-bc70-4a30-a8e6-8924be74373e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.192267 Jan 22 21:22:50.783718 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3221/6725] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:50 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:50.789081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15e76210-db15-4146-ae41-87d28fcb737e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:50.789495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15e76210-db15-4146-ae41-87d28fcb737e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:50.819209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15e76210-db15-4146-ae41-87d28fcb737e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:50.819791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15e76210-db15-4146-ae41-87d28fcb737e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:50.873730 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-15e76210-db15-4146-ae41-87d28fcb737e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118803 Jan 22 21:22:50.874404 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3505/6726] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:22:50 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:22:51.792267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2670d340-b690-4b3c-bfaf-3749bb842677 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:51.793144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2670d340-b690-4b3c-bfaf-3749bb842677 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:51.795084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c0a7de09-a4f9-4ffa-9f50-6fdba2707c51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:51.795999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c0a7de09-a4f9-4ffa-9f50-6fdba2707c51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:51.808985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2670d340-b690-4b3c-bfaf-3749bb842677 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:51.810388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2670d340-b690-4b3c-bfaf-3749bb842677 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:51.811283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0a7de09-a4f9-4ffa-9f50-6fdba2707c51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:51.811727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0a7de09-a4f9-4ffa-9f50-6fdba2707c51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:51.812642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0a7de09-a4f9-4ffa-9f50-6fdba2707c51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:51.812976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0a7de09-a4f9-4ffa-9f50-6fdba2707c51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:51.814477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2670d340-b690-4b3c-bfaf-3749bb842677 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:51.823692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2670d340-b690-4b3c-bfaf-3749bb842677 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:51.944494 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c0a7de09-a4f9-4ffa-9f50-6fdba2707c51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.147480 Jan 22 21:22:51.948892 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3506/6727] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:51 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:22:51.961204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-12392582-4562-4482-a7e8-efa16c4e4cd9 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:51.964698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-12392582-4562-4482-a7e8-efa16c4e4cd9 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:51.982904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12392582-4562-4482-a7e8-efa16c4e4cd9 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:51.983364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12392582-4562-4482-a7e8-efa16c4e4cd9 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:51.984174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12392582-4562-4482-a7e8-efa16c4e4cd9 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:51.986544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12392582-4562-4482-a7e8-efa16c4e4cd9 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:52.034623 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-12392582-4562-4482-a7e8-efa16c4e4cd9 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083077 Jan 22 21:22:52.035227 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3507/6728] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:22:51 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:22:52.224171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1539376275", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "450276e4-b8c9-4322-9dd8-f1637d2b1ee8"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:52.287231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] validate_networks() for [('450276e4-b8c9-4322-9dd8-f1637d2b1ee8', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:22:52.358558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2670d340-b690-4b3c-bfaf-3749bb842677 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:52.432328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2670d340-b690-4b3c-bfaf-3749bb842677 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:52.434058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2670d340-b690-4b3c-bfaf-3749bb842677 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:52.435306 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2670d340-b690-4b3c-bfaf-3749bb842677 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 0.659159 Jan 22 21:22:52.446621 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3222/6729] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:51 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:52.957426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5165b98e-c690-4e8d-9b7d-4198a0677acf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:52.959225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5165b98e-c690-4e8d-9b7d-4198a0677acf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:52.968713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5165b98e-c690-4e8d-9b7d-4198a0677acf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:52.969179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5165b98e-c690-4e8d-9b7d-4198a0677acf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:52.970785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5165b98e-c690-4e8d-9b7d-4198a0677acf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:52.971761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5165b98e-c690-4e8d-9b7d-4198a0677acf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:53.043522 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5165b98e-c690-4e8d-9b7d-4198a0677acf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.090580 Jan 22 21:22:53.047605 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3223/6730] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:52 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:22:53.112614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1066319143", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "327b231e-0fdc-4286-bad8-22f18130a05b"}, {"uuid": "c671fd70-7ff1-4fe9-99aa-e5d11f5e5725"}, {"uuid": "327b231e-0fdc-4286-bad8-22f18130a05b"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:53.189621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] validate_networks() for [('327b231e-0fdc-4286-bad8-22f18130a05b', None, None, None, None, None), ('c671fd70-7ff1-4fe9-99aa-e5d11f5e5725', None, None, None, None, None), ('327b231e-0fdc-4286-bad8-22f18130a05b', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:22:53.644126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:22:53.653830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:22:53.655085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:22:53.656730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:22:53.657753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:22:53.678543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:53.679352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:53.680560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:53.682311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:53.709190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Getting quotas for project 063a9e2a155241a3bf27e7d1b16d0419. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:22:53.715950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Getting quotas for user b9ea4bd8d1d94d6a8e41b26da41bd6fc and project 063a9e2a155241a3bf27e7d1b16d0419. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:22:53.731283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:22:53.734877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:22:53.952935 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b898e10e-2ef7-43a8-ace2-ae8e5cc183bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.733395 Jan 22 21:22:53.956116 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3508/6731] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:22:52 2022] POST /compute/v2.1/servers => generated 382 bytes in 1737 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:22:54.074126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f6c2cd3-5f0d-441e-9241-d94b33281863 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:54.074900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8f6c2cd3-5f0d-441e-9241-d94b33281863 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:54.102777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f6c2cd3-5f0d-441e-9241-d94b33281863 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:54.103682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f6c2cd3-5f0d-441e-9241-d94b33281863 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:54.105224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f6c2cd3-5f0d-441e-9241-d94b33281863 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:54.106655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f6c2cd3-5f0d-441e-9241-d94b33281863 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:54.682916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8f6c2cd3-5f0d-441e-9241-d94b33281863 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:54.692584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8f6c2cd3-5f0d-441e-9241-d94b33281863 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:54.699517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8f6c2cd3-5f0d-441e-9241-d94b33281863 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:54.702107 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8f6c2cd3-5f0d-441e-9241-d94b33281863 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 0.732646 Jan 22 21:22:54.707901 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3509/6732] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:53 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:54.722860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f16cefbb-a082-4688-8a2f-ec3331e7e73a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:54.727549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f16cefbb-a082-4688-8a2f-ec3331e7e73a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:54.851850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f16cefbb-a082-4688-8a2f-ec3331e7e73a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:54.859049 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f16cefbb-a082-4688-8a2f-ec3331e7e73a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1222 microversion: 2.1 time: 0.149994 Jan 22 21:22:54.863810 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3510/6733] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:54 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1222 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:54.868708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e67624ea-ddeb-4f26-b205-10b76c90d47c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:54.869733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e67624ea-ddeb-4f26-b205-10b76c90d47c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:54.880773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e67624ea-ddeb-4f26-b205-10b76c90d47c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:54.881148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e67624ea-ddeb-4f26-b205-10b76c90d47c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:54.882237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e67624ea-ddeb-4f26-b205-10b76c90d47c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:54.882461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e67624ea-ddeb-4f26-b205-10b76c90d47c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:54.983378 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e67624ea-ddeb-4f26-b205-10b76c90d47c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.118031 Jan 22 21:22:54.990366 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3511/6734] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:54 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:55.002707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:22:55.003206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:22:55.003613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:22:55.004043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:22:55.004466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:22:55.014620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:55.015289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:55.016283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:55.017492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:55.041927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Getting quotas for project 2512cc7caef541c58da8cd500af5beff. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:22:55.048040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Getting quotas for user ae64ff0a56a84c34954a4beaa1f3409c and project 2512cc7caef541c58da8cd500af5beff. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:22:55.066876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:22:55.069318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:22:55.276359 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6c9e01c7-108d-4ebf-8536-3ea16ca5ab3d tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.168947 Jan 22 21:22:55.288088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1134ae43-35aa-4fe1-97ac-46ee61e393f8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:55.296014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1134ae43-35aa-4fe1-97ac-46ee61e393f8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:55.309031 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3224/6735] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:22:53 2022] POST /compute/v2.1/servers => generated 382 bytes in 2202 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:22:55.384857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1134ae43-35aa-4fe1-97ac-46ee61e393f8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:55.392944 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1134ae43-35aa-4fe1-97ac-46ee61e393f8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1217 microversion: 2.1 time: 0.108870 Jan 22 21:22:55.397114 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3512/6736] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:55 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1217 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:55.728261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5d378d38-2250-4330-8abb-5b7aaf8eb6e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:55.730663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5d378d38-2250-4330-8abb-5b7aaf8eb6e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:55.740850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d378d38-2250-4330-8abb-5b7aaf8eb6e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:55.741755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d378d38-2250-4330-8abb-5b7aaf8eb6e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:55.743367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d378d38-2250-4330-8abb-5b7aaf8eb6e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:55.744109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d378d38-2250-4330-8abb-5b7aaf8eb6e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:55.882139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-948c7307-b69e-45f0-8723-f3884ce6b0b4 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:55.882763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-948c7307-b69e-45f0-8723-f3884ce6b0b4 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:55.910282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-948c7307-b69e-45f0-8723-f3884ce6b0b4 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:55.910591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-948c7307-b69e-45f0-8723-f3884ce6b0b4 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:55.911629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-948c7307-b69e-45f0-8723-f3884ce6b0b4 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:55.912373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-948c7307-b69e-45f0-8723-f3884ce6b0b4 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:56.029155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-948c7307-b69e-45f0-8723-f3884ce6b0b4 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:56.041164 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-948c7307-b69e-45f0-8723-f3884ce6b0b4 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1226 microversion: 2.1 time: 0.163727 Jan 22 21:22:56.042736 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3513/6737] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:55 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1226 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:22:56.048441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c50f93ff-b6de-49d2-8753-4b4f29015777 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:56.049943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c50f93ff-b6de-49d2-8753-4b4f29015777 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:56.070399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c50f93ff-b6de-49d2-8753-4b4f29015777 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:56.071217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c50f93ff-b6de-49d2-8753-4b4f29015777 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:56.072309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c50f93ff-b6de-49d2-8753-4b4f29015777 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:56.073057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c50f93ff-b6de-49d2-8753-4b4f29015777 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:56.148622 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c50f93ff-b6de-49d2-8753-4b4f29015777 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.104492 Jan 22 21:22:56.149908 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3514/6738] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:56 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:56.396767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5d378d38-2250-4330-8abb-5b7aaf8eb6e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:56.408881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5d378d38-2250-4330-8abb-5b7aaf8eb6e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:56.415104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1b0d8698-fc00-4733-8d3a-09af5109dcd6 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:56.416741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1b0d8698-fc00-4733-8d3a-09af5109dcd6 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:56.425813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5d378d38-2250-4330-8abb-5b7aaf8eb6e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:56.429073 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5d378d38-2250-4330-8abb-5b7aaf8eb6e9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 0.703691 Jan 22 21:22:56.430887 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3225/6739] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:55 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:22:56.499286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1b0d8698-fc00-4733-8d3a-09af5109dcd6 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:56.510481 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1b0d8698-fc00-4733-8d3a-09af5109dcd6 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1217 microversion: 2.1 time: 0.099612 Jan 22 21:22:56.515061 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3515/6740] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:56 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:22:56.809281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b6cdb814-2691-460a-8939-b61587df845e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:56.810377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b6cdb814-2691-460a-8939-b61587df845e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:56.819022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6cdb814-2691-460a-8939-b61587df845e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:56.819786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6cdb814-2691-460a-8939-b61587df845e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:56.821018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6cdb814-2691-460a-8939-b61587df845e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:56.821908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6cdb814-2691-460a-8939-b61587df845e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:56.920644 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b6cdb814-2691-460a-8939-b61587df845e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef/action" status: 200 len: 24547 microversion: 2.1 time: 0.115847 Jan 22 21:22:56.924693 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3226/6741] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:22:56 2022] POST /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef/action => generated 24547 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:22:57.058600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7ebe9777-9706-4608-b26f-912fe01aab4c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:57.059320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7ebe9777-9706-4608-b26f-912fe01aab4c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:57.102919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ebe9777-9706-4608-b26f-912fe01aab4c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:57.104580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ebe9777-9706-4608-b26f-912fe01aab4c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:57.105454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ebe9777-9706-4608-b26f-912fe01aab4c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:57.105942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ebe9777-9706-4608-b26f-912fe01aab4c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:57.168740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a211680-52db-49aa-a480-dc65775ac401 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:57.168740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9a211680-52db-49aa-a480-dc65775ac401 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:57.186690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a211680-52db-49aa-a480-dc65775ac401 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:57.187143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a211680-52db-49aa-a480-dc65775ac401 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:57.192973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a211680-52db-49aa-a480-dc65775ac401 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:57.194005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a211680-52db-49aa-a480-dc65775ac401 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:57.292575 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a211680-52db-49aa-a480-dc65775ac401 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.130489 Jan 22 21:22:57.295443 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3227/6742] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:57 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:22:57.356046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7ebe9777-9706-4608-b26f-912fe01aab4c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:57.366263 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7ebe9777-9706-4608-b26f-912fe01aab4c tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1274 microversion: 2.1 time: 0.311609 Jan 22 21:22:57.372061 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3516/6743] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:57 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1274 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:57.554829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1b94327a-7f5c-4ae7-8be8-cb3cd6eccf16 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:57.555464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1b94327a-7f5c-4ae7-8be8-cb3cd6eccf16 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:57.572092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b94327a-7f5c-4ae7-8be8-cb3cd6eccf16 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:57.572564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b94327a-7f5c-4ae7-8be8-cb3cd6eccf16 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:57.573361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b94327a-7f5c-4ae7-8be8-cb3cd6eccf16 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:57.590030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b94327a-7f5c-4ae7-8be8-cb3cd6eccf16 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:57.966504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f8eef481-049c-43eb-ab3a-40a8046b0cfe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:57.966504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f8eef481-049c-43eb-ab3a-40a8046b0cfe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:57.974612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1b94327a-7f5c-4ae7-8be8-cb3cd6eccf16 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:57.975351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8eef481-049c-43eb-ab3a-40a8046b0cfe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:57.976010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8eef481-049c-43eb-ab3a-40a8046b0cfe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:57.977868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8eef481-049c-43eb-ab3a-40a8046b0cfe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:57.978506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8eef481-049c-43eb-ab3a-40a8046b0cfe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:57.991329 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1b94327a-7f5c-4ae7-8be8-cb3cd6eccf16 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1221 microversion: 2.1 time: 0.460066 Jan 22 21:22:57.991939 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3517/6744] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:57 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1221 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:58.245681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a6d36d25-df0e-4a18-a926-f2f01200d7fb req-4de675ea-e026-43d7-a951-2edf90a5741b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89583718-5186-41d5-b5f3-ad8997c3eb59", "name": "network-vif-plugged", "status": "completed", "tag": "f3926427-e4b0-4ea7-846d-98fa049e0b27"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:58.248719 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:22:58.248719 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:22:58.264322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a6d36d25-df0e-4a18-a926-f2f01200d7fb req-4de675ea-e026-43d7-a951-2edf90a5741b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:58.264990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a6d36d25-df0e-4a18-a926-f2f01200d7fb req-4de675ea-e026-43d7-a951-2edf90a5741b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:58.289708 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a6d36d25-df0e-4a18-a926-f2f01200d7fb req-4de675ea-e026-43d7-a951-2edf90a5741b service nova] Creating event network-vif-plugged:f3926427-e4b0-4ea7-846d-98fa049e0b27 for instance 89583718-5186-41d5-b5f3-ad8997c3eb59 on nch1-master-1 Jan 22 21:22:58.295722 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a6d36d25-df0e-4a18-a926-f2f01200d7fb req-4de675ea-e026-43d7-a951-2edf90a5741b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053847 Jan 22 21:22:58.297116 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3518/6745] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:22:58.308168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fec7cd88-aa66-45a1-8e64-6a569c35397b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:58.315210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fec7cd88-aa66-45a1-8e64-6a569c35397b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:58.331553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fec7cd88-aa66-45a1-8e64-6a569c35397b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:58.332434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fec7cd88-aa66-45a1-8e64-6a569c35397b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:58.334165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fec7cd88-aa66-45a1-8e64-6a569c35397b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:58.342814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fec7cd88-aa66-45a1-8e64-6a569c35397b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:58.438969 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fec7cd88-aa66-45a1-8e64-6a569c35397b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.134711 Jan 22 21:22:58.440452 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3519/6746] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:58 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:22:58.467542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-94043b60-83ab-4c13-bee9-d44abae34ad1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:58.471834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-94043b60-83ab-4c13-bee9-d44abae34ad1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:58.490592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94043b60-83ab-4c13-bee9-d44abae34ad1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:58.493564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94043b60-83ab-4c13-bee9-d44abae34ad1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:58.495110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94043b60-83ab-4c13-bee9-d44abae34ad1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:58.497009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94043b60-83ab-4c13-bee9-d44abae34ad1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:58.621470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-94043b60-83ab-4c13-bee9-d44abae34ad1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:58.631082 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-94043b60-83ab-4c13-bee9-d44abae34ad1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1280 microversion: 2.1 time: 0.187117 Jan 22 21:22:58.639299 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3520/6747] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:58 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1280 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:58.901775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f8eef481-049c-43eb-ab3a-40a8046b0cfe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:58.921639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f8eef481-049c-43eb-ab3a-40a8046b0cfe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:58.927899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f8eef481-049c-43eb-ab3a-40a8046b0cfe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:58.932722 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f8eef481-049c-43eb-ab3a-40a8046b0cfe tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 1.477454 Jan 22 21:22:58.934856 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3228/6748] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:57 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:22:59.024212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-923d2d25-8a4d-44d3-a886-c83b815def9e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:59.025249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-923d2d25-8a4d-44d3-a886-c83b815def9e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:59.043950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-923d2d25-8a4d-44d3-a886-c83b815def9e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:59.046270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-923d2d25-8a4d-44d3-a886-c83b815def9e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:59.047144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-923d2d25-8a4d-44d3-a886-c83b815def9e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:59.047596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-923d2d25-8a4d-44d3-a886-c83b815def9e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:59.139964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-923d2d25-8a4d-44d3-a886-c83b815def9e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:59.154114 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-923d2d25-8a4d-44d3-a886-c83b815def9e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1269 microversion: 2.1 time: 0.146245 Jan 22 21:22:59.164734 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3521/6749] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:59 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:59.458411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cc6b275e-0777-4810-84a9-2452ac1bb70d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:22:59.459993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cc6b275e-0777-4810-84a9-2452ac1bb70d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:59.468335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc6b275e-0777-4810-84a9-2452ac1bb70d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:59.469305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc6b275e-0777-4810-84a9-2452ac1bb70d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:59.471533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc6b275e-0777-4810-84a9-2452ac1bb70d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:59.472463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc6b275e-0777-4810-84a9-2452ac1bb70d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:59.615516 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cc6b275e-0777-4810-84a9-2452ac1bb70d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.125842 Jan 22 21:22:59.626958 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3229/6750] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:22:59 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:22:59.650142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-158c140c-4445-459c-8429-42c724ef9aa1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:59.651155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-158c140c-4445-459c-8429-42c724ef9aa1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:59.669908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-158c140c-4445-459c-8429-42c724ef9aa1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:59.669908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-158c140c-4445-459c-8429-42c724ef9aa1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:59.669908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-158c140c-4445-459c-8429-42c724ef9aa1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:59.671303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-158c140c-4445-459c-8429-42c724ef9aa1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:59.916413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-158c140c-4445-459c-8429-42c724ef9aa1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:22:59.927657 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-158c140c-4445-459c-8429-42c724ef9aa1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1280 microversion: 2.1 time: 0.283243 Jan 22 21:22:59.928496 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3522/6751] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:22:59 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1280 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:22:59.955058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e9809dcc-4701-4cd3-ab68-81006182e522 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:22:59.956026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e9809dcc-4701-4cd3-ab68-81006182e522 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:22:59.967350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9809dcc-4701-4cd3-ab68-81006182e522 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:59.968095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9809dcc-4701-4cd3-ab68-81006182e522 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:22:59.971324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9809dcc-4701-4cd3-ab68-81006182e522 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:22:59.971974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9809dcc-4701-4cd3-ab68-81006182e522 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:00.176021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7819e5bf-e335-4b9b-a209-96b8df0736cc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:00.176767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7819e5bf-e335-4b9b-a209-96b8df0736cc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:00.187539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7819e5bf-e335-4b9b-a209-96b8df0736cc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:00.188152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7819e5bf-e335-4b9b-a209-96b8df0736cc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:00.189479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7819e5bf-e335-4b9b-a209-96b8df0736cc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:00.190539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7819e5bf-e335-4b9b-a209-96b8df0736cc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:00.303716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7819e5bf-e335-4b9b-a209-96b8df0736cc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:00.315116 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7819e5bf-e335-4b9b-a209-96b8df0736cc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1287 microversion: 2.1 time: 0.144180 Jan 22 21:23:00.327609 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3523/6752] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:00 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1287 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:00.570510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e9809dcc-4701-4cd3-ab68-81006182e522 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:00.590120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e9809dcc-4701-4cd3-ab68-81006182e522 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:00.591740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e9809dcc-4701-4cd3-ab68-81006182e522 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:00.593061 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e9809dcc-4701-4cd3-ab68-81006182e522 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 0.642917 Jan 22 21:23:00.596835 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3230/6753] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:22:59 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:23:00.636619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3297915d-75ac-475d-8703-58cdb1f6a200 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:00.642841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3297915d-75ac-475d-8703-58cdb1f6a200 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:00.652347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3297915d-75ac-475d-8703-58cdb1f6a200 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:00.653030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3297915d-75ac-475d-8703-58cdb1f6a200 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:00.653716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3297915d-75ac-475d-8703-58cdb1f6a200 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:00.654173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3297915d-75ac-475d-8703-58cdb1f6a200 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:00.733012 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3297915d-75ac-475d-8703-58cdb1f6a200 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.107256 Jan 22 21:23:00.736773 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3524/6754] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:00 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:00.944857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab728b2e-2320-4fd1-9714-d4f24bdafd7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:00.945694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab728b2e-2320-4fd1-9714-d4f24bdafd7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:00.958808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab728b2e-2320-4fd1-9714-d4f24bdafd7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:00.959277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab728b2e-2320-4fd1-9714-d4f24bdafd7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:00.960090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab728b2e-2320-4fd1-9714-d4f24bdafd7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:00.960718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab728b2e-2320-4fd1-9714-d4f24bdafd7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:01.345631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eda5a4ca-44d7-4a43-a29a-7df3984b6bc5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:01.346721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eda5a4ca-44d7-4a43-a29a-7df3984b6bc5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:01.362878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eda5a4ca-44d7-4a43-a29a-7df3984b6bc5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:01.363602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eda5a4ca-44d7-4a43-a29a-7df3984b6bc5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:01.364806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eda5a4ca-44d7-4a43-a29a-7df3984b6bc5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:01.365458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eda5a4ca-44d7-4a43-a29a-7df3984b6bc5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:01.506392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-eda5a4ca-44d7-4a43-a29a-7df3984b6bc5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:01.521610 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eda5a4ca-44d7-4a43-a29a-7df3984b6bc5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1275 microversion: 2.1 time: 0.190258 Jan 22 21:23:01.524801 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3525/6755] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:01 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:01.629434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5bebe669-68ec-4e0f-b9ee-d0eeb745a9e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:01.630576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5bebe669-68ec-4e0f-b9ee-d0eeb745a9e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:01.653484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bebe669-68ec-4e0f-b9ee-d0eeb745a9e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:01.653484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bebe669-68ec-4e0f-b9ee-d0eeb745a9e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:01.653484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bebe669-68ec-4e0f-b9ee-d0eeb745a9e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:01.653484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bebe669-68ec-4e0f-b9ee-d0eeb745a9e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:01.936867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5bebe669-68ec-4e0f-b9ee-d0eeb745a9e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:01.946543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5bebe669-68ec-4e0f-b9ee-d0eeb745a9e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:01.948426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5bebe669-68ec-4e0f-b9ee-d0eeb745a9e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:01.951062 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5bebe669-68ec-4e0f-b9ee-d0eeb745a9e2 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1736 microversion: 2.20 time: 0.338654 Jan 22 21:23:01.963435 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3526/6756] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:23:01 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1736 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:23:01.977147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9a06c0e7-bb7a-46d9-85ca-8ab843c88c8d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:01.978632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9a06c0e7-bb7a-46d9-85ca-8ab843c88c8d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:01.986853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a06c0e7-bb7a-46d9-85ca-8ab843c88c8d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:01.987455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a06c0e7-bb7a-46d9-85ca-8ab843c88c8d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:01.988373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a06c0e7-bb7a-46d9-85ca-8ab843c88c8d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:01.988925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a06c0e7-bb7a-46d9-85ca-8ab843c88c8d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:02.038477 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9a06c0e7-bb7a-46d9-85ca-8ab843c88c8d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.071950 Jan 22 21:23:02.042981 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3527/6757] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:01 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:02.139773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab728b2e-2320-4fd1-9714-d4f24bdafd7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:02.156409 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab728b2e-2320-4fd1-9714-d4f24bdafd7a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1322 microversion: 2.1 time: 1.215225 Jan 22 21:23:02.157439 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3231/6758] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:00 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1322 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:02.552171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0da1217f-12dd-489a-ab33-773b7f191cbb tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:02.552888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0da1217f-12dd-489a-ab33-773b7f191cbb tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:02.563977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0da1217f-12dd-489a-ab33-773b7f191cbb tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:02.564435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0da1217f-12dd-489a-ab33-773b7f191cbb tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:02.565249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0da1217f-12dd-489a-ab33-773b7f191cbb tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:02.565728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0da1217f-12dd-489a-ab33-773b7f191cbb tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:02.686230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0da1217f-12dd-489a-ab33-773b7f191cbb tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:02.695183 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0da1217f-12dd-489a-ab33-773b7f191cbb tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1275 microversion: 2.1 time: 0.151639 Jan 22 21:23:02.707721 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3528/6759] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:02 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:02.971714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-695fee14-c549-4465-ae55-18a7afac0ecb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:02.973836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-695fee14-c549-4465-ae55-18a7afac0ecb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:02.985616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-695fee14-c549-4465-ae55-18a7afac0ecb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:02.986465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-695fee14-c549-4465-ae55-18a7afac0ecb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:02.987487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-695fee14-c549-4465-ae55-18a7afac0ecb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:02.988117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-695fee14-c549-4465-ae55-18a7afac0ecb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:03.051930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2e096c75-4726-4bde-afd3-2af8089a357e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:03.053406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2e096c75-4726-4bde-afd3-2af8089a357e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:03.086182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e096c75-4726-4bde-afd3-2af8089a357e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:03.086648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e096c75-4726-4bde-afd3-2af8089a357e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:03.087478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e096c75-4726-4bde-afd3-2af8089a357e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:03.098643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e096c75-4726-4bde-afd3-2af8089a357e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:03.190630 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2e096c75-4726-4bde-afd3-2af8089a357e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.143952 Jan 22 21:23:03.191782 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3529/6760] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:03 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:23:03.216447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4641494f-e5d4-44af-94a5-b8405977232b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:03.217092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4641494f-e5d4-44af-94a5-b8405977232b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:03.246437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4641494f-e5d4-44af-94a5-b8405977232b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:03.248878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4641494f-e5d4-44af-94a5-b8405977232b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:03.249883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4641494f-e5d4-44af-94a5-b8405977232b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:03.250344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4641494f-e5d4-44af-94a5-b8405977232b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:03.500895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4641494f-e5d4-44af-94a5-b8405977232b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:03.515562 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4641494f-e5d4-44af-94a5-b8405977232b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1322 microversion: 2.1 time: 0.322345 Jan 22 21:23:03.525912 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3530/6761] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:03 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:03.731719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e8e40b7d-e20c-4f28-908d-05a95a8d4b71 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:03.732351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e8e40b7d-e20c-4f28-908d-05a95a8d4b71 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:03.745700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8e40b7d-e20c-4f28-908d-05a95a8d4b71 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:03.746709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8e40b7d-e20c-4f28-908d-05a95a8d4b71 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:03.747929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8e40b7d-e20c-4f28-908d-05a95a8d4b71 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:03.748770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8e40b7d-e20c-4f28-908d-05a95a8d4b71 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:03.756879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-695fee14-c549-4465-ae55-18a7afac0ecb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:03.770992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-695fee14-c549-4465-ae55-18a7afac0ecb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:03.777526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-695fee14-c549-4465-ae55-18a7afac0ecb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:03.790454 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-695fee14-c549-4465-ae55-18a7afac0ecb tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1723 microversion: 2.20 time: 0.812868 Jan 22 21:23:03.791627 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3232/6762] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:23:02 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1723 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:23:04.075939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e8e40b7d-e20c-4f28-908d-05a95a8d4b71 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:04.092693 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e8e40b7d-e20c-4f28-908d-05a95a8d4b71 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1317 microversion: 2.1 time: 0.371812 Jan 22 21:23:04.093604 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3531/6763] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:03 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:04.202274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-79bf88ae-e7a5-41da-9d4a-dd3a7f917558 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:04.203256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-79bf88ae-e7a5-41da-9d4a-dd3a7f917558 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:04.219986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79bf88ae-e7a5-41da-9d4a-dd3a7f917558 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:04.219986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79bf88ae-e7a5-41da-9d4a-dd3a7f917558 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:04.219986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79bf88ae-e7a5-41da-9d4a-dd3a7f917558 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:04.226556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-f1f2d0e3-59b8-434e-8d16-244095491241 req-c568ab96-02f2-444f-8e4c-ad0719821ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "823893cd-c3f3-4951-b57e-190007916140", "tag": "99202f8b-dd34-4923-ac45-a2e59360fb29"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:04.228272 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:04.228272 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:23:04.230386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79bf88ae-e7a5-41da-9d4a-dd3a7f917558 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:04.250456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f1f2d0e3-59b8-434e-8d16-244095491241 req-c568ab96-02f2-444f-8e4c-ad0719821ccb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:04.251583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f1f2d0e3-59b8-434e-8d16-244095491241 req-c568ab96-02f2-444f-8e4c-ad0719821ccb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:04.277470 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f1f2d0e3-59b8-434e-8d16-244095491241 req-c568ab96-02f2-444f-8e4c-ad0719821ccb service nova] Creating event network-changed:99202f8b-dd34-4923-ac45-a2e59360fb29 for instance 823893cd-c3f3-4951-b57e-190007916140 on nch1-master-1 Jan 22 21:23:04.284272 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-f1f2d0e3-59b8-434e-8d16-244095491241 req-c568ab96-02f2-444f-8e4c-ad0719821ccb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067424 Jan 22 21:23:04.295352 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3532/6764] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:04.322602 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-79bf88ae-e7a5-41da-9d4a-dd3a7f917558 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.123688 Jan 22 21:23:04.323707 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3233/6765] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:04 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:04.536631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d776b5ef-ade8-4e59-b0de-4c3a2f13752d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:04.537805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d776b5ef-ade8-4e59-b0de-4c3a2f13752d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:04.574938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d776b5ef-ade8-4e59-b0de-4c3a2f13752d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:04.575732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d776b5ef-ade8-4e59-b0de-4c3a2f13752d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:04.577232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d776b5ef-ade8-4e59-b0de-4c3a2f13752d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:04.580388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d776b5ef-ade8-4e59-b0de-4c3a2f13752d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:04.805808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d776b5ef-ade8-4e59-b0de-4c3a2f13752d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:04.828447 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d776b5ef-ade8-4e59-b0de-4c3a2f13752d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1322 microversion: 2.1 time: 0.298001 Jan 22 21:23:04.832716 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3533/6766] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:04 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:05.117961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c6f110a2-0f6f-4c5b-a654-134b280341be tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:05.121104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c6f110a2-0f6f-4c5b-a654-134b280341be tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:05.151002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6f110a2-0f6f-4c5b-a654-134b280341be tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:05.151873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6f110a2-0f6f-4c5b-a654-134b280341be tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:05.153733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6f110a2-0f6f-4c5b-a654-134b280341be tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:05.154461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6f110a2-0f6f-4c5b-a654-134b280341be tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:05.335849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-64d1b686-00ee-4dab-8b95-b03c9b77159a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:05.340842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-64d1b686-00ee-4dab-8b95-b03c9b77159a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:05.347248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64d1b686-00ee-4dab-8b95-b03c9b77159a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:05.348014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64d1b686-00ee-4dab-8b95-b03c9b77159a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:05.349063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64d1b686-00ee-4dab-8b95-b03c9b77159a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:05.349752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64d1b686-00ee-4dab-8b95-b03c9b77159a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:05.408064 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-64d1b686-00ee-4dab-8b95-b03c9b77159a tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 24585 microversion: 2.32 time: 0.075196 Jan 22 21:23:05.412698 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3534/6767] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:05 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 24585 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:05.851110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cdd98093-0ebe-4a14-bb6d-800daffd968f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:05.851823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cdd98093-0ebe-4a14-bb6d-800daffd968f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:05.868007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cdd98093-0ebe-4a14-bb6d-800daffd968f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:05.868770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cdd98093-0ebe-4a14-bb6d-800daffd968f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:05.869910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cdd98093-0ebe-4a14-bb6d-800daffd968f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:05.870476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cdd98093-0ebe-4a14-bb6d-800daffd968f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:06.045294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cdd98093-0ebe-4a14-bb6d-800daffd968f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:06.057444 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cdd98093-0ebe-4a14-bb6d-800daffd968f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1322 microversion: 2.1 time: 0.212793 Jan 22 21:23:06.061120 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3535/6768] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:05 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:23:06.170630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c6f110a2-0f6f-4c5b-a654-134b280341be tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:06.180766 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c6f110a2-0f6f-4c5b-a654-134b280341be tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1317 microversion: 2.1 time: 1.073432 Jan 22 21:23:06.191052 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3234/6769] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:05 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1317 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:06.420516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-87953e3c-f9e6-4e76-9296-87cfbf78db7d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:06.421807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-87953e3c-f9e6-4e76-9296-87cfbf78db7d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:06.431021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87953e3c-f9e6-4e76-9296-87cfbf78db7d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:06.432408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87953e3c-f9e6-4e76-9296-87cfbf78db7d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:06.433527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87953e3c-f9e6-4e76-9296-87cfbf78db7d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:06.434425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87953e3c-f9e6-4e76-9296-87cfbf78db7d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:06.522311 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-87953e3c-f9e6-4e76-9296-87cfbf78db7d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.105820 Jan 22 21:23:06.523143 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3536/6770] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:06 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:23:07.079353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bf2f3e39-5865-4cae-b17d-cc3689b7bbde tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:07.081389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bf2f3e39-5865-4cae-b17d-cc3689b7bbde tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:07.108479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf2f3e39-5865-4cae-b17d-cc3689b7bbde tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:07.112897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf2f3e39-5865-4cae-b17d-cc3689b7bbde tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:07.115799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf2f3e39-5865-4cae-b17d-cc3689b7bbde tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:07.117372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf2f3e39-5865-4cae-b17d-cc3689b7bbde tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:07.200259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2bbd3858-9fd4-4301-919b-d8a2d540d71e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:07.202510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2bbd3858-9fd4-4301-919b-d8a2d540d71e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:07.213533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2bbd3858-9fd4-4301-919b-d8a2d540d71e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:07.214061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2bbd3858-9fd4-4301-919b-d8a2d540d71e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:07.214868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2bbd3858-9fd4-4301-919b-d8a2d540d71e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:07.215308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2bbd3858-9fd4-4301-919b-d8a2d540d71e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:07.450437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2bbd3858-9fd4-4301-919b-d8a2d540d71e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:07.464495 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2bbd3858-9fd4-4301-919b-d8a2d540d71e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1338 microversion: 2.1 time: 0.270077 Jan 22 21:23:07.475583 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3537/6771] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:07 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1338 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:07.538612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-06e447c9-3d01-4111-9a07-f5ed64ed8c95 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:07.539902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-06e447c9-3d01-4111-9a07-f5ed64ed8c95 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:07.547180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06e447c9-3d01-4111-9a07-f5ed64ed8c95 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:07.548212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06e447c9-3d01-4111-9a07-f5ed64ed8c95 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:07.549333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06e447c9-3d01-4111-9a07-f5ed64ed8c95 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:07.550389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06e447c9-3d01-4111-9a07-f5ed64ed8c95 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:07.597848 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-06e447c9-3d01-4111-9a07-f5ed64ed8c95 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.066861 Jan 22 21:23:07.598648 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3538/6772] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:07 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:07.601842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bf2f3e39-5865-4cae-b17d-cc3689b7bbde tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:07.614753 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bf2f3e39-5865-4cae-b17d-cc3689b7bbde tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1322 microversion: 2.1 time: 0.541419 Jan 22 21:23:07.615358 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3235/6773] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:07 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:07.975180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b60c80a0-3216-4526-81f7-84dc9965028d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:07.975957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b60c80a0-3216-4526-81f7-84dc9965028d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:07.993954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b60c80a0-3216-4526-81f7-84dc9965028d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:07.994416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b60c80a0-3216-4526-81f7-84dc9965028d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:07.995229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b60c80a0-3216-4526-81f7-84dc9965028d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:07.995673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b60c80a0-3216-4526-81f7-84dc9965028d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:08.164041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b60c80a0-3216-4526-81f7-84dc9965028d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:08.172865 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b60c80a0-3216-4526-81f7-84dc9965028d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1682 microversion: 2.1 time: 0.201661 Jan 22 21:23:08.183751 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3539/6774] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:07 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1682 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:08.295106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-335f6117-4e44-4a0d-9ad3-6a102d68b822 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:08.296468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-335f6117-4e44-4a0d-9ad3-6a102d68b822 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:08.304228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-335f6117-4e44-4a0d-9ad3-6a102d68b822 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:08.304944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-335f6117-4e44-4a0d-9ad3-6a102d68b822 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:08.306004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-335f6117-4e44-4a0d-9ad3-6a102d68b822 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:08.306545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-335f6117-4e44-4a0d-9ad3-6a102d68b822 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:08.381874 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-335f6117-4e44-4a0d-9ad3-6a102d68b822 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef/action" status: 200 len: 32618 microversion: 2.1 time: 0.082987 Jan 22 21:23:08.383279 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3236/6775] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:23:08 2022] POST /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef/action => generated 32618 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:23:08.482645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-48e8e077-d8ec-4130-bf47-c479e49abc90 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:08.483854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-48e8e077-d8ec-4130-bf47-c479e49abc90 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:08.497419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48e8e077-d8ec-4130-bf47-c479e49abc90 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:08.502608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48e8e077-d8ec-4130-bf47-c479e49abc90 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:08.505285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48e8e077-d8ec-4130-bf47-c479e49abc90 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:08.505285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48e8e077-d8ec-4130-bf47-c479e49abc90 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:08.556678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-63c74e41-88d6-42cf-a7f5-f3cb65d025c4 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:08.557633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-63c74e41-88d6-42cf-a7f5-f3cb65d025c4 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:08.568106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63c74e41-88d6-42cf-a7f5-f3cb65d025c4 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:08.573741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63c74e41-88d6-42cf-a7f5-f3cb65d025c4 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:08.573741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63c74e41-88d6-42cf-a7f5-f3cb65d025c4 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:08.573741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63c74e41-88d6-42cf-a7f5-f3cb65d025c4 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:08.804016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-48e8e077-d8ec-4130-bf47-c479e49abc90 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:08.812965 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-48e8e077-d8ec-4130-bf47-c479e49abc90 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1338 microversion: 2.1 time: 0.333820 Jan 22 21:23:08.814282 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3540/6776] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:08 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1338 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:08.833532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-37659b57-f75a-4ed1-aa6b-6c33f8395c56 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:08.833867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-37659b57-f75a-4ed1-aa6b-6c33f8395c56 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:08.843614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37659b57-f75a-4ed1-aa6b-6c33f8395c56 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:08.845021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37659b57-f75a-4ed1-aa6b-6c33f8395c56 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:08.846261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37659b57-f75a-4ed1-aa6b-6c33f8395c56 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:08.846937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37659b57-f75a-4ed1-aa6b-6c33f8395c56 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:08.903362 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-37659b57-f75a-4ed1-aa6b-6c33f8395c56 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.087331 Jan 22 21:23:08.906876 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3541/6777] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:08 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:08.917551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-150bbdc3-2713-4f06-ae60-ccddd562767b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:08.919182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-150bbdc3-2713-4f06-ae60-ccddd562767b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:08.935296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-150bbdc3-2713-4f06-ae60-ccddd562767b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:08.936949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-150bbdc3-2713-4f06-ae60-ccddd562767b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:08.942473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-150bbdc3-2713-4f06-ae60-ccddd562767b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:08.943439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-150bbdc3-2713-4f06-ae60-ccddd562767b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:09.104098 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-63c74e41-88d6-42cf-a7f5-f3cb65d025c4 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1833 microversion: 2.1 time: 0.554978 Jan 22 21:23:09.123538 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3237/6778] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:08 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1833 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:09.135711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0526a6b7-f0d1-421a-8d5e-d00b1d65a463 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:09.137402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0526a6b7-f0d1-421a-8d5e-d00b1d65a463 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:09.158817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-150bbdc3-2713-4f06-ae60-ccddd562767b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:09.162664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0526a6b7-f0d1-421a-8d5e-d00b1d65a463 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:09.163439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0526a6b7-f0d1-421a-8d5e-d00b1d65a463 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:09.166343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0526a6b7-f0d1-421a-8d5e-d00b1d65a463 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:09.167062 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-150bbdc3-2713-4f06-ae60-ccddd562767b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1322 microversion: 2.1 time: 0.257162 Jan 22 21:23:09.177799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0526a6b7-f0d1-421a-8d5e-d00b1d65a463 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:09.179042 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3542/6779] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:08 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:09.205930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-0526a6b7-f0d1-421a-8d5e-d00b1d65a463 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lazy-loading 'flavor' on Instance uuid a12be9a2-2532-4441-94d7-1e38912ebaef {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:23:09.221200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0526a6b7-f0d1-421a-8d5e-d00b1d65a463 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Going to try to live migrate instance to another host {{(pid=137033) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Jan 22 21:23:09.833884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-281ff225-ac45-4c08-8d19-c614522af24e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:09.834505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-281ff225-ac45-4c08-8d19-c614522af24e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:09.878243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-281ff225-ac45-4c08-8d19-c614522af24e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:09.878711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-281ff225-ac45-4c08-8d19-c614522af24e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:09.880034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-281ff225-ac45-4c08-8d19-c614522af24e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:09.884270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-281ff225-ac45-4c08-8d19-c614522af24e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:10.272425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-281ff225-ac45-4c08-8d19-c614522af24e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:10.280323 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-281ff225-ac45-4c08-8d19-c614522af24e tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.451285 Jan 22 21:23:10.281142 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3543/6780] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:09 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:10.286797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cfa1a023-56c0-4dcc-a4dd-a1aed6676c32 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:10.287941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cfa1a023-56c0-4dcc-a4dd-a1aed6676c32 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:10.316723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfa1a023-56c0-4dcc-a4dd-a1aed6676c32 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:10.316723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfa1a023-56c0-4dcc-a4dd-a1aed6676c32 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:10.316723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfa1a023-56c0-4dcc-a4dd-a1aed6676c32 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:10.316723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cfa1a023-56c0-4dcc-a4dd-a1aed6676c32 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:10.379008 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cfa1a023-56c0-4dcc-a4dd-a1aed6676c32 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.096122 Jan 22 21:23:10.379835 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3544/6781] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:10 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:10.384848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9fb6b357-89c3-4d35-bdd0-2fe12cb88902 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:10.394272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9fb6b357-89c3-4d35-bdd0-2fe12cb88902 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:10.408604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fb6b357-89c3-4d35-bdd0-2fe12cb88902 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:10.409293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fb6b357-89c3-4d35-bdd0-2fe12cb88902 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:10.410292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fb6b357-89c3-4d35-bdd0-2fe12cb88902 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:10.410899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9fb6b357-89c3-4d35-bdd0-2fe12cb88902 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:10.775003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9fb6b357-89c3-4d35-bdd0-2fe12cb88902 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:10.815223 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9fb6b357-89c3-4d35-bdd0-2fe12cb88902 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1322 microversion: 2.1 time: 0.419559 Jan 22 21:23:10.817387 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3545/6782] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:10 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1322 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:11.296911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b0a8cd06-ab15-4fb7-a8ce-bb15f67f552a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:11.298691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b0a8cd06-ab15-4fb7-a8ce-bb15f67f552a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:11.306230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0a8cd06-ab15-4fb7-a8ce-bb15f67f552a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:11.306760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0a8cd06-ab15-4fb7-a8ce-bb15f67f552a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:11.307569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0a8cd06-ab15-4fb7-a8ce-bb15f67f552a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:11.308015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0a8cd06-ab15-4fb7-a8ce-bb15f67f552a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:11.616565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b0a8cd06-ab15-4fb7-a8ce-bb15f67f552a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:11.629833 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b0a8cd06-ab15-4fb7-a8ce-bb15f67f552a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.335634 Jan 22 21:23:11.631064 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3546/6783] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:11 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:23:11.637035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-59443556-7219-4c4b-8aa9-1eddd3061fd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:11.639194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-59443556-7219-4c4b-8aa9-1eddd3061fd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:11.648007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59443556-7219-4c4b-8aa9-1eddd3061fd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:11.648773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59443556-7219-4c4b-8aa9-1eddd3061fd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:11.651989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59443556-7219-4c4b-8aa9-1eddd3061fd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:11.654256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59443556-7219-4c4b-8aa9-1eddd3061fd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:11.745765 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-59443556-7219-4c4b-8aa9-1eddd3061fd4 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.112531 Jan 22 21:23:11.747524 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3547/6784] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:11 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:11.754588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5f0bf201-4d79-49ef-945f-8fa903073073 req-08c312d9-8120-40e1-b7d0-9e996f5344f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5dabfb-f484-4b09-b45f-b31db980db64", "tag": "43cc5dcd-7f91-417e-a1f5-fea90214a7b4"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:11.757638 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:11.757638 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:23:11.771260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5f0bf201-4d79-49ef-945f-8fa903073073 req-08c312d9-8120-40e1-b7d0-9e996f5344f0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:11.772569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5f0bf201-4d79-49ef-945f-8fa903073073 req-08c312d9-8120-40e1-b7d0-9e996f5344f0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:11.787469 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5f0bf201-4d79-49ef-945f-8fa903073073 req-08c312d9-8120-40e1-b7d0-9e996f5344f0 service nova] Creating event network-changed:43cc5dcd-7f91-417e-a1f5-fea90214a7b4 for instance 5f5dabfb-f484-4b09-b45f-b31db980db64 on nch1-master-1 Jan 22 21:23:11.794246 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-5f0bf201-4d79-49ef-945f-8fa903073073 req-08c312d9-8120-40e1-b7d0-9e996f5344f0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045076 Jan 22 21:23:11.796654 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3548/6785] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:11.838547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4c3140d8-6558-45fa-954e-6802e560e08a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:11.839458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4c3140d8-6558-45fa-954e-6802e560e08a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:11.855817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c3140d8-6558-45fa-954e-6802e560e08a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:11.856298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c3140d8-6558-45fa-954e-6802e560e08a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:11.865020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c3140d8-6558-45fa-954e-6802e560e08a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:11.865020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c3140d8-6558-45fa-954e-6802e560e08a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:12.709980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4c3140d8-6558-45fa-954e-6802e560e08a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:12.718688 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4c3140d8-6558-45fa-954e-6802e560e08a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1322 microversion: 2.1 time: 0.887100 Jan 22 21:23:12.719968 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3549/6786] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:11 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1322 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:12.725799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-539f0e1c-2862-449b-b293-cb59e5b0657c req-f670728e-79fa-4a73-8d2a-346c9dce2dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823893cd-c3f3-4951-b57e-190007916140", "name": "network-vif-plugged", "status": "completed", "tag": "99202f8b-dd34-4923-ac45-a2e59360fb29"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:12.727582 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:12.727582 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:23:12.736607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-539f0e1c-2862-449b-b293-cb59e5b0657c req-f670728e-79fa-4a73-8d2a-346c9dce2dc6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:12.737171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-539f0e1c-2862-449b-b293-cb59e5b0657c req-f670728e-79fa-4a73-8d2a-346c9dce2dc6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:12.750295 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-539f0e1c-2862-449b-b293-cb59e5b0657c req-f670728e-79fa-4a73-8d2a-346c9dce2dc6 service nova] Creating event network-vif-plugged:99202f8b-dd34-4923-ac45-a2e59360fb29 for instance 823893cd-c3f3-4951-b57e-190007916140 on nch1-master-1 Jan 22 21:23:12.756645 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-539f0e1c-2862-449b-b293-cb59e5b0657c req-f670728e-79fa-4a73-8d2a-346c9dce2dc6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034584 Jan 22 21:23:12.761219 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3550/6787] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:12.766492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-86ac20f2-dd3d-4277-a456-52348b853100 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:12.767602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-86ac20f2-dd3d-4277-a456-52348b853100 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:12.773958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86ac20f2-dd3d-4277-a456-52348b853100 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:12.774659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86ac20f2-dd3d-4277-a456-52348b853100 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:12.775664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86ac20f2-dd3d-4277-a456-52348b853100 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:12.776317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86ac20f2-dd3d-4277-a456-52348b853100 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:13.173764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-86ac20f2-dd3d-4277-a456-52348b853100 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:13.184921 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-86ac20f2-dd3d-4277-a456-52348b853100 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.422925 Jan 22 21:23:13.185710 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3551/6788] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:12 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:13.190753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-52725a85-16c4-4b0e-9bd6-7017e953acf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:13.191928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-52725a85-16c4-4b0e-9bd6-7017e953acf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:13.198736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52725a85-16c4-4b0e-9bd6-7017e953acf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:13.199273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52725a85-16c4-4b0e-9bd6-7017e953acf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:13.200152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52725a85-16c4-4b0e-9bd6-7017e953acf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:13.200904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52725a85-16c4-4b0e-9bd6-7017e953acf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:13.411024 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-52725a85-16c4-4b0e-9bd6-7017e953acf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.222957 Jan 22 21:23:13.423559 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3552/6789] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:13 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:13.436730 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0526a6b7-f0d1-421a-8d5e-d00b1d65a463 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef/action" status: 202 len: 0 microversion: 2.1 time: 4.309117 Jan 22 21:23:13.438689 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3238/6790] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:23:09 2022] POST /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef/action => generated 0 bytes in 4315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:13.454069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-850075cc-f8db-43c4-8cec-6cc1a79caf65 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:13.455458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-850075cc-f8db-43c4-8cec-6cc1a79caf65 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:13.471646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-850075cc-f8db-43c4-8cec-6cc1a79caf65 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:13.472187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-850075cc-f8db-43c4-8cec-6cc1a79caf65 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:13.473353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-850075cc-f8db-43c4-8cec-6cc1a79caf65 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:13.474880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-850075cc-f8db-43c4-8cec-6cc1a79caf65 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:13.736977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c768aac0-4e84-4488-b253-f758ac12fcf8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:13.737644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c768aac0-4e84-4488-b253-f758ac12fcf8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:13.752473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c768aac0-4e84-4488-b253-f758ac12fcf8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:13.753382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c768aac0-4e84-4488-b253-f758ac12fcf8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:13.754477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c768aac0-4e84-4488-b253-f758ac12fcf8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:13.755171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c768aac0-4e84-4488-b253-f758ac12fcf8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:13.853700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-850075cc-f8db-43c4-8cec-6cc1a79caf65 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:13.861660 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-850075cc-f8db-43c4-8cec-6cc1a79caf65 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 0.413194 Jan 22 21:23:13.862251 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3553/6791] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:13 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:14.064095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c768aac0-4e84-4488-b253-f758ac12fcf8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:14.086059 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c768aac0-4e84-4488-b253-f758ac12fcf8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1322 microversion: 2.1 time: 0.353479 Jan 22 21:23:14.087219 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3239/6792] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:13 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:14.128922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-be898bf3-1750-4116-82b6-d3f03b933055 req-3e9daf23-7da6-4f49-9c1e-179626c4bb12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5dabfb-f484-4b09-b45f-b31db980db64", "tag": "b4ffbbd7-26e1-4f22-95b4-c8670632f290"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:14.131469 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:14.131469 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:23:14.144961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-be898bf3-1750-4116-82b6-d3f03b933055 req-3e9daf23-7da6-4f49-9c1e-179626c4bb12 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:14.155683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-be898bf3-1750-4116-82b6-d3f03b933055 req-3e9daf23-7da6-4f49-9c1e-179626c4bb12 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:14.191525 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-be898bf3-1750-4116-82b6-d3f03b933055 req-3e9daf23-7da6-4f49-9c1e-179626c4bb12 service nova] Creating event network-changed:b4ffbbd7-26e1-4f22-95b4-c8670632f290 for instance 5f5dabfb-f484-4b09-b45f-b31db980db64 on nch1-master-1 Jan 22 21:23:14.203881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-23f763ce-01d9-46c4-8666-8c957d055df7 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:14.204652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-23f763ce-01d9-46c4-8666-8c957d055df7 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:14.207945 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-be898bf3-1750-4116-82b6-d3f03b933055 req-3e9daf23-7da6-4f49-9c1e-179626c4bb12 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081698 Jan 22 21:23:14.213900 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3554/6793] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:14.216520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23f763ce-01d9-46c4-8666-8c957d055df7 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:14.228445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23f763ce-01d9-46c4-8666-8c957d055df7 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:14.229731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23f763ce-01d9-46c4-8666-8c957d055df7 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:14.230763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23f763ce-01d9-46c4-8666-8c957d055df7 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:14.425581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7fcd26cd-db5d-46d0-a965-f2a22459bd7d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:14.427797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7fcd26cd-db5d-46d0-a965-f2a22459bd7d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:14.435838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fcd26cd-db5d-46d0-a965-f2a22459bd7d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:14.436542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fcd26cd-db5d-46d0-a965-f2a22459bd7d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:14.437344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fcd26cd-db5d-46d0-a965-f2a22459bd7d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:14.438673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fcd26cd-db5d-46d0-a965-f2a22459bd7d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:14.520874 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7fcd26cd-db5d-46d0-a965-f2a22459bd7d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.099922 Jan 22 21:23:14.526377 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3555/6794] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:14 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:23:14.750455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-23f763ce-01d9-46c4-8666-8c957d055df7 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:14.761230 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-23f763ce-01d9-46c4-8666-8c957d055df7 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.562695 Jan 22 21:23:14.762650 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3240/6795] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:14 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:14.883205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-37eb87d3-1aef-4204-bb44-1c4a51ae92f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:14.883911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-37eb87d3-1aef-4204-bb44-1c4a51ae92f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:14.898589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37eb87d3-1aef-4204-bb44-1c4a51ae92f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:14.900448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37eb87d3-1aef-4204-bb44-1c4a51ae92f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:14.901547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37eb87d3-1aef-4204-bb44-1c4a51ae92f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:14.902369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37eb87d3-1aef-4204-bb44-1c4a51ae92f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:15.103716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-abd90709-b21e-437a-9523-d812c87d0312 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:15.104174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-abd90709-b21e-437a-9523-d812c87d0312 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:15.118236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abd90709-b21e-437a-9523-d812c87d0312 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:15.119023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abd90709-b21e-437a-9523-d812c87d0312 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:15.119990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abd90709-b21e-437a-9523-d812c87d0312 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:15.120586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-abd90709-b21e-437a-9523-d812c87d0312 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:15.279175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-37eb87d3-1aef-4204-bb44-1c4a51ae92f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:15.287160 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-37eb87d3-1aef-4204-bb44-1c4a51ae92f2 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 0.409804 Jan 22 21:23:15.297106 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3556/6796] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:14 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:15.535681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9233869d-3e47-4a2e-931d-084ea5834c61 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:15.537043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9233869d-3e47-4a2e-931d-084ea5834c61 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:15.548322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9233869d-3e47-4a2e-931d-084ea5834c61 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:15.550053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9233869d-3e47-4a2e-931d-084ea5834c61 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:15.551141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9233869d-3e47-4a2e-931d-084ea5834c61 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:15.551812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9233869d-3e47-4a2e-931d-084ea5834c61 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:15.604440 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9233869d-3e47-4a2e-931d-084ea5834c61 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.074366 Jan 22 21:23:15.606495 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3557/6797] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:15 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:23:15.780520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7454d0bc-5bbf-445f-aebf-b82144d86ff2 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:15.781681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7454d0bc-5bbf-445f-aebf-b82144d86ff2 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:15.792403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7454d0bc-5bbf-445f-aebf-b82144d86ff2 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:15.793437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7454d0bc-5bbf-445f-aebf-b82144d86ff2 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:15.794331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7454d0bc-5bbf-445f-aebf-b82144d86ff2 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:15.795013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7454d0bc-5bbf-445f-aebf-b82144d86ff2 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:15.804154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-abd90709-b21e-437a-9523-d812c87d0312 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:15.818944 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-abd90709-b21e-437a-9523-d812c87d0312 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1512 microversion: 2.1 time: 0.719005 Jan 22 21:23:15.821759 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3241/6798] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:15 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1512 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:16.131485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7454d0bc-5bbf-445f-aebf-b82144d86ff2 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:16.140456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-c6c295b5-f882-492e-867d-50f49b419346 req-7ccc201f-f790-4c5e-9eca-afa03f2883c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12be9a2-2532-4441-94d7-1e38912ebaef", "name": "network-vif-unplugged", "status": "completed", "tag": "072275f1-ea9f-46b7-8332-4cc1cf1c51f3"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:16.142641 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:16.142641 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:23:16.144519 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7454d0bc-5bbf-445f-aebf-b82144d86ff2 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.368349 Jan 22 21:23:16.149133 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3558/6799] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:15 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:23:16.157097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c6c295b5-f882-492e-867d-50f49b419346 req-7ccc201f-f790-4c5e-9eca-afa03f2883c0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:16.157097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c6c295b5-f882-492e-867d-50f49b419346 req-7ccc201f-f790-4c5e-9eca-afa03f2883c0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:16.167462 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-c6c295b5-f882-492e-867d-50f49b419346 req-7ccc201f-f790-4c5e-9eca-afa03f2883c0 service nova] Creating event network-vif-unplugged:072275f1-ea9f-46b7-8332-4cc1cf1c51f3 for instance a12be9a2-2532-4441-94d7-1e38912ebaef on nch1-master-1 Jan 22 21:23:16.172930 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-c6c295b5-f882-492e-867d-50f49b419346 req-7ccc201f-f790-4c5e-9eca-afa03f2883c0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036109 Jan 22 21:23:16.174142 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3242/6800] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:16.304590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aae66645-01a8-42d7-afd6-025696d83abf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:16.305203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aae66645-01a8-42d7-afd6-025696d83abf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:16.316592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aae66645-01a8-42d7-afd6-025696d83abf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:16.318187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aae66645-01a8-42d7-afd6-025696d83abf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:16.318187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aae66645-01a8-42d7-afd6-025696d83abf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:16.318541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aae66645-01a8-42d7-afd6-025696d83abf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:16.370544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-20e091e1-3fea-4f35-b8dd-80ad1289b027 req-2b0a5e44-5ce0-4443-9218-85ddfe63b525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5dabfb-f484-4b09-b45f-b31db980db64", "tag": "8b400a6e-3146-420a-836b-7923996caf46"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:16.382480 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:16.382480 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:23:16.414402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-20e091e1-3fea-4f35-b8dd-80ad1289b027 req-2b0a5e44-5ce0-4443-9218-85ddfe63b525 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:16.416221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-20e091e1-3fea-4f35-b8dd-80ad1289b027 req-2b0a5e44-5ce0-4443-9218-85ddfe63b525 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:16.474690 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-20e091e1-3fea-4f35-b8dd-80ad1289b027 req-2b0a5e44-5ce0-4443-9218-85ddfe63b525 service nova] Creating event network-changed:8b400a6e-3146-420a-836b-7923996caf46 for instance 5f5dabfb-f484-4b09-b45f-b31db980db64 on nch1-master-1 Jan 22 21:23:16.493015 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-20e091e1-3fea-4f35-b8dd-80ad1289b027 req-2b0a5e44-5ce0-4443-9218-85ddfe63b525 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127324 Jan 22 21:23:16.494089 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3243/6801] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:23:16.627882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-31b23176-d94e-4a66-a3c6-945611bea28e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:16.629043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-31b23176-d94e-4a66-a3c6-945611bea28e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:16.652358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31b23176-d94e-4a66-a3c6-945611bea28e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:16.656166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31b23176-d94e-4a66-a3c6-945611bea28e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:16.657355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31b23176-d94e-4a66-a3c6-945611bea28e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:16.668134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31b23176-d94e-4a66-a3c6-945611bea28e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:16.768406 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-31b23176-d94e-4a66-a3c6-945611bea28e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.154429 Jan 22 21:23:16.769677 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3244/6802] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:16 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:17.167665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5d38d0c0-bc22-4bd4-b4db-25889ed09f68 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:17.167665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5d38d0c0-bc22-4bd4-b4db-25889ed09f68 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:17.190409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d38d0c0-bc22-4bd4-b4db-25889ed09f68 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:17.190655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d38d0c0-bc22-4bd4-b4db-25889ed09f68 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:17.191294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d38d0c0-bc22-4bd4-b4db-25889ed09f68 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:17.198375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d38d0c0-bc22-4bd4-b4db-25889ed09f68 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:17.576538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aae66645-01a8-42d7-afd6-025696d83abf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:17.593418 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aae66645-01a8-42d7-afd6-025696d83abf tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 1.292404 Jan 22 21:23:17.594881 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3559/6803] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:16 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:23:17.752347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5d38d0c0-bc22-4bd4-b4db-25889ed09f68 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:17.762756 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5d38d0c0-bc22-4bd4-b4db-25889ed09f68 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.603304 Jan 22 21:23:17.763918 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3245/6804] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:17 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:23:17.780797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f667dd5-71ae-4459-93d8-7b633c65066b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:17.782676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f667dd5-71ae-4459-93d8-7b633c65066b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:17.788827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f667dd5-71ae-4459-93d8-7b633c65066b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:17.789433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f667dd5-71ae-4459-93d8-7b633c65066b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:17.790430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f667dd5-71ae-4459-93d8-7b633c65066b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:17.791063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f667dd5-71ae-4459-93d8-7b633c65066b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:17.842160 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f667dd5-71ae-4459-93d8-7b633c65066b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.064856 Jan 22 21:23:17.843386 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3560/6805] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:17 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:18.301935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-31de9ab8-0b2c-4a4c-9a6c-169ebf0d1730 req-66670fad-3122-4a7a-82cd-6805023d9c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12be9a2-2532-4441-94d7-1e38912ebaef", "tag": "072275f1-ea9f-46b7-8332-4cc1cf1c51f3"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:18.307421 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:18.307421 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:23:18.321091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-31de9ab8-0b2c-4a4c-9a6c-169ebf0d1730 req-66670fad-3122-4a7a-82cd-6805023d9c9d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:18.322200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-31de9ab8-0b2c-4a4c-9a6c-169ebf0d1730 req-66670fad-3122-4a7a-82cd-6805023d9c9d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:18.348176 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-31de9ab8-0b2c-4a4c-9a6c-169ebf0d1730 req-66670fad-3122-4a7a-82cd-6805023d9c9d service nova] Creating event network-changed:072275f1-ea9f-46b7-8332-4cc1cf1c51f3 for instance a12be9a2-2532-4441-94d7-1e38912ebaef on nch1-master-1 Jan 22 21:23:18.356327 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-31de9ab8-0b2c-4a4c-9a6c-169ebf0d1730 req-66670fad-3122-4a7a-82cd-6805023d9c9d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061083 Jan 22 21:23:18.356992 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3246/6806] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:18.615392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c4db562c-320a-4139-b564-2529b439bc6c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:18.619549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c4db562c-320a-4139-b564-2529b439bc6c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:18.637172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4db562c-320a-4139-b564-2529b439bc6c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:18.638112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4db562c-320a-4139-b564-2529b439bc6c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:18.638930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4db562c-320a-4139-b564-2529b439bc6c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:18.639602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4db562c-320a-4139-b564-2529b439bc6c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:18.781682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-65d42303-cd06-4f5d-9872-372f654db243 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:18.782481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-65d42303-cd06-4f5d-9872-372f654db243 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:18.807827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65d42303-cd06-4f5d-9872-372f654db243 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:18.810617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65d42303-cd06-4f5d-9872-372f654db243 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:18.821050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65d42303-cd06-4f5d-9872-372f654db243 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:18.821781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65d42303-cd06-4f5d-9872-372f654db243 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:19.090888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c4db562c-320a-4139-b564-2529b439bc6c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:19.104015 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c4db562c-320a-4139-b564-2529b439bc6c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 0.493149 Jan 22 21:23:19.110552 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3561/6807] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:18 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:19.115722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4e9bb7ee-1c4d-4978-a2ac-07283262b341 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d587d96-e985-4ac3-a9ee-c08c47920b9a"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:19.118634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4e9bb7ee-1c4d-4978-a2ac-07283262b341 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:19.134709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e9bb7ee-1c4d-4978-a2ac-07283262b341 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:19.135604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e9bb7ee-1c4d-4978-a2ac-07283262b341 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:19.136633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e9bb7ee-1c4d-4978-a2ac-07283262b341 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:19.137289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e9bb7ee-1c4d-4978-a2ac-07283262b341 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:19.711908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-65d42303-cd06-4f5d-9872-372f654db243 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:19.717327 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-65d42303-cd06-4f5d-9872-372f654db243 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.940780 Jan 22 21:23:19.721413 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3247/6808] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:18 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:19.729584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a303c844-d702-4864-a2b4-055456921dfc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:19.732259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a303c844-d702-4864-a2b4-055456921dfc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:19.744506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a303c844-d702-4864-a2b4-055456921dfc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:19.745788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a303c844-d702-4864-a2b4-055456921dfc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:19.747338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a303c844-d702-4864-a2b4-055456921dfc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:19.748061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a303c844-d702-4864-a2b4-055456921dfc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:19.810345 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a303c844-d702-4864-a2b4-055456921dfc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.087115 Jan 22 21:23:19.813806 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3248/6809] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:19 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:19.817942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-7d61e145-cf56-4ce4-97fc-e9f09f6f0e59 req-938c5ec9-3767-4401-b58f-c903735be315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12be9a2-2532-4441-94d7-1e38912ebaef", "name": "network-vif-plugged", "status": "completed", "tag": "072275f1-ea9f-46b7-8332-4cc1cf1c51f3"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:19.819784 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:19.819784 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:23:19.829358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7d61e145-cf56-4ce4-97fc-e9f09f6f0e59 req-938c5ec9-3767-4401-b58f-c903735be315 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:19.829888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7d61e145-cf56-4ce4-97fc-e9f09f6f0e59 req-938c5ec9-3767-4401-b58f-c903735be315 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:19.843330 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-7d61e145-cf56-4ce4-97fc-e9f09f6f0e59 req-938c5ec9-3767-4401-b58f-c903735be315 service nova] Creating event network-vif-plugged:072275f1-ea9f-46b7-8332-4cc1cf1c51f3 for instance a12be9a2-2532-4441-94d7-1e38912ebaef on nch1-master-1 Jan 22 21:23:19.851174 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-7d61e145-cf56-4ce4-97fc-e9f09f6f0e59 req-938c5ec9-3767-4401-b58f-c903735be315 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037527 Jan 22 21:23:19.851174 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3249/6810] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:20.135656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c7804477-880d-4424-8e5b-838d7602fe6a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:20.136063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c7804477-880d-4424-8e5b-838d7602fe6a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:20.139873 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4e9bb7ee-1c4d-4978-a2ac-07283262b341 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "POST /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.027141 Jan 22 21:23:20.143223 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3562/6811] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:23:19 2022] POST /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140/os-volume_attachments => generated 194 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:20.157854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7804477-880d-4424-8e5b-838d7602fe6a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:20.160069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7804477-880d-4424-8e5b-838d7602fe6a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:20.163405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7804477-880d-4424-8e5b-838d7602fe6a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:20.164145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7804477-880d-4424-8e5b-838d7602fe6a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:20.741408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad5d4c3b-9fe6-44d6-bd1a-3e39cb6bb9ee tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:20.741408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad5d4c3b-9fe6-44d6-bd1a-3e39cb6bb9ee tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:20.767759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad5d4c3b-9fe6-44d6-bd1a-3e39cb6bb9ee tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:20.767890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad5d4c3b-9fe6-44d6-bd1a-3e39cb6bb9ee tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:20.768755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad5d4c3b-9fe6-44d6-bd1a-3e39cb6bb9ee tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:20.769116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad5d4c3b-9fe6-44d6-bd1a-3e39cb6bb9ee tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:21.205393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c7804477-880d-4424-8e5b-838d7602fe6a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:21.219245 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c7804477-880d-4424-8e5b-838d7602fe6a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 1.093897 Jan 22 21:23:21.220736 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3250/6812] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:20 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:23:21.246642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0038c28d-5bd1-4108-b8eb-22cf2231e86d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:21.251360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ad5d4c3b-9fe6-44d6-bd1a-3e39cb6bb9ee tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:21.251945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0038c28d-5bd1-4108-b8eb-22cf2231e86d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:21.262715 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad5d4c3b-9fe6-44d6-bd1a-3e39cb6bb9ee tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.526186 Jan 22 21:23:21.264398 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3563/6813] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:20 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:23:21.287899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0038c28d-5bd1-4108-b8eb-22cf2231e86d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:21.291532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0038c28d-5bd1-4108-b8eb-22cf2231e86d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:21.291532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0038c28d-5bd1-4108-b8eb-22cf2231e86d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:21.293387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0038c28d-5bd1-4108-b8eb-22cf2231e86d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:21.374605 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0038c28d-5bd1-4108-b8eb-22cf2231e86d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.150466 Jan 22 21:23:21.379436 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3251/6814] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:21 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:22.237062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a2e7407-10cc-4a8f-984d-d6c6f64efde0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:22.238245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a2e7407-10cc-4a8f-984d-d6c6f64efde0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:22.245247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a2e7407-10cc-4a8f-984d-d6c6f64efde0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:22.245951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a2e7407-10cc-4a8f-984d-d6c6f64efde0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:22.247738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a2e7407-10cc-4a8f-984d-d6c6f64efde0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:22.248205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a2e7407-10cc-4a8f-984d-d6c6f64efde0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:22.281683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-adef3f96-8ce5-47de-80fe-c180d7485247 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:22.282541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-adef3f96-8ce5-47de-80fe-c180d7485247 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:22.294830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adef3f96-8ce5-47de-80fe-c180d7485247 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:22.295578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adef3f96-8ce5-47de-80fe-c180d7485247 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:22.297875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adef3f96-8ce5-47de-80fe-c180d7485247 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:22.298660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adef3f96-8ce5-47de-80fe-c180d7485247 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:22.435349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6a2e7407-10cc-4a8f-984d-d6c6f64efde0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:22.446019 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a2e7407-10cc-4a8f-984d-d6c6f64efde0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 0.212247 Jan 22 21:23:22.446830 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3564/6815] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:22 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:22.455039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3d19a6c-82e8-478f-8401-b29247173df3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:22.456726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d3d19a6c-82e8-478f-8401-b29247173df3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:22.467753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3d19a6c-82e8-478f-8401-b29247173df3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:22.470033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3d19a6c-82e8-478f-8401-b29247173df3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:22.471148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3d19a6c-82e8-478f-8401-b29247173df3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:22.471785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3d19a6c-82e8-478f-8401-b29247173df3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:22.530392 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d3d19a6c-82e8-478f-8401-b29247173df3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.079177 Jan 22 21:23:22.531627 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3565/6816] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:22 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:22.740134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-adef3f96-8ce5-47de-80fe-c180d7485247 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:22.766945 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-adef3f96-8ce5-47de-80fe-c180d7485247 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.489772 Jan 22 21:23:22.774685 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3252/6817] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:22 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:23.464864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eb6fd8fe-00c5-49a0-a403-9bad8f3761da tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:23.465398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eb6fd8fe-00c5-49a0-a403-9bad8f3761da tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:23.475410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb6fd8fe-00c5-49a0-a403-9bad8f3761da tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:23.476168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb6fd8fe-00c5-49a0-a403-9bad8f3761da tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:23.477200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb6fd8fe-00c5-49a0-a403-9bad8f3761da tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:23.477831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eb6fd8fe-00c5-49a0-a403-9bad8f3761da tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:23.543610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0589dc19-6ebc-400f-9409-c6069ea71902 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:23.545285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0589dc19-6ebc-400f-9409-c6069ea71902 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:23.553410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0589dc19-6ebc-400f-9409-c6069ea71902 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:23.554179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0589dc19-6ebc-400f-9409-c6069ea71902 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:23.555195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0589dc19-6ebc-400f-9409-c6069ea71902 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:23.555721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0589dc19-6ebc-400f-9409-c6069ea71902 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:23.603227 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0589dc19-6ebc-400f-9409-c6069ea71902 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.062813 Jan 22 21:23:23.604028 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3253/6818] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:23 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:23:23.646877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-eb6fd8fe-00c5-49a0-a403-9bad8f3761da tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:23.655741 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eb6fd8fe-00c5-49a0-a403-9bad8f3761da tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 0.195410 Jan 22 21:23:23.656739 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3566/6819] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:23 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:23.792394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e44c05c4-f054-4ad0-9cb1-572257843ef3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:23.793400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e44c05c4-f054-4ad0-9cb1-572257843ef3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:23.807358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e44c05c4-f054-4ad0-9cb1-572257843ef3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:23.807835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e44c05c4-f054-4ad0-9cb1-572257843ef3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:23.811551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e44c05c4-f054-4ad0-9cb1-572257843ef3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:23.812221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e44c05c4-f054-4ad0-9cb1-572257843ef3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:24.205756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e44c05c4-f054-4ad0-9cb1-572257843ef3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:24.216496 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e44c05c4-f054-4ad0-9cb1-572257843ef3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.428516 Jan 22 21:23:24.217099 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3254/6820] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:23 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:24.618359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-59d04023-7e00-4b49-a3ff-5053b8217d94 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:24.619924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-59d04023-7e00-4b49-a3ff-5053b8217d94 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:24.627257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59d04023-7e00-4b49-a3ff-5053b8217d94 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:24.627710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59d04023-7e00-4b49-a3ff-5053b8217d94 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:24.635709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59d04023-7e00-4b49-a3ff-5053b8217d94 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:24.635709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59d04023-7e00-4b49-a3ff-5053b8217d94 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:24.681295 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-59d04023-7e00-4b49-a3ff-5053b8217d94 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.068454 Jan 22 21:23:24.684481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-366af1de-ff05-4196-92ad-161e491881ed tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:24.689367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-366af1de-ff05-4196-92ad-161e491881ed tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:24.690357 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3567/6821] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:24 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:23:24.708283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-366af1de-ff05-4196-92ad-161e491881ed tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:24.709108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-366af1de-ff05-4196-92ad-161e491881ed tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:24.710154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-366af1de-ff05-4196-92ad-161e491881ed tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:24.710718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-366af1de-ff05-4196-92ad-161e491881ed tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:24.785457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-df82405b-c12a-42b3-af9d-f1f0a1cd2e03 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:24.786359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-df82405b-c12a-42b3-af9d-f1f0a1cd2e03 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:24.795336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df82405b-c12a-42b3-af9d-f1f0a1cd2e03 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:24.796555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df82405b-c12a-42b3-af9d-f1f0a1cd2e03 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:24.797544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df82405b-c12a-42b3-af9d-f1f0a1cd2e03 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:24.798168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df82405b-c12a-42b3-af9d-f1f0a1cd2e03 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:24.895961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-df82405b-c12a-42b3-af9d-f1f0a1cd2e03 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lazy-loading 'services' on Instance uuid 823893cd-c3f3-4951-b57e-190007916140 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:23:24.953920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-366af1de-ff05-4196-92ad-161e491881ed tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:24.961416 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-366af1de-ff05-4196-92ad-161e491881ed tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 0.291075 Jan 22 21:23:24.972629 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3255/6822] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:24 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:23:25.000956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-90381018", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "ed96d77f-abc8-4d67-a986-37c4b82f7f2a"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:25.063386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] validate_networks() for [('ed96d77f-abc8-4d67-a986-37c4b82f7f2a', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:23:25.179451 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-df82405b-c12a-42b3-af9d-f1f0a1cd2e03 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "DELETE /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140/os-volume_attachments/6d587d96-e985-4ac3-a9ee-c08c47920b9a" status: 202 len: 0 microversion: 2.1 time: 0.399042 Jan 22 21:23:25.180686 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3568/6823] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 21:23:24 2022] DELETE /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140/os-volume_attachments/6d587d96-e985-4ac3-a9ee-c08c47920b9a => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:23:25.194012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2102f5c2-6b8c-4ebc-9ac4-c302daaec32e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:25.195154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2102f5c2-6b8c-4ebc-9ac4-c302daaec32e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:25.218741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2102f5c2-6b8c-4ebc-9ac4-c302daaec32e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:25.219509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2102f5c2-6b8c-4ebc-9ac4-c302daaec32e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:25.220409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2102f5c2-6b8c-4ebc-9ac4-c302daaec32e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:25.221514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2102f5c2-6b8c-4ebc-9ac4-c302daaec32e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:25.287450 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2102f5c2-6b8c-4ebc-9ac4-c302daaec32e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101463 Jan 22 21:23:25.293036 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3569/6824] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:23:25 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:23:25.305325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-07eeb53f-1801-4642-9774-7a6520322c77 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:25.306171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-07eeb53f-1801-4642-9774-7a6520322c77 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:25.339313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07eeb53f-1801-4642-9774-7a6520322c77 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:25.343949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07eeb53f-1801-4642-9774-7a6520322c77 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:25.343949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07eeb53f-1801-4642-9774-7a6520322c77 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:25.343949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-07eeb53f-1801-4642-9774-7a6520322c77 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:25.668962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-07eeb53f-1801-4642-9774-7a6520322c77 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:25.679944 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-07eeb53f-1801-4642-9774-7a6520322c77 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.385491 Jan 22 21:23:25.680811 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3570/6825] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:25 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:25.700359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f06f430-3f7c-42e4-8dc5-7e4cb3f52e26 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:25.701340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f06f430-3f7c-42e4-8dc5-7e4cb3f52e26 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:25.713984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f06f430-3f7c-42e4-8dc5-7e4cb3f52e26 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:25.720508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f06f430-3f7c-42e4-8dc5-7e4cb3f52e26 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:25.720508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f06f430-3f7c-42e4-8dc5-7e4cb3f52e26 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:25.720508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f06f430-3f7c-42e4-8dc5-7e4cb3f52e26 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:25.767149 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f06f430-3f7c-42e4-8dc5-7e4cb3f52e26 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.071520 Jan 22 21:23:25.772416 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3571/6826] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:25 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:25.981313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4c5c2b62-aec1-40ff-bd2b-8bf90dc866f0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:25.982303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4c5c2b62-aec1-40ff-bd2b-8bf90dc866f0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:25.990789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c5c2b62-aec1-40ff-bd2b-8bf90dc866f0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:25.991342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c5c2b62-aec1-40ff-bd2b-8bf90dc866f0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:25.992438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c5c2b62-aec1-40ff-bd2b-8bf90dc866f0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:25.993084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c5c2b62-aec1-40ff-bd2b-8bf90dc866f0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:26.045098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:23:26.046403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:23:26.047395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:23:26.048178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:23:26.048883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:23:26.059649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:26.060390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:26.061461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:26.062373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:26.084004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Getting quotas for project 8a97cd2dba7a47729ce29b8973f3bc44. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:23:26.090031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Getting quotas for user bc249e0680014981888b464000ff24fe and project 8a97cd2dba7a47729ce29b8973f3bc44. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:23:26.104964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:23:26.107861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:23:26.190925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4c5c2b62-aec1-40ff-bd2b-8bf90dc866f0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:26.198503 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4c5c2b62-aec1-40ff-bd2b-8bf90dc866f0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 0.221810 Jan 22 21:23:26.199071 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3572/6827] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:25 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:26.288359 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a0fdf4c9-92d9-4385-8c53-0f27da262c11 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.291764 Jan 22 21:23:26.289808 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3256/6828] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:23:24 2022] POST /compute/v2.1/servers => generated 382 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:23:26.299877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1d6da9c3-4b93-406b-bf07-ffce8e14bfb8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:26.300798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1d6da9c3-4b93-406b-bf07-ffce8e14bfb8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:26.309015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9ea8a684-2de8-4793-8758-6ae7769f0b6e tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:26.313201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d6da9c3-4b93-406b-bf07-ffce8e14bfb8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:26.313898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d6da9c3-4b93-406b-bf07-ffce8e14bfb8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:26.316618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9ea8a684-2de8-4793-8758-6ae7769f0b6e tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:26.316971 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d6da9c3-4b93-406b-bf07-ffce8e14bfb8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:26.318068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d6da9c3-4b93-406b-bf07-ffce8e14bfb8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:26.376396 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1d6da9c3-4b93-406b-bf07-ffce8e14bfb8 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081187 Jan 22 21:23:26.385226 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3573/6829] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:23:26 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:26.442770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9ea8a684-2de8-4793-8758-6ae7769f0b6e tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:26.450395 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9ea8a684-2de8-4793-8758-6ae7769f0b6e tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1216 microversion: 2.1 time: 0.145164 Jan 22 21:23:26.455558 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3257/6830] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:26 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:26.699525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1e73103b-7051-494b-a0b2-25d3c1bb8169 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:26.701076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1e73103b-7051-494b-a0b2-25d3c1bb8169 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:26.722876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e73103b-7051-494b-a0b2-25d3c1bb8169 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:26.726240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e73103b-7051-494b-a0b2-25d3c1bb8169 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:26.728803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e73103b-7051-494b-a0b2-25d3c1bb8169 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:26.731651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e73103b-7051-494b-a0b2-25d3c1bb8169 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:26.783426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ecb18b9-59fb-4004-b34c-e569552641b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:26.785113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1ecb18b9-59fb-4004-b34c-e569552641b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:26.797414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ecb18b9-59fb-4004-b34c-e569552641b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:26.798413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ecb18b9-59fb-4004-b34c-e569552641b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:26.800826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ecb18b9-59fb-4004-b34c-e569552641b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:26.801544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ecb18b9-59fb-4004-b34c-e569552641b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:26.851263 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1ecb18b9-59fb-4004-b34c-e569552641b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.074799 Jan 22 21:23:26.853230 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3258/6831] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:26 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:27.067544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1e73103b-7051-494b-a0b2-25d3c1bb8169 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:27.080833 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1e73103b-7051-494b-a0b2-25d3c1bb8169 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.380481 Jan 22 21:23:27.082020 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3574/6832] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:26 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:27.216010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0da502e3-1120-4158-a58c-c05dead595f1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:27.216774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0da502e3-1120-4158-a58c-c05dead595f1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:27.226002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0da502e3-1120-4158-a58c-c05dead595f1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:27.226002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0da502e3-1120-4158-a58c-c05dead595f1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:27.226520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0da502e3-1120-4158-a58c-c05dead595f1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:27.226969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0da502e3-1120-4158-a58c-c05dead595f1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:27.397123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e0f82d84-cda3-4566-b2d9-29d8c8c57fd2 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:27.398179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e0f82d84-cda3-4566-b2d9-29d8c8c57fd2 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:27.405116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0f82d84-cda3-4566-b2d9-29d8c8c57fd2 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:27.406604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0f82d84-cda3-4566-b2d9-29d8c8c57fd2 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:27.407530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0f82d84-cda3-4566-b2d9-29d8c8c57fd2 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:27.408182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0f82d84-cda3-4566-b2d9-29d8c8c57fd2 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:27.408426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0da502e3-1120-4158-a58c-c05dead595f1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:27.418037 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0da502e3-1120-4158-a58c-c05dead595f1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 0.205304 Jan 22 21:23:27.418037 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3259/6833] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:27 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:27.439298 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e0f82d84-cda3-4566-b2d9-29d8c8c57fd2 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046217 Jan 22 21:23:27.439961 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3575/6834] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:23:27 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:23:27.474214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0abff65c-f9d6-40a8-b2d7-8aec4e28a430 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:27.474946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0abff65c-f9d6-40a8-b2d7-8aec4e28a430 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:27.533885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0abff65c-f9d6-40a8-b2d7-8aec4e28a430 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:27.542499 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0abff65c-f9d6-40a8-b2d7-8aec4e28a430 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1216 microversion: 2.1 time: 0.073875 Jan 22 21:23:27.543731 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3260/6835] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:27 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:27.864869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0c83bef0-640a-48bd-afba-0a263083b7aa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:27.865805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0c83bef0-640a-48bd-afba-0a263083b7aa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:27.872273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c83bef0-640a-48bd-afba-0a263083b7aa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:27.872720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c83bef0-640a-48bd-afba-0a263083b7aa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:27.873537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c83bef0-640a-48bd-afba-0a263083b7aa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:27.873974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c83bef0-640a-48bd-afba-0a263083b7aa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:27.921369 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0c83bef0-640a-48bd-afba-0a263083b7aa tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.059855 Jan 22 21:23:27.925411 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3576/6836] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:27 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:23:28.098716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8d02ad47-4209-4265-8dc8-9bb9e2f03865 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:28.099334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8d02ad47-4209-4265-8dc8-9bb9e2f03865 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:28.106430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d02ad47-4209-4265-8dc8-9bb9e2f03865 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:28.106887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d02ad47-4209-4265-8dc8-9bb9e2f03865 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:28.107716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d02ad47-4209-4265-8dc8-9bb9e2f03865 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:28.108181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d02ad47-4209-4265-8dc8-9bb9e2f03865 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:28.292052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8d02ad47-4209-4265-8dc8-9bb9e2f03865 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:28.300642 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8d02ad47-4209-4265-8dc8-9bb9e2f03865 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.206056 Jan 22 21:23:28.301459 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3261/6837] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:28 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:28.435601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-04cb8628-a367-4b06-8661-03cd30f2d543 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:28.437726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-04cb8628-a367-4b06-8661-03cd30f2d543 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:28.443752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04cb8628-a367-4b06-8661-03cd30f2d543 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:28.444218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04cb8628-a367-4b06-8661-03cd30f2d543 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:28.445015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04cb8628-a367-4b06-8661-03cd30f2d543 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:28.445463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04cb8628-a367-4b06-8661-03cd30f2d543 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:28.567626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d702f8ff-40b8-4fdb-947b-67c64ade4cd3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:28.571676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d702f8ff-40b8-4fdb-947b-67c64ade4cd3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:28.588820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d702f8ff-40b8-4fdb-947b-67c64ade4cd3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:28.589309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d702f8ff-40b8-4fdb-947b-67c64ade4cd3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:28.590209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d702f8ff-40b8-4fdb-947b-67c64ade4cd3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:28.590666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d702f8ff-40b8-4fdb-947b-67c64ade4cd3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:28.634610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-04cb8628-a367-4b06-8661-03cd30f2d543 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:28.648615 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-04cb8628-a367-4b06-8661-03cd30f2d543 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 0.216671 Jan 22 21:23:28.649440 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3577/6838] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:28 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:28.684798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d702f8ff-40b8-4fdb-947b-67c64ade4cd3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:28.712068 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d702f8ff-40b8-4fdb-947b-67c64ade4cd3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1268 microversion: 2.1 time: 0.154986 Jan 22 21:23:28.713204 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3262/6839] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:28 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:28.938548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a9f8ce96-45bc-4f74-8633-feb6263398cf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:28.939703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a9f8ce96-45bc-4f74-8633-feb6263398cf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:28.948516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9f8ce96-45bc-4f74-8633-feb6263398cf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:28.949647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9f8ce96-45bc-4f74-8633-feb6263398cf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:28.950722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9f8ce96-45bc-4f74-8633-feb6263398cf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:28.951382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9f8ce96-45bc-4f74-8633-feb6263398cf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:29.028614 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a9f8ce96-45bc-4f74-8633-feb6263398cf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.095611 Jan 22 21:23:29.031903 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3578/6840] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:28 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:29.270226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-41d06c5b-0ff9-44ff-8a96-9b2cfb72606c req-04b65a68-ce29-46ea-a8c9-5b7506cc3ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5dabfb-f484-4b09-b45f-b31db980db64", "name": "network-vif-plugged", "status": "completed", "tag": "8b400a6e-3146-420a-836b-7923996caf46"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:29.273941 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:29.273941 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:23:29.285158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-41d06c5b-0ff9-44ff-8a96-9b2cfb72606c req-04b65a68-ce29-46ea-a8c9-5b7506cc3ce2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:29.286211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-41d06c5b-0ff9-44ff-8a96-9b2cfb72606c req-04b65a68-ce29-46ea-a8c9-5b7506cc3ce2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:29.303230 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-41d06c5b-0ff9-44ff-8a96-9b2cfb72606c req-04b65a68-ce29-46ea-a8c9-5b7506cc3ce2 service nova] Creating event network-vif-plugged:8b400a6e-3146-420a-836b-7923996caf46 for instance 5f5dabfb-f484-4b09-b45f-b31db980db64 on nch1-master-1 Jan 22 21:23:29.308722 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-41d06c5b-0ff9-44ff-8a96-9b2cfb72606c req-04b65a68-ce29-46ea-a8c9-5b7506cc3ce2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047457 Jan 22 21:23:29.310062 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3263/6841] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:29.320042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ff2f711c-e2b8-47f3-b63a-4485679591f3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:29.321247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ff2f711c-e2b8-47f3-b63a-4485679591f3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:29.330542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff2f711c-e2b8-47f3-b63a-4485679591f3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:29.335328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff2f711c-e2b8-47f3-b63a-4485679591f3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:29.335328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff2f711c-e2b8-47f3-b63a-4485679591f3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:29.335328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff2f711c-e2b8-47f3-b63a-4485679591f3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:29.667544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-712ad0a4-7a59-48ba-9408-2970af6aee69 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:29.668746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-712ad0a4-7a59-48ba-9408-2970af6aee69 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:29.677681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-712ad0a4-7a59-48ba-9408-2970af6aee69 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:29.678385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-712ad0a4-7a59-48ba-9408-2970af6aee69 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:29.680112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-712ad0a4-7a59-48ba-9408-2970af6aee69 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:29.680730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-712ad0a4-7a59-48ba-9408-2970af6aee69 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:29.809561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ff2f711c-e2b8-47f3-b63a-4485679591f3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:29.824420 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ff2f711c-e2b8-47f3-b63a-4485679591f3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.509156 Jan 22 21:23:29.826106 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3579/6842] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:29 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:29.834109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d59a1d41-b2d5-4e80-9418-1b8a05359215 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:29.836477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d59a1d41-b2d5-4e80-9418-1b8a05359215 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:29.843999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d59a1d41-b2d5-4e80-9418-1b8a05359215 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:29.844738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d59a1d41-b2d5-4e80-9418-1b8a05359215 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:29.846388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d59a1d41-b2d5-4e80-9418-1b8a05359215 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:29.860280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d59a1d41-b2d5-4e80-9418-1b8a05359215 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:30.000226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d59a1d41-b2d5-4e80-9418-1b8a05359215 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:30.019007 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d59a1d41-b2d5-4e80-9418-1b8a05359215 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1274 microversion: 2.1 time: 0.190169 Jan 22 21:23:30.020036 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3580/6843] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:29 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:30.047974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a3ade21b-2737-4320-ade7-960133927471 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:30.050293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a3ade21b-2737-4320-ade7-960133927471 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:30.067029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3ade21b-2737-4320-ade7-960133927471 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:30.067790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3ade21b-2737-4320-ade7-960133927471 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:30.069003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3ade21b-2737-4320-ade7-960133927471 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:30.072675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3ade21b-2737-4320-ade7-960133927471 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:30.099226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-712ad0a4-7a59-48ba-9408-2970af6aee69 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:30.114422 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-712ad0a4-7a59-48ba-9408-2970af6aee69 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 0.451010 Jan 22 21:23:30.115715 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3264/6844] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:29 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:30.152043 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a3ade21b-2737-4320-ade7-960133927471 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.113482 Jan 22 21:23:30.152718 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3581/6845] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:30 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:30.844316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a63fd7b2-dd4a-43e6-b08d-3e9067fb7312 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:30.844938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a63fd7b2-dd4a-43e6-b08d-3e9067fb7312 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:30.857594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a63fd7b2-dd4a-43e6-b08d-3e9067fb7312 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:30.858307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a63fd7b2-dd4a-43e6-b08d-3e9067fb7312 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:30.861403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a63fd7b2-dd4a-43e6-b08d-3e9067fb7312 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:30.866195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a63fd7b2-dd4a-43e6-b08d-3e9067fb7312 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:31.041733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7686a4f1-5e13-4e8c-91aa-b4738b69e8c6 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:31.042396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7686a4f1-5e13-4e8c-91aa-b4738b69e8c6 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:31.051128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7686a4f1-5e13-4e8c-91aa-b4738b69e8c6 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:31.052529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7686a4f1-5e13-4e8c-91aa-b4738b69e8c6 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:31.053608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7686a4f1-5e13-4e8c-91aa-b4738b69e8c6 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:31.054403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7686a4f1-5e13-4e8c-91aa-b4738b69e8c6 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:31.183971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a63fd7b2-dd4a-43e6-b08d-3e9067fb7312 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:31.196853 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a63fd7b2-dd4a-43e6-b08d-3e9067fb7312 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.356964 Jan 22 21:23:31.212249 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3265/6846] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:30 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:31.221713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5e35b050-5741-4519-8f7d-855b943d2feb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:31.222701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5e35b050-5741-4519-8f7d-855b943d2feb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:31.240243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e35b050-5741-4519-8f7d-855b943d2feb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:31.241141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e35b050-5741-4519-8f7d-855b943d2feb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:31.242257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e35b050-5741-4519-8f7d-855b943d2feb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:31.243059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e35b050-5741-4519-8f7d-855b943d2feb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:31.369999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7686a4f1-5e13-4e8c-91aa-b4738b69e8c6 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:31.383788 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7686a4f1-5e13-4e8c-91aa-b4738b69e8c6 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1316 microversion: 2.1 time: 0.345152 Jan 22 21:23:31.393660 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3582/6847] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:31 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:31.407012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-977e4a91-b870-4426-bc27-8cb4993033fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:31.408069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-977e4a91-b870-4426-bc27-8cb4993033fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:31.426547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-977e4a91-b870-4426-bc27-8cb4993033fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:31.426991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-977e4a91-b870-4426-bc27-8cb4993033fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:31.427731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-977e4a91-b870-4426-bc27-8cb4993033fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:31.428180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-977e4a91-b870-4426-bc27-8cb4993033fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:31.493118 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-977e4a91-b870-4426-bc27-8cb4993033fe tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.093978 Jan 22 21:23:31.494372 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3583/6848] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:31 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:31.502727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-f2d223b6-a1ad-49f2-9d43-df27cf2e6807 req-0881f2d7-dfbc-459e-8a7c-7503662dda57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5dabfb-f484-4b09-b45f-b31db980db64", "name": "network-vif-plugged", "status": "completed", "tag": "43cc5dcd-7f91-417e-a1f5-fea90214a7b4"}, {"server_uuid": "5f5dabfb-f484-4b09-b45f-b31db980db64", "name": "network-vif-plugged", "status": "completed", "tag": "b4ffbbd7-26e1-4f22-95b4-c8670632f290"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:31.506584 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:31.506584 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:23:31.510096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5e35b050-5741-4519-8f7d-855b943d2feb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:31.521095 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5e35b050-5741-4519-8f7d-855b943d2feb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 0.305956 Jan 22 21:23:31.521946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f2d223b6-a1ad-49f2-9d43-df27cf2e6807 req-0881f2d7-dfbc-459e-8a7c-7503662dda57 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:31.521946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f2d223b6-a1ad-49f2-9d43-df27cf2e6807 req-0881f2d7-dfbc-459e-8a7c-7503662dda57 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:31.522736 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3266/6849] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:31 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:31.540825 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f2d223b6-a1ad-49f2-9d43-df27cf2e6807 req-0881f2d7-dfbc-459e-8a7c-7503662dda57 service nova] Creating event network-vif-plugged:43cc5dcd-7f91-417e-a1f5-fea90214a7b4 for instance 5f5dabfb-f484-4b09-b45f-b31db980db64 on nch1-master-1 Jan 22 21:23:31.541891 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f2d223b6-a1ad-49f2-9d43-df27cf2e6807 req-0881f2d7-dfbc-459e-8a7c-7503662dda57 service nova] Creating event network-vif-plugged:b4ffbbd7-26e1-4f22-95b4-c8670632f290 for instance 5f5dabfb-f484-4b09-b45f-b31db980db64 on nch1-master-1 Jan 22 21:23:31.549221 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-f2d223b6-a1ad-49f2-9d43-df27cf2e6807 req-0881f2d7-dfbc-459e-8a7c-7503662dda57 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051950 Jan 22 21:23:31.550012 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3584/6850] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:32.215376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-704aceb6-2bbe-44a0-b9fe-565dada6740c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:32.217267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-704aceb6-2bbe-44a0-b9fe-565dada6740c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:32.238909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-704aceb6-2bbe-44a0-b9fe-565dada6740c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:32.239593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-704aceb6-2bbe-44a0-b9fe-565dada6740c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:32.241343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-704aceb6-2bbe-44a0-b9fe-565dada6740c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:32.242006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-704aceb6-2bbe-44a0-b9fe-565dada6740c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:32.404266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-350f9f07-ccfd-44cc-8c0e-cdfca6eeb524 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:32.405025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-350f9f07-ccfd-44cc-8c0e-cdfca6eeb524 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:32.416391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-350f9f07-ccfd-44cc-8c0e-cdfca6eeb524 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:32.416841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-350f9f07-ccfd-44cc-8c0e-cdfca6eeb524 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:32.417683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-350f9f07-ccfd-44cc-8c0e-cdfca6eeb524 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:32.418137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-350f9f07-ccfd-44cc-8c0e-cdfca6eeb524 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:32.629816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-704aceb6-2bbe-44a0-b9fe-565dada6740c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:32.637437 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-704aceb6-2bbe-44a0-b9fe-565dada6740c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1359 microversion: 2.1 time: 0.426020 Jan 22 21:23:32.638054 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3267/6851] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:32 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1359 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:32.649334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2145f765-1ac8-45a9-b2b0-fa3c7ab6c209 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:32.663393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2145f765-1ac8-45a9-b2b0-fa3c7ab6c209 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:32.699299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2145f765-1ac8-45a9-b2b0-fa3c7ab6c209 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:32.699776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2145f765-1ac8-45a9-b2b0-fa3c7ab6c209 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:32.700659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2145f765-1ac8-45a9-b2b0-fa3c7ab6c209 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:32.701061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2145f765-1ac8-45a9-b2b0-fa3c7ab6c209 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:32.806898 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2145f765-1ac8-45a9-b2b0-fa3c7ab6c209 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.161068 Jan 22 21:23:32.808281 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3268/6852] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:32 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:32.813990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4c4e3e15-d9be-48d7-86a2-304f1152e15b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:32.818884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-350f9f07-ccfd-44cc-8c0e-cdfca6eeb524 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:32.819124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4c4e3e15-d9be-48d7-86a2-304f1152e15b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:32.827781 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-350f9f07-ccfd-44cc-8c0e-cdfca6eeb524 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1316 microversion: 2.1 time: 0.428558 Jan 22 21:23:32.847005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c4e3e15-d9be-48d7-86a2-304f1152e15b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:32.847005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c4e3e15-d9be-48d7-86a2-304f1152e15b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:32.847005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c4e3e15-d9be-48d7-86a2-304f1152e15b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:32.847005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c4e3e15-d9be-48d7-86a2-304f1152e15b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:32.848170 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3585/6853] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:32 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:23:32.867974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-84218665-0b5e-4150-8cde-f067d9e81fa5 req-6a18f409-86dd-41bd-bda8-355b7bbfe63c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12be9a2-2532-4441-94d7-1e38912ebaef", "name": "network-vif-unplugged", "status": "completed", "tag": "072275f1-ea9f-46b7-8332-4cc1cf1c51f3"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:32.870499 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:32.870499 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:23:32.884901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-84218665-0b5e-4150-8cde-f067d9e81fa5 req-6a18f409-86dd-41bd-bda8-355b7bbfe63c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:32.886966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-84218665-0b5e-4150-8cde-f067d9e81fa5 req-6a18f409-86dd-41bd-bda8-355b7bbfe63c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:32.910858 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-84218665-0b5e-4150-8cde-f067d9e81fa5 req-6a18f409-86dd-41bd-bda8-355b7bbfe63c service nova] Creating event network-vif-unplugged:072275f1-ea9f-46b7-8332-4cc1cf1c51f3 for instance a12be9a2-2532-4441-94d7-1e38912ebaef on nch1-master-1 Jan 22 21:23:32.916923 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-84218665-0b5e-4150-8cde-f067d9e81fa5 req-6a18f409-86dd-41bd-bda8-355b7bbfe63c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073200 Jan 22 21:23:32.918153 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3586/6854] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:33.411437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4c4e3e15-d9be-48d7-86a2-304f1152e15b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:33.421540 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4c4e3e15-d9be-48d7-86a2-304f1152e15b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 0.611092 Jan 22 21:23:33.422812 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3269/6855] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:32 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:33.649576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-454c1d17-42e1-4546-ad77-3ade860e6118 req-4d899e31-39bf-480d-afd7-642bffbfd56a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d45478b2-2111-4644-a1c1-609e88b42d1c", "tag": "90a69713-d872-4a2f-aa0b-b9a4b9c625d0"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:33.652568 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:33.652568 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:23:33.653830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-71f54e63-6915-4d1d-8f60-81bb27c049e6 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:33.656307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-71f54e63-6915-4d1d-8f60-81bb27c049e6 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:33.660818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-454c1d17-42e1-4546-ad77-3ade860e6118 req-4d899e31-39bf-480d-afd7-642bffbfd56a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:33.661482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-454c1d17-42e1-4546-ad77-3ade860e6118 req-4d899e31-39bf-480d-afd7-642bffbfd56a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:33.663876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71f54e63-6915-4d1d-8f60-81bb27c049e6 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:33.664295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71f54e63-6915-4d1d-8f60-81bb27c049e6 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:33.665658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71f54e63-6915-4d1d-8f60-81bb27c049e6 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:33.666579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71f54e63-6915-4d1d-8f60-81bb27c049e6 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:33.677010 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-454c1d17-42e1-4546-ad77-3ade860e6118 req-4d899e31-39bf-480d-afd7-642bffbfd56a service nova] Creating event network-changed:90a69713-d872-4a2f-aa0b-b9a4b9c625d0 for instance d45478b2-2111-4644-a1c1-609e88b42d1c on nch2-master-1 Jan 22 21:23:33.684805 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-454c1d17-42e1-4546-ad77-3ade860e6118 req-4d899e31-39bf-480d-afd7-642bffbfd56a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186268 Jan 22 21:23:33.687800 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3587/6856] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:33.820034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f3507924-2bd9-4b65-a16b-09f5ebe1a62f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:33.821611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f3507924-2bd9-4b65-a16b-09f5ebe1a62f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:33.831809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3507924-2bd9-4b65-a16b-09f5ebe1a62f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:33.834636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3507924-2bd9-4b65-a16b-09f5ebe1a62f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:33.836968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3507924-2bd9-4b65-a16b-09f5ebe1a62f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:33.838197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3507924-2bd9-4b65-a16b-09f5ebe1a62f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:33.940713 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f3507924-2bd9-4b65-a16b-09f5ebe1a62f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.124875 Jan 22 21:23:33.942120 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3588/6857] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:33 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:33.950488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-000a62a0-96b8-43f8-bfaa-f88f2639be5b tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:33.951548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-000a62a0-96b8-43f8-bfaa-f88f2639be5b tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:33.969561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-000a62a0-96b8-43f8-bfaa-f88f2639be5b tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:33.972401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-000a62a0-96b8-43f8-bfaa-f88f2639be5b tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:33.973318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-000a62a0-96b8-43f8-bfaa-f88f2639be5b tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:33.973812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-000a62a0-96b8-43f8-bfaa-f88f2639be5b tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:34.217551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-71f54e63-6915-4d1d-8f60-81bb27c049e6 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:34.229788 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-71f54e63-6915-4d1d-8f60-81bb27c049e6 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1809 microversion: 2.1 time: 0.580100 Jan 22 21:23:34.234625 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3270/6858] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:33 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1809 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:23:34.254077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5fc855bd-5d9a-49cf-956e-38146d9d7775 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:34.255061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5fc855bd-5d9a-49cf-956e-38146d9d7775 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:34.278856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fc855bd-5d9a-49cf-956e-38146d9d7775 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:34.282445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fc855bd-5d9a-49cf-956e-38146d9d7775 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:34.288428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fc855bd-5d9a-49cf-956e-38146d9d7775 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:34.289304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fc855bd-5d9a-49cf-956e-38146d9d7775 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:34.359572 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5fc855bd-5d9a-49cf-956e-38146d9d7775 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64/ips" status: 200 len: 218 microversion: 2.1 time: 0.111217 Jan 22 21:23:34.370045 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3271/6859] 10.222.0.100 () {58 vars in 1252 bytes} [Sat Jan 22 21:23:34 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64/ips => generated 218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:34.398469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6c014cdf-773f-432a-ba71-fbb963e84435 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:34.399954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6c014cdf-773f-432a-ba71-fbb963e84435 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:34.411289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c014cdf-773f-432a-ba71-fbb963e84435 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:34.412117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c014cdf-773f-432a-ba71-fbb963e84435 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:34.414710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c014cdf-773f-432a-ba71-fbb963e84435 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:34.415471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6c014cdf-773f-432a-ba71-fbb963e84435 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:34.428116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-000a62a0-96b8-43f8-bfaa-f88f2639be5b tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:34.439002 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-000a62a0-96b8-43f8-bfaa-f88f2639be5b tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1316 microversion: 2.1 time: 0.495180 Jan 22 21:23:34.441364 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3589/6860] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:33 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1316 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:34.446112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f0925b8c-0ebb-4b56-a5c4-a608e2b8c080 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:34.447191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f0925b8c-0ebb-4b56-a5c4-a608e2b8c080 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:34.456457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0925b8c-0ebb-4b56-a5c4-a608e2b8c080 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:34.457276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0925b8c-0ebb-4b56-a5c4-a608e2b8c080 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:34.458315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0925b8c-0ebb-4b56-a5c4-a608e2b8c080 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:34.459097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0925b8c-0ebb-4b56-a5c4-a608e2b8c080 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:34.476993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6c014cdf-773f-432a-ba71-fbb963e84435 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:23:34.878774 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6c014cdf-773f-432a-ba71-fbb963e84435 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 204 len: 0 microversion: 2.1 time: 0.484799 Jan 22 21:23:34.879761 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3272/6861] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:23:34 2022] DELETE /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:23:34.890034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f67f3581-f3eb-4144-9822-4d7949cab7b5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:34.890034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f67f3581-f3eb-4144-9822-4d7949cab7b5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:34.899141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f0925b8c-0ebb-4b56-a5c4-a608e2b8c080 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:34.904373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f67f3581-f3eb-4144-9822-4d7949cab7b5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:34.905060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f67f3581-f3eb-4144-9822-4d7949cab7b5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:34.906700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f67f3581-f3eb-4144-9822-4d7949cab7b5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:34.907165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f67f3581-f3eb-4144-9822-4d7949cab7b5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:34.919352 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f0925b8c-0ebb-4b56-a5c4-a608e2b8c080 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 0.477597 Jan 22 21:23:34.922365 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3590/6862] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:34 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:34.955000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f647c1db-b585-4249-958a-7f637acf881d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:34.955000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f647c1db-b585-4249-958a-7f637acf881d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:34.965118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f647c1db-b585-4249-958a-7f637acf881d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:34.972517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f647c1db-b585-4249-958a-7f637acf881d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:34.977661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f647c1db-b585-4249-958a-7f637acf881d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:34.977661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f647c1db-b585-4249-958a-7f637acf881d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:35.063992 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f647c1db-b585-4249-958a-7f637acf881d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.113567 Jan 22 21:23:35.068581 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3591/6863] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:34 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:35.415688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-182459e9-54ca-4b67-b94f-ea114192a862 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:35.416278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-182459e9-54ca-4b67-b94f-ea114192a862 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:35.424244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-182459e9-54ca-4b67-b94f-ea114192a862 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:35.424992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-182459e9-54ca-4b67-b94f-ea114192a862 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:35.425996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-182459e9-54ca-4b67-b94f-ea114192a862 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:35.426602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-182459e9-54ca-4b67-b94f-ea114192a862 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:35.480319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-182459e9-54ca-4b67-b94f-ea114192a862 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:23:35.840822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f67f3581-f3eb-4144-9822-4d7949cab7b5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:35.850307 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f67f3581-f3eb-4144-9822-4d7949cab7b5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1815 microversion: 2.1 time: 0.966163 Jan 22 21:23:35.855117 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3273/6864] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:34 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1815 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:23:35.862059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5e834b08-29aa-43f7-aa03-7e6004df7140 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:35.868497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5e834b08-29aa-43f7-aa03-7e6004df7140 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:35.877237 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-182459e9-54ca-4b67-b94f-ea114192a862 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "DELETE /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 204 len: 0 microversion: 2.1 time: 0.465285 Jan 22 21:23:35.885458 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3592/6865] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:23:35 2022] DELETE /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:23:35.895155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-473d3283-5a97-4781-aed8-e46183ed6b52 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:35.898252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e834b08-29aa-43f7-aa03-7e6004df7140 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:35.899281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-473d3283-5a97-4781-aed8-e46183ed6b52 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:35.901867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e834b08-29aa-43f7-aa03-7e6004df7140 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:35.903394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e834b08-29aa-43f7-aa03-7e6004df7140 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:35.907054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e834b08-29aa-43f7-aa03-7e6004df7140 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:35.918590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-473d3283-5a97-4781-aed8-e46183ed6b52 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:35.925455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-473d3283-5a97-4781-aed8-e46183ed6b52 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:35.927463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-473d3283-5a97-4781-aed8-e46183ed6b52 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:35.928610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-473d3283-5a97-4781-aed8-e46183ed6b52 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:36.169816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5e834b08-29aa-43f7-aa03-7e6004df7140 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:36.181890 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5e834b08-29aa-43f7-aa03-7e6004df7140 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1316 microversion: 2.1 time: 0.325184 Jan 22 21:23:36.184178 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3274/6866] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:35 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:36.190417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-175bb194-886a-4f93-a98e-d2e50037b71b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:36.191288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-175bb194-886a-4f93-a98e-d2e50037b71b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:36.207897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-175bb194-886a-4f93-a98e-d2e50037b71b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:36.207897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-175bb194-886a-4f93-a98e-d2e50037b71b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:36.210519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-175bb194-886a-4f93-a98e-d2e50037b71b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:36.211068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-175bb194-886a-4f93-a98e-d2e50037b71b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:36.434755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-175bb194-886a-4f93-a98e-d2e50037b71b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:36.446334 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-175bb194-886a-4f93-a98e-d2e50037b71b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1692 microversion: 2.1 time: 0.260148 Jan 22 21:23:36.447675 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3275/6867] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:36 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1692 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:36.453287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d95bddc4-005c-4b9e-855e-2c4b4762e02d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:36.454592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d95bddc4-005c-4b9e-855e-2c4b4762e02d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:36.462398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d95bddc4-005c-4b9e-855e-2c4b4762e02d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:36.462995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d95bddc4-005c-4b9e-855e-2c4b4762e02d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:36.463933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d95bddc4-005c-4b9e-855e-2c4b4762e02d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:36.464491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d95bddc4-005c-4b9e-855e-2c4b4762e02d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:36.518296 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d95bddc4-005c-4b9e-855e-2c4b4762e02d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.068994 Jan 22 21:23:36.519158 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3276/6868] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:36 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:36.585570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-473d3283-5a97-4781-aed8-e46183ed6b52 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:36.598528 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-473d3283-5a97-4781-aed8-e46183ed6b52 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1518 microversion: 2.1 time: 0.710327 Jan 22 21:23:36.609344 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3593/6869] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:35 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1518 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:36.885128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f06323d5-ad48-4798-ba2c-f739880da975 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:36.887248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f06323d5-ad48-4798-ba2c-f739880da975 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:36.895961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06323d5-ad48-4798-ba2c-f739880da975 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:36.896130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06323d5-ad48-4798-ba2c-f739880da975 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:36.897055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06323d5-ad48-4798-ba2c-f739880da975 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:36.898192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06323d5-ad48-4798-ba2c-f739880da975 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:37.200837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0f77c6d7-591c-4f14-abe2-46f8dc159ce8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:37.201453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0f77c6d7-591c-4f14-abe2-46f8dc159ce8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:37.212402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f77c6d7-591c-4f14-abe2-46f8dc159ce8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:37.213172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f77c6d7-591c-4f14-abe2-46f8dc159ce8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:37.216425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f77c6d7-591c-4f14-abe2-46f8dc159ce8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:37.217135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f77c6d7-591c-4f14-abe2-46f8dc159ce8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:37.260859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f06323d5-ad48-4798-ba2c-f739880da975 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:37.272750 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f06323d5-ad48-4798-ba2c-f739880da975 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1815 microversion: 2.1 time: 0.400013 Jan 22 21:23:37.273938 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3277/6870] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:36 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1815 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:37.466201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3430da94-18e5-4629-a112-18d9e907e1b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:37.467153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3430da94-18e5-4629-a112-18d9e907e1b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:37.474565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3430da94-18e5-4629-a112-18d9e907e1b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:37.475306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3430da94-18e5-4629-a112-18d9e907e1b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:37.476125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3430da94-18e5-4629-a112-18d9e907e1b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:37.476569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3430da94-18e5-4629-a112-18d9e907e1b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:37.527454 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3430da94-18e5-4629-a112-18d9e907e1b9 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.071017 Jan 22 21:23:37.533455 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3278/6871] 10.222.0.100 () {60 vars in 1347 bytes} [Sat Jan 22 21:23:37 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:37.538603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7ebbabc6-8f6c-4f38-8df0-3b40ad19c959 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:37.539455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7ebbabc6-8f6c-4f38-8df0-3b40ad19c959 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:37.547230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ebbabc6-8f6c-4f38-8df0-3b40ad19c959 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:37.547909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ebbabc6-8f6c-4f38-8df0-3b40ad19c959 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:37.549160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ebbabc6-8f6c-4f38-8df0-3b40ad19c959 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:37.549793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ebbabc6-8f6c-4f38-8df0-3b40ad19c959 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:37.759898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7ebbabc6-8f6c-4f38-8df0-3b40ad19c959 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:37.768655 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7ebbabc6-8f6c-4f38-8df0-3b40ad19c959 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1682 microversion: 2.1 time: 0.233589 Jan 22 21:23:37.781295 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3279/6872] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:37 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:37.781295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-be67b9e7-ca67-4ef1-a397-6322a09e107f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:37.786016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-be67b9e7-ca67-4ef1-a397-6322a09e107f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:37.793876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be67b9e7-ca67-4ef1-a397-6322a09e107f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:37.794442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be67b9e7-ca67-4ef1-a397-6322a09e107f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:37.795411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be67b9e7-ca67-4ef1-a397-6322a09e107f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:37.795968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be67b9e7-ca67-4ef1-a397-6322a09e107f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:37.857019 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-be67b9e7-ca67-4ef1-a397-6322a09e107f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.082164 Jan 22 21:23:37.858048 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3280/6873] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:37 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:37.867831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-93f2efbd-b5ce-4da1-81b7-fb5e3c6b170e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:37.876082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-93f2efbd-b5ce-4da1-81b7-fb5e3c6b170e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:37.901005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93f2efbd-b5ce-4da1-81b7-fb5e3c6b170e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:37.906931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93f2efbd-b5ce-4da1-81b7-fb5e3c6b170e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:37.911232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93f2efbd-b5ce-4da1-81b7-fb5e3c6b170e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:37.911944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93f2efbd-b5ce-4da1-81b7-fb5e3c6b170e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:37.973057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-93f2efbd-b5ce-4da1-81b7-fb5e3c6b170e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:23:38.316026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0f77c6d7-591c-4f14-abe2-46f8dc159ce8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:38.323795 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0f77c6d7-591c-4f14-abe2-46f8dc159ce8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1316 microversion: 2.1 time: 1.126611 Jan 22 21:23:38.324516 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3594/6874] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:37 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1316 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:38.329421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-51dacf7e-052a-4785-a409-1b7fed3a7410 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:38.335399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-51dacf7e-052a-4785-a409-1b7fed3a7410 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:38.343834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51dacf7e-052a-4785-a409-1b7fed3a7410 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:38.348677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51dacf7e-052a-4785-a409-1b7fed3a7410 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:38.348677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51dacf7e-052a-4785-a409-1b7fed3a7410 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:38.348677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51dacf7e-052a-4785-a409-1b7fed3a7410 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:38.539262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-51dacf7e-052a-4785-a409-1b7fed3a7410 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:38.539262 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-51dacf7e-052a-4785-a409-1b7fed3a7410 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1518 microversion: 2.1 time: 0.196740 Jan 22 21:23:38.539262 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3595/6875] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:38 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1518 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:38.539262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cd896272-2985-4e84-a6b1-a182bffe0c65 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:38.539262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cd896272-2985-4e84-a6b1-a182bffe0c65 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:38.539262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd896272-2985-4e84-a6b1-a182bffe0c65 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:38.539262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd896272-2985-4e84-a6b1-a182bffe0c65 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:38.539262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd896272-2985-4e84-a6b1-a182bffe0c65 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:38.539262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd896272-2985-4e84-a6b1-a182bffe0c65 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:38.652165 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-93f2efbd-b5ce-4da1-81b7-fb5e3c6b170e tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "DELETE /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 204 len: 0 microversion: 2.20 time: 0.734244 Jan 22 21:23:38.652165 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3281/6876] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:23:37 2022] DELETE /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:23:38.652165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-1bffb3b1-90b7-4712-bad1-6911b9496c10 req-a48516e6-e17c-4dc4-abd2-c440a166afd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5dabfb-f484-4b09-b45f-b31db980db64", "name": "network-vif-deleted", "tag": "8b400a6e-3146-420a-836b-7923996caf46"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:38.652165 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:38.652165 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:23:38.652165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1bffb3b1-90b7-4712-bad1-6911b9496c10 req-a48516e6-e17c-4dc4-abd2-c440a166afd9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:38.652165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1bffb3b1-90b7-4712-bad1-6911b9496c10 req-a48516e6-e17c-4dc4-abd2-c440a166afd9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:38.652165 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-1bffb3b1-90b7-4712-bad1-6911b9496c10 req-a48516e6-e17c-4dc4-abd2-c440a166afd9 service nova] Creating event network-vif-deleted:8b400a6e-3146-420a-836b-7923996caf46 for instance 5f5dabfb-f484-4b09-b45f-b31db980db64 on nch1-master-1 Jan 22 21:23:38.652165 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-1bffb3b1-90b7-4712-bad1-6911b9496c10 req-a48516e6-e17c-4dc4-abd2-c440a166afd9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047404 Jan 22 21:23:38.652165 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3282/6877] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:38.663500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-741436be-d5c2-4b89-84a9-00ce238ae9e3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:38.668084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-741436be-d5c2-4b89-84a9-00ce238ae9e3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:38.711737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-741436be-d5c2-4b89-84a9-00ce238ae9e3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:38.713982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-741436be-d5c2-4b89-84a9-00ce238ae9e3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:38.715269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-741436be-d5c2-4b89-84a9-00ce238ae9e3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:38.723151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-741436be-d5c2-4b89-84a9-00ce238ae9e3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:38.836844 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cd896272-2985-4e84-a6b1-a182bffe0c65 tempest-TestNetworkAdvancedServerOps-140171726 tempest-TestNetworkAdvancedServerOps-140171726-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1833 microversion: 2.1 time: 0.310334 Jan 22 21:23:38.852238 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3596/6878] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:38 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1833 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:38.859334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1bfc02ba-ea07-461f-a840-a636e64d5cdf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:38.863838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1bfc02ba-ea07-461f-a840-a636e64d5cdf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:38.870692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bfc02ba-ea07-461f-a840-a636e64d5cdf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:38.871825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bfc02ba-ea07-461f-a840-a636e64d5cdf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:38.873038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bfc02ba-ea07-461f-a840-a636e64d5cdf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:38.873452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bfc02ba-ea07-461f-a840-a636e64d5cdf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:39.396665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1bfc02ba-ea07-461f-a840-a636e64d5cdf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:39.410785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1bfc02ba-ea07-461f-a840-a636e64d5cdf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:39.420095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1bfc02ba-ea07-461f-a840-a636e64d5cdf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:39.421996 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1bfc02ba-ea07-461f-a840-a636e64d5cdf tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1729 microversion: 2.20 time: 0.568486 Jan 22 21:23:39.422640 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3597/6879] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:23:38 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1729 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:23:39.441006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6469aedf-168d-4a1b-99fd-6f2b79526b03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:39.441910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6469aedf-168d-4a1b-99fd-6f2b79526b03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:39.454858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6469aedf-168d-4a1b-99fd-6f2b79526b03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:39.455318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6469aedf-168d-4a1b-99fd-6f2b79526b03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:39.456243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6469aedf-168d-4a1b-99fd-6f2b79526b03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:39.456583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6469aedf-168d-4a1b-99fd-6f2b79526b03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:39.519571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-741436be-d5c2-4b89-84a9-00ce238ae9e3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:39.529987 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-741436be-d5c2-4b89-84a9-00ce238ae9e3 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1794 microversion: 2.1 time: 0.879835 Jan 22 21:23:39.542694 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3283/6880] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:38 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1794 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:39.549046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ae886f2a-e9ad-4bb7-96fd-1f7db3c48dbf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:39.556137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ae886f2a-e9ad-4bb7-96fd-1f7db3c48dbf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:39.558149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae886f2a-e9ad-4bb7-96fd-1f7db3c48dbf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:39.558863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae886f2a-e9ad-4bb7-96fd-1f7db3c48dbf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:39.560662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae886f2a-e9ad-4bb7-96fd-1f7db3c48dbf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:39.562726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae886f2a-e9ad-4bb7-96fd-1f7db3c48dbf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:39.622650 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ae886f2a-e9ad-4bb7-96fd-1f7db3c48dbf tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.077562 Jan 22 21:23:39.624124 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3284/6881] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:39 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:39.636961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9b16303f-a3d1-42ba-84aa-353c8df407e7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:39.636961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9b16303f-a3d1-42ba-84aa-353c8df407e7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:39.649757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b16303f-a3d1-42ba-84aa-353c8df407e7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:39.663622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b16303f-a3d1-42ba-84aa-353c8df407e7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:39.665575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b16303f-a3d1-42ba-84aa-353c8df407e7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:39.666814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b16303f-a3d1-42ba-84aa-353c8df407e7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:39.912163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9b16303f-a3d1-42ba-84aa-353c8df407e7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:39.921582 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9b16303f-a3d1-42ba-84aa-353c8df407e7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1316 microversion: 2.1 time: 0.295124 Jan 22 21:23:39.922985 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3285/6882] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:39 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:39.927940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-39476107-cb17-4a62-a640-a9752c5cad29 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:39.928734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-39476107-cb17-4a62-a640-a9752c5cad29 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:39.939416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39476107-cb17-4a62-a640-a9752c5cad29 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:39.940265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39476107-cb17-4a62-a640-a9752c5cad29 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:39.942075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39476107-cb17-4a62-a640-a9752c5cad29 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:39.943003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39476107-cb17-4a62-a640-a9752c5cad29 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:39.992765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39476107-cb17-4a62-a640-a9752c5cad29 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:39.993574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39476107-cb17-4a62-a640-a9752c5cad29 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:39.994502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-39476107-cb17-4a62-a640-a9752c5cad29 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lazy-loading 'fault' on Instance uuid 823893cd-c3f3-4951-b57e-190007916140 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:23:40.013636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6469aedf-168d-4a1b-99fd-6f2b79526b03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:40.035740 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6469aedf-168d-4a1b-99fd-6f2b79526b03 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1682 microversion: 2.1 time: 0.604539 Jan 22 21:23:40.035740 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3598/6883] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:39 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1682 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:40.072189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-39476107-cb17-4a62-a640-a9752c5cad29 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:40.083668 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-39476107-cb17-4a62-a640-a9752c5cad29 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 200 len: 1312 microversion: 2.1 time: 0.158685 Jan 22 21:23:40.094210 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3286/6884] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:39 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:40.274614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a1c3156-235b-4264-a431-8dafa314db15 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:40.275835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a1c3156-235b-4264-a431-8dafa314db15 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:40.288224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a1c3156-235b-4264-a431-8dafa314db15 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:40.292159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a1c3156-235b-4264-a431-8dafa314db15 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:40.299457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a1c3156-235b-4264-a431-8dafa314db15 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:40.300373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a1c3156-235b-4264-a431-8dafa314db15 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:40.442362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-edd02a7e-b5ef-44e4-ba3c-38474cdc15f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:40.443469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-edd02a7e-b5ef-44e4-ba3c-38474cdc15f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:40.460643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-edd02a7e-b5ef-44e4-ba3c-38474cdc15f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:40.462374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-edd02a7e-b5ef-44e4-ba3c-38474cdc15f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:40.465572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-edd02a7e-b5ef-44e4-ba3c-38474cdc15f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:40.467071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-edd02a7e-b5ef-44e4-ba3c-38474cdc15f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:40.790791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-edd02a7e-b5ef-44e4-ba3c-38474cdc15f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:40.818574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-edd02a7e-b5ef-44e4-ba3c-38474cdc15f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:40.820665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-edd02a7e-b5ef-44e4-ba3c-38474cdc15f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:40.822343 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-edd02a7e-b5ef-44e4-ba3c-38474cdc15f5 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1729 microversion: 2.20 time: 0.385961 Jan 22 21:23:40.823134 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3287/6885] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:23:40 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1729 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:23:40.832050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ca845e32-8ae1-4b53-8a87-fcb8f1e06654 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:40.832917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ca845e32-8ae1-4b53-8a87-fcb8f1e06654 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:40.878551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca845e32-8ae1-4b53-8a87-fcb8f1e06654 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:40.882345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca845e32-8ae1-4b53-8a87-fcb8f1e06654 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:40.884688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca845e32-8ae1-4b53-8a87-fcb8f1e06654 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:40.885424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca845e32-8ae1-4b53-8a87-fcb8f1e06654 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:40.959050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca845e32-8ae1-4b53-8a87-fcb8f1e06654 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:40.962342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca845e32-8ae1-4b53-8a87-fcb8f1e06654 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:40.963001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-ca845e32-8ae1-4b53-8a87-fcb8f1e06654 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lazy-loading 'fault' on Instance uuid 5f5dabfb-f484-4b09-b45f-b31db980db64 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:23:41.078476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ca845e32-8ae1-4b53-8a87-fcb8f1e06654 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:41.088309 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ca845e32-8ae1-4b53-8a87-fcb8f1e06654 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 200 len: 1307 microversion: 2.1 time: 0.263566 Jan 22 21:23:41.102356 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3288/6886] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:40 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 1307 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:41.108400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0c54c2b1-a6f4-4424-a237-8fb7f62b07e6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:41.110509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0c54c2b1-a6f4-4424-a237-8fb7f62b07e6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:41.120796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c54c2b1-a6f4-4424-a237-8fb7f62b07e6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:41.120796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c54c2b1-a6f4-4424-a237-8fb7f62b07e6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:41.120796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c54c2b1-a6f4-4424-a237-8fb7f62b07e6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:41.121804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c54c2b1-a6f4-4424-a237-8fb7f62b07e6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:41.201144 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0c54c2b1-a6f4-4424-a237-8fb7f62b07e6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.096973 Jan 22 21:23:41.202148 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3289/6887] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:41 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:41.210133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f79f2d5b-4728-4e17-91b2-415fbb35bec6 req-cc115d01-6cd9-4a99-8f51-de6fa3e0f0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5dabfb-f484-4b09-b45f-b31db980db64", "name": "network-vif-deleted", "tag": "b4ffbbd7-26e1-4f22-95b4-c8670632f290"}, {"server_uuid": "823893cd-c3f3-4951-b57e-190007916140", "name": "network-vif-deleted", "tag": "99202f8b-dd34-4923-ac45-a2e59360fb29"}, {"server_uuid": "5f5dabfb-f484-4b09-b45f-b31db980db64", "name": "network-vif-deleted", "tag": "43cc5dcd-7f91-417e-a1f5-fea90214a7b4"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:41.216131 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:41.216131 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:23:41.226859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f79f2d5b-4728-4e17-91b2-415fbb35bec6 req-cc115d01-6cd9-4a99-8f51-de6fa3e0f0a4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:41.227554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f79f2d5b-4728-4e17-91b2-415fbb35bec6 req-cc115d01-6cd9-4a99-8f51-de6fa3e0f0a4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:41.252407 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f79f2d5b-4728-4e17-91b2-415fbb35bec6 req-cc115d01-6cd9-4a99-8f51-de6fa3e0f0a4 service nova] Creating event network-vif-deleted:b4ffbbd7-26e1-4f22-95b4-c8670632f290 for instance 5f5dabfb-f484-4b09-b45f-b31db980db64 on nch1-master-1 Jan 22 21:23:41.255161 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f79f2d5b-4728-4e17-91b2-415fbb35bec6 req-cc115d01-6cd9-4a99-8f51-de6fa3e0f0a4 service nova] Creating event network-vif-deleted:99202f8b-dd34-4923-ac45-a2e59360fb29 for instance 823893cd-c3f3-4951-b57e-190007916140 on nch1-master-1 Jan 22 21:23:41.255161 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f79f2d5b-4728-4e17-91b2-415fbb35bec6 req-cc115d01-6cd9-4a99-8f51-de6fa3e0f0a4 service nova] Creating event network-vif-deleted:43cc5dcd-7f91-417e-a1f5-fea90214a7b4 for instance 5f5dabfb-f484-4b09-b45f-b31db980db64 on nch1-master-1 Jan 22 21:23:41.262015 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f79f2d5b-4728-4e17-91b2-415fbb35bec6 req-cc115d01-6cd9-4a99-8f51-de6fa3e0f0a4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.058214 Jan 22 21:23:41.263865 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3290/6888] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:41.272936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d12f357f-0230-4f26-91af-29f435a36039 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:41.273721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d12f357f-0230-4f26-91af-29f435a36039 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:41.282195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d12f357f-0230-4f26-91af-29f435a36039 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:41.282655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d12f357f-0230-4f26-91af-29f435a36039 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:41.283764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d12f357f-0230-4f26-91af-29f435a36039 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:41.285198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d12f357f-0230-4f26-91af-29f435a36039 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:41.582121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d12f357f-0230-4f26-91af-29f435a36039 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:41.589842 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d12f357f-0230-4f26-91af-29f435a36039 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1316 microversion: 2.1 time: 0.322337 Jan 22 21:23:41.593551 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3291/6889] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:41 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:41.598104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48c1bbcd-51ad-430e-a9be-153e4c24706f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:41.598910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48c1bbcd-51ad-430e-a9be-153e4c24706f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 823893cd-c3f3-4951-b57e-190007916140] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:41.614041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48c1bbcd-51ad-430e-a9be-153e4c24706f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:41.617158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48c1bbcd-51ad-430e-a9be-153e4c24706f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:41.620228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48c1bbcd-51ad-430e-a9be-153e4c24706f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:41.620860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48c1bbcd-51ad-430e-a9be-153e4c24706f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:41.643720 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-48c1bbcd-51ad-430e-a9be-153e4c24706f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] HTTP exception thrown: Instance 823893cd-c3f3-4951-b57e-190007916140 could not be found. Jan 22 21:23:41.655173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48c1bbcd-51ad-430e-a9be-153e4c24706f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Returning 404 to user: Instance 823893cd-c3f3-4951-b57e-190007916140 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:23:41.655173 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48c1bbcd-51ad-430e-a9be-153e4c24706f tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140" status: 404 len: 111 microversion: 2.1 time: 0.050856 Jan 22 21:23:41.655173 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3292/6890] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:41 2022] GET /compute/v2.1/servers/823893cd-c3f3-4951-b57e-190007916140 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:23:41.852363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ccd068b8-8cd6-4c20-8486-1cb632794987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:41.854514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ccd068b8-8cd6-4c20-8486-1cb632794987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:41.862791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccd068b8-8cd6-4c20-8486-1cb632794987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:41.863591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccd068b8-8cd6-4c20-8486-1cb632794987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:41.864935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccd068b8-8cd6-4c20-8486-1cb632794987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:41.865633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccd068b8-8cd6-4c20-8486-1cb632794987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:41.961162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ccd068b8-8cd6-4c20-8486-1cb632794987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:41.972408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ccd068b8-8cd6-4c20-8486-1cb632794987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:41.976392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ccd068b8-8cd6-4c20-8486-1cb632794987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:41.978431 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ccd068b8-8cd6-4c20-8486-1cb632794987 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1661 microversion: 2.20 time: 0.139520 Jan 22 21:23:41.981118 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3293/6891] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:23:41 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1661 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:23:42.123325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f58960b7-007b-4aed-af59-8e94e7679a87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:42.124056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f58960b7-007b-4aed-af59-8e94e7679a87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:42.134556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f58960b7-007b-4aed-af59-8e94e7679a87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:42.137940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f58960b7-007b-4aed-af59-8e94e7679a87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:42.138864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f58960b7-007b-4aed-af59-8e94e7679a87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:42.140490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f58960b7-007b-4aed-af59-8e94e7679a87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:42.185495 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-f58960b7-007b-4aed-af59-8e94e7679a87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] HTTP exception thrown: Instance 5f5dabfb-f484-4b09-b45f-b31db980db64 could not be found. Jan 22 21:23:42.186197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f58960b7-007b-4aed-af59-8e94e7679a87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Returning 404 to user: Instance 5f5dabfb-f484-4b09-b45f-b31db980db64 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:23:42.187091 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f58960b7-007b-4aed-af59-8e94e7679a87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 404 len: 111 microversion: 2.1 time: 0.071580 Jan 22 21:23:42.187682 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3294/6892] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:42 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:23:42.216210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-55745722-d5d4-4cad-b976-74c8f154dbed tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:42.217996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-55745722-d5d4-4cad-b976-74c8f154dbed tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:42.235070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55745722-d5d4-4cad-b976-74c8f154dbed tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:42.235830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55745722-d5d4-4cad-b976-74c8f154dbed tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:42.236824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55745722-d5d4-4cad-b976-74c8f154dbed tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:42.237423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55745722-d5d4-4cad-b976-74c8f154dbed tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:42.324857 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-55745722-d5d4-4cad-b976-74c8f154dbed tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.112925 Jan 22 21:23:42.331034 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3295/6893] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:42 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:42.608377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ada38c02-f895-460f-9f11-f4c547e229d9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:42.608377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ada38c02-f895-460f-9f11-f4c547e229d9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:42.616170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ada38c02-f895-460f-9f11-f4c547e229d9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:42.616788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ada38c02-f895-460f-9f11-f4c547e229d9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:42.617783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ada38c02-f895-460f-9f11-f4c547e229d9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:42.618375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ada38c02-f895-460f-9f11-f4c547e229d9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:42.952463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ada38c02-f895-460f-9f11-f4c547e229d9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:42.963474 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ada38c02-f895-460f-9f11-f4c547e229d9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1316 microversion: 2.1 time: 0.358839 Jan 22 21:23:42.964390 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3296/6894] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:42 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:43.000530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f8c16afd-65e9-4a09-8d55-0ac7903ddfe4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:43.001553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f8c16afd-65e9-4a09-8d55-0ac7903ddfe4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:43.017320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8c16afd-65e9-4a09-8d55-0ac7903ddfe4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:43.017971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8c16afd-65e9-4a09-8d55-0ac7903ddfe4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:43.018813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8c16afd-65e9-4a09-8d55-0ac7903ddfe4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:43.019270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8c16afd-65e9-4a09-8d55-0ac7903ddfe4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:43.097687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8c16afd-65e9-4a09-8d55-0ac7903ddfe4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:43.098149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8c16afd-65e9-4a09-8d55-0ac7903ddfe4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:43.098623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-f8c16afd-65e9-4a09-8d55-0ac7903ddfe4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lazy-loading 'fault' on Instance uuid 89583718-5186-41d5-b5f3-ad8997c3eb59 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:23:43.516131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f8c16afd-65e9-4a09-8d55-0ac7903ddfe4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:43.525407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f8c16afd-65e9-4a09-8d55-0ac7903ddfe4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:43.527284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f8c16afd-65e9-4a09-8d55-0ac7903ddfe4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0be514b27f14d8a9e4fd71b31a6d2e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76ecd70d0be147b59ffbda6d93f73aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:43.528706 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f8c16afd-65e9-4a09-8d55-0ac7903ddfe4 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 200 len: 1375 microversion: 2.20 time: 0.532057 Jan 22 21:23:43.530217 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3297/6895] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:23:42 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 1375 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:23:43.535421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fd4fbfb4-69d5-4fbc-b44a-401268b882bc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:43.536929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fd4fbfb4-69d5-4fbc-b44a-401268b882bc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:43.543713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd4fbfb4-69d5-4fbc-b44a-401268b882bc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:43.544436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd4fbfb4-69d5-4fbc-b44a-401268b882bc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:43.545454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd4fbfb4-69d5-4fbc-b44a-401268b882bc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:43.546101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd4fbfb4-69d5-4fbc-b44a-401268b882bc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:43.605097 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fd4fbfb4-69d5-4fbc-b44a-401268b882bc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.073093 Jan 22 21:23:43.611203 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3298/6896] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:43 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:43.617669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-c64cd851-c9cc-4069-94d5-12c374b6dab8 req-1c438d78-62a7-4a96-991d-55a9d4e46e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89583718-5186-41d5-b5f3-ad8997c3eb59", "name": "network-vif-deleted", "tag": "f3926427-e4b0-4ea7-846d-98fa049e0b27"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:43.619521 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:43.619521 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:23:43.630809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c64cd851-c9cc-4069-94d5-12c374b6dab8 req-1c438d78-62a7-4a96-991d-55a9d4e46e7f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:43.631569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c64cd851-c9cc-4069-94d5-12c374b6dab8 req-1c438d78-62a7-4a96-991d-55a9d4e46e7f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:43.649113 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-c64cd851-c9cc-4069-94d5-12c374b6dab8 req-1c438d78-62a7-4a96-991d-55a9d4e46e7f service nova] Creating event network-vif-deleted:f3926427-e4b0-4ea7-846d-98fa049e0b27 for instance 89583718-5186-41d5-b5f3-ad8997c3eb59 on nch1-master-1 Jan 22 21:23:43.656789 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-c64cd851-c9cc-4069-94d5-12c374b6dab8 req-1c438d78-62a7-4a96-991d-55a9d4e46e7f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043695 Jan 22 21:23:43.658087 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3299/6897] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:43.990598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8fac0eee-0c00-48be-bdce-380df71ac0e3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:43.992135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8fac0eee-0c00-48be-bdce-380df71ac0e3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:44.000476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fac0eee-0c00-48be-bdce-380df71ac0e3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:44.001526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fac0eee-0c00-48be-bdce-380df71ac0e3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:44.003039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fac0eee-0c00-48be-bdce-380df71ac0e3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:44.003731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fac0eee-0c00-48be-bdce-380df71ac0e3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:44.231401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8fac0eee-0c00-48be-bdce-380df71ac0e3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:44.241564 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8fac0eee-0c00-48be-bdce-380df71ac0e3 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1316 microversion: 2.1 time: 0.260044 Jan 22 21:23:44.252133 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3300/6898] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:43 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:23:44.549902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-749c3a9c-b055-4656-b2a9-a14f0febbf51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:44.552013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-749c3a9c-b055-4656-b2a9-a14f0febbf51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:44.562775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-749c3a9c-b055-4656-b2a9-a14f0febbf51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:44.568160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-749c3a9c-b055-4656-b2a9-a14f0febbf51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:44.568160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-749c3a9c-b055-4656-b2a9-a14f0febbf51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:44.568160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-749c3a9c-b055-4656-b2a9-a14f0febbf51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:44.588058 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-749c3a9c-b055-4656-b2a9-a14f0febbf51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] HTTP exception thrown: Instance 89583718-5186-41d5-b5f3-ad8997c3eb59 could not be found. Jan 22 21:23:44.589835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-749c3a9c-b055-4656-b2a9-a14f0febbf51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Returning 404 to user: Instance 89583718-5186-41d5-b5f3-ad8997c3eb59 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:23:44.590936 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-749c3a9c-b055-4656-b2a9-a14f0febbf51 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 404 len: 111 microversion: 2.20 time: 0.046816 Jan 22 21:23:44.595943 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3301/6899] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:23:44 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:23:44.603302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e77356be-d04e-4e97-b7e9-ea478ea205e1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '.version_select at 0x7f1ed54389d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:44.703631 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e77356be-d04e-4e97-b7e9-ea478ea205e1 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-713307230" status: 204 len: 0 microversion: 2.20 time: 0.106202 Jan 22 21:23:44.705044 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3302/6900] 10.222.0.100 () {60 vars in 1263 bytes} [Sat Jan 22 21:23:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-713307230 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:23:44.721333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f92e1e4a-2d2e-4730-8677-4cfd237fab99 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:44.726290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f92e1e4a-2d2e-4730-8677-4cfd237fab99 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:44.744438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f92e1e4a-2d2e-4730-8677-4cfd237fab99 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:44.748164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f92e1e4a-2d2e-4730-8677-4cfd237fab99 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:44.750048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f92e1e4a-2d2e-4730-8677-4cfd237fab99 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:44.750676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f92e1e4a-2d2e-4730-8677-4cfd237fab99 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:44.817373 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f92e1e4a-2d2e-4730-8677-4cfd237fab99 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.106611 Jan 22 21:23:44.818496 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3303/6901] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:44 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:45.099084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-b7ddc070-cc25-46a0-8e64-ea40aa824330 req-5e1100c5-5237-43c5-ade2-5d902e0be704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d45478b2-2111-4644-a1c1-609e88b42d1c", "name": "network-vif-plugged", "status": "completed", "tag": "90a69713-d872-4a2f-aa0b-b9a4b9c625d0"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:45.102518 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:45.102518 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:23:45.133583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-b7ddc070-cc25-46a0-8e64-ea40aa824330 req-5e1100c5-5237-43c5-ade2-5d902e0be704 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:45.134452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-b7ddc070-cc25-46a0-8e64-ea40aa824330 req-5e1100c5-5237-43c5-ade2-5d902e0be704 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:45.201309 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-b7ddc070-cc25-46a0-8e64-ea40aa824330 req-5e1100c5-5237-43c5-ade2-5d902e0be704 service nova] Creating event network-vif-plugged:90a69713-d872-4a2f-aa0b-b9a4b9c625d0 for instance d45478b2-2111-4644-a1c1-609e88b42d1c on nch2-master-1 Jan 22 21:23:45.240384 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-b7ddc070-cc25-46a0-8e64-ea40aa824330 req-5e1100c5-5237-43c5-ade2-5d902e0be704 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146479 Jan 22 21:23:45.246785 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3304/6902] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:23:45.253627 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a1c3156-235b-4264-a431-8dafa314db15 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef/action" status: 200 len: 38583 microversion: 2.1 time: 4.982872 Jan 22 21:23:45.261792 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3599/6903] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:23:40 2022] POST /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef/action => generated 38583 bytes in 4993 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:23:45.293914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8c77f483-92a7-4b61-aae4-61f44baa422c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:45.296643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8c77f483-92a7-4b61-aae4-61f44baa422c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:45.323957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c77f483-92a7-4b61-aae4-61f44baa422c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:45.325626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c77f483-92a7-4b61-aae4-61f44baa422c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:45.327109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c77f483-92a7-4b61-aae4-61f44baa422c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:45.329970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c77f483-92a7-4b61-aae4-61f44baa422c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:45.768291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8c77f483-92a7-4b61-aae4-61f44baa422c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:45.779832 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8c77f483-92a7-4b61-aae4-61f44baa422c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1316 microversion: 2.1 time: 0.505838 Jan 22 21:23:45.781424 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3305/6904] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:45 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1316 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:45.831641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6f8e09ba-283f-4c09-9dd4-dadc4b981a99 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:45.832747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6f8e09ba-283f-4c09-9dd4-dadc4b981a99 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:45.841285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f8e09ba-283f-4c09-9dd4-dadc4b981a99 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:45.841783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f8e09ba-283f-4c09-9dd4-dadc4b981a99 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:45.852005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f8e09ba-283f-4c09-9dd4-dadc4b981a99 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:45.852512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f8e09ba-283f-4c09-9dd4-dadc4b981a99 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:45.914065 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6f8e09ba-283f-4c09-9dd4-dadc4b981a99 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.087402 Jan 22 21:23:45.921931 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3600/6905] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:45 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:46.800999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24afc176-55c1-41bc-bf8d-ef1f52f71dd9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:46.802104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-24afc176-55c1-41bc-bf8d-ef1f52f71dd9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:46.816925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24afc176-55c1-41bc-bf8d-ef1f52f71dd9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:46.818001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24afc176-55c1-41bc-bf8d-ef1f52f71dd9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:46.820998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24afc176-55c1-41bc-bf8d-ef1f52f71dd9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:46.821747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24afc176-55c1-41bc-bf8d-ef1f52f71dd9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:46.928868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d0a71e8e-cb3b-4903-ae17-ee619df6ae66 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:46.929893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d0a71e8e-cb3b-4903-ae17-ee619df6ae66 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:46.947271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0a71e8e-cb3b-4903-ae17-ee619df6ae66 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:46.947271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0a71e8e-cb3b-4903-ae17-ee619df6ae66 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:46.952667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0a71e8e-cb3b-4903-ae17-ee619df6ae66 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:46.953141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0a71e8e-cb3b-4903-ae17-ee619df6ae66 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:47.023592 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d0a71e8e-cb3b-4903-ae17-ee619df6ae66 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.098626 Jan 22 21:23:47.028219 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3601/6906] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:46 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:47.239615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-24afc176-55c1-41bc-bf8d-ef1f52f71dd9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:47.252043 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-24afc176-55c1-41bc-bf8d-ef1f52f71dd9 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1316 microversion: 2.1 time: 0.457518 Jan 22 21:23:47.253107 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3306/6907] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:46 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1316 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:48.041757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-55513111-b179-43d7-8748-bff46ea6988f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:48.046805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-55513111-b179-43d7-8748-bff46ea6988f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:48.069217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55513111-b179-43d7-8748-bff46ea6988f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:48.072668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55513111-b179-43d7-8748-bff46ea6988f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:48.074740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55513111-b179-43d7-8748-bff46ea6988f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:48.076268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55513111-b179-43d7-8748-bff46ea6988f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:48.153286 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-55513111-b179-43d7-8748-bff46ea6988f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.119854 Jan 22 21:23:48.155384 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3602/6908] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:48 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:48.268671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8e23df24-f082-446b-87c1-4ee98168dca1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:48.269991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8e23df24-f082-446b-87c1-4ee98168dca1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:48.277703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e23df24-f082-446b-87c1-4ee98168dca1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:48.278176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e23df24-f082-446b-87c1-4ee98168dca1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:48.278999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e23df24-f082-446b-87c1-4ee98168dca1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:48.279457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e23df24-f082-446b-87c1-4ee98168dca1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:48.530701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8e23df24-f082-446b-87c1-4ee98168dca1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:48.546314 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8e23df24-f082-446b-87c1-4ee98168dca1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1500 microversion: 2.1 time: 0.281941 Jan 22 21:23:48.555952 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3307/6909] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:48 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1500 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:49.129145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d5e31330-f622-41d4-a95c-0ff5faa6918d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:49.133625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d5e31330-f622-41d4-a95c-0ff5faa6918d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:49.133910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-b82a1581-e896-46ab-a604-40670609f2e5 req-010efaca-dda5-484f-aabd-a3a8b513c9ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12be9a2-2532-4441-94d7-1e38912ebaef", "tag": "072275f1-ea9f-46b7-8332-4cc1cf1c51f3"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:49.133910 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:49.133910 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:23:49.142111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-b82a1581-e896-46ab-a604-40670609f2e5 req-010efaca-dda5-484f-aabd-a3a8b513c9ed service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:49.142779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-b82a1581-e896-46ab-a604-40670609f2e5 req-010efaca-dda5-484f-aabd-a3a8b513c9ed service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:49.159288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5e31330-f622-41d4-a95c-0ff5faa6918d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:49.160037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5e31330-f622-41d4-a95c-0ff5faa6918d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:49.161166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5e31330-f622-41d4-a95c-0ff5faa6918d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:49.166225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5e31330-f622-41d4-a95c-0ff5faa6918d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:49.176477 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-b82a1581-e896-46ab-a604-40670609f2e5 req-010efaca-dda5-484f-aabd-a3a8b513c9ed service nova] Creating event network-changed:072275f1-ea9f-46b7-8332-4cc1cf1c51f3 for instance a12be9a2-2532-4441-94d7-1e38912ebaef on nch2-master-1 Jan 22 21:23:49.208559 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-b82a1581-e896-46ab-a604-40670609f2e5 req-010efaca-dda5-484f-aabd-a3a8b513c9ed service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081093 Jan 22 21:23:49.209870 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3308/6910] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:23:49.217287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c41b89c8-b267-462f-b9f7-5e64e84ef303 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:49.230299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c41b89c8-b267-462f-b9f7-5e64e84ef303 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:49.243215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c41b89c8-b267-462f-b9f7-5e64e84ef303 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:49.243906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c41b89c8-b267-462f-b9f7-5e64e84ef303 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:49.247694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c41b89c8-b267-462f-b9f7-5e64e84ef303 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:49.249681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c41b89c8-b267-462f-b9f7-5e64e84ef303 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:49.254227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d5e31330-f622-41d4-a95c-0ff5faa6918d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:23:49.341676 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c41b89c8-b267-462f-b9f7-5e64e84ef303 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.128323 Jan 22 21:23:49.343859 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3309/6911] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:49 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:49.737076 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d5e31330-f622-41d4-a95c-0ff5faa6918d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 204 len: 0 microversion: 2.1 time: 0.611962 Jan 22 21:23:49.742261 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3603/6912] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:23:49 2022] DELETE /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:23:49.748395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-14a527f2-b611-4a6c-aaaa-740c909fb658 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:49.749656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-14a527f2-b611-4a6c-aaaa-740c909fb658 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:49.757394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14a527f2-b611-4a6c-aaaa-740c909fb658 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:49.758649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14a527f2-b611-4a6c-aaaa-740c909fb658 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:49.758929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14a527f2-b611-4a6c-aaaa-740c909fb658 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:49.759477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14a527f2-b611-4a6c-aaaa-740c909fb658 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:50.048523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8050b164-ad6e-4931-be97-420c1ec2cbf7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:50.049477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8050b164-ad6e-4931-be97-420c1ec2cbf7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:50.081753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8050b164-ad6e-4931-be97-420c1ec2cbf7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:50.084476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8050b164-ad6e-4931-be97-420c1ec2cbf7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:50.091030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8050b164-ad6e-4931-be97-420c1ec2cbf7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:50.098316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8050b164-ad6e-4931-be97-420c1ec2cbf7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:50.229641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8050b164-ad6e-4931-be97-420c1ec2cbf7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:23:50.861156 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8050b164-ad6e-4931-be97-420c1ec2cbf7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "DELETE /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 204 len: 0 microversion: 2.1 time: 0.817201 Jan 22 21:23:50.864062 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3604/6913] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:23:50 2022] DELETE /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 0 bytes in 820 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:23:50.879915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ea07f9cc-a7ea-4693-bae1-299011fdc035 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:50.886133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ea07f9cc-a7ea-4693-bae1-299011fdc035 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:50.908494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea07f9cc-a7ea-4693-bae1-299011fdc035 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:50.908713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea07f9cc-a7ea-4693-bae1-299011fdc035 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:50.913167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea07f9cc-a7ea-4693-bae1-299011fdc035 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:50.922119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea07f9cc-a7ea-4693-bae1-299011fdc035 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:51.018119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-14a527f2-b611-4a6c-aaaa-740c909fb658 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:51.024393 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ea07f9cc-a7ea-4693-bae1-299011fdc035 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.157518 Jan 22 21:23:51.026445 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3605/6914] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:50 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:51.032835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fee0a309-afd4-4c51-ad59-7ea6c34bd9bf tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:51.034040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fee0a309-afd4-4c51-ad59-7ea6c34bd9bf tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:51.043804 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-14a527f2-b611-4a6c-aaaa-740c909fb658 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1688 microversion: 2.1 time: 1.285632 Jan 22 21:23:51.045265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fee0a309-afd4-4c51-ad59-7ea6c34bd9bf tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:51.046419 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3310/6915] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:49 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1688 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:23:51.046565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fee0a309-afd4-4c51-ad59-7ea6c34bd9bf tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:51.047682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fee0a309-afd4-4c51-ad59-7ea6c34bd9bf tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:51.048699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fee0a309-afd4-4c51-ad59-7ea6c34bd9bf tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:51.699219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fee0a309-afd4-4c51-ad59-7ea6c34bd9bf tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:51.709818 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fee0a309-afd4-4c51-ad59-7ea6c34bd9bf tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1506 microversion: 2.1 time: 0.681569 Jan 22 21:23:51.724106 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3606/6916] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:51 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1506 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:51.780138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fc871ac0-aab3-43e7-bf83-5433969b5bae tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:51.780648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fc871ac0-aab3-43e7-bf83-5433969b5bae tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:51.789165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc871ac0-aab3-43e7-bf83-5433969b5bae tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:51.789744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc871ac0-aab3-43e7-bf83-5433969b5bae tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:51.790651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc871ac0-aab3-43e7-bf83-5433969b5bae tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:51.791113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc871ac0-aab3-43e7-bf83-5433969b5bae tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:51.847545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fc871ac0-aab3-43e7-bf83-5433969b5bae tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:23:52.037298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-870b4586-3fa7-468a-bc2f-976046df34e0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:52.041162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-870b4586-3fa7-468a-bc2f-976046df34e0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:52.054113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-870b4586-3fa7-468a-bc2f-976046df34e0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:52.054869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-870b4586-3fa7-468a-bc2f-976046df34e0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:52.055855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-870b4586-3fa7-468a-bc2f-976046df34e0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:52.063148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-870b4586-3fa7-468a-bc2f-976046df34e0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:52.194763 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-870b4586-3fa7-468a-bc2f-976046df34e0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.150914 Jan 22 21:23:52.195366 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3607/6917] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:52 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:23:52.208335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-10d81bae-982a-4165-acbf-d88cd3f78afd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:52.209284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-10d81bae-982a-4165-acbf-d88cd3f78afd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:52.218787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10d81bae-982a-4165-acbf-d88cd3f78afd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:52.220799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10d81bae-982a-4165-acbf-d88cd3f78afd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:52.221945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10d81bae-982a-4165-acbf-d88cd3f78afd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:52.223268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10d81bae-982a-4165-acbf-d88cd3f78afd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:52.415061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-10d81bae-982a-4165-acbf-d88cd3f78afd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:52.431979 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-10d81bae-982a-4165-acbf-d88cd3f78afd tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 200 len: 1621 microversion: 2.1 time: 0.235226 Jan 22 21:23:52.450454 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fc871ac0-aab3-43e7-bf83-5433969b5bae tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 204 len: 0 microversion: 2.1 time: 0.669657 Jan 22 21:23:52.450454 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3311/6918] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:23:51 2022] DELETE /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:23:52.459506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-03a3970f-ec1a-4a85-af19-28be670bbfbe tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:52.460948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-03a3970f-ec1a-4a85-af19-28be670bbfbe tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:52.471087 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3608/6919] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:52 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 1621 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:52.475986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03a3970f-ec1a-4a85-af19-28be670bbfbe tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:52.479191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03a3970f-ec1a-4a85-af19-28be670bbfbe tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:52.479743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03a3970f-ec1a-4a85-af19-28be670bbfbe tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:52.480386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03a3970f-ec1a-4a85-af19-28be670bbfbe tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:52.537630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-65a8625e-e8da-4fb1-b0cb-02b4f3b0fe4b req-c6c73c46-25b0-4f99-b632-5a4dc798ad6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12be9a2-2532-4441-94d7-1e38912ebaef", "name": "network-vif-deleted", "tag": "072275f1-ea9f-46b7-8332-4cc1cf1c51f3"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:52.539475 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:52.539475 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:23:52.554864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-65a8625e-e8da-4fb1-b0cb-02b4f3b0fe4b req-c6c73c46-25b0-4f99-b632-5a4dc798ad6f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:52.559909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-65a8625e-e8da-4fb1-b0cb-02b4f3b0fe4b req-c6c73c46-25b0-4f99-b632-5a4dc798ad6f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:52.570185 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-65a8625e-e8da-4fb1-b0cb-02b4f3b0fe4b req-c6c73c46-25b0-4f99-b632-5a4dc798ad6f service nova] Creating event network-vif-deleted:072275f1-ea9f-46b7-8332-4cc1cf1c51f3 for instance a12be9a2-2532-4441-94d7-1e38912ebaef on nch2-master-1 Jan 22 21:23:52.575924 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-65a8625e-e8da-4fb1-b0cb-02b4f3b0fe4b req-c6c73c46-25b0-4f99-b632-5a4dc798ad6f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042825 Jan 22 21:23:52.578351 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3609/6920] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:23:52.741463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2f14497c-3cff-4333-963a-3e16959f7e5f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:52.746649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2f14497c-3cff-4333-963a-3e16959f7e5f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:52.768007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f14497c-3cff-4333-963a-3e16959f7e5f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:52.768871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f14497c-3cff-4333-963a-3e16959f7e5f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:52.770139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f14497c-3cff-4333-963a-3e16959f7e5f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:52.771980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f14497c-3cff-4333-963a-3e16959f7e5f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:53.008064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2f14497c-3cff-4333-963a-3e16959f7e5f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:53.025055 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2f14497c-3cff-4333-963a-3e16959f7e5f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1506 microversion: 2.1 time: 0.296657 Jan 22 21:23:53.026656 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3610/6921] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:52 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:23:53.139945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-587728264", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "3bb5a6ff-67b9-4103-8b9a-0496ca333746"}, {"uuid": "3294f23a-9377-448c-b9dd-a27e60532261"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:53.227352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] validate_networks() for [('3bb5a6ff-67b9-4103-8b9a-0496ca333746', None, None, None, None, None), ('3294f23a-9377-448c-b9dd-a27e60532261', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:23:53.429426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-03a3970f-ec1a-4a85-af19-28be670bbfbe tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:53.443618 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-03a3970f-ec1a-4a85-af19-28be670bbfbe tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1518 microversion: 2.1 time: 0.991628 Jan 22 21:23:53.447830 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3312/6922] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:52 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1518 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:53.453075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5cff199a-cc80-4734-be68-bdc8dc88b75b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:53.454149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5cff199a-cc80-4734-be68-bdc8dc88b75b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:53.471837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5cff199a-cc80-4734-be68-bdc8dc88b75b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:53.474490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5cff199a-cc80-4734-be68-bdc8dc88b75b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:53.475878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5cff199a-cc80-4734-be68-bdc8dc88b75b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:53.476802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5cff199a-cc80-4734-be68-bdc8dc88b75b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:53.556242 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5cff199a-cc80-4734-be68-bdc8dc88b75b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.106745 Jan 22 21:23:53.560564 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3313/6923] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:53 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:53.563781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96d87a26-d0ee-466c-b0af-69e11acae2c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:53.564887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96d87a26-d0ee-466c-b0af-69e11acae2c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: a12be9a2-2532-4441-94d7-1e38912ebaef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:53.572899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96d87a26-d0ee-466c-b0af-69e11acae2c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:53.573654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96d87a26-d0ee-466c-b0af-69e11acae2c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:53.574695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96d87a26-d0ee-466c-b0af-69e11acae2c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:53.575317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96d87a26-d0ee-466c-b0af-69e11acae2c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:53.594708 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-96d87a26-d0ee-466c-b0af-69e11acae2c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] HTTP exception thrown: Instance a12be9a2-2532-4441-94d7-1e38912ebaef could not be found. Jan 22 21:23:53.599813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96d87a26-d0ee-466c-b0af-69e11acae2c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Returning 404 to user: Instance a12be9a2-2532-4441-94d7-1e38912ebaef could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:23:53.599813 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96d87a26-d0ee-466c-b0af-69e11acae2c9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef" status: 404 len: 111 microversion: 2.1 time: 0.037608 Jan 22 21:23:53.599813 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3314/6924] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:53 2022] GET /compute/v2.1/servers/a12be9a2-2532-4441-94d7-1e38912ebaef => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:23:54.057319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ce7b8ca5-bc56-45b2-8ebd-e1086d43fd8e tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:54.060035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ce7b8ca5-bc56-45b2-8ebd-e1086d43fd8e tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:54.106109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce7b8ca5-bc56-45b2-8ebd-e1086d43fd8e tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:54.108078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce7b8ca5-bc56-45b2-8ebd-e1086d43fd8e tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:54.111526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce7b8ca5-bc56-45b2-8ebd-e1086d43fd8e tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:54.113739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ce7b8ca5-bc56-45b2-8ebd-e1086d43fd8e tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:55.061172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:23:55.061787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:23:55.062297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:23:55.063156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:23:55.063947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:23:55.093905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:55.094825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:55.099851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ce7b8ca5-bc56-45b2-8ebd-e1086d43fd8e tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:55.117335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:55.118173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:55.128275 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ce7b8ca5-bc56-45b2-8ebd-e1086d43fd8e tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1506 microversion: 2.1 time: 1.079718 Jan 22 21:23:55.132222 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3315/6925] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:54 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1506 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:55.165876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1312e907-8df3-40a6-a2d5-74f903e95b9e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:55.165876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1312e907-8df3-40a6-a2d5-74f903e95b9e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:55.196678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Getting quotas for project 2512cc7caef541c58da8cd500af5beff. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:23:55.197080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1312e907-8df3-40a6-a2d5-74f903e95b9e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:55.198571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1312e907-8df3-40a6-a2d5-74f903e95b9e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:55.204386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Getting quotas for user ae64ff0a56a84c34954a4beaa1f3409c and project 2512cc7caef541c58da8cd500af5beff. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:23:55.204757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1312e907-8df3-40a6-a2d5-74f903e95b9e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:55.205297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1312e907-8df3-40a6-a2d5-74f903e95b9e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:55.220964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:23:55.225334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:23:55.511357 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-99b905d7-8561-428c-8e81-b2fdca88ebba tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.377865 Jan 22 21:23:55.515750 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3611/6926] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:23:53 2022] POST /compute/v2.1/servers => generated 382 bytes in 2383 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:23:55.533859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b430df5c-dfa2-4f7f-98dd-b483921ff1a8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:55.549206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b430df5c-dfa2-4f7f-98dd-b483921ff1a8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:55.559645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b430df5c-dfa2-4f7f-98dd-b483921ff1a8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:55.561816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b430df5c-dfa2-4f7f-98dd-b483921ff1a8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:55.563067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b430df5c-dfa2-4f7f-98dd-b483921ff1a8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:55.565335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b430df5c-dfa2-4f7f-98dd-b483921ff1a8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:55.662979 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b430df5c-dfa2-4f7f-98dd-b483921ff1a8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.134993 Jan 22 21:23:55.662979 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3612/6927] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:55 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:55.671447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-0219307a-2e72-4b7e-85b9-9e3dab12857a req-7436e48a-37db-45d5-b539-725a71de195f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d45478b2-2111-4644-a1c1-609e88b42d1c", "name": "network-vif-deleted", "tag": "90a69713-d872-4a2f-aa0b-b9a4b9c625d0"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:55.673278 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:55.673278 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:23:55.714926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0219307a-2e72-4b7e-85b9-9e3dab12857a req-7436e48a-37db-45d5-b539-725a71de195f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:55.715557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0219307a-2e72-4b7e-85b9-9e3dab12857a req-7436e48a-37db-45d5-b539-725a71de195f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:55.731171 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-0219307a-2e72-4b7e-85b9-9e3dab12857a req-7436e48a-37db-45d5-b539-725a71de195f service nova] Creating event network-vif-deleted:90a69713-d872-4a2f-aa0b-b9a4b9c625d0 for instance d45478b2-2111-4644-a1c1-609e88b42d1c on nch2-master-1 Jan 22 21:23:55.738086 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-0219307a-2e72-4b7e-85b9-9e3dab12857a req-7436e48a-37db-45d5-b539-725a71de195f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083629 Jan 22 21:23:55.739379 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3613/6928] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:55.770050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08441038-a193-485d-9b80-07ce9d18cb3c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:55.775106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-08441038-a193-485d-9b80-07ce9d18cb3c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:55.959316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-08441038-a193-485d-9b80-07ce9d18cb3c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:55.972182 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-08441038-a193-485d-9b80-07ce9d18cb3c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1216 microversion: 2.1 time: 0.231308 Jan 22 21:23:55.973344 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3614/6929] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:55 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1216 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:56.149861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f6fb5491-23ee-4dc6-ada1-1c2eb0f5ab32 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:56.153309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f6fb5491-23ee-4dc6-ada1-1c2eb0f5ab32 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:56.166392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6fb5491-23ee-4dc6-ada1-1c2eb0f5ab32 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:56.166945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6fb5491-23ee-4dc6-ada1-1c2eb0f5ab32 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:56.168289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6fb5491-23ee-4dc6-ada1-1c2eb0f5ab32 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:56.168953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6fb5491-23ee-4dc6-ada1-1c2eb0f5ab32 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:56.230074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1312e907-8df3-40a6-a2d5-74f903e95b9e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:56.243329 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1312e907-8df3-40a6-a2d5-74f903e95b9e tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1518 microversion: 2.1 time: 1.109536 Jan 22 21:23:56.251121 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3316/6930] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:55 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1518 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:56.666061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-44936458-4d60-4cb9-a61d-4ccb8d90bf10 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:56.667063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-44936458-4d60-4cb9-a61d-4ccb8d90bf10 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:56.685195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44936458-4d60-4cb9-a61d-4ccb8d90bf10 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:56.691335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44936458-4d60-4cb9-a61d-4ccb8d90bf10 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:56.702703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44936458-4d60-4cb9-a61d-4ccb8d90bf10 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:56.703437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44936458-4d60-4cb9-a61d-4ccb8d90bf10 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:56.737013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6fb5491-23ee-4dc6-ada1-1c2eb0f5ab32 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:56.737494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6fb5491-23ee-4dc6-ada1-1c2eb0f5ab32 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:56.737981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-f6fb5491-23ee-4dc6-ada1-1c2eb0f5ab32 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lazy-loading 'fault' on Instance uuid d45478b2-2111-4644-a1c1-609e88b42d1c {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:23:56.835629 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-44936458-4d60-4cb9-a61d-4ccb8d90bf10 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.169116 Jan 22 21:23:56.835629 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3317/6931] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:56 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:56.847173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f6fb5491-23ee-4dc6-ada1-1c2eb0f5ab32 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:56.857668 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f6fb5491-23ee-4dc6-ada1-1c2eb0f5ab32 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 200 len: 1306 microversion: 2.1 time: 0.711233 Jan 22 21:23:56.858981 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3615/6932] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:56 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 1306 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:56.995467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-543ea601-530a-47ad-a55b-5db4c92d9db8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:56.996545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-543ea601-530a-47ad-a55b-5db4c92d9db8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:57.263111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-423ba0c7-bef1-4921-924f-00cc4c93c395 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:57.263751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-423ba0c7-bef1-4921-924f-00cc4c93c395 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:57.281537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-423ba0c7-bef1-4921-924f-00cc4c93c395 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:57.281537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-423ba0c7-bef1-4921-924f-00cc4c93c395 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:57.288238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-423ba0c7-bef1-4921-924f-00cc4c93c395 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:57.288763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-423ba0c7-bef1-4921-924f-00cc4c93c395 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:57.453399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-423ba0c7-bef1-4921-924f-00cc4c93c395 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:57.473943 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-423ba0c7-bef1-4921-924f-00cc4c93c395 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 200 len: 1307 microversion: 2.1 time: 0.214537 Jan 22 21:23:57.475259 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3616/6933] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:57 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 1307 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:57.688732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-543ea601-530a-47ad-a55b-5db4c92d9db8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:57.697709 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-543ea601-530a-47ad-a55b-5db4c92d9db8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1216 microversion: 2.1 time: 0.710403 Jan 22 21:23:57.699569 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3318/6934] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:56 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1216 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:57.844229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-53f6303b-b94a-4d20-983c-7aa78c6b80b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:57.845285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-53f6303b-b94a-4d20-983c-7aa78c6b80b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:57.855749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53f6303b-b94a-4d20-983c-7aa78c6b80b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:57.860271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53f6303b-b94a-4d20-983c-7aa78c6b80b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:57.861624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53f6303b-b94a-4d20-983c-7aa78c6b80b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:57.862435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53f6303b-b94a-4d20-983c-7aa78c6b80b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:57.884624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-60393d74-e180-4eb3-a847-bad3f9a3b283 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:57.885349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-60393d74-e180-4eb3-a847-bad3f9a3b283 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: d45478b2-2111-4644-a1c1-609e88b42d1c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:57.892022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60393d74-e180-4eb3-a847-bad3f9a3b283 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:57.897324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60393d74-e180-4eb3-a847-bad3f9a3b283 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:57.898326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60393d74-e180-4eb3-a847-bad3f9a3b283 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:57.898846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60393d74-e180-4eb3-a847-bad3f9a3b283 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:57.937887 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-60393d74-e180-4eb3-a847-bad3f9a3b283 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] HTTP exception thrown: Instance d45478b2-2111-4644-a1c1-609e88b42d1c could not be found. Jan 22 21:23:57.940211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-60393d74-e180-4eb3-a847-bad3f9a3b283 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Returning 404 to user: Instance d45478b2-2111-4644-a1c1-609e88b42d1c could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:23:57.940211 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-60393d74-e180-4eb3-a847-bad3f9a3b283 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c" status: 404 len: 111 microversion: 2.1 time: 0.059037 Jan 22 21:23:57.941694 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3319/6935] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:57 2022] GET /compute/v2.1/servers/d45478b2-2111-4644-a1c1-609e88b42d1c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:23:57.969319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-3827464e-4bb7-471e-bf0a-0ae2b6df2fde req-30f24d96-cec1-4494-b950-2288c040f481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72a8658-ab56-4cad-9ca5-9b053c3de51d", "name": "network-vif-deleted", "tag": "c133c4c9-6f72-48b4-baf4-44d21a6e1364"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:57.973013 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-53f6303b-b94a-4d20-983c-7aa78c6b80b3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.129007 Jan 22 21:23:57.975288 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3617/6936] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:57 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:23:57.975811 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:23:57.975811 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:23:57.997154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3827464e-4bb7-471e-bf0a-0ae2b6df2fde req-30f24d96-cec1-4494-b950-2288c040f481 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:57.998818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3827464e-4bb7-471e-bf0a-0ae2b6df2fde req-30f24d96-cec1-4494-b950-2288c040f481 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:58.011463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1282394389", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "ed96d77f-abc8-4d67-a986-37c4b82f7f2a"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:58.039720 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-3827464e-4bb7-471e-bf0a-0ae2b6df2fde req-30f24d96-cec1-4494-b950-2288c040f481 service nova] Creating event network-vif-deleted:c133c4c9-6f72-48b4-baf4-44d21a6e1364 for instance c72a8658-ab56-4cad-9ca5-9b053c3de51d on nch2-master-1 Jan 22 21:23:58.050036 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-3827464e-4bb7-471e-bf0a-0ae2b6df2fde req-30f24d96-cec1-4494-b950-2288c040f481 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106071 Jan 22 21:23:58.052930 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3320/6937] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:23:58.141166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] validate_networks() for [('ed96d77f-abc8-4d67-a986-37c4b82f7f2a', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:23:58.493560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a8cff660-e13d-4a54-900c-ba3feabbfe84 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:58.496027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a8cff660-e13d-4a54-900c-ba3feabbfe84 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: c72a8658-ab56-4cad-9ca5-9b053c3de51d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:58.507404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8cff660-e13d-4a54-900c-ba3feabbfe84 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:58.508130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8cff660-e13d-4a54-900c-ba3feabbfe84 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:58.509130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8cff660-e13d-4a54-900c-ba3feabbfe84 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:58.509837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8cff660-e13d-4a54-900c-ba3feabbfe84 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:58.549191 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-a8cff660-e13d-4a54-900c-ba3feabbfe84 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] HTTP exception thrown: Instance c72a8658-ab56-4cad-9ca5-9b053c3de51d could not be found. Jan 22 21:23:58.550195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a8cff660-e13d-4a54-900c-ba3feabbfe84 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Returning 404 to user: Instance c72a8658-ab56-4cad-9ca5-9b053c3de51d could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:23:58.551310 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a8cff660-e13d-4a54-900c-ba3feabbfe84 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d" status: 404 len: 111 microversion: 2.1 time: 0.062569 Jan 22 21:23:58.552283 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3321/6938] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:58 2022] GET /compute/v2.1/servers/c72a8658-ab56-4cad-9ca5-9b053c3de51d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:23:58.561296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-22cc9d92-25ed-4872-ab53-e55228e087c1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:58.562023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-22cc9d92-25ed-4872-ab53-e55228e087c1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:58.578456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22cc9d92-25ed-4872-ab53-e55228e087c1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:58.579230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22cc9d92-25ed-4872-ab53-e55228e087c1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:58.581893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22cc9d92-25ed-4872-ab53-e55228e087c1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:58.582598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22cc9d92-25ed-4872-ab53-e55228e087c1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:58.655391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-22cc9d92-25ed-4872-ab53-e55228e087c1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:23:58.901384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:23:58.901898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:23:58.902499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:23:58.902981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:23:58.903467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:23:58.913820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:58.914932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:58.916067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:58.917371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:58.948808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Getting quotas for project 8a97cd2dba7a47729ce29b8973f3bc44. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:23:58.956151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Getting quotas for user bc249e0680014981888b464000ff24fe and project 8a97cd2dba7a47729ce29b8973f3bc44. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:23:58.983752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:23:58.983752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:23:59.148380 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-22cc9d92-25ed-4872-ab53-e55228e087c1 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 204 len: 0 microversion: 2.1 time: 0.590232 Jan 22 21:23:59.149830 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3322/6939] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:23:58 2022] DELETE /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:23:59.160265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9c039ba2-a921-439b-832f-988f680a6ebd tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:59.161277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9c039ba2-a921-439b-832f-988f680a6ebd tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:59.173988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c039ba2-a921-439b-832f-988f680a6ebd tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:59.174447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c039ba2-a921-439b-832f-988f680a6ebd tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:59.175450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c039ba2-a921-439b-832f-988f680a6ebd tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:59.176090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c039ba2-a921-439b-832f-988f680a6ebd tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:59.251748 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-81d3b842-196f-4b12-b025-25c585b95ac7 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.242469 Jan 22 21:23:59.259119 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3618/6940] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:23:58 2022] POST /compute/v2.1/servers => generated 382 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:23:59.273169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-297e9fd2-5db6-409d-8da2-6ac43ce6b3a6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:23:59.275699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-297e9fd2-5db6-409d-8da2-6ac43ce6b3a6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:59.286477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-297e9fd2-5db6-409d-8da2-6ac43ce6b3a6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:59.288826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-297e9fd2-5db6-409d-8da2-6ac43ce6b3a6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:59.290453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-297e9fd2-5db6-409d-8da2-6ac43ce6b3a6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:59.291086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-297e9fd2-5db6-409d-8da2-6ac43ce6b3a6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:59.361069 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-297e9fd2-5db6-409d-8da2-6ac43ce6b3a6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.099717 Jan 22 21:23:59.366981 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3619/6941] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:23:59 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:23:59.373890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3b51d9fe-f2b8-4718-8c4d-a52e87de17f3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:59.375451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3b51d9fe-f2b8-4718-8c4d-a52e87de17f3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:59.384783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b51d9fe-f2b8-4718-8c4d-a52e87de17f3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:59.385458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b51d9fe-f2b8-4718-8c4d-a52e87de17f3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:59.387072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b51d9fe-f2b8-4718-8c4d-a52e87de17f3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:59.387698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b51d9fe-f2b8-4718-8c4d-a52e87de17f3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:59.415893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9c039ba2-a921-439b-832f-988f680a6ebd tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:59.438234 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9c039ba2-a921-439b-832f-988f680a6ebd tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1276 microversion: 2.1 time: 0.283577 Jan 22 21:23:59.438894 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3323/6942] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:59 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1276 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:59.453641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-59c58484-819a-4dff-9898-878ff68c66e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:59.454175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-59c58484-819a-4dff-9898-878ff68c66e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:59.476128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59c58484-819a-4dff-9898-878ff68c66e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:59.478882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59c58484-819a-4dff-9898-878ff68c66e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:59.480983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59c58484-819a-4dff-9898-878ff68c66e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:59.483863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59c58484-819a-4dff-9898-878ff68c66e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:59.535388 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-59c58484-819a-4dff-9898-878ff68c66e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] HTTP exception thrown: Instance 89583718-5186-41d5-b5f3-ad8997c3eb59 could not be found. Jan 22 21:23:59.536193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-59c58484-819a-4dff-9898-878ff68c66e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Returning 404 to user: Instance 89583718-5186-41d5-b5f3-ad8997c3eb59 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:23:59.537471 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-59c58484-819a-4dff-9898-878ff68c66e3 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "DELETE /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 404 len: 111 microversion: 2.20 time: 0.096887 Jan 22 21:23:59.542119 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3324/6943] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:23:59 2022] DELETE /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:23:59.555379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d25d4817-18c3-44fc-ab0d-bbe8cf8bfec6 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:59.556230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d25d4817-18c3-44fc-ab0d-bbe8cf8bfec6 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:59.654248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d25d4817-18c3-44fc-ab0d-bbe8cf8bfec6 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:59.664863 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d25d4817-18c3-44fc-ab0d-bbe8cf8bfec6 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1218 microversion: 2.1 time: 0.121476 Jan 22 21:23:59.666689 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3325/6944] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:59 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:59.686715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bac92822-a46e-4d49-bacb-463f77fac2a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:23:59.687607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bac92822-a46e-4d49-bacb-463f77fac2a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 89583718-5186-41d5-b5f3-ad8997c3eb59] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:23:59.697829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bac92822-a46e-4d49-bacb-463f77fac2a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:59.699530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bac92822-a46e-4d49-bacb-463f77fac2a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:59.700685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bac92822-a46e-4d49-bacb-463f77fac2a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:23:59.702137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bac92822-a46e-4d49-bacb-463f77fac2a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:23:59.705141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3b51d9fe-f2b8-4718-8c4d-a52e87de17f3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:23:59.714748 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3b51d9fe-f2b8-4718-8c4d-a52e87de17f3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1519 microversion: 2.1 time: 0.346133 Jan 22 21:23:59.715342 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3620/6945] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:23:59 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1519 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:23:59.722241 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-bac92822-a46e-4d49-bacb-463f77fac2a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] HTTP exception thrown: Instance 89583718-5186-41d5-b5f3-ad8997c3eb59 could not be found. Jan 22 21:23:59.728876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bac92822-a46e-4d49-bacb-463f77fac2a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Returning 404 to user: Instance 89583718-5186-41d5-b5f3-ad8997c3eb59 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:23:59.728876 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bac92822-a46e-4d49-bacb-463f77fac2a6 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59" status: 404 len: 111 microversion: 2.20 time: 0.042644 Jan 22 21:23:59.728876 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3326/6946] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:23:59 2022] GET /compute/v2.1/servers/89583718-5186-41d5-b5f3-ad8997c3eb59 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:24:00.377520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6d6ae7be-28e6-41bb-8661-e1e58ed7cc47 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:00.382655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6d6ae7be-28e6-41bb-8661-e1e58ed7cc47 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:00.400841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d6ae7be-28e6-41bb-8661-e1e58ed7cc47 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:00.402027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d6ae7be-28e6-41bb-8661-e1e58ed7cc47 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:00.404779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d6ae7be-28e6-41bb-8661-e1e58ed7cc47 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:00.406535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d6ae7be-28e6-41bb-8661-e1e58ed7cc47 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:00.456172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d0f45a66-a024-4752-992a-c89e174b88fc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:00.457636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d0f45a66-a024-4752-992a-c89e174b88fc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:00.479219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0f45a66-a024-4752-992a-c89e174b88fc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:00.488745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0f45a66-a024-4752-992a-c89e174b88fc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:00.488745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0f45a66-a024-4752-992a-c89e174b88fc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:00.488745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0f45a66-a024-4752-992a-c89e174b88fc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:00.543049 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6d6ae7be-28e6-41bb-8661-e1e58ed7cc47 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.168838 Jan 22 21:24:00.545679 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3621/6947] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:00 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:00.690319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-47f12f73-9165-4721-bf63-2e6c3d591047 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:00.697073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-47f12f73-9165-4721-bf63-2e6c3d591047 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:00.710023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47f12f73-9165-4721-bf63-2e6c3d591047 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:00.710805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47f12f73-9165-4721-bf63-2e6c3d591047 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:00.712579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47f12f73-9165-4721-bf63-2e6c3d591047 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:00.714049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47f12f73-9165-4721-bf63-2e6c3d591047 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:00.984483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-47f12f73-9165-4721-bf63-2e6c3d591047 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:01.000500 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-47f12f73-9165-4721-bf63-2e6c3d591047 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1222 microversion: 2.1 time: 0.319370 Jan 22 21:24:01.011008 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3622/6948] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:00 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1222 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:01.012574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d0f45a66-a024-4752-992a-c89e174b88fc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:01.016663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ebede25e-cb82-45ea-9256-8b803f64360a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:01.019866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ebede25e-cb82-45ea-9256-8b803f64360a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:01.025087 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d0f45a66-a024-4752-992a-c89e174b88fc tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1274 microversion: 2.1 time: 0.572551 Jan 22 21:24:01.028171 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3327/6949] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:00 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1274 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:24:01.047435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebede25e-cb82-45ea-9256-8b803f64360a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:01.049293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebede25e-cb82-45ea-9256-8b803f64360a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:01.051119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebede25e-cb82-45ea-9256-8b803f64360a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:01.051569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebede25e-cb82-45ea-9256-8b803f64360a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:01.556155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2e2f9a8c-0f05-45a8-9fc0-9722bacda072 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:01.557145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2e2f9a8c-0f05-45a8-9fc0-9722bacda072 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:01.564979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e2f9a8c-0f05-45a8-9fc0-9722bacda072 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:01.568557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e2f9a8c-0f05-45a8-9fc0-9722bacda072 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:01.568557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e2f9a8c-0f05-45a8-9fc0-9722bacda072 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:01.568557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e2f9a8c-0f05-45a8-9fc0-9722bacda072 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:01.648116 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2e2f9a8c-0f05-45a8-9fc0-9722bacda072 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.094945 Jan 22 21:24:01.659683 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3328/6950] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:01 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:24:01.703883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ebede25e-cb82-45ea-9256-8b803f64360a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:01.717772 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ebede25e-cb82-45ea-9256-8b803f64360a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1519 microversion: 2.1 time: 0.704333 Jan 22 21:24:01.718834 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3623/6951] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:01 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1519 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:02.025685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-063057ee-025c-4f13-8ec8-45aad24b4e9f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:02.026919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-063057ee-025c-4f13-8ec8-45aad24b4e9f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:02.042153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-063057ee-025c-4f13-8ec8-45aad24b4e9f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:02.042889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-063057ee-025c-4f13-8ec8-45aad24b4e9f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:02.043929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-063057ee-025c-4f13-8ec8-45aad24b4e9f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:02.044480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-67295578-1ee7-41e8-80c0-6e681db1444a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:02.045251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-063057ee-025c-4f13-8ec8-45aad24b4e9f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:02.045776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-67295578-1ee7-41e8-80c0-6e681db1444a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:02.058453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67295578-1ee7-41e8-80c0-6e681db1444a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:02.062759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67295578-1ee7-41e8-80c0-6e681db1444a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:02.062759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67295578-1ee7-41e8-80c0-6e681db1444a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:02.062759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67295578-1ee7-41e8-80c0-6e681db1444a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:02.231140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-063057ee-025c-4f13-8ec8-45aad24b4e9f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:02.242268 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-063057ee-025c-4f13-8ec8-45aad24b4e9f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1270 microversion: 2.1 time: 0.224164 Jan 22 21:24:02.245671 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3329/6952] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:02 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1270 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:02.663369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-22d2e1e2-1187-4899-a0cc-b32f335071dd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:02.665487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-22d2e1e2-1187-4899-a0cc-b32f335071dd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:02.676754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22d2e1e2-1187-4899-a0cc-b32f335071dd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:02.676754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22d2e1e2-1187-4899-a0cc-b32f335071dd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:02.676754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22d2e1e2-1187-4899-a0cc-b32f335071dd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:02.676754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22d2e1e2-1187-4899-a0cc-b32f335071dd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:02.711412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-67295578-1ee7-41e8-80c0-6e681db1444a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:02.724050 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-67295578-1ee7-41e8-80c0-6e681db1444a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1316 microversion: 2.1 time: 0.680429 Jan 22 21:24:02.728738 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3624/6953] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:02 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1316 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:02.747356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0e72e5cb-0b9a-4176-a84f-c9d87c8efb64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:02.749017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0e72e5cb-0b9a-4176-a84f-c9d87c8efb64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:02.755542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e72e5cb-0b9a-4176-a84f-c9d87c8efb64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:02.764290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-22d2e1e2-1187-4899-a0cc-b32f335071dd tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.105030 Jan 22 21:24:02.765100 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3330/6954] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:02 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:24:02.766096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e72e5cb-0b9a-4176-a84f-c9d87c8efb64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:02.767634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e72e5cb-0b9a-4176-a84f-c9d87c8efb64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:02.772476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e72e5cb-0b9a-4176-a84f-c9d87c8efb64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:02.893763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-3f92b014-2597-480f-bee4-ef47a61cfadf req-6f60361a-99b4-46ed-8965-4a0722f537c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6316a4f8-60dc-49da-98c2-3395f338f324", "name": "network-vif-deleted", "tag": "b990c73c-2a43-4448-af8b-ba36388255b7"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:02.900458 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:24:02.900458 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:24:02.930643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3f92b014-2597-480f-bee4-ef47a61cfadf req-6f60361a-99b4-46ed-8965-4a0722f537c3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:02.935948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3f92b014-2597-480f-bee4-ef47a61cfadf req-6f60361a-99b4-46ed-8965-4a0722f537c3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:02.962899 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-3f92b014-2597-480f-bee4-ef47a61cfadf req-6f60361a-99b4-46ed-8965-4a0722f537c3 service nova] Creating event network-vif-deleted:b990c73c-2a43-4448-af8b-ba36388255b7 for instance 6316a4f8-60dc-49da-98c2-3395f338f324 on nch2-master-1 Jan 22 21:24:02.981569 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-3f92b014-2597-480f-bee4-ef47a61cfadf req-6f60361a-99b4-46ed-8965-4a0722f537c3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092639 Jan 22 21:24:02.981569 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3331/6955] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:24:02.994771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0e72e5cb-0b9a-4176-a84f-c9d87c8efb64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:03.011593 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0e72e5cb-0b9a-4176-a84f-c9d87c8efb64 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1477 microversion: 2.1 time: 0.264320 Jan 22 21:24:03.015588 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3625/6956] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:02 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1477 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:03.262895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-26a662fa-3ee2-4809-b0e6-c16b4029d389 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:03.265815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-26a662fa-3ee2-4809-b0e6-c16b4029d389 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:03.280292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26a662fa-3ee2-4809-b0e6-c16b4029d389 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:03.283189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26a662fa-3ee2-4809-b0e6-c16b4029d389 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:03.284326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26a662fa-3ee2-4809-b0e6-c16b4029d389 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:03.285148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26a662fa-3ee2-4809-b0e6-c16b4029d389 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:03.464682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-26a662fa-3ee2-4809-b0e6-c16b4029d389 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:03.486537 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-26a662fa-3ee2-4809-b0e6-c16b4029d389 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1276 microversion: 2.1 time: 0.223908 Jan 22 21:24:03.487346 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3332/6957] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:03 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1276 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:03.746112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dc8f8fdd-96ae-4072-9d2f-ea159eae3ae1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:03.746782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dc8f8fdd-96ae-4072-9d2f-ea159eae3ae1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:03.762569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc8f8fdd-96ae-4072-9d2f-ea159eae3ae1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:03.763037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc8f8fdd-96ae-4072-9d2f-ea159eae3ae1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:03.765871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc8f8fdd-96ae-4072-9d2f-ea159eae3ae1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:03.766347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc8f8fdd-96ae-4072-9d2f-ea159eae3ae1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:03.787350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c10e708d-ab6c-4507-a67a-b45ad331c640 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:03.791251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c10e708d-ab6c-4507-a67a-b45ad331c640 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:03.814002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c10e708d-ab6c-4507-a67a-b45ad331c640 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:03.823306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c10e708d-ab6c-4507-a67a-b45ad331c640 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:03.824807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c10e708d-ab6c-4507-a67a-b45ad331c640 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:03.825488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c10e708d-ab6c-4507-a67a-b45ad331c640 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:03.926897 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c10e708d-ab6c-4507-a67a-b45ad331c640 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.151410 Jan 22 21:24:03.929167 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3333/6958] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:03 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:04.037289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6d361428-4a7c-4625-89a3-7bf4487fdb8a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:04.039730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6d361428-4a7c-4625-89a3-7bf4487fdb8a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:04.059636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d361428-4a7c-4625-89a3-7bf4487fdb8a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:04.061370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d361428-4a7c-4625-89a3-7bf4487fdb8a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:04.065140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d361428-4a7c-4625-89a3-7bf4487fdb8a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:04.065991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d361428-4a7c-4625-89a3-7bf4487fdb8a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:04.136166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d361428-4a7c-4625-89a3-7bf4487fdb8a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:04.144287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d361428-4a7c-4625-89a3-7bf4487fdb8a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:04.145094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-6d361428-4a7c-4625-89a3-7bf4487fdb8a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lazy-loading 'fault' on Instance uuid 6316a4f8-60dc-49da-98c2-3395f338f324 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:24:04.220858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dc8f8fdd-96ae-4072-9d2f-ea159eae3ae1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:04.232200 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dc8f8fdd-96ae-4072-9d2f-ea159eae3ae1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1316 microversion: 2.1 time: 0.490172 Jan 22 21:24:04.233445 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3626/6959] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:03 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:04.317454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6d361428-4a7c-4625-89a3-7bf4487fdb8a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:04.335919 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6d361428-4a7c-4625-89a3-7bf4487fdb8a tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 200 len: 1312 microversion: 2.1 time: 0.306834 Jan 22 21:24:04.337119 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3334/6960] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:04 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 1312 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:04.509365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-803b336e-98e5-4dd9-a8a0-8b1e9110128c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:04.510042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-803b336e-98e5-4dd9-a8a0-8b1e9110128c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:04.522974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-803b336e-98e5-4dd9-a8a0-8b1e9110128c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:04.527711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-803b336e-98e5-4dd9-a8a0-8b1e9110128c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:04.527711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-803b336e-98e5-4dd9-a8a0-8b1e9110128c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:04.527711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-803b336e-98e5-4dd9-a8a0-8b1e9110128c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:04.640838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-803b336e-98e5-4dd9-a8a0-8b1e9110128c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:04.649126 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-803b336e-98e5-4dd9-a8a0-8b1e9110128c tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1276 microversion: 2.1 time: 0.147522 Jan 22 21:24:04.651799 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3627/6961] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:04 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:04.943518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1f50e6a2-f86d-4515-8af2-dfbacf3dd3f0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:04.944696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1f50e6a2-f86d-4515-8af2-dfbacf3dd3f0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:04.952223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f50e6a2-f86d-4515-8af2-dfbacf3dd3f0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:04.953178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f50e6a2-f86d-4515-8af2-dfbacf3dd3f0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:04.954139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f50e6a2-f86d-4515-8af2-dfbacf3dd3f0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:04.954834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f50e6a2-f86d-4515-8af2-dfbacf3dd3f0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:05.037250 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1f50e6a2-f86d-4515-8af2-dfbacf3dd3f0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.096710 Jan 22 21:24:05.037250 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3335/6962] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:04 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:24:05.249665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3a41efec-759d-47b7-bf85-04b8b9ddd67b tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:05.250289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3a41efec-759d-47b7-bf85-04b8b9ddd67b tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:05.269700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a41efec-759d-47b7-bf85-04b8b9ddd67b tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:05.270509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a41efec-759d-47b7-bf85-04b8b9ddd67b tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:05.271714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a41efec-759d-47b7-bf85-04b8b9ddd67b tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:05.273116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a41efec-759d-47b7-bf85-04b8b9ddd67b tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:05.355777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0847e896-292f-45b3-8a8f-a18bc049bc95 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:05.356426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0847e896-292f-45b3-8a8f-a18bc049bc95 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 6316a4f8-60dc-49da-98c2-3395f338f324] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:05.380827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0847e896-292f-45b3-8a8f-a18bc049bc95 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:05.381565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0847e896-292f-45b3-8a8f-a18bc049bc95 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:05.382620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0847e896-292f-45b3-8a8f-a18bc049bc95 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:05.383227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0847e896-292f-45b3-8a8f-a18bc049bc95 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:05.424612 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-0847e896-292f-45b3-8a8f-a18bc049bc95 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] HTTP exception thrown: Instance 6316a4f8-60dc-49da-98c2-3395f338f324 could not be found. Jan 22 21:24:05.425781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0847e896-292f-45b3-8a8f-a18bc049bc95 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Returning 404 to user: Instance 6316a4f8-60dc-49da-98c2-3395f338f324 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:24:05.430739 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0847e896-292f-45b3-8a8f-a18bc049bc95 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324" status: 404 len: 111 microversion: 2.1 time: 0.080721 Jan 22 21:24:05.431929 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3336/6963] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:05 2022] GET /compute/v2.1/servers/6316a4f8-60dc-49da-98c2-3395f338f324 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:24:05.670658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a7657e79-124c-471e-befa-07c4e1a4f8f1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:05.671637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a7657e79-124c-471e-befa-07c4e1a4f8f1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:05.684212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7657e79-124c-471e-befa-07c4e1a4f8f1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:05.685153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7657e79-124c-471e-befa-07c4e1a4f8f1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:05.686335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7657e79-124c-471e-befa-07c4e1a4f8f1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:05.686995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7657e79-124c-471e-befa-07c4e1a4f8f1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:05.777213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3a41efec-759d-47b7-bf85-04b8b9ddd67b tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:05.790620 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3a41efec-759d-47b7-bf85-04b8b9ddd67b tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1337 microversion: 2.1 time: 0.545148 Jan 22 21:24:05.793128 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3628/6964] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:05 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1337 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:06.044308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b1747d9-08dd-4a76-9c8e-b1969afb363d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:06.045940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b1747d9-08dd-4a76-9c8e-b1969afb363d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:06.053445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b1747d9-08dd-4a76-9c8e-b1969afb363d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:06.054231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b1747d9-08dd-4a76-9c8e-b1969afb363d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:06.055327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b1747d9-08dd-4a76-9c8e-b1969afb363d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:06.055969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b1747d9-08dd-4a76-9c8e-b1969afb363d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:06.115548 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b1747d9-08dd-4a76-9c8e-b1969afb363d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.074365 Jan 22 21:24:06.117236 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3629/6965] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:06 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:06.534956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a7657e79-124c-471e-befa-07c4e1a4f8f1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:06.549331 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a7657e79-124c-471e-befa-07c4e1a4f8f1 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1318 microversion: 2.1 time: 0.882976 Jan 22 21:24:06.560042 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3337/6966] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:05 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1318 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:06.808886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b0295f3-1959-4454-a5a1-a6ca580a9899 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:06.810992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6b0295f3-1959-4454-a5a1-a6ca580a9899 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:06.818560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b0295f3-1959-4454-a5a1-a6ca580a9899 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:06.819022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b0295f3-1959-4454-a5a1-a6ca580a9899 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:06.819995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b0295f3-1959-4454-a5a1-a6ca580a9899 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:06.820636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b0295f3-1959-4454-a5a1-a6ca580a9899 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:06.995908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d5bda531-0806-4ace-9920-79c30607100d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '.version_select at 0x7f1ed5a3d9d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:07.098010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6b0295f3-1959-4454-a5a1-a6ca580a9899 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:07.108901 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b0295f3-1959-4454-a5a1-a6ca580a9899 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1337 microversion: 2.1 time: 0.303747 Jan 22 21:24:07.110879 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3630/6967] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:06 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1337 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:07.128965 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d5bda531-0806-4ace-9920-79c30607100d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-69235120" status: 202 len: 0 microversion: 2.1 time: 0.135818 Jan 22 21:24:07.129309 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3338/6968] 10.222.0.100 () {58 vars in 1282 bytes} [Sat Jan 22 21:24:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-69235120 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:24:07.131755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1a79f0be-6bc3-4046-8924-32414048e51d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:07.132932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1a79f0be-6bc3-4046-8924-32414048e51d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:07.152923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a79f0be-6bc3-4046-8924-32414048e51d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:07.163481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a79f0be-6bc3-4046-8924-32414048e51d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:07.164740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a79f0be-6bc3-4046-8924-32414048e51d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:07.165383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a79f0be-6bc3-4046-8924-32414048e51d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:07.169422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f5d4a7d0-15f9-4298-b211-28a3382e8355 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'create', calling method: .version_select at 0x7f1ed5d739d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-270184739"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:07.187406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-f5d4a7d0-15f9-4298-b211-28a3382e8355 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:24:07.195095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-f5d4a7d0-15f9-4298-b211-28a3382e8355 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for user 80aa2e03fde44436844a88a0ccc5d6a6 and project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:24:07.226973 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1a79f0be-6bc3-4046-8924-32414048e51d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.101109 Jan 22 21:24:07.228291 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3631/6969] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:07 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:24:07.570118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-303e3267-3629-45f2-8e74-86998648a160 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:07.574038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-303e3267-3629-45f2-8e74-86998648a160 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:07.587359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-303e3267-3629-45f2-8e74-86998648a160 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:07.587908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-303e3267-3629-45f2-8e74-86998648a160 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:07.589000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-303e3267-3629-45f2-8e74-86998648a160 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:07.589575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-303e3267-3629-45f2-8e74-86998648a160 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:07.929066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-f5d4a7d0-15f9-4298-b211-28a3382e8355 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:24:07.945240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-f5d4a7d0-15f9-4298-b211-28a3382e8355 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for user 80aa2e03fde44436844a88a0ccc5d6a6 and project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:24:07.958030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-303e3267-3629-45f2-8e74-86998648a160 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:07.979081 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f5d4a7d0-15f9-4298-b211-28a3382e8355 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.814020 Jan 22 21:24:07.984592 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3339/6970] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:24:07 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:07.989202 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-303e3267-3629-45f2-8e74-86998648a160 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1318 microversion: 2.1 time: 0.425597 Jan 22 21:24:07.991225 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3632/6971] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:07 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:08.129168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5078b2bc-2686-4a78-9b11-0df993019bea tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:08.129611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5078b2bc-2686-4a78-9b11-0df993019bea tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:08.141841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5078b2bc-2686-4a78-9b11-0df993019bea tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:08.142389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5078b2bc-2686-4a78-9b11-0df993019bea tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:08.143167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5078b2bc-2686-4a78-9b11-0df993019bea tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:08.144606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5078b2bc-2686-4a78-9b11-0df993019bea tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:08.252159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5b10dd09-f748-4e8c-945f-ed84c3960229 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:08.253400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5b10dd09-f748-4e8c-945f-ed84c3960229 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:08.266015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b10dd09-f748-4e8c-945f-ed84c3960229 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:08.266796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b10dd09-f748-4e8c-945f-ed84c3960229 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:08.268048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b10dd09-f748-4e8c-945f-ed84c3960229 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:08.268713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b10dd09-f748-4e8c-945f-ed84c3960229 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:08.360814 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5b10dd09-f748-4e8c-945f-ed84c3960229 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.117057 Jan 22 21:24:08.361963 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3633/6972] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:08 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:24:08.448313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-cd291ad1-234d-4a46-98b6-82b55b187932 req-50354ae0-c103-46c7-98eb-c23430ae466b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d1e62f2-2ac4-429b-ac51-e10fbb378afe", "tag": "696a1df9-47c9-480f-9c97-a0af39fe4c01"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:08.449939 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:24:08.449939 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:24:08.461108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-cd291ad1-234d-4a46-98b6-82b55b187932 req-50354ae0-c103-46c7-98eb-c23430ae466b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:08.462171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-cd291ad1-234d-4a46-98b6-82b55b187932 req-50354ae0-c103-46c7-98eb-c23430ae466b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:08.488186 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-cd291ad1-234d-4a46-98b6-82b55b187932 req-50354ae0-c103-46c7-98eb-c23430ae466b service nova] Creating event network-changed:696a1df9-47c9-480f-9c97-a0af39fe4c01 for instance 9d1e62f2-2ac4-429b-ac51-e10fbb378afe on nch1-master-1 Jan 22 21:24:08.495529 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-cd291ad1-234d-4a46-98b6-82b55b187932 req-50354ae0-c103-46c7-98eb-c23430ae466b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051273 Jan 22 21:24:08.498565 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3634/6973] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:24:09.009970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08dc9334-eac0-4645-bb29-0eb69d22e691 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:09.010682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-08dc9334-eac0-4645-bb29-0eb69d22e691 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:09.018659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08dc9334-eac0-4645-bb29-0eb69d22e691 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:09.019210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08dc9334-eac0-4645-bb29-0eb69d22e691 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:09.020440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08dc9334-eac0-4645-bb29-0eb69d22e691 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:09.020926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08dc9334-eac0-4645-bb29-0eb69d22e691 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:09.162565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5078b2bc-2686-4a78-9b11-0df993019bea tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:09.176763 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5078b2bc-2686-4a78-9b11-0df993019bea tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1337 microversion: 2.1 time: 1.051915 Jan 22 21:24:09.178819 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3340/6974] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:08 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1337 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:09.362529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-08dc9334-eac0-4645-bb29-0eb69d22e691 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:09.380530 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-08dc9334-eac0-4645-bb29-0eb69d22e691 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1318 microversion: 2.1 time: 0.368820 Jan 22 21:24:09.381774 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3635/6975] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:09 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:09.383859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fee72e7b-dd93-40f9-ad96-8cb6d1bb8ed2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:09.385028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fee72e7b-dd93-40f9-ad96-8cb6d1bb8ed2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:09.409950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fee72e7b-dd93-40f9-ad96-8cb6d1bb8ed2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:09.410429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fee72e7b-dd93-40f9-ad96-8cb6d1bb8ed2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:09.411267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fee72e7b-dd93-40f9-ad96-8cb6d1bb8ed2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:09.415150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fee72e7b-dd93-40f9-ad96-8cb6d1bb8ed2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:09.518906 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fee72e7b-dd93-40f9-ad96-8cb6d1bb8ed2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.142442 Jan 22 21:24:09.526830 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3341/6976] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:09 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:09.925201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b9c4d28e-a96a-448b-9edc-8864b5efe1a7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:09.925754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b9c4d28e-a96a-448b-9edc-8864b5efe1a7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:09.938048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9c4d28e-a96a-448b-9edc-8864b5efe1a7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:09.938759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9c4d28e-a96a-448b-9edc-8864b5efe1a7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:09.942930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9c4d28e-a96a-448b-9edc-8864b5efe1a7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:09.942930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9c4d28e-a96a-448b-9edc-8864b5efe1a7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:09.971985 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-b9c4d28e-a96a-448b-9edc-8864b5efe1a7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] HTTP exception thrown: Instance 8288fe26-7e9c-451c-a9a2-222abbcf201e could not be found. Jan 22 21:24:09.972870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b9c4d28e-a96a-448b-9edc-8864b5efe1a7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Returning 404 to user: Instance 8288fe26-7e9c-451c-a9a2-222abbcf201e could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:24:09.973962 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b9c4d28e-a96a-448b-9edc-8864b5efe1a7 tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 404 len: 111 microversion: 2.20 time: 0.052889 Jan 22 21:24:09.974703 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3636/6977] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:24:09 2022] DELETE /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:24:09.994415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5a57528e-1fcc-4fd7-a0d2-0a50f47f58df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:09.995430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5a57528e-1fcc-4fd7-a0d2-0a50f47f58df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] [instance: 8288fe26-7e9c-451c-a9a2-222abbcf201e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:10.004647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a57528e-1fcc-4fd7-a0d2-0a50f47f58df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:10.005792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a57528e-1fcc-4fd7-a0d2-0a50f47f58df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:10.007709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a57528e-1fcc-4fd7-a0d2-0a50f47f58df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:10.008333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a57528e-1fcc-4fd7-a0d2-0a50f47f58df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:10.030545 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-5a57528e-1fcc-4fd7-a0d2-0a50f47f58df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] HTTP exception thrown: Instance 8288fe26-7e9c-451c-a9a2-222abbcf201e could not be found. Jan 22 21:24:10.031600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5a57528e-1fcc-4fd7-a0d2-0a50f47f58df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] Returning 404 to user: Instance 8288fe26-7e9c-451c-a9a2-222abbcf201e could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:24:10.032823 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5a57528e-1fcc-4fd7-a0d2-0a50f47f58df tempest-AttachVolumeShelveTestJSON-1245575078 tempest-AttachVolumeShelveTestJSON-1245575078-project] 10.222.0.100 "GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e" status: 404 len: 111 microversion: 2.20 time: 0.053323 Jan 22 21:24:10.038392 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3342/6978] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:24:09 2022] GET /compute/v2.1/servers/8288fe26-7e9c-451c-a9a2-222abbcf201e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:24:10.195403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7a5401b0-50af-4f39-8c4a-96e07c97d751 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:10.196609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7a5401b0-50af-4f39-8c4a-96e07c97d751 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:10.218888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a5401b0-50af-4f39-8c4a-96e07c97d751 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:10.219424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a5401b0-50af-4f39-8c4a-96e07c97d751 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:10.232647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a5401b0-50af-4f39-8c4a-96e07c97d751 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:10.233470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a5401b0-50af-4f39-8c4a-96e07c97d751 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:10.398427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bd310c69-801f-4283-a5dd-e8e5849d9b3f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:10.399263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bd310c69-801f-4283-a5dd-e8e5849d9b3f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:10.409119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd310c69-801f-4283-a5dd-e8e5849d9b3f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:10.409648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd310c69-801f-4283-a5dd-e8e5849d9b3f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:10.413994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd310c69-801f-4283-a5dd-e8e5849d9b3f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:10.416620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd310c69-801f-4283-a5dd-e8e5849d9b3f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:10.852474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bd310c69-801f-4283-a5dd-e8e5849d9b3f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:10.862735 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bd310c69-801f-4283-a5dd-e8e5849d9b3f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1318 microversion: 2.1 time: 0.467777 Jan 22 21:24:10.867041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7a5401b0-50af-4f39-8c4a-96e07c97d751 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:10.875043 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3343/6979] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:10 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:24:10.877325 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7a5401b0-50af-4f39-8c4a-96e07c97d751 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1337 microversion: 2.1 time: 0.686231 Jan 22 21:24:10.889960 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3637/6980] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:10 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1337 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:10.894745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-526b884f-b63e-40a0-8dd6-f676dce90d37 req-4fc979e4-5de4-4e72-bca8-39d1f67079fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a333b3-7eae-42f9-b9de-4f6039bd8eb7", "tag": "b2d98517-c99e-4400-93f0-5758c75b4223"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:10.894929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4ece50aa-a43e-4429-add8-1135154183ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:10.904899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4ece50aa-a43e-4429-add8-1135154183ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:10.905449 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:24:10.905449 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:24:10.910078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ece50aa-a43e-4429-add8-1135154183ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:10.910891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ece50aa-a43e-4429-add8-1135154183ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:10.911110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-526b884f-b63e-40a0-8dd6-f676dce90d37 req-4fc979e4-5de4-4e72-bca8-39d1f67079fd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:10.911576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-526b884f-b63e-40a0-8dd6-f676dce90d37 req-4fc979e4-5de4-4e72-bca8-39d1f67079fd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:10.915188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ece50aa-a43e-4429-add8-1135154183ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:10.915896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ece50aa-a43e-4429-add8-1135154183ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:10.954702 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-526b884f-b63e-40a0-8dd6-f676dce90d37 req-4fc979e4-5de4-4e72-bca8-39d1f67079fd service nova] Creating event network-changed:b2d98517-c99e-4400-93f0-5758c75b4223 for instance a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 on nch2-master-1 Jan 22 21:24:10.968439 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-526b884f-b63e-40a0-8dd6-f676dce90d37 req-4fc979e4-5de4-4e72-bca8-39d1f67079fd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077161 Jan 22 21:24:10.969054 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3638/6981] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:24:11.006179 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4ece50aa-a43e-4429-add8-1135154183ca tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.129629 Jan 22 21:24:11.006856 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3344/6982] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:10 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:11.881720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fee93b7d-29dc-49d3-981d-d71dc115e211 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:11.882572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fee93b7d-29dc-49d3-981d-d71dc115e211 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:11.889256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fee93b7d-29dc-49d3-981d-d71dc115e211 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:11.889868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fee93b7d-29dc-49d3-981d-d71dc115e211 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:11.891050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fee93b7d-29dc-49d3-981d-d71dc115e211 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:11.892293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fee93b7d-29dc-49d3-981d-d71dc115e211 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:11.899308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-954d5489-a9fb-47c5-a702-8b0751600a9c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:11.912927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-954d5489-a9fb-47c5-a702-8b0751600a9c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:11.912927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-954d5489-a9fb-47c5-a702-8b0751600a9c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:11.912927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-954d5489-a9fb-47c5-a702-8b0751600a9c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:11.912927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-954d5489-a9fb-47c5-a702-8b0751600a9c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:11.912927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-954d5489-a9fb-47c5-a702-8b0751600a9c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:12.163549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fee93b7d-29dc-49d3-981d-d71dc115e211 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:12.186050 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fee93b7d-29dc-49d3-981d-d71dc115e211 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1318 microversion: 2.1 time: 0.308048 Jan 22 21:24:12.197280 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3639/6983] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:11 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:12.205761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aa27a505-6167-4a56-ae55-99c25bc2ea1e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:12.207162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aa27a505-6167-4a56-ae55-99c25bc2ea1e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:12.215026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa27a505-6167-4a56-ae55-99c25bc2ea1e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:12.215426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa27a505-6167-4a56-ae55-99c25bc2ea1e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:12.217122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa27a505-6167-4a56-ae55-99c25bc2ea1e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:12.217755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa27a505-6167-4a56-ae55-99c25bc2ea1e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:12.288411 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aa27a505-6167-4a56-ae55-99c25bc2ea1e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.086366 Jan 22 21:24:12.293317 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3640/6984] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:12 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:12.315765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-954d5489-a9fb-47c5-a702-8b0751600a9c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:12.326179 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-954d5489-a9fb-47c5-a702-8b0751600a9c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1337 microversion: 2.1 time: 0.432955 Jan 22 21:24:12.327223 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3345/6985] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:11 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1337 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:12.989281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-4e42bddc-b03d-4793-bd7c-b148242861fa req-faf9c9e4-9870-49dd-ab61-f542659e37ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a333b3-7eae-42f9-b9de-4f6039bd8eb7", "tag": "ef332a57-ef3d-4c8f-b5e7-d56312ed181f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:12.991336 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:24:12.991336 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:24:13.003445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4e42bddc-b03d-4793-bd7c-b148242861fa req-faf9c9e4-9870-49dd-ab61-f542659e37ed service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:13.003900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4e42bddc-b03d-4793-bd7c-b148242861fa req-faf9c9e4-9870-49dd-ab61-f542659e37ed service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:13.016691 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-4e42bddc-b03d-4793-bd7c-b148242861fa req-faf9c9e4-9870-49dd-ab61-f542659e37ed service nova] Creating event network-changed:ef332a57-ef3d-4c8f-b5e7-d56312ed181f for instance a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 on nch2-master-1 Jan 22 21:24:13.021676 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-4e42bddc-b03d-4793-bd7c-b148242861fa req-faf9c9e4-9870-49dd-ab61-f542659e37ed service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037789 Jan 22 21:24:13.022472 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3641/6986] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:24:13.203176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-59d8e9d1-d6c4-486f-b73e-ff0dc5fd2635 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:13.203795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-59d8e9d1-d6c4-486f-b73e-ff0dc5fd2635 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:13.218026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59d8e9d1-d6c4-486f-b73e-ff0dc5fd2635 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:13.219488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59d8e9d1-d6c4-486f-b73e-ff0dc5fd2635 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:13.222280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59d8e9d1-d6c4-486f-b73e-ff0dc5fd2635 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:13.223239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59d8e9d1-d6c4-486f-b73e-ff0dc5fd2635 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:13.301678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-49a73369-eba0-45fd-8801-5602d3056937 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:13.302703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-49a73369-eba0-45fd-8801-5602d3056937 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:13.316188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49a73369-eba0-45fd-8801-5602d3056937 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:13.316188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49a73369-eba0-45fd-8801-5602d3056937 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:13.320827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49a73369-eba0-45fd-8801-5602d3056937 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:13.321954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49a73369-eba0-45fd-8801-5602d3056937 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:13.411837 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-49a73369-eba0-45fd-8801-5602d3056937 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.114534 Jan 22 21:24:13.419171 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3642/6987] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:13 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:24:13.419171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-15f1cbec-6735-4e30-af60-b50813d89bc4 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:13.419171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-15f1cbec-6735-4e30-af60-b50813d89bc4 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:13.430655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15f1cbec-6735-4e30-af60-b50813d89bc4 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:13.440973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15f1cbec-6735-4e30-af60-b50813d89bc4 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:13.442461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15f1cbec-6735-4e30-af60-b50813d89bc4 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:13.446813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-15f1cbec-6735-4e30-af60-b50813d89bc4 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:14.004710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-59d8e9d1-d6c4-486f-b73e-ff0dc5fd2635 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:14.013858 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-59d8e9d1-d6c4-486f-b73e-ff0dc5fd2635 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1318 microversion: 2.1 time: 0.814253 Jan 22 21:24:14.014712 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3346/6988] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:13 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1318 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:14.222169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-15f1cbec-6735-4e30-af60-b50813d89bc4 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:14.230109 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-15f1cbec-6735-4e30-af60-b50813d89bc4 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1337 microversion: 2.1 time: 0.816493 Jan 22 21:24:14.230919 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3643/6989] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:13 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1337 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:14.425675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0ff8b39c-00b8-4aea-ba87-5a14e5d62d5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:14.427928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0ff8b39c-00b8-4aea-ba87-5a14e5d62d5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:14.435580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ff8b39c-00b8-4aea-ba87-5a14e5d62d5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:14.436198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ff8b39c-00b8-4aea-ba87-5a14e5d62d5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:14.437215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ff8b39c-00b8-4aea-ba87-5a14e5d62d5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:14.437839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ff8b39c-00b8-4aea-ba87-5a14e5d62d5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:14.516878 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0ff8b39c-00b8-4aea-ba87-5a14e5d62d5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.095701 Jan 22 21:24:14.517482 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3347/6990] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:14 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:15.035244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fd65f9d5-5623-4ee0-b412-6c18ea1d5af8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:15.036131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fd65f9d5-5623-4ee0-b412-6c18ea1d5af8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:15.062007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd65f9d5-5623-4ee0-b412-6c18ea1d5af8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:15.062561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd65f9d5-5623-4ee0-b412-6c18ea1d5af8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:15.063425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd65f9d5-5623-4ee0-b412-6c18ea1d5af8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:15.063881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd65f9d5-5623-4ee0-b412-6c18ea1d5af8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:15.110166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-79c17b6f-f8c7-4b46-b6fe-5cf6fdcbdc07 req-873d7415-62f1-44c7-8c9f-ee1e1df20b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1e62f2-2ac4-429b-ac51-e10fbb378afe", "name": "network-vif-plugged", "status": "completed", "tag": "696a1df9-47c9-480f-9c97-a0af39fe4c01"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:15.111832 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:24:15.111832 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:24:15.139488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-79c17b6f-f8c7-4b46-b6fe-5cf6fdcbdc07 req-873d7415-62f1-44c7-8c9f-ee1e1df20b32 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:15.139842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-79c17b6f-f8c7-4b46-b6fe-5cf6fdcbdc07 req-873d7415-62f1-44c7-8c9f-ee1e1df20b32 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:15.192866 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-79c17b6f-f8c7-4b46-b6fe-5cf6fdcbdc07 req-873d7415-62f1-44c7-8c9f-ee1e1df20b32 service nova] Creating event network-vif-plugged:696a1df9-47c9-480f-9c97-a0af39fe4c01 for instance 9d1e62f2-2ac4-429b-ac51-e10fbb378afe on nch1-master-1 Jan 22 21:24:15.204787 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-79c17b6f-f8c7-4b46-b6fe-5cf6fdcbdc07 req-873d7415-62f1-44c7-8c9f-ee1e1df20b32 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100678 Jan 22 21:24:15.205761 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3348/6991] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:24:15.255885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a8f01928-6589-4592-bebb-9c40bef6f592 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:15.260309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a8f01928-6589-4592-bebb-9c40bef6f592 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:15.298208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8f01928-6589-4592-bebb-9c40bef6f592 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:15.299190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8f01928-6589-4592-bebb-9c40bef6f592 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:15.300079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8f01928-6589-4592-bebb-9c40bef6f592 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:15.300540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8f01928-6589-4592-bebb-9c40bef6f592 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:15.572259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fd65f9d5-5623-4ee0-b412-6c18ea1d5af8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:15.585701 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fd65f9d5-5623-4ee0-b412-6c18ea1d5af8 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1318 microversion: 2.1 time: 0.554296 Jan 22 21:24:15.587346 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3644/6992] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:15 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:15.593352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5bec8fce-8a1e-4595-a05e-7ebe2fccd272 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:15.604637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5bec8fce-8a1e-4595-a05e-7ebe2fccd272 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:15.624510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bec8fce-8a1e-4595-a05e-7ebe2fccd272 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:15.624963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bec8fce-8a1e-4595-a05e-7ebe2fccd272 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:15.630770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bec8fce-8a1e-4595-a05e-7ebe2fccd272 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:15.631232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bec8fce-8a1e-4595-a05e-7ebe2fccd272 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:15.693661 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5bec8fce-8a1e-4595-a05e-7ebe2fccd272 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.104183 Jan 22 21:24:15.695018 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3645/6993] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:15 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:15.702142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1accb704-e099-4255-8de7-dfc535a8b49d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:15.714408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1accb704-e099-4255-8de7-dfc535a8b49d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:15.724222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1accb704-e099-4255-8de7-dfc535a8b49d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:15.724926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1accb704-e099-4255-8de7-dfc535a8b49d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:15.725981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1accb704-e099-4255-8de7-dfc535a8b49d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:15.726858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1accb704-e099-4255-8de7-dfc535a8b49d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:15.797423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1accb704-e099-4255-8de7-dfc535a8b49d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:24:15.807587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a8f01928-6589-4592-bebb-9c40bef6f592 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:15.831729 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a8f01928-6589-4592-bebb-9c40bef6f592 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1337 microversion: 2.1 time: 0.586162 Jan 22 21:24:15.842628 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3349/6994] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:15 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1337 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:24:16.359735 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1accb704-e099-4255-8de7-dfc535a8b49d tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 204 len: 0 microversion: 2.1 time: 0.662990 Jan 22 21:24:16.363584 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3646/6995] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:24:15 2022] DELETE /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:24:16.372476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4ae357ff-1a41-4e69-adde-a3638929a3eb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:16.373330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4ae357ff-1a41-4e69-adde-a3638929a3eb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:16.396937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ae357ff-1a41-4e69-adde-a3638929a3eb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:16.396937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ae357ff-1a41-4e69-adde-a3638929a3eb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:16.396937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ae357ff-1a41-4e69-adde-a3638929a3eb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:16.396937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ae357ff-1a41-4e69-adde-a3638929a3eb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:16.609669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7409e26f-cfc8-4a2d-b423-08fa294f23b4 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:16.611790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7409e26f-cfc8-4a2d-b423-08fa294f23b4 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:16.628463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7409e26f-cfc8-4a2d-b423-08fa294f23b4 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:16.628704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7409e26f-cfc8-4a2d-b423-08fa294f23b4 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:16.629553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7409e26f-cfc8-4a2d-b423-08fa294f23b4 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:16.639829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7409e26f-cfc8-4a2d-b423-08fa294f23b4 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:16.847911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4ae357ff-1a41-4e69-adde-a3638929a3eb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:16.860625 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4ae357ff-1a41-4e69-adde-a3638929a3eb tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1517 microversion: 2.1 time: 0.492398 Jan 22 21:24:16.877929 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3350/6996] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:16 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1517 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:16.882892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-deffb910-d01f-4c1b-bff3-67a57d21b32b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:16.884664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-deffb910-d01f-4c1b-bff3-67a57d21b32b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:16.897918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-deffb910-d01f-4c1b-bff3-67a57d21b32b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:16.899723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-deffb910-d01f-4c1b-bff3-67a57d21b32b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:16.900713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-deffb910-d01f-4c1b-bff3-67a57d21b32b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:16.907021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-deffb910-d01f-4c1b-bff3-67a57d21b32b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:16.976260 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-deffb910-d01f-4c1b-bff3-67a57d21b32b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.096944 Jan 22 21:24:16.981109 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3351/6997] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:16 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:16.987586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-105ccdc1-bbd4-4169-898f-14aaae54d043 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:16.998582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-105ccdc1-bbd4-4169-898f-14aaae54d043 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:17.006063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-105ccdc1-bbd4-4169-898f-14aaae54d043 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:17.010474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-105ccdc1-bbd4-4169-898f-14aaae54d043 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:17.011511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-105ccdc1-bbd4-4169-898f-14aaae54d043 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:17.012118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-105ccdc1-bbd4-4169-898f-14aaae54d043 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:17.221694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7409e26f-cfc8-4a2d-b423-08fa294f23b4 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:17.243413 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7409e26f-cfc8-4a2d-b423-08fa294f23b4 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1318 microversion: 2.1 time: 0.642567 Jan 22 21:24:17.245064 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3647/6998] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:16 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:17.745707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-105ccdc1-bbd4-4169-898f-14aaae54d043 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:17.768726 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-105ccdc1-bbd4-4169-898f-14aaae54d043 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1337 microversion: 2.1 time: 0.785142 Jan 22 21:24:17.769856 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3352/6999] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:16 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1337 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:17.879686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e1886771-db51-4116-8858-6e9aabcb4e0b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:17.879686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e1886771-db51-4116-8858-6e9aabcb4e0b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:17.886364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1886771-db51-4116-8858-6e9aabcb4e0b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:17.886820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1886771-db51-4116-8858-6e9aabcb4e0b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:17.888310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1886771-db51-4116-8858-6e9aabcb4e0b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:17.888757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1886771-db51-4116-8858-6e9aabcb4e0b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:17.995017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6ed47063-c7a8-46a0-8bce-ae6d5180f38b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:17.995961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6ed47063-c7a8-46a0-8bce-ae6d5180f38b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:18.002278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ed47063-c7a8-46a0-8bce-ae6d5180f38b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:18.005168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ed47063-c7a8-46a0-8bce-ae6d5180f38b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:18.005168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ed47063-c7a8-46a0-8bce-ae6d5180f38b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:18.005168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ed47063-c7a8-46a0-8bce-ae6d5180f38b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:18.060242 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6ed47063-c7a8-46a0-8bce-ae6d5180f38b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.068784 Jan 22 21:24:18.065177 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3353/7000] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:17 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:24:18.202791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e1886771-db51-4116-8858-6e9aabcb4e0b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:18.216513 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e1886771-db51-4116-8858-6e9aabcb4e0b tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1517 microversion: 2.1 time: 0.340959 Jan 22 21:24:18.217429 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3648/7001] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:17 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1517 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:18.261047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0b47d81f-b140-4918-8fd4-8b43873dd341 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:18.262246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0b47d81f-b140-4918-8fd4-8b43873dd341 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:18.270746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b47d81f-b140-4918-8fd4-8b43873dd341 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:18.271464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b47d81f-b140-4918-8fd4-8b43873dd341 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:18.272524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b47d81f-b140-4918-8fd4-8b43873dd341 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:18.273442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b47d81f-b140-4918-8fd4-8b43873dd341 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:18.621334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0b47d81f-b140-4918-8fd4-8b43873dd341 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:18.634738 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0b47d81f-b140-4918-8fd4-8b43873dd341 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1501 microversion: 2.1 time: 0.377663 Jan 22 21:24:18.647680 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3354/7002] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:18 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1501 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:18.788118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8de24424-bea0-400f-a01c-72f3d31cfa26 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:18.789544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8de24424-bea0-400f-a01c-72f3d31cfa26 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:18.813871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8de24424-bea0-400f-a01c-72f3d31cfa26 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:18.817119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8de24424-bea0-400f-a01c-72f3d31cfa26 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:18.818389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8de24424-bea0-400f-a01c-72f3d31cfa26 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:18.820499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8de24424-bea0-400f-a01c-72f3d31cfa26 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:19.072547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-178d8f07-3015-436d-87f7-ee662054a520 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:19.074717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-178d8f07-3015-436d-87f7-ee662054a520 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:19.084213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178d8f07-3015-436d-87f7-ee662054a520 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:19.085128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178d8f07-3015-436d-87f7-ee662054a520 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:19.086318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178d8f07-3015-436d-87f7-ee662054a520 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:19.087142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178d8f07-3015-436d-87f7-ee662054a520 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:19.144925 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-178d8f07-3015-436d-87f7-ee662054a520 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.076087 Jan 22 21:24:19.146577 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3355/7003] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:19 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:24:19.237043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-220eaadb-527d-4cd6-b769-7b8b317c5eb3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:19.237981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-220eaadb-527d-4cd6-b769-7b8b317c5eb3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:19.266709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-220eaadb-527d-4cd6-b769-7b8b317c5eb3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:19.269708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-220eaadb-527d-4cd6-b769-7b8b317c5eb3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:19.271982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-220eaadb-527d-4cd6-b769-7b8b317c5eb3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:19.276702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-220eaadb-527d-4cd6-b769-7b8b317c5eb3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:19.410571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-220eaadb-527d-4cd6-b769-7b8b317c5eb3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:19.418663 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-220eaadb-527d-4cd6-b769-7b8b317c5eb3 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1475 microversion: 2.1 time: 0.189006 Jan 22 21:24:19.419284 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3356/7004] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:19 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1475 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:24:19.425929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-a907cb40-96af-41a9-8fa2-027ff532d0b4 req-cb028cb2-018f-4fbe-9a21-275e07b39dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1333f8b7-c8db-487d-b9e6-b5452b4bae48", "name": "network-vif-deleted", "tag": "d5898bbb-29a7-4212-9028-982ac355edf5"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:19.429087 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:24:19.429087 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:24:19.444282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a907cb40-96af-41a9-8fa2-027ff532d0b4 req-cb028cb2-018f-4fbe-9a21-275e07b39dec service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:19.445026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a907cb40-96af-41a9-8fa2-027ff532d0b4 req-cb028cb2-018f-4fbe-9a21-275e07b39dec service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:19.479648 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-a907cb40-96af-41a9-8fa2-027ff532d0b4 req-cb028cb2-018f-4fbe-9a21-275e07b39dec service nova] Creating event network-vif-deleted:d5898bbb-29a7-4212-9028-982ac355edf5 for instance 1333f8b7-c8db-487d-b9e6-b5452b4bae48 on nch1-master-1 Jan 22 21:24:19.502112 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-a907cb40-96af-41a9-8fa2-027ff532d0b4 req-cb028cb2-018f-4fbe-9a21-275e07b39dec service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079283 Jan 22 21:24:19.503942 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3357/7005] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:24:19.597480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8de24424-bea0-400f-a01c-72f3d31cfa26 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:19.610368 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8de24424-bea0-400f-a01c-72f3d31cfa26 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1337 microversion: 2.1 time: 0.826776 Jan 22 21:24:19.625094 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3649/7006] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:18 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1337 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:19.722925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7662f94c-d9a0-4763-b5d9-5002a3b23a14 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:19.728197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7662f94c-d9a0-4763-b5d9-5002a3b23a14 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:19.740238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7662f94c-d9a0-4763-b5d9-5002a3b23a14 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:19.741289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7662f94c-d9a0-4763-b5d9-5002a3b23a14 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:19.742461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7662f94c-d9a0-4763-b5d9-5002a3b23a14 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:19.743146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7662f94c-d9a0-4763-b5d9-5002a3b23a14 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:19.784792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7662f94c-d9a0-4763-b5d9-5002a3b23a14 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:24:20.128959 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7662f94c-d9a0-4763-b5d9-5002a3b23a14 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "DELETE /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 204 len: 0 microversion: 2.1 time: 0.412524 Jan 22 21:24:20.130939 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3358/7007] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:24:19 2022] DELETE /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:24:20.140546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-904ed7e1-5ac8-4b35-b30e-3ac501224070 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:20.141769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-904ed7e1-5ac8-4b35-b30e-3ac501224070 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:20.152563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-904ed7e1-5ac8-4b35-b30e-3ac501224070 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:20.158042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-904ed7e1-5ac8-4b35-b30e-3ac501224070 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:20.160913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-973abfcc-6f85-481c-8fb4-ecabe2013aef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:20.161213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-904ed7e1-5ac8-4b35-b30e-3ac501224070 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:20.161849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-904ed7e1-5ac8-4b35-b30e-3ac501224070 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:20.162055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-973abfcc-6f85-481c-8fb4-ecabe2013aef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:20.170051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-973abfcc-6f85-481c-8fb4-ecabe2013aef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:20.171015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-973abfcc-6f85-481c-8fb4-ecabe2013aef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:20.172142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-973abfcc-6f85-481c-8fb4-ecabe2013aef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:20.172599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-973abfcc-6f85-481c-8fb4-ecabe2013aef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:20.230699 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-973abfcc-6f85-481c-8fb4-ecabe2013aef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.074701 Jan 22 21:24:20.231459 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3359/7008] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:20 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:20.437233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1dcf8a07-a6a9-4ab4-bb31-1347b9b9d1bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:20.438139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1dcf8a07-a6a9-4ab4-bb31-1347b9b9d1bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:20.455626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1dcf8a07-a6a9-4ab4-bb31-1347b9b9d1bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:20.458696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1dcf8a07-a6a9-4ab4-bb31-1347b9b9d1bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:20.461190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1dcf8a07-a6a9-4ab4-bb31-1347b9b9d1bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:20.463585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1dcf8a07-a6a9-4ab4-bb31-1347b9b9d1bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:20.527148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1dcf8a07-a6a9-4ab4-bb31-1347b9b9d1bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:20.527611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1dcf8a07-a6a9-4ab4-bb31-1347b9b9d1bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:20.528687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-1dcf8a07-a6a9-4ab4-bb31-1347b9b9d1bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lazy-loading 'fault' on Instance uuid 1333f8b7-c8db-487d-b9e6-b5452b4bae48 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:24:20.580566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1dcf8a07-a6a9-4ab4-bb31-1347b9b9d1bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9ea4bd8d1d94d6a8e41b26da41bd6fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '063a9e2a155241a3bf27e7d1b16d0419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:20.592340 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1dcf8a07-a6a9-4ab4-bb31-1347b9b9d1bd tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 200 len: 1311 microversion: 2.1 time: 0.159762 Jan 22 21:24:20.603124 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3360/7009] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:20 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 1311 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:20.626685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-904ed7e1-5ac8-4b35-b30e-3ac501224070 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:20.639033 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-904ed7e1-5ac8-4b35-b30e-3ac501224070 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1507 microversion: 2.1 time: 0.503601 Jan 22 21:24:20.640078 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3650/7010] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:20 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1507 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:20.654111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-06ff3f6d-871a-4a41-83c2-e51ef552366a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:20.654111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-06ff3f6d-871a-4a41-83c2-e51ef552366a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:20.673215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06ff3f6d-871a-4a41-83c2-e51ef552366a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:20.674378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06ff3f6d-871a-4a41-83c2-e51ef552366a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:20.675434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06ff3f6d-871a-4a41-83c2-e51ef552366a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:20.676423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06ff3f6d-871a-4a41-83c2-e51ef552366a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:20.914134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-06ff3f6d-871a-4a41-83c2-e51ef552366a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:20.922190 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-06ff3f6d-871a-4a41-83c2-e51ef552366a tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1337 microversion: 2.1 time: 0.284286 Jan 22 21:24:20.922785 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3361/7011] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:20 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1337 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:21.065887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-475e682b-9a81-44a0-becb-dbaefe297156 req-60328265-5829-4cfe-a933-ad76db3e813f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a333b3-7eae-42f9-b9de-4f6039bd8eb7", "name": "network-vif-plugged", "status": "completed", "tag": "b2d98517-c99e-4400-93f0-5758c75b4223"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:21.069423 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:24:21.069423 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:24:21.092350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-475e682b-9a81-44a0-becb-dbaefe297156 req-60328265-5829-4cfe-a933-ad76db3e813f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:21.094830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-475e682b-9a81-44a0-becb-dbaefe297156 req-60328265-5829-4cfe-a933-ad76db3e813f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:21.111721 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-475e682b-9a81-44a0-becb-dbaefe297156 req-60328265-5829-4cfe-a933-ad76db3e813f service nova] Creating event network-vif-plugged:b2d98517-c99e-4400-93f0-5758c75b4223 for instance a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 on nch2-master-1 Jan 22 21:24:21.130758 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-475e682b-9a81-44a0-becb-dbaefe297156 req-60328265-5829-4cfe-a933-ad76db3e813f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072769 Jan 22 21:24:21.141118 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3651/7012] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:24:21.243099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8d5415a8-8a2e-4d3a-ba83-3d81883ca116 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:21.248803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8d5415a8-8a2e-4d3a-ba83-3d81883ca116 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:21.267975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d5415a8-8a2e-4d3a-ba83-3d81883ca116 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:21.273269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d5415a8-8a2e-4d3a-ba83-3d81883ca116 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:21.273269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d5415a8-8a2e-4d3a-ba83-3d81883ca116 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:21.273269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d5415a8-8a2e-4d3a-ba83-3d81883ca116 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:21.346595 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8d5415a8-8a2e-4d3a-ba83-3d81883ca116 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.106987 Jan 22 21:24:21.350759 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3362/7013] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:21 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:24:21.612640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3e7d7dad-ea73-4ad4-9ec0-80240d7d1d42 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:21.614003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3e7d7dad-ea73-4ad4-9ec0-80240d7d1d42 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] [instance: 1333f8b7-c8db-487d-b9e6-b5452b4bae48] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:21.625477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e7d7dad-ea73-4ad4-9ec0-80240d7d1d42 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:21.628923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e7d7dad-ea73-4ad4-9ec0-80240d7d1d42 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:21.633088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e7d7dad-ea73-4ad4-9ec0-80240d7d1d42 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:21.633917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e7d7dad-ea73-4ad4-9ec0-80240d7d1d42 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:21.658131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ea20ee9-e3a5-4c6b-86ec-88846fb6470a tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:21.659701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1ea20ee9-e3a5-4c6b-86ec-88846fb6470a tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:21.689378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ea20ee9-e3a5-4c6b-86ec-88846fb6470a tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:21.690414 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-3e7d7dad-ea73-4ad4-9ec0-80240d7d1d42 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] HTTP exception thrown: Instance 1333f8b7-c8db-487d-b9e6-b5452b4bae48 could not be found. Jan 22 21:24:21.695225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3e7d7dad-ea73-4ad4-9ec0-80240d7d1d42 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] Returning 404 to user: Instance 1333f8b7-c8db-487d-b9e6-b5452b4bae48 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:24:21.695355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ea20ee9-e3a5-4c6b-86ec-88846fb6470a tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:21.695456 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3e7d7dad-ea73-4ad4-9ec0-80240d7d1d42 tempest-AttachVolumeNegativeTest-1922868514 tempest-AttachVolumeNegativeTest-1922868514-project] 10.222.0.100 "GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48" status: 404 len: 111 microversion: 2.1 time: 0.084281 Jan 22 21:24:21.695456 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3652/7014] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:21 2022] GET /compute/v2.1/servers/1333f8b7-c8db-487d-b9e6-b5452b4bae48 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:24:21.698202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ea20ee9-e3a5-4c6b-86ec-88846fb6470a tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:21.699984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ea20ee9-e3a5-4c6b-86ec-88846fb6470a tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:21.942522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dd5ea6ea-1c37-4959-987f-d967d45363ac tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:21.943196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dd5ea6ea-1c37-4959-987f-d967d45363ac tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:21.962050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd5ea6ea-1c37-4959-987f-d967d45363ac tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:21.963970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd5ea6ea-1c37-4959-987f-d967d45363ac tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:21.970273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd5ea6ea-1c37-4959-987f-d967d45363ac tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:21.971098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd5ea6ea-1c37-4959-987f-d967d45363ac tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:22.263095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1ea20ee9-e3a5-4c6b-86ec-88846fb6470a tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:22.272403 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1ea20ee9-e3a5-4c6b-86ec-88846fb6470a tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1507 microversion: 2.1 time: 0.619672 Jan 22 21:24:22.274817 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3363/7015] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:21 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1507 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:22.362286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d25cfb52-2552-470e-8d9d-fdceaef52d5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:22.364110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d25cfb52-2552-470e-8d9d-fdceaef52d5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:22.379870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d25cfb52-2552-470e-8d9d-fdceaef52d5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:22.383218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d25cfb52-2552-470e-8d9d-fdceaef52d5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:22.384388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d25cfb52-2552-470e-8d9d-fdceaef52d5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:22.386979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d25cfb52-2552-470e-8d9d-fdceaef52d5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:22.497562 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d25cfb52-2552-470e-8d9d-fdceaef52d5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.140840 Jan 22 21:24:22.499322 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3364/7016] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:22 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:24:22.680224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dd5ea6ea-1c37-4959-987f-d967d45363ac tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:22.690589 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dd5ea6ea-1c37-4959-987f-d967d45363ac tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1337 microversion: 2.1 time: 0.752655 Jan 22 21:24:22.694873 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3653/7017] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:21 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1337 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:23.292870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-15a16371-ed13-4f96-954c-e909409a2461 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:23.294369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-15a16371-ed13-4f96-954c-e909409a2461 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:23.308091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15a16371-ed13-4f96-954c-e909409a2461 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:23.311352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15a16371-ed13-4f96-954c-e909409a2461 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:23.315658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15a16371-ed13-4f96-954c-e909409a2461 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:23.316126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15a16371-ed13-4f96-954c-e909409a2461 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:23.436308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-816154f9-89ad-407b-afbd-3df38ca6dea9 req-c9927e88-c199-4ebc-8b27-ac91a547d452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a333b3-7eae-42f9-b9de-4f6039bd8eb7", "name": "network-vif-plugged", "status": "completed", "tag": "ef332a57-ef3d-4c8f-b5e7-d56312ed181f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:23.442714 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:24:23.442714 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:24:23.449389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-816154f9-89ad-407b-afbd-3df38ca6dea9 req-c9927e88-c199-4ebc-8b27-ac91a547d452 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:23.462476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-816154f9-89ad-407b-afbd-3df38ca6dea9 req-c9927e88-c199-4ebc-8b27-ac91a547d452 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:23.480666 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-816154f9-89ad-407b-afbd-3df38ca6dea9 req-c9927e88-c199-4ebc-8b27-ac91a547d452 service nova] Creating event network-vif-plugged:ef332a57-ef3d-4c8f-b5e7-d56312ed181f for instance a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 on nch2-master-1 Jan 22 21:24:23.496439 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-816154f9-89ad-407b-afbd-3df38ca6dea9 req-c9927e88-c199-4ebc-8b27-ac91a547d452 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064144 Jan 22 21:24:23.505803 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3654/7018] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:24:23.512432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e0065493-56e2-4189-9b84-6a3a531fadd5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:23.525986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e0065493-56e2-4189-9b84-6a3a531fadd5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:23.533861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0065493-56e2-4189-9b84-6a3a531fadd5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:23.534683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0065493-56e2-4189-9b84-6a3a531fadd5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:23.535659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0065493-56e2-4189-9b84-6a3a531fadd5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:23.536251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e0065493-56e2-4189-9b84-6a3a531fadd5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:23.634719 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e0065493-56e2-4189-9b84-6a3a531fadd5 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.127219 Jan 22 21:24:23.635379 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3655/7019] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:23 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:23.713171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-23e0d00c-89b6-400f-a97a-296acff030a5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:23.714241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-23e0d00c-89b6-400f-a97a-296acff030a5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:23.733356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23e0d00c-89b6-400f-a97a-296acff030a5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:23.734149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23e0d00c-89b6-400f-a97a-296acff030a5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:23.735283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23e0d00c-89b6-400f-a97a-296acff030a5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:23.736057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23e0d00c-89b6-400f-a97a-296acff030a5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:24.513473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-23e0d00c-89b6-400f-a97a-296acff030a5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:24.552252 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-23e0d00c-89b6-400f-a97a-296acff030a5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1337 microversion: 2.1 time: 0.842616 Jan 22 21:24:24.577009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-15a16371-ed13-4f96-954c-e909409a2461 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:24.579302 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3656/7020] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:23 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1337 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:24.591955 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-15a16371-ed13-4f96-954c-e909409a2461 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1507 microversion: 2.1 time: 1.299547 Jan 22 21:24:24.592860 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3365/7021] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:23 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1507 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:24.647762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-53fc927c-98b3-421e-bab9-5ebef8790784 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:24.649010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-53fc927c-98b3-421e-bab9-5ebef8790784 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:24.662520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53fc927c-98b3-421e-bab9-5ebef8790784 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:24.663257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53fc927c-98b3-421e-bab9-5ebef8790784 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:24.665814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53fc927c-98b3-421e-bab9-5ebef8790784 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:24.665814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53fc927c-98b3-421e-bab9-5ebef8790784 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:24.744944 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-53fc927c-98b3-421e-bab9-5ebef8790784 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.100849 Jan 22 21:24:24.747386 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3657/7022] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:24 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:24.880434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-13208b00-8a9f-4d13-b72d-d10a08ec6eeb req-579448ab-8200-4992-a98b-bc751f1db2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1e62f2-2ac4-429b-ac51-e10fbb378afe", "name": "network-vif-deleted", "tag": "696a1df9-47c9-480f-9c97-a0af39fe4c01"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:24.882479 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:24:24.882479 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:24:24.900804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-13208b00-8a9f-4d13-b72d-d10a08ec6eeb req-579448ab-8200-4992-a98b-bc751f1db2ac service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:24.906478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-13208b00-8a9f-4d13-b72d-d10a08ec6eeb req-579448ab-8200-4992-a98b-bc751f1db2ac service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:24.951945 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-13208b00-8a9f-4d13-b72d-d10a08ec6eeb req-579448ab-8200-4992-a98b-bc751f1db2ac service nova] Creating event network-vif-deleted:696a1df9-47c9-480f-9c97-a0af39fe4c01 for instance 9d1e62f2-2ac4-429b-ac51-e10fbb378afe on nch1-master-1 Jan 22 21:24:24.973169 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-13208b00-8a9f-4d13-b72d-d10a08ec6eeb req-579448ab-8200-4992-a98b-bc751f1db2ac service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093408 Jan 22 21:24:24.979248 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3366/7023] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:24:25.590643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4d8aa664-3013-4337-906f-9af5b918a23c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:25.591367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4d8aa664-3013-4337-906f-9af5b918a23c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:25.611908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ffee7815-3717-46fd-b56d-66454725843f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:25.612979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ffee7815-3717-46fd-b56d-66454725843f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:25.624797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d8aa664-3013-4337-906f-9af5b918a23c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:25.625272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d8aa664-3013-4337-906f-9af5b918a23c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:25.633380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d8aa664-3013-4337-906f-9af5b918a23c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:25.633887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d8aa664-3013-4337-906f-9af5b918a23c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:25.638127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffee7815-3717-46fd-b56d-66454725843f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:25.638127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffee7815-3717-46fd-b56d-66454725843f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:25.638127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffee7815-3717-46fd-b56d-66454725843f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:25.641900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffee7815-3717-46fd-b56d-66454725843f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:25.768470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffee7815-3717-46fd-b56d-66454725843f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:25.770557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffee7815-3717-46fd-b56d-66454725843f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:25.772078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-ffee7815-3717-46fd-b56d-66454725843f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lazy-loading 'fault' on Instance uuid 9d1e62f2-2ac4-429b-ac51-e10fbb378afe {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:24:25.944895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ffee7815-3717-46fd-b56d-66454725843f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc249e0680014981888b464000ff24fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97cd2dba7a47729ce29b8973f3bc44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:26.010293 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ffee7815-3717-46fd-b56d-66454725843f tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 200 len: 1308 microversion: 2.1 time: 0.399168 Jan 22 21:24:26.011003 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3367/7024] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:25 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:26.044717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8f50e5f5-13ce-4eb5-bd36-6b38f5730a11 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:26.046473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8f50e5f5-13ce-4eb5-bd36-6b38f5730a11 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:26.059250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f50e5f5-13ce-4eb5-bd36-6b38f5730a11 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:26.066037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f50e5f5-13ce-4eb5-bd36-6b38f5730a11 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:26.067139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f50e5f5-13ce-4eb5-bd36-6b38f5730a11 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:26.067673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f50e5f5-13ce-4eb5-bd36-6b38f5730a11 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:26.140527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4d8aa664-3013-4337-906f-9af5b918a23c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:26.155820 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8f50e5f5-13ce-4eb5-bd36-6b38f5730a11 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.126536 Jan 22 21:24:26.156501 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3368/7025] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:26 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:26.160446 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4d8aa664-3013-4337-906f-9af5b918a23c tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1337 microversion: 2.1 time: 0.580258 Jan 22 21:24:26.165052 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3658/7026] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:25 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1337 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:27.040973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-daa1b16a-edf7-4e5b-841f-ee9fad969010 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:27.044563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-daa1b16a-edf7-4e5b-841f-ee9fad969010 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] [instance: 9d1e62f2-2ac4-429b-ac51-e10fbb378afe] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:27.058849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa1b16a-edf7-4e5b-841f-ee9fad969010 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:27.059839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa1b16a-edf7-4e5b-841f-ee9fad969010 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:27.060953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa1b16a-edf7-4e5b-841f-ee9fad969010 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:27.061721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-daa1b16a-edf7-4e5b-841f-ee9fad969010 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:27.080580 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-daa1b16a-edf7-4e5b-841f-ee9fad969010 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] HTTP exception thrown: Instance 9d1e62f2-2ac4-429b-ac51-e10fbb378afe could not be found. Jan 22 21:24:27.081203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-daa1b16a-edf7-4e5b-841f-ee9fad969010 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] Returning 404 to user: Instance 9d1e62f2-2ac4-429b-ac51-e10fbb378afe could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:24:27.082113 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-daa1b16a-edf7-4e5b-841f-ee9fad969010 tempest-VolumesActionsTest-1017798535 tempest-VolumesActionsTest-1017798535-project] 10.222.0.100 "GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe" status: 404 len: 111 microversion: 2.1 time: 0.045933 Jan 22 21:24:27.083151 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3369/7027] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:27 2022] GET /compute/v2.1/servers/9d1e62f2-2ac4-429b-ac51-e10fbb378afe => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:24:27.171231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eae9028e-5eb2-4eea-9bd9-7fc5b9339764 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:27.173912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eae9028e-5eb2-4eea-9bd9-7fc5b9339764 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:27.182664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fc0f8dfa-5761-42e5-a8c3-251658fc755f tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:27.193341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fc0f8dfa-5761-42e5-a8c3-251658fc755f tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:27.196879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eae9028e-5eb2-4eea-9bd9-7fc5b9339764 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:27.197349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eae9028e-5eb2-4eea-9bd9-7fc5b9339764 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:27.198198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eae9028e-5eb2-4eea-9bd9-7fc5b9339764 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:27.198640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eae9028e-5eb2-4eea-9bd9-7fc5b9339764 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:27.205089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc0f8dfa-5761-42e5-a8c3-251658fc755f tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:27.206740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc0f8dfa-5761-42e5-a8c3-251658fc755f tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:27.208332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc0f8dfa-5761-42e5-a8c3-251658fc755f tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:27.209060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc0f8dfa-5761-42e5-a8c3-251658fc755f tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:27.329523 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eae9028e-5eb2-4eea-9bd9-7fc5b9339764 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.164610 Jan 22 21:24:27.332174 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3659/7028] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:27 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:27.854602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fc0f8dfa-5761-42e5-a8c3-251658fc755f tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:27.866429 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fc0f8dfa-5761-42e5-a8c3-251658fc755f tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1671 microversion: 2.1 time: 0.688421 Jan 22 21:24:27.867025 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3370/7029] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:27 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1671 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:27.890750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-878459c7-006a-4087-8ef8-a834b144c462 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:27.891491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-878459c7-006a-4087-8ef8-a834b144c462 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:27.921904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-878459c7-006a-4087-8ef8-a834b144c462 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:27.922826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-878459c7-006a-4087-8ef8-a834b144c462 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:27.928191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-878459c7-006a-4087-8ef8-a834b144c462 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:27.928942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-878459c7-006a-4087-8ef8-a834b144c462 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:28.004982 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-878459c7-006a-4087-8ef8-a834b144c462 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7/ips" status: 200 len: 178 microversion: 2.1 time: 0.123525 Jan 22 21:24:28.008952 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3660/7030] 10.222.0.100 () {58 vars in 1252 bytes} [Sat Jan 22 21:24:27 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7/ips => generated 178 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:24:28.018485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-642d88bd-46bc-4a81-aeba-502e2e6f98e1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:28.019267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-642d88bd-46bc-4a81-aeba-502e2e6f98e1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:28.031278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-642d88bd-46bc-4a81-aeba-502e2e6f98e1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:28.031966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-642d88bd-46bc-4a81-aeba-502e2e6f98e1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:28.035747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-642d88bd-46bc-4a81-aeba-502e2e6f98e1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:28.037056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-642d88bd-46bc-4a81-aeba-502e2e6f98e1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:28.098612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-642d88bd-46bc-4a81-aeba-502e2e6f98e1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:24:28.345758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-991e5e4b-d8df-4ad6-8c37-f9f6e2695c37 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:28.347265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-991e5e4b-d8df-4ad6-8c37-f9f6e2695c37 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:28.359910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-991e5e4b-d8df-4ad6-8c37-f9f6e2695c37 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:28.360630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-991e5e4b-d8df-4ad6-8c37-f9f6e2695c37 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:28.361806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-991e5e4b-d8df-4ad6-8c37-f9f6e2695c37 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:28.364844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-991e5e4b-d8df-4ad6-8c37-f9f6e2695c37 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:28.442599 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-991e5e4b-d8df-4ad6-8c37-f9f6e2695c37 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.102438 Jan 22 21:24:28.443308 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3661/7031] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:28 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:28.491794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-183961055", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "9d7210dd-3ff6-4546-9523-1f7d08ad9010"}], "key_name": "tempest-TestNetworkAdvancedServerOps-270184739", "security_groups": [{"name": "tempest-secgroup-smoke-806787068"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:28.665163 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-642d88bd-46bc-4a81-aeba-502e2e6f98e1 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 204 len: 0 microversion: 2.1 time: 0.651252 Jan 22 21:24:28.673910 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3371/7032] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:24:28 2022] DELETE /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:24:28.681419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bb3b797b-8308-465d-8a26-a3377e3780e5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:28.682405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bb3b797b-8308-465d-8a26-a3377e3780e5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:28.694632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb3b797b-8308-465d-8a26-a3377e3780e5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:28.696251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb3b797b-8308-465d-8a26-a3377e3780e5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:28.702669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb3b797b-8308-465d-8a26-a3377e3780e5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:28.702669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb3b797b-8308-465d-8a26-a3377e3780e5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:28.741721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] validate_networks() for [('9d7210dd-3ff6-4546-9523-1f7d08ad9010', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:24:29.257886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bb3b797b-8308-465d-8a26-a3377e3780e5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:29.273685 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bb3b797b-8308-465d-8a26-a3377e3780e5 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1677 microversion: 2.1 time: 0.590314 Jan 22 21:24:29.274597 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3372/7033] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:28 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1677 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:24:29.356487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:24:29.357094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:24:29.357586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:24:29.358059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:24:29.358439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:24:29.370594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:29.377113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:29.377113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:29.377113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:29.434194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:24:29.449599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Getting quotas for user 80aa2e03fde44436844a88a0ccc5d6a6 and project a02dd0e2564b41e3b5800b144a1ed831. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:24:29.455563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7e7e3f2a-713e-48ea-9aa2-69a9fc235009 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:29.456510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7e7e3f2a-713e-48ea-9aa2-69a9fc235009 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:29.470491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:24:29.473172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e7e3f2a-713e-48ea-9aa2-69a9fc235009 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:29.473698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e7e3f2a-713e-48ea-9aa2-69a9fc235009 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:29.475026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e7e3f2a-713e-48ea-9aa2-69a9fc235009 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:29.475497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e7e3f2a-713e-48ea-9aa2-69a9fc235009 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:29.478825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:24:29.564516 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7e7e3f2a-713e-48ea-9aa2-69a9fc235009 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.113190 Jan 22 21:24:29.566156 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3373/7034] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:29 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:29.727250 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e855049-8fa3-41f9-bd8b-b125011e2469 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.237330 Jan 22 21:24:29.729249 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3662/7035] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:24:28 2022] POST /compute/v2.1/servers => generated 407 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:24:29.740794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d8231250-2ea1-4848-ad74-1f4ca193ed30 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:29.741832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d8231250-2ea1-4848-ad74-1f4ca193ed30 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:30.295039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c801ae8c-b6ac-4bfc-b941-cdaa27149791 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:30.295648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c801ae8c-b6ac-4bfc-b941-cdaa27149791 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:30.318046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c801ae8c-b6ac-4bfc-b941-cdaa27149791 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:30.319918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c801ae8c-b6ac-4bfc-b941-cdaa27149791 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:30.325555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c801ae8c-b6ac-4bfc-b941-cdaa27149791 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:30.335821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c801ae8c-b6ac-4bfc-b941-cdaa27149791 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:30.500387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d8231250-2ea1-4848-ad74-1f4ca193ed30 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:30.509043 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d8231250-2ea1-4848-ad74-1f4ca193ed30 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1269 microversion: 2.1 time: 0.772925 Jan 22 21:24:30.516788 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3374/7036] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:29 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1269 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:30.586167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-76be80e0-290a-4fc5-88be-342887a3ce91 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:30.589453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-76be80e0-290a-4fc5-88be-342887a3ce91 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:30.639466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76be80e0-290a-4fc5-88be-342887a3ce91 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:30.645563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76be80e0-290a-4fc5-88be-342887a3ce91 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:30.653154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76be80e0-290a-4fc5-88be-342887a3ce91 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:30.653154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76be80e0-290a-4fc5-88be-342887a3ce91 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:30.795770 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-76be80e0-290a-4fc5-88be-342887a3ce91 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.219740 Jan 22 21:24:30.802671 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3375/7037] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:30 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:24:30.951803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c801ae8c-b6ac-4bfc-b941-cdaa27149791 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:30.960258 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c801ae8c-b6ac-4bfc-b941-cdaa27149791 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1677 microversion: 2.1 time: 0.671852 Jan 22 21:24:30.964159 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3663/7038] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:30 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1677 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:31.527796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a7882990-a08b-4358-ad09-e7ed59e44ae9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:31.528933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a7882990-a08b-4358-ad09-e7ed59e44ae9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:31.569525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7882990-a08b-4358-ad09-e7ed59e44ae9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:31.573126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7882990-a08b-4358-ad09-e7ed59e44ae9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:31.574105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7882990-a08b-4358-ad09-e7ed59e44ae9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:31.575896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7882990-a08b-4358-ad09-e7ed59e44ae9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:31.808420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-89ec310f-8da7-4d63-9360-f62610fcdaf3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:31.809353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a7882990-a08b-4358-ad09-e7ed59e44ae9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:31.809808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-89ec310f-8da7-4d63-9360-f62610fcdaf3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:31.819970 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a7882990-a08b-4358-ad09-e7ed59e44ae9 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1273 microversion: 2.1 time: 0.295964 Jan 22 21:24:31.821765 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3376/7039] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:31 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:31.825928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89ec310f-8da7-4d63-9360-f62610fcdaf3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:31.826270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89ec310f-8da7-4d63-9360-f62610fcdaf3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:31.827562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89ec310f-8da7-4d63-9360-f62610fcdaf3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:31.828201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89ec310f-8da7-4d63-9360-f62610fcdaf3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:31.904004 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-89ec310f-8da7-4d63-9360-f62610fcdaf3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.097592 Jan 22 21:24:31.911510 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3664/7040] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:31 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:31.986011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2d327d32-dae0-4299-88b1-965822700e87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:31.987242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2d327d32-dae0-4299-88b1-965822700e87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:32.006490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d327d32-dae0-4299-88b1-965822700e87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:32.007659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d327d32-dae0-4299-88b1-965822700e87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:32.011169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d327d32-dae0-4299-88b1-965822700e87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:32.012298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d327d32-dae0-4299-88b1-965822700e87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:32.841160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b4fcafd9-b4e0-4b82-9efd-982c4995c65e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:32.842187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b4fcafd9-b4e0-4b82-9efd-982c4995c65e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:32.880226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4fcafd9-b4e0-4b82-9efd-982c4995c65e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:32.880815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4fcafd9-b4e0-4b82-9efd-982c4995c65e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:32.881716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4fcafd9-b4e0-4b82-9efd-982c4995c65e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:32.882170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4fcafd9-b4e0-4b82-9efd-982c4995c65e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:32.978358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2d327d32-dae0-4299-88b1-965822700e87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:32.987960 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2d327d32-dae0-4299-88b1-965822700e87 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1677 microversion: 2.1 time: 1.011947 Jan 22 21:24:32.996837 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3377/7041] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:31 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1677 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:33.006471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-90c8c113-16e7-4782-8949-8bd1f9d17961 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:33.014106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-90c8c113-16e7-4782-8949-8bd1f9d17961 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:33.035455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90c8c113-16e7-4782-8949-8bd1f9d17961 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:33.044479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90c8c113-16e7-4782-8949-8bd1f9d17961 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:33.046088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90c8c113-16e7-4782-8949-8bd1f9d17961 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:33.048919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90c8c113-16e7-4782-8949-8bd1f9d17961 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:33.069741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b4fcafd9-b4e0-4b82-9efd-982c4995c65e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:33.079689 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b4fcafd9-b4e0-4b82-9efd-982c4995c65e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1321 microversion: 2.1 time: 0.244800 Jan 22 21:24:33.088302 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3665/7042] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:32 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:24:33.148959 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-90c8c113-16e7-4782-8949-8bd1f9d17961 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.154009 Jan 22 21:24:33.152274 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3378/7043] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:32 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:33.812990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a6edbcb6-92e7-422f-90e9-b7e9e4473df0 req-6ad56e30-4780-4dc0-95f7-b036518dceb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a333b3-7eae-42f9-b9de-4f6039bd8eb7", "name": "network-vif-deleted", "tag": "ef332a57-ef3d-4c8f-b5e7-d56312ed181f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:33.814862 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:24:33.814862 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:24:33.838397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a6edbcb6-92e7-422f-90e9-b7e9e4473df0 req-6ad56e30-4780-4dc0-95f7-b036518dceb9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:33.848359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a6edbcb6-92e7-422f-90e9-b7e9e4473df0 req-6ad56e30-4780-4dc0-95f7-b036518dceb9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:33.921897 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a6edbcb6-92e7-422f-90e9-b7e9e4473df0 req-6ad56e30-4780-4dc0-95f7-b036518dceb9 service nova] Creating event network-vif-deleted:ef332a57-ef3d-4c8f-b5e7-d56312ed181f for instance a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 on nch2-master-1 Jan 22 21:24:33.944783 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a6edbcb6-92e7-422f-90e9-b7e9e4473df0 req-6ad56e30-4780-4dc0-95f7-b036518dceb9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135390 Jan 22 21:24:33.959345 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3666/7044] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:24:34.010629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c0d50af8-1eb1-4a35-bdb6-736316c59f93 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:34.011243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c0d50af8-1eb1-4a35-bdb6-736316c59f93 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:34.039614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0d50af8-1eb1-4a35-bdb6-736316c59f93 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:34.045068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0d50af8-1eb1-4a35-bdb6-736316c59f93 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:34.050643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0d50af8-1eb1-4a35-bdb6-736316c59f93 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:34.053232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0d50af8-1eb1-4a35-bdb6-736316c59f93 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:34.100530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-11e98c11-7a35-4267-a77f-088c1ac83a52 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:34.101790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-11e98c11-7a35-4267-a77f-088c1ac83a52 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:34.127110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11e98c11-7a35-4267-a77f-088c1ac83a52 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:34.135805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11e98c11-7a35-4267-a77f-088c1ac83a52 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:34.138887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11e98c11-7a35-4267-a77f-088c1ac83a52 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:34.145245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11e98c11-7a35-4267-a77f-088c1ac83a52 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:34.335955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-11e98c11-7a35-4267-a77f-088c1ac83a52 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:34.349539 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-11e98c11-7a35-4267-a77f-088c1ac83a52 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1339 microversion: 2.1 time: 0.253367 Jan 22 21:24:34.350349 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3667/7045] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:34 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1339 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:34.355194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-02af0a28-1d7a-4b15-91ee-51f13f8e0167 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:34.360435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-02af0a28-1d7a-4b15-91ee-51f13f8e0167 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:34.368015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02af0a28-1d7a-4b15-91ee-51f13f8e0167 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:34.368635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02af0a28-1d7a-4b15-91ee-51f13f8e0167 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:34.369908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02af0a28-1d7a-4b15-91ee-51f13f8e0167 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:34.370674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02af0a28-1d7a-4b15-91ee-51f13f8e0167 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:34.431344 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-02af0a28-1d7a-4b15-91ee-51f13f8e0167 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.077107 Jan 22 21:24:34.436402 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3668/7046] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:34 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:34.969130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c0d50af8-1eb1-4a35-bdb6-736316c59f93 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:34.981143 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c0d50af8-1eb1-4a35-bdb6-736316c59f93 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1499 microversion: 2.1 time: 0.974549 Jan 22 21:24:34.988006 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3379/7047] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:34 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1499 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:35.377394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-529cd27b-da69-405c-bf47-e4c5940733bc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:35.378998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-529cd27b-da69-405c-bf47-e4c5940733bc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:35.403878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-529cd27b-da69-405c-bf47-e4c5940733bc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:35.412606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-529cd27b-da69-405c-bf47-e4c5940733bc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:35.419614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-529cd27b-da69-405c-bf47-e4c5940733bc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:35.420079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-529cd27b-da69-405c-bf47-e4c5940733bc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:35.447133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c6454fe2-5376-442f-a5b2-816dbd584f09 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:35.448283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c6454fe2-5376-442f-a5b2-816dbd584f09 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:35.469792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6454fe2-5376-442f-a5b2-816dbd584f09 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:35.480956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6454fe2-5376-442f-a5b2-816dbd584f09 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:35.482321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6454fe2-5376-442f-a5b2-816dbd584f09 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:35.483435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c6454fe2-5376-442f-a5b2-816dbd584f09 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:35.602056 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c6454fe2-5376-442f-a5b2-816dbd584f09 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.158875 Jan 22 21:24:35.608479 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3380/7048] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:35 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:35.654991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-529cd27b-da69-405c-bf47-e4c5940733bc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:35.667441 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-529cd27b-da69-405c-bf47-e4c5940733bc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1327 microversion: 2.1 time: 0.296270 Jan 22 21:24:35.672463 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3669/7049] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:35 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1327 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:36.007720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-55aec553-2cad-4e83-b89d-aea88185c9ed tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:36.009191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-55aec553-2cad-4e83-b89d-aea88185c9ed tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:36.028933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55aec553-2cad-4e83-b89d-aea88185c9ed tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:36.031999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55aec553-2cad-4e83-b89d-aea88185c9ed tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:36.035709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55aec553-2cad-4e83-b89d-aea88185c9ed tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:36.039826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55aec553-2cad-4e83-b89d-aea88185c9ed tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:36.616738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9d98614e-28df-4b6b-b143-416c245b3f5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:36.618323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9d98614e-28df-4b6b-b143-416c245b3f5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:36.650196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d98614e-28df-4b6b-b143-416c245b3f5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:36.650934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d98614e-28df-4b6b-b143-416c245b3f5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:36.659312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d98614e-28df-4b6b-b143-416c245b3f5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:36.660384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d98614e-28df-4b6b-b143-416c245b3f5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:36.861772 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9d98614e-28df-4b6b-b143-416c245b3f5c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.249110 Jan 22 21:24:36.862926 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3670/7050] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:36 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:24:36.910550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-57b768b9-3442-49d3-a4a6-a06f1c4bceee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:36.911852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-57b768b9-3442-49d3-a4a6-a06f1c4bceee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:36.958979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57b768b9-3442-49d3-a4a6-a06f1c4bceee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:36.967504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57b768b9-3442-49d3-a4a6-a06f1c4bceee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:36.970350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57b768b9-3442-49d3-a4a6-a06f1c4bceee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:36.971030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57b768b9-3442-49d3-a4a6-a06f1c4bceee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:37.274264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-55aec553-2cad-4e83-b89d-aea88185c9ed tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:37.282971 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-55aec553-2cad-4e83-b89d-aea88185c9ed tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1499 microversion: 2.1 time: 1.280568 Jan 22 21:24:37.295641 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3381/7051] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:36 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1499 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:37.300711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-7288fff5-d1d4-4955-9194-9a4171f9b901 req-b7b2292a-5f1c-481f-a807-4eeb54d857c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a333b3-7eae-42f9-b9de-4f6039bd8eb7", "name": "network-vif-deleted", "tag": "b2d98517-c99e-4400-93f0-5758c75b4223"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:37.318487 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:24:37.318487 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:24:37.341546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7288fff5-d1d4-4955-9194-9a4171f9b901 req-b7b2292a-5f1c-481f-a807-4eeb54d857c2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:37.347065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7288fff5-d1d4-4955-9194-9a4171f9b901 req-b7b2292a-5f1c-481f-a807-4eeb54d857c2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:37.375028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-57b768b9-3442-49d3-a4a6-a06f1c4bceee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:37.379314 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-7288fff5-d1d4-4955-9194-9a4171f9b901 req-b7b2292a-5f1c-481f-a807-4eeb54d857c2 service nova] Creating event network-vif-deleted:b2d98517-c99e-4400-93f0-5758c75b4223 for instance a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 on nch2-master-1 Jan 22 21:24:37.389091 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-57b768b9-3442-49d3-a4a6-a06f1c4bceee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1327 microversion: 2.1 time: 0.524878 Jan 22 21:24:37.389714 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3671/7052] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:36 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1327 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:37.409196 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-7288fff5-d1d4-4955-9194-9a4171f9b901 req-b7b2292a-5f1c-481f-a807-4eeb54d857c2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111680 Jan 22 21:24:37.409872 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3382/7053] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:24:37.874979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b60edd68-f24f-4f83-b3f5-896be78d9e4b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:37.876524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b60edd68-f24f-4f83-b3f5-896be78d9e4b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:37.889211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b60edd68-f24f-4f83-b3f5-896be78d9e4b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:37.896106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b60edd68-f24f-4f83-b3f5-896be78d9e4b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:37.897229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b60edd68-f24f-4f83-b3f5-896be78d9e4b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:37.897873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b60edd68-f24f-4f83-b3f5-896be78d9e4b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:38.031166 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b60edd68-f24f-4f83-b3f5-896be78d9e4b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.160459 Jan 22 21:24:38.033445 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3672/7054] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:37 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:38.314194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c37b5d21-f51f-44a7-b326-fb72232255b8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:38.315716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c37b5d21-f51f-44a7-b326-fb72232255b8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:38.331834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c37b5d21-f51f-44a7-b326-fb72232255b8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:38.335939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c37b5d21-f51f-44a7-b326-fb72232255b8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:38.335939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c37b5d21-f51f-44a7-b326-fb72232255b8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:38.335939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c37b5d21-f51f-44a7-b326-fb72232255b8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:38.408485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb24ea14-2dfc-4d1a-8b9d-1c659e21672f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:38.409640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fb24ea14-2dfc-4d1a-8b9d-1c659e21672f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:38.433057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb24ea14-2dfc-4d1a-8b9d-1c659e21672f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:38.433057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb24ea14-2dfc-4d1a-8b9d-1c659e21672f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:38.441730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb24ea14-2dfc-4d1a-8b9d-1c659e21672f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:38.442591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb24ea14-2dfc-4d1a-8b9d-1c659e21672f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:38.458858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c37b5d21-f51f-44a7-b326-fb72232255b8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:38.468059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c37b5d21-f51f-44a7-b326-fb72232255b8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:38.471627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-c37b5d21-f51f-44a7-b326-fb72232255b8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lazy-loading 'fault' on Instance uuid a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:24:38.632137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c37b5d21-f51f-44a7-b326-fb72232255b8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae64ff0a56a84c34954a4beaa1f3409c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2512cc7caef541c58da8cd500af5beff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:38.643924 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c37b5d21-f51f-44a7-b326-fb72232255b8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 200 len: 1306 microversion: 2.1 time: 0.335214 Jan 22 21:24:38.672035 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3383/7055] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:38 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 1306 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:39.115328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-da608c6a-8fc7-4ba4-8c29-71b2e50b6118 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:39.117382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-da608c6a-8fc7-4ba4-8c29-71b2e50b6118 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:39.132141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da608c6a-8fc7-4ba4-8c29-71b2e50b6118 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:39.141592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da608c6a-8fc7-4ba4-8c29-71b2e50b6118 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:39.143147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da608c6a-8fc7-4ba4-8c29-71b2e50b6118 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:39.145611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da608c6a-8fc7-4ba4-8c29-71b2e50b6118 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:39.253241 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-da608c6a-8fc7-4ba4-8c29-71b2e50b6118 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.142487 Jan 22 21:24:39.266425 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3384/7056] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:39 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:24:39.397983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fb24ea14-2dfc-4d1a-8b9d-1c659e21672f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:39.409765 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fb24ea14-2dfc-4d1a-8b9d-1c659e21672f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1394 microversion: 2.1 time: 1.004044 Jan 22 21:24:39.411666 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3673/7057] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:38 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1394 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:39.669937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-01375272-53e9-461b-aee7-ac7850c68782 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:39.670685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-01375272-53e9-461b-aee7-ac7850c68782 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:39.688425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01375272-53e9-461b-aee7-ac7850c68782 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:39.695212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01375272-53e9-461b-aee7-ac7850c68782 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:39.696281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01375272-53e9-461b-aee7-ac7850c68782 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:39.700054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01375272-53e9-461b-aee7-ac7850c68782 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:39.782850 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-01375272-53e9-461b-aee7-ac7850c68782 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] HTTP exception thrown: Instance a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 could not be found. Jan 22 21:24:39.784340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-01375272-53e9-461b-aee7-ac7850c68782 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Returning 404 to user: Instance a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:24:39.793122 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-01375272-53e9-461b-aee7-ac7850c68782 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 404 len: 111 microversion: 2.1 time: 0.125295 Jan 22 21:24:39.799756 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3385/7058] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:39 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:24:40.274074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7312187f-c35d-46f3-a2bd-1b0fe1a24808 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:40.275235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7312187f-c35d-46f3-a2bd-1b0fe1a24808 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:40.286439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7312187f-c35d-46f3-a2bd-1b0fe1a24808 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:40.295327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7312187f-c35d-46f3-a2bd-1b0fe1a24808 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:40.301219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7312187f-c35d-46f3-a2bd-1b0fe1a24808 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:40.302554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7312187f-c35d-46f3-a2bd-1b0fe1a24808 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:40.427837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4a202527-279f-4317-ba21-ba1bacaae0b1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:40.428743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4a202527-279f-4317-ba21-ba1bacaae0b1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:40.444208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a202527-279f-4317-ba21-ba1bacaae0b1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:40.444916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a202527-279f-4317-ba21-ba1bacaae0b1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:40.448531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a202527-279f-4317-ba21-ba1bacaae0b1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:40.451849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a202527-279f-4317-ba21-ba1bacaae0b1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:40.467230 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7312187f-c35d-46f3-a2bd-1b0fe1a24808 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.196901 Jan 22 21:24:40.484640 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3674/7059] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:40 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:41.492233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d4ce4bd7-7d78-4eaf-9917-b528efac781e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:41.494005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d4ce4bd7-7d78-4eaf-9917-b528efac781e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:41.508223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4ce4bd7-7d78-4eaf-9917-b528efac781e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:41.512760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4ce4bd7-7d78-4eaf-9917-b528efac781e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:41.513980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4ce4bd7-7d78-4eaf-9917-b528efac781e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:41.514584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4ce4bd7-7d78-4eaf-9917-b528efac781e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:41.569900 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d4ce4bd7-7d78-4eaf-9917-b528efac781e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.081298 Jan 22 21:24:41.571222 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3675/7060] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:41 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:41.752004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4a202527-279f-4317-ba21-ba1bacaae0b1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:41.780585 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4a202527-279f-4317-ba21-ba1bacaae0b1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1394 microversion: 2.1 time: 1.351651 Jan 22 21:24:41.783233 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3386/7061] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:40 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1394 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:42.583775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-77774222-c67b-427e-81a0-28686c7f993d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:42.585758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-77774222-c67b-427e-81a0-28686c7f993d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:42.629741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77774222-c67b-427e-81a0-28686c7f993d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:42.629741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77774222-c67b-427e-81a0-28686c7f993d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:42.629741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77774222-c67b-427e-81a0-28686c7f993d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:42.629741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77774222-c67b-427e-81a0-28686c7f993d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:42.810892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-34897b7a-7bd1-4dbf-b755-40171872968a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:42.810892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-34897b7a-7bd1-4dbf-b755-40171872968a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:42.811435 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-77774222-c67b-427e-81a0-28686c7f993d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.222891 Jan 22 21:24:42.814573 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3676/7062] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:42 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:42.818332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34897b7a-7bd1-4dbf-b755-40171872968a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:42.819972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34897b7a-7bd1-4dbf-b755-40171872968a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:42.825670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34897b7a-7bd1-4dbf-b755-40171872968a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:42.841659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34897b7a-7bd1-4dbf-b755-40171872968a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:43.288337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-34897b7a-7bd1-4dbf-b755-40171872968a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:43.302780 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-34897b7a-7bd1-4dbf-b755-40171872968a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1394 microversion: 2.1 time: 0.505012 Jan 22 21:24:43.316355 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3387/7063] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:42 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1394 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:24:43.819601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4bb6a52b-92d0-4138-ae8c-6bbce6715243 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:43.821292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4bb6a52b-92d0-4138-ae8c-6bbce6715243 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:43.853376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bb6a52b-92d0-4138-ae8c-6bbce6715243 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:43.856965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bb6a52b-92d0-4138-ae8c-6bbce6715243 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:43.863488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bb6a52b-92d0-4138-ae8c-6bbce6715243 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:43.865861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bb6a52b-92d0-4138-ae8c-6bbce6715243 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:43.950757 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4bb6a52b-92d0-4138-ae8c-6bbce6715243 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.135717 Jan 22 21:24:43.953734 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3677/7064] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:43 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:44.327709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-37da9cff-56da-4aad-ae95-6ff6c13b9fca tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:44.329121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-37da9cff-56da-4aad-ae95-6ff6c13b9fca tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:44.340875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37da9cff-56da-4aad-ae95-6ff6c13b9fca tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:44.341984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37da9cff-56da-4aad-ae95-6ff6c13b9fca tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:44.343855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37da9cff-56da-4aad-ae95-6ff6c13b9fca tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:44.344770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37da9cff-56da-4aad-ae95-6ff6c13b9fca tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:44.964914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4aaaea36-ef06-49a0-b88b-86773c07c424 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:44.966064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4aaaea36-ef06-49a0-b88b-86773c07c424 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:45.017594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aaaea36-ef06-49a0-b88b-86773c07c424 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:45.017594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aaaea36-ef06-49a0-b88b-86773c07c424 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:45.020212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aaaea36-ef06-49a0-b88b-86773c07c424 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:45.022378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4aaaea36-ef06-49a0-b88b-86773c07c424 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:45.138441 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4aaaea36-ef06-49a0-b88b-86773c07c424 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.175062 Jan 22 21:24:45.142818 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3678/7065] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:44 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:24:45.154590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-dcf2bdc2-fea5-49f4-9710-000fd6a5f59c req-695f730f-8377-4227-83a7-0d5f2495d5db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dcb1d75-21c2-47b6-9ad6-02833e78b124", "tag": "68be209a-849c-46f1-a4f3-5b720fb720ac"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:45.160146 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:24:45.160146 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:24:45.186755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-dcf2bdc2-fea5-49f4-9710-000fd6a5f59c req-695f730f-8377-4227-83a7-0d5f2495d5db service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:45.191512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-dcf2bdc2-fea5-49f4-9710-000fd6a5f59c req-695f730f-8377-4227-83a7-0d5f2495d5db service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:45.228788 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-dcf2bdc2-fea5-49f4-9710-000fd6a5f59c req-695f730f-8377-4227-83a7-0d5f2495d5db service nova] Creating event network-changed:68be209a-849c-46f1-a4f3-5b720fb720ac for instance 8dcb1d75-21c2-47b6-9ad6-02833e78b124 on nch1-master-1 Jan 22 21:24:45.248844 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-dcf2bdc2-fea5-49f4-9710-000fd6a5f59c req-695f730f-8377-4227-83a7-0d5f2495d5db service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097098 Jan 22 21:24:45.249551 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3679/7066] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:24:45.492784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-37da9cff-56da-4aad-ae95-6ff6c13b9fca tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:45.503784 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-37da9cff-56da-4aad-ae95-6ff6c13b9fca tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1394 microversion: 2.1 time: 1.183254 Jan 22 21:24:45.508762 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3388/7067] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:44 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1394 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:46.156510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f89940c6-00b0-492c-b9eb-8308a198f3f3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:46.156510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f89940c6-00b0-492c-b9eb-8308a198f3f3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:46.164157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f89940c6-00b0-492c-b9eb-8308a198f3f3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:46.165595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f89940c6-00b0-492c-b9eb-8308a198f3f3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:46.171817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f89940c6-00b0-492c-b9eb-8308a198f3f3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:46.175091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f89940c6-00b0-492c-b9eb-8308a198f3f3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:46.284595 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f89940c6-00b0-492c-b9eb-8308a198f3f3 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.123024 Jan 22 21:24:46.291159 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3680/7068] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:46 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:46.526494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6b96c84f-c4cd-41bf-ad6a-fe0d777aa03f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:46.528872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6b96c84f-c4cd-41bf-ad6a-fe0d777aa03f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:46.547963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b96c84f-c4cd-41bf-ad6a-fe0d777aa03f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:46.547963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b96c84f-c4cd-41bf-ad6a-fe0d777aa03f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:46.548455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b96c84f-c4cd-41bf-ad6a-fe0d777aa03f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:46.548909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b96c84f-c4cd-41bf-ad6a-fe0d777aa03f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:46.645621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-29cfce57-381e-4b89-88c8-bdbd276c4cf8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:46.645621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-29cfce57-381e-4b89-88c8-bdbd276c4cf8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:46.660515 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29cfce57-381e-4b89-88c8-bdbd276c4cf8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:46.661081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29cfce57-381e-4b89-88c8-bdbd276c4cf8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:46.662077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29cfce57-381e-4b89-88c8-bdbd276c4cf8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:46.662770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29cfce57-381e-4b89-88c8-bdbd276c4cf8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:46.685439 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-29cfce57-381e-4b89-88c8-bdbd276c4cf8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] HTTP exception thrown: Instance a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 could not be found. Jan 22 21:24:46.691437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-29cfce57-381e-4b89-88c8-bdbd276c4cf8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Returning 404 to user: Instance a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:24:46.693911 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-29cfce57-381e-4b89-88c8-bdbd276c4cf8 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 404 len: 111 microversion: 2.1 time: 0.054220 Jan 22 21:24:46.700430 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3681/7069] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:24:46 2022] DELETE /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:24:46.770025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8998d3bd-b733-46d3-978f-a0dd772134e9 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:46.772896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8998d3bd-b733-46d3-978f-a0dd772134e9 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: a8a333b3-7eae-42f9-b9de-4f6039bd8eb7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:46.784214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8998d3bd-b733-46d3-978f-a0dd772134e9 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:46.784890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8998d3bd-b733-46d3-978f-a0dd772134e9 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:46.786093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8998d3bd-b733-46d3-978f-a0dd772134e9 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:46.786794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8998d3bd-b733-46d3-978f-a0dd772134e9 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:46.810216 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-8998d3bd-b733-46d3-978f-a0dd772134e9 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] HTTP exception thrown: Instance a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 could not be found. Jan 22 21:24:46.811113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8998d3bd-b733-46d3-978f-a0dd772134e9 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Returning 404 to user: Instance a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:24:46.812127 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8998d3bd-b733-46d3-978f-a0dd772134e9 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7" status: 404 len: 111 microversion: 2.1 time: 0.106560 Jan 22 21:24:46.812700 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3682/7070] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:46 2022] GET /compute/v2.1/servers/a8a333b3-7eae-42f9-b9de-4f6039bd8eb7 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:24:46.821195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1af199c0-e3bb-4e05-8b3b-67e1fa2b3708 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:46.822116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1af199c0-e3bb-4e05-8b3b-67e1fa2b3708 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:46.835420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1af199c0-e3bb-4e05-8b3b-67e1fa2b3708 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:46.839905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1af199c0-e3bb-4e05-8b3b-67e1fa2b3708 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:46.839905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1af199c0-e3bb-4e05-8b3b-67e1fa2b3708 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:46.839905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1af199c0-e3bb-4e05-8b3b-67e1fa2b3708 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:46.860990 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-1af199c0-e3bb-4e05-8b3b-67e1fa2b3708 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] HTTP exception thrown: Instance 5f5dabfb-f484-4b09-b45f-b31db980db64 could not be found. Jan 22 21:24:46.861767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1af199c0-e3bb-4e05-8b3b-67e1fa2b3708 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Returning 404 to user: Instance 5f5dabfb-f484-4b09-b45f-b31db980db64 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:24:46.863083 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1af199c0-e3bb-4e05-8b3b-67e1fa2b3708 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 404 len: 111 microversion: 2.1 time: 0.045615 Jan 22 21:24:46.864074 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3683/7071] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:24:46 2022] DELETE /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:24:46.886081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2625e782-469e-4d27-b037-4aa1ead94e19 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:46.890172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2625e782-469e-4d27-b037-4aa1ead94e19 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] [instance: 5f5dabfb-f484-4b09-b45f-b31db980db64] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:46.909419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2625e782-469e-4d27-b037-4aa1ead94e19 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:46.913197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2625e782-469e-4d27-b037-4aa1ead94e19 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:46.927581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2625e782-469e-4d27-b037-4aa1ead94e19 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:46.929156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2625e782-469e-4d27-b037-4aa1ead94e19 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:46.965624 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-2625e782-469e-4d27-b037-4aa1ead94e19 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] HTTP exception thrown: Instance 5f5dabfb-f484-4b09-b45f-b31db980db64 could not be found. Jan 22 21:24:46.970936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2625e782-469e-4d27-b037-4aa1ead94e19 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] Returning 404 to user: Instance 5f5dabfb-f484-4b09-b45f-b31db980db64 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:24:46.970936 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2625e782-469e-4d27-b037-4aa1ead94e19 tempest-ServersTestMultiNic-106752641 tempest-ServersTestMultiNic-106752641-project] 10.222.0.100 "GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64" status: 404 len: 111 microversion: 2.1 time: 0.092276 Jan 22 21:24:46.970936 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3684/7072] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:46 2022] GET /compute/v2.1/servers/5f5dabfb-f484-4b09-b45f-b31db980db64 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:24:47.167613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6b96c84f-c4cd-41bf-ad6a-fe0d777aa03f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:47.199417 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6b96c84f-c4cd-41bf-ad6a-fe0d777aa03f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1394 microversion: 2.1 time: 0.668058 Jan 22 21:24:47.199417 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3389/7073] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:46 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1394 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:47.300449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f9d75c6f-4f2c-4094-8c65-442f3717fe7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:47.302382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f9d75c6f-4f2c-4094-8c65-442f3717fe7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:47.340906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9d75c6f-4f2c-4094-8c65-442f3717fe7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:47.345106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9d75c6f-4f2c-4094-8c65-442f3717fe7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:47.355315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9d75c6f-4f2c-4094-8c65-442f3717fe7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:47.355315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9d75c6f-4f2c-4094-8c65-442f3717fe7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:47.440298 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f9d75c6f-4f2c-4094-8c65-442f3717fe7f tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.145880 Jan 22 21:24:47.461168 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3685/7074] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:47 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:48.212461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9435b747-3f72-4379-99d3-ca2770a0bb4b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:48.213132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9435b747-3f72-4379-99d3-ca2770a0bb4b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:48.221739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9435b747-3f72-4379-99d3-ca2770a0bb4b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:48.229492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9435b747-3f72-4379-99d3-ca2770a0bb4b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:48.229492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9435b747-3f72-4379-99d3-ca2770a0bb4b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:48.229492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9435b747-3f72-4379-99d3-ca2770a0bb4b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:48.423126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9435b747-3f72-4379-99d3-ca2770a0bb4b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:48.436088 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9435b747-3f72-4379-99d3-ca2770a0bb4b tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1394 microversion: 2.1 time: 0.227314 Jan 22 21:24:48.436707 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3390/7075] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:48 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1394 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:48.472945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-86607af7-67f4-4425-9bb3-44af985f3950 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:48.476301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-86607af7-67f4-4425-9bb3-44af985f3950 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:48.487737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86607af7-67f4-4425-9bb3-44af985f3950 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:48.488210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86607af7-67f4-4425-9bb3-44af985f3950 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:48.489022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86607af7-67f4-4425-9bb3-44af985f3950 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:48.489483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86607af7-67f4-4425-9bb3-44af985f3950 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:48.566726 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-86607af7-67f4-4425-9bb3-44af985f3950 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.098994 Jan 22 21:24:48.572263 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3686/7076] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:48 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:49.453486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-becd470e-efe9-4d2d-bd94-e33b430f6fa4 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:49.459301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-becd470e-efe9-4d2d-bd94-e33b430f6fa4 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:49.473219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-becd470e-efe9-4d2d-bd94-e33b430f6fa4 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:49.473899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-becd470e-efe9-4d2d-bd94-e33b430f6fa4 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:49.474755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-becd470e-efe9-4d2d-bd94-e33b430f6fa4 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:49.475209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-becd470e-efe9-4d2d-bd94-e33b430f6fa4 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:49.579852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-abee941a-63c6-435d-b1b0-f5230464195c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:49.580925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-abee941a-63c6-435d-b1b0-f5230464195c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:49.604320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abee941a-63c6-435d-b1b0-f5230464195c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:49.614302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abee941a-63c6-435d-b1b0-f5230464195c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:49.617982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abee941a-63c6-435d-b1b0-f5230464195c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:49.623514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abee941a-63c6-435d-b1b0-f5230464195c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:49.745933 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-abee941a-63c6-435d-b1b0-f5230464195c tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.154230 Jan 22 21:24:49.745933 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3687/7077] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:49 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:49.906557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-becd470e-efe9-4d2d-bd94-e33b430f6fa4 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:49.914824 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-becd470e-efe9-4d2d-bd94-e33b430f6fa4 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1394 microversion: 2.1 time: 0.464711 Jan 22 21:24:49.915058 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3391/7078] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:49 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1394 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:50.752898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d47a5c52-445c-4348-a125-27195b37582d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:50.757998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d47a5c52-445c-4348-a125-27195b37582d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:50.783869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d47a5c52-445c-4348-a125-27195b37582d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:50.789602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d47a5c52-445c-4348-a125-27195b37582d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:50.796505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d47a5c52-445c-4348-a125-27195b37582d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:50.797322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d47a5c52-445c-4348-a125-27195b37582d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:50.932375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-00c86d58-7ea3-4c58-94a0-6b090f635cd1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:50.934392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-00c86d58-7ea3-4c58-94a0-6b090f635cd1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:50.945795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00c86d58-7ea3-4c58-94a0-6b090f635cd1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:50.958667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00c86d58-7ea3-4c58-94a0-6b090f635cd1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:50.960989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00c86d58-7ea3-4c58-94a0-6b090f635cd1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:50.964391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00c86d58-7ea3-4c58-94a0-6b090f635cd1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:50.975681 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d47a5c52-445c-4348-a125-27195b37582d tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.226788 Jan 22 21:24:50.985067 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3688/7079] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:50 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:51.352626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-00c86d58-7ea3-4c58-94a0-6b090f635cd1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:51.362119 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-00c86d58-7ea3-4c58-94a0-6b090f635cd1 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1394 microversion: 2.1 time: 0.433465 Jan 22 21:24:51.381212 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3392/7080] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:50 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1394 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:52.014330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9de7fe12-3463-450d-ac2a-c9e24b89a883 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:52.019811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9de7fe12-3463-450d-ac2a-c9e24b89a883 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:52.058877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9de7fe12-3463-450d-ac2a-c9e24b89a883 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:52.061303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9de7fe12-3463-450d-ac2a-c9e24b89a883 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:52.066870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9de7fe12-3463-450d-ac2a-c9e24b89a883 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:52.068895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9de7fe12-3463-450d-ac2a-c9e24b89a883 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:52.217637 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9de7fe12-3463-450d-ac2a-c9e24b89a883 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.224927 Jan 22 21:24:52.222915 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3689/7081] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:51 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:52.394688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9235d305-2770-4d0c-b951-9c55f1c6aec3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:52.395607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9235d305-2770-4d0c-b951-9c55f1c6aec3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:52.429989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9235d305-2770-4d0c-b951-9c55f1c6aec3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:52.436291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9235d305-2770-4d0c-b951-9c55f1c6aec3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:52.438845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9235d305-2770-4d0c-b951-9c55f1c6aec3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:52.443760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9235d305-2770-4d0c-b951-9c55f1c6aec3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:53.239098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-d0a6cd66-632f-4ac2-af9e-ceecb91ce494 req-7b23fcb6-2225-422e-a00a-719f43d92aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dcb1d75-21c2-47b6-9ad6-02833e78b124", "name": "network-vif-plugged", "status": "completed", "tag": "68be209a-849c-46f1-a4f3-5b720fb720ac"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:53.249818 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:24:53.249818 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:24:53.267288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d0a6cd66-632f-4ac2-af9e-ceecb91ce494 req-7b23fcb6-2225-422e-a00a-719f43d92aaf service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:53.267804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d0a6cd66-632f-4ac2-af9e-ceecb91ce494 req-7b23fcb6-2225-422e-a00a-719f43d92aaf service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:53.296917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9235d305-2770-4d0c-b951-9c55f1c6aec3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:53.311109 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9235d305-2770-4d0c-b951-9c55f1c6aec3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1394 microversion: 2.1 time: 0.924746 Jan 22 21:24:53.311743 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3393/7082] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:52 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1394 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:53.333332 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d0a6cd66-632f-4ac2-af9e-ceecb91ce494 req-7b23fcb6-2225-422e-a00a-719f43d92aaf service nova] Creating event network-vif-plugged:68be209a-849c-46f1-a4f3-5b720fb720ac for instance 8dcb1d75-21c2-47b6-9ad6-02833e78b124 on nch1-master-1 Jan 22 21:24:53.346289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fe5665cd-d60a-4824-994f-c5837ffc8b80 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:53.347616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fe5665cd-d60a-4824-994f-c5837ffc8b80 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:53.366772 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-d0a6cd66-632f-4ac2-af9e-ceecb91ce494 req-7b23fcb6-2225-422e-a00a-719f43d92aaf service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120411 Jan 22 21:24:53.374978 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3690/7083] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:24:53.383202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe5665cd-d60a-4824-994f-c5837ffc8b80 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:53.386558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe5665cd-d60a-4824-994f-c5837ffc8b80 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:53.387763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe5665cd-d60a-4824-994f-c5837ffc8b80 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:53.391947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe5665cd-d60a-4824-994f-c5837ffc8b80 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:53.533216 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fe5665cd-d60a-4824-994f-c5837ffc8b80 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.220136 Jan 22 21:24:53.534473 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3394/7084] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:53 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:54.333319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2bdb4370-64a0-4130-8cf3-cc58de965c0f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:54.334071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2bdb4370-64a0-4130-8cf3-cc58de965c0f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:54.371861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2bdb4370-64a0-4130-8cf3-cc58de965c0f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:54.373177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2bdb4370-64a0-4130-8cf3-cc58de965c0f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:54.375735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2bdb4370-64a0-4130-8cf3-cc58de965c0f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:54.381304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2bdb4370-64a0-4130-8cf3-cc58de965c0f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:54.547758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2d02d946-a950-43d6-bfe8-eedb2f927123 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:54.549709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2d02d946-a950-43d6-bfe8-eedb2f927123 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:54.571603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d02d946-a950-43d6-bfe8-eedb2f927123 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:54.572076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d02d946-a950-43d6-bfe8-eedb2f927123 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:54.572912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d02d946-a950-43d6-bfe8-eedb2f927123 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:54.580921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d02d946-a950-43d6-bfe8-eedb2f927123 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:54.686525 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2d02d946-a950-43d6-bfe8-eedb2f927123 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.142134 Jan 22 21:24:54.688637 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3395/7085] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:54 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:54.903199 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:24:54.903445 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 21:24:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 (ip 10.222.0.100) !!! Jan 22 21:24:55.712838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6b76adee-5543-4e39-b1f5-19a265c6de9e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:55.715339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6b76adee-5543-4e39-b1f5-19a265c6de9e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:55.759256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b76adee-5543-4e39-b1f5-19a265c6de9e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:55.759256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b76adee-5543-4e39-b1f5-19a265c6de9e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:55.759471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b76adee-5543-4e39-b1f5-19a265c6de9e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:55.759886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b76adee-5543-4e39-b1f5-19a265c6de9e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:55.910264 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6b76adee-5543-4e39-b1f5-19a265c6de9e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.205054 Jan 22 21:24:55.918711 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3396/7086] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:55 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:56.046748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2bdb4370-64a0-4130-8cf3-cc58de965c0f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:56.062266 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2bdb4370-64a0-4130-8cf3-cc58de965c0f tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1394 microversion: 2.1 time: 1.736953 Jan 22 21:24:56.066120 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3691/7087] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:54 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1394 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:56.938919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6db451bb-4c26-42b5-9ab9-960850506cf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:56.940622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6db451bb-4c26-42b5-9ab9-960850506cf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:56.975514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6db451bb-4c26-42b5-9ab9-960850506cf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:56.978906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6db451bb-4c26-42b5-9ab9-960850506cf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:56.983162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6db451bb-4c26-42b5-9ab9-960850506cf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:56.989533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6db451bb-4c26-42b5-9ab9-960850506cf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:57.080932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c840f6a3-00e8-4c29-a017-41cdc6affb0e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:57.082514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c840f6a3-00e8-4c29-a017-41cdc6affb0e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:57.095586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c840f6a3-00e8-4c29-a017-41cdc6affb0e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:57.096342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c840f6a3-00e8-4c29-a017-41cdc6affb0e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:57.097325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c840f6a3-00e8-4c29-a017-41cdc6affb0e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:57.097976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c840f6a3-00e8-4c29-a017-41cdc6affb0e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:57.108542 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6db451bb-4c26-42b5-9ab9-960850506cf1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.181511 Jan 22 21:24:57.113698 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3397/7088] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:56 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:57.467916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c840f6a3-00e8-4c29-a017-41cdc6affb0e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:57.481925 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c840f6a3-00e8-4c29-a017-41cdc6affb0e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1565 microversion: 2.1 time: 0.401959 Jan 22 21:24:57.497045 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3692/7089] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:57 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1565 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:57.501357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7a49d62a-3d48-4d55-a1d5-4f504814dea7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:24:57.502078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7a49d62a-3d48-4d55-a1d5-4f504814dea7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:57.522348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a49d62a-3d48-4d55-a1d5-4f504814dea7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:57.522826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a49d62a-3d48-4d55-a1d5-4f504814dea7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:57.526823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a49d62a-3d48-4d55-a1d5-4f504814dea7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:57.527292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a49d62a-3d48-4d55-a1d5-4f504814dea7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:57.960054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7a49d62a-3d48-4d55-a1d5-4f504814dea7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:24:57.998686 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7a49d62a-3d48-4d55-a1d5-4f504814dea7 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1565 microversion: 2.1 time: 0.501009 Jan 22 21:24:58.001097 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3398/7090] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:24:57 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1565 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:24:58.124193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-47319067-831f-4a7e-89ed-fbb6c160fda0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:58.126806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-47319067-831f-4a7e-89ed-fbb6c160fda0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:58.142090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47319067-831f-4a7e-89ed-fbb6c160fda0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:58.143547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47319067-831f-4a7e-89ed-fbb6c160fda0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:58.150475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47319067-831f-4a7e-89ed-fbb6c160fda0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:58.152512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47319067-831f-4a7e-89ed-fbb6c160fda0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:58.308879 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-47319067-831f-4a7e-89ed-fbb6c160fda0 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.191537 Jan 22 21:24:58.319323 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3693/7091] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:58 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:24:59.320587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-299994d1-d557-4392-b834-1f2a3ef0add7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:24:59.321547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-299994d1-d557-4392-b834-1f2a3ef0add7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:24:59.350549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-299994d1-d557-4392-b834-1f2a3ef0add7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:59.351025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-299994d1-d557-4392-b834-1f2a3ef0add7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:59.354790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-299994d1-d557-4392-b834-1f2a3ef0add7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:24:59.355410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-299994d1-d557-4392-b834-1f2a3ef0add7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:24:59.448158 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-299994d1-d557-4392-b834-1f2a3ef0add7 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.131256 Jan 22 21:24:59.449748 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3399/7092] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:24:59 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:25:00.463208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e5dbffeb-d10c-4af0-9131-9a756998827e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:00.471120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e5dbffeb-d10c-4af0-9131-9a756998827e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:00.480218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5dbffeb-d10c-4af0-9131-9a756998827e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:00.481144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5dbffeb-d10c-4af0-9131-9a756998827e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:00.482911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5dbffeb-d10c-4af0-9131-9a756998827e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:00.483865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5dbffeb-d10c-4af0-9131-9a756998827e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:00.565121 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e5dbffeb-d10c-4af0-9131-9a756998827e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.107571 Jan 22 21:25:00.569800 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3694/7093] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:25:00 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:25:01.582572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4fded43a-a3a1-47a6-9dc3-819e2c299276 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:01.585410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4fded43a-a3a1-47a6-9dc3-819e2c299276 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:01.612204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fded43a-a3a1-47a6-9dc3-819e2c299276 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:01.621013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fded43a-a3a1-47a6-9dc3-819e2c299276 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:01.621013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fded43a-a3a1-47a6-9dc3-819e2c299276 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:01.621013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4fded43a-a3a1-47a6-9dc3-819e2c299276 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:01.719433 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4fded43a-a3a1-47a6-9dc3-819e2c299276 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.139800 Jan 22 21:25:01.728037 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3400/7094] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:25:01 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:25:02.736880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dc2a6f49-4e70-4e8f-acb3-8bb0b409dee8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:02.737955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dc2a6f49-4e70-4e8f-acb3-8bb0b409dee8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:02.758092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc2a6f49-4e70-4e8f-acb3-8bb0b409dee8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:02.764875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc2a6f49-4e70-4e8f-acb3-8bb0b409dee8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:02.765775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc2a6f49-4e70-4e8f-acb3-8bb0b409dee8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:02.770810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc2a6f49-4e70-4e8f-acb3-8bb0b409dee8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:02.866966 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dc2a6f49-4e70-4e8f-acb3-8bb0b409dee8 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.134098 Jan 22 21:25:02.867558 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3695/7095] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:25:02 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:25:03.429908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-244de23c-b71c-4f44-896e-75bae8ca1ae3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:03.430621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-244de23c-b71c-4f44-896e-75bae8ca1ae3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:03.444844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-244de23c-b71c-4f44-896e-75bae8ca1ae3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:03.446038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-244de23c-b71c-4f44-896e-75bae8ca1ae3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:03.451328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-541d0663-91c0-41f6-aff4-32b61bd5b54c req-557558e1-027f-4f97-b8e4-0e7414350caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dcb1d75-21c2-47b6-9ad6-02833e78b124", "tag": "68be209a-849c-46f1-a4f3-5b720fb720ac"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:03.451328 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:25:03.451328 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:25:03.452258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-244de23c-b71c-4f44-896e-75bae8ca1ae3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:03.452258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-244de23c-b71c-4f44-896e-75bae8ca1ae3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:03.462733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-541d0663-91c0-41f6-aff4-32b61bd5b54c req-557558e1-027f-4f97-b8e4-0e7414350caf service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:03.464352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-541d0663-91c0-41f6-aff4-32b61bd5b54c req-557558e1-027f-4f97-b8e4-0e7414350caf service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:03.497272 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-541d0663-91c0-41f6-aff4-32b61bd5b54c req-557558e1-027f-4f97-b8e4-0e7414350caf service nova] Creating event network-changed:68be209a-849c-46f1-a4f3-5b720fb720ac for instance 8dcb1d75-21c2-47b6-9ad6-02833e78b124 on nch1-master-1 Jan 22 21:25:03.514499 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-541d0663-91c0-41f6-aff4-32b61bd5b54c req-557558e1-027f-4f97-b8e4-0e7414350caf service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074270 Jan 22 21:25:03.518195 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3696/7096] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:25:03.883208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cca18bd7-bb8b-4304-9713-f4bb9d33025b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:03.884176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cca18bd7-bb8b-4304-9713-f4bb9d33025b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:03.900697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cca18bd7-bb8b-4304-9713-f4bb9d33025b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:03.906209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cca18bd7-bb8b-4304-9713-f4bb9d33025b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:03.909650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cca18bd7-bb8b-4304-9713-f4bb9d33025b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:03.912744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cca18bd7-bb8b-4304-9713-f4bb9d33025b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:04.024464 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cca18bd7-bb8b-4304-9713-f4bb9d33025b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.145280 Jan 22 21:25:04.032766 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3697/7097] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:25:03 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:25:04.041402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a093e835-d579-43f3-895e-6332c71d47ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:04.044439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a093e835-d579-43f3-895e-6332c71d47ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:04.061278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a093e835-d579-43f3-895e-6332c71d47ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:04.063389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a093e835-d579-43f3-895e-6332c71d47ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:04.064595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a093e835-d579-43f3-895e-6332c71d47ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:04.066023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a093e835-d579-43f3-895e-6332c71d47ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:04.608826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a093e835-d579-43f3-895e-6332c71d47ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:04.629769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a093e835-d579-43f3-895e-6332c71d47ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:04.641159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a093e835-d579-43f3-895e-6332c71d47ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:04.642537 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a093e835-d579-43f3-895e-6332c71d47ef tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 2948 microversion: 2.32 time: 0.608112 Jan 22 21:25:04.662696 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3698/7098] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:25:04 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 2948 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:25:04.696920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4e58af16-a995-458e-b55f-e2c9794a2c12 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:04.701892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4e58af16-a995-458e-b55f-e2c9794a2c12 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:04.725592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e58af16-a995-458e-b55f-e2c9794a2c12 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:04.727072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e58af16-a995-458e-b55f-e2c9794a2c12 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:04.728526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e58af16-a995-458e-b55f-e2c9794a2c12 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:04.733806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e58af16-a995-458e-b55f-e2c9794a2c12 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:04.797099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-244de23c-b71c-4f44-896e-75bae8ca1ae3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:04.816889 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-244de23c-b71c-4f44-896e-75bae8ca1ae3 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1565 microversion: 2.1 time: 1.391095 Jan 22 21:25:04.832348 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3401/7099] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:03 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1565 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:05.641231 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4e58af16-a995-458e-b55f-e2c9794a2c12 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.953475 Jan 22 21:25:05.643445 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3699/7100] 10.222.0.100 () {60 vars in 1320 bytes} [Sat Jan 22 21:25:04 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/os-interface => generated 1831 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:25:16.067025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1857802499", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:16.163962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] validate_networks() for [('daab66b3-e475-410d-b3c6-879c9ee42b5f', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:25:16.690632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:25:16.695729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:25:16.695729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:25:16.695729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:25:16.695729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:25:16.703165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:16.703618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:16.704442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:16.704884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:16.725576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Getting quotas for project 33aa542d613e412b9f8da4e23e5ee160. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:25:16.732416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Getting quotas for user 6f1e2e6e86ce481f8a8761d163075d67 and project 33aa542d613e412b9f8da4e23e5ee160. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:25:16.746050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:25:16.748400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:25:16.893737 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-26aad14d-6dc0-4918-bd6d-50cab4ad07a9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.176466 Jan 22 21:25:16.900885 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3402/7101] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:25:15 2022] POST /compute/v2.1/servers => generated 385 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:25:16.901704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-db95b710-1940-4e7d-8f6b-e380cd653494 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:16.903371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-db95b710-1940-4e7d-8f6b-e380cd653494 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:17.027956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-db95b710-1940-4e7d-8f6b-e380cd653494 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:17.038492 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-db95b710-1940-4e7d-8f6b-e380cd653494 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1226 microversion: 2.1 time: 0.138938 Jan 22 21:25:17.054276 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3700/7102] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:16 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1226 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:25:17.216323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1279631989", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:17.277935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] validate_networks() for [('daab66b3-e475-410d-b3c6-879c9ee42b5f', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:25:17.712317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:25:17.712317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:25:17.712317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:25:17.713184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:25:17.713868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:25:17.724312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:17.724810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:17.725673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:17.726128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:17.753405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Getting quotas for project 33aa542d613e412b9f8da4e23e5ee160. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:25:17.767587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Getting quotas for user 6f1e2e6e86ce481f8a8761d163075d67 and project 33aa542d613e412b9f8da4e23e5ee160. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:25:17.784256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:25:17.787304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:25:17.963706 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0ca6d74e-152f-4dc0-aa25-1356187bc549 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 0.752229 Jan 22 21:25:17.965398 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3403/7103] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:25:17 2022] POST /compute/v2.1/servers => generated 385 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:25:17.975492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d59ba6c9-7a42-45db-a655-a142877bc846 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:17.976445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d59ba6c9-7a42-45db-a655-a142877bc846 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:18.081622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d59ba6c9-7a42-45db-a655-a142877bc846 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:18.089939 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d59ba6c9-7a42-45db-a655-a142877bc846 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1226 microversion: 2.1 time: 0.110322 Jan 22 21:25:18.101536 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3701/7104] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:17 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:19.109559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85aa5e36-d77a-4266-b4df-e0d01933e422 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:19.110897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85aa5e36-d77a-4266-b4df-e0d01933e422 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:19.138586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85aa5e36-d77a-4266-b4df-e0d01933e422 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:19.138586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85aa5e36-d77a-4266-b4df-e0d01933e422 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:19.138586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85aa5e36-d77a-4266-b4df-e0d01933e422 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:19.138586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85aa5e36-d77a-4266-b4df-e0d01933e422 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:19.278748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-85aa5e36-d77a-4266-b4df-e0d01933e422 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:19.295424 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-85aa5e36-d77a-4266-b4df-e0d01933e422 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1230 microversion: 2.1 time: 0.192572 Jan 22 21:25:19.296465 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3404/7105] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:19 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1230 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:20.314455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4b0ca56f-c921-42bd-862c-c9dbab1b7e81 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:20.315076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4b0ca56f-c921-42bd-862c-c9dbab1b7e81 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:20.329913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b0ca56f-c921-42bd-862c-c9dbab1b7e81 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:20.330393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b0ca56f-c921-42bd-862c-c9dbab1b7e81 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:20.331246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b0ca56f-c921-42bd-862c-c9dbab1b7e81 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:20.334976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b0ca56f-c921-42bd-862c-c9dbab1b7e81 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:20.437158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4b0ca56f-c921-42bd-862c-c9dbab1b7e81 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:20.444950 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4b0ca56f-c921-42bd-862c-c9dbab1b7e81 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1278 microversion: 2.1 time: 0.134945 Jan 22 21:25:20.445547 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3702/7106] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:20 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1278 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:21.463821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ec78f19-e8d6-4d2f-bef4-7912c8213095 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:21.480414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3ec78f19-e8d6-4d2f-bef4-7912c8213095 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:21.480414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ec78f19-e8d6-4d2f-bef4-7912c8213095 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:21.480414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ec78f19-e8d6-4d2f-bef4-7912c8213095 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:21.480414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ec78f19-e8d6-4d2f-bef4-7912c8213095 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:21.480414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ec78f19-e8d6-4d2f-bef4-7912c8213095 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:21.570870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3ec78f19-e8d6-4d2f-bef4-7912c8213095 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:21.578873 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3ec78f19-e8d6-4d2f-bef4-7912c8213095 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1284 microversion: 2.1 time: 0.119512 Jan 22 21:25:21.579463 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3405/7107] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:21 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:22.601943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4700a121-2df0-4dba-aa1e-adfced39acd9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:22.602794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4700a121-2df0-4dba-aa1e-adfced39acd9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:22.611327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4700a121-2df0-4dba-aa1e-adfced39acd9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:22.611876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4700a121-2df0-4dba-aa1e-adfced39acd9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:22.613083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4700a121-2df0-4dba-aa1e-adfced39acd9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:22.613584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4700a121-2df0-4dba-aa1e-adfced39acd9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:22.865729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4700a121-2df0-4dba-aa1e-adfced39acd9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:22.876913 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4700a121-2df0-4dba-aa1e-adfced39acd9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1326 microversion: 2.1 time: 0.278490 Jan 22 21:25:22.877669 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3703/7108] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:22 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1326 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:22.926284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f1257a20-5731-4ba7-82cd-fd19a48910eb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:22.927971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f1257a20-5731-4ba7-82cd-fd19a48910eb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:22.940266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1257a20-5731-4ba7-82cd-fd19a48910eb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:22.940266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1257a20-5731-4ba7-82cd-fd19a48910eb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:22.940266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1257a20-5731-4ba7-82cd-fd19a48910eb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:22.940266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1257a20-5731-4ba7-82cd-fd19a48910eb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:22.993871 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f1257a20-5731-4ba7-82cd-fd19a48910eb tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124/action" status: 200 len: 24561 microversion: 2.1 time: 0.071573 Jan 22 21:25:22.994965 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3406/7109] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:25:22 2022] POST /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124/action => generated 24561 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:25:23.252353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-6315ffc3-1464-4406-b973-0bb805c66141 req-8aa05b3b-a049-484c-9a81-1a1257e87036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac840d9b-3179-4fcc-8d58-47094d6ad85c", "tag": "18513f77-a21a-4b8f-b83b-24ecc957f30f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:23.252353 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:25:23.252353 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:25:23.256376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6315ffc3-1464-4406-b973-0bb805c66141 req-8aa05b3b-a049-484c-9a81-1a1257e87036 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:23.257131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6315ffc3-1464-4406-b973-0bb805c66141 req-8aa05b3b-a049-484c-9a81-1a1257e87036 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:23.275569 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-6315ffc3-1464-4406-b973-0bb805c66141 req-8aa05b3b-a049-484c-9a81-1a1257e87036 service nova] Creating event network-changed:18513f77-a21a-4b8f-b83b-24ecc957f30f for instance ac840d9b-3179-4fcc-8d58-47094d6ad85c on nch2-master-1 Jan 22 21:25:23.279997 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-6315ffc3-1464-4406-b973-0bb805c66141 req-8aa05b3b-a049-484c-9a81-1a1257e87036 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038226 Jan 22 21:25:23.280921 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3704/7110] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:25:23.898162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-93e3d0fe-4163-40ff-84d0-7d1cb07004aa tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:23.899256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-93e3d0fe-4163-40ff-84d0-7d1cb07004aa tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:23.908847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93e3d0fe-4163-40ff-84d0-7d1cb07004aa tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:23.909524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93e3d0fe-4163-40ff-84d0-7d1cb07004aa tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:23.910697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93e3d0fe-4163-40ff-84d0-7d1cb07004aa tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:23.911485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93e3d0fe-4163-40ff-84d0-7d1cb07004aa tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:24.383889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-93e3d0fe-4163-40ff-84d0-7d1cb07004aa tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:24.402190 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-93e3d0fe-4163-40ff-84d0-7d1cb07004aa tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1326 microversion: 2.1 time: 0.510936 Jan 22 21:25:24.407093 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3407/7111] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:23 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1326 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:25.424982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-adf9e018-8f34-4bbb-87f6-149e27d28cf8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:25.425643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-adf9e018-8f34-4bbb-87f6-149e27d28cf8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:25.445105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adf9e018-8f34-4bbb-87f6-149e27d28cf8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:25.445797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adf9e018-8f34-4bbb-87f6-149e27d28cf8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:25.446681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adf9e018-8f34-4bbb-87f6-149e27d28cf8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:25.447310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adf9e018-8f34-4bbb-87f6-149e27d28cf8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:25.484183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-00237403-b34e-4548-ba6c-eccd91b8c874 req-67562ee6-76bf-4352-8c78-b60a48e84c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1267bed-c7b9-4f9f-baa1-e1891f588795", "tag": "6bea5fb2-1f3e-435a-89ec-a17935154ddc"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:25.486015 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:25:25.486015 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:25:25.494040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-00237403-b34e-4548-ba6c-eccd91b8c874 req-67562ee6-76bf-4352-8c78-b60a48e84c0d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:25.494499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-00237403-b34e-4548-ba6c-eccd91b8c874 req-67562ee6-76bf-4352-8c78-b60a48e84c0d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:25.505842 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-00237403-b34e-4548-ba6c-eccd91b8c874 req-67562ee6-76bf-4352-8c78-b60a48e84c0d service nova] Creating event network-changed:6bea5fb2-1f3e-435a-89ec-a17935154ddc for instance a1267bed-c7b9-4f9f-baa1-e1891f588795 on nch2-master-1 Jan 22 21:25:25.511630 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-00237403-b34e-4548-ba6c-eccd91b8c874 req-67562ee6-76bf-4352-8c78-b60a48e84c0d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196008 Jan 22 21:25:25.512390 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3705/7112] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:25:26.125625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-adf9e018-8f34-4bbb-87f6-149e27d28cf8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:26.147970 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-adf9e018-8f34-4bbb-87f6-149e27d28cf8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1326 microversion: 2.1 time: 0.727592 Jan 22 21:25:26.148952 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3408/7113] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:25 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1326 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:27.167560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bc2cfc9c-97e2-4e1d-b353-99043d7fa6a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:27.168265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bc2cfc9c-97e2-4e1d-b353-99043d7fa6a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:27.174678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc2cfc9c-97e2-4e1d-b353-99043d7fa6a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:27.175137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc2cfc9c-97e2-4e1d-b353-99043d7fa6a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:27.175939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc2cfc9c-97e2-4e1d-b353-99043d7fa6a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:27.176416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc2cfc9c-97e2-4e1d-b353-99043d7fa6a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:27.332224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bc2cfc9c-97e2-4e1d-b353-99043d7fa6a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:27.341572 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bc2cfc9c-97e2-4e1d-b353-99043d7fa6a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1326 microversion: 2.1 time: 0.179772 Jan 22 21:25:27.346700 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3706/7114] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:27 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1326 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:28.359495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2e15c713-362a-452f-bb39-3f9e3e82f1f2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:28.359495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2e15c713-362a-452f-bb39-3f9e3e82f1f2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:28.366320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e15c713-362a-452f-bb39-3f9e3e82f1f2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:28.366773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e15c713-362a-452f-bb39-3f9e3e82f1f2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:28.367823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e15c713-362a-452f-bb39-3f9e3e82f1f2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:28.368326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e15c713-362a-452f-bb39-3f9e3e82f1f2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:28.542945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2e15c713-362a-452f-bb39-3f9e3e82f1f2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:28.550932 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2e15c713-362a-452f-bb39-3f9e3e82f1f2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1326 microversion: 2.1 time: 0.195909 Jan 22 21:25:28.551503 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3409/7115] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:28 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1326 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:29.570984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4c2e9a68-4328-4fe3-a092-d6f92090aecb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:29.570984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4c2e9a68-4328-4fe3-a092-d6f92090aecb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:29.580014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c2e9a68-4328-4fe3-a092-d6f92090aecb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:29.580478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c2e9a68-4328-4fe3-a092-d6f92090aecb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:29.581278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c2e9a68-4328-4fe3-a092-d6f92090aecb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:29.581942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c2e9a68-4328-4fe3-a092-d6f92090aecb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:29.773597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4c2e9a68-4328-4fe3-a092-d6f92090aecb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:29.785912 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4c2e9a68-4328-4fe3-a092-d6f92090aecb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1326 microversion: 2.1 time: 0.217570 Jan 22 21:25:29.786540 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3707/7116] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:29 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1326 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:30.804046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-932bd330-a41e-4788-ad06-1bfc9a5cc9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:30.804669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-932bd330-a41e-4788-ad06-1bfc9a5cc9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:30.813454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-932bd330-a41e-4788-ad06-1bfc9a5cc9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:30.813454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-932bd330-a41e-4788-ad06-1bfc9a5cc9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:30.813454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-932bd330-a41e-4788-ad06-1bfc9a5cc9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:30.813982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-932bd330-a41e-4788-ad06-1bfc9a5cc9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:31.048399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-932bd330-a41e-4788-ad06-1bfc9a5cc9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:31.057173 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-932bd330-a41e-4788-ad06-1bfc9a5cc9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1326 microversion: 2.1 time: 0.257236 Jan 22 21:25:31.058004 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3410/7117] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:30 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1326 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:31.305908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-de852e27-3e6d-414e-863c-33e68aa2959f req-9b72bd4b-f217-41f7-a595-a0fd03f22c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac840d9b-3179-4fcc-8d58-47094d6ad85c", "name": "network-vif-plugged", "status": "completed", "tag": "18513f77-a21a-4b8f-b83b-24ecc957f30f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:31.309348 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:25:31.309348 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:25:31.317880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-de852e27-3e6d-414e-863c-33e68aa2959f req-9b72bd4b-f217-41f7-a595-a0fd03f22c93 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:31.318405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-de852e27-3e6d-414e-863c-33e68aa2959f req-9b72bd4b-f217-41f7-a595-a0fd03f22c93 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:31.331291 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-de852e27-3e6d-414e-863c-33e68aa2959f req-9b72bd4b-f217-41f7-a595-a0fd03f22c93 service nova] Creating event network-vif-plugged:18513f77-a21a-4b8f-b83b-24ecc957f30f for instance ac840d9b-3179-4fcc-8d58-47094d6ad85c on nch2-master-1 Jan 22 21:25:31.336903 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-de852e27-3e6d-414e-863c-33e68aa2959f req-9b72bd4b-f217-41f7-a595-a0fd03f22c93 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037078 Jan 22 21:25:31.338293 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3708/7118] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:25:32.074532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1403e2fb-89dd-4cc6-b9a3-97029f1a9839 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:32.075324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1403e2fb-89dd-4cc6-b9a3-97029f1a9839 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:32.084237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1403e2fb-89dd-4cc6-b9a3-97029f1a9839 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:32.084481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1403e2fb-89dd-4cc6-b9a3-97029f1a9839 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:32.085655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1403e2fb-89dd-4cc6-b9a3-97029f1a9839 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:32.086654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1403e2fb-89dd-4cc6-b9a3-97029f1a9839 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:32.413897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1403e2fb-89dd-4cc6-b9a3-97029f1a9839 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:32.425292 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1403e2fb-89dd-4cc6-b9a3-97029f1a9839 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1326 microversion: 2.1 time: 0.354426 Jan 22 21:25:32.429244 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3411/7119] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:32 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1326 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:33.357093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-bafae955-7d37-4226-a9cb-f33708f32339 req-e716c591-2948-4f37-904b-297b8ff465dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1267bed-c7b9-4f9f-baa1-e1891f588795", "name": "network-vif-plugged", "status": "completed", "tag": "6bea5fb2-1f3e-435a-89ec-a17935154ddc"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:33.358742 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:25:33.358742 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:25:33.366602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bafae955-7d37-4226-a9cb-f33708f32339 req-e716c591-2948-4f37-904b-297b8ff465dd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:33.367044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bafae955-7d37-4226-a9cb-f33708f32339 req-e716c591-2948-4f37-904b-297b8ff465dd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:33.379551 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-bafae955-7d37-4226-a9cb-f33708f32339 req-e716c591-2948-4f37-904b-297b8ff465dd service nova] Creating event network-vif-plugged:6bea5fb2-1f3e-435a-89ec-a17935154ddc for instance a1267bed-c7b9-4f9f-baa1-e1891f588795 on nch2-master-1 Jan 22 21:25:33.385155 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-bafae955-7d37-4226-a9cb-f33708f32339 req-e716c591-2948-4f37-904b-297b8ff465dd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033529 Jan 22 21:25:33.386398 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3709/7120] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:25:33.443695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7cfa014a-3c6b-43c6-a111-b07b6ac76a47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:33.444304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7cfa014a-3c6b-43c6-a111-b07b6ac76a47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:33.454721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cfa014a-3c6b-43c6-a111-b07b6ac76a47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:33.455181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cfa014a-3c6b-43c6-a111-b07b6ac76a47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:33.464732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cfa014a-3c6b-43c6-a111-b07b6ac76a47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:33.465272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7cfa014a-3c6b-43c6-a111-b07b6ac76a47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:33.689420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7cfa014a-3c6b-43c6-a111-b07b6ac76a47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:33.698264 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7cfa014a-3c6b-43c6-a111-b07b6ac76a47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1326 microversion: 2.1 time: 0.258483 Jan 22 21:25:33.699116 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3412/7121] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:33 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1326 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:34.166150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:34.167744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:34.174749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:34.175210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:34.176013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:34.176460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:34.263170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:25:34.263856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:25:34.264572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:25:34.265148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:25:34.265753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:25:34.561646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:34.569478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:34.570414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:34.572829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:34.573800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:34.605303 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c06f4e21-5300-49fa-b112-a4cd4eac17ab tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124/action" status: 202 len: 1139 microversion: 2.1 time: 0.446547 Jan 22 21:25:34.605968 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3710/7122] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:25:34 2022] POST /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124/action => generated 1139 bytes in 448 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 22 21:25:34.716824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9389f2cc-aa2a-4249-8564-9069ef45b4a8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:34.717748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9389f2cc-aa2a-4249-8564-9069ef45b4a8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:34.727092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9389f2cc-aa2a-4249-8564-9069ef45b4a8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:34.728348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9389f2cc-aa2a-4249-8564-9069ef45b4a8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:34.729177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9389f2cc-aa2a-4249-8564-9069ef45b4a8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:34.729771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9389f2cc-aa2a-4249-8564-9069ef45b4a8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:35.216505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-97e2e62e-c396-4135-95d5-d701df60bb2e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:35.217126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-97e2e62e-c396-4135-95d5-d701df60bb2e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:35.242496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97e2e62e-c396-4135-95d5-d701df60bb2e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:35.243541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97e2e62e-c396-4135-95d5-d701df60bb2e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:35.246326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97e2e62e-c396-4135-95d5-d701df60bb2e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:35.247226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97e2e62e-c396-4135-95d5-d701df60bb2e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:35.414878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9389f2cc-aa2a-4249-8564-9069ef45b4a8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:35.426655 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9389f2cc-aa2a-4249-8564-9069ef45b4a8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1326 microversion: 2.1 time: 0.713857 Jan 22 21:25:35.427573 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3711/7123] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:34 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1326 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:25:35.582047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-97e2e62e-c396-4135-95d5-d701df60bb2e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:35.593856 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-97e2e62e-c396-4135-95d5-d701df60bb2e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1692 microversion: 2.1 time: 0.974797 Jan 22 21:25:35.595491 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3413/7124] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:34 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1692 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:36.444917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b1d986ff-265c-4ccc-9f5b-7b560209e78f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:36.445784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b1d986ff-265c-4ccc-9f5b-7b560209e78f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:36.454295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1d986ff-265c-4ccc-9f5b-7b560209e78f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:36.454757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1d986ff-265c-4ccc-9f5b-7b560209e78f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:36.458544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1d986ff-265c-4ccc-9f5b-7b560209e78f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:36.458544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1d986ff-265c-4ccc-9f5b-7b560209e78f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:36.612968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b1d986ff-265c-4ccc-9f5b-7b560209e78f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:36.613275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fa081abc-14ef-4d02-ade5-3266b8d8e4e0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:36.614696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fa081abc-14ef-4d02-ade5-3266b8d8e4e0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:36.622152 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b1d986ff-265c-4ccc-9f5b-7b560209e78f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1520 microversion: 2.1 time: 0.181620 Jan 22 21:25:36.624112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa081abc-14ef-4d02-ade5-3266b8d8e4e0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:36.624933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa081abc-14ef-4d02-ade5-3266b8d8e4e0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:36.626138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa081abc-14ef-4d02-ade5-3266b8d8e4e0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:36.626797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa081abc-14ef-4d02-ade5-3266b8d8e4e0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:36.635947 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3712/7125] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:36 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:36.641631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5566bfd2-5bb4-48d2-a9b7-aaac517c2d47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:36.642988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5566bfd2-5bb4-48d2-a9b7-aaac517c2d47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:36.652698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5566bfd2-5bb4-48d2-a9b7-aaac517c2d47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:36.654412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5566bfd2-5bb4-48d2-a9b7-aaac517c2d47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:36.655866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5566bfd2-5bb4-48d2-a9b7-aaac517c2d47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:36.656455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5566bfd2-5bb4-48d2-a9b7-aaac517c2d47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:36.731718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-5566bfd2-5bb4-48d2-a9b7-aaac517c2d47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lazy-loading 'flavor' on Instance uuid a1267bed-c7b9-4f9f-baa1-e1891f588795 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:25:37.016790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fa081abc-14ef-4d02-ade5-3266b8d8e4e0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:37.028823 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fa081abc-14ef-4d02-ade5-3266b8d8e4e0 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1692 microversion: 2.1 time: 0.419868 Jan 22 21:25:37.030916 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3414/7126] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:36 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1692 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:25:37.150417 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5566bfd2-5bb4-48d2-a9b7-aaac517c2d47 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "POST /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795/action" status: 200 len: 32 microversion: 2.1 time: 0.512603 Jan 22 21:25:37.151565 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3713/7127] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:25:36 2022] POST /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795/action => generated 32 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:25:37.161619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-95de5ee5-defd-4409-ac93-46c9ef450a89 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:37.162304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-95de5ee5-defd-4409-ac93-46c9ef450a89 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:37.172557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95de5ee5-defd-4409-ac93-46c9ef450a89 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:37.181473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95de5ee5-defd-4409-ac93-46c9ef450a89 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:37.181473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95de5ee5-defd-4409-ac93-46c9ef450a89 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:37.181473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95de5ee5-defd-4409-ac93-46c9ef450a89 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:37.616514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-95de5ee5-defd-4409-ac93-46c9ef450a89 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:37.627435 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-95de5ee5-defd-4409-ac93-46c9ef450a89 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.470492 Jan 22 21:25:37.642540 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3415/7128] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:37 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:38.051697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5cc76172-47df-49f1-afee-e347d33bcf7c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:38.052546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5cc76172-47df-49f1-afee-e347d33bcf7c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:38.061571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5cc76172-47df-49f1-afee-e347d33bcf7c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:38.068722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5cc76172-47df-49f1-afee-e347d33bcf7c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:38.071488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5cc76172-47df-49f1-afee-e347d33bcf7c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:38.072201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5cc76172-47df-49f1-afee-e347d33bcf7c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:38.604448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5cc76172-47df-49f1-afee-e347d33bcf7c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:38.613480 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5cc76172-47df-49f1-afee-e347d33bcf7c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1692 microversion: 2.1 time: 0.568002 Jan 22 21:25:38.614293 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3714/7129] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:38 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1692 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:38.650475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-511b9cd7-86c1-48d7-9a2d-2b8386e8bda0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:38.651232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-511b9cd7-86c1-48d7-9a2d-2b8386e8bda0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:38.658491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-511b9cd7-86c1-48d7-9a2d-2b8386e8bda0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:38.658949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-511b9cd7-86c1-48d7-9a2d-2b8386e8bda0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:38.659756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-511b9cd7-86c1-48d7-9a2d-2b8386e8bda0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:38.660214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-511b9cd7-86c1-48d7-9a2d-2b8386e8bda0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:39.037364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-511b9cd7-86c1-48d7-9a2d-2b8386e8bda0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:39.049454 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-511b9cd7-86c1-48d7-9a2d-2b8386e8bda0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.402220 Jan 22 21:25:39.051849 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3416/7130] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:38 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:39.633985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bc8ba4c0-4d2e-4588-9f9b-c18795fe2348 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:39.635232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bc8ba4c0-4d2e-4588-9f9b-c18795fe2348 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:39.645931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc8ba4c0-4d2e-4588-9f9b-c18795fe2348 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:39.646593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc8ba4c0-4d2e-4588-9f9b-c18795fe2348 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:39.647687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc8ba4c0-4d2e-4588-9f9b-c18795fe2348 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:39.648450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bc8ba4c0-4d2e-4588-9f9b-c18795fe2348 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:40.078961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-26965079-8df1-4a27-bbd8-7d2dc5711172 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:40.079602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-26965079-8df1-4a27-bbd8-7d2dc5711172 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:40.111821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26965079-8df1-4a27-bbd8-7d2dc5711172 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:40.112227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26965079-8df1-4a27-bbd8-7d2dc5711172 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:40.113077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26965079-8df1-4a27-bbd8-7d2dc5711172 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:40.113550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26965079-8df1-4a27-bbd8-7d2dc5711172 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:40.183919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bc8ba4c0-4d2e-4588-9f9b-c18795fe2348 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:40.210264 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bc8ba4c0-4d2e-4588-9f9b-c18795fe2348 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1692 microversion: 2.1 time: 0.581722 Jan 22 21:25:40.210876 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3715/7131] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:39 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1692 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:40.482337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-26965079-8df1-4a27-bbd8-7d2dc5711172 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:40.497760 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-26965079-8df1-4a27-bbd8-7d2dc5711172 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.427873 Jan 22 21:25:40.510521 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3417/7132] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:40 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:25:41.231590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-53dcba08-afb9-4b21-934f-350d82f32188 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:41.232882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-53dcba08-afb9-4b21-934f-350d82f32188 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:41.243700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53dcba08-afb9-4b21-934f-350d82f32188 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:41.245708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53dcba08-afb9-4b21-934f-350d82f32188 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:41.245708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53dcba08-afb9-4b21-934f-350d82f32188 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:41.246497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53dcba08-afb9-4b21-934f-350d82f32188 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:41.427574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-53dcba08-afb9-4b21-934f-350d82f32188 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:41.440494 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-53dcba08-afb9-4b21-934f-350d82f32188 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1692 microversion: 2.1 time: 0.215422 Jan 22 21:25:41.441837 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3716/7133] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:41 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1692 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:41.516339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-68ffa840-2dd8-4290-9c3d-6c7c7a5e55a1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:41.517133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-68ffa840-2dd8-4290-9c3d-6c7c7a5e55a1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:41.531679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68ffa840-2dd8-4290-9c3d-6c7c7a5e55a1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:41.532359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68ffa840-2dd8-4290-9c3d-6c7c7a5e55a1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:41.533308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68ffa840-2dd8-4290-9c3d-6c7c7a5e55a1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:41.539588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68ffa840-2dd8-4290-9c3d-6c7c7a5e55a1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:41.562601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-420b7085-6d32-4865-9a90-ac1d01a98f0f tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Action: 'create', calling method: .version_select at 0x7f1ed5dc9ee0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-575367562"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:41.579947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-420b7085-6d32-4865-9a90-ac1d01a98f0f tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:25:41.595977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-420b7085-6d32-4865-9a90-ac1d01a98f0f tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for user f84a5c446f01456e991f940f550199e5 and project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:25:41.722308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-68ffa840-2dd8-4290-9c3d-6c7c7a5e55a1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:41.734651 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-68ffa840-2dd8-4290-9c3d-6c7c7a5e55a1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.218097 Jan 22 21:25:41.735433 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3418/7134] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:41 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:42.069691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-420b7085-6d32-4865-9a90-ac1d01a98f0f tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:25:42.074902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-420b7085-6d32-4865-9a90-ac1d01a98f0f tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for user f84a5c446f01456e991f940f550199e5 and project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:25:42.093836 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-420b7085-6d32-4865-9a90-ac1d01a98f0f tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.534624 Jan 22 21:25:42.094865 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3717/7135] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:25:41 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:42.465441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a540c647-efd3-476f-8e08-6aa9aa6d1433 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:42.466876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a540c647-efd3-476f-8e08-6aa9aa6d1433 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:42.480943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a540c647-efd3-476f-8e08-6aa9aa6d1433 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:42.482940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a540c647-efd3-476f-8e08-6aa9aa6d1433 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:42.483970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a540c647-efd3-476f-8e08-6aa9aa6d1433 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:42.485321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a540c647-efd3-476f-8e08-6aa9aa6d1433 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:42.520358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7f447db7-8a90-4c48-9f06-303a3f2e2186 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215-project-admin] Calling method '.version_select at 0x7f1ed6033430>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:42.521354 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:25:42.521354 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:25:42.523061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f447db7-8a90-4c48-9f06-303a3f2e2186 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:42.523527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f447db7-8a90-4c48-9f06-303a3f2e2186 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:42.542880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f447db7-8a90-4c48-9f06-303a3f2e2186 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:42.543615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f447db7-8a90-4c48-9f06-303a3f2e2186 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:42.556595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f447db7-8a90-4c48-9f06-303a3f2e2186 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:42.556914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f447db7-8a90-4c48-9f06-303a3f2e2186 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:42.564627 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7f447db7-8a90-4c48-9f06-303a3f2e2186 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215 tempest-PortsAdminExtendedAttrsIpV6TestJSON-608328215-project-admin] 10.222.0.100 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.313098 Jan 22 21:25:42.565951 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3419/7136] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:25:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:25:42.714145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a540c647-efd3-476f-8e08-6aa9aa6d1433 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:42.723298 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a540c647-efd3-476f-8e08-6aa9aa6d1433 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1692 microversion: 2.1 time: 0.268506 Jan 22 21:25:42.723916 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3718/7137] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:42 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1692 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:42.752715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c72c5d88-424f-404a-a3ac-5b8eb534c1ed tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:42.753776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c72c5d88-424f-404a-a3ac-5b8eb534c1ed tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:42.763119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c72c5d88-424f-404a-a3ac-5b8eb534c1ed tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:42.763939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c72c5d88-424f-404a-a3ac-5b8eb534c1ed tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:42.765008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c72c5d88-424f-404a-a3ac-5b8eb534c1ed tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:42.765783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c72c5d88-424f-404a-a3ac-5b8eb534c1ed tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:42.974936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c72c5d88-424f-404a-a3ac-5b8eb534c1ed tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:42.983989 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c72c5d88-424f-404a-a3ac-5b8eb534c1ed tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.235584 Jan 22 21:25:42.984648 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3420/7138] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:42 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:43.742053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b7800cf0-d7e5-4f6b-aab9-d892a2ffc595 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:43.743560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b7800cf0-d7e5-4f6b-aab9-d892a2ffc595 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:43.751249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7800cf0-d7e5-4f6b-aab9-d892a2ffc595 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:43.752270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7800cf0-d7e5-4f6b-aab9-d892a2ffc595 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:43.753284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7800cf0-d7e5-4f6b-aab9-d892a2ffc595 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:43.754020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7800cf0-d7e5-4f6b-aab9-d892a2ffc595 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:44.002908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ebc29f2b-6547-4fd7-a1af-7eeaa5bb6fef tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:44.003535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ebc29f2b-6547-4fd7-a1af-7eeaa5bb6fef tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:44.016597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebc29f2b-6547-4fd7-a1af-7eeaa5bb6fef tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:44.017162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebc29f2b-6547-4fd7-a1af-7eeaa5bb6fef tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:44.022424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebc29f2b-6547-4fd7-a1af-7eeaa5bb6fef tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:44.022424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebc29f2b-6547-4fd7-a1af-7eeaa5bb6fef tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:44.061782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b7800cf0-d7e5-4f6b-aab9-d892a2ffc595 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:44.075049 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b7800cf0-d7e5-4f6b-aab9-d892a2ffc595 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1692 microversion: 2.1 time: 0.337125 Jan 22 21:25:44.076264 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3719/7139] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:43 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1692 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:44.287732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ebc29f2b-6547-4fd7-a1af-7eeaa5bb6fef tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:44.302040 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ebc29f2b-6547-4fd7-a1af-7eeaa5bb6fef tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.302512 Jan 22 21:25:44.309648 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3421/7140] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:43 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:45.093432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f65f61c3-f534-4784-9d1b-90b1d6fb6e9c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:45.098589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f65f61c3-f534-4784-9d1b-90b1d6fb6e9c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:45.105961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f65f61c3-f534-4784-9d1b-90b1d6fb6e9c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:45.106686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f65f61c3-f534-4784-9d1b-90b1d6fb6e9c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:45.107518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f65f61c3-f534-4784-9d1b-90b1d6fb6e9c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:45.107965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f65f61c3-f534-4784-9d1b-90b1d6fb6e9c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:45.303365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f65f61c3-f534-4784-9d1b-90b1d6fb6e9c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:45.312190 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f65f61c3-f534-4784-9d1b-90b1d6fb6e9c tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1692 microversion: 2.1 time: 0.222496 Jan 22 21:25:45.313091 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3720/7141] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:45 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1692 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:45.323896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c5555ee3-7638-4022-b4b6-62d2df64e058 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:45.323896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c5555ee3-7638-4022-b4b6-62d2df64e058 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:45.329212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5555ee3-7638-4022-b4b6-62d2df64e058 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:45.329925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5555ee3-7638-4022-b4b6-62d2df64e058 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:45.330718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5555ee3-7638-4022-b4b6-62d2df64e058 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:45.331159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c5555ee3-7638-4022-b4b6-62d2df64e058 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:45.495625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c5555ee3-7638-4022-b4b6-62d2df64e058 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:45.503511 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c5555ee3-7638-4022-b4b6-62d2df64e058 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.187705 Jan 22 21:25:45.504095 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3422/7142] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:45 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:46.080498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1901070335", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "e177671c-f753-4a51-a9d6-b517b34e1381"}], "key_name": "tempest-TestNetworkBasicOps-575367562", "security_groups": [{"name": "tempest-secgroup-smoke-495546748"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:46.235224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] validate_networks() for [('e177671c-f753-4a51-a9d6-b517b34e1381', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:25:46.330674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2819dbc6-6b74-4508-bd87-053f6814040a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:46.331639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2819dbc6-6b74-4508-bd87-053f6814040a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:46.339309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2819dbc6-6b74-4508-bd87-053f6814040a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:46.339704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2819dbc6-6b74-4508-bd87-053f6814040a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:46.340506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2819dbc6-6b74-4508-bd87-053f6814040a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:46.340954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2819dbc6-6b74-4508-bd87-053f6814040a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:46.509749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2819dbc6-6b74-4508-bd87-053f6814040a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:46.520129 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2819dbc6-6b74-4508-bd87-053f6814040a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1692 microversion: 2.1 time: 0.193225 Jan 22 21:25:46.521201 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3423/7143] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:46 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1692 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:25:46.525966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5d4675bb-25ca-4e39-a09c-db9ae8bbce3f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:46.526580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5d4675bb-25ca-4e39-a09c-db9ae8bbce3f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:46.532765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d4675bb-25ca-4e39-a09c-db9ae8bbce3f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:46.533235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d4675bb-25ca-4e39-a09c-db9ae8bbce3f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:46.534084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d4675bb-25ca-4e39-a09c-db9ae8bbce3f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:46.534548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d4675bb-25ca-4e39-a09c-db9ae8bbce3f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:46.683693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5d4675bb-25ca-4e39-a09c-db9ae8bbce3f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:46.691531 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5d4675bb-25ca-4e39-a09c-db9ae8bbce3f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.169123 Jan 22 21:25:46.692133 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3424/7144] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:46 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:46.823695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:25:46.824128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:25:46.824699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:25:46.825118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:25:46.825565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:25:46.835779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:46.836264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:46.837550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:46.838051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:46.856044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:25:46.861361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for user f84a5c446f01456e991f940f550199e5 and project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:25:46.873968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:25:46.876524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:25:47.066208 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0fa2e490-4ae8-4b86-87cd-649f64e36eac tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.990134 Jan 22 21:25:47.090933 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3721/7145] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:25:46 2022] POST /compute/v2.1/servers => generated 407 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:25:47.092211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-74deae50-27b9-4253-bf6f-2d2c8433bb44 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:47.092211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-74deae50-27b9-4253-bf6f-2d2c8433bb44 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:47.172268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-74deae50-27b9-4253-bf6f-2d2c8433bb44 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:47.180345 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-74deae50-27b9-4253-bf6f-2d2c8433bb44 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1252 microversion: 2.1 time: 0.106662 Jan 22 21:25:47.181016 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3425/7146] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:47 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1252 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:47.540162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a2ab54fb-98e1-428f-a8f8-ddb9f9d48cd5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:47.542924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a2ab54fb-98e1-428f-a8f8-ddb9f9d48cd5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:47.553542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2ab54fb-98e1-428f-a8f8-ddb9f9d48cd5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:47.554100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2ab54fb-98e1-428f-a8f8-ddb9f9d48cd5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:47.555037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2ab54fb-98e1-428f-a8f8-ddb9f9d48cd5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:47.555806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2ab54fb-98e1-428f-a8f8-ddb9f9d48cd5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:47.709303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-80c61f3f-5189-4769-8297-a904828ed53c tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:47.710909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-80c61f3f-5189-4769-8297-a904828ed53c tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:47.724902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80c61f3f-5189-4769-8297-a904828ed53c tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:47.725908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80c61f3f-5189-4769-8297-a904828ed53c tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:47.727640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80c61f3f-5189-4769-8297-a904828ed53c tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:47.729150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80c61f3f-5189-4769-8297-a904828ed53c tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:48.014337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-80c61f3f-5189-4769-8297-a904828ed53c tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:48.026949 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-80c61f3f-5189-4769-8297-a904828ed53c tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.318181 Jan 22 21:25:48.026949 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3426/7147] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:47 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:48.138418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a2ab54fb-98e1-428f-a8f8-ddb9f9d48cd5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:48.146410 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a2ab54fb-98e1-428f-a8f8-ddb9f9d48cd5 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1692 microversion: 2.1 time: 0.611428 Jan 22 21:25:48.147164 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3722/7148] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:47 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1692 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:48.200411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4271f843-6b5f-4870-9e93-0c10730faca7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:48.201298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4271f843-6b5f-4870-9e93-0c10730faca7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:48.259382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4271f843-6b5f-4870-9e93-0c10730faca7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:48.266423 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4271f843-6b5f-4870-9e93-0c10730faca7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1252 microversion: 2.1 time: 0.072519 Jan 22 21:25:48.277613 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3427/7149] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:48 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1252 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:49.041867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4a044ab0-af94-4e95-a769-4a6c0cf837ad tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:49.042517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4a044ab0-af94-4e95-a769-4a6c0cf837ad tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:49.049632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a044ab0-af94-4e95-a769-4a6c0cf837ad tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:49.050305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a044ab0-af94-4e95-a769-4a6c0cf837ad tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:49.051111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a044ab0-af94-4e95-a769-4a6c0cf837ad tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:49.051679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a044ab0-af94-4e95-a769-4a6c0cf837ad tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:49.164463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ed36a707-1d16-4ae1-9b7d-55c018ef29dc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:49.165871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ed36a707-1d16-4ae1-9b7d-55c018ef29dc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:49.176765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed36a707-1d16-4ae1-9b7d-55c018ef29dc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:49.182930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed36a707-1d16-4ae1-9b7d-55c018ef29dc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:49.182930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed36a707-1d16-4ae1-9b7d-55c018ef29dc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:49.182930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed36a707-1d16-4ae1-9b7d-55c018ef29dc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:49.248821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4a044ab0-af94-4e95-a769-4a6c0cf837ad tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:49.268173 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4a044ab0-af94-4e95-a769-4a6c0cf837ad tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.231485 Jan 22 21:25:49.270184 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3723/7150] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:49 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:49.302821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f51f9764-18a2-4f1b-8cae-d9209726e727 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:49.305620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f51f9764-18a2-4f1b-8cae-d9209726e727 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:49.319578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f51f9764-18a2-4f1b-8cae-d9209726e727 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:49.322675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f51f9764-18a2-4f1b-8cae-d9209726e727 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:49.324444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f51f9764-18a2-4f1b-8cae-d9209726e727 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:49.329408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f51f9764-18a2-4f1b-8cae-d9209726e727 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:49.457373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f51f9764-18a2-4f1b-8cae-d9209726e727 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:49.470922 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f51f9764-18a2-4f1b-8cae-d9209726e727 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1304 microversion: 2.1 time: 0.178894 Jan 22 21:25:49.473729 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3724/7151] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:49 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:49.518216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ed36a707-1d16-4ae1-9b7d-55c018ef29dc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:49.527763 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ed36a707-1d16-4ae1-9b7d-55c018ef29dc tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1698 microversion: 2.1 time: 0.367339 Jan 22 21:25:49.528357 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3428/7152] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:49 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1698 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:25:50.290024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1b97beba-3e69-44dc-829b-64011698030e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:50.291347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1b97beba-3e69-44dc-829b-64011698030e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:50.299808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b97beba-3e69-44dc-829b-64011698030e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:50.300202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b97beba-3e69-44dc-829b-64011698030e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:50.301108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b97beba-3e69-44dc-829b-64011698030e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:50.301633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b97beba-3e69-44dc-829b-64011698030e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:50.481414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1b97beba-3e69-44dc-829b-64011698030e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:50.489983 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1b97beba-3e69-44dc-829b-64011698030e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.202950 Jan 22 21:25:50.491220 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3725/7153] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:50 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:50.502157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ad90524b-a5f8-4294-8c63-76e0a582fa51 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:50.503223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ad90524b-a5f8-4294-8c63-76e0a582fa51 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:50.511015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad90524b-a5f8-4294-8c63-76e0a582fa51 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:50.511657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad90524b-a5f8-4294-8c63-76e0a582fa51 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:50.512479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad90524b-a5f8-4294-8c63-76e0a582fa51 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:50.512927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad90524b-a5f8-4294-8c63-76e0a582fa51 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:50.545315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-201ade87-3074-4d5c-9334-ccb3dfb7e72e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:50.545958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-201ade87-3074-4d5c-9334-ccb3dfb7e72e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:50.556531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-201ade87-3074-4d5c-9334-ccb3dfb7e72e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:50.557303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-201ade87-3074-4d5c-9334-ccb3dfb7e72e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:50.558629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-201ade87-3074-4d5c-9334-ccb3dfb7e72e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:50.559519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-201ade87-3074-4d5c-9334-ccb3dfb7e72e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:50.607087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ad90524b-a5f8-4294-8c63-76e0a582fa51 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:50.617081 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ad90524b-a5f8-4294-8c63-76e0a582fa51 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1310 microversion: 2.1 time: 0.129823 Jan 22 21:25:50.620928 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3429/7154] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:50 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1310 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:50.831519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-201ade87-3074-4d5c-9334-ccb3dfb7e72e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:50.840978 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-201ade87-3074-4d5c-9334-ccb3dfb7e72e tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1698 microversion: 2.1 time: 0.300474 Jan 22 21:25:50.858742 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3726/7155] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:50 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1698 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:25:51.510359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d271e78c-ed3e-41da-a794-97d3f8824c2e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:51.511648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d271e78c-ed3e-41da-a794-97d3f8824c2e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:51.520133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d271e78c-ed3e-41da-a794-97d3f8824c2e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:51.520942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d271e78c-ed3e-41da-a794-97d3f8824c2e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:51.522043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d271e78c-ed3e-41da-a794-97d3f8824c2e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:51.522745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d271e78c-ed3e-41da-a794-97d3f8824c2e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:51.652671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-055959b7-d3fd-47b8-be86-9923359e437d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:51.654295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-055959b7-d3fd-47b8-be86-9923359e437d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:51.663590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-055959b7-d3fd-47b8-be86-9923359e437d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:51.664296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-055959b7-d3fd-47b8-be86-9923359e437d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:51.665470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-055959b7-d3fd-47b8-be86-9923359e437d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:51.666492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-055959b7-d3fd-47b8-be86-9923359e437d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:51.868855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d271e78c-ed3e-41da-a794-97d3f8824c2e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:51.885012 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d271e78c-ed3e-41da-a794-97d3f8824c2e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.375802 Jan 22 21:25:51.891365 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3430/7156] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:51 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:51.919122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-71476e11-9c0e-4ed6-a774-700b786327ad tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:51.919751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-71476e11-9c0e-4ed6-a774-700b786327ad tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:51.941417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71476e11-9c0e-4ed6-a774-700b786327ad tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:51.944631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71476e11-9c0e-4ed6-a774-700b786327ad tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:51.944631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71476e11-9c0e-4ed6-a774-700b786327ad tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:51.944631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-71476e11-9c0e-4ed6-a774-700b786327ad tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:51.989953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-055959b7-d3fd-47b8-be86-9923359e437d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:52.008977 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-055959b7-d3fd-47b8-be86-9923359e437d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1377 microversion: 2.1 time: 0.369281 Jan 22 21:25:52.009690 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3727/7157] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:51 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1377 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:52.230821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-71476e11-9c0e-4ed6-a774-700b786327ad tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:52.280478 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-71476e11-9c0e-4ed6-a774-700b786327ad tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1683 microversion: 2.1 time: 0.386519 Jan 22 21:25:52.282845 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3431/7158] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:51 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1683 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:52.812032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5ab7feb1-f78b-4ab5-9a3a-9c2c70cd2c7e req-4e71341f-80df-4854-9c31-1bd02dfa216f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dcb1d75-21c2-47b6-9ad6-02833e78b124", "name": "network-vif-unplugged", "status": "completed", "tag": "68be209a-849c-46f1-a4f3-5b720fb720ac"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:52.815919 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:25:52.815919 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:25:52.827487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5ab7feb1-f78b-4ab5-9a3a-9c2c70cd2c7e req-4e71341f-80df-4854-9c31-1bd02dfa216f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:52.827954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5ab7feb1-f78b-4ab5-9a3a-9c2c70cd2c7e req-4e71341f-80df-4854-9c31-1bd02dfa216f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:52.851002 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5ab7feb1-f78b-4ab5-9a3a-9c2c70cd2c7e req-4e71341f-80df-4854-9c31-1bd02dfa216f service nova] Creating event network-vif-unplugged:68be209a-849c-46f1-a4f3-5b720fb720ac for instance 8dcb1d75-21c2-47b6-9ad6-02833e78b124 on nch1-master-1 Jan 22 21:25:52.863171 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-5ab7feb1-f78b-4ab5-9a3a-9c2c70cd2c7e req-4e71341f-80df-4854-9c31-1bd02dfa216f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.483512 Jan 22 21:25:52.868052 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3728/7159] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:25:52.878451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-8306d6d9-9247-46b5-a35f-b2cddb13cc08 req-b85a4a95-f9b7-47e8-afa0-3a1a6c7cc88d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33b40b35-505b-4258-aa2a-123597f6bcde", "tag": "a3c778a0-a263-4ea2-b05d-86a39189bf83"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:52.879825 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:25:52.879825 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:25:52.890974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8306d6d9-9247-46b5-a35f-b2cddb13cc08 req-b85a4a95-f9b7-47e8-afa0-3a1a6c7cc88d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:52.891472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8306d6d9-9247-46b5-a35f-b2cddb13cc08 req-b85a4a95-f9b7-47e8-afa0-3a1a6c7cc88d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:52.905231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-094b3fe4-051d-4eb2-b722-facbec458466 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:52.906352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-094b3fe4-051d-4eb2-b722-facbec458466 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:52.909718 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8306d6d9-9247-46b5-a35f-b2cddb13cc08 req-b85a4a95-f9b7-47e8-afa0-3a1a6c7cc88d service nova] Creating event network-changed:a3c778a0-a263-4ea2-b05d-86a39189bf83 for instance 33b40b35-505b-4258-aa2a-123597f6bcde on nch1-master-1 Jan 22 21:25:52.916083 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-8306d6d9-9247-46b5-a35f-b2cddb13cc08 req-b85a4a95-f9b7-47e8-afa0-3a1a6c7cc88d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043267 Jan 22 21:25:52.916404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-094b3fe4-051d-4eb2-b722-facbec458466 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:52.917556 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3432/7160] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:25:52.919618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-094b3fe4-051d-4eb2-b722-facbec458466 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:52.926890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-094b3fe4-051d-4eb2-b722-facbec458466 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:52.927446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-094b3fe4-051d-4eb2-b722-facbec458466 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:53.029045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2c2b774d-0881-463a-ac83-da78b9179deb tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:53.029839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2c2b774d-0881-463a-ac83-da78b9179deb tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:53.045864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c2b774d-0881-463a-ac83-da78b9179deb tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:53.046718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c2b774d-0881-463a-ac83-da78b9179deb tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:53.049111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c2b774d-0881-463a-ac83-da78b9179deb tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:53.056805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c2b774d-0881-463a-ac83-da78b9179deb tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:53.150599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-094b3fe4-051d-4eb2-b722-facbec458466 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:53.159033 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-094b3fe4-051d-4eb2-b722-facbec458466 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.260007 Jan 22 21:25:53.159808 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3729/7161] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:52 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:25:53.536770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2c2b774d-0881-463a-ac83-da78b9179deb tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:53.547403 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2c2b774d-0881-463a-ac83-da78b9179deb tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1377 microversion: 2.1 time: 0.524118 Jan 22 21:25:53.548109 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3433/7162] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:53 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1377 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:54.183370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5ae88698-a6fe-4ef4-92c0-bd6c8c0fb96a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:54.183990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5ae88698-a6fe-4ef4-92c0-bd6c8c0fb96a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:54.190753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ae88698-a6fe-4ef4-92c0-bd6c8c0fb96a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:54.191496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ae88698-a6fe-4ef4-92c0-bd6c8c0fb96a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:54.192249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ae88698-a6fe-4ef4-92c0-bd6c8c0fb96a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:54.192697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ae88698-a6fe-4ef4-92c0-bd6c8c0fb96a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:54.356907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5ae88698-a6fe-4ef4-92c0-bd6c8c0fb96a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:54.364457 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5ae88698-a6fe-4ef4-92c0-bd6c8c0fb96a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.185055 Jan 22 21:25:54.365611 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3730/7163] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:54 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:54.565229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9031a231-c63c-4c2b-832d-12385f2ae905 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:54.566017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9031a231-c63c-4c2b-832d-12385f2ae905 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:54.573625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9031a231-c63c-4c2b-832d-12385f2ae905 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:54.574082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9031a231-c63c-4c2b-832d-12385f2ae905 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:54.574940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9031a231-c63c-4c2b-832d-12385f2ae905 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:54.575384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9031a231-c63c-4c2b-832d-12385f2ae905 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:54.727876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9031a231-c63c-4c2b-832d-12385f2ae905 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:54.752971 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9031a231-c63c-4c2b-832d-12385f2ae905 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1377 microversion: 2.1 time: 0.191707 Jan 22 21:25:54.753845 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3434/7164] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:54 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1377 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:55.383471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-151a0652-28d4-41af-97b6-6414137c2be4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:55.384171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-151a0652-28d4-41af-97b6-6414137c2be4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:55.392209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-151a0652-28d4-41af-97b6-6414137c2be4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:55.393951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-151a0652-28d4-41af-97b6-6414137c2be4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:55.394247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-151a0652-28d4-41af-97b6-6414137c2be4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:55.394700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-151a0652-28d4-41af-97b6-6414137c2be4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:55.543502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-151a0652-28d4-41af-97b6-6414137c2be4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:55.551750 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-151a0652-28d4-41af-97b6-6414137c2be4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.172104 Jan 22 21:25:55.552409 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3731/7165] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:55 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:55.772555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-011faec0-5c44-420a-a731-af5839e8b692 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:55.774013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-011faec0-5c44-420a-a731-af5839e8b692 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:55.782006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-011faec0-5c44-420a-a731-af5839e8b692 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:55.782462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-011faec0-5c44-420a-a731-af5839e8b692 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:55.783275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-011faec0-5c44-420a-a731-af5839e8b692 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:55.788627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-011faec0-5c44-420a-a731-af5839e8b692 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:55.921659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-9798e126-2a17-4d1f-8501-2933cb6c2108 req-d8045aee-2843-4029-b868-f93eb389850e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dcb1d75-21c2-47b6-9ad6-02833e78b124", "name": "network-vif-plugged", "status": "completed", "tag": "68be209a-849c-46f1-a4f3-5b720fb720ac"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:25:55.923506 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:25:55.923506 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:25:55.931411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9798e126-2a17-4d1f-8501-2933cb6c2108 req-d8045aee-2843-4029-b868-f93eb389850e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:55.931882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9798e126-2a17-4d1f-8501-2933cb6c2108 req-d8045aee-2843-4029-b868-f93eb389850e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:55.948459 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-9798e126-2a17-4d1f-8501-2933cb6c2108 req-d8045aee-2843-4029-b868-f93eb389850e service nova] Creating event network-vif-plugged:68be209a-849c-46f1-a4f3-5b720fb720ac for instance 8dcb1d75-21c2-47b6-9ad6-02833e78b124 on nch1-master-1 Jan 22 21:25:55.968164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-011faec0-5c44-420a-a731-af5839e8b692 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:55.973479 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-9798e126-2a17-4d1f-8501-2933cb6c2108 req-d8045aee-2843-4029-b868-f93eb389850e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049507 Jan 22 21:25:55.974117 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3732/7166] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:25:55.983024 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-011faec0-5c44-420a-a731-af5839e8b692 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1377 microversion: 2.1 time: 0.214385 Jan 22 21:25:55.984737 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3435/7167] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:55 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1377 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:56.569680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a8eeb73c-f367-4a8d-a235-9f75538b3be7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:56.570389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a8eeb73c-f367-4a8d-a235-9f75538b3be7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:56.582292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8eeb73c-f367-4a8d-a235-9f75538b3be7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:56.583129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8eeb73c-f367-4a8d-a235-9f75538b3be7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:56.584167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8eeb73c-f367-4a8d-a235-9f75538b3be7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:56.584872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8eeb73c-f367-4a8d-a235-9f75538b3be7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:56.765763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a8eeb73c-f367-4a8d-a235-9f75538b3be7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:56.773734 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a8eeb73c-f367-4a8d-a235-9f75538b3be7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.208781 Jan 22 21:25:56.781755 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3733/7168] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:56 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:57.001354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b34cfe7e-5691-4740-b780-006406ccf16c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:57.002637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b34cfe7e-5691-4740-b780-006406ccf16c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:57.011046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b34cfe7e-5691-4740-b780-006406ccf16c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:57.011731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b34cfe7e-5691-4740-b780-006406ccf16c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:57.012749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b34cfe7e-5691-4740-b780-006406ccf16c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:57.013417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b34cfe7e-5691-4740-b780-006406ccf16c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:57.554498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b34cfe7e-5691-4740-b780-006406ccf16c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:57.563716 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b34cfe7e-5691-4740-b780-006406ccf16c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1377 microversion: 2.1 time: 0.565935 Jan 22 21:25:57.575716 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3436/7169] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:56 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1377 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:57.793208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1c94b6de-61bf-4707-aabc-8454df84563a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:57.794224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1c94b6de-61bf-4707-aabc-8454df84563a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:57.816917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c94b6de-61bf-4707-aabc-8454df84563a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:57.819945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c94b6de-61bf-4707-aabc-8454df84563a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:57.820934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c94b6de-61bf-4707-aabc-8454df84563a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:57.821626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1c94b6de-61bf-4707-aabc-8454df84563a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:58.011131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1c94b6de-61bf-4707-aabc-8454df84563a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:58.025343 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1c94b6de-61bf-4707-aabc-8454df84563a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.236799 Jan 22 21:25:58.025982 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3734/7170] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:57 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:58.590051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5fbb0d57-68f0-4700-83c3-6f4db6702807 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:58.590703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5fbb0d57-68f0-4700-83c3-6f4db6702807 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:58.601867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fbb0d57-68f0-4700-83c3-6f4db6702807 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:58.602907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fbb0d57-68f0-4700-83c3-6f4db6702807 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:58.614915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fbb0d57-68f0-4700-83c3-6f4db6702807 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:58.615706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fbb0d57-68f0-4700-83c3-6f4db6702807 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:58.855556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5fbb0d57-68f0-4700-83c3-6f4db6702807 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:58.886613 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5fbb0d57-68f0-4700-83c3-6f4db6702807 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1377 microversion: 2.1 time: 0.306062 Jan 22 21:25:58.889660 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3437/7171] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:58 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1377 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:59.045203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-687d5b77-f197-4912-83cb-0ffdac112ec7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:59.053181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-687d5b77-f197-4912-83cb-0ffdac112ec7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:59.069138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-687d5b77-f197-4912-83cb-0ffdac112ec7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:59.070685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-687d5b77-f197-4912-83cb-0ffdac112ec7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:59.071777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-687d5b77-f197-4912-83cb-0ffdac112ec7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:59.072899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-687d5b77-f197-4912-83cb-0ffdac112ec7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:59.373471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-687d5b77-f197-4912-83cb-0ffdac112ec7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:25:59.388617 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-687d5b77-f197-4912-83cb-0ffdac112ec7 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.349002 Jan 22 21:25:59.389413 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3735/7172] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:59 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:25:59.903979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7fe71971-ace2-4813-99b1-d1fc2e827bd0 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:25:59.904651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7fe71971-ace2-4813-99b1-d1fc2e827bd0 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:25:59.913460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7fe71971-ace2-4813-99b1-d1fc2e827bd0 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:59.914213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7fe71971-ace2-4813-99b1-d1fc2e827bd0 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:25:59.915444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7fe71971-ace2-4813-99b1-d1fc2e827bd0 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:25:59.916056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7fe71971-ace2-4813-99b1-d1fc2e827bd0 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:00.125979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7fe71971-ace2-4813-99b1-d1fc2e827bd0 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:00.142737 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7fe71971-ace2-4813-99b1-d1fc2e827bd0 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1377 microversion: 2.1 time: 0.241267 Jan 22 21:26:00.152870 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3438/7173] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:25:59 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1377 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:00.393796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5002176d-3dd8-4b4d-93e4-e6cac916b926 req-8ec8f6b4-2567-449a-9c84-e8db4709826d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b40b35-505b-4258-aa2a-123597f6bcde", "name": "network-vif-plugged", "status": "completed", "tag": "a3c778a0-a263-4ea2-b05d-86a39189bf83"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:00.398574 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:26:00.398574 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:26:00.411153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-59ad2ede-7c48-4fc2-8961-f339054ebc0b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:00.411978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-59ad2ede-7c48-4fc2-8961-f339054ebc0b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:00.414065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5002176d-3dd8-4b4d-93e4-e6cac916b926 req-8ec8f6b4-2567-449a-9c84-e8db4709826d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:00.417135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5002176d-3dd8-4b4d-93e4-e6cac916b926 req-8ec8f6b4-2567-449a-9c84-e8db4709826d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:00.420977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59ad2ede-7c48-4fc2-8961-f339054ebc0b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:00.425968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59ad2ede-7c48-4fc2-8961-f339054ebc0b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:00.425968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59ad2ede-7c48-4fc2-8961-f339054ebc0b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:00.425968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59ad2ede-7c48-4fc2-8961-f339054ebc0b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:00.444289 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5002176d-3dd8-4b4d-93e4-e6cac916b926 req-8ec8f6b4-2567-449a-9c84-e8db4709826d service nova] Creating event network-vif-plugged:a3c778a0-a263-4ea2-b05d-86a39189bf83 for instance 33b40b35-505b-4258-aa2a-123597f6bcde on nch1-master-1 Jan 22 21:26:00.458784 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-5002176d-3dd8-4b4d-93e4-e6cac916b926 req-8ec8f6b4-2567-449a-9c84-e8db4709826d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072491 Jan 22 21:26:00.462629 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3736/7174] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:26:00.697752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-59ad2ede-7c48-4fc2-8961-f339054ebc0b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:00.713439 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-59ad2ede-7c48-4fc2-8961-f339054ebc0b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.304479 Jan 22 21:26:00.729068 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3439/7175] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:00 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:01.161126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-470539ac-51d9-47f1-b051-a6b08c620996 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:01.161856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-470539ac-51d9-47f1-b051-a6b08c620996 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:01.170781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-470539ac-51d9-47f1-b051-a6b08c620996 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:01.171248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-470539ac-51d9-47f1-b051-a6b08c620996 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:01.173572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-470539ac-51d9-47f1-b051-a6b08c620996 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:01.173572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-470539ac-51d9-47f1-b051-a6b08c620996 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:01.346147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-470539ac-51d9-47f1-b051-a6b08c620996 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:01.357913 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-470539ac-51d9-47f1-b051-a6b08c620996 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1377 microversion: 2.1 time: 0.200982 Jan 22 21:26:01.368292 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3737/7176] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:01 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1377 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:01.736067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a2fee159-a2c0-44fa-8c18-c76a41508f4f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:01.737694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a2fee159-a2c0-44fa-8c18-c76a41508f4f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:01.744354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2fee159-a2c0-44fa-8c18-c76a41508f4f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:01.744814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2fee159-a2c0-44fa-8c18-c76a41508f4f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:01.745676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2fee159-a2c0-44fa-8c18-c76a41508f4f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:01.746116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2fee159-a2c0-44fa-8c18-c76a41508f4f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:01.952733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a2fee159-a2c0-44fa-8c18-c76a41508f4f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:01.960983 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a2fee159-a2c0-44fa-8c18-c76a41508f4f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.228623 Jan 22 21:26:01.961719 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3440/7177] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:01 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:26:02.377624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f560b3c7-a99c-4af8-8f8e-cc46868dc76c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:02.377624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f560b3c7-a99c-4af8-8f8e-cc46868dc76c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:02.398556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f560b3c7-a99c-4af8-8f8e-cc46868dc76c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:02.399639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f560b3c7-a99c-4af8-8f8e-cc46868dc76c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:02.400940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f560b3c7-a99c-4af8-8f8e-cc46868dc76c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:02.405994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f560b3c7-a99c-4af8-8f8e-cc46868dc76c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:02.706367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f560b3c7-a99c-4af8-8f8e-cc46868dc76c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:02.719761 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f560b3c7-a99c-4af8-8f8e-cc46868dc76c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1549 microversion: 2.1 time: 0.348265 Jan 22 21:26:02.725536 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3738/7178] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:02 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1549 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:02.738026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bbe158e3-de82-4db4-95a8-5f89a6c2dc73 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:02.745325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bbe158e3-de82-4db4-95a8-5f89a6c2dc73 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:02.754990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbe158e3-de82-4db4-95a8-5f89a6c2dc73 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:02.755791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbe158e3-de82-4db4-95a8-5f89a6c2dc73 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:02.757605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbe158e3-de82-4db4-95a8-5f89a6c2dc73 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:02.758252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbe158e3-de82-4db4-95a8-5f89a6c2dc73 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:02.992488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-515d80f8-80e0-4ed5-be52-f221c98202b1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:02.996050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-515d80f8-80e0-4ed5-be52-f221c98202b1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:03.003911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-515d80f8-80e0-4ed5-be52-f221c98202b1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:03.004614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-515d80f8-80e0-4ed5-be52-f221c98202b1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:03.005957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-515d80f8-80e0-4ed5-be52-f221c98202b1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:03.007983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-515d80f8-80e0-4ed5-be52-f221c98202b1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:03.008124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bbe158e3-de82-4db4-95a8-5f89a6c2dc73 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:03.018238 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bbe158e3-de82-4db4-95a8-5f89a6c2dc73 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1549 microversion: 2.1 time: 0.284487 Jan 22 21:26:03.019469 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3441/7179] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:02 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1549 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:03.334708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-515d80f8-80e0-4ed5-be52-f221c98202b1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:03.344996 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-515d80f8-80e0-4ed5-be52-f221c98202b1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.367278 Jan 22 21:26:03.345780 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3739/7180] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:02 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:26:04.362818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-607b202d-cbd8-4def-baa2-d8bf2900d759 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:04.364698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-607b202d-cbd8-4def-baa2-d8bf2900d759 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:04.376079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-607b202d-cbd8-4def-baa2-d8bf2900d759 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:04.377483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-607b202d-cbd8-4def-baa2-d8bf2900d759 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:04.379170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-607b202d-cbd8-4def-baa2-d8bf2900d759 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:04.381179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-607b202d-cbd8-4def-baa2-d8bf2900d759 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:04.896874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-607b202d-cbd8-4def-baa2-d8bf2900d759 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:04.912839 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-607b202d-cbd8-4def-baa2-d8bf2900d759 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.553088 Jan 22 21:26:04.915733 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3442/7181] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:04 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:05.935194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d7f99e54-9c97-4186-894c-6cd84302823a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:05.937798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d7f99e54-9c97-4186-894c-6cd84302823a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:05.956855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7f99e54-9c97-4186-894c-6cd84302823a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:05.958585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7f99e54-9c97-4186-894c-6cd84302823a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:05.959436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7f99e54-9c97-4186-894c-6cd84302823a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:05.961053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7f99e54-9c97-4186-894c-6cd84302823a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:06.364836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d7f99e54-9c97-4186-894c-6cd84302823a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:06.379983 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d7f99e54-9c97-4186-894c-6cd84302823a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.450086 Jan 22 21:26:06.379983 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3740/7182] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:05 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:07.396593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b7cb2168-9f91-479b-95ab-bb9388aaadbf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:07.397976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b7cb2168-9f91-479b-95ab-bb9388aaadbf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:07.421220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7cb2168-9f91-479b-95ab-bb9388aaadbf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:07.422102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7cb2168-9f91-479b-95ab-bb9388aaadbf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:07.423548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7cb2168-9f91-479b-95ab-bb9388aaadbf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:07.424228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7cb2168-9f91-479b-95ab-bb9388aaadbf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:07.703525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-ed872a84-fea2-4310-820a-4b9af0e9da01 req-8a3fa46c-d3c3-45b5-b385-0074bcae6040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33b40b35-505b-4258-aa2a-123597f6bcde", "tag": "a3c778a0-a263-4ea2-b05d-86a39189bf83"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:07.708275 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:26:07.708275 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:26:07.724444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ed872a84-fea2-4310-820a-4b9af0e9da01 req-8a3fa46c-d3c3-45b5-b385-0074bcae6040 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:07.726175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ed872a84-fea2-4310-820a-4b9af0e9da01 req-8a3fa46c-d3c3-45b5-b385-0074bcae6040 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:07.784737 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-ed872a84-fea2-4310-820a-4b9af0e9da01 req-8a3fa46c-d3c3-45b5-b385-0074bcae6040 service nova] Creating event network-changed:a3c778a0-a263-4ea2-b05d-86a39189bf83 for instance 33b40b35-505b-4258-aa2a-123597f6bcde on nch1-master-1 Jan 22 21:26:07.794619 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-ed872a84-fea2-4310-820a-4b9af0e9da01 req-8a3fa46c-d3c3-45b5-b385-0074bcae6040 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095179 Jan 22 21:26:07.799112 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3741/7183] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:26:07.975248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b7cb2168-9f91-479b-95ab-bb9388aaadbf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:07.983683 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b7cb2168-9f91-479b-95ab-bb9388aaadbf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1526 microversion: 2.1 time: 0.591544 Jan 22 21:26:07.987211 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3443/7184] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:07 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1526 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:09.004754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6727301d-22fb-425b-9c8f-0eb3f8e83dbb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:09.005473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6727301d-22fb-425b-9c8f-0eb3f8e83dbb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:09.021728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6727301d-22fb-425b-9c8f-0eb3f8e83dbb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:09.022247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6727301d-22fb-425b-9c8f-0eb3f8e83dbb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:09.023257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6727301d-22fb-425b-9c8f-0eb3f8e83dbb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:09.023899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6727301d-22fb-425b-9c8f-0eb3f8e83dbb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:09.561990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6727301d-22fb-425b-9c8f-0eb3f8e83dbb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:09.575018 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6727301d-22fb-425b-9c8f-0eb3f8e83dbb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1506 microversion: 2.1 time: 0.574612 Jan 22 21:26:09.585967 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3742/7185] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:08 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1506 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:09.592121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2fbeebc1-02f4-4df3-88b0-efb99a635bb4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:09.593359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2fbeebc1-02f4-4df3-88b0-efb99a635bb4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:09.600846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fbeebc1-02f4-4df3-88b0-efb99a635bb4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:09.601627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fbeebc1-02f4-4df3-88b0-efb99a635bb4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:09.603238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fbeebc1-02f4-4df3-88b0-efb99a635bb4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:09.603866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fbeebc1-02f4-4df3-88b0-efb99a635bb4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:09.931345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2fbeebc1-02f4-4df3-88b0-efb99a635bb4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:09.954012 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2fbeebc1-02f4-4df3-88b0-efb99a635bb4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1519 microversion: 2.1 time: 0.365289 Jan 22 21:26:09.958811 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3444/7186] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:09 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1519 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:26:09.974343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2545171c-9347-460e-aaa4-c9577a67e86a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:09.975697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2545171c-9347-460e-aaa4-c9577a67e86a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: d12e50a2-4c33-4f3c-bd95-18edfffcbff8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:09.982866 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-2545171c-9347-460e-aaa4-c9577a67e86a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] HTTP exception thrown: Instance d12e50a2-4c33-4f3c-bd95-18edfffcbff8 could not be found. Jan 22 21:26:09.983480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2545171c-9347-460e-aaa4-c9577a67e86a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Returning 404 to user: Instance d12e50a2-4c33-4f3c-bd95-18edfffcbff8 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:26:09.984329 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2545171c-9347-460e-aaa4-c9577a67e86a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "POST /compute/v2.1/servers/d12e50a2-4c33-4f3c-bd95-18edfffcbff8/action" status: 404 len: 111 microversion: 2.1 time: 0.013781 Jan 22 21:26:09.994441 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3743/7187] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:26:09 2022] POST /compute/v2.1/servers/d12e50a2-4c33-4f3c-bd95-18edfffcbff8/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:26:09.999588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-963a1e0d-2c42-488a-9bab-df1a02fdb71b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:10.000142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-963a1e0d-2c42-488a-9bab-df1a02fdb71b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:10.006457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-963a1e0d-2c42-488a-9bab-df1a02fdb71b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:10.006925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-963a1e0d-2c42-488a-9bab-df1a02fdb71b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:10.007736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-963a1e0d-2c42-488a-9bab-df1a02fdb71b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:10.009104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-963a1e0d-2c42-488a-9bab-df1a02fdb71b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:10.268388 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-963a1e0d-2c42-488a-9bab-df1a02fdb71b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/action" status: 202 len: 0 microversion: 2.1 time: 0.271760 Jan 22 21:26:10.270760 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3445/7188] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:26:09 2022] POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:26:10.294930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-70526e10-48f6-4a9a-b099-0045f6f85156 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:10.297243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-70526e10-48f6-4a9a-b099-0045f6f85156 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:10.318728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70526e10-48f6-4a9a-b099-0045f6f85156 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:10.321748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70526e10-48f6-4a9a-b099-0045f6f85156 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:10.321748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70526e10-48f6-4a9a-b099-0045f6f85156 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:10.321748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70526e10-48f6-4a9a-b099-0045f6f85156 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:11.232764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-70526e10-48f6-4a9a-b099-0045f6f85156 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:11.241290 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-70526e10-48f6-4a9a-b099-0045f6f85156 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1524 microversion: 2.1 time: 0.965547 Jan 22 21:26:11.242030 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3744/7189] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:10 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1524 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:12.261636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-06f57d07-6be2-491d-af56-21c80084e0a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:12.262352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-06f57d07-6be2-491d-af56-21c80084e0a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:12.278378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06f57d07-6be2-491d-af56-21c80084e0a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:12.282923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06f57d07-6be2-491d-af56-21c80084e0a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:12.282923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06f57d07-6be2-491d-af56-21c80084e0a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:12.282923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06f57d07-6be2-491d-af56-21c80084e0a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:13.170860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-06f57d07-6be2-491d-af56-21c80084e0a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:13.181021 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-06f57d07-6be2-491d-af56-21c80084e0a2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1504 microversion: 2.1 time: 0.925055 Jan 22 21:26:13.187859 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3446/7190] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:12 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1504 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:13.212146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aa59d2e5-559a-4d2d-af5c-870aa627b348 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:13.213269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aa59d2e5-559a-4d2d-af5c-870aa627b348 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:13.221042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa59d2e5-559a-4d2d-af5c-870aa627b348 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:13.222286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa59d2e5-559a-4d2d-af5c-870aa627b348 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:13.223269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa59d2e5-559a-4d2d-af5c-870aa627b348 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:13.223718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa59d2e5-559a-4d2d-af5c-870aa627b348 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:13.250319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-aa59d2e5-559a-4d2d-af5c-870aa627b348 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lazy-loading 'flavor' on Instance uuid ac840d9b-3179-4fcc-8d58-47094d6ad85c {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:26:13.267116 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-aa59d2e5-559a-4d2d-af5c-870aa627b348 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] HTTP exception thrown: Cannot 'rescue' instance ac840d9b-3179-4fcc-8d58-47094d6ad85c while it is in vm_state paused Jan 22 21:26:13.267805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aa59d2e5-559a-4d2d-af5c-870aa627b348 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Returning 409 to user: Cannot 'rescue' instance ac840d9b-3179-4fcc-8d58-47094d6ad85c while it is in vm_state paused {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:26:13.268930 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aa59d2e5-559a-4d2d-af5c-870aa627b348 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/action" status: 409 len: 144 microversion: 2.1 time: 0.061343 Jan 22 21:26:13.269829 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3745/7191] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:26:13 2022] POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/action => generated 144 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:26:13.284380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-596ed59e-04ff-483d-a52e-72c07d1d461b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:13.285038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-596ed59e-04ff-483d-a52e-72c07d1d461b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:13.294916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-596ed59e-04ff-483d-a52e-72c07d1d461b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:13.298590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-596ed59e-04ff-483d-a52e-72c07d1d461b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:13.298590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-596ed59e-04ff-483d-a52e-72c07d1d461b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:13.298590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-596ed59e-04ff-483d-a52e-72c07d1d461b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:13.548864 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-596ed59e-04ff-483d-a52e-72c07d1d461b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/action" status: 202 len: 0 microversion: 2.1 time: 0.269588 Jan 22 21:26:13.553318 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3447/7192] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:26:13 2022] POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:26:13.559133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9e1b45c8-dcb0-4ae8-a9e2-51b7b846b561 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:13.560029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9e1b45c8-dcb0-4ae8-a9e2-51b7b846b561 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:13.569380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e1b45c8-dcb0-4ae8-a9e2-51b7b846b561 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:13.572078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e1b45c8-dcb0-4ae8-a9e2-51b7b846b561 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:13.573151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e1b45c8-dcb0-4ae8-a9e2-51b7b846b561 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:13.573943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e1b45c8-dcb0-4ae8-a9e2-51b7b846b561 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:13.911209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9e1b45c8-dcb0-4ae8-a9e2-51b7b846b561 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:13.924453 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9e1b45c8-dcb0-4ae8-a9e2-51b7b846b561 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1511 microversion: 2.1 time: 0.369834 Jan 22 21:26:13.925057 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3746/7193] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:13 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:14.942953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fbc11f09-7bb0-4b43-92e1-2635e130b57b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:14.943714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fbc11f09-7bb0-4b43-92e1-2635e130b57b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:14.955603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbc11f09-7bb0-4b43-92e1-2635e130b57b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:14.956380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbc11f09-7bb0-4b43-92e1-2635e130b57b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:14.957373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbc11f09-7bb0-4b43-92e1-2635e130b57b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:14.958276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbc11f09-7bb0-4b43-92e1-2635e130b57b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:15.309111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fbc11f09-7bb0-4b43-92e1-2635e130b57b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:15.320406 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fbc11f09-7bb0-4b43-92e1-2635e130b57b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1519 microversion: 2.1 time: 0.381090 Jan 22 21:26:15.329594 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3448/7194] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:14 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1519 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:18.322997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-728cb398-b6e1-45ea-95cc-18066b6bd25d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:18.323984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-728cb398-b6e1-45ea-95cc-18066b6bd25d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:18.333494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-728cb398-b6e1-45ea-95cc-18066b6bd25d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:18.334359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-728cb398-b6e1-45ea-95cc-18066b6bd25d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:18.335170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-728cb398-b6e1-45ea-95cc-18066b6bd25d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:18.335685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-728cb398-b6e1-45ea-95cc-18066b6bd25d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:18.380739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-728cb398-b6e1-45ea-95cc-18066b6bd25d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lazy-loading 'flavor' on Instance uuid ac840d9b-3179-4fcc-8d58-47094d6ad85c {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:26:18.645088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6dfae5b7-c5b9-4331-b4d0-83e80552891a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:18.647045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6dfae5b7-c5b9-4331-b4d0-83e80552891a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:18.656748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6dfae5b7-c5b9-4331-b4d0-83e80552891a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:18.661739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6dfae5b7-c5b9-4331-b4d0-83e80552891a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:18.661739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6dfae5b7-c5b9-4331-b4d0-83e80552891a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:18.661739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6dfae5b7-c5b9-4331-b4d0-83e80552891a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:18.754496 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6dfae5b7-c5b9-4331-b4d0-83e80552891a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "POST /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124/action" status: 200 len: 24568 microversion: 2.1 time: 0.111855 Jan 22 21:26:18.755534 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3449/7195] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:26:18 2022] POST /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124/action => generated 24568 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:26:18.808457 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-728cb398-b6e1-45ea-95cc-18066b6bd25d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/action" status: 200 len: 32 microversion: 2.1 time: 0.494867 Jan 22 21:26:18.809213 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3747/7196] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:26:18 2022] POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/action => generated 32 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:26:18.819336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb499fed-0920-47f0-8d23-5ac688a0f024 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:18.820168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb499fed-0920-47f0-8d23-5ac688a0f024 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:18.831708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb499fed-0920-47f0-8d23-5ac688a0f024 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:18.834106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb499fed-0920-47f0-8d23-5ac688a0f024 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:18.839563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb499fed-0920-47f0-8d23-5ac688a0f024 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:18.839563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb499fed-0920-47f0-8d23-5ac688a0f024 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:19.236463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fb499fed-0920-47f0-8d23-5ac688a0f024 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:19.245532 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb499fed-0920-47f0-8d23-5ac688a0f024 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1525 microversion: 2.1 time: 0.430491 Jan 22 21:26:19.247123 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3450/7197] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:18 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1525 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:20.266155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-73e26696-9e64-4582-b28e-eedf5eb181c4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:20.266774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-73e26696-9e64-4582-b28e-eedf5eb181c4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:20.273121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73e26696-9e64-4582-b28e-eedf5eb181c4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:20.273717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73e26696-9e64-4582-b28e-eedf5eb181c4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:20.274520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73e26696-9e64-4582-b28e-eedf5eb181c4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:20.274967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73e26696-9e64-4582-b28e-eedf5eb181c4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:20.932155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-73e26696-9e64-4582-b28e-eedf5eb181c4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:20.958453 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-73e26696-9e64-4582-b28e-eedf5eb181c4 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1525 microversion: 2.1 time: 0.697209 Jan 22 21:26:20.961651 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3748/7198] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:20 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1525 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:21.977009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-22ac3c57-03ae-4568-a1c6-9286898c1174 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:21.978279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-22ac3c57-03ae-4568-a1c6-9286898c1174 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:21.986509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22ac3c57-03ae-4568-a1c6-9286898c1174 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:21.989212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22ac3c57-03ae-4568-a1c6-9286898c1174 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:21.989212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22ac3c57-03ae-4568-a1c6-9286898c1174 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:21.989212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22ac3c57-03ae-4568-a1c6-9286898c1174 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:22.307680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-22ac3c57-03ae-4568-a1c6-9286898c1174 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:22.320438 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-22ac3c57-03ae-4568-a1c6-9286898c1174 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1525 microversion: 2.1 time: 0.347246 Jan 22 21:26:22.323721 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3451/7199] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:21 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1525 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:23.361851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ed3aa0b8-b52e-4de2-ab2d-edf848b647cf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:23.364101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ed3aa0b8-b52e-4de2-ab2d-edf848b647cf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:23.400134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed3aa0b8-b52e-4de2-ab2d-edf848b647cf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:23.400844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed3aa0b8-b52e-4de2-ab2d-edf848b647cf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:23.401998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed3aa0b8-b52e-4de2-ab2d-edf848b647cf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:23.402461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed3aa0b8-b52e-4de2-ab2d-edf848b647cf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:23.834332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed3aa0b8-b52e-4de2-ab2d-edf848b647cf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:23.844146 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ed3aa0b8-b52e-4de2-ab2d-edf848b647cf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1525 microversion: 2.1 time: 0.506253 Jan 22 21:26:23.849684 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3749/7200] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:23 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1525 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:24.867731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc8cd15f-aa56-442e-b57f-98a6da74a713 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:24.868464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bc8cd15f-aa56-442e-b57f-98a6da74a713 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:24.877244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc8cd15f-aa56-442e-b57f-98a6da74a713 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:24.878202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc8cd15f-aa56-442e-b57f-98a6da74a713 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:24.879065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc8cd15f-aa56-442e-b57f-98a6da74a713 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:24.880650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc8cd15f-aa56-442e-b57f-98a6da74a713 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:25.532809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bc8cd15f-aa56-442e-b57f-98a6da74a713 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:25.544342 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bc8cd15f-aa56-442e-b57f-98a6da74a713 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1525 microversion: 2.1 time: 0.679640 Jan 22 21:26:25.546380 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3452/7201] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:24 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1525 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:26.563977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c44cb49a-b3b2-4424-8b8e-f9082176cb8d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:26.564588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c44cb49a-b3b2-4424-8b8e-f9082176cb8d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:26.572462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c44cb49a-b3b2-4424-8b8e-f9082176cb8d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:26.572925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c44cb49a-b3b2-4424-8b8e-f9082176cb8d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:26.573743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c44cb49a-b3b2-4424-8b8e-f9082176cb8d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:26.574192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c44cb49a-b3b2-4424-8b8e-f9082176cb8d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:26.759185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c44cb49a-b3b2-4424-8b8e-f9082176cb8d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:26.774449 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c44cb49a-b3b2-4424-8b8e-f9082176cb8d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1525 microversion: 2.1 time: 0.209094 Jan 22 21:26:26.775533 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3750/7202] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:26 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1525 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:27.805053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d5c9a365-c661-49de-bd5a-186b3372b863 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:27.806344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d5c9a365-c661-49de-bd5a-186b3372b863 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:27.820552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5c9a365-c661-49de-bd5a-186b3372b863 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:27.821358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5c9a365-c661-49de-bd5a-186b3372b863 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:27.822598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5c9a365-c661-49de-bd5a-186b3372b863 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:27.823301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5c9a365-c661-49de-bd5a-186b3372b863 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:28.095855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d5c9a365-c661-49de-bd5a-186b3372b863 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:28.113539 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d5c9a365-c661-49de-bd5a-186b3372b863 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1525 microversion: 2.1 time: 0.312817 Jan 22 21:26:28.113539 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3453/7203] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:27 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1525 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:29.130622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a00c3ecd-fa68-453d-b7cb-a19f978ae38a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:29.131248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a00c3ecd-fa68-453d-b7cb-a19f978ae38a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:29.157925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a00c3ecd-fa68-453d-b7cb-a19f978ae38a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:29.158625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a00c3ecd-fa68-453d-b7cb-a19f978ae38a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:29.161306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a00c3ecd-fa68-453d-b7cb-a19f978ae38a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:29.162013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a00c3ecd-fa68-453d-b7cb-a19f978ae38a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:29.456280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a00c3ecd-fa68-453d-b7cb-a19f978ae38a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:29.470059 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a00c3ecd-fa68-453d-b7cb-a19f978ae38a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1505 microversion: 2.1 time: 0.342148 Jan 22 21:26:29.471510 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3751/7204] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:29 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1505 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:29.488194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2a965e3d-ed5b-40d3-a7a2-64d0e5a9f90b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c76dc115-8684-4473-93fe-2951f4784073"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:29.490896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2a965e3d-ed5b-40d3-a7a2-64d0e5a9f90b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:29.499542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a965e3d-ed5b-40d3-a7a2-64d0e5a9f90b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:29.501704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a965e3d-ed5b-40d3-a7a2-64d0e5a9f90b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:29.505867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a965e3d-ed5b-40d3-a7a2-64d0e5a9f90b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:29.506289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a965e3d-ed5b-40d3-a7a2-64d0e5a9f90b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:29.533902 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-2a965e3d-ed5b-40d3-a7a2-64d0e5a9f90b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] HTTP exception thrown: Cannot 'attach_volume' instance ac840d9b-3179-4fcc-8d58-47094d6ad85c while it is in vm_state rescued Jan 22 21:26:29.535444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2a965e3d-ed5b-40d3-a7a2-64d0e5a9f90b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Returning 409 to user: Cannot 'attach_volume' instance ac840d9b-3179-4fcc-8d58-47094d6ad85c while it is in vm_state rescued {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:26:29.536287 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2a965e3d-ed5b-40d3-a7a2-64d0e5a9f90b tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052778 Jan 22 21:26:29.536857 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3454/7205] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:26:29 2022] POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 22 21:26:29.546104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-63787df5-e12c-42a8-b3ee-eff8ae6f18d9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:29.547121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-63787df5-e12c-42a8-b3ee-eff8ae6f18d9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:29.554223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63787df5-e12c-42a8-b3ee-eff8ae6f18d9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:29.558929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63787df5-e12c-42a8-b3ee-eff8ae6f18d9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:29.558929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63787df5-e12c-42a8-b3ee-eff8ae6f18d9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:29.558929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63787df5-e12c-42a8-b3ee-eff8ae6f18d9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:29.780365 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-63787df5-e12c-42a8-b3ee-eff8ae6f18d9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/action" status: 202 len: 0 microversion: 2.1 time: 0.237676 Jan 22 21:26:29.781470 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3752/7206] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:26:29 2022] POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:26:29.792379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-381b7838-1dd1-484c-889a-9146716df1cd tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:29.796349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-381b7838-1dd1-484c-889a-9146716df1cd tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:29.806186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-381b7838-1dd1-484c-889a-9146716df1cd tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:29.806913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-381b7838-1dd1-484c-889a-9146716df1cd tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:29.821248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-381b7838-1dd1-484c-889a-9146716df1cd tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:29.821753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-381b7838-1dd1-484c-889a-9146716df1cd tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:30.236182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-381b7838-1dd1-484c-889a-9146716df1cd tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:30.248800 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-381b7838-1dd1-484c-889a-9146716df1cd tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1513 microversion: 2.1 time: 0.463015 Jan 22 21:26:30.254667 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3455/7207] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:29 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1513 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:30.417734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4bab1b0e-ae79-4c0b-a218-293480a878a9 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:30.418834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4bab1b0e-ae79-4c0b-a218-293480a878a9 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:30.425259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bab1b0e-ae79-4c0b-a218-293480a878a9 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:30.425837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bab1b0e-ae79-4c0b-a218-293480a878a9 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:30.426724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bab1b0e-ae79-4c0b-a218-293480a878a9 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:30.427245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bab1b0e-ae79-4c0b-a218-293480a878a9 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:30.486150 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4bab1b0e-ae79-4c0b-a218-293480a878a9 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "POST /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde/action" status: 200 len: 24575 microversion: 2.1 time: 0.073802 Jan 22 21:26:30.488738 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3753/7208] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:26:30 2022] POST /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde/action => generated 24575 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:26:31.277356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-57b041b4-4987-40ee-924c-325631499a35 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:31.278807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-57b041b4-4987-40ee-924c-325631499a35 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:31.287715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57b041b4-4987-40ee-924c-325631499a35 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:31.288578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57b041b4-4987-40ee-924c-325631499a35 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:31.289698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57b041b4-4987-40ee-924c-325631499a35 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:31.295746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57b041b4-4987-40ee-924c-325631499a35 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:31.960675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-57b041b4-4987-40ee-924c-325631499a35 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:31.970031 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-57b041b4-4987-40ee-924c-325631499a35 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1513 microversion: 2.1 time: 0.705159 Jan 22 21:26:31.971240 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3456/7209] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:31 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1513 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:32.317173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-688f821a-1cb2-436d-bb1a-d6481abed3ba tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:32.318611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-688f821a-1cb2-436d-bb1a-d6481abed3ba tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:32.331642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-8387145a-5423-4437-a995-834e341431d7 req-ce95839a-5a0d-4935-a1d6-af2fb67b0af0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dcb1d75-21c2-47b6-9ad6-02833e78b124", "tag": "68be209a-849c-46f1-a4f3-5b720fb720ac"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:32.333098 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:26:32.333098 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:26:32.349228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-688f821a-1cb2-436d-bb1a-d6481abed3ba tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:32.349725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-688f821a-1cb2-436d-bb1a-d6481abed3ba tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:32.354133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-688f821a-1cb2-436d-bb1a-d6481abed3ba tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:32.354133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-688f821a-1cb2-436d-bb1a-d6481abed3ba tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:32.363574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8387145a-5423-4437-a995-834e341431d7 req-ce95839a-5a0d-4935-a1d6-af2fb67b0af0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:32.364029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8387145a-5423-4437-a995-834e341431d7 req-ce95839a-5a0d-4935-a1d6-af2fb67b0af0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:32.404620 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8387145a-5423-4437-a995-834e341431d7 req-ce95839a-5a0d-4935-a1d6-af2fb67b0af0 service nova] Creating event network-changed:68be209a-849c-46f1-a4f3-5b720fb720ac for instance 8dcb1d75-21c2-47b6-9ad6-02833e78b124 on nch1-master-1 Jan 22 21:26:32.419236 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-8387145a-5423-4437-a995-834e341431d7 req-ce95839a-5a0d-4935-a1d6-af2fb67b0af0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091186 Jan 22 21:26:32.423134 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3457/7210] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:26:32.460372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-688f821a-1cb2-436d-bb1a-d6481abed3ba tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:26:32.810020 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-688f821a-1cb2-436d-bb1a-d6481abed3ba tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 204 len: 0 microversion: 2.1 time: 0.501232 Jan 22 21:26:32.811261 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3754/7211] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:26:32 2022] DELETE /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:26:32.823056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f865856c-a0cd-44f4-9efd-b34bdde3ee3d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:32.825543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f865856c-a0cd-44f4-9efd-b34bdde3ee3d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:32.867651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f865856c-a0cd-44f4-9efd-b34bdde3ee3d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:32.870145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f865856c-a0cd-44f4-9efd-b34bdde3ee3d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:32.873025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f865856c-a0cd-44f4-9efd-b34bdde3ee3d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:32.874190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f865856c-a0cd-44f4-9efd-b34bdde3ee3d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:32.989964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b1620376-a0ab-4b8a-aee2-ff127529fdf2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:32.990886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b1620376-a0ab-4b8a-aee2-ff127529fdf2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:32.999445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1620376-a0ab-4b8a-aee2-ff127529fdf2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:33.000298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1620376-a0ab-4b8a-aee2-ff127529fdf2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:33.002246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1620376-a0ab-4b8a-aee2-ff127529fdf2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:33.002955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1620376-a0ab-4b8a-aee2-ff127529fdf2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:33.371006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b1620376-a0ab-4b8a-aee2-ff127529fdf2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:33.371006 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b1620376-a0ab-4b8a-aee2-ff127529fdf2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1513 microversion: 2.1 time: 0.378265 Jan 22 21:26:33.372117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f865856c-a0cd-44f4-9efd-b34bdde3ee3d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:33.375178 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3755/7212] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:32 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1513 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:33.386190 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f865856c-a0cd-44f4-9efd-b34bdde3ee3d tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1689 microversion: 2.1 time: 0.570086 Jan 22 21:26:33.390308 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3458/7213] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:32 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1689 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:34.380051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-52d0a4c2-07c3-4bf1-9bdd-ca471765767d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:34.381342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-52d0a4c2-07c3-4bf1-9bdd-ca471765767d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:34.390379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52d0a4c2-07c3-4bf1-9bdd-ca471765767d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:34.391185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52d0a4c2-07c3-4bf1-9bdd-ca471765767d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:34.392518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52d0a4c2-07c3-4bf1-9bdd-ca471765767d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:34.393208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52d0a4c2-07c3-4bf1-9bdd-ca471765767d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:34.404011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d7f1aa51-b515-4596-abd3-e70c842860ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:34.404784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d7f1aa51-b515-4596-abd3-e70c842860ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:34.421626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7f1aa51-b515-4596-abd3-e70c842860ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:34.426904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7f1aa51-b515-4596-abd3-e70c842860ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:34.426904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7f1aa51-b515-4596-abd3-e70c842860ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:34.426904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7f1aa51-b515-4596-abd3-e70c842860ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:34.745642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-52d0a4c2-07c3-4bf1-9bdd-ca471765767d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:34.754089 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-52d0a4c2-07c3-4bf1-9bdd-ca471765767d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1519 microversion: 2.1 time: 0.377763 Jan 22 21:26:34.757584 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3756/7214] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:34 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1519 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:34.937925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d7f1aa51-b515-4596-abd3-e70c842860ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:34.948528 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d7f1aa51-b515-4596-abd3-e70c842860ee tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1571 microversion: 2.1 time: 0.548187 Jan 22 21:26:34.958857 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3459/7215] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:34 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1571 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:26:35.732823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-ef1a4f70-c058-4fe4-804d-6a07dc182dcc req-d7f54b17-b201-4057-b7c4-179168bee284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dcb1d75-21c2-47b6-9ad6-02833e78b124", "name": "network-vif-deleted", "tag": "68be209a-849c-46f1-a4f3-5b720fb720ac"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:35.747206 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:26:35.747206 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:26:35.764254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ef1a4f70-c058-4fe4-804d-6a07dc182dcc req-d7f54b17-b201-4057-b7c4-179168bee284 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:35.765905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ef1a4f70-c058-4fe4-804d-6a07dc182dcc req-d7f54b17-b201-4057-b7c4-179168bee284 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:35.777775 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-ef1a4f70-c058-4fe4-804d-6a07dc182dcc req-d7f54b17-b201-4057-b7c4-179168bee284 service nova] Creating event network-vif-deleted:68be209a-849c-46f1-a4f3-5b720fb720ac for instance 8dcb1d75-21c2-47b6-9ad6-02833e78b124 on nch1-master-1 Jan 22 21:26:35.782808 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-ef1a4f70-c058-4fe4-804d-6a07dc182dcc req-d7f54b17-b201-4057-b7c4-179168bee284 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053766 Jan 22 21:26:35.783428 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3757/7216] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:26:35.967272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-760fff3d-ff3a-435a-b690-0e88b0068b1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:35.967901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-760fff3d-ff3a-435a-b690-0e88b0068b1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:35.982137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-760fff3d-ff3a-435a-b690-0e88b0068b1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:35.982616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-760fff3d-ff3a-435a-b690-0e88b0068b1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:35.983450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-760fff3d-ff3a-435a-b690-0e88b0068b1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:35.983899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-760fff3d-ff3a-435a-b690-0e88b0068b1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:36.180794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-760fff3d-ff3a-435a-b690-0e88b0068b1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80aa2e03fde44436844a88a0ccc5d6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a02dd0e2564b41e3b5800b144a1ed831', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:36.190480 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-760fff3d-ff3a-435a-b690-0e88b0068b1a tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 200 len: 1354 microversion: 2.1 time: 0.226903 Jan 22 21:26:36.203460 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3460/7217] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:35 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 1354 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:37.208368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb08c5fa-4eed-4280-a173-9834791899c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:37.209075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fb08c5fa-4eed-4280-a173-9834791899c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] [instance: 8dcb1d75-21c2-47b6-9ad6-02833e78b124] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:37.219170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb08c5fa-4eed-4280-a173-9834791899c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:37.219643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb08c5fa-4eed-4280-a173-9834791899c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:37.220461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb08c5fa-4eed-4280-a173-9834791899c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:37.222874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb08c5fa-4eed-4280-a173-9834791899c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:37.251523 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-fb08c5fa-4eed-4280-a173-9834791899c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] HTTP exception thrown: Instance 8dcb1d75-21c2-47b6-9ad6-02833e78b124 could not be found. Jan 22 21:26:37.252063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb08c5fa-4eed-4280-a173-9834791899c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Returning 404 to user: Instance 8dcb1d75-21c2-47b6-9ad6-02833e78b124 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:26:37.252931 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fb08c5fa-4eed-4280-a173-9834791899c8 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124" status: 404 len: 111 microversion: 2.1 time: 0.048593 Jan 22 21:26:37.255601 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3758/7218] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:37 2022] GET /compute/v2.1/servers/8dcb1d75-21c2-47b6-9ad6-02833e78b124 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:26:37.596340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6204c01b-a510-42db-b746-3e37f2bdcee2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:37.597599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6204c01b-a510-42db-b746-3e37f2bdcee2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:37.606970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6204c01b-a510-42db-b746-3e37f2bdcee2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:37.607635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6204c01b-a510-42db-b746-3e37f2bdcee2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:37.608641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6204c01b-a510-42db-b746-3e37f2bdcee2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:37.609260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6204c01b-a510-42db-b746-3e37f2bdcee2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:37.903467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6204c01b-a510-42db-b746-3e37f2bdcee2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:37.925545 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6204c01b-a510-42db-b746-3e37f2bdcee2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1519 microversion: 2.1 time: 0.333637 Jan 22 21:26:37.929687 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3461/7219] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:37 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1519 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:37.947694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-24aea8a8-eb13-4101-8803-195274abda25 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95aa6904-b117-424d-b97b-91744fe32d8a"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:37.949071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-24aea8a8-eb13-4101-8803-195274abda25 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:37.955576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24aea8a8-eb13-4101-8803-195274abda25 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:37.956356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24aea8a8-eb13-4101-8803-195274abda25 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:37.957676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24aea8a8-eb13-4101-8803-195274abda25 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:37.958300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-24aea8a8-eb13-4101-8803-195274abda25 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:38.997077 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-24aea8a8-eb13-4101-8803-195274abda25 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.053795 Jan 22 21:26:39.002790 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3759/7220] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:26:37 2022] POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/os-volume_attachments => generated 194 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:26:43.810261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-98f8a181-da89-4286-b31f-095de81fa254 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] Calling method '.version_select at 0x7f1ed4ee4f70>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:44.007818 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-98f8a181-da89-4286-b31f-095de81fa254 tempest-TestNetworkAdvancedServerOps-26034949 tempest-TestNetworkAdvancedServerOps-26034949-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-270184739" status: 202 len: 0 microversion: 2.1 time: 0.201409 Jan 22 21:26:44.015676 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3462/7221] 10.222.0.100 () {58 vars in 1285 bytes} [Sat Jan 22 21:26:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-270184739 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:26:44.625572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2d29ce19-86c3-41ca-a939-b90fa90ba1da tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:44.627763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2d29ce19-86c3-41ca-a939-b90fa90ba1da tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:44.642266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d29ce19-86c3-41ca-a939-b90fa90ba1da tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:44.642266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d29ce19-86c3-41ca-a939-b90fa90ba1da tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:44.642266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d29ce19-86c3-41ca-a939-b90fa90ba1da tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:44.642572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d29ce19-86c3-41ca-a939-b90fa90ba1da tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:44.674152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-2d29ce19-86c3-41ca-a939-b90fa90ba1da tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lazy-loading 'flavor' on Instance uuid ac840d9b-3179-4fcc-8d58-47094d6ad85c {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:26:45.164646 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2d29ce19-86c3-41ca-a939-b90fa90ba1da tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/action" status: 200 len: 32 microversion: 2.1 time: 0.552225 Jan 22 21:26:45.165294 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3760/7222] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:26:44 2022] POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/action => generated 32 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:26:45.176574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-368306e4-1a79-4daf-9e2a-0a0215cba8f0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:45.177904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-368306e4-1a79-4daf-9e2a-0a0215cba8f0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:45.192327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-368306e4-1a79-4daf-9e2a-0a0215cba8f0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:45.194471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-368306e4-1a79-4daf-9e2a-0a0215cba8f0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:45.198701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-368306e4-1a79-4daf-9e2a-0a0215cba8f0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:45.199171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-368306e4-1a79-4daf-9e2a-0a0215cba8f0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:45.560513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-368306e4-1a79-4daf-9e2a-0a0215cba8f0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:45.571769 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-368306e4-1a79-4daf-9e2a-0a0215cba8f0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1571 microversion: 2.1 time: 0.397996 Jan 22 21:26:45.579727 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3463/7223] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:45 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1571 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:46.595409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-48ae988e-3195-4775-b100-f2c4dded0577 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:46.596127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-48ae988e-3195-4775-b100-f2c4dded0577 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:46.620911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48ae988e-3195-4775-b100-f2c4dded0577 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:46.621407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48ae988e-3195-4775-b100-f2c4dded0577 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:46.622426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48ae988e-3195-4775-b100-f2c4dded0577 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:46.622739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-48ae988e-3195-4775-b100-f2c4dded0577 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:47.191367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-48ae988e-3195-4775-b100-f2c4dded0577 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:47.207032 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-48ae988e-3195-4775-b100-f2c4dded0577 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1571 microversion: 2.1 time: 0.616466 Jan 22 21:26:47.207884 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3761/7224] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:46 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1571 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:48.224002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c9d000d6-90ca-4e1c-8cf9-367734d4eedf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:48.224628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c9d000d6-90ca-4e1c-8cf9-367734d4eedf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:48.243748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9d000d6-90ca-4e1c-8cf9-367734d4eedf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:48.244216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9d000d6-90ca-4e1c-8cf9-367734d4eedf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:48.245045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9d000d6-90ca-4e1c-8cf9-367734d4eedf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:48.245514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9d000d6-90ca-4e1c-8cf9-367734d4eedf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:48.662120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c9d000d6-90ca-4e1c-8cf9-367734d4eedf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:48.696665 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c9d000d6-90ca-4e1c-8cf9-367734d4eedf tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1571 microversion: 2.1 time: 0.460433 Jan 22 21:26:48.699380 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3464/7225] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:48 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1571 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:49.524162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d23c2cb1-9bac-4bfb-b4b9-d4bb5f70c6d8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Action: 'create', calling method: .version_select at 0x7f1ed6382700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1592314114"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:49.565490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-d23c2cb1-9bac-4bfb-b4b9-d4bb5f70c6d8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:26:49.584919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-d23c2cb1-9bac-4bfb-b4b9-d4bb5f70c6d8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for user f84a5c446f01456e991f940f550199e5 and project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:26:49.715113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-42a3b4c3-2ec0-4102-bc17-1bc80ba52430 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:49.716282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-42a3b4c3-2ec0-4102-bc17-1bc80ba52430 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:49.727832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42a3b4c3-2ec0-4102-bc17-1bc80ba52430 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:49.728531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42a3b4c3-2ec0-4102-bc17-1bc80ba52430 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:49.731576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42a3b4c3-2ec0-4102-bc17-1bc80ba52430 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:49.733207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42a3b4c3-2ec0-4102-bc17-1bc80ba52430 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:49.991313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-d23c2cb1-9bac-4bfb-b4b9-d4bb5f70c6d8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:26:49.999568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-d23c2cb1-9bac-4bfb-b4b9-d4bb5f70c6d8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for user f84a5c446f01456e991f940f550199e5 and project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:26:50.039279 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d23c2cb1-9bac-4bfb-b4b9-d4bb5f70c6d8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.520009 Jan 22 21:26:50.039910 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3762/7226] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:26:49 2022] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:50.282265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-42a3b4c3-2ec0-4102-bc17-1bc80ba52430 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:50.296145 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-42a3b4c3-2ec0-4102-bc17-1bc80ba52430 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1571 microversion: 2.1 time: 0.584357 Jan 22 21:26:50.297303 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3465/7227] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:49 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1571 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:51.315010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-20ef0368-39d6-4cf3-89b1-eb749411fe0f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:51.316354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-20ef0368-39d6-4cf3-89b1-eb749411fe0f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:51.330810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20ef0368-39d6-4cf3-89b1-eb749411fe0f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:51.331776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20ef0368-39d6-4cf3-89b1-eb749411fe0f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:51.338568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20ef0368-39d6-4cf3-89b1-eb749411fe0f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:51.339055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20ef0368-39d6-4cf3-89b1-eb749411fe0f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:51.924518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-20ef0368-39d6-4cf3-89b1-eb749411fe0f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:51.933618 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-20ef0368-39d6-4cf3-89b1-eb749411fe0f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1571 microversion: 2.1 time: 0.622299 Jan 22 21:26:51.938735 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3763/7228] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:51 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1571 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:52.960521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-893820f2-5c1b-4581-bfd4-cfb986512272 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:52.962737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-893820f2-5c1b-4581-bfd4-cfb986512272 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:52.976017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-893820f2-5c1b-4581-bfd4-cfb986512272 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:52.977397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-893820f2-5c1b-4581-bfd4-cfb986512272 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:52.981173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-893820f2-5c1b-4581-bfd4-cfb986512272 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:52.985010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-893820f2-5c1b-4581-bfd4-cfb986512272 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:53.427058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-893820f2-5c1b-4581-bfd4-cfb986512272 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:53.438338 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-893820f2-5c1b-4581-bfd4-cfb986512272 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1571 microversion: 2.1 time: 0.485181 Jan 22 21:26:53.439266 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3466/7229] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:52 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1571 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:54.475577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bee7b7ad-37f1-41cc-b1eb-59aaff8f273e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:54.477206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bee7b7ad-37f1-41cc-b1eb-59aaff8f273e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:54.486951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bee7b7ad-37f1-41cc-b1eb-59aaff8f273e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:54.487796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bee7b7ad-37f1-41cc-b1eb-59aaff8f273e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:54.489350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bee7b7ad-37f1-41cc-b1eb-59aaff8f273e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:54.493156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bee7b7ad-37f1-41cc-b1eb-59aaff8f273e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:54.842987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bee7b7ad-37f1-41cc-b1eb-59aaff8f273e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:54.853838 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bee7b7ad-37f1-41cc-b1eb-59aaff8f273e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1571 microversion: 2.1 time: 0.401406 Jan 22 21:26:54.854769 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3764/7230] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:54 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1571 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:55.872042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e1982ced-bc87-4c36-a7ce-be96f253d3fc tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:55.872812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e1982ced-bc87-4c36-a7ce-be96f253d3fc tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:55.883873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1982ced-bc87-4c36-a7ce-be96f253d3fc tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:55.887188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1982ced-bc87-4c36-a7ce-be96f253d3fc tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:55.889731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1982ced-bc87-4c36-a7ce-be96f253d3fc tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:55.889731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1982ced-bc87-4c36-a7ce-be96f253d3fc tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:56.483713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-107923879", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "1d6c3f8b-691f-44dd-adb8-8fd886bae2da"}], "key_name": "tempest-TestNetworkBasicOps-1592314114", "security_groups": [{"name": "tempest-secgroup-smoke-1354512036"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:26:56.705490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e1982ced-bc87-4c36-a7ce-be96f253d3fc tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:56.730695 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e1982ced-bc87-4c36-a7ce-be96f253d3fc tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1571 microversion: 2.1 time: 0.859424 Jan 22 21:26:56.731642 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3467/7231] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:55 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1571 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:56.898610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] validate_networks() for [('1d6c3f8b-691f-44dd-adb8-8fd886bae2da', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:26:57.628387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:26:57.630113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:26:57.632572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:26:57.633333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:26:57.635802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:26:57.650535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:57.652049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:57.652919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:57.653640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:57.676046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:26:57.683073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for user f84a5c446f01456e991f940f550199e5 and project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:26:57.702357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:26:57.706297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:26:57.751708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4e7f8935-366f-4aa8-94ed-ce2507d11a0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:57.751708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4e7f8935-366f-4aa8-94ed-ce2507d11a0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:57.769340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e7f8935-366f-4aa8-94ed-ce2507d11a0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:57.775294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e7f8935-366f-4aa8-94ed-ce2507d11a0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:57.775294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e7f8935-366f-4aa8-94ed-ce2507d11a0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:57.775294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e7f8935-366f-4aa8-94ed-ce2507d11a0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:57.836778 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d96bd4e8-ac7b-4847-b89c-a0c85a9711a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.358015 Jan 22 21:26:57.837468 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3765/7232] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:26:56 2022] POST /compute/v2.1/servers => generated 408 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:26:57.848972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1272ff6b-eb2c-4d65-877d-5351b3bfda89 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:57.851004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1272ff6b-eb2c-4d65-877d-5351b3bfda89 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:57.968406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1272ff6b-eb2c-4d65-877d-5351b3bfda89 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:57.981102 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1272ff6b-eb2c-4d65-877d-5351b3bfda89 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1252 microversion: 2.1 time: 0.135703 Jan 22 21:26:57.985828 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3766/7233] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:57 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1252 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:58.296630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4e7f8935-366f-4aa8-94ed-ce2507d11a0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:58.322265 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4e7f8935-366f-4aa8-94ed-ce2507d11a0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1571 microversion: 2.1 time: 0.576954 Jan 22 21:26:58.327465 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3468/7234] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:57 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1571 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:26:59.016049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9e4f5dbe-3a6a-4a47-b72b-2c46424182f5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:59.017430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9e4f5dbe-3a6a-4a47-b72b-2c46424182f5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:59.175868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9e4f5dbe-3a6a-4a47-b72b-2c46424182f5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:59.207951 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9e4f5dbe-3a6a-4a47-b72b-2c46424182f5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1252 microversion: 2.1 time: 0.201177 Jan 22 21:26:59.221646 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3767/7235] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:59 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1252 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:26:59.344522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f1c49a74-9ac7-435d-8c8e-fbafa65ec7c2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:26:59.345188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f1c49a74-9ac7-435d-8c8e-fbafa65ec7c2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:26:59.359812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1c49a74-9ac7-435d-8c8e-fbafa65ec7c2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:59.361536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1c49a74-9ac7-435d-8c8e-fbafa65ec7c2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:59.363449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1c49a74-9ac7-435d-8c8e-fbafa65ec7c2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:26:59.365407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1c49a74-9ac7-435d-8c8e-fbafa65ec7c2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:26:59.758726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f1c49a74-9ac7-435d-8c8e-fbafa65ec7c2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:26:59.773323 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f1c49a74-9ac7-435d-8c8e-fbafa65ec7c2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1571 microversion: 2.1 time: 0.432611 Jan 22 21:26:59.775568 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3469/7236] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:26:59 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1571 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:00.239517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dd7ad735-14d7-4322-a5ea-7b9b7c2800ea tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:00.241126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dd7ad735-14d7-4322-a5ea-7b9b7c2800ea tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:00.259505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd7ad735-14d7-4322-a5ea-7b9b7c2800ea tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:00.259960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd7ad735-14d7-4322-a5ea-7b9b7c2800ea tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:00.261440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd7ad735-14d7-4322-a5ea-7b9b7c2800ea tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:00.261928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd7ad735-14d7-4322-a5ea-7b9b7c2800ea tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:00.343340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dd7ad735-14d7-4322-a5ea-7b9b7c2800ea tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:00.352539 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dd7ad735-14d7-4322-a5ea-7b9b7c2800ea tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1304 microversion: 2.1 time: 0.126920 Jan 22 21:27:00.354599 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3768/7237] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:00 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:00.793194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-caea9600-8fb4-4fa4-8b46-20e6b3baa30d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:00.793883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-caea9600-8fb4-4fa4-8b46-20e6b3baa30d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:00.801945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-caea9600-8fb4-4fa4-8b46-20e6b3baa30d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:00.803373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-caea9600-8fb4-4fa4-8b46-20e6b3baa30d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:00.804539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-caea9600-8fb4-4fa4-8b46-20e6b3baa30d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:00.805157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-caea9600-8fb4-4fa4-8b46-20e6b3baa30d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:01.354523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-caea9600-8fb4-4fa4-8b46-20e6b3baa30d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:01.377645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e1df716e-60ea-441d-930a-1118bbb110b4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:01.378272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e1df716e-60ea-441d-930a-1118bbb110b4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:01.399343 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-caea9600-8fb4-4fa4-8b46-20e6b3baa30d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1571 microversion: 2.1 time: 0.611600 Jan 22 21:27:01.400839 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3470/7238] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:00 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1571 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:01.406876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1df716e-60ea-441d-930a-1118bbb110b4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:01.415144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1df716e-60ea-441d-930a-1118bbb110b4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:01.415144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1df716e-60ea-441d-930a-1118bbb110b4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:01.415144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1df716e-60ea-441d-930a-1118bbb110b4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:01.524836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e1df716e-60ea-441d-930a-1118bbb110b4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:01.533951 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e1df716e-60ea-441d-930a-1118bbb110b4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1310 microversion: 2.1 time: 0.159990 Jan 22 21:27:01.536227 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3769/7239] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:01 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1310 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:02.416988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2cc122ba-ebeb-40db-a99b-9d0be79b215d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:02.417466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2cc122ba-ebeb-40db-a99b-9d0be79b215d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:02.433125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cc122ba-ebeb-40db-a99b-9d0be79b215d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:02.433637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cc122ba-ebeb-40db-a99b-9d0be79b215d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:02.435193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cc122ba-ebeb-40db-a99b-9d0be79b215d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:02.435806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cc122ba-ebeb-40db-a99b-9d0be79b215d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:02.555650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a0a9f058-0ca8-4d39-9302-bc03400e00f5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:02.556832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a0a9f058-0ca8-4d39-9302-bc03400e00f5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:02.572112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0a9f058-0ca8-4d39-9302-bc03400e00f5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:02.574115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0a9f058-0ca8-4d39-9302-bc03400e00f5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:02.575136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0a9f058-0ca8-4d39-9302-bc03400e00f5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:02.575592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0a9f058-0ca8-4d39-9302-bc03400e00f5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:02.985446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a0a9f058-0ca8-4d39-9302-bc03400e00f5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:02.997723 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a0a9f058-0ca8-4d39-9302-bc03400e00f5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1310 microversion: 2.1 time: 0.447716 Jan 22 21:27:03.004487 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3770/7240] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:02 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1310 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:03.585767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2cc122ba-ebeb-40db-a99b-9d0be79b215d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:03.600812 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2cc122ba-ebeb-40db-a99b-9d0be79b215d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1571 microversion: 2.1 time: 1.187770 Jan 22 21:27:03.610453 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3471/7241] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:02 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1571 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:27:04.017109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f8ffb7d9-2789-449f-82cc-2debb96c5bdc tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:04.019115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f8ffb7d9-2789-449f-82cc-2debb96c5bdc tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:04.032302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f8ffb7d9-2789-449f-82cc-2debb96c5bdc tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:04.033130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f8ffb7d9-2789-449f-82cc-2debb96c5bdc tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:04.034425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f8ffb7d9-2789-449f-82cc-2debb96c5bdc tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:04.035929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f8ffb7d9-2789-449f-82cc-2debb96c5bdc tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:04.395166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f8ffb7d9-2789-449f-82cc-2debb96c5bdc tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:04.410726 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f8ffb7d9-2789-449f-82cc-2debb96c5bdc tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1378 microversion: 2.1 time: 0.399122 Jan 22 21:27:04.411691 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3771/7242] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:04 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1378 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:04.617747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-adb770c3-478a-4a41-b9b8-6f89b50eb8d1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:04.618544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-adb770c3-478a-4a41-b9b8-6f89b50eb8d1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:04.627866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adb770c3-478a-4a41-b9b8-6f89b50eb8d1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:04.632322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adb770c3-478a-4a41-b9b8-6f89b50eb8d1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:04.633288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adb770c3-478a-4a41-b9b8-6f89b50eb8d1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:04.634380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adb770c3-478a-4a41-b9b8-6f89b50eb8d1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:05.246767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-adb770c3-478a-4a41-b9b8-6f89b50eb8d1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:05.258891 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-adb770c3-478a-4a41-b9b8-6f89b50eb8d1 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1571 microversion: 2.1 time: 0.645518 Jan 22 21:27:05.259666 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3472/7243] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:04 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1571 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:05.428951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-42e0ce91-3cf5-430c-88ab-7481812adff5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:05.429680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-42e0ce91-3cf5-430c-88ab-7481812adff5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:05.445257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42e0ce91-3cf5-430c-88ab-7481812adff5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:05.445872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42e0ce91-3cf5-430c-88ab-7481812adff5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:05.446721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42e0ce91-3cf5-430c-88ab-7481812adff5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:05.447173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42e0ce91-3cf5-430c-88ab-7481812adff5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:06.012236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-42e0ce91-3cf5-430c-88ab-7481812adff5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:06.029907 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-42e0ce91-3cf5-430c-88ab-7481812adff5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1378 microversion: 2.1 time: 0.603141 Jan 22 21:27:06.029907 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3772/7244] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:05 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1378 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:06.283255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a4f20fdb-219c-4212-845f-37c7a951b32e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:06.283972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a4f20fdb-219c-4212-845f-37c7a951b32e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:06.312449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4f20fdb-219c-4212-845f-37c7a951b32e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:06.313139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4f20fdb-219c-4212-845f-37c7a951b32e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:06.319373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4f20fdb-219c-4212-845f-37c7a951b32e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:06.321632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4f20fdb-219c-4212-845f-37c7a951b32e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:06.834158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-7bcf9010-5ea2-4237-a90a-a433c2c21cec req-099d52e9-44fa-4918-a127-d27be04d9a63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9948aad5-a378-4dea-8566-8e201f065623", "tag": "2b2ae932-7adb-4ffd-b2d8-b5d44cd19f03"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:27:06.836950 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:27:06.836950 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:27:06.880228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7bcf9010-5ea2-4237-a90a-a433c2c21cec req-099d52e9-44fa-4918-a127-d27be04d9a63 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:06.883627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7bcf9010-5ea2-4237-a90a-a433c2c21cec req-099d52e9-44fa-4918-a127-d27be04d9a63 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:06.914063 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-7bcf9010-5ea2-4237-a90a-a433c2c21cec req-099d52e9-44fa-4918-a127-d27be04d9a63 service nova] Creating event network-changed:2b2ae932-7adb-4ffd-b2d8-b5d44cd19f03 for instance 9948aad5-a378-4dea-8566-8e201f065623 on nch2-master-1 Jan 22 21:27:06.924095 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-7bcf9010-5ea2-4237-a90a-a433c2c21cec req-099d52e9-44fa-4918-a127-d27be04d9a63 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111529 Jan 22 21:27:06.932231 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3773/7245] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:27:07.047197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9c040791-4cce-4e8c-bfc6-35e44806e368 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:07.047916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9c040791-4cce-4e8c-bfc6-35e44806e368 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:07.059072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c040791-4cce-4e8c-bfc6-35e44806e368 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:07.061901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c040791-4cce-4e8c-bfc6-35e44806e368 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:07.062936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c040791-4cce-4e8c-bfc6-35e44806e368 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:07.063406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c040791-4cce-4e8c-bfc6-35e44806e368 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:07.368943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9c040791-4cce-4e8c-bfc6-35e44806e368 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:07.390607 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9c040791-4cce-4e8c-bfc6-35e44806e368 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1378 microversion: 2.1 time: 0.347486 Jan 22 21:27:07.392330 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3774/7246] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:07 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1378 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:07.629345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a4f20fdb-219c-4212-845f-37c7a951b32e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:07.647977 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a4f20fdb-219c-4212-845f-37c7a951b32e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1551 microversion: 2.1 time: 1.364778 Jan 22 21:27:07.657889 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3473/7247] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:06 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1551 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:07.675314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17068d01-af7d-4b69-8982-730810841968 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:07.676154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17068d01-af7d-4b69-8982-730810841968 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:07.684454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17068d01-af7d-4b69-8982-730810841968 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:07.685494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17068d01-af7d-4b69-8982-730810841968 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:07.686703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17068d01-af7d-4b69-8982-730810841968 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:07.687407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17068d01-af7d-4b69-8982-730810841968 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:07.859917 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-17068d01-af7d-4b69-8982-730810841968 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] HTTP exception thrown: Cannot 'detach_volume' instance ac840d9b-3179-4fcc-8d58-47094d6ad85c while it is in vm_state rescued Jan 22 21:27:07.865855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17068d01-af7d-4b69-8982-730810841968 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Returning 409 to user: Cannot 'detach_volume' instance ac840d9b-3179-4fcc-8d58-47094d6ad85c while it is in vm_state rescued {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:27:07.865855 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17068d01-af7d-4b69-8982-730810841968 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/os-volume_attachments/95aa6904-b117-424d-b97b-91744fe32d8a" status: 409 len: 152 microversion: 2.1 time: 0.195416 Jan 22 21:27:07.865855 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3775/7248] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 21:27:07 2022] DELETE /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/os-volume_attachments/95aa6904-b117-424d-b97b-91744fe32d8a => generated 152 bytes in 197 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:27:07.872811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5fa6a840-0f42-4f49-97c0-15ab3a50b48a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:27:07.873767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5fa6a840-0f42-4f49-97c0-15ab3a50b48a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:07.884994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fa6a840-0f42-4f49-97c0-15ab3a50b48a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:07.885786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fa6a840-0f42-4f49-97c0-15ab3a50b48a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:07.886976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fa6a840-0f42-4f49-97c0-15ab3a50b48a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:07.890761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fa6a840-0f42-4f49-97c0-15ab3a50b48a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:08.258473 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5fa6a840-0f42-4f49-97c0-15ab3a50b48a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/action" status: 202 len: 0 microversion: 2.1 time: 0.388433 Jan 22 21:27:08.259165 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3474/7249] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:27:07 2022] POST /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:27:08.269330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6ce760b4-5050-4a8d-81d4-da45d074b103 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:08.270304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6ce760b4-5050-4a8d-81d4-da45d074b103 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:08.285658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ce760b4-5050-4a8d-81d4-da45d074b103 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:08.287435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ce760b4-5050-4a8d-81d4-da45d074b103 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:08.293051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ce760b4-5050-4a8d-81d4-da45d074b103 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:08.293788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ce760b4-5050-4a8d-81d4-da45d074b103 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:08.410005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-be8017cd-45a4-44d5-bbe8-c2d47f0bccb3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:08.410738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-be8017cd-45a4-44d5-bbe8-c2d47f0bccb3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:08.437482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be8017cd-45a4-44d5-bbe8-c2d47f0bccb3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:08.438364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be8017cd-45a4-44d5-bbe8-c2d47f0bccb3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:08.439390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be8017cd-45a4-44d5-bbe8-c2d47f0bccb3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:08.440190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be8017cd-45a4-44d5-bbe8-c2d47f0bccb3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:08.888376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6ce760b4-5050-4a8d-81d4-da45d074b103 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:08.901608 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6ce760b4-5050-4a8d-81d4-da45d074b103 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1559 microversion: 2.1 time: 0.636998 Jan 22 21:27:08.902212 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3776/7250] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:08 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1559 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:09.290691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-be8017cd-45a4-44d5-bbe8-c2d47f0bccb3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:09.303529 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-be8017cd-45a4-44d5-bbe8-c2d47f0bccb3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1378 microversion: 2.1 time: 0.897648 Jan 22 21:27:09.307466 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3475/7251] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:08 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1378 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:27:09.923231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ce2640a-12f5-459f-9a08-29f96d727fc9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:09.924453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1ce2640a-12f5-459f-9a08-29f96d727fc9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:09.936139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ce2640a-12f5-459f-9a08-29f96d727fc9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:09.937069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ce2640a-12f5-459f-9a08-29f96d727fc9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:09.939348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ce2640a-12f5-459f-9a08-29f96d727fc9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:09.940055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ce2640a-12f5-459f-9a08-29f96d727fc9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:10.327002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-39230471-9b70-4881-8885-34e25d3af452 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:10.327623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-39230471-9b70-4881-8885-34e25d3af452 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:10.340979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39230471-9b70-4881-8885-34e25d3af452 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:10.341722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39230471-9b70-4881-8885-34e25d3af452 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:10.342997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39230471-9b70-4881-8885-34e25d3af452 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:10.343723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39230471-9b70-4881-8885-34e25d3af452 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:10.475837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1ce2640a-12f5-459f-9a08-29f96d727fc9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:10.483074 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ce2640a-12f5-459f-9a08-29f96d727fc9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1559 microversion: 2.1 time: 0.567235 Jan 22 21:27:10.491279 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3777/7252] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:09 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1559 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:10.727011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-39230471-9b70-4881-8885-34e25d3af452 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:10.736876 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-39230471-9b70-4881-8885-34e25d3af452 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1378 microversion: 2.1 time: 0.416097 Jan 22 21:27:10.741346 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3476/7253] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:10 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1378 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:11.502699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bf47566e-8829-49ca-a027-2115d1dfa57f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:11.503387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bf47566e-8829-49ca-a027-2115d1dfa57f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:11.512197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf47566e-8829-49ca-a027-2115d1dfa57f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:11.512959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf47566e-8829-49ca-a027-2115d1dfa57f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:11.515420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf47566e-8829-49ca-a027-2115d1dfa57f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:11.516500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf47566e-8829-49ca-a027-2115d1dfa57f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:11.696876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bf47566e-8829-49ca-a027-2115d1dfa57f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:11.705191 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bf47566e-8829-49ca-a027-2115d1dfa57f tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1559 microversion: 2.1 time: 0.207632 Jan 22 21:27:11.705815 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3778/7254] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:11 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:11.760862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-72629d28-1b83-466e-bed3-2606c423a8f6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:11.762189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-72629d28-1b83-466e-bed3-2606c423a8f6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:11.769884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72629d28-1b83-466e-bed3-2606c423a8f6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:11.770350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72629d28-1b83-466e-bed3-2606c423a8f6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:11.772050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72629d28-1b83-466e-bed3-2606c423a8f6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:11.772698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-72629d28-1b83-466e-bed3-2606c423a8f6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:12.606138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-72629d28-1b83-466e-bed3-2606c423a8f6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:12.613558 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-72629d28-1b83-466e-bed3-2606c423a8f6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1378 microversion: 2.1 time: 0.858677 Jan 22 21:27:12.614130 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3477/7255] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:11 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1378 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:27:12.730859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19d4f5e7-a83a-48d1-9ee4-6d47e6b7738d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:12.731513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-19d4f5e7-a83a-48d1-9ee4-6d47e6b7738d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:12.763466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19d4f5e7-a83a-48d1-9ee4-6d47e6b7738d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:12.764023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19d4f5e7-a83a-48d1-9ee4-6d47e6b7738d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:12.766317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19d4f5e7-a83a-48d1-9ee4-6d47e6b7738d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:12.772138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19d4f5e7-a83a-48d1-9ee4-6d47e6b7738d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:13.092814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-19d4f5e7-a83a-48d1-9ee4-6d47e6b7738d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:13.106779 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19d4f5e7-a83a-48d1-9ee4-6d47e6b7738d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1559 microversion: 2.1 time: 0.386965 Jan 22 21:27:13.107838 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3779/7256] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:12 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1559 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:13.633064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b6992337-75b7-4b31-a8e8-6adf03369837 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:13.634109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b6992337-75b7-4b31-a8e8-6adf03369837 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:13.646235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6992337-75b7-4b31-a8e8-6adf03369837 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:13.647524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6992337-75b7-4b31-a8e8-6adf03369837 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:13.650405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6992337-75b7-4b31-a8e8-6adf03369837 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:13.651222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b6992337-75b7-4b31-a8e8-6adf03369837 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:14.096890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b6992337-75b7-4b31-a8e8-6adf03369837 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:14.105544 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b6992337-75b7-4b31-a8e8-6adf03369837 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1378 microversion: 2.1 time: 0.476112 Jan 22 21:27:14.106794 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3478/7257] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:13 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1378 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:14.132768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a95f28fd-fd2f-4e37-ad3d-6bbcd8c5ed0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:14.140089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a95f28fd-fd2f-4e37-ad3d-6bbcd8c5ed0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:14.169144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a95f28fd-fd2f-4e37-ad3d-6bbcd8c5ed0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:14.173327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a95f28fd-fd2f-4e37-ad3d-6bbcd8c5ed0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:14.176401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a95f28fd-fd2f-4e37-ad3d-6bbcd8c5ed0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:14.177387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a95f28fd-fd2f-4e37-ad3d-6bbcd8c5ed0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:14.480680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a95f28fd-fd2f-4e37-ad3d-6bbcd8c5ed0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:14.496535 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a95f28fd-fd2f-4e37-ad3d-6bbcd8c5ed0e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1565 microversion: 2.1 time: 0.375324 Jan 22 21:27:14.498009 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3780/7258] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:14 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1565 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:14.583537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d95ddcb-e0f7-496a-897c-7d4d9babca83 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:14.583537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d95ddcb-e0f7-496a-897c-7d4d9babca83 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:14.591066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d95ddcb-e0f7-496a-897c-7d4d9babca83 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:14.592030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d95ddcb-e0f7-496a-897c-7d4d9babca83 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:14.593443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d95ddcb-e0f7-496a-897c-7d4d9babca83 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:14.594079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d95ddcb-e0f7-496a-897c-7d4d9babca83 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:14.757381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-3d95ddcb-e0f7-496a-897c-7d4d9babca83 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lazy-loading 'services' on Instance uuid ac840d9b-3179-4fcc-8d58-47094d6ad85c {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:27:15.076963 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d95ddcb-e0f7-496a-897c-7d4d9babca83 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/os-volume_attachments/95aa6904-b117-424d-b97b-91744fe32d8a" status: 202 len: 0 microversion: 2.1 time: 0.500085 Jan 22 21:27:15.077886 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3479/7259] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 21:27:14 2022] DELETE /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/os-volume_attachments/95aa6904-b117-424d-b97b-91744fe32d8a => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:27:15.097331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-acd54846-a9b6-4226-979a-32b80cd2a5ad tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:15.097331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-acd54846-a9b6-4226-979a-32b80cd2a5ad tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:15.105191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acd54846-a9b6-4226-979a-32b80cd2a5ad tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:15.105719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acd54846-a9b6-4226-979a-32b80cd2a5ad tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:15.106544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acd54846-a9b6-4226-979a-32b80cd2a5ad tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:15.106995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acd54846-a9b6-4226-979a-32b80cd2a5ad tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:15.123909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d529099c-a889-44fd-b3e5-0bc0ec72a6c4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:15.124531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d529099c-a889-44fd-b3e5-0bc0ec72a6c4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:15.132840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d529099c-a889-44fd-b3e5-0bc0ec72a6c4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:15.133581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d529099c-a889-44fd-b3e5-0bc0ec72a6c4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:15.134607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d529099c-a889-44fd-b3e5-0bc0ec72a6c4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:15.135242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d529099c-a889-44fd-b3e5-0bc0ec72a6c4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:15.169229 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-acd54846-a9b6-4226-979a-32b80cd2a5ad tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086514 Jan 22 21:27:15.182339 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3781/7260] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:27:15 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:27:15.619804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d529099c-a889-44fd-b3e5-0bc0ec72a6c4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:15.632303 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d529099c-a889-44fd-b3e5-0bc0ec72a6c4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1378 microversion: 2.1 time: 0.508146 Jan 22 21:27:15.633001 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3480/7261] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:15 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1378 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:27:16.193354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e3416fc0-9c57-45cc-a911-5229e54abdf8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:16.194967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e3416fc0-9c57-45cc-a911-5229e54abdf8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:16.212697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3416fc0-9c57-45cc-a911-5229e54abdf8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:16.212697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3416fc0-9c57-45cc-a911-5229e54abdf8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:16.212697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3416fc0-9c57-45cc-a911-5229e54abdf8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:16.214319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3416fc0-9c57-45cc-a911-5229e54abdf8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:16.279793 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e3416fc0-9c57-45cc-a911-5229e54abdf8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087509 Jan 22 21:27:16.279793 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3782/7262] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:27:16 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:27:16.574649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-73a6ee54-3d74-42f4-8530-59041a43b0bc req-b12f8f81-b668-45cb-accb-95c865b0deaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9948aad5-a378-4dea-8566-8e201f065623", "name": "network-vif-plugged", "status": "completed", "tag": "2b2ae932-7adb-4ffd-b2d8-b5d44cd19f03"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:27:16.576251 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:27:16.576251 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:27:16.584408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-73a6ee54-3d74-42f4-8530-59041a43b0bc req-b12f8f81-b668-45cb-accb-95c865b0deaa service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:16.584876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-73a6ee54-3d74-42f4-8530-59041a43b0bc req-b12f8f81-b668-45cb-accb-95c865b0deaa service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:16.596749 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-73a6ee54-3d74-42f4-8530-59041a43b0bc req-b12f8f81-b668-45cb-accb-95c865b0deaa service nova] Creating event network-vif-plugged:2b2ae932-7adb-4ffd-b2d8-b5d44cd19f03 for instance 9948aad5-a378-4dea-8566-8e201f065623 on nch2-master-1 Jan 22 21:27:16.602290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-73a6ee54-3d74-42f4-8530-59041a43b0bc req-b12f8f81-b668-45cb-accb-95c865b0deaa service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031457 Jan 22 21:27:16.602897 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3481/7263] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:27:16.652389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-66e06488-d7dc-4a6f-b4b0-407ba6952527 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:16.654518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-66e06488-d7dc-4a6f-b4b0-407ba6952527 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:16.677824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66e06488-d7dc-4a6f-b4b0-407ba6952527 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:16.678380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66e06488-d7dc-4a6f-b4b0-407ba6952527 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:16.680453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66e06488-d7dc-4a6f-b4b0-407ba6952527 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:16.680910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66e06488-d7dc-4a6f-b4b0-407ba6952527 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:16.890220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-66e06488-d7dc-4a6f-b4b0-407ba6952527 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:16.900129 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-66e06488-d7dc-4a6f-b4b0-407ba6952527 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1378 microversion: 2.1 time: 0.255125 Jan 22 21:27:16.901045 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3783/7264] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:16 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1378 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:17.290084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b2168f96-6f04-459a-b95c-909c57b3d9e2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:17.291107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b2168f96-6f04-459a-b95c-909c57b3d9e2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:17.306012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2168f96-6f04-459a-b95c-909c57b3d9e2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:17.306585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2168f96-6f04-459a-b95c-909c57b3d9e2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:17.307519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2168f96-6f04-459a-b95c-909c57b3d9e2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:17.308024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2168f96-6f04-459a-b95c-909c57b3d9e2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:17.353092 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b2168f96-6f04-459a-b95c-909c57b3d9e2 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068236 Jan 22 21:27:17.353722 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3482/7265] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 21:27:17 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:27:17.441421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5c60afae-e875-4881-abca-5ede48d3c9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:27:17.443714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5c60afae-e875-4881-abca-5ede48d3c9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:17.457564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c60afae-e875-4881-abca-5ede48d3c9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:17.459066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c60afae-e875-4881-abca-5ede48d3c9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:17.460175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c60afae-e875-4881-abca-5ede48d3c9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:17.460810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c60afae-e875-4881-abca-5ede48d3c9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:17.503984 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-5c60afae-e875-4881-abca-5ede48d3c9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] HTTP exception thrown: Cannot 'reboot' instance a1267bed-c7b9-4f9f-baa1-e1891f588795 while it is in vm_state rescued Jan 22 21:27:17.506019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5c60afae-e875-4881-abca-5ede48d3c9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Returning 409 to user: Cannot 'reboot' instance a1267bed-c7b9-4f9f-baa1-e1891f588795 while it is in vm_state rescued {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:27:17.509340 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5c60afae-e875-4881-abca-5ede48d3c9ff tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "POST /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795/action" status: 409 len: 145 microversion: 2.1 time: 0.076033 Jan 22 21:27:17.516685 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3784/7266] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:27:17 2022] POST /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795/action => generated 145 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:27:17.523106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c669cdc5-11d8-4db3-8edb-e125c268998e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:27:17.524568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c669cdc5-11d8-4db3-8edb-e125c268998e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:17.535646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c669cdc5-11d8-4db3-8edb-e125c268998e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:17.544921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c669cdc5-11d8-4db3-8edb-e125c268998e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:17.550988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c669cdc5-11d8-4db3-8edb-e125c268998e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:17.551496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c669cdc5-11d8-4db3-8edb-e125c268998e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:17.642006 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-c669cdc5-11d8-4db3-8edb-e125c268998e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] HTTP exception thrown: Cannot 'rebuild' instance a1267bed-c7b9-4f9f-baa1-e1891f588795 while it is in vm_state rescued Jan 22 21:27:17.647632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c669cdc5-11d8-4db3-8edb-e125c268998e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Returning 409 to user: Cannot 'rebuild' instance a1267bed-c7b9-4f9f-baa1-e1891f588795 while it is in vm_state rescued {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:27:17.652793 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c669cdc5-11d8-4db3-8edb-e125c268998e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "POST /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795/action" status: 409 len: 146 microversion: 2.1 time: 0.135489 Jan 22 21:27:17.656678 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3483/7267] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:27:17 2022] POST /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795/action => generated 146 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:27:17.918837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3d7e2871-154e-43c6-bd65-14ab8ea1929c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:17.919556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3d7e2871-154e-43c6-bd65-14ab8ea1929c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:17.926595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d7e2871-154e-43c6-bd65-14ab8ea1929c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:17.927125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d7e2871-154e-43c6-bd65-14ab8ea1929c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:17.928488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d7e2871-154e-43c6-bd65-14ab8ea1929c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:17.929105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d7e2871-154e-43c6-bd65-14ab8ea1929c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:18.230256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3d7e2871-154e-43c6-bd65-14ab8ea1929c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:18.240933 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3d7e2871-154e-43c6-bd65-14ab8ea1929c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1378 microversion: 2.1 time: 0.326693 Jan 22 21:27:18.250740 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3785/7268] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:17 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1378 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:19.263719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ac27c9e9-23f0-4a78-90f2-d4a94fae001a tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:19.267270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ac27c9e9-23f0-4a78-90f2-d4a94fae001a tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:19.301167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac27c9e9-23f0-4a78-90f2-d4a94fae001a tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:19.324078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac27c9e9-23f0-4a78-90f2-d4a94fae001a tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:19.324078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac27c9e9-23f0-4a78-90f2-d4a94fae001a tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:19.324078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac27c9e9-23f0-4a78-90f2-d4a94fae001a tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:19.681595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ac27c9e9-23f0-4a78-90f2-d4a94fae001a tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:19.692224 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ac27c9e9-23f0-4a78-90f2-d4a94fae001a tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1551 microversion: 2.1 time: 0.437648 Jan 22 21:27:19.692945 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3484/7269] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:19 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1551 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:19.709558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7c4a7185-dfa5-48f3-ae9d-f772fb8720b6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:19.710190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7c4a7185-dfa5-48f3-ae9d-f772fb8720b6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:19.720236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c4a7185-dfa5-48f3-ae9d-f772fb8720b6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:19.720978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c4a7185-dfa5-48f3-ae9d-f772fb8720b6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:19.721558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c4a7185-dfa5-48f3-ae9d-f772fb8720b6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:19.731751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c4a7185-dfa5-48f3-ae9d-f772fb8720b6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:20.184896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7c4a7185-dfa5-48f3-ae9d-f772fb8720b6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:20.196524 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7c4a7185-dfa5-48f3-ae9d-f772fb8720b6 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1551 microversion: 2.1 time: 0.491256 Jan 22 21:27:20.210175 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3786/7270] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:19 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1551 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:22.106813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c0c79f64-e597-423f-a201-0040b8a31a7d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:22.107256 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:27:22.107256 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:27:22.108453 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0c79f64-e597-423f-a201-0040b8a31a7d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:22.108905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0c79f64-e597-423f-a201-0040b8a31a7d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:22.110046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0c79f64-e597-423f-a201-0040b8a31a7d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:22.110497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0c79f64-e597-423f-a201-0040b8a31a7d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:22.149408 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c0c79f64-e597-423f-a201-0040b8a31a7d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.282607 Jan 22 21:27:22.150326 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3485/7271] 10.222.0.100 () {58 vars in 1189 bytes} [Sat Jan 22 21:27:21 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:27:22.283762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-416991344", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "9ad2daa8-7c94-4e7e-a2ac-6a5e33d5dce7"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:27:22.403605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] validate_networks() for [('9ad2daa8-7c94-4e7e-a2ac-6a5e33d5dce7', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:27:22.902009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:27:22.902809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:27:22.903980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:27:22.904475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:27:22.905008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:27:22.928719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:22.937916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:22.943494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:22.945324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:23.014201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Getting quotas for project 0ec2e0d7462a44fa9b65a1b491a4d3a6. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:27:23.022931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Getting quotas for user d6ea279277424ccb9a5c267f2a3f8b71 and project 0ec2e0d7462a44fa9b65a1b491a4d3a6. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:27:23.039814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:27:23.046238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:27:23.171962 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-198847e9-246a-4863-bfb1-2d3fa76140b7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.891789 Jan 22 21:27:23.180295 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3787/7272] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:27:22 2022] POST /compute/v2.1/servers => generated 382 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:27:23.186088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-26c37947-31e3-4ac9-8e84-1b67e3eb62ec tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:23.187252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-26c37947-31e3-4ac9-8e84-1b67e3eb62ec tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:23.319258 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-26c37947-31e3-4ac9-8e84-1b67e3eb62ec tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1332 microversion: 2.1 time: 0.137069 Jan 22 21:27:23.330029 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3486/7273] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:23 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1332 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:24.340780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c48ec949-1c47-48e3-99f2-85cd7cf86f7e tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:24.343118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c48ec949-1c47-48e3-99f2-85cd7cf86f7e tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:24.609132 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c48ec949-1c47-48e3-99f2-85cd7cf86f7e tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1332 microversion: 2.1 time: 0.276558 Jan 22 21:27:24.613196 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3788/7274] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:24 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1332 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:25.633698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-707a55b9-38f3-4b33-aee2-56e478108b16 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:25.634346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-707a55b9-38f3-4b33-aee2-56e478108b16 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:25.685944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-707a55b9-38f3-4b33-aee2-56e478108b16 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:25.687690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-707a55b9-38f3-4b33-aee2-56e478108b16 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:25.694894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-707a55b9-38f3-4b33-aee2-56e478108b16 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:25.695608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-707a55b9-38f3-4b33-aee2-56e478108b16 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:26.494864 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-707a55b9-38f3-4b33-aee2-56e478108b16 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1341 microversion: 2.1 time: 0.858984 Jan 22 21:27:26.495959 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3487/7275] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:25 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1341 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:27.513048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f23f5002-2a69-43da-8015-d51a46ea614a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:27.517337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f23f5002-2a69-43da-8015-d51a46ea614a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:27.521300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f23f5002-2a69-43da-8015-d51a46ea614a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:27.536756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f23f5002-2a69-43da-8015-d51a46ea614a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:27.540878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f23f5002-2a69-43da-8015-d51a46ea614a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:27.541348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f23f5002-2a69-43da-8015-d51a46ea614a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:27.808225 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f23f5002-2a69-43da-8015-d51a46ea614a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1425 microversion: 2.1 time: 0.297220 Jan 22 21:27:27.808863 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3789/7276] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:27 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1425 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:28.826038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-29355cd3-2dc8-4453-b7c5-14f815bd1a4e tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:28.826657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-29355cd3-2dc8-4453-b7c5-14f815bd1a4e tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:28.834831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-29355cd3-2dc8-4453-b7c5-14f815bd1a4e tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:28.838545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-29355cd3-2dc8-4453-b7c5-14f815bd1a4e tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:28.838545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-29355cd3-2dc8-4453-b7c5-14f815bd1a4e tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:28.838545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-29355cd3-2dc8-4453-b7c5-14f815bd1a4e tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:29.336093 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-29355cd3-2dc8-4453-b7c5-14f815bd1a4e tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1467 microversion: 2.1 time: 0.514626 Jan 22 21:27:29.345297 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3488/7277] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:28 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1467 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:30.358840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a52452cb-7b6a-41a0-8d74-a5c68d888a4d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:30.359659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a52452cb-7b6a-41a0-8d74-a5c68d888a4d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:30.392354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a52452cb-7b6a-41a0-8d74-a5c68d888a4d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:30.396795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a52452cb-7b6a-41a0-8d74-a5c68d888a4d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:30.400527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-35e12399-2415-488e-b1cb-5fa60c506503 req-da5dbde0-d3eb-4f58-93a0-7b7bf62ad83c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0190f72d-8dc0-49d0-ba97-bfaefbc4093f", "tag": "e9eafc73-c205-4111-8f99-fcaddd676b4f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:27:30.401020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a52452cb-7b6a-41a0-8d74-a5c68d888a4d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:30.401020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a52452cb-7b6a-41a0-8d74-a5c68d888a4d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:30.401233 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:27:30.401233 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:27:30.416799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-35e12399-2415-488e-b1cb-5fa60c506503 req-da5dbde0-d3eb-4f58-93a0-7b7bf62ad83c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:30.417259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-35e12399-2415-488e-b1cb-5fa60c506503 req-da5dbde0-d3eb-4f58-93a0-7b7bf62ad83c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:30.444491 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-35e12399-2415-488e-b1cb-5fa60c506503 req-da5dbde0-d3eb-4f58-93a0-7b7bf62ad83c service nova] Creating event network-changed:e9eafc73-c205-4111-8f99-fcaddd676b4f for instance 0190f72d-8dc0-49d0-ba97-bfaefbc4093f on nch2-master-1 Jan 22 21:27:30.455470 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-35e12399-2415-488e-b1cb-5fa60c506503 req-da5dbde0-d3eb-4f58-93a0-7b7bf62ad83c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062183 Jan 22 21:27:30.458422 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3489/7278] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:27:31.587770 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a52452cb-7b6a-41a0-8d74-a5c68d888a4d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1467 microversion: 2.1 time: 1.232005 Jan 22 21:27:31.598504 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3790/7279] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:30 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1467 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:32.604752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-94d7628d-4cb8-42e4-9aa6-e26f76906d45 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:32.605463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-94d7628d-4cb8-42e4-9aa6-e26f76906d45 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:32.634812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94d7628d-4cb8-42e4-9aa6-e26f76906d45 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:32.635570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94d7628d-4cb8-42e4-9aa6-e26f76906d45 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:32.636879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94d7628d-4cb8-42e4-9aa6-e26f76906d45 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:32.637950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94d7628d-4cb8-42e4-9aa6-e26f76906d45 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:32.861065 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-94d7628d-4cb8-42e4-9aa6-e26f76906d45 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1467 microversion: 2.1 time: 0.260273 Jan 22 21:27:32.862059 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3490/7280] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:32 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1467 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:33.878581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e7511791-245b-4a62-b372-6d86a4d3edb6 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:33.879211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e7511791-245b-4a62-b372-6d86a4d3edb6 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:33.886029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7511791-245b-4a62-b372-6d86a4d3edb6 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:33.886484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7511791-245b-4a62-b372-6d86a4d3edb6 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:33.887274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7511791-245b-4a62-b372-6d86a4d3edb6 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:33.887716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7511791-245b-4a62-b372-6d86a4d3edb6 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:34.028470 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e7511791-245b-4a62-b372-6d86a4d3edb6 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1467 microversion: 2.1 time: 0.153640 Jan 22 21:27:34.029248 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3791/7281] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:33 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1467 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:35.048014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ce94cad-94c1-42a0-972d-c6c3f4bb7319 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:35.054035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ce94cad-94c1-42a0-972d-c6c3f4bb7319 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:35.067929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ce94cad-94c1-42a0-972d-c6c3f4bb7319 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:35.074754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ce94cad-94c1-42a0-972d-c6c3f4bb7319 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:35.076316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ce94cad-94c1-42a0-972d-c6c3f4bb7319 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:35.077007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ce94cad-94c1-42a0-972d-c6c3f4bb7319 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:35.322117 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ce94cad-94c1-42a0-972d-c6c3f4bb7319 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1467 microversion: 2.1 time: 0.278726 Jan 22 21:27:35.322705 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3491/7282] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:35 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1467 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:36.339629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b51e82b9-616f-46dd-ae36-c9f387ae603f tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:36.340723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b51e82b9-616f-46dd-ae36-c9f387ae603f tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:36.351100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b51e82b9-616f-46dd-ae36-c9f387ae603f tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:36.353718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b51e82b9-616f-46dd-ae36-c9f387ae603f tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:36.353718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b51e82b9-616f-46dd-ae36-c9f387ae603f tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:36.354057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b51e82b9-616f-46dd-ae36-c9f387ae603f tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:36.670315 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b51e82b9-616f-46dd-ae36-c9f387ae603f tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1467 microversion: 2.1 time: 0.329406 Jan 22 21:27:36.674582 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3792/7283] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:36 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1467 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:37.085034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ec878e60-543c-4c3d-be48-b2a866222028 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:37.088582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ec878e60-543c-4c3d-be48-b2a866222028 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:37.101335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec878e60-543c-4c3d-be48-b2a866222028 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:37.102942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec878e60-543c-4c3d-be48-b2a866222028 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:37.103975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec878e60-543c-4c3d-be48-b2a866222028 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:37.104595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec878e60-543c-4c3d-be48-b2a866222028 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:37.159705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ec878e60-543c-4c3d-be48-b2a866222028 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:27:37.590227 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ec878e60-543c-4c3d-be48-b2a866222028 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 204 len: 0 microversion: 2.1 time: 0.519156 Jan 22 21:27:37.592707 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3492/7284] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:27:37 2022] DELETE /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:27:37.600972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c34b197c-ae17-4886-981a-d0133ebd042e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:37.601635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c34b197c-ae17-4886-981a-d0133ebd042e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:37.617107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c34b197c-ae17-4886-981a-d0133ebd042e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:37.618930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c34b197c-ae17-4886-981a-d0133ebd042e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:37.620045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c34b197c-ae17-4886-981a-d0133ebd042e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:37.621331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c34b197c-ae17-4886-981a-d0133ebd042e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:37.692401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-887c1d2c-2afc-4fca-a7d4-992d0bc71af1 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:37.693533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-887c1d2c-2afc-4fca-a7d4-992d0bc71af1 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:37.701337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-887c1d2c-2afc-4fca-a7d4-992d0bc71af1 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:37.702093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-887c1d2c-2afc-4fca-a7d4-992d0bc71af1 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:37.704817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-887c1d2c-2afc-4fca-a7d4-992d0bc71af1 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:37.706068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-887c1d2c-2afc-4fca-a7d4-992d0bc71af1 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:37.994168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c34b197c-ae17-4886-981a-d0133ebd042e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:38.007900 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c34b197c-ae17-4886-981a-d0133ebd042e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1512 microversion: 2.1 time: 0.409659 Jan 22 21:27:38.018988 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3793/7285] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:37 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1512 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:38.092866 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-887c1d2c-2afc-4fca-a7d4-992d0bc71af1 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1467 microversion: 2.1 time: 0.406715 Jan 22 21:27:38.093798 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3493/7286] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:37 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1467 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:27:38.668852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-bf394c79-c439-428c-b31e-698655100bf7 req-814a3105-da4c-4479-9670-161ead8a5fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0190f72d-8dc0-49d0-ba97-bfaefbc4093f", "name": "network-vif-plugged", "status": "completed", "tag": "e9eafc73-c205-4111-8f99-fcaddd676b4f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:27:38.671649 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:27:38.671649 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:27:38.682660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bf394c79-c439-428c-b31e-698655100bf7 req-814a3105-da4c-4479-9670-161ead8a5fc9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:38.683281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bf394c79-c439-428c-b31e-698655100bf7 req-814a3105-da4c-4479-9670-161ead8a5fc9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:38.701329 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-bf394c79-c439-428c-b31e-698655100bf7 req-814a3105-da4c-4479-9670-161ead8a5fc9 service nova] Creating event network-vif-plugged:e9eafc73-c205-4111-8f99-fcaddd676b4f for instance 0190f72d-8dc0-49d0-ba97-bfaefbc4093f on nch2-master-1 Jan 22 21:27:38.707006 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-bf394c79-c439-428c-b31e-698655100bf7 req-814a3105-da4c-4479-9670-161ead8a5fc9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042253 Jan 22 21:27:38.708134 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3794/7287] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:27:39.026157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8178fb87-de76-452f-9587-e5cb4dd9953e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:39.026773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8178fb87-de76-452f-9587-e5cb4dd9953e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:39.039438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8178fb87-de76-452f-9587-e5cb4dd9953e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:39.039438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8178fb87-de76-452f-9587-e5cb4dd9953e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:39.043032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8178fb87-de76-452f-9587-e5cb4dd9953e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:39.059360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8178fb87-de76-452f-9587-e5cb4dd9953e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:39.111806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2ce53a8c-1773-492f-91c8-f1ed6c674dc6 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:39.112818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2ce53a8c-1773-492f-91c8-f1ed6c674dc6 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:39.128301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ce53a8c-1773-492f-91c8-f1ed6c674dc6 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:39.128983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ce53a8c-1773-492f-91c8-f1ed6c674dc6 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:39.129989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ce53a8c-1773-492f-91c8-f1ed6c674dc6 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:39.130474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ce53a8c-1773-492f-91c8-f1ed6c674dc6 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:39.427371 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2ce53a8c-1773-492f-91c8-f1ed6c674dc6 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1467 microversion: 2.1 time: 0.300448 Jan 22 21:27:39.427371 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3795/7288] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:39 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1467 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:39.527946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8178fb87-de76-452f-9587-e5cb4dd9953e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:39.545170 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8178fb87-de76-452f-9587-e5cb4dd9953e tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1512 microversion: 2.1 time: 0.521892 Jan 22 21:27:39.547316 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3494/7289] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:39 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1512 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:40.434204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-99afaf5d-6692-4a14-8c2d-a73102878a6f tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:40.434900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-99afaf5d-6692-4a14-8c2d-a73102878a6f tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:40.443280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99afaf5d-6692-4a14-8c2d-a73102878a6f tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:40.443909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99afaf5d-6692-4a14-8c2d-a73102878a6f tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:40.444925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99afaf5d-6692-4a14-8c2d-a73102878a6f tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:40.445469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99afaf5d-6692-4a14-8c2d-a73102878a6f tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:40.563614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0ffc3cf9-e4d7-4ead-9afe-44e53de7c018 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:40.566516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0ffc3cf9-e4d7-4ead-9afe-44e53de7c018 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:40.579294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ffc3cf9-e4d7-4ead-9afe-44e53de7c018 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:40.579988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ffc3cf9-e4d7-4ead-9afe-44e53de7c018 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:40.582110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ffc3cf9-e4d7-4ead-9afe-44e53de7c018 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:40.583480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ffc3cf9-e4d7-4ead-9afe-44e53de7c018 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:40.668703 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-99afaf5d-6692-4a14-8c2d-a73102878a6f tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1467 microversion: 2.1 time: 0.233329 Jan 22 21:27:40.668703 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3796/7290] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:40 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1467 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:40.939231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0ffc3cf9-e4d7-4ead-9afe-44e53de7c018 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:40.953295 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0ffc3cf9-e4d7-4ead-9afe-44e53de7c018 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1512 microversion: 2.1 time: 0.390407 Jan 22 21:27:40.954660 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3495/7291] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:40 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1512 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:41.688147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a8ebd1d5-1009-4b4b-8989-4654fe52b2b2 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:41.689556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a8ebd1d5-1009-4b4b-8989-4654fe52b2b2 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:41.701263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8ebd1d5-1009-4b4b-8989-4654fe52b2b2 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:41.702506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8ebd1d5-1009-4b4b-8989-4654fe52b2b2 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:41.703610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8ebd1d5-1009-4b4b-8989-4654fe52b2b2 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:41.704354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8ebd1d5-1009-4b4b-8989-4654fe52b2b2 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:41.761985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-6e62955a-cf84-4610-8ec1-758bed65a56e req-db300282-1039-425b-9685-5b2a8928bf7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1267bed-c7b9-4f9f-baa1-e1891f588795", "name": "network-vif-deleted", "tag": "6bea5fb2-1f3e-435a-89ec-a17935154ddc"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:27:41.763601 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:27:41.763601 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:27:41.794713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6e62955a-cf84-4610-8ec1-758bed65a56e req-db300282-1039-425b-9685-5b2a8928bf7b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:41.795172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6e62955a-cf84-4610-8ec1-758bed65a56e req-db300282-1039-425b-9685-5b2a8928bf7b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:41.834934 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-6e62955a-cf84-4610-8ec1-758bed65a56e req-db300282-1039-425b-9685-5b2a8928bf7b service nova] Creating event network-vif-deleted:6bea5fb2-1f3e-435a-89ec-a17935154ddc for instance a1267bed-c7b9-4f9f-baa1-e1891f588795 on nch2-master-1 Jan 22 21:27:41.868235 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-6e62955a-cf84-4610-8ec1-758bed65a56e req-db300282-1039-425b-9685-5b2a8928bf7b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106128 Jan 22 21:27:41.873252 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3496/7292] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:27:41.974988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e48060e2-f66f-48c8-8409-642f185bb20a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:41.981600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e48060e2-f66f-48c8-8409-642f185bb20a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:42.004810 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a8ebd1d5-1009-4b4b-8989-4654fe52b2b2 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1651 microversion: 2.1 time: 0.326274 Jan 22 21:27:42.008648 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3797/7293] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:41 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1651 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:42.012228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e48060e2-f66f-48c8-8409-642f185bb20a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:42.013550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e48060e2-f66f-48c8-8409-642f185bb20a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:42.015055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e48060e2-f66f-48c8-8409-642f185bb20a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:42.015502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e48060e2-f66f-48c8-8409-642f185bb20a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:42.025586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3540ee9a-f0a3-4971-ace4-4613b850355d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:42.026217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3540ee9a-f0a3-4971-ace4-4613b850355d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:42.032638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3540ee9a-f0a3-4971-ace4-4613b850355d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:42.033355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3540ee9a-f0a3-4971-ace4-4613b850355d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:42.034234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3540ee9a-f0a3-4971-ace4-4613b850355d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:42.035648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3540ee9a-f0a3-4971-ace4-4613b850355d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:42.235252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e48060e2-f66f-48c8-8409-642f185bb20a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:42.253303 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e48060e2-f66f-48c8-8409-642f185bb20a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 200 len: 1297 microversion: 2.1 time: 0.284912 Jan 22 21:27:42.264754 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3497/7294] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:41 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 1297 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:27:42.323457 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3540ee9a-f0a3-4971-ace4-4613b850355d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1651 microversion: 2.1 time: 0.301271 Jan 22 21:27:42.324621 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3798/7295] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:42 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1651 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:42.343168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ccee58ce-3b12-4f4e-96a8-1d78191e7236 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:42.343851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ccee58ce-3b12-4f4e-96a8-1d78191e7236 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:42.357743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccee58ce-3b12-4f4e-96a8-1d78191e7236 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:42.358332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccee58ce-3b12-4f4e-96a8-1d78191e7236 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:42.359259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccee58ce-3b12-4f4e-96a8-1d78191e7236 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:42.360258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ccee58ce-3b12-4f4e-96a8-1d78191e7236 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:42.625060 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ccee58ce-3b12-4f4e-96a8-1d78191e7236 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1651 microversion: 2.1 time: 0.287130 Jan 22 21:27:42.626019 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3498/7296] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:42 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1651 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:42.746892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1044544064", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "9ad2daa8-7c94-4e7e-a2ac-6a5e33d5dce7"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:27:42.834249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] validate_networks() for [('9ad2daa8-7c94-4e7e-a2ac-6a5e33d5dce7', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:27:43.271780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e7faa28f-813b-470c-86c3-98b98fd3dcd8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:43.274039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e7faa28f-813b-470c-86c3-98b98fd3dcd8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: a1267bed-c7b9-4f9f-baa1-e1891f588795] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:43.280960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7faa28f-813b-470c-86c3-98b98fd3dcd8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:43.281715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7faa28f-813b-470c-86c3-98b98fd3dcd8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:43.282701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7faa28f-813b-470c-86c3-98b98fd3dcd8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:43.290224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7faa28f-813b-470c-86c3-98b98fd3dcd8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:43.324365 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-e7faa28f-813b-470c-86c3-98b98fd3dcd8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] HTTP exception thrown: Instance a1267bed-c7b9-4f9f-baa1-e1891f588795 could not be found. Jan 22 21:27:43.324365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e7faa28f-813b-470c-86c3-98b98fd3dcd8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Returning 404 to user: Instance a1267bed-c7b9-4f9f-baa1-e1891f588795 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:27:43.324365 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e7faa28f-813b-470c-86c3-98b98fd3dcd8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795" status: 404 len: 111 microversion: 2.1 time: 0.047997 Jan 22 21:27:43.324365 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3499/7297] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:43 2022] GET /compute/v2.1/servers/a1267bed-c7b9-4f9f-baa1-e1891f588795 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:27:43.325030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5f0c57a9-6d44-4cea-87dc-ce9a1aa02ef3 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:43.325792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5f0c57a9-6d44-4cea-87dc-ce9a1aa02ef3 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:43.333188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f0c57a9-6d44-4cea-87dc-ce9a1aa02ef3 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:43.333713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f0c57a9-6d44-4cea-87dc-ce9a1aa02ef3 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:43.334693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f0c57a9-6d44-4cea-87dc-ce9a1aa02ef3 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:43.335144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f0c57a9-6d44-4cea-87dc-ce9a1aa02ef3 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:43.412575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5f0c57a9-6d44-4cea-87dc-ce9a1aa02ef3 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:27:43.784206 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5f0c57a9-6d44-4cea-87dc-ce9a1aa02ef3 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 204 len: 0 microversion: 2.1 time: 0.462971 Jan 22 21:27:43.786349 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3500/7298] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:27:43 2022] DELETE /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:27:43.796602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-38160569-eebd-45f4-bda3-18ab2d43a049 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:43.797833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-38160569-eebd-45f4-bda3-18ab2d43a049 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:43.809676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38160569-eebd-45f4-bda3-18ab2d43a049 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:43.810665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38160569-eebd-45f4-bda3-18ab2d43a049 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:43.811876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38160569-eebd-45f4-bda3-18ab2d43a049 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:43.812590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-38160569-eebd-45f4-bda3-18ab2d43a049 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:44.119303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:27:44.120450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:27:44.121708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:27:44.122338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:27:44.122946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:27:44.141066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:44.142733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:44.144551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:44.145207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:44.170913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Getting quotas for project 0ec2e0d7462a44fa9b65a1b491a4d3a6. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:27:44.178604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Getting quotas for user d6ea279277424ccb9a5c267f2a3f8b71 and project 0ec2e0d7462a44fa9b65a1b491a4d3a6. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:27:44.194449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:27:44.197956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:27:44.259429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-38160569-eebd-45f4-bda3-18ab2d43a049 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:44.271559 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-38160569-eebd-45f4-bda3-18ab2d43a049 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1525 microversion: 2.1 time: 0.479771 Jan 22 21:27:44.276236 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3501/7299] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:43 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1525 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:44.329002 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c1bfc9ed-6572-40f1-a5bc-89524ae92ec7 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.585707 Jan 22 21:27:44.331164 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3799/7300] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:27:42 2022] POST /compute/v2.1/servers => generated 382 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:27:44.352776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b3c7c826-7457-4c0f-b46c-9fd61bd52b56 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:44.355657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b3c7c826-7457-4c0f-b46c-9fd61bd52b56 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:44.514565 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b3c7c826-7457-4c0f-b46c-9fd61bd52b56 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1333 microversion: 2.1 time: 0.176637 Jan 22 21:27:44.535175 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3502/7301] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:44 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1333 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:45.293563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-db369fad-f904-4d1d-9ce8-b32ba48a841d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:45.294200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-db369fad-f904-4d1d-9ce8-b32ba48a841d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:45.303334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db369fad-f904-4d1d-9ce8-b32ba48a841d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:45.304126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db369fad-f904-4d1d-9ce8-b32ba48a841d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:45.304947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db369fad-f904-4d1d-9ce8-b32ba48a841d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:45.305402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db369fad-f904-4d1d-9ce8-b32ba48a841d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:45.500571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-db369fad-f904-4d1d-9ce8-b32ba48a841d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:45.513569 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-db369fad-f904-4d1d-9ce8-b32ba48a841d tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1525 microversion: 2.1 time: 0.224486 Jan 22 21:27:45.519536 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3800/7302] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:45 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1525 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:45.544674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7d00d1e1-9839-42b6-8bbe-cd72b44184ad tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:45.545431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7d00d1e1-9839-42b6-8bbe-cd72b44184ad tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:45.554652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d00d1e1-9839-42b6-8bbe-cd72b44184ad tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:45.555235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d00d1e1-9839-42b6-8bbe-cd72b44184ad tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:45.556045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d00d1e1-9839-42b6-8bbe-cd72b44184ad tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:45.556590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d00d1e1-9839-42b6-8bbe-cd72b44184ad tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:45.672694 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7d00d1e1-9839-42b6-8bbe-cd72b44184ad tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1350 microversion: 2.1 time: 0.133628 Jan 22 21:27:45.684228 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3503/7303] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:45 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:46.542148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-489cd6e9-fd2a-4597-9412-9e85894d4f49 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:46.542148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-489cd6e9-fd2a-4597-9412-9e85894d4f49 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:46.545864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-489cd6e9-fd2a-4597-9412-9e85894d4f49 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:46.546501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-489cd6e9-fd2a-4597-9412-9e85894d4f49 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:46.547475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-489cd6e9-fd2a-4597-9412-9e85894d4f49 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:46.547930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-489cd6e9-fd2a-4597-9412-9e85894d4f49 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:46.692281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc855117-6606-4425-a626-db897227926d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:46.693077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bc855117-6606-4425-a626-db897227926d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:46.702067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc855117-6606-4425-a626-db897227926d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:46.702570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc855117-6606-4425-a626-db897227926d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:46.705205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc855117-6606-4425-a626-db897227926d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:46.706270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc855117-6606-4425-a626-db897227926d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:46.870092 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bc855117-6606-4425-a626-db897227926d tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1420 microversion: 2.1 time: 0.182474 Jan 22 21:27:46.873640 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3504/7304] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:46 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:27:46.919441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-489cd6e9-fd2a-4597-9412-9e85894d4f49 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:46.933729 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-489cd6e9-fd2a-4597-9412-9e85894d4f49 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1525 microversion: 2.1 time: 0.403163 Jan 22 21:27:46.934356 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3801/7305] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:46 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1525 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:47.893543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-640a967e-ccab-482e-ba6e-30d490447ef9 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:47.895353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-640a967e-ccab-482e-ba6e-30d490447ef9 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:47.902142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-640a967e-ccab-482e-ba6e-30d490447ef9 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:47.908236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-640a967e-ccab-482e-ba6e-30d490447ef9 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:47.910815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-640a967e-ccab-482e-ba6e-30d490447ef9 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:47.911473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-640a967e-ccab-482e-ba6e-30d490447ef9 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:47.955198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-057b4829-dc2a-48ce-90cb-969344b0e6e0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:47.961223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-057b4829-dc2a-48ce-90cb-969344b0e6e0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:47.967904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-057b4829-dc2a-48ce-90cb-969344b0e6e0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:47.968368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-057b4829-dc2a-48ce-90cb-969344b0e6e0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:47.969180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-057b4829-dc2a-48ce-90cb-969344b0e6e0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:47.969787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-057b4829-dc2a-48ce-90cb-969344b0e6e0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:48.077467 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-640a967e-ccab-482e-ba6e-30d490447ef9 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1426 microversion: 2.1 time: 0.187667 Jan 22 21:27:48.080631 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3505/7306] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:47 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1426 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:48.376972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-057b4829-dc2a-48ce-90cb-969344b0e6e0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:48.389023 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-057b4829-dc2a-48ce-90cb-969344b0e6e0 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1525 microversion: 2.1 time: 0.437464 Jan 22 21:27:48.395866 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3802/7307] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:47 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1525 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:49.096819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a60bcef8-97d4-434b-9dd0-90db669f4059 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:49.098176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a60bcef8-97d4-434b-9dd0-90db669f4059 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:49.111635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a60bcef8-97d4-434b-9dd0-90db669f4059 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:49.114662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a60bcef8-97d4-434b-9dd0-90db669f4059 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:49.114662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a60bcef8-97d4-434b-9dd0-90db669f4059 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:49.114662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a60bcef8-97d4-434b-9dd0-90db669f4059 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:49.405901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ed7329b9-8279-4691-9ccf-65e5934db2e9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:49.413672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ed7329b9-8279-4691-9ccf-65e5934db2e9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:49.422838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed7329b9-8279-4691-9ccf-65e5934db2e9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:49.423307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed7329b9-8279-4691-9ccf-65e5934db2e9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:49.424334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed7329b9-8279-4691-9ccf-65e5934db2e9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:49.425719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed7329b9-8279-4691-9ccf-65e5934db2e9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:49.668716 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a60bcef8-97d4-434b-9dd0-90db669f4059 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1468 microversion: 2.1 time: 0.576153 Jan 22 21:27:49.676851 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3506/7308] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:49 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1468 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:49.705012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed7329b9-8279-4691-9ccf-65e5934db2e9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:49.719193 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ed7329b9-8279-4691-9ccf-65e5934db2e9 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1525 microversion: 2.1 time: 0.316836 Jan 22 21:27:49.720457 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3803/7309] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:49 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1525 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:27:50.370940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-36c1db0c-b421-4403-bf08-c5fa726d4d7a req-dc2f446a-c549-4ed9-8640-7af4861057d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0255fc-7d3c-45f2-b6de-655b09dca4ec", "tag": "a0277eb0-7a18-48af-9465-e3e1d07c7179"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:27:50.375300 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:27:50.375300 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:27:50.386318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-36c1db0c-b421-4403-bf08-c5fa726d4d7a req-dc2f446a-c549-4ed9-8640-7af4861057d8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:50.387448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-36c1db0c-b421-4403-bf08-c5fa726d4d7a req-dc2f446a-c549-4ed9-8640-7af4861057d8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:50.403633 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-36c1db0c-b421-4403-bf08-c5fa726d4d7a req-dc2f446a-c549-4ed9-8640-7af4861057d8 service nova] Creating event network-changed:a0277eb0-7a18-48af-9465-e3e1d07c7179 for instance ef0255fc-7d3c-45f2-b6de-655b09dca4ec on nch1-master-1 Jan 22 21:27:50.409921 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-36c1db0c-b421-4403-bf08-c5fa726d4d7a req-dc2f446a-c549-4ed9-8640-7af4861057d8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043148 Jan 22 21:27:50.411668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3507/7310] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:27:50.693737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cddd37f6-1da6-4ff0-8ae0-53debfc0e1ef tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:50.695046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cddd37f6-1da6-4ff0-8ae0-53debfc0e1ef tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:50.703081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cddd37f6-1da6-4ff0-8ae0-53debfc0e1ef tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:50.703547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cddd37f6-1da6-4ff0-8ae0-53debfc0e1ef tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:50.704558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cddd37f6-1da6-4ff0-8ae0-53debfc0e1ef tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:50.704992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cddd37f6-1da6-4ff0-8ae0-53debfc0e1ef tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:50.739221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-639b81ee-5614-48ff-8851-84a64b6a805a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:50.740505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-639b81ee-5614-48ff-8851-84a64b6a805a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:50.751234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-639b81ee-5614-48ff-8851-84a64b6a805a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:50.755464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-639b81ee-5614-48ff-8851-84a64b6a805a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:50.761598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-639b81ee-5614-48ff-8851-84a64b6a805a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:50.761598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-639b81ee-5614-48ff-8851-84a64b6a805a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:50.885711 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cddd37f6-1da6-4ff0-8ae0-53debfc0e1ef tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1468 microversion: 2.1 time: 0.195956 Jan 22 21:27:50.886268 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3804/7311] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:50 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1468 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:51.355327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-639b81ee-5614-48ff-8851-84a64b6a805a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:51.366310 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-639b81ee-5614-48ff-8851-84a64b6a805a tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1525 microversion: 2.1 time: 0.632499 Jan 22 21:27:51.367738 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3508/7312] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:50 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1525 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:27:51.904212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-838d88a6-118c-4bcb-8453-1860a45a3a4a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:51.906974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-838d88a6-118c-4bcb-8453-1860a45a3a4a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:51.915929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-838d88a6-118c-4bcb-8453-1860a45a3a4a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:51.916613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-838d88a6-118c-4bcb-8453-1860a45a3a4a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:51.917439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-838d88a6-118c-4bcb-8453-1860a45a3a4a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:51.917910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-838d88a6-118c-4bcb-8453-1860a45a3a4a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:52.357354 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-838d88a6-118c-4bcb-8453-1860a45a3a4a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1468 microversion: 2.1 time: 0.457639 Jan 22 21:27:52.361859 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3805/7313] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:51 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1468 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:52.400781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-89b4ca9a-a1d4-458f-965d-e8e4fc8b21fb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:52.401665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-89b4ca9a-a1d4-458f-965d-e8e4fc8b21fb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:52.409933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89b4ca9a-a1d4-458f-965d-e8e4fc8b21fb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:52.410702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89b4ca9a-a1d4-458f-965d-e8e4fc8b21fb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:52.411697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89b4ca9a-a1d4-458f-965d-e8e4fc8b21fb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:52.412340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89b4ca9a-a1d4-458f-965d-e8e4fc8b21fb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:52.448077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-223e4842-b783-46ef-b5c5-a96b551a37ef req-ec7bf25d-a801-4ffe-90a9-079883df063f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac840d9b-3179-4fcc-8d58-47094d6ad85c", "name": "network-vif-deleted", "tag": "18513f77-a21a-4b8f-b83b-24ecc957f30f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:27:52.450148 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:27:52.450148 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:27:52.462113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-223e4842-b783-46ef-b5c5-a96b551a37ef req-ec7bf25d-a801-4ffe-90a9-079883df063f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:52.464844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-223e4842-b783-46ef-b5c5-a96b551a37ef req-ec7bf25d-a801-4ffe-90a9-079883df063f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:52.465847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89b4ca9a-a1d4-458f-965d-e8e4fc8b21fb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:52.466534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89b4ca9a-a1d4-458f-965d-e8e4fc8b21fb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:52.467021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-89b4ca9a-a1d4-458f-965d-e8e4fc8b21fb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lazy-loading 'fault' on Instance uuid ac840d9b-3179-4fcc-8d58-47094d6ad85c {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:27:52.540791 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-223e4842-b783-46ef-b5c5-a96b551a37ef req-ec7bf25d-a801-4ffe-90a9-079883df063f service nova] Creating event network-vif-deleted:18513f77-a21a-4b8f-b83b-24ecc957f30f for instance ac840d9b-3179-4fcc-8d58-47094d6ad85c on nch2-master-1 Jan 22 21:27:52.551677 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-223e4842-b783-46ef-b5c5-a96b551a37ef req-ec7bf25d-a801-4ffe-90a9-079883df063f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106027 Jan 22 21:27:52.552911 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3806/7314] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:27:52.580434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-89b4ca9a-a1d4-458f-965d-e8e4fc8b21fb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1e2e6e86ce481f8a8761d163075d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33aa542d613e412b9f8da4e23e5ee160', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:27:52.615953 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-89b4ca9a-a1d4-458f-965d-e8e4fc8b21fb tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 200 len: 1316 microversion: 2.1 time: 0.215106 Jan 22 21:27:52.616612 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3509/7315] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:52 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:53.376173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2494695a-cd3e-40e8-b89c-1bd31da45082 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:53.377563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2494695a-cd3e-40e8-b89c-1bd31da45082 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:53.386586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2494695a-cd3e-40e8-b89c-1bd31da45082 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:53.387489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2494695a-cd3e-40e8-b89c-1bd31da45082 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:53.395130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2494695a-cd3e-40e8-b89c-1bd31da45082 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:53.395841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2494695a-cd3e-40e8-b89c-1bd31da45082 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:53.807000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8efd1f5b-3bfe-4a12-8705-e4ebb29cf6b8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:53.809936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8efd1f5b-3bfe-4a12-8705-e4ebb29cf6b8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] [instance: ac840d9b-3179-4fcc-8d58-47094d6ad85c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:53.822886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8efd1f5b-3bfe-4a12-8705-e4ebb29cf6b8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:53.825131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8efd1f5b-3bfe-4a12-8705-e4ebb29cf6b8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:53.827674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8efd1f5b-3bfe-4a12-8705-e4ebb29cf6b8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:53.829371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8efd1f5b-3bfe-4a12-8705-e4ebb29cf6b8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:53.860858 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-8efd1f5b-3bfe-4a12-8705-e4ebb29cf6b8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] HTTP exception thrown: Instance ac840d9b-3179-4fcc-8d58-47094d6ad85c could not be found. Jan 22 21:27:53.861527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8efd1f5b-3bfe-4a12-8705-e4ebb29cf6b8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] Returning 404 to user: Instance ac840d9b-3179-4fcc-8d58-47094d6ad85c could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:27:53.862780 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8efd1f5b-3bfe-4a12-8705-e4ebb29cf6b8 tempest-ServerRescueNegativeTestJSON-158390040 tempest-ServerRescueNegativeTestJSON-158390040-project] 10.222.0.100 "GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c" status: 404 len: 111 microversion: 2.1 time: 0.062227 Jan 22 21:27:53.863718 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3510/7316] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:53 2022] GET /compute/v2.1/servers/ac840d9b-3179-4fcc-8d58-47094d6ad85c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:27:53.882718 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2494695a-cd3e-40e8-b89c-1bd31da45082 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1468 microversion: 2.1 time: 0.498035 Jan 22 21:27:53.882718 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3807/7317] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:53 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1468 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:54.890916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-56abcd8c-562b-47f2-984d-532bf4314c03 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:54.892240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-56abcd8c-562b-47f2-984d-532bf4314c03 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:54.923097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56abcd8c-562b-47f2-984d-532bf4314c03 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:54.924090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56abcd8c-562b-47f2-984d-532bf4314c03 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:54.927579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56abcd8c-562b-47f2-984d-532bf4314c03 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:54.928225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56abcd8c-562b-47f2-984d-532bf4314c03 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:55.914976 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-56abcd8c-562b-47f2-984d-532bf4314c03 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1468 microversion: 2.1 time: 1.027522 Jan 22 21:27:55.918026 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3511/7318] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:54 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1468 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:56.934986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b9634578-42fb-4bf0-b23c-a89e37218366 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:56.935698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b9634578-42fb-4bf0-b23c-a89e37218366 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:56.945616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9634578-42fb-4bf0-b23c-a89e37218366 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:56.946232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9634578-42fb-4bf0-b23c-a89e37218366 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:56.947201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9634578-42fb-4bf0-b23c-a89e37218366 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:56.947651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b9634578-42fb-4bf0-b23c-a89e37218366 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:57.420078 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b9634578-42fb-4bf0-b23c-a89e37218366 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1468 microversion: 2.1 time: 0.489048 Jan 22 21:27:57.430728 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3808/7319] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:56 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1468 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:57.774359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-94721f50-b6b1-4353-a6ef-0691669ced82 req-7b47ed0a-d5ed-44bf-96cd-b697494c425b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0255fc-7d3c-45f2-b6de-655b09dca4ec", "name": "network-vif-plugged", "status": "completed", "tag": "a0277eb0-7a18-48af-9465-e3e1d07c7179"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:27:57.775896 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:27:57.775896 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:27:57.794642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-94721f50-b6b1-4353-a6ef-0691669ced82 req-7b47ed0a-d5ed-44bf-96cd-b697494c425b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:57.795101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-94721f50-b6b1-4353-a6ef-0691669ced82 req-7b47ed0a-d5ed-44bf-96cd-b697494c425b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:57.807379 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-94721f50-b6b1-4353-a6ef-0691669ced82 req-7b47ed0a-d5ed-44bf-96cd-b697494c425b service nova] Creating event network-vif-plugged:a0277eb0-7a18-48af-9465-e3e1d07c7179 for instance ef0255fc-7d3c-45f2-b6de-655b09dca4ec on nch1-master-1 Jan 22 21:27:57.820600 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-94721f50-b6b1-4353-a6ef-0691669ced82 req-7b47ed0a-d5ed-44bf-96cd-b697494c425b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047679 Jan 22 21:27:57.821964 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3512/7320] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:27:58.439440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1552f6e6-7c56-4fa2-8d4c-35095d588ee9 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:58.442883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1552f6e6-7c56-4fa2-8d4c-35095d588ee9 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:58.457001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1552f6e6-7c56-4fa2-8d4c-35095d588ee9 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:58.457458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1552f6e6-7c56-4fa2-8d4c-35095d588ee9 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:58.458326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1552f6e6-7c56-4fa2-8d4c-35095d588ee9 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:58.458834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1552f6e6-7c56-4fa2-8d4c-35095d588ee9 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:58.842244 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1552f6e6-7c56-4fa2-8d4c-35095d588ee9 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1468 microversion: 2.1 time: 0.407906 Jan 22 21:27:58.848328 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3809/7321] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:58 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1468 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:27:59.860209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5ac86123-d451-40f0-b854-01a642adfdcd tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:27:59.860997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5ac86123-d451-40f0-b854-01a642adfdcd tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:27:59.882352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ac86123-d451-40f0-b854-01a642adfdcd tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:59.884836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ac86123-d451-40f0-b854-01a642adfdcd tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:27:59.890696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ac86123-d451-40f0-b854-01a642adfdcd tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:27:59.890696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ac86123-d451-40f0-b854-01a642adfdcd tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:01.000417 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5ac86123-d451-40f0-b854-01a642adfdcd tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1653 microversion: 2.1 time: 1.144709 Jan 22 21:28:01.001738 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3513/7322] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:27:59 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1653 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:01.020502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-307a29dc-f3e2-4d7a-8373-1f8ec356d0c1 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:01.021914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-307a29dc-f3e2-4d7a-8373-1f8ec356d0c1 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:01.031458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-307a29dc-f3e2-4d7a-8373-1f8ec356d0c1 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:01.032385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-307a29dc-f3e2-4d7a-8373-1f8ec356d0c1 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:01.033587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-307a29dc-f3e2-4d7a-8373-1f8ec356d0c1 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:01.034855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-307a29dc-f3e2-4d7a-8373-1f8ec356d0c1 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:01.380116 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-307a29dc-f3e2-4d7a-8373-1f8ec356d0c1 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1653 microversion: 2.1 time: 0.364421 Jan 22 21:28:01.384184 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3810/7323] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:01 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1653 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:01.415306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-caae4ea6-1085-4213-bcd8-618a4722f745 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:01.416880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-caae4ea6-1085-4213-bcd8-618a4722f745 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:01.427292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-caae4ea6-1085-4213-bcd8-618a4722f745 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:01.427982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-caae4ea6-1085-4213-bcd8-618a4722f745 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:01.428768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-caae4ea6-1085-4213-bcd8-618a4722f745 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:01.429444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-caae4ea6-1085-4213-bcd8-618a4722f745 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:01.450587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a8ce98b6-7f13-4fdc-84bc-554ae376ecb4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:01.451090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a8ce98b6-7f13-4fdc-84bc-554ae376ecb4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:01.458338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8ce98b6-7f13-4fdc-84bc-554ae376ecb4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:01.461546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8ce98b6-7f13-4fdc-84bc-554ae376ecb4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:01.461546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8ce98b6-7f13-4fdc-84bc-554ae376ecb4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:01.461792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8ce98b6-7f13-4fdc-84bc-554ae376ecb4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:01.525325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a8ce98b6-7f13-4fdc-84bc-554ae376ecb4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:28:01.667088 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-caae4ea6-1085-4213-bcd8-618a4722f745 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1653 microversion: 2.1 time: 0.264012 Jan 22 21:28:01.668438 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3514/7324] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:01 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1653 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:01.686341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ad9da1ee-77e5-44c7-9acc-ef7ea82ecb13 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:01.686890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ad9da1ee-77e5-44c7-9acc-ef7ea82ecb13 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:01.697562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad9da1ee-77e5-44c7-9acc-ef7ea82ecb13 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:01.698383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad9da1ee-77e5-44c7-9acc-ef7ea82ecb13 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:01.700046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad9da1ee-77e5-44c7-9acc-ef7ea82ecb13 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:01.701018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad9da1ee-77e5-44c7-9acc-ef7ea82ecb13 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:01.755077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ad9da1ee-77e5-44c7-9acc-ef7ea82ecb13 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:28:02.006427 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a8ce98b6-7f13-4fdc-84bc-554ae376ecb4 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "DELETE /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 204 len: 0 microversion: 2.1 time: 0.560685 Jan 22 21:28:02.007032 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3811/7325] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:28:01 2022] DELETE /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:28:02.016651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4bd45c66-9781-438b-a1c9-1476fbbb39be tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:02.017569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4bd45c66-9781-438b-a1c9-1476fbbb39be tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:02.031003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bd45c66-9781-438b-a1c9-1476fbbb39be tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:02.034180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bd45c66-9781-438b-a1c9-1476fbbb39be tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:02.038871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bd45c66-9781-438b-a1c9-1476fbbb39be tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:02.039338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bd45c66-9781-438b-a1c9-1476fbbb39be tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:02.235572 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ad9da1ee-77e5-44c7-9acc-ef7ea82ecb13 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "DELETE /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 204 len: 0 microversion: 2.1 time: 0.554043 Jan 22 21:28:02.236185 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3515/7326] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:28:01 2022] DELETE /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:28:02.242564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4bd45c66-9781-438b-a1c9-1476fbbb39be tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:02.249881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-08eab396-68a6-4d01-8c26-a669d041f338 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:02.252485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-08eab396-68a6-4d01-8c26-a669d041f338 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:02.263683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08eab396-68a6-4d01-8c26-a669d041f338 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:02.266937 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4bd45c66-9781-438b-a1c9-1476fbbb39be tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1557 microversion: 2.1 time: 0.248488 Jan 22 21:28:02.266937 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3812/7327] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:02 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1557 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:02.267301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08eab396-68a6-4d01-8c26-a669d041f338 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:02.267301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08eab396-68a6-4d01-8c26-a669d041f338 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:02.268565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08eab396-68a6-4d01-8c26-a669d041f338 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:02.546980 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-08eab396-68a6-4d01-8c26-a669d041f338 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1659 microversion: 2.1 time: 0.298364 Jan 22 21:28:02.558523 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3516/7328] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:02 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1659 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:03.297366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f778b2d8-1c39-421d-ae8d-e6e7d5ad6105 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:03.298688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f778b2d8-1c39-421d-ae8d-e6e7d5ad6105 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:03.313301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f778b2d8-1c39-421d-ae8d-e6e7d5ad6105 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:03.313301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f778b2d8-1c39-421d-ae8d-e6e7d5ad6105 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:03.313301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f778b2d8-1c39-421d-ae8d-e6e7d5ad6105 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:03.313301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f778b2d8-1c39-421d-ae8d-e6e7d5ad6105 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:03.566797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1f7e7dad-3763-44ae-a726-0ef3022d1020 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:03.567525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1f7e7dad-3763-44ae-a726-0ef3022d1020 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:03.580469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f7e7dad-3763-44ae-a726-0ef3022d1020 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:03.586772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f7e7dad-3763-44ae-a726-0ef3022d1020 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:03.588187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f7e7dad-3763-44ae-a726-0ef3022d1020 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:03.588848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f7e7dad-3763-44ae-a726-0ef3022d1020 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:03.649392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f778b2d8-1c39-421d-ae8d-e6e7d5ad6105 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:03.663190 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f778b2d8-1c39-421d-ae8d-e6e7d5ad6105 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1557 microversion: 2.1 time: 0.383901 Jan 22 21:28:03.665195 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3813/7329] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:03 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1557 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:04.102763 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1f7e7dad-3763-44ae-a726-0ef3022d1020 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1659 microversion: 2.1 time: 0.536628 Jan 22 21:28:04.102763 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3517/7330] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:03 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1659 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:04.682764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-75b0f35f-c21a-422a-8e93-c18e4866b1f3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:04.683245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-75b0f35f-c21a-422a-8e93-c18e4866b1f3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:04.697183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75b0f35f-c21a-422a-8e93-c18e4866b1f3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:04.697737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75b0f35f-c21a-422a-8e93-c18e4866b1f3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:04.698337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75b0f35f-c21a-422a-8e93-c18e4866b1f3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:04.698780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75b0f35f-c21a-422a-8e93-c18e4866b1f3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:05.035257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-75b0f35f-c21a-422a-8e93-c18e4866b1f3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:05.058927 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-75b0f35f-c21a-422a-8e93-c18e4866b1f3 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1557 microversion: 2.1 time: 0.365648 Jan 22 21:28:05.061427 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3814/7331] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:04 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1557 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:05.154666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-704130b6-95e9-4146-a638-08fb31ff5319 req-78442b84-cac2-4d1e-acc7-d3409fa795ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0255fc-7d3c-45f2-b6de-655b09dca4ec", "name": "network-vif-deleted", "tag": "a0277eb0-7a18-48af-9465-e3e1d07c7179"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:05.156557 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:28:05.156557 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:28:05.183592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-704130b6-95e9-4146-a638-08fb31ff5319 req-78442b84-cac2-4d1e-acc7-d3409fa795ae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:05.183592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-704130b6-95e9-4146-a638-08fb31ff5319 req-78442b84-cac2-4d1e-acc7-d3409fa795ae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:05.207774 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-704130b6-95e9-4146-a638-08fb31ff5319 req-78442b84-cac2-4d1e-acc7-d3409fa795ae service nova] Creating event network-vif-deleted:a0277eb0-7a18-48af-9465-e3e1d07c7179 for instance ef0255fc-7d3c-45f2-b6de-655b09dca4ec on nch1-master-1 Jan 22 21:28:05.213820 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-704130b6-95e9-4146-a638-08fb31ff5319 req-78442b84-cac2-4d1e-acc7-d3409fa795ae service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064376 Jan 22 21:28:05.215330 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3518/7332] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:28:05.225323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6da23a0e-d5a1-4318-ad7b-dd03aed65d1a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:05.234041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6da23a0e-d5a1-4318-ad7b-dd03aed65d1a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:05.248017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6da23a0e-d5a1-4318-ad7b-dd03aed65d1a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:05.248926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6da23a0e-d5a1-4318-ad7b-dd03aed65d1a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:05.249312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6da23a0e-d5a1-4318-ad7b-dd03aed65d1a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:05.249830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6da23a0e-d5a1-4318-ad7b-dd03aed65d1a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:05.356734 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6da23a0e-d5a1-4318-ad7b-dd03aed65d1a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1617 microversion: 2.1 time: 0.136151 Jan 22 21:28:05.357632 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3815/7333] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:05 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1617 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:06.081434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-57e55830-eb89-4761-8447-50b2b2e91366 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:06.081434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-57e55830-eb89-4761-8447-50b2b2e91366 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:06.091721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57e55830-eb89-4761-8447-50b2b2e91366 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:06.092189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57e55830-eb89-4761-8447-50b2b2e91366 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:06.093010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57e55830-eb89-4761-8447-50b2b2e91366 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:06.093463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57e55830-eb89-4761-8447-50b2b2e91366 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:06.190124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57e55830-eb89-4761-8447-50b2b2e91366 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:06.190879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57e55830-eb89-4761-8447-50b2b2e91366 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:06.192134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-57e55830-eb89-4761-8447-50b2b2e91366 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lazy-loading 'fault' on Instance uuid 9948aad5-a378-4dea-8566-8e201f065623 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:28:06.258609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-57e55830-eb89-4761-8447-50b2b2e91366 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:06.277881 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-57e55830-eb89-4761-8447-50b2b2e91366 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 200 len: 1342 microversion: 2.1 time: 0.202779 Jan 22 21:28:06.281053 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3519/7334] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:06 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 1342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:06.376864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8521df3f-903c-416a-b624-7c950fe7bb92 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:06.377789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8521df3f-903c-416a-b624-7c950fe7bb92 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:06.390057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8521df3f-903c-416a-b624-7c950fe7bb92 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:06.392745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8521df3f-903c-416a-b624-7c950fe7bb92 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:06.395151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8521df3f-903c-416a-b624-7c950fe7bb92 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:06.396728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8521df3f-903c-416a-b624-7c950fe7bb92 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:06.445036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8521df3f-903c-416a-b624-7c950fe7bb92 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:06.446083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8521df3f-903c-416a-b624-7c950fe7bb92 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:06.447018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-8521df3f-903c-416a-b624-7c950fe7bb92 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lazy-loading 'fault' on Instance uuid ef0255fc-7d3c-45f2-b6de-655b09dca4ec {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:28:06.509107 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8521df3f-903c-416a-b624-7c950fe7bb92 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 200 len: 1458 microversion: 2.1 time: 0.137994 Jan 22 21:28:06.510134 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3816/7335] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:06 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 1458 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:07.245090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-14e090d5-f07d-4c43-aa70-16778b22c3c1 req-a0f1c114-b7c5-4d02-aa40-93ca5545d4dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9948aad5-a378-4dea-8566-8e201f065623", "name": "network-vif-deleted", "tag": "2b2ae932-7adb-4ffd-b2d8-b5d44cd19f03"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:07.247112 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:28:07.247112 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:28:07.262186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-14e090d5-f07d-4c43-aa70-16778b22c3c1 req-a0f1c114-b7c5-4d02-aa40-93ca5545d4dd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:07.262869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-14e090d5-f07d-4c43-aa70-16778b22c3c1 req-a0f1c114-b7c5-4d02-aa40-93ca5545d4dd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:07.280137 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-14e090d5-f07d-4c43-aa70-16778b22c3c1 req-a0f1c114-b7c5-4d02-aa40-93ca5545d4dd service nova] Creating event network-vif-deleted:2b2ae932-7adb-4ffd-b2d8-b5d44cd19f03 for instance 9948aad5-a378-4dea-8566-8e201f065623 on nch2-master-1 Jan 22 21:28:07.286059 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-14e090d5-f07d-4c43-aa70-16778b22c3c1 req-a0f1c114-b7c5-4d02-aa40-93ca5545d4dd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044264 Jan 22 21:28:07.287515 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3520/7336] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:28:07.308302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7f261a75-d8a5-4984-a583-3fcc81cb541c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:07.308962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7f261a75-d8a5-4984-a583-3fcc81cb541c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 9948aad5-a378-4dea-8566-8e201f065623] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:07.324479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f261a75-d8a5-4984-a583-3fcc81cb541c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:07.324948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f261a75-d8a5-4984-a583-3fcc81cb541c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:07.325793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f261a75-d8a5-4984-a583-3fcc81cb541c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:07.329816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f261a75-d8a5-4984-a583-3fcc81cb541c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:07.353964 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-7f261a75-d8a5-4984-a583-3fcc81cb541c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] HTTP exception thrown: Instance 9948aad5-a378-4dea-8566-8e201f065623 could not be found. Jan 22 21:28:07.353964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7f261a75-d8a5-4984-a583-3fcc81cb541c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Returning 404 to user: Instance 9948aad5-a378-4dea-8566-8e201f065623 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:28:07.354601 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7f261a75-d8a5-4984-a583-3fcc81cb541c tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623" status: 404 len: 111 microversion: 2.1 time: 0.052398 Jan 22 21:28:07.355367 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3817/7337] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:07 2022] GET /compute/v2.1/servers/9948aad5-a378-4dea-8566-8e201f065623 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:28:07.529782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b10b05e2-4df1-4e2a-a3c5-c0e26e671ca3 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:07.530795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b10b05e2-4df1-4e2a-a3c5-c0e26e671ca3 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: ef0255fc-7d3c-45f2-b6de-655b09dca4ec] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:07.543966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b10b05e2-4df1-4e2a-a3c5-c0e26e671ca3 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:07.544442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b10b05e2-4df1-4e2a-a3c5-c0e26e671ca3 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:07.545346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b10b05e2-4df1-4e2a-a3c5-c0e26e671ca3 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:07.545827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b10b05e2-4df1-4e2a-a3c5-c0e26e671ca3 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:07.579673 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-b10b05e2-4df1-4e2a-a3c5-c0e26e671ca3 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] HTTP exception thrown: Instance ef0255fc-7d3c-45f2-b6de-655b09dca4ec could not be found. Jan 22 21:28:07.579673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b10b05e2-4df1-4e2a-a3c5-c0e26e671ca3 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Returning 404 to user: Instance ef0255fc-7d3c-45f2-b6de-655b09dca4ec could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:28:07.579673 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b10b05e2-4df1-4e2a-a3c5-c0e26e671ca3 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec" status: 404 len: 111 microversion: 2.1 time: 0.052003 Jan 22 21:28:07.579673 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3521/7338] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:07 2022] GET /compute/v2.1/servers/ef0255fc-7d3c-45f2-b6de-655b09dca4ec => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:28:07.587635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0bca977c-749d-4784-938d-30aeb494ac5a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:07.588749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0bca977c-749d-4784-938d-30aeb494ac5a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:07.596939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bca977c-749d-4784-938d-30aeb494ac5a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:07.598757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bca977c-749d-4784-938d-30aeb494ac5a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:07.599903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bca977c-749d-4784-938d-30aeb494ac5a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:07.600532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bca977c-749d-4784-938d-30aeb494ac5a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:07.643279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0bca977c-749d-4784-938d-30aeb494ac5a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:28:08.046399 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0bca977c-749d-4784-938d-30aeb494ac5a tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "DELETE /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 204 len: 0 microversion: 2.1 time: 0.462396 Jan 22 21:28:08.047014 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3818/7339] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:28:07 2022] DELETE /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:28:08.058012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2276ecf9-5f1c-4e8a-9e70-6f77228ff3a5 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:08.058995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2276ecf9-5f1c-4e8a-9e70-6f77228ff3a5 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:08.070974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2276ecf9-5f1c-4e8a-9e70-6f77228ff3a5 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:08.072278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2276ecf9-5f1c-4e8a-9e70-6f77228ff3a5 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:08.072936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2276ecf9-5f1c-4e8a-9e70-6f77228ff3a5 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:08.073753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2276ecf9-5f1c-4e8a-9e70-6f77228ff3a5 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:08.578635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ca694879-e406-454e-986f-5bf3c73c6a5d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '.version_select at 0x7f1ed61775e0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:08.618292 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2276ecf9-5f1c-4e8a-9e70-6f77228ff3a5 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1657 microversion: 2.1 time: 0.565995 Jan 22 21:28:08.623603 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3522/7340] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:08 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1657 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:08.681781 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ca694879-e406-454e-986f-5bf3c73c6a5d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1592314114" status: 202 len: 0 microversion: 2.1 time: 0.108471 Jan 22 21:28:08.685680 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3819/7341] 10.222.0.100 () {58 vars in 1261 bytes} [Sat Jan 22 21:28:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1592314114 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:28:09.640260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-04f7b871-3da9-4604-8127-f8b85e5a6337 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:09.640836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-04f7b871-3da9-4604-8127-f8b85e5a6337 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:09.652279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04f7b871-3da9-4604-8127-f8b85e5a6337 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:09.657901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04f7b871-3da9-4604-8127-f8b85e5a6337 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:09.657901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04f7b871-3da9-4604-8127-f8b85e5a6337 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:09.657901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-04f7b871-3da9-4604-8127-f8b85e5a6337 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:10.211388 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-04f7b871-3da9-4604-8127-f8b85e5a6337 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1657 microversion: 2.1 time: 0.574700 Jan 22 21:28:10.211971 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3523/7342] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:09 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1657 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:10.929218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-42fffe90-8d6e-45de-ae10-c410865471f4 req-a943c724-e7a6-488c-bc61-bbe3627629c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0190f72d-8dc0-49d0-ba97-bfaefbc4093f", "name": "network-vif-deleted", "tag": "e9eafc73-c205-4111-8f99-fcaddd676b4f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:10.930938 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:28:10.930938 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:28:10.950579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-42fffe90-8d6e-45de-ae10-c410865471f4 req-a943c724-e7a6-488c-bc61-bbe3627629c9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:10.950579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-42fffe90-8d6e-45de-ae10-c410865471f4 req-a943c724-e7a6-488c-bc61-bbe3627629c9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:10.966353 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-42fffe90-8d6e-45de-ae10-c410865471f4 req-a943c724-e7a6-488c-bc61-bbe3627629c9 service nova] Creating event network-vif-deleted:e9eafc73-c205-4111-8f99-fcaddd676b4f for instance 0190f72d-8dc0-49d0-ba97-bfaefbc4093f on nch2-master-1 Jan 22 21:28:10.981455 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-42fffe90-8d6e-45de-ae10-c410865471f4 req-a943c724-e7a6-488c-bc61-bbe3627629c9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056104 Jan 22 21:28:10.982692 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3524/7343] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:28:11.180824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-948649215", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "c0ae182f-b701-486f-8425-cc765e27410d"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:11.229214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ebca881-8cde-44fb-aa80-fc29fa23ffcb tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:11.232246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1ebca881-8cde-44fb-aa80-fc29fa23ffcb tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:11.247480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ebca881-8cde-44fb-aa80-fc29fa23ffcb tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:11.248225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ebca881-8cde-44fb-aa80-fc29fa23ffcb tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:11.249814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ebca881-8cde-44fb-aa80-fc29fa23ffcb tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:11.254422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ebca881-8cde-44fb-aa80-fc29fa23ffcb tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:11.265225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] validate_networks() for [('c0ae182f-b701-486f-8425-cc765e27410d', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:28:11.323106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ebca881-8cde-44fb-aa80-fc29fa23ffcb tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:11.323911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ebca881-8cde-44fb-aa80-fc29fa23ffcb tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:11.324527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-1ebca881-8cde-44fb-aa80-fc29fa23ffcb tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lazy-loading 'fault' on Instance uuid 0190f72d-8dc0-49d0-ba97-bfaefbc4093f {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:28:11.426591 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1ebca881-8cde-44fb-aa80-fc29fa23ffcb tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 200 len: 1457 microversion: 2.1 time: 0.201803 Jan 22 21:28:11.430053 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3525/7344] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:11 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 1457 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:28:11.808536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:28:11.809483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:28:11.810381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:28:11.811015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:28:11.811542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:28:11.821993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:11.824075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:11.824075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:11.824654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:11.848512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Getting quotas for project 4a61bb11aef749ecbbe18f381db4a041. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:28:11.854840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Getting quotas for user be417c0e17f546699a2387d02f6f28e9 and project 4a61bb11aef749ecbbe18f381db4a041. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:28:11.870316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:28:11.873198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:28:12.166448 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d9735c2a-0222-428a-a7a4-e5b623fb464c tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.309484 Jan 22 21:28:12.171044 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3820/7345] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:28:10 2022] POST /compute/v2.1/servers => generated 382 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:28:12.179816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d7bafd41-dd6b-4da7-a631-2f906c5d7a86 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:12.180445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d7bafd41-dd6b-4da7-a631-2f906c5d7a86 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:12.450452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-69384164-266e-4293-a46d-70349ae08316 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:12.451318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-69384164-266e-4293-a46d-70349ae08316 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] [instance: 0190f72d-8dc0-49d0-ba97-bfaefbc4093f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:12.467957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69384164-266e-4293-a46d-70349ae08316 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:12.473389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69384164-266e-4293-a46d-70349ae08316 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:12.473389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69384164-266e-4293-a46d-70349ae08316 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:12.473389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69384164-266e-4293-a46d-70349ae08316 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:12.474961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d7bafd41-dd6b-4da7-a631-2f906c5d7a86 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:12.490986 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d7bafd41-dd6b-4da7-a631-2f906c5d7a86 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1231 microversion: 2.1 time: 0.314781 Jan 22 21:28:12.508223 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3526/7346] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:12 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1231 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:12.508386 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-69384164-266e-4293-a46d-70349ae08316 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] HTTP exception thrown: Instance 0190f72d-8dc0-49d0-ba97-bfaefbc4093f could not be found. Jan 22 21:28:12.508386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-69384164-266e-4293-a46d-70349ae08316 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] Returning 404 to user: Instance 0190f72d-8dc0-49d0-ba97-bfaefbc4093f could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:28:12.508386 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-69384164-266e-4293-a46d-70349ae08316 tempest-TestServerMultinode-1677530552 tempest-TestServerMultinode-1677530552-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f" status: 404 len: 111 microversion: 2.1 time: 0.059534 Jan 22 21:28:12.509218 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3821/7347] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:12 2022] GET /compute/v2.1/servers/0190f72d-8dc0-49d0-ba97-bfaefbc4093f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:28:13.515706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-36cd1f04-0ca0-4984-8836-94b7e9b68fc1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:13.516855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-36cd1f04-0ca0-4984-8836-94b7e9b68fc1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:13.627763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-36cd1f04-0ca0-4984-8836-94b7e9b68fc1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:13.637689 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-36cd1f04-0ca0-4984-8836-94b7e9b68fc1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1231 microversion: 2.1 time: 0.125943 Jan 22 21:28:13.638928 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3527/7348] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:13 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1231 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:13.858903 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:28:13.859410 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 21:28:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:28:14.010502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-3826503a-a56a-4967-95b1-61f385c05086 req-4236e7a3-8ef8-4455-a726-03ea71979a59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33b40b35-505b-4258-aa2a-123597f6bcde", "tag": "a3c778a0-a263-4ea2-b05d-86a39189bf83"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:14.012082 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:28:14.012082 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:28:14.015263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a3a2a591-34bf-4262-8da2-83eaf140b334 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:14.018899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a3a2a591-34bf-4262-8da2-83eaf140b334 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:14.027248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3826503a-a56a-4967-95b1-61f385c05086 req-4236e7a3-8ef8-4455-a726-03ea71979a59 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:14.030069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3826503a-a56a-4967-95b1-61f385c05086 req-4236e7a3-8ef8-4455-a726-03ea71979a59 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:14.031426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3a2a591-34bf-4262-8da2-83eaf140b334 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:14.033773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3a2a591-34bf-4262-8da2-83eaf140b334 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:14.034928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3a2a591-34bf-4262-8da2-83eaf140b334 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:14.037860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3a2a591-34bf-4262-8da2-83eaf140b334 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:14.062487 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-3826503a-a56a-4967-95b1-61f385c05086 req-4236e7a3-8ef8-4455-a726-03ea71979a59 service nova] Creating event network-changed:a3c778a0-a263-4ea2-b05d-86a39189bf83 for instance 33b40b35-505b-4258-aa2a-123597f6bcde on nch1-master-1 Jan 22 21:28:14.072833 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-3826503a-a56a-4967-95b1-61f385c05086 req-4236e7a3-8ef8-4455-a726-03ea71979a59 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065861 Jan 22 21:28:14.078127 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3528/7349] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:28:14.092228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a3a2a591-34bf-4262-8da2-83eaf140b334 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:28:14.657405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-43e97848-3568-4aea-89b2-8bedcb2df7b6 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:14.658234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-43e97848-3568-4aea-89b2-8bedcb2df7b6 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:14.663254 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a3a2a591-34bf-4262-8da2-83eaf140b334 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "DELETE /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 204 len: 0 microversion: 2.1 time: 0.660638 Jan 22 21:28:14.671867 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3822/7350] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:28:13 2022] DELETE /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 0 bytes in 669 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:28:14.675119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43e97848-3568-4aea-89b2-8bedcb2df7b6 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:14.675587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43e97848-3568-4aea-89b2-8bedcb2df7b6 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:14.676400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43e97848-3568-4aea-89b2-8bedcb2df7b6 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:14.676849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43e97848-3568-4aea-89b2-8bedcb2df7b6 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:14.678140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-67c92eb8-94d4-43e6-ab03-4a79b3ce59c7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:14.678965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-67c92eb8-94d4-43e6-ab03-4a79b3ce59c7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:14.692391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67c92eb8-94d4-43e6-ab03-4a79b3ce59c7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:14.692864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67c92eb8-94d4-43e6-ab03-4a79b3ce59c7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:14.693741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67c92eb8-94d4-43e6-ab03-4a79b3ce59c7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:14.699819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67c92eb8-94d4-43e6-ab03-4a79b3ce59c7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:14.831312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-43e97848-3568-4aea-89b2-8bedcb2df7b6 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:14.849353 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-43e97848-3568-4aea-89b2-8bedcb2df7b6 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1227 microversion: 2.1 time: 0.197860 Jan 22 21:28:14.850026 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3529/7351] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:14 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1227 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:14.990997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-67c92eb8-94d4-43e6-ab03-4a79b3ce59c7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:15.003569 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-67c92eb8-94d4-43e6-ab03-4a79b3ce59c7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1673 microversion: 2.1 time: 0.330924 Jan 22 21:28:15.006284 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3823/7352] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:14 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1673 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:15.868077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-291e7382-7141-4f81-afbb-cb2acece8b63 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:15.879817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-291e7382-7141-4f81-afbb-cb2acece8b63 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:15.885154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-291e7382-7141-4f81-afbb-cb2acece8b63 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:15.885643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-291e7382-7141-4f81-afbb-cb2acece8b63 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:15.886459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-291e7382-7141-4f81-afbb-cb2acece8b63 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:15.886902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-291e7382-7141-4f81-afbb-cb2acece8b63 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:16.022476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b818494b-4186-4214-a662-4fc2f35fb454 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:16.023716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b818494b-4186-4214-a662-4fc2f35fb454 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:16.039023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b818494b-4186-4214-a662-4fc2f35fb454 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:16.039713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b818494b-4186-4214-a662-4fc2f35fb454 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:16.040716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b818494b-4186-4214-a662-4fc2f35fb454 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:16.041332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b818494b-4186-4214-a662-4fc2f35fb454 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:16.079736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-291e7382-7141-4f81-afbb-cb2acece8b63 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:16.096786 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-291e7382-7141-4f81-afbb-cb2acece8b63 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1291 microversion: 2.1 time: 0.233205 Jan 22 21:28:16.097409 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3530/7353] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:15 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1291 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:16.428830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b818494b-4186-4214-a662-4fc2f35fb454 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:16.443065 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b818494b-4186-4214-a662-4fc2f35fb454 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1673 microversion: 2.1 time: 0.424207 Jan 22 21:28:16.444060 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3824/7354] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:16 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1673 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:28:17.118778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-885176ed-7bbb-4f06-b683-425c8907fdcb tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:17.119370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-885176ed-7bbb-4f06-b683-425c8907fdcb tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:17.129279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-885176ed-7bbb-4f06-b683-425c8907fdcb tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:17.129279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-885176ed-7bbb-4f06-b683-425c8907fdcb tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:17.129279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-885176ed-7bbb-4f06-b683-425c8907fdcb tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:17.130060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-885176ed-7bbb-4f06-b683-425c8907fdcb tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:17.284801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-885176ed-7bbb-4f06-b683-425c8907fdcb tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:17.305674 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-885176ed-7bbb-4f06-b683-425c8907fdcb tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1289 microversion: 2.1 time: 0.190473 Jan 22 21:28:17.306714 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3531/7355] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:17 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1289 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:17.462579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7676a525-8c8b-467b-b6f8-3d14159da81d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:17.464683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7676a525-8c8b-467b-b6f8-3d14159da81d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:17.472262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7676a525-8c8b-467b-b6f8-3d14159da81d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:17.481370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7676a525-8c8b-467b-b6f8-3d14159da81d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:17.481370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7676a525-8c8b-467b-b6f8-3d14159da81d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:17.481370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7676a525-8c8b-467b-b6f8-3d14159da81d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:17.947463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7676a525-8c8b-467b-b6f8-3d14159da81d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:17.961866 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7676a525-8c8b-467b-b6f8-3d14159da81d tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1555 microversion: 2.1 time: 0.502475 Jan 22 21:28:17.963442 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3825/7356] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:17 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1555 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:18.026099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-e3eb361d-d382-4dba-ba56-a6b8dc4d0581 req-9a13e90d-64f5-49c5-8e7f-e9fecf02e228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b40b35-505b-4258-aa2a-123597f6bcde", "name": "network-vif-deleted", "tag": "a3c778a0-a263-4ea2-b05d-86a39189bf83"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:18.027004 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:28:18.027004 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:28:18.043622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e3eb361d-d382-4dba-ba56-a6b8dc4d0581 req-9a13e90d-64f5-49c5-8e7f-e9fecf02e228 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:18.046825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e3eb361d-d382-4dba-ba56-a6b8dc4d0581 req-9a13e90d-64f5-49c5-8e7f-e9fecf02e228 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:18.077536 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-e3eb361d-d382-4dba-ba56-a6b8dc4d0581 req-9a13e90d-64f5-49c5-8e7f-e9fecf02e228 service nova] Creating event network-vif-deleted:a3c778a0-a263-4ea2-b05d-86a39189bf83 for instance 33b40b35-505b-4258-aa2a-123597f6bcde on nch1-master-1 Jan 22 21:28:18.089399 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-e3eb361d-d382-4dba-ba56-a6b8dc4d0581 req-9a13e90d-64f5-49c5-8e7f-e9fecf02e228 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087568 Jan 22 21:28:18.102454 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3532/7357] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:28:18.326193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9f6b97f6-6d85-4f3b-aa7c-21fb1071c0a1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:18.326193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9f6b97f6-6d85-4f3b-aa7c-21fb1071c0a1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:18.337152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f6b97f6-6d85-4f3b-aa7c-21fb1071c0a1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:18.338744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f6b97f6-6d85-4f3b-aa7c-21fb1071c0a1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:18.339864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f6b97f6-6d85-4f3b-aa7c-21fb1071c0a1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:18.342075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f6b97f6-6d85-4f3b-aa7c-21fb1071c0a1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:18.981450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d51cc5d0-8595-49de-af85-a34534572789 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:18.982968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d51cc5d0-8595-49de-af85-a34534572789 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:18.992827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d51cc5d0-8595-49de-af85-a34534572789 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:18.995213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d51cc5d0-8595-49de-af85-a34534572789 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:18.996384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d51cc5d0-8595-49de-af85-a34534572789 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:18.997352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d51cc5d0-8595-49de-af85-a34534572789 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:19.044427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d51cc5d0-8595-49de-af85-a34534572789 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:19.046671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d51cc5d0-8595-49de-af85-a34534572789 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:19.047752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-d51cc5d0-8595-49de-af85-a34534572789 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lazy-loading 'fault' on Instance uuid 33b40b35-505b-4258-aa2a-123597f6bcde {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:28:19.096443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9f6b97f6-6d85-4f3b-aa7c-21fb1071c0a1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:19.111522 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9f6b97f6-6d85-4f3b-aa7c-21fb1071c0a1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1331 microversion: 2.1 time: 0.791365 Jan 22 21:28:19.112659 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3826/7358] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:18 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1331 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:19.130493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d51cc5d0-8595-49de-af85-a34534572789 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:19.157655 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d51cc5d0-8595-49de-af85-a34534572789 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 200 len: 1342 microversion: 2.1 time: 0.180252 Jan 22 21:28:19.171505 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3533/7359] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:18 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 1342 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:20.132670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8ce3ebb7-19db-446d-951a-5090062c6048 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:20.133411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8ce3ebb7-19db-446d-951a-5090062c6048 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:20.148671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ce3ebb7-19db-446d-951a-5090062c6048 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:20.148671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ce3ebb7-19db-446d-951a-5090062c6048 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:20.148671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ce3ebb7-19db-446d-951a-5090062c6048 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:20.150631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ce3ebb7-19db-446d-951a-5090062c6048 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:20.163168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-5bd93113-e2df-401a-90b9-619ea82331a5 req-ffcfece3-96a1-4aaf-83d0-60bbbe27a758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f23a906-1762-4922-8021-8a08514c6e52", "tag": "995db515-224a-4b04-9aac-b70ec2b1289c"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:20.166959 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:28:20.166959 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:28:20.186096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5bd93113-e2df-401a-90b9-619ea82331a5 req-ffcfece3-96a1-4aaf-83d0-60bbbe27a758 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:20.186862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5bd93113-e2df-401a-90b9-619ea82331a5 req-ffcfece3-96a1-4aaf-83d0-60bbbe27a758 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:20.205238 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-5bd93113-e2df-401a-90b9-619ea82331a5 req-ffcfece3-96a1-4aaf-83d0-60bbbe27a758 service nova] Creating event network-changed:995db515-224a-4b04-9aac-b70ec2b1289c for instance 5f23a906-1762-4922-8021-8a08514c6e52 on nch2-master-1 Jan 22 21:28:20.220520 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-5bd93113-e2df-401a-90b9-619ea82331a5 req-ffcfece3-96a1-4aaf-83d0-60bbbe27a758 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054426 Jan 22 21:28:20.220520 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3534/7360] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:28:20.223327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-76d33811-8da9-492f-a294-59c98b709e52 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:20.224513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-76d33811-8da9-492f-a294-59c98b709e52 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 33b40b35-505b-4258-aa2a-123597f6bcde] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:20.237475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76d33811-8da9-492f-a294-59c98b709e52 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:20.238951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76d33811-8da9-492f-a294-59c98b709e52 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:20.241256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76d33811-8da9-492f-a294-59c98b709e52 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:20.241992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76d33811-8da9-492f-a294-59c98b709e52 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:20.260706 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-76d33811-8da9-492f-a294-59c98b709e52 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] HTTP exception thrown: Instance 33b40b35-505b-4258-aa2a-123597f6bcde could not be found. Jan 22 21:28:20.262351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-76d33811-8da9-492f-a294-59c98b709e52 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Returning 404 to user: Instance 33b40b35-505b-4258-aa2a-123597f6bcde could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:28:20.270616 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-76d33811-8da9-492f-a294-59c98b709e52 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde" status: 404 len: 111 microversion: 2.1 time: 0.046466 Jan 22 21:28:20.276745 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3535/7361] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:20 2022] GET /compute/v2.1/servers/33b40b35-505b-4258-aa2a-123597f6bcde => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:28:20.856712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8ce3ebb7-19db-446d-951a-5090062c6048 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:20.888044 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8ce3ebb7-19db-446d-951a-5090062c6048 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1331 microversion: 2.1 time: 0.763510 Jan 22 21:28:20.889740 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3827/7362] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:20 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1331 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:21.051357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d5fd45e9-92c8-42a3-9edb-828475fbee29 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '.version_select at 0x7f1ed51a0700>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:21.167933 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d5fd45e9-92c8-42a3-9edb-828475fbee29 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-575367562" status: 202 len: 0 microversion: 2.1 time: 0.122635 Jan 22 21:28:21.172588 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3536/7363] 10.222.0.100 () {58 vars in 1258 bytes} [Sat Jan 22 21:28:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-575367562 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:28:21.909609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5233975e-d09a-43d8-869d-4cd43b532b9f tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:21.909609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5233975e-d09a-43d8-869d-4cd43b532b9f tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:21.918203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5233975e-d09a-43d8-869d-4cd43b532b9f tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:21.918955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5233975e-d09a-43d8-869d-4cd43b532b9f tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:21.920450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5233975e-d09a-43d8-869d-4cd43b532b9f tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:21.921132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5233975e-d09a-43d8-869d-4cd43b532b9f tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:22.223440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5233975e-d09a-43d8-869d-4cd43b532b9f tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:22.249146 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5233975e-d09a-43d8-869d-4cd43b532b9f tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1331 microversion: 2.1 time: 0.346525 Jan 22 21:28:22.249819 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3828/7364] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:21 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1331 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:23.268795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cd87dfb4-6415-4a07-881b-2b170257c31e tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:23.269662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cd87dfb4-6415-4a07-881b-2b170257c31e tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:23.293217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd87dfb4-6415-4a07-881b-2b170257c31e tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:23.293850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd87dfb4-6415-4a07-881b-2b170257c31e tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:23.301193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd87dfb4-6415-4a07-881b-2b170257c31e tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:23.301900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd87dfb4-6415-4a07-881b-2b170257c31e tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:24.149743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1b56b529-e7c1-4d4f-b643-30b493790d73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:24.151401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1b56b529-e7c1-4d4f-b643-30b493790d73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:24.158078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b56b529-e7c1-4d4f-b643-30b493790d73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:24.158551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b56b529-e7c1-4d4f-b643-30b493790d73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:24.159355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b56b529-e7c1-4d4f-b643-30b493790d73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:24.159998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b56b529-e7c1-4d4f-b643-30b493790d73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:24.183191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cd87dfb4-6415-4a07-881b-2b170257c31e tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:24.191637 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cd87dfb4-6415-4a07-881b-2b170257c31e tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1331 microversion: 2.1 time: 0.928905 Jan 22 21:28:24.192229 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3537/7365] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:23 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1331 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:24.216758 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1b56b529-e7c1-4d4f-b643-30b493790d73 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action" status: 200 len: 32494 microversion: 2.32 time: 0.247195 Jan 22 21:28:24.217397 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3829/7366] 10.222.0.100 () {62 vars in 1323 bytes} [Sat Jan 22 21:28:23 2022] POST /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363/action => generated 32494 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:28:24.234655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4745ceca-f282-4fbd-baa5-a3500e8be8bc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:24.235017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4745ceca-f282-4fbd-baa5-a3500e8be8bc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:24.245550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4745ceca-f282-4fbd-baa5-a3500e8be8bc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:24.246082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4745ceca-f282-4fbd-baa5-a3500e8be8bc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:24.246898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4745ceca-f282-4fbd-baa5-a3500e8be8bc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:24.247435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4745ceca-f282-4fbd-baa5-a3500e8be8bc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:24.275584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4745ceca-f282-4fbd-baa5-a3500e8be8bc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:28:24.661849 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4745ceca-f282-4fbd-baa5-a3500e8be8bc tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "DELETE /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 204 len: 0 microversion: 2.32 time: 0.432688 Jan 22 21:28:24.662593 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3538/7367] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:28:24 2022] DELETE /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:28:24.671836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0695c3aa-4513-4898-b80c-4738988e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:24.674493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0695c3aa-4513-4898-b80c-4738988e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:24.680809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0695c3aa-4513-4898-b80c-4738988e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:24.681272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0695c3aa-4513-4898-b80c-4738988e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:24.682121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0695c3aa-4513-4898-b80c-4738988e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:24.682571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0695c3aa-4513-4898-b80c-4738988e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:25.160717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0695c3aa-4513-4898-b80c-4738988e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:25.197267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0695c3aa-4513-4898-b80c-4738988e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:25.209619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96478761-ae1d-412b-b19a-44dc2037a214 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:25.210652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96478761-ae1d-412b-b19a-44dc2037a214 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:25.212635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0695c3aa-4513-4898-b80c-4738988e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:25.214428 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0695c3aa-4513-4898-b80c-4738988e718b tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 2954 microversion: 2.32 time: 0.546731 Jan 22 21:28:25.223518 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3830/7368] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:28:24 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 2954 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:28:25.249063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96478761-ae1d-412b-b19a-44dc2037a214 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:25.251608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96478761-ae1d-412b-b19a-44dc2037a214 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:25.260962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96478761-ae1d-412b-b19a-44dc2037a214 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:25.261728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96478761-ae1d-412b-b19a-44dc2037a214 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:25.747329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-96478761-ae1d-412b-b19a-44dc2037a214 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:25.765188 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96478761-ae1d-412b-b19a-44dc2037a214 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1331 microversion: 2.1 time: 0.560225 Jan 22 21:28:25.776600 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3539/7369] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:25 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1331 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:28:26.236149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fa103e36-70f4-4ca7-9ed9-2e473ca2fdf6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:26.237485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fa103e36-70f4-4ca7-9ed9-2e473ca2fdf6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:26.259105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa103e36-70f4-4ca7-9ed9-2e473ca2fdf6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:26.261333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa103e36-70f4-4ca7-9ed9-2e473ca2fdf6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:26.263943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa103e36-70f4-4ca7-9ed9-2e473ca2fdf6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:26.264647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa103e36-70f4-4ca7-9ed9-2e473ca2fdf6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:26.790398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9471b2f4-1f80-4f60-84b4-ca0aa139ba62 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:26.791165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9471b2f4-1f80-4f60-84b4-ca0aa139ba62 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:26.798430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9471b2f4-1f80-4f60-84b4-ca0aa139ba62 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:26.799186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9471b2f4-1f80-4f60-84b4-ca0aa139ba62 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:26.801738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9471b2f4-1f80-4f60-84b4-ca0aa139ba62 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:26.803619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9471b2f4-1f80-4f60-84b4-ca0aa139ba62 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:26.981549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fa103e36-70f4-4ca7-9ed9-2e473ca2fdf6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:26.997264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fa103e36-70f4-4ca7-9ed9-2e473ca2fdf6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:26.999588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fa103e36-70f4-4ca7-9ed9-2e473ca2fdf6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:27.033591 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fa103e36-70f4-4ca7-9ed9-2e473ca2fdf6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 2954 microversion: 2.32 time: 0.770392 Jan 22 21:28:27.057877 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3831/7370] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:28:26 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 2954 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:28:28.051075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9471b2f4-1f80-4f60-84b4-ca0aa139ba62 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:28.056186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4c41b7e4-7aec-40f2-b971-e830d7bed8ff tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:28.056811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4c41b7e4-7aec-40f2-b971-e830d7bed8ff tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:28.058096 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9471b2f4-1f80-4f60-84b4-ca0aa139ba62 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1331 microversion: 2.1 time: 1.280137 Jan 22 21:28:28.058975 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3540/7371] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:26 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1331 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:28.086071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c41b7e4-7aec-40f2-b971-e830d7bed8ff tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:28.086071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c41b7e4-7aec-40f2-b971-e830d7bed8ff tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:28.086071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c41b7e4-7aec-40f2-b971-e830d7bed8ff tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:28.086071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c41b7e4-7aec-40f2-b971-e830d7bed8ff tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:28.926838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4c41b7e4-7aec-40f2-b971-e830d7bed8ff tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:28.944873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4c41b7e4-7aec-40f2-b971-e830d7bed8ff tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:28.948395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4c41b7e4-7aec-40f2-b971-e830d7bed8ff tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:28.962636 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4c41b7e4-7aec-40f2-b971-e830d7bed8ff tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 2954 microversion: 2.32 time: 0.897406 Jan 22 21:28:28.962636 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3832/7372] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:28:28 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 2954 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:28:29.075258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab7a3386-35af-4144-b9e9-fb87fa9c9ab4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:29.076713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab7a3386-35af-4144-b9e9-fb87fa9c9ab4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:29.088549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab7a3386-35af-4144-b9e9-fb87fa9c9ab4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:29.089625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab7a3386-35af-4144-b9e9-fb87fa9c9ab4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:29.092213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab7a3386-35af-4144-b9e9-fb87fa9c9ab4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:29.092745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab7a3386-35af-4144-b9e9-fb87fa9c9ab4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:29.363409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-00d1b72b-c749-49e6-9e65-fd7bf351bf6b req-fd4f8210-59cd-4605-beff-e45ded95eefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f23a906-1762-4922-8021-8a08514c6e52", "name": "network-vif-plugged", "status": "completed", "tag": "995db515-224a-4b04-9aac-b70ec2b1289c"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:29.365263 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:28:29.365263 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:28:29.393286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-00d1b72b-c749-49e6-9e65-fd7bf351bf6b req-fd4f8210-59cd-4605-beff-e45ded95eefd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:29.393985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-00d1b72b-c749-49e6-9e65-fd7bf351bf6b req-fd4f8210-59cd-4605-beff-e45ded95eefd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:29.409218 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-00d1b72b-c749-49e6-9e65-fd7bf351bf6b req-fd4f8210-59cd-4605-beff-e45ded95eefd service nova] Creating event network-vif-plugged:995db515-224a-4b04-9aac-b70ec2b1289c for instance 5f23a906-1762-4922-8021-8a08514c6e52 on nch2-master-1 Jan 22 21:28:29.417621 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-00d1b72b-c749-49e6-9e65-fd7bf351bf6b req-fd4f8210-59cd-4605-beff-e45ded95eefd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055803 Jan 22 21:28:29.418713 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3833/7373] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:28:29.824350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab7a3386-35af-4144-b9e9-fb87fa9c9ab4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:29.853037 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab7a3386-35af-4144-b9e9-fb87fa9c9ab4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1331 microversion: 2.1 time: 0.781371 Jan 22 21:28:29.853947 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3541/7374] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:29 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1331 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:29.975805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-729d3ba8-d504-41e3-ae09-54336948eda1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:29.976513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-729d3ba8-d504-41e3-ae09-54336948eda1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:29.990130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-729d3ba8-d504-41e3-ae09-54336948eda1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:29.990130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-729d3ba8-d504-41e3-ae09-54336948eda1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:29.990130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-729d3ba8-d504-41e3-ae09-54336948eda1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:29.990130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-729d3ba8-d504-41e3-ae09-54336948eda1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:30.420378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-729d3ba8-d504-41e3-ae09-54336948eda1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:30.442599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-729d3ba8-d504-41e3-ae09-54336948eda1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:30.452384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-729d3ba8-d504-41e3-ae09-54336948eda1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:30.452384 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-729d3ba8-d504-41e3-ae09-54336948eda1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 2933 microversion: 2.32 time: 0.477994 Jan 22 21:28:30.454708 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3834/7375] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:28:29 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 2933 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:28:30.872585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6b2a2d15-4be6-46ae-8715-04b2fa10ccd4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:30.873952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6b2a2d15-4be6-46ae-8715-04b2fa10ccd4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:30.886306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b2a2d15-4be6-46ae-8715-04b2fa10ccd4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:30.896290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b2a2d15-4be6-46ae-8715-04b2fa10ccd4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:30.900679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b2a2d15-4be6-46ae-8715-04b2fa10ccd4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:30.900679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b2a2d15-4be6-46ae-8715-04b2fa10ccd4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:31.448540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-4656e408-1413-4c96-a8fb-199d045b7d86 req-26ea6853-f7a2-4e5c-8e42-c85a9e5edd16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-unplugged", "status": "completed", "tag": "6e0c2428-e53e-4cf5-abde-0f2811b46da4"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:31.450303 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:28:31.450303 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:28:31.457967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6b2a2d15-4be6-46ae-8715-04b2fa10ccd4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:31.468310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4656e408-1413-4c96-a8fb-199d045b7d86 req-26ea6853-f7a2-4e5c-8e42-c85a9e5edd16 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:31.471737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4656e408-1413-4c96-a8fb-199d045b7d86 req-26ea6853-f7a2-4e5c-8e42-c85a9e5edd16 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:31.471865 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6b2a2d15-4be6-46ae-8715-04b2fa10ccd4 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1331 microversion: 2.1 time: 0.601964 Jan 22 21:28:31.474764 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3542/7376] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:30 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1331 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:31.498294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e7817cfa-18c9-498b-93e0-d5b9baab63d1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:31.499141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e7817cfa-18c9-498b-93e0-d5b9baab63d1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:31.502461 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-4656e408-1413-4c96-a8fb-199d045b7d86 req-26ea6853-f7a2-4e5c-8e42-c85a9e5edd16 service nova] Creating event network-vif-unplugged:6e0c2428-e53e-4cf5-abde-0f2811b46da4 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:28:31.512007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7817cfa-18c9-498b-93e0-d5b9baab63d1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:31.512862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7817cfa-18c9-498b-93e0-d5b9baab63d1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:31.514490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7817cfa-18c9-498b-93e0-d5b9baab63d1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:31.515115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7817cfa-18c9-498b-93e0-d5b9baab63d1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:31.515473 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-4656e408-1413-4c96-a8fb-199d045b7d86 req-26ea6853-f7a2-4e5c-8e42-c85a9e5edd16 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070520 Jan 22 21:28:31.518272 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3835/7377] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:28:31.822008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e7817cfa-18c9-498b-93e0-d5b9baab63d1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:31.833056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e7817cfa-18c9-498b-93e0-d5b9baab63d1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:31.834672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e7817cfa-18c9-498b-93e0-d5b9baab63d1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:31.836051 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e7817cfa-18c9-498b-93e0-d5b9baab63d1 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 2912 microversion: 2.32 time: 0.359416 Jan 22 21:28:31.839551 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3543/7378] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:28:31 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 2912 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:28:31.978657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-638d43dc-4c68-4cad-98f2-ae378bbdecaa req-f22a90d1-a755-445b-9167-c3948517968c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-deleted", "tag": "5deaf213-88f0-4d59-9ebc-8825f8699d40"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:31.980820 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:28:31.980820 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:28:32.001263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-638d43dc-4c68-4cad-98f2-ae378bbdecaa req-f22a90d1-a755-445b-9167-c3948517968c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:32.008206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-638d43dc-4c68-4cad-98f2-ae378bbdecaa req-f22a90d1-a755-445b-9167-c3948517968c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:32.033344 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-638d43dc-4c68-4cad-98f2-ae378bbdecaa req-f22a90d1-a755-445b-9167-c3948517968c service nova] Creating event network-vif-deleted:5deaf213-88f0-4d59-9ebc-8825f8699d40 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:28:32.041164 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-638d43dc-4c68-4cad-98f2-ae378bbdecaa req-f22a90d1-a755-445b-9167-c3948517968c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069254 Jan 22 21:28:32.042484 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3836/7379] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:28:32.492289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-677f3bd9-6b5f-4698-a5c9-16f1cfa88afc tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:32.499791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-677f3bd9-6b5f-4698-a5c9-16f1cfa88afc tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:32.530335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-677f3bd9-6b5f-4698-a5c9-16f1cfa88afc tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:32.538239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-677f3bd9-6b5f-4698-a5c9-16f1cfa88afc tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:32.538239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-677f3bd9-6b5f-4698-a5c9-16f1cfa88afc tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:32.538239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-677f3bd9-6b5f-4698-a5c9-16f1cfa88afc tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:32.865399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-96ed7532-6d6b-4e2c-b3cd-a16b5223d215 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:32.866658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-96ed7532-6d6b-4e2c-b3cd-a16b5223d215 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:32.886065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96ed7532-6d6b-4e2c-b3cd-a16b5223d215 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:32.888696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96ed7532-6d6b-4e2c-b3cd-a16b5223d215 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:32.891260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96ed7532-6d6b-4e2c-b3cd-a16b5223d215 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:32.894178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96ed7532-6d6b-4e2c-b3cd-a16b5223d215 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:33.416032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-96ed7532-6d6b-4e2c-b3cd-a16b5223d215 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:33.430739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-96ed7532-6d6b-4e2c-b3cd-a16b5223d215 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:33.438929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-96ed7532-6d6b-4e2c-b3cd-a16b5223d215 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:33.444781 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-96ed7532-6d6b-4e2c-b3cd-a16b5223d215 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 2706 microversion: 2.32 time: 0.588098 Jan 22 21:28:33.448883 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3837/7380] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:28:32 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 2706 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:28:33.496764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-677f3bd9-6b5f-4698-a5c9-16f1cfa88afc tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:33.505878 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-677f3bd9-6b5f-4698-a5c9-16f1cfa88afc tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1530 microversion: 2.1 time: 1.020919 Jan 22 21:28:33.507503 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3544/7381] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:32 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1530 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:33.530693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bed5359e-5c86-472e-b6b0-2eccac2b0e35 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:33.530693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bed5359e-5c86-472e-b6b0-2eccac2b0e35 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:33.539568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bed5359e-5c86-472e-b6b0-2eccac2b0e35 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:33.540485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bed5359e-5c86-472e-b6b0-2eccac2b0e35 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:33.541604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bed5359e-5c86-472e-b6b0-2eccac2b0e35 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:33.542289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bed5359e-5c86-472e-b6b0-2eccac2b0e35 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:33.561840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-9e1d8ffb-df02-49a5-ae12-f0be16fdc73e req-e5d744bb-21a7-42e0-b16e-dc5a7d5e9fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-unplugged", "status": "completed", "tag": "f1445cec-d592-4347-ab81-b946b09943fa"}, {"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-unplugged", "status": "completed", "tag": "a9f0a176-56d8-4260-a888-954dfaa6e694"}, {"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-unplugged", "status": "completed", "tag": "d6ad2c1e-3a87-493b-b14b-01230bfd2da6"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:33.564831 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:28:33.564831 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:28:33.575735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9e1d8ffb-df02-49a5-ae12-f0be16fdc73e req-e5d744bb-21a7-42e0-b16e-dc5a7d5e9fcd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:33.576750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9e1d8ffb-df02-49a5-ae12-f0be16fdc73e req-e5d744bb-21a7-42e0-b16e-dc5a7d5e9fcd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:33.623308 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-9e1d8ffb-df02-49a5-ae12-f0be16fdc73e req-e5d744bb-21a7-42e0-b16e-dc5a7d5e9fcd service nova] Creating event network-vif-unplugged:f1445cec-d592-4347-ab81-b946b09943fa for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:28:33.623824 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-9e1d8ffb-df02-49a5-ae12-f0be16fdc73e req-e5d744bb-21a7-42e0-b16e-dc5a7d5e9fcd service nova] Creating event network-vif-unplugged:a9f0a176-56d8-4260-a888-954dfaa6e694 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:28:33.624345 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-9e1d8ffb-df02-49a5-ae12-f0be16fdc73e req-e5d744bb-21a7-42e0-b16e-dc5a7d5e9fcd service nova] Creating event network-vif-unplugged:d6ad2c1e-3a87-493b-b14b-01230bfd2da6 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:28:33.632135 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-9e1d8ffb-df02-49a5-ae12-f0be16fdc73e req-e5d744bb-21a7-42e0-b16e-dc5a7d5e9fcd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.074078 Jan 22 21:28:33.634886 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3545/7382] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:28:33.864220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bed5359e-5c86-472e-b6b0-2eccac2b0e35 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:33.880656 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bed5359e-5c86-472e-b6b0-2eccac2b0e35 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1530 microversion: 2.1 time: 0.358332 Jan 22 21:28:33.895491 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3838/7383] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:33 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1530 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:34.076848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-045d9a56-4b92-4739-b78c-6d14f7b8303d req-e36b296d-3051-4560-a282-1d05d159408e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-deleted", "tag": "a9f0a176-56d8-4260-a888-954dfaa6e694"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:34.080535 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:28:34.080535 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:28:34.099709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-045d9a56-4b92-4739-b78c-6d14f7b8303d req-e36b296d-3051-4560-a282-1d05d159408e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:34.107606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-045d9a56-4b92-4739-b78c-6d14f7b8303d req-e36b296d-3051-4560-a282-1d05d159408e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:34.155401 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-045d9a56-4b92-4739-b78c-6d14f7b8303d req-e36b296d-3051-4560-a282-1d05d159408e service nova] Creating event network-vif-deleted:a9f0a176-56d8-4260-a888-954dfaa6e694 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:28:34.162444 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-045d9a56-4b92-4739-b78c-6d14f7b8303d req-e36b296d-3051-4560-a282-1d05d159408e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089971 Jan 22 21:28:34.163697 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3839/7384] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:28:34.448846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-94421ec9-1d4b-4411-9050-4b8e6e30602b tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:34.449461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-94421ec9-1d4b-4411-9050-4b8e6e30602b tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:34.468619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2fff098f-0661-4921-9c97-b0c15f3c868e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:34.469394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2fff098f-0661-4921-9c97-b0c15f3c868e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:34.484118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94421ec9-1d4b-4411-9050-4b8e6e30602b tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:34.485796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fff098f-0661-4921-9c97-b0c15f3c868e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:34.486278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fff098f-0661-4921-9c97-b0c15f3c868e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:34.487936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94421ec9-1d4b-4411-9050-4b8e6e30602b tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:34.488652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fff098f-0661-4921-9c97-b0c15f3c868e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:34.488808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94421ec9-1d4b-4411-9050-4b8e6e30602b tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:34.490795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fff098f-0661-4921-9c97-b0c15f3c868e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:34.498634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94421ec9-1d4b-4411-9050-4b8e6e30602b tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:34.561623 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-94421ec9-1d4b-4411-9050-4b8e6e30602b tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] HTTP exception thrown: Instance 5f23a906-1762-4922-8021-8a08514c6e52 could not be found. Jan 22 21:28:34.562205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-94421ec9-1d4b-4411-9050-4b8e6e30602b tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] Returning 404 to user: Instance 5f23a906-1762-4922-8021-8a08514c6e52 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:28:34.567158 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-94421ec9-1d4b-4411-9050-4b8e6e30602b tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 404 len: 111 microversion: 2.1 time: 0.669653 Jan 22 21:28:34.571463 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3546/7385] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:28:33 2022] DELETE /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 111 bytes in 673 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:28:34.582888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0f3a41bc-2fa8-4974-90ed-a90b36671373 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:34.583527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0f3a41bc-2fa8-4974-90ed-a90b36671373 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:34.608639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f3a41bc-2fa8-4974-90ed-a90b36671373 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:34.610631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f3a41bc-2fa8-4974-90ed-a90b36671373 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:34.612532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f3a41bc-2fa8-4974-90ed-a90b36671373 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:34.613187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f3a41bc-2fa8-4974-90ed-a90b36671373 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:34.888416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2fff098f-0661-4921-9c97-b0c15f3c868e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:34.898952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2fff098f-0661-4921-9c97-b0c15f3c868e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:34.900486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2fff098f-0661-4921-9c97-b0c15f3c868e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:34.901790 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2fff098f-0661-4921-9c97-b0c15f3c868e tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 2548 microversion: 2.32 time: 0.437544 Jan 22 21:28:34.909894 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3840/7386] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:28:34 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 2548 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:28:35.159029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0f3a41bc-2fa8-4974-90ed-a90b36671373 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:35.188862 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0f3a41bc-2fa8-4974-90ed-a90b36671373 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1530 microversion: 2.1 time: 0.612345 Jan 22 21:28:35.203071 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3547/7387] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:34 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1530 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:35.210120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2dc4c12f-07e7-4fea-88fc-46202e854424 tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] Action: 'update', calling method: >, body: {"server": {"name": "5f23a906-1762-4922-8021-8a08514c6e52_new"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:35.211349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2dc4c12f-07e7-4fea-88fc-46202e854424 tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:35.242005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dc4c12f-07e7-4fea-88fc-46202e854424 tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:35.249481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dc4c12f-07e7-4fea-88fc-46202e854424 tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:35.253002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dc4c12f-07e7-4fea-88fc-46202e854424 tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:35.257722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2dc4c12f-07e7-4fea-88fc-46202e854424 tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:35.306782 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-2dc4c12f-07e7-4fea-88fc-46202e854424 tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] HTTP exception thrown: Instance 5f23a906-1762-4922-8021-8a08514c6e52 could not be found. Jan 22 21:28:35.308662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2dc4c12f-07e7-4fea-88fc-46202e854424 tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] Returning 404 to user: Instance 5f23a906-1762-4922-8021-8a08514c6e52 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:28:35.311585 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2dc4c12f-07e7-4fea-88fc-46202e854424 tempest-ServersNegativeTestMultiTenantJSON-1977286746 tempest-ServersNegativeTestMultiTenantJSON-1977286746-project] 10.222.0.100 "PUT /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 404 len: 111 microversion: 2.1 time: 0.104561 Jan 22 21:28:35.314207 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3841/7388] 10.222.0.100 () {60 vars in 1260 bytes} [Sat Jan 22 21:28:35 2022] PUT /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:28:35.323718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-57825626-cd76-481d-ad20-611c6185d5f7 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:35.324388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-57825626-cd76-481d-ad20-611c6185d5f7 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:35.332619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57825626-cd76-481d-ad20-611c6185d5f7 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:35.336487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57825626-cd76-481d-ad20-611c6185d5f7 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:35.338794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57825626-cd76-481d-ad20-611c6185d5f7 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:35.350066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57825626-cd76-481d-ad20-611c6185d5f7 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:35.412349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-57825626-cd76-481d-ad20-611c6185d5f7 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:28:35.830149 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-57825626-cd76-481d-ad20-611c6185d5f7 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 204 len: 0 microversion: 2.1 time: 0.511726 Jan 22 21:28:35.831346 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3548/7389] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:28:35 2022] DELETE /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:28:35.839807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a2a2a59e-d0e6-4c66-b6b2-31a6c872a2e5 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:35.840628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a2a2a59e-d0e6-4c66-b6b2-31a6c872a2e5 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:35.848747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2a2a59e-d0e6-4c66-b6b2-31a6c872a2e5 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:35.849675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2a2a59e-d0e6-4c66-b6b2-31a6c872a2e5 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:35.850753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2a2a59e-d0e6-4c66-b6b2-31a6c872a2e5 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:35.851383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2a2a59e-d0e6-4c66-b6b2-31a6c872a2e5 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:35.942200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b7f0104-2e69-4756-bf11-d37d464a0293 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:35.946121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4b7f0104-2e69-4756-bf11-d37d464a0293 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:35.955694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b7f0104-2e69-4756-bf11-d37d464a0293 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:35.956386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b7f0104-2e69-4756-bf11-d37d464a0293 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:35.957637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b7f0104-2e69-4756-bf11-d37d464a0293 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:35.958306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b7f0104-2e69-4756-bf11-d37d464a0293 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:36.166945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a2a2a59e-d0e6-4c66-b6b2-31a6c872a2e5 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:36.182798 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a2a2a59e-d0e6-4c66-b6b2-31a6c872a2e5 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1536 microversion: 2.1 time: 0.346235 Jan 22 21:28:36.183401 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3842/7390] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:35 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1536 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:36.242836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-1ca68581-a6de-4dea-a729-fa26ddafd8c3 req-ed670472-2280-4395-89a6-30bdf2927f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-deleted", "tag": "6e0c2428-e53e-4cf5-abde-0f2811b46da4"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:36.246213 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:28:36.246213 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:28:36.267736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1ca68581-a6de-4dea-a729-fa26ddafd8c3 req-ed670472-2280-4395-89a6-30bdf2927f23 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:36.268771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1ca68581-a6de-4dea-a729-fa26ddafd8c3 req-ed670472-2280-4395-89a6-30bdf2927f23 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:36.292511 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-1ca68581-a6de-4dea-a729-fa26ddafd8c3 req-ed670472-2280-4395-89a6-30bdf2927f23 service nova] Creating event network-vif-deleted:6e0c2428-e53e-4cf5-abde-0f2811b46da4 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:28:36.305658 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-1ca68581-a6de-4dea-a729-fa26ddafd8c3 req-ed670472-2280-4395-89a6-30bdf2927f23 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066921 Jan 22 21:28:36.306474 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3843/7391] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:28:36.523115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4b7f0104-2e69-4756-bf11-d37d464a0293 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:36.537659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4b7f0104-2e69-4756-bf11-d37d464a0293 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:36.540563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4b7f0104-2e69-4756-bf11-d37d464a0293 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:36.542330 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b7f0104-2e69-4756-bf11-d37d464a0293 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 2502 microversion: 2.32 time: 0.622364 Jan 22 21:28:36.558644 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3549/7392] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:28:35 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 2502 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:28:37.204982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-733bb474-798d-4880-96bd-cd7e596738f1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:37.204982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-733bb474-798d-4880-96bd-cd7e596738f1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:37.214899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-733bb474-798d-4880-96bd-cd7e596738f1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:37.215358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-733bb474-798d-4880-96bd-cd7e596738f1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:37.216222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-733bb474-798d-4880-96bd-cd7e596738f1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:37.216594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-733bb474-798d-4880-96bd-cd7e596738f1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:37.566021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ebf813bb-4a37-412f-9855-fa6dfb674659 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:37.567267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ebf813bb-4a37-412f-9855-fa6dfb674659 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:37.584971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebf813bb-4a37-412f-9855-fa6dfb674659 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:37.585430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebf813bb-4a37-412f-9855-fa6dfb674659 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:37.586256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebf813bb-4a37-412f-9855-fa6dfb674659 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:37.586696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebf813bb-4a37-412f-9855-fa6dfb674659 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:37.752139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-733bb474-798d-4880-96bd-cd7e596738f1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:37.776203 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-733bb474-798d-4880-96bd-cd7e596738f1 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1536 microversion: 2.1 time: 0.574250 Jan 22 21:28:37.776203 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3844/7393] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:37 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1536 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:38.346220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-187cfaba-f13a-46d5-892b-9d8b10ce6030 req-1f74efde-7905-44a1-8b31-912497b2f5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-deleted", "tag": "d6ad2c1e-3a87-493b-b14b-01230bfd2da6"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:38.349285 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:28:38.349285 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:28:38.364565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-187cfaba-f13a-46d5-892b-9d8b10ce6030 req-1f74efde-7905-44a1-8b31-912497b2f5c1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:38.365488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-187cfaba-f13a-46d5-892b-9d8b10ce6030 req-1f74efde-7905-44a1-8b31-912497b2f5c1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:38.382012 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-187cfaba-f13a-46d5-892b-9d8b10ce6030 req-1f74efde-7905-44a1-8b31-912497b2f5c1 service nova] Creating event network-vif-deleted:d6ad2c1e-3a87-493b-b14b-01230bfd2da6 for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:28:38.394664 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-187cfaba-f13a-46d5-892b-9d8b10ce6030 req-1f74efde-7905-44a1-8b31-912497b2f5c1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056874 Jan 22 21:28:38.395969 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3845/7394] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:28:38.640859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ebf813bb-4a37-412f-9855-fa6dfb674659 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:38.640859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ebf813bb-4a37-412f-9855-fa6dfb674659 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:38.640859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ebf813bb-4a37-412f-9855-fa6dfb674659 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:38.640859 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ebf813bb-4a37-412f-9855-fa6dfb674659 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 2342 microversion: 2.32 time: 1.024154 Jan 22 21:28:38.640859 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3550/7395] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:28:37 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 2342 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:28:38.792254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-88735bcb-e556-4f2f-8d5c-d4d533ae9855 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:38.792970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-88735bcb-e556-4f2f-8d5c-d4d533ae9855 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:38.800966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88735bcb-e556-4f2f-8d5c-d4d533ae9855 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:38.801572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88735bcb-e556-4f2f-8d5c-d4d533ae9855 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:38.812418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88735bcb-e556-4f2f-8d5c-d4d533ae9855 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:38.812418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88735bcb-e556-4f2f-8d5c-d4d533ae9855 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:39.547325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-88735bcb-e556-4f2f-8d5c-d4d533ae9855 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:39.559701 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-88735bcb-e556-4f2f-8d5c-d4d533ae9855 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1536 microversion: 2.1 time: 0.771424 Jan 22 21:28:39.560629 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3846/7396] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:38 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1536 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:39.608242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-377dff82-f742-4797-b405-edc6c00b3776 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:39.608870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-377dff82-f742-4797-b405-edc6c00b3776 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:39.620215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-377dff82-f742-4797-b405-edc6c00b3776 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:39.620544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-377dff82-f742-4797-b405-edc6c00b3776 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:39.625573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-377dff82-f742-4797-b405-edc6c00b3776 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:39.626592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-377dff82-f742-4797-b405-edc6c00b3776 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:39.884828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-377dff82-f742-4797-b405-edc6c00b3776 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:39.904934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-377dff82-f742-4797-b405-edc6c00b3776 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:39.907788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-377dff82-f742-4797-b405-edc6c00b3776 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:39.909348 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-377dff82-f742-4797-b405-edc6c00b3776 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 2162 microversion: 2.32 time: 0.306019 Jan 22 21:28:39.930661 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3551/7397] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:28:39 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 2162 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:28:40.468285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-2987214d-b6c3-4853-8770-a5169b9e014a req-6e6d100a-0551-40ab-b4d9-a534c602901a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f23a906-1762-4922-8021-8a08514c6e52", "name": "network-vif-deleted", "tag": "995db515-224a-4b04-9aac-b70ec2b1289c"}, {"server_uuid": "47918756-7251-498d-9ad4-d2006148f363", "name": "network-vif-deleted", "tag": "f1445cec-d592-4347-ab81-b946b09943fa"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:40.472048 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:28:40.472048 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:28:40.486837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2987214d-b6c3-4853-8770-a5169b9e014a req-6e6d100a-0551-40ab-b4d9-a534c602901a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:40.487429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2987214d-b6c3-4853-8770-a5169b9e014a req-6e6d100a-0551-40ab-b4d9-a534c602901a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:40.505191 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-2987214d-b6c3-4853-8770-a5169b9e014a req-6e6d100a-0551-40ab-b4d9-a534c602901a service nova] Creating event network-vif-deleted:995db515-224a-4b04-9aac-b70ec2b1289c for instance 5f23a906-1762-4922-8021-8a08514c6e52 on nch2-master-1 Jan 22 21:28:40.506458 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-2987214d-b6c3-4853-8770-a5169b9e014a req-6e6d100a-0551-40ab-b4d9-a534c602901a service nova] Creating event network-vif-deleted:f1445cec-d592-4347-ab81-b946b09943fa for instance 47918756-7251-498d-9ad4-d2006148f363 on nch1-master-1 Jan 22 21:28:40.519659 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-2987214d-b6c3-4853-8770-a5169b9e014a req-6e6d100a-0551-40ab-b4d9-a534c602901a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055152 Jan 22 21:28:40.522064 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3847/7398] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:28:40.580788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2f587f8b-2681-4dce-aed2-be990724972d tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:40.581424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2f587f8b-2681-4dce-aed2-be990724972d tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:40.591277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f587f8b-2681-4dce-aed2-be990724972d tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:40.594094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f587f8b-2681-4dce-aed2-be990724972d tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:40.597784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f587f8b-2681-4dce-aed2-be990724972d tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:40.599639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f587f8b-2681-4dce-aed2-be990724972d tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:40.678788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f587f8b-2681-4dce-aed2-be990724972d tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:40.679260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f587f8b-2681-4dce-aed2-be990724972d tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:40.680671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-2f587f8b-2681-4dce-aed2-be990724972d tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lazy-loading 'fault' on Instance uuid 5f23a906-1762-4922-8021-8a08514c6e52 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:28:40.931339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-568513cd-f018-4560-ba4f-29ce3b79fd51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:40.932050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-568513cd-f018-4560-ba4f-29ce3b79fd51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:40.954467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-568513cd-f018-4560-ba4f-29ce3b79fd51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:40.958121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-568513cd-f018-4560-ba4f-29ce3b79fd51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:40.962154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-568513cd-f018-4560-ba4f-29ce3b79fd51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:40.965807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-568513cd-f018-4560-ba4f-29ce3b79fd51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:41.155408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2f587f8b-2681-4dce-aed2-be990724972d tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be417c0e17f546699a2387d02f6f28e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a61bb11aef749ecbbe18f381db4a041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:41.172702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-568513cd-f018-4560-ba4f-29ce3b79fd51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:41.218295 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2f587f8b-2681-4dce-aed2-be990724972d tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 200 len: 1321 microversion: 2.1 time: 0.616236 Jan 22 21:28:41.218295 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3552/7399] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:40 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 1321 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:41.218610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-568513cd-f018-4560-ba4f-29ce3b79fd51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:41.218610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-568513cd-f018-4560-ba4f-29ce3b79fd51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:41.218610 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-568513cd-f018-4560-ba4f-29ce3b79fd51 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1608 microversion: 2.32 time: 0.276990 Jan 22 21:28:41.218610 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3848/7400] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:28:40 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1608 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:28:42.212330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a10c7b6b-439a-4467-ba73-88de54cf1448 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:42.212996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a10c7b6b-439a-4467-ba73-88de54cf1448 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] [instance: 5f23a906-1762-4922-8021-8a08514c6e52] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:42.226091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3cdc010a-1503-469e-84cd-29bd33111eab tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:42.226768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3cdc010a-1503-469e-84cd-29bd33111eab tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:42.247916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a10c7b6b-439a-4467-ba73-88de54cf1448 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:42.248420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a10c7b6b-439a-4467-ba73-88de54cf1448 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:42.251529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a10c7b6b-439a-4467-ba73-88de54cf1448 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:42.252051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3cdc010a-1503-469e-84cd-29bd33111eab tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:42.253196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3cdc010a-1503-469e-84cd-29bd33111eab tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:42.253914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a10c7b6b-439a-4467-ba73-88de54cf1448 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:42.269825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3cdc010a-1503-469e-84cd-29bd33111eab tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:42.273716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3cdc010a-1503-469e-84cd-29bd33111eab tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:42.342886 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-a10c7b6b-439a-4467-ba73-88de54cf1448 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] HTTP exception thrown: Instance 5f23a906-1762-4922-8021-8a08514c6e52 could not be found. Jan 22 21:28:42.346893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a10c7b6b-439a-4467-ba73-88de54cf1448 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] Returning 404 to user: Instance 5f23a906-1762-4922-8021-8a08514c6e52 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:28:42.352452 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a10c7b6b-439a-4467-ba73-88de54cf1448 tempest-ServersNegativeTestMultiTenantJSON-268431665 tempest-ServersNegativeTestMultiTenantJSON-268431665-project] 10.222.0.100 "GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52" status: 404 len: 111 microversion: 2.1 time: 0.141992 Jan 22 21:28:42.357240 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3553/7401] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:28:42 2022] GET /compute/v2.1/servers/5f23a906-1762-4922-8021-8a08514c6e52 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:28:42.419692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3cdc010a-1503-469e-84cd-29bd33111eab tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:42.419692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3cdc010a-1503-469e-84cd-29bd33111eab tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:42.419692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-3cdc010a-1503-469e-84cd-29bd33111eab tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lazy-loading 'fault' on Instance uuid 47918756-7251-498d-9ad4-d2006148f363 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:28:42.508177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3cdc010a-1503-469e-84cd-29bd33111eab tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:42.520657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3cdc010a-1503-469e-84cd-29bd33111eab tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:42.522585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3cdc010a-1503-469e-84cd-29bd33111eab tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5f940a48ba74abeaca28109a6bf6f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9480b0ab9b5461c953e555cb140b8f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:28:42.524081 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3cdc010a-1503-469e-84cd-29bd33111eab tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 200 len: 1613 microversion: 2.32 time: 0.302216 Jan 22 21:28:42.525784 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3849/7402] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:28:42 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 1613 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:28:43.549937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e30ece01-3c37-4bba-b54f-5756a90e7ef2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:43.550561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e30ece01-3c37-4bba-b54f-5756a90e7ef2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:43.564677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e30ece01-3c37-4bba-b54f-5756a90e7ef2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:43.565201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e30ece01-3c37-4bba-b54f-5756a90e7ef2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:43.566204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e30ece01-3c37-4bba-b54f-5756a90e7ef2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:43.566520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e30ece01-3c37-4bba-b54f-5756a90e7ef2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:43.615765 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-e30ece01-3c37-4bba-b54f-5756a90e7ef2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] HTTP exception thrown: Instance 47918756-7251-498d-9ad4-d2006148f363 could not be found. Jan 22 21:28:43.616382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e30ece01-3c37-4bba-b54f-5756a90e7ef2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Returning 404 to user: Instance 47918756-7251-498d-9ad4-d2006148f363 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:28:43.624386 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e30ece01-3c37-4bba-b54f-5756a90e7ef2 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 404 len: 111 microversion: 2.32 time: 0.078534 Jan 22 21:28:43.627597 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3554/7403] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:28:43 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:28:43.637127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-91599f80-8aeb-46ca-b841-7ae7b8ec3e34 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '.version_select at 0x7f1ed4bc83a0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:43.826238 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-91599f80-8aeb-46ca-b841-7ae7b8ec3e34 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410337914" status: 204 len: 0 microversion: 2.32 time: 0.195971 Jan 22 21:28:43.829621 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3850/7404] 10.222.0.100 () {60 vars in 1266 bytes} [Sat Jan 22 21:28:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410337914 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:28:49.987988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cfb13aa0-2edc-4990-bdaa-53a964ddb4a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Action: 'create', calling method: .version_select at 0x7f1ed6094790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2053380229"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:50.042844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-cfb13aa0-2edc-4990-bdaa-53a964ddb4a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:28:50.060078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-cfb13aa0-2edc-4990-bdaa-53a964ddb4a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for user f84a5c446f01456e991f940f550199e5 and project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:28:50.685160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-cfb13aa0-2edc-4990-bdaa-53a964ddb4a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:28:50.705237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-cfb13aa0-2edc-4990-bdaa-53a964ddb4a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for user f84a5c446f01456e991f940f550199e5 and project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:28:50.764326 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cfb13aa0-2edc-4990-bdaa-53a964ddb4a8 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.777784 Jan 22 21:28:50.764326 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3555/7405] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:28:49 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:28:56.795389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e3ffe99-ec68-415a-a874-00210e3e2b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:56.797781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e3ffe99-ec68-415a-a874-00210e3e2b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:56.815566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e3ffe99-ec68-415a-a874-00210e3e2b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:56.819450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e3ffe99-ec68-415a-a874-00210e3e2b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:56.819450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e3ffe99-ec68-415a-a874-00210e3e2b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:56.819450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e3ffe99-ec68-415a-a874-00210e3e2b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:56.872717 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-5e3ffe99-ec68-415a-a874-00210e3e2b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] HTTP exception thrown: Instance 47918756-7251-498d-9ad4-d2006148f363 could not be found. Jan 22 21:28:56.873442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e3ffe99-ec68-415a-a874-00210e3e2b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Returning 404 to user: Instance 47918756-7251-498d-9ad4-d2006148f363 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:28:56.876140 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e3ffe99-ec68-415a-a874-00210e3e2b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "DELETE /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 404 len: 111 microversion: 2.32 time: 0.086038 Jan 22 21:28:56.877736 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3851/7406] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:28:56 2022] DELETE /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:28:56.886556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a2ac453f-0591-4152-bb48-e53bf73fd0b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:56.891518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a2ac453f-0591-4152-bb48-e53bf73fd0b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] [instance: 47918756-7251-498d-9ad4-d2006148f363] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:28:56.899301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2ac453f-0591-4152-bb48-e53bf73fd0b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:56.905790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2ac453f-0591-4152-bb48-e53bf73fd0b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:56.905790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2ac453f-0591-4152-bb48-e53bf73fd0b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:56.905790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2ac453f-0591-4152-bb48-e53bf73fd0b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:56.927207 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-a2ac453f-0591-4152-bb48-e53bf73fd0b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] HTTP exception thrown: Instance 47918756-7251-498d-9ad4-d2006148f363 could not be found. Jan 22 21:28:56.927954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a2ac453f-0591-4152-bb48-e53bf73fd0b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Returning 404 to user: Instance 47918756-7251-498d-9ad4-d2006148f363 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:28:56.928939 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a2ac453f-0591-4152-bb48-e53bf73fd0b6 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363" status: 404 len: 111 microversion: 2.32 time: 0.047378 Jan 22 21:28:56.930124 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3556/7407] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:28:56 2022] GET /compute/v2.1/servers/47918756-7251-498d-9ad4-d2006148f363 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:28:58.240573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e3ffe99-ec68-415a-a874-00210e3e2b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:28:58.241602 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e3ffe99-ec68-415a-a874-00210e3e2b53 tempest-TaggedBootDevicesTest-807480544 tempest-TaggedBootDevicesTest-807480544-project] 10.222.0.100 "GET /compute//" status: 200 len: 379 microversion: - time: 0.001357 Jan 22 21:28:58.241941 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3852/7408] 10.222.0.100 () {56 vars in 890 bytes} [Sat Jan 22 21:28:58 2022] GET /compute/ => generated 379 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jan 22 21:28:59.033301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1182744406", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "82ba5506-8cbc-4bdc-a05e-42d2d8f80f24"}], "key_name": "tempest-TestNetworkBasicOps-2053380229", "security_groups": [{"name": "tempest-secgroup-smoke-1445307563"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:28:59.174006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] validate_networks() for [('82ba5506-8cbc-4bdc-a05e-42d2d8f80f24', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:28:59.845965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:28:59.846709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:28:59.847518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:28:59.851526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:28:59.851526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:28:59.863913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:59.864898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:59.866347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:28:59.867045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:28:59.890871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:28:59.899490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Getting quotas for user f84a5c446f01456e991f940f550199e5 and project 6bdc4a0a875547f1a6ace5470bb1e777. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:28:59.918992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:28:59.922760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:29:00.065481 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb88e685-690f-41ce-8878-8378568a3000 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.043233 Jan 22 21:29:00.066251 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3557/7409] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:28:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:29:00.078161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-35ccb147-5dae-4ea7-a979-f46ede84234a tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:00.080232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-35ccb147-5dae-4ea7-a979-f46ede84234a tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:00.839290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-35ccb147-5dae-4ea7-a979-f46ede84234a tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:00.847485 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-35ccb147-5dae-4ea7-a979-f46ede84234a tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1253 microversion: 2.1 time: 0.774506 Jan 22 21:29:00.858163 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3853/7410] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:00 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1253 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:01.867241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3759aad6-6692-4de7-99fe-042b7e1f9d48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:01.868020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3759aad6-6692-4de7-99fe-042b7e1f9d48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:01.876921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3759aad6-6692-4de7-99fe-042b7e1f9d48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:01.877458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3759aad6-6692-4de7-99fe-042b7e1f9d48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:01.878357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3759aad6-6692-4de7-99fe-042b7e1f9d48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:01.878872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3759aad6-6692-4de7-99fe-042b7e1f9d48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:02.004901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3759aad6-6692-4de7-99fe-042b7e1f9d48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:02.013947 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3759aad6-6692-4de7-99fe-042b7e1f9d48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1249 microversion: 2.1 time: 0.152101 Jan 22 21:29:02.014588 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3558/7411] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:01 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1249 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:03.042406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3df8113b-865c-4e79-a603-3bdccc4418e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:03.043566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3df8113b-865c-4e79-a603-3bdccc4418e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:03.052773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3df8113b-865c-4e79-a603-3bdccc4418e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:03.053226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3df8113b-865c-4e79-a603-3bdccc4418e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:03.054300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3df8113b-865c-4e79-a603-3bdccc4418e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:03.055965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3df8113b-865c-4e79-a603-3bdccc4418e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:03.132203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3df8113b-865c-4e79-a603-3bdccc4418e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:03.141462 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3df8113b-865c-4e79-a603-3bdccc4418e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1311 microversion: 2.1 time: 0.113276 Jan 22 21:29:03.142632 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3854/7412] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:03 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:04.160785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5b70843a-4415-4ab5-ac64-a367af3383e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:04.162275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5b70843a-4415-4ab5-ac64-a367af3383e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:04.170398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b70843a-4415-4ab5-ac64-a367af3383e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:04.171200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b70843a-4415-4ab5-ac64-a367af3383e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:04.172004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b70843a-4415-4ab5-ac64-a367af3383e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:04.172637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5b70843a-4415-4ab5-ac64-a367af3383e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:04.447551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5b70843a-4415-4ab5-ac64-a367af3383e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:04.456269 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5b70843a-4415-4ab5-ac64-a367af3383e7 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1379 microversion: 2.1 time: 0.300885 Jan 22 21:29:04.456862 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3559/7413] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:04 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1379 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:05.058717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5033341c-3365-48b3-9eb2-b643639700d6 req-3d692928-9285-42e2-9cfe-b336b1e14fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8", "tag": "c39bfb96-d763-420b-963d-c992680fb94e"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:29:05.060127 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:29:05.060127 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:29:05.080742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5033341c-3365-48b3-9eb2-b643639700d6 req-3d692928-9285-42e2-9cfe-b336b1e14fb7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:05.081767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5033341c-3365-48b3-9eb2-b643639700d6 req-3d692928-9285-42e2-9cfe-b336b1e14fb7 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:05.107973 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5033341c-3365-48b3-9eb2-b643639700d6 req-3d692928-9285-42e2-9cfe-b336b1e14fb7 service nova] Creating event network-changed:c39bfb96-d763-420b-963d-c992680fb94e for instance 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 on nch2-master-1 Jan 22 21:29:05.114498 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-5033341c-3365-48b3-9eb2-b643639700d6 req-3d692928-9285-42e2-9cfe-b336b1e14fb7 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061212 Jan 22 21:29:05.115741 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3855/7414] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:29:05.473767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0e4b785c-4bcb-4788-9969-08cbaabfe1b1 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:05.474377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0e4b785c-4bcb-4788-9969-08cbaabfe1b1 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:05.487978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e4b785c-4bcb-4788-9969-08cbaabfe1b1 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:05.490163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e4b785c-4bcb-4788-9969-08cbaabfe1b1 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:05.492969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e4b785c-4bcb-4788-9969-08cbaabfe1b1 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:05.493948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e4b785c-4bcb-4788-9969-08cbaabfe1b1 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:05.819320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0e4b785c-4bcb-4788-9969-08cbaabfe1b1 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:05.829933 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0e4b785c-4bcb-4788-9969-08cbaabfe1b1 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1379 microversion: 2.1 time: 0.359796 Jan 22 21:29:05.833566 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3560/7415] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:05 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1379 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:06.850782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-150f9fae-8c54-4316-be5d-2a551d98b251 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:06.851489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-150f9fae-8c54-4316-be5d-2a551d98b251 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:06.857752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-150f9fae-8c54-4316-be5d-2a551d98b251 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:06.858224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-150f9fae-8c54-4316-be5d-2a551d98b251 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:06.859221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-150f9fae-8c54-4316-be5d-2a551d98b251 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:06.859671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-150f9fae-8c54-4316-be5d-2a551d98b251 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:07.008590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-150f9fae-8c54-4316-be5d-2a551d98b251 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:07.017776 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-150f9fae-8c54-4316-be5d-2a551d98b251 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1379 microversion: 2.1 time: 0.171910 Jan 22 21:29:07.018429 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3856/7416] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:06 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1379 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:29:08.034751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-259084c5-35e6-4314-895f-6d06fef38fdf tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:08.035372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-259084c5-35e6-4314-895f-6d06fef38fdf tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:08.042209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-259084c5-35e6-4314-895f-6d06fef38fdf tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:08.043126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-259084c5-35e6-4314-895f-6d06fef38fdf tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:08.043550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-259084c5-35e6-4314-895f-6d06fef38fdf tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:08.044005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-259084c5-35e6-4314-895f-6d06fef38fdf tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:08.193191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-259084c5-35e6-4314-895f-6d06fef38fdf tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:08.202100 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-259084c5-35e6-4314-895f-6d06fef38fdf tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1379 microversion: 2.1 time: 0.171250 Jan 22 21:29:08.205124 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3561/7417] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:08 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1379 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:09.220021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6338fc82-1556-49e0-9cda-c770f8ced1d5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:09.220640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6338fc82-1556-49e0-9cda-c770f8ced1d5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:09.227388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6338fc82-1556-49e0-9cda-c770f8ced1d5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:09.227853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6338fc82-1556-49e0-9cda-c770f8ced1d5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:09.228703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6338fc82-1556-49e0-9cda-c770f8ced1d5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:09.229150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6338fc82-1556-49e0-9cda-c770f8ced1d5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:09.375440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6338fc82-1556-49e0-9cda-c770f8ced1d5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:09.389714 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6338fc82-1556-49e0-9cda-c770f8ced1d5 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1379 microversion: 2.1 time: 0.173934 Jan 22 21:29:09.391014 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3857/7418] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:09 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1379 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:10.407817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-15bb314f-102f-4441-be55-242cec40b17e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:10.409998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-15bb314f-102f-4441-be55-242cec40b17e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:10.424568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15bb314f-102f-4441-be55-242cec40b17e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:10.424568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15bb314f-102f-4441-be55-242cec40b17e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:10.424568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15bb314f-102f-4441-be55-242cec40b17e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:10.424568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15bb314f-102f-4441-be55-242cec40b17e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:10.707368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-15bb314f-102f-4441-be55-242cec40b17e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:10.720248 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-15bb314f-102f-4441-be55-242cec40b17e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1379 microversion: 2.1 time: 0.316694 Jan 22 21:29:10.721909 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3562/7419] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:10 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1379 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:11.740038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cf56a09b-966a-4f68-b742-c7f17da87a77 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:11.740956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cf56a09b-966a-4f68-b742-c7f17da87a77 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:11.749535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf56a09b-966a-4f68-b742-c7f17da87a77 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:11.761458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf56a09b-966a-4f68-b742-c7f17da87a77 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:11.774751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf56a09b-966a-4f68-b742-c7f17da87a77 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:11.774751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cf56a09b-966a-4f68-b742-c7f17da87a77 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:11.946615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cf56a09b-966a-4f68-b742-c7f17da87a77 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:11.954863 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cf56a09b-966a-4f68-b742-c7f17da87a77 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1379 microversion: 2.1 time: 0.219852 Jan 22 21:29:11.955379 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3858/7420] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:11 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1379 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:12.973368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-365e50de-0cae-4e89-bbbf-95e9d44c08de tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:12.973941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-365e50de-0cae-4e89-bbbf-95e9d44c08de tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:12.980354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-365e50de-0cae-4e89-bbbf-95e9d44c08de tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:12.980812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-365e50de-0cae-4e89-bbbf-95e9d44c08de tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:12.981674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-365e50de-0cae-4e89-bbbf-95e9d44c08de tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:12.982127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-365e50de-0cae-4e89-bbbf-95e9d44c08de tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:13.167680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-365e50de-0cae-4e89-bbbf-95e9d44c08de tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:13.194017 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-365e50de-0cae-4e89-bbbf-95e9d44c08de tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1379 microversion: 2.1 time: 0.224904 Jan 22 21:29:13.195249 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3563/7421] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:12 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1379 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:13.311951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-942342df-984e-4c5e-bfee-c9122e416c34 req-64bd90a4-acfe-465f-a18b-ea2754122ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8", "name": "network-vif-plugged", "status": "completed", "tag": "c39bfb96-d763-420b-963d-c992680fb94e"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:29:13.313771 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:29:13.313771 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:29:13.321561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-942342df-984e-4c5e-bfee-c9122e416c34 req-64bd90a4-acfe-465f-a18b-ea2754122ede service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:13.327366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-942342df-984e-4c5e-bfee-c9122e416c34 req-64bd90a4-acfe-465f-a18b-ea2754122ede service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:13.334699 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-942342df-984e-4c5e-bfee-c9122e416c34 req-64bd90a4-acfe-465f-a18b-ea2754122ede service nova] Creating event network-vif-plugged:c39bfb96-d763-420b-963d-c992680fb94e for instance 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 on nch2-master-1 Jan 22 21:29:13.339609 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-942342df-984e-4c5e-bfee-c9122e416c34 req-64bd90a4-acfe-465f-a18b-ea2754122ede service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031518 Jan 22 21:29:13.340218 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3859/7422] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:29:14.212017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7e421274-0d12-4ee3-88f8-559badf4be74 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:14.212623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7e421274-0d12-4ee3-88f8-559badf4be74 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:14.220013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e421274-0d12-4ee3-88f8-559badf4be74 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:14.220465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e421274-0d12-4ee3-88f8-559badf4be74 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:14.221247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e421274-0d12-4ee3-88f8-559badf4be74 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:14.221725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e421274-0d12-4ee3-88f8-559badf4be74 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:14.458637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7e421274-0d12-4ee3-88f8-559badf4be74 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:14.472046 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7e421274-0d12-4ee3-88f8-559badf4be74 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1379 microversion: 2.1 time: 0.260861 Jan 22 21:29:14.472599 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3564/7423] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:14 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1379 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:15.501856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-de5071a2-7f05-45a3-a828-dc719133bd48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:15.501856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-de5071a2-7f05-45a3-a828-dc719133bd48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:15.501856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5071a2-7f05-45a3-a828-dc719133bd48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:15.501856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5071a2-7f05-45a3-a828-dc719133bd48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:15.505040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5071a2-7f05-45a3-a828-dc719133bd48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:15.505561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5071a2-7f05-45a3-a828-dc719133bd48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:15.695091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-de5071a2-7f05-45a3-a828-dc719133bd48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:15.703427 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-de5071a2-7f05-45a3-a828-dc719133bd48 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1552 microversion: 2.1 time: 0.218364 Jan 22 21:29:15.717925 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3860/7424] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:15 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1552 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:15.721836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4ac79bc9-0db2-4543-9b62-c81377d5c931 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:15.722699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4ac79bc9-0db2-4543-9b62-c81377d5c931 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:15.739406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ac79bc9-0db2-4543-9b62-c81377d5c931 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:15.739810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ac79bc9-0db2-4543-9b62-c81377d5c931 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:15.740786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ac79bc9-0db2-4543-9b62-c81377d5c931 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:15.741567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ac79bc9-0db2-4543-9b62-c81377d5c931 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:15.919991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4ac79bc9-0db2-4543-9b62-c81377d5c931 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:15.930468 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4ac79bc9-0db2-4543-9b62-c81377d5c931 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1552 microversion: 2.1 time: 0.212501 Jan 22 21:29:15.932850 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3565/7425] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:15 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1552 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:18.457935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-609dab8d-8cd4-4931-aa86-ba70047fe962 req-b68dc3ad-3491-4a4a-a360-ccee7833ea56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8", "tag": "c39bfb96-d763-420b-963d-c992680fb94e"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:29:18.460316 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:29:18.460316 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:29:18.468419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-609dab8d-8cd4-4931-aa86-ba70047fe962 req-b68dc3ad-3491-4a4a-a360-ccee7833ea56 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:18.474290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-609dab8d-8cd4-4931-aa86-ba70047fe962 req-b68dc3ad-3491-4a4a-a360-ccee7833ea56 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:18.481316 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-609dab8d-8cd4-4931-aa86-ba70047fe962 req-b68dc3ad-3491-4a4a-a360-ccee7833ea56 service nova] Creating event network-changed:c39bfb96-d763-420b-963d-c992680fb94e for instance 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 on nch2-master-1 Jan 22 21:29:18.487303 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-609dab8d-8cd4-4931-aa86-ba70047fe962 req-b68dc3ad-3491-4a4a-a360-ccee7833ea56 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203126 Jan 22 21:29:18.488719 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3861/7426] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:29:48.699266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e717c8f8-7b18-47c3-bf80-fbac8ef96f8b tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:29:48.700286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e717c8f8-7b18-47c3-bf80-fbac8ef96f8b tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:48.707461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e717c8f8-7b18-47c3-bf80-fbac8ef96f8b tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:48.707990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e717c8f8-7b18-47c3-bf80-fbac8ef96f8b tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:48.720075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e717c8f8-7b18-47c3-bf80-fbac8ef96f8b tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:48.720075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e717c8f8-7b18-47c3-bf80-fbac8ef96f8b tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:48.773963 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e717c8f8-7b18-47c3-bf80-fbac8ef96f8b tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "POST /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8/action" status: 200 len: 24560 microversion: 2.1 time: 0.078204 Jan 22 21:29:48.774225 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3566/7427] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:29:48 2022] POST /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8/action => generated 24560 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:29:49.433947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-63dccf83-0edd-4678-83ae-f45332a454d0 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1728079398", "availability_zone": "foo_zone"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:29:49.440472 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:29:49.440472 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:29:49.440472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.aggregate [None req-63dccf83-0edd-4678-83ae-f45332a454d0 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Generated uuid 6345238f-4f2c-4a72-9b2e-86fc798ab13a for aggregate {{(pid=137032) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jan 22 21:29:49.534025 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-63dccf83-0edd-4678-83ae-f45332a454d0 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.618384 Jan 22 21:29:49.542012 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3862/7428] 10.222.0.100 () {60 vars in 1168 bytes} [Sat Jan 22 21:29:48 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:29:49.548213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9d67eeb0-08e3-4243-b556-ae928b20b158 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:29:49.553464 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:29:49.553464 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:29:49.635289 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9d67eeb0-08e3-4243-b556-ae928b20b158 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.093417 Jan 22 21:29:49.635936 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3567/7429] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 21:29:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:29:49.646148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-89cd0619-5cb2-4b09-9db5-d51d87268fc0 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:49.647389 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:29:49.647389 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:29:49.649056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89cd0619-5cb2-4b09-9db5-d51d87268fc0 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:49.649560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89cd0619-5cb2-4b09-9db5-d51d87268fc0 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:49.650405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89cd0619-5cb2-4b09-9db5-d51d87268fc0 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:49.650840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89cd0619-5cb2-4b09-9db5-d51d87268fc0 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:49.675682 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-89cd0619-5cb2-4b09-9db5-d51d87268fc0 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] 10.222.0.100 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.033209 Jan 22 21:29:49.676285 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3863/7430] 10.222.0.100 () {58 vars in 1180 bytes} [Sat Jan 22 21:29:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:29:49.686359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-58e24df6-7514-412d-9c8f-046224d16d96 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:49.687112 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:29:49.687112 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:29:49.694043 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-58e24df6-7514-412d-9c8f-046224d16d96 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] 10.222.0.100 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.011324 Jan 22 21:29:49.694599 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3568/7431] 10.222.0.100 () {58 vars in 1147 bytes} [Sat Jan 22 21:29:49 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:29:49.704380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-06669912-48ce-4169-93c7-2b7a1ccd124e tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:29:49.705681 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:29:49.705681 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:29:49.717933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06669912-48ce-4169-93c7-2b7a1ccd124e tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:49.718476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06669912-48ce-4169-93c7-2b7a1ccd124e tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:50.312575 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-06669912-48ce-4169-93c7-2b7a1ccd124e tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.611840 Jan 22 21:29:50.313188 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3864/7432] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 21:29:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:29:50.323882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0897e8ea-c5a8-4367-8f5e-697e550872ec tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:50.325614 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:29:50.325614 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:29:50.335766 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0897e8ea-c5a8-4367-8f5e-697e550872ec tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] 10.222.0.100 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.016064 Jan 22 21:29:50.336506 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3569/7433] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:29:50 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:29:50.347611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7b068b38-1772-4e8d-b709-fde431ca5751 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-27892937", "availability_zone": "foo_zone"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:29:50.349875 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:29:50.349875 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:29:50.561265 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7b068b38-1772-4e8d-b709-fde431ca5751 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] 10.222.0.100 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 340 microversion: 2.1 time: 0.217311 Jan 22 21:29:50.562017 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3865/7434] 10.222.0.100 () {60 vars in 1177 bytes} [Sat Jan 22 21:29:50 2022] PUT /compute/v2.1/os-aggregates/19 => generated 340 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:29:50.573071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2e808bd9-3a17-46a3-abfe-97967ee6be7e tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:29:50.574459 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:29:50.574459 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:29:50.678644 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2e808bd9-3a17-46a3-abfe-97967ee6be7e tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 354 microversion: 2.1 time: 0.109758 Jan 22 21:29:50.679256 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3570/7435] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 21:29:50 2022] POST /compute/v2.1/os-aggregates/19/action => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:29:50.689929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4a345dc4-fb24-4d29-aaf3-adbadf09ebb3 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:50.690902 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:29:50.690902 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:29:50.700216 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4a345dc4-fb24-4d29-aaf3-adbadf09ebb3 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] 10.222.0.100 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 354 microversion: 2.1 time: 0.013945 Jan 22 21:29:50.712813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7430066e-e15b-45ec-8f3e-eb2e7661b115 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:29:50.715678 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:29:50.715678 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:29:50.716222 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3866/7436] 10.222.0.100 () {58 vars in 1156 bytes} [Sat Jan 22 21:29:50 2022] GET /compute/v2.1/os-aggregates/19 => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:29:50.725131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7430066e-e15b-45ec-8f3e-eb2e7661b115 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:50.726016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7430066e-e15b-45ec-8f3e-eb2e7661b115 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:51.202635 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7430066e-e15b-45ec-8f3e-eb2e7661b115 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] 10.222.0.100 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 339 microversion: 2.1 time: 0.493158 Jan 22 21:29:51.203577 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3571/7437] 10.222.0.100 () {60 vars in 1198 bytes} [Sat Jan 22 21:29:50 2022] POST /compute/v2.1/os-aggregates/19/action => generated 339 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:29:51.213424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-01f1eba0-eecf-4eac-b480-6eb5cd41f5e8 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:51.214210 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:29:51.214210 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:29:51.346099 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-01f1eba0-eecf-4eac-b480-6eb5cd41f5e8 tempest-TestAggregatesBasicOps-2006131980 tempest-TestAggregatesBasicOps-2006131980-project-admin] 10.222.0.100 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.136084 Jan 22 21:29:51.351967 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3867/7438] 10.222.0.100 () {58 vars in 1159 bytes} [Sat Jan 22 21:29:51 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jan 22 21:29:53.163311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-2035490605", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "004f48b9-fa77-40f8-baac-6567e8a50075"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:29:53.229654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] validate_networks() for [('004f48b9-fa77-40f8-baac-6567e8a50075', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:29:53.788979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:29:53.789457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:29:53.789999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:29:53.790418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:29:53.790837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:29:53.800449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:53.800912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:53.801876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:53.802759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:53.823689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Getting quotas for project 0155083ce38b4d8fa425622e90ed8338. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:29:53.830424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Getting quotas for user ca13589dc75041fe8b10975aeba4e540 and project 0155083ce38b4d8fa425622e90ed8338. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:29:53.860072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:29:53.865024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:29:54.011942 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d5f71833-040b-4758-b8f3-08cf1ecac47d tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.031748 Jan 22 21:29:54.013157 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3572/7439] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:29:52 2022] POST /compute/v2.1/servers => generated 382 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:29:54.025013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-589ece49-be9f-47d7-aa81-ac5622242252 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:54.025930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-589ece49-be9f-47d7-aa81-ac5622242252 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:54.143662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-589ece49-be9f-47d7-aa81-ac5622242252 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:54.152649 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-589ece49-be9f-47d7-aa81-ac5622242252 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1221 microversion: 2.1 time: 0.133063 Jan 22 21:29:54.155080 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3868/7440] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:54 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1221 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:55.171875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8a5ddad1-6b5f-40e5-8e6b-ff8bf82768e6 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:55.172497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8a5ddad1-6b5f-40e5-8e6b-ff8bf82768e6 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:55.237259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8a5ddad1-6b5f-40e5-8e6b-ff8bf82768e6 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:55.252955 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8a5ddad1-6b5f-40e5-8e6b-ff8bf82768e6 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1221 microversion: 2.1 time: 0.080934 Jan 22 21:29:55.262594 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3573/7441] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:55 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:56.269020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ce6495c7-4ec1-4ef3-96fc-234f5751c57e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:56.269576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ce6495c7-4ec1-4ef3-96fc-234f5751c57e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:56.310356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce6495c7-4ec1-4ef3-96fc-234f5751c57e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:56.312155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce6495c7-4ec1-4ef3-96fc-234f5751c57e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:56.313034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce6495c7-4ec1-4ef3-96fc-234f5751c57e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:56.319358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce6495c7-4ec1-4ef3-96fc-234f5751c57e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:56.688717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ce6495c7-4ec1-4ef3-96fc-234f5751c57e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:56.695775 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ce6495c7-4ec1-4ef3-96fc-234f5751c57e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1217 microversion: 2.1 time: 0.431238 Jan 22 21:29:56.697447 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3869/7442] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:56 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1217 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:57.721768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5f6fdc41-c9a8-4f1f-8412-fbcb86082fa5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:57.722466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5f6fdc41-c9a8-4f1f-8412-fbcb86082fa5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:57.749078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f6fdc41-c9a8-4f1f-8412-fbcb86082fa5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:57.749679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f6fdc41-c9a8-4f1f-8412-fbcb86082fa5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:57.752130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f6fdc41-c9a8-4f1f-8412-fbcb86082fa5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:57.756051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5f6fdc41-c9a8-4f1f-8412-fbcb86082fa5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:57.890064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5f6fdc41-c9a8-4f1f-8412-fbcb86082fa5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:57.898432 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5f6fdc41-c9a8-4f1f-8412-fbcb86082fa5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1291 microversion: 2.1 time: 0.181838 Jan 22 21:29:57.912751 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3574/7443] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:57 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1291 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:29:58.922059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-29c7c7ae-0fc2-41ea-8a5c-c77e6cb38287 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:29:58.923333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-29c7c7ae-0fc2-41ea-8a5c-c77e6cb38287 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:29:58.934801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29c7c7ae-0fc2-41ea-8a5c-c77e6cb38287 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:58.939603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29c7c7ae-0fc2-41ea-8a5c-c77e6cb38287 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:58.939603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29c7c7ae-0fc2-41ea-8a5c-c77e6cb38287 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:29:58.939603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29c7c7ae-0fc2-41ea-8a5c-c77e6cb38287 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:29:59.229483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-29c7c7ae-0fc2-41ea-8a5c-c77e6cb38287 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:29:59.240894 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-29c7c7ae-0fc2-41ea-8a5c-c77e6cb38287 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1321 microversion: 2.1 time: 0.323931 Jan 22 21:29:59.242153 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3870/7444] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:29:58 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:00.263804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7b15fb19-ac07-4933-a276-fc2481be8ab9 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:00.265558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7b15fb19-ac07-4933-a276-fc2481be8ab9 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:00.276918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b15fb19-ac07-4933-a276-fc2481be8ab9 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:00.283624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b15fb19-ac07-4933-a276-fc2481be8ab9 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:00.285269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b15fb19-ac07-4933-a276-fc2481be8ab9 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:00.286762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b15fb19-ac07-4933-a276-fc2481be8ab9 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:00.393069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-d215a1fa-1e5d-4acb-8c3b-13ecc5f34694 req-ce0c2a3b-d78e-402e-9446-665ba9e7c75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0baccbde-7e33-4152-bed9-1ad1b2d27ca5", "tag": "18bf4346-9c2b-41ca-9ff8-ec9f5fcbe012"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:00.395651 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:30:00.395651 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:30:00.414058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d215a1fa-1e5d-4acb-8c3b-13ecc5f34694 req-ce0c2a3b-d78e-402e-9446-665ba9e7c75f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:00.416505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d215a1fa-1e5d-4acb-8c3b-13ecc5f34694 req-ce0c2a3b-d78e-402e-9446-665ba9e7c75f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:00.433247 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d215a1fa-1e5d-4acb-8c3b-13ecc5f34694 req-ce0c2a3b-d78e-402e-9446-665ba9e7c75f service nova] Creating event network-changed:18bf4346-9c2b-41ca-9ff8-ec9f5fcbe012 for instance 0baccbde-7e33-4152-bed9-1ad1b2d27ca5 on nch1-master-1 Jan 22 21:30:00.440389 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-d215a1fa-1e5d-4acb-8c3b-13ecc5f34694 req-ce0c2a3b-d78e-402e-9446-665ba9e7c75f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052447 Jan 22 21:30:00.444048 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3871/7445] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:30:00.634092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7b15fb19-ac07-4933-a276-fc2481be8ab9 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:00.643810 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7b15fb19-ac07-4933-a276-fc2481be8ab9 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1321 microversion: 2.1 time: 0.382818 Jan 22 21:30:00.643810 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3575/7446] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:00 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:01.662521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d4a9ca68-0e3c-45d8-9afb-718c8e214254 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:01.663941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d4a9ca68-0e3c-45d8-9afb-718c8e214254 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:01.671757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4a9ca68-0e3c-45d8-9afb-718c8e214254 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:01.672224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4a9ca68-0e3c-45d8-9afb-718c8e214254 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:01.673034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4a9ca68-0e3c-45d8-9afb-718c8e214254 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:01.673486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4a9ca68-0e3c-45d8-9afb-718c8e214254 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:01.895396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d4a9ca68-0e3c-45d8-9afb-718c8e214254 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:01.905061 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d4a9ca68-0e3c-45d8-9afb-718c8e214254 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1321 microversion: 2.1 time: 0.247427 Jan 22 21:30:01.905706 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3872/7447] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:01 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:02.924162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-482839e4-afa2-47a5-be9f-3b76959dca9b tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:02.925473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-482839e4-afa2-47a5-be9f-3b76959dca9b tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:02.933543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-482839e4-afa2-47a5-be9f-3b76959dca9b tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:02.934600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-482839e4-afa2-47a5-be9f-3b76959dca9b tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:02.935686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-482839e4-afa2-47a5-be9f-3b76959dca9b tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:02.936330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-482839e4-afa2-47a5-be9f-3b76959dca9b tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:03.116851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-482839e4-afa2-47a5-be9f-3b76959dca9b tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:03.125216 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-482839e4-afa2-47a5-be9f-3b76959dca9b tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1321 microversion: 2.1 time: 0.206107 Jan 22 21:30:03.126367 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3576/7448] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:02 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:04.143009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-30b39551-aa04-408d-932c-5ce65e7a7aab tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:04.144195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-30b39551-aa04-408d-932c-5ce65e7a7aab tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:04.151020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30b39551-aa04-408d-932c-5ce65e7a7aab tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:04.156598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30b39551-aa04-408d-932c-5ce65e7a7aab tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:04.158132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30b39551-aa04-408d-932c-5ce65e7a7aab tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:04.158793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30b39551-aa04-408d-932c-5ce65e7a7aab tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:04.381898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-30b39551-aa04-408d-932c-5ce65e7a7aab tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:04.391560 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-30b39551-aa04-408d-932c-5ce65e7a7aab tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1321 microversion: 2.1 time: 0.252581 Jan 22 21:30:04.392414 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3873/7449] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:04 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:05.416382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-df763c29-39dc-4d98-8a13-0f1d907368ec tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:05.417013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-df763c29-39dc-4d98-8a13-0f1d907368ec tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:05.426141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df763c29-39dc-4d98-8a13-0f1d907368ec tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:05.426844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df763c29-39dc-4d98-8a13-0f1d907368ec tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:05.427928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df763c29-39dc-4d98-8a13-0f1d907368ec tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:05.431917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-df763c29-39dc-4d98-8a13-0f1d907368ec tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:05.907358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-df763c29-39dc-4d98-8a13-0f1d907368ec tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:05.918364 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-df763c29-39dc-4d98-8a13-0f1d907368ec tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1321 microversion: 2.1 time: 0.505733 Jan 22 21:30:05.919027 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3577/7450] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:05 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1321 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:05.940579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-e39b8c0d-7b64-49b1-9e56-81e2c3e83d05 req-a769d025-a492-4a98-8368-116dfd082367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0baccbde-7e33-4152-bed9-1ad1b2d27ca5", "name": "network-vif-plugged", "status": "completed", "tag": "18bf4346-9c2b-41ca-9ff8-ec9f5fcbe012"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:05.943124 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:30:05.943124 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:30:05.953693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e39b8c0d-7b64-49b1-9e56-81e2c3e83d05 req-a769d025-a492-4a98-8368-116dfd082367 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:05.954152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e39b8c0d-7b64-49b1-9e56-81e2c3e83d05 req-a769d025-a492-4a98-8368-116dfd082367 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:05.965864 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-e39b8c0d-7b64-49b1-9e56-81e2c3e83d05 req-a769d025-a492-4a98-8368-116dfd082367 service nova] Creating event network-vif-plugged:18bf4346-9c2b-41ca-9ff8-ec9f5fcbe012 for instance 0baccbde-7e33-4152-bed9-1ad1b2d27ca5 on nch1-master-1 Jan 22 21:30:05.970946 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-e39b8c0d-7b64-49b1-9e56-81e2c3e83d05 req-a769d025-a492-4a98-8368-116dfd082367 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035409 Jan 22 21:30:05.972033 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3874/7451] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:30:06.935949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-585034a5-37a8-41f8-b22f-3c709998e0a3 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:06.936597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-585034a5-37a8-41f8-b22f-3c709998e0a3 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:06.943488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-585034a5-37a8-41f8-b22f-3c709998e0a3 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:06.943950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-585034a5-37a8-41f8-b22f-3c709998e0a3 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:06.944745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-585034a5-37a8-41f8-b22f-3c709998e0a3 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:06.945199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-585034a5-37a8-41f8-b22f-3c709998e0a3 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:07.106796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-585034a5-37a8-41f8-b22f-3c709998e0a3 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:07.114512 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-585034a5-37a8-41f8-b22f-3c709998e0a3 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1321 microversion: 2.1 time: 0.182301 Jan 22 21:30:07.120138 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3578/7452] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:06 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:08.132375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fdd0505b-fe00-425b-a445-1d19e6b2727e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:08.133706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fdd0505b-fe00-425b-a445-1d19e6b2727e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:08.142852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdd0505b-fe00-425b-a445-1d19e6b2727e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:08.143621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdd0505b-fe00-425b-a445-1d19e6b2727e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:08.144519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdd0505b-fe00-425b-a445-1d19e6b2727e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:08.145166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdd0505b-fe00-425b-a445-1d19e6b2727e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:08.319686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fdd0505b-fe00-425b-a445-1d19e6b2727e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:08.335595 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fdd0505b-fe00-425b-a445-1d19e6b2727e tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1509 microversion: 2.1 time: 0.207088 Jan 22 21:30:08.336200 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3875/7453] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:08 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:08.355970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-280463cc-95b7-4c4f-ac80-3a62febdf7ed tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:08.356505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-280463cc-95b7-4c4f-ac80-3a62febdf7ed tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:08.368985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-280463cc-95b7-4c4f-ac80-3a62febdf7ed tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:08.369454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-280463cc-95b7-4c4f-ac80-3a62febdf7ed tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:08.372679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-280463cc-95b7-4c4f-ac80-3a62febdf7ed tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:08.374769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-280463cc-95b7-4c4f-ac80-3a62febdf7ed tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:08.412175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-280463cc-95b7-4c4f-ac80-3a62febdf7ed tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:08.413250 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-280463cc-95b7-4c4f-ac80-3a62febdf7ed tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5/os-instance-actions/req-d5f71833-040b-4758-b8f3-08cf1ecac47d" status: 200 len: 313 microversion: 2.1 time: 0.061871 Jan 22 21:30:08.414070 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3579/7454] 10.222.0.100 () {58 vars in 1423 bytes} [Sat Jan 22 21:30:08 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5/os-instance-actions/req-d5f71833-040b-4758-b8f3-08cf1ecac47d => generated 313 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:30:08.430278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5b94e6c0-dcd3-4908-8416-95442c510bcb tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:08.430278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5b94e6c0-dcd3-4908-8416-95442c510bcb tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:08.438463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b94e6c0-dcd3-4908-8416-95442c510bcb tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:08.439178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b94e6c0-dcd3-4908-8416-95442c510bcb tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:08.440098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b94e6c0-dcd3-4908-8416-95442c510bcb tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:08.440677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b94e6c0-dcd3-4908-8416-95442c510bcb tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:08.660808 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5b94e6c0-dcd3-4908-8416-95442c510bcb tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "POST /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5/action" status: 202 len: 0 microversion: 2.1 time: 0.237635 Jan 22 21:30:08.664298 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3876/7455] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:30:08 2022] POST /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:30:08.673994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8726178b-921f-42d2-a919-3ea0da247271 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:08.674808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8726178b-921f-42d2-a919-3ea0da247271 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:08.682905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8726178b-921f-42d2-a919-3ea0da247271 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:08.684032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8726178b-921f-42d2-a919-3ea0da247271 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:08.685958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8726178b-921f-42d2-a919-3ea0da247271 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:08.686540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8726178b-921f-42d2-a919-3ea0da247271 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:08.870102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8726178b-921f-42d2-a919-3ea0da247271 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:08.895176 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8726178b-921f-42d2-a919-3ea0da247271 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1511 microversion: 2.1 time: 0.227620 Jan 22 21:30:08.905794 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3580/7456] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:08 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:09.913839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-80092bdb-0f13-41b6-ad5c-695307a1c4b5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:09.914649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-80092bdb-0f13-41b6-ad5c-695307a1c4b5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:09.925899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80092bdb-0f13-41b6-ad5c-695307a1c4b5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:09.926573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80092bdb-0f13-41b6-ad5c-695307a1c4b5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:09.927714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80092bdb-0f13-41b6-ad5c-695307a1c4b5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:09.928351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80092bdb-0f13-41b6-ad5c-695307a1c4b5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:10.093066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-80092bdb-0f13-41b6-ad5c-695307a1c4b5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:10.104838 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-80092bdb-0f13-41b6-ad5c-695307a1c4b5 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1516 microversion: 2.1 time: 0.191784 Jan 22 21:30:10.104838 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3877/7457] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:09 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1516 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:11.120260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b70e3271-9011-4765-8c99-df68fb778870 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:11.120812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b70e3271-9011-4765-8c99-df68fb778870 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:11.127736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b70e3271-9011-4765-8c99-df68fb778870 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:11.128313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b70e3271-9011-4765-8c99-df68fb778870 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:11.129091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b70e3271-9011-4765-8c99-df68fb778870 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:11.129610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b70e3271-9011-4765-8c99-df68fb778870 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:11.284712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b70e3271-9011-4765-8c99-df68fb778870 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:11.297786 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b70e3271-9011-4765-8c99-df68fb778870 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1509 microversion: 2.1 time: 0.181485 Jan 22 21:30:11.298372 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3581/7458] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:11 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:11.315025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a8b8b1b-f7e4-4d32-8f10-340856a17d77 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '.version_select at 0x7f1ed50b6ee0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:11.315603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a8b8b1b-f7e4-4d32-8f10-340856a17d77 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:11.322737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a8b8b1b-f7e4-4d32-8f10-340856a17d77 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:11.323192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a8b8b1b-f7e4-4d32-8f10-340856a17d77 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:11.323997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a8b8b1b-f7e4-4d32-8f10-340856a17d77 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:11.324449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a8b8b1b-f7e4-4d32-8f10-340856a17d77 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:11.359028 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a8b8b1b-f7e4-4d32-8f10-340856a17d77 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.048609 Jan 22 21:30:11.359608 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3878/7459] 10.222.0.100 () {58 vars in 1300 bytes} [Sat Jan 22 21:30:11 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5/os-instance-actions => generated 611 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:30:11.382929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b816b651-1e98-4e42-bd14-dceb10972903 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:11.382929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b816b651-1e98-4e42-bd14-dceb10972903 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:11.382929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b816b651-1e98-4e42-bd14-dceb10972903 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:11.382929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b816b651-1e98-4e42-bd14-dceb10972903 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:11.382929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b816b651-1e98-4e42-bd14-dceb10972903 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:11.382929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b816b651-1e98-4e42-bd14-dceb10972903 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:11.412591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b816b651-1e98-4e42-bd14-dceb10972903 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:30:11.691180 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b816b651-1e98-4e42-bd14-dceb10972903 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "DELETE /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 204 len: 0 microversion: 2.1 time: 0.323629 Jan 22 21:30:11.691792 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3582/7460] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:30:11 2022] DELETE /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:30:11.699741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-04c1a242-ab58-4094-8b02-b679ec734125 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:11.700355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-04c1a242-ab58-4094-8b02-b679ec734125 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:11.711826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04c1a242-ab58-4094-8b02-b679ec734125 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:11.711826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04c1a242-ab58-4094-8b02-b679ec734125 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:11.711826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04c1a242-ab58-4094-8b02-b679ec734125 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:11.711826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04c1a242-ab58-4094-8b02-b679ec734125 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:11.849903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-04c1a242-ab58-4094-8b02-b679ec734125 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:11.859762 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-04c1a242-ab58-4094-8b02-b679ec734125 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1515 microversion: 2.1 time: 0.163628 Jan 22 21:30:11.860346 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3879/7461] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:11 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:12.877822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-021eeb08-69bc-486b-8af7-c6a7c476f0c0 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:12.878603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-021eeb08-69bc-486b-8af7-c6a7c476f0c0 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:12.885584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-021eeb08-69bc-486b-8af7-c6a7c476f0c0 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:12.886243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-021eeb08-69bc-486b-8af7-c6a7c476f0c0 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:12.887096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-021eeb08-69bc-486b-8af7-c6a7c476f0c0 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:12.887562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-021eeb08-69bc-486b-8af7-c6a7c476f0c0 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:13.040821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-021eeb08-69bc-486b-8af7-c6a7c476f0c0 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:13.050076 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-021eeb08-69bc-486b-8af7-c6a7c476f0c0 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1515 microversion: 2.1 time: 0.177273 Jan 22 21:30:13.050763 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3583/7462] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:12 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:13.865624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-c256ead1-406c-4551-b03c-360524565045 req-797b6223-b15d-4f1f-b35f-ebfed020d64a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0baccbde-7e33-4152-bed9-1ad1b2d27ca5", "name": "network-vif-deleted", "tag": "18bf4346-9c2b-41ca-9ff8-ec9f5fcbe012"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:13.872313 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:30:13.872313 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:30:13.881825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c256ead1-406c-4551-b03c-360524565045 req-797b6223-b15d-4f1f-b35f-ebfed020d64a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:13.882322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c256ead1-406c-4551-b03c-360524565045 req-797b6223-b15d-4f1f-b35f-ebfed020d64a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:13.894178 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-c256ead1-406c-4551-b03c-360524565045 req-797b6223-b15d-4f1f-b35f-ebfed020d64a service nova] Creating event network-vif-deleted:18bf4346-9c2b-41ca-9ff8-ec9f5fcbe012 for instance 0baccbde-7e33-4152-bed9-1ad1b2d27ca5 on nch1-master-1 Jan 22 21:30:13.901686 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-c256ead1-406c-4551-b03c-360524565045 req-797b6223-b15d-4f1f-b35f-ebfed020d64a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038324 Jan 22 21:30:13.902304 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3880/7463] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:30:14.066931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4d1447aa-cfc0-4915-bfff-301c13be4aa7 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:14.067551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4d1447aa-cfc0-4915-bfff-301c13be4aa7 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:14.074423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d1447aa-cfc0-4915-bfff-301c13be4aa7 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:14.074878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d1447aa-cfc0-4915-bfff-301c13be4aa7 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:14.075838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d1447aa-cfc0-4915-bfff-301c13be4aa7 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:14.076568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d1447aa-cfc0-4915-bfff-301c13be4aa7 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:14.144352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4d1447aa-cfc0-4915-bfff-301c13be4aa7 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13589dc75041fe8b10975aeba4e540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0155083ce38b4d8fa425622e90ed8338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:14.152144 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4d1447aa-cfc0-4915-bfff-301c13be4aa7 tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 200 len: 1306 microversion: 2.1 time: 0.088962 Jan 22 21:30:14.153069 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3584/7464] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:14 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 1306 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:15.172062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c78102ab-5fed-4f3f-ba97-358d2c06bcfd tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:15.172770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c78102ab-5fed-4f3f-ba97-358d2c06bcfd tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] [instance: 0baccbde-7e33-4152-bed9-1ad1b2d27ca5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:15.180413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c78102ab-5fed-4f3f-ba97-358d2c06bcfd tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:15.181033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c78102ab-5fed-4f3f-ba97-358d2c06bcfd tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:15.181992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c78102ab-5fed-4f3f-ba97-358d2c06bcfd tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:15.182592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c78102ab-5fed-4f3f-ba97-358d2c06bcfd tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:15.197235 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-c78102ab-5fed-4f3f-ba97-358d2c06bcfd tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] HTTP exception thrown: Instance 0baccbde-7e33-4152-bed9-1ad1b2d27ca5 could not be found. Jan 22 21:30:15.197755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c78102ab-5fed-4f3f-ba97-358d2c06bcfd tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] Returning 404 to user: Instance 0baccbde-7e33-4152-bed9-1ad1b2d27ca5 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:30:15.198589 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c78102ab-5fed-4f3f-ba97-358d2c06bcfd tempest-InstanceActionsTestJSON-1940047863 tempest-InstanceActionsTestJSON-1940047863-project] 10.222.0.100 "GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5" status: 404 len: 111 microversion: 2.1 time: 0.031670 Jan 22 21:30:15.199130 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3881/7465] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:15 2022] GET /compute/v2.1/servers/0baccbde-7e33-4152-bed9-1ad1b2d27ca5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:30:17.945426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1e1176fe-e4aa-4d1a-a3f6-46e9bf463eef tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-656348883", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:17.947437 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-1e1176fe-e4aa-4d1a-a3f6-46e9bf463eef tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] HTTP exception thrown: min_count must be <= max_count Jan 22 21:30:17.948017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1e1176fe-e4aa-4d1a-a3f6-46e9bf463eef tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] Returning 400 to user: min_count must be <= max_count {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:30:17.948834 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1e1176fe-e4aa-4d1a-a3f6-46e9bf463eef tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.123361 Jan 22 21:30:17.949385 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3585/7466] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:30:17 2022] POST /compute/v2.1/servers => generated 74 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jan 22 21:30:18.001321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6209a64-c538-429f-9e43-ff033586d329 tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1040834246", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "max_count": 0}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:18.002793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6209a64-c538-429f-9e43-ff033586d329 tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:30:18.003666 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b6209a64-c538-429f-9e43-ff033586d329 tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.006842 Jan 22 21:30:18.004626 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3882/7467] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:30:17 2022] POST /compute/v2.1/servers => generated 130 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:30:18.055697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a9ce9623-a6b1-4821-9d95-c2da9625313a tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-109613558", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "max_count": 2.5}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:18.057067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a9ce9623-a6b1-4821-9d95-c2da9625313a tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:30:18.058713 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a9ce9623-a6b1-4821-9d95-c2da9625313a tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006721 Jan 22 21:30:18.059267 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3586/7468] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:30:18 2022] POST /compute/v2.1/servers => generated 139 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:30:18.107297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e262027c-491a-47e1-8f65-f245a73d608d tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-633189695", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "min_count": 0}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:18.110542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e262027c-491a-47e1-8f65-f245a73d608d tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:30:18.111410 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e262027c-491a-47e1-8f65-f245a73d608d tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.008461 Jan 22 21:30:18.112029 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3883/7469] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:30:18 2022] POST /compute/v2.1/servers => generated 130 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:30:18.160658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-53c0d51c-460d-4d69-aace-9eafb8c25c33 tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-444046905", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "min_count": 2.5}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:18.162050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-53c0d51c-460d-4d69-aace-9eafb8c25c33 tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:30:18.163447 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-53c0d51c-460d-4d69-aace-9eafb8c25c33 tempest-MultipleCreateNegativeTestJSON-882783486 tempest-MultipleCreateNegativeTestJSON-882783486-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006807 Jan 22 21:30:18.163971 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3587/7470] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:30:18 2022] POST /compute/v2.1/servers => generated 139 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:30:19.307259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3da53dc8-db75-40b8-83d5-c2db86744a07 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:19.308174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3da53dc8-db75-40b8-83d5-c2db86744a07 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:19.316795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3da53dc8-db75-40b8-83d5-c2db86744a07 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:19.317437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3da53dc8-db75-40b8-83d5-c2db86744a07 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:19.318387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3da53dc8-db75-40b8-83d5-c2db86744a07 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:19.318861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3da53dc8-db75-40b8-83d5-c2db86744a07 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:19.386306 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3da53dc8-db75-40b8-83d5-c2db86744a07 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "POST /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8/action" status: 200 len: 32633 microversion: 2.1 time: 0.083589 Jan 22 21:30:19.387564 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3884/7471] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:30:19 2022] POST /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8/action => generated 32633 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:30:20.768053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7be1a25e-bcd5-4b93-91bd-fceeb10b2f39 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:20.768479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7be1a25e-bcd5-4b93-91bd-fceeb10b2f39 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:20.777110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7be1a25e-bcd5-4b93-91bd-fceeb10b2f39 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:20.778525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7be1a25e-bcd5-4b93-91bd-fceeb10b2f39 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:20.779339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7be1a25e-bcd5-4b93-91bd-fceeb10b2f39 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:20.779788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7be1a25e-bcd5-4b93-91bd-fceeb10b2f39 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:20.811504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-019a6a05-7920-4b53-b9e5-6ac4e4083305 req-62206013-92e3-4aef-bda7-71d65c890f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8", "tag": "c39bfb96-d763-420b-963d-c992680fb94e"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:20.814980 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:30:20.814980 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:30:20.822063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7be1a25e-bcd5-4b93-91bd-fceeb10b2f39 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:30:20.834090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-019a6a05-7920-4b53-b9e5-6ac4e4083305 req-62206013-92e3-4aef-bda7-71d65c890f21 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:20.834551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-019a6a05-7920-4b53-b9e5-6ac4e4083305 req-62206013-92e3-4aef-bda7-71d65c890f21 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:20.857538 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-019a6a05-7920-4b53-b9e5-6ac4e4083305 req-62206013-92e3-4aef-bda7-71d65c890f21 service nova] Creating event network-changed:c39bfb96-d763-420b-963d-c992680fb94e for instance 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 on nch2-master-1 Jan 22 21:30:20.865180 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-019a6a05-7920-4b53-b9e5-6ac4e4083305 req-62206013-92e3-4aef-bda7-71d65c890f21 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081068 Jan 22 21:30:20.867290 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3885/7472] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:30:21.203091 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7be1a25e-bcd5-4b93-91bd-fceeb10b2f39 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "DELETE /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 204 len: 0 microversion: 2.1 time: 0.438092 Jan 22 21:30:21.204361 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3588/7473] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:30:20 2022] DELETE /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:30:21.216767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e48b576b-bcb0-4be1-a9ca-39cc46724a2e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:21.218089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e48b576b-bcb0-4be1-a9ca-39cc46724a2e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:21.234866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e48b576b-bcb0-4be1-a9ca-39cc46724a2e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:21.235334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e48b576b-bcb0-4be1-a9ca-39cc46724a2e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:21.238173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e48b576b-bcb0-4be1-a9ca-39cc46724a2e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:21.239200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e48b576b-bcb0-4be1-a9ca-39cc46724a2e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:21.453534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e48b576b-bcb0-4be1-a9ca-39cc46724a2e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:21.461536 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e48b576b-bcb0-4be1-a9ca-39cc46724a2e tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1677 microversion: 2.1 time: 0.251805 Jan 22 21:30:21.462572 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3886/7474] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:21 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1677 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:30:22.480640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0f90744f-1de2-4a45-816a-0d935d5ed796 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:22.481351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0f90744f-1de2-4a45-816a-0d935d5ed796 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:22.498469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f90744f-1de2-4a45-816a-0d935d5ed796 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:22.498469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f90744f-1de2-4a45-816a-0d935d5ed796 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:22.500539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f90744f-1de2-4a45-816a-0d935d5ed796 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:22.500539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f90744f-1de2-4a45-816a-0d935d5ed796 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:22.692039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0f90744f-1de2-4a45-816a-0d935d5ed796 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:22.700463 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0f90744f-1de2-4a45-816a-0d935d5ed796 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1558 microversion: 2.1 time: 0.223855 Jan 22 21:30:22.701224 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3589/7475] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:22 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:23.552770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-37741891-feae-4605-9a25-9f3a71c2e103 req-21ebe431-6688-458a-bbb3-13b600a71f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8", "name": "network-vif-deleted", "tag": "c39bfb96-d763-420b-963d-c992680fb94e"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:23.554311 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:30:23.554311 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:30:23.567754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-37741891-feae-4605-9a25-9f3a71c2e103 req-21ebe431-6688-458a-bbb3-13b600a71f50 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:23.568475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-37741891-feae-4605-9a25-9f3a71c2e103 req-21ebe431-6688-458a-bbb3-13b600a71f50 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:23.585902 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-37741891-feae-4605-9a25-9f3a71c2e103 req-21ebe431-6688-458a-bbb3-13b600a71f50 service nova] Creating event network-vif-deleted:c39bfb96-d763-420b-963d-c992680fb94e for instance 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 on nch2-master-1 Jan 22 21:30:23.593728 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-37741891-feae-4605-9a25-9f3a71c2e103 req-21ebe431-6688-458a-bbb3-13b600a71f50 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043646 Jan 22 21:30:23.594581 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3887/7476] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:30:23.730206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-20c780b3-6015-4cfc-9a9a-c8bbe25ef891 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:23.731035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-20c780b3-6015-4cfc-9a9a-c8bbe25ef891 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:23.739396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20c780b3-6015-4cfc-9a9a-c8bbe25ef891 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:23.739864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20c780b3-6015-4cfc-9a9a-c8bbe25ef891 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:23.740865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20c780b3-6015-4cfc-9a9a-c8bbe25ef891 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:23.741685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20c780b3-6015-4cfc-9a9a-c8bbe25ef891 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:23.870365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-20c780b3-6015-4cfc-9a9a-c8bbe25ef891 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84a5c446f01456e991f940f550199e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bdc4a0a875547f1a6ace5470bb1e777', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:23.881400 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-20c780b3-6015-4cfc-9a9a-c8bbe25ef891 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 200 len: 1338 microversion: 2.1 time: 0.164467 Jan 22 21:30:23.882054 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3590/7477] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:23 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 1338 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:24.900519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-76addf1a-da79-4a04-9add-4ba1303bc719 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:24.901435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-76addf1a-da79-4a04-9add-4ba1303bc719 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] [instance: 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:24.910865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76addf1a-da79-4a04-9add-4ba1303bc719 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:24.912153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76addf1a-da79-4a04-9add-4ba1303bc719 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:24.913153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76addf1a-da79-4a04-9add-4ba1303bc719 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:24.914080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76addf1a-da79-4a04-9add-4ba1303bc719 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:24.929954 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-76addf1a-da79-4a04-9add-4ba1303bc719 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] HTTP exception thrown: Instance 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 could not be found. Jan 22 21:30:24.930675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-76addf1a-da79-4a04-9add-4ba1303bc719 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Returning 404 to user: Instance 69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:30:24.931611 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-76addf1a-da79-4a04-9add-4ba1303bc719 tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8" status: 404 len: 111 microversion: 2.1 time: 0.036607 Jan 22 21:30:24.932446 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3888/7478] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:24 2022] GET /compute/v2.1/servers/69e4d7ce-ecd8-4007-89f8-6d6c7f61b5c8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:30:25.307920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-454be328-e326-4b29-904c-1e262511ea5b tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] Calling method '.version_select at 0x7f1ed51a09d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:25.407491 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-454be328-e326-4b29-904c-1e262511ea5b tempest-TestNetworkBasicOps-1364933817 tempest-TestNetworkBasicOps-1364933817-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2053380229" status: 202 len: 0 microversion: 2.1 time: 0.103165 Jan 22 21:30:25.412870 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3591/7479] 10.222.0.100 () {58 vars in 1261 bytes} [Sat Jan 22 21:30:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2053380229 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:30:29.649386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8219619b-de85-4cf1-bdc0-48516fa2720f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'create', calling method: .version_select at 0x7f1edaf8a550>, body: {"keypair": {"name": "tempest-keypair-744958505"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:29.666783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-8219619b-de85-4cf1-bdc0-48516fa2720f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Getting quotas for project d8242a159f044587a7f8bb2eef2c9914. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:30:29.694222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-8219619b-de85-4cf1-bdc0-48516fa2720f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Getting quotas for user 8ace63d7c59243d5abda14fbabd0fbed and project d8242a159f044587a7f8bb2eef2c9914. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:30:30.401716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-8219619b-de85-4cf1-bdc0-48516fa2720f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Getting quotas for project d8242a159f044587a7f8bb2eef2c9914. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:30:30.419474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-8219619b-de85-4cf1-bdc0-48516fa2720f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Getting quotas for user 8ace63d7c59243d5abda14fbabd0fbed and project d8242a159f044587a7f8bb2eef2c9914. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:30:30.448153 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8219619b-de85-4cf1-bdc0-48516fa2720f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.173580 Jan 22 21:30:30.457322 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3889/7480] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:30:29 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:34.779081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1387251294", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e64f360b-3907-4876-bfd1-47cd0201d17f"}], "security_groups": [{"name": "tempest-securitygroup--1236297435"}], "key_name": "tempest-keypair-744958505", "user_data": "}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:34.974898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] validate_networks() for [('e64f360b-3907-4876-bfd1-47cd0201d17f', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:30:35.573970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:30:35.574472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:30:35.575115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:30:35.575633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:30:35.576148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:30:35.586885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:35.587463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:35.588311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:35.588747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:35.609643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Getting quotas for project d8242a159f044587a7f8bb2eef2c9914. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:30:35.614804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Getting quotas for user 8ace63d7c59243d5abda14fbabd0fbed and project d8242a159f044587a7f8bb2eef2c9914. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:30:35.627934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:30:35.630343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:30:35.751322 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d828d0ba-8437-447e-a003-4d2367d47cfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 0.977331 Jan 22 21:30:35.752224 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3592/7481] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:30:34 2022] POST /compute/v2.1/servers => generated 411 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:30:35.763048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4047453a-86eb-47d3-bc86-eaf50d4c01e4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:35.765386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4047453a-86eb-47d3-bc86-eaf50d4c01e4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:35.857108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4047453a-86eb-47d3-bc86-eaf50d4c01e4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:35.868803 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4047453a-86eb-47d3-bc86-eaf50d4c01e4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1242 microversion: 2.1 time: 0.110186 Jan 22 21:30:35.870806 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3890/7482] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:35 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1242 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:36.585199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1997204499", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:36.644390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:30:36.887401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-76b83e7c-8a24-48e5-9c57-0f414859dad2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:36.888077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-76b83e7c-8a24-48e5-9c57-0f414859dad2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:36.964091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-76b83e7c-8a24-48e5-9c57-0f414859dad2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:36.971856 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-76b83e7c-8a24-48e5-9c57-0f414859dad2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1242 microversion: 2.1 time: 0.088082 Jan 22 21:30:36.972433 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3891/7483] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:36 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:37.016067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:30:37.016609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:30:37.017321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:30:37.017983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:30:37.018634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:30:37.029100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:37.029713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:37.031321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:37.036068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:37.052435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Getting quotas for project 44f9009465234bd2b86f8525b5b212c7. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:30:37.058960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Getting quotas for user 6199d0571f624eebbc985677380351fb and project 44f9009465234bd2b86f8525b5b212c7. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:30:37.072851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:30:37.075177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:30:37.380264 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0e31e0e3-6790-4c7b-8d69-05ffaa2a2959 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.797224 Jan 22 21:30:37.383319 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3593/7484] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:30:36 2022] POST /compute/v2.1/servers => generated 382 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:30:37.396471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cac64ffa-c640-49b6-bc6c-ba7ea9e72dba tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:37.400026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cac64ffa-c640-49b6-bc6c-ba7ea9e72dba tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:37.476808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cac64ffa-c640-49b6-bc6c-ba7ea9e72dba tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:37.484030 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cac64ffa-c640-49b6-bc6c-ba7ea9e72dba tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1218 microversion: 2.1 time: 0.090665 Jan 22 21:30:37.484631 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3892/7485] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:37 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:37.991114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ffd01bb3-35e0-4539-b122-2bcac663ef0d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:37.991765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ffd01bb3-35e0-4539-b122-2bcac663ef0d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:37.998574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffd01bb3-35e0-4539-b122-2bcac663ef0d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:38.000928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffd01bb3-35e0-4539-b122-2bcac663ef0d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:38.000928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffd01bb3-35e0-4539-b122-2bcac663ef0d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:38.001280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ffd01bb3-35e0-4539-b122-2bcac663ef0d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:38.065942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ffd01bb3-35e0-4539-b122-2bcac663ef0d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:38.073541 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ffd01bb3-35e0-4539-b122-2bcac663ef0d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1294 microversion: 2.1 time: 0.087428 Jan 22 21:30:38.074176 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3594/7486] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:37 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:38.501820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e9bf6d2b-885e-4b0c-bc2d-b0a9aca03c25 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:38.502485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e9bf6d2b-885e-4b0c-bc2d-b0a9aca03c25 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:38.604327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e9bf6d2b-885e-4b0c-bc2d-b0a9aca03c25 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:38.614468 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e9bf6d2b-885e-4b0c-bc2d-b0a9aca03c25 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1218 microversion: 2.1 time: 0.116905 Jan 22 21:30:38.615678 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3893/7487] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:38 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:39.097285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5c29b35a-8a9b-44ed-94aa-edde4cde74ba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:39.097984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5c29b35a-8a9b-44ed-94aa-edde4cde74ba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:39.117934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c29b35a-8a9b-44ed-94aa-edde4cde74ba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:39.121163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c29b35a-8a9b-44ed-94aa-edde4cde74ba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:39.124394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c29b35a-8a9b-44ed-94aa-edde4cde74ba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:39.124394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c29b35a-8a9b-44ed-94aa-edde4cde74ba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:39.202718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5c29b35a-8a9b-44ed-94aa-edde4cde74ba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:39.214839 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5c29b35a-8a9b-44ed-94aa-edde4cde74ba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1300 microversion: 2.1 time: 0.118662 Jan 22 21:30:39.214839 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3595/7488] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:39 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:39.638958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dafbc756-2b06-41c7-8d84-95dfa8b24a29 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:39.641228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dafbc756-2b06-41c7-8d84-95dfa8b24a29 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:39.662868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dafbc756-2b06-41c7-8d84-95dfa8b24a29 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:39.664570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dafbc756-2b06-41c7-8d84-95dfa8b24a29 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:39.669012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dafbc756-2b06-41c7-8d84-95dfa8b24a29 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:39.670126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dafbc756-2b06-41c7-8d84-95dfa8b24a29 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:39.780783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dafbc756-2b06-41c7-8d84-95dfa8b24a29 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:39.789214 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dafbc756-2b06-41c7-8d84-95dfa8b24a29 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1270 microversion: 2.1 time: 0.157755 Jan 22 21:30:39.789925 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3894/7489] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:39 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:40.228564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-752cb2e8-1588-41ca-962b-632244190877 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:40.229737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-752cb2e8-1588-41ca-962b-632244190877 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:40.242752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-752cb2e8-1588-41ca-962b-632244190877 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:40.243474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-752cb2e8-1588-41ca-962b-632244190877 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:40.247999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-752cb2e8-1588-41ca-962b-632244190877 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:40.248650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-752cb2e8-1588-41ca-962b-632244190877 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:40.593366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-752cb2e8-1588-41ca-962b-632244190877 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:40.608429 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-752cb2e8-1588-41ca-962b-632244190877 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1368 microversion: 2.1 time: 0.380248 Jan 22 21:30:40.608429 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3596/7490] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:40 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1368 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:40.638871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-946039327", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "486361d2-61e7-44ea-81d3-a4e696d54a23"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:40.703583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] validate_networks() for [('486361d2-61e7-44ea-81d3-a4e696d54a23', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:30:40.818792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cd2edd52-97e1-484e-bf1e-a83283268c9f tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:40.819614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cd2edd52-97e1-484e-bf1e-a83283268c9f tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:40.826970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd2edd52-97e1-484e-bf1e-a83283268c9f tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:40.827737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd2edd52-97e1-484e-bf1e-a83283268c9f tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:40.829347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd2edd52-97e1-484e-bf1e-a83283268c9f tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:40.829804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd2edd52-97e1-484e-bf1e-a83283268c9f tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:40.923755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cd2edd52-97e1-484e-bf1e-a83283268c9f tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:40.931701 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cd2edd52-97e1-484e-bf1e-a83283268c9f tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1276 microversion: 2.1 time: 0.128663 Jan 22 21:30:40.932762 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3597/7491] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:40 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:30:41.154635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-5ef02a0d-aa2e-483c-ad7e-eb997fbc9dfc req-463c9ed4-8997-4b6a-85e7-cb2014f61a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e98b30-0c8f-4544-9800-71179f1dfed0", "tag": "a39b0c0a-a794-487b-b823-eb2be84c82fa"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:41.157114 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:30:41.157114 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:30:41.165087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5ef02a0d-aa2e-483c-ad7e-eb997fbc9dfc req-463c9ed4-8997-4b6a-85e7-cb2014f61a6b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:41.165568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5ef02a0d-aa2e-483c-ad7e-eb997fbc9dfc req-463c9ed4-8997-4b6a-85e7-cb2014f61a6b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:41.179266 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-5ef02a0d-aa2e-483c-ad7e-eb997fbc9dfc req-463c9ed4-8997-4b6a-85e7-cb2014f61a6b service nova] Creating event network-changed:a39b0c0a-a794-487b-b823-eb2be84c82fa for instance a0e98b30-0c8f-4544-9800-71179f1dfed0 on nch2-master-1 Jan 22 21:30:41.184843 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-5ef02a0d-aa2e-483c-ad7e-eb997fbc9dfc req-463c9ed4-8997-4b6a-85e7-cb2014f61a6b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128494 Jan 22 21:30:41.186110 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3598/7492] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:30:41.438300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:30:41.438792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:30:41.439657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:30:41.440199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:30:41.440721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:30:41.450469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:41.451284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:41.453080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:41.453716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:41.473746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Getting quotas for project 02683bc7565949ab9c1ac9ba2c3c45cf. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:30:41.481803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Getting quotas for user 63d9158d3741473994ad5cb2066857d0 and project 02683bc7565949ab9c1ac9ba2c3c45cf. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:30:41.496409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:30:41.500096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:30:41.628531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ac3e749d-81a5-40bd-9c76-d23a7b945155 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:41.628531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ac3e749d-81a5-40bd-9c76-d23a7b945155 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:41.637496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac3e749d-81a5-40bd-9c76-d23a7b945155 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:41.638019 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-40455038-5054-4ca7-871d-77d181579974 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.175079 Jan 22 21:30:41.638576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac3e749d-81a5-40bd-9c76-d23a7b945155 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:41.641317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac3e749d-81a5-40bd-9c76-d23a7b945155 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:41.642022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac3e749d-81a5-40bd-9c76-d23a7b945155 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:41.644669 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3895/7493] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:30:40 2022] POST /compute/v2.1/servers => generated 382 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:30:41.650703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8d526ae9-15e2-403b-93c4-0dbb18215d7b tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:41.651701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8d526ae9-15e2-403b-93c4-0dbb18215d7b tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:41.749236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8d526ae9-15e2-403b-93c4-0dbb18215d7b tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:41.749236 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8d526ae9-15e2-403b-93c4-0dbb18215d7b tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1218 microversion: 2.1 time: 0.102637 Jan 22 21:30:41.750246 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3896/7494] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:41 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:41.952280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-00636518-c967-4f96-bbc3-38a0de0775b7 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:41.953267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-00636518-c967-4f96-bbc3-38a0de0775b7 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:41.961286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00636518-c967-4f96-bbc3-38a0de0775b7 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:41.962049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00636518-c967-4f96-bbc3-38a0de0775b7 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:41.963258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00636518-c967-4f96-bbc3-38a0de0775b7 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:41.963917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00636518-c967-4f96-bbc3-38a0de0775b7 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:42.105783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ac3e749d-81a5-40bd-9c76-d23a7b945155 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:42.120113 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ac3e749d-81a5-40bd-9c76-d23a7b945155 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1368 microversion: 2.1 time: 0.500058 Jan 22 21:30:42.120113 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3599/7495] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:41 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1368 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:42.767052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-681361e7-dbda-47f9-a758-89ad593e1e0e tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:42.767711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-681361e7-dbda-47f9-a758-89ad593e1e0e tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:42.797194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-00636518-c967-4f96-bbc3-38a0de0775b7 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:42.808633 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-00636518-c967-4f96-bbc3-38a0de0775b7 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1318 microversion: 2.1 time: 0.860029 Jan 22 21:30:42.810683 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3897/7496] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:41 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1318 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:43.050327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-681361e7-dbda-47f9-a758-89ad593e1e0e tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:43.069912 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-681361e7-dbda-47f9-a758-89ad593e1e0e tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1218 microversion: 2.1 time: 0.306491 Jan 22 21:30:43.072645 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3600/7497] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:42 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1218 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:30:43.136175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cea7fc90-074f-4a4d-8f93-8ac605669baa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:43.137323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cea7fc90-074f-4a4d-8f93-8ac605669baa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:43.143789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cea7fc90-074f-4a4d-8f93-8ac605669baa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:43.144302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cea7fc90-074f-4a4d-8f93-8ac605669baa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:43.145047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cea7fc90-074f-4a4d-8f93-8ac605669baa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:43.145492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cea7fc90-074f-4a4d-8f93-8ac605669baa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:43.305294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cea7fc90-074f-4a4d-8f93-8ac605669baa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:43.314775 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cea7fc90-074f-4a4d-8f93-8ac605669baa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1368 microversion: 2.1 time: 0.182293 Jan 22 21:30:43.319732 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3898/7498] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:43 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:43.827723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb877ac5-6f86-44ac-aa2e-913dfddc935a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:43.828389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb877ac5-6f86-44ac-aa2e-913dfddc935a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:43.840460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb877ac5-6f86-44ac-aa2e-913dfddc935a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:43.840928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb877ac5-6f86-44ac-aa2e-913dfddc935a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:43.841770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb877ac5-6f86-44ac-aa2e-913dfddc935a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:43.842225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb877ac5-6f86-44ac-aa2e-913dfddc935a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:43.984717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-c970a309-b8ad-4fbc-8aba-58eaea28fbe0 req-289a9fed-2cf1-4cc7-86bc-8c68b2e182b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e43d666-76b2-4247-8f74-edf55ee918bf", "tag": "36987e11-f55e-4a96-8b20-b7f9bc094bbc"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:43.987712 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:30:43.987712 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:30:44.007763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c970a309-b8ad-4fbc-8aba-58eaea28fbe0 req-289a9fed-2cf1-4cc7-86bc-8c68b2e182b6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:44.009299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-c970a309-b8ad-4fbc-8aba-58eaea28fbe0 req-289a9fed-2cf1-4cc7-86bc-8c68b2e182b6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:44.027865 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-c970a309-b8ad-4fbc-8aba-58eaea28fbe0 req-289a9fed-2cf1-4cc7-86bc-8c68b2e182b6 service nova] Creating event network-changed:36987e11-f55e-4a96-8b20-b7f9bc094bbc for instance 2e43d666-76b2-4247-8f74-edf55ee918bf on nch2-master-1 Jan 22 21:30:44.036181 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-c970a309-b8ad-4fbc-8aba-58eaea28fbe0 req-289a9fed-2cf1-4cc7-86bc-8c68b2e182b6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063900 Jan 22 21:30:44.036718 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3899/7499] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:30:44.090129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b4bcd22f-635b-40ae-a956-ab9fd785330b tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:44.091068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b4bcd22f-635b-40ae-a956-ab9fd785330b tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:44.099352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4bcd22f-635b-40ae-a956-ab9fd785330b tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:44.100301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4bcd22f-635b-40ae-a956-ab9fd785330b tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:44.101304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4bcd22f-635b-40ae-a956-ab9fd785330b tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:44.102193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4bcd22f-635b-40ae-a956-ab9fd785330b tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:44.181979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fb877ac5-6f86-44ac-aa2e-913dfddc935a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:44.191423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b4bcd22f-635b-40ae-a956-ab9fd785330b tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:44.195430 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb877ac5-6f86-44ac-aa2e-913dfddc935a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1318 microversion: 2.1 time: 0.372337 Jan 22 21:30:44.196413 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3601/7500] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:43 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:44.203553 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b4bcd22f-635b-40ae-a956-ab9fd785330b tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1270 microversion: 2.1 time: 0.118852 Jan 22 21:30:44.204144 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3900/7501] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:44 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:30:44.334080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5aa1158b-5637-4296-ba9b-7e8b3802bd0e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:44.346850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5aa1158b-5637-4296-ba9b-7e8b3802bd0e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:44.349793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5aa1158b-5637-4296-ba9b-7e8b3802bd0e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:44.350258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5aa1158b-5637-4296-ba9b-7e8b3802bd0e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:44.352002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5aa1158b-5637-4296-ba9b-7e8b3802bd0e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:44.352714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5aa1158b-5637-4296-ba9b-7e8b3802bd0e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:44.752200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5aa1158b-5637-4296-ba9b-7e8b3802bd0e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:44.759994 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5aa1158b-5637-4296-ba9b-7e8b3802bd0e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1368 microversion: 2.1 time: 0.430985 Jan 22 21:30:44.760584 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3602/7502] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:44 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1368 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:45.217193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-29e867ec-58dd-43ed-8afd-cb4999042cd5 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:45.218878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-29e867ec-58dd-43ed-8afd-cb4999042cd5 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:45.222128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d90b3bae-ba68-496b-b97b-856284ce65d8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:45.222748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d90b3bae-ba68-496b-b97b-856284ce65d8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:45.229487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d90b3bae-ba68-496b-b97b-856284ce65d8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:45.230262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d90b3bae-ba68-496b-b97b-856284ce65d8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:45.230821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29e867ec-58dd-43ed-8afd-cb4999042cd5 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:45.231075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d90b3bae-ba68-496b-b97b-856284ce65d8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:45.231523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29e867ec-58dd-43ed-8afd-cb4999042cd5 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:45.231629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d90b3bae-ba68-496b-b97b-856284ce65d8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:45.232349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29e867ec-58dd-43ed-8afd-cb4999042cd5 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:45.232793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29e867ec-58dd-43ed-8afd-cb4999042cd5 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:45.301990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d90b3bae-ba68-496b-b97b-856284ce65d8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:45.310972 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d90b3bae-ba68-496b-b97b-856284ce65d8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1276 microversion: 2.1 time: 0.094264 Jan 22 21:30:45.312507 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3603/7503] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:45 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:30:45.456343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-29e867ec-58dd-43ed-8afd-cb4999042cd5 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:45.478881 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-29e867ec-58dd-43ed-8afd-cb4999042cd5 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1318 microversion: 2.1 time: 0.268625 Jan 22 21:30:45.479853 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3901/7504] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:45 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:45.776170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dd3e2bb2-e162-4d13-b0a2-f710129acf63 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:45.777229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dd3e2bb2-e162-4d13-b0a2-f710129acf63 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:45.786392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd3e2bb2-e162-4d13-b0a2-f710129acf63 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:45.789384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd3e2bb2-e162-4d13-b0a2-f710129acf63 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:45.790606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd3e2bb2-e162-4d13-b0a2-f710129acf63 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:45.791215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd3e2bb2-e162-4d13-b0a2-f710129acf63 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:46.049904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dd3e2bb2-e162-4d13-b0a2-f710129acf63 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:46.058813 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dd3e2bb2-e162-4d13-b0a2-f710129acf63 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1368 microversion: 2.1 time: 0.286382 Jan 22 21:30:46.060264 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3604/7505] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:45 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:46.338134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-065df9f9-be0e-42d3-b2b4-fd2c63f1907a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:46.339554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-065df9f9-be0e-42d3-b2b4-fd2c63f1907a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:46.349190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-065df9f9-be0e-42d3-b2b4-fd2c63f1907a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:46.349782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-065df9f9-be0e-42d3-b2b4-fd2c63f1907a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:46.351178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-065df9f9-be0e-42d3-b2b4-fd2c63f1907a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:46.351769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-065df9f9-be0e-42d3-b2b4-fd2c63f1907a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:46.496192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c294ab70-2265-4768-807f-87ae6d2d5cf4 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:46.496915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c294ab70-2265-4768-807f-87ae6d2d5cf4 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:46.505428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c294ab70-2265-4768-807f-87ae6d2d5cf4 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:46.506105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c294ab70-2265-4768-807f-87ae6d2d5cf4 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:46.506922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c294ab70-2265-4768-807f-87ae6d2d5cf4 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:46.507376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c294ab70-2265-4768-807f-87ae6d2d5cf4 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:46.593460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-065df9f9-be0e-42d3-b2b4-fd2c63f1907a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:46.603352 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-065df9f9-be0e-42d3-b2b4-fd2c63f1907a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1318 microversion: 2.1 time: 0.271775 Jan 22 21:30:46.614746 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3902/7506] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:46 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:46.673091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a7e10f3c-1cfc-4513-948c-c5f27451ba20 req-da153a48-2af6-4293-989a-d287cd4101f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "338d6677-62a3-49f4-b495-a3e1bdf71fb1", "tag": "119fa872-96b8-4abc-b528-bd69db90e714"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:46.675642 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:30:46.675642 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:30:46.685858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a7e10f3c-1cfc-4513-948c-c5f27451ba20 req-da153a48-2af6-4293-989a-d287cd4101f6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:46.685858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a7e10f3c-1cfc-4513-948c-c5f27451ba20 req-da153a48-2af6-4293-989a-d287cd4101f6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:46.699733 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a7e10f3c-1cfc-4513-948c-c5f27451ba20 req-da153a48-2af6-4293-989a-d287cd4101f6 service nova] Creating event network-changed:119fa872-96b8-4abc-b528-bd69db90e714 for instance 338d6677-62a3-49f4-b495-a3e1bdf71fb1 on nch1-master-1 Jan 22 21:30:46.705767 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a7e10f3c-1cfc-4513-948c-c5f27451ba20 req-da153a48-2af6-4293-989a-d287cd4101f6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039451 Jan 22 21:30:46.710247 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3903/7507] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:30:46.754766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c294ab70-2265-4768-807f-87ae6d2d5cf4 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:46.761366 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c294ab70-2265-4768-807f-87ae6d2d5cf4 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1318 microversion: 2.1 time: 0.268872 Jan 22 21:30:46.764157 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3605/7508] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:46 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:47.085714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0e45dd89-09e2-493b-8ce9-f8562b462a0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:47.087092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0e45dd89-09e2-493b-8ce9-f8562b462a0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:47.097074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e45dd89-09e2-493b-8ce9-f8562b462a0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:47.097883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e45dd89-09e2-493b-8ce9-f8562b462a0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:47.099002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e45dd89-09e2-493b-8ce9-f8562b462a0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:47.100142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e45dd89-09e2-493b-8ce9-f8562b462a0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:47.266724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0e45dd89-09e2-493b-8ce9-f8562b462a0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:47.276084 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0e45dd89-09e2-493b-8ce9-f8562b462a0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1368 microversion: 2.1 time: 0.195197 Jan 22 21:30:47.290815 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3904/7509] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:47 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:47.620442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-074700db-c719-427f-9096-ee31dac0791a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:47.621683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-074700db-c719-427f-9096-ee31dac0791a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:47.629073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-074700db-c719-427f-9096-ee31dac0791a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:47.629736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-074700db-c719-427f-9096-ee31dac0791a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:47.630701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-074700db-c719-427f-9096-ee31dac0791a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:47.631299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-074700db-c719-427f-9096-ee31dac0791a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:47.769755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-e1d66d42-3bca-4989-843c-ff25280b5bc7 req-1edd1912-3db8-45bf-8ff9-df0e9a2b7ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e98b30-0c8f-4544-9800-71179f1dfed0", "name": "network-vif-plugged", "status": "completed", "tag": "a39b0c0a-a794-487b-b823-eb2be84c82fa"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:47.771482 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:30:47.771482 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:30:47.779831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e1d66d42-3bca-4989-843c-ff25280b5bc7 req-1edd1912-3db8-45bf-8ff9-df0e9a2b7ce9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:47.784246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e1d66d42-3bca-4989-843c-ff25280b5bc7 req-1edd1912-3db8-45bf-8ff9-df0e9a2b7ce9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:47.795570 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-e1d66d42-3bca-4989-843c-ff25280b5bc7 req-1edd1912-3db8-45bf-8ff9-df0e9a2b7ce9 service nova] Creating event network-vif-plugged:a39b0c0a-a794-487b-b823-eb2be84c82fa for instance a0e98b30-0c8f-4544-9800-71179f1dfed0 on nch2-master-1 Jan 22 21:30:47.800917 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-e1d66d42-3bca-4989-843c-ff25280b5bc7 req-1edd1912-3db8-45bf-8ff9-df0e9a2b7ce9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035971 Jan 22 21:30:47.801704 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3905/7510] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:30:47.806836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-514c11f4-4f3d-4f1f-8035-d0aa82c73dd3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:47.807528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-514c11f4-4f3d-4f1f-8035-d0aa82c73dd3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:47.814276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-514c11f4-4f3d-4f1f-8035-d0aa82c73dd3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:47.814798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-514c11f4-4f3d-4f1f-8035-d0aa82c73dd3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:47.815599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-514c11f4-4f3d-4f1f-8035-d0aa82c73dd3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:47.816040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-514c11f4-4f3d-4f1f-8035-d0aa82c73dd3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:47.877731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-074700db-c719-427f-9096-ee31dac0791a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:47.885467 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-074700db-c719-427f-9096-ee31dac0791a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1318 microversion: 2.1 time: 0.268647 Jan 22 21:30:47.886080 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3606/7511] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:47 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:48.047810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-514c11f4-4f3d-4f1f-8035-d0aa82c73dd3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:48.056403 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-514c11f4-4f3d-4f1f-8035-d0aa82c73dd3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1318 microversion: 2.1 time: 0.253458 Jan 22 21:30:48.066571 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3906/7512] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:47 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:48.299125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-69a0ac58-3ea8-4835-bb55-f5128924656c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:48.300222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-69a0ac58-3ea8-4835-bb55-f5128924656c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:48.306914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69a0ac58-3ea8-4835-bb55-f5128924656c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:48.307558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69a0ac58-3ea8-4835-bb55-f5128924656c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:48.308847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69a0ac58-3ea8-4835-bb55-f5128924656c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:48.309301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69a0ac58-3ea8-4835-bb55-f5128924656c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:48.493147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-69a0ac58-3ea8-4835-bb55-f5128924656c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:48.504888 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-69a0ac58-3ea8-4835-bb55-f5128924656c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1368 microversion: 2.1 time: 0.210189 Jan 22 21:30:48.506747 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3607/7513] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:48 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:48.902950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6cd18c31-24f7-44aa-b2ee-1437c5a34124 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:48.903581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6cd18c31-24f7-44aa-b2ee-1437c5a34124 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:48.912606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6cd18c31-24f7-44aa-b2ee-1437c5a34124 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:48.912850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6cd18c31-24f7-44aa-b2ee-1437c5a34124 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:48.914024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6cd18c31-24f7-44aa-b2ee-1437c5a34124 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:48.914477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6cd18c31-24f7-44aa-b2ee-1437c5a34124 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:49.073022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6cd18c31-24f7-44aa-b2ee-1437c5a34124 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:49.073855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-17dd4bd5-815a-4bbd-a512-fe61eef83c7a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:49.074494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-17dd4bd5-815a-4bbd-a512-fe61eef83c7a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:49.082040 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6cd18c31-24f7-44aa-b2ee-1437c5a34124 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1318 microversion: 2.1 time: 0.182936 Jan 22 21:30:49.082203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17dd4bd5-815a-4bbd-a512-fe61eef83c7a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:49.089699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17dd4bd5-815a-4bbd-a512-fe61eef83c7a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:49.089804 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3907/7514] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:48 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:49.089883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17dd4bd5-815a-4bbd-a512-fe61eef83c7a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:49.089883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17dd4bd5-815a-4bbd-a512-fe61eef83c7a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:49.260615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-17dd4bd5-815a-4bbd-a512-fe61eef83c7a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:49.268355 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-17dd4bd5-815a-4bbd-a512-fe61eef83c7a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1318 microversion: 2.1 time: 0.198091 Jan 22 21:30:49.268945 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3608/7515] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:49 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:30:49.522699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6c75cc52-84f7-4330-a3a0-ad3f1adbd75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:49.523354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6c75cc52-84f7-4330-a3a0-ad3f1adbd75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:49.529555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c75cc52-84f7-4330-a3a0-ad3f1adbd75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:49.530225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c75cc52-84f7-4330-a3a0-ad3f1adbd75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:49.531668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c75cc52-84f7-4330-a3a0-ad3f1adbd75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:49.532255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6c75cc52-84f7-4330-a3a0-ad3f1adbd75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:49.768604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6c75cc52-84f7-4330-a3a0-ad3f1adbd75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:49.785331 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6c75cc52-84f7-4330-a3a0-ad3f1adbd75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1368 microversion: 2.1 time: 0.266466 Jan 22 21:30:49.797217 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3908/7516] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:49 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:50.099525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab1f223f-efba-4f51-b26c-9e55bb2c37be tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:50.100542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab1f223f-efba-4f51-b26c-9e55bb2c37be tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:50.107846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab1f223f-efba-4f51-b26c-9e55bb2c37be tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:50.108580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab1f223f-efba-4f51-b26c-9e55bb2c37be tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:50.110118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab1f223f-efba-4f51-b26c-9e55bb2c37be tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:50.110832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab1f223f-efba-4f51-b26c-9e55bb2c37be tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:50.254957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab1f223f-efba-4f51-b26c-9e55bb2c37be tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:50.287665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7dac1478-20e7-4c84-a987-eca336c7bc2a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:50.288749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7dac1478-20e7-4c84-a987-eca336c7bc2a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:50.293153 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab1f223f-efba-4f51-b26c-9e55bb2c37be tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1318 microversion: 2.1 time: 0.197109 Jan 22 21:30:50.307817 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3609/7517] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:50 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:50.316229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dac1478-20e7-4c84-a987-eca336c7bc2a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:50.316638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dac1478-20e7-4c84-a987-eca336c7bc2a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:50.317843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dac1478-20e7-4c84-a987-eca336c7bc2a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:50.320130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dac1478-20e7-4c84-a987-eca336c7bc2a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:50.503721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7dac1478-20e7-4c84-a987-eca336c7bc2a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:50.514731 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7dac1478-20e7-4c84-a987-eca336c7bc2a tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1318 microversion: 2.1 time: 0.232166 Jan 22 21:30:50.516081 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3909/7518] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:50 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:30:50.802928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-885e86ad-3261-4201-888f-14744bf2166d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:50.803462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-885e86ad-3261-4201-888f-14744bf2166d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:50.809772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-885e86ad-3261-4201-888f-14744bf2166d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:50.810227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-885e86ad-3261-4201-888f-14744bf2166d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:50.811040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-885e86ad-3261-4201-888f-14744bf2166d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:50.811514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-885e86ad-3261-4201-888f-14744bf2166d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:50.949195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-885e86ad-3261-4201-888f-14744bf2166d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:50.957935 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-885e86ad-3261-4201-888f-14744bf2166d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1554 microversion: 2.1 time: 0.158821 Jan 22 21:30:50.958575 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3610/7519] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:50 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:50.975768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ce5df44c-a871-45f4-8c63-b04521acc3a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:50.976287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ce5df44c-a871-45f4-8c63-b04521acc3a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:50.982781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce5df44c-a871-45f4-8c63-b04521acc3a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:50.983240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce5df44c-a871-45f4-8c63-b04521acc3a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:50.984069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce5df44c-a871-45f4-8c63-b04521acc3a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:50.984557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce5df44c-a871-45f4-8c63-b04521acc3a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:51.083733 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ce5df44c-a871-45f4-8c63-b04521acc3a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111788 Jan 22 21:30:51.089670 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3910/7520] 10.222.0.100 () {58 vars in 1279 bytes} [Sat Jan 22 21:30:50 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:30:51.326924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d503f2d2-a208-43cb-a140-0a39c538627c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:51.330729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d503f2d2-a208-43cb-a140-0a39c538627c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:51.340930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d503f2d2-a208-43cb-a140-0a39c538627c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:51.341800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d503f2d2-a208-43cb-a140-0a39c538627c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:51.343192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d503f2d2-a208-43cb-a140-0a39c538627c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:51.344700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d503f2d2-a208-43cb-a140-0a39c538627c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:51.526820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d503f2d2-a208-43cb-a140-0a39c538627c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:51.535942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d6ae21d-2810-4f33-bde5-668feeac32d3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:51.537605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d6ae21d-2810-4f33-bde5-668feeac32d3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:51.537746 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d503f2d2-a208-43cb-a140-0a39c538627c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1318 microversion: 2.1 time: 0.216105 Jan 22 21:30:51.545528 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3611/7521] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:51 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:51.554024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d6ae21d-2810-4f33-bde5-668feeac32d3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:51.554485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d6ae21d-2810-4f33-bde5-668feeac32d3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:51.555327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d6ae21d-2810-4f33-bde5-668feeac32d3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:51.558513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d6ae21d-2810-4f33-bde5-668feeac32d3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:51.850349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-33e8cfda-8d51-436d-99cc-4686f0c05b03 req-39ecf441-287a-4692-bd47-f79d0fcce4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e43d666-76b2-4247-8f74-edf55ee918bf", "name": "network-vif-plugged", "status": "completed", "tag": "36987e11-f55e-4a96-8b20-b7f9bc094bbc"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:51.852845 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:30:51.852845 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:30:51.860852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-33e8cfda-8d51-436d-99cc-4686f0c05b03 req-39ecf441-287a-4692-bd47-f79d0fcce4b1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:51.861491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-33e8cfda-8d51-436d-99cc-4686f0c05b03 req-39ecf441-287a-4692-bd47-f79d0fcce4b1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:51.884522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5d6ae21d-2810-4f33-bde5-668feeac32d3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:51.897697 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d6ae21d-2810-4f33-bde5-668feeac32d3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1318 microversion: 2.1 time: 0.368719 Jan 22 21:30:51.898305 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3911/7522] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:51 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:30:51.907379 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-33e8cfda-8d51-436d-99cc-4686f0c05b03 req-39ecf441-287a-4692-bd47-f79d0fcce4b1 service nova] Creating event network-vif-plugged:36987e11-f55e-4a96-8b20-b7f9bc094bbc for instance 2e43d666-76b2-4247-8f74-edf55ee918bf on nch2-master-1 Jan 22 21:30:51.912240 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-33e8cfda-8d51-436d-99cc-4686f0c05b03 req-39ecf441-287a-4692-bd47-f79d0fcce4b1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065230 Jan 22 21:30:51.917880 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3612/7523] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:30:52.378988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b4eaf145-7ffb-41e3-9f47-47f435affa27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:52.380003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b4eaf145-7ffb-41e3-9f47-47f435affa27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:52.383997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-fbe3f93e-dce9-4d96-a3a2-fcf19fa064e8 req-76d93bbb-c90f-4acb-97d8-a3f6f8ca9814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e98b30-0c8f-4544-9800-71179f1dfed0", "tag": "a39b0c0a-a794-487b-b823-eb2be84c82fa"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:52.386193 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:30:52.386193 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:30:52.386512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4eaf145-7ffb-41e3-9f47-47f435affa27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:52.386968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4eaf145-7ffb-41e3-9f47-47f435affa27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:52.387766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4eaf145-7ffb-41e3-9f47-47f435affa27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:52.388479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b4eaf145-7ffb-41e3-9f47-47f435affa27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:52.397233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fbe3f93e-dce9-4d96-a3a2-fcf19fa064e8 req-76d93bbb-c90f-4acb-97d8-a3f6f8ca9814 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:52.398562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fbe3f93e-dce9-4d96-a3a2-fcf19fa064e8 req-76d93bbb-c90f-4acb-97d8-a3f6f8ca9814 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:52.414413 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-fbe3f93e-dce9-4d96-a3a2-fcf19fa064e8 req-76d93bbb-c90f-4acb-97d8-a3f6f8ca9814 service nova] Creating event network-changed:a39b0c0a-a794-487b-b823-eb2be84c82fa for instance a0e98b30-0c8f-4544-9800-71179f1dfed0 on nch2-master-1 Jan 22 21:30:52.420413 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-fbe3f93e-dce9-4d96-a3a2-fcf19fa064e8 req-76d93bbb-c90f-4acb-97d8-a3f6f8ca9814 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044447 Jan 22 21:30:52.421159 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3613/7524] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:30:52.443570 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b4eaf145-7ffb-41e3-9f47-47f435affa27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 14 microversion: 2.1 time: 0.069498 Jan 22 21:30:52.444228 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3912/7525] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:30:52 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:30:52.559314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bbce5985-2712-46a7-be96-d8519c9a80f8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:52.560382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bbce5985-2712-46a7-be96-d8519c9a80f8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:52.567501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbce5985-2712-46a7-be96-d8519c9a80f8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:52.568855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbce5985-2712-46a7-be96-d8519c9a80f8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:52.569926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbce5985-2712-46a7-be96-d8519c9a80f8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:52.570584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbce5985-2712-46a7-be96-d8519c9a80f8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:52.763768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bbce5985-2712-46a7-be96-d8519c9a80f8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:52.774010 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bbce5985-2712-46a7-be96-d8519c9a80f8 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1318 microversion: 2.1 time: 0.218311 Jan 22 21:30:52.780904 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3614/7526] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:52 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:52.920120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6f720078-1661-4b93-a895-166f3edc384b tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:52.923377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6f720078-1661-4b93-a895-166f3edc384b tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:52.943658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f720078-1661-4b93-a895-166f3edc384b tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:52.944599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f720078-1661-4b93-a895-166f3edc384b tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:52.946264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f720078-1661-4b93-a895-166f3edc384b tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:52.947193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f720078-1661-4b93-a895-166f3edc384b tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:53.250053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6f720078-1661-4b93-a895-166f3edc384b tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:53.258710 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6f720078-1661-4b93-a895-166f3edc384b tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1318 microversion: 2.1 time: 0.345835 Jan 22 21:30:53.270073 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3913/7527] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:52 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:53.454224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fed4a109-5181-4759-8ce0-b43c5a62c734 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:53.455379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fed4a109-5181-4759-8ce0-b43c5a62c734 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:53.465818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fed4a109-5181-4759-8ce0-b43c5a62c734 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:53.466747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fed4a109-5181-4759-8ce0-b43c5a62c734 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:53.467566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fed4a109-5181-4759-8ce0-b43c5a62c734 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:53.468011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fed4a109-5181-4759-8ce0-b43c5a62c734 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:53.509724 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fed4a109-5181-4759-8ce0-b43c5a62c734 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 14 microversion: 2.1 time: 0.059624 Jan 22 21:30:53.510756 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3615/7528] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:30:53 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:30:53.791714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8738fedf-dfa0-4546-b1c6-6d6a9a475760 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:53.792825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8738fedf-dfa0-4546-b1c6-6d6a9a475760 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:53.807299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8738fedf-dfa0-4546-b1c6-6d6a9a475760 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:53.810061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8738fedf-dfa0-4546-b1c6-6d6a9a475760 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:53.811151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8738fedf-dfa0-4546-b1c6-6d6a9a475760 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:53.811647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8738fedf-dfa0-4546-b1c6-6d6a9a475760 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:54.098779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8738fedf-dfa0-4546-b1c6-6d6a9a475760 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:54.110667 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8738fedf-dfa0-4546-b1c6-6d6a9a475760 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1318 microversion: 2.1 time: 0.322738 Jan 22 21:30:54.112918 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3914/7529] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:53 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:54.181992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-c3f76607-25a5-4e42-9811-ae1fe4d30385 req-e56ed673-6a85-4186-a918-3a03b568a863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "338d6677-62a3-49f4-b495-a3e1bdf71fb1", "name": "network-vif-plugged", "status": "completed", "tag": "119fa872-96b8-4abc-b528-bd69db90e714"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:54.183957 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:30:54.183957 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:30:54.193091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c3f76607-25a5-4e42-9811-ae1fe4d30385 req-e56ed673-6a85-4186-a918-3a03b568a863 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:54.193670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c3f76607-25a5-4e42-9811-ae1fe4d30385 req-e56ed673-6a85-4186-a918-3a03b568a863 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:54.206348 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-c3f76607-25a5-4e42-9811-ae1fe4d30385 req-e56ed673-6a85-4186-a918-3a03b568a863 service nova] Creating event network-vif-plugged:119fa872-96b8-4abc-b528-bd69db90e714 for instance 338d6677-62a3-49f4-b495-a3e1bdf71fb1 on nch1-master-1 Jan 22 21:30:54.212185 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-c3f76607-25a5-4e42-9811-ae1fe4d30385 req-e56ed673-6a85-4186-a918-3a03b568a863 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.271826 Jan 22 21:30:54.217219 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3616/7530] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:30:54.279162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b1b1de4-1b51-4c92-9d33-265dcd1f3615 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:54.284567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6b1b1de4-1b51-4c92-9d33-265dcd1f3615 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:54.289386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b1b1de4-1b51-4c92-9d33-265dcd1f3615 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:54.290799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b1b1de4-1b51-4c92-9d33-265dcd1f3615 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:54.291848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b1b1de4-1b51-4c92-9d33-265dcd1f3615 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:54.292559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b1b1de4-1b51-4c92-9d33-265dcd1f3615 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:54.511740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6b1b1de4-1b51-4c92-9d33-265dcd1f3615 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:54.520876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cc9ddfcc-8ba2-4a68-859c-40faed8d8963 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:54.522045 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b1b1de4-1b51-4c92-9d33-265dcd1f3615 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1468 microversion: 2.1 time: 0.246640 Jan 22 21:30:54.522166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cc9ddfcc-8ba2-4a68-859c-40faed8d8963 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:54.522637 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3915/7531] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:54 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1468 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:54.540665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc9ddfcc-8ba2-4a68-859c-40faed8d8963 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:54.544410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0415ea23-f158-4dca-9df5-b3be0152c486 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c51668d-fc20-4f01-a879-3813357f7a73", "device": "/dev/sdb"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:54.544531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc9ddfcc-8ba2-4a68-859c-40faed8d8963 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:54.544531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc9ddfcc-8ba2-4a68-859c-40faed8d8963 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:54.544691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0415ea23-f158-4dca-9df5-b3be0152c486 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:54.544767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc9ddfcc-8ba2-4a68-859c-40faed8d8963 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:54.549470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0415ea23-f158-4dca-9df5-b3be0152c486 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:54.550036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0415ea23-f158-4dca-9df5-b3be0152c486 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:54.551015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0415ea23-f158-4dca-9df5-b3be0152c486 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:54.551637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0415ea23-f158-4dca-9df5-b3be0152c486 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:54.582624 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cc9ddfcc-8ba2-4a68-859c-40faed8d8963 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 14 microversion: 2.1 time: 0.065559 Jan 22 21:30:54.583286 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3617/7532] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:30:54 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:30:55.131441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-afb50052-f48e-4b62-8f70-1325b74cbddb tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:55.132304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-afb50052-f48e-4b62-8f70-1325b74cbddb tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:55.139521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afb50052-f48e-4b62-8f70-1325b74cbddb tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:55.139988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afb50052-f48e-4b62-8f70-1325b74cbddb tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:55.141559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afb50052-f48e-4b62-8f70-1325b74cbddb tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:55.142353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afb50052-f48e-4b62-8f70-1325b74cbddb tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:55.308357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-afb50052-f48e-4b62-8f70-1325b74cbddb tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:55.317244 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-afb50052-f48e-4b62-8f70-1325b74cbddb tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1318 microversion: 2.1 time: 0.190636 Jan 22 21:30:55.318152 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3618/7533] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:55 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:30:55.411519 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0415ea23-f158-4dca-9df5-b3be0152c486 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "POST /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.873814 Jan 22 21:30:55.425690 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3916/7534] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:30:54 2022] POST /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf/os-volume_attachments => generated 194 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:30:55.596263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-efa754a3-dd82-4514-b7d2-25233b25bb16 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:55.597142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-efa754a3-dd82-4514-b7d2-25233b25bb16 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:55.604979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efa754a3-dd82-4514-b7d2-25233b25bb16 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:55.605531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efa754a3-dd82-4514-b7d2-25233b25bb16 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:55.606393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efa754a3-dd82-4514-b7d2-25233b25bb16 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:55.606943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efa754a3-dd82-4514-b7d2-25233b25bb16 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:55.662145 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-efa754a3-dd82-4514-b7d2-25233b25bb16 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 14 microversion: 2.1 time: 0.057057 Jan 22 21:30:55.665631 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3619/7535] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:30:55 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:30:56.337730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c1448696-acc0-446a-a109-6bc61a365923 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:56.338400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c1448696-acc0-446a-a109-6bc61a365923 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:56.355083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1448696-acc0-446a-a109-6bc61a365923 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:56.356300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1448696-acc0-446a-a109-6bc61a365923 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:56.359909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1448696-acc0-446a-a109-6bc61a365923 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:56.362188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1448696-acc0-446a-a109-6bc61a365923 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:56.674748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-59346ea2-e8bc-4252-af21-6492e1a99330 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:56.676808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-59346ea2-e8bc-4252-af21-6492e1a99330 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:56.685181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59346ea2-e8bc-4252-af21-6492e1a99330 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:56.685822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59346ea2-e8bc-4252-af21-6492e1a99330 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:56.686790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59346ea2-e8bc-4252-af21-6492e1a99330 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:56.688172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59346ea2-e8bc-4252-af21-6492e1a99330 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:56.747025 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-59346ea2-e8bc-4252-af21-6492e1a99330 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 14 microversion: 2.1 time: 0.077496 Jan 22 21:30:56.747987 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3620/7536] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:30:56 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:30:56.882962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c1448696-acc0-446a-a109-6bc61a365923 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:56.894715 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c1448696-acc0-446a-a109-6bc61a365923 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1505 microversion: 2.1 time: 0.563072 Jan 22 21:30:56.895863 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3917/7537] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:56 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1505 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:56.914127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-33207609-9f0c-4522-b186-507e60b4f22a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:56.915464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-33207609-9f0c-4522-b186-507e60b4f22a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:56.923825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33207609-9f0c-4522-b186-507e60b4f22a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:56.924495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33207609-9f0c-4522-b186-507e60b4f22a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:56.925410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33207609-9f0c-4522-b186-507e60b4f22a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:56.926167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33207609-9f0c-4522-b186-507e60b4f22a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:57.096402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-33207609-9f0c-4522-b186-507e60b4f22a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:57.104279 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-33207609-9f0c-4522-b186-507e60b4f22a tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1505 microversion: 2.1 time: 0.195551 Jan 22 21:30:57.104836 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3621/7538] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:56 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:57.123704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-acfb791d-0af3-46f2-bb34-d9aaf224c6fc tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:57.124246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-acfb791d-0af3-46f2-bb34-d9aaf224c6fc tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:57.131808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acfb791d-0af3-46f2-bb34-d9aaf224c6fc tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:57.132298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acfb791d-0af3-46f2-bb34-d9aaf224c6fc tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:57.132998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acfb791d-0af3-46f2-bb34-d9aaf224c6fc tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:57.133438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-acfb791d-0af3-46f2-bb34-d9aaf224c6fc tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:57.159893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-acfb791d-0af3-46f2-bb34-d9aaf224c6fc tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lazy-loading 'flavor' on Instance uuid 338d6677-62a3-49f4-b495-a3e1bdf71fb1 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:30:57.473539 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-acfb791d-0af3-46f2-bb34-d9aaf224c6fc tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "POST /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1/action" status: 202 len: 0 microversion: 2.1 time: 0.353291 Jan 22 21:30:57.474875 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3918/7539] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:30:57 2022] POST /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:30:57.483743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-afb41b02-8f30-4a46-b3e5-13e6ef7a16d4 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:57.485212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-afb41b02-8f30-4a46-b3e5-13e6ef7a16d4 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:57.496411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afb41b02-8f30-4a46-b3e5-13e6ef7a16d4 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:57.497103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afb41b02-8f30-4a46-b3e5-13e6ef7a16d4 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:57.504733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afb41b02-8f30-4a46-b3e5-13e6ef7a16d4 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:57.504733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afb41b02-8f30-4a46-b3e5-13e6ef7a16d4 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:57.760859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9de9e15f-eb74-4feb-aa1e-4c7222415b29 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:57.761625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9de9e15f-eb74-4feb-aa1e-4c7222415b29 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:57.775035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9de9e15f-eb74-4feb-aa1e-4c7222415b29 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:57.775557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9de9e15f-eb74-4feb-aa1e-4c7222415b29 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:57.776338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9de9e15f-eb74-4feb-aa1e-4c7222415b29 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:57.777314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-afb41b02-8f30-4a46-b3e5-13e6ef7a16d4 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:57.777903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9de9e15f-eb74-4feb-aa1e-4c7222415b29 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:57.787192 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-afb41b02-8f30-4a46-b3e5-13e6ef7a16d4 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1513 microversion: 2.1 time: 0.307578 Jan 22 21:30:57.788615 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3622/7540] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:57 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1513 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:30:57.839867 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9de9e15f-eb74-4feb-aa1e-4c7222415b29 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 14 microversion: 2.1 time: 0.084783 Jan 22 21:30:57.844603 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3919/7541] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:30:57 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:30:58.805513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-833f5950-57a2-4a8d-8d2f-5ad556efddba tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:58.806144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-833f5950-57a2-4a8d-8d2f-5ad556efddba tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:58.814730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-833f5950-57a2-4a8d-8d2f-5ad556efddba tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:58.815286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-833f5950-57a2-4a8d-8d2f-5ad556efddba tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:58.816001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-833f5950-57a2-4a8d-8d2f-5ad556efddba tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:58.816450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-833f5950-57a2-4a8d-8d2f-5ad556efddba tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:58.852017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-41f28816-1974-40c7-8924-b303b90070b3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:58.853007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-41f28816-1974-40c7-8924-b303b90070b3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:58.861439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41f28816-1974-40c7-8924-b303b90070b3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:58.862194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41f28816-1974-40c7-8924-b303b90070b3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:58.863006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41f28816-1974-40c7-8924-b303b90070b3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:58.863640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41f28816-1974-40c7-8924-b303b90070b3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:58.905693 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-41f28816-1974-40c7-8924-b303b90070b3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 14 microversion: 2.1 time: 0.057419 Jan 22 21:30:58.909538 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3920/7542] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:30:58 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:30:58.963318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-833f5950-57a2-4a8d-8d2f-5ad556efddba tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:58.971535 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-833f5950-57a2-4a8d-8d2f-5ad556efddba tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1496 microversion: 2.1 time: 0.169718 Jan 22 21:30:58.972133 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3623/7543] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:58 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1496 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:58.989595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0ac9eb8a-4abc-4729-921d-0203a3455a56 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:58.990242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0ac9eb8a-4abc-4729-921d-0203a3455a56 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:58.997316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ac9eb8a-4abc-4729-921d-0203a3455a56 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:58.997793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ac9eb8a-4abc-4729-921d-0203a3455a56 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:58.998582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ac9eb8a-4abc-4729-921d-0203a3455a56 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:58.999022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ac9eb8a-4abc-4729-921d-0203a3455a56 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:59.239496 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0ac9eb8a-4abc-4729-921d-0203a3455a56 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "POST /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1/action" status: 202 len: 0 microversion: 2.1 time: 0.253784 Jan 22 21:30:59.243318 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3921/7544] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:30:58 2022] POST /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:30:59.249525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-79264eda-d4c3-486a-8762-83974885e7c9 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:30:59.250729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-79264eda-d4c3-486a-8762-83974885e7c9 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:59.257054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79264eda-d4c3-486a-8762-83974885e7c9 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:59.257538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79264eda-d4c3-486a-8762-83974885e7c9 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:59.258350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79264eda-d4c3-486a-8762-83974885e7c9 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:59.258797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79264eda-d4c3-486a-8762-83974885e7c9 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:59.584656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-79264eda-d4c3-486a-8762-83974885e7c9 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:30:59.593645 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-79264eda-d4c3-486a-8762-83974885e7c9 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1502 microversion: 2.1 time: 0.349043 Jan 22 21:30:59.594254 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3624/7545] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:30:59 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1502 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:30:59.920856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-edf96ca1-37fd-4692-ba18-242b03d6cb2b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:30:59.922208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-edf96ca1-37fd-4692-ba18-242b03d6cb2b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:30:59.932729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edf96ca1-37fd-4692-ba18-242b03d6cb2b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:59.933853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edf96ca1-37fd-4692-ba18-242b03d6cb2b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:59.935293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edf96ca1-37fd-4692-ba18-242b03d6cb2b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:30:59.936009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edf96ca1-37fd-4692-ba18-242b03d6cb2b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:30:59.986237 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-edf96ca1-37fd-4692-ba18-242b03d6cb2b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 14 microversion: 2.1 time: 0.071265 Jan 22 21:30:59.988971 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3922/7546] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:30:59 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:31:00.612114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2d383e68-88e4-48e4-aac8-64dad4ed687f tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:00.612818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2d383e68-88e4-48e4-aac8-64dad4ed687f tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:00.619859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d383e68-88e4-48e4-aac8-64dad4ed687f tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:00.630588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d383e68-88e4-48e4-aac8-64dad4ed687f tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:00.630588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d383e68-88e4-48e4-aac8-64dad4ed687f tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:00.630588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d383e68-88e4-48e4-aac8-64dad4ed687f tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:00.792495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2d383e68-88e4-48e4-aac8-64dad4ed687f tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:00.803530 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2d383e68-88e4-48e4-aac8-64dad4ed687f tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1502 microversion: 2.1 time: 0.196185 Jan 22 21:31:00.805983 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3625/7547] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:00 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:00.998786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17d2bb82-b699-4ecf-a544-b1bbec0d6e9a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:00.999845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17d2bb82-b699-4ecf-a544-b1bbec0d6e9a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:01.007244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17d2bb82-b699-4ecf-a544-b1bbec0d6e9a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:01.007709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17d2bb82-b699-4ecf-a544-b1bbec0d6e9a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:01.011880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17d2bb82-b699-4ecf-a544-b1bbec0d6e9a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:01.011880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17d2bb82-b699-4ecf-a544-b1bbec0d6e9a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:01.056251 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17d2bb82-b699-4ecf-a544-b1bbec0d6e9a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 14 microversion: 2.1 time: 0.062087 Jan 22 21:31:01.057620 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3923/7548] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:00 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:31:01.822403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7ec21309-feb3-40fc-b68c-ab0cde93a734 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:01.823027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7ec21309-feb3-40fc-b68c-ab0cde93a734 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:01.832090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ec21309-feb3-40fc-b68c-ab0cde93a734 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:01.832693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ec21309-feb3-40fc-b68c-ab0cde93a734 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:01.833388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ec21309-feb3-40fc-b68c-ab0cde93a734 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:01.833857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ec21309-feb3-40fc-b68c-ab0cde93a734 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:01.988671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7ec21309-feb3-40fc-b68c-ab0cde93a734 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:01.996304 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7ec21309-feb3-40fc-b68c-ab0cde93a734 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1505 microversion: 2.1 time: 0.177598 Jan 22 21:31:01.996979 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3626/7549] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:01 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:02.013182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1bd4e529-1d53-4023-a96f-546d30775c75 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:02.013851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1bd4e529-1d53-4023-a96f-546d30775c75 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:02.022438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bd4e529-1d53-4023-a96f-546d30775c75 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:02.022902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bd4e529-1d53-4023-a96f-546d30775c75 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:02.023716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bd4e529-1d53-4023-a96f-546d30775c75 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:02.024167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1bd4e529-1d53-4023-a96f-546d30775c75 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:02.048139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-1bd4e529-1d53-4023-a96f-546d30775c75 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lazy-loading 'flavor' on Instance uuid 338d6677-62a3-49f4-b495-a3e1bdf71fb1 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:31:02.068199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-74c6d1c7-24a9-4e5c-882c-95b33706dde3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:02.069345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-74c6d1c7-24a9-4e5c-882c-95b33706dde3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:02.075636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74c6d1c7-24a9-4e5c-882c-95b33706dde3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:02.077573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74c6d1c7-24a9-4e5c-882c-95b33706dde3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:02.077573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74c6d1c7-24a9-4e5c-882c-95b33706dde3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:02.077573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74c6d1c7-24a9-4e5c-882c-95b33706dde3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:02.128592 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-74c6d1c7-24a9-4e5c-882c-95b33706dde3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 8208 microversion: 2.1 time: 0.063951 Jan 22 21:31:02.131963 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3627/7550] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:02 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 8208 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:02.334827 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1bd4e529-1d53-4023-a96f-546d30775c75 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "POST /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1/action" status: 202 len: 0 microversion: 2.1 time: 0.325078 Jan 22 21:31:02.335619 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3924/7551] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:02 2022] POST /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:31:02.344428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7d37ecb3-02b0-487d-98ec-c1e5812f54ed tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:02.345291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7d37ecb3-02b0-487d-98ec-c1e5812f54ed tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:02.353468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d37ecb3-02b0-487d-98ec-c1e5812f54ed tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:02.353941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d37ecb3-02b0-487d-98ec-c1e5812f54ed tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:02.354760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d37ecb3-02b0-487d-98ec-c1e5812f54ed tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:02.355197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d37ecb3-02b0-487d-98ec-c1e5812f54ed tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:02.498545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7d37ecb3-02b0-487d-98ec-c1e5812f54ed tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:02.506423 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7d37ecb3-02b0-487d-98ec-c1e5812f54ed tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1513 microversion: 2.1 time: 0.166583 Jan 22 21:31:02.506912 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3628/7552] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:02 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:03.139911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b316737-475d-4092-902e-053b440eb2fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:03.141026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b316737-475d-4092-902e-053b440eb2fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:03.152392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b316737-475d-4092-902e-053b440eb2fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:03.152392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b316737-475d-4092-902e-053b440eb2fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:03.152392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b316737-475d-4092-902e-053b440eb2fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:03.152392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b316737-475d-4092-902e-053b440eb2fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:03.204598 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b316737-475d-4092-902e-053b440eb2fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 16392 microversion: 2.1 time: 0.068130 Jan 22 21:31:03.208644 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3925/7553] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:03 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 16392 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:03.525084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ebc5e374-892b-4ce8-866b-fc00a765e2d2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:03.525903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ebc5e374-892b-4ce8-866b-fc00a765e2d2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:03.534376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebc5e374-892b-4ce8-866b-fc00a765e2d2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:03.534977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebc5e374-892b-4ce8-866b-fc00a765e2d2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:03.535864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebc5e374-892b-4ce8-866b-fc00a765e2d2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:03.536904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ebc5e374-892b-4ce8-866b-fc00a765e2d2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:03.737392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ebc5e374-892b-4ce8-866b-fc00a765e2d2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:03.745489 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ebc5e374-892b-4ce8-866b-fc00a765e2d2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1496 microversion: 2.1 time: 0.225833 Jan 22 21:31:03.746131 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3629/7554] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:03 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1496 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:03.769598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ec5ad301-fd5c-4f8c-a2e0-2d29a11129ce tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:03.770761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ec5ad301-fd5c-4f8c-a2e0-2d29a11129ce tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:03.779298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec5ad301-fd5c-4f8c-a2e0-2d29a11129ce tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:03.779945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec5ad301-fd5c-4f8c-a2e0-2d29a11129ce tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:03.781080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec5ad301-fd5c-4f8c-a2e0-2d29a11129ce tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:03.782587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec5ad301-fd5c-4f8c-a2e0-2d29a11129ce tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:03.977473 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ec5ad301-fd5c-4f8c-a2e0-2d29a11129ce tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "POST /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1/action" status: 202 len: 0 microversion: 2.1 time: 0.215842 Jan 22 21:31:03.978325 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3926/7555] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:03 2022] POST /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:31:04.001800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-900a0c92-e25f-4255-9658-0a1dbfe2ddd2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:04.002414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-900a0c92-e25f-4255-9658-0a1dbfe2ddd2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:04.012760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-900a0c92-e25f-4255-9658-0a1dbfe2ddd2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:04.013385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-900a0c92-e25f-4255-9658-0a1dbfe2ddd2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:04.019050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-900a0c92-e25f-4255-9658-0a1dbfe2ddd2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:04.019050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-900a0c92-e25f-4255-9658-0a1dbfe2ddd2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:04.224004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b923636c-2db7-46a6-a1a0-00086d34ee50 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:04.244183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-900a0c92-e25f-4255-9658-0a1dbfe2ddd2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:04.245321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b923636c-2db7-46a6-a1a0-00086d34ee50 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:04.253542 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-900a0c92-e25f-4255-9658-0a1dbfe2ddd2 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1502 microversion: 2.1 time: 0.262685 Jan 22 21:31:04.254422 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3630/7556] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:03 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1502 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:04.264866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b923636c-2db7-46a6-a1a0-00086d34ee50 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:04.265417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b923636c-2db7-46a6-a1a0-00086d34ee50 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:04.266383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b923636c-2db7-46a6-a1a0-00086d34ee50 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:04.267125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b923636c-2db7-46a6-a1a0-00086d34ee50 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:04.309341 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b923636c-2db7-46a6-a1a0-00086d34ee50 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 16392 microversion: 2.1 time: 0.095359 Jan 22 21:31:04.311150 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3927/7557] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:04 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 16392 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:31:05.272966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-36291477-0f3f-438e-983e-997c7d4c9dc0 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:05.273876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-36291477-0f3f-438e-983e-997c7d4c9dc0 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:05.281106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36291477-0f3f-438e-983e-997c7d4c9dc0 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:05.282536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36291477-0f3f-438e-983e-997c7d4c9dc0 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:05.283603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36291477-0f3f-438e-983e-997c7d4c9dc0 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:05.284178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36291477-0f3f-438e-983e-997c7d4c9dc0 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:05.323033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9c3db240-b415-42a8-8cd1-f4a6caefc993 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:05.324240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9c3db240-b415-42a8-8cd1-f4a6caefc993 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:05.333202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c3db240-b415-42a8-8cd1-f4a6caefc993 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:05.333782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c3db240-b415-42a8-8cd1-f4a6caefc993 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:05.334832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c3db240-b415-42a8-8cd1-f4a6caefc993 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:05.335359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c3db240-b415-42a8-8cd1-f4a6caefc993 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:05.394747 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9c3db240-b415-42a8-8cd1-f4a6caefc993 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 16392 microversion: 2.1 time: 0.075038 Jan 22 21:31:05.395431 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3928/7558] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:05 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 16392 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:05.440562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-36291477-0f3f-438e-983e-997c7d4c9dc0 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:05.449135 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-36291477-0f3f-438e-983e-997c7d4c9dc0 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1502 microversion: 2.1 time: 0.180708 Jan 22 21:31:05.457604 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3631/7559] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:05 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:06.410161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b179c179-2b6b-469f-85b0-e3e55d9e4669 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:06.411158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b179c179-2b6b-469f-85b0-e3e55d9e4669 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:06.418692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b179c179-2b6b-469f-85b0-e3e55d9e4669 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:06.419152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b179c179-2b6b-469f-85b0-e3e55d9e4669 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:06.420037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b179c179-2b6b-469f-85b0-e3e55d9e4669 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:06.420590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b179c179-2b6b-469f-85b0-e3e55d9e4669 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:06.462713 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b179c179-2b6b-469f-85b0-e3e55d9e4669 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 16392 microversion: 2.1 time: 0.057815 Jan 22 21:31:06.463535 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3929/7560] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:06 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 16392 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:06.466633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f19374f0-13a3-4dfa-b1c0-f1152251d49c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:06.467281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f19374f0-13a3-4dfa-b1c0-f1152251d49c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:06.475200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f19374f0-13a3-4dfa-b1c0-f1152251d49c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:06.475660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f19374f0-13a3-4dfa-b1c0-f1152251d49c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:06.477116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f19374f0-13a3-4dfa-b1c0-f1152251d49c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:06.477116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f19374f0-13a3-4dfa-b1c0-f1152251d49c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:06.753072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f19374f0-13a3-4dfa-b1c0-f1152251d49c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:06.762087 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f19374f0-13a3-4dfa-b1c0-f1152251d49c tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1505 microversion: 2.1 time: 0.299160 Jan 22 21:31:06.762734 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3632/7561] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:06 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:31:06.779851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-271290b2-b77c-4fae-885c-91d051442f52 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:06.780529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-271290b2-b77c-4fae-885c-91d051442f52 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:06.789075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-271290b2-b77c-4fae-885c-91d051442f52 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:06.789572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-271290b2-b77c-4fae-885c-91d051442f52 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:06.790897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-271290b2-b77c-4fae-885c-91d051442f52 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:06.791352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-271290b2-b77c-4fae-885c-91d051442f52 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:06.822725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-271290b2-b77c-4fae-885c-91d051442f52 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:31:07.142472 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-271290b2-b77c-4fae-885c-91d051442f52 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "DELETE /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 204 len: 0 microversion: 2.1 time: 0.366577 Jan 22 21:31:07.143055 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3930/7562] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:31:06 2022] DELETE /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:31:07.151137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-da6799a4-8145-4165-b14b-3519db80b571 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:07.151753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-da6799a4-8145-4165-b14b-3519db80b571 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:07.158641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da6799a4-8145-4165-b14b-3519db80b571 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:07.159108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da6799a4-8145-4165-b14b-3519db80b571 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:07.159915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da6799a4-8145-4165-b14b-3519db80b571 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:07.160376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da6799a4-8145-4165-b14b-3519db80b571 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:07.363839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-da6799a4-8145-4165-b14b-3519db80b571 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:07.371792 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-da6799a4-8145-4165-b14b-3519db80b571 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1511 microversion: 2.1 time: 0.224154 Jan 22 21:31:07.381786 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3633/7563] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:07 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:31:07.475376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-def4c813-fc55-4325-9a58-449ec31f99d4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:07.476382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-def4c813-fc55-4325-9a58-449ec31f99d4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:07.484176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-def4c813-fc55-4325-9a58-449ec31f99d4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:07.485284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-def4c813-fc55-4325-9a58-449ec31f99d4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:07.486380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-def4c813-fc55-4325-9a58-449ec31f99d4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:07.486833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-def4c813-fc55-4325-9a58-449ec31f99d4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:07.544082 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-def4c813-fc55-4325-9a58-449ec31f99d4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.072601 Jan 22 21:31:07.545739 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3931/7564] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:07 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:08.388279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cf6f53f0-0339-490d-bd08-44544c44f7de tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:08.388917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cf6f53f0-0339-490d-bd08-44544c44f7de tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:08.397170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf6f53f0-0339-490d-bd08-44544c44f7de tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:08.398812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf6f53f0-0339-490d-bd08-44544c44f7de tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:08.400292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf6f53f0-0339-490d-bd08-44544c44f7de tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:08.400899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cf6f53f0-0339-490d-bd08-44544c44f7de tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:08.548974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cf6f53f0-0339-490d-bd08-44544c44f7de tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:08.558144 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cf6f53f0-0339-490d-bd08-44544c44f7de tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1511 microversion: 2.1 time: 0.173635 Jan 22 21:31:08.559463 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3634/7565] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:08 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:08.565721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-50815f71-a61d-4be5-970a-817980f2109c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:08.567473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-50815f71-a61d-4be5-970a-817980f2109c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:08.575150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50815f71-a61d-4be5-970a-817980f2109c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:08.575604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50815f71-a61d-4be5-970a-817980f2109c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:08.576426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50815f71-a61d-4be5-970a-817980f2109c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:08.576872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50815f71-a61d-4be5-970a-817980f2109c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:08.621082 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-50815f71-a61d-4be5-970a-817980f2109c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.064833 Jan 22 21:31:08.621082 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3932/7566] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:08 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:09.577100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3c08aad0-d504-4e36-ad99-2f8f090c5560 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:09.577975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3c08aad0-d504-4e36-ad99-2f8f090c5560 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:09.592945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c08aad0-d504-4e36-ad99-2f8f090c5560 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:09.592945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c08aad0-d504-4e36-ad99-2f8f090c5560 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:09.592945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c08aad0-d504-4e36-ad99-2f8f090c5560 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:09.592945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c08aad0-d504-4e36-ad99-2f8f090c5560 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:09.632978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19c5c28b-a70d-4bfd-9969-236b793e4d1f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:09.636883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-19c5c28b-a70d-4bfd-9969-236b793e4d1f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:09.644528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19c5c28b-a70d-4bfd-9969-236b793e4d1f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:09.645145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19c5c28b-a70d-4bfd-9969-236b793e4d1f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:09.646375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19c5c28b-a70d-4bfd-9969-236b793e4d1f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:09.647146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19c5c28b-a70d-4bfd-9969-236b793e4d1f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:09.700845 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19c5c28b-a70d-4bfd-9969-236b793e4d1f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.073856 Jan 22 21:31:09.704751 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3933/7567] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:09 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:09.854333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3c08aad0-d504-4e36-ad99-2f8f090c5560 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:09.861335 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3c08aad0-d504-4e36-ad99-2f8f090c5560 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1511 microversion: 2.1 time: 0.288162 Jan 22 21:31:09.861934 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3635/7568] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:09 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1511 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:10.009277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-2478f42c-0257-43c2-ae90-f46ecf6f1222 req-e33da912-1dd5-4036-a94f-8f550f8a2a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "338d6677-62a3-49f4-b495-a3e1bdf71fb1", "name": "network-vif-deleted", "tag": "119fa872-96b8-4abc-b528-bd69db90e714"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:10.010835 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:31:10.010835 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:31:10.021628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2478f42c-0257-43c2-ae90-f46ecf6f1222 req-e33da912-1dd5-4036-a94f-8f550f8a2a91 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:10.022360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2478f42c-0257-43c2-ae90-f46ecf6f1222 req-e33da912-1dd5-4036-a94f-8f550f8a2a91 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:10.036300 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-2478f42c-0257-43c2-ae90-f46ecf6f1222 req-e33da912-1dd5-4036-a94f-8f550f8a2a91 service nova] Creating event network-vif-deleted:119fa872-96b8-4abc-b528-bd69db90e714 for instance 338d6677-62a3-49f4-b495-a3e1bdf71fb1 on nch1-master-1 Jan 22 21:31:10.041125 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-2478f42c-0257-43c2-ae90-f46ecf6f1222 req-e33da912-1dd5-4036-a94f-8f550f8a2a91 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036963 Jan 22 21:31:10.041773 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3934/7569] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:31:10.714333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fad08035-1c2c-4042-91dc-269451f7ed06 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:10.715292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fad08035-1c2c-4042-91dc-269451f7ed06 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:10.722985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fad08035-1c2c-4042-91dc-269451f7ed06 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:10.728331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fad08035-1c2c-4042-91dc-269451f7ed06 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:10.728331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fad08035-1c2c-4042-91dc-269451f7ed06 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:10.728331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fad08035-1c2c-4042-91dc-269451f7ed06 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:10.766944 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fad08035-1c2c-4042-91dc-269451f7ed06 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.056183 Jan 22 21:31:10.768720 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3636/7570] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:10 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:10.881465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7c2842fa-d302-4843-b7de-66c284588581 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:10.886604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7c2842fa-d302-4843-b7de-66c284588581 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:10.889535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c2842fa-d302-4843-b7de-66c284588581 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:10.890028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c2842fa-d302-4843-b7de-66c284588581 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:10.890852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c2842fa-d302-4843-b7de-66c284588581 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:10.891439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c2842fa-d302-4843-b7de-66c284588581 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:10.933698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c2842fa-d302-4843-b7de-66c284588581 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:10.934129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c2842fa-d302-4843-b7de-66c284588581 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:10.934590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-7c2842fa-d302-4843-b7de-66c284588581 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lazy-loading 'fault' on Instance uuid 338d6677-62a3-49f4-b495-a3e1bdf71fb1 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:31:10.985913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7c2842fa-d302-4843-b7de-66c284588581 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d9158d3741473994ad5cb2066857d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02683bc7565949ab9c1ac9ba2c3c45cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:10.995223 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7c2842fa-d302-4843-b7de-66c284588581 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 200 len: 1308 microversion: 2.1 time: 0.119723 Jan 22 21:31:10.996312 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3935/7571] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:10 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 1308 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:11.779796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4737d738-b601-4b2c-93d1-1f99b1fed213 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:11.781834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4737d738-b601-4b2c-93d1-1f99b1fed213 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:11.793798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4737d738-b601-4b2c-93d1-1f99b1fed213 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:11.794321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4737d738-b601-4b2c-93d1-1f99b1fed213 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:11.795170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4737d738-b601-4b2c-93d1-1f99b1fed213 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:11.795624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4737d738-b601-4b2c-93d1-1f99b1fed213 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:11.851684 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4737d738-b601-4b2c-93d1-1f99b1fed213 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.075720 Jan 22 21:31:11.852548 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3637/7572] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:11 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:12.023422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-275c3586-2661-4b04-ac87-7824da47b814 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:12.024089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-275c3586-2661-4b04-ac87-7824da47b814 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] [instance: 338d6677-62a3-49f4-b495-a3e1bdf71fb1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:12.033694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-275c3586-2661-4b04-ac87-7824da47b814 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:12.035940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-275c3586-2661-4b04-ac87-7824da47b814 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:12.035940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-275c3586-2661-4b04-ac87-7824da47b814 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:12.035940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-275c3586-2661-4b04-ac87-7824da47b814 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:12.050139 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-275c3586-2661-4b04-ac87-7824da47b814 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] HTTP exception thrown: Instance 338d6677-62a3-49f4-b495-a3e1bdf71fb1 could not be found. Jan 22 21:31:12.050747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-275c3586-2661-4b04-ac87-7824da47b814 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] Returning 404 to user: Instance 338d6677-62a3-49f4-b495-a3e1bdf71fb1 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:31:12.051587 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-275c3586-2661-4b04-ac87-7824da47b814 tempest-TestServerAdvancedOps-1272832855 tempest-TestServerAdvancedOps-1272832855-project] 10.222.0.100 "GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1" status: 404 len: 111 microversion: 2.1 time: 0.039314 Jan 22 21:31:12.052138 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3936/7573] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:12 2022] GET /compute/v2.1/servers/338d6677-62a3-49f4-b495-a3e1bdf71fb1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:31:12.869855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4072e769-a26d-46c4-bd14-78301fa16f88 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:12.869855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4072e769-a26d-46c4-bd14-78301fa16f88 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:12.875457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4072e769-a26d-46c4-bd14-78301fa16f88 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:12.875913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4072e769-a26d-46c4-bd14-78301fa16f88 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:12.876711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4072e769-a26d-46c4-bd14-78301fa16f88 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:12.877956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4072e769-a26d-46c4-bd14-78301fa16f88 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:12.929558 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4072e769-a26d-46c4-bd14-78301fa16f88 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.068801 Jan 22 21:31:12.949733 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3638/7574] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:12 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:13.943729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0ba2e28a-a8f3-479c-9b86-8a3b350658f7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:13.944680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0ba2e28a-a8f3-479c-9b86-8a3b350658f7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:13.969797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ba2e28a-a8f3-479c-9b86-8a3b350658f7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:13.971596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ba2e28a-a8f3-479c-9b86-8a3b350658f7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:13.975436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ba2e28a-a8f3-479c-9b86-8a3b350658f7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:13.976076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ba2e28a-a8f3-479c-9b86-8a3b350658f7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:14.095419 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0ba2e28a-a8f3-479c-9b86-8a3b350658f7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.156563 Jan 22 21:31:14.101394 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3937/7575] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:13 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:15.113790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8fa30bc8-03fa-443c-bc1b-1c9b98d08c69 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:15.119341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8fa30bc8-03fa-443c-bc1b-1c9b98d08c69 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:15.135850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fa30bc8-03fa-443c-bc1b-1c9b98d08c69 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:15.135850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fa30bc8-03fa-443c-bc1b-1c9b98d08c69 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:15.135850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fa30bc8-03fa-443c-bc1b-1c9b98d08c69 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:15.142869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fa30bc8-03fa-443c-bc1b-1c9b98d08c69 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:15.200725 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8fa30bc8-03fa-443c-bc1b-1c9b98d08c69 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.092810 Jan 22 21:31:15.202799 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3639/7576] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:15 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:16.229322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb4bad68-f443-470d-926f-5511411315b9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:16.230381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fb4bad68-f443-470d-926f-5511411315b9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:16.241567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb4bad68-f443-470d-926f-5511411315b9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:16.242299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb4bad68-f443-470d-926f-5511411315b9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:16.243308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb4bad68-f443-470d-926f-5511411315b9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:16.244221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb4bad68-f443-470d-926f-5511411315b9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:16.305684 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fb4bad68-f443-470d-926f-5511411315b9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.081262 Jan 22 21:31:16.310188 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3938/7577] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:16 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:17.321170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a6135b6a-95bd-41a3-8603-c8ba89ea4d6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:17.328967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a6135b6a-95bd-41a3-8603-c8ba89ea4d6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:17.338262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6135b6a-95bd-41a3-8603-c8ba89ea4d6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:17.344086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6135b6a-95bd-41a3-8603-c8ba89ea4d6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:17.345227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6135b6a-95bd-41a3-8603-c8ba89ea4d6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:17.346647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6135b6a-95bd-41a3-8603-c8ba89ea4d6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:17.416555 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a6135b6a-95bd-41a3-8603-c8ba89ea4d6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.101907 Jan 22 21:31:17.417786 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3640/7578] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:17 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:18.430073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d2fcd82-ab73-4687-b250-d551e2ef5346 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:18.431083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d2fcd82-ab73-4687-b250-d551e2ef5346 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:18.438815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d2fcd82-ab73-4687-b250-d551e2ef5346 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:18.439212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d2fcd82-ab73-4687-b250-d551e2ef5346 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:18.441142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d2fcd82-ab73-4687-b250-d551e2ef5346 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:18.441622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d2fcd82-ab73-4687-b250-d551e2ef5346 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:18.491601 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d2fcd82-ab73-4687-b250-d551e2ef5346 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.065750 Jan 22 21:31:18.499948 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3939/7579] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:18 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:19.513037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb164eea-fded-4eb9-ae46-0e8b453af81a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:19.514682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb164eea-fded-4eb9-ae46-0e8b453af81a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:19.522615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb164eea-fded-4eb9-ae46-0e8b453af81a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:19.523116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb164eea-fded-4eb9-ae46-0e8b453af81a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:19.523909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb164eea-fded-4eb9-ae46-0e8b453af81a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:19.524349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb164eea-fded-4eb9-ae46-0e8b453af81a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:19.571606 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb164eea-fded-4eb9-ae46-0e8b453af81a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.061366 Jan 22 21:31:19.572256 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3641/7580] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:19 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:20.583936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-db429070-3cda-4377-8668-b5c6fc85ed1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:20.584946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-db429070-3cda-4377-8668-b5c6fc85ed1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:20.592734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db429070-3cda-4377-8668-b5c6fc85ed1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:20.593293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db429070-3cda-4377-8668-b5c6fc85ed1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:20.594331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db429070-3cda-4377-8668-b5c6fc85ed1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:20.594772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db429070-3cda-4377-8668-b5c6fc85ed1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:20.635681 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-db429070-3cda-4377-8668-b5c6fc85ed1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.055698 Jan 22 21:31:20.636351 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3940/7581] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:20 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:21.351946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c32de7be-b3d0-4630-8c4c-8627ccdc7428 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:21.357780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c32de7be-b3d0-4630-8c4c-8627ccdc7428 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:21.362531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c32de7be-b3d0-4630-8c4c-8627ccdc7428 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:21.362955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c32de7be-b3d0-4630-8c4c-8627ccdc7428 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:21.363852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c32de7be-b3d0-4630-8c4c-8627ccdc7428 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:21.364302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c32de7be-b3d0-4630-8c4c-8627ccdc7428 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:21.478971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-c32de7be-b3d0-4630-8c4c-8627ccdc7428 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lazy-loading 'services' on Instance uuid 2e43d666-76b2-4247-8f74-edf55ee918bf {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:31:21.652086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dca426d8-f54b-4f7e-a136-81b1508e371e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:21.652086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dca426d8-f54b-4f7e-a136-81b1508e371e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:21.658143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dca426d8-f54b-4f7e-a136-81b1508e371e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:21.659258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dca426d8-f54b-4f7e-a136-81b1508e371e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:21.660085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dca426d8-f54b-4f7e-a136-81b1508e371e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:21.660643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dca426d8-f54b-4f7e-a136-81b1508e371e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:21.706710 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dca426d8-f54b-4f7e-a136-81b1508e371e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.061296 Jan 22 21:31:21.710009 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3941/7582] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:21 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:31:21.735034 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c32de7be-b3d0-4630-8c4c-8627ccdc7428 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "DELETE /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf/os-volume_attachments/5c51668d-fc20-4f01-a879-3813357f7a73" status: 202 len: 0 microversion: 2.1 time: 0.387100 Jan 22 21:31:21.736980 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3642/7583] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 21:31:21 2022] DELETE /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf/os-volume_attachments/5c51668d-fc20-4f01-a879-3813357f7a73 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:31:22.719917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b538f85c-2886-4822-98d6-930698d6814c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:22.721036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b538f85c-2886-4822-98d6-930698d6814c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:22.728608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b538f85c-2886-4822-98d6-930698d6814c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:22.729060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b538f85c-2886-4822-98d6-930698d6814c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:22.729870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b538f85c-2886-4822-98d6-930698d6814c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:22.730310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b538f85c-2886-4822-98d6-930698d6814c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:22.775902 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b538f85c-2886-4822-98d6-930698d6814c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.059958 Jan 22 21:31:22.776838 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3942/7584] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:22 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:22.858700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9dd16451-998c-448c-afc5-a38b9ee5a13e tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:22.859276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9dd16451-998c-448c-afc5-a38b9ee5a13e tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:22.868125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9dd16451-998c-448c-afc5-a38b9ee5a13e tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:22.868579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9dd16451-998c-448c-afc5-a38b9ee5a13e tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:22.869565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9dd16451-998c-448c-afc5-a38b9ee5a13e tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:22.869960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9dd16451-998c-448c-afc5-a38b9ee5a13e tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:22.898425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9dd16451-998c-448c-afc5-a38b9ee5a13e tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:31:23.172013 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9dd16451-998c-448c-afc5-a38b9ee5a13e tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "DELETE /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 204 len: 0 microversion: 2.1 time: 0.317045 Jan 22 21:31:23.172657 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3643/7585] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:31:22 2022] DELETE /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:31:23.181791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-56a97221-1938-47ae-8b51-7bf8021883b8 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:23.182627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-56a97221-1938-47ae-8b51-7bf8021883b8 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:23.190553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56a97221-1938-47ae-8b51-7bf8021883b8 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:23.191011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56a97221-1938-47ae-8b51-7bf8021883b8 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:23.191908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56a97221-1938-47ae-8b51-7bf8021883b8 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:23.192365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56a97221-1938-47ae-8b51-7bf8021883b8 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:23.355608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-56a97221-1938-47ae-8b51-7bf8021883b8 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:23.365005 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-56a97221-1938-47ae-8b51-7bf8021883b8 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1474 microversion: 2.1 time: 0.187198 Jan 22 21:31:23.365623 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3943/7586] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:23 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1474 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:23.788875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a3d860a3-6793-4400-b8cf-edcb505dc0ef tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:23.790048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a3d860a3-6793-4400-b8cf-edcb505dc0ef tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:23.796511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3d860a3-6793-4400-b8cf-edcb505dc0ef tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:23.796977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3d860a3-6793-4400-b8cf-edcb505dc0ef tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:23.797794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3d860a3-6793-4400-b8cf-edcb505dc0ef tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:23.798245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3d860a3-6793-4400-b8cf-edcb505dc0ef tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:23.838122 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a3d860a3-6793-4400-b8cf-edcb505dc0ef tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.053891 Jan 22 21:31:23.838988 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3644/7587] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:23 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:24.166709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1002956522", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:24.222736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] validate_networks() for None {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:31:24.385418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-52fc3dad-fb8a-46f6-9891-f899a7b4d6b3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:24.388744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-52fc3dad-fb8a-46f6-9891-f899a7b4d6b3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:24.398198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52fc3dad-fb8a-46f6-9891-f899a7b4d6b3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:24.398654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52fc3dad-fb8a-46f6-9891-f899a7b4d6b3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:24.399746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52fc3dad-fb8a-46f6-9891-f899a7b4d6b3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:24.400193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52fc3dad-fb8a-46f6-9891-f899a7b4d6b3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:24.493580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:31:24.494046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:31:24.494710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:31:24.495293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:31:24.495720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:31:24.506099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:24.506564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:24.507584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:24.508033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:24.526836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Getting quotas for project e82da13b4e8649d39cfeeecdecedd458. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:31:24.533026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Getting quotas for user 682168e54f9e446aabf66b552dffb707 and project e82da13b4e8649d39cfeeecdecedd458. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:31:24.547087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:31:24.548605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-52fc3dad-fb8a-46f6-9891-f899a7b4d6b3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:24.550537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:31:24.557586 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-52fc3dad-fb8a-46f6-9891-f899a7b4d6b3 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1474 microversion: 2.1 time: 0.178797 Jan 22 21:31:24.558294 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3645/7588] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:24 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1474 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:31:24.704639 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d414f873-f649-4218-a8aa-46d227b65b88 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.542105 Jan 22 21:31:24.705770 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3944/7589] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:31:24 2022] POST /compute/v2.1/servers => generated 382 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:31:24.715574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c328883e-3564-4efa-9513-523191328a06 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:24.716186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c328883e-3564-4efa-9513-523191328a06 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:24.783910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c328883e-3564-4efa-9513-523191328a06 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:24.791742 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c328883e-3564-4efa-9513-523191328a06 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1219 microversion: 2.1 time: 0.079996 Jan 22 21:31:24.792313 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3646/7590] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:24 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:24.850105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad6505b4-ba31-43a9-8099-e8ef65eb6820 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:24.851087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad6505b4-ba31-43a9-8099-e8ef65eb6820 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:24.857913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad6505b4-ba31-43a9-8099-e8ef65eb6820 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:24.858372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad6505b4-ba31-43a9-8099-e8ef65eb6820 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:24.859157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad6505b4-ba31-43a9-8099-e8ef65eb6820 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:24.859599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad6505b4-ba31-43a9-8099-e8ef65eb6820 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:24.901441 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad6505b4-ba31-43a9-8099-e8ef65eb6820 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.055271 Jan 22 21:31:24.902912 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3945/7591] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:24 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:25.576357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-12196184-0234-4287-8b10-9b6aea734721 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:25.576970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-12196184-0234-4287-8b10-9b6aea734721 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:25.584804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12196184-0234-4287-8b10-9b6aea734721 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:25.585254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12196184-0234-4287-8b10-9b6aea734721 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:25.586082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12196184-0234-4287-8b10-9b6aea734721 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:25.586586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12196184-0234-4287-8b10-9b6aea734721 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:25.740122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-12196184-0234-4287-8b10-9b6aea734721 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6199d0571f624eebbc985677380351fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f9009465234bd2b86f8525b5b212c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:25.764113 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-12196184-0234-4287-8b10-9b6aea734721 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 200 len: 1474 microversion: 2.1 time: 0.191334 Jan 22 21:31:25.764927 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3647/7592] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:25 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 1474 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:31:25.809539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5e69aba1-72c1-4e04-be23-1b43ab9d970d tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:25.811801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-1b53148a-ebbd-46c7-931f-facaf908dc3b req-65c35b3e-c130-4ab4-bb0c-24b5d23d00bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e43d666-76b2-4247-8f74-edf55ee918bf", "name": "network-vif-deleted", "tag": "36987e11-f55e-4a96-8b20-b7f9bc094bbc"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:25.812259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5e69aba1-72c1-4e04-be23-1b43ab9d970d tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:25.812364 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:31:25.812364 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:31:25.841249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1b53148a-ebbd-46c7-931f-facaf908dc3b req-65c35b3e-c130-4ab4-bb0c-24b5d23d00bb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:25.841922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1b53148a-ebbd-46c7-931f-facaf908dc3b req-65c35b3e-c130-4ab4-bb0c-24b5d23d00bb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:25.867208 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-1b53148a-ebbd-46c7-931f-facaf908dc3b req-65c35b3e-c130-4ab4-bb0c-24b5d23d00bb service nova] Creating event network-vif-deleted:36987e11-f55e-4a96-8b20-b7f9bc094bbc for instance 2e43d666-76b2-4247-8f74-edf55ee918bf on nch2-master-1 Jan 22 21:31:25.872433 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-1b53148a-ebbd-46c7-931f-facaf908dc3b req-65c35b3e-c130-4ab4-bb0c-24b5d23d00bb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067922 Jan 22 21:31:25.873392 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3946/7593] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:31:25.916070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5e69aba1-72c1-4e04-be23-1b43ab9d970d tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:25.922959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-92610f95-0847-4f75-9fbc-0c2d8b7e92dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:25.923466 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5e69aba1-72c1-4e04-be23-1b43ab9d970d tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1219 microversion: 2.1 time: 0.118875 Jan 22 21:31:25.925181 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3648/7594] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:25 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:31:25.935767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-92610f95-0847-4f75-9fbc-0c2d8b7e92dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:25.949126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92610f95-0847-4f75-9fbc-0c2d8b7e92dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:25.949641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92610f95-0847-4f75-9fbc-0c2d8b7e92dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:25.954697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92610f95-0847-4f75-9fbc-0c2d8b7e92dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:25.954697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92610f95-0847-4f75-9fbc-0c2d8b7e92dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:26.005346 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-92610f95-0847-4f75-9fbc-0c2d8b7e92dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.092219 Jan 22 21:31:26.006972 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3947/7595] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:25 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:26.782574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ba2e98ad-7675-4a3c-acbc-89ac3d56c8f6 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:26.784599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ba2e98ad-7675-4a3c-acbc-89ac3d56c8f6 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] [instance: 2e43d666-76b2-4247-8f74-edf55ee918bf] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:26.792610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba2e98ad-7675-4a3c-acbc-89ac3d56c8f6 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:26.793072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba2e98ad-7675-4a3c-acbc-89ac3d56c8f6 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:26.794019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba2e98ad-7675-4a3c-acbc-89ac3d56c8f6 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:26.794463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba2e98ad-7675-4a3c-acbc-89ac3d56c8f6 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:26.811799 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-ba2e98ad-7675-4a3c-acbc-89ac3d56c8f6 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] HTTP exception thrown: Instance 2e43d666-76b2-4247-8f74-edf55ee918bf could not be found. Jan 22 21:31:26.812672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ba2e98ad-7675-4a3c-acbc-89ac3d56c8f6 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] Returning 404 to user: Instance 2e43d666-76b2-4247-8f74-edf55ee918bf could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:31:26.813556 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ba2e98ad-7675-4a3c-acbc-89ac3d56c8f6 tempest-VolumesBackupsTest-1274070825 tempest-VolumesBackupsTest-1274070825-project] 10.222.0.100 "GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf" status: 404 len: 111 microversion: 2.1 time: 0.034747 Jan 22 21:31:26.814124 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3649/7596] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:26 2022] GET /compute/v2.1/servers/2e43d666-76b2-4247-8f74-edf55ee918bf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:31:26.941636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9d470e96-3508-4884-ae8c-4e772ede32f8 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:26.942400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9d470e96-3508-4884-ae8c-4e772ede32f8 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:26.950290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d470e96-3508-4884-ae8c-4e772ede32f8 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:26.950968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d470e96-3508-4884-ae8c-4e772ede32f8 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:26.956328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d470e96-3508-4884-ae8c-4e772ede32f8 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:26.957085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d470e96-3508-4884-ae8c-4e772ede32f8 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:27.016977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a9a8dffa-50df-4ffa-a3de-2ceb042b820d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:27.018571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a9a8dffa-50df-4ffa-a3de-2ceb042b820d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:27.026091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9a8dffa-50df-4ffa-a3de-2ceb042b820d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:27.026773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9a8dffa-50df-4ffa-a3de-2ceb042b820d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:27.028504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9a8dffa-50df-4ffa-a3de-2ceb042b820d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:27.029459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9a8dffa-50df-4ffa-a3de-2ceb042b820d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:27.077112 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a9a8dffa-50df-4ffa-a3de-2ceb042b820d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.063674 Jan 22 21:31:27.078121 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3650/7597] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:27 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:31:27.091230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9d470e96-3508-4884-ae8c-4e772ede32f8 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:27.100831 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9d470e96-3508-4884-ae8c-4e772ede32f8 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1271 microversion: 2.1 time: 0.163573 Jan 22 21:31:27.101416 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3948/7598] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:26 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:28.096673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b820225e-802a-4c55-8a5b-09c783d2eda2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:28.098243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b820225e-802a-4c55-8a5b-09c783d2eda2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:28.114209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b820225e-802a-4c55-8a5b-09c783d2eda2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:28.115966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b820225e-802a-4c55-8a5b-09c783d2eda2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:28.118456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b820225e-802a-4c55-8a5b-09c783d2eda2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:28.119145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b820225e-802a-4c55-8a5b-09c783d2eda2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:28.121215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-77b2e77d-5e69-4437-9349-e8ff589885a1 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:28.122979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-77b2e77d-5e69-4437-9349-e8ff589885a1 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:28.139808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77b2e77d-5e69-4437-9349-e8ff589885a1 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:28.149436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77b2e77d-5e69-4437-9349-e8ff589885a1 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:28.150775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77b2e77d-5e69-4437-9349-e8ff589885a1 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:28.151446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77b2e77d-5e69-4437-9349-e8ff589885a1 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:28.186405 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b820225e-802a-4c55-8a5b-09c783d2eda2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.099104 Jan 22 21:31:28.187474 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3651/7599] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:28 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:28.232377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-77b2e77d-5e69-4437-9349-e8ff589885a1 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:28.241678 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-77b2e77d-5e69-4437-9349-e8ff589885a1 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1277 microversion: 2.1 time: 0.125987 Jan 22 21:31:28.242524 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3949/7600] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:28 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1277 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:31:29.202064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-07f5f53f-0d6f-498f-a9ed-adfd12864673 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:29.205410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-07f5f53f-0d6f-498f-a9ed-adfd12864673 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:29.218936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07f5f53f-0d6f-498f-a9ed-adfd12864673 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:29.219594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07f5f53f-0d6f-498f-a9ed-adfd12864673 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:29.221770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07f5f53f-0d6f-498f-a9ed-adfd12864673 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:29.222419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07f5f53f-0d6f-498f-a9ed-adfd12864673 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:29.259759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d8f3ebd5-7856-4997-ba47-8b1ce0fa6934 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:29.261045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d8f3ebd5-7856-4997-ba47-8b1ce0fa6934 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:29.277400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8f3ebd5-7856-4997-ba47-8b1ce0fa6934 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:29.277903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8f3ebd5-7856-4997-ba47-8b1ce0fa6934 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:29.283936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8f3ebd5-7856-4997-ba47-8b1ce0fa6934 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:29.287647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8f3ebd5-7856-4997-ba47-8b1ce0fa6934 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:29.320273 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-07f5f53f-0d6f-498f-a9ed-adfd12864673 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.124250 Jan 22 21:31:29.321121 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3652/7601] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:29 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:29.631520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d8f3ebd5-7856-4997-ba47-8b1ce0fa6934 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:29.639495 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d8f3ebd5-7856-4997-ba47-8b1ce0fa6934 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1319 microversion: 2.1 time: 0.383695 Jan 22 21:31:29.641214 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3950/7602] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:29 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:31:29.967023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f2ce65ac-f483-42c5-948a-fa7d4846a8f3 req-898f647e-eb70-4821-beb6-a9bcd84ea5ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "627f99b4-aee0-447b-a8e5-67dfe9ed655b", "tag": "9b1ef8f1-2905-4b94-aeb6-32163e6ad9dc"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:29.972583 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:31:29.972583 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:31:29.992941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f2ce65ac-f483-42c5-948a-fa7d4846a8f3 req-898f647e-eb70-4821-beb6-a9bcd84ea5ea service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:29.993397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f2ce65ac-f483-42c5-948a-fa7d4846a8f3 req-898f647e-eb70-4821-beb6-a9bcd84ea5ea service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:30.016816 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f2ce65ac-f483-42c5-948a-fa7d4846a8f3 req-898f647e-eb70-4821-beb6-a9bcd84ea5ea service nova] Creating event network-changed:9b1ef8f1-2905-4b94-aeb6-32163e6ad9dc for instance 627f99b4-aee0-447b-a8e5-67dfe9ed655b on nch1-master-1 Jan 22 21:31:30.023798 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f2ce65ac-f483-42c5-948a-fa7d4846a8f3 req-898f647e-eb70-4821-beb6-a9bcd84ea5ea service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066095 Jan 22 21:31:30.024910 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3653/7603] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:31:30.336451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-935e787e-5e89-40f7-8000-88d5057457b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:30.338146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-935e787e-5e89-40f7-8000-88d5057457b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:30.374478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-935e787e-5e89-40f7-8000-88d5057457b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:30.375464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-935e787e-5e89-40f7-8000-88d5057457b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:30.376495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-935e787e-5e89-40f7-8000-88d5057457b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:30.376985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-935e787e-5e89-40f7-8000-88d5057457b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:30.425731 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-935e787e-5e89-40f7-8000-88d5057457b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.095860 Jan 22 21:31:30.427026 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3951/7604] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:30 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:30.658011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8abd972c-009c-4f75-9015-ec140f7ecdb7 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:30.659066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8abd972c-009c-4f75-9015-ec140f7ecdb7 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:30.667893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8abd972c-009c-4f75-9015-ec140f7ecdb7 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:30.668358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8abd972c-009c-4f75-9015-ec140f7ecdb7 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:30.669372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8abd972c-009c-4f75-9015-ec140f7ecdb7 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:30.670140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8abd972c-009c-4f75-9015-ec140f7ecdb7 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:31.213346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8abd972c-009c-4f75-9015-ec140f7ecdb7 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:31.225329 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8abd972c-009c-4f75-9015-ec140f7ecdb7 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1319 microversion: 2.1 time: 0.571527 Jan 22 21:31:31.227657 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3654/7605] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:30 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1319 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:31.441325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-136d1a6a-e4ff-4f2b-b8a3-4a308dba54aa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:31.442413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-136d1a6a-e4ff-4f2b-b8a3-4a308dba54aa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:31.450851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-136d1a6a-e4ff-4f2b-b8a3-4a308dba54aa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:31.451318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-136d1a6a-e4ff-4f2b-b8a3-4a308dba54aa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:31.452172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-136d1a6a-e4ff-4f2b-b8a3-4a308dba54aa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:31.452734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-136d1a6a-e4ff-4f2b-b8a3-4a308dba54aa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:31.504147 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-136d1a6a-e4ff-4f2b-b8a3-4a308dba54aa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.067350 Jan 22 21:31:31.506491 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3952/7606] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:31 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:32.243771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-36fc4780-bd51-410c-9b5c-caa5d3f1f449 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:32.244392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-36fc4780-bd51-410c-9b5c-caa5d3f1f449 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:32.251891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36fc4780-bd51-410c-9b5c-caa5d3f1f449 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:32.252430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36fc4780-bd51-410c-9b5c-caa5d3f1f449 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:32.253221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36fc4780-bd51-410c-9b5c-caa5d3f1f449 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:32.253965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36fc4780-bd51-410c-9b5c-caa5d3f1f449 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:32.417470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-36fc4780-bd51-410c-9b5c-caa5d3f1f449 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:32.425183 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-36fc4780-bd51-410c-9b5c-caa5d3f1f449 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1319 microversion: 2.1 time: 0.186019 Jan 22 21:31:32.425807 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3655/7607] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:32 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:32.516630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a4865bb5-f7b2-471c-a4ae-941472b836ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:32.518580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a4865bb5-f7b2-471c-a4ae-941472b836ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:32.526960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4865bb5-f7b2-471c-a4ae-941472b836ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:32.527497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4865bb5-f7b2-471c-a4ae-941472b836ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:32.528375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4865bb5-f7b2-471c-a4ae-941472b836ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:32.528827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4865bb5-f7b2-471c-a4ae-941472b836ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:32.580300 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a4865bb5-f7b2-471c-a4ae-941472b836ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.067554 Jan 22 21:31:32.581107 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3953/7608] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:32 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:33.442538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8d94330e-652a-484c-a0e3-7538fe362862 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:33.443262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8d94330e-652a-484c-a0e3-7538fe362862 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:33.450482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d94330e-652a-484c-a0e3-7538fe362862 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:33.450949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d94330e-652a-484c-a0e3-7538fe362862 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:33.451745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d94330e-652a-484c-a0e3-7538fe362862 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:33.452186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d94330e-652a-484c-a0e3-7538fe362862 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:33.596814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fedf8ef1-f863-4fc0-a09e-0e2636f534dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:33.598605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fedf8ef1-f863-4fc0-a09e-0e2636f534dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:33.609864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fedf8ef1-f863-4fc0-a09e-0e2636f534dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:33.610329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fedf8ef1-f863-4fc0-a09e-0e2636f534dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:33.610444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8d94330e-652a-484c-a0e3-7538fe362862 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:33.611559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fedf8ef1-f863-4fc0-a09e-0e2636f534dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:33.612235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fedf8ef1-f863-4fc0-a09e-0e2636f534dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:33.618020 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8d94330e-652a-484c-a0e3-7538fe362862 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1319 microversion: 2.1 time: 0.179783 Jan 22 21:31:33.618624 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3656/7609] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:33 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:33.669740 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fedf8ef1-f863-4fc0-a09e-0e2636f534dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.080937 Jan 22 21:31:33.670408 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3954/7610] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:33 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:31:34.641341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0530420e-bae0-4190-9cd8-8976e16caa6c tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:34.642290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0530420e-bae0-4190-9cd8-8976e16caa6c tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:34.649716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0530420e-bae0-4190-9cd8-8976e16caa6c tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:34.650313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0530420e-bae0-4190-9cd8-8976e16caa6c tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:34.651247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0530420e-bae0-4190-9cd8-8976e16caa6c tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:34.652021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0530420e-bae0-4190-9cd8-8976e16caa6c tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:34.683196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d1b5072-9095-405a-a563-0be282e9c450 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:34.690311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d1b5072-9095-405a-a563-0be282e9c450 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:34.698683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d1b5072-9095-405a-a563-0be282e9c450 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:34.699452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d1b5072-9095-405a-a563-0be282e9c450 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:34.700516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d1b5072-9095-405a-a563-0be282e9c450 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:34.701154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d1b5072-9095-405a-a563-0be282e9c450 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:34.749047 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d1b5072-9095-405a-a563-0be282e9c450 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.071025 Jan 22 21:31:34.750800 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3955/7611] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:34 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:31:34.825685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0530420e-bae0-4190-9cd8-8976e16caa6c tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:34.839238 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0530420e-bae0-4190-9cd8-8976e16caa6c tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1319 microversion: 2.1 time: 0.202096 Jan 22 21:31:34.839238 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3657/7612] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:34 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:35.761644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7a0cb1b7-828b-4f1f-a710-c99ed729c379 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:35.763014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7a0cb1b7-828b-4f1f-a710-c99ed729c379 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:35.771134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a0cb1b7-828b-4f1f-a710-c99ed729c379 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:35.771596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a0cb1b7-828b-4f1f-a710-c99ed729c379 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:35.772439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a0cb1b7-828b-4f1f-a710-c99ed729c379 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:35.772884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a0cb1b7-828b-4f1f-a710-c99ed729c379 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:35.838503 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7a0cb1b7-828b-4f1f-a710-c99ed729c379 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.081568 Jan 22 21:31:35.840030 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3956/7613] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:35 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:35.862217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6aa0b618-9cac-4654-b5b8-887cf080c93e tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:35.863667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6aa0b618-9cac-4654-b5b8-887cf080c93e tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:35.880418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aa0b618-9cac-4654-b5b8-887cf080c93e tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:35.883600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aa0b618-9cac-4654-b5b8-887cf080c93e tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:35.884634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aa0b618-9cac-4654-b5b8-887cf080c93e tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:35.888648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aa0b618-9cac-4654-b5b8-887cf080c93e tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:36.134253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6aa0b618-9cac-4654-b5b8-887cf080c93e tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:36.145758 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6aa0b618-9cac-4654-b5b8-887cf080c93e tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1319 microversion: 2.1 time: 0.295283 Jan 22 21:31:36.157876 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3658/7614] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:35 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:36.855686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8e2359b0-123b-449a-8daf-7bdec9730733 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:36.856678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8e2359b0-123b-449a-8daf-7bdec9730733 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:36.864284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e2359b0-123b-449a-8daf-7bdec9730733 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:36.864739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e2359b0-123b-449a-8daf-7bdec9730733 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:36.865542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e2359b0-123b-449a-8daf-7bdec9730733 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:36.866392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e2359b0-123b-449a-8daf-7bdec9730733 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:36.916747 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8e2359b0-123b-449a-8daf-7bdec9730733 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.064442 Jan 22 21:31:36.917830 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3957/7615] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:36 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:37.163411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-01e6f4d0-f882-44cc-982c-f5d0cbde21d9 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:37.163958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-01e6f4d0-f882-44cc-982c-f5d0cbde21d9 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:37.170848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01e6f4d0-f882-44cc-982c-f5d0cbde21d9 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:37.171312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01e6f4d0-f882-44cc-982c-f5d0cbde21d9 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:37.172112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01e6f4d0-f882-44cc-982c-f5d0cbde21d9 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:37.172567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-01e6f4d0-f882-44cc-982c-f5d0cbde21d9 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:37.329130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-01e6f4d0-f882-44cc-982c-f5d0cbde21d9 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:37.336755 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-01e6f4d0-f882-44cc-982c-f5d0cbde21d9 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1319 microversion: 2.1 time: 0.177255 Jan 22 21:31:37.337332 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3659/7616] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:37 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:37.931352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a884ad2b-cc1e-4dd6-8c08-4d344e1999b4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:37.933043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a884ad2b-cc1e-4dd6-8c08-4d344e1999b4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:37.941136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a884ad2b-cc1e-4dd6-8c08-4d344e1999b4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:37.941646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a884ad2b-cc1e-4dd6-8c08-4d344e1999b4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:37.942452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a884ad2b-cc1e-4dd6-8c08-4d344e1999b4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:37.943114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a884ad2b-cc1e-4dd6-8c08-4d344e1999b4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:37.988217 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a884ad2b-cc1e-4dd6-8c08-4d344e1999b4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.060882 Jan 22 21:31:37.989337 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3958/7617] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:37 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:38.278105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-665d5ff8-dd49-4a1f-8c81-55cbbc89df70 req-21621037-eff1-44e6-80ae-651739f21731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "627f99b4-aee0-447b-a8e5-67dfe9ed655b", "name": "network-vif-plugged", "status": "completed", "tag": "9b1ef8f1-2905-4b94-aeb6-32163e6ad9dc"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:38.280503 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:31:38.280503 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:31:38.290032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-665d5ff8-dd49-4a1f-8c81-55cbbc89df70 req-21621037-eff1-44e6-80ae-651739f21731 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:38.290746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-665d5ff8-dd49-4a1f-8c81-55cbbc89df70 req-21621037-eff1-44e6-80ae-651739f21731 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:38.303260 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-665d5ff8-dd49-4a1f-8c81-55cbbc89df70 req-21621037-eff1-44e6-80ae-651739f21731 service nova] Creating event network-vif-plugged:9b1ef8f1-2905-4b94-aeb6-32163e6ad9dc for instance 627f99b4-aee0-447b-a8e5-67dfe9ed655b on nch1-master-1 Jan 22 21:31:38.308543 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-665d5ff8-dd49-4a1f-8c81-55cbbc89df70 req-21621037-eff1-44e6-80ae-651739f21731 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036703 Jan 22 21:31:38.309619 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3660/7618] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:31:38.354189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-167db938-05ed-4a8e-be90-641bdbfdbe44 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:38.354961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-167db938-05ed-4a8e-be90-641bdbfdbe44 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:38.364412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-167db938-05ed-4a8e-be90-641bdbfdbe44 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:38.368205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-167db938-05ed-4a8e-be90-641bdbfdbe44 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:38.369273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-167db938-05ed-4a8e-be90-641bdbfdbe44 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:38.370487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-167db938-05ed-4a8e-be90-641bdbfdbe44 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:38.532997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-167db938-05ed-4a8e-be90-641bdbfdbe44 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:38.541669 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-167db938-05ed-4a8e-be90-641bdbfdbe44 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1319 microversion: 2.1 time: 0.191787 Jan 22 21:31:38.542615 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3959/7619] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:38 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:38.999975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-91e91c36-430e-4f78-ae42-c537c26d2e1e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:39.000984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-91e91c36-430e-4f78-ae42-c537c26d2e1e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:39.007421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91e91c36-430e-4f78-ae42-c537c26d2e1e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:39.007905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91e91c36-430e-4f78-ae42-c537c26d2e1e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:39.008710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91e91c36-430e-4f78-ae42-c537c26d2e1e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:39.012492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-91e91c36-430e-4f78-ae42-c537c26d2e1e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:39.049535 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-91e91c36-430e-4f78-ae42-c537c26d2e1e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.053309 Jan 22 21:31:39.053167 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3661/7620] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:38 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:39.559587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bd73edaf-36b0-47b2-821f-fb04287443c3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:39.561446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bd73edaf-36b0-47b2-821f-fb04287443c3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:39.570566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd73edaf-36b0-47b2-821f-fb04287443c3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:39.571188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd73edaf-36b0-47b2-821f-fb04287443c3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:39.572000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd73edaf-36b0-47b2-821f-fb04287443c3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:39.572629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd73edaf-36b0-47b2-821f-fb04287443c3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:39.736145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bd73edaf-36b0-47b2-821f-fb04287443c3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:39.758067 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bd73edaf-36b0-47b2-821f-fb04287443c3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1319 microversion: 2.1 time: 0.202154 Jan 22 21:31:39.759184 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3960/7621] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:39 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:40.071498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f8ba4e50-af92-4051-a683-54c022bed3bd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:40.072619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f8ba4e50-af92-4051-a683-54c022bed3bd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:40.083619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8ba4e50-af92-4051-a683-54c022bed3bd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:40.084429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8ba4e50-af92-4051-a683-54c022bed3bd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:40.085640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8ba4e50-af92-4051-a683-54c022bed3bd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:40.086261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8ba4e50-af92-4051-a683-54c022bed3bd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:40.132742 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f8ba4e50-af92-4051-a683-54c022bed3bd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.075095 Jan 22 21:31:40.133586 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3662/7622] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:40 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:40.776144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-10faa292-66f8-4202-8a56-735554ec2bc0 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:40.776762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-10faa292-66f8-4202-8a56-735554ec2bc0 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:40.785190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10faa292-66f8-4202-8a56-735554ec2bc0 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:40.785691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10faa292-66f8-4202-8a56-735554ec2bc0 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:40.786486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10faa292-66f8-4202-8a56-735554ec2bc0 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:40.786931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10faa292-66f8-4202-8a56-735554ec2bc0 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:40.953464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-10faa292-66f8-4202-8a56-735554ec2bc0 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:40.961953 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-10faa292-66f8-4202-8a56-735554ec2bc0 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1467 microversion: 2.1 time: 0.189355 Jan 22 21:31:40.962650 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3961/7623] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:40 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1467 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:41.003326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d20ee5e6-0f13-4198-9d3f-e006f0481297 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:41.004228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d20ee5e6-0f13-4198-9d3f-e006f0481297 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:41.012296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d20ee5e6-0f13-4198-9d3f-e006f0481297 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:41.012756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d20ee5e6-0f13-4198-9d3f-e006f0481297 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:41.013593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d20ee5e6-0f13-4198-9d3f-e006f0481297 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:41.014045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d20ee5e6-0f13-4198-9d3f-e006f0481297 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:41.050074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d20ee5e6-0f13-4198-9d3f-e006f0481297 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:31:41.145761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c9ba93b4-40d0-4412-ac9b-7617a0074231 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:41.146908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c9ba93b4-40d0-4412-ac9b-7617a0074231 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:41.153074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9ba93b4-40d0-4412-ac9b-7617a0074231 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:41.153567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9ba93b4-40d0-4412-ac9b-7617a0074231 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:41.154372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9ba93b4-40d0-4412-ac9b-7617a0074231 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:41.154819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9ba93b4-40d0-4412-ac9b-7617a0074231 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:41.195935 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c9ba93b4-40d0-4412-ac9b-7617a0074231 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.055183 Jan 22 21:31:41.196608 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3962/7624] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:41 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:31:41.509253 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d20ee5e6-0f13-4198-9d3f-e006f0481297 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "DELETE /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 204 len: 0 microversion: 2.1 time: 0.509666 Jan 22 21:31:41.510315 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3663/7625] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:31:40 2022] DELETE /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:31:41.520820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-70106665-36aa-4b23-9866-aa5199273eca tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:41.522899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-70106665-36aa-4b23-9866-aa5199273eca tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:41.542091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70106665-36aa-4b23-9866-aa5199273eca tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:41.543084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70106665-36aa-4b23-9866-aa5199273eca tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:41.544178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70106665-36aa-4b23-9866-aa5199273eca tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:41.544823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70106665-36aa-4b23-9866-aa5199273eca tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:41.785769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-70106665-36aa-4b23-9866-aa5199273eca tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:41.795015 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-70106665-36aa-4b23-9866-aa5199273eca tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1473 microversion: 2.1 time: 0.280283 Jan 22 21:31:41.806171 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3963/7626] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:41 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1473 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:31:42.209579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96ef6d6e-7ab7-455c-b0ce-0e7772d04a8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:42.210782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96ef6d6e-7ab7-455c-b0ce-0e7772d04a8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:42.225167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96ef6d6e-7ab7-455c-b0ce-0e7772d04a8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:42.225848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96ef6d6e-7ab7-455c-b0ce-0e7772d04a8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:42.226620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96ef6d6e-7ab7-455c-b0ce-0e7772d04a8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:42.227013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96ef6d6e-7ab7-455c-b0ce-0e7772d04a8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:42.273881 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96ef6d6e-7ab7-455c-b0ce-0e7772d04a8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.069706 Jan 22 21:31:42.275162 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3664/7627] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:42 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:42.813703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d30cd259-3491-46a1-825a-a95a77c0ace3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:42.814977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d30cd259-3491-46a1-825a-a95a77c0ace3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:42.822929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d30cd259-3491-46a1-825a-a95a77c0ace3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:42.823402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d30cd259-3491-46a1-825a-a95a77c0ace3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:42.824224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d30cd259-3491-46a1-825a-a95a77c0ace3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:42.824672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d30cd259-3491-46a1-825a-a95a77c0ace3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:43.102013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d30cd259-3491-46a1-825a-a95a77c0ace3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:43.112022 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d30cd259-3491-46a1-825a-a95a77c0ace3 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1473 microversion: 2.1 time: 0.301651 Jan 22 21:31:43.122764 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3964/7628] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:42 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1473 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:43.287759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f8b7f881-351b-4298-983d-dd79b7b7ad6d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:43.289063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f8b7f881-351b-4298-983d-dd79b7b7ad6d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:43.297134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8b7f881-351b-4298-983d-dd79b7b7ad6d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:43.297912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8b7f881-351b-4298-983d-dd79b7b7ad6d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:43.298730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8b7f881-351b-4298-983d-dd79b7b7ad6d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:43.299175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8b7f881-351b-4298-983d-dd79b7b7ad6d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:43.346035 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f8b7f881-351b-4298-983d-dd79b7b7ad6d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.062903 Jan 22 21:31:43.346794 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3665/7629] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:43 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:43.489813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-ab3f48bd-8fee-4722-b293-f694a74ef39f req-2aac0a05-adac-4146-b5df-b3e40e77eef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "627f99b4-aee0-447b-a8e5-67dfe9ed655b", "name": "network-vif-deleted", "tag": "9b1ef8f1-2905-4b94-aeb6-32163e6ad9dc"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:43.492040 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:31:43.492040 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:31:43.507447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ab3f48bd-8fee-4722-b293-f694a74ef39f req-2aac0a05-adac-4146-b5df-b3e40e77eef4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:43.508058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ab3f48bd-8fee-4722-b293-f694a74ef39f req-2aac0a05-adac-4146-b5df-b3e40e77eef4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:43.524929 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-ab3f48bd-8fee-4722-b293-f694a74ef39f req-2aac0a05-adac-4146-b5df-b3e40e77eef4 service nova] Creating event network-vif-deleted:9b1ef8f1-2905-4b94-aeb6-32163e6ad9dc for instance 627f99b4-aee0-447b-a8e5-67dfe9ed655b on nch1-master-1 Jan 22 21:31:43.531245 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-ab3f48bd-8fee-4722-b293-f694a74ef39f req-2aac0a05-adac-4146-b5df-b3e40e77eef4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048583 Jan 22 21:31:43.532068 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3965/7630] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:31:44.131561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bf41d237-feee-4df5-ac10-6ad4e7eaf927 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:44.132489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bf41d237-feee-4df5-ac10-6ad4e7eaf927 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:44.144687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf41d237-feee-4df5-ac10-6ad4e7eaf927 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:44.145154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf41d237-feee-4df5-ac10-6ad4e7eaf927 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:44.146087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf41d237-feee-4df5-ac10-6ad4e7eaf927 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:44.147357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf41d237-feee-4df5-ac10-6ad4e7eaf927 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:44.186053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf41d237-feee-4df5-ac10-6ad4e7eaf927 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:44.186499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bf41d237-feee-4df5-ac10-6ad4e7eaf927 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:44.186947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-bf41d237-feee-4df5-ac10-6ad4e7eaf927 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lazy-loading 'fault' on Instance uuid 627f99b4-aee0-447b-a8e5-67dfe9ed655b {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:31:44.232252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bf41d237-feee-4df5-ac10-6ad4e7eaf927 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '682168e54f9e446aabf66b552dffb707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82da13b4e8649d39cfeeecdecedd458', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:31:44.240184 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bf41d237-feee-4df5-ac10-6ad4e7eaf927 tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 200 len: 1309 microversion: 2.1 time: 0.115270 Jan 22 21:31:44.240750 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3666/7631] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:44 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:31:44.359153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b60bbbd8-e870-46f6-a100-49bdd4877480 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:44.360083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b60bbbd8-e870-46f6-a100-49bdd4877480 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:44.367210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b60bbbd8-e870-46f6-a100-49bdd4877480 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:44.367668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b60bbbd8-e870-46f6-a100-49bdd4877480 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:44.368457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b60bbbd8-e870-46f6-a100-49bdd4877480 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:44.368901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b60bbbd8-e870-46f6-a100-49bdd4877480 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:44.408179 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b60bbbd8-e870-46f6-a100-49bdd4877480 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.052981 Jan 22 21:31:44.409062 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3966/7632] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:44 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:31:45.258073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b46d6c6d-aa10-4d5d-9578-52b1e9269bcc tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:31:45.258685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b46d6c6d-aa10-4d5d-9578-52b1e9269bcc tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] [instance: 627f99b4-aee0-447b-a8e5-67dfe9ed655b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:45.266197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b46d6c6d-aa10-4d5d-9578-52b1e9269bcc tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:45.266482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b46d6c6d-aa10-4d5d-9578-52b1e9269bcc tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:45.267339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b46d6c6d-aa10-4d5d-9578-52b1e9269bcc tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:45.267716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b46d6c6d-aa10-4d5d-9578-52b1e9269bcc tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:45.282428 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-b46d6c6d-aa10-4d5d-9578-52b1e9269bcc tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] HTTP exception thrown: Instance 627f99b4-aee0-447b-a8e5-67dfe9ed655b could not be found. Jan 22 21:31:45.283023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b46d6c6d-aa10-4d5d-9578-52b1e9269bcc tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] Returning 404 to user: Instance 627f99b4-aee0-447b-a8e5-67dfe9ed655b could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:31:45.284260 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b46d6c6d-aa10-4d5d-9578-52b1e9269bcc tempest-VolumesNegativeTest-1107392943 tempest-VolumesNegativeTest-1107392943-project] 10.222.0.100 "GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b" status: 404 len: 111 microversion: 2.1 time: 0.029868 Jan 22 21:31:45.285010 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3667/7633] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:31:45 2022] GET /compute/v2.1/servers/627f99b4-aee0-447b-a8e5-67dfe9ed655b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:31:45.420686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-047295a8-001c-4f76-a21a-709ac60a0b23 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:45.422441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-047295a8-001c-4f76-a21a-709ac60a0b23 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:45.434493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-047295a8-001c-4f76-a21a-709ac60a0b23 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:45.435083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-047295a8-001c-4f76-a21a-709ac60a0b23 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:45.435988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-047295a8-001c-4f76-a21a-709ac60a0b23 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:45.436544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-047295a8-001c-4f76-a21a-709ac60a0b23 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:45.479070 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-047295a8-001c-4f76-a21a-709ac60a0b23 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.062525 Jan 22 21:31:45.479807 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3967/7634] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:45 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:46.491516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-47adc39e-c355-4c0b-b8d7-584c7d413b8a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:46.493812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-47adc39e-c355-4c0b-b8d7-584c7d413b8a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:46.501702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47adc39e-c355-4c0b-b8d7-584c7d413b8a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:46.502170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47adc39e-c355-4c0b-b8d7-584c7d413b8a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:46.503479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47adc39e-c355-4c0b-b8d7-584c7d413b8a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:46.503926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47adc39e-c355-4c0b-b8d7-584c7d413b8a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:46.551836 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-47adc39e-c355-4c0b-b8d7-584c7d413b8a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.064482 Jan 22 21:31:46.552503 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3668/7635] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:46 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:47.570145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-766e8069-c617-4646-aa9f-95527671e4a7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:47.572384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-766e8069-c617-4646-aa9f-95527671e4a7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:47.588086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-766e8069-c617-4646-aa9f-95527671e4a7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:47.590944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-766e8069-c617-4646-aa9f-95527671e4a7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:47.593064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-766e8069-c617-4646-aa9f-95527671e4a7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:47.593818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-766e8069-c617-4646-aa9f-95527671e4a7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:47.662135 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-766e8069-c617-4646-aa9f-95527671e4a7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.101609 Jan 22 21:31:47.663697 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3968/7636] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:47 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:48.674104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4e4156b9-534e-4cd0-b664-72ef03e85924 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:48.675759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4e4156b9-534e-4cd0-b664-72ef03e85924 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:48.683618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e4156b9-534e-4cd0-b664-72ef03e85924 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:48.684069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e4156b9-534e-4cd0-b664-72ef03e85924 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:48.684850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e4156b9-534e-4cd0-b664-72ef03e85924 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:48.685289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e4156b9-534e-4cd0-b664-72ef03e85924 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:48.729827 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4e4156b9-534e-4cd0-b664-72ef03e85924 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.059662 Jan 22 21:31:48.730562 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3669/7637] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:48 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:49.745010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-23ec8887-3253-4c76-8ef6-affd9c322111 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:49.746368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-23ec8887-3253-4c76-8ef6-affd9c322111 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:49.755255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23ec8887-3253-4c76-8ef6-affd9c322111 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:49.761106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23ec8887-3253-4c76-8ef6-affd9c322111 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:49.761106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23ec8887-3253-4c76-8ef6-affd9c322111 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:49.761106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23ec8887-3253-4c76-8ef6-affd9c322111 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:49.802761 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-23ec8887-3253-4c76-8ef6-affd9c322111 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.063994 Jan 22 21:31:49.803863 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3969/7638] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:49 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:50.815353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3bd07421-ceae-4b35-8b2f-f3d8c7ad8fe7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:50.817439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3bd07421-ceae-4b35-8b2f-f3d8c7ad8fe7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:50.825067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3bd07421-ceae-4b35-8b2f-f3d8c7ad8fe7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:50.825690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3bd07421-ceae-4b35-8b2f-f3d8c7ad8fe7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:50.826386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3bd07421-ceae-4b35-8b2f-f3d8c7ad8fe7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:50.826830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3bd07421-ceae-4b35-8b2f-f3d8c7ad8fe7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:50.872478 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3bd07421-ceae-4b35-8b2f-f3d8c7ad8fe7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.061074 Jan 22 21:31:50.873383 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3670/7639] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:50 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:51.885304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a8e1aad5-f124-40b2-993f-204ed5f1de0f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:51.886522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a8e1aad5-f124-40b2-993f-204ed5f1de0f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:51.894055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8e1aad5-f124-40b2-993f-204ed5f1de0f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:51.894818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8e1aad5-f124-40b2-993f-204ed5f1de0f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:51.895649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8e1aad5-f124-40b2-993f-204ed5f1de0f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:51.896170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a8e1aad5-f124-40b2-993f-204ed5f1de0f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:51.945072 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a8e1aad5-f124-40b2-993f-204ed5f1de0f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.063870 Jan 22 21:31:51.946211 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3970/7640] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:51 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:52.957378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-66b6839e-70e7-481f-92bb-fab243386a9f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:52.959215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-66b6839e-70e7-481f-92bb-fab243386a9f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:52.967067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66b6839e-70e7-481f-92bb-fab243386a9f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:52.967525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66b6839e-70e7-481f-92bb-fab243386a9f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:52.968336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66b6839e-70e7-481f-92bb-fab243386a9f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:52.968780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66b6839e-70e7-481f-92bb-fab243386a9f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:53.007539 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-66b6839e-70e7-481f-92bb-fab243386a9f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.054679 Jan 22 21:31:53.011394 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3671/7641] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:52 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:54.024462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-44a590d9-8aa3-4f1d-95b7-9cd4d605fcad tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:54.026486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-44a590d9-8aa3-4f1d-95b7-9cd4d605fcad tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:54.049454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44a590d9-8aa3-4f1d-95b7-9cd4d605fcad tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:54.050928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44a590d9-8aa3-4f1d-95b7-9cd4d605fcad tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:54.051789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44a590d9-8aa3-4f1d-95b7-9cd4d605fcad tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:54.052228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44a590d9-8aa3-4f1d-95b7-9cd4d605fcad tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:54.098724 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-44a590d9-8aa3-4f1d-95b7-9cd4d605fcad tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.078774 Jan 22 21:31:54.102401 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3971/7642] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:54 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:55.110792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b3acb0cf-d030-412d-9500-d616a5e38b88 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:55.111821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b3acb0cf-d030-412d-9500-d616a5e38b88 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:55.121545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3acb0cf-d030-412d-9500-d616a5e38b88 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:55.122330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3acb0cf-d030-412d-9500-d616a5e38b88 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:55.123403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3acb0cf-d030-412d-9500-d616a5e38b88 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:55.123744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3acb0cf-d030-412d-9500-d616a5e38b88 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:55.167328 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b3acb0cf-d030-412d-9500-d616a5e38b88 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 24566 microversion: 2.1 time: 0.060441 Jan 22 21:31:55.168352 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3672/7643] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:55 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 24566 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:56.180048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2ad7d10c-ded9-4027-8a1b-50123ec8cf84 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:56.181066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2ad7d10c-ded9-4027-8a1b-50123ec8cf84 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:56.189494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ad7d10c-ded9-4027-8a1b-50123ec8cf84 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:56.189996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ad7d10c-ded9-4027-8a1b-50123ec8cf84 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:56.190799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ad7d10c-ded9-4027-8a1b-50123ec8cf84 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:56.191952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ad7d10c-ded9-4027-8a1b-50123ec8cf84 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:56.254505 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2ad7d10c-ded9-4027-8a1b-50123ec8cf84 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.078989 Jan 22 21:31:56.255646 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3972/7644] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:56 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:57.267728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bdb69cc9-4706-4899-a38d-86f83042560b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:57.270143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bdb69cc9-4706-4899-a38d-86f83042560b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:57.279240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdb69cc9-4706-4899-a38d-86f83042560b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:57.279692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdb69cc9-4706-4899-a38d-86f83042560b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:57.280479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdb69cc9-4706-4899-a38d-86f83042560b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:57.281099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdb69cc9-4706-4899-a38d-86f83042560b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:57.324908 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bdb69cc9-4706-4899-a38d-86f83042560b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.061249 Jan 22 21:31:57.326094 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3673/7645] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:57 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:58.337532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-668114e9-f5ca-4b2c-a643-720bd8329344 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:58.338579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-668114e9-f5ca-4b2c-a643-720bd8329344 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:58.346257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-668114e9-f5ca-4b2c-a643-720bd8329344 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:58.346707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-668114e9-f5ca-4b2c-a643-720bd8329344 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:58.348213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-668114e9-f5ca-4b2c-a643-720bd8329344 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:58.348726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-668114e9-f5ca-4b2c-a643-720bd8329344 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:58.390006 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-668114e9-f5ca-4b2c-a643-720bd8329344 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.056461 Jan 22 21:31:58.390702 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3973/7646] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:58 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:31:59.403254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab0d98f1-5652-4712-94db-f4693cb54f17 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:31:59.404141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab0d98f1-5652-4712-94db-f4693cb54f17 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:31:59.412841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab0d98f1-5652-4712-94db-f4693cb54f17 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:59.413675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab0d98f1-5652-4712-94db-f4693cb54f17 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:59.414539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab0d98f1-5652-4712-94db-f4693cb54f17 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:31:59.415142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab0d98f1-5652-4712-94db-f4693cb54f17 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:31:59.463796 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab0d98f1-5652-4712-94db-f4693cb54f17 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.064655 Jan 22 21:31:59.467795 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3674/7647] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:31:59 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:00.478903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ffc45492-1d31-4de1-a377-a675cdc38b7c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:00.480507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ffc45492-1d31-4de1-a377-a675cdc38b7c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:00.489833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffc45492-1d31-4de1-a377-a675cdc38b7c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:00.490653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffc45492-1d31-4de1-a377-a675cdc38b7c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:00.491529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffc45492-1d31-4de1-a377-a675cdc38b7c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:00.491972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffc45492-1d31-4de1-a377-a675cdc38b7c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:00.537643 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ffc45492-1d31-4de1-a377-a675cdc38b7c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.065233 Jan 22 21:32:00.538485 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3974/7648] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:00 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:01.550884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6df0a64a-c77c-4e73-bdcb-1a8550479c4d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:01.552161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6df0a64a-c77c-4e73-bdcb-1a8550479c4d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:01.570347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6df0a64a-c77c-4e73-bdcb-1a8550479c4d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:01.571199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6df0a64a-c77c-4e73-bdcb-1a8550479c4d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:01.572698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6df0a64a-c77c-4e73-bdcb-1a8550479c4d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:01.573838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6df0a64a-c77c-4e73-bdcb-1a8550479c4d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:01.634160 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6df0a64a-c77c-4e73-bdcb-1a8550479c4d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.087092 Jan 22 21:32:01.636595 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3675/7649] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:01 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:32:02.651061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d6a6df8d-17e4-4b75-a87d-586e4a664f06 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:02.652082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d6a6df8d-17e4-4b75-a87d-586e4a664f06 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:02.660522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6a6df8d-17e4-4b75-a87d-586e4a664f06 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:02.661012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6a6df8d-17e4-4b75-a87d-586e4a664f06 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:02.662093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6a6df8d-17e4-4b75-a87d-586e4a664f06 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:02.662548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6a6df8d-17e4-4b75-a87d-586e4a664f06 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:02.709923 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d6a6df8d-17e4-4b75-a87d-586e4a664f06 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.062858 Jan 22 21:32:02.710871 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3975/7650] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:02 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:03.724472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9dc95701-7e69-43ab-bb66-efe924802fd9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:03.726609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9dc95701-7e69-43ab-bb66-efe924802fd9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:03.735290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9dc95701-7e69-43ab-bb66-efe924802fd9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:03.736109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9dc95701-7e69-43ab-bb66-efe924802fd9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:03.744955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9dc95701-7e69-43ab-bb66-efe924802fd9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:03.744955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9dc95701-7e69-43ab-bb66-efe924802fd9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:03.782951 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9dc95701-7e69-43ab-bb66-efe924802fd9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.064228 Jan 22 21:32:03.784146 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3676/7651] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:03 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:04.800077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-300f097c-a1cb-4104-9dff-b22cff5c12a1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:04.801407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-300f097c-a1cb-4104-9dff-b22cff5c12a1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:04.814552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-300f097c-a1cb-4104-9dff-b22cff5c12a1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:04.815246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-300f097c-a1cb-4104-9dff-b22cff5c12a1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:04.816777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-300f097c-a1cb-4104-9dff-b22cff5c12a1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:04.818528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-300f097c-a1cb-4104-9dff-b22cff5c12a1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:04.886628 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-300f097c-a1cb-4104-9dff-b22cff5c12a1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.090537 Jan 22 21:32:04.888543 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3976/7652] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:04 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:05.904415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-533918d4-62a3-43df-92ee-97f2928556e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:05.907301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-533918d4-62a3-43df-92ee-97f2928556e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:05.916435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-533918d4-62a3-43df-92ee-97f2928556e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:05.917167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-533918d4-62a3-43df-92ee-97f2928556e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:05.918227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-533918d4-62a3-43df-92ee-97f2928556e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:05.918855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-533918d4-62a3-43df-92ee-97f2928556e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:05.970000 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-533918d4-62a3-43df-92ee-97f2928556e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.072921 Jan 22 21:32:05.970448 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3677/7653] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:05 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:06.982206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad5e397e-d796-45c9-9ac8-464876868096 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:06.984051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad5e397e-d796-45c9-9ac8-464876868096 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:06.995931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad5e397e-d796-45c9-9ac8-464876868096 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:06.996386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad5e397e-d796-45c9-9ac8-464876868096 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:06.997186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad5e397e-d796-45c9-9ac8-464876868096 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:06.997925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad5e397e-d796-45c9-9ac8-464876868096 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:07.056982 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad5e397e-d796-45c9-9ac8-464876868096 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.078622 Jan 22 21:32:07.058317 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3977/7654] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:06 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:08.071126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4d1f7964-56a0-4c72-99ba-f2bc42e20d51 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:08.072351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4d1f7964-56a0-4c72-99ba-f2bc42e20d51 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:08.080215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d1f7964-56a0-4c72-99ba-f2bc42e20d51 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:08.080794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d1f7964-56a0-4c72-99ba-f2bc42e20d51 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:08.081764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d1f7964-56a0-4c72-99ba-f2bc42e20d51 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:08.082443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d1f7964-56a0-4c72-99ba-f2bc42e20d51 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:08.131792 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4d1f7964-56a0-4c72-99ba-f2bc42e20d51 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.065481 Jan 22 21:32:08.137033 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3678/7655] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:08 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:09.143395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7dc66e62-a10a-404b-bc31-84627dda9cd0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:09.144430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7dc66e62-a10a-404b-bc31-84627dda9cd0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:09.152797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dc66e62-a10a-404b-bc31-84627dda9cd0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:09.153263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dc66e62-a10a-404b-bc31-84627dda9cd0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:09.154110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dc66e62-a10a-404b-bc31-84627dda9cd0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:09.154560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dc66e62-a10a-404b-bc31-84627dda9cd0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:09.201222 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7dc66e62-a10a-404b-bc31-84627dda9cd0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.059723 Jan 22 21:32:09.201222 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3978/7656] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:09 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:10.212140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b9579ef1-fb13-47c6-a6b5-2a8a201b29c3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:10.213071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b9579ef1-fb13-47c6-a6b5-2a8a201b29c3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:10.220910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9579ef1-fb13-47c6-a6b5-2a8a201b29c3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:10.221366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9579ef1-fb13-47c6-a6b5-2a8a201b29c3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:10.222187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9579ef1-fb13-47c6-a6b5-2a8a201b29c3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:10.222632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9579ef1-fb13-47c6-a6b5-2a8a201b29c3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:10.262598 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b9579ef1-fb13-47c6-a6b5-2a8a201b29c3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055071 Jan 22 21:32:10.263325 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3679/7657] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:10 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:11.274851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e3e3047b-621c-4e6a-89b0-cd9ec408e6fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:11.275919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e3e3047b-621c-4e6a-89b0-cd9ec408e6fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:11.283695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3e3047b-621c-4e6a-89b0-cd9ec408e6fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:11.284448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3e3047b-621c-4e6a-89b0-cd9ec408e6fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:11.285844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3e3047b-621c-4e6a-89b0-cd9ec408e6fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:11.286472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3e3047b-621c-4e6a-89b0-cd9ec408e6fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:11.327178 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e3e3047b-621c-4e6a-89b0-cd9ec408e6fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.056316 Jan 22 21:32:11.327842 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3979/7658] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:11 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:12.339277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0bb8468c-9f36-4329-811d-2fc166c77fe4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:12.340286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0bb8468c-9f36-4329-811d-2fc166c77fe4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:12.347757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0bb8468c-9f36-4329-811d-2fc166c77fe4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:12.349317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0bb8468c-9f36-4329-811d-2fc166c77fe4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:12.349317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0bb8468c-9f36-4329-811d-2fc166c77fe4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:12.349800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0bb8468c-9f36-4329-811d-2fc166c77fe4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:12.391857 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0bb8468c-9f36-4329-811d-2fc166c77fe4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.056355 Jan 22 21:32:12.395904 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3680/7659] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:12 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:13.408595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad8be57e-e1de-4adf-a647-f577b9a04e39 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:13.411635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad8be57e-e1de-4adf-a647-f577b9a04e39 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:13.424264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad8be57e-e1de-4adf-a647-f577b9a04e39 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:13.425139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad8be57e-e1de-4adf-a647-f577b9a04e39 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:13.426828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad8be57e-e1de-4adf-a647-f577b9a04e39 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:13.427702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad8be57e-e1de-4adf-a647-f577b9a04e39 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:13.475252 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad8be57e-e1de-4adf-a647-f577b9a04e39 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.074224 Jan 22 21:32:13.476420 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3980/7660] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:13 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:14.489670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-94da078f-5ed8-4966-bc4d-1a5d36ddd86b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:14.491648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-94da078f-5ed8-4966-bc4d-1a5d36ddd86b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:14.499064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94da078f-5ed8-4966-bc4d-1a5d36ddd86b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:14.499521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94da078f-5ed8-4966-bc4d-1a5d36ddd86b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:14.500318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94da078f-5ed8-4966-bc4d-1a5d36ddd86b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:14.501166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94da078f-5ed8-4966-bc4d-1a5d36ddd86b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:14.547877 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-94da078f-5ed8-4966-bc4d-1a5d36ddd86b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.063562 Jan 22 21:32:14.551935 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3681/7661] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:14 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:15.560570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-235e5f40-f517-4b84-a4f6-75ade01b07d4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:15.561633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-235e5f40-f517-4b84-a4f6-75ade01b07d4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:15.569954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-235e5f40-f517-4b84-a4f6-75ade01b07d4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:15.570454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-235e5f40-f517-4b84-a4f6-75ade01b07d4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:15.571305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-235e5f40-f517-4b84-a4f6-75ade01b07d4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:15.571784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-235e5f40-f517-4b84-a4f6-75ade01b07d4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:15.618294 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-235e5f40-f517-4b84-a4f6-75ade01b07d4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.061909 Jan 22 21:32:15.622298 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3981/7662] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:15 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:16.632259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-667ee622-81f1-4004-a1e0-c9c3c8bed0cf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:16.633545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-667ee622-81f1-4004-a1e0-c9c3c8bed0cf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:16.641648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-667ee622-81f1-4004-a1e0-c9c3c8bed0cf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:16.642241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-667ee622-81f1-4004-a1e0-c9c3c8bed0cf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:16.643053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-667ee622-81f1-4004-a1e0-c9c3c8bed0cf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:16.643676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-667ee622-81f1-4004-a1e0-c9c3c8bed0cf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:16.688703 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-667ee622-81f1-4004-a1e0-c9c3c8bed0cf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.061976 Jan 22 21:32:16.689747 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3682/7663] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:16 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:17.701245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-65fb08e9-0f85-4cf4-aa22-9803993ad8ca tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:17.702192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-65fb08e9-0f85-4cf4-aa22-9803993ad8ca tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:17.710416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65fb08e9-0f85-4cf4-aa22-9803993ad8ca tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:17.710861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65fb08e9-0f85-4cf4-aa22-9803993ad8ca tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:17.711685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65fb08e9-0f85-4cf4-aa22-9803993ad8ca tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:17.712131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65fb08e9-0f85-4cf4-aa22-9803993ad8ca tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:17.758955 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-65fb08e9-0f85-4cf4-aa22-9803993ad8ca tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.061533 Jan 22 21:32:17.759639 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3982/7664] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:17 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:18.771974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-70bd7e16-b875-4a69-a343-0fcccc8bdaf7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:18.773218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-70bd7e16-b875-4a69-a343-0fcccc8bdaf7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:18.780897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70bd7e16-b875-4a69-a343-0fcccc8bdaf7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:18.781355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70bd7e16-b875-4a69-a343-0fcccc8bdaf7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:18.782185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70bd7e16-b875-4a69-a343-0fcccc8bdaf7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:18.782634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70bd7e16-b875-4a69-a343-0fcccc8bdaf7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:18.823931 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-70bd7e16-b875-4a69-a343-0fcccc8bdaf7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055842 Jan 22 21:32:18.824925 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3683/7665] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:18 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:19.836452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9cfc25c1-8b3d-40e9-a3df-25ed4e5a90d5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:19.837569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9cfc25c1-8b3d-40e9-a3df-25ed4e5a90d5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:19.845020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cfc25c1-8b3d-40e9-a3df-25ed4e5a90d5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:19.845585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cfc25c1-8b3d-40e9-a3df-25ed4e5a90d5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:19.846473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cfc25c1-8b3d-40e9-a3df-25ed4e5a90d5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:19.846962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cfc25c1-8b3d-40e9-a3df-25ed4e5a90d5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:19.889457 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9cfc25c1-8b3d-40e9-a3df-25ed4e5a90d5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.057578 Jan 22 21:32:19.890909 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3983/7666] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:19 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:20.903577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4c7eedac-cf1a-4a18-8383-bec2da240b24 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:20.905298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4c7eedac-cf1a-4a18-8383-bec2da240b24 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:20.914113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c7eedac-cf1a-4a18-8383-bec2da240b24 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:20.914561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c7eedac-cf1a-4a18-8383-bec2da240b24 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:20.915522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c7eedac-cf1a-4a18-8383-bec2da240b24 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:20.915964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c7eedac-cf1a-4a18-8383-bec2da240b24 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:20.971867 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4c7eedac-cf1a-4a18-8383-bec2da240b24 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.072476 Jan 22 21:32:20.972452 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3684/7667] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:20 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:21.984281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-92980736-eaee-4463-9664-f42c93622e27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:21.985293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-92980736-eaee-4463-9664-f42c93622e27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:21.994809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92980736-eaee-4463-9664-f42c93622e27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:21.995276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92980736-eaee-4463-9664-f42c93622e27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:21.996100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92980736-eaee-4463-9664-f42c93622e27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:21.996550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-92980736-eaee-4463-9664-f42c93622e27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:22.038602 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-92980736-eaee-4463-9664-f42c93622e27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.058241 Jan 22 21:32:22.039287 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3984/7668] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:21 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:23.051973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5dfc7064-e9c1-44d1-ab27-74901cb25419 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:23.053489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5dfc7064-e9c1-44d1-ab27-74901cb25419 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:23.061809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5dfc7064-e9c1-44d1-ab27-74901cb25419 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:23.062272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5dfc7064-e9c1-44d1-ab27-74901cb25419 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:23.063289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5dfc7064-e9c1-44d1-ab27-74901cb25419 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:23.063795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5dfc7064-e9c1-44d1-ab27-74901cb25419 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:23.104478 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5dfc7064-e9c1-44d1-ab27-74901cb25419 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.056505 Jan 22 21:32:23.105366 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3685/7669] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:23 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:24.117286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad79bf12-918e-4841-aea6-6dd8ff03b7e5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:24.118336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad79bf12-918e-4841-aea6-6dd8ff03b7e5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:24.125751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad79bf12-918e-4841-aea6-6dd8ff03b7e5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:24.126208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad79bf12-918e-4841-aea6-6dd8ff03b7e5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:24.127007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad79bf12-918e-4841-aea6-6dd8ff03b7e5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:24.127444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad79bf12-918e-4841-aea6-6dd8ff03b7e5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:24.167061 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad79bf12-918e-4841-aea6-6dd8ff03b7e5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.054279 Jan 22 21:32:24.167862 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3985/7670] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:24 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:25.180957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cb8f9042-3802-4dd6-bd3e-9f2b170285da tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:25.182205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cb8f9042-3802-4dd6-bd3e-9f2b170285da tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:25.190160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb8f9042-3802-4dd6-bd3e-9f2b170285da tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:25.190625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb8f9042-3802-4dd6-bd3e-9f2b170285da tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:25.191471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb8f9042-3802-4dd6-bd3e-9f2b170285da tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:25.192010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb8f9042-3802-4dd6-bd3e-9f2b170285da tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:25.232726 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cb8f9042-3802-4dd6-bd3e-9f2b170285da tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.056857 Jan 22 21:32:25.233389 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3686/7671] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:25 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:32:26.246921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d269042e-618d-46d4-92a3-63c898e5f6f3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:26.249510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d269042e-618d-46d4-92a3-63c898e5f6f3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:26.263084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d269042e-618d-46d4-92a3-63c898e5f6f3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:26.263901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d269042e-618d-46d4-92a3-63c898e5f6f3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:26.265184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d269042e-618d-46d4-92a3-63c898e5f6f3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:26.265984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d269042e-618d-46d4-92a3-63c898e5f6f3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:26.317870 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d269042e-618d-46d4-92a3-63c898e5f6f3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.076943 Jan 22 21:32:26.321943 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3986/7672] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:26 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:27.332099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-adb804a4-7545-43f7-a6ae-7bfdac9ef4ce tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:27.333110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-adb804a4-7545-43f7-a6ae-7bfdac9ef4ce tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:27.340929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adb804a4-7545-43f7-a6ae-7bfdac9ef4ce tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:27.341627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adb804a4-7545-43f7-a6ae-7bfdac9ef4ce tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:27.342422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adb804a4-7545-43f7-a6ae-7bfdac9ef4ce tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:27.342866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adb804a4-7545-43f7-a6ae-7bfdac9ef4ce tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:27.387632 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-adb804a4-7545-43f7-a6ae-7bfdac9ef4ce tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.059133 Jan 22 21:32:27.392223 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3687/7673] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:27 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:28.400893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b0d83a7f-3066-4b0b-bc1d-d42ce16a5cc2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:28.402132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b0d83a7f-3066-4b0b-bc1d-d42ce16a5cc2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:28.409801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0d83a7f-3066-4b0b-bc1d-d42ce16a5cc2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:28.410250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0d83a7f-3066-4b0b-bc1d-d42ce16a5cc2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:28.411038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0d83a7f-3066-4b0b-bc1d-d42ce16a5cc2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:28.411512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b0d83a7f-3066-4b0b-bc1d-d42ce16a5cc2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:28.452922 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b0d83a7f-3066-4b0b-bc1d-d42ce16a5cc2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.056847 Jan 22 21:32:28.453814 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3987/7674] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:28 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:29.465608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9abad998-075a-43ee-b413-c884222c0b03 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:29.466650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9abad998-075a-43ee-b413-c884222c0b03 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:29.474086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9abad998-075a-43ee-b413-c884222c0b03 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:29.474539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9abad998-075a-43ee-b413-c884222c0b03 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:29.475322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9abad998-075a-43ee-b413-c884222c0b03 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:29.475764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9abad998-075a-43ee-b413-c884222c0b03 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:29.516555 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9abad998-075a-43ee-b413-c884222c0b03 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055561 Jan 22 21:32:29.517095 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3688/7675] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:29 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:30.529102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a68b5bd5-86c1-4ef3-9ab7-4c96343812e3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:30.530152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a68b5bd5-86c1-4ef3-9ab7-4c96343812e3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:30.537759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a68b5bd5-86c1-4ef3-9ab7-4c96343812e3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:30.538226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a68b5bd5-86c1-4ef3-9ab7-4c96343812e3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:30.539088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a68b5bd5-86c1-4ef3-9ab7-4c96343812e3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:30.540119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a68b5bd5-86c1-4ef3-9ab7-4c96343812e3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:30.583861 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a68b5bd5-86c1-4ef3-9ab7-4c96343812e3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.058582 Jan 22 21:32:30.584452 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3988/7676] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:30 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:31.596658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-64adb2ee-769b-49ae-aa7a-bd2ad2e4aee0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:31.597677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-64adb2ee-769b-49ae-aa7a-bd2ad2e4aee0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:31.605261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64adb2ee-769b-49ae-aa7a-bd2ad2e4aee0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:31.609003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64adb2ee-769b-49ae-aa7a-bd2ad2e4aee0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:31.609003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64adb2ee-769b-49ae-aa7a-bd2ad2e4aee0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:31.609003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64adb2ee-769b-49ae-aa7a-bd2ad2e4aee0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:31.646306 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-64adb2ee-769b-49ae-aa7a-bd2ad2e4aee0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.053638 Jan 22 21:32:31.647027 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3689/7677] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:31 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:32.658733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0305397c-85bd-41d8-b370-bfe02cbe28c8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:32.660637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0305397c-85bd-41d8-b370-bfe02cbe28c8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:32.669636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0305397c-85bd-41d8-b370-bfe02cbe28c8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:32.670095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0305397c-85bd-41d8-b370-bfe02cbe28c8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:32.674842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0305397c-85bd-41d8-b370-bfe02cbe28c8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:32.674842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0305397c-85bd-41d8-b370-bfe02cbe28c8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:32.713868 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0305397c-85bd-41d8-b370-bfe02cbe28c8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.058788 Jan 22 21:32:32.714607 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3989/7678] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:32 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:33.726321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dcffedf9-f8fb-4a83-a588-9cdf52d47bea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:33.727699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dcffedf9-f8fb-4a83-a588-9cdf52d47bea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:33.735088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcffedf9-f8fb-4a83-a588-9cdf52d47bea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:33.735540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcffedf9-f8fb-4a83-a588-9cdf52d47bea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:33.736328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcffedf9-f8fb-4a83-a588-9cdf52d47bea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:33.736775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcffedf9-f8fb-4a83-a588-9cdf52d47bea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:33.777674 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dcffedf9-f8fb-4a83-a588-9cdf52d47bea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055238 Jan 22 21:32:33.778521 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3690/7679] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:33 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:34.790848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1633c0a7-5c0c-4f88-bf8e-0824b570e03d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:34.791871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1633c0a7-5c0c-4f88-bf8e-0824b570e03d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:34.799071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1633c0a7-5c0c-4f88-bf8e-0824b570e03d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:34.799532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1633c0a7-5c0c-4f88-bf8e-0824b570e03d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:34.800321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1633c0a7-5c0c-4f88-bf8e-0824b570e03d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:34.800767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1633c0a7-5c0c-4f88-bf8e-0824b570e03d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:34.854068 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1633c0a7-5c0c-4f88-bf8e-0824b570e03d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.067554 Jan 22 21:32:34.855135 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3990/7680] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:34 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:35.865763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3c79324a-78a0-47b8-833b-9d1f7486ed50 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:35.866806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3c79324a-78a0-47b8-833b-9d1f7486ed50 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:35.874866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c79324a-78a0-47b8-833b-9d1f7486ed50 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:35.875392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c79324a-78a0-47b8-833b-9d1f7486ed50 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:35.876191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c79324a-78a0-47b8-833b-9d1f7486ed50 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:35.876641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c79324a-78a0-47b8-833b-9d1f7486ed50 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:35.917530 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3c79324a-78a0-47b8-833b-9d1f7486ed50 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055813 Jan 22 21:32:35.918294 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3691/7681] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:35 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:36.929949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1d75afab-bbeb-4410-acd6-4e7547eedf8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:36.931131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1d75afab-bbeb-4410-acd6-4e7547eedf8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:36.938795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d75afab-bbeb-4410-acd6-4e7547eedf8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:36.939259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d75afab-bbeb-4410-acd6-4e7547eedf8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:36.940095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d75afab-bbeb-4410-acd6-4e7547eedf8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:36.940547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d75afab-bbeb-4410-acd6-4e7547eedf8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:36.983454 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1d75afab-bbeb-4410-acd6-4e7547eedf8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.057640 Jan 22 21:32:36.984102 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3991/7682] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:36 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:37.995987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b7ee856a-010d-4ba2-805c-8eeb7ba3c2d0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:37.996998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b7ee856a-010d-4ba2-805c-8eeb7ba3c2d0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:38.004653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7ee856a-010d-4ba2-805c-8eeb7ba3c2d0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:38.011856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7ee856a-010d-4ba2-805c-8eeb7ba3c2d0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:38.011856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7ee856a-010d-4ba2-805c-8eeb7ba3c2d0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:38.011856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b7ee856a-010d-4ba2-805c-8eeb7ba3c2d0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:38.049602 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b7ee856a-010d-4ba2-805c-8eeb7ba3c2d0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.058398 Jan 22 21:32:38.050272 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3692/7683] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:37 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:39.061352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3709e321-1f4d-4cae-9010-11858d3a8652 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:39.062396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3709e321-1f4d-4cae-9010-11858d3a8652 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:39.070396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3709e321-1f4d-4cae-9010-11858d3a8652 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:39.070861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3709e321-1f4d-4cae-9010-11858d3a8652 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:39.072321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3709e321-1f4d-4cae-9010-11858d3a8652 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:39.072878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3709e321-1f4d-4cae-9010-11858d3a8652 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:39.113945 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3709e321-1f4d-4cae-9010-11858d3a8652 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.056487 Jan 22 21:32:39.117660 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3992/7684] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:39 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:32:40.125866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-03bd7052-c01d-4ed9-a41a-7ed9be419261 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:40.126877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-03bd7052-c01d-4ed9-a41a-7ed9be419261 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:40.134566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03bd7052-c01d-4ed9-a41a-7ed9be419261 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:40.135023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03bd7052-c01d-4ed9-a41a-7ed9be419261 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:40.135828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03bd7052-c01d-4ed9-a41a-7ed9be419261 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:40.136275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03bd7052-c01d-4ed9-a41a-7ed9be419261 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:40.180031 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-03bd7052-c01d-4ed9-a41a-7ed9be419261 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.058121 Jan 22 21:32:40.180919 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3693/7685] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:40 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:41.192168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5501081b-e1af-4670-834e-ba083acd4671 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:41.193207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5501081b-e1af-4670-834e-ba083acd4671 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:41.201221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5501081b-e1af-4670-834e-ba083acd4671 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:41.201713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5501081b-e1af-4670-834e-ba083acd4671 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:41.202509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5501081b-e1af-4670-834e-ba083acd4671 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:41.202957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5501081b-e1af-4670-834e-ba083acd4671 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:41.243719 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5501081b-e1af-4670-834e-ba083acd4671 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055203 Jan 22 21:32:41.244315 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3993/7686] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:41 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:42.255880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-34951063-b5b9-4d4d-927b-00c74cf70458 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:42.256879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-34951063-b5b9-4d4d-927b-00c74cf70458 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:42.264944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34951063-b5b9-4d4d-927b-00c74cf70458 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:42.265404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34951063-b5b9-4d4d-927b-00c74cf70458 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:42.266239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34951063-b5b9-4d4d-927b-00c74cf70458 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:42.266688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34951063-b5b9-4d4d-927b-00c74cf70458 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:42.325088 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-34951063-b5b9-4d4d-927b-00c74cf70458 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.073199 Jan 22 21:32:42.325797 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3694/7687] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:42 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:43.337298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-91c33406-7793-4904-b6ad-b43fbe9bf1b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:43.338376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-91c33406-7793-4904-b6ad-b43fbe9bf1b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:43.346470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91c33406-7793-4904-b6ad-b43fbe9bf1b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:43.346963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91c33406-7793-4904-b6ad-b43fbe9bf1b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:43.347759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91c33406-7793-4904-b6ad-b43fbe9bf1b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:43.348208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-91c33406-7793-4904-b6ad-b43fbe9bf1b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:43.395257 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-91c33406-7793-4904-b6ad-b43fbe9bf1b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.062132 Jan 22 21:32:43.396128 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3994/7688] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:43 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:44.408331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f3f159ce-98d2-4e82-a04f-60bc7db7b242 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:44.409653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f3f159ce-98d2-4e82-a04f-60bc7db7b242 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:44.417344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3f159ce-98d2-4e82-a04f-60bc7db7b242 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:44.417861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3f159ce-98d2-4e82-a04f-60bc7db7b242 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:44.418662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3f159ce-98d2-4e82-a04f-60bc7db7b242 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:44.419111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3f159ce-98d2-4e82-a04f-60bc7db7b242 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:44.469709 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f3f159ce-98d2-4e82-a04f-60bc7db7b242 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.065393 Jan 22 21:32:44.477080 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3695/7689] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:44 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:45.485169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cdb6cfc5-7ad4-45f9-8bfe-8375022530e8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:45.486210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cdb6cfc5-7ad4-45f9-8bfe-8375022530e8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:45.493831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cdb6cfc5-7ad4-45f9-8bfe-8375022530e8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:45.494295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cdb6cfc5-7ad4-45f9-8bfe-8375022530e8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:45.495858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cdb6cfc5-7ad4-45f9-8bfe-8375022530e8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:45.496317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cdb6cfc5-7ad4-45f9-8bfe-8375022530e8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:45.536716 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cdb6cfc5-7ad4-45f9-8bfe-8375022530e8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055475 Jan 22 21:32:45.537364 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3995/7690] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:45 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:32:46.549218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-23bb5c0e-b6ff-4322-90a5-c4af4d04af1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:46.550355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-23bb5c0e-b6ff-4322-90a5-c4af4d04af1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:46.558999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23bb5c0e-b6ff-4322-90a5-c4af4d04af1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:46.559462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23bb5c0e-b6ff-4322-90a5-c4af4d04af1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:46.560271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23bb5c0e-b6ff-4322-90a5-c4af4d04af1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:46.560718 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23bb5c0e-b6ff-4322-90a5-c4af4d04af1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:46.600169 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-23bb5c0e-b6ff-4322-90a5-c4af4d04af1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055278 Jan 22 21:32:46.600811 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3696/7691] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:46 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:47.612986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-86aaa126-4f73-475b-8551-d614b9af1158 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:47.614108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-86aaa126-4f73-475b-8551-d614b9af1158 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:47.621836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86aaa126-4f73-475b-8551-d614b9af1158 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:47.622297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86aaa126-4f73-475b-8551-d614b9af1158 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:47.623097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86aaa126-4f73-475b-8551-d614b9af1158 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:47.623539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86aaa126-4f73-475b-8551-d614b9af1158 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:47.664994 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-86aaa126-4f73-475b-8551-d614b9af1158 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055997 Jan 22 21:32:47.666556 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3996/7692] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:47 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:48.677303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1d57feef-6333-4ac0-98f0-d99c1a83e915 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:48.678303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1d57feef-6333-4ac0-98f0-d99c1a83e915 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:48.686214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d57feef-6333-4ac0-98f0-d99c1a83e915 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:48.686663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d57feef-6333-4ac0-98f0-d99c1a83e915 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:48.687432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d57feef-6333-4ac0-98f0-d99c1a83e915 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:48.687866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d57feef-6333-4ac0-98f0-d99c1a83e915 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:48.728651 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1d57feef-6333-4ac0-98f0-d99c1a83e915 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055334 Jan 22 21:32:48.729637 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3697/7693] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:48 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:49.740119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e6593909-cdb5-485b-9d6f-8e1589228b7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:49.741153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e6593909-cdb5-485b-9d6f-8e1589228b7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:49.749510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6593909-cdb5-485b-9d6f-8e1589228b7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:49.749990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6593909-cdb5-485b-9d6f-8e1589228b7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:49.750794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6593909-cdb5-485b-9d6f-8e1589228b7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:49.751242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6593909-cdb5-485b-9d6f-8e1589228b7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:49.799142 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e6593909-cdb5-485b-9d6f-8e1589228b7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.062128 Jan 22 21:32:49.799733 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3997/7694] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:49 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:50.812025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a5c67bbe-29d6-4b92-8c8c-546deaaf8609 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:50.813171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a5c67bbe-29d6-4b92-8c8c-546deaaf8609 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:50.822501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5c67bbe-29d6-4b92-8c8c-546deaaf8609 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:50.823077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5c67bbe-29d6-4b92-8c8c-546deaaf8609 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:50.826541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5c67bbe-29d6-4b92-8c8c-546deaaf8609 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:50.826541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5c67bbe-29d6-4b92-8c8c-546deaaf8609 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:50.867178 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a5c67bbe-29d6-4b92-8c8c-546deaaf8609 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.059872 Jan 22 21:32:50.868091 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3698/7695] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:50 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:51.880616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4e728a63-1e7e-42d6-a6cc-03d307d7e45b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:51.881780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4e728a63-1e7e-42d6-a6cc-03d307d7e45b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:51.889805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e728a63-1e7e-42d6-a6cc-03d307d7e45b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:51.892649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e728a63-1e7e-42d6-a6cc-03d307d7e45b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:51.892649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e728a63-1e7e-42d6-a6cc-03d307d7e45b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:51.892649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4e728a63-1e7e-42d6-a6cc-03d307d7e45b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:51.938729 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4e728a63-1e7e-42d6-a6cc-03d307d7e45b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.062039 Jan 22 21:32:51.939383 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3998/7696] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:51 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:52.952084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-42e1d4ae-7d25-495d-b903-e01d234310ba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:52.953207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-42e1d4ae-7d25-495d-b903-e01d234310ba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:52.960770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42e1d4ae-7d25-495d-b903-e01d234310ba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:52.961561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42e1d4ae-7d25-495d-b903-e01d234310ba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:52.962341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42e1d4ae-7d25-495d-b903-e01d234310ba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:52.962776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42e1d4ae-7d25-495d-b903-e01d234310ba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:53.008310 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-42e1d4ae-7d25-495d-b903-e01d234310ba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.061124 Jan 22 21:32:53.009095 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3699/7697] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:52 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:54.021763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b7f4f62c-beae-425e-9060-2fe058e59b65 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:54.022697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b7f4f62c-beae-425e-9060-2fe058e59b65 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:54.031304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7f4f62c-beae-425e-9060-2fe058e59b65 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:54.031764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7f4f62c-beae-425e-9060-2fe058e59b65 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:54.032562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7f4f62c-beae-425e-9060-2fe058e59b65 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:54.033007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7f4f62c-beae-425e-9060-2fe058e59b65 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:54.072759 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b7f4f62c-beae-425e-9060-2fe058e59b65 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055225 Jan 22 21:32:54.073661 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 3999/7698] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:54 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:55.084643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0208dcfb-3e41-42a8-b286-d05e486caf5e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:55.085659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0208dcfb-3e41-42a8-b286-d05e486caf5e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:55.093313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0208dcfb-3e41-42a8-b286-d05e486caf5e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:55.093877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0208dcfb-3e41-42a8-b286-d05e486caf5e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:55.094651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0208dcfb-3e41-42a8-b286-d05e486caf5e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:55.095086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0208dcfb-3e41-42a8-b286-d05e486caf5e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:55.138963 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0208dcfb-3e41-42a8-b286-d05e486caf5e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.057635 Jan 22 21:32:55.139612 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3700/7699] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:55 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:56.151425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2db8711e-e43d-491a-b9be-dde3d8278d4b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:56.152433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2db8711e-e43d-491a-b9be-dde3d8278d4b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:56.160352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2db8711e-e43d-491a-b9be-dde3d8278d4b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:56.162482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2db8711e-e43d-491a-b9be-dde3d8278d4b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:56.162482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2db8711e-e43d-491a-b9be-dde3d8278d4b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:56.162482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2db8711e-e43d-491a-b9be-dde3d8278d4b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:56.205581 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2db8711e-e43d-491a-b9be-dde3d8278d4b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.058199 Jan 22 21:32:56.206275 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4000/7700] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:56 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:57.216899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-edd74f62-7b68-4375-98d9-688c08770cfe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:57.217932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-edd74f62-7b68-4375-98d9-688c08770cfe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:57.225271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-edd74f62-7b68-4375-98d9-688c08770cfe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:57.225775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-edd74f62-7b68-4375-98d9-688c08770cfe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:57.226556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-edd74f62-7b68-4375-98d9-688c08770cfe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:57.226993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-edd74f62-7b68-4375-98d9-688c08770cfe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:57.267853 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-edd74f62-7b68-4375-98d9-688c08770cfe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.054995 Jan 22 21:32:57.268490 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3701/7701] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:57 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:32:58.282726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-349ca642-b954-47be-ab2d-e787db310442 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:58.284707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-349ca642-b954-47be-ab2d-e787db310442 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:58.293135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-349ca642-b954-47be-ab2d-e787db310442 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:58.293628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-349ca642-b954-47be-ab2d-e787db310442 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:58.294493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-349ca642-b954-47be-ab2d-e787db310442 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:58.295124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-349ca642-b954-47be-ab2d-e787db310442 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:58.336220 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-349ca642-b954-47be-ab2d-e787db310442 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.059279 Jan 22 21:32:58.336915 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4001/7702] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:58 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:32:59.348589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-416cd93a-b855-4ab3-95e0-c785f9b1fd13 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:32:59.349665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-416cd93a-b855-4ab3-95e0-c785f9b1fd13 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:32:59.358723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-416cd93a-b855-4ab3-95e0-c785f9b1fd13 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:59.359351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-416cd93a-b855-4ab3-95e0-c785f9b1fd13 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:59.360501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-416cd93a-b855-4ab3-95e0-c785f9b1fd13 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:32:59.360890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-416cd93a-b855-4ab3-95e0-c785f9b1fd13 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:32:59.404478 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-416cd93a-b855-4ab3-95e0-c785f9b1fd13 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.059305 Jan 22 21:32:59.405350 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3702/7703] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:32:59 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:00.416683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-83c987bd-fc8c-4de1-9f46-42c852cf978e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:00.417748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-83c987bd-fc8c-4de1-9f46-42c852cf978e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:00.426412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83c987bd-fc8c-4de1-9f46-42c852cf978e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:00.427207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83c987bd-fc8c-4de1-9f46-42c852cf978e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:00.428451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83c987bd-fc8c-4de1-9f46-42c852cf978e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:00.429177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83c987bd-fc8c-4de1-9f46-42c852cf978e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:00.488965 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-83c987bd-fc8c-4de1-9f46-42c852cf978e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.076238 Jan 22 21:33:00.489788 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4002/7704] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:00 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:01.505304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-685156c3-158b-45dc-b43d-8afa38a52380 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:01.506399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-685156c3-158b-45dc-b43d-8afa38a52380 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:01.514637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-685156c3-158b-45dc-b43d-8afa38a52380 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:01.515084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-685156c3-158b-45dc-b43d-8afa38a52380 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:01.515858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-685156c3-158b-45dc-b43d-8afa38a52380 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:01.516301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-685156c3-158b-45dc-b43d-8afa38a52380 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:01.558960 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-685156c3-158b-45dc-b43d-8afa38a52380 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.057453 Jan 22 21:33:01.560255 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3703/7705] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:01 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:02.572452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-593808f9-c657-4d47-b5f4-470bd9566733 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:02.574098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-593808f9-c657-4d47-b5f4-470bd9566733 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:02.583349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-593808f9-c657-4d47-b5f4-470bd9566733 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:02.583349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-593808f9-c657-4d47-b5f4-470bd9566733 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:02.583349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-593808f9-c657-4d47-b5f4-470bd9566733 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:02.583642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-593808f9-c657-4d47-b5f4-470bd9566733 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:02.624501 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-593808f9-c657-4d47-b5f4-470bd9566733 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055314 Jan 22 21:33:02.628483 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4003/7706] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:02 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:03.636219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8b81a122-fa39-48e2-9caf-92a84420c596 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:03.637221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8b81a122-fa39-48e2-9caf-92a84420c596 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:03.644595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b81a122-fa39-48e2-9caf-92a84420c596 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:03.644980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b81a122-fa39-48e2-9caf-92a84420c596 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:03.645782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b81a122-fa39-48e2-9caf-92a84420c596 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:03.646221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b81a122-fa39-48e2-9caf-92a84420c596 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:03.686735 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8b81a122-fa39-48e2-9caf-92a84420c596 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.054292 Jan 22 21:33:03.687466 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3704/7707] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:03 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:04.698906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cc51cf31-f6b6-4e42-a7ab-6f3736b27376 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:04.699925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cc51cf31-f6b6-4e42-a7ab-6f3736b27376 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:04.708026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc51cf31-f6b6-4e42-a7ab-6f3736b27376 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:04.708511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc51cf31-f6b6-4e42-a7ab-6f3736b27376 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:04.709396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc51cf31-f6b6-4e42-a7ab-6f3736b27376 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:04.709865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc51cf31-f6b6-4e42-a7ab-6f3736b27376 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:04.749442 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cc51cf31-f6b6-4e42-a7ab-6f3736b27376 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.054518 Jan 22 21:33:04.750348 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4004/7708] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:04 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:05.760812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ab20e56-adc1-4d7e-9bc2-0438c7523104 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:05.761852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ab20e56-adc1-4d7e-9bc2-0438c7523104 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:05.769656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab20e56-adc1-4d7e-9bc2-0438c7523104 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:05.770378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab20e56-adc1-4d7e-9bc2-0438c7523104 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:05.771179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab20e56-adc1-4d7e-9bc2-0438c7523104 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:05.771626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab20e56-adc1-4d7e-9bc2-0438c7523104 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:05.816371 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ab20e56-adc1-4d7e-9bc2-0438c7523104 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.059569 Jan 22 21:33:05.817030 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3705/7709] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:05 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:06.829717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0404efa7-6b22-406a-86fc-a9b20ffb3912 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:06.830872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0404efa7-6b22-406a-86fc-a9b20ffb3912 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:06.838296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0404efa7-6b22-406a-86fc-a9b20ffb3912 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:06.838760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0404efa7-6b22-406a-86fc-a9b20ffb3912 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:06.839570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0404efa7-6b22-406a-86fc-a9b20ffb3912 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:06.840041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0404efa7-6b22-406a-86fc-a9b20ffb3912 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:06.880058 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0404efa7-6b22-406a-86fc-a9b20ffb3912 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055084 Jan 22 21:33:06.880696 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4005/7710] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:06 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:07.893670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2b802999-d8f6-43b9-a787-c1fe6636e107 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:07.895402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2b802999-d8f6-43b9-a787-c1fe6636e107 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:07.911346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b802999-d8f6-43b9-a787-c1fe6636e107 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:07.911346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b802999-d8f6-43b9-a787-c1fe6636e107 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:07.911611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b802999-d8f6-43b9-a787-c1fe6636e107 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:07.912304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b802999-d8f6-43b9-a787-c1fe6636e107 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:08.003365 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2b802999-d8f6-43b9-a787-c1fe6636e107 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.114912 Jan 22 21:33:08.008235 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3706/7711] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:07 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:09.016593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d278b820-11a2-42b9-b464-9b5efc3dd0ac tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:09.017621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d278b820-11a2-42b9-b464-9b5efc3dd0ac tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:09.026036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d278b820-11a2-42b9-b464-9b5efc3dd0ac tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:09.026496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d278b820-11a2-42b9-b464-9b5efc3dd0ac tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:09.027295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d278b820-11a2-42b9-b464-9b5efc3dd0ac tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:09.027745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d278b820-11a2-42b9-b464-9b5efc3dd0ac tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:09.074395 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d278b820-11a2-42b9-b464-9b5efc3dd0ac tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.062574 Jan 22 21:33:09.075044 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4006/7712] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:09 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:10.087796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b58fc962-87f3-419f-9518-4ab8bc6baf5f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:10.088791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b58fc962-87f3-419f-9518-4ab8bc6baf5f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:10.097030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b58fc962-87f3-419f-9518-4ab8bc6baf5f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:10.097490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b58fc962-87f3-419f-9518-4ab8bc6baf5f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:10.098309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b58fc962-87f3-419f-9518-4ab8bc6baf5f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:10.098758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b58fc962-87f3-419f-9518-4ab8bc6baf5f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:10.138915 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b58fc962-87f3-419f-9518-4ab8bc6baf5f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055470 Jan 22 21:33:10.139593 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3707/7713] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:10 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:33:11.151895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a0ab9d5f-5ea5-464a-abeb-48573c41f568 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:11.152923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a0ab9d5f-5ea5-464a-abeb-48573c41f568 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:11.160835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0ab9d5f-5ea5-464a-abeb-48573c41f568 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:11.161306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0ab9d5f-5ea5-464a-abeb-48573c41f568 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:11.162110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0ab9d5f-5ea5-464a-abeb-48573c41f568 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:11.162555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a0ab9d5f-5ea5-464a-abeb-48573c41f568 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:11.205446 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a0ab9d5f-5ea5-464a-abeb-48573c41f568 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.057467 Jan 22 21:33:11.206136 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4007/7714] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:11 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:12.217851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fe420f95-6940-4fec-8dcc-cb5dc9e0d8aa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:12.218925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fe420f95-6940-4fec-8dcc-cb5dc9e0d8aa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:12.226438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe420f95-6940-4fec-8dcc-cb5dc9e0d8aa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:12.226957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe420f95-6940-4fec-8dcc-cb5dc9e0d8aa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:12.227759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe420f95-6940-4fec-8dcc-cb5dc9e0d8aa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:12.228246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe420f95-6940-4fec-8dcc-cb5dc9e0d8aa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:12.270907 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fe420f95-6940-4fec-8dcc-cb5dc9e0d8aa tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.057242 Jan 22 21:33:12.271585 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3708/7715] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:12 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:13.283885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c9de50bb-cb23-4ea8-8323-dc06d938a7b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:13.285148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c9de50bb-cb23-4ea8-8323-dc06d938a7b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:13.292528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9de50bb-cb23-4ea8-8323-dc06d938a7b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:13.292985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9de50bb-cb23-4ea8-8323-dc06d938a7b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:13.293807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9de50bb-cb23-4ea8-8323-dc06d938a7b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:13.294250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9de50bb-cb23-4ea8-8323-dc06d938a7b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:13.339622 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c9de50bb-cb23-4ea8-8323-dc06d938a7b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.060489 Jan 22 21:33:13.340242 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4008/7716] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:13 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:13.810319 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:33:13.810834 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 21:33:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:33:13.882906 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:33:13.883090 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 21:33:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:33:14.353155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cc8e86f9-21b4-4c82-b84d-be99546ba22c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:14.354179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cc8e86f9-21b4-4c82-b84d-be99546ba22c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:14.361574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc8e86f9-21b4-4c82-b84d-be99546ba22c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:14.369187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc8e86f9-21b4-4c82-b84d-be99546ba22c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:14.369187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc8e86f9-21b4-4c82-b84d-be99546ba22c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:14.369187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc8e86f9-21b4-4c82-b84d-be99546ba22c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:14.403469 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cc8e86f9-21b4-4c82-b84d-be99546ba22c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.054731 Jan 22 21:33:14.404117 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3709/7717] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:14 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:14.922332 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:33:14.922921 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 21:33:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:33:15.416556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-845c5782-4525-48ae-93ab-5fb1c4f16e6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:15.417582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-845c5782-4525-48ae-93ab-5fb1c4f16e6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:15.424985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-845c5782-4525-48ae-93ab-5fb1c4f16e6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:15.425444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-845c5782-4525-48ae-93ab-5fb1c4f16e6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:15.426257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-845c5782-4525-48ae-93ab-5fb1c4f16e6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:15.426759 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-845c5782-4525-48ae-93ab-5fb1c4f16e6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:15.466966 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-845c5782-4525-48ae-93ab-5fb1c4f16e6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.054217 Jan 22 21:33:15.468176 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4009/7718] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:15 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:16.479971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ae7abf94-d80d-4be4-8a3d-473f9684a6ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:16.480974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ae7abf94-d80d-4be4-8a3d-473f9684a6ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:16.489054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae7abf94-d80d-4be4-8a3d-473f9684a6ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:16.489558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae7abf94-d80d-4be4-8a3d-473f9684a6ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:16.490328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae7abf94-d80d-4be4-8a3d-473f9684a6ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:16.490771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae7abf94-d80d-4be4-8a3d-473f9684a6ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:16.531041 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ae7abf94-d80d-4be4-8a3d-473f9684a6ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.054997 Jan 22 21:33:16.535776 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3710/7719] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:16 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:17.544192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d71ad6c-5a26-4d24-83e2-ee17432c7949 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:17.545226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d71ad6c-5a26-4d24-83e2-ee17432c7949 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:17.553009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d71ad6c-5a26-4d24-83e2-ee17432c7949 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:17.553472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d71ad6c-5a26-4d24-83e2-ee17432c7949 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:17.554282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d71ad6c-5a26-4d24-83e2-ee17432c7949 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:17.554763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d71ad6c-5a26-4d24-83e2-ee17432c7949 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:17.599754 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d71ad6c-5a26-4d24-83e2-ee17432c7949 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.059678 Jan 22 21:33:17.600754 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4010/7720] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:17 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:18.612289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1840ae3c-0580-40cc-889b-0b7922d488e1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:18.613284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1840ae3c-0580-40cc-889b-0b7922d488e1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:18.620532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1840ae3c-0580-40cc-889b-0b7922d488e1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:18.620977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1840ae3c-0580-40cc-889b-0b7922d488e1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:18.621786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1840ae3c-0580-40cc-889b-0b7922d488e1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:18.622224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1840ae3c-0580-40cc-889b-0b7922d488e1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:18.663479 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1840ae3c-0580-40cc-889b-0b7922d488e1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055612 Jan 22 21:33:18.664060 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3711/7721] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:18 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 21:33:19.677168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9918ac0a-2b90-44dc-b00a-ad2a36ba9743 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:19.678141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9918ac0a-2b90-44dc-b00a-ad2a36ba9743 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:19.686123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9918ac0a-2b90-44dc-b00a-ad2a36ba9743 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:19.686587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9918ac0a-2b90-44dc-b00a-ad2a36ba9743 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:19.687391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9918ac0a-2b90-44dc-b00a-ad2a36ba9743 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:19.687843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9918ac0a-2b90-44dc-b00a-ad2a36ba9743 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:19.728663 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9918ac0a-2b90-44dc-b00a-ad2a36ba9743 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.055567 Jan 22 21:33:19.729312 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4011/7722] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:19 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:20.741129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f7214dfc-7310-4118-85aa-d89c610d84ce tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:20.742299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f7214dfc-7310-4118-85aa-d89c610d84ce tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:20.749645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7214dfc-7310-4118-85aa-d89c610d84ce tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:20.750107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7214dfc-7310-4118-85aa-d89c610d84ce tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:20.750905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7214dfc-7310-4118-85aa-d89c610d84ce tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:20.751351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7214dfc-7310-4118-85aa-d89c610d84ce tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:20.791269 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f7214dfc-7310-4118-85aa-d89c610d84ce tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.054343 Jan 22 21:33:20.791897 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3712/7723] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:20 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:21.803655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-42477020-4f1b-4c85-9847-1cbe2321311b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:21.804661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-42477020-4f1b-4c85-9847-1cbe2321311b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:21.812449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42477020-4f1b-4c85-9847-1cbe2321311b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:21.812917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42477020-4f1b-4c85-9847-1cbe2321311b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:21.814036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42477020-4f1b-4c85-9847-1cbe2321311b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:21.814496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42477020-4f1b-4c85-9847-1cbe2321311b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:21.861656 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-42477020-4f1b-4c85-9847-1cbe2321311b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 32637 microversion: 2.1 time: 0.061937 Jan 22 21:33:21.862294 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4012/7724] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:21 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 32637 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:22.873692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f065a95-84a7-47b9-a3a0-76b10e2991e9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:22.874695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9f065a95-84a7-47b9-a3a0-76b10e2991e9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:22.883112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f065a95-84a7-47b9-a3a0-76b10e2991e9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:22.883567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f065a95-84a7-47b9-a3a0-76b10e2991e9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:22.884397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f065a95-84a7-47b9-a3a0-76b10e2991e9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:22.884799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f065a95-84a7-47b9-a3a0-76b10e2991e9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:22.938741 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9f065a95-84a7-47b9-a3a0-76b10e2991e9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 40790 microversion: 2.1 time: 0.067757 Jan 22 21:33:22.938741 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3713/7725] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:22 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 40790 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:33:22.951756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2d23bd04-d7fa-4ce6-9310-f82055ab2ad2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:33:22.952701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2d23bd04-d7fa-4ce6-9310-f82055ab2ad2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:22.960745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d23bd04-d7fa-4ce6-9310-f82055ab2ad2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:22.961205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d23bd04-d7fa-4ce6-9310-f82055ab2ad2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:22.962035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d23bd04-d7fa-4ce6-9310-f82055ab2ad2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:22.962487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d23bd04-d7fa-4ce6-9310-f82055ab2ad2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:23.098090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2d23bd04-d7fa-4ce6-9310-f82055ab2ad2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:33:23.106093 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2d23bd04-d7fa-4ce6-9310-f82055ab2ad2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.158573 Jan 22 21:33:23.106662 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4013/7726] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:33:22 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:33:23.124418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-67b4644f-5ca3-404b-a229-b8133ff59c26 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1658247813"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:23.125495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-67b4644f-5ca3-404b-a229-b8133ff59c26 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:23.133141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67b4644f-5ca3-404b-a229-b8133ff59c26 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:23.133630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67b4644f-5ca3-404b-a229-b8133ff59c26 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:23.134429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67b4644f-5ca3-404b-a229-b8133ff59c26 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:23.134871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67b4644f-5ca3-404b-a229-b8133ff59c26 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:23.659288 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-67b4644f-5ca3-404b-a229-b8133ff59c26 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.538748 Jan 22 21:33:23.659929 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3714/7727] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:23 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 457 bytes (1 switches on core 0) Jan 22 21:33:30.419764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-1532297b-87dd-4cc6-9fa4-bc1c9ae69055 req-228af5e2-6e22-41ca-b90a-9cde652a8e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e98b30-0c8f-4544-9800-71179f1dfed0", "name": "network-vif-plugged", "status": "completed", "tag": "a39b0c0a-a794-487b-b823-eb2be84c82fa"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:30.421336 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:33:30.421336 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:33:30.431452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1532297b-87dd-4cc6-9fa4-bc1c9ae69055 req-228af5e2-6e22-41ca-b90a-9cde652a8e94 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:30.431946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1532297b-87dd-4cc6-9fa4-bc1c9ae69055 req-228af5e2-6e22-41ca-b90a-9cde652a8e94 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:30.442355 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-1532297b-87dd-4cc6-9fa4-bc1c9ae69055 req-228af5e2-6e22-41ca-b90a-9cde652a8e94 service nova] Creating event network-vif-plugged:a39b0c0a-a794-487b-b823-eb2be84c82fa for instance a0e98b30-0c8f-4544-9800-71179f1dfed0 on nch2-master-1 Jan 22 21:33:30.448261 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-1532297b-87dd-4cc6-9fa4-bc1c9ae69055 req-228af5e2-6e22-41ca-b90a-9cde652a8e94 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032280 Jan 22 21:33:30.448857 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4014/7728] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:33:44.215629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-007cc813-b013-49e7-b2e3-24e2869c8062 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:33:44.216333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-007cc813-b013-49e7-b2e3-24e2869c8062 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:44.222691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-007cc813-b013-49e7-b2e3-24e2869c8062 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:44.223151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-007cc813-b013-49e7-b2e3-24e2869c8062 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:44.223935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-007cc813-b013-49e7-b2e3-24e2869c8062 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:44.224380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-007cc813-b013-49e7-b2e3-24e2869c8062 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:44.364396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-007cc813-b013-49e7-b2e3-24e2869c8062 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:33:44.372180 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-007cc813-b013-49e7-b2e3-24e2869c8062 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1686 microversion: 2.1 time: 0.162395 Jan 22 21:33:44.372794 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3715/7729] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:33:44 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:33:45.390706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1a2e42b2-4180-48dd-b699-771bc643abfc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:33:45.415189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1a2e42b2-4180-48dd-b699-771bc643abfc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:45.415189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a2e42b2-4180-48dd-b699-771bc643abfc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:45.415189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a2e42b2-4180-48dd-b699-771bc643abfc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:45.415189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a2e42b2-4180-48dd-b699-771bc643abfc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:45.415189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a2e42b2-4180-48dd-b699-771bc643abfc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:45.546874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1a2e42b2-4180-48dd-b699-771bc643abfc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:33:45.554684 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1a2e42b2-4180-48dd-b699-771bc643abfc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.169563 Jan 22 21:33:45.555255 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4015/7730] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:33:45 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:33:45.571397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4d2b1021-54c0-471e-a958-aa5b91c8e536 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-674805585"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:45.572570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4d2b1021-54c0-471e-a958-aa5b91c8e536 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:33:45.579934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d2b1021-54c0-471e-a958-aa5b91c8e536 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:45.581802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d2b1021-54c0-471e-a958-aa5b91c8e536 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:45.581802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d2b1021-54c0-471e-a958-aa5b91c8e536 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:45.581802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4d2b1021-54c0-471e-a958-aa5b91c8e536 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:46.158220 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4d2b1021-54c0-471e-a958-aa5b91c8e536 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.590275 Jan 22 21:33:46.158926 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3716/7731] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:33:45 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 457 bytes (1 switches on core 0) Jan 22 21:33:48.430260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-23f9fd50-21c1-4422-add7-635ec2ff3f4f req-db6aed09-6c10-4f95-9777-1563f3f10826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e98b30-0c8f-4544-9800-71179f1dfed0", "name": "network-vif-unplugged", "status": "completed", "tag": "a39b0c0a-a794-487b-b823-eb2be84c82fa"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:48.431834 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:33:48.431834 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:33:48.439547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-23f9fd50-21c1-4422-add7-635ec2ff3f4f req-db6aed09-6c10-4f95-9777-1563f3f10826 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:48.446337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-23f9fd50-21c1-4422-add7-635ec2ff3f4f req-db6aed09-6c10-4f95-9777-1563f3f10826 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:48.451529 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-23f9fd50-21c1-4422-add7-635ec2ff3f4f req-db6aed09-6c10-4f95-9777-1563f3f10826 service nova] Creating event network-vif-unplugged:a39b0c0a-a794-487b-b823-eb2be84c82fa for instance a0e98b30-0c8f-4544-9800-71179f1dfed0 on nch2-master-1 Jan 22 21:33:48.456421 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-23f9fd50-21c1-4422-add7-635ec2ff3f4f req-db6aed09-6c10-4f95-9777-1563f3f10826 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030006 Jan 22 21:33:48.457008 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4016/7732] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:33:54.512906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f12cf690-65d3-4336-937d-6c55ef1bc5c1 req-4c4afcd2-dbaf-47bf-a6e7-b22a091ba8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e98b30-0c8f-4544-9800-71179f1dfed0", "name": "network-vif-plugged", "status": "completed", "tag": "a39b0c0a-a794-487b-b823-eb2be84c82fa"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:33:54.515218 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:33:54.515218 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:33:54.522477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f12cf690-65d3-4336-937d-6c55ef1bc5c1 req-4c4afcd2-dbaf-47bf-a6e7-b22a091ba8b6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:33:54.522928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f12cf690-65d3-4336-937d-6c55ef1bc5c1 req-4c4afcd2-dbaf-47bf-a6e7-b22a091ba8b6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:33:54.535162 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f12cf690-65d3-4336-937d-6c55ef1bc5c1 req-4c4afcd2-dbaf-47bf-a6e7-b22a091ba8b6 service nova] Creating event network-vif-plugged:a39b0c0a-a794-487b-b823-eb2be84c82fa for instance a0e98b30-0c8f-4544-9800-71179f1dfed0 on nch2-master-1 Jan 22 21:33:54.539926 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f12cf690-65d3-4336-937d-6c55ef1bc5c1 req-4c4afcd2-dbaf-47bf-a6e7-b22a091ba8b6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031884 Jan 22 21:33:54.540529 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3717/7733] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:34:06.785950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e810520c-51a2-4259-bcf7-39703b75b1ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:06.786654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e810520c-51a2-4259-bcf7-39703b75b1ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:06.792860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e810520c-51a2-4259-bcf7-39703b75b1ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:06.793328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e810520c-51a2-4259-bcf7-39703b75b1ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:06.794153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e810520c-51a2-4259-bcf7-39703b75b1ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:06.794602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e810520c-51a2-4259-bcf7-39703b75b1ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:06.929146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e810520c-51a2-4259-bcf7-39703b75b1ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:06.936662 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e810520c-51a2-4259-bcf7-39703b75b1ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.156609 Jan 22 21:34:06.937236 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4017/7734] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:06 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:06.954860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0337138b-d41b-4d6e-931d-8feb9d8bfa14 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1222224597"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:34:06.960579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0337138b-d41b-4d6e-931d-8feb9d8bfa14 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:06.962045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0337138b-d41b-4d6e-931d-8feb9d8bfa14 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:06.962493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0337138b-d41b-4d6e-931d-8feb9d8bfa14 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:06.963267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0337138b-d41b-4d6e-931d-8feb9d8bfa14 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:06.963704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0337138b-d41b-4d6e-931d-8feb9d8bfa14 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:07.477703 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0337138b-d41b-4d6e-931d-8feb9d8bfa14 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.528067 Jan 22 21:34:07.478406 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3718/7735] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:34:06 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 457 bytes (1 switches on core 0) Jan 22 21:34:07.487251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7ee96e67-8208-4811-b7f9-f324ea87a87a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:07.487863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7ee96e67-8208-4811-b7f9-f324ea87a87a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:07.493888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ee96e67-8208-4811-b7f9-f324ea87a87a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:07.494255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ee96e67-8208-4811-b7f9-f324ea87a87a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:07.495049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ee96e67-8208-4811-b7f9-f324ea87a87a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:07.495532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ee96e67-8208-4811-b7f9-f324ea87a87a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:07.638653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7ee96e67-8208-4811-b7f9-f324ea87a87a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:07.646178 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7ee96e67-8208-4811-b7f9-f324ea87a87a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.163528 Jan 22 21:34:07.646751 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4018/7736] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:07 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:08.665868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-40dad346-2d5f-4e8f-b3e7-e5f88fe42655 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:08.666639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-40dad346-2d5f-4e8f-b3e7-e5f88fe42655 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:08.672851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40dad346-2d5f-4e8f-b3e7-e5f88fe42655 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:08.673552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40dad346-2d5f-4e8f-b3e7-e5f88fe42655 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:08.674466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40dad346-2d5f-4e8f-b3e7-e5f88fe42655 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:08.674914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40dad346-2d5f-4e8f-b3e7-e5f88fe42655 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:08.811340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-40dad346-2d5f-4e8f-b3e7-e5f88fe42655 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:08.819878 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-40dad346-2d5f-4e8f-b3e7-e5f88fe42655 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.159260 Jan 22 21:34:08.820450 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3719/7737] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:08 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:09.837846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a731e2f5-b386-44e8-8293-435d2310ab23 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:09.838530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a731e2f5-b386-44e8-8293-435d2310ab23 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:09.845322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a731e2f5-b386-44e8-8293-435d2310ab23 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:09.845815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a731e2f5-b386-44e8-8293-435d2310ab23 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:09.846606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a731e2f5-b386-44e8-8293-435d2310ab23 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:09.847054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a731e2f5-b386-44e8-8293-435d2310ab23 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:09.991749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a731e2f5-b386-44e8-8293-435d2310ab23 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:10.000499 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a731e2f5-b386-44e8-8293-435d2310ab23 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.166279 Jan 22 21:34:10.001166 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4019/7738] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:09 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:10.609056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-d9757243-b59c-47af-866c-b57b3b1a2caf req-06dc08de-a91c-4c74-a250-0153400bda51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e98b30-0c8f-4544-9800-71179f1dfed0", "name": "network-vif-unplugged", "status": "completed", "tag": "a39b0c0a-a794-487b-b823-eb2be84c82fa"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:34:10.611848 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:34:10.611848 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:34:10.622808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d9757243-b59c-47af-866c-b57b3b1a2caf req-06dc08de-a91c-4c74-a250-0153400bda51 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:10.622808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d9757243-b59c-47af-866c-b57b3b1a2caf req-06dc08de-a91c-4c74-a250-0153400bda51 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:10.633536 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-d9757243-b59c-47af-866c-b57b3b1a2caf req-06dc08de-a91c-4c74-a250-0153400bda51 service nova] Creating event network-vif-unplugged:a39b0c0a-a794-487b-b823-eb2be84c82fa for instance a0e98b30-0c8f-4544-9800-71179f1dfed0 on nch2-master-1 Jan 22 21:34:10.638909 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-d9757243-b59c-47af-866c-b57b3b1a2caf req-06dc08de-a91c-4c74-a250-0153400bda51 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033479 Jan 22 21:34:10.643794 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3720/7739] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:34:11.018016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-06658d9a-0729-49d8-a2cf-ffc275750e68 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:11.018629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-06658d9a-0729-49d8-a2cf-ffc275750e68 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:11.026040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06658d9a-0729-49d8-a2cf-ffc275750e68 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:11.030115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06658d9a-0729-49d8-a2cf-ffc275750e68 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:11.030115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06658d9a-0729-49d8-a2cf-ffc275750e68 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:11.030115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06658d9a-0729-49d8-a2cf-ffc275750e68 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:11.171848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-06658d9a-0729-49d8-a2cf-ffc275750e68 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:11.180395 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-06658d9a-0729-49d8-a2cf-ffc275750e68 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1691 microversion: 2.1 time: 0.166040 Jan 22 21:34:11.180975 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4020/7740] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:11 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:12.199845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-40524fdc-3f7f-42c3-8706-ea3984982ef0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:12.200727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-40524fdc-3f7f-42c3-8706-ea3984982ef0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:12.206892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40524fdc-3f7f-42c3-8706-ea3984982ef0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:12.207341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40524fdc-3f7f-42c3-8706-ea3984982ef0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:12.208121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40524fdc-3f7f-42c3-8706-ea3984982ef0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:12.209078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-40524fdc-3f7f-42c3-8706-ea3984982ef0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:12.358585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-40524fdc-3f7f-42c3-8706-ea3984982ef0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:12.366646 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-40524fdc-3f7f-42c3-8706-ea3984982ef0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1691 microversion: 2.1 time: 0.171687 Jan 22 21:34:12.367214 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3721/7741] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:12 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:34:13.384078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-39a3ea43-ee55-4784-9212-3e69b10b4e2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:13.384720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-39a3ea43-ee55-4784-9212-3e69b10b4e2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:13.391651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39a3ea43-ee55-4784-9212-3e69b10b4e2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:13.392106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39a3ea43-ee55-4784-9212-3e69b10b4e2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:13.392891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39a3ea43-ee55-4784-9212-3e69b10b4e2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:13.393331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39a3ea43-ee55-4784-9212-3e69b10b4e2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:13.527099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-39a3ea43-ee55-4784-9212-3e69b10b4e2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:13.534776 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-39a3ea43-ee55-4784-9212-3e69b10b4e2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1691 microversion: 2.1 time: 0.154457 Jan 22 21:34:13.535346 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4021/7742] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:13 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:14.553123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8045cfc0-612a-4e62-b053-4c0115b7f5cb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:14.556618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8045cfc0-612a-4e62-b053-4c0115b7f5cb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:14.561488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8045cfc0-612a-4e62-b053-4c0115b7f5cb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:14.562410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8045cfc0-612a-4e62-b053-4c0115b7f5cb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:14.563472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8045cfc0-612a-4e62-b053-4c0115b7f5cb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:14.563934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8045cfc0-612a-4e62-b053-4c0115b7f5cb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:14.714900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8045cfc0-612a-4e62-b053-4c0115b7f5cb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:14.725184 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8045cfc0-612a-4e62-b053-4c0115b7f5cb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1691 microversion: 2.1 time: 0.176567 Jan 22 21:34:14.728307 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3722/7743] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:14 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:14.812658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-51167062-bece-4402-bd3e-d82b265a0e87 req-e967a550-f021-4c38-b4dd-6205950f65d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e98b30-0c8f-4544-9800-71179f1dfed0", "name": "network-vif-plugged", "status": "completed", "tag": "a39b0c0a-a794-487b-b823-eb2be84c82fa"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:34:14.814281 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:34:14.814281 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:34:14.822183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-51167062-bece-4402-bd3e-d82b265a0e87 req-e967a550-f021-4c38-b4dd-6205950f65d2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:14.822642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-51167062-bece-4402-bd3e-d82b265a0e87 req-e967a550-f021-4c38-b4dd-6205950f65d2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:14.833322 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-51167062-bece-4402-bd3e-d82b265a0e87 req-e967a550-f021-4c38-b4dd-6205950f65d2 service nova] Creating event network-vif-plugged:a39b0c0a-a794-487b-b823-eb2be84c82fa for instance a0e98b30-0c8f-4544-9800-71179f1dfed0 on nch2-master-1 Jan 22 21:34:14.838649 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-51167062-bece-4402-bd3e-d82b265a0e87 req-e967a550-f021-4c38-b4dd-6205950f65d2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029852 Jan 22 21:34:14.839232 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4022/7744] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:34:15.743625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ecbe42ee-8020-48ec-9651-88ab8153af19 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:15.744170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ecbe42ee-8020-48ec-9651-88ab8153af19 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:15.751099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecbe42ee-8020-48ec-9651-88ab8153af19 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:15.751559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecbe42ee-8020-48ec-9651-88ab8153af19 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:15.752503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecbe42ee-8020-48ec-9651-88ab8153af19 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:15.752956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ecbe42ee-8020-48ec-9651-88ab8153af19 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:15.888531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ecbe42ee-8020-48ec-9651-88ab8153af19 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:15.896222 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ecbe42ee-8020-48ec-9651-88ab8153af19 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1691 microversion: 2.1 time: 0.157097 Jan 22 21:34:15.897357 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3723/7745] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:15 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:16.917868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4b48ba98-6c67-4395-9b8a-e1f760e27311 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:16.918895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4b48ba98-6c67-4395-9b8a-e1f760e27311 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:16.926691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b48ba98-6c67-4395-9b8a-e1f760e27311 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:16.927719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b48ba98-6c67-4395-9b8a-e1f760e27311 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:16.930050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b48ba98-6c67-4395-9b8a-e1f760e27311 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:16.930735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b48ba98-6c67-4395-9b8a-e1f760e27311 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:17.087741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4b48ba98-6c67-4395-9b8a-e1f760e27311 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:17.101076 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4b48ba98-6c67-4395-9b8a-e1f760e27311 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1686 microversion: 2.1 time: 0.189081 Jan 22 21:34:17.111317 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4023/7746] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:16 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1686 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:18.125429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4072e3e3-95d8-4ab1-8646-530de84f0eb7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:18.126099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4072e3e3-95d8-4ab1-8646-530de84f0eb7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:18.133704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4072e3e3-95d8-4ab1-8646-530de84f0eb7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:18.134468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4072e3e3-95d8-4ab1-8646-530de84f0eb7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:18.135689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4072e3e3-95d8-4ab1-8646-530de84f0eb7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:18.136354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4072e3e3-95d8-4ab1-8646-530de84f0eb7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:18.294901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4072e3e3-95d8-4ab1-8646-530de84f0eb7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:18.304316 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4072e3e3-95d8-4ab1-8646-530de84f0eb7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1686 microversion: 2.1 time: 0.182410 Jan 22 21:34:18.304889 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3724/7747] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:18 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1686 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:19.321588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1f24caff-e3ed-455b-bcd4-db63ec7c4aa4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:19.322216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1f24caff-e3ed-455b-bcd4-db63ec7c4aa4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:19.329680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f24caff-e3ed-455b-bcd4-db63ec7c4aa4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:19.330670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f24caff-e3ed-455b-bcd4-db63ec7c4aa4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:19.331152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f24caff-e3ed-455b-bcd4-db63ec7c4aa4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:19.331634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f24caff-e3ed-455b-bcd4-db63ec7c4aa4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:19.491685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1f24caff-e3ed-455b-bcd4-db63ec7c4aa4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:19.497112 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1f24caff-e3ed-455b-bcd4-db63ec7c4aa4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1686 microversion: 2.1 time: 0.180198 Jan 22 21:34:19.497724 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4024/7748] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:19 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:20.516440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a8fd967c-5dba-4c8c-b4fe-381585b1df9c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:20.517132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a8fd967c-5dba-4c8c-b4fe-381585b1df9c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:20.525661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8fd967c-5dba-4c8c-b4fe-381585b1df9c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:20.526226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8fd967c-5dba-4c8c-b4fe-381585b1df9c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:20.527151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8fd967c-5dba-4c8c-b4fe-381585b1df9c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:20.527678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8fd967c-5dba-4c8c-b4fe-381585b1df9c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:20.693804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a8fd967c-5dba-4c8c-b4fe-381585b1df9c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:20.701750 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a8fd967c-5dba-4c8c-b4fe-381585b1df9c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1686 microversion: 2.1 time: 0.190371 Jan 22 21:34:20.702540 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3725/7749] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:20 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1686 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:21.719616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-84edf2a7-c410-44be-9703-8a82b18245de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:21.720961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-84edf2a7-c410-44be-9703-8a82b18245de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:21.729663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84edf2a7-c410-44be-9703-8a82b18245de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:21.730209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84edf2a7-c410-44be-9703-8a82b18245de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:21.731128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84edf2a7-c410-44be-9703-8a82b18245de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:21.731636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84edf2a7-c410-44be-9703-8a82b18245de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:21.878896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-84edf2a7-c410-44be-9703-8a82b18245de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:21.887967 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-84edf2a7-c410-44be-9703-8a82b18245de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1686 microversion: 2.1 time: 0.171992 Jan 22 21:34:21.889560 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4025/7750] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:21 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:22.906004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-78af6859-6592-4ca5-a1d9-bfa78310acbf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:22.907380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-78af6859-6592-4ca5-a1d9-bfa78310acbf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:22.915249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78af6859-6592-4ca5-a1d9-bfa78310acbf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:22.915714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78af6859-6592-4ca5-a1d9-bfa78310acbf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:22.916519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78af6859-6592-4ca5-a1d9-bfa78310acbf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:22.916965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-78af6859-6592-4ca5-a1d9-bfa78310acbf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:23.083083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-78af6859-6592-4ca5-a1d9-bfa78310acbf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:23.092947 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-78af6859-6592-4ca5-a1d9-bfa78310acbf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1686 microversion: 2.1 time: 0.190451 Jan 22 21:34:23.093589 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3726/7751] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:22 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1686 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:24.110963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f0aaee24-7676-4a64-8293-e2805cd31727 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:24.111581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f0aaee24-7676-4a64-8293-e2805cd31727 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:24.119489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0aaee24-7676-4a64-8293-e2805cd31727 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:24.119941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0aaee24-7676-4a64-8293-e2805cd31727 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:24.120752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0aaee24-7676-4a64-8293-e2805cd31727 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:24.121206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f0aaee24-7676-4a64-8293-e2805cd31727 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:24.278430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f0aaee24-7676-4a64-8293-e2805cd31727 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:24.288052 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f0aaee24-7676-4a64-8293-e2805cd31727 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1686 microversion: 2.1 time: 0.180794 Jan 22 21:34:24.296235 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4026/7752] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:24 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:25.306090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5a5e452f-dfe7-419e-82b9-1336dcc500eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:25.306803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5a5e452f-dfe7-419e-82b9-1336dcc500eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:25.313756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a5e452f-dfe7-419e-82b9-1336dcc500eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:25.314216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a5e452f-dfe7-419e-82b9-1336dcc500eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:25.315009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a5e452f-dfe7-419e-82b9-1336dcc500eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:25.315460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a5e452f-dfe7-419e-82b9-1336dcc500eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:25.465689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5a5e452f-dfe7-419e-82b9-1336dcc500eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:25.473167 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5a5e452f-dfe7-419e-82b9-1336dcc500eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1686 microversion: 2.1 time: 0.171491 Jan 22 21:34:25.473778 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3727/7753] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:25 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:26.490985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-44fdb294-3ec3-4aaa-b3bb-c7979c7b9e30 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:26.491786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-44fdb294-3ec3-4aaa-b3bb-c7979c7b9e30 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:26.499658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44fdb294-3ec3-4aaa-b3bb-c7979c7b9e30 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:26.500029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44fdb294-3ec3-4aaa-b3bb-c7979c7b9e30 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:26.500835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44fdb294-3ec3-4aaa-b3bb-c7979c7b9e30 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:26.501286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44fdb294-3ec3-4aaa-b3bb-c7979c7b9e30 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:26.660030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-44fdb294-3ec3-4aaa-b3bb-c7979c7b9e30 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:26.668496 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-44fdb294-3ec3-4aaa-b3bb-c7979c7b9e30 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1686 microversion: 2.1 time: 0.181166 Jan 22 21:34:26.669078 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4027/7754] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:26 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:27.686748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-68c795fe-e489-4a4d-bf34-17781149231d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:27.687697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-68c795fe-e489-4a4d-bf34-17781149231d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:27.700547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68c795fe-e489-4a4d-bf34-17781149231d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:27.701013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68c795fe-e489-4a4d-bf34-17781149231d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:27.701929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68c795fe-e489-4a4d-bf34-17781149231d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:27.702379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68c795fe-e489-4a4d-bf34-17781149231d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:27.858730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-68c795fe-e489-4a4d-bf34-17781149231d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:27.868703 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-68c795fe-e489-4a4d-bf34-17781149231d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.185309 Jan 22 21:34:27.887412 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3728/7755] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:27 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:30.039531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-512662c7-fc1f-400f-b72d-72973585718f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:30.041769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-512662c7-fc1f-400f-b72d-72973585718f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:30.047488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-512662c7-fc1f-400f-b72d-72973585718f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:30.047954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-512662c7-fc1f-400f-b72d-72973585718f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:30.048772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-512662c7-fc1f-400f-b72d-72973585718f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:30.049216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-512662c7-fc1f-400f-b72d-72973585718f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:30.201087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-512662c7-fc1f-400f-b72d-72973585718f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:30.208501 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-512662c7-fc1f-400f-b72d-72973585718f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.173230 Jan 22 21:34:30.209081 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4028/7756] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:30 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:30.633286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-43de5bf2-ddcd-44af-a5df-ddd96a9ea1b9 req-82786e41-a282-4488-94b2-45b949fcbbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e98b30-0c8f-4544-9800-71179f1dfed0", "name": "network-vif-unplugged", "status": "completed", "tag": "a39b0c0a-a794-487b-b823-eb2be84c82fa"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:34:30.635588 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:34:30.635588 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:34:30.659451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-43de5bf2-ddcd-44af-a5df-ddd96a9ea1b9 req-82786e41-a282-4488-94b2-45b949fcbbe2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:30.659451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-43de5bf2-ddcd-44af-a5df-ddd96a9ea1b9 req-82786e41-a282-4488-94b2-45b949fcbbe2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:30.666883 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-43de5bf2-ddcd-44af-a5df-ddd96a9ea1b9 req-82786e41-a282-4488-94b2-45b949fcbbe2 service nova] Creating event network-vif-unplugged:a39b0c0a-a794-487b-b823-eb2be84c82fa for instance a0e98b30-0c8f-4544-9800-71179f1dfed0 on nch2-master-1 Jan 22 21:34:30.671986 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-43de5bf2-ddcd-44af-a5df-ddd96a9ea1b9 req-82786e41-a282-4488-94b2-45b949fcbbe2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043079 Jan 22 21:34:30.672584 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3729/7757] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:34:33.183209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-68277635-200b-431c-8549-9ea23aa1d9d7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:33.183810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-68277635-200b-431c-8549-9ea23aa1d9d7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:33.190379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-68277635-200b-431c-8549-9ea23aa1d9d7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:33.190834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-68277635-200b-431c-8549-9ea23aa1d9d7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:33.191626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-68277635-200b-431c-8549-9ea23aa1d9d7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:33.192068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-68277635-200b-431c-8549-9ea23aa1d9d7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:33.334880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-68277635-200b-431c-8549-9ea23aa1d9d7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:33.343667 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-68277635-200b-431c-8549-9ea23aa1d9d7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.165005 Jan 22 21:34:33.344261 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4029/7758] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:33 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:33.362113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d353b5f8-757f-4bfe-bf7a-0dc3e624e1a5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:34:33.363246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d353b5f8-757f-4bfe-bf7a-0dc3e624e1a5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:33.369758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d353b5f8-757f-4bfe-bf7a-0dc3e624e1a5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:33.370203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d353b5f8-757f-4bfe-bf7a-0dc3e624e1a5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:33.371884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d353b5f8-757f-4bfe-bf7a-0dc3e624e1a5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:33.371884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d353b5f8-757f-4bfe-bf7a-0dc3e624e1a5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:33.634507 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d353b5f8-757f-4bfe-bf7a-0dc3e624e1a5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.276956 Jan 22 21:34:33.635405 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3730/7759] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:34:33 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:34:33.644731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-41f7b0f4-81a0-4ea8-bdbb-85efc35c7879 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:33.645201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-41f7b0f4-81a0-4ea8-bdbb-85efc35c7879 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:33.651858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41f7b0f4-81a0-4ea8-bdbb-85efc35c7879 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:33.652326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41f7b0f4-81a0-4ea8-bdbb-85efc35c7879 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:33.653167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41f7b0f4-81a0-4ea8-bdbb-85efc35c7879 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:33.653648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41f7b0f4-81a0-4ea8-bdbb-85efc35c7879 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:33.815042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-41f7b0f4-81a0-4ea8-bdbb-85efc35c7879 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:33.823599 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-41f7b0f4-81a0-4ea8-bdbb-85efc35c7879 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1675 microversion: 2.1 time: 0.182889 Jan 22 21:34:33.824200 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4030/7760] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:33 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:34.842424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d5466ac0-2368-4fc1-8ef7-a167ec2ee60d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:34.843298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d5466ac0-2368-4fc1-8ef7-a167ec2ee60d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:34.849475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5466ac0-2368-4fc1-8ef7-a167ec2ee60d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:34.850087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5466ac0-2368-4fc1-8ef7-a167ec2ee60d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:34.851465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5466ac0-2368-4fc1-8ef7-a167ec2ee60d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:34.852215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5466ac0-2368-4fc1-8ef7-a167ec2ee60d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:34.986343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d5466ac0-2368-4fc1-8ef7-a167ec2ee60d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:34.994318 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d5466ac0-2368-4fc1-8ef7-a167ec2ee60d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1680 microversion: 2.1 time: 0.156840 Jan 22 21:34:34.994899 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3731/7761] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:34 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:36.012151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-959db779-d9a8-4f68-a354-76fb55057c44 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:36.012813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-959db779-d9a8-4f68-a354-76fb55057c44 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:36.019851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-959db779-d9a8-4f68-a354-76fb55057c44 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:36.020317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-959db779-d9a8-4f68-a354-76fb55057c44 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:36.021122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-959db779-d9a8-4f68-a354-76fb55057c44 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:36.021647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-959db779-d9a8-4f68-a354-76fb55057c44 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:36.153113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-959db779-d9a8-4f68-a354-76fb55057c44 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:36.161125 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-959db779-d9a8-4f68-a354-76fb55057c44 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.152743 Jan 22 21:34:36.161671 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4031/7762] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:36 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:36.177697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-32aa6abe-a29b-48a3-935a-fbf3cd5664c5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:34:36.179539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-32aa6abe-a29b-48a3-935a-fbf3cd5664c5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:36.186645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32aa6abe-a29b-48a3-935a-fbf3cd5664c5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:36.187082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32aa6abe-a29b-48a3-935a-fbf3cd5664c5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:36.188203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32aa6abe-a29b-48a3-935a-fbf3cd5664c5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:36.188655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32aa6abe-a29b-48a3-935a-fbf3cd5664c5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:36.236072 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-32aa6abe-a29b-48a3-935a-fbf3cd5664c5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 324 microversion: 2.1 time: 0.062185 Jan 22 21:34:36.236685 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3732/7763] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:34:36 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 324 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:34:36.246581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d7c52a3-f982-4171-9ea3-bdc737f24f85 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:36.247195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d7c52a3-f982-4171-9ea3-bdc737f24f85 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:36.253363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d7c52a3-f982-4171-9ea3-bdc737f24f85 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:36.253925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d7c52a3-f982-4171-9ea3-bdc737f24f85 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:36.254731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d7c52a3-f982-4171-9ea3-bdc737f24f85 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:36.255213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d7c52a3-f982-4171-9ea3-bdc737f24f85 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:36.398575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5d7c52a3-f982-4171-9ea3-bdc737f24f85 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:36.411125 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d7c52a3-f982-4171-9ea3-bdc737f24f85 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.163740 Jan 22 21:34:36.411125 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4032/7764] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:36 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:36.437038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-27381232-1e84-4b18-9c15-6775c9da0701 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:36.442795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-27381232-1e84-4b18-9c15-6775c9da0701 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:36.450010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27381232-1e84-4b18-9c15-6775c9da0701 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:36.450469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27381232-1e84-4b18-9c15-6775c9da0701 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:36.451345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27381232-1e84-4b18-9c15-6775c9da0701 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:36.451723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27381232-1e84-4b18-9c15-6775c9da0701 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:36.590017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-27381232-1e84-4b18-9c15-6775c9da0701 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:36.597563 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-27381232-1e84-4b18-9c15-6775c9da0701 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.164534 Jan 22 21:34:36.609558 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3733/7765] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:36 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:36.701762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1705249098", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "e64f360b-3907-4876-bfd1-47cd0201d17f"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:34:36.753693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] validate_networks() for [('e64f360b-3907-4876-bfd1-47cd0201d17f', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:34:37.167473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:34:37.168026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:34:37.168389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:34:37.168853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:34:37.169278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:34:37.179601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:37.180050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:37.180890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:37.181357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:37.198226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Getting quotas for project d8242a159f044587a7f8bb2eef2c9914. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:34:37.203309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Getting quotas for user 8ace63d7c59243d5abda14fbabd0fbed and project d8242a159f044587a7f8bb2eef2c9914. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:34:37.216269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:34:37.218629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:34:37.368832 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2005b4a5-ef34-4319-a636-32d18fea871e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.670801 Jan 22 21:34:37.369809 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4033/7766] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:34:36 2022] POST /compute/v2.1/servers => generated 382 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:34:37.380175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff4e9655-be1b-43f7-8300-90b49814b1dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:37.380936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ff4e9655-be1b-43f7-8300-90b49814b1dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:37.447887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ff4e9655-be1b-43f7-8300-90b49814b1dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:37.455703 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff4e9655-be1b-43f7-8300-90b49814b1dd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1219 microversion: 2.1 time: 0.079250 Jan 22 21:34:37.455917 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3734/7767] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:37 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:38.473934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-de5fbe24-430c-4ad6-9cc7-1a714157507b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:38.474550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-de5fbe24-430c-4ad6-9cc7-1a714157507b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:38.482103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5fbe24-430c-4ad6-9cc7-1a714157507b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:38.482564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5fbe24-430c-4ad6-9cc7-1a714157507b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:38.483361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5fbe24-430c-4ad6-9cc7-1a714157507b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:38.483877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5fbe24-430c-4ad6-9cc7-1a714157507b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:38.546573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-de5fbe24-430c-4ad6-9cc7-1a714157507b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:38.554415 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-de5fbe24-430c-4ad6-9cc7-1a714157507b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1223 microversion: 2.1 time: 0.084223 Jan 22 21:34:38.555000 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4034/7768] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:38 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:39.572034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-59673fb7-fe4c-470d-ac0c-ed5deb4ae28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:39.573281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-59673fb7-fe4c-470d-ac0c-ed5deb4ae28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:39.580172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59673fb7-fe4c-470d-ac0c-ed5deb4ae28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:39.580635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59673fb7-fe4c-470d-ac0c-ed5deb4ae28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:39.581478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59673fb7-fe4c-470d-ac0c-ed5deb4ae28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:39.582113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59673fb7-fe4c-470d-ac0c-ed5deb4ae28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:39.648480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-59673fb7-fe4c-470d-ac0c-ed5deb4ae28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:39.656002 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-59673fb7-fe4c-470d-ac0c-ed5deb4ae28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1279 microversion: 2.1 time: 0.088336 Jan 22 21:34:39.656582 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3735/7769] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:39 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1279 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:40.673344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6fe62e94-6aa1-4e10-8019-7aefaefd9998 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:40.673988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6fe62e94-6aa1-4e10-8019-7aefaefd9998 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:40.681091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6fe62e94-6aa1-4e10-8019-7aefaefd9998 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:40.681564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6fe62e94-6aa1-4e10-8019-7aefaefd9998 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:40.684253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6fe62e94-6aa1-4e10-8019-7aefaefd9998 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:40.684253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6fe62e94-6aa1-4e10-8019-7aefaefd9998 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:40.829729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6fe62e94-6aa1-4e10-8019-7aefaefd9998 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:40.837461 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6fe62e94-6aa1-4e10-8019-7aefaefd9998 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1319 microversion: 2.1 time: 0.168544 Jan 22 21:34:40.838223 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4035/7770] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:40 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:41.423603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-cb87351c-b8de-4a25-af0d-6666c2e34a78 req-af4a28cc-e28f-4271-bb8e-c006cc79542f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c40d759-a058-4e85-9c50-c2a4cc2f479d", "tag": "7bdd3932-b51d-4ed6-8c48-744e1d3a26eb"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:34:41.425985 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:34:41.425985 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:34:41.436061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-cb87351c-b8de-4a25-af0d-6666c2e34a78 req-af4a28cc-e28f-4271-bb8e-c006cc79542f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:41.436510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-cb87351c-b8de-4a25-af0d-6666c2e34a78 req-af4a28cc-e28f-4271-bb8e-c006cc79542f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:41.720147 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-cb87351c-b8de-4a25-af0d-6666c2e34a78 req-af4a28cc-e28f-4271-bb8e-c006cc79542f service nova] Creating event network-changed:7bdd3932-b51d-4ed6-8c48-744e1d3a26eb for instance 3c40d759-a058-4e85-9c50-c2a4cc2f479d on nch1-master-1 Jan 22 21:34:41.724998 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-cb87351c-b8de-4a25-af0d-6666c2e34a78 req-af4a28cc-e28f-4271-bb8e-c006cc79542f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.305278 Jan 22 21:34:41.725682 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3736/7771] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:34:41.855038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-06295f16-bc9f-4c7d-8499-f69154bcfbee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:41.855635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-06295f16-bc9f-4c7d-8499-f69154bcfbee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:41.863101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06295f16-bc9f-4c7d-8499-f69154bcfbee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:41.866288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06295f16-bc9f-4c7d-8499-f69154bcfbee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:41.866288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06295f16-bc9f-4c7d-8499-f69154bcfbee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:41.866288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-06295f16-bc9f-4c7d-8499-f69154bcfbee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:42.009234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-06295f16-bc9f-4c7d-8499-f69154bcfbee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:42.016641 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-06295f16-bc9f-4c7d-8499-f69154bcfbee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1319 microversion: 2.1 time: 0.165432 Jan 22 21:34:42.017216 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4036/7772] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:41 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:43.035057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cb33d47a-0525-423c-aeb7-b11df3175029 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:43.035753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cb33d47a-0525-423c-aeb7-b11df3175029 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:43.042062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb33d47a-0525-423c-aeb7-b11df3175029 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:43.042522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb33d47a-0525-423c-aeb7-b11df3175029 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:43.043305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb33d47a-0525-423c-aeb7-b11df3175029 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:43.043746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cb33d47a-0525-423c-aeb7-b11df3175029 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:43.182214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cb33d47a-0525-423c-aeb7-b11df3175029 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:43.190255 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cb33d47a-0525-423c-aeb7-b11df3175029 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1319 microversion: 2.1 time: 0.160307 Jan 22 21:34:43.190922 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3737/7773] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:43 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:44.206766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e9fc69ac-64df-4115-96bf-f5c6aed735fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:44.207382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e9fc69ac-64df-4115-96bf-f5c6aed735fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:44.214900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9fc69ac-64df-4115-96bf-f5c6aed735fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:44.215361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9fc69ac-64df-4115-96bf-f5c6aed735fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:44.216160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9fc69ac-64df-4115-96bf-f5c6aed735fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:44.216610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9fc69ac-64df-4115-96bf-f5c6aed735fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:44.349546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e9fc69ac-64df-4115-96bf-f5c6aed735fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:44.357258 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e9fc69ac-64df-4115-96bf-f5c6aed735fd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1319 microversion: 2.1 time: 0.154282 Jan 22 21:34:44.357879 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4037/7774] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:44 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:45.374685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0f92a131-bb48-492b-93d0-95cea0b09751 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:45.375321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0f92a131-bb48-492b-93d0-95cea0b09751 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:45.382275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f92a131-bb48-492b-93d0-95cea0b09751 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:45.382722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f92a131-bb48-492b-93d0-95cea0b09751 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:45.383502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f92a131-bb48-492b-93d0-95cea0b09751 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:45.383940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f92a131-bb48-492b-93d0-95cea0b09751 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:45.519166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0f92a131-bb48-492b-93d0-95cea0b09751 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:45.526877 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0f92a131-bb48-492b-93d0-95cea0b09751 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1319 microversion: 2.1 time: 0.155948 Jan 22 21:34:45.527430 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3738/7775] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:45 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:46.544146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d1149f67-2617-409d-bb2b-553d0a10b07b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:46.544767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d1149f67-2617-409d-bb2b-553d0a10b07b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:46.552305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1149f67-2617-409d-bb2b-553d0a10b07b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:46.552771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1149f67-2617-409d-bb2b-553d0a10b07b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:46.555017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1149f67-2617-409d-bb2b-553d0a10b07b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:46.555496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1149f67-2617-409d-bb2b-553d0a10b07b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:46.707135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d1149f67-2617-409d-bb2b-553d0a10b07b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:46.714792 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d1149f67-2617-409d-bb2b-553d0a10b07b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1319 microversion: 2.1 time: 0.174483 Jan 22 21:34:46.724312 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4038/7776] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:46 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:46.826993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-9b52218e-2e57-4a1a-8013-40d111d6a561 req-4c04a0f4-20e8-4856-b1e8-70b4a5739f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c40d759-a058-4e85-9c50-c2a4cc2f479d", "name": "network-vif-plugged", "status": "completed", "tag": "7bdd3932-b51d-4ed6-8c48-744e1d3a26eb"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:34:46.828576 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:34:46.828576 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:34:46.836735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9b52218e-2e57-4a1a-8013-40d111d6a561 req-4c04a0f4-20e8-4856-b1e8-70b4a5739f93 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:46.837645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9b52218e-2e57-4a1a-8013-40d111d6a561 req-4c04a0f4-20e8-4856-b1e8-70b4a5739f93 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:46.848477 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-9b52218e-2e57-4a1a-8013-40d111d6a561 req-4c04a0f4-20e8-4856-b1e8-70b4a5739f93 service nova] Creating event network-vif-plugged:7bdd3932-b51d-4ed6-8c48-744e1d3a26eb for instance 3c40d759-a058-4e85-9c50-c2a4cc2f479d on nch1-master-1 Jan 22 21:34:46.854267 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-9b52218e-2e57-4a1a-8013-40d111d6a561 req-4c04a0f4-20e8-4856-b1e8-70b4a5739f93 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030835 Jan 22 21:34:46.854848 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3739/7777] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:34:47.732436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8194af62-8624-4e4d-b501-3b7a9edab284 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:47.733111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8194af62-8624-4e4d-b501-3b7a9edab284 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:47.740261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8194af62-8624-4e4d-b501-3b7a9edab284 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:47.740733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8194af62-8624-4e4d-b501-3b7a9edab284 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:47.742422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8194af62-8624-4e4d-b501-3b7a9edab284 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:47.742880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8194af62-8624-4e4d-b501-3b7a9edab284 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:47.880828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8194af62-8624-4e4d-b501-3b7a9edab284 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:47.888856 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8194af62-8624-4e4d-b501-3b7a9edab284 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1319 microversion: 2.1 time: 0.160111 Jan 22 21:34:47.890327 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4039/7778] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:47 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:48.906704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e8344cfc-9049-4034-82f8-481889a22ec7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:48.907395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e8344cfc-9049-4034-82f8-481889a22ec7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:48.914586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8344cfc-9049-4034-82f8-481889a22ec7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:48.915049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8344cfc-9049-4034-82f8-481889a22ec7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:48.915826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8344cfc-9049-4034-82f8-481889a22ec7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:48.916261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8344cfc-9049-4034-82f8-481889a22ec7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:49.057312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e8344cfc-9049-4034-82f8-481889a22ec7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:49.064989 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e8344cfc-9049-4034-82f8-481889a22ec7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1506 microversion: 2.1 time: 0.163145 Jan 22 21:34:49.065595 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3740/7779] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:48 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:49.085840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-380ccb14-2454-432f-a5f9-dd3d50479768 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:34:49.092700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-380ccb14-2454-432f-a5f9-dd3d50479768 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:49.093160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-380ccb14-2454-432f-a5f9-dd3d50479768 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:49.118700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-380ccb14-2454-432f-a5f9-dd3d50479768 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Going to try to stop instance {{(pid=137032) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 22 21:34:49.322000 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-380ccb14-2454-432f-a5f9-dd3d50479768 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d/action" status: 202 len: 0 microversion: 2.1 time: 0.240160 Jan 22 21:34:49.322616 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4040/7780] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:34:49 2022] POST /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:34:49.330805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e79bd613-e8a6-4afe-96f5-eafb3286da5a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:49.331475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e79bd613-e8a6-4afe-96f5-eafb3286da5a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:49.338264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e79bd613-e8a6-4afe-96f5-eafb3286da5a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:49.338728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e79bd613-e8a6-4afe-96f5-eafb3286da5a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:49.339567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e79bd613-e8a6-4afe-96f5-eafb3286da5a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:49.340152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e79bd613-e8a6-4afe-96f5-eafb3286da5a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:49.481333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e79bd613-e8a6-4afe-96f5-eafb3286da5a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:49.490754 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e79bd613-e8a6-4afe-96f5-eafb3286da5a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.163712 Jan 22 21:34:49.492058 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3741/7781] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:49 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:49.642833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-633905191", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "a5bc101a-fe74-4aff-ba67-9439c04f7a67"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:34:49.698127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] validate_networks() for [('a5bc101a-fe74-4aff-ba67-9439c04f7a67', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:34:50.038831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:34:50.039255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:34:50.039854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:34:50.040276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:34:50.040699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:34:50.050255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:50.050717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:50.051538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:50.051981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:50.068278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Getting quotas for project 037b801bacb742d89e5ea8f5e59ec7b4. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:34:50.073800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Getting quotas for user 912fa15040dc442fa281a72320a10dc5 and project 037b801bacb742d89e5ea8f5e59ec7b4. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:34:50.086310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:34:50.088712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:34:50.508932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4bb893a4-052c-4bd1-bc59-e2bdf7b755be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:50.509573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4bb893a4-052c-4bd1-bc59-e2bdf7b755be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:50.516410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bb893a4-052c-4bd1-bc59-e2bdf7b755be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:50.516866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bb893a4-052c-4bd1-bc59-e2bdf7b755be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:50.517678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bb893a4-052c-4bd1-bc59-e2bdf7b755be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:50.518123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bb893a4-052c-4bd1-bc59-e2bdf7b755be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:50.568988 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3a7f6556-320e-4973-a726-ea6a9dc8fdd0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.930156 Jan 22 21:34:50.575542 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4041/7782] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:34:49 2022] POST /compute/v2.1/servers => generated 382 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:34:50.580579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-463d58ec-56f1-4839-89d9-feca46bf264a tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:50.581400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-463d58ec-56f1-4839-89d9-feca46bf264a tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:50.648042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-463d58ec-56f1-4839-89d9-feca46bf264a tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:50.664014 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-463d58ec-56f1-4839-89d9-feca46bf264a tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 200 len: 1222 microversion: 2.1 time: 0.086092 Jan 22 21:34:50.664982 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4042/7783] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:50 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:50.670146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4bb893a4-052c-4bd1-bc59-e2bdf7b755be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:50.677963 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4bb893a4-052c-4bd1-bc59-e2bdf7b755be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.173130 Jan 22 21:34:50.678369 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3742/7784] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:50 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:34:51.683562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a0b03ab6-52ec-4bb0-b717-787ee23f7d40 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:51.685089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a0b03ab6-52ec-4bb0-b717-787ee23f7d40 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:51.701844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-849a5763-4e64-45bc-ba84-0904434a7894 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:51.702687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-849a5763-4e64-45bc-ba84-0904434a7894 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:51.709309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-849a5763-4e64-45bc-ba84-0904434a7894 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:51.710462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-849a5763-4e64-45bc-ba84-0904434a7894 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:51.711579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-849a5763-4e64-45bc-ba84-0904434a7894 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:51.712033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-849a5763-4e64-45bc-ba84-0904434a7894 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:51.740040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a0b03ab6-52ec-4bb0-b717-787ee23f7d40 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:51.747305 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a0b03ab6-52ec-4bb0-b717-787ee23f7d40 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 200 len: 1222 microversion: 2.1 time: 0.070519 Jan 22 21:34:51.747889 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4043/7785] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:51 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 1222 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:51.848651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-849a5763-4e64-45bc-ba84-0904434a7894 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:51.857981 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-849a5763-4e64-45bc-ba84-0904434a7894 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.159809 Jan 22 21:34:51.858896 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3743/7786] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:51 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:52.763635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2aa83209-9408-4e52-b626-63508da437ac tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:52.764250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2aa83209-9408-4e52-b626-63508da437ac tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:52.771817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aa83209-9408-4e52-b626-63508da437ac tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:52.772274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aa83209-9408-4e52-b626-63508da437ac tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:52.773384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aa83209-9408-4e52-b626-63508da437ac tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:52.773856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aa83209-9408-4e52-b626-63508da437ac tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:52.838557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2aa83209-9408-4e52-b626-63508da437ac tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:52.846179 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2aa83209-9408-4e52-b626-63508da437ac tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 200 len: 1274 microversion: 2.1 time: 0.086322 Jan 22 21:34:52.846772 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4044/7787] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:52 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:52.875985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d270ebd1-5100-43a7-a588-85e4d660643d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:52.876754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d270ebd1-5100-43a7-a588-85e4d660643d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:52.884719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d270ebd1-5100-43a7-a588-85e4d660643d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:52.885186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d270ebd1-5100-43a7-a588-85e4d660643d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:52.887921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d270ebd1-5100-43a7-a588-85e4d660643d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:52.887921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d270ebd1-5100-43a7-a588-85e4d660643d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:53.024887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d270ebd1-5100-43a7-a588-85e4d660643d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:53.032391 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d270ebd1-5100-43a7-a588-85e4d660643d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.160093 Jan 22 21:34:53.032971 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3744/7788] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:52 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:53.863517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4f215da8-589f-4b45-82fd-7e5c7846332c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:53.864690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4f215da8-589f-4b45-82fd-7e5c7846332c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:53.872375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f215da8-589f-4b45-82fd-7e5c7846332c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:53.872837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f215da8-589f-4b45-82fd-7e5c7846332c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:53.873677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f215da8-589f-4b45-82fd-7e5c7846332c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:53.874121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f215da8-589f-4b45-82fd-7e5c7846332c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:54.050550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a8c4f886-e154-4ad3-afef-5078c92528c8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:54.051169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a8c4f886-e154-4ad3-afef-5078c92528c8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:54.059292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8c4f886-e154-4ad3-afef-5078c92528c8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:54.059831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8c4f886-e154-4ad3-afef-5078c92528c8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:54.060896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8c4f886-e154-4ad3-afef-5078c92528c8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:54.061593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8c4f886-e154-4ad3-afef-5078c92528c8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:54.138133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4f215da8-589f-4b45-82fd-7e5c7846332c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:54.146883 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4f215da8-589f-4b45-82fd-7e5c7846332c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 200 len: 1322 microversion: 2.1 time: 0.286905 Jan 22 21:34:54.147748 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4045/7789] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:53 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:54.211628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a8c4f886-e154-4ad3-afef-5078c92528c8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:54.220165 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a8c4f886-e154-4ad3-afef-5078c92528c8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.173463 Jan 22 21:34:54.220873 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3745/7790] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:54 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:34:54.761637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-e3fc6f1d-ad40-4f57-98de-8591b6e4efd1 req-61ee8021-d0e2-4ad1-a914-dbba65fbc145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90aa83ca-8144-449e-ae33-a366d769df91", "tag": "e9a74340-d924-46bd-93b1-bc6946610c2a"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:34:54.763205 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:34:54.763205 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:34:54.770511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e3fc6f1d-ad40-4f57-98de-8591b6e4efd1 req-61ee8021-d0e2-4ad1-a914-dbba65fbc145 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:54.770965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e3fc6f1d-ad40-4f57-98de-8591b6e4efd1 req-61ee8021-d0e2-4ad1-a914-dbba65fbc145 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:54.785624 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-e3fc6f1d-ad40-4f57-98de-8591b6e4efd1 req-61ee8021-d0e2-4ad1-a914-dbba65fbc145 service nova] Creating event network-changed:e9a74340-d924-46bd-93b1-bc6946610c2a for instance 90aa83ca-8144-449e-ae33-a366d769df91 on nch2-master-1 Jan 22 21:34:54.790769 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-e3fc6f1d-ad40-4f57-98de-8591b6e4efd1 req-61ee8021-d0e2-4ad1-a914-dbba65fbc145 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173476 Jan 22 21:34:54.796428 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4046/7791] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:34:55.165810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96868f7f-d162-4a67-8137-bd6a746bd360 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:55.166456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96868f7f-d162-4a67-8137-bd6a746bd360 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:55.173535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96868f7f-d162-4a67-8137-bd6a746bd360 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:55.174009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96868f7f-d162-4a67-8137-bd6a746bd360 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:55.174817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96868f7f-d162-4a67-8137-bd6a746bd360 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:55.175263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96868f7f-d162-4a67-8137-bd6a746bd360 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:55.239016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-37dace42-2bbf-4333-ba44-9a126874990f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:55.240351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-37dace42-2bbf-4333-ba44-9a126874990f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:55.250551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37dace42-2bbf-4333-ba44-9a126874990f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:55.251014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37dace42-2bbf-4333-ba44-9a126874990f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:55.251816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37dace42-2bbf-4333-ba44-9a126874990f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:55.252455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37dace42-2bbf-4333-ba44-9a126874990f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:55.341576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-96868f7f-d162-4a67-8137-bd6a746bd360 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:55.349184 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96868f7f-d162-4a67-8137-bd6a746bd360 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 200 len: 1322 microversion: 2.1 time: 0.187454 Jan 22 21:34:55.349884 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3746/7792] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:55 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:55.497266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-37dace42-2bbf-4333-ba44-9a126874990f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:55.504825 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-37dace42-2bbf-4333-ba44-9a126874990f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.271014 Jan 22 21:34:55.505401 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4047/7793] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:55 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:56.365589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-79614f85-53e4-47dd-a744-43a539514c89 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:56.366340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-79614f85-53e4-47dd-a744-43a539514c89 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:56.373285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79614f85-53e4-47dd-a744-43a539514c89 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:56.373775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79614f85-53e4-47dd-a744-43a539514c89 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:56.374582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79614f85-53e4-47dd-a744-43a539514c89 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:56.375036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79614f85-53e4-47dd-a744-43a539514c89 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:56.511562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-79614f85-53e4-47dd-a744-43a539514c89 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:56.519704 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-79614f85-53e4-47dd-a744-43a539514c89 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 200 len: 1322 microversion: 2.1 time: 0.157794 Jan 22 21:34:56.524591 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3747/7794] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:56 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:56.524845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c7c8049e-741e-47c6-b4e2-6a9d2eb8ee7e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:56.524845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c7c8049e-741e-47c6-b4e2-6a9d2eb8ee7e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:56.530496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7c8049e-741e-47c6-b4e2-6a9d2eb8ee7e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:56.530940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7c8049e-741e-47c6-b4e2-6a9d2eb8ee7e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:56.531748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7c8049e-741e-47c6-b4e2-6a9d2eb8ee7e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:56.532188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7c8049e-741e-47c6-b4e2-6a9d2eb8ee7e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:56.791566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c7c8049e-741e-47c6-b4e2-6a9d2eb8ee7e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:56.799061 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c7c8049e-741e-47c6-b4e2-6a9d2eb8ee7e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.280821 Jan 22 21:34:56.799638 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4048/7795] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:56 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:34:57.539543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-18390d35-acec-43c7-90ee-fca3cf281d6e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:57.540199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-18390d35-acec-43c7-90ee-fca3cf281d6e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:57.546950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18390d35-acec-43c7-90ee-fca3cf281d6e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:57.547414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18390d35-acec-43c7-90ee-fca3cf281d6e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:57.548937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18390d35-acec-43c7-90ee-fca3cf281d6e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:57.548937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-18390d35-acec-43c7-90ee-fca3cf281d6e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:57.684038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-18390d35-acec-43c7-90ee-fca3cf281d6e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:57.691509 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-18390d35-acec-43c7-90ee-fca3cf281d6e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 200 len: 1322 microversion: 2.1 time: 0.155697 Jan 22 21:34:57.692078 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3748/7796] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:57 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:57.816578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-80f53818-7b25-4888-ab20-6bd83b60b4d2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:57.817307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-80f53818-7b25-4888-ab20-6bd83b60b4d2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:57.825060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80f53818-7b25-4888-ab20-6bd83b60b4d2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:57.825522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80f53818-7b25-4888-ab20-6bd83b60b4d2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:57.826336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80f53818-7b25-4888-ab20-6bd83b60b4d2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:57.826775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80f53818-7b25-4888-ab20-6bd83b60b4d2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:57.956854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-80f53818-7b25-4888-ab20-6bd83b60b4d2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:57.965016 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-80f53818-7b25-4888-ab20-6bd83b60b4d2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.152218 Jan 22 21:34:57.965616 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4049/7797] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:57 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:58.708079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2eaa6011-d089-4a14-b57d-c92ee83517b6 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:58.708698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2eaa6011-d089-4a14-b57d-c92ee83517b6 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:58.716852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eaa6011-d089-4a14-b57d-c92ee83517b6 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:58.717317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eaa6011-d089-4a14-b57d-c92ee83517b6 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:58.718164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eaa6011-d089-4a14-b57d-c92ee83517b6 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:58.718619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2eaa6011-d089-4a14-b57d-c92ee83517b6 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:58.865399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2eaa6011-d089-4a14-b57d-c92ee83517b6 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:58.873572 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2eaa6011-d089-4a14-b57d-c92ee83517b6 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 200 len: 1322 microversion: 2.1 time: 0.169099 Jan 22 21:34:58.874039 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3749/7798] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:58 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:58.981934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ccd1a66e-5208-4b7c-a72e-e49757b7591c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:58.982532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ccd1a66e-5208-4b7c-a72e-e49757b7591c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:58.989437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccd1a66e-5208-4b7c-a72e-e49757b7591c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:58.989930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccd1a66e-5208-4b7c-a72e-e49757b7591c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:58.990777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccd1a66e-5208-4b7c-a72e-e49757b7591c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:58.991898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccd1a66e-5208-4b7c-a72e-e49757b7591c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:59.137146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ccd1a66e-5208-4b7c-a72e-e49757b7591c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:34:59.144585 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ccd1a66e-5208-4b7c-a72e-e49757b7591c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.166408 Jan 22 21:34:59.145194 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4050/7799] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:58 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:34:59.890631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d7eaae2e-d029-44ea-b527-4156cac94662 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:34:59.891301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d7eaae2e-d029-44ea-b527-4156cac94662 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:34:59.898373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7eaae2e-d029-44ea-b527-4156cac94662 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:59.901387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7eaae2e-d029-44ea-b527-4156cac94662 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:34:59.901387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7eaae2e-d029-44ea-b527-4156cac94662 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:34:59.901387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d7eaae2e-d029-44ea-b527-4156cac94662 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:00.034458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d7eaae2e-d029-44ea-b527-4156cac94662 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:00.043016 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d7eaae2e-d029-44ea-b527-4156cac94662 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 200 len: 1322 microversion: 2.1 time: 0.156129 Jan 22 21:35:00.043593 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3750/7800] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:34:59 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:00.162521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-39c29699-f803-4ac1-b236-e38a6537a6d1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:00.163201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-39c29699-f803-4ac1-b236-e38a6537a6d1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:00.171043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39c29699-f803-4ac1-b236-e38a6537a6d1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:00.178669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39c29699-f803-4ac1-b236-e38a6537a6d1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:00.178669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39c29699-f803-4ac1-b236-e38a6537a6d1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:00.178669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39c29699-f803-4ac1-b236-e38a6537a6d1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:00.313803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-39c29699-f803-4ac1-b236-e38a6537a6d1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:00.322151 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-39c29699-f803-4ac1-b236-e38a6537a6d1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.163547 Jan 22 21:35:00.322738 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4051/7801] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:00 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:00.893493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-5f71342f-75e2-4069-9708-f653a27a9956 req-c80692b7-ff8f-4ed4-ae60-09e1bcfe8fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90aa83ca-8144-449e-ae33-a366d769df91", "name": "network-vif-plugged", "status": "completed", "tag": "e9a74340-d924-46bd-93b1-bc6946610c2a"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:00.895099 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:35:00.895099 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:35:00.904994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5f71342f-75e2-4069-9708-f653a27a9956 req-c80692b7-ff8f-4ed4-ae60-09e1bcfe8fbe service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:00.905327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5f71342f-75e2-4069-9708-f653a27a9956 req-c80692b7-ff8f-4ed4-ae60-09e1bcfe8fbe service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:00.919214 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-5f71342f-75e2-4069-9708-f653a27a9956 req-c80692b7-ff8f-4ed4-ae60-09e1bcfe8fbe service nova] Creating event network-vif-plugged:e9a74340-d924-46bd-93b1-bc6946610c2a for instance 90aa83ca-8144-449e-ae33-a366d769df91 on nch2-master-1 Jan 22 21:35:00.924335 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-5f71342f-75e2-4069-9708-f653a27a9956 req-c80692b7-ff8f-4ed4-ae60-09e1bcfe8fbe service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034392 Jan 22 21:35:00.924989 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3751/7802] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:35:01.060036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-482eaabf-ab3e-4b8a-b85a-755382fd47ca tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:01.063838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-482eaabf-ab3e-4b8a-b85a-755382fd47ca tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:01.069399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-482eaabf-ab3e-4b8a-b85a-755382fd47ca tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:01.069893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-482eaabf-ab3e-4b8a-b85a-755382fd47ca tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:01.074701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-482eaabf-ab3e-4b8a-b85a-755382fd47ca tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:01.075228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-482eaabf-ab3e-4b8a-b85a-755382fd47ca tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:01.218441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-482eaabf-ab3e-4b8a-b85a-755382fd47ca tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:01.226226 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-482eaabf-ab3e-4b8a-b85a-755382fd47ca tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 200 len: 1322 microversion: 2.1 time: 0.170414 Jan 22 21:35:01.230970 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4052/7803] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:01 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:01.341331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f9058bb7-3a37-40bf-9fc1-53911c349a01 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:01.342064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f9058bb7-3a37-40bf-9fc1-53911c349a01 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:01.349594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f9058bb7-3a37-40bf-9fc1-53911c349a01 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:01.350122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f9058bb7-3a37-40bf-9fc1-53911c349a01 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:01.351110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f9058bb7-3a37-40bf-9fc1-53911c349a01 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:01.352160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f9058bb7-3a37-40bf-9fc1-53911c349a01 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:01.521028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f9058bb7-3a37-40bf-9fc1-53911c349a01 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:01.531141 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f9058bb7-3a37-40bf-9fc1-53911c349a01 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.195190 Jan 22 21:35:01.531828 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3752/7804] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:01 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:02.247880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-86f3f9ba-6229-4a31-9b75-ee9401982d83 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:02.248501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-86f3f9ba-6229-4a31-9b75-ee9401982d83 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:02.255481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86f3f9ba-6229-4a31-9b75-ee9401982d83 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:02.255939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86f3f9ba-6229-4a31-9b75-ee9401982d83 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:02.256739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86f3f9ba-6229-4a31-9b75-ee9401982d83 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:02.257195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-86f3f9ba-6229-4a31-9b75-ee9401982d83 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:02.395312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-86f3f9ba-6229-4a31-9b75-ee9401982d83 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:02.402898 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-86f3f9ba-6229-4a31-9b75-ee9401982d83 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 200 len: 1322 microversion: 2.1 time: 0.159256 Jan 22 21:35:02.403478 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4053/7805] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:02 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:02.556925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-99006c67-18b0-41be-83c9-92faa13d78b1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:02.557458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-99006c67-18b0-41be-83c9-92faa13d78b1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:02.580413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99006c67-18b0-41be-83c9-92faa13d78b1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:02.580886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99006c67-18b0-41be-83c9-92faa13d78b1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:02.581706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99006c67-18b0-41be-83c9-92faa13d78b1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:02.582151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-99006c67-18b0-41be-83c9-92faa13d78b1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:02.723818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-99006c67-18b0-41be-83c9-92faa13d78b1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:02.738892 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-99006c67-18b0-41be-83c9-92faa13d78b1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.185702 Jan 22 21:35:02.746124 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3753/7806] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:02 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:03.420452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e00673c-592b-4dfc-825b-f069fc2041c8 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:03.421098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e00673c-592b-4dfc-825b-f069fc2041c8 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:03.427577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e00673c-592b-4dfc-825b-f069fc2041c8 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:03.428028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e00673c-592b-4dfc-825b-f069fc2041c8 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:03.428814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e00673c-592b-4dfc-825b-f069fc2041c8 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:03.429258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e00673c-592b-4dfc-825b-f069fc2041c8 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:03.565198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5e00673c-592b-4dfc-825b-f069fc2041c8 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:03.575690 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e00673c-592b-4dfc-825b-f069fc2041c8 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 200 len: 1511 microversion: 2.1 time: 0.158930 Jan 22 21:35:03.576277 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4054/7807] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:03 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:03.755556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-49a76654-513b-4be1-84fb-dbe0adf27e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:03.756269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-49a76654-513b-4be1-84fb-dbe0adf27e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:03.763557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49a76654-513b-4be1-84fb-dbe0adf27e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:03.764126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49a76654-513b-4be1-84fb-dbe0adf27e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:03.764956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49a76654-513b-4be1-84fb-dbe0adf27e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:03.765402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49a76654-513b-4be1-84fb-dbe0adf27e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:03.902139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-49a76654-513b-4be1-84fb-dbe0adf27e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:03.910053 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-49a76654-513b-4be1-84fb-dbe0adf27e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.158249 Jan 22 21:35:03.910623 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3754/7808] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:03 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:04.927486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-549d557b-d121-4ff9-a78a-ad7c9d965941 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:04.928016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-549d557b-d121-4ff9-a78a-ad7c9d965941 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:04.935768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-549d557b-d121-4ff9-a78a-ad7c9d965941 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:04.936220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-549d557b-d121-4ff9-a78a-ad7c9d965941 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:04.937005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-549d557b-d121-4ff9-a78a-ad7c9d965941 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:04.937441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-549d557b-d121-4ff9-a78a-ad7c9d965941 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:05.069463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-549d557b-d121-4ff9-a78a-ad7c9d965941 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:05.077123 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-549d557b-d121-4ff9-a78a-ad7c9d965941 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.153571 Jan 22 21:35:05.077732 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4055/7809] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:04 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:06.094397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dbf85d2f-1586-49ad-94f3-97ec44f50a39 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:06.095011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dbf85d2f-1586-49ad-94f3-97ec44f50a39 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:06.102008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbf85d2f-1586-49ad-94f3-97ec44f50a39 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:06.102513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbf85d2f-1586-49ad-94f3-97ec44f50a39 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:06.104034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbf85d2f-1586-49ad-94f3-97ec44f50a39 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:06.104034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dbf85d2f-1586-49ad-94f3-97ec44f50a39 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:06.431751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dbf85d2f-1586-49ad-94f3-97ec44f50a39 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:06.439221 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dbf85d2f-1586-49ad-94f3-97ec44f50a39 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.348790 Jan 22 21:35:06.441637 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3755/7810] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:06 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:07.456058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb0398b6-1214-488f-a7b2-3ac07a772159 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:07.456666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fb0398b6-1214-488f-a7b2-3ac07a772159 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:07.464285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb0398b6-1214-488f-a7b2-3ac07a772159 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:07.464788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb0398b6-1214-488f-a7b2-3ac07a772159 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:07.465618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb0398b6-1214-488f-a7b2-3ac07a772159 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:07.466053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb0398b6-1214-488f-a7b2-3ac07a772159 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:07.598387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fb0398b6-1214-488f-a7b2-3ac07a772159 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:07.606064 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fb0398b6-1214-488f-a7b2-3ac07a772159 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.153696 Jan 22 21:35:07.606638 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4056/7811] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:07 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:08.623554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6df6c764-3775-497b-b05f-bcf5f465cbfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:08.624297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6df6c764-3775-497b-b05f-bcf5f465cbfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:08.631280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6df6c764-3775-497b-b05f-bcf5f465cbfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:08.635842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6df6c764-3775-497b-b05f-bcf5f465cbfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:08.635842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6df6c764-3775-497b-b05f-bcf5f465cbfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:08.635842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6df6c764-3775-497b-b05f-bcf5f465cbfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:08.766570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6df6c764-3775-497b-b05f-bcf5f465cbfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:08.774047 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6df6c764-3775-497b-b05f-bcf5f465cbfd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.154191 Jan 22 21:35:08.774753 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3756/7812] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:08 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:09.792137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5ef19be3-4284-4f55-8f73-ad12e5b0c23a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:09.792748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5ef19be3-4284-4f55-8f73-ad12e5b0c23a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:09.799630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ef19be3-4284-4f55-8f73-ad12e5b0c23a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:09.800095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ef19be3-4284-4f55-8f73-ad12e5b0c23a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:09.800888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ef19be3-4284-4f55-8f73-ad12e5b0c23a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:09.801339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ef19be3-4284-4f55-8f73-ad12e5b0c23a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:09.957149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5ef19be3-4284-4f55-8f73-ad12e5b0c23a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:09.965666 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5ef19be3-4284-4f55-8f73-ad12e5b0c23a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.177733 Jan 22 21:35:09.966856 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4057/7813] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:09 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:10.541035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b0814234-940a-4e3d-abb5-cf5e2ffcc149 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b", "device": "/dev/sdb"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:10.542279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b0814234-940a-4e3d-abb5-cf5e2ffcc149 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:10.548816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0814234-940a-4e3d-abb5-cf5e2ffcc149 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:10.557222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0814234-940a-4e3d-abb5-cf5e2ffcc149 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:10.557222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0814234-940a-4e3d-abb5-cf5e2ffcc149 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:10.557222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0814234-940a-4e3d-abb5-cf5e2ffcc149 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:10.983563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cc196af1-ec13-4fe0-9744-02e424b73c7a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:10.984087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cc196af1-ec13-4fe0-9744-02e424b73c7a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:10.990775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc196af1-ec13-4fe0-9744-02e424b73c7a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:10.991463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc196af1-ec13-4fe0-9744-02e424b73c7a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:10.992250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc196af1-ec13-4fe0-9744-02e424b73c7a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:10.992689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc196af1-ec13-4fe0-9744-02e424b73c7a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:11.123711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cc196af1-ec13-4fe0-9744-02e424b73c7a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:11.131142 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cc196af1-ec13-4fe0-9744-02e424b73c7a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.151445 Jan 22 21:35:11.131708 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4058/7814] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:10 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:35:11.368117 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b0814234-940a-4e3d-abb5-cf5e2ffcc149 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "POST /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.830899 Jan 22 21:35:11.368731 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3757/7815] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:35:10 2022] POST /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91/os-volume_attachments => generated 194 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:35:12.148634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-34210933-cd3e-4acf-9c13-bc29f15ec921 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:12.149426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-34210933-cd3e-4acf-9c13-bc29f15ec921 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:12.156634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34210933-cd3e-4acf-9c13-bc29f15ec921 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:12.157186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34210933-cd3e-4acf-9c13-bc29f15ec921 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:12.158079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34210933-cd3e-4acf-9c13-bc29f15ec921 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:12.158859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34210933-cd3e-4acf-9c13-bc29f15ec921 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:12.395407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-34210933-cd3e-4acf-9c13-bc29f15ec921 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:12.411132 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-34210933-cd3e-4acf-9c13-bc29f15ec921 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.265950 Jan 22 21:35:12.411814 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4059/7816] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:12 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:13.433389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-378feb2f-b1ea-46c3-9aca-db5850ed583b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:13.435377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-378feb2f-b1ea-46c3-9aca-db5850ed583b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:13.442170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-378feb2f-b1ea-46c3-9aca-db5850ed583b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:13.443057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-378feb2f-b1ea-46c3-9aca-db5850ed583b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:13.443549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-378feb2f-b1ea-46c3-9aca-db5850ed583b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:13.444242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-378feb2f-b1ea-46c3-9aca-db5850ed583b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:13.581549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-378feb2f-b1ea-46c3-9aca-db5850ed583b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:13.589832 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-378feb2f-b1ea-46c3-9aca-db5850ed583b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.162768 Jan 22 21:35:13.590396 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3758/7817] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:13 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:14.607465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5a87ddfa-14ed-479e-a0d4-36f1d4109302 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:14.608076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5a87ddfa-14ed-479e-a0d4-36f1d4109302 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:14.614947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a87ddfa-14ed-479e-a0d4-36f1d4109302 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:14.615404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a87ddfa-14ed-479e-a0d4-36f1d4109302 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:14.616209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a87ddfa-14ed-479e-a0d4-36f1d4109302 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:14.616650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a87ddfa-14ed-479e-a0d4-36f1d4109302 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:14.753257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5a87ddfa-14ed-479e-a0d4-36f1d4109302 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:14.762192 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5a87ddfa-14ed-479e-a0d4-36f1d4109302 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.158877 Jan 22 21:35:14.771776 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4060/7818] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:14 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:15.779295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fc40d081-7a0b-4704-9a26-ed527b3fa2ca tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:15.779921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fc40d081-7a0b-4704-9a26-ed527b3fa2ca tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:15.787127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc40d081-7a0b-4704-9a26-ed527b3fa2ca tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:15.787588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc40d081-7a0b-4704-9a26-ed527b3fa2ca tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:15.788406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc40d081-7a0b-4704-9a26-ed527b3fa2ca tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:15.788849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc40d081-7a0b-4704-9a26-ed527b3fa2ca tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:15.930438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fc40d081-7a0b-4704-9a26-ed527b3fa2ca tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:15.938393 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fc40d081-7a0b-4704-9a26-ed527b3fa2ca tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.163535 Jan 22 21:35:15.938950 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3759/7819] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:15 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:16.965068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e755610e-aacc-4f59-8ee4-eab31215ccac tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:16.966421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e755610e-aacc-4f59-8ee4-eab31215ccac tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:16.972778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e755610e-aacc-4f59-8ee4-eab31215ccac tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:16.973245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e755610e-aacc-4f59-8ee4-eab31215ccac tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:16.974080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e755610e-aacc-4f59-8ee4-eab31215ccac tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:16.974533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e755610e-aacc-4f59-8ee4-eab31215ccac tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:17.107566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e755610e-aacc-4f59-8ee4-eab31215ccac tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:17.116096 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e755610e-aacc-4f59-8ee4-eab31215ccac tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.155579 Jan 22 21:35:17.116675 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4061/7820] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:16 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:18.133783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2a2f66c9-a916-4cf4-851b-9fdab5466de9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:18.134452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2a2f66c9-a916-4cf4-851b-9fdab5466de9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:18.143777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a2f66c9-a916-4cf4-851b-9fdab5466de9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:18.144298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a2f66c9-a916-4cf4-851b-9fdab5466de9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:18.145134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a2f66c9-a916-4cf4-851b-9fdab5466de9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:18.145628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a2f66c9-a916-4cf4-851b-9fdab5466de9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:18.292787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2a2f66c9-a916-4cf4-851b-9fdab5466de9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:18.301115 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2a2f66c9-a916-4cf4-851b-9fdab5466de9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.171164 Jan 22 21:35:18.301735 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3760/7821] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:18 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:19.318315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d1d66a82-b370-4500-bfd3-6625b01b024c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:19.318934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d1d66a82-b370-4500-bfd3-6625b01b024c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:19.325822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1d66a82-b370-4500-bfd3-6625b01b024c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:19.326286 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1d66a82-b370-4500-bfd3-6625b01b024c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:19.327077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1d66a82-b370-4500-bfd3-6625b01b024c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:19.327521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1d66a82-b370-4500-bfd3-6625b01b024c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:19.466857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d1d66a82-b370-4500-bfd3-6625b01b024c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:19.474270 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d1d66a82-b370-4500-bfd3-6625b01b024c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1516 microversion: 2.1 time: 0.159603 Jan 22 21:35:19.474842 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4062/7822] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:19 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:20.492067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d43eb6fc-f3ff-4849-9bcb-1e053d9b697c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:20.493250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d43eb6fc-f3ff-4849-9bcb-1e053d9b697c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:20.501982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d43eb6fc-f3ff-4849-9bcb-1e053d9b697c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:20.502448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d43eb6fc-f3ff-4849-9bcb-1e053d9b697c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:20.503261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d43eb6fc-f3ff-4849-9bcb-1e053d9b697c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:20.503712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d43eb6fc-f3ff-4849-9bcb-1e053d9b697c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:20.638710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d43eb6fc-f3ff-4849-9bcb-1e053d9b697c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:20.646475 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d43eb6fc-f3ff-4849-9bcb-1e053d9b697c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1493 microversion: 2.1 time: 0.158263 Jan 22 21:35:20.647379 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3761/7823] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:20 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1493 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:20.671340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1235db64-5bbf-46c5-a16e-1f96bf9761be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:20.672354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1235db64-5bbf-46c5-a16e-1f96bf9761be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:20.679095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1235db64-5bbf-46c5-a16e-1f96bf9761be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:20.679551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1235db64-5bbf-46c5-a16e-1f96bf9761be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:20.680336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1235db64-5bbf-46c5-a16e-1f96bf9761be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:20.680773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1235db64-5bbf-46c5-a16e-1f96bf9761be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:20.731151 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1235db64-5bbf-46c5-a16e-1f96bf9761be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 200 len: 152 microversion: 2.1 time: 0.065363 Jan 22 21:35:20.731711 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4063/7824] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:20 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 152 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:35:20.746564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fbce7f37-e2d3-4e4c-8500-010c6f4df594 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:20.747207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fbce7f37-e2d3-4e4c-8500-010c6f4df594 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:20.753236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbce7f37-e2d3-4e4c-8500-010c6f4df594 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:20.753753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbce7f37-e2d3-4e4c-8500-010c6f4df594 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:20.754539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbce7f37-e2d3-4e4c-8500-010c6f4df594 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:20.754987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fbce7f37-e2d3-4e4c-8500-010c6f4df594 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:20.904229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fbce7f37-e2d3-4e4c-8500-010c6f4df594 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:20.911973 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fbce7f37-e2d3-4e4c-8500-010c6f4df594 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.169652 Jan 22 21:35:20.912544 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3762/7825] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:20 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:20.942123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d6e65f48-578a-4e24-89bd-527bd6eb01a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:20.943482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d6e65f48-578a-4e24-89bd-527bd6eb01a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:20.958690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6e65f48-578a-4e24-89bd-527bd6eb01a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:20.958690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6e65f48-578a-4e24-89bd-527bd6eb01a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:20.958690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6e65f48-578a-4e24-89bd-527bd6eb01a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:20.958690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6e65f48-578a-4e24-89bd-527bd6eb01a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:21.086613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d6e65f48-578a-4e24-89bd-527bd6eb01a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:21.094892 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d6e65f48-578a-4e24-89bd-527bd6eb01a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.156786 Jan 22 21:35:21.095462 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4064/7826] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:20 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:35:21.198431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2064704129", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "e64f360b-3907-4876-bfd1-47cd0201d17f"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:21.252359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] validate_networks() for [('e64f360b-3907-4876-bfd1-47cd0201d17f', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:35:21.692556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:35:21.693129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:35:21.693659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:35:21.694143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:35:21.694572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:35:21.704621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:21.707860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:21.707860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:21.707860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:21.724023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Getting quotas for project d8242a159f044587a7f8bb2eef2c9914. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:35:21.730971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Getting quotas for user 8ace63d7c59243d5abda14fbabd0fbed and project d8242a159f044587a7f8bb2eef2c9914. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:35:21.741847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:35:21.744895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:35:21.903482 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-88b112f5-973a-4246-8c31-fb04894586b2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.709253 Jan 22 21:35:21.904444 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3763/7827] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:35:21 2022] POST /compute/v2.1/servers => generated 382 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:35:21.919341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f19e21e6-dcc1-4413-87b1-c3a3c029deaf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:21.919963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f19e21e6-dcc1-4413-87b1-c3a3c029deaf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:21.974908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f19e21e6-dcc1-4413-87b1-c3a3c029deaf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:21.993010 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f19e21e6-dcc1-4413-87b1-c3a3c029deaf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 200 len: 1219 microversion: 2.1 time: 0.078312 Jan 22 21:35:21.993626 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4065/7828] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:21 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:35:23.018693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5a1c1820-9fd5-415c-8c2d-7e2e3f0e06eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:23.019474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5a1c1820-9fd5-415c-8c2d-7e2e3f0e06eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:23.025814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a1c1820-9fd5-415c-8c2d-7e2e3f0e06eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:23.026293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a1c1820-9fd5-415c-8c2d-7e2e3f0e06eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:23.027120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a1c1820-9fd5-415c-8c2d-7e2e3f0e06eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:23.027655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a1c1820-9fd5-415c-8c2d-7e2e3f0e06eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:23.090705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5a1c1820-9fd5-415c-8c2d-7e2e3f0e06eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:23.098380 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5a1c1820-9fd5-415c-8c2d-7e2e3f0e06eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 200 len: 1223 microversion: 2.1 time: 0.084946 Jan 22 21:35:23.098994 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3764/7829] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:23 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:24.115906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f48da1ff-258f-4fab-8e12-d840ffc1aa36 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:24.116520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f48da1ff-258f-4fab-8e12-d840ffc1aa36 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:24.124369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f48da1ff-258f-4fab-8e12-d840ffc1aa36 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:24.125234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f48da1ff-258f-4fab-8e12-d840ffc1aa36 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:24.127640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f48da1ff-258f-4fab-8e12-d840ffc1aa36 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:24.127640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f48da1ff-258f-4fab-8e12-d840ffc1aa36 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:24.218498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f48da1ff-258f-4fab-8e12-d840ffc1aa36 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:24.222958 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f48da1ff-258f-4fab-8e12-d840ffc1aa36 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 200 len: 1279 microversion: 2.1 time: 0.110912 Jan 22 21:35:24.234182 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4066/7830] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:24 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 1279 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:25.253719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ec5fc6b4-e8c2-4d6e-80c6-57bb5315cda6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:25.254446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ec5fc6b4-e8c2-4d6e-80c6-57bb5315cda6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:25.261707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec5fc6b4-e8c2-4d6e-80c6-57bb5315cda6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:25.262262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec5fc6b4-e8c2-4d6e-80c6-57bb5315cda6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:25.263147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec5fc6b4-e8c2-4d6e-80c6-57bb5315cda6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:25.263813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec5fc6b4-e8c2-4d6e-80c6-57bb5315cda6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:25.472559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ec5fc6b4-e8c2-4d6e-80c6-57bb5315cda6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:25.478800 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ec5fc6b4-e8c2-4d6e-80c6-57bb5315cda6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 200 len: 1319 microversion: 2.1 time: 0.228783 Jan 22 21:35:25.479689 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3765/7831] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:25 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:25.899977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-2fb157b8-14ed-4af8-bc61-50350a76a605 req-bbf4a986-4001-46ea-a841-6f9ab8cb9663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4adbe6f8-1238-4ff9-bfba-add7c7cc36e5", "tag": "45a9dd8f-2604-4abd-afce-af33d0f4b7a5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:25.904105 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:35:25.904105 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:35:25.913418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2fb157b8-14ed-4af8-bc61-50350a76a605 req-bbf4a986-4001-46ea-a841-6f9ab8cb9663 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:25.913891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2fb157b8-14ed-4af8-bc61-50350a76a605 req-bbf4a986-4001-46ea-a841-6f9ab8cb9663 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:25.926129 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-2fb157b8-14ed-4af8-bc61-50350a76a605 req-bbf4a986-4001-46ea-a841-6f9ab8cb9663 service nova] Creating event network-changed:45a9dd8f-2604-4abd-afce-af33d0f4b7a5 for instance 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 on nch1-master-1 Jan 22 21:35:25.931198 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-2fb157b8-14ed-4af8-bc61-50350a76a605 req-bbf4a986-4001-46ea-a841-6f9ab8cb9663 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035063 Jan 22 21:35:25.932419 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4067/7832] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:35:26.496770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d1f31613-bac1-4aea-8988-962eb26eec9e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:26.499574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d1f31613-bac1-4aea-8988-962eb26eec9e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:26.504235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1f31613-bac1-4aea-8988-962eb26eec9e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:26.504698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1f31613-bac1-4aea-8988-962eb26eec9e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:26.505510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1f31613-bac1-4aea-8988-962eb26eec9e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:26.505966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1f31613-bac1-4aea-8988-962eb26eec9e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:26.734927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d1f31613-bac1-4aea-8988-962eb26eec9e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:26.744963 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d1f31613-bac1-4aea-8988-962eb26eec9e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 200 len: 1319 microversion: 2.1 time: 0.252182 Jan 22 21:35:26.759351 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3766/7833] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:26 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:27.772888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dc62a80c-f16d-46a7-b06e-a8324e3d73e4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:27.773519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dc62a80c-f16d-46a7-b06e-a8324e3d73e4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:27.780254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc62a80c-f16d-46a7-b06e-a8324e3d73e4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:27.780722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc62a80c-f16d-46a7-b06e-a8324e3d73e4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:27.781533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc62a80c-f16d-46a7-b06e-a8324e3d73e4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:27.781981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dc62a80c-f16d-46a7-b06e-a8324e3d73e4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:27.924379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dc62a80c-f16d-46a7-b06e-a8324e3d73e4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:27.933448 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dc62a80c-f16d-46a7-b06e-a8324e3d73e4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 200 len: 1319 microversion: 2.1 time: 0.165383 Jan 22 21:35:27.934281 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4068/7834] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:27 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:28.950609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8c68b88b-048c-490b-beae-37054be2e7e7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:28.951783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8c68b88b-048c-490b-beae-37054be2e7e7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:28.958899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c68b88b-048c-490b-beae-37054be2e7e7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:28.959367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c68b88b-048c-490b-beae-37054be2e7e7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:28.960194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c68b88b-048c-490b-beae-37054be2e7e7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:28.960647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8c68b88b-048c-490b-beae-37054be2e7e7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:29.096728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8c68b88b-048c-490b-beae-37054be2e7e7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:29.104621 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8c68b88b-048c-490b-beae-37054be2e7e7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 200 len: 1319 microversion: 2.1 time: 0.157923 Jan 22 21:35:29.105201 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3767/7835] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:28 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:30.187855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-289c39f0-7fae-43ce-85da-ddac02c503e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:30.188512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-289c39f0-7fae-43ce-85da-ddac02c503e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:30.194755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-289c39f0-7fae-43ce-85da-ddac02c503e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:30.195457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-289c39f0-7fae-43ce-85da-ddac02c503e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:30.197094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-289c39f0-7fae-43ce-85da-ddac02c503e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:30.197609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-289c39f0-7fae-43ce-85da-ddac02c503e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:30.335599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-289c39f0-7fae-43ce-85da-ddac02c503e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:30.343591 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-289c39f0-7fae-43ce-85da-ddac02c503e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 200 len: 1319 microversion: 2.1 time: 0.226278 Jan 22 21:35:30.344162 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4069/7836] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:30 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:31.360110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-247a1ad6-277c-44a7-8b9f-2ac5e53c5ae0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:31.360826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-247a1ad6-277c-44a7-8b9f-2ac5e53c5ae0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:31.367755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-247a1ad6-277c-44a7-8b9f-2ac5e53c5ae0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:31.368295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-247a1ad6-277c-44a7-8b9f-2ac5e53c5ae0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:31.369146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-247a1ad6-277c-44a7-8b9f-2ac5e53c5ae0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:31.369623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-247a1ad6-277c-44a7-8b9f-2ac5e53c5ae0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:31.505376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-247a1ad6-277c-44a7-8b9f-2ac5e53c5ae0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:31.513161 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-247a1ad6-277c-44a7-8b9f-2ac5e53c5ae0 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 200 len: 1319 microversion: 2.1 time: 0.156688 Jan 22 21:35:31.513999 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3768/7837] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:31 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:32.530521 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9cfe4455-447e-421e-993d-97d84037b02d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:32.531178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9cfe4455-447e-421e-993d-97d84037b02d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:32.538345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cfe4455-447e-421e-993d-97d84037b02d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:32.538808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cfe4455-447e-421e-993d-97d84037b02d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:32.539621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cfe4455-447e-421e-993d-97d84037b02d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:32.540070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cfe4455-447e-421e-993d-97d84037b02d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:32.675998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9cfe4455-447e-421e-993d-97d84037b02d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:32.683308 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9cfe4455-447e-421e-993d-97d84037b02d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 200 len: 1319 microversion: 2.1 time: 0.156848 Jan 22 21:35:32.685958 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4070/7838] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:32 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:32.961876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-56fce0fc-5c46-4ba5-abee-241a627dfc1e req-c1bb8e13-9ec1-4e30-bf83-3e252975daae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adbe6f8-1238-4ff9-bfba-add7c7cc36e5", "name": "network-vif-plugged", "status": "completed", "tag": "45a9dd8f-2604-4abd-afce-af33d0f4b7a5"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:32.964619 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:35:32.964619 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:35:32.974802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-56fce0fc-5c46-4ba5-abee-241a627dfc1e req-c1bb8e13-9ec1-4e30-bf83-3e252975daae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:32.975366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-56fce0fc-5c46-4ba5-abee-241a627dfc1e req-c1bb8e13-9ec1-4e30-bf83-3e252975daae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:32.990362 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-56fce0fc-5c46-4ba5-abee-241a627dfc1e req-c1bb8e13-9ec1-4e30-bf83-3e252975daae service nova] Creating event network-vif-plugged:45a9dd8f-2604-4abd-afce-af33d0f4b7a5 for instance 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 on nch1-master-1 Jan 22 21:35:32.999251 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-56fce0fc-5c46-4ba5-abee-241a627dfc1e req-c1bb8e13-9ec1-4e30-bf83-3e252975daae service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041507 Jan 22 21:35:33.000118 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3769/7839] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:35:33.700152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f01c9ab9-3f89-47fc-bdd2-d7bf14d0350c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:33.701517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f01c9ab9-3f89-47fc-bdd2-d7bf14d0350c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:33.708043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f01c9ab9-3f89-47fc-bdd2-d7bf14d0350c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:33.708502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f01c9ab9-3f89-47fc-bdd2-d7bf14d0350c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:33.709330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f01c9ab9-3f89-47fc-bdd2-d7bf14d0350c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:33.709819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f01c9ab9-3f89-47fc-bdd2-d7bf14d0350c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:33.841271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f01c9ab9-3f89-47fc-bdd2-d7bf14d0350c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:33.849418 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f01c9ab9-3f89-47fc-bdd2-d7bf14d0350c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 200 len: 1319 microversion: 2.1 time: 0.153086 Jan 22 21:35:33.850020 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4071/7840] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:33 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:34.867541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c15a677f-be55-489b-ae6e-e952ad2164ad tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:34.868249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c15a677f-be55-489b-ae6e-e952ad2164ad tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:34.874586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c15a677f-be55-489b-ae6e-e952ad2164ad tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:34.875687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c15a677f-be55-489b-ae6e-e952ad2164ad tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:34.876480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c15a677f-be55-489b-ae6e-e952ad2164ad tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:34.876928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c15a677f-be55-489b-ae6e-e952ad2164ad tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:35.016678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c15a677f-be55-489b-ae6e-e952ad2164ad tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:35.030351 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c15a677f-be55-489b-ae6e-e952ad2164ad tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 200 len: 1505 microversion: 2.1 time: 0.162093 Jan 22 21:35:35.030351 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3770/7841] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:34 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:35.044797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-63db8fd8-71e0-4cfe-8403-e4ded7122558 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:35.045819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-63db8fd8-71e0-4cfe-8403-e4ded7122558 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:35.055698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63db8fd8-71e0-4cfe-8403-e4ded7122558 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:35.056165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63db8fd8-71e0-4cfe-8403-e4ded7122558 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:35.056982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63db8fd8-71e0-4cfe-8403-e4ded7122558 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:35.057427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-63db8fd8-71e0-4cfe-8403-e4ded7122558 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:35.099069 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-63db8fd8-71e0-4cfe-8403-e4ded7122558 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action" status: 200 len: 14 microversion: 2.1 time: 0.057768 Jan 22 21:35:35.099688 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4072/7842] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:35 2022] POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:35:36.118019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3940a9eb-3b6c-4a25-837c-df48d787f422 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:36.118019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3940a9eb-3b6c-4a25-837c-df48d787f422 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:36.118596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3940a9eb-3b6c-4a25-837c-df48d787f422 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:36.118734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3940a9eb-3b6c-4a25-837c-df48d787f422 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:36.119529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3940a9eb-3b6c-4a25-837c-df48d787f422 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:36.120059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3940a9eb-3b6c-4a25-837c-df48d787f422 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:36.162102 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3940a9eb-3b6c-4a25-837c-df48d787f422 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action" status: 200 len: 14 microversion: 2.1 time: 0.055576 Jan 22 21:35:36.162746 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3771/7843] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:36 2022] POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:35:37.172900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b35f649d-caeb-4b35-9b96-39eb3386e827 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:37.173935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b35f649d-caeb-4b35-9b96-39eb3386e827 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:37.181205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b35f649d-caeb-4b35-9b96-39eb3386e827 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:37.183930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b35f649d-caeb-4b35-9b96-39eb3386e827 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:37.183930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b35f649d-caeb-4b35-9b96-39eb3386e827 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:37.183930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b35f649d-caeb-4b35-9b96-39eb3386e827 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:37.222204 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b35f649d-caeb-4b35-9b96-39eb3386e827 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action" status: 200 len: 14 microversion: 2.1 time: 0.053202 Jan 22 21:35:37.222848 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4073/7844] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:37 2022] POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:35:38.233904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-27dfdb6a-b0b3-479c-9e85-73673d8295f6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:38.234916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-27dfdb6a-b0b3-479c-9e85-73673d8295f6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:38.242901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27dfdb6a-b0b3-479c-9e85-73673d8295f6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:38.243368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27dfdb6a-b0b3-479c-9e85-73673d8295f6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:38.244839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27dfdb6a-b0b3-479c-9e85-73673d8295f6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:38.244839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27dfdb6a-b0b3-479c-9e85-73673d8295f6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:38.284619 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-27dfdb6a-b0b3-479c-9e85-73673d8295f6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action" status: 200 len: 14 microversion: 2.1 time: 0.054603 Jan 22 21:35:38.285272 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3772/7845] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:38 2022] POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:35:39.295853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6d118e41-c2d8-4d7d-8b82-42fde5b0cffe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:39.296885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6d118e41-c2d8-4d7d-8b82-42fde5b0cffe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:39.304402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d118e41-c2d8-4d7d-8b82-42fde5b0cffe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:39.304867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d118e41-c2d8-4d7d-8b82-42fde5b0cffe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:39.305737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d118e41-c2d8-4d7d-8b82-42fde5b0cffe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:39.306190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d118e41-c2d8-4d7d-8b82-42fde5b0cffe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:39.342737 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6d118e41-c2d8-4d7d-8b82-42fde5b0cffe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action" status: 200 len: 14 microversion: 2.1 time: 0.050808 Jan 22 21:35:39.343267 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4074/7846] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:39 2022] POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:35:40.355322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b15adb0a-bef0-4361-ac17-648c4856af8a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:40.356353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b15adb0a-bef0-4361-ac17-648c4856af8a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:40.370570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b15adb0a-bef0-4361-ac17-648c4856af8a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:40.371022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b15adb0a-bef0-4361-ac17-648c4856af8a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:40.371816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b15adb0a-bef0-4361-ac17-648c4856af8a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:40.372280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b15adb0a-bef0-4361-ac17-648c4856af8a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:40.411319 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b15adb0a-bef0-4361-ac17-648c4856af8a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action" status: 200 len: 14 microversion: 2.1 time: 0.060237 Jan 22 21:35:40.411940 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3773/7847] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:40 2022] POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:35:41.422150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f56f334-77ca-461b-8e29-68b7d482cda8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:41.423669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f56f334-77ca-461b-8e29-68b7d482cda8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:41.432808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f56f334-77ca-461b-8e29-68b7d482cda8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:41.433486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f56f334-77ca-461b-8e29-68b7d482cda8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:41.434362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f56f334-77ca-461b-8e29-68b7d482cda8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:41.434804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f56f334-77ca-461b-8e29-68b7d482cda8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:41.474562 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f56f334-77ca-461b-8e29-68b7d482cda8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action" status: 200 len: 14 microversion: 2.1 time: 0.056348 Jan 22 21:35:41.475531 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4075/7848] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:41 2022] POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:35:42.486760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b50f32e-1dda-4763-8cca-02b3a4759bee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:42.487773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4b50f32e-1dda-4763-8cca-02b3a4759bee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:42.495179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b50f32e-1dda-4763-8cca-02b3a4759bee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:42.495645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b50f32e-1dda-4763-8cca-02b3a4759bee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:42.496557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b50f32e-1dda-4763-8cca-02b3a4759bee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:42.497000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b50f32e-1dda-4763-8cca-02b3a4759bee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:42.536401 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b50f32e-1dda-4763-8cca-02b3a4759bee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action" status: 200 len: 14 microversion: 2.1 time: 0.053950 Jan 22 21:35:42.537300 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3774/7849] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:42 2022] POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:35:43.548017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4be81249-2b83-4288-8b3d-e077c4c5ada5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:43.549019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4be81249-2b83-4288-8b3d-e077c4c5ada5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:43.557086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4be81249-2b83-4288-8b3d-e077c4c5ada5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:43.557573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4be81249-2b83-4288-8b3d-e077c4c5ada5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:43.558367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4be81249-2b83-4288-8b3d-e077c4c5ada5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:43.558816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4be81249-2b83-4288-8b3d-e077c4c5ada5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:43.598746 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4be81249-2b83-4288-8b3d-e077c4c5ada5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action" status: 200 len: 14 microversion: 2.1 time: 0.054696 Jan 22 21:35:43.599423 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4076/7850] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:43 2022] POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:35:44.610412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ae407d42-bbcd-4fbf-bc0c-3ebdf0ad3114 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:44.611423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ae407d42-bbcd-4fbf-bc0c-3ebdf0ad3114 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:44.619233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae407d42-bbcd-4fbf-bc0c-3ebdf0ad3114 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:44.619689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae407d42-bbcd-4fbf-bc0c-3ebdf0ad3114 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:44.620467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae407d42-bbcd-4fbf-bc0c-3ebdf0ad3114 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:44.620906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae407d42-bbcd-4fbf-bc0c-3ebdf0ad3114 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:44.658952 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ae407d42-bbcd-4fbf-bc0c-3ebdf0ad3114 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action" status: 200 len: 14 microversion: 2.1 time: 0.052324 Jan 22 21:35:44.659534 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3775/7851] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:44 2022] POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:35:45.669374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-667384e1-c0e2-40d6-9a14-36ea8627469b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:45.670369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-667384e1-c0e2-40d6-9a14-36ea8627469b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:45.678384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-667384e1-c0e2-40d6-9a14-36ea8627469b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:45.678812 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-667384e1-c0e2-40d6-9a14-36ea8627469b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:45.679603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-667384e1-c0e2-40d6-9a14-36ea8627469b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:45.680054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-667384e1-c0e2-40d6-9a14-36ea8627469b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:45.717729 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-667384e1-c0e2-40d6-9a14-36ea8627469b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action" status: 200 len: 14 microversion: 2.1 time: 0.052244 Jan 22 21:35:45.718357 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4077/7852] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:45 2022] POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 21:35:46.729264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1a5d1b6d-47b5-4f5c-9cc5-0d23f0606c7e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:46.730304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1a5d1b6d-47b5-4f5c-9cc5-0d23f0606c7e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:46.738510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a5d1b6d-47b5-4f5c-9cc5-0d23f0606c7e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:46.742295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a5d1b6d-47b5-4f5c-9cc5-0d23f0606c7e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:46.742295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a5d1b6d-47b5-4f5c-9cc5-0d23f0606c7e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:46.742295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a5d1b6d-47b5-4f5c-9cc5-0d23f0606c7e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:46.780849 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1a5d1b6d-47b5-4f5c-9cc5-0d23f0606c7e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action" status: 200 len: 14 microversion: 2.1 time: 0.055623 Jan 22 21:35:46.781570 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3776/7853] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:46 2022] POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 21:35:47.791994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8a75fd45-fa9c-4e99-ab8b-82a0e69832bc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:47.792980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8a75fd45-fa9c-4e99-ab8b-82a0e69832bc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:47.801000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a75fd45-fa9c-4e99-ab8b-82a0e69832bc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:47.801448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a75fd45-fa9c-4e99-ab8b-82a0e69832bc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:47.802259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a75fd45-fa9c-4e99-ab8b-82a0e69832bc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:47.806216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a75fd45-fa9c-4e99-ab8b-82a0e69832bc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:47.858635 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8a75fd45-fa9c-4e99-ab8b-82a0e69832bc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action" status: 200 len: 8207 microversion: 2.1 time: 0.070436 Jan 22 21:35:47.859498 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4078/7854] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:47 2022] POST /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5/action => generated 8207 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:47.869520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f7bed0e1-7340-4443-8f72-33a6b5937239 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:47.870319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f7bed0e1-7340-4443-8f72-33a6b5937239 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:47.878184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7bed0e1-7340-4443-8f72-33a6b5937239 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:47.878588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7bed0e1-7340-4443-8f72-33a6b5937239 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:47.879399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7bed0e1-7340-4443-8f72-33a6b5937239 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:47.879852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7bed0e1-7340-4443-8f72-33a6b5937239 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:48.012949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f7bed0e1-7340-4443-8f72-33a6b5937239 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:48.021344 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f7bed0e1-7340-4443-8f72-33a6b5937239 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.155900 Jan 22 21:35:48.021946 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3777/7855] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:47 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:48.041022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-000048ee-5c35-4aaf-85e9-729fd916c83e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:48.041745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-000048ee-5c35-4aaf-85e9-729fd916c83e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:48.048777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-000048ee-5c35-4aaf-85e9-729fd916c83e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:48.049869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-000048ee-5c35-4aaf-85e9-729fd916c83e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:48.050785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-000048ee-5c35-4aaf-85e9-729fd916c83e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:48.051238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-000048ee-5c35-4aaf-85e9-729fd916c83e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:48.201077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-000048ee-5c35-4aaf-85e9-729fd916c83e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:48.208499 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-000048ee-5c35-4aaf-85e9-729fd916c83e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.171474 Jan 22 21:35:48.209075 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4079/7856] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:48 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:48.224448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0dc56933-3304-4c90-93e3-a5162c1e1a3c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:48.225104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0dc56933-3304-4c90-93e3-a5162c1e1a3c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:48.231600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dc56933-3304-4c90-93e3-a5162c1e1a3c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:48.232061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dc56933-3304-4c90-93e3-a5162c1e1a3c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:48.232857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dc56933-3304-4c90-93e3-a5162c1e1a3c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:48.233305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dc56933-3304-4c90-93e3-a5162c1e1a3c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:48.476853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0dc56933-3304-4c90-93e3-a5162c1e1a3c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Locking {{(pid=137033) lock /opt/stack/nova/nova/compute/api.py:4624}} Jan 22 21:35:48.654439 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0dc56933-3304-4c90-93e3-a5162c1e1a3c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.433711 Jan 22 21:35:48.655116 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3778/7857] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:48 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:35:48.664103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5bb04ed9-b84f-4ecf-9f08-7102b1a219b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:48.664726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5bb04ed9-b84f-4ecf-9f08-7102b1a219b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:48.671196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bb04ed9-b84f-4ecf-9f08-7102b1a219b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:48.679196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bb04ed9-b84f-4ecf-9f08-7102b1a219b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:48.679196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bb04ed9-b84f-4ecf-9f08-7102b1a219b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:48.679196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bb04ed9-b84f-4ecf-9f08-7102b1a219b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:48.807488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5bb04ed9-b84f-4ecf-9f08-7102b1a219b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:48.815530 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5bb04ed9-b84f-4ecf-9f08-7102b1a219b7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.154511 Jan 22 21:35:48.816107 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4080/7858] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:48 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:35:48.832199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a353f628-189e-41a5-bad7-28572bc1daba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:48.838244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a353f628-189e-41a5-bad7-28572bc1daba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:48.838713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a353f628-189e-41a5-bad7-28572bc1daba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:48.861096 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-a353f628-189e-41a5-bad7-28572bc1daba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] HTTP exception thrown: Instance a0e98b30-0c8f-4544-9800-71179f1dfed0 is locked Jan 22 21:35:48.862386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a353f628-189e-41a5-bad7-28572bc1daba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Returning 409 to user: Instance a0e98b30-0c8f-4544-9800-71179f1dfed0 is locked {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:35:48.863197 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a353f628-189e-41a5-bad7-28572bc1daba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 409 len: 107 microversion: 2.1 time: 0.035487 Jan 22 21:35:48.863733 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3779/7859] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:48 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 107 bytes in 37 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:35:48.871770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d324bb75-52bd-4b16-b222-6838a198cb6a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:48.872310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d324bb75-52bd-4b16-b222-6838a198cb6a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:48.878901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d324bb75-52bd-4b16-b222-6838a198cb6a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:48.879346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d324bb75-52bd-4b16-b222-6838a198cb6a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:48.880119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d324bb75-52bd-4b16-b222-6838a198cb6a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:48.880557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d324bb75-52bd-4b16-b222-6838a198cb6a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:49.013932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d324bb75-52bd-4b16-b222-6838a198cb6a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Unlocking {{(pid=137032) unlock /opt/stack/nova/nova/compute/api.py:4653}} Jan 22 21:35:49.220698 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d324bb75-52bd-4b16-b222-6838a198cb6a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.352597 Jan 22 21:35:49.224966 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4081/7860] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:48 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:35:49.231496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0e3e340e-3a54-4195-ac82-ff1b462e0130 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:49.238005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e3e340e-3a54-4195-ac82-ff1b462e0130 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:49.238470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e3e340e-3a54-4195-ac82-ff1b462e0130 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:49.261693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0e3e340e-3a54-4195-ac82-ff1b462e0130 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Going to try to stop instance {{(pid=137033) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 22 21:35:49.514270 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0e3e340e-3a54-4195-ac82-ff1b462e0130 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.287456 Jan 22 21:35:49.514781 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3780/7861] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:35:49 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:35:49.522813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d0869273-dd7b-4a8c-8ba3-7cc06c572ade tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:49.530242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d0869273-dd7b-4a8c-8ba3-7cc06c572ade tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:49.539111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0869273-dd7b-4a8c-8ba3-7cc06c572ade tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:49.539580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0869273-dd7b-4a8c-8ba3-7cc06c572ade tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:49.540395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0869273-dd7b-4a8c-8ba3-7cc06c572ade tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:49.540844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d0869273-dd7b-4a8c-8ba3-7cc06c572ade tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:49.674828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d0869273-dd7b-4a8c-8ba3-7cc06c572ade tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:49.682404 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d0869273-dd7b-4a8c-8ba3-7cc06c572ade tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.163354 Jan 22 21:35:49.682991 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4082/7862] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:49 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:50.701097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-243ce7b5-bb3f-4554-906e-2f272238290d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:50.701831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-243ce7b5-bb3f-4554-906e-2f272238290d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:50.708448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-243ce7b5-bb3f-4554-906e-2f272238290d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:50.708916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-243ce7b5-bb3f-4554-906e-2f272238290d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:50.709881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-243ce7b5-bb3f-4554-906e-2f272238290d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:50.710301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-243ce7b5-bb3f-4554-906e-2f272238290d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:50.854711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-243ce7b5-bb3f-4554-906e-2f272238290d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:50.863551 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-243ce7b5-bb3f-4554-906e-2f272238290d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.166960 Jan 22 21:35:50.873092 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3781/7863] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:50 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:51.880154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aacced42-9d66-4daa-b109-712987f3fef8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:51.880760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aacced42-9d66-4daa-b109-712987f3fef8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:51.887642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aacced42-9d66-4daa-b109-712987f3fef8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:51.888095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aacced42-9d66-4daa-b109-712987f3fef8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:51.888879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aacced42-9d66-4daa-b109-712987f3fef8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:51.889362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aacced42-9d66-4daa-b109-712987f3fef8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:52.027722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aacced42-9d66-4daa-b109-712987f3fef8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:52.036147 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aacced42-9d66-4daa-b109-712987f3fef8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.159759 Jan 22 21:35:52.036720 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4083/7864] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:51 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:53.052617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2a939414-0ee4-4cf5-8971-801640edbfa2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:53.053261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2a939414-0ee4-4cf5-8971-801640edbfa2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:53.060108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a939414-0ee4-4cf5-8971-801640edbfa2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:53.060678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a939414-0ee4-4cf5-8971-801640edbfa2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:53.061479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a939414-0ee4-4cf5-8971-801640edbfa2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:53.061948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a939414-0ee4-4cf5-8971-801640edbfa2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:53.201863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2a939414-0ee4-4cf5-8971-801640edbfa2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:53.210122 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2a939414-0ee4-4cf5-8971-801640edbfa2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.161340 Jan 22 21:35:53.210767 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3782/7865] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:53 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:53.633949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-80ae8e10-e969-4d51-bf61-fa23f881e496 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Action: 'create', calling method: .version_select at 0x7f1ed5d4a310>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-198063508"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:35:53.647958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-80ae8e10-e969-4d51-bf61-fa23f881e496 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Getting quotas for project b4131e0a91374bb69f73358493400e27. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:35:53.653381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-80ae8e10-e969-4d51-bf61-fa23f881e496 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Getting quotas for user a97c9e9c1358436f877a28cb54cf2413 and project b4131e0a91374bb69f73358493400e27. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:35:54.065920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-80ae8e10-e969-4d51-bf61-fa23f881e496 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Getting quotas for project b4131e0a91374bb69f73358493400e27. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:35:54.070723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-80ae8e10-e969-4d51-bf61-fa23f881e496 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Getting quotas for user a97c9e9c1358436f877a28cb54cf2413 and project b4131e0a91374bb69f73358493400e27. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:35:54.085096 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-80ae8e10-e969-4d51-bf61-fa23f881e496 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.611904 Jan 22 21:35:54.085729 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4084/7866] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:35:53 2022] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:54.227271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2fb74e63-cef7-4e83-b052-53432207c095 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:54.227964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2fb74e63-cef7-4e83-b052-53432207c095 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:54.234844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fb74e63-cef7-4e83-b052-53432207c095 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:54.235374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fb74e63-cef7-4e83-b052-53432207c095 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:54.236234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fb74e63-cef7-4e83-b052-53432207c095 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:54.237264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fb74e63-cef7-4e83-b052-53432207c095 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:54.377924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2fb74e63-cef7-4e83-b052-53432207c095 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:54.391789 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2fb74e63-cef7-4e83-b052-53432207c095 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.168120 Jan 22 21:35:54.392459 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3783/7867] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:54 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:55.412544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4822b92f-1775-4552-a75e-0b78761f9d9b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:55.413242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4822b92f-1775-4552-a75e-0b78761f9d9b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:55.419445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4822b92f-1775-4552-a75e-0b78761f9d9b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:55.420418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4822b92f-1775-4552-a75e-0b78761f9d9b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:55.421230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4822b92f-1775-4552-a75e-0b78761f9d9b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:55.421717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4822b92f-1775-4552-a75e-0b78761f9d9b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:55.630849 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4822b92f-1775-4552-a75e-0b78761f9d9b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:55.638232 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4822b92f-1775-4552-a75e-0b78761f9d9b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.232055 Jan 22 21:35:55.638805 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4085/7868] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:55 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:56.655706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a966a69e-8daf-468b-8eca-6c652f8be1e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:56.656482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a966a69e-8daf-468b-8eca-6c652f8be1e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:56.663995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a966a69e-8daf-468b-8eca-6c652f8be1e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:56.664219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a966a69e-8daf-468b-8eca-6c652f8be1e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:56.665035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a966a69e-8daf-468b-8eca-6c652f8be1e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:56.665487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a966a69e-8daf-468b-8eca-6c652f8be1e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:56.806333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a966a69e-8daf-468b-8eca-6c652f8be1e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:56.814090 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a966a69e-8daf-468b-8eca-6c652f8be1e6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.162110 Jan 22 21:35:56.814801 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3784/7869] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:56 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:57.831166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7a8c4aed-41fc-4440-bd9d-b9a62adbf770 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:57.831960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7a8c4aed-41fc-4440-bd9d-b9a62adbf770 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:57.838705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a8c4aed-41fc-4440-bd9d-b9a62adbf770 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:57.839172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a8c4aed-41fc-4440-bd9d-b9a62adbf770 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:57.840005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a8c4aed-41fc-4440-bd9d-b9a62adbf770 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:57.840456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7a8c4aed-41fc-4440-bd9d-b9a62adbf770 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:57.989155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7a8c4aed-41fc-4440-bd9d-b9a62adbf770 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:57.997622 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7a8c4aed-41fc-4440-bd9d-b9a62adbf770 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.170205 Jan 22 21:35:57.998426 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4086/7870] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:57 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:35:59.015855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3e1d1564-15ef-4bd1-a727-6a80251e0b37 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:35:59.018895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3e1d1564-15ef-4bd1-a727-6a80251e0b37 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:35:59.024897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e1d1564-15ef-4bd1-a727-6a80251e0b37 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:59.025365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e1d1564-15ef-4bd1-a727-6a80251e0b37 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:59.026222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e1d1564-15ef-4bd1-a727-6a80251e0b37 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:35:59.026676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3e1d1564-15ef-4bd1-a727-6a80251e0b37 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:35:59.323363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3e1d1564-15ef-4bd1-a727-6a80251e0b37 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:35:59.336747 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3e1d1564-15ef-4bd1-a727-6a80251e0b37 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.324407 Jan 22 21:35:59.337325 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3785/7871] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:35:59 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:00.354112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-88e77f10-83d3-48e8-98fd-e229e12b0543 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:00.354729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-88e77f10-83d3-48e8-98fd-e229e12b0543 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:00.366315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88e77f10-83d3-48e8-98fd-e229e12b0543 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:00.366940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88e77f10-83d3-48e8-98fd-e229e12b0543 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:00.367651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88e77f10-83d3-48e8-98fd-e229e12b0543 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:00.368090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88e77f10-83d3-48e8-98fd-e229e12b0543 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:00.570093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-88e77f10-83d3-48e8-98fd-e229e12b0543 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:00.578832 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-88e77f10-83d3-48e8-98fd-e229e12b0543 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1660 microversion: 2.1 time: 0.228851 Jan 22 21:36:00.595578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-814be9d3-180d-42cb-a1f9-9131228e2d3a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:36:00.604244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-814be9d3-180d-42cb-a1f9-9131228e2d3a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:00.604869 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4087/7872] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:00 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1660 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:00.605601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-814be9d3-180d-42cb-a1f9-9131228e2d3a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:00.639731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-814be9d3-180d-42cb-a1f9-9131228e2d3a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Going to try to start instance {{(pid=137033) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 22 21:36:00.841554 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-814be9d3-180d-42cb-a1f9-9131228e2d3a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.249625 Jan 22 21:36:00.845669 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3786/7873] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:36:00 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:36:00.852665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3098f01a-f7b0-4796-94c1-12a9656940fb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:00.856031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3098f01a-f7b0-4796-94c1-12a9656940fb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:00.864819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3098f01a-f7b0-4796-94c1-12a9656940fb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:00.865900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3098f01a-f7b0-4796-94c1-12a9656940fb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:00.867130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3098f01a-f7b0-4796-94c1-12a9656940fb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:00.867903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3098f01a-f7b0-4796-94c1-12a9656940fb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:01.097290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3098f01a-f7b0-4796-94c1-12a9656940fb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:01.109309 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3098f01a-f7b0-4796-94c1-12a9656940fb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1669 microversion: 2.1 time: 0.260019 Jan 22 21:36:01.109309 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4088/7874] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:00 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1669 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:36:02.132347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a3ba250e-2c93-43e5-88ff-7d4a43703099 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:02.133172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a3ba250e-2c93-43e5-88ff-7d4a43703099 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:02.142086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3ba250e-2c93-43e5-88ff-7d4a43703099 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:02.142699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3ba250e-2c93-43e5-88ff-7d4a43703099 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:02.143754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3ba250e-2c93-43e5-88ff-7d4a43703099 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:02.144664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3ba250e-2c93-43e5-88ff-7d4a43703099 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:02.369917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a3ba250e-2c93-43e5-88ff-7d4a43703099 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:02.386409 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a3ba250e-2c93-43e5-88ff-7d4a43703099 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1669 microversion: 2.1 time: 0.261408 Jan 22 21:36:02.398266 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3787/7875] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:02 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1669 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:02.590490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-467411862-access_point-1559284565", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "d6e804f4-4832-4fe7-b868-7670bb3d4133"}], "key_name": "tempest-TestSecurityGroupsBasicOps-198063508", "security_groups": [{"name": "tempest-secgroup_access--1351828721"}, {"name": "tempest-secgroup_general--1462641235"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:36:02.773132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] validate_networks() for [('d6e804f4-4832-4fe7-b868-7670bb3d4133', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:36:03.407335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ec2f764b-1c65-485a-965d-44f0d8b84603 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:03.407982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ec2f764b-1c65-485a-965d-44f0d8b84603 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:03.417399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec2f764b-1c65-485a-965d-44f0d8b84603 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:03.417929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec2f764b-1c65-485a-965d-44f0d8b84603 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:03.419666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec2f764b-1c65-485a-965d-44f0d8b84603 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:03.420120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec2f764b-1c65-485a-965d-44f0d8b84603 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:03.547009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:36:03.547607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:36:03.548379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:36:03.548933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:36:03.550128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:36:03.562981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:03.563446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:03.564275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:03.565001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:03.581319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ec2f764b-1c65-485a-965d-44f0d8b84603 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:03.586830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Getting quotas for project b4131e0a91374bb69f73358493400e27. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:36:03.592600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Getting quotas for user a97c9e9c1358436f877a28cb54cf2413 and project b4131e0a91374bb69f73358493400e27. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:36:03.594802 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ec2f764b-1c65-485a-965d-44f0d8b84603 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.194323 Jan 22 21:36:03.595590 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3788/7876] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:03 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:36:03.620094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:36:03.621627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0b2c43b6-dddc-4ad3-a383-64e48a822dec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:03.622876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0b2c43b6-dddc-4ad3-a383-64e48a822dec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:03.624234 ncdv-master-1 devstack@n-api.service[137032]: WARNING nova.utils [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-467411862-access_point-1559284565 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-467411862-acc Jan 22 21:36:03.625011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:36:03.632377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b2c43b6-dddc-4ad3-a383-64e48a822dec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:03.634942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b2c43b6-dddc-4ad3-a383-64e48a822dec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:03.642127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b2c43b6-dddc-4ad3-a383-64e48a822dec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:03.642127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b2c43b6-dddc-4ad3-a383-64e48a822dec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:03.781266 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f81c1ed6-bcc7-451f-9622-40ff88e70f14 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 460 microversion: 2.1 time: 1.195305 Jan 22 21:36:03.781973 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4089/7877] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:36:02 2022] POST /compute/v2.1/servers => generated 460 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:36:03.792904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a3ad1416-5934-4873-b93e-baea3e90ef57 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:03.793957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a3ad1416-5934-4873-b93e-baea3e90ef57 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:03.842314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0b2c43b6-dddc-4ad3-a383-64e48a822dec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:03.856273 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0b2c43b6-dddc-4ad3-a383-64e48a822dec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.242489 Jan 22 21:36:03.860283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a3ad1416-5934-4873-b93e-baea3e90ef57 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:03.870389 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a3ad1416-5934-4873-b93e-baea3e90ef57 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1297 microversion: 2.1 time: 0.081120 Jan 22 21:36:03.871344 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3789/7878] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:03 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:03.876979 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4090/7879] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:03 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:03.877580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fe1209a5-0f8f-4254-9ee5-9f2f56ca6006 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:36:03.877880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fe1209a5-0f8f-4254-9ee5-9f2f56ca6006 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:03.886432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe1209a5-0f8f-4254-9ee5-9f2f56ca6006 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:03.886900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe1209a5-0f8f-4254-9ee5-9f2f56ca6006 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:03.887773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe1209a5-0f8f-4254-9ee5-9f2f56ca6006 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:03.888230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe1209a5-0f8f-4254-9ee5-9f2f56ca6006 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:04.088847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fe1209a5-0f8f-4254-9ee5-9f2f56ca6006 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Unlocking {{(pid=137033) unlock /opt/stack/nova/nova/compute/api.py:4653}} Jan 22 21:36:04.328869 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fe1209a5-0f8f-4254-9ee5-9f2f56ca6006 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.456167 Jan 22 21:36:04.339116 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3790/7880] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:36:03 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:36:04.341417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-28bb9e47-cbff-48f9-a820-1145bddafae6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:04.342375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-28bb9e47-cbff-48f9-a820-1145bddafae6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:04.350118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28bb9e47-cbff-48f9-a820-1145bddafae6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:04.350597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28bb9e47-cbff-48f9-a820-1145bddafae6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:04.351411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28bb9e47-cbff-48f9-a820-1145bddafae6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:04.351866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28bb9e47-cbff-48f9-a820-1145bddafae6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:04.527305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-28bb9e47-cbff-48f9-a820-1145bddafae6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:04.536657 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-28bb9e47-cbff-48f9-a820-1145bddafae6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.199651 Jan 22 21:36:04.537264 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4091/7881] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:04 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:36:04.553715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c7d07e93-1bde-4314-b729-875a42bee5a5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:36:04.560860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c7d07e93-1bde-4314-b729-875a42bee5a5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:04.563149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7d07e93-1bde-4314-b729-875a42bee5a5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:04.563874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7d07e93-1bde-4314-b729-875a42bee5a5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:04.565728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7d07e93-1bde-4314-b729-875a42bee5a5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:04.566298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7d07e93-1bde-4314-b729-875a42bee5a5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:04.820213 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c7d07e93-1bde-4314-b729-875a42bee5a5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.270678 Jan 22 21:36:04.821382 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3791/7882] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:36:04 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:36:04.829713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b09869bb-2a62-4177-87a5-cdf624dde59f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:04.831811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b09869bb-2a62-4177-87a5-cdf624dde59f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:04.841131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b09869bb-2a62-4177-87a5-cdf624dde59f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:04.841242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b09869bb-2a62-4177-87a5-cdf624dde59f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:04.842173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b09869bb-2a62-4177-87a5-cdf624dde59f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:04.842625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b09869bb-2a62-4177-87a5-cdf624dde59f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:04.893301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2afd8d3d-b0c9-4833-a819-03966e7656ef tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:04.894046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2afd8d3d-b0c9-4833-a819-03966e7656ef tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:04.962008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2afd8d3d-b0c9-4833-a819-03966e7656ef tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:04.969874 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2afd8d3d-b0c9-4833-a819-03966e7656ef tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1297 microversion: 2.1 time: 0.081286 Jan 22 21:36:04.970465 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3792/7883] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:04 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:36:05.017017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b09869bb-2a62-4177-87a5-cdf624dde59f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:05.025022 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b09869bb-2a62-4177-87a5-cdf624dde59f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1678 microversion: 2.1 time: 0.199304 Jan 22 21:36:05.025757 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4092/7884] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:04 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1678 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:05.990365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-42719a3d-903b-4d87-957b-adc1dce4383a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:05.990925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-42719a3d-903b-4d87-957b-adc1dce4383a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:05.998571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42719a3d-903b-4d87-957b-adc1dce4383a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:05.999037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42719a3d-903b-4d87-957b-adc1dce4383a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:06.006644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42719a3d-903b-4d87-957b-adc1dce4383a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:06.006644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-42719a3d-903b-4d87-957b-adc1dce4383a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:06.046844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3d16f814-3fcf-41ae-b900-8160b91a0794 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:06.048986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3d16f814-3fcf-41ae-b900-8160b91a0794 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:06.056555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d16f814-3fcf-41ae-b900-8160b91a0794 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:06.057026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d16f814-3fcf-41ae-b900-8160b91a0794 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:06.057852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d16f814-3fcf-41ae-b900-8160b91a0794 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:06.058393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3d16f814-3fcf-41ae-b900-8160b91a0794 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:06.068834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-42719a3d-903b-4d87-957b-adc1dce4383a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:06.078874 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-42719a3d-903b-4d87-957b-adc1dce4383a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1349 microversion: 2.1 time: 0.092966 Jan 22 21:36:06.081847 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3793/7885] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:05 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:06.259805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3d16f814-3fcf-41ae-b900-8160b91a0794 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:06.277552 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3d16f814-3fcf-41ae-b900-8160b91a0794 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1658 microversion: 2.1 time: 0.237533 Jan 22 21:36:06.278484 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4093/7886] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:06 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1658 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:36:06.297394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-87251ac9-39f9-49de-beea-526cd843a0ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:36:06.298042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-87251ac9-39f9-49de-beea-526cd843a0ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:06.304479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87251ac9-39f9-49de-beea-526cd843a0ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:06.306485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87251ac9-39f9-49de-beea-526cd843a0ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:06.306485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87251ac9-39f9-49de-beea-526cd843a0ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:06.306485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87251ac9-39f9-49de-beea-526cd843a0ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:06.584957 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-87251ac9-39f9-49de-beea-526cd843a0ed tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.292338 Jan 22 21:36:06.590317 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3794/7887] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:36:06 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:36:06.594223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-419fcb5b-0487-4f9e-85cf-a434610c6c71 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:06.595082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-419fcb5b-0487-4f9e-85cf-a434610c6c71 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:06.602065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-419fcb5b-0487-4f9e-85cf-a434610c6c71 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:06.602526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-419fcb5b-0487-4f9e-85cf-a434610c6c71 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:06.603330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-419fcb5b-0487-4f9e-85cf-a434610c6c71 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:06.603777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-419fcb5b-0487-4f9e-85cf-a434610c6c71 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:06.851683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-419fcb5b-0487-4f9e-85cf-a434610c6c71 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:06.859566 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-419fcb5b-0487-4f9e-85cf-a434610c6c71 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1665 microversion: 2.1 time: 0.269213 Jan 22 21:36:06.860363 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4094/7888] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:06 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1665 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:07.097375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-73f9d5c7-7bd9-41f1-87bf-bcd21cf22a4b tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:07.098180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-73f9d5c7-7bd9-41f1-87bf-bcd21cf22a4b tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:07.105576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73f9d5c7-7bd9-41f1-87bf-bcd21cf22a4b tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:07.106128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73f9d5c7-7bd9-41f1-87bf-bcd21cf22a4b tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:07.107017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73f9d5c7-7bd9-41f1-87bf-bcd21cf22a4b tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:07.107538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73f9d5c7-7bd9-41f1-87bf-bcd21cf22a4b tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:07.269898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-73f9d5c7-7bd9-41f1-87bf-bcd21cf22a4b tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:07.277951 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-73f9d5c7-7bd9-41f1-87bf-bcd21cf22a4b tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1475 microversion: 2.1 time: 0.185211 Jan 22 21:36:07.285392 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3795/7889] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:07 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1475 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:07.878683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a3779724-88a8-45ea-9fef-564c4542dcbe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:07.879917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a3779724-88a8-45ea-9fef-564c4542dcbe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:07.889084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3779724-88a8-45ea-9fef-564c4542dcbe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:07.891645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3779724-88a8-45ea-9fef-564c4542dcbe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:07.891645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3779724-88a8-45ea-9fef-564c4542dcbe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:07.891645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3779724-88a8-45ea-9fef-564c4542dcbe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:08.098076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a3779724-88a8-45ea-9fef-564c4542dcbe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:08.107394 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a3779724-88a8-45ea-9fef-564c4542dcbe tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.232883 Jan 22 21:36:08.114710 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4095/7890] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:07 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:08.128060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fcf48bbc-fdf3-4821-b924-27b4e788daf6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:08.128670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fcf48bbc-fdf3-4821-b924-27b4e788daf6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:08.136548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcf48bbc-fdf3-4821-b924-27b4e788daf6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:08.137111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcf48bbc-fdf3-4821-b924-27b4e788daf6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:08.138134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcf48bbc-fdf3-4821-b924-27b4e788daf6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:08.138667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcf48bbc-fdf3-4821-b924-27b4e788daf6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:08.219936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-e28677c0-e00c-41f7-b14e-7c85238ad509 req-4a774cb9-f4f0-4092-8cac-da2b54b19712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec84b62-2250-45af-a9e1-d230f191b0e6", "tag": "d07cd01c-f144-45d1-a522-aa8b451a43a9"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:36:08.225235 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:36:08.225235 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:36:08.233247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e28677c0-e00c-41f7-b14e-7c85238ad509 req-4a774cb9-f4f0-4092-8cac-da2b54b19712 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:08.233931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e28677c0-e00c-41f7-b14e-7c85238ad509 req-4a774cb9-f4f0-4092-8cac-da2b54b19712 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:08.250342 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-e28677c0-e00c-41f7-b14e-7c85238ad509 req-4a774cb9-f4f0-4092-8cac-da2b54b19712 service nova] Creating event network-changed:d07cd01c-f144-45d1-a522-aa8b451a43a9 for instance 6ec84b62-2250-45af-a9e1-d230f191b0e6 on nch2-master-1 Jan 22 21:36:08.256205 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-e28677c0-e00c-41f7-b14e-7c85238ad509 req-4a774cb9-f4f0-4092-8cac-da2b54b19712 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039959 Jan 22 21:36:08.258273 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4096/7891] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:36:08.296595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1387c459-e5c5-49b6-ae53-5bb9d649784a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:08.297462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1387c459-e5c5-49b6-ae53-5bb9d649784a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:08.304238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1387c459-e5c5-49b6-ae53-5bb9d649784a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:08.304875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1387c459-e5c5-49b6-ae53-5bb9d649784a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:08.308854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fcf48bbc-fdf3-4821-b924-27b4e788daf6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:08.317951 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fcf48bbc-fdf3-4821-b924-27b4e788daf6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.193785 Jan 22 21:36:08.318135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1387c459-e5c5-49b6-ae53-5bb9d649784a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:08.318949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1387c459-e5c5-49b6-ae53-5bb9d649784a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:08.319355 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3796/7892] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:08 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:08.337632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b065a78c-1e9d-46f8-946a-db46f081aaba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:08.338367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b065a78c-1e9d-46f8-946a-db46f081aaba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:08.345213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b065a78c-1e9d-46f8-946a-db46f081aaba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:08.345884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b065a78c-1e9d-46f8-946a-db46f081aaba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:08.348152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b065a78c-1e9d-46f8-946a-db46f081aaba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:08.348762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b065a78c-1e9d-46f8-946a-db46f081aaba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:08.527235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b065a78c-1e9d-46f8-946a-db46f081aaba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:08.539048 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b065a78c-1e9d-46f8-946a-db46f081aaba tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.205624 Jan 22 21:36:08.539639 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3797/7893] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:08 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:36:08.557457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9634f266-84f4-42cf-ab24-bd471d0a819d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:08.558105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9634f266-84f4-42cf-ab24-bd471d0a819d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:08.564655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9634f266-84f4-42cf-ab24-bd471d0a819d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:08.564881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9634f266-84f4-42cf-ab24-bd471d0a819d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:08.566336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9634f266-84f4-42cf-ab24-bd471d0a819d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:08.566790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9634f266-84f4-42cf-ab24-bd471d0a819d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:08.662148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1387c459-e5c5-49b6-ae53-5bb9d649784a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:08.674343 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1387c459-e5c5-49b6-ae53-5bb9d649784a tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1475 microversion: 2.1 time: 0.381870 Jan 22 21:36:08.675103 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4097/7894] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:08 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1475 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:36:08.703965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9634f266-84f4-42cf-ab24-bd471d0a819d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:08.712202 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9634f266-84f4-42cf-ab24-bd471d0a819d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.159142 Jan 22 21:36:08.712706 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3798/7895] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:08 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:36:09.692500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb92d737-22cc-4ee8-8a67-8b4b76d4614e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:09.693053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fb92d737-22cc-4ee8-8a67-8b4b76d4614e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:09.700117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb92d737-22cc-4ee8-8a67-8b4b76d4614e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:09.700578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb92d737-22cc-4ee8-8a67-8b4b76d4614e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:09.701365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb92d737-22cc-4ee8-8a67-8b4b76d4614e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:09.701845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb92d737-22cc-4ee8-8a67-8b4b76d4614e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:09.854255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fb92d737-22cc-4ee8-8a67-8b4b76d4614e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:09.862265 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fb92d737-22cc-4ee8-8a67-8b4b76d4614e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1475 microversion: 2.1 time: 0.173288 Jan 22 21:36:09.862969 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4098/7896] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:09 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1475 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:10.879387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7d50c954-4672-40d1-b2e5-30784e792d23 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:10.880008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7d50c954-4672-40d1-b2e5-30784e792d23 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:10.886753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d50c954-4672-40d1-b2e5-30784e792d23 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:10.887215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d50c954-4672-40d1-b2e5-30784e792d23 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:10.888014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d50c954-4672-40d1-b2e5-30784e792d23 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:10.888464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d50c954-4672-40d1-b2e5-30784e792d23 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:11.078902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7d50c954-4672-40d1-b2e5-30784e792d23 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:11.087511 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7d50c954-4672-40d1-b2e5-30784e792d23 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1475 microversion: 2.1 time: 0.211855 Jan 22 21:36:11.088015 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3799/7897] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:10 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1475 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:12.104078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-36f37b3b-9bd0-4820-b03d-ed13a8d0640f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:12.104805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-36f37b3b-9bd0-4820-b03d-ed13a8d0640f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:12.112154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36f37b3b-9bd0-4820-b03d-ed13a8d0640f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:12.112704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36f37b3b-9bd0-4820-b03d-ed13a8d0640f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:12.113494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36f37b3b-9bd0-4820-b03d-ed13a8d0640f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:12.113966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36f37b3b-9bd0-4820-b03d-ed13a8d0640f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:12.268243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-36f37b3b-9bd0-4820-b03d-ed13a8d0640f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:12.276247 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-36f37b3b-9bd0-4820-b03d-ed13a8d0640f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1475 microversion: 2.1 time: 0.175828 Jan 22 21:36:12.277136 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4099/7898] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:12 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1475 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:13.293581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8d0031c3-da44-4a4c-86a7-e2b75bb78615 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:13.294108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8d0031c3-da44-4a4c-86a7-e2b75bb78615 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:13.302651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d0031c3-da44-4a4c-86a7-e2b75bb78615 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:13.303127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d0031c3-da44-4a4c-86a7-e2b75bb78615 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:13.304126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d0031c3-da44-4a4c-86a7-e2b75bb78615 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:13.304581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d0031c3-da44-4a4c-86a7-e2b75bb78615 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:13.459073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8d0031c3-da44-4a4c-86a7-e2b75bb78615 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:13.466678 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8d0031c3-da44-4a4c-86a7-e2b75bb78615 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1475 microversion: 2.1 time: 0.177007 Jan 22 21:36:13.467447 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3800/7899] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:13 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1475 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:14.484218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1f1e2a2-e448-4f1a-9cda-ee75ff52eee4 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:14.484910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1f1e2a2-e448-4f1a-9cda-ee75ff52eee4 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:14.494945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1f1e2a2-e448-4f1a-9cda-ee75ff52eee4 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:14.495405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1f1e2a2-e448-4f1a-9cda-ee75ff52eee4 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:14.496209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1f1e2a2-e448-4f1a-9cda-ee75ff52eee4 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:14.496951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1f1e2a2-e448-4f1a-9cda-ee75ff52eee4 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:14.660904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f1f1e2a2-e448-4f1a-9cda-ee75ff52eee4 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:14.669115 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1f1e2a2-e448-4f1a-9cda-ee75ff52eee4 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1475 microversion: 2.1 time: 0.188762 Jan 22 21:36:14.669744 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4100/7900] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:14 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1475 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:15.455617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-091c2359-0bb8-4211-8e16-aa588a6ef706 req-5d22a64d-433b-4ef4-9d0e-60e8210f92d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec84b62-2250-45af-a9e1-d230f191b0e6", "name": "network-vif-plugged", "status": "completed", "tag": "d07cd01c-f144-45d1-a522-aa8b451a43a9"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:36:15.457253 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:36:15.457253 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:36:15.464102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-091c2359-0bb8-4211-8e16-aa588a6ef706 req-5d22a64d-433b-4ef4-9d0e-60e8210f92d2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:15.469406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-091c2359-0bb8-4211-8e16-aa588a6ef706 req-5d22a64d-433b-4ef4-9d0e-60e8210f92d2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:15.476610 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-091c2359-0bb8-4211-8e16-aa588a6ef706 req-5d22a64d-433b-4ef4-9d0e-60e8210f92d2 service nova] Creating event network-vif-plugged:d07cd01c-f144-45d1-a522-aa8b451a43a9 for instance 6ec84b62-2250-45af-a9e1-d230f191b0e6 on nch2-master-1 Jan 22 21:36:15.481778 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-091c2359-0bb8-4211-8e16-aa588a6ef706 req-5d22a64d-433b-4ef4-9d0e-60e8210f92d2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156812 Jan 22 21:36:15.482595 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3801/7901] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:36:15.688673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-33045505-9653-455a-af09-0274106848ba tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:15.689348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-33045505-9653-455a-af09-0274106848ba tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:15.696974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33045505-9653-455a-af09-0274106848ba tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:15.697863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33045505-9653-455a-af09-0274106848ba tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:15.698805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33045505-9653-455a-af09-0274106848ba tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:15.699550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33045505-9653-455a-af09-0274106848ba tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:15.844543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-33045505-9653-455a-af09-0274106848ba tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:15.852210 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-33045505-9653-455a-af09-0274106848ba tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1475 microversion: 2.1 time: 0.168698 Jan 22 21:36:15.852792 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4101/7902] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:15 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1475 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:16.870611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-33741345-6245-4d2c-ad52-f3cf035d10cf tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:16.871321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-33741345-6245-4d2c-ad52-f3cf035d10cf tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:16.878254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33741345-6245-4d2c-ad52-f3cf035d10cf tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:16.878729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33741345-6245-4d2c-ad52-f3cf035d10cf tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:16.879520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33741345-6245-4d2c-ad52-f3cf035d10cf tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:16.879970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33741345-6245-4d2c-ad52-f3cf035d10cf tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:17.025107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-33741345-6245-4d2c-ad52-f3cf035d10cf tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:17.034110 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-33741345-6245-4d2c-ad52-f3cf035d10cf tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1475 microversion: 2.1 time: 0.167529 Jan 22 21:36:17.034767 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3802/7903] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:16 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1475 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:18.051486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-38d37f30-b722-4904-aa6b-aadfa78f5d0d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:18.052230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-38d37f30-b722-4904-aa6b-aadfa78f5d0d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:18.059072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38d37f30-b722-4904-aa6b-aadfa78f5d0d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:18.059531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38d37f30-b722-4904-aa6b-aadfa78f5d0d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:18.060332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38d37f30-b722-4904-aa6b-aadfa78f5d0d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:18.060785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38d37f30-b722-4904-aa6b-aadfa78f5d0d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:18.201895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-38d37f30-b722-4904-aa6b-aadfa78f5d0d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:18.209558 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-38d37f30-b722-4904-aa6b-aadfa78f5d0d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1647 microversion: 2.1 time: 0.162071 Jan 22 21:36:18.210134 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4102/7904] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:18 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1647 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:18.226230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f38b2e1a-02cd-4311-83c7-2c95318f3f7d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:18.226845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f38b2e1a-02cd-4311-83c7-2c95318f3f7d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:18.233555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f38b2e1a-02cd-4311-83c7-2c95318f3f7d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:18.234133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f38b2e1a-02cd-4311-83c7-2c95318f3f7d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:18.234921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f38b2e1a-02cd-4311-83c7-2c95318f3f7d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:18.235363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f38b2e1a-02cd-4311-83c7-2c95318f3f7d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:18.378799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f38b2e1a-02cd-4311-83c7-2c95318f3f7d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:36:18.386459 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f38b2e1a-02cd-4311-83c7-2c95318f3f7d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1647 microversion: 2.1 time: 0.163888 Jan 22 21:36:18.387034 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3803/7905] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:18 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1647 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:18.402585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-73c2d574-98c0-4998-b45f-3e707bff67b6 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:36:18.403190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-73c2d574-98c0-4998-b45f-3e707bff67b6 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:36:18.409593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73c2d574-98c0-4998-b45f-3e707bff67b6 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:18.410052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73c2d574-98c0-4998-b45f-3e707bff67b6 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:18.410832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73c2d574-98c0-4998-b45f-3e707bff67b6 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:18.411273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-73c2d574-98c0-4998-b45f-3e707bff67b6 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:18.708596 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-73c2d574-98c0-4998-b45f-3e707bff67b6 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1798 microversion: 2.1 time: 0.309569 Jan 22 21:36:18.709172 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4103/7906] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:36:18 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1798 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:36:21.268932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f5bc873e-f857-457f-b2b2-c204508b2d73 req-093e80d0-826b-4950-a727-09c23072800c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec84b62-2250-45af-a9e1-d230f191b0e6", "tag": "d07cd01c-f144-45d1-a522-aa8b451a43a9"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:36:21.270745 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:36:21.270745 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:36:21.279360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f5bc873e-f857-457f-b2b2-c204508b2d73 req-093e80d0-826b-4950-a727-09c23072800c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:36:21.280668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f5bc873e-f857-457f-b2b2-c204508b2d73 req-093e80d0-826b-4950-a727-09c23072800c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:36:21.294983 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f5bc873e-f857-457f-b2b2-c204508b2d73 req-093e80d0-826b-4950-a727-09c23072800c service nova] Creating event network-changed:d07cd01c-f144-45d1-a522-aa8b451a43a9 for instance 6ec84b62-2250-45af-a9e1-d230f191b0e6 on nch2-master-1 Jan 22 21:36:21.300682 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f5bc873e-f857-457f-b2b2-c204508b2d73 req-093e80d0-826b-4950-a727-09c23072800c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100441 Jan 22 21:36:21.302572 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3804/7907] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:36:33.822128 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:36:33.822849 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 21:36:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:37:04.712396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aabc20ac-be4f-4efa-90da-7c76ff7b822d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:37:04.713381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aabc20ac-be4f-4efa-90da-7c76ff7b822d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:04.719768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aabc20ac-be4f-4efa-90da-7c76ff7b822d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:04.720586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aabc20ac-be4f-4efa-90da-7c76ff7b822d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:04.721135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aabc20ac-be4f-4efa-90da-7c76ff7b822d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:04.721611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aabc20ac-be4f-4efa-90da-7c76ff7b822d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:04.870217 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aabc20ac-be4f-4efa-90da-7c76ff7b822d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.161513 Jan 22 21:37:04.870889 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4104/7908] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:37:04 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:37:04.883126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-58323f97-4ebe-49f9-a333-6754a78c9f55 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:04.884212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-58323f97-4ebe-49f9-a333-6754a78c9f55 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:04.890729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58323f97-4ebe-49f9-a333-6754a78c9f55 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:04.891195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58323f97-4ebe-49f9-a333-6754a78c9f55 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:04.892004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58323f97-4ebe-49f9-a333-6754a78c9f55 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:04.892486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58323f97-4ebe-49f9-a333-6754a78c9f55 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:05.033280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-58323f97-4ebe-49f9-a333-6754a78c9f55 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:05.041131 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-58323f97-4ebe-49f9-a333-6754a78c9f55 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1675 microversion: 2.1 time: 0.165612 Jan 22 21:37:05.041750 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3805/7909] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:04 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:05.885585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ea387795-fbbe-471f-9c07-a6aaa8c2bc36 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:05.886167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ea387795-fbbe-471f-9c07-a6aaa8c2bc36 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:05.893301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea387795-fbbe-471f-9c07-a6aaa8c2bc36 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:05.893790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea387795-fbbe-471f-9c07-a6aaa8c2bc36 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:05.894568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea387795-fbbe-471f-9c07-a6aaa8c2bc36 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:05.895007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea387795-fbbe-471f-9c07-a6aaa8c2bc36 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:05.972762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-ea387795-fbbe-471f-9c07-a6aaa8c2bc36 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lazy-loading 'services' on Instance uuid 90aa83ca-8144-449e-ae33-a366d769df91 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:37:06.059692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a8b74457-d2d1-4c07-85b4-78483de9b66d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:06.060448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a8b74457-d2d1-4c07-85b4-78483de9b66d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:06.067259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8b74457-d2d1-4c07-85b4-78483de9b66d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:06.067728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8b74457-d2d1-4c07-85b4-78483de9b66d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:06.069252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8b74457-d2d1-4c07-85b4-78483de9b66d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:06.069943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a8b74457-d2d1-4c07-85b4-78483de9b66d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:06.176729 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ea387795-fbbe-471f-9c07-a6aaa8c2bc36 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "DELETE /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91/os-volume_attachments/03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b" status: 202 len: 0 microversion: 2.1 time: 0.295650 Jan 22 21:37:06.178627 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4105/7910] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 21:37:05 2022] DELETE /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91/os-volume_attachments/03eda9d7-c3c3-4b8d-8aa5-a1533f9ce58b => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:37:06.207332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a8b74457-d2d1-4c07-85b4-78483de9b66d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:06.215091 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a8b74457-d2d1-4c07-85b4-78483de9b66d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1680 microversion: 2.1 time: 0.159178 Jan 22 21:37:06.215733 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3806/7911] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:06 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:07.234017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-095cb034-2de8-430b-86b8-a4689c59bfbd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:07.234637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-095cb034-2de8-430b-86b8-a4689c59bfbd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:07.241002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-095cb034-2de8-430b-86b8-a4689c59bfbd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:07.241469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-095cb034-2de8-430b-86b8-a4689c59bfbd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:07.242291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-095cb034-2de8-430b-86b8-a4689c59bfbd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:07.242745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-095cb034-2de8-430b-86b8-a4689c59bfbd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:07.293181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-57a487b6-ecfa-4b24-8110-8e5b6ff58415 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:07.293774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-57a487b6-ecfa-4b24-8110-8e5b6ff58415 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:07.300286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57a487b6-ecfa-4b24-8110-8e5b6ff58415 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:07.300753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57a487b6-ecfa-4b24-8110-8e5b6ff58415 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:07.301582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57a487b6-ecfa-4b24-8110-8e5b6ff58415 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:07.302123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57a487b6-ecfa-4b24-8110-8e5b6ff58415 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:07.328730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-57a487b6-ecfa-4b24-8110-8e5b6ff58415 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:37:07.385381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-095cb034-2de8-430b-86b8-a4689c59bfbd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:07.393008 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-095cb034-2de8-430b-86b8-a4689c59bfbd tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.164067 Jan 22 21:37:07.393630 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4106/7912] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:07 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:07.568084 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-57a487b6-ecfa-4b24-8110-8e5b6ff58415 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "DELETE /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 204 len: 0 microversion: 2.1 time: 0.278413 Jan 22 21:37:07.569301 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3807/7913] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:37:07 2022] DELETE /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:37:07.577444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9c704317-6c87-49c0-80b1-ae1f306cd42f tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:07.579114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9c704317-6c87-49c0-80b1-ae1f306cd42f tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:07.584329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c704317-6c87-49c0-80b1-ae1f306cd42f tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:07.584787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c704317-6c87-49c0-80b1-ae1f306cd42f tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:07.585608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c704317-6c87-49c0-80b1-ae1f306cd42f tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:07.586056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c704317-6c87-49c0-80b1-ae1f306cd42f tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:07.721467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9c704317-6c87-49c0-80b1-ae1f306cd42f tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:07.728962 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9c704317-6c87-49c0-80b1-ae1f306cd42f tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 200 len: 1517 microversion: 2.1 time: 0.155240 Jan 22 21:37:07.729590 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4107/7914] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:07 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:08.746552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1534a209-07ac-42ab-ac03-8947def76264 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:08.747261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1534a209-07ac-42ab-ac03-8947def76264 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:08.754101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1534a209-07ac-42ab-ac03-8947def76264 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:08.754565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1534a209-07ac-42ab-ac03-8947def76264 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:08.755359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1534a209-07ac-42ab-ac03-8947def76264 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:08.756397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1534a209-07ac-42ab-ac03-8947def76264 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:08.886014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1534a209-07ac-42ab-ac03-8947def76264 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:08.893424 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1534a209-07ac-42ab-ac03-8947def76264 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 200 len: 1517 microversion: 2.1 time: 0.151034 Jan 22 21:37:08.894027 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3808/7915] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:08 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:09.811115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-18eebe17-6397-4a60-9666-3838ccbb2d9d req-23add29e-d045-4890-b870-3d8012597fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90aa83ca-8144-449e-ae33-a366d769df91", "name": "network-vif-deleted", "tag": "e9a74340-d924-46bd-93b1-bc6946610c2a"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:37:09.812522 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:37:09.812522 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:37:09.820048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-18eebe17-6397-4a60-9666-3838ccbb2d9d req-23add29e-d045-4890-b870-3d8012597fd3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:09.820489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-18eebe17-6397-4a60-9666-3838ccbb2d9d req-23add29e-d045-4890-b870-3d8012597fd3 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:09.831325 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-18eebe17-6397-4a60-9666-3838ccbb2d9d req-23add29e-d045-4890-b870-3d8012597fd3 service nova] Creating event network-vif-deleted:e9a74340-d924-46bd-93b1-bc6946610c2a for instance 90aa83ca-8144-449e-ae33-a366d769df91 on nch2-master-1 Jan 22 21:37:09.835999 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-18eebe17-6397-4a60-9666-3838ccbb2d9d req-23add29e-d045-4890-b870-3d8012597fd3 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028604 Jan 22 21:37:09.837099 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4108/7916] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:37:09.911783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2a414610-be75-4c4a-89d1-92987895eb50 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:09.912764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2a414610-be75-4c4a-89d1-92987895eb50 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:09.921607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a414610-be75-4c4a-89d1-92987895eb50 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:09.922070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a414610-be75-4c4a-89d1-92987895eb50 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:09.922874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a414610-be75-4c4a-89d1-92987895eb50 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:09.923406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a414610-be75-4c4a-89d1-92987895eb50 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:09.985336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2a414610-be75-4c4a-89d1-92987895eb50 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:09.993477 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2a414610-be75-4c4a-89d1-92987895eb50 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 200 len: 1475 microversion: 2.1 time: 0.086455 Jan 22 21:37:09.998714 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3809/7917] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:09 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 1475 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:11.011929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-013588f4-5ebe-4371-af3d-26008c251082 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:11.012660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-013588f4-5ebe-4371-af3d-26008c251082 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 90aa83ca-8144-449e-ae33-a366d769df91] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:11.018893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-013588f4-5ebe-4371-af3d-26008c251082 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:11.019350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-013588f4-5ebe-4371-af3d-26008c251082 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:11.020138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-013588f4-5ebe-4371-af3d-26008c251082 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:11.020583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-013588f4-5ebe-4371-af3d-26008c251082 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:11.034343 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-013588f4-5ebe-4371-af3d-26008c251082 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] HTTP exception thrown: Instance 90aa83ca-8144-449e-ae33-a366d769df91 could not be found. Jan 22 21:37:11.034887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-013588f4-5ebe-4371-af3d-26008c251082 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Returning 404 to user: Instance 90aa83ca-8144-449e-ae33-a366d769df91 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:37:11.035719 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-013588f4-5ebe-4371-af3d-26008c251082 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91" status: 404 len: 111 microversion: 2.1 time: 0.028845 Jan 22 21:37:11.036259 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4109/7918] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:11 2022] GET /compute/v2.1/servers/90aa83ca-8144-449e-ae33-a366d769df91 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:37:19.238077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-108344117", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "a5bc101a-fe74-4aff-ba67-9439c04f7a67"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:37:19.291032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] validate_networks() for [('a5bc101a-fe74-4aff-ba67-9439c04f7a67', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:37:19.640543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:37:19.640986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:37:19.641474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:37:19.641927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:37:19.642352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:37:19.652005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:19.652458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:19.653286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:19.653766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:19.676105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Getting quotas for project 037b801bacb742d89e5ea8f5e59ec7b4. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:37:19.681527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Getting quotas for user 912fa15040dc442fa281a72320a10dc5 and project 037b801bacb742d89e5ea8f5e59ec7b4. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:37:19.693696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:37:19.696025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:37:19.815264 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-73d3e5ac-7798-4f30-9fed-4a9898202e3c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.581111 Jan 22 21:37:19.815932 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3810/7919] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:37:19 2022] POST /compute/v2.1/servers => generated 382 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:37:19.826495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-62420ea8-4655-4efe-bbfe-09fa86043197 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:19.827110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-62420ea8-4655-4efe-bbfe-09fa86043197 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:19.882968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-62420ea8-4655-4efe-bbfe-09fa86043197 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:19.890673 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-62420ea8-4655-4efe-bbfe-09fa86043197 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 200 len: 1222 microversion: 2.1 time: 0.068741 Jan 22 21:37:19.891331 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4110/7920] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:19 2022] GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 1222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:20.908257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5143ad85-4942-4b78-9710-d72f499eb20b tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:20.908875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5143ad85-4942-4b78-9710-d72f499eb20b tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:20.916293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5143ad85-4942-4b78-9710-d72f499eb20b tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:20.916759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5143ad85-4942-4b78-9710-d72f499eb20b tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:20.917580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5143ad85-4942-4b78-9710-d72f499eb20b tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:20.918039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5143ad85-4942-4b78-9710-d72f499eb20b tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:20.982087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5143ad85-4942-4b78-9710-d72f499eb20b tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:20.989819 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5143ad85-4942-4b78-9710-d72f499eb20b tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 200 len: 1218 microversion: 2.1 time: 0.085627 Jan 22 21:37:20.990388 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3811/7921] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:20 2022] GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:22.006946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fce72922-9aae-4b84-bfe3-80a414da5498 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:22.007588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fce72922-9aae-4b84-bfe3-80a414da5498 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:22.015478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fce72922-9aae-4b84-bfe3-80a414da5498 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:22.015944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fce72922-9aae-4b84-bfe3-80a414da5498 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:22.016745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fce72922-9aae-4b84-bfe3-80a414da5498 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:22.017248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fce72922-9aae-4b84-bfe3-80a414da5498 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:22.080460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fce72922-9aae-4b84-bfe3-80a414da5498 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:22.088500 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fce72922-9aae-4b84-bfe3-80a414da5498 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 200 len: 1280 microversion: 2.1 time: 0.084712 Jan 22 21:37:22.089072 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4111/7922] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:22 2022] GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:23.101906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-46c2ced7-c0b2-4961-893d-b792c2852242 req-51c353ef-b392-4612-836a-887a81dcee7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8765ddf0-5c8c-489c-a745-ea810d02bd80", "tag": "abe33bb0-e7ed-4829-882f-a1b97d1387f4"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:37:23.103506 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:37:23.103506 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:37:23.105656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-811db6c0-981b-48c8-b5f6-c16c14b51217 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:23.108425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-811db6c0-981b-48c8-b5f6-c16c14b51217 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:23.111349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-46c2ced7-c0b2-4961-893d-b792c2852242 req-51c353ef-b392-4612-836a-887a81dcee7f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:23.111813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-46c2ced7-c0b2-4961-893d-b792c2852242 req-51c353ef-b392-4612-836a-887a81dcee7f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:23.114018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-811db6c0-981b-48c8-b5f6-c16c14b51217 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:23.114568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-811db6c0-981b-48c8-b5f6-c16c14b51217 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:23.115440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-811db6c0-981b-48c8-b5f6-c16c14b51217 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:23.116142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-811db6c0-981b-48c8-b5f6-c16c14b51217 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:23.123283 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-46c2ced7-c0b2-4961-893d-b792c2852242 req-51c353ef-b392-4612-836a-887a81dcee7f service nova] Creating event network-changed:abe33bb0-e7ed-4829-882f-a1b97d1387f4 for instance 8765ddf0-5c8c-489c-a745-ea810d02bd80 on nch1-master-1 Jan 22 21:37:23.135469 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-46c2ced7-c0b2-4961-893d-b792c2852242 req-51c353ef-b392-4612-836a-887a81dcee7f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031097 Jan 22 21:37:23.135469 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3812/7923] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:37:23.272829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-811db6c0-981b-48c8-b5f6-c16c14b51217 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:23.280405 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-811db6c0-981b-48c8-b5f6-c16c14b51217 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 200 len: 1322 microversion: 2.1 time: 0.178747 Jan 22 21:37:23.281072 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4112/7924] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:23 2022] GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:37:24.299254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-33c32188-34fd-46d2-b3cd-ab0c6ff47f5c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:24.300001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-33c32188-34fd-46d2-b3cd-ab0c6ff47f5c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:24.306534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33c32188-34fd-46d2-b3cd-ab0c6ff47f5c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:24.307003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33c32188-34fd-46d2-b3cd-ab0c6ff47f5c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:24.307804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33c32188-34fd-46d2-b3cd-ab0c6ff47f5c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:24.308350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33c32188-34fd-46d2-b3cd-ab0c6ff47f5c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:24.667761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-33c32188-34fd-46d2-b3cd-ab0c6ff47f5c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:24.675125 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-33c32188-34fd-46d2-b3cd-ab0c6ff47f5c tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 200 len: 1322 microversion: 2.1 time: 0.380872 Jan 22 21:37:24.675692 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3813/7925] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:24 2022] GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:25.692562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cca49edd-6182-4477-9615-7fc6cd43171d tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:25.693090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cca49edd-6182-4477-9615-7fc6cd43171d tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:25.700969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cca49edd-6182-4477-9615-7fc6cd43171d tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:25.701433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cca49edd-6182-4477-9615-7fc6cd43171d tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:25.702257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cca49edd-6182-4477-9615-7fc6cd43171d tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:25.702707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cca49edd-6182-4477-9615-7fc6cd43171d tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:25.836014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cca49edd-6182-4477-9615-7fc6cd43171d tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:25.843789 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cca49edd-6182-4477-9615-7fc6cd43171d tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 200 len: 1322 microversion: 2.1 time: 0.155086 Jan 22 21:37:25.844433 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4113/7926] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:25 2022] GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:26.860193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-373323ce-b0d1-4893-bd88-e3f4ff33ea64 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:26.860817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-373323ce-b0d1-4893-bd88-e3f4ff33ea64 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:26.867695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-373323ce-b0d1-4893-bd88-e3f4ff33ea64 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:26.868159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-373323ce-b0d1-4893-bd88-e3f4ff33ea64 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:26.869672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-373323ce-b0d1-4893-bd88-e3f4ff33ea64 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:26.870164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-373323ce-b0d1-4893-bd88-e3f4ff33ea64 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:27.001631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-373323ce-b0d1-4893-bd88-e3f4ff33ea64 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:27.009064 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-373323ce-b0d1-4893-bd88-e3f4ff33ea64 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 200 len: 1322 microversion: 2.1 time: 0.152652 Jan 22 21:37:27.010366 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3814/7927] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:26 2022] GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:28.027012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e5d20a21-e43e-4428-b104-0297c0282ba4 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:28.027632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e5d20a21-e43e-4428-b104-0297c0282ba4 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:28.034778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5d20a21-e43e-4428-b104-0297c0282ba4 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:28.036865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5d20a21-e43e-4428-b104-0297c0282ba4 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:28.036865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5d20a21-e43e-4428-b104-0297c0282ba4 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:28.036865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5d20a21-e43e-4428-b104-0297c0282ba4 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:28.171921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e5d20a21-e43e-4428-b104-0297c0282ba4 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:28.179420 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e5d20a21-e43e-4428-b104-0297c0282ba4 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 200 len: 1322 microversion: 2.1 time: 0.156819 Jan 22 21:37:28.179983 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4114/7928] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:28 2022] GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:37:29.196238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2213cee5-1c40-4bb5-97c2-527013294d14 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:29.197537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2213cee5-1c40-4bb5-97c2-527013294d14 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:29.204395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2213cee5-1c40-4bb5-97c2-527013294d14 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:29.204861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2213cee5-1c40-4bb5-97c2-527013294d14 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:29.205713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2213cee5-1c40-4bb5-97c2-527013294d14 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:29.206165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2213cee5-1c40-4bb5-97c2-527013294d14 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:29.344334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2213cee5-1c40-4bb5-97c2-527013294d14 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:29.351978 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2213cee5-1c40-4bb5-97c2-527013294d14 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 200 len: 1322 microversion: 2.1 time: 0.159578 Jan 22 21:37:29.352613 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3815/7929] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:29 2022] GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:29.507635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-719c72d7-428b-4c4a-b2f6-3e6c7eed286c req-71b82461-8d76-4cd0-83dd-fbcf1442f5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8765ddf0-5c8c-489c-a745-ea810d02bd80", "name": "network-vif-plugged", "status": "completed", "tag": "abe33bb0-e7ed-4829-882f-a1b97d1387f4"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:37:29.509222 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:37:29.509222 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:37:29.517021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-719c72d7-428b-4c4a-b2f6-3e6c7eed286c req-71b82461-8d76-4cd0-83dd-fbcf1442f5f9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:29.517483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-719c72d7-428b-4c4a-b2f6-3e6c7eed286c req-71b82461-8d76-4cd0-83dd-fbcf1442f5f9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:29.528866 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-719c72d7-428b-4c4a-b2f6-3e6c7eed286c req-71b82461-8d76-4cd0-83dd-fbcf1442f5f9 service nova] Creating event network-vif-plugged:abe33bb0-e7ed-4829-882f-a1b97d1387f4 for instance 8765ddf0-5c8c-489c-a745-ea810d02bd80 on nch1-master-1 Jan 22 21:37:29.534157 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-719c72d7-428b-4c4a-b2f6-3e6c7eed286c req-71b82461-8d76-4cd0-83dd-fbcf1442f5f9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030277 Jan 22 21:37:29.534753 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4115/7930] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:37:30.369698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3be72dc2-d17e-4ab5-bee9-50a8da8bce76 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:30.370322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3be72dc2-d17e-4ab5-bee9-50a8da8bce76 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:30.377270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3be72dc2-d17e-4ab5-bee9-50a8da8bce76 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:30.377768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3be72dc2-d17e-4ab5-bee9-50a8da8bce76 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:30.378565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3be72dc2-d17e-4ab5-bee9-50a8da8bce76 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:30.379013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3be72dc2-d17e-4ab5-bee9-50a8da8bce76 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:30.510983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3be72dc2-d17e-4ab5-bee9-50a8da8bce76 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:30.518272 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3be72dc2-d17e-4ab5-bee9-50a8da8bce76 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 200 len: 1322 microversion: 2.1 time: 0.153043 Jan 22 21:37:30.518848 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3816/7931] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:30 2022] GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:31.536169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ff8d54a3-bcfe-4060-b623-9e88ff2450e7 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:31.536889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ff8d54a3-bcfe-4060-b623-9e88ff2450e7 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:31.549035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff8d54a3-bcfe-4060-b623-9e88ff2450e7 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:31.549487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff8d54a3-bcfe-4060-b623-9e88ff2450e7 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:31.550320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff8d54a3-bcfe-4060-b623-9e88ff2450e7 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:31.550758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff8d54a3-bcfe-4060-b623-9e88ff2450e7 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:31.689277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ff8d54a3-bcfe-4060-b623-9e88ff2450e7 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:31.696709 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ff8d54a3-bcfe-4060-b623-9e88ff2450e7 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 200 len: 1511 microversion: 2.1 time: 0.165724 Jan 22 21:37:31.697275 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4116/7932] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:31 2022] GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:31.713459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dcf09ae1-97b9-4a03-8582-2a9add6be89d tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6238c78-261a-421a-b7a2-43273813620f", "device": "/dev/sdb"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:37:31.714615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dcf09ae1-97b9-4a03-8582-2a9add6be89d tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:31.721375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcf09ae1-97b9-4a03-8582-2a9add6be89d tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:31.721873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcf09ae1-97b9-4a03-8582-2a9add6be89d tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:31.722684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcf09ae1-97b9-4a03-8582-2a9add6be89d tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:31.723114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcf09ae1-97b9-4a03-8582-2a9add6be89d tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:32.383181 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dcf09ae1-97b9-4a03-8582-2a9add6be89d tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "POST /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.674206 Jan 22 21:37:32.389242 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3817/7933] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 21:37:31 2022] POST /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80/os-volume_attachments => generated 194 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:37:43.195018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-2005686934", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "85709839-0ef1-4341-8af0-64266de1e7d5"}], "key_name": "tempest-TestSecurityGroupsBasicOps-198063508", "security_groups": []}, "os:scheduler_hints": {"different_host": ["6ec84b62-2250-45af-a9e1-d230f191b0e6"]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:37:43.259016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] validate_networks() for [('85709839-0ef1-4341-8af0-64266de1e7d5', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:37:43.672977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:37:43.673695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:37:43.674180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:37:43.674613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:37:43.675015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:37:43.684023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:43.684480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:43.694233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:43.694233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:43.703311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Getting quotas for project b4131e0a91374bb69f73358493400e27. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:37:43.709698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Getting quotas for user a97c9e9c1358436f877a28cb54cf2413 and project b4131e0a91374bb69f73358493400e27. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:37:43.723458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:37:43.726149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:37:43.855254 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8efe6327-b8be-49d4-82f5-71a7766f18b3 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 363 microversion: 2.1 time: 0.664622 Jan 22 21:37:43.855922 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4117/7934] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:37:43 2022] POST /compute/v2.1/servers => generated 363 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:37:43.866902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4a733b1c-7920-4078-acb8-f2a0781b1cf1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:43.868229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4a733b1c-7920-4078-acb8-f2a0781b1cf1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:43.930943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4a733b1c-7920-4078-acb8-f2a0781b1cf1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:43.939130 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4a733b1c-7920-4078-acb8-f2a0781b1cf1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1245 microversion: 2.1 time: 0.076147 Jan 22 21:37:43.939808 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3818/7935] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:43 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1245 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:44.956666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0124853e-a201-44a8-9688-298650b320b1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:44.957361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0124853e-a201-44a8-9688-298650b320b1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:44.966440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0124853e-a201-44a8-9688-298650b320b1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:44.966894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0124853e-a201-44a8-9688-298650b320b1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:44.967920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0124853e-a201-44a8-9688-298650b320b1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:44.968401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0124853e-a201-44a8-9688-298650b320b1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:45.043231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0124853e-a201-44a8-9688-298650b320b1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:45.051124 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0124853e-a201-44a8-9688-298650b320b1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1241 microversion: 2.1 time: 0.098588 Jan 22 21:37:45.051707 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4118/7936] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:44 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:46.073394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f12b650c-5400-4a51-8a08-1de22c2c168e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:46.073990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f12b650c-5400-4a51-8a08-1de22c2c168e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:46.083803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f12b650c-5400-4a51-8a08-1de22c2c168e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:46.084248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f12b650c-5400-4a51-8a08-1de22c2c168e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:46.085418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f12b650c-5400-4a51-8a08-1de22c2c168e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:46.086056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f12b650c-5400-4a51-8a08-1de22c2c168e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:46.176056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f12b650c-5400-4a51-8a08-1de22c2c168e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:46.184510 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f12b650c-5400-4a51-8a08-1de22c2c168e tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1303 microversion: 2.1 time: 0.118593 Jan 22 21:37:46.185104 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3819/7937] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:46 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1303 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:47.202912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9d19728e-0920-45cc-b13a-c0b3e3ee29c2 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:47.203625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9d19728e-0920-45cc-b13a-c0b3e3ee29c2 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:47.211003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d19728e-0920-45cc-b13a-c0b3e3ee29c2 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:47.211601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d19728e-0920-45cc-b13a-c0b3e3ee29c2 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:47.212513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d19728e-0920-45cc-b13a-c0b3e3ee29c2 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:47.213194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d19728e-0920-45cc-b13a-c0b3e3ee29c2 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:47.307712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9d19728e-0920-45cc-b13a-c0b3e3ee29c2 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:47.315469 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9d19728e-0920-45cc-b13a-c0b3e3ee29c2 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1303 microversion: 2.1 time: 0.117572 Jan 22 21:37:47.316050 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4119/7938] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:47 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:47.411065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-e6247faa-640e-4dba-8c02-749162119612 req-27d7f0e4-117b-44aa-9263-25a505664aed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a043fd79-014e-4ac0-822f-372dcbfe85ac", "tag": "3a325c6a-605f-4799-b313-db29dd5aedd8"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:37:47.413483 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:37:47.413483 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:37:47.435715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e6247faa-640e-4dba-8c02-749162119612 req-27d7f0e4-117b-44aa-9263-25a505664aed service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:47.436179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-e6247faa-640e-4dba-8c02-749162119612 req-27d7f0e4-117b-44aa-9263-25a505664aed service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:47.448466 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-e6247faa-640e-4dba-8c02-749162119612 req-27d7f0e4-117b-44aa-9263-25a505664aed service nova] Creating event network-changed:3a325c6a-605f-4799-b313-db29dd5aedd8 for instance a043fd79-014e-4ac0-822f-372dcbfe85ac on nch1-master-1 Jan 22 21:37:47.453966 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-e6247faa-640e-4dba-8c02-749162119612 req-27d7f0e4-117b-44aa-9263-25a505664aed service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049171 Jan 22 21:37:47.454588 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3820/7939] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:37:48.332065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-66f0185a-1d72-4e2f-a5a1-1bde81cf62c1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:48.332682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-66f0185a-1d72-4e2f-a5a1-1bde81cf62c1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:48.340448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66f0185a-1d72-4e2f-a5a1-1bde81cf62c1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:48.340912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66f0185a-1d72-4e2f-a5a1-1bde81cf62c1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:48.341793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66f0185a-1d72-4e2f-a5a1-1bde81cf62c1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:48.342294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66f0185a-1d72-4e2f-a5a1-1bde81cf62c1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:48.432341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-66f0185a-1d72-4e2f-a5a1-1bde81cf62c1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:48.439757 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-66f0185a-1d72-4e2f-a5a1-1bde81cf62c1 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1303 microversion: 2.1 time: 0.111501 Jan 22 21:37:48.440339 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4120/7940] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:48 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:49.457634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee337d16-8866-4aa0-b64e-858a17ccbfdd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:49.458344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ee337d16-8866-4aa0-b64e-858a17ccbfdd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:49.464772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee337d16-8866-4aa0-b64e-858a17ccbfdd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:49.465236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee337d16-8866-4aa0-b64e-858a17ccbfdd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:49.466072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee337d16-8866-4aa0-b64e-858a17ccbfdd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:49.466527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee337d16-8866-4aa0-b64e-858a17ccbfdd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:49.550995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ee337d16-8866-4aa0-b64e-858a17ccbfdd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:49.559502 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee337d16-8866-4aa0-b64e-858a17ccbfdd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1303 microversion: 2.1 time: 0.106809 Jan 22 21:37:49.560077 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3821/7941] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:49 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:37:50.580739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-641c44e5-5178-4b28-abcc-03b85d243978 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:50.581377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-641c44e5-5178-4b28-abcc-03b85d243978 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:50.588168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-641c44e5-5178-4b28-abcc-03b85d243978 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:50.588620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-641c44e5-5178-4b28-abcc-03b85d243978 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:50.590120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-641c44e5-5178-4b28-abcc-03b85d243978 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:50.590610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-641c44e5-5178-4b28-abcc-03b85d243978 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:50.674218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-641c44e5-5178-4b28-abcc-03b85d243978 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:50.681879 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-641c44e5-5178-4b28-abcc-03b85d243978 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1303 microversion: 2.1 time: 0.104780 Jan 22 21:37:50.682481 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4121/7942] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:50 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:51.700626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ba7cbde8-7dca-40a4-ac88-af0bb265ee2d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:51.701239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ba7cbde8-7dca-40a4-ac88-af0bb265ee2d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:51.708111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba7cbde8-7dca-40a4-ac88-af0bb265ee2d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:51.708572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba7cbde8-7dca-40a4-ac88-af0bb265ee2d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:51.709373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba7cbde8-7dca-40a4-ac88-af0bb265ee2d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:51.709856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ba7cbde8-7dca-40a4-ac88-af0bb265ee2d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:51.794854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ba7cbde8-7dca-40a4-ac88-af0bb265ee2d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:51.802392 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ba7cbde8-7dca-40a4-ac88-af0bb265ee2d tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1303 microversion: 2.1 time: 0.106558 Jan 22 21:37:51.802966 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3822/7943] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:51 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:52.818011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-773f21d2-569a-4343-8b4e-a39728ec16ee tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:52.818618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-773f21d2-569a-4343-8b4e-a39728ec16ee tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:52.825475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-773f21d2-569a-4343-8b4e-a39728ec16ee tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:52.825956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-773f21d2-569a-4343-8b4e-a39728ec16ee tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:52.826733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-773f21d2-569a-4343-8b4e-a39728ec16ee tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:52.827175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-773f21d2-569a-4343-8b4e-a39728ec16ee tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:52.918030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-773f21d2-569a-4343-8b4e-a39728ec16ee tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:52.922571 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-773f21d2-569a-4343-8b4e-a39728ec16ee tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1303 microversion: 2.1 time: 0.108204 Jan 22 21:37:52.923141 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4122/7944] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:52 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:53.603448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-1e1fae71-67cd-4b3b-97af-49715bc5126a req-e9e1e60a-55f7-4b78-a140-adc908843618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a043fd79-014e-4ac0-822f-372dcbfe85ac", "name": "network-vif-plugged", "status": "completed", "tag": "3a325c6a-605f-4799-b313-db29dd5aedd8"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:37:53.605100 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:37:53.605100 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:37:53.613321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1e1fae71-67cd-4b3b-97af-49715bc5126a req-e9e1e60a-55f7-4b78-a140-adc908843618 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:53.613803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1e1fae71-67cd-4b3b-97af-49715bc5126a req-e9e1e60a-55f7-4b78-a140-adc908843618 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:53.628244 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-1e1fae71-67cd-4b3b-97af-49715bc5126a req-e9e1e60a-55f7-4b78-a140-adc908843618 service nova] Creating event network-vif-plugged:3a325c6a-605f-4799-b313-db29dd5aedd8 for instance a043fd79-014e-4ac0-822f-372dcbfe85ac on nch1-master-1 Jan 22 21:37:53.633198 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-1e1fae71-67cd-4b3b-97af-49715bc5126a req-e9e1e60a-55f7-4b78-a140-adc908843618 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033432 Jan 22 21:37:53.633827 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3823/7945] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:37:53.939308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d32dd497-95b4-42ea-8dec-8fe222ea62f0 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:53.939853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d32dd497-95b4-42ea-8dec-8fe222ea62f0 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:53.946613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d32dd497-95b4-42ea-8dec-8fe222ea62f0 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:53.947080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d32dd497-95b4-42ea-8dec-8fe222ea62f0 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:53.947868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d32dd497-95b4-42ea-8dec-8fe222ea62f0 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:53.948313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d32dd497-95b4-42ea-8dec-8fe222ea62f0 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:54.032388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d32dd497-95b4-42ea-8dec-8fe222ea62f0 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:54.040295 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d32dd497-95b4-42ea-8dec-8fe222ea62f0 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1303 microversion: 2.1 time: 0.104769 Jan 22 21:37:54.040858 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4123/7946] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:53 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:55.058118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8fe3270b-e2a7-44f5-9db8-3602a9b58e12 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:55.058811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8fe3270b-e2a7-44f5-9db8-3602a9b58e12 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:55.065072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fe3270b-e2a7-44f5-9db8-3602a9b58e12 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:55.065544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fe3270b-e2a7-44f5-9db8-3602a9b58e12 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:55.066333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fe3270b-e2a7-44f5-9db8-3602a9b58e12 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:55.066771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fe3270b-e2a7-44f5-9db8-3602a9b58e12 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:55.158629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8fe3270b-e2a7-44f5-9db8-3602a9b58e12 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:55.167411 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8fe3270b-e2a7-44f5-9db8-3602a9b58e12 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1303 microversion: 2.1 time: 0.112865 Jan 22 21:37:55.167411 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3824/7947] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:55 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:56.183105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fc9ddc1c-bc2b-4e16-a4de-f986489c755f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:56.183717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fc9ddc1c-bc2b-4e16-a4de-f986489c755f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:56.191110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc9ddc1c-bc2b-4e16-a4de-f986489c755f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:56.191564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc9ddc1c-bc2b-4e16-a4de-f986489c755f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:56.192403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc9ddc1c-bc2b-4e16-a4de-f986489c755f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:56.192796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc9ddc1c-bc2b-4e16-a4de-f986489c755f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:56.275829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fc9ddc1c-bc2b-4e16-a4de-f986489c755f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:56.283990 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fc9ddc1c-bc2b-4e16-a4de-f986489c755f tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1476 microversion: 2.1 time: 0.104569 Jan 22 21:37:56.284565 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4124/7948] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:56 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1476 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:56.300405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-76cf7136-5273-4227-a1bb-2bd123923c78 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:56.301015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-76cf7136-5273-4227-a1bb-2bd123923c78 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:56.307780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76cf7136-5273-4227-a1bb-2bd123923c78 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:56.308234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76cf7136-5273-4227-a1bb-2bd123923c78 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:56.309546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76cf7136-5273-4227-a1bb-2bd123923c78 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:56.311780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76cf7136-5273-4227-a1bb-2bd123923c78 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:56.398888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-76cf7136-5273-4227-a1bb-2bd123923c78 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:56.406317 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-76cf7136-5273-4227-a1bb-2bd123923c78 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1476 microversion: 2.1 time: 0.109680 Jan 22 21:37:56.407171 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3825/7949] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:56 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1476 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:56.422046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-407d85cc-04b9-4389-9a4d-25d013591c19 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:56.422655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-407d85cc-04b9-4389-9a4d-25d013591c19 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:56.428701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-407d85cc-04b9-4389-9a4d-25d013591c19 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:56.429152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-407d85cc-04b9-4389-9a4d-25d013591c19 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:56.429963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-407d85cc-04b9-4389-9a4d-25d013591c19 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:56.430406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-407d85cc-04b9-4389-9a4d-25d013591c19 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:56.515569 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-407d85cc-04b9-4389-9a4d-25d013591c19 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1627 microversion: 2.1 time: 0.097218 Jan 22 21:37:56.516153 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4125/7950] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:56 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1627 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:56.532861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4f314442-0b85-4e30-b50d-65d06f8f2f22 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:56.533762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4f314442-0b85-4e30-b50d-65d06f8f2f22 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:56.540226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f314442-0b85-4e30-b50d-65d06f8f2f22 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:56.540688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f314442-0b85-4e30-b50d-65d06f8f2f22 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:56.541656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f314442-0b85-4e30-b50d-65d06f8f2f22 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:56.542110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f314442-0b85-4e30-b50d-65d06f8f2f22 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:56.673795 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4f314442-0b85-4e30-b50d-65d06f8f2f22 tempest-TestSecurityGroupsBasicOps-1101447464 tempest-TestSecurityGroupsBasicOps-1101447464-project-admin] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1915 microversion: 2.1 time: 0.145734 Jan 22 21:37:56.674381 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3826/7951] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:56 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1915 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:56.738172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-45b5fef8-806c-495d-bee0-347412d72a34 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:56.738677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-45b5fef8-806c-495d-bee0-347412d72a34 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:56.744695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45b5fef8-806c-495d-bee0-347412d72a34 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:56.745155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45b5fef8-806c-495d-bee0-347412d72a34 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:56.745980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45b5fef8-806c-495d-bee0-347412d72a34 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:56.746555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45b5fef8-806c-495d-bee0-347412d72a34 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:56.771411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-45b5fef8-806c-495d-bee0-347412d72a34 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:37:57.076587 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-45b5fef8-806c-495d-bee0-347412d72a34 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 204 len: 0 microversion: 2.1 time: 0.341839 Jan 22 21:37:57.077210 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4126/7952] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:37:56 2022] DELETE /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:37:57.084975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-66c80d90-bd17-457e-9b32-f3cb2c180096 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:57.085606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-66c80d90-bd17-457e-9b32-f3cb2c180096 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:57.091729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66c80d90-bd17-457e-9b32-f3cb2c180096 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:57.092185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66c80d90-bd17-457e-9b32-f3cb2c180096 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:57.092975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66c80d90-bd17-457e-9b32-f3cb2c180096 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:57.093414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66c80d90-bd17-457e-9b32-f3cb2c180096 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:57.175923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-66c80d90-bd17-457e-9b32-f3cb2c180096 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:57.183329 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-66c80d90-bd17-457e-9b32-f3cb2c180096 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1482 microversion: 2.1 time: 0.102010 Jan 22 21:37:57.184403 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3827/7953] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:57 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1482 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:58.201858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2db343ee-ca0c-4d21-af36-b488121b7170 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:58.202672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2db343ee-ca0c-4d21-af36-b488121b7170 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:58.209382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2db343ee-ca0c-4d21-af36-b488121b7170 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:58.209868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2db343ee-ca0c-4d21-af36-b488121b7170 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:58.210650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2db343ee-ca0c-4d21-af36-b488121b7170 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:58.211086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2db343ee-ca0c-4d21-af36-b488121b7170 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:58.299104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2db343ee-ca0c-4d21-af36-b488121b7170 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:58.306765 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2db343ee-ca0c-4d21-af36-b488121b7170 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1482 microversion: 2.1 time: 0.109591 Jan 22 21:37:58.307446 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4127/7954] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:58 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1482 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:37:59.309108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-de0211b1-ccb1-419b-9e4e-a08be5d81bde req-cf0097b5-f7cf-4c4c-9064-78e2eb5fbf43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a043fd79-014e-4ac0-822f-372dcbfe85ac", "name": "network-vif-deleted", "tag": "3a325c6a-605f-4799-b313-db29dd5aedd8"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:37:59.311477 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:37:59.311477 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:37:59.320261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-de0211b1-ccb1-419b-9e4e-a08be5d81bde req-cf0097b5-f7cf-4c4c-9064-78e2eb5fbf43 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:59.320817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-de0211b1-ccb1-419b-9e4e-a08be5d81bde req-cf0097b5-f7cf-4c4c-9064-78e2eb5fbf43 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:59.328266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bb8f0408-f186-4af7-9f78-e11d80089bb7 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:37:59.332101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bb8f0408-f186-4af7-9f78-e11d80089bb7 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:37:59.335026 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-de0211b1-ccb1-419b-9e4e-a08be5d81bde req-cf0097b5-f7cf-4c4c-9064-78e2eb5fbf43 service nova] Creating event network-vif-deleted:3a325c6a-605f-4799-b313-db29dd5aedd8 for instance a043fd79-014e-4ac0-822f-372dcbfe85ac on nch1-master-1 Jan 22 21:37:59.337595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb8f0408-f186-4af7-9f78-e11d80089bb7 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:59.338069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb8f0408-f186-4af7-9f78-e11d80089bb7 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:59.339577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb8f0408-f186-4af7-9f78-e11d80089bb7 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:37:59.340853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb8f0408-f186-4af7-9f78-e11d80089bb7 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:37:59.341202 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-de0211b1-ccb1-419b-9e4e-a08be5d81bde req-cf0097b5-f7cf-4c4c-9064-78e2eb5fbf43 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035283 Jan 22 21:37:59.342029 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3828/7955] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:37:59.411690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bb8f0408-f186-4af7-9f78-e11d80089bb7 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:37:59.420577 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bb8f0408-f186-4af7-9f78-e11d80089bb7 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 200 len: 1482 microversion: 2.1 time: 0.098290 Jan 22 21:37:59.422019 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4128/7956] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:37:59 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 1482 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:38:00.440142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9b02ddf4-b201-4fd5-8fa1-5b30b984b010 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:00.440893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9b02ddf4-b201-4fd5-8fa1-5b30b984b010 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: a043fd79-014e-4ac0-822f-372dcbfe85ac] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:00.447183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b02ddf4-b201-4fd5-8fa1-5b30b984b010 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:00.447652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b02ddf4-b201-4fd5-8fa1-5b30b984b010 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:00.448447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b02ddf4-b201-4fd5-8fa1-5b30b984b010 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:00.448902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b02ddf4-b201-4fd5-8fa1-5b30b984b010 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:00.462727 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-9b02ddf4-b201-4fd5-8fa1-5b30b984b010 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] HTTP exception thrown: Instance a043fd79-014e-4ac0-822f-372dcbfe85ac could not be found. Jan 22 21:38:00.463324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9b02ddf4-b201-4fd5-8fa1-5b30b984b010 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Returning 404 to user: Instance a043fd79-014e-4ac0-822f-372dcbfe85ac could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:38:00.464154 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9b02ddf4-b201-4fd5-8fa1-5b30b984b010 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac" status: 404 len: 111 microversion: 2.1 time: 0.028944 Jan 22 21:38:00.464689 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3829/7957] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:00 2022] GET /compute/v2.1/servers/a043fd79-014e-4ac0-822f-372dcbfe85ac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:38:05.185186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f2467607-88d8-46c2-a023-a635ec921955 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:05.186361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f2467607-88d8-46c2-a023-a635ec921955 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:05.187321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-a215e2f9-2896-42ea-ae5e-0695d585439b req-a2c7db8a-2cb7-4a00-8fde-b971f0ba98e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec84b62-2250-45af-a9e1-d230f191b0e6", "tag": "d07cd01c-f144-45d1-a522-aa8b451a43a9"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:38:05.188934 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:38:05.188934 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:38:05.194649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2467607-88d8-46c2-a023-a635ec921955 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:05.195320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2467607-88d8-46c2-a023-a635ec921955 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:05.196330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2467607-88d8-46c2-a023-a635ec921955 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:05.196762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2467607-88d8-46c2-a023-a635ec921955 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:05.197079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a215e2f9-2896-42ea-ae5e-0695d585439b req-a2c7db8a-2cb7-4a00-8fde-b971f0ba98e8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:05.197638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a215e2f9-2896-42ea-ae5e-0695d585439b req-a2c7db8a-2cb7-4a00-8fde-b971f0ba98e8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:05.218810 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-a215e2f9-2896-42ea-ae5e-0695d585439b req-a2c7db8a-2cb7-4a00-8fde-b971f0ba98e8 service nova] Creating event network-changed:d07cd01c-f144-45d1-a522-aa8b451a43a9 for instance 6ec84b62-2250-45af-a9e1-d230f191b0e6 on nch2-master-1 Jan 22 21:38:05.225204 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-a215e2f9-2896-42ea-ae5e-0695d585439b req-a2c7db8a-2cb7-4a00-8fde-b971f0ba98e8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042320 Jan 22 21:38:05.226105 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3830/7958] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:38:05.234679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f2467607-88d8-46c2-a023-a635ec921955 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:38:05.590853 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f2467607-88d8-46c2-a023-a635ec921955 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 204 len: 0 microversion: 2.1 time: 0.412149 Jan 22 21:38:05.591584 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4129/7959] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:38:05 2022] DELETE /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:38:05.600513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-53b11447-0866-4019-8387-d67edd00e6bd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:05.601228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-53b11447-0866-4019-8387-d67edd00e6bd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:05.609739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53b11447-0866-4019-8387-d67edd00e6bd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:05.610372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53b11447-0866-4019-8387-d67edd00e6bd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:05.611199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53b11447-0866-4019-8387-d67edd00e6bd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:05.611669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53b11447-0866-4019-8387-d67edd00e6bd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:05.785510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-53b11447-0866-4019-8387-d67edd00e6bd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:05.794767 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-53b11447-0866-4019-8387-d67edd00e6bd tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1770 microversion: 2.1 time: 0.198512 Jan 22 21:38:05.795363 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3831/7960] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:05 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1770 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:06.812798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2ffbc85e-286c-43f8-9ccc-6adf5b79b19c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:06.813525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2ffbc85e-286c-43f8-9ccc-6adf5b79b19c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:06.820227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ffbc85e-286c-43f8-9ccc-6adf5b79b19c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:06.820688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ffbc85e-286c-43f8-9ccc-6adf5b79b19c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:06.821483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ffbc85e-286c-43f8-9ccc-6adf5b79b19c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:06.821959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2ffbc85e-286c-43f8-9ccc-6adf5b79b19c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:06.964343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2ffbc85e-286c-43f8-9ccc-6adf5b79b19c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:06.972521 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2ffbc85e-286c-43f8-9ccc-6adf5b79b19c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1653 microversion: 2.1 time: 0.163891 Jan 22 21:38:06.973095 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4130/7961] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:06 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1653 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:07.795188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-a62ea751-6998-4e7d-95b0-16291bea89e0 req-003f14bf-3e00-464d-a37b-48418e3b26cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec84b62-2250-45af-a9e1-d230f191b0e6", "name": "network-vif-deleted", "tag": "d07cd01c-f144-45d1-a522-aa8b451a43a9"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:38:07.796788 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:38:07.796788 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:38:07.805024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a62ea751-6998-4e7d-95b0-16291bea89e0 req-003f14bf-3e00-464d-a37b-48418e3b26cb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:07.805474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a62ea751-6998-4e7d-95b0-16291bea89e0 req-003f14bf-3e00-464d-a37b-48418e3b26cb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:07.817008 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-a62ea751-6998-4e7d-95b0-16291bea89e0 req-003f14bf-3e00-464d-a37b-48418e3b26cb service nova] Creating event network-vif-deleted:d07cd01c-f144-45d1-a522-aa8b451a43a9 for instance 6ec84b62-2250-45af-a9e1-d230f191b0e6 on nch2-master-1 Jan 22 21:38:07.822022 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-a62ea751-6998-4e7d-95b0-16291bea89e0 req-003f14bf-3e00-464d-a37b-48418e3b26cb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031258 Jan 22 21:38:07.822611 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3832/7962] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:38:07.990441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f6ca0c4a-e9f2-4e8b-8eae-a16a7c26dd5c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:07.991048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f6ca0c4a-e9f2-4e8b-8eae-a16a7c26dd5c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:07.998999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6ca0c4a-e9f2-4e8b-8eae-a16a7c26dd5c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:07.999494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6ca0c4a-e9f2-4e8b-8eae-a16a7c26dd5c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:08.000237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6ca0c4a-e9f2-4e8b-8eae-a16a7c26dd5c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:08.000673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6ca0c4a-e9f2-4e8b-8eae-a16a7c26dd5c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:08.033253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6ca0c4a-e9f2-4e8b-8eae-a16a7c26dd5c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:08.033729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6ca0c4a-e9f2-4e8b-8eae-a16a7c26dd5c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:08.034180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-f6ca0c4a-e9f2-4e8b-8eae-a16a7c26dd5c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lazy-loading 'fault' on Instance uuid 6ec84b62-2250-45af-a9e1-d230f191b0e6 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:38:08.075544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f6ca0c4a-e9f2-4e8b-8eae-a16a7c26dd5c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a97c9e9c1358436f877a28cb54cf2413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4131e0a91374bb69f73358493400e27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:08.083991 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f6ca0c4a-e9f2-4e8b-8eae-a16a7c26dd5c tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 200 len: 1387 microversion: 2.1 time: 0.097347 Jan 22 21:38:08.084590 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4131/7963] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:07 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 1387 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:09.103364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-facafdc8-c0e5-4a56-a825-87631c49cca9 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:09.104067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-facafdc8-c0e5-4a56-a825-87631c49cca9 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] [instance: 6ec84b62-2250-45af-a9e1-d230f191b0e6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:09.111236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-facafdc8-c0e5-4a56-a825-87631c49cca9 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:09.111700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-facafdc8-c0e5-4a56-a825-87631c49cca9 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:09.112504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-facafdc8-c0e5-4a56-a825-87631c49cca9 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:09.113009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-facafdc8-c0e5-4a56-a825-87631c49cca9 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:09.128558 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-facafdc8-c0e5-4a56-a825-87631c49cca9 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] HTTP exception thrown: Instance 6ec84b62-2250-45af-a9e1-d230f191b0e6 could not be found. Jan 22 21:38:09.129165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-facafdc8-c0e5-4a56-a825-87631c49cca9 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Returning 404 to user: Instance 6ec84b62-2250-45af-a9e1-d230f191b0e6 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:38:09.130054 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-facafdc8-c0e5-4a56-a825-87631c49cca9 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6" status: 404 len: 111 microversion: 2.1 time: 0.031856 Jan 22 21:38:09.130604 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3833/7964] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:09 2022] GET /compute/v2.1/servers/6ec84b62-2250-45af-a9e1-d230f191b0e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:38:10.483211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-febec758-8102-4e0a-8d14-12326973273f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:10.483820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-febec758-8102-4e0a-8d14-12326973273f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:10.490618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-febec758-8102-4e0a-8d14-12326973273f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:10.491072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-febec758-8102-4e0a-8d14-12326973273f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:10.491860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-febec758-8102-4e0a-8d14-12326973273f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:10.492294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-febec758-8102-4e0a-8d14-12326973273f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:10.627486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-febec758-8102-4e0a-8d14-12326973273f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:10.635087 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-febec758-8102-4e0a-8d14-12326973273f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.156408 Jan 22 21:38:10.640002 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4132/7965] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:10 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:10.654528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9c2b7428-1dba-45a5-9e48-6be23b98e95c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:10.655145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9c2b7428-1dba-45a5-9e48-6be23b98e95c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:10.662114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c2b7428-1dba-45a5-9e48-6be23b98e95c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:10.665126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c2b7428-1dba-45a5-9e48-6be23b98e95c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:10.665126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c2b7428-1dba-45a5-9e48-6be23b98e95c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:10.665126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c2b7428-1dba-45a5-9e48-6be23b98e95c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:10.943879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9c2b7428-1dba-45a5-9e48-6be23b98e95c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:10.952373 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9c2b7428-1dba-45a5-9e48-6be23b98e95c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.302517 Jan 22 21:38:10.953011 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3834/7966] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:10 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:11.062620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-280594641", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "e64f360b-3907-4876-bfd1-47cd0201d17f"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:38:11.115793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] validate_networks() for [('e64f360b-3907-4876-bfd1-47cd0201d17f', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:38:11.533761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:38:11.535819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:38:11.536310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:38:11.537029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:38:11.537632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:38:11.550791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:11.551507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:11.552507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:11.553226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:11.572632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Getting quotas for project d8242a159f044587a7f8bb2eef2c9914. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:38:11.578475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Getting quotas for user 8ace63d7c59243d5abda14fbabd0fbed and project d8242a159f044587a7f8bb2eef2c9914. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:38:11.591238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:38:11.594031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:38:11.728932 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cc12d354-e646-4666-ae7d-ec9d397783a4 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.670083 Jan 22 21:38:11.732836 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4133/7967] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:38:11 2022] POST /compute/v2.1/servers => generated 382 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:38:11.744014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-43408e16-9d2c-46b6-8f0f-ba1684ace25f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:11.745068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-43408e16-9d2c-46b6-8f0f-ba1684ace25f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:11.853842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-43408e16-9d2c-46b6-8f0f-ba1684ace25f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:11.864660 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-43408e16-9d2c-46b6-8f0f-ba1684ace25f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1218 microversion: 2.1 time: 0.122454 Jan 22 21:38:11.864660 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3835/7968] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:11 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:12.881712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fe6cdf56-e0b2-4d93-92b1-bf7dbd200599 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:12.882698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fe6cdf56-e0b2-4d93-92b1-bf7dbd200599 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:12.905176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe6cdf56-e0b2-4d93-92b1-bf7dbd200599 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:12.905777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe6cdf56-e0b2-4d93-92b1-bf7dbd200599 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:12.908845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe6cdf56-e0b2-4d93-92b1-bf7dbd200599 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:12.909334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe6cdf56-e0b2-4d93-92b1-bf7dbd200599 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:13.015983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fe6cdf56-e0b2-4d93-92b1-bf7dbd200599 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:13.015983 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fe6cdf56-e0b2-4d93-92b1-bf7dbd200599 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1222 microversion: 2.1 time: 0.136745 Jan 22 21:38:13.015983 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4134/7969] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:12 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:13.384867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4c1b5e8b-c5bc-40f4-9cbb-79143980fa60 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] Calling method '.version_select at 0x7f1edae7f4c0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:13.523226 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4c1b5e8b-c5bc-40f4-9cbb-79143980fa60 tempest-TestSecurityGroupsBasicOps-467411862 tempest-TestSecurityGroupsBasicOps-467411862-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-198063508" status: 202 len: 0 microversion: 2.1 time: 0.141941 Jan 22 21:38:13.528411 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3836/7970] 10.222.0.100 () {58 vars in 1279 bytes} [Sat Jan 22 21:38:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-198063508 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:38:14.030597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-29ef2e43-b570-4bfd-b794-1a0c1d79a344 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:14.031219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-29ef2e43-b570-4bfd-b794-1a0c1d79a344 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:14.039277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29ef2e43-b570-4bfd-b794-1a0c1d79a344 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:14.039737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29ef2e43-b570-4bfd-b794-1a0c1d79a344 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:14.040548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29ef2e43-b570-4bfd-b794-1a0c1d79a344 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:14.040998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29ef2e43-b570-4bfd-b794-1a0c1d79a344 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:14.131516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-29ef2e43-b570-4bfd-b794-1a0c1d79a344 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:14.140078 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-29ef2e43-b570-4bfd-b794-1a0c1d79a344 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1276 microversion: 2.1 time: 0.113852 Jan 22 21:38:14.140706 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4135/7971] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:14 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:14.934673 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:38:14.935187 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 21:38:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:38:15.156895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-949c337d-d164-41d1-aeea-0bd0d99e5f27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:15.158209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-949c337d-d164-41d1-aeea-0bd0d99e5f27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:15.165364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-949c337d-d164-41d1-aeea-0bd0d99e5f27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:15.165777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-949c337d-d164-41d1-aeea-0bd0d99e5f27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:15.166788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-949c337d-d164-41d1-aeea-0bd0d99e5f27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:15.167245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-949c337d-d164-41d1-aeea-0bd0d99e5f27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:15.323995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-949c337d-d164-41d1-aeea-0bd0d99e5f27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:15.332591 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-949c337d-d164-41d1-aeea-0bd0d99e5f27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1318 microversion: 2.1 time: 0.180141 Jan 22 21:38:15.333172 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3837/7972] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:15 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:15.509242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-86994bef-5636-4346-a2dd-bf34423d18ad req-e1e8a6e6-6748-488b-ac27-74cf53ab1776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af93bae-aa61-4977-a49d-c8d4c9de5e7b", "tag": "2e8a94ad-27f4-4dfa-b369-5da9f1f84301"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:38:15.512328 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:38:15.512328 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:38:15.520813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-86994bef-5636-4346-a2dd-bf34423d18ad req-e1e8a6e6-6748-488b-ac27-74cf53ab1776 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:15.521650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-86994bef-5636-4346-a2dd-bf34423d18ad req-e1e8a6e6-6748-488b-ac27-74cf53ab1776 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:15.538765 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-86994bef-5636-4346-a2dd-bf34423d18ad req-e1e8a6e6-6748-488b-ac27-74cf53ab1776 service nova] Creating event network-changed:2e8a94ad-27f4-4dfa-b369-5da9f1f84301 for instance 6af93bae-aa61-4977-a49d-c8d4c9de5e7b on nch2-master-1 Jan 22 21:38:15.543355 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-86994bef-5636-4346-a2dd-bf34423d18ad req-e1e8a6e6-6748-488b-ac27-74cf53ab1776 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037270 Jan 22 21:38:15.545443 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4136/7973] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:38:16.349131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1b1873ea-afd0-46df-b814-d29e2bd16272 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:16.349852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1b1873ea-afd0-46df-b814-d29e2bd16272 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:16.356948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b1873ea-afd0-46df-b814-d29e2bd16272 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:16.357402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b1873ea-afd0-46df-b814-d29e2bd16272 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:16.358225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b1873ea-afd0-46df-b814-d29e2bd16272 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:16.358666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b1873ea-afd0-46df-b814-d29e2bd16272 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:16.521391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1b1873ea-afd0-46df-b814-d29e2bd16272 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:16.529773 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1b1873ea-afd0-46df-b814-d29e2bd16272 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1318 microversion: 2.1 time: 0.184460 Jan 22 21:38:16.530389 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3838/7974] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:16 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:17.548337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6e6d30a0-e478-4204-b710-35e6509f6f0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:17.549051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6e6d30a0-e478-4204-b710-35e6509f6f0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:17.555646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e6d30a0-e478-4204-b710-35e6509f6f0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:17.556223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e6d30a0-e478-4204-b710-35e6509f6f0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:17.557017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e6d30a0-e478-4204-b710-35e6509f6f0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:17.557469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e6d30a0-e478-4204-b710-35e6509f6f0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:17.694784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6e6d30a0-e478-4204-b710-35e6509f6f0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:17.703240 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6e6d30a0-e478-4204-b710-35e6509f6f0a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1318 microversion: 2.1 time: 0.159388 Jan 22 21:38:17.703824 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4137/7975] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:17 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:18.720945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc109eb6-45b4-4442-b243-5b109ae7a8d9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:18.721495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bc109eb6-45b4-4442-b243-5b109ae7a8d9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:18.728262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc109eb6-45b4-4442-b243-5b109ae7a8d9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:18.728713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc109eb6-45b4-4442-b243-5b109ae7a8d9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:18.729495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc109eb6-45b4-4442-b243-5b109ae7a8d9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:18.729956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc109eb6-45b4-4442-b243-5b109ae7a8d9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:18.870215 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bc109eb6-45b4-4442-b243-5b109ae7a8d9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:18.878502 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bc109eb6-45b4-4442-b243-5b109ae7a8d9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1318 microversion: 2.1 time: 0.161404 Jan 22 21:38:18.879076 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3839/7976] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:18 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:19.895829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fb029562-3c95-4299-a0cc-d2d468f1eb1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:19.896445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fb029562-3c95-4299-a0cc-d2d468f1eb1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:19.904253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb029562-3c95-4299-a0cc-d2d468f1eb1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:19.904713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb029562-3c95-4299-a0cc-d2d468f1eb1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:19.905527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb029562-3c95-4299-a0cc-d2d468f1eb1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:19.905991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fb029562-3c95-4299-a0cc-d2d468f1eb1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:20.049553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fb029562-3c95-4299-a0cc-d2d468f1eb1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:20.056979 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fb029562-3c95-4299-a0cc-d2d468f1eb1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1318 microversion: 2.1 time: 0.164907 Jan 22 21:38:20.057561 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4138/7977] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:19 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:21.082470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7341eacb-fcea-4363-97dd-743efef52203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:21.083089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7341eacb-fcea-4363-97dd-743efef52203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:21.090681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7341eacb-fcea-4363-97dd-743efef52203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:21.091140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7341eacb-fcea-4363-97dd-743efef52203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:21.091930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7341eacb-fcea-4363-97dd-743efef52203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:21.092407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7341eacb-fcea-4363-97dd-743efef52203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:21.220455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7341eacb-fcea-4363-97dd-743efef52203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:21.227815 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7341eacb-fcea-4363-97dd-743efef52203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1318 microversion: 2.1 time: 0.149093 Jan 22 21:38:21.228387 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3840/7978] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:21 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:21.945656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-90700d78-0a53-406f-a23c-2df2fd6ddcd8 req-b8ce2ce8-a4ea-49f2-9004-49818a155e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af93bae-aa61-4977-a49d-c8d4c9de5e7b", "name": "network-vif-plugged", "status": "completed", "tag": "2e8a94ad-27f4-4dfa-b369-5da9f1f84301"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:38:21.947423 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:38:21.947423 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:38:21.964061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-90700d78-0a53-406f-a23c-2df2fd6ddcd8 req-b8ce2ce8-a4ea-49f2-9004-49818a155e75 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:21.964061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-90700d78-0a53-406f-a23c-2df2fd6ddcd8 req-b8ce2ce8-a4ea-49f2-9004-49818a155e75 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:21.979441 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-90700d78-0a53-406f-a23c-2df2fd6ddcd8 req-b8ce2ce8-a4ea-49f2-9004-49818a155e75 service nova] Creating event network-vif-plugged:2e8a94ad-27f4-4dfa-b369-5da9f1f84301 for instance 6af93bae-aa61-4977-a49d-c8d4c9de5e7b on nch2-master-1 Jan 22 21:38:21.984792 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-90700d78-0a53-406f-a23c-2df2fd6ddcd8 req-b8ce2ce8-a4ea-49f2-9004-49818a155e75 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042928 Jan 22 21:38:21.985395 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4139/7979] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:38:22.244082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4db7a8dd-d906-428f-a071-446108794f05 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:22.244614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4db7a8dd-d906-428f-a071-446108794f05 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:22.252211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4db7a8dd-d906-428f-a071-446108794f05 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:22.252684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4db7a8dd-d906-428f-a071-446108794f05 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:22.253480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4db7a8dd-d906-428f-a071-446108794f05 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:22.253960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4db7a8dd-d906-428f-a071-446108794f05 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:22.391211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4db7a8dd-d906-428f-a071-446108794f05 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:22.398689 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4db7a8dd-d906-428f-a071-446108794f05 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1318 microversion: 2.1 time: 0.158399 Jan 22 21:38:22.399257 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3841/7980] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:22 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:23.416770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bae9ff88-7d6b-4de0-a73a-fb73ee794551 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:23.417468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bae9ff88-7d6b-4de0-a73a-fb73ee794551 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:23.424400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bae9ff88-7d6b-4de0-a73a-fb73ee794551 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:23.424983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bae9ff88-7d6b-4de0-a73a-fb73ee794551 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:23.425976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bae9ff88-7d6b-4de0-a73a-fb73ee794551 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:23.426551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bae9ff88-7d6b-4de0-a73a-fb73ee794551 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:23.561076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bae9ff88-7d6b-4de0-a73a-fb73ee794551 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:23.568512 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bae9ff88-7d6b-4de0-a73a-fb73ee794551 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1318 microversion: 2.1 time: 0.156627 Jan 22 21:38:23.569075 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4140/7981] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:23 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:24.586002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d9271d67-8d46-4473-81ad-990ac49e0d6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:24.586611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d9271d67-8d46-4473-81ad-990ac49e0d6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:24.594214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9271d67-8d46-4473-81ad-990ac49e0d6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:24.594669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9271d67-8d46-4473-81ad-990ac49e0d6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:24.595480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9271d67-8d46-4473-81ad-990ac49e0d6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:24.595924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9271d67-8d46-4473-81ad-990ac49e0d6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:24.729812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d9271d67-8d46-4473-81ad-990ac49e0d6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:24.738049 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d9271d67-8d46-4473-81ad-990ac49e0d6f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1504 microversion: 2.1 time: 0.155833 Jan 22 21:38:24.738638 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3842/7982] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:24 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:24.754216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-62af45e4-848a-4154-bbc2-2eec7e828c2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:38:24.754778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-62af45e4-848a-4154-bbc2-2eec7e828c2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:24.761586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62af45e4-848a-4154-bbc2-2eec7e828c2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:24.762045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62af45e4-848a-4154-bbc2-2eec7e828c2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:24.763015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62af45e4-848a-4154-bbc2-2eec7e828c2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:24.763460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62af45e4-848a-4154-bbc2-2eec7e828c2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:24.887010 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.network.security_group_api [None req-62af45e4-848a-4154-bbc2-2eec7e828c2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Removing security group 5079bccf-82bc-4b9e-9acf-9267b6b171c0 from port 2e8a94ad-27f4-4dfa-b369-5da9f1f84301 Jan 22 21:38:25.254764 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-62af45e4-848a-4154-bbc2-2eec7e828c2e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b/action" status: 202 len: 0 microversion: 2.1 time: 0.504158 Jan 22 21:38:25.259597 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4141/7983] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:38:24 2022] POST /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:38:25.262590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-4972b590-7ea6-4833-8821-d5493473d7ca req-ea101e15-dc2c-4f09-b135-f6dd24851bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af93bae-aa61-4977-a49d-c8d4c9de5e7b", "tag": "2e8a94ad-27f4-4dfa-b369-5da9f1f84301"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:38:25.264184 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:38:25.264184 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:38:25.267664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ba712da1-9e04-4f70-a046-f44e34baf696 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:25.268290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ba712da1-9e04-4f70-a046-f44e34baf696 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:25.273454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4972b590-7ea6-4833-8821-d5493473d7ca req-ea101e15-dc2c-4f09-b135-f6dd24851bca service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:25.278230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4972b590-7ea6-4833-8821-d5493473d7ca req-ea101e15-dc2c-4f09-b135-f6dd24851bca service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:25.285368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba712da1-9e04-4f70-a046-f44e34baf696 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:25.285806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba712da1-9e04-4f70-a046-f44e34baf696 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:25.286924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba712da1-9e04-4f70-a046-f44e34baf696 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:25.287539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba712da1-9e04-4f70-a046-f44e34baf696 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:25.300454 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-4972b590-7ea6-4833-8821-d5493473d7ca req-ea101e15-dc2c-4f09-b135-f6dd24851bca service nova] Creating event network-changed:2e8a94ad-27f4-4dfa-b369-5da9f1f84301 for instance 6af93bae-aa61-4977-a49d-c8d4c9de5e7b on nch2-master-1 Jan 22 21:38:25.324459 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-4972b590-7ea6-4833-8821-d5493473d7ca req-ea101e15-dc2c-4f09-b135-f6dd24851bca service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063203 Jan 22 21:38:25.325734 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3843/7984] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:38:25.756016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ba712da1-9e04-4f70-a046-f44e34baf696 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:25.765163 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ba712da1-9e04-4f70-a046-f44e34baf696 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1462 microversion: 2.1 time: 0.504145 Jan 22 21:38:25.765778 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4142/7985] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:25 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1462 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:25.782169 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-340efa39-7e47-4079-b925-aeaa0e023030 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:25.783000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-340efa39-7e47-4079-b925-aeaa0e023030 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:25.790289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-340efa39-7e47-4079-b925-aeaa0e023030 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:25.790755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-340efa39-7e47-4079-b925-aeaa0e023030 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:25.791562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-340efa39-7e47-4079-b925-aeaa0e023030 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:25.792017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-340efa39-7e47-4079-b925-aeaa0e023030 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:25.938537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-340efa39-7e47-4079-b925-aeaa0e023030 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:25.946384 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-340efa39-7e47-4079-b925-aeaa0e023030 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.168653 Jan 22 21:38:25.957984 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3844/7986] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:25 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:25.965872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8d8a59e1-fc88-4eb0-8db9-d12860183836 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:25.968952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8d8a59e1-fc88-4eb0-8db9-d12860183836 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:25.972629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d8a59e1-fc88-4eb0-8db9-d12860183836 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:25.973091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d8a59e1-fc88-4eb0-8db9-d12860183836 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:25.974022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d8a59e1-fc88-4eb0-8db9-d12860183836 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:25.974470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d8a59e1-fc88-4eb0-8db9-d12860183836 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:26.237783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8d8a59e1-fc88-4eb0-8db9-d12860183836 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:26.245244 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8d8a59e1-fc88-4eb0-8db9-d12860183836 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.283972 Jan 22 21:38:26.245870 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4143/7987] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:25 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:26.348123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1360750327", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "e64f360b-3907-4876-bfd1-47cd0201d17f"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:38:26.399387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] validate_networks() for [('e64f360b-3907-4876-bfd1-47cd0201d17f', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:38:26.769590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:38:26.770030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:38:26.770522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:38:26.770947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:38:26.771372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:38:26.781698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:26.781964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:26.782807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:26.783351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:26.802643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Getting quotas for project d8242a159f044587a7f8bb2eef2c9914. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:38:26.808804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Getting quotas for user 8ace63d7c59243d5abda14fbabd0fbed and project d8242a159f044587a7f8bb2eef2c9914. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:38:26.822062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:38:26.825337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:38:26.935653 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d152822c-e0cd-4cd4-a3c0-5b7cd3a1cd2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.591178 Jan 22 21:38:26.936330 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3845/7988] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:38:26 2022] POST /compute/v2.1/servers => generated 382 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:38:26.946226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4b4401c1-195e-45fe-9ec6-d2734fc524e8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:26.946956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4b4401c1-195e-45fe-9ec6-d2734fc524e8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:27.001202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4b4401c1-195e-45fe-9ec6-d2734fc524e8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:27.007812 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4b4401c1-195e-45fe-9ec6-d2734fc524e8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1219 microversion: 2.1 time: 0.065168 Jan 22 21:38:27.008386 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4144/7989] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:26 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:28.026733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-503eb12d-e18f-4c14-8afa-0a8a30f1caec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:28.028069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-503eb12d-e18f-4c14-8afa-0a8a30f1caec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:28.035159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-503eb12d-e18f-4c14-8afa-0a8a30f1caec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:28.035618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-503eb12d-e18f-4c14-8afa-0a8a30f1caec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:28.036414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-503eb12d-e18f-4c14-8afa-0a8a30f1caec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:28.036862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-503eb12d-e18f-4c14-8afa-0a8a30f1caec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:28.099018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-503eb12d-e18f-4c14-8afa-0a8a30f1caec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:28.106524 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-503eb12d-e18f-4c14-8afa-0a8a30f1caec tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1215 microversion: 2.1 time: 0.084442 Jan 22 21:38:28.107097 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3846/7990] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:28 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:29.124537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5c3114ee-d540-4501-bed1-d7a5667bda57 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:29.125179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5c3114ee-d540-4501-bed1-d7a5667bda57 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:29.132588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c3114ee-d540-4501-bed1-d7a5667bda57 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:29.133043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c3114ee-d540-4501-bed1-d7a5667bda57 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:29.133868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c3114ee-d540-4501-bed1-d7a5667bda57 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:29.134314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c3114ee-d540-4501-bed1-d7a5667bda57 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:29.195471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5c3114ee-d540-4501-bed1-d7a5667bda57 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:29.204555 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5c3114ee-d540-4501-bed1-d7a5667bda57 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1277 microversion: 2.1 time: 0.084592 Jan 22 21:38:29.205128 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4145/7991] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:29 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:30.222146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0a886299-6c35-47cb-bf03-8b00ec9229fc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:30.222947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0a886299-6c35-47cb-bf03-8b00ec9229fc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:30.231649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a886299-6c35-47cb-bf03-8b00ec9229fc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:30.232113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a886299-6c35-47cb-bf03-8b00ec9229fc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:30.232925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a886299-6c35-47cb-bf03-8b00ec9229fc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:30.233366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a886299-6c35-47cb-bf03-8b00ec9229fc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:30.374904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-be2ed05e-363e-426a-acc5-1a7327a36ba1 req-a38c51a8-7a06-4341-a2d7-5f3be04a52ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e22c8515-73f5-4d2f-a4c0-f252876a1ae0", "tag": "616aa0d5-0133-4131-b99c-2b594f3660ae"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:38:30.376492 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:38:30.376492 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:38:30.385819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-be2ed05e-363e-426a-acc5-1a7327a36ba1 req-a38c51a8-7a06-4341-a2d7-5f3be04a52ca service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:30.386809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-be2ed05e-363e-426a-acc5-1a7327a36ba1 req-a38c51a8-7a06-4341-a2d7-5f3be04a52ca service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:30.407631 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-be2ed05e-363e-426a-acc5-1a7327a36ba1 req-a38c51a8-7a06-4341-a2d7-5f3be04a52ca service nova] Creating event network-changed:616aa0d5-0133-4131-b99c-2b594f3660ae for instance e22c8515-73f5-4d2f-a4c0-f252876a1ae0 on nch1-master-1 Jan 22 21:38:30.412788 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-be2ed05e-363e-426a-acc5-1a7327a36ba1 req-a38c51a8-7a06-4341-a2d7-5f3be04a52ca service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041470 Jan 22 21:38:30.413782 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4146/7992] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:38:30.483642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0a886299-6c35-47cb-bf03-8b00ec9229fc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:30.491450 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0a886299-6c35-47cb-bf03-8b00ec9229fc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1319 microversion: 2.1 time: 0.273254 Jan 22 21:38:30.492365 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3847/7993] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:30 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:31.509239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2137f329-5f72-4c44-a864-4fb7b3e8bd8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:31.509969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2137f329-5f72-4c44-a864-4fb7b3e8bd8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:31.516130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2137f329-5f72-4c44-a864-4fb7b3e8bd8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:31.516579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2137f329-5f72-4c44-a864-4fb7b3e8bd8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:31.517356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2137f329-5f72-4c44-a864-4fb7b3e8bd8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:31.517825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2137f329-5f72-4c44-a864-4fb7b3e8bd8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:31.646411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2137f329-5f72-4c44-a864-4fb7b3e8bd8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:31.654724 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2137f329-5f72-4c44-a864-4fb7b3e8bd8d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1319 microversion: 2.1 time: 0.150250 Jan 22 21:38:31.655299 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4147/7994] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:31 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:38:32.673283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dfcb5346-2f6e-4588-b08f-0f45092ccc61 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:32.673942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dfcb5346-2f6e-4588-b08f-0f45092ccc61 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:32.679940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfcb5346-2f6e-4588-b08f-0f45092ccc61 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:32.680394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfcb5346-2f6e-4588-b08f-0f45092ccc61 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:32.681174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfcb5346-2f6e-4588-b08f-0f45092ccc61 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:32.681642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfcb5346-2f6e-4588-b08f-0f45092ccc61 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:32.818295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dfcb5346-2f6e-4588-b08f-0f45092ccc61 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:32.826192 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dfcb5346-2f6e-4588-b08f-0f45092ccc61 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1319 microversion: 2.1 time: 0.158161 Jan 22 21:38:32.826770 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3848/7995] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:32 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:33.844851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-88c049ea-e9e0-4c33-a64c-41b9d77d164a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:33.845579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-88c049ea-e9e0-4c33-a64c-41b9d77d164a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:33.852260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88c049ea-e9e0-4c33-a64c-41b9d77d164a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:33.852737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88c049ea-e9e0-4c33-a64c-41b9d77d164a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:33.855196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88c049ea-e9e0-4c33-a64c-41b9d77d164a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:33.855666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88c049ea-e9e0-4c33-a64c-41b9d77d164a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:33.996686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-88c049ea-e9e0-4c33-a64c-41b9d77d164a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:34.005265 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-88c049ea-e9e0-4c33-a64c-41b9d77d164a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1319 microversion: 2.1 time: 0.165222 Jan 22 21:38:34.005885 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4148/7996] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:33 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:35.022782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee0b9c7b-accd-48b5-8f1e-24311045f41d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:35.023379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ee0b9c7b-accd-48b5-8f1e-24311045f41d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:35.030827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee0b9c7b-accd-48b5-8f1e-24311045f41d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:35.031557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee0b9c7b-accd-48b5-8f1e-24311045f41d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:35.032372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee0b9c7b-accd-48b5-8f1e-24311045f41d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:35.032825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee0b9c7b-accd-48b5-8f1e-24311045f41d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:35.164054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ee0b9c7b-accd-48b5-8f1e-24311045f41d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:35.171597 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee0b9c7b-accd-48b5-8f1e-24311045f41d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1319 microversion: 2.1 time: 0.152836 Jan 22 21:38:35.172170 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3849/7997] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:35 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:38:35.797924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-90e8b57b-759f-4323-927d-80de44401d07 req-29cf69e9-f603-473e-928f-a113d1f38f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22c8515-73f5-4d2f-a4c0-f252876a1ae0", "name": "network-vif-plugged", "status": "completed", "tag": "616aa0d5-0133-4131-b99c-2b594f3660ae"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:38:35.800061 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:38:35.800061 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:38:35.807778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-90e8b57b-759f-4323-927d-80de44401d07 req-29cf69e9-f603-473e-928f-a113d1f38f6a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:35.808234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-90e8b57b-759f-4323-927d-80de44401d07 req-29cf69e9-f603-473e-928f-a113d1f38f6a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:35.819835 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-90e8b57b-759f-4323-927d-80de44401d07 req-29cf69e9-f603-473e-928f-a113d1f38f6a service nova] Creating event network-vif-plugged:616aa0d5-0133-4131-b99c-2b594f3660ae for instance e22c8515-73f5-4d2f-a4c0-f252876a1ae0 on nch1-master-1 Jan 22 21:38:35.824549 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-90e8b57b-759f-4323-927d-80de44401d07 req-29cf69e9-f603-473e-928f-a113d1f38f6a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030939 Jan 22 21:38:35.825134 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4149/7998] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:38:36.189679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5a007c10-eb6a-4c69-99a2-1ce6332560de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:36.190675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5a007c10-eb6a-4c69-99a2-1ce6332560de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:36.197373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a007c10-eb6a-4c69-99a2-1ce6332560de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:36.197867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a007c10-eb6a-4c69-99a2-1ce6332560de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:36.198666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a007c10-eb6a-4c69-99a2-1ce6332560de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:36.199112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a007c10-eb6a-4c69-99a2-1ce6332560de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:36.336801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5a007c10-eb6a-4c69-99a2-1ce6332560de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:36.345131 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5a007c10-eb6a-4c69-99a2-1ce6332560de tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1319 microversion: 2.1 time: 0.160564 Jan 22 21:38:36.345770 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3850/7999] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:36 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:37.363891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-47a78181-f5e5-40ee-8701-3f188c941676 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:37.364616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-47a78181-f5e5-40ee-8701-3f188c941676 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:37.370937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47a78181-f5e5-40ee-8701-3f188c941676 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:37.371393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47a78181-f5e5-40ee-8701-3f188c941676 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:37.372177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47a78181-f5e5-40ee-8701-3f188c941676 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:37.372628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47a78181-f5e5-40ee-8701-3f188c941676 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:37.505016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-47a78181-f5e5-40ee-8701-3f188c941676 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:37.512545 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-47a78181-f5e5-40ee-8701-3f188c941676 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1319 microversion: 2.1 time: 0.153496 Jan 22 21:38:37.513111 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4150/8000] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:37 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:38.529106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fdfa3072-3113-4eea-9fc5-b71cb227e180 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:38.529785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fdfa3072-3113-4eea-9fc5-b71cb227e180 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:38.536886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fdfa3072-3113-4eea-9fc5-b71cb227e180 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:38.537350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fdfa3072-3113-4eea-9fc5-b71cb227e180 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:38.538178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fdfa3072-3113-4eea-9fc5-b71cb227e180 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:38.538632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fdfa3072-3113-4eea-9fc5-b71cb227e180 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:38.668384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fdfa3072-3113-4eea-9fc5-b71cb227e180 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:38.676506 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fdfa3072-3113-4eea-9fc5-b71cb227e180 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1506 microversion: 2.1 time: 0.151139 Jan 22 21:38:38.677081 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3851/8001] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:38 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:38.693004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-efee99f9-1fc7-42ce-8b83-170809997b7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:38:38.693576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-efee99f9-1fc7-42ce-8b83-170809997b7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:38.700461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-efee99f9-1fc7-42ce-8b83-170809997b7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:38.775977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-efee99f9-1fc7-42ce-8b83-170809997b7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:38.775977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-efee99f9-1fc7-42ce-8b83-170809997b7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:38.775977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-efee99f9-1fc7-42ce-8b83-170809997b7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:38.867355 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-efee99f9-1fc7-42ce-8b83-170809997b7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0/action" status: 202 len: 0 microversion: 2.1 time: 0.177785 Jan 22 21:38:38.868132 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4151/8002] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:38:38 2022] POST /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:38:38.876986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8a625f0a-e097-4ff7-bf6d-f6f27654f367 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:38.884622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8a625f0a-e097-4ff7-bf6d-f6f27654f367 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:38.884622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a625f0a-e097-4ff7-bf6d-f6f27654f367 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:38.884622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a625f0a-e097-4ff7-bf6d-f6f27654f367 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:38.884937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a625f0a-e097-4ff7-bf6d-f6f27654f367 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:38.885360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a625f0a-e097-4ff7-bf6d-f6f27654f367 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:39.021671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8a625f0a-e097-4ff7-bf6d-f6f27654f367 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:39.029204 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8a625f0a-e097-4ff7-bf6d-f6f27654f367 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1511 microversion: 2.1 time: 0.156530 Jan 22 21:38:39.029832 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3852/8003] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:38 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:40.048811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f29be256-1053-4bf7-a29e-c5494b40acd7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:40.049523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f29be256-1053-4bf7-a29e-c5494b40acd7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:40.058551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f29be256-1053-4bf7-a29e-c5494b40acd7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:40.059247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f29be256-1053-4bf7-a29e-c5494b40acd7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:40.059781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f29be256-1053-4bf7-a29e-c5494b40acd7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:40.060222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f29be256-1053-4bf7-a29e-c5494b40acd7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:40.198751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f29be256-1053-4bf7-a29e-c5494b40acd7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:40.206676 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f29be256-1053-4bf7-a29e-c5494b40acd7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1491 microversion: 2.1 time: 0.163212 Jan 22 21:38:40.207245 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4152/8004] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:40 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1491 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:40.223433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-707e47e8-1a8d-493a-8ec5-dd6d4a2a507f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:38:40.223956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-707e47e8-1a8d-493a-8ec5-dd6d4a2a507f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:40.230638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-707e47e8-1a8d-493a-8ec5-dd6d4a2a507f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:40.231102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-707e47e8-1a8d-493a-8ec5-dd6d4a2a507f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:40.231897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-707e47e8-1a8d-493a-8ec5-dd6d4a2a507f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:40.232348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-707e47e8-1a8d-493a-8ec5-dd6d4a2a507f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:40.255891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-707e47e8-1a8d-493a-8ec5-dd6d4a2a507f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lazy-loading 'flavor' on Instance uuid e22c8515-73f5-4d2f-a4c0-f252876a1ae0 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:38:40.731540 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-707e47e8-1a8d-493a-8ec5-dd6d4a2a507f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0/action" status: 202 len: 0 microversion: 2.1 time: 0.511746 Jan 22 21:38:40.732340 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3853/8005] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:38:40 2022] POST /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:38:40.740149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0cb93cfb-5bb2-491d-801d-c8093efc5152 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:40.740760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0cb93cfb-5bb2-491d-801d-c8093efc5152 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:40.747043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cb93cfb-5bb2-491d-801d-c8093efc5152 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:40.747560 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cb93cfb-5bb2-491d-801d-c8093efc5152 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:40.748345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cb93cfb-5bb2-491d-801d-c8093efc5152 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:40.748784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cb93cfb-5bb2-491d-801d-c8093efc5152 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:40.881726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0cb93cfb-5bb2-491d-801d-c8093efc5152 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:40.889344 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0cb93cfb-5bb2-491d-801d-c8093efc5152 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1497 microversion: 2.1 time: 0.152737 Jan 22 21:38:40.890487 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4153/8006] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:40 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:41.909585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2986d6b4-e429-4c73-b192-0e53c81c51be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:41.910234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2986d6b4-e429-4c73-b192-0e53c81c51be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:41.916542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2986d6b4-e429-4c73-b192-0e53c81c51be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:41.916999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2986d6b4-e429-4c73-b192-0e53c81c51be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:41.917820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2986d6b4-e429-4c73-b192-0e53c81c51be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:41.918269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2986d6b4-e429-4c73-b192-0e53c81c51be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:42.050284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2986d6b4-e429-4c73-b192-0e53c81c51be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:42.057938 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2986d6b4-e429-4c73-b192-0e53c81c51be tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1518 microversion: 2.1 time: 0.154095 Jan 22 21:38:42.058515 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3854/8007] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:41 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:43.075649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f2b7531d-42c7-4061-8c66-3a43010cbee5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:43.076258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f2b7531d-42c7-4061-8c66-3a43010cbee5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:43.083458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2b7531d-42c7-4061-8c66-3a43010cbee5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:43.083913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2b7531d-42c7-4061-8c66-3a43010cbee5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:43.084738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2b7531d-42c7-4061-8c66-3a43010cbee5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:43.085180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2b7531d-42c7-4061-8c66-3a43010cbee5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:43.220302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f2b7531d-42c7-4061-8c66-3a43010cbee5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:43.228507 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f2b7531d-42c7-4061-8c66-3a43010cbee5 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1518 microversion: 2.1 time: 0.156583 Jan 22 21:38:43.229086 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4154/8008] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:43 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:44.244629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e8166e9e-38e6-42d4-b817-306b376e5e48 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:44.246889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e8166e9e-38e6-42d4-b817-306b376e5e48 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:44.252615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8166e9e-38e6-42d4-b817-306b376e5e48 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:44.253083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8166e9e-38e6-42d4-b817-306b376e5e48 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:44.253918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8166e9e-38e6-42d4-b817-306b376e5e48 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:44.254376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8166e9e-38e6-42d4-b817-306b376e5e48 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:44.414573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e8166e9e-38e6-42d4-b817-306b376e5e48 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:44.423227 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e8166e9e-38e6-42d4-b817-306b376e5e48 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1513 microversion: 2.1 time: 0.182240 Jan 22 21:38:44.424117 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3855/8009] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:44 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:45.447922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08d15422-f076-40c1-a37a-90f8146dfeb8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:45.448718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-08d15422-f076-40c1-a37a-90f8146dfeb8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:45.456148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08d15422-f076-40c1-a37a-90f8146dfeb8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:45.457067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08d15422-f076-40c1-a37a-90f8146dfeb8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:45.458291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08d15422-f076-40c1-a37a-90f8146dfeb8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:45.459566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08d15422-f076-40c1-a37a-90f8146dfeb8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:45.629387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-08d15422-f076-40c1-a37a-90f8146dfeb8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:45.634646 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-08d15422-f076-40c1-a37a-90f8146dfeb8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1513 microversion: 2.1 time: 0.189276 Jan 22 21:38:45.634646 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4155/8010] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:45 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:46.001488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-4ff709c4-74ce-4a21-9cb5-43dfa1d806c2 req-cd107b06-40c0-4efd-9af7-d8f5255211d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22c8515-73f5-4d2f-a4c0-f252876a1ae0", "name": "network-vif-plugged", "status": "completed", "tag": "616aa0d5-0133-4131-b99c-2b594f3660ae"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:38:46.003173 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:38:46.003173 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:38:46.011936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4ff709c4-74ce-4a21-9cb5-43dfa1d806c2 req-cd107b06-40c0-4efd-9af7-d8f5255211d5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:46.012775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4ff709c4-74ce-4a21-9cb5-43dfa1d806c2 req-cd107b06-40c0-4efd-9af7-d8f5255211d5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:46.026426 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-4ff709c4-74ce-4a21-9cb5-43dfa1d806c2 req-cd107b06-40c0-4efd-9af7-d8f5255211d5 service nova] Creating event network-vif-plugged:616aa0d5-0133-4131-b99c-2b594f3660ae for instance e22c8515-73f5-4d2f-a4c0-f252876a1ae0 on nch1-master-1 Jan 22 21:38:46.034208 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-4ff709c4-74ce-4a21-9cb5-43dfa1d806c2 req-cd107b06-40c0-4efd-9af7-d8f5255211d5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037571 Jan 22 21:38:46.034824 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3856/8011] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:38:46.651348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fa9a9375-da48-46ef-a105-5d6ba7fa2c15 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:46.652708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fa9a9375-da48-46ef-a105-5d6ba7fa2c15 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:46.661299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa9a9375-da48-46ef-a105-5d6ba7fa2c15 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:46.662999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa9a9375-da48-46ef-a105-5d6ba7fa2c15 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:46.664209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa9a9375-da48-46ef-a105-5d6ba7fa2c15 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:46.664911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fa9a9375-da48-46ef-a105-5d6ba7fa2c15 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:46.821911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fa9a9375-da48-46ef-a105-5d6ba7fa2c15 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:46.830892 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fa9a9375-da48-46ef-a105-5d6ba7fa2c15 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1513 microversion: 2.1 time: 0.184031 Jan 22 21:38:46.831513 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4156/8012] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:46 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:47.851052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f9e6fba0-fe18-481c-b2b7-019af0108f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:47.852392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f9e6fba0-fe18-481c-b2b7-019af0108f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:47.858911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f9e6fba0-fe18-481c-b2b7-019af0108f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:47.860337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f9e6fba0-fe18-481c-b2b7-019af0108f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:47.861197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f9e6fba0-fe18-481c-b2b7-019af0108f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:47.861836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f9e6fba0-fe18-481c-b2b7-019af0108f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:48.012733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f9e6fba0-fe18-481c-b2b7-019af0108f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:48.022962 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f9e6fba0-fe18-481c-b2b7-019af0108f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1513 microversion: 2.1 time: 0.177161 Jan 22 21:38:48.023761 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3857/8013] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:47 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:49.041550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-00dab929-6b90-42bc-931b-53411c23e8a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:49.042288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-00dab929-6b90-42bc-931b-53411c23e8a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:49.050697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00dab929-6b90-42bc-931b-53411c23e8a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:49.051156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00dab929-6b90-42bc-931b-53411c23e8a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:49.053548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00dab929-6b90-42bc-931b-53411c23e8a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:49.053548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00dab929-6b90-42bc-931b-53411c23e8a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:49.212697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-00dab929-6b90-42bc-931b-53411c23e8a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:49.222243 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-00dab929-6b90-42bc-931b-53411c23e8a9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1513 microversion: 2.1 time: 0.185647 Jan 22 21:38:49.222835 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4157/8014] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:49 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:50.239219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-30a27c33-52ea-4d88-b379-5c4bd6b0c07f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:50.240470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-30a27c33-52ea-4d88-b379-5c4bd6b0c07f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:50.247386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30a27c33-52ea-4d88-b379-5c4bd6b0c07f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:50.247847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30a27c33-52ea-4d88-b379-5c4bd6b0c07f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:50.248649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30a27c33-52ea-4d88-b379-5c4bd6b0c07f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:50.249099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30a27c33-52ea-4d88-b379-5c4bd6b0c07f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:50.417578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-30a27c33-52ea-4d88-b379-5c4bd6b0c07f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:50.429017 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-30a27c33-52ea-4d88-b379-5c4bd6b0c07f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1513 microversion: 2.1 time: 0.193588 Jan 22 21:38:50.433008 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3858/8015] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:50 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:51.447908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f76decf-45c6-4a2f-84e4-1449ed30b50a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:51.448533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8f76decf-45c6-4a2f-84e4-1449ed30b50a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:51.456023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f76decf-45c6-4a2f-84e4-1449ed30b50a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:51.456481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f76decf-45c6-4a2f-84e4-1449ed30b50a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:51.457280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f76decf-45c6-4a2f-84e4-1449ed30b50a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:51.457782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f76decf-45c6-4a2f-84e4-1449ed30b50a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:51.624335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8f76decf-45c6-4a2f-84e4-1449ed30b50a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:51.633094 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8f76decf-45c6-4a2f-84e4-1449ed30b50a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1513 microversion: 2.1 time: 0.189953 Jan 22 21:38:51.634027 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4158/8016] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:51 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:52.652539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1f669df9-16ec-42e5-b078-025bf83139ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:52.653090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1f669df9-16ec-42e5-b078-025bf83139ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:52.661492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f669df9-16ec-42e5-b078-025bf83139ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:52.662162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f669df9-16ec-42e5-b078-025bf83139ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:52.663038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f669df9-16ec-42e5-b078-025bf83139ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:52.663499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f669df9-16ec-42e5-b078-025bf83139ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:52.811776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1f669df9-16ec-42e5-b078-025bf83139ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:52.821739 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1f669df9-16ec-42e5-b078-025bf83139ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1513 microversion: 2.1 time: 0.173194 Jan 22 21:38:52.822515 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3859/8017] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:52 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:53.840575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-240b3d41-b16f-4e79-b28a-24f090a74cbb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:53.843509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-240b3d41-b16f-4e79-b28a-24f090a74cbb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:53.849433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-240b3d41-b16f-4e79-b28a-24f090a74cbb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:53.849946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-240b3d41-b16f-4e79-b28a-24f090a74cbb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:53.850741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-240b3d41-b16f-4e79-b28a-24f090a74cbb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:53.851184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-240b3d41-b16f-4e79-b28a-24f090a74cbb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:53.989867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-240b3d41-b16f-4e79-b28a-24f090a74cbb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:53.997226 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-240b3d41-b16f-4e79-b28a-24f090a74cbb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1513 microversion: 2.1 time: 0.160400 Jan 22 21:38:53.997819 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4159/8018] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:53 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:55.014393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9eed85bc-cc36-449f-89e7-2a0efb889d2a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:55.014916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9eed85bc-cc36-449f-89e7-2a0efb889d2a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:55.021930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9eed85bc-cc36-449f-89e7-2a0efb889d2a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:55.022388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9eed85bc-cc36-449f-89e7-2a0efb889d2a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:55.023194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9eed85bc-cc36-449f-89e7-2a0efb889d2a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:55.023641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9eed85bc-cc36-449f-89e7-2a0efb889d2a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:55.161688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9eed85bc-cc36-449f-89e7-2a0efb889d2a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:55.187609 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9eed85bc-cc36-449f-89e7-2a0efb889d2a tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1510 microversion: 2.1 time: 0.158623 Jan 22 21:38:55.187609 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3860/8019] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:55 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:56.187107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a12a1803-0507-40fc-8a1b-98ac5ea00aa8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:56.187663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a12a1803-0507-40fc-8a1b-98ac5ea00aa8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:56.195206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a12a1803-0507-40fc-8a1b-98ac5ea00aa8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:56.195667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a12a1803-0507-40fc-8a1b-98ac5ea00aa8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:56.196476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a12a1803-0507-40fc-8a1b-98ac5ea00aa8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:56.196925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a12a1803-0507-40fc-8a1b-98ac5ea00aa8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:56.336012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a12a1803-0507-40fc-8a1b-98ac5ea00aa8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:56.343376 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a12a1803-0507-40fc-8a1b-98ac5ea00aa8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1510 microversion: 2.1 time: 0.160063 Jan 22 21:38:56.343945 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4160/8020] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:56 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:57.360272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b2935db2-a419-4bba-8250-e52300849283 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:57.361290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b2935db2-a419-4bba-8250-e52300849283 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:57.368182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2935db2-a419-4bba-8250-e52300849283 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:57.368647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2935db2-a419-4bba-8250-e52300849283 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:57.369460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2935db2-a419-4bba-8250-e52300849283 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:57.369934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2935db2-a419-4bba-8250-e52300849283 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:57.504343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b2935db2-a419-4bba-8250-e52300849283 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:57.511969 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b2935db2-a419-4bba-8250-e52300849283 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1510 microversion: 2.1 time: 0.155409 Jan 22 21:38:57.512494 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3861/8021] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:57 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:57.791278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-1d0d0130-bb1b-43da-af7e-687a1ba0db56 req-dc81a702-66e1-43ac-8b4f-df66cca38a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22c8515-73f5-4d2f-a4c0-f252876a1ae0", "name": "network-vif-unplugged", "status": "completed", "tag": "616aa0d5-0133-4131-b99c-2b594f3660ae"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:38:57.792818 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:38:57.792818 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:38:57.801581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1d0d0130-bb1b-43da-af7e-687a1ba0db56 req-dc81a702-66e1-43ac-8b4f-df66cca38a6e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:57.802031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1d0d0130-bb1b-43da-af7e-687a1ba0db56 req-dc81a702-66e1-43ac-8b4f-df66cca38a6e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:57.812809 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-1d0d0130-bb1b-43da-af7e-687a1ba0db56 req-dc81a702-66e1-43ac-8b4f-df66cca38a6e service nova] Creating event network-vif-unplugged:616aa0d5-0133-4131-b99c-2b594f3660ae for instance e22c8515-73f5-4d2f-a4c0-f252876a1ae0 on nch1-master-1 Jan 22 21:38:57.818021 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-1d0d0130-bb1b-43da-af7e-687a1ba0db56 req-dc81a702-66e1-43ac-8b4f-df66cca38a6e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030298 Jan 22 21:38:57.818619 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4161/8022] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:38:58.529550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-188169aa-34d6-42dd-a7f1-efec1644ef00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:58.530204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-188169aa-34d6-42dd-a7f1-efec1644ef00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:58.537426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-188169aa-34d6-42dd-a7f1-efec1644ef00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:58.537921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-188169aa-34d6-42dd-a7f1-efec1644ef00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:58.538726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-188169aa-34d6-42dd-a7f1-efec1644ef00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:58.539198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-188169aa-34d6-42dd-a7f1-efec1644ef00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:58.675745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-188169aa-34d6-42dd-a7f1-efec1644ef00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:58.683079 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-188169aa-34d6-42dd-a7f1-efec1644ef00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 200 len: 1453 microversion: 2.1 time: 0.157284 Jan 22 21:38:58.683668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3862/8023] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:58 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:58.699513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-04f20b2e-d9b1-495b-b0c0-c1f2f6a3e28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:58.700243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-04f20b2e-d9b1-495b-b0c0-c1f2f6a3e28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:58.707073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f20b2e-d9b1-495b-b0c0-c1f2f6a3e28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:58.707555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f20b2e-d9b1-495b-b0c0-c1f2f6a3e28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:58.708339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f20b2e-d9b1-495b-b0c0-c1f2f6a3e28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:58.708781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04f20b2e-d9b1-495b-b0c0-c1f2f6a3e28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:58.839235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-04f20b2e-d9b1-495b-b0c0-c1f2f6a3e28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:58.846611 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-04f20b2e-d9b1-495b-b0c0-c1f2f6a3e28e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.151115 Jan 22 21:38:58.847206 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4162/8024] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:58 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:38:58.868252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b3530253-a6b4-4c21-8dca-c80cd96bc75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:58.868860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b3530253-a6b4-4c21-8dca-c80cd96bc75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:58.875086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3530253-a6b4-4c21-8dca-c80cd96bc75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:58.875553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3530253-a6b4-4c21-8dca-c80cd96bc75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:58.877063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3530253-a6b4-4c21-8dca-c80cd96bc75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:58.877529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3530253-a6b4-4c21-8dca-c80cd96bc75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:59.007558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b3530253-a6b4-4c21-8dca-c80cd96bc75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:59.016267 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b3530253-a6b4-4c21-8dca-c80cd96bc75f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.151692 Jan 22 21:38:59.016849 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3863/8025] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:58 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:38:59.037747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-95fd2c78-f968-4438-8168-3a046b2182bc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:38:59.043798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95fd2c78-f968-4438-8168-3a046b2182bc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:59.044257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95fd2c78-f968-4438-8168-3a046b2182bc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:59.067523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-95fd2c78-f968-4438-8168-3a046b2182bc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Going to try to stop instance {{(pid=137032) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 22 21:38:59.256214 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-95fd2c78-f968-4438-8168-3a046b2182bc tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.221904 Jan 22 21:38:59.256757 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4163/8026] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:38:59 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:38:59.264759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c297e265-f266-4041-9438-2c700018379d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:38:59.265416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c297e265-f266-4041-9438-2c700018379d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:38:59.272027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c297e265-f266-4041-9438-2c700018379d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:59.272484 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c297e265-f266-4041-9438-2c700018379d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:59.273278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c297e265-f266-4041-9438-2c700018379d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:38:59.273754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c297e265-f266-4041-9438-2c700018379d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:38:59.410674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c297e265-f266-4041-9438-2c700018379d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:38:59.418381 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c297e265-f266-4041-9438-2c700018379d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.157436 Jan 22 21:38:59.418976 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3864/8027] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:38:59 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:00.438448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e7bfbf14-fe1c-4d79-bf4f-7b22cdb93997 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:00.439328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e7bfbf14-fe1c-4d79-bf4f-7b22cdb93997 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:00.446288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7bfbf14-fe1c-4d79-bf4f-7b22cdb93997 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:00.446747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7bfbf14-fe1c-4d79-bf4f-7b22cdb93997 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:00.447542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7bfbf14-fe1c-4d79-bf4f-7b22cdb93997 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:00.447991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7bfbf14-fe1c-4d79-bf4f-7b22cdb93997 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:00.586516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e7bfbf14-fe1c-4d79-bf4f-7b22cdb93997 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:00.593965 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e7bfbf14-fe1c-4d79-bf4f-7b22cdb93997 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.160034 Jan 22 21:39:00.594535 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4164/8028] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:00 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:01.611930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48ed5197-c7fe-4c63-abbc-a21cae9fb065 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:01.613199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48ed5197-c7fe-4c63-abbc-a21cae9fb065 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:01.619401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48ed5197-c7fe-4c63-abbc-a21cae9fb065 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:01.625061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48ed5197-c7fe-4c63-abbc-a21cae9fb065 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:01.625061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48ed5197-c7fe-4c63-abbc-a21cae9fb065 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:01.625061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48ed5197-c7fe-4c63-abbc-a21cae9fb065 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:01.755282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-48ed5197-c7fe-4c63-abbc-a21cae9fb065 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:01.762727 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48ed5197-c7fe-4c63-abbc-a21cae9fb065 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.155210 Jan 22 21:39:01.763312 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3865/8029] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:01 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:02.779608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dcf83fc1-e073-4240-9c25-aa87b827ebf7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:02.780347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dcf83fc1-e073-4240-9c25-aa87b827ebf7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:02.787253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dcf83fc1-e073-4240-9c25-aa87b827ebf7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:02.787734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dcf83fc1-e073-4240-9c25-aa87b827ebf7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:02.788526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dcf83fc1-e073-4240-9c25-aa87b827ebf7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:02.788972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dcf83fc1-e073-4240-9c25-aa87b827ebf7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:02.920898 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dcf83fc1-e073-4240-9c25-aa87b827ebf7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:02.928499 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dcf83fc1-e073-4240-9c25-aa87b827ebf7 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.152773 Jan 22 21:39:02.929068 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4165/8030] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:02 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:03.946240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-55ac1173-fcbf-4c49-9b18-79458d79d83f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:03.946852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-55ac1173-fcbf-4c49-9b18-79458d79d83f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:03.953694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55ac1173-fcbf-4c49-9b18-79458d79d83f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:03.954082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55ac1173-fcbf-4c49-9b18-79458d79d83f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:03.954882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55ac1173-fcbf-4c49-9b18-79458d79d83f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:03.955327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55ac1173-fcbf-4c49-9b18-79458d79d83f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:04.089953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-55ac1173-fcbf-4c49-9b18-79458d79d83f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:04.097946 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-55ac1173-fcbf-4c49-9b18-79458d79d83f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.155563 Jan 22 21:39:04.098545 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3866/8031] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:03 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:05.115051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ec53e50e-a543-45b7-9bd6-962d007eb104 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:05.115704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ec53e50e-a543-45b7-9bd6-962d007eb104 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:05.126824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec53e50e-a543-45b7-9bd6-962d007eb104 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:05.127633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec53e50e-a543-45b7-9bd6-962d007eb104 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:05.129033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec53e50e-a543-45b7-9bd6-962d007eb104 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:05.129892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec53e50e-a543-45b7-9bd6-962d007eb104 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:05.267288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ec53e50e-a543-45b7-9bd6-962d007eb104 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:05.275387 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ec53e50e-a543-45b7-9bd6-962d007eb104 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.164171 Jan 22 21:39:05.275955 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4166/8032] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:05 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:06.293195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8345d31d-4240-4717-a83b-29e3da0e9e7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:06.293819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8345d31d-4240-4717-a83b-29e3da0e9e7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:06.301120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8345d31d-4240-4717-a83b-29e3da0e9e7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:06.301606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8345d31d-4240-4717-a83b-29e3da0e9e7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:06.302396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8345d31d-4240-4717-a83b-29e3da0e9e7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:06.302941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8345d31d-4240-4717-a83b-29e3da0e9e7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:06.443750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8345d31d-4240-4717-a83b-29e3da0e9e7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:06.453080 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8345d31d-4240-4717-a83b-29e3da0e9e7d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.163354 Jan 22 21:39:06.453382 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3867/8033] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:06 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:07.470646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f6d1a2a1-87e5-4c0e-ac48-f50730661970 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:07.471259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f6d1a2a1-87e5-4c0e-ac48-f50730661970 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:07.478003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6d1a2a1-87e5-4c0e-ac48-f50730661970 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:07.478456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6d1a2a1-87e5-4c0e-ac48-f50730661970 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:07.479235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6d1a2a1-87e5-4c0e-ac48-f50730661970 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:07.479674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6d1a2a1-87e5-4c0e-ac48-f50730661970 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:07.608330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f6d1a2a1-87e5-4c0e-ac48-f50730661970 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:07.616346 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f6d1a2a1-87e5-4c0e-ac48-f50730661970 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.149538 Jan 22 21:39:07.616914 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4167/8034] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:07 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:08.634992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-55af25b0-4db3-48e3-bfce-bd69a5a11b7c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:08.635674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-55af25b0-4db3-48e3-bfce-bd69a5a11b7c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:08.642419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55af25b0-4db3-48e3-bfce-bd69a5a11b7c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:08.642969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55af25b0-4db3-48e3-bfce-bd69a5a11b7c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:08.644073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55af25b0-4db3-48e3-bfce-bd69a5a11b7c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:08.644522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55af25b0-4db3-48e3-bfce-bd69a5a11b7c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:08.774162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-55af25b0-4db3-48e3-bfce-bd69a5a11b7c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:08.781835 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-55af25b0-4db3-48e3-bfce-bd69a5a11b7c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1683 microversion: 2.1 time: 0.151474 Jan 22 21:39:08.782416 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3868/8035] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:08 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:09.800028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6e400877-c0ba-46fa-846f-aefbd47f6d2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:09.800690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6e400877-c0ba-46fa-846f-aefbd47f6d2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:09.807427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e400877-c0ba-46fa-846f-aefbd47f6d2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:09.807875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e400877-c0ba-46fa-846f-aefbd47f6d2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:09.808652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e400877-c0ba-46fa-846f-aefbd47f6d2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:09.809091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e400877-c0ba-46fa-846f-aefbd47f6d2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:09.944978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6e400877-c0ba-46fa-846f-aefbd47f6d2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:09.952508 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6e400877-c0ba-46fa-846f-aefbd47f6d2d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1660 microversion: 2.1 time: 0.156790 Jan 22 21:39:09.953145 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4168/8036] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:09 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1660 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:09.969468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7c986153-dc91-43c4-b72a-eddc1adaae45 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:39:09.979027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7c986153-dc91-43c4-b72a-eddc1adaae45 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:09.979027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7c986153-dc91-43c4-b72a-eddc1adaae45 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:10.003568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7c986153-dc91-43c4-b72a-eddc1adaae45 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Going to try to start instance {{(pid=137033) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 22 21:39:10.176231 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7c986153-dc91-43c4-b72a-eddc1adaae45 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.210184 Jan 22 21:39:10.176755 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3869/8037] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:39:09 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:39:10.184700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-01649131-b686-4a38-a443-151d85e15cc3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:10.186747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-01649131-b686-4a38-a443-151d85e15cc3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:10.192349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01649131-b686-4a38-a443-151d85e15cc3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:10.192804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01649131-b686-4a38-a443-151d85e15cc3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:10.193631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01649131-b686-4a38-a443-151d85e15cc3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:10.194074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01649131-b686-4a38-a443-151d85e15cc3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:10.334330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-01649131-b686-4a38-a443-151d85e15cc3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:10.341903 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-01649131-b686-4a38-a443-151d85e15cc3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1669 microversion: 2.1 time: 0.160817 Jan 22 21:39:10.342682 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4169/8038] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:10 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:11.361491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4832a25d-a621-4ef8-8df8-3153b6b7dc53 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:11.362380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4832a25d-a621-4ef8-8df8-3153b6b7dc53 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:11.368932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4832a25d-a621-4ef8-8df8-3153b6b7dc53 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:11.369455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4832a25d-a621-4ef8-8df8-3153b6b7dc53 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:11.370272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4832a25d-a621-4ef8-8df8-3153b6b7dc53 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:11.370722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4832a25d-a621-4ef8-8df8-3153b6b7dc53 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:11.509623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4832a25d-a621-4ef8-8df8-3153b6b7dc53 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:11.518661 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4832a25d-a621-4ef8-8df8-3153b6b7dc53 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1669 microversion: 2.1 time: 0.162006 Jan 22 21:39:11.519268 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3870/8039] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:11 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:12.536000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f3711e8b-9c00-4539-be64-eadbf77f93f1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:12.536616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f3711e8b-9c00-4539-be64-eadbf77f93f1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:12.543645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3711e8b-9c00-4539-be64-eadbf77f93f1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:12.544110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3711e8b-9c00-4539-be64-eadbf77f93f1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:12.544903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3711e8b-9c00-4539-be64-eadbf77f93f1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:12.545349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3711e8b-9c00-4539-be64-eadbf77f93f1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:12.683686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f3711e8b-9c00-4539-be64-eadbf77f93f1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:12.691228 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f3711e8b-9c00-4539-be64-eadbf77f93f1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.158935 Jan 22 21:39:12.692591 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4170/8040] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:12 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:12.708403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6b80ae45-4956-462f-afd2-913a3d93536f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:12.709021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6b80ae45-4956-462f-afd2-913a3d93536f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:12.715592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b80ae45-4956-462f-afd2-913a3d93536f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:12.716052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b80ae45-4956-462f-afd2-913a3d93536f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:12.716842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b80ae45-4956-462f-afd2-913a3d93536f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:12.717288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6b80ae45-4956-462f-afd2-913a3d93536f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:12.849476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6b80ae45-4956-462f-afd2-913a3d93536f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:12.856883 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6b80ae45-4956-462f-afd2-913a3d93536f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.152764 Jan 22 21:39:12.857457 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3871/8041] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:12 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:12.874755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8cf10180-c72f-4adb-b42d-d4cf51cd576d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:12.875373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8cf10180-c72f-4adb-b42d-d4cf51cd576d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:12.881567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8cf10180-c72f-4adb-b42d-d4cf51cd576d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:12.881986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8cf10180-c72f-4adb-b42d-d4cf51cd576d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:12.882777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8cf10180-c72f-4adb-b42d-d4cf51cd576d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:12.883227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8cf10180-c72f-4adb-b42d-d4cf51cd576d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:13.015754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8cf10180-c72f-4adb-b42d-d4cf51cd576d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:13.024871 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8cf10180-c72f-4adb-b42d-d4cf51cd576d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.153752 Jan 22 21:39:13.025461 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4171/8042] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:12 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:39:13.042163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-66dd0744-51f2-4248-98f3-3b9cc088d068 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:39:13.042715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-66dd0744-51f2-4248-98f3-3b9cc088d068 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:13.048578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66dd0744-51f2-4248-98f3-3b9cc088d068 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:13.049043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66dd0744-51f2-4248-98f3-3b9cc088d068 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:13.049910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66dd0744-51f2-4248-98f3-3b9cc088d068 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:13.050367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66dd0744-51f2-4248-98f3-3b9cc088d068 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:13.074376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-66dd0744-51f2-4248-98f3-3b9cc088d068 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lazy-loading 'flavor' on Instance uuid a0e98b30-0c8f-4544-9800-71179f1dfed0 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:39:13.279400 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-66dd0744-51f2-4248-98f3-3b9cc088d068 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.240824 Jan 22 21:39:13.280229 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3872/8043] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:39:13 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:39:13.288264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3a728fa8-7edb-444e-b3d6-297266400728 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:13.288887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3a728fa8-7edb-444e-b3d6-297266400728 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:13.295048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a728fa8-7edb-444e-b3d6-297266400728 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:13.295512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a728fa8-7edb-444e-b3d6-297266400728 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:13.296429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a728fa8-7edb-444e-b3d6-297266400728 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:13.296885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a728fa8-7edb-444e-b3d6-297266400728 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:13.432922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3a728fa8-7edb-444e-b3d6-297266400728 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:13.440349 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3a728fa8-7edb-444e-b3d6-297266400728 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1681 microversion: 2.1 time: 0.155900 Jan 22 21:39:13.440922 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4172/8044] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:13 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:14.459928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7bbbab5e-d67a-4a76-a654-cec6a1a83510 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:14.460639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7bbbab5e-d67a-4a76-a654-cec6a1a83510 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:14.467072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bbbab5e-d67a-4a76-a654-cec6a1a83510 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:14.467548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bbbab5e-d67a-4a76-a654-cec6a1a83510 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:14.468342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bbbab5e-d67a-4a76-a654-cec6a1a83510 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:14.468793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bbbab5e-d67a-4a76-a654-cec6a1a83510 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:14.605819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7bbbab5e-d67a-4a76-a654-cec6a1a83510 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:14.614364 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7bbbab5e-d67a-4a76-a654-cec6a1a83510 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1664 microversion: 2.1 time: 0.158664 Jan 22 21:39:14.615106 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3873/8045] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:14 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:39:14.631047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-69157a91-9f30-4aca-beca-90f1497a213e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:39:14.631563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-69157a91-9f30-4aca-beca-90f1497a213e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:14.638326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69157a91-9f30-4aca-beca-90f1497a213e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:14.638788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69157a91-9f30-4aca-beca-90f1497a213e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:14.639616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69157a91-9f30-4aca-beca-90f1497a213e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:14.640064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69157a91-9f30-4aca-beca-90f1497a213e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:14.854871 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-69157a91-9f30-4aca-beca-90f1497a213e tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action" status: 202 len: 0 microversion: 2.1 time: 0.227531 Jan 22 21:39:14.855579 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4173/8046] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:39:14 2022] POST /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:39:14.863354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff625e07-3cab-496d-ace5-8f4fad4a97b3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:14.864006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ff625e07-3cab-496d-ace5-8f4fad4a97b3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:14.870585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff625e07-3cab-496d-ace5-8f4fad4a97b3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:14.871045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff625e07-3cab-496d-ace5-8f4fad4a97b3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:14.871847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff625e07-3cab-496d-ace5-8f4fad4a97b3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:14.872292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff625e07-3cab-496d-ace5-8f4fad4a97b3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:15.005728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ff625e07-3cab-496d-ace5-8f4fad4a97b3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:15.014127 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff625e07-3cab-496d-ace5-8f4fad4a97b3 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1670 microversion: 2.1 time: 0.154415 Jan 22 21:39:15.014712 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3874/8047] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:14 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:15.413109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-01a4c30d-cfe1-425e-bc7b-8dd4cdb222c0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:15.413739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-01a4c30d-cfe1-425e-bc7b-8dd4cdb222c0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:15.420054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01a4c30d-cfe1-425e-bc7b-8dd4cdb222c0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:15.420516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01a4c30d-cfe1-425e-bc7b-8dd4cdb222c0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:15.421318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01a4c30d-cfe1-425e-bc7b-8dd4cdb222c0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:15.421798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01a4c30d-cfe1-425e-bc7b-8dd4cdb222c0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:15.501555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-01a4c30d-cfe1-425e-bc7b-8dd4cdb222c0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lazy-loading 'services' on Instance uuid 8765ddf0-5c8c-489c-a745-ea810d02bd80 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:39:15.633553 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-01a4c30d-cfe1-425e-bc7b-8dd4cdb222c0 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80/os-volume_attachments/f6238c78-261a-421a-b7a2-43273813620f" status: 202 len: 0 microversion: 2.1 time: 0.224396 Jan 22 21:39:15.634222 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4174/8048] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 21:39:15 2022] DELETE /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80/os-volume_attachments/f6238c78-261a-421a-b7a2-43273813620f => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:39:16.032181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e2af4275-3ef9-4f27-b94b-0ff76b1c1754 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:16.032924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e2af4275-3ef9-4f27-b94b-0ff76b1c1754 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:16.040001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2af4275-3ef9-4f27-b94b-0ff76b1c1754 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:16.040468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2af4275-3ef9-4f27-b94b-0ff76b1c1754 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:16.041279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2af4275-3ef9-4f27-b94b-0ff76b1c1754 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:16.041766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2af4275-3ef9-4f27-b94b-0ff76b1c1754 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:16.183807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e2af4275-3ef9-4f27-b94b-0ff76b1c1754 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:16.191441 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e2af4275-3ef9-4f27-b94b-0ff76b1c1754 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1670 microversion: 2.1 time: 0.163308 Jan 22 21:39:16.192010 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3875/8049] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:16 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:16.741226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ca74e73b-c350-4058-9f3a-6ea60ee0b095 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:16.741932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ca74e73b-c350-4058-9f3a-6ea60ee0b095 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:16.749183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca74e73b-c350-4058-9f3a-6ea60ee0b095 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:16.749694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca74e73b-c350-4058-9f3a-6ea60ee0b095 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:16.750499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca74e73b-c350-4058-9f3a-6ea60ee0b095 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:16.751029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca74e73b-c350-4058-9f3a-6ea60ee0b095 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:16.776381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ca74e73b-c350-4058-9f3a-6ea60ee0b095 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:39:17.075232 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ca74e73b-c350-4058-9f3a-6ea60ee0b095 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "DELETE /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 204 len: 0 microversion: 2.1 time: 0.338809 Jan 22 21:39:17.075833 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4175/8050] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:39:16 2022] DELETE /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:39:17.083893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3c8129e1-b890-4bc8-b0fb-7d0d2b20ce0e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:17.090940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3c8129e1-b890-4bc8-b0fb-7d0d2b20ce0e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:17.092480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c8129e1-b890-4bc8-b0fb-7d0d2b20ce0e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:17.092944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c8129e1-b890-4bc8-b0fb-7d0d2b20ce0e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:17.093777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c8129e1-b890-4bc8-b0fb-7d0d2b20ce0e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:17.094228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c8129e1-b890-4bc8-b0fb-7d0d2b20ce0e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:17.211199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3f37526d-20b8-4345-9a3e-aacc2086b3eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:17.212015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3f37526d-20b8-4345-9a3e-aacc2086b3eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:17.217973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f37526d-20b8-4345-9a3e-aacc2086b3eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:17.218506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f37526d-20b8-4345-9a3e-aacc2086b3eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:17.219369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f37526d-20b8-4345-9a3e-aacc2086b3eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:17.219889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f37526d-20b8-4345-9a3e-aacc2086b3eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:17.230549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3c8129e1-b890-4bc8-b0fb-7d0d2b20ce0e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:17.238206 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3c8129e1-b890-4bc8-b0fb-7d0d2b20ce0e tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 200 len: 1517 microversion: 2.1 time: 0.158084 Jan 22 21:39:17.238781 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3876/8051] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:17 2022] GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:17.354267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3f37526d-20b8-4345-9a3e-aacc2086b3eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:17.361644 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3f37526d-20b8-4345-9a3e-aacc2086b3eb tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.155488 Jan 22 21:39:17.362213 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4176/8052] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:17 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:17.377781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7089615a-c087-4b0d-bffa-46c3b66e3203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:17.378407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7089615a-c087-4b0d-bffa-46c3b66e3203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:17.385183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7089615a-c087-4b0d-bffa-46c3b66e3203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:17.385682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7089615a-c087-4b0d-bffa-46c3b66e3203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:17.386483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7089615a-c087-4b0d-bffa-46c3b66e3203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:17.386933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7089615a-c087-4b0d-bffa-46c3b66e3203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:17.516593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7089615a-c087-4b0d-bffa-46c3b66e3203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:17.524735 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7089615a-c087-4b0d-bffa-46c3b66e3203 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1673 microversion: 2.1 time: 0.150643 Jan 22 21:39:17.525304 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3877/8053] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:17 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:17.541657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9f679dd0-97e0-4a70-82d5-951528576a40 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:17.542165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9f679dd0-97e0-4a70-82d5-951528576a40 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:17.548118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f679dd0-97e0-4a70-82d5-951528576a40 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:17.548581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f679dd0-97e0-4a70-82d5-951528576a40 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:17.549371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f679dd0-97e0-4a70-82d5-951528576a40 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:17.549852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f679dd0-97e0-4a70-82d5-951528576a40 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:17.575970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9f679dd0-97e0-4a70-82d5-951528576a40 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:39:17.581597 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.compute.api [None req-9f679dd0-97e0-4a70-82d5-951528576a40 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Working on deleting snapshot f4db732b-b597-4c89-bea8-ba434e0621f7 from shelved instance... Jan 22 21:39:18.255408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b2d0f89c-f3e0-46dc-95e2-f4204bf759f1 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:18.256430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b2d0f89c-f3e0-46dc-95e2-f4204bf759f1 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:18.263492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2d0f89c-f3e0-46dc-95e2-f4204bf759f1 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:18.263950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2d0f89c-f3e0-46dc-95e2-f4204bf759f1 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:18.264830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2d0f89c-f3e0-46dc-95e2-f4204bf759f1 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:18.265225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2d0f89c-f3e0-46dc-95e2-f4204bf759f1 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:18.403386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b2d0f89c-f3e0-46dc-95e2-f4204bf759f1 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:18.412112 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b2d0f89c-f3e0-46dc-95e2-f4204bf759f1 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 200 len: 1517 microversion: 2.1 time: 0.161173 Jan 22 21:39:18.412756 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3878/8054] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:18 2022] GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:39:18.708053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9f679dd0-97e0-4a70-82d5-951528576a40 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Doing local delete in cell 52f5c6ef-d4de-4047-a310-d7aef14748aa(cell1) {{(pid=137032) _delete /opt/stack/nova/nova/compute/api.py:2439}} Jan 22 21:39:18.709415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f679dd0-97e0-4a70-82d5-951528576a40 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:18.710003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f679dd0-97e0-4a70-82d5-951528576a40 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:18.710437 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.compute.api [None req-9f679dd0-97e0-4a70-82d5-951528576a40 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jan 22 21:39:18.718628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-9f679dd0-97e0-4a70-82d5-951528576a40 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] deallocate_for_instance() {{(pid=137032) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Jan 22 21:39:19.312111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-fdd21cdb-8e95-45c2-a6c6-d2736a81e1f9 req-5ad8beb2-8707-4fd3-bc37-eebb54404eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e22c8515-73f5-4d2f-a4c0-f252876a1ae0", "name": "network-vif-deleted", "tag": "616aa0d5-0133-4131-b99c-2b594f3660ae"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:39:19.314592 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:39:19.314592 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:39:19.324966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fdd21cdb-8e95-45c2-a6c6-d2736a81e1f9 req-5ad8beb2-8707-4fd3-bc37-eebb54404eee service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:19.326058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fdd21cdb-8e95-45c2-a6c6-d2736a81e1f9 req-5ad8beb2-8707-4fd3-bc37-eebb54404eee service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:19.338981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.compute.server_external_events [req-fdd21cdb-8e95-45c2-a6c6-d2736a81e1f9 req-5ad8beb2-8707-4fd3-bc37-eebb54404eee service nova] Unable to find a host for instance e22c8515-73f5-4d2f-a4c0-f252876a1ae0. Dropping event network-vif-deleted {{(pid=137033) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 22 21:39:19.340081 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-fdd21cdb-8e95-45c2-a6c6-d2736a81e1f9 req-5ad8beb2-8707-4fd3-bc37-eebb54404eee service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.032196 Jan 22 21:39:19.341330 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3879/8055] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 22 21:39:19.378939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-9f679dd0-97e0-4a70-82d5-951528576a40 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Updating instance_info_cache with network_info: [] {{(pid=137032) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jan 22 21:39:19.441562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9214c5a1-04e3-4a89-ae22-30049eefb5bb tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:19.442188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9214c5a1-04e3-4a89-ae22-30049eefb5bb tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:19.449074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9214c5a1-04e3-4a89-ae22-30049eefb5bb tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:19.450076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9214c5a1-04e3-4a89-ae22-30049eefb5bb tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:19.450890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9214c5a1-04e3-4a89-ae22-30049eefb5bb tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:19.451316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9214c5a1-04e3-4a89-ae22-30049eefb5bb tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:19.565936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9214c5a1-04e3-4a89-ae22-30049eefb5bb tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '912fa15040dc442fa281a72320a10dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037b801bacb742d89e5ea8f5e59ec7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:19.576086 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9214c5a1-04e3-4a89-ae22-30049eefb5bb tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 200 len: 1475 microversion: 2.1 time: 0.150238 Jan 22 21:39:19.577424 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3880/8056] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:19 2022] GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 1475 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:19.582172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-5580cdeb-5b96-4e28-9201-79f7e607af30 req-e456de6b-83f5-475b-bffb-b5b3d1db6091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8765ddf0-5c8c-489c-a745-ea810d02bd80", "name": "network-vif-deleted", "tag": "abe33bb0-e7ed-4829-882f-a1b97d1387f4"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:39:19.583649 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:39:19.583649 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:39:19.591351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5580cdeb-5b96-4e28-9201-79f7e607af30 req-e456de6b-83f5-475b-bffb-b5b3d1db6091 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:19.592047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5580cdeb-5b96-4e28-9201-79f7e607af30 req-e456de6b-83f5-475b-bffb-b5b3d1db6091 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:19.605923 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-5580cdeb-5b96-4e28-9201-79f7e607af30 req-e456de6b-83f5-475b-bffb-b5b3d1db6091 service nova] Creating event network-vif-deleted:abe33bb0-e7ed-4829-882f-a1b97d1387f4 for instance 8765ddf0-5c8c-489c-a745-ea810d02bd80 on nch1-master-1 Jan 22 21:39:19.611533 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-5580cdeb-5b96-4e28-9201-79f7e607af30 req-e456de6b-83f5-475b-bffb-b5b3d1db6091 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032826 Jan 22 21:39:19.614655 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3881/8057] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:39:20.033330 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9f679dd0-97e0-4a70-82d5-951528576a40 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "DELETE /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 204 len: 0 microversion: 2.1 time: 2.495210 Jan 22 21:39:20.039072 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4177/8058] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:39:17 2022] DELETE /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 0 bytes in 2497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:39:20.042735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9c84b607-7013-4d10-806f-918f6f61b5ee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:20.043431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9c84b607-7013-4d10-806f-918f6f61b5ee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: e22c8515-73f5-4d2f-a4c0-f252876a1ae0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:20.050135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c84b607-7013-4d10-806f-918f6f61b5ee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:20.050604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c84b607-7013-4d10-806f-918f6f61b5ee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:20.051416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c84b607-7013-4d10-806f-918f6f61b5ee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:20.051867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c84b607-7013-4d10-806f-918f6f61b5ee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:20.066198 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-9c84b607-7013-4d10-806f-918f6f61b5ee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] HTTP exception thrown: Instance e22c8515-73f5-4d2f-a4c0-f252876a1ae0 could not be found. Jan 22 21:39:20.066795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9c84b607-7013-4d10-806f-918f6f61b5ee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Returning 404 to user: Instance e22c8515-73f5-4d2f-a4c0-f252876a1ae0 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:39:20.067648 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9c84b607-7013-4d10-806f-918f6f61b5ee tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0" status: 404 len: 111 microversion: 2.1 time: 0.029213 Jan 22 21:39:20.069057 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3882/8059] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:20 2022] GET /compute/v2.1/servers/e22c8515-73f5-4d2f-a4c0-f252876a1ae0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:39:20.077307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a930aea3-a375-4000-adb1-2d24c0fc14bf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:20.077920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a930aea3-a375-4000-adb1-2d24c0fc14bf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:20.084214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a930aea3-a375-4000-adb1-2d24c0fc14bf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:20.084803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a930aea3-a375-4000-adb1-2d24c0fc14bf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:20.085621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a930aea3-a375-4000-adb1-2d24c0fc14bf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:20.086059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a930aea3-a375-4000-adb1-2d24c0fc14bf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:20.110510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a930aea3-a375-4000-adb1-2d24c0fc14bf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:39:20.331781 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a930aea3-a375-4000-adb1-2d24c0fc14bf tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "DELETE /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 204 len: 0 microversion: 2.1 time: 0.257519 Jan 22 21:39:20.332430 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4178/8060] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:39:20 2022] DELETE /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:39:20.340371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eec9e39f-3edf-45fb-ba86-3a675ba60f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:20.340995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eec9e39f-3edf-45fb-ba86-3a675ba60f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:20.347878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eec9e39f-3edf-45fb-ba86-3a675ba60f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:20.348342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eec9e39f-3edf-45fb-ba86-3a675ba60f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:20.349951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eec9e39f-3edf-45fb-ba86-3a675ba60f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:20.350648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eec9e39f-3edf-45fb-ba86-3a675ba60f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:20.443378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eec9e39f-3edf-45fb-ba86-3a675ba60f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:20.451179 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eec9e39f-3edf-45fb-ba86-3a675ba60f1c tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1468 microversion: 2.1 time: 0.114542 Jan 22 21:39:20.451938 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3883/8061] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:20 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1468 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:20.594064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-790126aa-a1de-4aac-ae50-8a976bef3715 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:20.594754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-790126aa-a1de-4aac-ae50-8a976bef3715 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] [instance: 8765ddf0-5c8c-489c-a745-ea810d02bd80] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:20.601270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-790126aa-a1de-4aac-ae50-8a976bef3715 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:20.601743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-790126aa-a1de-4aac-ae50-8a976bef3715 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:20.602539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-790126aa-a1de-4aac-ae50-8a976bef3715 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:20.602980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-790126aa-a1de-4aac-ae50-8a976bef3715 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:20.617105 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-790126aa-a1de-4aac-ae50-8a976bef3715 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] HTTP exception thrown: Instance 8765ddf0-5c8c-489c-a745-ea810d02bd80 could not be found. Jan 22 21:39:20.617731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-790126aa-a1de-4aac-ae50-8a976bef3715 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] Returning 404 to user: Instance 8765ddf0-5c8c-489c-a745-ea810d02bd80 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:39:20.618552 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-790126aa-a1de-4aac-ae50-8a976bef3715 tempest-VolumesSnapshotTestJSON-664893185 tempest-VolumesSnapshotTestJSON-664893185-project] 10.222.0.100 "GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80" status: 404 len: 111 microversion: 2.1 time: 0.028577 Jan 22 21:39:20.619115 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4179/8062] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:20 2022] GET /compute/v2.1/servers/8765ddf0-5c8c-489c-a745-ea810d02bd80 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:39:21.468268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-44ec361d-4a89-48e4-838a-47d64f02da2f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:21.468893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-44ec361d-4a89-48e4-838a-47d64f02da2f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:21.477330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44ec361d-4a89-48e4-838a-47d64f02da2f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:21.477759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44ec361d-4a89-48e4-838a-47d64f02da2f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:21.478607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44ec361d-4a89-48e4-838a-47d64f02da2f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:21.479009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44ec361d-4a89-48e4-838a-47d64f02da2f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:21.565528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-44ec361d-4a89-48e4-838a-47d64f02da2f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:21.573670 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-44ec361d-4a89-48e4-838a-47d64f02da2f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1468 microversion: 2.1 time: 0.109273 Jan 22 21:39:21.574457 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3884/8063] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:21 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1468 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:22.436770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-8fcf0e98-0f98-4ab2-a7c1-6502b71e49a3 req-a9d3af13-3700-4e59-a6df-bd7bdd5d1337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af93bae-aa61-4977-a49d-c8d4c9de5e7b", "name": "network-vif-deleted", "tag": "2e8a94ad-27f4-4dfa-b369-5da9f1f84301"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:39:22.439000 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:39:22.439000 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:39:22.451811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8fcf0e98-0f98-4ab2-a7c1-6502b71e49a3 req-a9d3af13-3700-4e59-a6df-bd7bdd5d1337 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:22.452324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8fcf0e98-0f98-4ab2-a7c1-6502b71e49a3 req-a9d3af13-3700-4e59-a6df-bd7bdd5d1337 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:22.463952 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-8fcf0e98-0f98-4ab2-a7c1-6502b71e49a3 req-a9d3af13-3700-4e59-a6df-bd7bdd5d1337 service nova] Creating event network-vif-deleted:2e8a94ad-27f4-4dfa-b369-5da9f1f84301 for instance 6af93bae-aa61-4977-a49d-c8d4c9de5e7b on nch2-master-1 Jan 22 21:39:22.469712 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-8fcf0e98-0f98-4ab2-a7c1-6502b71e49a3 req-a9d3af13-3700-4e59-a6df-bd7bdd5d1337 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036023 Jan 22 21:39:22.469965 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4180/8064] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:39:22.594098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5afe91fa-13bb-4f8d-a3d4-eb4c04783748 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:22.594713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5afe91fa-13bb-4f8d-a3d4-eb4c04783748 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:22.602646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5afe91fa-13bb-4f8d-a3d4-eb4c04783748 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:22.603059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5afe91fa-13bb-4f8d-a3d4-eb4c04783748 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:22.603860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5afe91fa-13bb-4f8d-a3d4-eb4c04783748 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:22.604309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5afe91fa-13bb-4f8d-a3d4-eb4c04783748 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:22.667472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5afe91fa-13bb-4f8d-a3d4-eb4c04783748 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:22.674883 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5afe91fa-13bb-4f8d-a3d4-eb4c04783748 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 200 len: 1303 microversion: 2.1 time: 0.084430 Jan 22 21:39:22.675868 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3885/8065] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:22 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 1303 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:23.694070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7dce3816-1ac1-4c4a-b618-2a8fc515eac9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:23.694700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7dce3816-1ac1-4c4a-b618-2a8fc515eac9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 6af93bae-aa61-4977-a49d-c8d4c9de5e7b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:23.700958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dce3816-1ac1-4c4a-b618-2a8fc515eac9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:23.701416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dce3816-1ac1-4c4a-b618-2a8fc515eac9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:23.702230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dce3816-1ac1-4c4a-b618-2a8fc515eac9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:23.702677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dce3816-1ac1-4c4a-b618-2a8fc515eac9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:23.967572 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-7dce3816-1ac1-4c4a-b618-2a8fc515eac9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] HTTP exception thrown: Instance 6af93bae-aa61-4977-a49d-c8d4c9de5e7b could not be found. Jan 22 21:39:23.968099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7dce3816-1ac1-4c4a-b618-2a8fc515eac9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Returning 404 to user: Instance 6af93bae-aa61-4977-a49d-c8d4c9de5e7b could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:39:23.968941 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7dce3816-1ac1-4c4a-b618-2a8fc515eac9 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b" status: 404 len: 111 microversion: 2.1 time: 0.280020 Jan 22 21:39:23.969521 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4181/8066] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:23 2022] GET /compute/v2.1/servers/6af93bae-aa61-4977-a49d-c8d4c9de5e7b => generated 111 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:39:23.978006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-34a2f487-8e38-4cb4-ae9d-d778358eb18d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:23.978499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-34a2f487-8e38-4cb4-ae9d-d778358eb18d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:23.985463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34a2f487-8e38-4cb4-ae9d-d778358eb18d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:23.985974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34a2f487-8e38-4cb4-ae9d-d778358eb18d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:23.986777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34a2f487-8e38-4cb4-ae9d-d778358eb18d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:23.987227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34a2f487-8e38-4cb4-ae9d-d778358eb18d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:24.013319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-34a2f487-8e38-4cb4-ae9d-d778358eb18d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:39:24.296291 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-34a2f487-8e38-4cb4-ae9d-d778358eb18d tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "DELETE /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 204 len: 0 microversion: 2.1 time: 0.322267 Jan 22 21:39:24.296912 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3886/8067] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:39:23 2022] DELETE /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:39:24.305797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c4d1959f-f1a3-43f5-ad17-cc13ddad7681 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:24.306414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c4d1959f-f1a3-43f5-ad17-cc13ddad7681 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:24.312425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4d1959f-f1a3-43f5-ad17-cc13ddad7681 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:24.312888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4d1959f-f1a3-43f5-ad17-cc13ddad7681 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:24.313700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4d1959f-f1a3-43f5-ad17-cc13ddad7681 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:24.314149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c4d1959f-f1a3-43f5-ad17-cc13ddad7681 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:24.456350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c4d1959f-f1a3-43f5-ad17-cc13ddad7681 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:24.464593 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c4d1959f-f1a3-43f5-ad17-cc13ddad7681 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 200 len: 1511 microversion: 2.1 time: 0.163615 Jan 22 21:39:24.465154 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4182/8068] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:24 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:25.483366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-90b9cd67-3772-43fb-bf14-37f273aef005 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:25.483989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-90b9cd67-3772-43fb-bf14-37f273aef005 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:25.490697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90b9cd67-3772-43fb-bf14-37f273aef005 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:25.492703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90b9cd67-3772-43fb-bf14-37f273aef005 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:25.492703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90b9cd67-3772-43fb-bf14-37f273aef005 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:25.492703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90b9cd67-3772-43fb-bf14-37f273aef005 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:25.631116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-90b9cd67-3772-43fb-bf14-37f273aef005 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:25.639208 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-90b9cd67-3772-43fb-bf14-37f273aef005 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 200 len: 1511 microversion: 2.1 time: 0.160097 Jan 22 21:39:25.639802 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3887/8069] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:25 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:26.424879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-22d2f924-0b7e-4d91-a3db-cccf9edec5e8 req-fa342ddd-42be-426b-bd5f-3c7f35a84321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adbe6f8-1238-4ff9-bfba-add7c7cc36e5", "name": "network-vif-deleted", "tag": "45a9dd8f-2604-4abd-afce-af33d0f4b7a5"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:39:26.426467 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:39:26.426467 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:39:26.434531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-22d2f924-0b7e-4d91-a3db-cccf9edec5e8 req-fa342ddd-42be-426b-bd5f-3c7f35a84321 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:26.434985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-22d2f924-0b7e-4d91-a3db-cccf9edec5e8 req-fa342ddd-42be-426b-bd5f-3c7f35a84321 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:26.446647 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-22d2f924-0b7e-4d91-a3db-cccf9edec5e8 req-fa342ddd-42be-426b-bd5f-3c7f35a84321 service nova] Creating event network-vif-deleted:45a9dd8f-2604-4abd-afce-af33d0f4b7a5 for instance 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 on nch1-master-1 Jan 22 21:39:26.452022 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-22d2f924-0b7e-4d91-a3db-cccf9edec5e8 req-fa342ddd-42be-426b-bd5f-3c7f35a84321 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030583 Jan 22 21:39:26.452713 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4183/8070] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:39:26.657379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4f4c742-6263-4825-a691-04502a121ba8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:26.658036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c4f4c742-6263-4825-a691-04502a121ba8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:26.665399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4f4c742-6263-4825-a691-04502a121ba8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:26.665893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4f4c742-6263-4825-a691-04502a121ba8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:26.666693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4f4c742-6263-4825-a691-04502a121ba8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:26.667138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4f4c742-6263-4825-a691-04502a121ba8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:26.739706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c4f4c742-6263-4825-a691-04502a121ba8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:26.750101 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c4f4c742-6263-4825-a691-04502a121ba8 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 200 len: 1304 microversion: 2.1 time: 0.096647 Jan 22 21:39:26.750686 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3888/8071] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:26 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:27.769337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17e39739-45f4-43ef-aff3-1dfaf6be65ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:27.770120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17e39739-45f4-43ef-aff3-1dfaf6be65ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:27.777199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17e39739-45f4-43ef-aff3-1dfaf6be65ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:27.777703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17e39739-45f4-43ef-aff3-1dfaf6be65ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:27.778498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17e39739-45f4-43ef-aff3-1dfaf6be65ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:27.778946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17e39739-45f4-43ef-aff3-1dfaf6be65ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:27.792969 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-17e39739-45f4-43ef-aff3-1dfaf6be65ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] HTTP exception thrown: Instance 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 could not be found. Jan 22 21:39:27.795461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17e39739-45f4-43ef-aff3-1dfaf6be65ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Returning 404 to user: Instance 4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:39:27.795461 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17e39739-45f4-43ef-aff3-1dfaf6be65ea tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5" status: 404 len: 111 microversion: 2.1 time: 0.030278 Jan 22 21:39:27.795461 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4184/8072] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:27 2022] GET /compute/v2.1/servers/4adbe6f8-1238-4ff9-bfba-add7c7cc36e5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:39:27.802762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b11fbf93-f59b-47aa-9e1f-9ef01442aa79 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:27.803275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b11fbf93-f59b-47aa-9e1f-9ef01442aa79 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:27.810407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b11fbf93-f59b-47aa-9e1f-9ef01442aa79 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:27.810868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b11fbf93-f59b-47aa-9e1f-9ef01442aa79 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:27.811660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b11fbf93-f59b-47aa-9e1f-9ef01442aa79 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:27.812110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b11fbf93-f59b-47aa-9e1f-9ef01442aa79 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:27.841579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b11fbf93-f59b-47aa-9e1f-9ef01442aa79 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:39:28.130844 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b11fbf93-f59b-47aa-9e1f-9ef01442aa79 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "DELETE /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 204 len: 0 microversion: 2.1 time: 0.331400 Jan 22 21:39:28.131449 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3889/8073] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:39:27 2022] DELETE /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:39:28.139956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-357f5cf2-1d12-4972-ad7c-52c8fce93233 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:28.140566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-357f5cf2-1d12-4972-ad7c-52c8fce93233 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:28.146636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-357f5cf2-1d12-4972-ad7c-52c8fce93233 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:28.147082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-357f5cf2-1d12-4972-ad7c-52c8fce93233 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:28.147863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-357f5cf2-1d12-4972-ad7c-52c8fce93233 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:28.148304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-357f5cf2-1d12-4972-ad7c-52c8fce93233 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:28.280579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-357f5cf2-1d12-4972-ad7c-52c8fce93233 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:28.288906 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-357f5cf2-1d12-4972-ad7c-52c8fce93233 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1499 microversion: 2.1 time: 0.151985 Jan 22 21:39:28.289464 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4185/8074] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:28 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1499 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:29.306560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4719900-e348-451d-b518-d6ba494ad0e2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:29.307255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c4719900-e348-451d-b518-d6ba494ad0e2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:29.314102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4719900-e348-451d-b518-d6ba494ad0e2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:29.314551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4719900-e348-451d-b518-d6ba494ad0e2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:29.315336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4719900-e348-451d-b518-d6ba494ad0e2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:29.317428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4719900-e348-451d-b518-d6ba494ad0e2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:29.460642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c4719900-e348-451d-b518-d6ba494ad0e2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:29.466321 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c4719900-e348-451d-b518-d6ba494ad0e2 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1499 microversion: 2.1 time: 0.163797 Jan 22 21:39:29.467116 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3890/8075] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:29 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1499 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:30.279203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-e15b1c3b-ec78-450d-aeeb-782271f2d947 req-e1f3f9b4-c808-4ef5-b7db-4a22927ebf2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c40d759-a058-4e85-9c50-c2a4cc2f479d", "name": "network-vif-deleted", "tag": "7bdd3932-b51d-4ed6-8c48-744e1d3a26eb"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:39:30.281886 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:39:30.281886 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:39:30.292056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e15b1c3b-ec78-450d-aeeb-782271f2d947 req-e1f3f9b4-c808-4ef5-b7db-4a22927ebf2e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:30.292574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e15b1c3b-ec78-450d-aeeb-782271f2d947 req-e1f3f9b4-c808-4ef5-b7db-4a22927ebf2e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:30.304835 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-e15b1c3b-ec78-450d-aeeb-782271f2d947 req-e1f3f9b4-c808-4ef5-b7db-4a22927ebf2e service nova] Creating event network-vif-deleted:7bdd3932-b51d-4ed6-8c48-744e1d3a26eb for instance 3c40d759-a058-4e85-9c50-c2a4cc2f479d on nch1-master-1 Jan 22 21:39:30.309858 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-e15b1c3b-ec78-450d-aeeb-782271f2d947 req-e1f3f9b4-c808-4ef5-b7db-4a22927ebf2e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034658 Jan 22 21:39:30.310539 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4186/8076] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:39:30.482873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bbd13bcf-599a-4759-9662-962b8ce439d6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:30.483410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bbd13bcf-599a-4759-9662-962b8ce439d6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:30.490320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbd13bcf-599a-4759-9662-962b8ce439d6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:30.490789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbd13bcf-599a-4759-9662-962b8ce439d6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:30.492224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbd13bcf-599a-4759-9662-962b8ce439d6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:30.492677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bbd13bcf-599a-4759-9662-962b8ce439d6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:30.557911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bbd13bcf-599a-4759-9662-962b8ce439d6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:30.565619 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bbd13bcf-599a-4759-9662-962b8ce439d6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 200 len: 1291 microversion: 2.1 time: 0.086589 Jan 22 21:39:30.566190 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3891/8077] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:30 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 1291 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:39:31.584444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e420569f-a5ff-4628-b776-3564f768b30b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:31.585900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e420569f-a5ff-4628-b776-3564f768b30b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: 3c40d759-a058-4e85-9c50-c2a4cc2f479d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:31.592284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e420569f-a5ff-4628-b776-3564f768b30b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:31.592783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e420569f-a5ff-4628-b776-3564f768b30b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:31.593611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e420569f-a5ff-4628-b776-3564f768b30b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:31.594063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e420569f-a5ff-4628-b776-3564f768b30b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:31.607585 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-e420569f-a5ff-4628-b776-3564f768b30b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] HTTP exception thrown: Instance 3c40d759-a058-4e85-9c50-c2a4cc2f479d could not be found. Jan 22 21:39:31.608185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e420569f-a5ff-4628-b776-3564f768b30b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Returning 404 to user: Instance 3c40d759-a058-4e85-9c50-c2a4cc2f479d could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:39:31.609010 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e420569f-a5ff-4628-b776-3564f768b30b tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d" status: 404 len: 111 microversion: 2.1 time: 0.029559 Jan 22 21:39:31.614164 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4187/8078] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:31 2022] GET /compute/v2.1/servers/3c40d759-a058-4e85-9c50-c2a4cc2f479d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:39:31.618197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c60799c4-a7c8-41c0-8f0e-57f3985a5a9f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:31.618733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c60799c4-a7c8-41c0-8f0e-57f3985a5a9f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:31.625623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c60799c4-a7c8-41c0-8f0e-57f3985a5a9f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:31.626141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c60799c4-a7c8-41c0-8f0e-57f3985a5a9f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:31.626936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c60799c4-a7c8-41c0-8f0e-57f3985a5a9f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:31.627382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c60799c4-a7c8-41c0-8f0e-57f3985a5a9f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:31.653681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c60799c4-a7c8-41c0-8f0e-57f3985a5a9f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:39:31.966342 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c60799c4-a7c8-41c0-8f0e-57f3985a5a9f tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 204 len: 0 microversion: 2.1 time: 0.352015 Jan 22 21:39:31.966871 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3892/8079] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:39:31 2022] DELETE /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:39:31.974722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9133993f-72a4-4568-9ba6-8b35c6c978b6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:31.975976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9133993f-72a4-4568-9ba6-8b35c6c978b6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:31.982400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9133993f-72a4-4568-9ba6-8b35c6c978b6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:31.982852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9133993f-72a4-4568-9ba6-8b35c6c978b6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:31.983667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9133993f-72a4-4568-9ba6-8b35c6c978b6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:31.984111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9133993f-72a4-4568-9ba6-8b35c6c978b6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:32.143558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9133993f-72a4-4568-9ba6-8b35c6c978b6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:32.151454 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9133993f-72a4-4568-9ba6-8b35c6c978b6 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1679 microversion: 2.1 time: 0.180519 Jan 22 21:39:32.155683 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4188/8080] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:31 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:33.170776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7821dcbd-9aba-44ca-8b0d-c376fd3a9e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:33.171492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7821dcbd-9aba-44ca-8b0d-c376fd3a9e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:33.178409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7821dcbd-9aba-44ca-8b0d-c376fd3a9e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:33.179805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7821dcbd-9aba-44ca-8b0d-c376fd3a9e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:33.180688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7821dcbd-9aba-44ca-8b0d-c376fd3a9e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:33.181140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7821dcbd-9aba-44ca-8b0d-c376fd3a9e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:33.344972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7821dcbd-9aba-44ca-8b0d-c376fd3a9e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:33.344972 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7821dcbd-9aba-44ca-8b0d-c376fd3a9e09 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1679 microversion: 2.1 time: 0.166652 Jan 22 21:39:33.344972 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3893/8081] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:33 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:34.360142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-49abec5d-d0e7-4f71-ad99-2d2f8daffd00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:34.361573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-49abec5d-d0e7-4f71-ad99-2d2f8daffd00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:34.369215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49abec5d-d0e7-4f71-ad99-2d2f8daffd00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:34.372998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49abec5d-d0e7-4f71-ad99-2d2f8daffd00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:34.372998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49abec5d-d0e7-4f71-ad99-2d2f8daffd00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:34.372998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-49abec5d-d0e7-4f71-ad99-2d2f8daffd00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:34.447796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-49abec5d-d0e7-4f71-ad99-2d2f8daffd00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:34.455539 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-49abec5d-d0e7-4f71-ad99-2d2f8daffd00 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1611 microversion: 2.1 time: 0.098963 Jan 22 21:39:34.456647 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4189/8082] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:34 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1611 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:34.980267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-532a8a96-07fa-40cb-a813-4475b06c4e95 req-ccaf9aad-0301-4fe2-b3c3-af1554a1e838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e98b30-0c8f-4544-9800-71179f1dfed0", "name": "network-vif-deleted", "tag": "a39b0c0a-a794-487b-b823-eb2be84c82fa"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:39:34.983153 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:39:34.983153 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:39:34.993052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-532a8a96-07fa-40cb-a813-4475b06c4e95 req-ccaf9aad-0301-4fe2-b3c3-af1554a1e838 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:34.994352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-532a8a96-07fa-40cb-a813-4475b06c4e95 req-ccaf9aad-0301-4fe2-b3c3-af1554a1e838 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:35.005604 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-532a8a96-07fa-40cb-a813-4475b06c4e95 req-ccaf9aad-0301-4fe2-b3c3-af1554a1e838 service nova] Creating event network-vif-deleted:a39b0c0a-a794-487b-b823-eb2be84c82fa for instance a0e98b30-0c8f-4544-9800-71179f1dfed0 on nch2-master-1 Jan 22 21:39:35.011487 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-532a8a96-07fa-40cb-a813-4475b06c4e95 req-ccaf9aad-0301-4fe2-b3c3-af1554a1e838 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036503 Jan 22 21:39:35.012362 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3894/8083] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:39:35.474480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-79b1f67c-4dab-4111-9377-c73062141a27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:35.476041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-79b1f67c-4dab-4111-9377-c73062141a27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:35.483264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79b1f67c-4dab-4111-9377-c73062141a27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:35.484914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79b1f67c-4dab-4111-9377-c73062141a27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:35.484914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79b1f67c-4dab-4111-9377-c73062141a27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:35.485181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79b1f67c-4dab-4111-9377-c73062141a27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:35.520935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79b1f67c-4dab-4111-9377-c73062141a27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:35.521547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79b1f67c-4dab-4111-9377-c73062141a27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:35.522277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-79b1f67c-4dab-4111-9377-c73062141a27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lazy-loading 'fault' on Instance uuid a0e98b30-0c8f-4544-9800-71179f1dfed0 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:39:35.570945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-79b1f67c-4dab-4111-9377-c73062141a27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ace63d7c59243d5abda14fbabd0fbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8242a159f044587a7f8bb2eef2c9914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:35.579032 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-79b1f67c-4dab-4111-9377-c73062141a27 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 200 len: 1332 microversion: 2.1 time: 0.108336 Jan 22 21:39:35.582262 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4190/8084] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:35 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:36.596920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6942cabc-c06e-4204-ad4f-e8a8e1ae0661 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:36.597659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6942cabc-c06e-4204-ad4f-e8a8e1ae0661 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] [instance: a0e98b30-0c8f-4544-9800-71179f1dfed0] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:36.605434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6942cabc-c06e-4204-ad4f-e8a8e1ae0661 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:36.605922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6942cabc-c06e-4204-ad4f-e8a8e1ae0661 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:36.606731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6942cabc-c06e-4204-ad4f-e8a8e1ae0661 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:36.607183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6942cabc-c06e-4204-ad4f-e8a8e1ae0661 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:36.624468 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-6942cabc-c06e-4204-ad4f-e8a8e1ae0661 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] HTTP exception thrown: Instance a0e98b30-0c8f-4544-9800-71179f1dfed0 could not be found. Jan 22 21:39:36.626865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6942cabc-c06e-4204-ad4f-e8a8e1ae0661 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Returning 404 to user: Instance a0e98b30-0c8f-4544-9800-71179f1dfed0 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:39:36.626865 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6942cabc-c06e-4204-ad4f-e8a8e1ae0661 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0" status: 404 len: 111 microversion: 2.1 time: 0.033239 Jan 22 21:39:36.626865 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3895/8085] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:36 2022] GET /compute/v2.1/servers/a0e98b30-0c8f-4544-9800-71179f1dfed0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:39:36.635298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d4476727-1f7d-47da-b3a1-e89165286ab1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] Calling method '.version_select at 0x7f1ed4ae4310>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:36.728121 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d4476727-1f7d-47da-b3a1-e89165286ab1 tempest-ServerActionsTestJSON-1916607750 tempest-ServerActionsTestJSON-1916607750-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-744958505" status: 202 len: 0 microversion: 2.1 time: 0.097175 Jan 22 21:39:36.728810 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4191/8086] 10.222.0.100 () {58 vars in 1222 bytes} [Sat Jan 22 21:39:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-744958505 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:39:44.981262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-872466209", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "41a4289a-b065-4560-b557-720452d5145c"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:39:45.033425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] validate_networks() for [('41a4289a-b065-4560-b557-720452d5145c', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:39:45.384660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:39:45.385086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:39:45.385588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:39:45.386001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:39:45.386473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:39:45.395461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:45.395915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:45.396732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:45.397205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:45.415066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Getting quotas for project 8e0117ced8b44da88c5b9726e789038a. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:39:45.420125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Getting quotas for user 897e75af6fbf4837956b2961cb6ee943 and project 8e0117ced8b44da88c5b9726e789038a. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:39:45.432858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:39:45.435250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:39:45.652276 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-555b63d4-0932-4bc3-b9d3-bdaa8f701b6e tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.790473 Jan 22 21:39:45.652858 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3896/8087] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:39:44 2022] POST /compute/v2.1/servers => generated 382 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:39:45.664260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-449e59c0-70c1-4867-84d3-9192606b9466 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:45.665128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-449e59c0-70c1-4867-84d3-9192606b9466 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:45.717834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-449e59c0-70c1-4867-84d3-9192606b9466 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897e75af6fbf4837956b2961cb6ee943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0117ced8b44da88c5b9726e789038a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:45.724739 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-449e59c0-70c1-4867-84d3-9192606b9466 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 200 len: 1228 microversion: 2.1 time: 0.065653 Jan 22 21:39:45.726386 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4192/8088] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:45 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 1228 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:46.742869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-12d02487-0042-4075-8a2e-992348f02b22 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:46.743494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-12d02487-0042-4075-8a2e-992348f02b22 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:46.795263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-12d02487-0042-4075-8a2e-992348f02b22 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897e75af6fbf4837956b2961cb6ee943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0117ced8b44da88c5b9726e789038a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:46.802113 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-12d02487-0042-4075-8a2e-992348f02b22 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 200 len: 1228 microversion: 2.1 time: 0.064251 Jan 22 21:39:46.802685 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3897/8089] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:46 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 1228 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:39:47.819955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f94ddac3-21ab-421c-9ade-49bf07be7be9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:47.820576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f94ddac3-21ab-421c-9ade-49bf07be7be9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:47.828097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f94ddac3-21ab-421c-9ade-49bf07be7be9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:47.828565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f94ddac3-21ab-421c-9ade-49bf07be7be9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:47.829386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f94ddac3-21ab-421c-9ade-49bf07be7be9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:47.829974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f94ddac3-21ab-421c-9ade-49bf07be7be9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:47.895753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f94ddac3-21ab-421c-9ade-49bf07be7be9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897e75af6fbf4837956b2961cb6ee943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0117ced8b44da88c5b9726e789038a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:47.903891 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f94ddac3-21ab-421c-9ade-49bf07be7be9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 200 len: 1280 microversion: 2.1 time: 0.088371 Jan 22 21:39:47.904467 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4193/8090] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:47 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:48.920472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cd5cd084-4bd2-4c2a-a770-a92759b5ba66 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:48.921005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cd5cd084-4bd2-4c2a-a770-a92759b5ba66 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:48.928654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd5cd084-4bd2-4c2a-a770-a92759b5ba66 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:48.929856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd5cd084-4bd2-4c2a-a770-a92759b5ba66 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:48.930891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd5cd084-4bd2-4c2a-a770-a92759b5ba66 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:48.931340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd5cd084-4bd2-4c2a-a770-a92759b5ba66 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:49.066863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cd5cd084-4bd2-4c2a-a770-a92759b5ba66 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897e75af6fbf4837956b2961cb6ee943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0117ced8b44da88c5b9726e789038a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:49.074667 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cd5cd084-4bd2-4c2a-a770-a92759b5ba66 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 200 len: 1328 microversion: 2.1 time: 0.157958 Jan 22 21:39:49.075244 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3898/8091] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:48 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 1328 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:49.777567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5a8aeae9-5dca-472e-8791-2454b2352eb7 req-02e74ece-944f-4508-8135-feecacfc5b8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c230db6b-ec99-4152-830e-e76bf14d8ba5", "tag": "4668e2d4-f8d0-423f-bf6c-391791a28152"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:39:49.779178 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:39:49.779178 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:39:49.787416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5a8aeae9-5dca-472e-8791-2454b2352eb7 req-02e74ece-944f-4508-8135-feecacfc5b8e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:49.788191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5a8aeae9-5dca-472e-8791-2454b2352eb7 req-02e74ece-944f-4508-8135-feecacfc5b8e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:49.804965 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5a8aeae9-5dca-472e-8791-2454b2352eb7 req-02e74ece-944f-4508-8135-feecacfc5b8e service nova] Creating event network-changed:4668e2d4-f8d0-423f-bf6c-391791a28152 for instance c230db6b-ec99-4152-830e-e76bf14d8ba5 on nch2-master-1 Jan 22 21:39:49.809880 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-5a8aeae9-5dca-472e-8791-2454b2352eb7 req-02e74ece-944f-4508-8135-feecacfc5b8e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036849 Jan 22 21:39:49.810475 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4194/8092] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:39:50.092385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-93c71520-4a8c-4e9e-96f7-fde1739112ee tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:50.093006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-93c71520-4a8c-4e9e-96f7-fde1739112ee tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:50.101518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93c71520-4a8c-4e9e-96f7-fde1739112ee tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:50.101995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93c71520-4a8c-4e9e-96f7-fde1739112ee tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:50.102810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93c71520-4a8c-4e9e-96f7-fde1739112ee tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:50.103265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-93c71520-4a8c-4e9e-96f7-fde1739112ee tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:50.240649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-93c71520-4a8c-4e9e-96f7-fde1739112ee tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897e75af6fbf4837956b2961cb6ee943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0117ced8b44da88c5b9726e789038a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:50.251290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-93c71520-4a8c-4e9e-96f7-fde1739112ee tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 200 len: 1328 microversion: 2.1 time: 0.163386 Jan 22 21:39:50.251973 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3899/8093] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:50 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 1328 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:51.270015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8fc1300f-1d96-4c4f-aa63-fc96cdccb020 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:51.270606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8fc1300f-1d96-4c4f-aa63-fc96cdccb020 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:51.277523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8fc1300f-1d96-4c4f-aa63-fc96cdccb020 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:51.278056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8fc1300f-1d96-4c4f-aa63-fc96cdccb020 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:51.278839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8fc1300f-1d96-4c4f-aa63-fc96cdccb020 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:51.279282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8fc1300f-1d96-4c4f-aa63-fc96cdccb020 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:51.415092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8fc1300f-1d96-4c4f-aa63-fc96cdccb020 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897e75af6fbf4837956b2961cb6ee943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0117ced8b44da88c5b9726e789038a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:51.428556 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8fc1300f-1d96-4c4f-aa63-fc96cdccb020 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 200 len: 1328 microversion: 2.1 time: 0.157565 Jan 22 21:39:51.428556 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4195/8094] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:51 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 1328 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:52.439977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f7087b67-61ed-46cc-a190-04efa7571480 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:52.440604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f7087b67-61ed-46cc-a190-04efa7571480 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:52.448450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7087b67-61ed-46cc-a190-04efa7571480 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:52.448984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7087b67-61ed-46cc-a190-04efa7571480 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:52.451459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7087b67-61ed-46cc-a190-04efa7571480 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:52.451459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7087b67-61ed-46cc-a190-04efa7571480 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:52.581166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f7087b67-61ed-46cc-a190-04efa7571480 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897e75af6fbf4837956b2961cb6ee943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0117ced8b44da88c5b9726e789038a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:52.589173 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f7087b67-61ed-46cc-a190-04efa7571480 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 200 len: 1328 microversion: 2.1 time: 0.153096 Jan 22 21:39:52.589778 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3900/8095] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:52 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 1328 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:53.605893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-53a6d5c5-057c-40e6-a89c-d6facacf6f14 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:53.606512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-53a6d5c5-057c-40e6-a89c-d6facacf6f14 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:53.613284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53a6d5c5-057c-40e6-a89c-d6facacf6f14 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:53.613785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53a6d5c5-057c-40e6-a89c-d6facacf6f14 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:53.619703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53a6d5c5-057c-40e6-a89c-d6facacf6f14 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:53.619703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53a6d5c5-057c-40e6-a89c-d6facacf6f14 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:53.745270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-53a6d5c5-057c-40e6-a89c-d6facacf6f14 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897e75af6fbf4837956b2961cb6ee943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0117ced8b44da88c5b9726e789038a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:53.752668 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-53a6d5c5-057c-40e6-a89c-d6facacf6f14 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 200 len: 1328 microversion: 2.1 time: 0.150589 Jan 22 21:39:53.753240 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4196/8096] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:53 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 1328 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:54.769464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5fcfa6ac-7f5d-4c5b-8ed8-5531f37562f3 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:54.770138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5fcfa6ac-7f5d-4c5b-8ed8-5531f37562f3 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:54.777734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fcfa6ac-7f5d-4c5b-8ed8-5531f37562f3 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:54.778198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fcfa6ac-7f5d-4c5b-8ed8-5531f37562f3 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:54.778995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fcfa6ac-7f5d-4c5b-8ed8-5531f37562f3 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:54.779454 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5fcfa6ac-7f5d-4c5b-8ed8-5531f37562f3 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:54.916696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5fcfa6ac-7f5d-4c5b-8ed8-5531f37562f3 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897e75af6fbf4837956b2961cb6ee943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0117ced8b44da88c5b9726e789038a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:54.924943 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5fcfa6ac-7f5d-4c5b-8ed8-5531f37562f3 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 200 len: 1328 microversion: 2.1 time: 0.159229 Jan 22 21:39:54.926033 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3901/8097] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:54 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 1328 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:55.942590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e5ab6a4-e054-452b-a938-f19f966e23a7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:55.943211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e5ab6a4-e054-452b-a938-f19f966e23a7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:55.951119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e5ab6a4-e054-452b-a938-f19f966e23a7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:55.951590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e5ab6a4-e054-452b-a938-f19f966e23a7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:55.952409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e5ab6a4-e054-452b-a938-f19f966e23a7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:55.952857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e5ab6a4-e054-452b-a938-f19f966e23a7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:56.091747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5e5ab6a4-e054-452b-a938-f19f966e23a7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897e75af6fbf4837956b2961cb6ee943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0117ced8b44da88c5b9726e789038a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:56.100750 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e5ab6a4-e054-452b-a938-f19f966e23a7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 200 len: 1328 microversion: 2.1 time: 0.161796 Jan 22 21:39:56.104729 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4197/8098] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:55 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 1328 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:56.613751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-1cf3681e-ca51-4d0d-af2c-1b0f30a2de0a req-e21f48e5-47ae-45d3-a3f7-50cf3e636466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c230db6b-ec99-4152-830e-e76bf14d8ba5", "name": "network-vif-plugged", "status": "completed", "tag": "4668e2d4-f8d0-423f-bf6c-391791a28152"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:39:56.615499 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:39:56.615499 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:39:56.623537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1cf3681e-ca51-4d0d-af2c-1b0f30a2de0a req-e21f48e5-47ae-45d3-a3f7-50cf3e636466 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:56.623987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1cf3681e-ca51-4d0d-af2c-1b0f30a2de0a req-e21f48e5-47ae-45d3-a3f7-50cf3e636466 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:56.635208 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-1cf3681e-ca51-4d0d-af2c-1b0f30a2de0a req-e21f48e5-47ae-45d3-a3f7-50cf3e636466 service nova] Creating event network-vif-plugged:4668e2d4-f8d0-423f-bf6c-391791a28152 for instance c230db6b-ec99-4152-830e-e76bf14d8ba5 on nch2-master-1 Jan 22 21:39:56.640137 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-1cf3681e-ca51-4d0d-af2c-1b0f30a2de0a req-e21f48e5-47ae-45d3-a3f7-50cf3e636466 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030095 Jan 22 21:39:56.640716 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3902/8099] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:39:57.120651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1cdf2027-3a58-4b29-9093-30b172fdb57d tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:57.121269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1cdf2027-3a58-4b29-9093-30b172fdb57d tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:57.128009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cdf2027-3a58-4b29-9093-30b172fdb57d tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:57.128501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cdf2027-3a58-4b29-9093-30b172fdb57d tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:57.129301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cdf2027-3a58-4b29-9093-30b172fdb57d tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:57.129777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cdf2027-3a58-4b29-9093-30b172fdb57d tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:57.354914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1cdf2027-3a58-4b29-9093-30b172fdb57d tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897e75af6fbf4837956b2961cb6ee943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0117ced8b44da88c5b9726e789038a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:57.362421 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1cdf2027-3a58-4b29-9093-30b172fdb57d tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 200 len: 1328 microversion: 2.1 time: 0.245856 Jan 22 21:39:57.362987 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4198/8100] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:57 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 1328 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:58.380256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1bc44980-c39e-48f6-bd7f-750ed682c8c9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:58.380968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1bc44980-c39e-48f6-bd7f-750ed682c8c9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:58.388513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bc44980-c39e-48f6-bd7f-750ed682c8c9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:58.388976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bc44980-c39e-48f6-bd7f-750ed682c8c9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:58.389846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bc44980-c39e-48f6-bd7f-750ed682c8c9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:58.390296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bc44980-c39e-48f6-bd7f-750ed682c8c9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:58.532546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1bc44980-c39e-48f6-bd7f-750ed682c8c9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897e75af6fbf4837956b2961cb6ee943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0117ced8b44da88c5b9726e789038a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:58.540243 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1bc44980-c39e-48f6-bd7f-750ed682c8c9 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 200 len: 1525 microversion: 2.1 time: 0.164956 Jan 22 21:39:58.540829 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3903/8101] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:58 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 1525 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:39:58.557009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-00136d38-0ca5-4e74-ae40-5229b0728ed7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:58.557557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-00136d38-0ca5-4e74-ae40-5229b0728ed7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:58.564402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00136d38-0ca5-4e74-ae40-5229b0728ed7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:58.564857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00136d38-0ca5-4e74-ae40-5229b0728ed7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:58.565683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00136d38-0ca5-4e74-ae40-5229b0728ed7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:58.566125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00136d38-0ca5-4e74-ae40-5229b0728ed7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:58.590385 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-00136d38-0ca5-4e74-ae40-5229b0728ed7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] HTTP exception thrown: Instance is not a member of specified network Jan 22 21:39:58.590982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-00136d38-0ca5-4e74-ae40-5229b0728ed7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Returning 404 to user: Instance is not a member of specified network {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:39:58.591805 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-00136d38-0ca5-4e74-ae40-5229b0728ed7 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.038751 Jan 22 21:39:58.592369 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4199/8102] 10.222.0.100 () {58 vars in 1276 bytes} [Sat Jan 22 21:39:58 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5/ips/invalid => generated 91 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:39:58.601409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-31bb966c-ea94-4c54-9143-a59ec3d4a0d8 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:58.601988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-31bb966c-ea94-4c54-9143-a59ec3d4a0d8 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Failed to fetch instance by id 999 {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2871}} Jan 22 21:39:58.602512 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-31bb966c-ea94-4c54-9143-a59ec3d4a0d8 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] HTTP exception thrown: Instance 999 could not be found. Jan 22 21:39:58.603081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-31bb966c-ea94-4c54-9143-a59ec3d4a0d8 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Returning 404 to user: Instance 999 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:39:58.603891 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-31bb966c-ea94-4c54-9143-a59ec3d4a0d8 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.006376 Jan 22 21:39:58.604405 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3904/8103] 10.222.0.100 () {58 vars in 1153 bytes} [Sat Jan 22 21:39:58 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 7 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 22 21:39:58.613148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-df29dcc5-b39f-4619-9fec-f2efed176de1 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:58.613754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-df29dcc5-b39f-4619-9fec-f2efed176de1 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:58.620727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df29dcc5-b39f-4619-9fec-f2efed176de1 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:58.621230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df29dcc5-b39f-4619-9fec-f2efed176de1 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:58.622056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df29dcc5-b39f-4619-9fec-f2efed176de1 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:58.622499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-df29dcc5-b39f-4619-9fec-f2efed176de1 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:58.649047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-df29dcc5-b39f-4619-9fec-f2efed176de1 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:39:58.869474 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-df29dcc5-b39f-4619-9fec-f2efed176de1 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 204 len: 0 microversion: 2.1 time: 0.259629 Jan 22 21:39:58.870096 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4200/8104] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:39:58 2022] DELETE /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:39:58.878007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c3ffee92-961c-48ef-a861-a32940a3b5dd tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:39:58.879106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c3ffee92-961c-48ef-a861-a32940a3b5dd tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:39:58.885473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3ffee92-961c-48ef-a861-a32940a3b5dd tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:58.885961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3ffee92-961c-48ef-a861-a32940a3b5dd tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:58.886759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3ffee92-961c-48ef-a861-a32940a3b5dd tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:39:58.887209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c3ffee92-961c-48ef-a861-a32940a3b5dd tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:39:59.020340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c3ffee92-961c-48ef-a861-a32940a3b5dd tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897e75af6fbf4837956b2961cb6ee943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0117ced8b44da88c5b9726e789038a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:39:59.028741 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c3ffee92-961c-48ef-a861-a32940a3b5dd tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 200 len: 1531 microversion: 2.1 time: 0.154363 Jan 22 21:39:59.029318 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3905/8105] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:39:58 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 1531 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:00.047211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a9f8ee27-0f99-4a50-9cf7-84dc30f97980 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:00.047921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a9f8ee27-0f99-4a50-9cf7-84dc30f97980 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:00.054667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9f8ee27-0f99-4a50-9cf7-84dc30f97980 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:00.055169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9f8ee27-0f99-4a50-9cf7-84dc30f97980 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:00.060063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9f8ee27-0f99-4a50-9cf7-84dc30f97980 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:00.060063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9f8ee27-0f99-4a50-9cf7-84dc30f97980 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:00.193653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a9f8ee27-0f99-4a50-9cf7-84dc30f97980 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897e75af6fbf4837956b2961cb6ee943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0117ced8b44da88c5b9726e789038a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:00.201700 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a9f8ee27-0f99-4a50-9cf7-84dc30f97980 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 200 len: 1531 microversion: 2.1 time: 0.158559 Jan 22 21:40:00.202275 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4201/8106] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:40:00 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 1531 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:00.923514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-21a6f3f4-3648-41d9-8b12-f4166a2fec53 req-912dea96-bee5-4b3d-b5ce-dbc9170b7006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c230db6b-ec99-4152-830e-e76bf14d8ba5", "name": "network-vif-deleted", "tag": "4668e2d4-f8d0-423f-bf6c-391791a28152"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:40:00.926851 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:40:00.926851 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:40:00.932305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-21a6f3f4-3648-41d9-8b12-f4166a2fec53 req-912dea96-bee5-4b3d-b5ce-dbc9170b7006 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:00.932755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-21a6f3f4-3648-41d9-8b12-f4166a2fec53 req-912dea96-bee5-4b3d-b5ce-dbc9170b7006 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:00.943969 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-21a6f3f4-3648-41d9-8b12-f4166a2fec53 req-912dea96-bee5-4b3d-b5ce-dbc9170b7006 service nova] Creating event network-vif-deleted:4668e2d4-f8d0-423f-bf6c-391791a28152 for instance c230db6b-ec99-4152-830e-e76bf14d8ba5 on nch2-master-1 Jan 22 21:40:00.949088 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-21a6f3f4-3648-41d9-8b12-f4166a2fec53 req-912dea96-bee5-4b3d-b5ce-dbc9170b7006 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118319 Jan 22 21:40:00.949719 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3906/8107] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:01.218661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0946afdf-01ff-4f7d-9a82-0b500b8426a5 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:01.219259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0946afdf-01ff-4f7d-9a82-0b500b8426a5 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:01.226008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0946afdf-01ff-4f7d-9a82-0b500b8426a5 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:01.226461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0946afdf-01ff-4f7d-9a82-0b500b8426a5 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:01.227308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0946afdf-01ff-4f7d-9a82-0b500b8426a5 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:01.227684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0946afdf-01ff-4f7d-9a82-0b500b8426a5 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:01.259113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0946afdf-01ff-4f7d-9a82-0b500b8426a5 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:01.259573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0946afdf-01ff-4f7d-9a82-0b500b8426a5 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:01.260019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-0946afdf-01ff-4f7d-9a82-0b500b8426a5 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lazy-loading 'fault' on Instance uuid c230db6b-ec99-4152-830e-e76bf14d8ba5 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:40:01.302439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0946afdf-01ff-4f7d-9a82-0b500b8426a5 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897e75af6fbf4837956b2961cb6ee943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0117ced8b44da88c5b9726e789038a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:01.310108 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0946afdf-01ff-4f7d-9a82-0b500b8426a5 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 200 len: 1318 microversion: 2.1 time: 0.095072 Jan 22 21:40:01.316861 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4202/8108] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:40:01 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 1318 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:02.328422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6202dad1-6b2f-476e-8fc3-2ba84b470c79 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:02.329123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6202dad1-6b2f-476e-8fc3-2ba84b470c79 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] [instance: c230db6b-ec99-4152-830e-e76bf14d8ba5] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:02.335568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6202dad1-6b2f-476e-8fc3-2ba84b470c79 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:02.336064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6202dad1-6b2f-476e-8fc3-2ba84b470c79 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:02.337712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6202dad1-6b2f-476e-8fc3-2ba84b470c79 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:02.338192 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6202dad1-6b2f-476e-8fc3-2ba84b470c79 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:02.351788 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-6202dad1-6b2f-476e-8fc3-2ba84b470c79 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] HTTP exception thrown: Instance c230db6b-ec99-4152-830e-e76bf14d8ba5 could not be found. Jan 22 21:40:02.352567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6202dad1-6b2f-476e-8fc3-2ba84b470c79 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] Returning 404 to user: Instance c230db6b-ec99-4152-830e-e76bf14d8ba5 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:40:02.353428 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6202dad1-6b2f-476e-8fc3-2ba84b470c79 tempest-ServerAddressesNegativeTestJSON-1558293966 tempest-ServerAddressesNegativeTestJSON-1558293966-project] 10.222.0.100 "GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5" status: 404 len: 111 microversion: 2.1 time: 0.030050 Jan 22 21:40:02.354004 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3907/8109] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:40:02 2022] GET /compute/v2.1/servers/c230db6b-ec99-4152-830e-e76bf14d8ba5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:40:06.562247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-2049910858", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "9ae46ef8-8c67-459f-9422-1f40743a1e88"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:40:06.614843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] validate_networks() for [('9ae46ef8-8c67-459f-9422-1f40743a1e88', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:40:06.967047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:40:06.967482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:40:06.968000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:40:06.968423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:40:06.968850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:40:06.978300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:06.979278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:06.979570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:06.980027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:06.997288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Getting quotas for project ad79ba026c514dae94cb7cd8ba312da3. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:40:07.002457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Getting quotas for user add2f83347eb4173884e9307af324d49 and project ad79ba026c514dae94cb7cd8ba312da3. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:40:07.014603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:40:07.017083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:40:07.134040 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-89b325b9-13a4-40cd-8d30-9a169d348c76 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.26 time: 0.725396 Jan 22 21:40:07.135029 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4203/8110] 10.222.0.100 () {62 vars in 1192 bytes} [Sat Jan 22 21:40:06 2022] POST /compute/v2.1/servers => generated 382 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 22 21:40:07.145013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e74ba853-4266-450d-8a23-7f53c7a50209 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:07.146535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e74ba853-4266-450d-8a23-7f53c7a50209 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:07.274879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e74ba853-4266-450d-8a23-7f53c7a50209 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:07.284200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e74ba853-4266-450d-8a23-7f53c7a50209 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:07.285764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e74ba853-4266-450d-8a23-7f53c7a50209 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:07.286925 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e74ba853-4266-450d-8a23-7f53c7a50209 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 200 len: 1266 microversion: 2.26 time: 0.145782 Jan 22 21:40:07.287487 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3908/8111] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:40:07 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 22 21:40:08.306103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a6e8ff64-533f-4c4e-9639-e0be307e049c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:08.306779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a6e8ff64-533f-4c4e-9639-e0be307e049c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:08.361113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a6e8ff64-533f-4c4e-9639-e0be307e049c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:08.368401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a6e8ff64-533f-4c4e-9639-e0be307e049c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:08.369977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a6e8ff64-533f-4c4e-9639-e0be307e049c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:08.371226 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a6e8ff64-533f-4c4e-9639-e0be307e049c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 200 len: 1266 microversion: 2.26 time: 0.069786 Jan 22 21:40:08.371784 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4204/8112] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:40:08 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 1266 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:40:09.391041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3245ed2e-c04f-40f1-84fc-1c218363349b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:09.392231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3245ed2e-c04f-40f1-84fc-1c218363349b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:09.402093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3245ed2e-c04f-40f1-84fc-1c218363349b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:09.405188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3245ed2e-c04f-40f1-84fc-1c218363349b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:09.405188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3245ed2e-c04f-40f1-84fc-1c218363349b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:09.405188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3245ed2e-c04f-40f1-84fc-1c218363349b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:09.473600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3245ed2e-c04f-40f1-84fc-1c218363349b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:09.482957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3245ed2e-c04f-40f1-84fc-1c218363349b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:09.484639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3245ed2e-c04f-40f1-84fc-1c218363349b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:09.485837 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3245ed2e-c04f-40f1-84fc-1c218363349b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 200 len: 1326 microversion: 2.26 time: 0.099261 Jan 22 21:40:09.486539 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3909/8113] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:40:09 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:40:10.504308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2d15124f-9ddd-4175-881e-3c36bdd06a4c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:10.504938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2d15124f-9ddd-4175-881e-3c36bdd06a4c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:10.512548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d15124f-9ddd-4175-881e-3c36bdd06a4c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:10.513005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d15124f-9ddd-4175-881e-3c36bdd06a4c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:10.513822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d15124f-9ddd-4175-881e-3c36bdd06a4c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:10.514268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d15124f-9ddd-4175-881e-3c36bdd06a4c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:10.734551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2d15124f-9ddd-4175-881e-3c36bdd06a4c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:10.743147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2d15124f-9ddd-4175-881e-3c36bdd06a4c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:10.744757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2d15124f-9ddd-4175-881e-3c36bdd06a4c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:10.745941 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2d15124f-9ddd-4175-881e-3c36bdd06a4c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 200 len: 1366 microversion: 2.26 time: 0.245371 Jan 22 21:40:10.746506 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4205/8114] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:40:10 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:40:10.964523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-66e58029-5824-49fe-9c22-d35ccaf1bef0 req-7964910e-5520-4afb-bbbb-1aab48814130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25371ff1-9717-4d04-886b-b825467726c1", "tag": "cb21cab8-2020-4ebe-8885-cccc078a30d1"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:40:10.967076 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:40:10.967076 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:40:10.974766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-66e58029-5824-49fe-9c22-d35ccaf1bef0 req-7964910e-5520-4afb-bbbb-1aab48814130 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:10.975222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-66e58029-5824-49fe-9c22-d35ccaf1bef0 req-7964910e-5520-4afb-bbbb-1aab48814130 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:10.987378 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-66e58029-5824-49fe-9c22-d35ccaf1bef0 req-7964910e-5520-4afb-bbbb-1aab48814130 service nova] Creating event network-changed:cb21cab8-2020-4ebe-8885-cccc078a30d1 for instance 25371ff1-9717-4d04-886b-b825467726c1 on nch2-master-1 Jan 22 21:40:10.992063 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-66e58029-5824-49fe-9c22-d35ccaf1bef0 req-7964910e-5520-4afb-bbbb-1aab48814130 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032949 Jan 22 21:40:10.993254 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3910/8115] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:11.770160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19222356-c871-4d62-a34c-c29ba7c573d7 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:11.770778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-19222356-c871-4d62-a34c-c29ba7c573d7 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:11.777842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19222356-c871-4d62-a34c-c29ba7c573d7 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:11.778301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19222356-c871-4d62-a34c-c29ba7c573d7 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:11.779093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19222356-c871-4d62-a34c-c29ba7c573d7 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:11.779805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19222356-c871-4d62-a34c-c29ba7c573d7 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:11.915305 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-19222356-c871-4d62-a34c-c29ba7c573d7 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:11.923249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-19222356-c871-4d62-a34c-c29ba7c573d7 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:11.924774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-19222356-c871-4d62-a34c-c29ba7c573d7 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:11.925937 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19222356-c871-4d62-a34c-c29ba7c573d7 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 200 len: 1366 microversion: 2.26 time: 0.159541 Jan 22 21:40:11.926499 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4206/8116] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:40:11 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:40:12.945631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e7e29dab-de47-4892-b565-ab06e5217402 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:12.946451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e7e29dab-de47-4892-b565-ab06e5217402 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:12.952656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7e29dab-de47-4892-b565-ab06e5217402 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:12.953119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7e29dab-de47-4892-b565-ab06e5217402 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:12.953955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7e29dab-de47-4892-b565-ab06e5217402 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:12.954404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e7e29dab-de47-4892-b565-ab06e5217402 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:13.086702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e7e29dab-de47-4892-b565-ab06e5217402 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:13.094644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e7e29dab-de47-4892-b565-ab06e5217402 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:13.096163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e7e29dab-de47-4892-b565-ab06e5217402 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:13.097304 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e7e29dab-de47-4892-b565-ab06e5217402 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 200 len: 1366 microversion: 2.26 time: 0.156805 Jan 22 21:40:13.097907 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3911/8117] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:40:12 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:40:14.116191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-44053c91-6dae-4fea-ba18-823031521f38 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:14.116834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-44053c91-6dae-4fea-ba18-823031521f38 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:14.124373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44053c91-6dae-4fea-ba18-823031521f38 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:14.124842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44053c91-6dae-4fea-ba18-823031521f38 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:14.125677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44053c91-6dae-4fea-ba18-823031521f38 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:14.126134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44053c91-6dae-4fea-ba18-823031521f38 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:14.256725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-44053c91-6dae-4fea-ba18-823031521f38 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:14.264694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-44053c91-6dae-4fea-ba18-823031521f38 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:14.266232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-44053c91-6dae-4fea-ba18-823031521f38 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:14.267388 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-44053c91-6dae-4fea-ba18-823031521f38 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 200 len: 1366 microversion: 2.26 time: 0.155080 Jan 22 21:40:14.267944 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4207/8118] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:40:14 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:40:15.285935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f286d3b4-36b3-42d2-b174-cefec8a53b37 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:15.286712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f286d3b4-36b3-42d2-b174-cefec8a53b37 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:15.294156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f286d3b4-36b3-42d2-b174-cefec8a53b37 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:15.294613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f286d3b4-36b3-42d2-b174-cefec8a53b37 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:15.295407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f286d3b4-36b3-42d2-b174-cefec8a53b37 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:15.295853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f286d3b4-36b3-42d2-b174-cefec8a53b37 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:15.429373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f286d3b4-36b3-42d2-b174-cefec8a53b37 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:15.438039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f286d3b4-36b3-42d2-b174-cefec8a53b37 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:15.439560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f286d3b4-36b3-42d2-b174-cefec8a53b37 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:15.440737 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f286d3b4-36b3-42d2-b174-cefec8a53b37 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 200 len: 1366 microversion: 2.26 time: 0.158596 Jan 22 21:40:15.441305 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3912/8119] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:40:15 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:40:16.459729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7c8d06cf-13dc-4776-96e4-b7dd249c0263 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:16.462776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7c8d06cf-13dc-4776-96e4-b7dd249c0263 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:16.467341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c8d06cf-13dc-4776-96e4-b7dd249c0263 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:16.467890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c8d06cf-13dc-4776-96e4-b7dd249c0263 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:16.468780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c8d06cf-13dc-4776-96e4-b7dd249c0263 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:16.469307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c8d06cf-13dc-4776-96e4-b7dd249c0263 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:16.612366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7c8d06cf-13dc-4776-96e4-b7dd249c0263 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:16.620507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7c8d06cf-13dc-4776-96e4-b7dd249c0263 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:16.622038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7c8d06cf-13dc-4776-96e4-b7dd249c0263 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:16.623572 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7c8d06cf-13dc-4776-96e4-b7dd249c0263 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 200 len: 1366 microversion: 2.26 time: 0.167369 Jan 22 21:40:16.625555 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4208/8120] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:40:16 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:40:16.678717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-ac9bab6a-82d4-4016-a958-a31b97760aa2 req-b426b10c-ab98-4b59-9945-093570d2d386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25371ff1-9717-4d04-886b-b825467726c1", "name": "network-vif-plugged", "status": "completed", "tag": "cb21cab8-2020-4ebe-8885-cccc078a30d1"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:40:16.680352 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:40:16.680352 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:40:16.688505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-ac9bab6a-82d4-4016-a958-a31b97760aa2 req-b426b10c-ab98-4b59-9945-093570d2d386 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:16.688958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-ac9bab6a-82d4-4016-a958-a31b97760aa2 req-b426b10c-ab98-4b59-9945-093570d2d386 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:16.703391 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-ac9bab6a-82d4-4016-a958-a31b97760aa2 req-b426b10c-ab98-4b59-9945-093570d2d386 service nova] Creating event network-vif-plugged:cb21cab8-2020-4ebe-8885-cccc078a30d1 for instance 25371ff1-9717-4d04-886b-b825467726c1 on nch2-master-1 Jan 22 21:40:16.709261 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-ac9bab6a-82d4-4016-a958-a31b97760aa2 req-b426b10c-ab98-4b59-9945-093570d2d386 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034306 Jan 22 21:40:16.709914 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3913/8121] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:17.643556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e45cb045-03ac-4874-bb7e-341399003729 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:17.644089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e45cb045-03ac-4874-bb7e-341399003729 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:17.652059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e45cb045-03ac-4874-bb7e-341399003729 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:17.652597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e45cb045-03ac-4874-bb7e-341399003729 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:17.653398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e45cb045-03ac-4874-bb7e-341399003729 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:17.653865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e45cb045-03ac-4874-bb7e-341399003729 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:17.785846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e45cb045-03ac-4874-bb7e-341399003729 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:17.794711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e45cb045-03ac-4874-bb7e-341399003729 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:17.796234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e45cb045-03ac-4874-bb7e-341399003729 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:17.797434 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e45cb045-03ac-4874-bb7e-341399003729 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 200 len: 1366 microversion: 2.26 time: 0.157756 Jan 22 21:40:17.798021 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4209/8122] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:40:17 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:40:18.816665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d942e146-6388-4630-a6f0-0dc6f6ed24a8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:18.817358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d942e146-6388-4630-a6f0-0dc6f6ed24a8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:18.825054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d942e146-6388-4630-a6f0-0dc6f6ed24a8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:18.825526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d942e146-6388-4630-a6f0-0dc6f6ed24a8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:18.826313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d942e146-6388-4630-a6f0-0dc6f6ed24a8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:18.826752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d942e146-6388-4630-a6f0-0dc6f6ed24a8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.224635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d942e146-6388-4630-a6f0-0dc6f6ed24a8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:19.232983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d942e146-6388-4630-a6f0-0dc6f6ed24a8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:19.234656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d942e146-6388-4630-a6f0-0dc6f6ed24a8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:19.235975 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d942e146-6388-4630-a6f0-0dc6f6ed24a8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 200 len: 1550 microversion: 2.26 time: 0.423488 Jan 22 21:40:19.236669 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3914/8123] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:40:18 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 1550 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:40:19.257824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-858b236a-df87-4167-a8f0-ac8040aba5bb tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1ed4a65310>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:19.267654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-858b236a-df87-4167-a8f0-ac8040aba5bb tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.268110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-858b236a-df87-4167-a8f0-ac8040aba5bb tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.268584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-858b236a-df87-4167-a8f0-ac8040aba5bb tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:19.273846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-858b236a-df87-4167-a8f0-ac8040aba5bb tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.274299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-858b236a-df87-4167-a8f0-ac8040aba5bb tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.275189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-858b236a-df87-4167-a8f0-ac8040aba5bb tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.275819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-858b236a-df87-4167-a8f0-ac8040aba5bb tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.301290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-858b236a-df87-4167-a8f0-ac8040aba5bb tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.301764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-858b236a-df87-4167-a8f0-ac8040aba5bb tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.315193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-858b236a-df87-4167-a8f0-ac8040aba5bb tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.315604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-858b236a-df87-4167-a8f0-ac8040aba5bb tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.465200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-858b236a-df87-4167-a8f0-ac8040aba5bb tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lazy-loading 'flavor' on Instance uuid 25371ff1-9717-4d04-886b-b825467726c1 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:40:19.481425 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-858b236a-df87-4167-a8f0-ac8040aba5bb tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "PUT /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-82203257" status: 201 len: 0 microversion: 2.26 time: 0.227482 Jan 22 21:40:19.482096 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4210/8124] 10.222.0.100 () {62 vars in 1378 bytes} [Sat Jan 22 21:40:19 2022] PUT /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-82203257 => generated 0 bytes in 229 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jan 22 21:40:19.497121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f9b033f8-9fd9-48f6-bbd1-4d3e3e4fee86 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1edaed7dc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:19.505267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f9b033f8-9fd9-48f6-bbd1-4d3e3e4fee86 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.505752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f9b033f8-9fd9-48f6-bbd1-4d3e3e4fee86 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.520797 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f9b033f8-9fd9-48f6-bbd1-4d3e3e4fee86 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-82203257" status: 204 len: 0 microversion: 2.26 time: 0.028229 Jan 22 21:40:19.523185 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3915/8125] 10.222.0.100 () {60 vars in 1359 bytes} [Sat Jan 22 21:40:19 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-82203257 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:40:19.530492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5eb33d04-f2e9-4950-83dc-5a24dd137184 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1ed4a96160>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:19.538477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eb33d04-f2e9-4950-83dc-5a24dd137184 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.538942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eb33d04-f2e9-4950-83dc-5a24dd137184 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.539418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5eb33d04-f2e9-4950-83dc-5a24dd137184 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:19.545133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eb33d04-f2e9-4950-83dc-5a24dd137184 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.545692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eb33d04-f2e9-4950-83dc-5a24dd137184 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.546469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eb33d04-f2e9-4950-83dc-5a24dd137184 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.546921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eb33d04-f2e9-4950-83dc-5a24dd137184 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.568262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eb33d04-f2e9-4950-83dc-5a24dd137184 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.568722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eb33d04-f2e9-4950-83dc-5a24dd137184 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.670163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-5eb33d04-f2e9-4950-83dc-5a24dd137184 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lazy-loading 'flavor' on Instance uuid 25371ff1-9717-4d04-886b-b825467726c1 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:40:19.685492 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5eb33d04-f2e9-4950-83dc-5a24dd137184 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "DELETE /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags" status: 204 len: 0 microversion: 2.26 time: 0.159165 Jan 22 21:40:19.686286 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4211/8126] 10.222.0.100 () {60 vars in 1299 bytes} [Sat Jan 22 21:40:19 2022] DELETE /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:40:19.695205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff0117ce-412a-4360-8426-509dc4d7ddac tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1ed60945e0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:19.703271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff0117ce-412a-4360-8426-509dc4d7ddac tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.703721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff0117ce-412a-4360-8426-509dc4d7ddac tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.713479 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff0117ce-412a-4360-8426-509dc4d7ddac tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags" status: 200 len: 12 microversion: 2.26 time: 0.022012 Jan 22 21:40:19.714085 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3916/8127] 10.222.0.100 () {60 vars in 1296 bytes} [Sat Jan 22 21:40:19 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags => generated 12 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:19.723641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a1c7360e-1f8d-4a00-b6ae-9b74af3d191c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1ed4bb1820>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:19.732855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1c7360e-1f8d-4a00-b6ae-9b74af3d191c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.733324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1c7360e-1f8d-4a00-b6ae-9b74af3d191c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.733837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a1c7360e-1f8d-4a00-b6ae-9b74af3d191c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:19.739035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1c7360e-1f8d-4a00-b6ae-9b74af3d191c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.739500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1c7360e-1f8d-4a00-b6ae-9b74af3d191c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.740275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1c7360e-1f8d-4a00-b6ae-9b74af3d191c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.740723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1c7360e-1f8d-4a00-b6ae-9b74af3d191c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.763756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1c7360e-1f8d-4a00-b6ae-9b74af3d191c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.764215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1c7360e-1f8d-4a00-b6ae-9b74af3d191c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.772694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1c7360e-1f8d-4a00-b6ae-9b74af3d191c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.773157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1c7360e-1f8d-4a00-b6ae-9b74af3d191c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.883750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-a1c7360e-1f8d-4a00-b6ae-9b74af3d191c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lazy-loading 'flavor' on Instance uuid 25371ff1-9717-4d04-886b-b825467726c1 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:40:19.897881 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a1c7360e-1f8d-4a00-b6ae-9b74af3d191c tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "PUT /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-1709114298" status: 201 len: 0 microversion: 2.26 time: 0.178112 Jan 22 21:40:19.898517 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4212/8128] 10.222.0.100 () {62 vars in 1384 bytes} [Sat Jan 22 21:40:19 2022] PUT /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-1709114298 => generated 0 bytes in 179 msecs (HTTP/1.1 201) 10 headers in 487 bytes (2 switches on core 0) Jan 22 21:40:19.908333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b815abc2-3697-47b1-a063-d10b11fa7c4a tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1edaed73a0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:19.917891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b815abc2-3697-47b1-a063-d10b11fa7c4a tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.918353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b815abc2-3697-47b1-a063-d10b11fa7c4a tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.927713 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b815abc2-3697-47b1-a063-d10b11fa7c4a tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags" status: 200 len: 36 microversion: 2.26 time: 0.023545 Jan 22 21:40:19.928302 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3917/8129] 10.222.0.100 () {60 vars in 1296 bytes} [Sat Jan 22 21:40:19 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags => generated 36 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:19.938505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-37a358e9-6085-42e1-9f86-3edd2dcc9e66 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1ed4a50e50>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:19.946674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37a358e9-6085-42e1-9f86-3edd2dcc9e66 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.947171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37a358e9-6085-42e1-9f86-3edd2dcc9e66 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.947661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-37a358e9-6085-42e1-9f86-3edd2dcc9e66 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:19.953072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37a358e9-6085-42e1-9f86-3edd2dcc9e66 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.953548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37a358e9-6085-42e1-9f86-3edd2dcc9e66 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.954312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37a358e9-6085-42e1-9f86-3edd2dcc9e66 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.954750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37a358e9-6085-42e1-9f86-3edd2dcc9e66 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:19.983134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37a358e9-6085-42e1-9f86-3edd2dcc9e66 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:19.983134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37a358e9-6085-42e1-9f86-3edd2dcc9e66 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.073558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-37a358e9-6085-42e1-9f86-3edd2dcc9e66 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lazy-loading 'flavor' on Instance uuid 25371ff1-9717-4d04-886b-b825467726c1 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:40:20.088016 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-37a358e9-6085-42e1-9f86-3edd2dcc9e66 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "DELETE /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-1709114298" status: 204 len: 0 microversion: 2.26 time: 0.153366 Jan 22 21:40:20.088731 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4213/8130] 10.222.0.100 () {60 vars in 1368 bytes} [Sat Jan 22 21:40:19 2022] DELETE /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-1709114298 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 22 21:40:20.097003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2fe4409e-fbb7-4809-8be5-d5a0739a7f55 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1ed60d9b80>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:20.105728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fe4409e-fbb7-4809-8be5-d5a0739a7f55 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.106195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fe4409e-fbb7-4809-8be5-d5a0739a7f55 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.114990 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2fe4409e-fbb7-4809-8be5-d5a0739a7f55 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags" status: 200 len: 12 microversion: 2.26 time: 0.021877 Jan 22 21:40:20.115589 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3918/8131] 10.222.0.100 () {60 vars in 1296 bytes} [Sat Jan 22 21:40:20 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags => generated 12 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:20.125844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1f717680-0879-42c6-ab3d-fbd41f67b5fc tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1ed4a50af0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:20.134720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f717680-0879-42c6-ab3d-fbd41f67b5fc tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.135783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f717680-0879-42c6-ab3d-fbd41f67b5fc tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.136269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1f717680-0879-42c6-ab3d-fbd41f67b5fc tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:20.145771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f717680-0879-42c6-ab3d-fbd41f67b5fc tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.145771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f717680-0879-42c6-ab3d-fbd41f67b5fc tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.145771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f717680-0879-42c6-ab3d-fbd41f67b5fc tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.145771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f717680-0879-42c6-ab3d-fbd41f67b5fc tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.166673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f717680-0879-42c6-ab3d-fbd41f67b5fc tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.167090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f717680-0879-42c6-ab3d-fbd41f67b5fc tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.177173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-1f717680-0879-42c6-ab3d-fbd41f67b5fc tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lazy-loading 'flavor' on Instance uuid 25371ff1-9717-4d04-886b-b825467726c1 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:40:20.191932 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1f717680-0879-42c6-ab3d-fbd41f67b5fc tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "DELETE /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags" status: 204 len: 0 microversion: 2.26 time: 0.069966 Jan 22 21:40:20.192541 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4214/8132] 10.222.0.100 () {60 vars in 1299 bytes} [Sat Jan 22 21:40:20 2022] DELETE /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:40:20.202690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4adb9d11-ceb4-4b82-b116-bdce805c334b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1edaed74c0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:20.210951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4adb9d11-ceb4-4b82-b116-bdce805c334b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.211420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4adb9d11-ceb4-4b82-b116-bdce805c334b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.211902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4adb9d11-ceb4-4b82-b116-bdce805c334b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:20.217812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4adb9d11-ceb4-4b82-b116-bdce805c334b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.218273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4adb9d11-ceb4-4b82-b116-bdce805c334b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.219053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4adb9d11-ceb4-4b82-b116-bdce805c334b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.219506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4adb9d11-ceb4-4b82-b116-bdce805c334b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.242582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4adb9d11-ceb4-4b82-b116-bdce805c334b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.242973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4adb9d11-ceb4-4b82-b116-bdce805c334b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.251370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4adb9d11-ceb4-4b82-b116-bdce805c334b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.251824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4adb9d11-ceb4-4b82-b116-bdce805c334b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.365844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-4adb9d11-ceb4-4b82-b116-bdce805c334b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lazy-loading 'flavor' on Instance uuid 25371ff1-9717-4d04-886b-b825467726c1 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:40:20.383892 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4adb9d11-ceb4-4b82-b116-bdce805c334b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "PUT /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-928432704" status: 201 len: 0 microversion: 2.26 time: 0.184998 Jan 22 21:40:20.389464 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3919/8133] 10.222.0.100 () {62 vars in 1381 bytes} [Sat Jan 22 21:40:20 2022] PUT /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-928432704 => generated 0 bytes in 187 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jan 22 21:40:20.394682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-922d0b34-abbf-4c9c-bffc-4563450a49b1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1ed4a18ee0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:20.405325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-922d0b34-abbf-4c9c-bffc-4563450a49b1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.405839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-922d0b34-abbf-4c9c-bffc-4563450a49b1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.406323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-922d0b34-abbf-4c9c-bffc-4563450a49b1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:20.411527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-922d0b34-abbf-4c9c-bffc-4563450a49b1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.411986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-922d0b34-abbf-4c9c-bffc-4563450a49b1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.412804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-922d0b34-abbf-4c9c-bffc-4563450a49b1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.413257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-922d0b34-abbf-4c9c-bffc-4563450a49b1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.438897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-922d0b34-abbf-4c9c-bffc-4563450a49b1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.439369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-922d0b34-abbf-4c9c-bffc-4563450a49b1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.448563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-922d0b34-abbf-4c9c-bffc-4563450a49b1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.449022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-922d0b34-abbf-4c9c-bffc-4563450a49b1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.521819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-922d0b34-abbf-4c9c-bffc-4563450a49b1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lazy-loading 'flavor' on Instance uuid 25371ff1-9717-4d04-886b-b825467726c1 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:40:20.537583 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-922d0b34-abbf-4c9c-bffc-4563450a49b1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "PUT /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-730573850" status: 201 len: 0 microversion: 2.26 time: 0.146529 Jan 22 21:40:20.542754 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4215/8134] 10.222.0.100 () {62 vars in 1381 bytes} [Sat Jan 22 21:40:20 2022] PUT /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-730573850 => generated 0 bytes in 148 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jan 22 21:40:20.547976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aa5b2d64-229d-4e9b-bb55-bd6995f4c8c4 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1ed6611310>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:20.557408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa5b2d64-229d-4e9b-bb55-bd6995f4c8c4 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.557909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa5b2d64-229d-4e9b-bb55-bd6995f4c8c4 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.558396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aa5b2d64-229d-4e9b-bb55-bd6995f4c8c4 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:20.564548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa5b2d64-229d-4e9b-bb55-bd6995f4c8c4 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.565002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa5b2d64-229d-4e9b-bb55-bd6995f4c8c4 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.565832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa5b2d64-229d-4e9b-bb55-bd6995f4c8c4 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.566355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa5b2d64-229d-4e9b-bb55-bd6995f4c8c4 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.588777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa5b2d64-229d-4e9b-bb55-bd6995f4c8c4 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.589235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa5b2d64-229d-4e9b-bb55-bd6995f4c8c4 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.690968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-aa5b2d64-229d-4e9b-bb55-bd6995f4c8c4 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lazy-loading 'flavor' on Instance uuid 25371ff1-9717-4d04-886b-b825467726c1 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:40:20.707053 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aa5b2d64-229d-4e9b-bb55-bd6995f4c8c4 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "DELETE /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags" status: 204 len: 0 microversion: 2.26 time: 0.162971 Jan 22 21:40:20.707683 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3920/8135] 10.222.0.100 () {60 vars in 1299 bytes} [Sat Jan 22 21:40:20 2022] DELETE /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:40:20.716838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-53710e79-8df2-4121-b1d0-6635349d3d0b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1ed4ad2a60>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:20.724945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53710e79-8df2-4121-b1d0-6635349d3d0b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.725437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-53710e79-8df2-4121-b1d0-6635349d3d0b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.735506 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-53710e79-8df2-4121-b1d0-6635349d3d0b tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags" status: 200 len: 12 microversion: 2.26 time: 0.023406 Jan 22 21:40:20.736097 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4216/8136] 10.222.0.100 () {60 vars in 1296 bytes} [Sat Jan 22 21:40:20 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags => generated 12 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:20.746053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-850ec0a8-7332-4e18-be54-fbf360bae885 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1edaed75e0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:20.754068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-850ec0a8-7332-4e18-be54-fbf360bae885 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.754529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-850ec0a8-7332-4e18-be54-fbf360bae885 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.755005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-850ec0a8-7332-4e18-be54-fbf360bae885 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:20.760628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-850ec0a8-7332-4e18-be54-fbf360bae885 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.761089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-850ec0a8-7332-4e18-be54-fbf360bae885 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.761895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-850ec0a8-7332-4e18-be54-fbf360bae885 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.762341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-850ec0a8-7332-4e18-be54-fbf360bae885 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.785021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-850ec0a8-7332-4e18-be54-fbf360bae885 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.785644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-850ec0a8-7332-4e18-be54-fbf360bae885 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.796476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-850ec0a8-7332-4e18-be54-fbf360bae885 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lazy-loading 'flavor' on Instance uuid 25371ff1-9717-4d04-886b-b825467726c1 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:40:20.810656 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-850ec0a8-7332-4e18-be54-fbf360bae885 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "DELETE /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags" status: 204 len: 0 microversion: 2.26 time: 0.069040 Jan 22 21:40:20.813397 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3921/8137] 10.222.0.100 () {60 vars in 1299 bytes} [Sat Jan 22 21:40:20 2022] DELETE /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:40:20.820438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9d6531b0-2e48-4ff3-94e0-5f3a34a16491 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1ed4b1a790>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:20.829067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d6531b0-2e48-4ff3-94e0-5f3a34a16491 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.829556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d6531b0-2e48-4ff3-94e0-5f3a34a16491 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.830041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9d6531b0-2e48-4ff3-94e0-5f3a34a16491 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:20.835217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d6531b0-2e48-4ff3-94e0-5f3a34a16491 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.835684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d6531b0-2e48-4ff3-94e0-5f3a34a16491 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.836458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d6531b0-2e48-4ff3-94e0-5f3a34a16491 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.836905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d6531b0-2e48-4ff3-94e0-5f3a34a16491 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.860088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d6531b0-2e48-4ff3-94e0-5f3a34a16491 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.860584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d6531b0-2e48-4ff3-94e0-5f3a34a16491 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.869011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d6531b0-2e48-4ff3-94e0-5f3a34a16491 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:20.869470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d6531b0-2e48-4ff3-94e0-5f3a34a16491 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:20.964024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-9d6531b0-2e48-4ff3-94e0-5f3a34a16491 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lazy-loading 'flavor' on Instance uuid 25371ff1-9717-4d04-886b-b825467726c1 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:40:20.979941 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9d6531b0-2e48-4ff3-94e0-5f3a34a16491 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "PUT /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-1860355586" status: 201 len: 0 microversion: 2.26 time: 0.162882 Jan 22 21:40:20.980721 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4217/8138] 10.222.0.100 () {62 vars in 1384 bytes} [Sat Jan 22 21:40:20 2022] PUT /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-1860355586 => generated 0 bytes in 165 msecs (HTTP/1.1 201) 10 headers in 487 bytes (1 switches on core 0) Jan 22 21:40:20.990723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a9ad00ce-3d7d-47e3-a97c-aaba5b99ad51 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1ed5ffca60>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:21.000160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ad00ce-3d7d-47e3-a97c-aaba5b99ad51 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.000551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ad00ce-3d7d-47e3-a97c-aaba5b99ad51 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.001037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a9ad00ce-3d7d-47e3-a97c-aaba5b99ad51 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:21.006430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ad00ce-3d7d-47e3-a97c-aaba5b99ad51 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.006888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ad00ce-3d7d-47e3-a97c-aaba5b99ad51 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.007674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ad00ce-3d7d-47e3-a97c-aaba5b99ad51 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.008124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ad00ce-3d7d-47e3-a97c-aaba5b99ad51 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.031496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ad00ce-3d7d-47e3-a97c-aaba5b99ad51 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.031963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ad00ce-3d7d-47e3-a97c-aaba5b99ad51 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.040840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ad00ce-3d7d-47e3-a97c-aaba5b99ad51 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.041911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ad00ce-3d7d-47e3-a97c-aaba5b99ad51 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.118528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-a9ad00ce-3d7d-47e3-a97c-aaba5b99ad51 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lazy-loading 'flavor' on Instance uuid 25371ff1-9717-4d04-886b-b825467726c1 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:40:21.133622 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a9ad00ce-3d7d-47e3-a97c-aaba5b99ad51 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "PUT /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-1264249187" status: 201 len: 0 microversion: 2.26 time: 0.147621 Jan 22 21:40:21.137534 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3922/8139] 10.222.0.100 () {62 vars in 1384 bytes} [Sat Jan 22 21:40:20 2022] PUT /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags/tempest-tag-1264249187 => generated 0 bytes in 149 msecs (HTTP/1.1 201) 10 headers in 487 bytes (2 switches on core 0) Jan 22 21:40:21.144162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6ff64b85-1dfa-4f4b-b3e4-f1517585ac82 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Action: 'update_all', calling method: .version_select at 0x7f1ed4a505e0>, body: {"tags": ["tempest-tag-1698956844", "tempest-tag-948054124"]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:40:21.153606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ff64b85-1dfa-4f4b-b3e4-f1517585ac82 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.154325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ff64b85-1dfa-4f4b-b3e4-f1517585ac82 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.154807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6ff64b85-1dfa-4f4b-b3e4-f1517585ac82 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:21.159903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ff64b85-1dfa-4f4b-b3e4-f1517585ac82 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.160357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ff64b85-1dfa-4f4b-b3e4-f1517585ac82 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.161122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ff64b85-1dfa-4f4b-b3e4-f1517585ac82 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.161607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ff64b85-1dfa-4f4b-b3e4-f1517585ac82 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.184315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ff64b85-1dfa-4f4b-b3e4-f1517585ac82 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.184776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6ff64b85-1dfa-4f4b-b3e4-f1517585ac82 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.268114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-6ff64b85-1dfa-4f4b-b3e4-f1517585ac82 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lazy-loading 'flavor' on Instance uuid 25371ff1-9717-4d04-886b-b825467726c1 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:40:21.289435 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6ff64b85-1dfa-4f4b-b3e4-f1517585ac82 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "PUT /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags" status: 200 len: 61 microversion: 2.26 time: 0.149179 Jan 22 21:40:21.290369 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4218/8140] 10.222.0.100 () {62 vars in 1316 bytes} [Sat Jan 22 21:40:21 2022] PUT /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags => generated 61 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:40:21.301133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d5e309ec-bf8e-4c0e-b8f9-5ec134447c8a tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1ed61abdc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:21.309365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5e309ec-bf8e-4c0e-b8f9-5ec134447c8a tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.309845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5e309ec-bf8e-4c0e-b8f9-5ec134447c8a tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.319315 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d5e309ec-bf8e-4c0e-b8f9-5ec134447c8a tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags" status: 200 len: 61 microversion: 2.26 time: 0.022415 Jan 22 21:40:21.319929 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3923/8141] 10.222.0.100 () {60 vars in 1296 bytes} [Sat Jan 22 21:40:21 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags => generated 61 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:21.330583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-021cc87e-4cf1-4668-9ca3-992d82ad6daa tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '.version_select at 0x7f1ed4a985e0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:21.339226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-021cc87e-4cf1-4668-9ca3-992d82ad6daa tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.339688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-021cc87e-4cf1-4668-9ca3-992d82ad6daa tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.340238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-021cc87e-4cf1-4668-9ca3-992d82ad6daa tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:21.345659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-021cc87e-4cf1-4668-9ca3-992d82ad6daa tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.346118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-021cc87e-4cf1-4668-9ca3-992d82ad6daa tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.347037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-021cc87e-4cf1-4668-9ca3-992d82ad6daa tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.347491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-021cc87e-4cf1-4668-9ca3-992d82ad6daa tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.369738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-021cc87e-4cf1-4668-9ca3-992d82ad6daa tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.370203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-021cc87e-4cf1-4668-9ca3-992d82ad6daa tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.484236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-021cc87e-4cf1-4668-9ca3-992d82ad6daa tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lazy-loading 'flavor' on Instance uuid 25371ff1-9717-4d04-886b-b825467726c1 {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:40:21.503572 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-021cc87e-4cf1-4668-9ca3-992d82ad6daa tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "DELETE /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags" status: 204 len: 0 microversion: 2.26 time: 0.177355 Jan 22 21:40:21.504747 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4219/8142] 10.222.0.100 () {60 vars in 1299 bytes} [Sat Jan 22 21:40:21 2022] DELETE /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1/tags => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 22 21:40:21.515353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-66dc10b2-d8bb-4122-8c50-3023075095c8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:21.515863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-66dc10b2-d8bb-4122-8c50-3023075095c8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:21.521959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66dc10b2-d8bb-4122-8c50-3023075095c8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.522451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66dc10b2-d8bb-4122-8c50-3023075095c8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.523240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66dc10b2-d8bb-4122-8c50-3023075095c8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.523693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66dc10b2-d8bb-4122-8c50-3023075095c8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.552280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-66dc10b2-d8bb-4122-8c50-3023075095c8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:40:21.883953 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-66dc10b2-d8bb-4122-8c50-3023075095c8 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "DELETE /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 204 len: 0 microversion: 2.26 time: 0.372196 Jan 22 21:40:21.885854 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3924/8143] 10.222.0.100 () {60 vars in 1284 bytes} [Sat Jan 22 21:40:21 2022] DELETE /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 22 21:40:21.893966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61748b92-316d-438b-8f92-62ced75fe029 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:21.894611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-61748b92-316d-438b-8f92-62ced75fe029 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:21.901195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61748b92-316d-438b-8f92-62ced75fe029 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.901758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61748b92-316d-438b-8f92-62ced75fe029 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:21.902573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61748b92-316d-438b-8f92-62ced75fe029 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:21.903029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61748b92-316d-438b-8f92-62ced75fe029 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:22.053038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-61748b92-316d-438b-8f92-62ced75fe029 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:22.062154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-61748b92-316d-438b-8f92-62ced75fe029 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:22.063729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-61748b92-316d-438b-8f92-62ced75fe029 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:22.064934 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61748b92-316d-438b-8f92-62ced75fe029 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 200 len: 1556 microversion: 2.26 time: 0.175350 Jan 22 21:40:22.065484 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4220/8144] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:40:21 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:40:23.084809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f86105fa-9230-4d31-8f0e-9b0654e8439d tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:23.088386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f86105fa-9230-4d31-8f0e-9b0654e8439d tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:23.093147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f86105fa-9230-4d31-8f0e-9b0654e8439d tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:23.093640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f86105fa-9230-4d31-8f0e-9b0654e8439d tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:23.094460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f86105fa-9230-4d31-8f0e-9b0654e8439d tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:23.094982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f86105fa-9230-4d31-8f0e-9b0654e8439d tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:23.319472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f86105fa-9230-4d31-8f0e-9b0654e8439d tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:23.328861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f86105fa-9230-4d31-8f0e-9b0654e8439d tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:23.330708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f86105fa-9230-4d31-8f0e-9b0654e8439d tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:23.331923 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f86105fa-9230-4d31-8f0e-9b0654e8439d tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 200 len: 1556 microversion: 2.26 time: 0.251464 Jan 22 21:40:23.332509 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3925/8145] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:40:23 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 1556 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:40:23.815262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-cfecdcb4-f770-421c-b187-1e51f7378a0d req-42a3cc66-734a-47a8-a95e-3226f1e76704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25371ff1-9717-4d04-886b-b825467726c1", "name": "network-vif-deleted", "tag": "cb21cab8-2020-4ebe-8885-cccc078a30d1"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:40:23.819577 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:40:23.819577 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:40:23.826323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-cfecdcb4-f770-421c-b187-1e51f7378a0d req-42a3cc66-734a-47a8-a95e-3226f1e76704 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:23.827045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-cfecdcb4-f770-421c-b187-1e51f7378a0d req-42a3cc66-734a-47a8-a95e-3226f1e76704 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:23.839093 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-cfecdcb4-f770-421c-b187-1e51f7378a0d req-42a3cc66-734a-47a8-a95e-3226f1e76704 service nova] Creating event network-vif-deleted:cb21cab8-2020-4ebe-8885-cccc078a30d1 for instance 25371ff1-9717-4d04-886b-b825467726c1 on nch2-master-1 Jan 22 21:40:23.844413 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-cfecdcb4-f770-421c-b187-1e51f7378a0d req-42a3cc66-734a-47a8-a95e-3226f1e76704 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032760 Jan 22 21:40:23.845139 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4221/8146] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:24.361346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:24.362191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:24.370667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:24.371136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:24.371974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:24.374336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:24.420599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:24.421359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:24.422042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lazy-loading 'fault' on Instance uuid 25371ff1-9717-4d04-886b-b825467726c1 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:40:24.483857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:24.492852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:24.494787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add2f83347eb4173884e9307af324d49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad79ba026c514dae94cb7cd8ba312da3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:24.496056 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 200 len: 1356 microversion: 2.26 time: 0.139043 Jan 22 21:40:24.496638 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3926/8147] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:40:24 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 1356 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 22 21:40:25.516119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fda92e48-cf85-4e7b-9645-3567ee9b5140 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:25.516912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fda92e48-cf85-4e7b-9645-3567ee9b5140 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] [instance: 25371ff1-9717-4d04-886b-b825467726c1] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:25.524080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fda92e48-cf85-4e7b-9645-3567ee9b5140 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:25.524619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fda92e48-cf85-4e7b-9645-3567ee9b5140 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:25.526106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fda92e48-cf85-4e7b-9645-3567ee9b5140 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:25.526798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fda92e48-cf85-4e7b-9645-3567ee9b5140 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:25.541894 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-fda92e48-cf85-4e7b-9645-3567ee9b5140 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] HTTP exception thrown: Instance 25371ff1-9717-4d04-886b-b825467726c1 could not be found. Jan 22 21:40:25.542636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fda92e48-cf85-4e7b-9645-3567ee9b5140 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Returning 404 to user: Instance 25371ff1-9717-4d04-886b-b825467726c1 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:40:25.543488 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fda92e48-cf85-4e7b-9645-3567ee9b5140 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1" status: 404 len: 111 microversion: 2.26 time: 0.031514 Jan 22 21:40:25.544068 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4222/8148] 10.222.0.100 () {60 vars in 1281 bytes} [Sat Jan 22 21:40:25 2022] GET /compute/v2.1/servers/25371ff1-9717-4d04-886b-b825467726c1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 22 21:40:28.510304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:28.510304 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute//" status: 200 len: 379 microversion: - time: 0.001666 Jan 22 21:40:28.510304 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3927/8149] 10.222.0.100 () {56 vars in 890 bytes} [Sat Jan 22 21:40:28 2022] GET /compute/ => generated 379 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jan 22 21:40:28.512110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fda92e48-cf85-4e7b-9645-3567ee9b5140 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:28.513589 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fda92e48-cf85-4e7b-9645-3567ee9b5140 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2/" status: 200 len: 380 microversion: 2.1 time: 0.002002 Jan 22 21:40:28.518500 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4223/8150] 10.222.0.100 () {54 vars in 1039 bytes} [Sat Jan 22 21:40:28 2022] GET /compute/v2/ => generated 380 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jan 22 21:40:28.520263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:28.521100 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0a52d791-10a1-4b57-865f-d4970fbe8ee1 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001503 Jan 22 21:40:28.521549 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3928/8151] 10.222.0.100 () {54 vars in 1045 bytes} [Sat Jan 22 21:40:28 2022] GET /compute/v2.1/ => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:28.529384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fda92e48-cf85-4e7b-9645-3567ee9b5140 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:28.531056 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fda92e48-cf85-4e7b-9645-3567ee9b5140 tempest-ServerTagsTestJSON-1455557216 tempest-ServerTagsTestJSON-1455557216-project] 10.222.0.100 "GET /compute//" status: 200 len: 379 microversion: - time: 0.001618 Jan 22 21:40:28.531056 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4224/8152] 10.222.0.100 () {56 vars in 890 bytes} [Sat Jan 22 21:40:28 2022] GET /compute/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jan 22 21:40:31.071344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-90b98a58-e574-49cf-956c-1e3b42852af3 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Action: 'create', calling method: .version_select at 0x7f1ed517fe50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-672437625"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:40:32.137099 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-90b98a58-e574-49cf-956c-1e3b42852af3 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 1.223462 Jan 22 21:40:32.137949 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3929/8153] 10.222.0.100 () {60 vars in 1159 bytes} [Sat Jan 22 21:40:30 2022] POST /compute/v2.1/os-volumes => generated 337 bytes in 1225 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jan 22 21:40:32.149254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ffd516c1-bb5d-4582-9ba3-82193078ceb2 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed4a96160>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:32.241594 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ffd516c1-bb5d-4582-9ba3-82193078ceb2 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405" status: 200 len: 337 microversion: 2.1 time: 0.095912 Jan 22 21:40:32.242459 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4225/8154] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:40:32 2022] GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405 => generated 337 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:33.258863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-98683cfa-b3cf-4b6d-8433-26386f2407c4 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed5e2de50>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:33.332241 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-98683cfa-b3cf-4b6d-8433-26386f2407c4 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405" status: 200 len: 337 microversion: 2.1 time: 0.079200 Jan 22 21:40:33.332831 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3930/8155] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:40:33 2022] GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405 => generated 337 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:34.345193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5866e646-e7a2-4246-8afa-7d0476ee334d tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed4a18f70>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:34.436426 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5866e646-e7a2-4246-8afa-7d0476ee334d tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405" status: 200 len: 338 microversion: 2.1 time: 0.095351 Jan 22 21:40:34.437004 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4226/8156] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:40:34 2022] GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405 => generated 338 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:34.457990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aba893aa-f99e-4363-834a-647d92df170e tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Action: 'create', calling method: .version_select at 0x7f1ed4ee41f0>, body: {"snapshot": {"volume_id": "131af0b9-b9c0-48fe-af9e-6e5dcdb01405", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-277889611"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:40:35.214229 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aba893aa-f99e-4363-834a-647d92df170e tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.769536 Jan 22 21:40:35.214834 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3931/8157] 10.222.0.100 () {60 vars in 1166 bytes} [Sat Jan 22 21:40:34 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:35.234151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-516b6a9a-70e4-4068-89a5-9f120619e04a tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed4a96790>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:35.267392 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-516b6a9a-70e4-4068-89a5-9f120619e04a tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d" status: 200 len: 286 microversion: 2.1 time: 0.046049 Jan 22 21:40:35.270482 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4227/8158] 10.222.0.100 () {58 vars in 1255 bytes} [Sat Jan 22 21:40:35 2022] GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:35.279288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e6d26326-e15b-4599-b87f-8d70025c079b tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed619e0d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:35.310652 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e6d26326-e15b-4599-b87f-8d70025c079b tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035936 Jan 22 21:40:35.311236 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3932/8159] 10.222.0.100 () {58 vars in 1144 bytes} [Sat Jan 22 21:40:35 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:35.321072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bd495a13-af0c-4d3b-81ec-97153f19057a tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed4b1adc0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:35.354491 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bd495a13-af0c-4d3b-81ec-97153f19057a tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d" status: 200 len: 286 microversion: 2.1 time: 0.036908 Jan 22 21:40:35.355380 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4228/8160] 10.222.0.100 () {58 vars in 1255 bytes} [Sat Jan 22 21:40:35 2022] GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:40:36.367011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1dae2e81-fea4-49d9-9709-fecefcaf9e3e tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed5a3d9d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:36.396755 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1dae2e81-fea4-49d9-9709-fecefcaf9e3e tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d" status: 200 len: 286 microversion: 2.1 time: 0.034369 Jan 22 21:40:36.397337 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3933/8161] 10.222.0.100 () {58 vars in 1255 bytes} [Sat Jan 22 21:40:36 2022] GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:37.410271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0a65d9f8-3551-41cd-9e87-e638870fc783 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed4f34dc0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:37.442802 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0a65d9f8-3551-41cd-9e87-e638870fc783 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d" status: 200 len: 286 microversion: 2.1 time: 0.036966 Jan 22 21:40:37.443297 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4229/8162] 10.222.0.100 () {58 vars in 1255 bytes} [Sat Jan 22 21:40:37 2022] GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:38.455819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-95d47b4f-79dd-4ce2-a542-c524fa74fc07 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed5e2d4c0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:38.491170 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-95d47b4f-79dd-4ce2-a542-c524fa74fc07 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d" status: 200 len: 286 microversion: 2.1 time: 0.038149 Jan 22 21:40:38.491816 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3934/8163] 10.222.0.100 () {58 vars in 1255 bytes} [Sat Jan 22 21:40:38 2022] GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:39.509019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b15130ed-a349-417b-8a42-ef0e47797b14 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed4a96ca0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:39.547593 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b15130ed-a349-417b-8a42-ef0e47797b14 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d" status: 200 len: 286 microversion: 2.1 time: 0.047181 Jan 22 21:40:39.548336 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4230/8164] 10.222.0.100 () {58 vars in 1255 bytes} [Sat Jan 22 21:40:39 2022] GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:40.560568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-58fe0bbb-ccb9-4f1d-8f6a-73b59c430a52 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed6110040>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:40.595940 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-58fe0bbb-ccb9-4f1d-8f6a-73b59c430a52 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d" status: 200 len: 287 microversion: 2.1 time: 0.040433 Jan 22 21:40:40.596729 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3935/8165] 10.222.0.100 () {58 vars in 1255 bytes} [Sat Jan 22 21:40:40 2022] GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:40:40.606881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-375f1646-f057-44d8-b685-41992a6de17e tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed4ad2040>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:40.774343 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-375f1646-f057-44d8-b685-41992a6de17e tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "DELETE /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d" status: 202 len: 0 microversion: 2.1 time: 0.166773 Jan 22 21:40:40.780660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9c42760e-30a4-4d27-91ea-f20bb72a3dfb tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed6002040>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:40.781605 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4231/8166] 10.222.0.100 () {58 vars in 1258 bytes} [Sat Jan 22 21:40:40 2022] DELETE /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:40:40.811964 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9c42760e-30a4-4d27-91ea-f20bb72a3dfb tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d" status: 200 len: 286 microversion: 2.1 time: 0.035106 Jan 22 21:40:40.816739 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3936/8167] 10.222.0.100 () {58 vars in 1255 bytes} [Sat Jan 22 21:40:40 2022] GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:41.824778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5b84e210-f039-4d3f-b879-95fc7844362f tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed50f7f70>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:41.855550 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5b84e210-f039-4d3f-b879-95fc7844362f tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d" status: 200 len: 286 microversion: 2.1 time: 0.035692 Jan 22 21:40:41.856122 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4232/8168] 10.222.0.100 () {58 vars in 1255 bytes} [Sat Jan 22 21:40:41 2022] GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:42.868341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7f588999-10f3-4bbe-934a-efab07940152 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed50f69d0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:42.897235 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7f588999-10f3-4bbe-934a-efab07940152 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d" status: 200 len: 286 microversion: 2.1 time: 0.033431 Jan 22 21:40:42.897860 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3937/8169] 10.222.0.100 () {58 vars in 1255 bytes} [Sat Jan 22 21:40:42 2022] GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:43.911191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9f83f51d-d6f1-4827-af55-067979a2d4cc tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed512a040>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:43.935604 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-9f83f51d-d6f1-4827-af55-067979a2d4cc tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] HTTP exception thrown: Snapshot ce6780aa-f0d3-499c-b5cf-82d7e746129d could not be found. Jan 22 21:40:43.936270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9f83f51d-d6f1-4827-af55-067979a2d4cc tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Returning 404 to user: Snapshot ce6780aa-f0d3-499c-b5cf-82d7e746129d could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:40:43.937218 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9f83f51d-d6f1-4827-af55-067979a2d4cc tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d" status: 404 len: 111 microversion: 2.1 time: 0.030746 Jan 22 21:40:43.938172 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4233/8170] 10.222.0.100 () {58 vars in 1255 bytes} [Sat Jan 22 21:40:43 2022] GET /compute/v2.1/os-snapshots/ce6780aa-f0d3-499c-b5cf-82d7e746129d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:40:43.948230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-acf30b9c-92ea-403a-9ddc-1942ec1a2a46 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed5da8af0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:44.154911 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-acf30b9c-92ea-403a-9ddc-1942ec1a2a46 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405" status: 202 len: 0 microversion: 2.1 time: 0.212261 Jan 22 21:40:44.158921 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3938/8171] 10.222.0.100 () {58 vars in 1252 bytes} [Sat Jan 22 21:40:43 2022] DELETE /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:40:44.163742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-599dd5e8-6f04-4238-adb3-6c394b8eb63f tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed50f7790>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:44.212162 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-599dd5e8-6f04-4238-adb3-6c394b8eb63f tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405" status: 200 len: 337 microversion: 2.1 time: 0.052131 Jan 22 21:40:44.212741 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4234/8172] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:40:44 2022] GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405 => generated 337 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:40:45.226489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ceffa48c-d6bd-4fb0-8e23-b73f916de67c tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed5d35dc0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:45.272339 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ceffa48c-d6bd-4fb0-8e23-b73f916de67c tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405" status: 200 len: 337 microversion: 2.1 time: 0.050399 Jan 22 21:40:45.272918 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3939/8173] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:40:45 2022] GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405 => generated 337 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:45.802220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1662636930", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "709f7487-685f-4f76-8a90-fe865459ee83", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "0d3284bd-fac7-4820-be51-ef816f4145f3"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:40:45.885427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] validate_networks() for [('0d3284bd-fac7-4820-be51-ef816f4145f3', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:40:46.252641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:40:46.253079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:40:46.253603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:40:46.254032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:40:46.254460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:40:46.264457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:46.264917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:46.265769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:46.266223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:46.284081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Getting quotas for project 61bfb71de54c471193d2c71859a7f051. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:40:46.290709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0e629c60-6e03-4138-9637-cda35ee1ae75 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1edae25700>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:46.291184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Getting quotas for user 29e976f05d60471b9e6fb8290f07ccce and project 61bfb71de54c471193d2c71859a7f051. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:40:46.302932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:40:46.305045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='709f7487-685f-4f76-8a90-fe865459ee83',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:40:46.334802 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0e629c60-6e03-4138-9637-cda35ee1ae75 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405" status: 200 len: 337 microversion: 2.1 time: 0.052680 Jan 22 21:40:46.335387 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3940/8174] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:40:46 2022] GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405 => generated 337 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:40:46.445999 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e46ddd0a-97e8-4d86-b997-96d43977d1df tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.648288 Jan 22 21:40:46.446654 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4235/8175] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:40:45 2022] POST /compute/v2.1/servers => generated 382 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:40:46.456670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ba1d4c7-c45a-4263-83a5-1a934d58de8e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:46.457287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1ba1d4c7-c45a-4263-83a5-1a934d58de8e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:46.511271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1ba1d4c7-c45a-4263-83a5-1a934d58de8e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:46.518845 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1ba1d4c7-c45a-4263-83a5-1a934d58de8e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1060 microversion: 2.1 time: 0.065852 Jan 22 21:40:46.519467 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3941/8176] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:40:46 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1060 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:47.347302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8d04be55-6485-4925-bcb2-541b6b199ef0 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed4af21f0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:47.394877 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8d04be55-6485-4925-bcb2-541b6b199ef0 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405" status: 200 len: 337 microversion: 2.1 time: 0.051267 Jan 22 21:40:47.395453 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4236/8177] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:40:47 2022] GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405 => generated 337 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:47.535949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4400d00e-0e34-4d24-b8e4-1dc5d9c49223 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:47.536573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4400d00e-0e34-4d24-b8e4-1dc5d9c49223 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:47.605913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4400d00e-0e34-4d24-b8e4-1dc5d9c49223 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:47.612738 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4400d00e-0e34-4d24-b8e4-1dc5d9c49223 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1060 microversion: 2.1 time: 0.080495 Jan 22 21:40:47.613316 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3942/8178] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:40:47 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1060 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:48.409646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c7cbb714-6e0a-4c30-9b23-f83d5f0efb14 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1edaecdaf0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:48.458711 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c7cbb714-6e0a-4c30-9b23-f83d5f0efb14 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405" status: 200 len: 337 microversion: 2.1 time: 0.054343 Jan 22 21:40:48.459290 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4237/8179] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:40:48 2022] GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405 => generated 337 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:48.629037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cd0a4d12-2891-4e71-9255-123f2f6a909d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:48.629681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cd0a4d12-2891-4e71-9255-123f2f6a909d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:48.637450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd0a4d12-2891-4e71-9255-123f2f6a909d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:48.638694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd0a4d12-2891-4e71-9255-123f2f6a909d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:48.639804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd0a4d12-2891-4e71-9255-123f2f6a909d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:48.640775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd0a4d12-2891-4e71-9255-123f2f6a909d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:48.712302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cd0a4d12-2891-4e71-9255-123f2f6a909d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:48.720742 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cd0a4d12-2891-4e71-9255-123f2f6a909d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1120 microversion: 2.1 time: 0.095491 Jan 22 21:40:48.721338 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3943/8180] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:40:48 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1120 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:49.472612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e8ccbc88-b48d-480a-a8f8-35e66c0c2319 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed5ed88b0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:49.512143 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-e8ccbc88-b48d-480a-a8f8-35e66c0c2319 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] HTTP exception thrown: Volume 131af0b9-b9c0-48fe-af9e-6e5dcdb01405 could not be found. Jan 22 21:40:49.513476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e8ccbc88-b48d-480a-a8f8-35e66c0c2319 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Returning 404 to user: Volume 131af0b9-b9c0-48fe-af9e-6e5dcdb01405 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:40:49.514280 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e8ccbc88-b48d-480a-a8f8-35e66c0c2319 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405" status: 404 len: 109 microversion: 2.1 time: 0.046558 Jan 22 21:40:49.514829 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4238/8181] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:40:49 2022] GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:40:49.529988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bf8f49e1-a6de-45b8-8db9-922dfec53688 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1ed61105e0>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:49.562561 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-bf8f49e1-a6de-45b8-8db9-922dfec53688 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] HTTP exception thrown: Volume 131af0b9-b9c0-48fe-af9e-6e5dcdb01405 could not be found. Jan 22 21:40:49.563257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bf8f49e1-a6de-45b8-8db9-922dfec53688 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Returning 404 to user: Volume 131af0b9-b9c0-48fe-af9e-6e5dcdb01405 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:40:49.564162 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bf8f49e1-a6de-45b8-8db9-922dfec53688 tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "DELETE /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405" status: 404 len: 109 microversion: 2.1 time: 0.040110 Jan 22 21:40:49.565551 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3944/8182] 10.222.0.100 () {58 vars in 1252 bytes} [Sat Jan 22 21:40:49 2022] DELETE /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:40:49.574083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-310e826e-35af-4b58-8054-60dc219cbcbb tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Calling method '.version_select at 0x7f1edaecd310>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:49.609746 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-310e826e-35af-4b58-8054-60dc219cbcbb tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] HTTP exception thrown: Volume 131af0b9-b9c0-48fe-af9e-6e5dcdb01405 could not be found. Jan 22 21:40:49.611843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-310e826e-35af-4b58-8054-60dc219cbcbb tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] Returning 404 to user: Volume 131af0b9-b9c0-48fe-af9e-6e5dcdb01405 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:40:49.613742 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-310e826e-35af-4b58-8054-60dc219cbcbb tempest-VolumesSnapshotsTestJSON-620201569 tempest-VolumesSnapshotsTestJSON-620201569-project] 10.222.0.100 "GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405" status: 404 len: 109 microversion: 2.1 time: 0.043545 Jan 22 21:40:49.621711 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4239/8183] 10.222.0.100 () {58 vars in 1249 bytes} [Sat Jan 22 21:40:49 2022] GET /compute/v2.1/os-volumes/131af0b9-b9c0-48fe-af9e-6e5dcdb01405 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:40:49.737735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-448bafc4-002a-4ba3-b487-9ae7b34e9805 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:49.738917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-448bafc4-002a-4ba3-b487-9ae7b34e9805 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:49.747843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-448bafc4-002a-4ba3-b487-9ae7b34e9805 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:49.748691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-448bafc4-002a-4ba3-b487-9ae7b34e9805 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:49.749862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-448bafc4-002a-4ba3-b487-9ae7b34e9805 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:49.750464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-448bafc4-002a-4ba3-b487-9ae7b34e9805 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:49.890071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-448bafc4-002a-4ba3-b487-9ae7b34e9805 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:49.898609 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-448bafc4-002a-4ba3-b487-9ae7b34e9805 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1172 microversion: 2.1 time: 0.164551 Jan 22 21:40:49.899198 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3945/8184] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:40:49 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1172 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:50.458617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-8363a73b-870d-4183-aba4-21dca404b18d req-34e683d2-f7f9-496b-9afd-41381e2f9005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fda2ef84-3b7f-4ead-9f69-03737b08199a", "tag": "b61273a4-a8e2-42cc-a5ae-ec5439b196d7"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:40:50.458617 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:40:50.458617 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:40:50.463346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8363a73b-870d-4183-aba4-21dca404b18d req-34e683d2-f7f9-496b-9afd-41381e2f9005 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:50.463919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8363a73b-870d-4183-aba4-21dca404b18d req-34e683d2-f7f9-496b-9afd-41381e2f9005 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:50.476624 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-8363a73b-870d-4183-aba4-21dca404b18d req-34e683d2-f7f9-496b-9afd-41381e2f9005 service nova] Creating event network-changed:b61273a4-a8e2-42cc-a5ae-ec5439b196d7 for instance fda2ef84-3b7f-4ead-9f69-03737b08199a on nch2-master-1 Jan 22 21:40:50.482022 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-8363a73b-870d-4183-aba4-21dca404b18d req-34e683d2-f7f9-496b-9afd-41381e2f9005 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032506 Jan 22 21:40:50.483041 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4240/8185] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:40:50.918470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7b60b6da-e99b-4d38-8f94-67b81f1c7cdc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:50.919843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7b60b6da-e99b-4d38-8f94-67b81f1c7cdc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:50.934821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b60b6da-e99b-4d38-8f94-67b81f1c7cdc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:50.935235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b60b6da-e99b-4d38-8f94-67b81f1c7cdc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:50.936041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b60b6da-e99b-4d38-8f94-67b81f1c7cdc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:50.936487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b60b6da-e99b-4d38-8f94-67b81f1c7cdc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:51.081190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7b60b6da-e99b-4d38-8f94-67b81f1c7cdc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:51.088665 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7b60b6da-e99b-4d38-8f94-67b81f1c7cdc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1172 microversion: 2.1 time: 0.174592 Jan 22 21:40:51.089250 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3946/8186] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:40:50 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1172 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:40:52.108068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-33284e77-ede3-4eb8-8e53-7d07a52abc5e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:52.108822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-33284e77-ede3-4eb8-8e53-7d07a52abc5e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:52.115260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33284e77-ede3-4eb8-8e53-7d07a52abc5e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:52.115800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33284e77-ede3-4eb8-8e53-7d07a52abc5e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:52.116674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33284e77-ede3-4eb8-8e53-7d07a52abc5e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:52.117198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-33284e77-ede3-4eb8-8e53-7d07a52abc5e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:52.253126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-33284e77-ede3-4eb8-8e53-7d07a52abc5e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:52.260563 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-33284e77-ede3-4eb8-8e53-7d07a52abc5e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1172 microversion: 2.1 time: 0.158073 Jan 22 21:40:52.261142 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4241/8187] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:40:52 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1172 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:53.276356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0f7703a5-9d12-4187-bd64-156d53f1721a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:53.277795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0f7703a5-9d12-4187-bd64-156d53f1721a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:53.284951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f7703a5-9d12-4187-bd64-156d53f1721a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:53.285477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f7703a5-9d12-4187-bd64-156d53f1721a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:53.286257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f7703a5-9d12-4187-bd64-156d53f1721a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:53.286707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f7703a5-9d12-4187-bd64-156d53f1721a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:53.436266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0f7703a5-9d12-4187-bd64-156d53f1721a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:53.444867 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0f7703a5-9d12-4187-bd64-156d53f1721a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1172 microversion: 2.1 time: 0.172319 Jan 22 21:40:53.453594 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3947/8188] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:40:53 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1172 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:54.462477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1528090b-84c3-4da4-b12c-3bf7d61d7b1e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:54.464024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1528090b-84c3-4da4-b12c-3bf7d61d7b1e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:54.472257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1528090b-84c3-4da4-b12c-3bf7d61d7b1e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:54.474004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1528090b-84c3-4da4-b12c-3bf7d61d7b1e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:54.474459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1528090b-84c3-4da4-b12c-3bf7d61d7b1e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:54.474908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1528090b-84c3-4da4-b12c-3bf7d61d7b1e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:54.610978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1528090b-84c3-4da4-b12c-3bf7d61d7b1e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:54.619397 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1528090b-84c3-4da4-b12c-3bf7d61d7b1e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1218 microversion: 2.1 time: 0.160878 Jan 22 21:40:54.619979 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4242/8189] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:40:54 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1218 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:55.636362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-82159f47-9df9-440d-9c90-9de29e669862 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:55.636978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-82159f47-9df9-440d-9c90-9de29e669862 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:55.643955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82159f47-9df9-440d-9c90-9de29e669862 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:55.644422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82159f47-9df9-440d-9c90-9de29e669862 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:55.645223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82159f47-9df9-440d-9c90-9de29e669862 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:55.645703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-82159f47-9df9-440d-9c90-9de29e669862 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:55.795831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-82159f47-9df9-440d-9c90-9de29e669862 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:55.803739 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-82159f47-9df9-440d-9c90-9de29e669862 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1206 microversion: 2.1 time: 0.171148 Jan 22 21:40:55.804265 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3948/8190] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:40:55 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1206 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:56.820164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2403d6b6-8a42-4d02-a643-c16ba3544a4a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:56.820781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2403d6b6-8a42-4d02-a643-c16ba3544a4a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:56.828422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2403d6b6-8a42-4d02-a643-c16ba3544a4a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:56.828879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2403d6b6-8a42-4d02-a643-c16ba3544a4a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:56.829706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2403d6b6-8a42-4d02-a643-c16ba3544a4a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:56.830152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2403d6b6-8a42-4d02-a643-c16ba3544a4a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:56.969125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2403d6b6-8a42-4d02-a643-c16ba3544a4a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:56.976573 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2403d6b6-8a42-4d02-a643-c16ba3544a4a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1206 microversion: 2.1 time: 0.160290 Jan 22 21:40:56.977235 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4243/8191] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:40:56 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1206 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:57.993818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7def3c61-f46d-4a59-8b3a-491c2b7c975f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:57.994425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7def3c61-f46d-4a59-8b3a-491c2b7c975f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:58.001138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7def3c61-f46d-4a59-8b3a-491c2b7c975f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:58.001632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7def3c61-f46d-4a59-8b3a-491c2b7c975f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:58.002421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7def3c61-f46d-4a59-8b3a-491c2b7c975f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:58.002867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7def3c61-f46d-4a59-8b3a-491c2b7c975f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:58.140802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7def3c61-f46d-4a59-8b3a-491c2b7c975f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:58.148334 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7def3c61-f46d-4a59-8b3a-491c2b7c975f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1206 microversion: 2.1 time: 0.158269 Jan 22 21:40:58.148925 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3949/8192] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:40:57 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1206 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:40:59.165905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-40a62d24-ed3a-4700-91e4-d289f49d2c7c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:40:59.166449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-40a62d24-ed3a-4700-91e4-d289f49d2c7c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:40:59.174226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40a62d24-ed3a-4700-91e4-d289f49d2c7c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:59.174691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40a62d24-ed3a-4700-91e4-d289f49d2c7c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:59.175492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40a62d24-ed3a-4700-91e4-d289f49d2c7c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:40:59.175947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40a62d24-ed3a-4700-91e4-d289f49d2c7c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:40:59.326738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-40a62d24-ed3a-4700-91e4-d289f49d2c7c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:40:59.335643 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-40a62d24-ed3a-4700-91e4-d289f49d2c7c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1206 microversion: 2.1 time: 0.173503 Jan 22 21:40:59.336225 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4244/8193] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:40:59 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1206 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:00.352004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-70c43bf6-f3f3-4347-bb71-808cdad2666c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:00.352650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-70c43bf6-f3f3-4347-bb71-808cdad2666c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:00.360150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70c43bf6-f3f3-4347-bb71-808cdad2666c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:00.360611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70c43bf6-f3f3-4347-bb71-808cdad2666c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:00.361403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70c43bf6-f3f3-4347-bb71-808cdad2666c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:00.361882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-70c43bf6-f3f3-4347-bb71-808cdad2666c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:00.497447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-70c43bf6-f3f3-4347-bb71-808cdad2666c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:00.506286 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-70c43bf6-f3f3-4347-bb71-808cdad2666c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1206 microversion: 2.1 time: 0.157946 Jan 22 21:41:00.506796 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3950/8194] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:00 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1206 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:41:00.887246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-3d0423c2-c6f7-4926-babf-f8888fedd193 req-19fbfd28-e97e-4a39-8e3a-e9976f663307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda2ef84-3b7f-4ead-9f69-03737b08199a", "name": "network-vif-plugged", "status": "completed", "tag": "b61273a4-a8e2-42cc-a5ae-ec5439b196d7"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:41:00.889603 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:41:00.889603 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:41:00.897555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-3d0423c2-c6f7-4926-babf-f8888fedd193 req-19fbfd28-e97e-4a39-8e3a-e9976f663307 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:00.898022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-3d0423c2-c6f7-4926-babf-f8888fedd193 req-19fbfd28-e97e-4a39-8e3a-e9976f663307 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:00.909698 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-3d0423c2-c6f7-4926-babf-f8888fedd193 req-19fbfd28-e97e-4a39-8e3a-e9976f663307 service nova] Creating event network-vif-plugged:b61273a4-a8e2-42cc-a5ae-ec5439b196d7 for instance fda2ef84-3b7f-4ead-9f69-03737b08199a on nch2-master-1 Jan 22 21:41:00.914564 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-3d0423c2-c6f7-4926-babf-f8888fedd193 req-19fbfd28-e97e-4a39-8e3a-e9976f663307 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031173 Jan 22 21:41:00.915155 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4245/8195] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:41:01.523762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-81a6120d-5245-4f05-a47e-6d920d234539 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:01.524380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-81a6120d-5245-4f05-a47e-6d920d234539 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:01.531560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81a6120d-5245-4f05-a47e-6d920d234539 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:01.532017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81a6120d-5245-4f05-a47e-6d920d234539 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:01.532867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81a6120d-5245-4f05-a47e-6d920d234539 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:01.533320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81a6120d-5245-4f05-a47e-6d920d234539 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:01.667295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-81a6120d-5245-4f05-a47e-6d920d234539 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:01.675370 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-81a6120d-5245-4f05-a47e-6d920d234539 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1206 microversion: 2.1 time: 0.155278 Jan 22 21:41:01.675938 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3951/8196] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:01 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1206 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:02.693547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-93562db1-80a7-464f-9413-912404bbf3f4 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:02.694407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-93562db1-80a7-464f-9413-912404bbf3f4 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:02.701462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93562db1-80a7-464f-9413-912404bbf3f4 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:02.702197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93562db1-80a7-464f-9413-912404bbf3f4 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:02.703196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93562db1-80a7-464f-9413-912404bbf3f4 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:02.703641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93562db1-80a7-464f-9413-912404bbf3f4 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:02.843342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-93562db1-80a7-464f-9413-912404bbf3f4 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:02.851121 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-93562db1-80a7-464f-9413-912404bbf3f4 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1206 microversion: 2.1 time: 0.162664 Jan 22 21:41:02.851809 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4246/8197] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:02 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1206 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:03.868124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fe0ac2c3-11b1-4c25-a35f-6c358147676c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:03.868665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fe0ac2c3-11b1-4c25-a35f-6c358147676c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:03.875611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe0ac2c3-11b1-4c25-a35f-6c358147676c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:03.876075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe0ac2c3-11b1-4c25-a35f-6c358147676c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:03.876866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe0ac2c3-11b1-4c25-a35f-6c358147676c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:03.877326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe0ac2c3-11b1-4c25-a35f-6c358147676c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:04.018497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fe0ac2c3-11b1-4c25-a35f-6c358147676c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:04.026342 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fe0ac2c3-11b1-4c25-a35f-6c358147676c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1392 microversion: 2.1 time: 0.161937 Jan 22 21:41:04.026930 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3952/8198] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:03 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:04.043466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b2d0d7a0-7648-4aa5-8583-1ee2a480757b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:04.044076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b2d0d7a0-7648-4aa5-8583-1ee2a480757b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:04.051376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2d0d7a0-7648-4aa5-8583-1ee2a480757b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:04.051834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2d0d7a0-7648-4aa5-8583-1ee2a480757b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:04.052628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2d0d7a0-7648-4aa5-8583-1ee2a480757b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:04.053074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b2d0d7a0-7648-4aa5-8583-1ee2a480757b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:04.187864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b2d0d7a0-7648-4aa5-8583-1ee2a480757b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:04.195574 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b2d0d7a0-7648-4aa5-8583-1ee2a480757b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1392 microversion: 2.1 time: 0.155728 Jan 22 21:41:04.196142 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4247/8199] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:04 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:04.211519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-37176112-bb54-41c8-964a-fe2b874f23d9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:04.212148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-37176112-bb54-41c8-964a-fe2b874f23d9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:04.218768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37176112-bb54-41c8-964a-fe2b874f23d9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:04.219228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37176112-bb54-41c8-964a-fe2b874f23d9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:04.220017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37176112-bb54-41c8-964a-fe2b874f23d9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:04.220467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-37176112-bb54-41c8-964a-fe2b874f23d9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:04.358156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-37176112-bb54-41c8-964a-fe2b874f23d9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:04.365623 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-37176112-bb54-41c8-964a-fe2b874f23d9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1392 microversion: 2.1 time: 0.157837 Jan 22 21:41:04.366190 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3953/8200] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:04 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:04.433871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-26cb3808-faf7-4c21-ad8d-ed045c7e967c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:04.434585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-26cb3808-faf7-4c21-ad8d-ed045c7e967c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:04.441369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26cb3808-faf7-4c21-ad8d-ed045c7e967c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:04.441861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26cb3808-faf7-4c21-ad8d-ed045c7e967c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:04.442657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26cb3808-faf7-4c21-ad8d-ed045c7e967c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:04.443099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26cb3808-faf7-4c21-ad8d-ed045c7e967c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:04.469088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-26cb3808-faf7-4c21-ad8d-ed045c7e967c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:41:04.807648 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-26cb3808-faf7-4c21-ad8d-ed045c7e967c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "DELETE /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 204 len: 0 microversion: 2.1 time: 0.377234 Jan 22 21:41:04.808249 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4248/8201] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:41:04 2022] DELETE /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:41:04.816368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-22a60651-000f-4da0-9d2c-57ebadb7a748 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:04.816989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-22a60651-000f-4da0-9d2c-57ebadb7a748 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:04.823000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22a60651-000f-4da0-9d2c-57ebadb7a748 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:04.823461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22a60651-000f-4da0-9d2c-57ebadb7a748 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:04.824246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22a60651-000f-4da0-9d2c-57ebadb7a748 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:04.824690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22a60651-000f-4da0-9d2c-57ebadb7a748 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:04.964539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-22a60651-000f-4da0-9d2c-57ebadb7a748 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:04.972844 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-22a60651-000f-4da0-9d2c-57ebadb7a748 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1398 microversion: 2.1 time: 0.160203 Jan 22 21:41:04.973416 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3954/8202] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:04 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1398 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:05.992955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-543390ad-5a29-4720-8dbb-a3a67d723ad0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:05.993699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-543390ad-5a29-4720-8dbb-a3a67d723ad0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:06.000860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-543390ad-5a29-4720-8dbb-a3a67d723ad0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:06.001315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-543390ad-5a29-4720-8dbb-a3a67d723ad0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:06.002299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-543390ad-5a29-4720-8dbb-a3a67d723ad0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:06.003510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-543390ad-5a29-4720-8dbb-a3a67d723ad0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:06.167937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-543390ad-5a29-4720-8dbb-a3a67d723ad0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:06.181728 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-543390ad-5a29-4720-8dbb-a3a67d723ad0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1398 microversion: 2.1 time: 0.193631 Jan 22 21:41:06.182829 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4249/8203] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:05 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1398 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:06.990549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-d7513f04-38d1-44b3-9a10-abe8a04b8bf8 req-bed7b6d7-1f48-4b01-9cdb-620063d9fade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fda2ef84-3b7f-4ead-9f69-03737b08199a", "name": "network-vif-deleted", "tag": "b61273a4-a8e2-42cc-a5ae-ec5439b196d7"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:41:06.992111 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:41:06.992111 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:41:07.002505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d7513f04-38d1-44b3-9a10-abe8a04b8bf8 req-bed7b6d7-1f48-4b01-9cdb-620063d9fade service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:07.002965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d7513f04-38d1-44b3-9a10-abe8a04b8bf8 req-bed7b6d7-1f48-4b01-9cdb-620063d9fade service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:07.018574 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-d7513f04-38d1-44b3-9a10-abe8a04b8bf8 req-bed7b6d7-1f48-4b01-9cdb-620063d9fade service nova] Creating event network-vif-deleted:b61273a4-a8e2-42cc-a5ae-ec5439b196d7 for instance fda2ef84-3b7f-4ead-9f69-03737b08199a on nch2-master-1 Jan 22 21:41:07.023581 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-d7513f04-38d1-44b3-9a10-abe8a04b8bf8 req-bed7b6d7-1f48-4b01-9cdb-620063d9fade service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036730 Jan 22 21:41:07.024187 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3955/8204] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:41:07.199635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fd8609ff-2025-4c77-9505-2470daccaf7e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:07.241991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fd8609ff-2025-4c77-9505-2470daccaf7e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:07.241991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd8609ff-2025-4c77-9505-2470daccaf7e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:07.241991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd8609ff-2025-4c77-9505-2470daccaf7e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:07.241991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd8609ff-2025-4c77-9505-2470daccaf7e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:07.241991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd8609ff-2025-4c77-9505-2470daccaf7e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:07.273925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fd8609ff-2025-4c77-9505-2470daccaf7e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:07.282275 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fd8609ff-2025-4c77-9505-2470daccaf7e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1191 microversion: 2.1 time: 0.086373 Jan 22 21:41:07.283093 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4250/8205] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:07 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:08.300419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a6eff6bd-a07e-4b5b-864e-10d8d8ac026f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:08.301124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a6eff6bd-a07e-4b5b-864e-10d8d8ac026f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:08.307722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6eff6bd-a07e-4b5b-864e-10d8d8ac026f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:08.308194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6eff6bd-a07e-4b5b-864e-10d8d8ac026f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:08.308987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6eff6bd-a07e-4b5b-864e-10d8d8ac026f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:08.309441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6eff6bd-a07e-4b5b-864e-10d8d8ac026f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:08.342977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6eff6bd-a07e-4b5b-864e-10d8d8ac026f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:08.343639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a6eff6bd-a07e-4b5b-864e-10d8d8ac026f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:08.344099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-a6eff6bd-a07e-4b5b-864e-10d8d8ac026f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lazy-loading 'fault' on Instance uuid fda2ef84-3b7f-4ead-9f69-03737b08199a {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:41:08.388224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a6eff6bd-a07e-4b5b-864e-10d8d8ac026f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:08.396699 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a6eff6bd-a07e-4b5b-864e-10d8d8ac026f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 200 len: 1150 microversion: 2.1 time: 0.101143 Jan 22 21:41:08.397827 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3956/8206] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:08 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 1150 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:09.414201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-215cee50-0aec-473b-a840-9fd61f9913ad tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:09.414826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-215cee50-0aec-473b-a840-9fd61f9913ad tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:09.422477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-215cee50-0aec-473b-a840-9fd61f9913ad tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:09.428386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-215cee50-0aec-473b-a840-9fd61f9913ad tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:09.428386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-215cee50-0aec-473b-a840-9fd61f9913ad tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:09.428386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-215cee50-0aec-473b-a840-9fd61f9913ad tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:09.438214 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-215cee50-0aec-473b-a840-9fd61f9913ad tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] HTTP exception thrown: Instance fda2ef84-3b7f-4ead-9f69-03737b08199a could not be found. Jan 22 21:41:09.438835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-215cee50-0aec-473b-a840-9fd61f9913ad tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Returning 404 to user: Instance fda2ef84-3b7f-4ead-9f69-03737b08199a could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:41:09.439734 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-215cee50-0aec-473b-a840-9fd61f9913ad tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 404 len: 111 microversion: 2.1 time: 0.029207 Jan 22 21:41:09.440281 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4251/8207] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:09 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:41:11.567657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-373eaf96-8ccb-4a18-934f-29fac215e4fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:11.568214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-373eaf96-8ccb-4a18-934f-29fac215e4fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:11.574712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-373eaf96-8ccb-4a18-934f-29fac215e4fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:11.575170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-373eaf96-8ccb-4a18-934f-29fac215e4fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:11.575962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-373eaf96-8ccb-4a18-934f-29fac215e4fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:11.576409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-373eaf96-8ccb-4a18-934f-29fac215e4fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:11.590213 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-373eaf96-8ccb-4a18-934f-29fac215e4fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] HTTP exception thrown: Instance fda2ef84-3b7f-4ead-9f69-03737b08199a could not be found. Jan 22 21:41:11.590803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-373eaf96-8ccb-4a18-934f-29fac215e4fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Returning 404 to user: Instance fda2ef84-3b7f-4ead-9f69-03737b08199a could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:41:11.592292 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-373eaf96-8ccb-4a18-934f-29fac215e4fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "DELETE /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 404 len: 111 microversion: 2.1 time: 0.027975 Jan 22 21:41:11.592292 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3957/8208] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:41:11 2022] DELETE /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:41:11.600273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5336617d-0e28-40dd-b9a7-07451f286639 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:11.600947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5336617d-0e28-40dd-b9a7-07451f286639 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: fda2ef84-3b7f-4ead-9f69-03737b08199a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:11.609977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5336617d-0e28-40dd-b9a7-07451f286639 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:11.609977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5336617d-0e28-40dd-b9a7-07451f286639 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:11.610606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5336617d-0e28-40dd-b9a7-07451f286639 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:11.611091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5336617d-0e28-40dd-b9a7-07451f286639 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:11.625297 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-5336617d-0e28-40dd-b9a7-07451f286639 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] HTTP exception thrown: Instance fda2ef84-3b7f-4ead-9f69-03737b08199a could not be found. Jan 22 21:41:11.626089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5336617d-0e28-40dd-b9a7-07451f286639 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Returning 404 to user: Instance fda2ef84-3b7f-4ead-9f69-03737b08199a could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:41:11.626880 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5336617d-0e28-40dd-b9a7-07451f286639 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a" status: 404 len: 111 microversion: 2.1 time: 0.030421 Jan 22 21:41:11.627599 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4252/8209] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:11 2022] GET /compute/v2.1/servers/fda2ef84-3b7f-4ead-9f69-03737b08199a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:41:26.625683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1073109520", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5372a0ff-89fb-48b9-9dc8-50dcd6dd4944", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "0d3284bd-fac7-4820-be51-ef816f4145f3"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:41:26.700130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] validate_networks() for [('0d3284bd-fac7-4820-be51-ef816f4145f3', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:41:27.434034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:41:27.434463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:41:27.434943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:41:27.435373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:41:27.435812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:41:27.448271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:27.448733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:27.449608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:27.450068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:27.467864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Getting quotas for project 61bfb71de54c471193d2c71859a7f051. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:41:27.473985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Getting quotas for user 29e976f05d60471b9e6fb8290f07ccce and project 61bfb71de54c471193d2c71859a7f051. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:41:27.532062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:41:27.534959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5372a0ff-89fb-48b9-9dc8-50dcd6dd4944',volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:41:27.962499 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-517b2022-0bd7-46c8-b084-f28252f1bf46 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.340929 Jan 22 21:41:27.963337 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3958/8210] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:41:26 2022] POST /compute/v2.1/servers => generated 382 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 21:41:27.973287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c4ab5390-97cc-458a-b90f-577abc61eb48 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:27.973947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c4ab5390-97cc-458a-b90f-577abc61eb48 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:28.028789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c4ab5390-97cc-458a-b90f-577abc61eb48 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:28.036637 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c4ab5390-97cc-458a-b90f-577abc61eb48 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1074 microversion: 2.1 time: 0.067460 Jan 22 21:41:28.037221 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4253/8211] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:27 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1074 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:29.055017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee52b537-1c97-430a-acba-c539a62e036f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:29.055768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ee52b537-1c97-430a-acba-c539a62e036f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:29.062243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee52b537-1c97-430a-acba-c539a62e036f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:29.062766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee52b537-1c97-430a-acba-c539a62e036f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:29.063641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee52b537-1c97-430a-acba-c539a62e036f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:29.064247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee52b537-1c97-430a-acba-c539a62e036f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:29.126213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ee52b537-1c97-430a-acba-c539a62e036f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:29.133948 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee52b537-1c97-430a-acba-c539a62e036f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1124 microversion: 2.1 time: 0.083618 Jan 22 21:41:29.134536 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3959/8212] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:29 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1124 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:30.151594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-02a39360-d814-4cfd-92da-76b75dbc49da tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:30.152362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-02a39360-d814-4cfd-92da-76b75dbc49da tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:30.162537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02a39360-d814-4cfd-92da-76b75dbc49da tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:30.163157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02a39360-d814-4cfd-92da-76b75dbc49da tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:30.164067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02a39360-d814-4cfd-92da-76b75dbc49da tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:30.164543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-02a39360-d814-4cfd-92da-76b75dbc49da tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:30.236885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-02a39360-d814-4cfd-92da-76b75dbc49da tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:30.245730 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-02a39360-d814-4cfd-92da-76b75dbc49da tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1190 microversion: 2.1 time: 0.098380 Jan 22 21:41:30.246431 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4254/8213] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:30 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1190 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:31.262939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-60c02736-68bb-43db-be5d-0e53c91d2a21 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:31.264171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-60c02736-68bb-43db-be5d-0e53c91d2a21 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:31.280851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60c02736-68bb-43db-be5d-0e53c91d2a21 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:31.281327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60c02736-68bb-43db-be5d-0e53c91d2a21 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:31.282175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60c02736-68bb-43db-be5d-0e53c91d2a21 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:31.283218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60c02736-68bb-43db-be5d-0e53c91d2a21 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:31.444959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-60c02736-68bb-43db-be5d-0e53c91d2a21 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:31.454484 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-60c02736-68bb-43db-be5d-0e53c91d2a21 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1232 microversion: 2.1 time: 0.195184 Jan 22 21:41:31.455720 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3960/8214] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:31 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1232 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:32.191861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a0404019-6146-4879-94c2-71fde810e9d0 req-9fb10285-da75-4109-b740-293ca7e52678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a4558d-6d3e-4360-8609-662819990734", "tag": "c817ff2d-3d03-44ab-ba72-67b49d3b2f90"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:41:32.199230 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:41:32.199230 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:41:32.211867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a0404019-6146-4879-94c2-71fde810e9d0 req-9fb10285-da75-4109-b740-293ca7e52678 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:32.215123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a0404019-6146-4879-94c2-71fde810e9d0 req-9fb10285-da75-4109-b740-293ca7e52678 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:32.229416 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a0404019-6146-4879-94c2-71fde810e9d0 req-9fb10285-da75-4109-b740-293ca7e52678 service nova] Creating event network-changed:c817ff2d-3d03-44ab-ba72-67b49d3b2f90 for instance 59a4558d-6d3e-4360-8609-662819990734 on nch2-master-1 Jan 22 21:41:32.234868 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a0404019-6146-4879-94c2-71fde810e9d0 req-9fb10285-da75-4109-b740-293ca7e52678 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054325 Jan 22 21:41:32.238308 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4255/8215] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:41:32.479530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-60aee7fc-b211-46d8-a500-8761926e7ca7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:32.480150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-60aee7fc-b211-46d8-a500-8761926e7ca7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:32.488083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60aee7fc-b211-46d8-a500-8761926e7ca7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:32.488526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60aee7fc-b211-46d8-a500-8761926e7ca7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:32.489629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60aee7fc-b211-46d8-a500-8761926e7ca7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:32.490085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-60aee7fc-b211-46d8-a500-8761926e7ca7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:32.642792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-60aee7fc-b211-46d8-a500-8761926e7ca7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:32.649655 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-60aee7fc-b211-46d8-a500-8761926e7ca7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1220 microversion: 2.1 time: 0.173929 Jan 22 21:41:32.650357 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3961/8216] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:32 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1220 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:33.668505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c213f56b-6ba2-4bc0-9668-67bf3283efbb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:33.669920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c213f56b-6ba2-4bc0-9668-67bf3283efbb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:33.677050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c213f56b-6ba2-4bc0-9668-67bf3283efbb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:33.677534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c213f56b-6ba2-4bc0-9668-67bf3283efbb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:33.678407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c213f56b-6ba2-4bc0-9668-67bf3283efbb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:33.678981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c213f56b-6ba2-4bc0-9668-67bf3283efbb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:33.818273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c213f56b-6ba2-4bc0-9668-67bf3283efbb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:33.826009 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c213f56b-6ba2-4bc0-9668-67bf3283efbb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1220 microversion: 2.1 time: 0.161709 Jan 22 21:41:33.826599 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4256/8217] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:33 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:34.843354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d72ce937-0e15-4564-97b0-0c1a6f4b101e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:34.843981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d72ce937-0e15-4564-97b0-0c1a6f4b101e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:34.851596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d72ce937-0e15-4564-97b0-0c1a6f4b101e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:34.856158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d72ce937-0e15-4564-97b0-0c1a6f4b101e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:34.856158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d72ce937-0e15-4564-97b0-0c1a6f4b101e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:34.856158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d72ce937-0e15-4564-97b0-0c1a6f4b101e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:35.032482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d72ce937-0e15-4564-97b0-0c1a6f4b101e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:35.041018 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d72ce937-0e15-4564-97b0-0c1a6f4b101e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1220 microversion: 2.1 time: 0.201334 Jan 22 21:41:35.041637 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3962/8218] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:34 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1220 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:36.058670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-130d4d51-f99e-4095-b5b7-7a9c5753cf4c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:36.059295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-130d4d51-f99e-4095-b5b7-7a9c5753cf4c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:36.066099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-130d4d51-f99e-4095-b5b7-7a9c5753cf4c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:36.066565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-130d4d51-f99e-4095-b5b7-7a9c5753cf4c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:36.068214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-130d4d51-f99e-4095-b5b7-7a9c5753cf4c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:36.068214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-130d4d51-f99e-4095-b5b7-7a9c5753cf4c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:36.206721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-130d4d51-f99e-4095-b5b7-7a9c5753cf4c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:36.214209 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-130d4d51-f99e-4095-b5b7-7a9c5753cf4c tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1220 microversion: 2.1 time: 0.159405 Jan 22 21:41:36.214790 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4257/8219] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:36 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:41:37.231301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7b12b1fd-5e59-449e-af8b-72dc5cdc71dc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:37.231913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7b12b1fd-5e59-449e-af8b-72dc5cdc71dc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:37.239449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b12b1fd-5e59-449e-af8b-72dc5cdc71dc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:37.239907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b12b1fd-5e59-449e-af8b-72dc5cdc71dc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:37.240697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b12b1fd-5e59-449e-af8b-72dc5cdc71dc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:37.241143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b12b1fd-5e59-449e-af8b-72dc5cdc71dc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:37.387201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7b12b1fd-5e59-449e-af8b-72dc5cdc71dc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:37.395913 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7b12b1fd-5e59-449e-af8b-72dc5cdc71dc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1220 microversion: 2.1 time: 0.168157 Jan 22 21:41:37.396632 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3963/8220] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:37 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1220 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:38.414173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9e537578-7906-4366-8d95-d57df582b1c1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:38.414825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9e537578-7906-4366-8d95-d57df582b1c1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:38.421797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e537578-7906-4366-8d95-d57df582b1c1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:38.422326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e537578-7906-4366-8d95-d57df582b1c1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:38.425789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e537578-7906-4366-8d95-d57df582b1c1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:38.425789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e537578-7906-4366-8d95-d57df582b1c1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:38.562435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9e537578-7906-4366-8d95-d57df582b1c1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:38.570321 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9e537578-7906-4366-8d95-d57df582b1c1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1220 microversion: 2.1 time: 0.159942 Jan 22 21:41:38.570892 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4258/8221] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:38 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:39.230112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-67ffcf21-a963-45dd-a9d3-bf281237d11d req-f10e1500-0dae-46c8-b7d0-07b8587de9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a4558d-6d3e-4360-8609-662819990734", "name": "network-vif-plugged", "status": "completed", "tag": "c817ff2d-3d03-44ab-ba72-67b49d3b2f90"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:41:39.231754 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:41:39.231754 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:41:39.238849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-67ffcf21-a963-45dd-a9d3-bf281237d11d req-f10e1500-0dae-46c8-b7d0-07b8587de9b1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:39.239300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-67ffcf21-a963-45dd-a9d3-bf281237d11d req-f10e1500-0dae-46c8-b7d0-07b8587de9b1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:39.253576 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-67ffcf21-a963-45dd-a9d3-bf281237d11d req-f10e1500-0dae-46c8-b7d0-07b8587de9b1 service nova] Creating event network-vif-plugged:c817ff2d-3d03-44ab-ba72-67b49d3b2f90 for instance 59a4558d-6d3e-4360-8609-662819990734 on nch2-master-1 Jan 22 21:41:39.258724 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-67ffcf21-a963-45dd-a9d3-bf281237d11d req-f10e1500-0dae-46c8-b7d0-07b8587de9b1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185902 Jan 22 21:41:39.259272 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3964/8222] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:41:39.588244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bcdeed1d-f053-42a5-9cfe-98b99acdf3bc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:39.588857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bcdeed1d-f053-42a5-9cfe-98b99acdf3bc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:39.596765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcdeed1d-f053-42a5-9cfe-98b99acdf3bc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:39.597327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcdeed1d-f053-42a5-9cfe-98b99acdf3bc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:39.598668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcdeed1d-f053-42a5-9cfe-98b99acdf3bc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:39.599362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcdeed1d-f053-42a5-9cfe-98b99acdf3bc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:39.744645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bcdeed1d-f053-42a5-9cfe-98b99acdf3bc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:39.752166 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bcdeed1d-f053-42a5-9cfe-98b99acdf3bc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1220 microversion: 2.1 time: 0.167600 Jan 22 21:41:39.752744 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4259/8223] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:39 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1220 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:40.770045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cafbc643-0743-45a7-a37f-40473e7f998e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:40.770748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cafbc643-0743-45a7-a37f-40473e7f998e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:40.777137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cafbc643-0743-45a7-a37f-40473e7f998e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:40.783802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cafbc643-0743-45a7-a37f-40473e7f998e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:40.783802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cafbc643-0743-45a7-a37f-40473e7f998e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:40.783802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cafbc643-0743-45a7-a37f-40473e7f998e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:40.928950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cafbc643-0743-45a7-a37f-40473e7f998e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:40.934851 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cafbc643-0743-45a7-a37f-40473e7f998e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1220 microversion: 2.1 time: 0.170300 Jan 22 21:41:40.935559 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3965/8224] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:40 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1220 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:41.951915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b713714-7c79-4c91-9e47-88dfb383773d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:41.952446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b713714-7c79-4c91-9e47-88dfb383773d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:41.959423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b713714-7c79-4c91-9e47-88dfb383773d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:41.959881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b713714-7c79-4c91-9e47-88dfb383773d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:41.960879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b713714-7c79-4c91-9e47-88dfb383773d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:41.961333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b713714-7c79-4c91-9e47-88dfb383773d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:42.327536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8b713714-7c79-4c91-9e47-88dfb383773d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:42.336627 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b713714-7c79-4c91-9e47-88dfb383773d tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1406 microversion: 2.1 time: 0.388422 Jan 22 21:41:42.337228 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4260/8225] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:41 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1406 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:41:42.353474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-911fc9fc-8621-479f-ab5b-50d80f145ef8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:42.354160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-911fc9fc-8621-479f-ab5b-50d80f145ef8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:42.361015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-911fc9fc-8621-479f-ab5b-50d80f145ef8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:42.361477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-911fc9fc-8621-479f-ab5b-50d80f145ef8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:42.362387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-911fc9fc-8621-479f-ab5b-50d80f145ef8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:42.362892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-911fc9fc-8621-479f-ab5b-50d80f145ef8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:42.495588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-911fc9fc-8621-479f-ab5b-50d80f145ef8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:42.504475 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-911fc9fc-8621-479f-ab5b-50d80f145ef8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1406 microversion: 2.1 time: 0.154733 Jan 22 21:41:42.505064 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3966/8226] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:42 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:42.520722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-47031efb-4d5e-4266-9ab7-fb3f96671a73 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-28626556"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:41:42.521786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-47031efb-4d5e-4266-9ab7-fb3f96671a73 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:42.527922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47031efb-4d5e-4266-9ab7-fb3f96671a73 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:42.528387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47031efb-4d5e-4266-9ab7-fb3f96671a73 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:42.529185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47031efb-4d5e-4266-9ab7-fb3f96671a73 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:42.529666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47031efb-4d5e-4266-9ab7-fb3f96671a73 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:42.619355 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.compute.api [None req-47031efb-4d5e-4266-9ab7-fb3f96671a73 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Attempting to quiesce instance before volume snapshot. Jan 22 21:41:42.660509 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.compute.api [None req-47031efb-4d5e-4266-9ab7-fb3f96671a73 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jan 22 21:41:42.867039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-47031efb-4d5e-4266-9ab7-fb3f96671a73 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Creating snapshot from volume 5372a0ff-89fb-48b9-9dc8-50dcd6dd4944. {{(pid=137032) snapshot_instance /opt/stack/nova/nova/compute/api.py:3399}} Jan 22 21:41:44.569809 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-47031efb-4d5e-4266-9ab7-fb3f96671a73 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "POST /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734/action" status: 202 len: 0 microversion: 2.1 time: 2.052810 Jan 22 21:41:44.570847 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4261/8227] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:41:42 2022] POST /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734/action => generated 0 bytes in 2054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 22 21:41:46.817922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1748852130", "imageRef": "95b72da3-7029-45f7-bf29-032aa7a2b960", "flavorRef": "452", "networks": [{"uuid": "0d3284bd-fac7-4820-be51-ef816f4145f3"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:41:46.872172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] validate_networks() for [('0d3284bd-fac7-4820-be51-ef816f4145f3', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:41:47.247717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:41:47.248145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:41:47.248617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:41:47.249031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:41:47.249444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:41:47.259054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:47.259504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:47.260354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:47.260841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:47.277953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Getting quotas for project 61bfb71de54c471193d2c71859a7f051. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:41:47.283319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Getting quotas for user 29e976f05d60471b9e6fb8290f07ccce and project 61bfb71de54c471193d2c71859a7f051. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:41:47.295873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:41:47.298447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d45f94a9-6b17-42e9-a7fe-43568a5ee7e5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:41:47.479609 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e33af1e5-2c72-40bc-99fb-52b1c66c8fc6 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.665398 Jan 22 21:41:47.480290 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3967/8228] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:41:46 2022] POST /compute/v2.1/servers => generated 382 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:41:47.493805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c7380fab-17e4-40bf-ac8f-99e60f84893a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:47.495011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c7380fab-17e4-40bf-ac8f-99e60f84893a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:47.550110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c7380fab-17e4-40bf-ac8f-99e60f84893a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:47.557929 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c7380fab-17e4-40bf-ac8f-99e60f84893a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1234 microversion: 2.1 time: 0.071267 Jan 22 21:41:47.558620 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4262/8229] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:47 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1234 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:48.575843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e0a0b32f-f266-4dbb-923f-8ecc642b1ead tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:48.576674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e0a0b32f-f266-4dbb-923f-8ecc642b1ead tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:48.584313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0a0b32f-f266-4dbb-923f-8ecc642b1ead tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:48.584780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0a0b32f-f266-4dbb-923f-8ecc642b1ead tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:48.585619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0a0b32f-f266-4dbb-923f-8ecc642b1ead tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:48.586131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0a0b32f-f266-4dbb-923f-8ecc642b1ead tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:48.652913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e0a0b32f-f266-4dbb-923f-8ecc642b1ead tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:48.660764 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e0a0b32f-f266-4dbb-923f-8ecc642b1ead tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1238 microversion: 2.1 time: 0.089524 Jan 22 21:41:48.661330 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3968/8230] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:48 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:49.677248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-47ee8ff1-3559-4594-a9be-2aea56ca209a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:49.677935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-47ee8ff1-3559-4594-a9be-2aea56ca209a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:49.685428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47ee8ff1-3559-4594-a9be-2aea56ca209a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:49.685945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47ee8ff1-3559-4594-a9be-2aea56ca209a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:49.686769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47ee8ff1-3559-4594-a9be-2aea56ca209a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:49.687230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47ee8ff1-3559-4594-a9be-2aea56ca209a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:49.759065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-47ee8ff1-3559-4594-a9be-2aea56ca209a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:49.767894 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-47ee8ff1-3559-4594-a9be-2aea56ca209a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1304 microversion: 2.1 time: 0.094255 Jan 22 21:41:49.770023 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4263/8231] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:49 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:50.786324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bfa24b1b-d872-48db-8392-faae5bc3c3b1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:50.786988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bfa24b1b-d872-48db-8392-faae5bc3c3b1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:50.817876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfa24b1b-d872-48db-8392-faae5bc3c3b1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:50.818371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfa24b1b-d872-48db-8392-faae5bc3c3b1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:50.819188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfa24b1b-d872-48db-8392-faae5bc3c3b1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:50.819649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfa24b1b-d872-48db-8392-faae5bc3c3b1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:51.233332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bfa24b1b-d872-48db-8392-faae5bc3c3b1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:51.255108 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bfa24b1b-d872-48db-8392-faae5bc3c3b1 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1346 microversion: 2.1 time: 0.473102 Jan 22 21:41:51.256891 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3969/8232] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:50 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1346 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:52.235425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-fdf9d100-dad5-4be8-abfb-761a5b66f427 req-43a8b2b5-c226-4069-9fa5-8f61ca665498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6405706-034c-4195-a6be-5569c386321c", "tag": "edeeb379-9c4e-45a8-bd58-6ad2103238fc"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:41:52.237455 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:41:52.237455 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:41:52.250221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-fdf9d100-dad5-4be8-abfb-761a5b66f427 req-43a8b2b5-c226-4069-9fa5-8f61ca665498 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:52.250894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-fdf9d100-dad5-4be8-abfb-761a5b66f427 req-43a8b2b5-c226-4069-9fa5-8f61ca665498 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:52.266470 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-fdf9d100-dad5-4be8-abfb-761a5b66f427 req-43a8b2b5-c226-4069-9fa5-8f61ca665498 service nova] Creating event network-changed:edeeb379-9c4e-45a8-bd58-6ad2103238fc for instance a6405706-034c-4195-a6be-5569c386321c on nch1-master-1 Jan 22 21:41:52.274258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1b4f3034-8209-4723-8bfb-d02612023256 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:52.275900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1b4f3034-8209-4723-8bfb-d02612023256 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:52.293415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b4f3034-8209-4723-8bfb-d02612023256 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:52.307597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b4f3034-8209-4723-8bfb-d02612023256 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:52.307978 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-fdf9d100-dad5-4be8-abfb-761a5b66f427 req-43a8b2b5-c226-4069-9fa5-8f61ca665498 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268280 Jan 22 21:41:52.308806 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4264/8233] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:41:52.311915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b4f3034-8209-4723-8bfb-d02612023256 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:52.312669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1b4f3034-8209-4723-8bfb-d02612023256 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:52.602634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1b4f3034-8209-4723-8bfb-d02612023256 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:52.615480 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1b4f3034-8209-4723-8bfb-d02612023256 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1346 microversion: 2.1 time: 0.345291 Jan 22 21:41:52.616470 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3970/8234] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:52 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1346 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:53.634289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-43e9c054-152d-49c7-b41a-7e3f7d9227f8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:53.636858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-43e9c054-152d-49c7-b41a-7e3f7d9227f8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:53.652735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43e9c054-152d-49c7-b41a-7e3f7d9227f8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:53.653213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43e9c054-152d-49c7-b41a-7e3f7d9227f8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:53.654218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43e9c054-152d-49c7-b41a-7e3f7d9227f8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:53.654674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43e9c054-152d-49c7-b41a-7e3f7d9227f8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:53.803166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-43e9c054-152d-49c7-b41a-7e3f7d9227f8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:53.815284 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-43e9c054-152d-49c7-b41a-7e3f7d9227f8 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1346 microversion: 2.1 time: 0.185849 Jan 22 21:41:53.815755 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4265/8235] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:53 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1346 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:54.832812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dcd676bc-4e9c-4215-a6dc-bf5527e18cc3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:54.833432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dcd676bc-4e9c-4215-a6dc-bf5527e18cc3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:54.840738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcd676bc-4e9c-4215-a6dc-bf5527e18cc3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:54.843686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcd676bc-4e9c-4215-a6dc-bf5527e18cc3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:54.843686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcd676bc-4e9c-4215-a6dc-bf5527e18cc3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:54.843686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcd676bc-4e9c-4215-a6dc-bf5527e18cc3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:55.004687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dcd676bc-4e9c-4215-a6dc-bf5527e18cc3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:55.016574 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dcd676bc-4e9c-4215-a6dc-bf5527e18cc3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1346 microversion: 2.1 time: 0.184262 Jan 22 21:41:55.016574 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3971/8236] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:54 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:56.030594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1d96e447-8a2c-406a-b17a-9270a63e0d50 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:56.031223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1d96e447-8a2c-406a-b17a-9270a63e0d50 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:56.038292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d96e447-8a2c-406a-b17a-9270a63e0d50 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:56.038767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d96e447-8a2c-406a-b17a-9270a63e0d50 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:56.039582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d96e447-8a2c-406a-b17a-9270a63e0d50 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:56.040042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d96e447-8a2c-406a-b17a-9270a63e0d50 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:56.204573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1d96e447-8a2c-406a-b17a-9270a63e0d50 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:56.213762 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1d96e447-8a2c-406a-b17a-9270a63e0d50 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1380 microversion: 2.1 time: 0.187105 Jan 22 21:41:56.214365 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4266/8237] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:56 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1380 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:57.231571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d3956d48-71c6-4bd6-a048-5a8cbaedf784 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:57.232230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d3956d48-71c6-4bd6-a048-5a8cbaedf784 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:57.240418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3956d48-71c6-4bd6-a048-5a8cbaedf784 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:57.240886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3956d48-71c6-4bd6-a048-5a8cbaedf784 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:57.241728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3956d48-71c6-4bd6-a048-5a8cbaedf784 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:57.248811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3956d48-71c6-4bd6-a048-5a8cbaedf784 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:57.428472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d3956d48-71c6-4bd6-a048-5a8cbaedf784 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:57.436142 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d3956d48-71c6-4bd6-a048-5a8cbaedf784 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1380 microversion: 2.1 time: 0.208382 Jan 22 21:41:57.436715 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3972/8238] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:57 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1380 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:58.453295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9140c351-5b83-4408-a9c2-c130a3515d41 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:58.461475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9140c351-5b83-4408-a9c2-c130a3515d41 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:58.462307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9140c351-5b83-4408-a9c2-c130a3515d41 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:58.462593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9140c351-5b83-4408-a9c2-c130a3515d41 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:58.463426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9140c351-5b83-4408-a9c2-c130a3515d41 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:58.463873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9140c351-5b83-4408-a9c2-c130a3515d41 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:58.609531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9140c351-5b83-4408-a9c2-c130a3515d41 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:58.622588 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9140c351-5b83-4408-a9c2-c130a3515d41 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1380 microversion: 2.1 time: 0.173472 Jan 22 21:41:58.633398 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4267/8239] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:58 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1380 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:41:59.639498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a747594d-6f9a-4073-a40a-71d0870686e3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:41:59.640333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a747594d-6f9a-4073-a40a-71d0870686e3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:41:59.647771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a747594d-6f9a-4073-a40a-71d0870686e3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:59.648431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a747594d-6f9a-4073-a40a-71d0870686e3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:59.649344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a747594d-6f9a-4073-a40a-71d0870686e3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:41:59.649873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a747594d-6f9a-4073-a40a-71d0870686e3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:41:59.853251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a747594d-6f9a-4073-a40a-71d0870686e3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:41:59.862468 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a747594d-6f9a-4073-a40a-71d0870686e3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1380 microversion: 2.1 time: 0.226440 Jan 22 21:41:59.863514 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3973/8240] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:41:59 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1380 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:42:00.879685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-044440eb-2b0d-4f76-a68a-44623423ebc0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:00.881089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-044440eb-2b0d-4f76-a68a-44623423ebc0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:00.887936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-044440eb-2b0d-4f76-a68a-44623423ebc0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:00.888644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-044440eb-2b0d-4f76-a68a-44623423ebc0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:00.889641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-044440eb-2b0d-4f76-a68a-44623423ebc0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:00.890264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-044440eb-2b0d-4f76-a68a-44623423ebc0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:00.997141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-67ba6a03-b0b9-4006-ab8e-31fa9775e284 req-26e6826d-0abf-48ef-a469-5c61e42dddae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6405706-034c-4195-a6be-5569c386321c", "name": "network-vif-plugged", "status": "completed", "tag": "edeeb379-9c4e-45a8-bd58-6ad2103238fc"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:42:00.998798 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:42:00.998798 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:42:01.007393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-67ba6a03-b0b9-4006-ab8e-31fa9775e284 req-26e6826d-0abf-48ef-a469-5c61e42dddae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:01.008039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-67ba6a03-b0b9-4006-ab8e-31fa9775e284 req-26e6826d-0abf-48ef-a469-5c61e42dddae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:01.025620 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-67ba6a03-b0b9-4006-ab8e-31fa9775e284 req-26e6826d-0abf-48ef-a469-5c61e42dddae service nova] Creating event network-vif-plugged:edeeb379-9c4e-45a8-bd58-6ad2103238fc for instance a6405706-034c-4195-a6be-5569c386321c on nch1-master-1 Jan 22 21:42:01.027015 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-67ba6a03-b0b9-4006-ab8e-31fa9775e284 req-26e6826d-0abf-48ef-a469-5c61e42dddae service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033434 Jan 22 21:42:01.027644 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3974/8241] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:42:01.073251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-044440eb-2b0d-4f76-a68a-44623423ebc0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:42:01.081985 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-044440eb-2b0d-4f76-a68a-44623423ebc0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1380 microversion: 2.1 time: 0.206766 Jan 22 21:42:01.082730 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4268/8242] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:42:00 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1380 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:42:02.098863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2c2e09ff-081c-4da5-a4f0-f37de2e4b0fd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:02.099650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2c2e09ff-081c-4da5-a4f0-f37de2e4b0fd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:02.107504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c2e09ff-081c-4da5-a4f0-f37de2e4b0fd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:02.111049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c2e09ff-081c-4da5-a4f0-f37de2e4b0fd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:02.111049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c2e09ff-081c-4da5-a4f0-f37de2e4b0fd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:02.111049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c2e09ff-081c-4da5-a4f0-f37de2e4b0fd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:02.251804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2c2e09ff-081c-4da5-a4f0-f37de2e4b0fd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:42:02.260139 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2c2e09ff-081c-4da5-a4f0-f37de2e4b0fd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1380 microversion: 2.1 time: 0.165585 Jan 22 21:42:02.260832 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3975/8243] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:42:02 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1380 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:42:03.277968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7938e572-5526-46e1-85fa-adf499c887fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:03.282400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7938e572-5526-46e1-85fa-adf499c887fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:03.285734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7938e572-5526-46e1-85fa-adf499c887fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:03.286216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7938e572-5526-46e1-85fa-adf499c887fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:03.287052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7938e572-5526-46e1-85fa-adf499c887fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:03.287513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7938e572-5526-46e1-85fa-adf499c887fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:03.427969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7938e572-5526-46e1-85fa-adf499c887fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:42:03.435540 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7938e572-5526-46e1-85fa-adf499c887fb tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1566 microversion: 2.1 time: 0.161735 Jan 22 21:42:03.436115 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4269/8244] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:42:03 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:42:03.451343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b59d4d76-a467-4b16-8ae0-a7778ca014c0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:03.451959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b59d4d76-a467-4b16-8ae0-a7778ca014c0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:03.459057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b59d4d76-a467-4b16-8ae0-a7778ca014c0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:03.459521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b59d4d76-a467-4b16-8ae0-a7778ca014c0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:03.460360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b59d4d76-a467-4b16-8ae0-a7778ca014c0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:03.460771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b59d4d76-a467-4b16-8ae0-a7778ca014c0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:03.608189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b59d4d76-a467-4b16-8ae0-a7778ca014c0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:42:03.616631 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b59d4d76-a467-4b16-8ae0-a7778ca014c0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1566 microversion: 2.1 time: 0.168930 Jan 22 21:42:03.617342 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3976/8245] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:42:03 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:42:03.708295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:03.708295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:03.708295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:03.708295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:03.708295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:03.708295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:03.722843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:42:04.188193 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a2817699-3e30-4a98-8fdc-ea1dca3b1bff tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 204 len: 0 microversion: 2.1 time: 0.504844 Jan 22 21:42:04.188992 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4270/8246] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:42:03 2022] DELETE /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:42:04.197853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-95d28d20-afd4-47be-a4a5-da6019d53f29 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:04.198615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-95d28d20-afd4-47be-a4a5-da6019d53f29 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:04.205252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95d28d20-afd4-47be-a4a5-da6019d53f29 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:04.205747 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95d28d20-afd4-47be-a4a5-da6019d53f29 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:04.206595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95d28d20-afd4-47be-a4a5-da6019d53f29 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:04.207213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-95d28d20-afd4-47be-a4a5-da6019d53f29 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:04.357050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-95d28d20-afd4-47be-a4a5-da6019d53f29 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:42:04.365826 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-95d28d20-afd4-47be-a4a5-da6019d53f29 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1572 microversion: 2.1 time: 0.171969 Jan 22 21:42:04.366923 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3977/8247] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:42:04 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1572 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:42:05.387426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-83d7cb80-ad37-4b84-aeac-90005f4068fa tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:05.388183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-83d7cb80-ad37-4b84-aeac-90005f4068fa tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:05.396411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83d7cb80-ad37-4b84-aeac-90005f4068fa tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:05.396885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83d7cb80-ad37-4b84-aeac-90005f4068fa tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:05.397912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83d7cb80-ad37-4b84-aeac-90005f4068fa tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:05.402272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83d7cb80-ad37-4b84-aeac-90005f4068fa tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:05.551017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-83d7cb80-ad37-4b84-aeac-90005f4068fa tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:42:05.561185 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-83d7cb80-ad37-4b84-aeac-90005f4068fa tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1572 microversion: 2.1 time: 0.179479 Jan 22 21:42:05.563357 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4271/8248] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:42:05 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1572 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:42:06.497264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-41a37f96-f915-4c64-af60-4e81639d63df req-dc094764-1486-4333-b8e0-dccd6bbd39d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6405706-034c-4195-a6be-5569c386321c", "name": "network-vif-deleted", "tag": "edeeb379-9c4e-45a8-bd58-6ad2103238fc"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:42:06.499477 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:42:06.499477 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:42:06.509479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-41a37f96-f915-4c64-af60-4e81639d63df req-dc094764-1486-4333-b8e0-dccd6bbd39d2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:06.510016 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-41a37f96-f915-4c64-af60-4e81639d63df req-dc094764-1486-4333-b8e0-dccd6bbd39d2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:06.533579 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-41a37f96-f915-4c64-af60-4e81639d63df req-dc094764-1486-4333-b8e0-dccd6bbd39d2 service nova] Creating event network-vif-deleted:edeeb379-9c4e-45a8-bd58-6ad2103238fc for instance a6405706-034c-4195-a6be-5569c386321c on nch1-master-1 Jan 22 21:42:06.539424 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-41a37f96-f915-4c64-af60-4e81639d63df req-dc094764-1486-4333-b8e0-dccd6bbd39d2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045732 Jan 22 21:42:06.542441 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3978/8249] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:42:06.580137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f3db92bc-82f1-42db-a715-9e387f95da53 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:06.580847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f3db92bc-82f1-42db-a715-9e387f95da53 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:06.590677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3db92bc-82f1-42db-a715-9e387f95da53 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:06.592564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3db92bc-82f1-42db-a715-9e387f95da53 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:06.593628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3db92bc-82f1-42db-a715-9e387f95da53 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:06.594264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f3db92bc-82f1-42db-a715-9e387f95da53 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:06.679742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f3db92bc-82f1-42db-a715-9e387f95da53 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:42:06.691558 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f3db92bc-82f1-42db-a715-9e387f95da53 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1530 microversion: 2.1 time: 0.115248 Jan 22 21:42:06.692266 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4272/8250] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:42:06 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1530 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:42:07.709947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-86b789f0-af20-4605-9e47-f3e5fca20859 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:07.710652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-86b789f0-af20-4605-9e47-f3e5fca20859 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:07.717618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86b789f0-af20-4605-9e47-f3e5fca20859 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:07.718082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86b789f0-af20-4605-9e47-f3e5fca20859 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:07.718873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86b789f0-af20-4605-9e47-f3e5fca20859 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:07.719318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86b789f0-af20-4605-9e47-f3e5fca20859 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:07.752110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86b789f0-af20-4605-9e47-f3e5fca20859 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:07.752567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-86b789f0-af20-4605-9e47-f3e5fca20859 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:07.753022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-86b789f0-af20-4605-9e47-f3e5fca20859 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lazy-loading 'fault' on Instance uuid a6405706-034c-4195-a6be-5569c386321c {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:42:07.793427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-86b789f0-af20-4605-9e47-f3e5fca20859 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:42:07.800954 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-86b789f0-af20-4605-9e47-f3e5fca20859 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 200 len: 1370 microversion: 2.1 time: 0.096037 Jan 22 21:42:07.801744 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3979/8251] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:42:07 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:42:08.820382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-67127b4e-1a75-437c-83c3-cce8b0028a0a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:08.821000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-67127b4e-1a75-437c-83c3-cce8b0028a0a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:08.827824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67127b4e-1a75-437c-83c3-cce8b0028a0a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:08.828291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67127b4e-1a75-437c-83c3-cce8b0028a0a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:08.829093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67127b4e-1a75-437c-83c3-cce8b0028a0a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:08.829658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67127b4e-1a75-437c-83c3-cce8b0028a0a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:08.842943 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-67127b4e-1a75-437c-83c3-cce8b0028a0a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] HTTP exception thrown: Instance a6405706-034c-4195-a6be-5569c386321c could not be found. Jan 22 21:42:08.843630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-67127b4e-1a75-437c-83c3-cce8b0028a0a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Returning 404 to user: Instance a6405706-034c-4195-a6be-5569c386321c could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:42:08.844488 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-67127b4e-1a75-437c-83c3-cce8b0028a0a tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 404 len: 111 microversion: 2.1 time: 0.027938 Jan 22 21:42:08.845021 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4273/8252] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:42:08 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:42:49.195323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b0e5a6d6-cf69-4b11-bbed-561574a18374 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:49.195323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b0e5a6d6-cf69-4b11-bbed-561574a18374 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:49.200472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0e5a6d6-cf69-4b11-bbed-561574a18374 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:49.200918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0e5a6d6-cf69-4b11-bbed-561574a18374 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:49.201737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0e5a6d6-cf69-4b11-bbed-561574a18374 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:49.202286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0e5a6d6-cf69-4b11-bbed-561574a18374 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:49.226924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b0e5a6d6-cf69-4b11-bbed-561574a18374 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:42:49.599257 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b0e5a6d6-cf69-4b11-bbed-561574a18374 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "DELETE /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 204 len: 0 microversion: 2.1 time: 0.410251 Jan 22 21:42:49.599861 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3980/8253] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:42:49 2022] DELETE /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:42:49.608032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ba9b9aa7-03ee-48fa-81d2-ca187008f2ed tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:49.608665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ba9b9aa7-03ee-48fa-81d2-ca187008f2ed tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:49.615406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba9b9aa7-03ee-48fa-81d2-ca187008f2ed tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:49.615885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba9b9aa7-03ee-48fa-81d2-ca187008f2ed tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:49.616697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba9b9aa7-03ee-48fa-81d2-ca187008f2ed tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:49.617162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba9b9aa7-03ee-48fa-81d2-ca187008f2ed tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:49.756619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ba9b9aa7-03ee-48fa-81d2-ca187008f2ed tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:42:49.765170 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ba9b9aa7-03ee-48fa-81d2-ca187008f2ed tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1412 microversion: 2.1 time: 0.161117 Jan 22 21:42:49.765778 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4274/8254] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:42:49 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1412 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:42:50.782778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d5529858-df19-4e9d-b8fa-9dcb21ec3ccd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:50.783487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d5529858-df19-4e9d-b8fa-9dcb21ec3ccd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:50.790555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5529858-df19-4e9d-b8fa-9dcb21ec3ccd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:50.791024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5529858-df19-4e9d-b8fa-9dcb21ec3ccd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:50.792539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5529858-df19-4e9d-b8fa-9dcb21ec3ccd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:50.792959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5529858-df19-4e9d-b8fa-9dcb21ec3ccd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:50.933428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d5529858-df19-4e9d-b8fa-9dcb21ec3ccd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:42:50.941942 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d5529858-df19-4e9d-b8fa-9dcb21ec3ccd tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1412 microversion: 2.1 time: 0.163213 Jan 22 21:42:50.942528 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3981/8255] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:42:50 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:42:51.895029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-e460f4d7-9469-4686-ad5b-8c3175c70652 req-32c99291-5b9a-42dd-b7ff-37c34fd00990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a4558d-6d3e-4360-8609-662819990734", "name": "network-vif-deleted", "tag": "c817ff2d-3d03-44ab-ba72-67b49d3b2f90"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:42:51.896610 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:42:51.896610 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:42:51.906158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e460f4d7-9469-4686-ad5b-8c3175c70652 req-32c99291-5b9a-42dd-b7ff-37c34fd00990 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:51.907280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-e460f4d7-9469-4686-ad5b-8c3175c70652 req-32c99291-5b9a-42dd-b7ff-37c34fd00990 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:51.919602 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-e460f4d7-9469-4686-ad5b-8c3175c70652 req-32c99291-5b9a-42dd-b7ff-37c34fd00990 service nova] Creating event network-vif-deleted:c817ff2d-3d03-44ab-ba72-67b49d3b2f90 for instance 59a4558d-6d3e-4360-8609-662819990734 on nch2-master-1 Jan 22 21:42:51.925285 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-e460f4d7-9469-4686-ad5b-8c3175c70652 req-32c99291-5b9a-42dd-b7ff-37c34fd00990 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034238 Jan 22 21:42:51.926140 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4275/8256] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:42:51.959307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2a194bc7-e644-4b9e-ab52-61ae4d43d4a9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:51.959931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2a194bc7-e644-4b9e-ab52-61ae4d43d4a9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:51.968667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a194bc7-e644-4b9e-ab52-61ae4d43d4a9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:51.971089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a194bc7-e644-4b9e-ab52-61ae4d43d4a9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:51.972380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a194bc7-e644-4b9e-ab52-61ae4d43d4a9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:51.972828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2a194bc7-e644-4b9e-ab52-61ae4d43d4a9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:52.041750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2a194bc7-e644-4b9e-ab52-61ae4d43d4a9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:42:52.050485 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2a194bc7-e644-4b9e-ab52-61ae4d43d4a9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 200 len: 1370 microversion: 2.1 time: 0.095006 Jan 22 21:42:52.051078 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3982/8257] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:42:51 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 1370 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:42:53.068843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-afc4da9e-be9d-4529-812a-f303e49bdd55 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:53.069693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-afc4da9e-be9d-4529-812a-f303e49bdd55 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:53.077357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afc4da9e-be9d-4529-812a-f303e49bdd55 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:53.077929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afc4da9e-be9d-4529-812a-f303e49bdd55 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:53.078755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afc4da9e-be9d-4529-812a-f303e49bdd55 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:53.079217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afc4da9e-be9d-4529-812a-f303e49bdd55 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:53.094461 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-afc4da9e-be9d-4529-812a-f303e49bdd55 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] HTTP exception thrown: Instance 59a4558d-6d3e-4360-8609-662819990734 could not be found. Jan 22 21:42:53.095087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-afc4da9e-be9d-4529-812a-f303e49bdd55 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Returning 404 to user: Instance 59a4558d-6d3e-4360-8609-662819990734 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:42:53.095951 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-afc4da9e-be9d-4529-812a-f303e49bdd55 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 404 len: 111 microversion: 2.1 time: 0.032141 Jan 22 21:42:53.096509 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4276/8258] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:42:53 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:42:59.430949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7b30b533-7351-4d45-bdef-f8c6aada5e70 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:59.431434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7b30b533-7351-4d45-bdef-f8c6aada5e70 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:59.439021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b30b533-7351-4d45-bdef-f8c6aada5e70 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:59.439477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b30b533-7351-4d45-bdef-f8c6aada5e70 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:59.440267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b30b533-7351-4d45-bdef-f8c6aada5e70 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:59.440712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b30b533-7351-4d45-bdef-f8c6aada5e70 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:59.454817 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-7b30b533-7351-4d45-bdef-f8c6aada5e70 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] HTTP exception thrown: Instance a6405706-034c-4195-a6be-5569c386321c could not be found. Jan 22 21:42:59.459056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7b30b533-7351-4d45-bdef-f8c6aada5e70 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Returning 404 to user: Instance a6405706-034c-4195-a6be-5569c386321c could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:42:59.459056 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7b30b533-7351-4d45-bdef-f8c6aada5e70 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 404 len: 111 microversion: 2.1 time: 0.028926 Jan 22 21:42:59.459056 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3983/8259] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:42:59 2022] DELETE /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:42:59.466091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ebcebe34-7f1f-40ac-b929-1004e3a4bcde tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:42:59.466718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ebcebe34-7f1f-40ac-b929-1004e3a4bcde tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: a6405706-034c-4195-a6be-5569c386321c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:42:59.473412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebcebe34-7f1f-40ac-b929-1004e3a4bcde tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:59.473906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebcebe34-7f1f-40ac-b929-1004e3a4bcde tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:59.474701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebcebe34-7f1f-40ac-b929-1004e3a4bcde tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:42:59.475299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebcebe34-7f1f-40ac-b929-1004e3a4bcde tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:42:59.489548 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-ebcebe34-7f1f-40ac-b929-1004e3a4bcde tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] HTTP exception thrown: Instance a6405706-034c-4195-a6be-5569c386321c could not be found. Jan 22 21:42:59.490144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ebcebe34-7f1f-40ac-b929-1004e3a4bcde tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Returning 404 to user: Instance a6405706-034c-4195-a6be-5569c386321c could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:42:59.490981 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ebcebe34-7f1f-40ac-b929-1004e3a4bcde tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c" status: 404 len: 111 microversion: 2.1 time: 0.029087 Jan 22 21:42:59.491533 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4277/8260] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:42:59 2022] GET /compute/v2.1/servers/a6405706-034c-4195-a6be-5569c386321c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:43:00.391627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e37157c7-0dfc-47f6-aeba-87cc226e6ccf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:00.392359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e37157c7-0dfc-47f6-aeba-87cc226e6ccf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:00.398372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e37157c7-0dfc-47f6-aeba-87cc226e6ccf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:00.398836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e37157c7-0dfc-47f6-aeba-87cc226e6ccf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:00.399663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e37157c7-0dfc-47f6-aeba-87cc226e6ccf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:00.400107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e37157c7-0dfc-47f6-aeba-87cc226e6ccf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:00.414137 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-e37157c7-0dfc-47f6-aeba-87cc226e6ccf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] HTTP exception thrown: Instance 59a4558d-6d3e-4360-8609-662819990734 could not be found. Jan 22 21:43:00.414762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e37157c7-0dfc-47f6-aeba-87cc226e6ccf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Returning 404 to user: Instance 59a4558d-6d3e-4360-8609-662819990734 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:43:00.415596 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e37157c7-0dfc-47f6-aeba-87cc226e6ccf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "DELETE /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 404 len: 111 microversion: 2.1 time: 0.027857 Jan 22 21:43:00.416133 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3984/8261] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:43:00 2022] DELETE /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:43:00.424446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-37f8cc5b-ef92-4328-a2dc-9acbc7c1dd45 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:00.425018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-37f8cc5b-ef92-4328-a2dc-9acbc7c1dd45 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 59a4558d-6d3e-4360-8609-662819990734] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:00.430909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37f8cc5b-ef92-4328-a2dc-9acbc7c1dd45 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:00.431383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37f8cc5b-ef92-4328-a2dc-9acbc7c1dd45 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:00.432181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37f8cc5b-ef92-4328-a2dc-9acbc7c1dd45 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:00.433311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37f8cc5b-ef92-4328-a2dc-9acbc7c1dd45 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:00.446562 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-37f8cc5b-ef92-4328-a2dc-9acbc7c1dd45 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] HTTP exception thrown: Instance 59a4558d-6d3e-4360-8609-662819990734 could not be found. Jan 22 21:43:00.447161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-37f8cc5b-ef92-4328-a2dc-9acbc7c1dd45 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Returning 404 to user: Instance 59a4558d-6d3e-4360-8609-662819990734 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:43:00.448775 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-37f8cc5b-ef92-4328-a2dc-9acbc7c1dd45 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734" status: 404 len: 111 microversion: 2.1 time: 0.027357 Jan 22 21:43:00.449575 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4278/8262] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:00 2022] GET /compute/v2.1/servers/59a4558d-6d3e-4360-8609-662819990734 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:43:00.514654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-54f8d38a-ef32-4691-83ee-a197514d5d4e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Action: 'create', calling method: .version_select at 0x7f1ed5dca0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-293722043"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:43:00.530029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-54f8d38a-ef32-4691-83ee-a197514d5d4e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Getting quotas for project 61bfb71de54c471193d2c71859a7f051. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:43:00.538378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-54f8d38a-ef32-4691-83ee-a197514d5d4e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Getting quotas for user 29e976f05d60471b9e6fb8290f07ccce and project 61bfb71de54c471193d2c71859a7f051. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:43:00.552392 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [None req-54f8d38a-ef32-4691-83ee-a197514d5d4e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [5ae1cfda-c842-4ad6-9e4a-94babe62e9a0] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 21:43:01.559205 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [None req-54f8d38a-ef32-4691-83ee-a197514d5d4e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [5ae1cfda-c842-4ad6-9e4a-94babe62e9a0] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 54578. Jan 22 21:43:01.753854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-54f8d38a-ef32-4691-83ee-a197514d5d4e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Getting quotas for project 61bfb71de54c471193d2c71859a7f051. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:43:01.758991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-54f8d38a-ef32-4691-83ee-a197514d5d4e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Getting quotas for user 29e976f05d60471b9e6fb8290f07ccce and project 61bfb71de54c471193d2c71859a7f051. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:43:01.773471 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-54f8d38a-ef32-4691-83ee-a197514d5d4e tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 1.262571 Jan 22 21:43:01.774120 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3985/8263] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:43:00 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:09.130564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1507569456", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-293722043", "security_groups": [{"name": "tempest-secgroup-smoke-1583999484"}], "block_device_mapping_v2": [{"uuid": "0bfe528f-1900-4abf-897d-9ebc47bcb9b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0d3284bd-fac7-4820-be51-ef816f4145f3"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:43:09.253677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] validate_networks() for [('0d3284bd-fac7-4820-be51-ef816f4145f3', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:43:09.754277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:43:09.754720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:43:09.755237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:43:09.755666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:43:09.756097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:43:09.765400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:09.765902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:09.766732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:09.767189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:09.786969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Getting quotas for project 61bfb71de54c471193d2c71859a7f051. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:43:09.792244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Getting quotas for user 29e976f05d60471b9e6fb8290f07ccce and project 61bfb71de54c471193d2c71859a7f051. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:43:09.849534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:43:09.851746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0bfe528f-1900-4abf-897d-9ebc47bcb9b1',volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:43:10.278390 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [4a072d27-0db7-45bb-97aa-2c81015ea852] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 21:43:11.285676 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [4a072d27-0db7-45bb-97aa-2c81015ea852] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 54788. Jan 22 21:43:11.290355 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8a4088a1-a99e-4d55-be6e-3fde23bc626f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.163729 Jan 22 21:43:11.291009 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4279/8264] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:43:09 2022] POST /compute/v2.1/servers => generated 408 bytes in 2165 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:43:11.301791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9af30bb4-0581-4077-891c-3035c688aac5 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:11.302457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9af30bb4-0581-4077-891c-3035c688aac5 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:11.366450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9af30bb4-0581-4077-891c-3035c688aac5 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:11.374101 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9af30bb4-0581-4077-891c-3035c688aac5 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1097 microversion: 2.1 time: 0.076041 Jan 22 21:43:11.375838 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3986/8265] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:11 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1097 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:12.401440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1abd1bbf-1e85-4986-b323-8192c16b1b4f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:12.402118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1abd1bbf-1e85-4986-b323-8192c16b1b4f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:12.408904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1abd1bbf-1e85-4986-b323-8192c16b1b4f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:12.409376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1abd1bbf-1e85-4986-b323-8192c16b1b4f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:12.410238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1abd1bbf-1e85-4986-b323-8192c16b1b4f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:12.411020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1abd1bbf-1e85-4986-b323-8192c16b1b4f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:12.477697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1abd1bbf-1e85-4986-b323-8192c16b1b4f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:12.485922 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1abd1bbf-1e85-4986-b323-8192c16b1b4f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1139 microversion: 2.1 time: 0.089389 Jan 22 21:43:12.486421 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4280/8266] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:12 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:13.502997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-33608db7-b7ee-407f-b75c-be118801006b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:13.503599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-33608db7-b7ee-407f-b75c-be118801006b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:13.511271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33608db7-b7ee-407f-b75c-be118801006b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:13.511734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33608db7-b7ee-407f-b75c-be118801006b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:13.512535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33608db7-b7ee-407f-b75c-be118801006b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:13.512991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-33608db7-b7ee-407f-b75c-be118801006b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:13.579951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-33608db7-b7ee-407f-b75c-be118801006b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:13.588536 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-33608db7-b7ee-407f-b75c-be118801006b tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1213 microversion: 2.1 time: 0.089498 Jan 22 21:43:13.589451 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3987/8267] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:13 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:14.612958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-380aee78-435a-4ce5-89de-e4db25a78aee tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:14.613616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-380aee78-435a-4ce5-89de-e4db25a78aee tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:14.620407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-380aee78-435a-4ce5-89de-e4db25a78aee tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:14.620884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-380aee78-435a-4ce5-89de-e4db25a78aee tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:14.621737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-380aee78-435a-4ce5-89de-e4db25a78aee tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:14.622198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-380aee78-435a-4ce5-89de-e4db25a78aee tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:14.830797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-380aee78-435a-4ce5-89de-e4db25a78aee tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:14.841009 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-380aee78-435a-4ce5-89de-e4db25a78aee tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1281 microversion: 2.1 time: 0.229979 Jan 22 21:43:14.841009 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4281/8268] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:14 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1281 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:14.949355 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:43:14.949645 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 21:43:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:43:15.281244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-65c30bdb-2770-417d-a11e-e572f1b35be9 req-59455ed9-cf6e-4554-8e36-ce804a876ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83095fa7-9674-41d3-a6c0-d936215ecf0e", "tag": "90d3f07d-cfae-4997-9e86-1ac2bf305cb7"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:43:15.284979 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:43:15.284979 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:43:15.305359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-65c30bdb-2770-417d-a11e-e572f1b35be9 req-59455ed9-cf6e-4554-8e36-ce804a876ae2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:15.305918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-65c30bdb-2770-417d-a11e-e572f1b35be9 req-59455ed9-cf6e-4554-8e36-ce804a876ae2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:15.319019 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-65c30bdb-2770-417d-a11e-e572f1b35be9 req-59455ed9-cf6e-4554-8e36-ce804a876ae2 service nova] Creating event network-changed:90d3f07d-cfae-4997-9e86-1ac2bf305cb7 for instance 83095fa7-9674-41d3-a6c0-d936215ecf0e on nch2-master-1 Jan 22 21:43:15.324169 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-65c30bdb-2770-417d-a11e-e572f1b35be9 req-59455ed9-cf6e-4554-8e36-ce804a876ae2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050044 Jan 22 21:43:15.325433 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3988/8269] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:43:15.856159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-83e95d61-f2c8-491f-8c16-c0f0c58d9070 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:15.856969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-83e95d61-f2c8-491f-8c16-c0f0c58d9070 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:15.865270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83e95d61-f2c8-491f-8c16-c0f0c58d9070 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:15.865878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83e95d61-f2c8-491f-8c16-c0f0c58d9070 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:15.866782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83e95d61-f2c8-491f-8c16-c0f0c58d9070 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:15.867342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-83e95d61-f2c8-491f-8c16-c0f0c58d9070 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:16.082165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-83e95d61-f2c8-491f-8c16-c0f0c58d9070 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:16.089671 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-83e95d61-f2c8-491f-8c16-c0f0c58d9070 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1269 microversion: 2.1 time: 0.238158 Jan 22 21:43:16.090257 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4282/8270] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:15 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1269 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:17.108127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c256d3e0-28af-4972-a881-d84a34a2ab17 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:17.109522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c256d3e0-28af-4972-a881-d84a34a2ab17 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:17.115811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c256d3e0-28af-4972-a881-d84a34a2ab17 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:17.116261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c256d3e0-28af-4972-a881-d84a34a2ab17 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:17.117033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c256d3e0-28af-4972-a881-d84a34a2ab17 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:17.117472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c256d3e0-28af-4972-a881-d84a34a2ab17 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:17.250825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c256d3e0-28af-4972-a881-d84a34a2ab17 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:17.258696 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c256d3e0-28af-4972-a881-d84a34a2ab17 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1269 microversion: 2.1 time: 0.155586 Jan 22 21:43:17.259315 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3989/8271] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:17 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:18.275526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6373fee0-ba55-488c-b8d8-bf3d9ec5e836 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:18.276279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6373fee0-ba55-488c-b8d8-bf3d9ec5e836 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:18.283722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6373fee0-ba55-488c-b8d8-bf3d9ec5e836 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:18.284199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6373fee0-ba55-488c-b8d8-bf3d9ec5e836 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:18.285017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6373fee0-ba55-488c-b8d8-bf3d9ec5e836 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:18.285482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6373fee0-ba55-488c-b8d8-bf3d9ec5e836 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:18.425652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6373fee0-ba55-488c-b8d8-bf3d9ec5e836 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:18.434159 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6373fee0-ba55-488c-b8d8-bf3d9ec5e836 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1269 microversion: 2.1 time: 0.162642 Jan 22 21:43:18.435380 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4283/8272] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:18 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:19.449877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9bb479fb-2e4a-4da5-891e-9f46f75fb314 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:19.450487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9bb479fb-2e4a-4da5-891e-9f46f75fb314 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:19.457993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bb479fb-2e4a-4da5-891e-9f46f75fb314 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:19.458449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bb479fb-2e4a-4da5-891e-9f46f75fb314 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:19.459250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bb479fb-2e4a-4da5-891e-9f46f75fb314 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:19.459688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bb479fb-2e4a-4da5-891e-9f46f75fb314 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:19.597741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9bb479fb-2e4a-4da5-891e-9f46f75fb314 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:19.608489 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9bb479fb-2e4a-4da5-891e-9f46f75fb314 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1269 microversion: 2.1 time: 0.162217 Jan 22 21:43:19.609264 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3990/8273] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:19 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:20.624369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fd89528a-8763-4678-ad59-57a6e342c8e9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:20.624900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fd89528a-8763-4678-ad59-57a6e342c8e9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:20.632833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd89528a-8763-4678-ad59-57a6e342c8e9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:20.633337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd89528a-8763-4678-ad59-57a6e342c8e9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:20.634174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd89528a-8763-4678-ad59-57a6e342c8e9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:20.634629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fd89528a-8763-4678-ad59-57a6e342c8e9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:20.774599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fd89528a-8763-4678-ad59-57a6e342c8e9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:20.783492 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fd89528a-8763-4678-ad59-57a6e342c8e9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1269 microversion: 2.1 time: 0.163079 Jan 22 21:43:20.784079 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4284/8274] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:20 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:21.800158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d26414f6-2882-4e52-b876-d75078e5c5fc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:21.800845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d26414f6-2882-4e52-b876-d75078e5c5fc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:21.807830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d26414f6-2882-4e52-b876-d75078e5c5fc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:21.808291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d26414f6-2882-4e52-b876-d75078e5c5fc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:21.809082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d26414f6-2882-4e52-b876-d75078e5c5fc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:21.809556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d26414f6-2882-4e52-b876-d75078e5c5fc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:21.941693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d26414f6-2882-4e52-b876-d75078e5c5fc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:21.949193 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d26414f6-2882-4e52-b876-d75078e5c5fc tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1269 microversion: 2.1 time: 0.152743 Jan 22 21:43:21.949850 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3991/8275] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:21 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:22.966896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cbaa67fa-dcfe-42fa-9b4d-89aa13e4cecf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:22.967530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cbaa67fa-dcfe-42fa-9b4d-89aa13e4cecf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:22.974963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cbaa67fa-dcfe-42fa-9b4d-89aa13e4cecf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:22.975438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cbaa67fa-dcfe-42fa-9b4d-89aa13e4cecf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:22.976247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cbaa67fa-dcfe-42fa-9b4d-89aa13e4cecf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:22.976707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cbaa67fa-dcfe-42fa-9b4d-89aa13e4cecf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:23.110161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-cbaa67fa-dcfe-42fa-9b4d-89aa13e4cecf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:23.117813 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cbaa67fa-dcfe-42fa-9b4d-89aa13e4cecf tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1269 microversion: 2.1 time: 0.154614 Jan 22 21:43:23.118399 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4285/8276] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:22 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:23.636316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-a629b3c1-5f7a-4d3f-9403-37191def997c req-6f822911-4804-4b0f-ad66-0e48c339ddeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83095fa7-9674-41d3-a6c0-d936215ecf0e", "name": "network-vif-plugged", "status": "completed", "tag": "90d3f07d-cfae-4997-9e86-1ac2bf305cb7"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:43:23.637961 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:43:23.637961 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:43:23.646803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a629b3c1-5f7a-4d3f-9403-37191def997c req-6f822911-4804-4b0f-ad66-0e48c339ddeb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:23.647273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-a629b3c1-5f7a-4d3f-9403-37191def997c req-6f822911-4804-4b0f-ad66-0e48c339ddeb service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:23.659505 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-a629b3c1-5f7a-4d3f-9403-37191def997c req-6f822911-4804-4b0f-ad66-0e48c339ddeb service nova] Creating event network-vif-plugged:90d3f07d-cfae-4997-9e86-1ac2bf305cb7 for instance 83095fa7-9674-41d3-a6c0-d936215ecf0e on nch2-master-1 Jan 22 21:43:23.663862 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-a629b3c1-5f7a-4d3f-9403-37191def997c req-6f822911-4804-4b0f-ad66-0e48c339ddeb service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031385 Jan 22 21:43:23.664579 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3992/8277] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:43:24.135376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0173bec1-b781-4e15-a5b3-6f29c657ccb3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:24.136009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0173bec1-b781-4e15-a5b3-6f29c657ccb3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:24.143720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0173bec1-b781-4e15-a5b3-6f29c657ccb3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:24.144193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0173bec1-b781-4e15-a5b3-6f29c657ccb3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:24.144998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0173bec1-b781-4e15-a5b3-6f29c657ccb3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:24.145778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0173bec1-b781-4e15-a5b3-6f29c657ccb3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:24.296659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0173bec1-b781-4e15-a5b3-6f29c657ccb3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:24.304638 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0173bec1-b781-4e15-a5b3-6f29c657ccb3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1269 microversion: 2.1 time: 0.172959 Jan 22 21:43:24.305216 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4286/8278] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:24 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:25.324496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-318dc58a-c19d-4667-906c-45d696035876 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:25.325291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-318dc58a-c19d-4667-906c-45d696035876 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:25.332175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-318dc58a-c19d-4667-906c-45d696035876 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:25.332816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-318dc58a-c19d-4667-906c-45d696035876 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:25.333673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-318dc58a-c19d-4667-906c-45d696035876 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:25.334116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-318dc58a-c19d-4667-906c-45d696035876 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:25.494807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-318dc58a-c19d-4667-906c-45d696035876 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:25.503719 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-318dc58a-c19d-4667-906c-45d696035876 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1269 microversion: 2.1 time: 0.185026 Jan 22 21:43:25.504447 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3993/8279] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:25 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1269 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:26.520360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c1a60590-5e8a-4db7-bd0d-2153d7792cc9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:26.521051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c1a60590-5e8a-4db7-bd0d-2153d7792cc9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:26.528381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1a60590-5e8a-4db7-bd0d-2153d7792cc9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:26.528859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1a60590-5e8a-4db7-bd0d-2153d7792cc9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:26.529705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1a60590-5e8a-4db7-bd0d-2153d7792cc9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:26.530172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1a60590-5e8a-4db7-bd0d-2153d7792cc9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:26.669885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c1a60590-5e8a-4db7-bd0d-2153d7792cc9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:26.678094 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c1a60590-5e8a-4db7-bd0d-2153d7792cc9 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1455 microversion: 2.1 time: 0.161579 Jan 22 21:43:26.678681 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4287/8280] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:26 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:26.695941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24a69bec-a9db-4c67-bace-43f9e1e600c3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:26.696570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-24a69bec-a9db-4c67-bace-43f9e1e600c3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:26.703464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a69bec-a9db-4c67-bace-43f9e1e600c3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:26.703930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a69bec-a9db-4c67-bace-43f9e1e600c3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:26.705257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a69bec-a9db-4c67-bace-43f9e1e600c3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:26.705734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24a69bec-a9db-4c67-bace-43f9e1e600c3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:26.857624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-24a69bec-a9db-4c67-bace-43f9e1e600c3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:26.865397 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-24a69bec-a9db-4c67-bace-43f9e1e600c3 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1455 microversion: 2.1 time: 0.173083 Jan 22 21:43:26.865917 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3994/8281] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:26 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1455 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:29.068036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-4ac906d0-e67b-4388-8fc8-deda2eb9497f req-714a273e-0efb-45ad-a115-d630bfb96908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83095fa7-9674-41d3-a6c0-d936215ecf0e", "tag": "90d3f07d-cfae-4997-9e86-1ac2bf305cb7"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:43:29.069713 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:43:29.069713 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:43:29.078177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4ac906d0-e67b-4388-8fc8-deda2eb9497f req-714a273e-0efb-45ad-a115-d630bfb96908 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:29.081903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4ac906d0-e67b-4388-8fc8-deda2eb9497f req-714a273e-0efb-45ad-a115-d630bfb96908 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:29.090541 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-4ac906d0-e67b-4388-8fc8-deda2eb9497f req-714a273e-0efb-45ad-a115-d630bfb96908 service nova] Creating event network-changed:90d3f07d-cfae-4997-9e86-1ac2bf305cb7 for instance 83095fa7-9674-41d3-a6c0-d936215ecf0e on nch2-master-1 Jan 22 21:43:29.096821 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-4ac906d0-e67b-4388-8fc8-deda2eb9497f req-714a273e-0efb-45ad-a115-d630bfb96908 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033354 Jan 22 21:43:29.100336 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4288/8282] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:43:46.989068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-381c52e6-e6c6-45fe-9437-99fa86437674 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Action: 'create', calling method: .version_select at 0x7f1ed4f59280>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1981517450"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:43:47.005393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-381c52e6-e6c6-45fe-9437-99fa86437674 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Getting quotas for project 32bdfe54bcc5435582e616e74129513e. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:43:47.010476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-381c52e6-e6c6-45fe-9437-99fa86437674 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Getting quotas for user 366901c3e8854d0e8c6654f2ba2c450a and project 32bdfe54bcc5435582e616e74129513e. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:43:47.598891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-381c52e6-e6c6-45fe-9437-99fa86437674 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Getting quotas for project 32bdfe54bcc5435582e616e74129513e. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:43:47.604136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-381c52e6-e6c6-45fe-9437-99fa86437674 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Getting quotas for user 366901c3e8854d0e8c6654f2ba2c450a and project 32bdfe54bcc5435582e616e74129513e. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:43:47.620449 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-381c52e6-e6c6-45fe-9437-99fa86437674 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.847641 Jan 22 21:43:47.621066 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3995/8283] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:43:46 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:50.263905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-465190570", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1981517450", "security_groups": [{"name": "tempest-secgroup-smoke-1361761649"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "715421c7-9a21-4a9b-bc08-5f9dd22416e1"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:43:50.378174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] validate_networks() for [('715421c7-9a21-4a9b-bc08-5f9dd22416e1', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:43:50.812212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Getting quotas for project 32bdfe54bcc5435582e616e74129513e. Resources: dict_keys(['metadata_items']) {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:43:50.819159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Getting quotas for user 366901c3e8854d0e8c6654f2ba2c450a and project 32bdfe54bcc5435582e616e74129513e. Resources: dict_keys(['metadata_items']) {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:43:50.834284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:43:50.834766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:43:50.835447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:43:50.836050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:43:50.836832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:43:50.847737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:50.850386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:50.850386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:50.850386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:50.871510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Getting quotas for project 32bdfe54bcc5435582e616e74129513e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:43:50.878714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Getting quotas for user 366901c3e8854d0e8c6654f2ba2c450a and project 32bdfe54bcc5435582e616e74129513e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:43:50.893679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:43:50.896174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:43:51.058151 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cb3eeddc-3b10-4c67-aef9-4a2d0a30019f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.798880 Jan 22 21:43:51.058662 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4289/8284] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:43:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:43:51.068740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-63d2e09d-90df-4d5f-99a7-0c51e9ec38db tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:51.069354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-63d2e09d-90df-4d5f-99a7-0c51e9ec38db tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:51.181645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-63d2e09d-90df-4d5f-99a7-0c51e9ec38db tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:51.181645 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-63d2e09d-90df-4d5f-99a7-0c51e9ec38db tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1306 microversion: 2.1 time: 0.078721 Jan 22 21:43:51.181645 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3996/8285] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:51 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1306 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:52.161700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b3bf1b84-5fda-4af8-8b69-4d6f1caee20a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:52.162335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b3bf1b84-5fda-4af8-8b69-4d6f1caee20a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:52.170502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3bf1b84-5fda-4af8-8b69-4d6f1caee20a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:52.175245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3bf1b84-5fda-4af8-8b69-4d6f1caee20a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:52.175245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3bf1b84-5fda-4af8-8b69-4d6f1caee20a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:52.175245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3bf1b84-5fda-4af8-8b69-4d6f1caee20a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:52.237832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b3bf1b84-5fda-4af8-8b69-4d6f1caee20a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:52.245304 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b3bf1b84-5fda-4af8-8b69-4d6f1caee20a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1310 microversion: 2.1 time: 0.088525 Jan 22 21:43:52.245919 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4290/8286] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:52 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:53.263325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-35801800-e92f-4435-b8b5-7ead1de88893 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:53.263924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-35801800-e92f-4435-b8b5-7ead1de88893 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:53.271580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35801800-e92f-4435-b8b5-7ead1de88893 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:53.272042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35801800-e92f-4435-b8b5-7ead1de88893 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:53.272838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35801800-e92f-4435-b8b5-7ead1de88893 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:53.273285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35801800-e92f-4435-b8b5-7ead1de88893 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:53.380310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-35801800-e92f-4435-b8b5-7ead1de88893 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:53.388708 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-35801800-e92f-4435-b8b5-7ead1de88893 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1366 microversion: 2.1 time: 0.129083 Jan 22 21:43:53.389657 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3997/8287] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:53 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:54.407159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fac589b0-d239-420f-b0c6-fcd64ff3ad4e tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:54.410864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fac589b0-d239-420f-b0c6-fcd64ff3ad4e tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:54.415549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fac589b0-d239-420f-b0c6-fcd64ff3ad4e tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:54.416042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fac589b0-d239-420f-b0c6-fcd64ff3ad4e tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:54.416869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fac589b0-d239-420f-b0c6-fcd64ff3ad4e tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:54.417469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fac589b0-d239-420f-b0c6-fcd64ff3ad4e tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:54.555093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fac589b0-d239-420f-b0c6-fcd64ff3ad4e tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:54.562620 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fac589b0-d239-420f-b0c6-fcd64ff3ad4e tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1432 microversion: 2.1 time: 0.159667 Jan 22 21:43:54.563804 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4291/8288] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:54 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1432 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:55.098236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-c8b2d522-79ce-4148-bcaf-4a69cf28a5fc req-c1ddd3a3-e4f4-4e30-a3c6-0f7d1b9f3c61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba", "tag": "aede3afd-82c4-4fbf-8c84-67dad88b6d28"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:43:55.100046 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:43:55.100046 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:43:55.108315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c8b2d522-79ce-4148-bcaf-4a69cf28a5fc req-c1ddd3a3-e4f4-4e30-a3c6-0f7d1b9f3c61 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:55.109335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c8b2d522-79ce-4148-bcaf-4a69cf28a5fc req-c1ddd3a3-e4f4-4e30-a3c6-0f7d1b9f3c61 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:55.121791 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-c8b2d522-79ce-4148-bcaf-4a69cf28a5fc req-c1ddd3a3-e4f4-4e30-a3c6-0f7d1b9f3c61 service nova] Creating event network-changed:aede3afd-82c4-4fbf-8c84-67dad88b6d28 for instance 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba on nch1-master-1 Jan 22 21:43:55.127401 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-c8b2d522-79ce-4148-bcaf-4a69cf28a5fc req-c1ddd3a3-e4f4-4e30-a3c6-0f7d1b9f3c61 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037578 Jan 22 21:43:55.128511 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3998/8289] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:43:55.581072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0808d8d8-e943-49e9-9a95-67542701f1a9 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:55.581846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0808d8d8-e943-49e9-9a95-67542701f1a9 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:55.588855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0808d8d8-e943-49e9-9a95-67542701f1a9 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:55.589410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0808d8d8-e943-49e9-9a95-67542701f1a9 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:55.590260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0808d8d8-e943-49e9-9a95-67542701f1a9 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:55.590714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0808d8d8-e943-49e9-9a95-67542701f1a9 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:55.738916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0808d8d8-e943-49e9-9a95-67542701f1a9 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:55.745097 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0808d8d8-e943-49e9-9a95-67542701f1a9 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1432 microversion: 2.1 time: 0.168319 Jan 22 21:43:55.745720 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4292/8290] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:55 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1432 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:56.763610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2426538f-f1ef-40d8-b583-d5bbc849b179 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:56.764321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2426538f-f1ef-40d8-b583-d5bbc849b179 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:56.771380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2426538f-f1ef-40d8-b583-d5bbc849b179 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:56.771841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2426538f-f1ef-40d8-b583-d5bbc849b179 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:56.772703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2426538f-f1ef-40d8-b583-d5bbc849b179 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:56.773154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2426538f-f1ef-40d8-b583-d5bbc849b179 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:56.918704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2426538f-f1ef-40d8-b583-d5bbc849b179 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:56.927169 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2426538f-f1ef-40d8-b583-d5bbc849b179 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1432 microversion: 2.1 time: 0.168552 Jan 22 21:43:56.927756 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 3999/8291] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:56 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1432 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:57.944643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c93eaf78-620c-4052-b386-ace4c6fd5d44 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:57.945331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c93eaf78-620c-4052-b386-ace4c6fd5d44 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:57.952363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c93eaf78-620c-4052-b386-ace4c6fd5d44 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:57.952842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c93eaf78-620c-4052-b386-ace4c6fd5d44 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:57.953784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c93eaf78-620c-4052-b386-ace4c6fd5d44 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:57.954804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c93eaf78-620c-4052-b386-ace4c6fd5d44 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:58.090692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c93eaf78-620c-4052-b386-ace4c6fd5d44 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:58.098291 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c93eaf78-620c-4052-b386-ace4c6fd5d44 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1432 microversion: 2.1 time: 0.157536 Jan 22 21:43:58.098875 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4293/8292] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:57 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1432 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:43:59.114979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3487a288-db84-4fd4-b06e-6ed1b98547ec tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:43:59.115580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3487a288-db84-4fd4-b06e-6ed1b98547ec tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:43:59.122482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3487a288-db84-4fd4-b06e-6ed1b98547ec tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:59.122935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3487a288-db84-4fd4-b06e-6ed1b98547ec tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:59.123721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3487a288-db84-4fd4-b06e-6ed1b98547ec tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:43:59.124161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3487a288-db84-4fd4-b06e-6ed1b98547ec tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:43:59.262620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3487a288-db84-4fd4-b06e-6ed1b98547ec tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:43:59.273394 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3487a288-db84-4fd4-b06e-6ed1b98547ec tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1432 microversion: 2.1 time: 0.161994 Jan 22 21:43:59.274334 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4000/8293] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:43:59 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1432 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:44:00.290847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9acc77c1-aaf8-480b-8dd5-6acab8352de4 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:44:00.291383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9acc77c1-aaf8-480b-8dd5-6acab8352de4 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:44:00.299379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9acc77c1-aaf8-480b-8dd5-6acab8352de4 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:00.299847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9acc77c1-aaf8-480b-8dd5-6acab8352de4 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:00.300653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9acc77c1-aaf8-480b-8dd5-6acab8352de4 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:00.301114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9acc77c1-aaf8-480b-8dd5-6acab8352de4 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:00.445086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9acc77c1-aaf8-480b-8dd5-6acab8352de4 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:44:00.452563 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9acc77c1-aaf8-480b-8dd5-6acab8352de4 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1432 microversion: 2.1 time: 0.165632 Jan 22 21:44:00.453150 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4294/8294] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:44:00 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1432 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:44:01.431975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-2cb6a2cd-00c7-4dec-9dd2-505cde45fbaf req-bbf66f54-db92-40d3-8cba-b08195355274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba", "name": "network-vif-plugged", "status": "completed", "tag": "aede3afd-82c4-4fbf-8c84-67dad88b6d28"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:44:01.433619 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:44:01.433619 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:44:01.442161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2cb6a2cd-00c7-4dec-9dd2-505cde45fbaf req-bbf66f54-db92-40d3-8cba-b08195355274 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:01.442618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2cb6a2cd-00c7-4dec-9dd2-505cde45fbaf req-bbf66f54-db92-40d3-8cba-b08195355274 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:01.454246 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-2cb6a2cd-00c7-4dec-9dd2-505cde45fbaf req-bbf66f54-db92-40d3-8cba-b08195355274 service nova] Creating event network-vif-plugged:aede3afd-82c4-4fbf-8c84-67dad88b6d28 for instance 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba on nch1-master-1 Jan 22 21:44:01.459272 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-2cb6a2cd-00c7-4dec-9dd2-505cde45fbaf req-bbf66f54-db92-40d3-8cba-b08195355274 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031195 Jan 22 21:44:01.459799 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4001/8295] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:44:01.470446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f409e3ce-7eab-4dbf-816b-0d64a1cac4ff tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:44:01.471084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f409e3ce-7eab-4dbf-816b-0d64a1cac4ff tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:44:01.478262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f409e3ce-7eab-4dbf-816b-0d64a1cac4ff tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:01.486652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f409e3ce-7eab-4dbf-816b-0d64a1cac4ff tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:01.486652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f409e3ce-7eab-4dbf-816b-0d64a1cac4ff tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:01.486652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f409e3ce-7eab-4dbf-816b-0d64a1cac4ff tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:01.625199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f409e3ce-7eab-4dbf-816b-0d64a1cac4ff tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:44:01.633070 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f409e3ce-7eab-4dbf-816b-0d64a1cac4ff tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1432 microversion: 2.1 time: 0.166872 Jan 22 21:44:01.633691 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4295/8296] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:44:01 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1432 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:44:02.652619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bd5f776b-0405-4922-b2dc-4ed70edade41 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:44:02.653328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bd5f776b-0405-4922-b2dc-4ed70edade41 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:44:02.660689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd5f776b-0405-4922-b2dc-4ed70edade41 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:02.661149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd5f776b-0405-4922-b2dc-4ed70edade41 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:02.661997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd5f776b-0405-4922-b2dc-4ed70edade41 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:02.662441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd5f776b-0405-4922-b2dc-4ed70edade41 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:02.801860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bd5f776b-0405-4922-b2dc-4ed70edade41 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:44:02.809306 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bd5f776b-0405-4922-b2dc-4ed70edade41 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1432 microversion: 2.1 time: 0.161963 Jan 22 21:44:02.809925 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4002/8297] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:44:02 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1432 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:44:03.826039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-36171752-7b3b-46c5-a851-4d7dbd17247b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:44:03.826674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-36171752-7b3b-46c5-a851-4d7dbd17247b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:44:03.833426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36171752-7b3b-46c5-a851-4d7dbd17247b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:03.833938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36171752-7b3b-46c5-a851-4d7dbd17247b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:03.834737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36171752-7b3b-46c5-a851-4d7dbd17247b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:03.835225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-36171752-7b3b-46c5-a851-4d7dbd17247b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:03.976781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-36171752-7b3b-46c5-a851-4d7dbd17247b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:44:03.984168 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-36171752-7b3b-46c5-a851-4d7dbd17247b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1612 microversion: 2.1 time: 0.162185 Jan 22 21:44:03.984737 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4296/8298] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:44:03 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1612 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:44:04.000516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0cbdd962-8356-45f7-8cb6-0a989613b097 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:44:04.001916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0cbdd962-8356-45f7-8cb6-0a989613b097 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:44:04.008134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cbdd962-8356-45f7-8cb6-0a989613b097 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:04.008597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cbdd962-8356-45f7-8cb6-0a989613b097 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:04.009391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cbdd962-8356-45f7-8cb6-0a989613b097 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:04.009870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0cbdd962-8356-45f7-8cb6-0a989613b097 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:04.143696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0cbdd962-8356-45f7-8cb6-0a989613b097 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:44:04.151340 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0cbdd962-8356-45f7-8cb6-0a989613b097 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1612 microversion: 2.1 time: 0.154579 Jan 22 21:44:04.151910 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4003/8299] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:44:03 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1612 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:44:04.167841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-42920b31-1f7e-47fd-a5a2-64718b3abd56 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:44:04.168464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-42920b31-1f7e-47fd-a5a2-64718b3abd56 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:44:04.174802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42920b31-1f7e-47fd-a5a2-64718b3abd56 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:04.179610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42920b31-1f7e-47fd-a5a2-64718b3abd56 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:04.179610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42920b31-1f7e-47fd-a5a2-64718b3abd56 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:04.179610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42920b31-1f7e-47fd-a5a2-64718b3abd56 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:04.310513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-42920b31-1f7e-47fd-a5a2-64718b3abd56 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:44:04.318012 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-42920b31-1f7e-47fd-a5a2-64718b3abd56 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1612 microversion: 2.1 time: 0.153845 Jan 22 21:44:04.318595 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4297/8300] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:44:04 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1612 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:44:06.442336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-9290d5d5-07d5-4b33-ae9d-ddf3b1a2761e req-3c3f6f58-4ce1-495b-917a-cb8b0286f3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba", "tag": "aede3afd-82c4-4fbf-8c84-67dad88b6d28"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:44:06.444182 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:44:06.444182 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:44:06.452142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9290d5d5-07d5-4b33-ae9d-ddf3b1a2761e req-3c3f6f58-4ce1-495b-917a-cb8b0286f3d8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:06.452593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9290d5d5-07d5-4b33-ae9d-ddf3b1a2761e req-3c3f6f58-4ce1-495b-917a-cb8b0286f3d8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:06.464408 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-9290d5d5-07d5-4b33-ae9d-ddf3b1a2761e req-3c3f6f58-4ce1-495b-917a-cb8b0286f3d8 service nova] Creating event network-changed:aede3afd-82c4-4fbf-8c84-67dad88b6d28 for instance 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba on nch1-master-1 Jan 22 21:44:06.478070 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-9290d5d5-07d5-4b33-ae9d-ddf3b1a2761e req-3c3f6f58-4ce1-495b-917a-cb8b0286f3d8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031887 Jan 22 21:44:06.478070 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4004/8301] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:44:44.847916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d64e1334-6b01-45e7-9b9a-4a41cfbc9525 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:44:44.848503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d64e1334-6b01-45e7-9b9a-4a41cfbc9525 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:44:44.855374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d64e1334-6b01-45e7-9b9a-4a41cfbc9525 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:44.855851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d64e1334-6b01-45e7-9b9a-4a41cfbc9525 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:44.856654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d64e1334-6b01-45e7-9b9a-4a41cfbc9525 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:44:44.857134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d64e1334-6b01-45e7-9b9a-4a41cfbc9525 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:44:44.882253 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d64e1334-6b01-45e7-9b9a-4a41cfbc9525 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.038189 Jan 22 21:44:44.882833 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4298/8302] 10.222.0.100 () {58 vars in 1297 bytes} [Sat Jan 22 21:44:44 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba/os-server-password => generated 116 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:44:53.898726 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:44:53.899331 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 21:44:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:46:33.838230 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:46:33.838996 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 21:46:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:46:34.639408 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:46:34.640127 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 21:46:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:46:34.960092 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:46:34.960308 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 21:46:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:46:45.161879 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:46:45.162755 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 21:46:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:46:47.909994 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5c65b53b-7dc4-496f-937e-a7dc1df2041e] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 21:46:47.910827 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [-] [913664d8-58d1-4bc9-a0cb-33264365d7dc] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 21:46:48.016137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d01d79fd-92f5-49fb-a752-9299a1bb68d7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:46:48.017162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d01d79fd-92f5-49fb-a752-9299a1bb68d7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:46:48.025260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d01d79fd-92f5-49fb-a752-9299a1bb68d7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:46:48.025792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d01d79fd-92f5-49fb-a752-9299a1bb68d7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:46:48.026569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d01d79fd-92f5-49fb-a752-9299a1bb68d7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:46:48.027014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d01d79fd-92f5-49fb-a752-9299a1bb68d7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:46:48.053096 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d01d79fd-92f5-49fb-a752-9299a1bb68d7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [f962eaa4-b2c4-4269-b24d-bd2b807893d1] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 21:46:48.919733 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] [5c65b53b-7dc4-496f-937e-a7dc1df2041e] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 55450. Jan 22 21:46:48.920453 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] [913664d8-58d1-4bc9-a0cb-33264365d7dc] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 55452. Jan 22 21:46:49.059963 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [None req-d01d79fd-92f5-49fb-a752-9299a1bb68d7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [f962eaa4-b2c4-4269-b24d-bd2b807893d1] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 55454. Jan 22 21:46:49.087599 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d01d79fd-92f5-49fb-a752-9299a1bb68d7 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "POST /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e/action" status: 200 len: 24570 microversion: 2.1 time: 1.179951 Jan 22 21:46:49.089670 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4005/8303] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:46:47 2022] POST /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e/action => generated 24570 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 21:46:50.122119 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edc45ac6-e555-423c-baf2-d131dfc2b608] AMQP server on 10.222.0.100:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 22 21:46:50.122119 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7ed686d-6f24-47e8-978c-4287ce754ef2] AMQP server on 10.222.0.100:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 22 21:46:50.124388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d2064f71-b70b-4021-b8ae-b87363764eb0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:46:50.124672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-1d1c1e1a-668c-4a4b-8bd5-7c87ba3e2fcb req-061c2816-18fd-41cd-9c81-bbe7cbfd1358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83095fa7-9674-41d3-a6c0-d936215ecf0e", "tag": "90d3f07d-cfae-4997-9e86-1ac2bf305cb7"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:46:50.125128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d2064f71-b70b-4021-b8ae-b87363764eb0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:46:50.126237 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:46:50.126237 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:46:50.133362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2064f71-b70b-4021-b8ae-b87363764eb0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:46:50.133910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2064f71-b70b-4021-b8ae-b87363764eb0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:46:50.134735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2064f71-b70b-4021-b8ae-b87363764eb0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:46:50.135201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2064f71-b70b-4021-b8ae-b87363764eb0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:46:50.136670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1d1c1e1a-668c-4a4b-8bd5-7c87ba3e2fcb req-061c2816-18fd-41cd-9c81-bbe7cbfd1358 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:46:50.137860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1d1c1e1a-668c-4a4b-8bd5-7c87ba3e2fcb req-061c2816-18fd-41cd-9c81-bbe7cbfd1358 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:46:50.149305 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-1d1c1e1a-668c-4a4b-8bd5-7c87ba3e2fcb req-061c2816-18fd-41cd-9c81-bbe7cbfd1358 service nova] Creating event network-changed:90d3f07d-cfae-4997-9e86-1ac2bf305cb7 for instance 83095fa7-9674-41d3-a6c0-d936215ecf0e on nch2-master-1 Jan 22 21:46:50.154549 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-1d1c1e1a-668c-4a4b-8bd5-7c87ba3e2fcb req-061c2816-18fd-41cd-9c81-bbe7cbfd1358 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034067 Jan 22 21:46:50.155557 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4006/8304] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:46:50.164448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d2064f71-b70b-4021-b8ae-b87363764eb0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:46:50.528018 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d2064f71-b70b-4021-b8ae-b87363764eb0 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "DELETE /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 204 len: 0 microversion: 2.1 time: 0.410326 Jan 22 21:46:50.531089 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4299/8305] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:46:50 2022] DELETE /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:46:50.537482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8f4ce22f-fae7-4284-bd52-ae031fdffb2f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:46:50.538208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8f4ce22f-fae7-4284-bd52-ae031fdffb2f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:46:50.545413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f4ce22f-fae7-4284-bd52-ae031fdffb2f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:46:50.545917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f4ce22f-fae7-4284-bd52-ae031fdffb2f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:46:50.546713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f4ce22f-fae7-4284-bd52-ae031fdffb2f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:46:50.547155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f4ce22f-fae7-4284-bd52-ae031fdffb2f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:46:50.823766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8f4ce22f-fae7-4284-bd52-ae031fdffb2f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:46:50.831443 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8f4ce22f-fae7-4284-bd52-ae031fdffb2f tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1580 microversion: 2.1 time: 0.298303 Jan 22 21:46:50.832016 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4007/8306] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:46:50 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1580 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:46:51.850393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-50f836e5-6e25-475d-9dc5-6bf83f29a033 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:46:51.851115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-50f836e5-6e25-475d-9dc5-6bf83f29a033 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:46:51.866509 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] [edc45ac6-e555-423c-baf2-d131dfc2b608] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 55472. Jan 22 21:46:51.871913 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7ed686d-6f24-47e8-978c-4287ce754ef2] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 55474. Jan 22 21:46:51.873343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50f836e5-6e25-475d-9dc5-6bf83f29a033 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:46:51.873945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50f836e5-6e25-475d-9dc5-6bf83f29a033 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:46:51.874761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50f836e5-6e25-475d-9dc5-6bf83f29a033 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:46:51.875224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50f836e5-6e25-475d-9dc5-6bf83f29a033 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:46:52.072529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-50f836e5-6e25-475d-9dc5-6bf83f29a033 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:46:52.080099 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-50f836e5-6e25-475d-9dc5-6bf83f29a033 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1461 microversion: 2.1 time: 0.234426 Jan 22 21:46:52.080678 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4300/8307] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:46:51 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1461 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:46:53.079793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-721b5d6d-a175-4d6a-8d4f-47f77f47b4c6 req-3eef6cc6-7946-49dd-afa9-f01e8b494add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83095fa7-9674-41d3-a6c0-d936215ecf0e", "name": "network-vif-deleted", "tag": "90d3f07d-cfae-4997-9e86-1ac2bf305cb7"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:46:53.081463 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:46:53.081463 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:46:53.091241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-721b5d6d-a175-4d6a-8d4f-47f77f47b4c6 req-3eef6cc6-7946-49dd-afa9-f01e8b494add service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:46:53.091696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-721b5d6d-a175-4d6a-8d4f-47f77f47b4c6 req-3eef6cc6-7946-49dd-afa9-f01e8b494add service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:46:53.098104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8bc1fcbb-88b4-40bb-8990-aade954a5e00 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:46:53.098792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8bc1fcbb-88b4-40bb-8990-aade954a5e00 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:46:53.103343 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-721b5d6d-a175-4d6a-8d4f-47f77f47b4c6 req-3eef6cc6-7946-49dd-afa9-f01e8b494add service nova] Creating event network-vif-deleted:90d3f07d-cfae-4997-9e86-1ac2bf305cb7 for instance 83095fa7-9674-41d3-a6c0-d936215ecf0e on nch2-master-1 Jan 22 21:46:53.107872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bc1fcbb-88b4-40bb-8990-aade954a5e00 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:46:53.108333 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-721b5d6d-a175-4d6a-8d4f-47f77f47b4c6 req-3eef6cc6-7946-49dd-afa9-f01e8b494add service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096463 Jan 22 21:46:53.108456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bc1fcbb-88b4-40bb-8990-aade954a5e00 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:46:53.108975 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4008/8308] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:46:53.109161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bc1fcbb-88b4-40bb-8990-aade954a5e00 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:46:53.109660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8bc1fcbb-88b4-40bb-8990-aade954a5e00 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:46:53.175983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8bc1fcbb-88b4-40bb-8990-aade954a5e00 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29e976f05d60471b9e6fb8290f07ccce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61bfb71de54c471193d2c71859a7f051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:46:53.189952 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8bc1fcbb-88b4-40bb-8990-aade954a5e00 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 200 len: 1393 microversion: 2.1 time: 0.090110 Jan 22 21:46:53.189952 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4301/8309] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:46:53 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 1393 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:46:54.203456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-03538c2a-cf46-47cd-adcf-dfa3515f34db tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:46:54.204159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-03538c2a-cf46-47cd-adcf-dfa3515f34db tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] [instance: 83095fa7-9674-41d3-a6c0-d936215ecf0e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:46:54.211028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03538c2a-cf46-47cd-adcf-dfa3515f34db tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:46:54.211489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03538c2a-cf46-47cd-adcf-dfa3515f34db tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:46:54.212280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03538c2a-cf46-47cd-adcf-dfa3515f34db tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:46:54.212724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03538c2a-cf46-47cd-adcf-dfa3515f34db tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:46:54.228120 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-03538c2a-cf46-47cd-adcf-dfa3515f34db tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] HTTP exception thrown: Instance 83095fa7-9674-41d3-a6c0-d936215ecf0e could not be found. Jan 22 21:46:54.228754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-03538c2a-cf46-47cd-adcf-dfa3515f34db tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Returning 404 to user: Instance 83095fa7-9674-41d3-a6c0-d936215ecf0e could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:46:54.229644 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-03538c2a-cf46-47cd-adcf-dfa3515f34db tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e" status: 404 len: 111 microversion: 2.1 time: 0.031208 Jan 22 21:46:54.230226 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4009/8310] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:46:54 2022] GET /compute/v2.1/servers/83095fa7-9674-41d3-a6c0-d936215ecf0e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:47:02.023041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-46391f74-f510-44ba-a60a-7999699c6158 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] Calling method '.version_select at 0x7f1ed4a65280>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:47:02.111744 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-46391f74-f510-44ba-a60a-7999699c6158 tempest-TestVolumeBootPattern-763913219 tempest-TestVolumeBootPattern-763913219-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-293722043" status: 202 len: 0 microversion: 2.1 time: 0.092509 Jan 22 21:47:02.112286 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4302/8311] 10.222.0.100 () {58 vars in 1264 bytes} [Sat Jan 22 21:47:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-293722043 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:48:13.909289 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:48:13.910084 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 21:48:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:48:48.679885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-66c95db1-6869-405e-93a1-32b0056c8518 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:48:48.680505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-66c95db1-6869-405e-93a1-32b0056c8518 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:48:48.686271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66c95db1-6869-405e-93a1-32b0056c8518 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:48.686729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66c95db1-6869-405e-93a1-32b0056c8518 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:48.687516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66c95db1-6869-405e-93a1-32b0056c8518 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:48.687966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-66c95db1-6869-405e-93a1-32b0056c8518 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:48.716287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-66c95db1-6869-405e-93a1-32b0056c8518 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:48:48.988006 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-66c95db1-6869-405e-93a1-32b0056c8518 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "DELETE /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 204 len: 0 microversion: 2.1 time: 0.472391 Jan 22 21:48:48.988725 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4010/8312] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:48:48 2022] DELETE /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:48:48.998734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9e419116-7ffc-4544-a27d-e684bd17d02b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:48:48.999372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9e419116-7ffc-4544-a27d-e684bd17d02b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:48:49.007821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e419116-7ffc-4544-a27d-e684bd17d02b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:49.008275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e419116-7ffc-4544-a27d-e684bd17d02b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:49.009101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e419116-7ffc-4544-a27d-e684bd17d02b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:49.009594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e419116-7ffc-4544-a27d-e684bd17d02b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:49.149016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9e419116-7ffc-4544-a27d-e684bd17d02b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:48:49.156500 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9e419116-7ffc-4544-a27d-e684bd17d02b tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1737 microversion: 2.1 time: 0.163710 Jan 22 21:48:49.157074 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4303/8313] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:48:48 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:48:50.174667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff1c7ec9-729a-422e-b055-3944e7011c34 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:48:50.175362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ff1c7ec9-729a-422e-b055-3944e7011c34 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:48:50.182387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff1c7ec9-729a-422e-b055-3944e7011c34 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:50.182842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff1c7ec9-729a-422e-b055-3944e7011c34 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:50.183636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff1c7ec9-729a-422e-b055-3944e7011c34 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:50.184074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff1c7ec9-729a-422e-b055-3944e7011c34 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:50.324355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ff1c7ec9-729a-422e-b055-3944e7011c34 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:48:50.332504 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff1c7ec9-729a-422e-b055-3944e7011c34 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1737 microversion: 2.1 time: 0.162192 Jan 22 21:48:50.333080 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4011/8314] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:48:50 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:48:51.349806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ffd92bd3-af16-4127-8185-3407e581fa98 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:48:51.350439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ffd92bd3-af16-4127-8185-3407e581fa98 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:48:51.357813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffd92bd3-af16-4127-8185-3407e581fa98 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:51.358310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffd92bd3-af16-4127-8185-3407e581fa98 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:51.359120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffd92bd3-af16-4127-8185-3407e581fa98 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:51.359581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ffd92bd3-af16-4127-8185-3407e581fa98 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:51.431562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ffd92bd3-af16-4127-8185-3407e581fa98 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:48:51.440064 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ffd92bd3-af16-4127-8185-3407e581fa98 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1669 microversion: 2.1 time: 0.094059 Jan 22 21:48:51.440657 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4304/8315] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:48:51 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1669 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:48:51.841830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-7418772e-111d-43fe-9551-25ca405f9397 req-0176e0e9-7442-42ab-a69e-14d3e5960e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba", "name": "network-vif-deleted", "tag": "aede3afd-82c4-4fbf-8c84-67dad88b6d28"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:48:51.843415 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:48:51.843415 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:48:51.851277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7418772e-111d-43fe-9551-25ca405f9397 req-0176e0e9-7442-42ab-a69e-14d3e5960e32 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:51.851728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7418772e-111d-43fe-9551-25ca405f9397 req-0176e0e9-7442-42ab-a69e-14d3e5960e32 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:51.864098 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-7418772e-111d-43fe-9551-25ca405f9397 req-0176e0e9-7442-42ab-a69e-14d3e5960e32 service nova] Creating event network-vif-deleted:aede3afd-82c4-4fbf-8c84-67dad88b6d28 for instance 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba on nch1-master-1 Jan 22 21:48:51.869226 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-7418772e-111d-43fe-9551-25ca405f9397 req-0176e0e9-7442-42ab-a69e-14d3e5960e32 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095185 Jan 22 21:48:51.869875 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4012/8316] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:48:52.457686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b756c83-a0db-451f-ad76-b8d608b90224 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:48:52.458324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6b756c83-a0db-451f-ad76-b8d608b90224 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:48:52.464608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b756c83-a0db-451f-ad76-b8d608b90224 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:52.465085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b756c83-a0db-451f-ad76-b8d608b90224 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:52.465952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b756c83-a0db-451f-ad76-b8d608b90224 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:52.466426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b756c83-a0db-451f-ad76-b8d608b90224 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:52.501696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b756c83-a0db-451f-ad76-b8d608b90224 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:52.502171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b756c83-a0db-451f-ad76-b8d608b90224 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:52.502649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-6b756c83-a0db-451f-ad76-b8d608b90224 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lazy-loading 'fault' on Instance uuid 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:48:52.544212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6b756c83-a0db-451f-ad76-b8d608b90224 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '366901c3e8854d0e8c6654f2ba2c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32bdfe54bcc5435582e616e74129513e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:48:52.552762 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b756c83-a0db-451f-ad76-b8d608b90224 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 200 len: 1392 microversion: 2.1 time: 0.099354 Jan 22 21:48:52.553345 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4305/8317] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:48:52 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 1392 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:48:53.577713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f390a8d4-fa2b-430d-9b44-4e466cb0067a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:48:53.578417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f390a8d4-fa2b-430d-9b44-4e466cb0067a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:48:53.589492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f390a8d4-fa2b-430d-9b44-4e466cb0067a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:53.589977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f390a8d4-fa2b-430d-9b44-4e466cb0067a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:53.590793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f390a8d4-fa2b-430d-9b44-4e466cb0067a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:53.591233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f390a8d4-fa2b-430d-9b44-4e466cb0067a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:53.605831 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-f390a8d4-fa2b-430d-9b44-4e466cb0067a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] HTTP exception thrown: Instance 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba could not be found. Jan 22 21:48:53.606439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f390a8d4-fa2b-430d-9b44-4e466cb0067a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Returning 404 to user: Instance 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:48:53.607273 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f390a8d4-fa2b-430d-9b44-4e466cb0067a tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 404 len: 111 microversion: 2.1 time: 0.034729 Jan 22 21:48:53.607821 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4013/8318] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:48:53 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:48:54.120444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3619eab5-5e5a-4664-ace7-ef241c9143b7 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:48:54.121870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3619eab5-5e5a-4664-ace7-ef241c9143b7 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:48:54.128216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3619eab5-5e5a-4664-ace7-ef241c9143b7 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:54.128689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3619eab5-5e5a-4664-ace7-ef241c9143b7 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:54.129495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3619eab5-5e5a-4664-ace7-ef241c9143b7 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:54.129974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3619eab5-5e5a-4664-ace7-ef241c9143b7 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:54.144261 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-3619eab5-5e5a-4664-ace7-ef241c9143b7 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] HTTP exception thrown: Instance 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba could not be found. Jan 22 21:48:54.144870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3619eab5-5e5a-4664-ace7-ef241c9143b7 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Returning 404 to user: Instance 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:48:54.145767 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3619eab5-5e5a-4664-ace7-ef241c9143b7 tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "DELETE /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 404 len: 111 microversion: 2.1 time: 0.029042 Jan 22 21:48:54.146305 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4306/8319] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:48:54 2022] DELETE /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:48:54.154213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7052dbe4-bc86-4e10-b178-8060e681f47c tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:48:54.154822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7052dbe4-bc86-4e10-b178-8060e681f47c tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] [instance: 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:48:54.161241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7052dbe4-bc86-4e10-b178-8060e681f47c tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:54.161729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7052dbe4-bc86-4e10-b178-8060e681f47c tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:54.162507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7052dbe4-bc86-4e10-b178-8060e681f47c tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:48:54.162948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7052dbe4-bc86-4e10-b178-8060e681f47c tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:48:54.176742 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-7052dbe4-bc86-4e10-b178-8060e681f47c tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] HTTP exception thrown: Instance 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba could not be found. Jan 22 21:48:54.177320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7052dbe4-bc86-4e10-b178-8060e681f47c tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Returning 404 to user: Instance 09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:48:54.178176 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7052dbe4-bc86-4e10-b178-8060e681f47c tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba" status: 404 len: 111 microversion: 2.1 time: 0.027651 Jan 22 21:48:54.178706 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4014/8320] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:48:54 2022] GET /compute/v2.1/servers/09e5b3f3-8e51-4ef1-8edb-a4f8e9e881ba => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:48:54.414829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a74a0c30-f82c-4e94-8ed3-c46a9ae6f16f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] Calling method '.version_select at 0x7f1ed58c3550>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:48:54.479697 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a74a0c30-f82c-4e94-8ed3-c46a9ae6f16f tempest-TestServerBasicOps-630407421 tempest-TestServerBasicOps-630407421-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1981517450" status: 202 len: 0 microversion: 2.1 time: 0.068480 Jan 22 21:48:54.480321 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4307/8321] 10.222.0.100 () {58 vars in 1258 bytes} [Sat Jan 22 21:48:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1981517450 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:49:53.847229 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:49:53.848067 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 21:49:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:49:54.648790 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:49:54.649540 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 21:49:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:50:05.170584 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:50:05.171285 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 21:50:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:50:57.627784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-666a37ed-43d9-451b-a216-fda10a3d97c3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Action: 'create', calling method: .version_select at 0x7f1ed5d35550>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2022106336"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:50:57.642816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-666a37ed-43d9-451b-a216-fda10a3d97c3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Getting quotas for project 479688e52574428bab32e5f9e0ad1910. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:50:57.647744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-666a37ed-43d9-451b-a216-fda10a3d97c3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Getting quotas for user 2ab4c5a8b2034ac79070e92037330ab5 and project 479688e52574428bab32e5f9e0ad1910. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:50:58.069602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-666a37ed-43d9-451b-a216-fda10a3d97c3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Getting quotas for project 479688e52574428bab32e5f9e0ad1910. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:50:58.075137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-666a37ed-43d9-451b-a216-fda10a3d97c3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Getting quotas for user 2ab4c5a8b2034ac79070e92037330ab5 and project 479688e52574428bab32e5f9e0ad1910. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:50:58.089228 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-666a37ed-43d9-451b-a216-fda10a3d97c3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.466411 Jan 22 21:50:58.090260 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4015/8322] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 21:50:57 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:51:00.552250 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edc45ac6-e555-423c-baf2-d131dfc2b608] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 21:51:00.553914 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7ed686d-6f24-47e8-978c-4287ce754ef2] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 21:51:00.557679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1370550710", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7787920b-4db0-477d-a5ae-1db8121ceed7", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2022106336", "security_groups": [{"name": "tempest-secgroup-smoke-1863583834"}], "networks": [{"uuid": "164021dd-8c38-4eed-b5ab-31a671055697"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:51:00.666033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] validate_networks() for [('164021dd-8c38-4eed-b5ab-31a671055697', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:51:01.163126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:51:01.163576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:51:01.164072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:51:01.164504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:51:01.164938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:51:01.173895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:01.174374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:01.175242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:01.175706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:01.193323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Getting quotas for project 479688e52574428bab32e5f9e0ad1910. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:51:01.198465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Getting quotas for user 2ab4c5a8b2034ac79070e92037330ab5 and project 479688e52574428bab32e5f9e0ad1910. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:51:01.254455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:51:01.256624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7787920b-4db0-477d-a5ae-1db8121ceed7',volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:51:01.561912 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] [edc45ac6-e555-423c-baf2-d131dfc2b608] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 56330. Jan 22 21:51:01.562664 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7ed686d-6f24-47e8-978c-4287ce754ef2] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 56332. Jan 22 21:51:01.609857 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-88b1d930-340a-4030-825c-c67c911a47e3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.059288 Jan 22 21:51:01.610512 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4308/8323] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:51:00 2022] POST /compute/v2.1/servers => generated 408 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:51:01.622041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-40058cc8-d4dc-4e9d-9470-c52efa0e9d6f tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:51:01.622696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-40058cc8-d4dc-4e9d-9470-c52efa0e9d6f tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:51:01.688609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-40058cc8-d4dc-4e9d-9470-c52efa0e9d6f tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:51:01.695441 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-40058cc8-d4dc-4e9d-9470-c52efa0e9d6f tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1102 microversion: 2.1 time: 0.078724 Jan 22 21:51:01.696020 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4016/8324] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:51:01 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1102 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:51:02.713742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-497e3109-03c6-453e-b6c0-5e55f82dcd4e tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:51:02.714298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-497e3109-03c6-453e-b6c0-5e55f82dcd4e tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:51:02.720865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-497e3109-03c6-453e-b6c0-5e55f82dcd4e tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:02.721346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-497e3109-03c6-453e-b6c0-5e55f82dcd4e tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:02.722186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-497e3109-03c6-453e-b6c0-5e55f82dcd4e tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:02.722650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-497e3109-03c6-453e-b6c0-5e55f82dcd4e tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:02.786044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-497e3109-03c6-453e-b6c0-5e55f82dcd4e tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:51:02.793730 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-497e3109-03c6-453e-b6c0-5e55f82dcd4e tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1152 microversion: 2.1 time: 0.084599 Jan 22 21:51:02.795922 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4309/8325] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:51:02 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:51:03.811816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d4e1758f-b56d-4e31-9ac8-6a35acac0c31 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:51:03.812437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d4e1758f-b56d-4e31-9ac8-6a35acac0c31 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:51:03.819333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4e1758f-b56d-4e31-9ac8-6a35acac0c31 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:03.819799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4e1758f-b56d-4e31-9ac8-6a35acac0c31 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:03.820600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4e1758f-b56d-4e31-9ac8-6a35acac0c31 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:03.821085 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4e1758f-b56d-4e31-9ac8-6a35acac0c31 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:03.886533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d4e1758f-b56d-4e31-9ac8-6a35acac0c31 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:51:03.897792 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d4e1758f-b56d-4e31-9ac8-6a35acac0c31 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1208 microversion: 2.1 time: 0.090392 Jan 22 21:51:03.898669 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4017/8326] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:51:03 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1208 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:51:04.915408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0f14dfd2-3df4-4ae9-85c4-b3a00f81ccaa tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:51:04.915961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0f14dfd2-3df4-4ae9-85c4-b3a00f81ccaa tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:51:04.925017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f14dfd2-3df4-4ae9-85c4-b3a00f81ccaa tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:04.925530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f14dfd2-3df4-4ae9-85c4-b3a00f81ccaa tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:04.926472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f14dfd2-3df4-4ae9-85c4-b3a00f81ccaa tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:04.926932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0f14dfd2-3df4-4ae9-85c4-b3a00f81ccaa tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:05.136860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0f14dfd2-3df4-4ae9-85c4-b3a00f81ccaa tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:51:05.145390 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0f14dfd2-3df4-4ae9-85c4-b3a00f81ccaa tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1286 microversion: 2.1 time: 0.233891 Jan 22 21:51:05.146200 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4310/8327] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:51:04 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1286 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:51:05.624415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-418a69f7-eebe-43ec-acae-4e540bd276ad req-3c65a0b2-1cb6-4a80-b3ba-c69968194bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d", "tag": "1771599c-dd34-4b95-be5b-bd085b5fee7d"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:51:05.626080 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:51:05.626080 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:51:05.640386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-418a69f7-eebe-43ec-acae-4e540bd276ad req-3c65a0b2-1cb6-4a80-b3ba-c69968194bcc service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:05.640386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-418a69f7-eebe-43ec-acae-4e540bd276ad req-3c65a0b2-1cb6-4a80-b3ba-c69968194bcc service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:05.650997 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-418a69f7-eebe-43ec-acae-4e540bd276ad req-3c65a0b2-1cb6-4a80-b3ba-c69968194bcc service nova] Creating event network-changed:1771599c-dd34-4b95-be5b-bd085b5fee7d for instance 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d on nch2-master-1 Jan 22 21:51:05.656709 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-418a69f7-eebe-43ec-acae-4e540bd276ad req-3c65a0b2-1cb6-4a80-b3ba-c69968194bcc service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035994 Jan 22 21:51:05.657715 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4018/8328] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:51:06.162883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aa1d610a-bf47-402a-b07a-714c686b06c5 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:51:06.163511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aa1d610a-bf47-402a-b07a-714c686b06c5 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:51:06.171227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa1d610a-bf47-402a-b07a-714c686b06c5 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:06.171701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa1d610a-bf47-402a-b07a-714c686b06c5 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:06.172516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa1d610a-bf47-402a-b07a-714c686b06c5 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:06.172970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa1d610a-bf47-402a-b07a-714c686b06c5 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:06.635626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aa1d610a-bf47-402a-b07a-714c686b06c5 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:51:06.643268 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aa1d610a-bf47-402a-b07a-714c686b06c5 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1274 microversion: 2.1 time: 0.484342 Jan 22 21:51:06.643850 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4311/8329] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:51:06 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1274 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:51:07.661880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d5fd487f-508a-48b1-82ca-aa97b6875665 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:51:07.662509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d5fd487f-508a-48b1-82ca-aa97b6875665 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:51:07.668896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5fd487f-508a-48b1-82ca-aa97b6875665 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:07.669516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5fd487f-508a-48b1-82ca-aa97b6875665 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:07.670328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5fd487f-508a-48b1-82ca-aa97b6875665 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:07.670778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d5fd487f-508a-48b1-82ca-aa97b6875665 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:07.809134 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d5fd487f-508a-48b1-82ca-aa97b6875665 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:51:07.817191 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d5fd487f-508a-48b1-82ca-aa97b6875665 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1274 microversion: 2.1 time: 0.160398 Jan 22 21:51:07.817812 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4019/8330] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:51:07 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:51:08.834500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6962d1d7-5b36-45bb-bd45-d49e6bc336cb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:51:08.835136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6962d1d7-5b36-45bb-bd45-d49e6bc336cb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:51:08.842144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6962d1d7-5b36-45bb-bd45-d49e6bc336cb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:08.842614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6962d1d7-5b36-45bb-bd45-d49e6bc336cb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:08.843429 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6962d1d7-5b36-45bb-bd45-d49e6bc336cb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:08.843896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6962d1d7-5b36-45bb-bd45-d49e6bc336cb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:08.978564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6962d1d7-5b36-45bb-bd45-d49e6bc336cb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:51:08.986579 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6962d1d7-5b36-45bb-bd45-d49e6bc336cb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1274 microversion: 2.1 time: 0.155829 Jan 22 21:51:08.987149 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4312/8331] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:51:08 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1274 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:51:10.003578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-adf22822-ba9d-438e-a15f-6cde05737fd3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:51:10.004196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-adf22822-ba9d-438e-a15f-6cde05737fd3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:51:10.011345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adf22822-ba9d-438e-a15f-6cde05737fd3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:10.011809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adf22822-ba9d-438e-a15f-6cde05737fd3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:10.013238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adf22822-ba9d-438e-a15f-6cde05737fd3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:10.013725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adf22822-ba9d-438e-a15f-6cde05737fd3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:10.147131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-adf22822-ba9d-438e-a15f-6cde05737fd3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:51:10.154715 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-adf22822-ba9d-438e-a15f-6cde05737fd3 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1274 microversion: 2.1 time: 0.154843 Jan 22 21:51:10.155283 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4020/8332] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:51:09 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1274 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:51:11.172018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-52563b8d-5452-4a88-84b5-f785e188d7fb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:51:11.172597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-52563b8d-5452-4a88-84b5-f785e188d7fb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:51:11.179460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52563b8d-5452-4a88-84b5-f785e188d7fb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:11.179945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52563b8d-5452-4a88-84b5-f785e188d7fb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:11.180760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52563b8d-5452-4a88-84b5-f785e188d7fb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:11.181223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52563b8d-5452-4a88-84b5-f785e188d7fb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:11.315544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-52563b8d-5452-4a88-84b5-f785e188d7fb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:51:11.323049 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-52563b8d-5452-4a88-84b5-f785e188d7fb tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1274 microversion: 2.1 time: 0.155368 Jan 22 21:51:11.323621 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4313/8333] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:51:11 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1274 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:51:12.338930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-455c46ec-103f-477c-96ad-69cec4a22b4c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:51:12.339531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-455c46ec-103f-477c-96ad-69cec4a22b4c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:51:12.346362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-455c46ec-103f-477c-96ad-69cec4a22b4c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:12.346827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-455c46ec-103f-477c-96ad-69cec4a22b4c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:12.347619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-455c46ec-103f-477c-96ad-69cec4a22b4c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:12.348072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-455c46ec-103f-477c-96ad-69cec4a22b4c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:12.488118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-455c46ec-103f-477c-96ad-69cec4a22b4c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:51:12.495571 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-455c46ec-103f-477c-96ad-69cec4a22b4c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1274 microversion: 2.1 time: 0.160417 Jan 22 21:51:12.496146 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4021/8334] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:51:12 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:51:13.512708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e51dcb43-c604-440f-9cab-b3abbe319781 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:51:13.513448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e51dcb43-c604-440f-9cab-b3abbe319781 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:51:13.520334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51dcb43-c604-440f-9cab-b3abbe319781 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:13.520807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51dcb43-c604-440f-9cab-b3abbe319781 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:13.521655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51dcb43-c604-440f-9cab-b3abbe319781 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:13.522125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e51dcb43-c604-440f-9cab-b3abbe319781 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:13.656168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e51dcb43-c604-440f-9cab-b3abbe319781 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:51:13.663667 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e51dcb43-c604-440f-9cab-b3abbe319781 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1274 microversion: 2.1 time: 0.155143 Jan 22 21:51:13.670607 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4314/8335] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:51:13 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1274 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:51:14.097325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-763d4d3b-dd43-4f60-a900-9a0f23f64bd0 req-e99fe5d0-5c9c-46e5-bdb4-776f89b5e094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d", "name": "network-vif-plugged", "status": "completed", "tag": "1771599c-dd34-4b95-be5b-bd085b5fee7d"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:51:14.098902 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:51:14.098902 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:51:14.106485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-763d4d3b-dd43-4f60-a900-9a0f23f64bd0 req-e99fe5d0-5c9c-46e5-bdb4-776f89b5e094 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:14.107220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-763d4d3b-dd43-4f60-a900-9a0f23f64bd0 req-e99fe5d0-5c9c-46e5-bdb4-776f89b5e094 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:14.118048 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-763d4d3b-dd43-4f60-a900-9a0f23f64bd0 req-e99fe5d0-5c9c-46e5-bdb4-776f89b5e094 service nova] Creating event network-vif-plugged:1771599c-dd34-4b95-be5b-bd085b5fee7d for instance 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d on nch2-master-1 Jan 22 21:51:14.124000 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-763d4d3b-dd43-4f60-a900-9a0f23f64bd0 req-e99fe5d0-5c9c-46e5-bdb4-776f89b5e094 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178461 Jan 22 21:51:14.124582 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4022/8336] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:51:14.682826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c90064c9-2402-4168-b0a0-43e6e1fc0775 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:51:14.683477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c90064c9-2402-4168-b0a0-43e6e1fc0775 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:51:14.691538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c90064c9-2402-4168-b0a0-43e6e1fc0775 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:14.692007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c90064c9-2402-4168-b0a0-43e6e1fc0775 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:14.692818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c90064c9-2402-4168-b0a0-43e6e1fc0775 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:14.693271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c90064c9-2402-4168-b0a0-43e6e1fc0775 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:14.859723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c90064c9-2402-4168-b0a0-43e6e1fc0775 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:51:14.870260 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c90064c9-2402-4168-b0a0-43e6e1fc0775 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1274 microversion: 2.1 time: 0.191188 Jan 22 21:51:14.870875 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4315/8337] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:51:14 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:51:15.890500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-02f81b45-3df8-45a2-ac20-cc559a1fad96 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:51:15.891230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-02f81b45-3df8-45a2-ac20-cc559a1fad96 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:51:15.898200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-02f81b45-3df8-45a2-ac20-cc559a1fad96 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:15.898659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-02f81b45-3df8-45a2-ac20-cc559a1fad96 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:15.899442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-02f81b45-3df8-45a2-ac20-cc559a1fad96 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:15.899891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-02f81b45-3df8-45a2-ac20-cc559a1fad96 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:16.036407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-02f81b45-3df8-45a2-ac20-cc559a1fad96 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:51:16.044793 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-02f81b45-3df8-45a2-ac20-cc559a1fad96 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1462 microversion: 2.1 time: 0.158816 Jan 22 21:51:16.045366 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4023/8338] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:51:15 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1462 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:51:16.060933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ed243740-6048-4bbb-b81b-3821b59cf58c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:51:16.061597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ed243740-6048-4bbb-b81b-3821b59cf58c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:51:16.068233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed243740-6048-4bbb-b81b-3821b59cf58c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:16.068704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed243740-6048-4bbb-b81b-3821b59cf58c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:16.069522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed243740-6048-4bbb-b81b-3821b59cf58c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:16.069992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed243740-6048-4bbb-b81b-3821b59cf58c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:16.201441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ed243740-6048-4bbb-b81b-3821b59cf58c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:51:16.208868 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ed243740-6048-4bbb-b81b-3821b59cf58c tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1462 microversion: 2.1 time: 0.151875 Jan 22 21:51:16.209441 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4316/8339] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:51:16 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1462 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:51:18.192318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-5bff66ae-1ca9-463a-8f3e-3245581f176e req-18691782-9a8f-48ef-a0e5-e0249f2c2ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d", "tag": "1771599c-dd34-4b95-be5b-bd085b5fee7d"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:51:18.193957 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:51:18.193957 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:51:18.203511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5bff66ae-1ca9-463a-8f3e-3245581f176e req-18691782-9a8f-48ef-a0e5-e0249f2c2ef8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:18.203959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5bff66ae-1ca9-463a-8f3e-3245581f176e req-18691782-9a8f-48ef-a0e5-e0249f2c2ef8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:18.216972 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-5bff66ae-1ca9-463a-8f3e-3245581f176e req-18691782-9a8f-48ef-a0e5-e0249f2c2ef8 service nova] Creating event network-changed:1771599c-dd34-4b95-be5b-bd085b5fee7d for instance 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d on nch2-master-1 Jan 22 21:51:18.222481 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-5bff66ae-1ca9-463a-8f3e-3245581f176e req-18691782-9a8f-48ef-a0e5-e0249f2c2ef8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033697 Jan 22 21:51:18.223343 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4024/8340] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:51:19.253629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-f7ff1de0-f3cd-4a15-88fc-dab6d8d2504e req-44669ba0-6c0c-44ca-9a91-11b93587fa41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d", "tag": "1771599c-dd34-4b95-be5b-bd085b5fee7d"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:51:19.255222 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:51:19.255222 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:51:19.264080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f7ff1de0-f3cd-4a15-88fc-dab6d8d2504e req-44669ba0-6c0c-44ca-9a91-11b93587fa41 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:19.264550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f7ff1de0-f3cd-4a15-88fc-dab6d8d2504e req-44669ba0-6c0c-44ca-9a91-11b93587fa41 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:19.278700 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f7ff1de0-f3cd-4a15-88fc-dab6d8d2504e req-44669ba0-6c0c-44ca-9a91-11b93587fa41 service nova] Creating event network-changed:1771599c-dd34-4b95-be5b-bd085b5fee7d for instance 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d on nch2-master-1 Jan 22 21:51:19.285011 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-f7ff1de0-f3cd-4a15-88fc-dab6d8d2504e req-44669ba0-6c0c-44ca-9a91-11b93587fa41 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035103 Jan 22 21:51:19.285876 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4317/8341] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:51:21.301053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-8812ee26-e4a0-428c-8d0b-0f969e7487eb req-cb573873-efd2-4b6a-839d-4099e603d9ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d", "tag": "1771599c-dd34-4b95-be5b-bd085b5fee7d"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:51:21.305811 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:51:21.305811 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:51:21.310170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8812ee26-e4a0-428c-8d0b-0f969e7487eb req-cb573873-efd2-4b6a-839d-4099e603d9ca service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:51:21.310624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8812ee26-e4a0-428c-8d0b-0f969e7487eb req-cb573873-efd2-4b6a-839d-4099e603d9ca service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:51:21.321776 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8812ee26-e4a0-428c-8d0b-0f969e7487eb req-cb573873-efd2-4b6a-839d-4099e603d9ca service nova] Creating event network-changed:1771599c-dd34-4b95-be5b-bd085b5fee7d for instance 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d on nch2-master-1 Jan 22 21:51:21.326686 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-8812ee26-e4a0-428c-8d0b-0f969e7487eb req-cb573873-efd2-4b6a-839d-4099e603d9ca service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029838 Jan 22 21:51:21.327273 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4025/8342] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:51:33.918638 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:51:33.919371 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 21:51:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:51:34.970900 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:51:34.971587 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 21:51:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:54:53.929312 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:54:53.930031 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 21:54:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:54:54.980016 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:54:54.980558 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 21:54:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:56:09.652272 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [-] [913664d8-58d1-4bc9-a0cb-33264365d7dc] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 21:56:09.653159 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5c65b53b-7dc4-496f-937e-a7dc1df2041e] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 21:56:09.655005 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edc45ac6-e555-423c-baf2-d131dfc2b608] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 21:56:09.655831 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7ed686d-6f24-47e8-978c-4287ce754ef2] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 21:56:09.660249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9b117af5-aebe-41a5-9f2e-5afc9fa0d9d6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:56:09.660843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9b117af5-aebe-41a5-9f2e-5afc9fa0d9d6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:56:09.667930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b117af5-aebe-41a5-9f2e-5afc9fa0d9d6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:09.669466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b117af5-aebe-41a5-9f2e-5afc9fa0d9d6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:09.669466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b117af5-aebe-41a5-9f2e-5afc9fa0d9d6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:09.670231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b117af5-aebe-41a5-9f2e-5afc9fa0d9d6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:09.696258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9b117af5-aebe-41a5-9f2e-5afc9fa0d9d6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:56:09.751934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-1b02ecec-aa56-4be4-9db3-8719da651282 req-eae2af0a-d134-4507-9df3-793d23f43300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d", "tag": "1771599c-dd34-4b95-be5b-bd085b5fee7d"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:56:09.751934 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:56:09.751934 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:56:09.758888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1b02ecec-aa56-4be4-9db3-8719da651282 req-eae2af0a-d134-4507-9df3-793d23f43300 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:09.759332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-1b02ecec-aa56-4be4-9db3-8719da651282 req-eae2af0a-d134-4507-9df3-793d23f43300 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:09.770700 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-1b02ecec-aa56-4be4-9db3-8719da651282 req-eae2af0a-d134-4507-9df3-793d23f43300 service nova] Creating event network-changed:1771599c-dd34-4b95-be5b-bd085b5fee7d for instance 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d on nch2-master-1 Jan 22 21:56:09.774253 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [req-1b02ecec-aa56-4be4-9db3-8719da651282 req-eae2af0a-d134-4507-9df3-793d23f43300 service nova] [f962eaa4-b2c4-4269-b24d-bd2b807893d1] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 21:56:09.901032 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9b117af5-aebe-41a5-9f2e-5afc9fa0d9d6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [cd24fd2d-b24e-4cbc-bd78-795dc9904d01] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 21:56:10.664322 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] [913664d8-58d1-4bc9-a0cb-33264365d7dc] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 56592. Jan 22 21:56:10.666447 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] [5c65b53b-7dc4-496f-937e-a7dc1df2041e] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 56594. Jan 22 21:56:10.668786 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] [edc45ac6-e555-423c-baf2-d131dfc2b608] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 56596. Jan 22 21:56:10.669589 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7ed686d-6f24-47e8-978c-4287ce754ef2] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 56598. Jan 22 21:56:10.781612 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [req-1b02ecec-aa56-4be4-9db3-8719da651282 req-eae2af0a-d134-4507-9df3-793d23f43300 service nova] [f962eaa4-b2c4-4269-b24d-bd2b807893d1] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 56600. Jan 22 21:56:10.785434 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-1b02ecec-aa56-4be4-9db3-8719da651282 req-eae2af0a-d134-4507-9df3-793d23f43300 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.134619 Jan 22 21:56:10.786141 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4026/8343] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:56:10.908940 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [None req-9b117af5-aebe-41a5-9f2e-5afc9fa0d9d6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [cd24fd2d-b24e-4cbc-bd78-795dc9904d01] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 56602. Jan 22 21:56:11.015002 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9b117af5-aebe-41a5-9f2e-5afc9fa0d9d6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 204 len: 0 microversion: 2.1 time: 1.366323 Jan 22 21:56:11.016935 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4318/8344] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:56:09 2022] DELETE /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 0 bytes in 1368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:56:11.025057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-996fc36c-be65-4171-b854-cee6872d4920 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:56:11.026999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-996fc36c-be65-4171-b854-cee6872d4920 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:56:11.036979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-996fc36c-be65-4171-b854-cee6872d4920 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:11.037440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-996fc36c-be65-4171-b854-cee6872d4920 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:11.038263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-996fc36c-be65-4171-b854-cee6872d4920 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:11.038702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-996fc36c-be65-4171-b854-cee6872d4920 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:11.237293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-996fc36c-be65-4171-b854-cee6872d4920 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:56:11.245414 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-996fc36c-be65-4171-b854-cee6872d4920 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1587 microversion: 2.1 time: 0.224507 Jan 22 21:56:11.246017 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4027/8345] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:56:11 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1587 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:56:12.264638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5a8c9448-d2f0-40e0-95ed-7c0d681d8cd6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:56:12.265345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5a8c9448-d2f0-40e0-95ed-7c0d681d8cd6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:56:12.272790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a8c9448-d2f0-40e0-95ed-7c0d681d8cd6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:12.273255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a8c9448-d2f0-40e0-95ed-7c0d681d8cd6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:12.274077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a8c9448-d2f0-40e0-95ed-7c0d681d8cd6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:12.274532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a8c9448-d2f0-40e0-95ed-7c0d681d8cd6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:12.562914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5a8c9448-d2f0-40e0-95ed-7c0d681d8cd6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:56:12.571208 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5a8c9448-d2f0-40e0-95ed-7c0d681d8cd6 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1468 microversion: 2.1 time: 0.310651 Jan 22 21:56:12.571785 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4319/8346] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:56:12 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1468 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:56:13.048999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-8ff73e67-33f9-431c-aaa6-83a55eacab40 req-4acb63ac-06bb-45d7-809b-9b0f32e6cd64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d", "name": "network-vif-deleted", "tag": "1771599c-dd34-4b95-be5b-bd085b5fee7d"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:56:13.050773 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:56:13.050773 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:56:13.060018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8ff73e67-33f9-431c-aaa6-83a55eacab40 req-4acb63ac-06bb-45d7-809b-9b0f32e6cd64 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:13.060488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8ff73e67-33f9-431c-aaa6-83a55eacab40 req-4acb63ac-06bb-45d7-809b-9b0f32e6cd64 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:13.072444 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8ff73e67-33f9-431c-aaa6-83a55eacab40 req-4acb63ac-06bb-45d7-809b-9b0f32e6cd64 service nova] Creating event network-vif-deleted:1771599c-dd34-4b95-be5b-bd085b5fee7d for instance 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d on nch2-master-1 Jan 22 21:56:13.077665 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-8ff73e67-33f9-431c-aaa6-83a55eacab40 req-4acb63ac-06bb-45d7-809b-9b0f32e6cd64 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092289 Jan 22 21:56:13.078303 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4028/8347] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:56:13.590140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4c76d269-1dce-4d0f-b13c-44cca84ab6b9 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:56:13.590769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4c76d269-1dce-4d0f-b13c-44cca84ab6b9 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:56:13.597808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c76d269-1dce-4d0f-b13c-44cca84ab6b9 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:13.602394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c76d269-1dce-4d0f-b13c-44cca84ab6b9 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:13.602394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c76d269-1dce-4d0f-b13c-44cca84ab6b9 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:13.602394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c76d269-1dce-4d0f-b13c-44cca84ab6b9 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:13.640229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c76d269-1dce-4d0f-b13c-44cca84ab6b9 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:13.640702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c76d269-1dce-4d0f-b13c-44cca84ab6b9 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:13.641176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-4c76d269-1dce-4d0f-b13c-44cca84ab6b9 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lazy-loading 'fault' on Instance uuid 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:56:13.695770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4c76d269-1dce-4d0f-b13c-44cca84ab6b9 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab4c5a8b2034ac79070e92037330ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479688e52574428bab32e5f9e0ad1910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:56:13.703284 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4c76d269-1dce-4d0f-b13c-44cca84ab6b9 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 200 len: 1238 microversion: 2.1 time: 0.116974 Jan 22 21:56:13.703854 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4320/8348] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:56:13 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 1238 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:56:14.721119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-89de3b1d-1e1e-486f-be92-8048bf0507c0 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:56:14.721768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-89de3b1d-1e1e-486f-be92-8048bf0507c0 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] [instance: 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:56:14.728463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89de3b1d-1e1e-486f-be92-8048bf0507c0 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:14.728923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89de3b1d-1e1e-486f-be92-8048bf0507c0 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:14.729737 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89de3b1d-1e1e-486f-be92-8048bf0507c0 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:14.730186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89de3b1d-1e1e-486f-be92-8048bf0507c0 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:14.743760 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-89de3b1d-1e1e-486f-be92-8048bf0507c0 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] HTTP exception thrown: Instance 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d could not be found. Jan 22 21:56:14.744350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-89de3b1d-1e1e-486f-be92-8048bf0507c0 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Returning 404 to user: Instance 1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:56:14.745183 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-89de3b1d-1e1e-486f-be92-8048bf0507c0 tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d" status: 404 len: 111 microversion: 2.1 time: 0.029157 Jan 22 21:56:14.745753 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4029/8349] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:56:14 2022] GET /compute/v2.1/servers/1353e4a1-00c2-4cdb-b8b3-bdb208de5c2d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:56:14.950514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d141eff1-89a4-4b72-a33b-bc5a2056b40d tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] Calling method '.version_select at 0x7f1ed4b3d040>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:56:15.087417 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d141eff1-89a4-4b72-a33b-bc5a2056b40d tempest-TestVolumeBackupRestore-1156611914 tempest-TestVolumeBackupRestore-1156611914-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2022106336" status: 202 len: 0 microversion: 2.1 time: 0.140473 Jan 22 21:56:15.087999 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4321/8350] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 21:56:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2022106336 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:56:33.860297 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:56:33.861028 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 21:56:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:56:34.661213 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:56:34.661813 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 21:56:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:56:54.763846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1195808540", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:56:54.816382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] validate_networks() for None {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:56:55.083873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:56:55.084329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:56:55.084814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:56:55.085232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:56:55.085683 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:56:55.095418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:55.095418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:55.096165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:55.096608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:55.113028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Getting quotas for project 216befde6e214edabc20c41bfad7c838. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:56:55.118836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Getting quotas for user 61ade724c0d848dd8689e6f010c3a122 and project 216befde6e214edabc20c41bfad7c838. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:56:55.131024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:56:55.133949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:56:55.252906 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c0e00d37-48ea-4c27-983a-bbf4626a559f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.601723 Jan 22 21:56:55.253550 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4030/8351] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:56:54 2022] POST /compute/v2.1/servers => generated 382 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:56:55.268621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3b8ff35c-8543-4c96-9409-9fa7d7b4e3b9 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:56:55.269244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3b8ff35c-8543-4c96-9409-9fa7d7b4e3b9 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:56:55.322451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3b8ff35c-8543-4c96-9409-9fa7d7b4e3b9 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ade724c0d848dd8689e6f010c3a122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216befde6e214edabc20c41bfad7c838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:56:55.329150 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3b8ff35c-8543-4c96-9409-9fa7d7b4e3b9 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 200 len: 1226 microversion: 2.1 time: 0.068428 Jan 22 21:56:55.329854 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4322/8352] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:56:55 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 1226 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:56:56.350758 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8c8ca2fa-f9b8-4fce-ae80-f1cf525b481c tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:56:56.351377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8c8ca2fa-f9b8-4fce-ae80-f1cf525b481c tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:56:56.403481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8c8ca2fa-f9b8-4fce-ae80-f1cf525b481c tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ade724c0d848dd8689e6f010c3a122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216befde6e214edabc20c41bfad7c838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:56:56.410492 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8c8ca2fa-f9b8-4fce-ae80-f1cf525b481c tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 200 len: 1226 microversion: 2.1 time: 0.064252 Jan 22 21:56:56.410995 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4031/8353] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:56:56 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 1226 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:56:57.427095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f22c828f-04b4-42f2-9175-fe7a1e5b308a tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:56:57.427710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f22c828f-04b4-42f2-9175-fe7a1e5b308a tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:56:57.434895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f22c828f-04b4-42f2-9175-fe7a1e5b308a tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:57.435367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f22c828f-04b4-42f2-9175-fe7a1e5b308a tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:57.436237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f22c828f-04b4-42f2-9175-fe7a1e5b308a tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:57.436699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f22c828f-04b4-42f2-9175-fe7a1e5b308a tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:57.520632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f22c828f-04b4-42f2-9175-fe7a1e5b308a tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ade724c0d848dd8689e6f010c3a122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216befde6e214edabc20c41bfad7c838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:56:57.529007 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f22c828f-04b4-42f2-9175-fe7a1e5b308a tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 200 len: 1286 microversion: 2.1 time: 0.105434 Jan 22 21:56:57.529758 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4323/8354] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:56:57 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 1286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:56:58.550814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8d06a796-e445-4928-b1dd-8057a9e6f0c4 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:56:58.552377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8d06a796-e445-4928-b1dd-8057a9e6f0c4 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:56:58.561914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d06a796-e445-4928-b1dd-8057a9e6f0c4 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:58.562378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d06a796-e445-4928-b1dd-8057a9e6f0c4 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:58.563249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d06a796-e445-4928-b1dd-8057a9e6f0c4 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:58.564278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d06a796-e445-4928-b1dd-8057a9e6f0c4 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:58.700118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8d06a796-e445-4928-b1dd-8057a9e6f0c4 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ade724c0d848dd8689e6f010c3a122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216befde6e214edabc20c41bfad7c838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:56:58.708174 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8d06a796-e445-4928-b1dd-8057a9e6f0c4 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 200 len: 1326 microversion: 2.1 time: 0.161169 Jan 22 21:56:58.719764 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4032/8355] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:56:58 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 1326 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:56:59.307006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-16e9c405-8776-4fce-bcd9-dc4efd2fdf5c req-89d997c5-156f-4973-bd05-42f7aada76b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9aa5155-4f12-491d-be73-fa6b18ee340b", "tag": "5136c056-13bf-41c6-bf8f-4c182a2acb7e"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:56:59.309601 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:56:59.309601 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:56:59.316749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-16e9c405-8776-4fce-bcd9-dc4efd2fdf5c req-89d997c5-156f-4973-bd05-42f7aada76b9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:59.317227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-16e9c405-8776-4fce-bcd9-dc4efd2fdf5c req-89d997c5-156f-4973-bd05-42f7aada76b9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:59.329738 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-16e9c405-8776-4fce-bcd9-dc4efd2fdf5c req-89d997c5-156f-4973-bd05-42f7aada76b9 service nova] Creating event network-changed:5136c056-13bf-41c6-bf8f-4c182a2acb7e for instance c9aa5155-4f12-491d-be73-fa6b18ee340b on nch2-master-1 Jan 22 21:56:59.334799 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-16e9c405-8776-4fce-bcd9-dc4efd2fdf5c req-89d997c5-156f-4973-bd05-42f7aada76b9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033598 Jan 22 21:56:59.337132 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4324/8356] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:56:59.727660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0f2a22ad-d7f3-4d92-aeea-8315c79019cf tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:56:59.728377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0f2a22ad-d7f3-4d92-aeea-8315c79019cf tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:56:59.735168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f2a22ad-d7f3-4d92-aeea-8315c79019cf tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:59.735615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f2a22ad-d7f3-4d92-aeea-8315c79019cf tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:59.736397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f2a22ad-d7f3-4d92-aeea-8315c79019cf tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:56:59.736875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0f2a22ad-d7f3-4d92-aeea-8315c79019cf tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:56:59.878095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0f2a22ad-d7f3-4d92-aeea-8315c79019cf tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ade724c0d848dd8689e6f010c3a122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216befde6e214edabc20c41bfad7c838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:56:59.885896 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0f2a22ad-d7f3-4d92-aeea-8315c79019cf tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 200 len: 1326 microversion: 2.1 time: 0.162620 Jan 22 21:56:59.886480 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4033/8357] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:56:59 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 1326 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:00.904248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-28d05dec-c6b8-4a53-9215-346bfe3e7499 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:00.904972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-28d05dec-c6b8-4a53-9215-346bfe3e7499 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:00.911950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28d05dec-c6b8-4a53-9215-346bfe3e7499 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:00.912702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28d05dec-c6b8-4a53-9215-346bfe3e7499 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:00.913635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28d05dec-c6b8-4a53-9215-346bfe3e7499 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:00.914105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28d05dec-c6b8-4a53-9215-346bfe3e7499 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:01.047573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-28d05dec-c6b8-4a53-9215-346bfe3e7499 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ade724c0d848dd8689e6f010c3a122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216befde6e214edabc20c41bfad7c838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:01.055068 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-28d05dec-c6b8-4a53-9215-346bfe3e7499 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 200 len: 1326 microversion: 2.1 time: 0.156085 Jan 22 21:57:01.056164 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4325/8358] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:00 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 1326 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:02.072969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-73faa0df-bae9-4b91-bc9c-79963b0d1c0f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:02.073600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-73faa0df-bae9-4b91-bc9c-79963b0d1c0f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:02.080344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73faa0df-bae9-4b91-bc9c-79963b0d1c0f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:02.080796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73faa0df-bae9-4b91-bc9c-79963b0d1c0f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:02.081605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73faa0df-bae9-4b91-bc9c-79963b0d1c0f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:02.082045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73faa0df-bae9-4b91-bc9c-79963b0d1c0f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:02.212981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-73faa0df-bae9-4b91-bc9c-79963b0d1c0f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ade724c0d848dd8689e6f010c3a122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216befde6e214edabc20c41bfad7c838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:02.222455 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-73faa0df-bae9-4b91-bc9c-79963b0d1c0f tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 200 len: 1326 microversion: 2.1 time: 0.153703 Jan 22 21:57:02.223018 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4034/8359] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:02 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:03.240040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-100038ef-90a6-4052-9eb3-7095d4ac4715 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:03.240596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-100038ef-90a6-4052-9eb3-7095d4ac4715 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:03.248196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-100038ef-90a6-4052-9eb3-7095d4ac4715 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:03.248671 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-100038ef-90a6-4052-9eb3-7095d4ac4715 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:03.249768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-100038ef-90a6-4052-9eb3-7095d4ac4715 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:03.250232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-100038ef-90a6-4052-9eb3-7095d4ac4715 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:03.397195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-100038ef-90a6-4052-9eb3-7095d4ac4715 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ade724c0d848dd8689e6f010c3a122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216befde6e214edabc20c41bfad7c838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:03.404984 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-100038ef-90a6-4052-9eb3-7095d4ac4715 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 200 len: 1326 microversion: 2.1 time: 0.168774 Jan 22 21:57:03.405581 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4326/8360] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:03 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 1326 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:04.421867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-852598fe-5420-48f6-9954-8012b6266c53 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:04.422488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-852598fe-5420-48f6-9954-8012b6266c53 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:04.429425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-852598fe-5420-48f6-9954-8012b6266c53 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:04.429925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-852598fe-5420-48f6-9954-8012b6266c53 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:04.431467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-852598fe-5420-48f6-9954-8012b6266c53 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:04.431869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-852598fe-5420-48f6-9954-8012b6266c53 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:04.568362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-852598fe-5420-48f6-9954-8012b6266c53 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ade724c0d848dd8689e6f010c3a122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216befde6e214edabc20c41bfad7c838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:04.576022 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-852598fe-5420-48f6-9954-8012b6266c53 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 200 len: 1326 microversion: 2.1 time: 0.158028 Jan 22 21:57:04.576609 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4035/8361] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:04 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 1326 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:05.592815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3ce817db-9db7-4e3c-ba8f-f17d32108a0c tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:05.593476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3ce817db-9db7-4e3c-ba8f-f17d32108a0c tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:05.600476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ce817db-9db7-4e3c-ba8f-f17d32108a0c tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:05.600942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ce817db-9db7-4e3c-ba8f-f17d32108a0c tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:05.601778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ce817db-9db7-4e3c-ba8f-f17d32108a0c tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:05.602274 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ce817db-9db7-4e3c-ba8f-f17d32108a0c tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:05.732624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3ce817db-9db7-4e3c-ba8f-f17d32108a0c tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ade724c0d848dd8689e6f010c3a122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216befde6e214edabc20c41bfad7c838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:05.740040 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3ce817db-9db7-4e3c-ba8f-f17d32108a0c tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 200 len: 1326 microversion: 2.1 time: 0.150960 Jan 22 21:57:05.740615 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4327/8362] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:05 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 1326 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:06.039873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-7c654d3d-e4ee-434c-b136-578e4478f090 req-44373219-b1b5-43dd-9dbc-9b593dd37ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9aa5155-4f12-491d-be73-fa6b18ee340b", "name": "network-vif-plugged", "status": "completed", "tag": "5136c056-13bf-41c6-bf8f-4c182a2acb7e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:57:06.042185 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:57:06.042185 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:57:06.049196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7c654d3d-e4ee-434c-b136-578e4478f090 req-44373219-b1b5-43dd-9dbc-9b593dd37ba5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:06.049700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7c654d3d-e4ee-434c-b136-578e4478f090 req-44373219-b1b5-43dd-9dbc-9b593dd37ba5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:06.060995 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-7c654d3d-e4ee-434c-b136-578e4478f090 req-44373219-b1b5-43dd-9dbc-9b593dd37ba5 service nova] Creating event network-vif-plugged:5136c056-13bf-41c6-bf8f-4c182a2acb7e for instance c9aa5155-4f12-491d-be73-fa6b18ee340b on nch2-master-1 Jan 22 21:57:06.066200 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-7c654d3d-e4ee-434c-b136-578e4478f090 req-44373219-b1b5-43dd-9dbc-9b593dd37ba5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091894 Jan 22 21:57:06.066837 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4036/8363] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:57:06.757492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b21f3501-01db-48b0-956d-e6423ddec84b tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:06.758137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b21f3501-01db-48b0-956d-e6423ddec84b tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:06.765009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b21f3501-01db-48b0-956d-e6423ddec84b tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:06.765488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b21f3501-01db-48b0-956d-e6423ddec84b tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:06.766338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b21f3501-01db-48b0-956d-e6423ddec84b tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:06.766806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b21f3501-01db-48b0-956d-e6423ddec84b tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:06.897476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b21f3501-01db-48b0-956d-e6423ddec84b tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ade724c0d848dd8689e6f010c3a122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216befde6e214edabc20c41bfad7c838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:06.905455 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b21f3501-01db-48b0-956d-e6423ddec84b tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 200 len: 1326 microversion: 2.1 time: 0.151725 Jan 22 21:57:06.906064 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4328/8364] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:06 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 1326 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:07.923430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8b797994-d13a-412c-a755-5f91dc6aaff9 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:07.924150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8b797994-d13a-412c-a755-5f91dc6aaff9 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:07.930372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b797994-d13a-412c-a755-5f91dc6aaff9 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:07.931862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b797994-d13a-412c-a755-5f91dc6aaff9 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:07.932699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b797994-d13a-412c-a755-5f91dc6aaff9 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:07.933141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b797994-d13a-412c-a755-5f91dc6aaff9 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:08.062534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8b797994-d13a-412c-a755-5f91dc6aaff9 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ade724c0d848dd8689e6f010c3a122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216befde6e214edabc20c41bfad7c838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:08.069888 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8b797994-d13a-412c-a755-5f91dc6aaff9 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 200 len: 1475 microversion: 2.1 time: 0.151234 Jan 22 21:57:08.070460 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4037/8365] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:07 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 1475 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:08.145592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ea5a1fbc-960d-40f4-9f22-d5b274649e59 tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Calling method '.version_select at 0x7f1ed52323a0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:08.214039 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ea5a1fbc-960d-40f4-9f22-d5b274649e59 tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/3f754d79163d406d95cb9b7f5f1ea462" status: 200 len: 371 microversion: 2.1 time: 0.129490 Jan 22 21:57:08.214625 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4329/8366] 10.222.0.100 () {58 vars in 1246 bytes} [Sat Jan 22 21:57:08 2022] GET /compute/v2.1/os-quota-sets/3f754d79163d406d95cb9b7f5f1ea462 => generated 371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:57:08.224948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5d941a9b-5d78-438a-ab2c-a006b35121a9 tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-61401437", "id": 736140355, "os-flavor-access:is_public": "True"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:57:08.226670 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:57:08.226670 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:57:08.303776 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5d941a9b-5d78-438a-ab2c-a006b35121a9 tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.082515 Jan 22 21:57:08.304402 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4038/8367] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:57:08 2022] POST /compute/v2.1/flavors => generated 435 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:57:08.315810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "736140355"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:57:08.316782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:08.323651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:08.324116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:08.324938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:08.325412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:08.517666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'eecebfe8a4374ae78d1094f1ea54d651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f754d79163d406d95cb9b7f5f1ea462', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:08.524265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-61401437 {{(pid=137032) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 21:57:08.525545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:08.526021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:08.526865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:08.527326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:08.547186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Getting quotas for project 216befde6e214edabc20c41bfad7c838. Resources: {'cores', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:57:08.553006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Getting quotas for user 61ade724c0d848dd8689e6f010c3a122 and project 216befde6e214edabc20c41bfad7c838. Resources: {'cores', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:57:08.565416 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.compute.api [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] ram quota exceeded for 3f754d79163d406d95cb9b7f5f1ea462, tried to resize instance. Jan 22 21:57:08.576752 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jan 22 21:57:08.576752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:57:08.576752 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-03053773-f601-4c00-963f-b5787c313b3d tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b/action" status: 403 len: 118 microversion: 2.1 time: 0.255511 Jan 22 21:57:08.576752 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4330/8368] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:57:08 2022] POST /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b/action => generated 118 bytes in 257 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:57:08.577179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0e1110ea-d3a3-4e44-8f39-f3e2336f3d13 tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:08.577839 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:57:08.577839 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:57:08.628719 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0e1110ea-d3a3-4e44-8f39-f3e2336f3d13 tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/736140355" status: 202 len: 0 microversion: 2.1 time: 0.055465 Jan 22 21:57:08.629307 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4039/8369] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 21:57:08 2022] DELETE /compute/v2.1/flavors/736140355 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 21:57:08.637785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9b6c0d11-0468-4e01-aab6-751629abe34f tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:08.656593 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9b6c0d11-0468-4e01-aab6-751629abe34f tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.023121 Jan 22 21:57:08.657139 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4331/8370] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:57:08 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:08.675628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-90b0305e-462b-4035-9145-b4db088bbd8e tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Calling method '.version_select at 0x7f1ed5dca280>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:08.745999 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-90b0305e-462b-4035-9145-b4db088bbd8e tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] 10.222.0.100 "GET /compute/v2.1/os-quota-sets/3f754d79163d406d95cb9b7f5f1ea462" status: 200 len: 371 microversion: 2.1 time: 0.074020 Jan 22 21:57:08.746604 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4040/8371] 10.222.0.100 () {58 vars in 1246 bytes} [Sat Jan 22 21:57:08 2022] GET /compute/v2.1/os-quota-sets/3f754d79163d406d95cb9b7f5f1ea462 => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:57:08.757084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-480a6de1-652c-479c-967b-b49ae30c2eda tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-846565026", "id": 674246686, "os-flavor-access:is_public": "True"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:57:08.759193 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:57:08.759193 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:57:08.824828 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-480a6de1-652c-479c-967b-b49ae30c2eda tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] 10.222.0.100 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.071677 Jan 22 21:57:08.825456 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4332/8372] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:57:08 2022] POST /compute/v2.1/flavors => generated 435 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:57:08.836170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "674246686"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:57:08.838176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:08.844500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:08.844954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:08.845763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:08.846202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:08.984157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'eecebfe8a4374ae78d1094f1ea54d651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f754d79163d406d95cb9b7f5f1ea462', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:08.990798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-846565026 {{(pid=137033) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 21:57:08.991892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:08.992352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:08.993742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:08.993742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:09.016793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Getting quotas for project 216befde6e214edabc20c41bfad7c838. Resources: {'cores', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:57:09.021745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Getting quotas for user 61ade724c0d848dd8689e6f010c3a122 and project 216befde6e214edabc20c41bfad7c838. Resources: {'cores', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:57:09.036142 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.compute.api [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] cores quota exceeded for 3f754d79163d406d95cb9b7f5f1ea462, tried to resize instance. Jan 22 21:57:09.036689 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jan 22 21:57:09.037294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:57:09.038181 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8ab747ea-b4cf-466d-904b-e802f6eb49cb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] 10.222.0.100 "POST /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b/action" status: 403 len: 113 microversion: 2.1 time: 0.206004 Jan 22 21:57:09.038768 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4041/8373] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:57:08 2022] POST /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b/action => generated 113 bytes in 207 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:57:09.047240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5535586d-1f72-4a19-9fc0-c18947e0f1fb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:09.048012 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:57:09.048012 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:57:09.121035 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5535586d-1f72-4a19-9fc0-c18947e0f1fb tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] 10.222.0.100 "DELETE /compute/v2.1/flavors/674246686" status: 202 len: 0 microversion: 2.1 time: 0.077469 Jan 22 21:57:09.121673 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4333/8374] 10.222.0.100 () {58 vars in 1162 bytes} [Sat Jan 22 21:57:09 2022] DELETE /compute/v2.1/flavors/674246686 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:57:09.129740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-357f104b-f3da-4ba1-842c-284aa1205662 tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:09.148359 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-357f104b-f3da-4ba1-842c-284aa1205662 tempest-ServersAdminNegativeTestJSON-844512039 tempest-ServersAdminNegativeTestJSON-844512039-project-admin] 10.222.0.100 "GET /compute/v2.1/flavors/detail" status: 200 len: 5019 microversion: 2.1 time: 0.022229 Jan 22 21:57:09.148918 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4042/8375] 10.222.0.100 () {58 vars in 1150 bytes} [Sat Jan 22 21:57:09 2022] GET /compute/v2.1/flavors/detail => generated 5019 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:09.165131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4434dd30-f194-4b22-a880-c93a5e12795e tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:09.165827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4434dd30-f194-4b22-a880-c93a5e12795e tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:09.172268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4434dd30-f194-4b22-a880-c93a5e12795e tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:09.172743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4434dd30-f194-4b22-a880-c93a5e12795e tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:09.173711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4434dd30-f194-4b22-a880-c93a5e12795e tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:09.174180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4434dd30-f194-4b22-a880-c93a5e12795e tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:09.199252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4434dd30-f194-4b22-a880-c93a5e12795e tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:57:09.435280 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4434dd30-f194-4b22-a880-c93a5e12795e tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 204 len: 0 microversion: 2.1 time: 0.273623 Jan 22 21:57:09.435875 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4334/8376] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:57:09 2022] DELETE /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:57:09.444178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-28740af8-7982-484d-9e4a-d33415a72827 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:09.444844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-28740af8-7982-484d-9e4a-d33415a72827 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:09.452065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28740af8-7982-484d-9e4a-d33415a72827 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:09.452529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28740af8-7982-484d-9e4a-d33415a72827 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:09.453328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28740af8-7982-484d-9e4a-d33415a72827 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:09.453824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-28740af8-7982-484d-9e4a-d33415a72827 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:09.588899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-28740af8-7982-484d-9e4a-d33415a72827 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ade724c0d848dd8689e6f010c3a122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216befde6e214edabc20c41bfad7c838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:09.596466 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-28740af8-7982-484d-9e4a-d33415a72827 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 200 len: 1481 microversion: 2.1 time: 0.156323 Jan 22 21:57:09.597047 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4043/8377] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:09 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 1481 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:10.614718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74519e01-60db-4920-9e2d-8badd274d794 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:10.615489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-74519e01-60db-4920-9e2d-8badd274d794 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:10.622378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74519e01-60db-4920-9e2d-8badd274d794 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:10.622853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74519e01-60db-4920-9e2d-8badd274d794 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:10.623657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74519e01-60db-4920-9e2d-8badd274d794 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:10.624383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74519e01-60db-4920-9e2d-8badd274d794 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:10.762493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-74519e01-60db-4920-9e2d-8badd274d794 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ade724c0d848dd8689e6f010c3a122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216befde6e214edabc20c41bfad7c838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:10.770275 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-74519e01-60db-4920-9e2d-8badd274d794 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 200 len: 1481 microversion: 2.1 time: 0.159745 Jan 22 21:57:10.770851 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4335/8378] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:10 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 1481 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:11.367005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-836509d2-6f6b-4b09-a834-1635d2def3b8 req-b54e594d-cf86-443e-83e0-06b107f2456b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9aa5155-4f12-491d-be73-fa6b18ee340b", "name": "network-vif-deleted", "tag": "5136c056-13bf-41c6-bf8f-4c182a2acb7e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:57:11.369207 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:57:11.369207 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:57:11.378308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-836509d2-6f6b-4b09-a834-1635d2def3b8 req-b54e594d-cf86-443e-83e0-06b107f2456b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:11.378765 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-836509d2-6f6b-4b09-a834-1635d2def3b8 req-b54e594d-cf86-443e-83e0-06b107f2456b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:11.392926 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-836509d2-6f6b-4b09-a834-1635d2def3b8 req-b54e594d-cf86-443e-83e0-06b107f2456b service nova] Creating event network-vif-deleted:5136c056-13bf-41c6-bf8f-4c182a2acb7e for instance c9aa5155-4f12-491d-be73-fa6b18ee340b on nch2-master-1 Jan 22 21:57:11.398293 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-836509d2-6f6b-4b09-a834-1635d2def3b8 req-b54e594d-cf86-443e-83e0-06b107f2456b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035670 Jan 22 21:57:11.398907 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4044/8379] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:57:11.788017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-20a87ce9-c8ca-4eca-8f37-dccd0d376dc5 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:11.788648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-20a87ce9-c8ca-4eca-8f37-dccd0d376dc5 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:11.796829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20a87ce9-c8ca-4eca-8f37-dccd0d376dc5 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:11.797306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20a87ce9-c8ca-4eca-8f37-dccd0d376dc5 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:11.798149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20a87ce9-c8ca-4eca-8f37-dccd0d376dc5 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:11.798613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20a87ce9-c8ca-4eca-8f37-dccd0d376dc5 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:11.832683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20a87ce9-c8ca-4eca-8f37-dccd0d376dc5 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:11.833159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20a87ce9-c8ca-4eca-8f37-dccd0d376dc5 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:11.833692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-20a87ce9-c8ca-4eca-8f37-dccd0d376dc5 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lazy-loading 'fault' on Instance uuid c9aa5155-4f12-491d-be73-fa6b18ee340b {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:57:11.873607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-20a87ce9-c8ca-4eca-8f37-dccd0d376dc5 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61ade724c0d848dd8689e6f010c3a122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '216befde6e214edabc20c41bfad7c838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:11.881249 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-20a87ce9-c8ca-4eca-8f37-dccd0d376dc5 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 200 len: 1316 microversion: 2.1 time: 0.097018 Jan 22 21:57:11.881869 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4336/8380] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:11 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 1316 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:12.900291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-26c8e126-572c-447e-9d86-3aef06cba7a0 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:12.900987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-26c8e126-572c-447e-9d86-3aef06cba7a0 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] [instance: c9aa5155-4f12-491d-be73-fa6b18ee340b] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:12.907278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26c8e126-572c-447e-9d86-3aef06cba7a0 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:12.907740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26c8e126-572c-447e-9d86-3aef06cba7a0 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:12.908534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26c8e126-572c-447e-9d86-3aef06cba7a0 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:12.908986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26c8e126-572c-447e-9d86-3aef06cba7a0 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:12.923172 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-26c8e126-572c-447e-9d86-3aef06cba7a0 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] HTTP exception thrown: Instance c9aa5155-4f12-491d-be73-fa6b18ee340b could not be found. Jan 22 21:57:12.923797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-26c8e126-572c-447e-9d86-3aef06cba7a0 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] Returning 404 to user: Instance c9aa5155-4f12-491d-be73-fa6b18ee340b could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:57:12.924625 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-26c8e126-572c-447e-9d86-3aef06cba7a0 tempest-ServersAdminNegativeTestJSON-1720793479 tempest-ServersAdminNegativeTestJSON-1720793479-project] 10.222.0.100 "GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b" status: 404 len: 111 microversion: 2.1 time: 0.030120 Jan 22 21:57:12.925197 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4045/8381] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:12 2022] GET /compute/v2.1/servers/c9aa5155-4f12-491d-be73-fa6b18ee340b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:57:16.989876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-451614878", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "606102d4-569f-485e-bb46-a4f526029dc6"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:57:17.039143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] validate_networks() for [('606102d4-569f-485e-bb46-a4f526029dc6', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:57:17.383066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:57:17.383516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:57:17.384018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:57:17.384442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:57:17.384873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:57:17.394553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:17.395026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:17.395865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:17.396326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:17.412810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Getting quotas for project 170db29a8fc941a898b0a603ea2bc165. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:57:17.418217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Getting quotas for user a0413419e2ea44619f03f60657e21889 and project 170db29a8fc941a898b0a603ea2bc165. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:57:17.430167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:57:17.432508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:57:17.550605 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ade7291b-dd37-4632-89f2-f2383cc15c66 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.671389 Jan 22 21:57:17.551220 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4337/8382] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:57:16 2022] POST /compute/v2.1/servers => generated 382 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:57:17.562107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0631ea08-58d9-4ea8-9f6a-302f8c3840da tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:17.562717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0631ea08-58d9-4ea8-9f6a-302f8c3840da tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:17.615695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0631ea08-58d9-4ea8-9f6a-302f8c3840da tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:17.624322 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0631ea08-58d9-4ea8-9f6a-302f8c3840da tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1218 microversion: 2.1 time: 0.066358 Jan 22 21:57:17.624886 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4046/8383] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:17 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:57:18.642309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e3b4d418-f638-4908-a86e-1f09b91ac740 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:18.642866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e3b4d418-f638-4908-a86e-1f09b91ac740 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:18.649640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3b4d418-f638-4908-a86e-1f09b91ac740 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:18.650113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3b4d418-f638-4908-a86e-1f09b91ac740 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:18.650912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3b4d418-f638-4908-a86e-1f09b91ac740 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:18.651367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3b4d418-f638-4908-a86e-1f09b91ac740 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:18.711063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e3b4d418-f638-4908-a86e-1f09b91ac740 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:18.720185 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e3b4d418-f638-4908-a86e-1f09b91ac740 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1222 microversion: 2.1 time: 0.082719 Jan 22 21:57:18.720781 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4338/8384] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:18 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:19.736485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7ff00aaa-e9f2-43bb-af3b-07cf26b4f4df tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:19.741560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7ff00aaa-e9f2-43bb-af3b-07cf26b4f4df tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:19.744174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ff00aaa-e9f2-43bb-af3b-07cf26b4f4df tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:19.744634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ff00aaa-e9f2-43bb-af3b-07cf26b4f4df tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:19.746114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ff00aaa-e9f2-43bb-af3b-07cf26b4f4df tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:19.746861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ff00aaa-e9f2-43bb-af3b-07cf26b4f4df tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:19.810059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7ff00aaa-e9f2-43bb-af3b-07cf26b4f4df tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:19.820694 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7ff00aaa-e9f2-43bb-af3b-07cf26b4f4df tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1278 microversion: 2.1 time: 0.087888 Jan 22 21:57:19.831364 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4047/8385] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:19 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:20.841302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e8894d01-b35f-4ffa-9088-cccf179cc357 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:20.841937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e8894d01-b35f-4ffa-9088-cccf179cc357 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:20.851444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8894d01-b35f-4ffa-9088-cccf179cc357 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:20.852762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8894d01-b35f-4ffa-9088-cccf179cc357 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:20.855184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8894d01-b35f-4ffa-9088-cccf179cc357 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:20.855501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e8894d01-b35f-4ffa-9088-cccf179cc357 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:21.069804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e8894d01-b35f-4ffa-9088-cccf179cc357 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:21.078152 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e8894d01-b35f-4ffa-9088-cccf179cc357 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1318 microversion: 2.1 time: 0.240794 Jan 22 21:57:21.080180 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4339/8386] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:20 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:21.341020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-dc6507b6-c600-44be-b511-469a320e1330 req-d8f83bf2-1f24-404d-b64d-ba3b0df764f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e5c723-031d-4c0b-9acc-1d727a0111ef", "tag": "1e698c2a-3013-497a-81b5-1af94654cff8"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:57:21.342820 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:57:21.342820 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:57:21.350857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-dc6507b6-c600-44be-b511-469a320e1330 req-d8f83bf2-1f24-404d-b64d-ba3b0df764f5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:21.351304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-dc6507b6-c600-44be-b511-469a320e1330 req-d8f83bf2-1f24-404d-b64d-ba3b0df764f5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:21.364218 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-dc6507b6-c600-44be-b511-469a320e1330 req-d8f83bf2-1f24-404d-b64d-ba3b0df764f5 service nova] Creating event network-changed:1e698c2a-3013-497a-81b5-1af94654cff8 for instance 04e5c723-031d-4c0b-9acc-1d727a0111ef on nch2-master-1 Jan 22 21:57:21.369122 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-dc6507b6-c600-44be-b511-469a320e1330 req-d8f83bf2-1f24-404d-b64d-ba3b0df764f5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032508 Jan 22 21:57:21.369778 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4048/8387] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:57:22.096029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e683993c-25e6-47f2-8165-4d9c1e5da724 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:22.096658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e683993c-25e6-47f2-8165-4d9c1e5da724 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:22.103772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e683993c-25e6-47f2-8165-4d9c1e5da724 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:22.104238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e683993c-25e6-47f2-8165-4d9c1e5da724 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:22.105094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e683993c-25e6-47f2-8165-4d9c1e5da724 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:22.105572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e683993c-25e6-47f2-8165-4d9c1e5da724 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:22.438251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e683993c-25e6-47f2-8165-4d9c1e5da724 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:22.445911 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e683993c-25e6-47f2-8165-4d9c1e5da724 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1318 microversion: 2.1 time: 0.353587 Jan 22 21:57:22.446528 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4340/8388] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:22 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:23.469158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-12fe0018-017e-4425-b49b-5fa76712e936 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:23.469904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-12fe0018-017e-4425-b49b-5fa76712e936 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:23.476937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12fe0018-017e-4425-b49b-5fa76712e936 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:23.477398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12fe0018-017e-4425-b49b-5fa76712e936 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:23.478218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12fe0018-017e-4425-b49b-5fa76712e936 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:23.478668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12fe0018-017e-4425-b49b-5fa76712e936 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:23.613689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-12fe0018-017e-4425-b49b-5fa76712e936 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:23.622102 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-12fe0018-017e-4425-b49b-5fa76712e936 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1318 microversion: 2.1 time: 0.157960 Jan 22 21:57:23.623249 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4049/8389] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:23 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:24.640511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-377682b9-9c53-4f94-9798-f831a91523f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:24.641086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-377682b9-9c53-4f94-9798-f831a91523f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:24.648146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-377682b9-9c53-4f94-9798-f831a91523f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:24.648619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-377682b9-9c53-4f94-9798-f831a91523f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:24.649415 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-377682b9-9c53-4f94-9798-f831a91523f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:24.649899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-377682b9-9c53-4f94-9798-f831a91523f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:24.780535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-377682b9-9c53-4f94-9798-f831a91523f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:24.787874 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-377682b9-9c53-4f94-9798-f831a91523f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1318 microversion: 2.1 time: 0.151981 Jan 22 21:57:24.788452 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4341/8390] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:24 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:25.805103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1a13fa35-d247-4372-bd68-b9a5e4434678 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:25.805744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1a13fa35-d247-4372-bd68-b9a5e4434678 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:25.813120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a13fa35-d247-4372-bd68-b9a5e4434678 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:25.813605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a13fa35-d247-4372-bd68-b9a5e4434678 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:25.814393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a13fa35-d247-4372-bd68-b9a5e4434678 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:25.814840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1a13fa35-d247-4372-bd68-b9a5e4434678 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:25.950807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1a13fa35-d247-4372-bd68-b9a5e4434678 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:25.958371 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1a13fa35-d247-4372-bd68-b9a5e4434678 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1318 microversion: 2.1 time: 0.156953 Jan 22 21:57:25.959029 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4050/8391] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:25 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:26.976397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bcf7c9d5-75cf-4c5d-8dd2-b20515eceef1 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:26.977028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bcf7c9d5-75cf-4c5d-8dd2-b20515eceef1 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:26.984528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcf7c9d5-75cf-4c5d-8dd2-b20515eceef1 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:26.985004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcf7c9d5-75cf-4c5d-8dd2-b20515eceef1 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:26.985839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcf7c9d5-75cf-4c5d-8dd2-b20515eceef1 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:26.986308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bcf7c9d5-75cf-4c5d-8dd2-b20515eceef1 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:27.119337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bcf7c9d5-75cf-4c5d-8dd2-b20515eceef1 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:27.127135 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bcf7c9d5-75cf-4c5d-8dd2-b20515eceef1 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1318 microversion: 2.1 time: 0.154559 Jan 22 21:57:27.127716 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4342/8392] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:26 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:28.076396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-de47b62a-b463-40bc-aacc-4c7e18d223c0 req-44b06aa5-58f1-4652-9eaa-e4d7d2f32ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e5c723-031d-4c0b-9acc-1d727a0111ef", "name": "network-vif-plugged", "status": "completed", "tag": "1e698c2a-3013-497a-81b5-1af94654cff8"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:57:28.078100 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:57:28.078100 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:57:28.085833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-de47b62a-b463-40bc-aacc-4c7e18d223c0 req-44b06aa5-58f1-4652-9eaa-e4d7d2f32ac9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:28.086285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-de47b62a-b463-40bc-aacc-4c7e18d223c0 req-44b06aa5-58f1-4652-9eaa-e4d7d2f32ac9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:28.098094 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-de47b62a-b463-40bc-aacc-4c7e18d223c0 req-44b06aa5-58f1-4652-9eaa-e4d7d2f32ac9 service nova] Creating event network-vif-plugged:1e698c2a-3013-497a-81b5-1af94654cff8 for instance 04e5c723-031d-4c0b-9acc-1d727a0111ef on nch2-master-1 Jan 22 21:57:28.102869 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-de47b62a-b463-40bc-aacc-4c7e18d223c0 req-44b06aa5-58f1-4652-9eaa-e4d7d2f32ac9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031199 Jan 22 21:57:28.103462 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4051/8393] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:57:28.145348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-307a7a1d-1b33-4e58-a084-c86792757b9f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:28.146324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-307a7a1d-1b33-4e58-a084-c86792757b9f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:28.155881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-307a7a1d-1b33-4e58-a084-c86792757b9f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:28.156386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-307a7a1d-1b33-4e58-a084-c86792757b9f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:28.157184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-307a7a1d-1b33-4e58-a084-c86792757b9f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:28.157679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-307a7a1d-1b33-4e58-a084-c86792757b9f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:28.329458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-307a7a1d-1b33-4e58-a084-c86792757b9f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:28.336995 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-307a7a1d-1b33-4e58-a084-c86792757b9f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1318 microversion: 2.1 time: 0.195734 Jan 22 21:57:28.340473 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4343/8394] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:28 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:29.355901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d3183a5f-54d1-4d7f-b50a-29f53626b4b7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:29.356593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d3183a5f-54d1-4d7f-b50a-29f53626b4b7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:29.362940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3183a5f-54d1-4d7f-b50a-29f53626b4b7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:29.363392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3183a5f-54d1-4d7f-b50a-29f53626b4b7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:29.364172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3183a5f-54d1-4d7f-b50a-29f53626b4b7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:29.364609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3183a5f-54d1-4d7f-b50a-29f53626b4b7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:29.508528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d3183a5f-54d1-4d7f-b50a-29f53626b4b7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:29.516314 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d3183a5f-54d1-4d7f-b50a-29f53626b4b7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1318 microversion: 2.1 time: 0.166045 Jan 22 21:57:29.516903 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4052/8395] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:29 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:30.535888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-639489d5-0903-49c6-b5d0-632ee29d3934 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:30.536527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-639489d5-0903-49c6-b5d0-632ee29d3934 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:30.543461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-639489d5-0903-49c6-b5d0-632ee29d3934 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:30.543942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-639489d5-0903-49c6-b5d0-632ee29d3934 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:30.544760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-639489d5-0903-49c6-b5d0-632ee29d3934 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:30.545225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-639489d5-0903-49c6-b5d0-632ee29d3934 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:30.678342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-639489d5-0903-49c6-b5d0-632ee29d3934 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:30.685871 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-639489d5-0903-49c6-b5d0-632ee29d3934 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1504 microversion: 2.1 time: 0.155322 Jan 22 21:57:30.686459 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4344/8396] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:30 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:30.703020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-80b5ccb6-214c-499c-b34c-43b9cdd939f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:57:30.703979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-80b5ccb6-214c-499c-b34c-43b9cdd939f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:30.710713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80b5ccb6-214c-499c-b34c-43b9cdd939f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:30.711170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80b5ccb6-214c-499c-b34c-43b9cdd939f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:30.711960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80b5ccb6-214c-499c-b34c-43b9cdd939f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:30.712407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-80b5ccb6-214c-499c-b34c-43b9cdd939f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:30.741121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-80b5ccb6-214c-499c-b34c-43b9cdd939f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:30.749311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-80b5ccb6-214c-499c-b34c-43b9cdd939f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Old instance type m1.heat2, new instance type m1.heat {{(pid=137033) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 21:57:30.756431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-80b5ccb6-214c-499c-b34c-43b9cdd939f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:57:30.756711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-80b5ccb6-214c-499c-b34c-43b9cdd939f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:57:30.757194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-80b5ccb6-214c-499c-b34c-43b9cdd939f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:57:30.757635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-80b5ccb6-214c-499c-b34c-43b9cdd939f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:57:30.758052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-80b5ccb6-214c-499c-b34c-43b9cdd939f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:57:31.084728 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-80b5ccb6-214c-499c-b34c-43b9cdd939f5 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "POST /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef/action" status: 202 len: 0 microversion: 2.1 time: 0.385034 Jan 22 21:57:31.088368 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4053/8397] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:57:30 2022] POST /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:57:31.094478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d866089f-82ec-46f0-97a3-136676d2770f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:31.095112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d866089f-82ec-46f0-97a3-136676d2770f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:31.101149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d866089f-82ec-46f0-97a3-136676d2770f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:31.101662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d866089f-82ec-46f0-97a3-136676d2770f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:31.102488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d866089f-82ec-46f0-97a3-136676d2770f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:31.102947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d866089f-82ec-46f0-97a3-136676d2770f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:31.235172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d866089f-82ec-46f0-97a3-136676d2770f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:31.242672 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d866089f-82ec-46f0-97a3-136676d2770f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1513 microversion: 2.1 time: 0.152198 Jan 22 21:57:31.243271 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4345/8398] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:31 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:57:32.260166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-619b2298-b7d6-48df-b4f2-420aaa12eb30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:32.261521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-619b2298-b7d6-48df-b4f2-420aaa12eb30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:32.268392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-619b2298-b7d6-48df-b4f2-420aaa12eb30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:32.268861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-619b2298-b7d6-48df-b4f2-420aaa12eb30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:32.269935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-619b2298-b7d6-48df-b4f2-420aaa12eb30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:32.270391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-619b2298-b7d6-48df-b4f2-420aaa12eb30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:32.410221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-619b2298-b7d6-48df-b4f2-420aaa12eb30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:32.417832 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-619b2298-b7d6-48df-b4f2-420aaa12eb30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1513 microversion: 2.1 time: 0.161401 Jan 22 21:57:32.418420 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4054/8399] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:32 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:33.434634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-777bf7b2-5a1a-46ce-83ce-1e44ffc806d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:33.435264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-777bf7b2-5a1a-46ce-83ce-1e44ffc806d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:33.442167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-777bf7b2-5a1a-46ce-83ce-1e44ffc806d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:33.442634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-777bf7b2-5a1a-46ce-83ce-1e44ffc806d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:33.443450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-777bf7b2-5a1a-46ce-83ce-1e44ffc806d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:33.443904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-777bf7b2-5a1a-46ce-83ce-1e44ffc806d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:33.676523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-777bf7b2-5a1a-46ce-83ce-1e44ffc806d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:33.685081 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-777bf7b2-5a1a-46ce-83ce-1e44ffc806d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1513 microversion: 2.1 time: 0.254338 Jan 22 21:57:33.685768 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4346/8400] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:33 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:34.701959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9bb67317-0d7f-4ebc-8f23-7cfa6f767042 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:34.702546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9bb67317-0d7f-4ebc-8f23-7cfa6f767042 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:34.709180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bb67317-0d7f-4ebc-8f23-7cfa6f767042 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:34.709742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bb67317-0d7f-4ebc-8f23-7cfa6f767042 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:34.710526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bb67317-0d7f-4ebc-8f23-7cfa6f767042 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:34.710966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bb67317-0d7f-4ebc-8f23-7cfa6f767042 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:34.842869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9bb67317-0d7f-4ebc-8f23-7cfa6f767042 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:34.850289 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9bb67317-0d7f-4ebc-8f23-7cfa6f767042 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.152139 Jan 22 21:57:34.850868 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4055/8401] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:34 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:35.868167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-358d72bd-ade4-4fd0-a07c-51f39881d5c0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:35.868799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-358d72bd-ade4-4fd0-a07c-51f39881d5c0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:35.875907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-358d72bd-ade4-4fd0-a07c-51f39881d5c0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:35.876412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-358d72bd-ade4-4fd0-a07c-51f39881d5c0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:35.877222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-358d72bd-ade4-4fd0-a07c-51f39881d5c0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:35.877725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-358d72bd-ade4-4fd0-a07c-51f39881d5c0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:36.010019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-358d72bd-ade4-4fd0-a07c-51f39881d5c0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:36.019337 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-358d72bd-ade4-4fd0-a07c-51f39881d5c0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.154676 Jan 22 21:57:36.020192 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4347/8402] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:35 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:37.037305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ac94507c-f40c-404c-bb5d-2da7da00b660 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:37.037976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ac94507c-f40c-404c-bb5d-2da7da00b660 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:37.045400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac94507c-f40c-404c-bb5d-2da7da00b660 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:37.045874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac94507c-f40c-404c-bb5d-2da7da00b660 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:37.046668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac94507c-f40c-404c-bb5d-2da7da00b660 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:37.047175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac94507c-f40c-404c-bb5d-2da7da00b660 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:37.178256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ac94507c-f40c-404c-bb5d-2da7da00b660 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:37.186436 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ac94507c-f40c-404c-bb5d-2da7da00b660 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.152852 Jan 22 21:57:37.187112 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4056/8403] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:37 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:38.204043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-790200ad-8291-4597-9251-cae934e062d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:38.204662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-790200ad-8291-4597-9251-cae934e062d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:38.211470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-790200ad-8291-4597-9251-cae934e062d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:38.211939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-790200ad-8291-4597-9251-cae934e062d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:38.212748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-790200ad-8291-4597-9251-cae934e062d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:38.213300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-790200ad-8291-4597-9251-cae934e062d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:38.347587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-790200ad-8291-4597-9251-cae934e062d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:38.351688 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-790200ad-8291-4597-9251-cae934e062d6 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.151823 Jan 22 21:57:38.352264 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4348/8404] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:38 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:39.368763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7a0453bb-70d6-49ef-8de1-1c602e1c28e2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:39.369420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7a0453bb-70d6-49ef-8de1-1c602e1c28e2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:39.376861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a0453bb-70d6-49ef-8de1-1c602e1c28e2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:39.377329 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a0453bb-70d6-49ef-8de1-1c602e1c28e2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:39.378310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a0453bb-70d6-49ef-8de1-1c602e1c28e2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:39.378759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a0453bb-70d6-49ef-8de1-1c602e1c28e2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:39.525077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7a0453bb-70d6-49ef-8de1-1c602e1c28e2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:39.532862 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7a0453bb-70d6-49ef-8de1-1c602e1c28e2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.167808 Jan 22 21:57:39.533477 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4057/8405] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:39 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:40.550204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d5ea6017-91d2-4504-af82-83ff7fb96816 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:40.550844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d5ea6017-91d2-4504-af82-83ff7fb96816 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:40.557648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5ea6017-91d2-4504-af82-83ff7fb96816 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:40.558123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5ea6017-91d2-4504-af82-83ff7fb96816 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:40.558939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5ea6017-91d2-4504-af82-83ff7fb96816 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:40.559402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5ea6017-91d2-4504-af82-83ff7fb96816 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:40.693774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d5ea6017-91d2-4504-af82-83ff7fb96816 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:40.701200 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d5ea6017-91d2-4504-af82-83ff7fb96816 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.154738 Jan 22 21:57:40.701794 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4349/8406] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:40 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:41.718418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5d8eaba1-70fa-460f-a808-99e157894df8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:41.718970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5d8eaba1-70fa-460f-a808-99e157894df8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:41.724969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d8eaba1-70fa-460f-a808-99e157894df8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:41.725420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d8eaba1-70fa-460f-a808-99e157894df8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:41.726227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d8eaba1-70fa-460f-a808-99e157894df8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:41.726666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d8eaba1-70fa-460f-a808-99e157894df8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:41.854537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5d8eaba1-70fa-460f-a808-99e157894df8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:41.862549 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5d8eaba1-70fa-460f-a808-99e157894df8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.148113 Jan 22 21:57:41.863129 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4058/8407] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:41 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:42.880197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fe228669-915f-49ca-926d-d0d6682cef30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:42.880825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fe228669-915f-49ca-926d-d0d6682cef30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:42.888535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe228669-915f-49ca-926d-d0d6682cef30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:42.889004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe228669-915f-49ca-926d-d0d6682cef30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:42.889867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe228669-915f-49ca-926d-d0d6682cef30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:42.890326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fe228669-915f-49ca-926d-d0d6682cef30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:43.023802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fe228669-915f-49ca-926d-d0d6682cef30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:43.031672 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fe228669-915f-49ca-926d-d0d6682cef30 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.155210 Jan 22 21:57:43.032246 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4350/8408] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:42 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:44.048536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-931087b3-0dcc-413d-9fa8-222086356ecb tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:44.049149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-931087b3-0dcc-413d-9fa8-222086356ecb tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:44.055892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-931087b3-0dcc-413d-9fa8-222086356ecb tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:44.056344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-931087b3-0dcc-413d-9fa8-222086356ecb tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:44.057127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-931087b3-0dcc-413d-9fa8-222086356ecb tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:44.057596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-931087b3-0dcc-413d-9fa8-222086356ecb tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:44.192618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-931087b3-0dcc-413d-9fa8-222086356ecb tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:44.201020 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-931087b3-0dcc-413d-9fa8-222086356ecb tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.156080 Jan 22 21:57:44.201671 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4059/8409] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:44 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:45.218680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-041360b2-89d2-4ebe-ad4f-55ca27721309 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:45.219311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-041360b2-89d2-4ebe-ad4f-55ca27721309 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:45.226097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-041360b2-89d2-4ebe-ad4f-55ca27721309 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:45.231293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-041360b2-89d2-4ebe-ad4f-55ca27721309 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:45.231293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-041360b2-89d2-4ebe-ad4f-55ca27721309 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:45.231293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-041360b2-89d2-4ebe-ad4f-55ca27721309 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:45.361230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-041360b2-89d2-4ebe-ad4f-55ca27721309 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:45.368720 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-041360b2-89d2-4ebe-ad4f-55ca27721309 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.154319 Jan 22 21:57:45.371155 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4351/8410] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:45 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:46.387004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9c45ff62-fe25-4af4-9c5a-0c73452a81f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:46.387655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9c45ff62-fe25-4af4-9c5a-0c73452a81f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:46.394690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c45ff62-fe25-4af4-9c5a-0c73452a81f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:46.395696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c45ff62-fe25-4af4-9c5a-0c73452a81f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:46.395992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c45ff62-fe25-4af4-9c5a-0c73452a81f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:46.396447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9c45ff62-fe25-4af4-9c5a-0c73452a81f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:46.527608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9c45ff62-fe25-4af4-9c5a-0c73452a81f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:46.535932 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9c45ff62-fe25-4af4-9c5a-0c73452a81f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.152687 Jan 22 21:57:46.536504 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4060/8411] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:46 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:47.553578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e573fbb1-3874-4786-8a0c-2cf46a232d74 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:47.554280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e573fbb1-3874-4786-8a0c-2cf46a232d74 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:47.562132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e573fbb1-3874-4786-8a0c-2cf46a232d74 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:47.562633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e573fbb1-3874-4786-8a0c-2cf46a232d74 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:47.563440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e573fbb1-3874-4786-8a0c-2cf46a232d74 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:47.563897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e573fbb1-3874-4786-8a0c-2cf46a232d74 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:47.698378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e573fbb1-3874-4786-8a0c-2cf46a232d74 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:47.706107 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e573fbb1-3874-4786-8a0c-2cf46a232d74 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.156246 Jan 22 21:57:47.706692 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4352/8412] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:47 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:48.723196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bdc14114-782d-4ea9-932d-1a77708af8c2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:48.723751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bdc14114-782d-4ea9-932d-1a77708af8c2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:48.730555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdc14114-782d-4ea9-932d-1a77708af8c2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:48.731018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdc14114-782d-4ea9-932d-1a77708af8c2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:48.732547 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdc14114-782d-4ea9-932d-1a77708af8c2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:48.732995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bdc14114-782d-4ea9-932d-1a77708af8c2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:48.861729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bdc14114-782d-4ea9-932d-1a77708af8c2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:48.869154 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bdc14114-782d-4ea9-932d-1a77708af8c2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.149817 Jan 22 21:57:48.869762 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4061/8413] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:48 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:49.887012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5b50137f-7e65-43f3-9128-e4833ade6e88 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:49.887658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5b50137f-7e65-43f3-9128-e4833ade6e88 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:49.894517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b50137f-7e65-43f3-9128-e4833ade6e88 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:49.894977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b50137f-7e65-43f3-9128-e4833ade6e88 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:49.895777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b50137f-7e65-43f3-9128-e4833ade6e88 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:49.896238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b50137f-7e65-43f3-9128-e4833ade6e88 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:50.026951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5b50137f-7e65-43f3-9128-e4833ade6e88 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:50.035342 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5b50137f-7e65-43f3-9128-e4833ade6e88 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.152041 Jan 22 21:57:50.035930 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4353/8414] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:49 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:51.052252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f68e10de-e13a-47a5-8a55-2ae410662bab tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:51.052861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f68e10de-e13a-47a5-8a55-2ae410662bab tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:51.059797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f68e10de-e13a-47a5-8a55-2ae410662bab tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:51.060332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f68e10de-e13a-47a5-8a55-2ae410662bab tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:51.061116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f68e10de-e13a-47a5-8a55-2ae410662bab tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:51.061583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f68e10de-e13a-47a5-8a55-2ae410662bab tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:51.196735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f68e10de-e13a-47a5-8a55-2ae410662bab tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:51.204564 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f68e10de-e13a-47a5-8a55-2ae410662bab tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.156028 Jan 22 21:57:51.205170 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4062/8415] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:51 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:52.222178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4407dca4-eeef-4917-8175-e074f466cae7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:52.222829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4407dca4-eeef-4917-8175-e074f466cae7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:52.229663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4407dca4-eeef-4917-8175-e074f466cae7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:52.230137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4407dca4-eeef-4917-8175-e074f466cae7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:52.230943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4407dca4-eeef-4917-8175-e074f466cae7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:52.231636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4407dca4-eeef-4917-8175-e074f466cae7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:52.424845 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4407dca4-eeef-4917-8175-e074f466cae7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:52.432823 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4407dca4-eeef-4917-8175-e074f466cae7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.214308 Jan 22 21:57:52.433400 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4354/8416] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:52 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:53.449334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b2441f21-4458-426f-888c-72e8a146b933 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:53.450236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b2441f21-4458-426f-888c-72e8a146b933 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:53.456727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2441f21-4458-426f-888c-72e8a146b933 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:53.457173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2441f21-4458-426f-888c-72e8a146b933 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:53.457985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2441f21-4458-426f-888c-72e8a146b933 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:53.458426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2441f21-4458-426f-888c-72e8a146b933 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:53.624742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b2441f21-4458-426f-888c-72e8a146b933 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:53.632184 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b2441f21-4458-426f-888c-72e8a146b933 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.186539 Jan 22 21:57:53.632755 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4063/8417] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:53 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:54.649555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7c2b10b0-bf5f-440a-8c42-7e6dabc56d9e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:54.650219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7c2b10b0-bf5f-440a-8c42-7e6dabc56d9e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:54.658167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c2b10b0-bf5f-440a-8c42-7e6dabc56d9e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:54.658645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c2b10b0-bf5f-440a-8c42-7e6dabc56d9e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:54.659462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c2b10b0-bf5f-440a-8c42-7e6dabc56d9e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:54.659922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c2b10b0-bf5f-440a-8c42-7e6dabc56d9e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:54.880732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7c2b10b0-bf5f-440a-8c42-7e6dabc56d9e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:54.888433 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7c2b10b0-bf5f-440a-8c42-7e6dabc56d9e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.242805 Jan 22 21:57:54.889014 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4355/8418] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:54 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:55.905904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4201412b-4a20-49fb-82be-1080996684a2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:55.906541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4201412b-4a20-49fb-82be-1080996684a2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:55.913261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4201412b-4a20-49fb-82be-1080996684a2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:55.913757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4201412b-4a20-49fb-82be-1080996684a2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:55.914531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4201412b-4a20-49fb-82be-1080996684a2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:55.914975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4201412b-4a20-49fb-82be-1080996684a2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:56.135264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4201412b-4a20-49fb-82be-1080996684a2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:56.143338 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4201412b-4a20-49fb-82be-1080996684a2 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.241838 Jan 22 21:57:56.143934 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4064/8419] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:55 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:57.159372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8ae61f12-7482-4fc9-bb61-901819e3955e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:57.160003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8ae61f12-7482-4fc9-bb61-901819e3955e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:57.166828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ae61f12-7482-4fc9-bb61-901819e3955e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:57.167337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ae61f12-7482-4fc9-bb61-901819e3955e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:57.168160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ae61f12-7482-4fc9-bb61-901819e3955e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:57.168649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ae61f12-7482-4fc9-bb61-901819e3955e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:57.299332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8ae61f12-7482-4fc9-bb61-901819e3955e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:57.306672 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8ae61f12-7482-4fc9-bb61-901819e3955e tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.151054 Jan 22 21:57:57.307245 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4356/8420] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:57 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:58.324026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7ce0e543-a522-4a93-9292-a1088e606fcf tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:58.325156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7ce0e543-a522-4a93-9292-a1088e606fcf tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:58.332306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ce0e543-a522-4a93-9292-a1088e606fcf tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:58.332767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ce0e543-a522-4a93-9292-a1088e606fcf tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:58.333578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ce0e543-a522-4a93-9292-a1088e606fcf tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:58.334028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7ce0e543-a522-4a93-9292-a1088e606fcf tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:58.466878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7ce0e543-a522-4a93-9292-a1088e606fcf tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:58.474357 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7ce0e543-a522-4a93-9292-a1088e606fcf tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.154045 Jan 22 21:57:58.474930 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4065/8421] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:58 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:57:59.491033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-45e90fe7-c038-4b0f-8092-6faa63b05df0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:57:59.491655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-45e90fe7-c038-4b0f-8092-6faa63b05df0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:57:59.499920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45e90fe7-c038-4b0f-8092-6faa63b05df0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:59.500395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45e90fe7-c038-4b0f-8092-6faa63b05df0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:59.501191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45e90fe7-c038-4b0f-8092-6faa63b05df0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:57:59.501673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45e90fe7-c038-4b0f-8092-6faa63b05df0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:57:59.637574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-45e90fe7-c038-4b0f-8092-6faa63b05df0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:57:59.645217 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-45e90fe7-c038-4b0f-8092-6faa63b05df0 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.157823 Jan 22 21:57:59.645769 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4357/8422] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:57:59 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:00.662018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0774b46c-e60d-4f2a-9338-2abe7496246f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:00.662575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0774b46c-e60d-4f2a-9338-2abe7496246f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:00.669352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0774b46c-e60d-4f2a-9338-2abe7496246f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:00.669891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0774b46c-e60d-4f2a-9338-2abe7496246f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:00.670670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0774b46c-e60d-4f2a-9338-2abe7496246f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:00.671109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0774b46c-e60d-4f2a-9338-2abe7496246f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:00.808561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0774b46c-e60d-4f2a-9338-2abe7496246f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:00.816909 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0774b46c-e60d-4f2a-9338-2abe7496246f tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1518 microversion: 2.1 time: 0.158671 Jan 22 21:58:00.817832 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4066/8423] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:00 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:01.834959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3012a973-08d3-44d0-8dfa-6668f9a9127a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:01.835611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3012a973-08d3-44d0-8dfa-6668f9a9127a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:01.842606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3012a973-08d3-44d0-8dfa-6668f9a9127a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:01.843072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3012a973-08d3-44d0-8dfa-6668f9a9127a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:01.843892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3012a973-08d3-44d0-8dfa-6668f9a9127a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:01.844344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3012a973-08d3-44d0-8dfa-6668f9a9127a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:01.988241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3012a973-08d3-44d0-8dfa-6668f9a9127a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:01.996243 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3012a973-08d3-44d0-8dfa-6668f9a9127a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1517 microversion: 2.1 time: 0.164922 Jan 22 21:58:01.996838 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4358/8424] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:01 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:02.537891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-fafec3bc-3529-4083-8925-4b07c8e7939a req-62afeb78-973b-40d6-aed6-22cde22353b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e5c723-031d-4c0b-9acc-1d727a0111ef", "name": "network-vif-unplugged", "status": "completed", "tag": "1e698c2a-3013-497a-81b5-1af94654cff8"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:58:02.540051 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:58:02.540051 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:58:02.548671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fafec3bc-3529-4083-8925-4b07c8e7939a req-62afeb78-973b-40d6-aed6-22cde22353b1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:02.549150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fafec3bc-3529-4083-8925-4b07c8e7939a req-62afeb78-973b-40d6-aed6-22cde22353b1 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:02.560950 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-fafec3bc-3529-4083-8925-4b07c8e7939a req-62afeb78-973b-40d6-aed6-22cde22353b1 service nova] Creating event network-vif-unplugged:1e698c2a-3013-497a-81b5-1af94654cff8 for instance 04e5c723-031d-4c0b-9acc-1d727a0111ef on nch1-master-1 Jan 22 21:58:02.566403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-fafec3bc-3529-4083-8925-4b07c8e7939a req-62afeb78-973b-40d6-aed6-22cde22353b1 service nova] Instance 04e5c723-031d-4c0b-9acc-1d727a0111ef is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:58:02.578010 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-fafec3bc-3529-4083-8925-4b07c8e7939a req-62afeb78-973b-40d6-aed6-22cde22353b1 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043877 Jan 22 21:58:02.578662 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4067/8425] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:58:03.014953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d7f2fa84-8853-4710-9786-b211afdab3f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:03.015574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d7f2fa84-8853-4710-9786-b211afdab3f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:03.022537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7f2fa84-8853-4710-9786-b211afdab3f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:03.023006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7f2fa84-8853-4710-9786-b211afdab3f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:03.024006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7f2fa84-8853-4710-9786-b211afdab3f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:03.024696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7f2fa84-8853-4710-9786-b211afdab3f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:03.157772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d7f2fa84-8853-4710-9786-b211afdab3f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:03.165244 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d7f2fa84-8853-4710-9786-b211afdab3f7 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1517 microversion: 2.1 time: 0.154108 Jan 22 21:58:03.165855 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4359/8426] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:03 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:04.184959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f7c30cd4-d8d6-4b97-97a4-06f32f72dd35 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:04.185741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f7c30cd4-d8d6-4b97-97a4-06f32f72dd35 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:04.191977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7c30cd4-d8d6-4b97-97a4-06f32f72dd35 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:04.192459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7c30cd4-d8d6-4b97-97a4-06f32f72dd35 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:04.193235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7c30cd4-d8d6-4b97-97a4-06f32f72dd35 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:04.193717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7c30cd4-d8d6-4b97-97a4-06f32f72dd35 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:04.332587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f7c30cd4-d8d6-4b97-97a4-06f32f72dd35 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:04.336748 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f7c30cd4-d8d6-4b97-97a4-06f32f72dd35 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1515 microversion: 2.1 time: 0.156925 Jan 22 21:58:04.337354 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4068/8427] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:04 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:04.592431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-49036f2e-daba-43a0-b628-148212b7a974 req-713ababa-d5fc-4d21-b191-bcfbe8e0ad04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e5c723-031d-4c0b-9acc-1d727a0111ef", "tag": "1e698c2a-3013-497a-81b5-1af94654cff8"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:58:04.594066 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:58:04.594066 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:58:04.601754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-49036f2e-daba-43a0-b628-148212b7a974 req-713ababa-d5fc-4d21-b191-bcfbe8e0ad04 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:04.602212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-49036f2e-daba-43a0-b628-148212b7a974 req-713ababa-d5fc-4d21-b191-bcfbe8e0ad04 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:04.613540 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-49036f2e-daba-43a0-b628-148212b7a974 req-713ababa-d5fc-4d21-b191-bcfbe8e0ad04 service nova] Creating event network-changed:1e698c2a-3013-497a-81b5-1af94654cff8 for instance 04e5c723-031d-4c0b-9acc-1d727a0111ef on nch1-master-1 Jan 22 21:58:04.618694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-49036f2e-daba-43a0-b628-148212b7a974 req-713ababa-d5fc-4d21-b191-bcfbe8e0ad04 service nova] Instance 04e5c723-031d-4c0b-9acc-1d727a0111ef is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:58:04.630132 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-49036f2e-daba-43a0-b628-148212b7a974 req-713ababa-d5fc-4d21-b191-bcfbe8e0ad04 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041427 Jan 22 21:58:04.630720 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4360/8428] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:58:05.354993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b1de4feb-366e-4557-a4b1-6324f1cbb0da tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:05.355651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b1de4feb-366e-4557-a4b1-6324f1cbb0da tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:05.367310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1de4feb-366e-4557-a4b1-6324f1cbb0da tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:05.367310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1de4feb-366e-4557-a4b1-6324f1cbb0da tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:05.367310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1de4feb-366e-4557-a4b1-6324f1cbb0da tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:05.367310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1de4feb-366e-4557-a4b1-6324f1cbb0da tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:05.500633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b1de4feb-366e-4557-a4b1-6324f1cbb0da tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:05.508414 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b1de4feb-366e-4557-a4b1-6324f1cbb0da tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1515 microversion: 2.1 time: 0.157186 Jan 22 21:58:05.509187 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4069/8429] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:05 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:06.527493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f91dd8c7-554f-47af-8db6-4bc615883565 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:06.528215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f91dd8c7-554f-47af-8db6-4bc615883565 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:06.534592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f91dd8c7-554f-47af-8db6-4bc615883565 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:06.535079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f91dd8c7-554f-47af-8db6-4bc615883565 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:06.535915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f91dd8c7-554f-47af-8db6-4bc615883565 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:06.536376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f91dd8c7-554f-47af-8db6-4bc615883565 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:06.672037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f91dd8c7-554f-47af-8db6-4bc615883565 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:06.679546 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f91dd8c7-554f-47af-8db6-4bc615883565 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1512 microversion: 2.1 time: 0.157089 Jan 22 21:58:06.680116 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4361/8430] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:06 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:06.695750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b20ae5bd-3dd9-4716-9364-05a5e1fb7d79 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:06.696286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b20ae5bd-3dd9-4716-9364-05a5e1fb7d79 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:06.703357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b20ae5bd-3dd9-4716-9364-05a5e1fb7d79 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:06.703816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b20ae5bd-3dd9-4716-9364-05a5e1fb7d79 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:06.704606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b20ae5bd-3dd9-4716-9364-05a5e1fb7d79 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:06.705052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b20ae5bd-3dd9-4716-9364-05a5e1fb7d79 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:06.734368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b20ae5bd-3dd9-4716-9364-05a5e1fb7d79 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:58:06.835719 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.compute.api [None req-b20ae5bd-3dd9-4716-9364-05a5e1fb7d79 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Found an unconfirmed migration during delete, id: 16, status: finished Jan 22 21:58:08.821155 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b20ae5bd-3dd9-4716-9364-05a5e1fb7d79 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "DELETE /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 204 len: 0 microversion: 2.1 time: 2.128845 Jan 22 21:58:08.821875 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4070/8431] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:58:06 2022] DELETE /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 0 bytes in 2130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:58:08.829974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f488b954-ab60-4564-9b98-bbb5249a82e8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:08.830616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f488b954-ab60-4564-9b98-bbb5249a82e8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:08.838352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f488b954-ab60-4564-9b98-bbb5249a82e8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:08.839116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f488b954-ab60-4564-9b98-bbb5249a82e8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:08.840134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f488b954-ab60-4564-9b98-bbb5249a82e8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:08.840612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f488b954-ab60-4564-9b98-bbb5249a82e8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:08.986514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f488b954-ab60-4564-9b98-bbb5249a82e8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:08.994254 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f488b954-ab60-4564-9b98-bbb5249a82e8 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1504 microversion: 2.1 time: 0.168141 Jan 22 21:58:08.994843 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4362/8432] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:08 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:09.117371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-3201da4c-67cc-4418-9175-5b2b9502566a req-f4071b2c-4969-4f26-a41e-dfb02828b158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e5c723-031d-4c0b-9acc-1d727a0111ef", "name": "network-vif-plugged", "status": "completed", "tag": "1e698c2a-3013-497a-81b5-1af94654cff8"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:58:09.119089 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:58:09.119089 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:58:09.127416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3201da4c-67cc-4418-9175-5b2b9502566a req-f4071b2c-4969-4f26-a41e-dfb02828b158 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:09.127874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3201da4c-67cc-4418-9175-5b2b9502566a req-f4071b2c-4969-4f26-a41e-dfb02828b158 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:09.139294 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-3201da4c-67cc-4418-9175-5b2b9502566a req-f4071b2c-4969-4f26-a41e-dfb02828b158 service nova] Creating event network-vif-plugged:1e698c2a-3013-497a-81b5-1af94654cff8 for instance 04e5c723-031d-4c0b-9acc-1d727a0111ef on nch1-master-1 Jan 22 21:58:09.144368 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-3201da4c-67cc-4418-9175-5b2b9502566a req-f4071b2c-4969-4f26-a41e-dfb02828b158 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030890 Jan 22 21:58:09.153219 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4071/8433] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:58:10.012120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bb31d533-be20-41f1-9eea-dbd1afb9b62a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:10.012740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bb31d533-be20-41f1-9eea-dbd1afb9b62a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:10.020091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb31d533-be20-41f1-9eea-dbd1afb9b62a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:10.020558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb31d533-be20-41f1-9eea-dbd1afb9b62a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:10.021367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb31d533-be20-41f1-9eea-dbd1afb9b62a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:10.021853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bb31d533-be20-41f1-9eea-dbd1afb9b62a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:10.161859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bb31d533-be20-41f1-9eea-dbd1afb9b62a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:10.169310 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bb31d533-be20-41f1-9eea-dbd1afb9b62a tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1504 microversion: 2.1 time: 0.161011 Jan 22 21:58:10.182330 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4363/8434] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:10 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:10.825451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-29d35e5c-8fcc-42cf-9647-c38140250e14 req-0d6e934d-1b77-4025-81fc-865d578a108c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e5c723-031d-4c0b-9acc-1d727a0111ef", "name": "network-vif-deleted", "tag": "1e698c2a-3013-497a-81b5-1af94654cff8"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:58:10.828228 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:58:10.828228 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:58:10.835443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-29d35e5c-8fcc-42cf-9647-c38140250e14 req-0d6e934d-1b77-4025-81fc-865d578a108c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:10.835880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-29d35e5c-8fcc-42cf-9647-c38140250e14 req-0d6e934d-1b77-4025-81fc-865d578a108c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:10.847276 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-29d35e5c-8fcc-42cf-9647-c38140250e14 req-0d6e934d-1b77-4025-81fc-865d578a108c service nova] Creating event network-vif-deleted:1e698c2a-3013-497a-81b5-1af94654cff8 for instance 04e5c723-031d-4c0b-9acc-1d727a0111ef on nch1-master-1 Jan 22 21:58:10.851874 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-29d35e5c-8fcc-42cf-9647-c38140250e14 req-0d6e934d-1b77-4025-81fc-865d578a108c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031344 Jan 22 21:58:10.852451 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4072/8435] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:58:11.186505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a2676458-a4a9-4760-a4e1-264de1d29272 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:11.187311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a2676458-a4a9-4760-a4e1-264de1d29272 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:11.193616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2676458-a4a9-4760-a4e1-264de1d29272 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:11.194091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2676458-a4a9-4760-a4e1-264de1d29272 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:11.194967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2676458-a4a9-4760-a4e1-264de1d29272 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:11.195423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2676458-a4a9-4760-a4e1-264de1d29272 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:11.227171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2676458-a4a9-4760-a4e1-264de1d29272 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:11.227640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2676458-a4a9-4760-a4e1-264de1d29272 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:11.228106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-a2676458-a4a9-4760-a4e1-264de1d29272 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lazy-loading 'fault' on Instance uuid 04e5c723-031d-4c0b-9acc-1d727a0111ef {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 21:58:11.267875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a2676458-a4a9-4760-a4e1-264de1d29272 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0413419e2ea44619f03f60657e21889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170db29a8fc941a898b0a603ea2bc165', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:11.275396 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a2676458-a4a9-4760-a4e1-264de1d29272 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 200 len: 1308 microversion: 2.1 time: 0.092948 Jan 22 21:58:11.275971 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4364/8436] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:11 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:12.293343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2f4fe44f-8d3d-49d8-9f1c-d1bc967dae19 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:12.294088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2f4fe44f-8d3d-49d8-9f1c-d1bc967dae19 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:12.300280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f4fe44f-8d3d-49d8-9f1c-d1bc967dae19 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:12.300748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f4fe44f-8d3d-49d8-9f1c-d1bc967dae19 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:12.301578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f4fe44f-8d3d-49d8-9f1c-d1bc967dae19 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:12.302035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f4fe44f-8d3d-49d8-9f1c-d1bc967dae19 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:12.315288 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-2f4fe44f-8d3d-49d8-9f1c-d1bc967dae19 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] HTTP exception thrown: Instance 04e5c723-031d-4c0b-9acc-1d727a0111ef could not be found. Jan 22 21:58:12.323854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2f4fe44f-8d3d-49d8-9f1c-d1bc967dae19 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Returning 404 to user: Instance 04e5c723-031d-4c0b-9acc-1d727a0111ef could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:58:12.323854 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2f4fe44f-8d3d-49d8-9f1c-d1bc967dae19 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 404 len: 111 microversion: 2.1 time: 0.028327 Jan 22 21:58:12.323854 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4073/8437] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:12 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 21:58:12.334846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2365e7b5-674d-49cc-a8db-0728ee0c8688 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:12.335624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2365e7b5-674d-49cc-a8db-0728ee0c8688 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:12.343567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2365e7b5-674d-49cc-a8db-0728ee0c8688 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:12.344121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2365e7b5-674d-49cc-a8db-0728ee0c8688 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:12.345024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2365e7b5-674d-49cc-a8db-0728ee0c8688 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:12.345599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2365e7b5-674d-49cc-a8db-0728ee0c8688 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:12.360159 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-2365e7b5-674d-49cc-a8db-0728ee0c8688 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] HTTP exception thrown: Instance 04e5c723-031d-4c0b-9acc-1d727a0111ef could not be found. Jan 22 21:58:12.360768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2365e7b5-674d-49cc-a8db-0728ee0c8688 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Returning 404 to user: Instance 04e5c723-031d-4c0b-9acc-1d727a0111ef could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:58:12.361740 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2365e7b5-674d-49cc-a8db-0728ee0c8688 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "DELETE /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 404 len: 111 microversion: 2.1 time: 0.031650 Jan 22 21:58:12.362283 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4365/8438] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:58:12 2022] DELETE /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:58:12.370337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2d63a9ef-ba23-4209-b4b2-fddddf889870 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:12.370982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2d63a9ef-ba23-4209-b4b2-fddddf889870 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] [instance: 04e5c723-031d-4c0b-9acc-1d727a0111ef] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:12.378131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d63a9ef-ba23-4209-b4b2-fddddf889870 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:12.378593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d63a9ef-ba23-4209-b4b2-fddddf889870 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:12.379394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d63a9ef-ba23-4209-b4b2-fddddf889870 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:12.379848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d63a9ef-ba23-4209-b4b2-fddddf889870 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:12.394254 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-2d63a9ef-ba23-4209-b4b2-fddddf889870 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] HTTP exception thrown: Instance 04e5c723-031d-4c0b-9acc-1d727a0111ef could not be found. Jan 22 21:58:12.394890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2d63a9ef-ba23-4209-b4b2-fddddf889870 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] Returning 404 to user: Instance 04e5c723-031d-4c0b-9acc-1d727a0111ef could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 21:58:12.395779 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2d63a9ef-ba23-4209-b4b2-fddddf889870 tempest-DeleteServersTestJSON-1325754319 tempest-DeleteServersTestJSON-1325754319-project] 10.222.0.100 "GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef" status: 404 len: 111 microversion: 2.1 time: 0.029099 Jan 22 21:58:12.396331 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4074/8439] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:12 2022] GET /compute/v2.1/servers/04e5c723-031d-4c0b-9acc-1d727a0111ef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 21:58:16.056112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1051121596", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "4a1708dd-545c-4a2b-9ad3-956c080f69bf"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:58:16.110238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] validate_networks() for [('4a1708dd-545c-4a2b-9ad3-956c080f69bf', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:58:16.449609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:58:16.450050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:58:16.450569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:58:16.450992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:58:16.451432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:58:16.460986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:16.461550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:16.470921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:16.470921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:16.479542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Getting quotas for project ebad5df743954fcfbcbabe08f9049b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:58:16.484743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Getting quotas for user 2db0a2ad45bb48fdbaf9e0cb2da999ea and project ebad5df743954fcfbcbabe08f9049b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:58:16.496932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:58:16.499425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:58:16.593749 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-76a86fde-9c10-4291-af05-42a6c185e131 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.655975 Jan 22 21:58:16.594358 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4366/8440] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:58:15 2022] POST /compute/v2.1/servers => generated 382 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:58:16.604306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0d503856-7ea1-4e7b-9f4c-5f1ec06f2d29 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:16.604929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0d503856-7ea1-4e7b-9f4c-5f1ec06f2d29 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:16.658932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0d503856-7ea1-4e7b-9f4c-5f1ec06f2d29 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:16.666351 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0d503856-7ea1-4e7b-9f4c-5f1ec06f2d29 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1222 microversion: 2.1 time: 0.065826 Jan 22 21:58:16.666927 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4075/8441] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:16 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1222 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:17.684202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-edd30880-4b92-4a93-965e-79e568ac4a40 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:17.684828 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-edd30880-4b92-4a93-965e-79e568ac4a40 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:17.693190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edd30880-4b92-4a93-965e-79e568ac4a40 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:17.693687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edd30880-4b92-4a93-965e-79e568ac4a40 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:17.694500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edd30880-4b92-4a93-965e-79e568ac4a40 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:17.694958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-edd30880-4b92-4a93-965e-79e568ac4a40 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:17.759802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-edd30880-4b92-4a93-965e-79e568ac4a40 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:17.768041 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-edd30880-4b92-4a93-965e-79e568ac4a40 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1226 microversion: 2.1 time: 0.087731 Jan 22 21:58:17.768610 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4367/8442] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:17 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:18.784961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3a79b270-c399-4020-901c-1403705a52c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:18.785736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3a79b270-c399-4020-901c-1403705a52c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:18.792616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a79b270-c399-4020-901c-1403705a52c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:18.793078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a79b270-c399-4020-901c-1403705a52c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:18.793901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a79b270-c399-4020-901c-1403705a52c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:18.794352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a79b270-c399-4020-901c-1403705a52c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:18.863238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3a79b270-c399-4020-901c-1403705a52c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:18.870752 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3a79b270-c399-4020-901c-1403705a52c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1282 microversion: 2.1 time: 0.090353 Jan 22 21:58:18.871336 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4076/8443] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:18 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:19.893757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-148e3b87-011d-4475-97cd-25f27b09ed5a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:19.894384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-148e3b87-011d-4475-97cd-25f27b09ed5a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:19.901185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-148e3b87-011d-4475-97cd-25f27b09ed5a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:19.901757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-148e3b87-011d-4475-97cd-25f27b09ed5a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:19.902565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-148e3b87-011d-4475-97cd-25f27b09ed5a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:19.903042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-148e3b87-011d-4475-97cd-25f27b09ed5a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:20.044174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-148e3b87-011d-4475-97cd-25f27b09ed5a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:20.052627 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-148e3b87-011d-4475-97cd-25f27b09ed5a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1322 microversion: 2.1 time: 0.162929 Jan 22 21:58:20.053215 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4368/8444] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:19 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:20.294548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-be3c81f5-14ca-4e1b-8358-b7c6c09711ba req-d6c5e38d-f524-4e52-94b1-f36ffad4fa96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32273408-e773-477a-8fff-660c0ad6cff6", "tag": "27eedf5c-82a3-45c1-8b16-86b2c3f44e4e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:58:20.296102 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:58:20.296102 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:58:20.304446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-be3c81f5-14ca-4e1b-8358-b7c6c09711ba req-d6c5e38d-f524-4e52-94b1-f36ffad4fa96 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:20.304899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-be3c81f5-14ca-4e1b-8358-b7c6c09711ba req-d6c5e38d-f524-4e52-94b1-f36ffad4fa96 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:20.316136 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-be3c81f5-14ca-4e1b-8358-b7c6c09711ba req-d6c5e38d-f524-4e52-94b1-f36ffad4fa96 service nova] Creating event network-changed:27eedf5c-82a3-45c1-8b16-86b2c3f44e4e for instance 32273408-e773-477a-8fff-660c0ad6cff6 on nch1-master-1 Jan 22 21:58:20.320952 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-be3c81f5-14ca-4e1b-8358-b7c6c09711ba req-d6c5e38d-f524-4e52-94b1-f36ffad4fa96 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085190 Jan 22 21:58:20.321589 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4077/8445] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:58:21.071862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-31f4b324-6803-4bb2-b7b4-6138a8fd5995 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:21.072640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-31f4b324-6803-4bb2-b7b4-6138a8fd5995 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:21.080383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31f4b324-6803-4bb2-b7b4-6138a8fd5995 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:21.080855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31f4b324-6803-4bb2-b7b4-6138a8fd5995 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:21.081764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31f4b324-6803-4bb2-b7b4-6138a8fd5995 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:21.082961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31f4b324-6803-4bb2-b7b4-6138a8fd5995 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:21.222197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-31f4b324-6803-4bb2-b7b4-6138a8fd5995 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:21.229568 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-31f4b324-6803-4bb2-b7b4-6138a8fd5995 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1322 microversion: 2.1 time: 0.162343 Jan 22 21:58:21.234402 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4369/8446] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:21 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:22.247572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a2b7963c-278f-4cef-bc40-ae5abf87e08c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:22.248262 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a2b7963c-278f-4cef-bc40-ae5abf87e08c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:22.255172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2b7963c-278f-4cef-bc40-ae5abf87e08c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:22.255614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2b7963c-278f-4cef-bc40-ae5abf87e08c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:22.256392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2b7963c-278f-4cef-bc40-ae5abf87e08c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:22.256831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a2b7963c-278f-4cef-bc40-ae5abf87e08c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:22.403232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a2b7963c-278f-4cef-bc40-ae5abf87e08c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:22.411591 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a2b7963c-278f-4cef-bc40-ae5abf87e08c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1322 microversion: 2.1 time: 0.169003 Jan 22 21:58:22.412195 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4078/8447] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:22 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:23.429561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-85cc2d13-4156-4991-9078-a34a3828b41b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:23.430222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-85cc2d13-4156-4991-9078-a34a3828b41b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:23.438234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85cc2d13-4156-4991-9078-a34a3828b41b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:23.438727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85cc2d13-4156-4991-9078-a34a3828b41b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:23.440147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85cc2d13-4156-4991-9078-a34a3828b41b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:23.440620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85cc2d13-4156-4991-9078-a34a3828b41b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:23.573842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-85cc2d13-4156-4991-9078-a34a3828b41b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:23.581784 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-85cc2d13-4156-4991-9078-a34a3828b41b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1322 microversion: 2.1 time: 0.156149 Jan 22 21:58:23.582392 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4370/8448] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:23 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:58:24.598413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-931d6499-8927-48c3-8f31-2c4ceaa59f0a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:24.599030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-931d6499-8927-48c3-8f31-2c4ceaa59f0a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:24.605807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-931d6499-8927-48c3-8f31-2c4ceaa59f0a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:24.606266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-931d6499-8927-48c3-8f31-2c4ceaa59f0a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:24.607063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-931d6499-8927-48c3-8f31-2c4ceaa59f0a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:24.607509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-931d6499-8927-48c3-8f31-2c4ceaa59f0a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:24.736311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-931d6499-8927-48c3-8f31-2c4ceaa59f0a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:24.743782 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-931d6499-8927-48c3-8f31-2c4ceaa59f0a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1322 microversion: 2.1 time: 0.149155 Jan 22 21:58:24.744353 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4079/8449] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:24 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:25.309382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-b692368c-4e8c-47a6-9d21-2f7b3d9892e7 req-1e7a308f-a213-4c52-b9e0-c263eb0f9507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32273408-e773-477a-8fff-660c0ad6cff6", "name": "network-vif-plugged", "status": "completed", "tag": "27eedf5c-82a3-45c1-8b16-86b2c3f44e4e"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:58:25.311028 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:58:25.311028 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:58:25.318164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b692368c-4e8c-47a6-9d21-2f7b3d9892e7 req-1e7a308f-a213-4c52-b9e0-c263eb0f9507 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:25.318620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-b692368c-4e8c-47a6-9d21-2f7b3d9892e7 req-1e7a308f-a213-4c52-b9e0-c263eb0f9507 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:25.330236 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-b692368c-4e8c-47a6-9d21-2f7b3d9892e7 req-1e7a308f-a213-4c52-b9e0-c263eb0f9507 service nova] Creating event network-vif-plugged:27eedf5c-82a3-45c1-8b16-86b2c3f44e4e for instance 32273408-e773-477a-8fff-660c0ad6cff6 on nch1-master-1 Jan 22 21:58:25.335405 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-b692368c-4e8c-47a6-9d21-2f7b3d9892e7 req-1e7a308f-a213-4c52-b9e0-c263eb0f9507 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080551 Jan 22 21:58:25.336002 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4371/8450] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:58:25.762063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cdc70607-1870-4c31-8c7e-ba61bed33e0c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:25.762615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cdc70607-1870-4c31-8c7e-ba61bed33e0c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:25.769834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdc70607-1870-4c31-8c7e-ba61bed33e0c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:25.770290 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdc70607-1870-4c31-8c7e-ba61bed33e0c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:25.771070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdc70607-1870-4c31-8c7e-ba61bed33e0c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:25.771569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdc70607-1870-4c31-8c7e-ba61bed33e0c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:25.913727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cdc70607-1870-4c31-8c7e-ba61bed33e0c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:25.921093 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cdc70607-1870-4c31-8c7e-ba61bed33e0c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1322 microversion: 2.1 time: 0.162783 Jan 22 21:58:25.921693 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4080/8451] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:25 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:26.939725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9a3e3789-1860-4bd8-b562-032c221619a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:26.940517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9a3e3789-1860-4bd8-b562-032c221619a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:26.946711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a3e3789-1860-4bd8-b562-032c221619a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:26.947175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a3e3789-1860-4bd8-b562-032c221619a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:26.947976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a3e3789-1860-4bd8-b562-032c221619a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:26.948431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9a3e3789-1860-4bd8-b562-032c221619a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:27.089580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9a3e3789-1860-4bd8-b562-032c221619a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:27.097307 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9a3e3789-1860-4bd8-b562-032c221619a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1513 microversion: 2.1 time: 0.163017 Jan 22 21:58:27.097905 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4372/8452] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:26 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:27.115727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-513f2224-f0e3-40f3-8428-0dbab800ffb8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:27.116528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-513f2224-f0e3-40f3-8428-0dbab800ffb8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:27.125440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-513f2224-f0e3-40f3-8428-0dbab800ffb8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:27.125931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-513f2224-f0e3-40f3-8428-0dbab800ffb8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:27.128469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-513f2224-f0e3-40f3-8428-0dbab800ffb8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:27.129099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-513f2224-f0e3-40f3-8428-0dbab800ffb8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:27.273887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-513f2224-f0e3-40f3-8428-0dbab800ffb8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:27.281362 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-513f2224-f0e3-40f3-8428-0dbab800ffb8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1513 microversion: 2.1 time: 0.171768 Jan 22 21:58:27.281912 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4081/8453] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:27 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:27.297141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7e0d72fb-c7c5-42c0-be05-00c466e65380 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:58:27.298298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7e0d72fb-c7c5-42c0-be05-00c466e65380 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:27.304888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e0d72fb-c7c5-42c0-be05-00c466e65380 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:27.305360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e0d72fb-c7c5-42c0-be05-00c466e65380 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:27.306187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e0d72fb-c7c5-42c0-be05-00c466e65380 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:27.306650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7e0d72fb-c7c5-42c0-be05-00c466e65380 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:27.413359 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7e0d72fb-c7c5-42c0-be05-00c466e65380 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "PUT /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1085 microversion: 2.1 time: 0.119747 Jan 22 21:58:27.414028 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4373/8454] 10.222.0.100 () {60 vars in 1260 bytes} [Sat Jan 22 21:58:27 2022] PUT /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1085 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:27.427953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e6ecfad9-3209-48a0-a124-e29251514983 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:27.428569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e6ecfad9-3209-48a0-a124-e29251514983 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:27.434684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6ecfad9-3209-48a0-a124-e29251514983 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:27.435146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6ecfad9-3209-48a0-a124-e29251514983 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:27.435939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6ecfad9-3209-48a0-a124-e29251514983 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:27.436387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6ecfad9-3209-48a0-a124-e29251514983 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:27.568516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e6ecfad9-3209-48a0-a124-e29251514983 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:27.575999 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e6ecfad9-3209-48a0-a124-e29251514983 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1511 microversion: 2.1 time: 0.152249 Jan 22 21:58:27.576570 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4082/8455] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:27 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:58:27.591660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7885fa6d-8959-43c6-b3c5-f454cd0450c3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:27.592459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7885fa6d-8959-43c6-b3c5-f454cd0450c3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:27.599233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7885fa6d-8959-43c6-b3c5-f454cd0450c3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:27.599730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7885fa6d-8959-43c6-b3c5-f454cd0450c3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:27.600531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7885fa6d-8959-43c6-b3c5-f454cd0450c3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:27.600986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7885fa6d-8959-43c6-b3c5-f454cd0450c3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:27.729206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7885fa6d-8959-43c6-b3c5-f454cd0450c3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:27.736938 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7885fa6d-8959-43c6-b3c5-f454cd0450c3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1511 microversion: 2.1 time: 0.148921 Jan 22 21:58:27.737578 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4374/8456] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:27 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:27.753900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cc97064c-4241-4e21-a4e4-546782bb6463 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:58:27.754941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cc97064c-4241-4e21-a4e4-546782bb6463 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:27.760935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc97064c-4241-4e21-a4e4-546782bb6463 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:27.761390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc97064c-4241-4e21-a4e4-546782bb6463 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:27.762205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc97064c-4241-4e21-a4e4-546782bb6463 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:27.762650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc97064c-4241-4e21-a4e4-546782bb6463 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:27.794102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cc97064c-4241-4e21-a4e4-546782bb6463 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:27.800685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cc97064c-4241-4e21-a4e4-546782bb6463 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Old instance type m1.heat2, new instance type m1.heat {{(pid=137033) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 21:58:27.807504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-cc97064c-4241-4e21-a4e4-546782bb6463 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:58:27.808002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-cc97064c-4241-4e21-a4e4-546782bb6463 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:58:27.808465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-cc97064c-4241-4e21-a4e4-546782bb6463 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:58:27.808887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-cc97064c-4241-4e21-a4e4-546782bb6463 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:58:27.809310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-cc97064c-4241-4e21-a4e4-546782bb6463 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:58:27.990553 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cc97064c-4241-4e21-a4e4-546782bb6463 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "POST /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6/action" status: 202 len: 0 microversion: 2.1 time: 0.240897 Jan 22 21:58:27.991241 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4083/8457] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:58:27 2022] POST /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:58:28.000364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-31d494b2-bec7-461c-a0b3-28e5d3b6899c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:28.001045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-31d494b2-bec7-461c-a0b3-28e5d3b6899c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:28.008684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31d494b2-bec7-461c-a0b3-28e5d3b6899c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:28.009159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31d494b2-bec7-461c-a0b3-28e5d3b6899c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:28.009999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31d494b2-bec7-461c-a0b3-28e5d3b6899c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:28.010464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-31d494b2-bec7-461c-a0b3-28e5d3b6899c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:28.173008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-31d494b2-bec7-461c-a0b3-28e5d3b6899c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:28.180567 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-31d494b2-bec7-461c-a0b3-28e5d3b6899c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1522 microversion: 2.1 time: 0.184318 Jan 22 21:58:28.181471 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4375/8458] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:27 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:58:29.197740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fc4f2656-db02-4d36-9109-1205d0f76d35 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:29.198302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fc4f2656-db02-4d36-9109-1205d0f76d35 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:29.205096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc4f2656-db02-4d36-9109-1205d0f76d35 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:29.205854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc4f2656-db02-4d36-9109-1205d0f76d35 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:29.206766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc4f2656-db02-4d36-9109-1205d0f76d35 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:29.207223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc4f2656-db02-4d36-9109-1205d0f76d35 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:29.342193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fc4f2656-db02-4d36-9109-1205d0f76d35 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:29.350536 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fc4f2656-db02-4d36-9109-1205d0f76d35 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1522 microversion: 2.1 time: 0.156682 Jan 22 21:58:29.351126 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4084/8459] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:29 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:30.367831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-da3dc857-7085-4dab-810d-a14d0315277e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:30.368545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-da3dc857-7085-4dab-810d-a14d0315277e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:30.376110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da3dc857-7085-4dab-810d-a14d0315277e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:30.377194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da3dc857-7085-4dab-810d-a14d0315277e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:30.378136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da3dc857-7085-4dab-810d-a14d0315277e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:30.378607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da3dc857-7085-4dab-810d-a14d0315277e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:30.515034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-da3dc857-7085-4dab-810d-a14d0315277e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:30.523313 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-da3dc857-7085-4dab-810d-a14d0315277e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1522 microversion: 2.1 time: 0.159131 Jan 22 21:58:30.523907 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4376/8460] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:30 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:31.540392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f2eabbb4-0fbf-482b-91c6-2f2362f8d35f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:31.541009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f2eabbb4-0fbf-482b-91c6-2f2362f8d35f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:31.548087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2eabbb4-0fbf-482b-91c6-2f2362f8d35f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:31.549353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2eabbb4-0fbf-482b-91c6-2f2362f8d35f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:31.550216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2eabbb4-0fbf-482b-91c6-2f2362f8d35f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:31.550661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f2eabbb4-0fbf-482b-91c6-2f2362f8d35f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:31.683946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f2eabbb4-0fbf-482b-91c6-2f2362f8d35f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:31.691755 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f2eabbb4-0fbf-482b-91c6-2f2362f8d35f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.155184 Jan 22 21:58:31.692326 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4085/8461] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:31 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:32.708712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7523b34f-ece7-4ca9-820b-35d4467eafcc tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:32.709307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7523b34f-ece7-4ca9-820b-35d4467eafcc tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:32.716116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7523b34f-ece7-4ca9-820b-35d4467eafcc tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:32.716594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7523b34f-ece7-4ca9-820b-35d4467eafcc tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:32.717399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7523b34f-ece7-4ca9-820b-35d4467eafcc tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:32.717887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7523b34f-ece7-4ca9-820b-35d4467eafcc tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:32.851249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7523b34f-ece7-4ca9-820b-35d4467eafcc tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:32.858601 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7523b34f-ece7-4ca9-820b-35d4467eafcc tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.154248 Jan 22 21:58:32.859167 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4377/8462] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:32 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:33.878168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-938e5aa1-a556-4102-bfc3-93c25a4b6522 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:33.879148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-938e5aa1-a556-4102-bfc3-93c25a4b6522 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:33.886269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-938e5aa1-a556-4102-bfc3-93c25a4b6522 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:33.886730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-938e5aa1-a556-4102-bfc3-93c25a4b6522 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:33.887526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-938e5aa1-a556-4102-bfc3-93c25a4b6522 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:33.887975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-938e5aa1-a556-4102-bfc3-93c25a4b6522 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:34.016289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-938e5aa1-a556-4102-bfc3-93c25a4b6522 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:34.023642 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-938e5aa1-a556-4102-bfc3-93c25a4b6522 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.150299 Jan 22 21:58:34.024229 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4086/8463] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:33 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:35.041569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-37630726-b330-40a6-828e-bf67b36363c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:35.042539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-37630726-b330-40a6-828e-bf67b36363c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:35.049931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37630726-b330-40a6-828e-bf67b36363c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:35.050412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37630726-b330-40a6-828e-bf67b36363c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:35.051232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37630726-b330-40a6-828e-bf67b36363c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:35.051697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37630726-b330-40a6-828e-bf67b36363c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:35.183338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-37630726-b330-40a6-828e-bf67b36363c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:35.191217 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-37630726-b330-40a6-828e-bf67b36363c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.153597 Jan 22 21:58:35.191798 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4378/8464] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:35 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:36.208514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f59dc320-aa0e-4592-bc7e-0e810b52fe6e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:36.209114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f59dc320-aa0e-4592-bc7e-0e810b52fe6e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:36.215941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f59dc320-aa0e-4592-bc7e-0e810b52fe6e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:36.216398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f59dc320-aa0e-4592-bc7e-0e810b52fe6e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:36.217190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f59dc320-aa0e-4592-bc7e-0e810b52fe6e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:36.217672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f59dc320-aa0e-4592-bc7e-0e810b52fe6e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:36.349759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f59dc320-aa0e-4592-bc7e-0e810b52fe6e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:36.357288 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f59dc320-aa0e-4592-bc7e-0e810b52fe6e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.152948 Jan 22 21:58:36.357887 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4087/8465] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:36 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:37.375096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1ac7c04b-3e01-447b-8432-0dc5a9ede64f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:37.375652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1ac7c04b-3e01-447b-8432-0dc5a9ede64f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:37.383472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ac7c04b-3e01-447b-8432-0dc5a9ede64f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:37.383942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ac7c04b-3e01-447b-8432-0dc5a9ede64f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:37.384769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ac7c04b-3e01-447b-8432-0dc5a9ede64f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:37.385228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1ac7c04b-3e01-447b-8432-0dc5a9ede64f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:37.512861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1ac7c04b-3e01-447b-8432-0dc5a9ede64f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:37.521410 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1ac7c04b-3e01-447b-8432-0dc5a9ede64f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.150492 Jan 22 21:58:37.522018 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4379/8466] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:37 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:38.538872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-35a28d37-c257-4d83-8c9c-5e1bf4c482f3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:38.539495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-35a28d37-c257-4d83-8c9c-5e1bf4c482f3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:38.546343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35a28d37-c257-4d83-8c9c-5e1bf4c482f3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:38.546808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35a28d37-c257-4d83-8c9c-5e1bf4c482f3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:38.547601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35a28d37-c257-4d83-8c9c-5e1bf4c482f3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:38.548054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35a28d37-c257-4d83-8c9c-5e1bf4c482f3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:38.681563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-35a28d37-c257-4d83-8c9c-5e1bf4c482f3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:38.689138 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-35a28d37-c257-4d83-8c9c-5e1bf4c482f3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.153739 Jan 22 21:58:38.689885 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4088/8467] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:38 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:39.705787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-30748f2e-6e4a-4c01-a40e-7daee5860305 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:39.706428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-30748f2e-6e4a-4c01-a40e-7daee5860305 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:39.713167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30748f2e-6e4a-4c01-a40e-7daee5860305 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:39.713683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30748f2e-6e4a-4c01-a40e-7daee5860305 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:39.714489 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30748f2e-6e4a-4c01-a40e-7daee5860305 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:39.714946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-30748f2e-6e4a-4c01-a40e-7daee5860305 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:39.849297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-30748f2e-6e4a-4c01-a40e-7daee5860305 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:39.856690 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-30748f2e-6e4a-4c01-a40e-7daee5860305 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.155155 Jan 22 21:58:39.857267 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4380/8468] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:39 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:40.874755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eb351aa8-7414-4457-9f5b-8707fbec86f0 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:40.875439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eb351aa8-7414-4457-9f5b-8707fbec86f0 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:40.881892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb351aa8-7414-4457-9f5b-8707fbec86f0 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:40.882343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb351aa8-7414-4457-9f5b-8707fbec86f0 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:40.883121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb351aa8-7414-4457-9f5b-8707fbec86f0 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:40.883561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb351aa8-7414-4457-9f5b-8707fbec86f0 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:41.024909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eb351aa8-7414-4457-9f5b-8707fbec86f0 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:41.032463 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eb351aa8-7414-4457-9f5b-8707fbec86f0 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.162073 Jan 22 21:58:41.033035 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4089/8469] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:40 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:42.049402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-067982dd-c387-432a-8ee6-5b01b5bf587e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:42.050063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-067982dd-c387-432a-8ee6-5b01b5bf587e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:42.056272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-067982dd-c387-432a-8ee6-5b01b5bf587e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:42.056748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-067982dd-c387-432a-8ee6-5b01b5bf587e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:42.057584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-067982dd-c387-432a-8ee6-5b01b5bf587e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:42.058059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-067982dd-c387-432a-8ee6-5b01b5bf587e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:42.194846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-067982dd-c387-432a-8ee6-5b01b5bf587e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:42.202390 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-067982dd-c387-432a-8ee6-5b01b5bf587e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.156966 Jan 22 21:58:42.202974 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4381/8470] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:42 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:43.219304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-273c43ce-f236-407a-98cb-2a8bfec1a170 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:43.220670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-273c43ce-f236-407a-98cb-2a8bfec1a170 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:43.227694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-273c43ce-f236-407a-98cb-2a8bfec1a170 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:43.232081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-273c43ce-f236-407a-98cb-2a8bfec1a170 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:43.232081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-273c43ce-f236-407a-98cb-2a8bfec1a170 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:43.232081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-273c43ce-f236-407a-98cb-2a8bfec1a170 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:43.659959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-273c43ce-f236-407a-98cb-2a8bfec1a170 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:43.667344 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-273c43ce-f236-407a-98cb-2a8bfec1a170 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.451841 Jan 22 21:58:43.668235 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4090/8471] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:43 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:44.684614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2700c2ae-0515-470f-a08c-59a720bb1ab4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:44.685182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2700c2ae-0515-470f-a08c-59a720bb1ab4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:44.691882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2700c2ae-0515-470f-a08c-59a720bb1ab4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:44.692350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2700c2ae-0515-470f-a08c-59a720bb1ab4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:44.693138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2700c2ae-0515-470f-a08c-59a720bb1ab4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:44.693637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2700c2ae-0515-470f-a08c-59a720bb1ab4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:44.825847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2700c2ae-0515-470f-a08c-59a720bb1ab4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:44.833864 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2700c2ae-0515-470f-a08c-59a720bb1ab4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.152958 Jan 22 21:58:44.834451 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4382/8472] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:44 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:45.851884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-54ec526f-9b8e-4533-8ce9-9354b8b92bd8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:45.852487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-54ec526f-9b8e-4533-8ce9-9354b8b92bd8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:45.859307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54ec526f-9b8e-4533-8ce9-9354b8b92bd8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:45.859768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54ec526f-9b8e-4533-8ce9-9354b8b92bd8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:45.860568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54ec526f-9b8e-4533-8ce9-9354b8b92bd8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:45.861015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-54ec526f-9b8e-4533-8ce9-9354b8b92bd8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:45.994141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-54ec526f-9b8e-4533-8ce9-9354b8b92bd8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:46.002327 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-54ec526f-9b8e-4533-8ce9-9354b8b92bd8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.154188 Jan 22 21:58:46.002901 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4091/8473] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:45 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:47.019624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a42222a2-a138-4fad-a26b-61ccfff27b22 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:47.020284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a42222a2-a138-4fad-a26b-61ccfff27b22 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:47.027176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a42222a2-a138-4fad-a26b-61ccfff27b22 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:47.027651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a42222a2-a138-4fad-a26b-61ccfff27b22 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:47.028461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a42222a2-a138-4fad-a26b-61ccfff27b22 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:47.029022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a42222a2-a138-4fad-a26b-61ccfff27b22 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:47.164629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a42222a2-a138-4fad-a26b-61ccfff27b22 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:47.172358 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a42222a2-a138-4fad-a26b-61ccfff27b22 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.156824 Jan 22 21:58:47.172998 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4383/8474] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:47 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:48.189457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-accd31d0-ee79-42d7-a5a5-346c82736cfa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:48.190100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-accd31d0-ee79-42d7-a5a5-346c82736cfa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:48.196774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-accd31d0-ee79-42d7-a5a5-346c82736cfa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:48.197234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-accd31d0-ee79-42d7-a5a5-346c82736cfa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:48.198050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-accd31d0-ee79-42d7-a5a5-346c82736cfa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:48.198498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-accd31d0-ee79-42d7-a5a5-346c82736cfa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:48.327918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-accd31d0-ee79-42d7-a5a5-346c82736cfa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:48.336196 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-accd31d0-ee79-42d7-a5a5-346c82736cfa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.150750 Jan 22 21:58:48.336772 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4092/8475] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:48 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:49.353547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-69d4f624-ae6d-4cc4-9444-84e0dec19ba6 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:49.354175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-69d4f624-ae6d-4cc4-9444-84e0dec19ba6 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:49.361385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69d4f624-ae6d-4cc4-9444-84e0dec19ba6 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:49.361890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69d4f624-ae6d-4cc4-9444-84e0dec19ba6 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:49.362701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69d4f624-ae6d-4cc4-9444-84e0dec19ba6 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:49.363160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-69d4f624-ae6d-4cc4-9444-84e0dec19ba6 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:49.508089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-69d4f624-ae6d-4cc4-9444-84e0dec19ba6 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:49.515484 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-69d4f624-ae6d-4cc4-9444-84e0dec19ba6 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.165811 Jan 22 21:58:49.516065 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4384/8476] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:49 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:58:50.532819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-08e4c7f2-2c8f-45d2-844d-b3f08337979a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:50.533430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-08e4c7f2-2c8f-45d2-844d-b3f08337979a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:50.540371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08e4c7f2-2c8f-45d2-844d-b3f08337979a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:50.540834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08e4c7f2-2c8f-45d2-844d-b3f08337979a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:50.541658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08e4c7f2-2c8f-45d2-844d-b3f08337979a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:50.542105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08e4c7f2-2c8f-45d2-844d-b3f08337979a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:50.674261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-08e4c7f2-2c8f-45d2-844d-b3f08337979a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:50.681629 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-08e4c7f2-2c8f-45d2-844d-b3f08337979a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.152508 Jan 22 21:58:50.682197 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4093/8477] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:50 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:58:51.699299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b287677a-c582-4a0a-a834-66cd66b69482 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:51.699858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b287677a-c582-4a0a-a834-66cd66b69482 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:51.707692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b287677a-c582-4a0a-a834-66cd66b69482 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:51.708164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b287677a-c582-4a0a-a834-66cd66b69482 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:51.708970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b287677a-c582-4a0a-a834-66cd66b69482 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:51.709428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b287677a-c582-4a0a-a834-66cd66b69482 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:51.840153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b287677a-c582-4a0a-a834-66cd66b69482 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:51.848365 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b287677a-c582-4a0a-a834-66cd66b69482 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.152789 Jan 22 21:58:51.848981 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4385/8478] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:51 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:52.865448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-92e7bbf8-dd5e-454a-8b02-ab5602baa9d8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:52.866095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-92e7bbf8-dd5e-454a-8b02-ab5602baa9d8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:52.873102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92e7bbf8-dd5e-454a-8b02-ab5602baa9d8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:52.873582 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92e7bbf8-dd5e-454a-8b02-ab5602baa9d8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:52.874377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92e7bbf8-dd5e-454a-8b02-ab5602baa9d8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:52.874815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92e7bbf8-dd5e-454a-8b02-ab5602baa9d8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:53.004050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-92e7bbf8-dd5e-454a-8b02-ab5602baa9d8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:53.011499 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-92e7bbf8-dd5e-454a-8b02-ab5602baa9d8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.149874 Jan 22 21:58:53.012071 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4094/8479] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:52 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:54.028912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f778709e-57ed-46c3-9150-08ec9ee18f43 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:54.029598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f778709e-57ed-46c3-9150-08ec9ee18f43 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:54.037074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f778709e-57ed-46c3-9150-08ec9ee18f43 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:54.037594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f778709e-57ed-46c3-9150-08ec9ee18f43 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:54.039002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f778709e-57ed-46c3-9150-08ec9ee18f43 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:54.039836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f778709e-57ed-46c3-9150-08ec9ee18f43 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:54.168094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f778709e-57ed-46c3-9150-08ec9ee18f43 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:54.176028 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f778709e-57ed-46c3-9150-08ec9ee18f43 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.150846 Jan 22 21:58:54.176606 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4386/8480] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:54 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:55.193528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4e429727-7085-4179-b776-9cfac4a37b87 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:55.194141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4e429727-7085-4179-b776-9cfac4a37b87 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:55.200851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e429727-7085-4179-b776-9cfac4a37b87 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:55.201308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e429727-7085-4179-b776-9cfac4a37b87 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:55.202149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e429727-7085-4179-b776-9cfac4a37b87 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:55.202592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e429727-7085-4179-b776-9cfac4a37b87 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:55.336024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4e429727-7085-4179-b776-9cfac4a37b87 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:55.343547 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4e429727-7085-4179-b776-9cfac4a37b87 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.153910 Jan 22 21:58:55.346367 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4095/8481] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:55 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:56.366691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d90b3c0a-2091-4714-b5e3-ebe01656ac34 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:56.367329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d90b3c0a-2091-4714-b5e3-ebe01656ac34 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:56.374414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d90b3c0a-2091-4714-b5e3-ebe01656ac34 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:56.374885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d90b3c0a-2091-4714-b5e3-ebe01656ac34 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:56.376362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d90b3c0a-2091-4714-b5e3-ebe01656ac34 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:56.376825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d90b3c0a-2091-4714-b5e3-ebe01656ac34 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:56.517469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d90b3c0a-2091-4714-b5e3-ebe01656ac34 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:56.524938 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d90b3c0a-2091-4714-b5e3-ebe01656ac34 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.162037 Jan 22 21:58:56.525543 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4387/8482] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:56 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:57.542279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-839d0008-8cd7-498b-9b6c-fe9e0e528c6b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:57.542867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-839d0008-8cd7-498b-9b6c-fe9e0e528c6b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:57.549972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-839d0008-8cd7-498b-9b6c-fe9e0e528c6b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:57.550488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-839d0008-8cd7-498b-9b6c-fe9e0e528c6b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:57.551282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-839d0008-8cd7-498b-9b6c-fe9e0e528c6b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:57.551727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-839d0008-8cd7-498b-9b6c-fe9e0e528c6b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:57.679622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-839d0008-8cd7-498b-9b6c-fe9e0e528c6b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:57.687152 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-839d0008-8cd7-498b-9b6c-fe9e0e528c6b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1527 microversion: 2.1 time: 0.148578 Jan 22 21:58:57.687724 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4096/8483] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:57 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1527 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:58.704093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ef6e9231-b657-40a9-98d1-271c85c81b32 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:58.704721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ef6e9231-b657-40a9-98d1-271c85c81b32 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:58.712036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef6e9231-b657-40a9-98d1-271c85c81b32 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:58.712505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef6e9231-b657-40a9-98d1-271c85c81b32 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:58.713313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef6e9231-b657-40a9-98d1-271c85c81b32 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:58.713816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef6e9231-b657-40a9-98d1-271c85c81b32 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:58.962270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ef6e9231-b657-40a9-98d1-271c85c81b32 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:58:58.969846 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ef6e9231-b657-40a9-98d1-271c85c81b32 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1526 microversion: 2.1 time: 0.269550 Jan 22 21:58:58.970705 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4388/8484] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:58 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1526 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:58:59.123029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-db00907f-4e95-459c-92fa-273c8e6175d7 req-97b248ba-dd64-43c1-b36b-dfa4a12f9de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32273408-e773-477a-8fff-660c0ad6cff6", "name": "network-vif-unplugged", "status": "completed", "tag": "27eedf5c-82a3-45c1-8b16-86b2c3f44e4e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:58:59.124614 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:58:59.124614 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:58:59.131696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-db00907f-4e95-459c-92fa-273c8e6175d7 req-97b248ba-dd64-43c1-b36b-dfa4a12f9de9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:59.132147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-db00907f-4e95-459c-92fa-273c8e6175d7 req-97b248ba-dd64-43c1-b36b-dfa4a12f9de9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:59.146034 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-db00907f-4e95-459c-92fa-273c8e6175d7 req-97b248ba-dd64-43c1-b36b-dfa4a12f9de9 service nova] Creating event network-vif-unplugged:27eedf5c-82a3-45c1-8b16-86b2c3f44e4e for instance 32273408-e773-477a-8fff-660c0ad6cff6 on nch2-master-1 Jan 22 21:58:59.151558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-db00907f-4e95-459c-92fa-273c8e6175d7 req-97b248ba-dd64-43c1-b36b-dfa4a12f9de9 service nova] Instance 32273408-e773-477a-8fff-660c0ad6cff6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:58:59.163136 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-db00907f-4e95-459c-92fa-273c8e6175d7 req-97b248ba-dd64-43c1-b36b-dfa4a12f9de9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096776 Jan 22 21:58:59.163757 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4097/8485] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:58:59.987931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-78c69ea0-e015-4aa2-8cc7-a48b5c350f2f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:58:59.988600 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-78c69ea0-e015-4aa2-8cc7-a48b5c350f2f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:58:59.995735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78c69ea0-e015-4aa2-8cc7-a48b5c350f2f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:59.996209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78c69ea0-e015-4aa2-8cc7-a48b5c350f2f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:58:59.997010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78c69ea0-e015-4aa2-8cc7-a48b5c350f2f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:58:59.997464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-78c69ea0-e015-4aa2-8cc7-a48b5c350f2f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:00.240289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-78c69ea0-e015-4aa2-8cc7-a48b5c350f2f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:00.248037 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-78c69ea0-e015-4aa2-8cc7-a48b5c350f2f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1526 microversion: 2.1 time: 0.264116 Jan 22 21:59:00.248713 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4389/8486] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:58:59 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1526 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:01.178491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-809db9d9-3421-4846-8220-d5c17c276587 req-36afb689-13f3-4e95-9184-846f52d309cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32273408-e773-477a-8fff-660c0ad6cff6", "tag": "27eedf5c-82a3-45c1-8b16-86b2c3f44e4e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:59:01.179953 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:59:01.179953 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:59:01.187927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-809db9d9-3421-4846-8220-d5c17c276587 req-36afb689-13f3-4e95-9184-846f52d309cd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:01.188382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-809db9d9-3421-4846-8220-d5c17c276587 req-36afb689-13f3-4e95-9184-846f52d309cd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:01.201061 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-809db9d9-3421-4846-8220-d5c17c276587 req-36afb689-13f3-4e95-9184-846f52d309cd service nova] Creating event network-changed:27eedf5c-82a3-45c1-8b16-86b2c3f44e4e for instance 32273408-e773-477a-8fff-660c0ad6cff6 on nch2-master-1 Jan 22 21:59:01.207792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-809db9d9-3421-4846-8220-d5c17c276587 req-36afb689-13f3-4e95-9184-846f52d309cd service nova] Instance 32273408-e773-477a-8fff-660c0ad6cff6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:59:01.218184 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-809db9d9-3421-4846-8220-d5c17c276587 req-36afb689-13f3-4e95-9184-846f52d309cd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044940 Jan 22 21:59:01.218784 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4098/8487] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:59:01.265199 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-88c1b139-0f90-4c57-b862-32009da57213 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:01.265912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-88c1b139-0f90-4c57-b862-32009da57213 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:01.273803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88c1b139-0f90-4c57-b862-32009da57213 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:01.274752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88c1b139-0f90-4c57-b862-32009da57213 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:01.275763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88c1b139-0f90-4c57-b862-32009da57213 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:01.276218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88c1b139-0f90-4c57-b862-32009da57213 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:01.534330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-88c1b139-0f90-4c57-b862-32009da57213 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:01.542340 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-88c1b139-0f90-4c57-b862-32009da57213 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1524 microversion: 2.1 time: 0.280838 Jan 22 21:59:01.542941 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4390/8488] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:01 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1524 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:59:02.563797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ec4816f4-1120-429d-a2a2-709afab151fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:02.564497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ec4816f4-1120-429d-a2a2-709afab151fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:02.571461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec4816f4-1120-429d-a2a2-709afab151fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:02.571921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec4816f4-1120-429d-a2a2-709afab151fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:02.572713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec4816f4-1120-429d-a2a2-709afab151fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:02.573161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec4816f4-1120-429d-a2a2-709afab151fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:02.707065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ec4816f4-1120-429d-a2a2-709afab151fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:02.714570 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ec4816f4-1120-429d-a2a2-709afab151fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1524 microversion: 2.1 time: 0.155676 Jan 22 21:59:02.715137 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4099/8489] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:02 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:03.732092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-525976e7-e08f-488b-bd6c-70573cd9ed82 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:03.732684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-525976e7-e08f-488b-bd6c-70573cd9ed82 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:03.739388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-525976e7-e08f-488b-bd6c-70573cd9ed82 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:03.740564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-525976e7-e08f-488b-bd6c-70573cd9ed82 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:03.741457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-525976e7-e08f-488b-bd6c-70573cd9ed82 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:03.741942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-525976e7-e08f-488b-bd6c-70573cd9ed82 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:03.874805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-525976e7-e08f-488b-bd6c-70573cd9ed82 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:03.883239 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-525976e7-e08f-488b-bd6c-70573cd9ed82 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1521 microversion: 2.1 time: 0.155007 Jan 22 21:59:03.883824 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4391/8490] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:03 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:03.899873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7b01c647-9d68-486d-8b4c-18d7ef59bf31 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:59:03.900425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7b01c647-9d68-486d-8b4c-18d7ef59bf31 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:03.907221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b01c647-9d68-486d-8b4c-18d7ef59bf31 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:03.907675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b01c647-9d68-486d-8b4c-18d7ef59bf31 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:03.908462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b01c647-9d68-486d-8b4c-18d7ef59bf31 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:03.908906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b01c647-9d68-486d-8b4c-18d7ef59bf31 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:04.088431 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7b01c647-9d68-486d-8b4c-18d7ef59bf31 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "POST /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6/action" status: 204 len: 0 microversion: 2.1 time: 0.192278 Jan 22 21:59:04.089075 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4100/8491] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:59:03 2022] POST /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6/action => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:59:04.097187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19a8f2c3-5a12-410b-9bda-11e8a59ede06 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:04.100176 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-19a8f2c3-5a12-410b-9bda-11e8a59ede06 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:04.104535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19a8f2c3-5a12-410b-9bda-11e8a59ede06 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:04.105011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19a8f2c3-5a12-410b-9bda-11e8a59ede06 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:04.105869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19a8f2c3-5a12-410b-9bda-11e8a59ede06 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:04.106336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19a8f2c3-5a12-410b-9bda-11e8a59ede06 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:04.248552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-19a8f2c3-5a12-410b-9bda-11e8a59ede06 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:04.256910 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19a8f2c3-5a12-410b-9bda-11e8a59ede06 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1521 microversion: 2.1 time: 0.163396 Jan 22 21:59:04.260652 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4392/8492] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:04 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:59:05.275514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d138ca08-4a5e-4feb-9931-86c28f3873dd tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:05.276210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d138ca08-4a5e-4feb-9931-86c28f3873dd tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:05.283221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d138ca08-4a5e-4feb-9931-86c28f3873dd tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:05.283616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d138ca08-4a5e-4feb-9931-86c28f3873dd tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:05.284394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d138ca08-4a5e-4feb-9931-86c28f3873dd tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:05.284827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d138ca08-4a5e-4feb-9931-86c28f3873dd tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:05.421179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d138ca08-4a5e-4feb-9931-86c28f3873dd tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:05.428795 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d138ca08-4a5e-4feb-9931-86c28f3873dd tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1521 microversion: 2.1 time: 0.158077 Jan 22 21:59:05.429375 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4101/8493] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:05 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:06.446028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2b4985c0-c031-41ce-809f-608068c14e6a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:06.446850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2b4985c0-c031-41ce-809f-608068c14e6a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:06.453605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b4985c0-c031-41ce-809f-608068c14e6a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:06.454169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b4985c0-c031-41ce-809f-608068c14e6a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:06.457952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b4985c0-c031-41ce-809f-608068c14e6a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:06.458518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b4985c0-c031-41ce-809f-608068c14e6a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:06.557863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-8ab668df-809c-4f87-8e22-020831b514b6 req-a725c3ef-68d9-41fc-bee9-342f4f860c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32273408-e773-477a-8fff-660c0ad6cff6", "name": "network-vif-plugged", "status": "completed", "tag": "27eedf5c-82a3-45c1-8b16-86b2c3f44e4e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:59:06.559750 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:59:06.559750 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:59:06.567998 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8ab668df-809c-4f87-8e22-020831b514b6 req-a725c3ef-68d9-41fc-bee9-342f4f860c63 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:06.568552 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8ab668df-809c-4f87-8e22-020831b514b6 req-a725c3ef-68d9-41fc-bee9-342f4f860c63 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:06.580002 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8ab668df-809c-4f87-8e22-020831b514b6 req-a725c3ef-68d9-41fc-bee9-342f4f860c63 service nova] Creating event network-vif-plugged:27eedf5c-82a3-45c1-8b16-86b2c3f44e4e for instance 32273408-e773-477a-8fff-660c0ad6cff6 on nch2-master-1 Jan 22 21:59:06.584917 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-8ab668df-809c-4f87-8e22-020831b514b6 req-a725c3ef-68d9-41fc-bee9-342f4f860c63 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031431 Jan 22 21:59:06.585525 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4102/8494] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:59:06.597597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2b4985c0-c031-41ce-809f-608068c14e6a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:06.604894 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2b4985c0-c031-41ce-809f-608068c14e6a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1513 microversion: 2.1 time: 0.162637 Jan 22 21:59:06.605574 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4393/8495] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:06 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:06.622237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a4fb32b2-904a-4a1d-b6aa-977e17cf94d1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:06.626365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a4fb32b2-904a-4a1d-b6aa-977e17cf94d1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:06.629102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4fb32b2-904a-4a1d-b6aa-977e17cf94d1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:06.629578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4fb32b2-904a-4a1d-b6aa-977e17cf94d1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:06.630468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4fb32b2-904a-4a1d-b6aa-977e17cf94d1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:06.630913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4fb32b2-904a-4a1d-b6aa-977e17cf94d1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:06.768186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a4fb32b2-904a-4a1d-b6aa-977e17cf94d1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:06.776469 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a4fb32b2-904a-4a1d-b6aa-977e17cf94d1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1513 microversion: 2.1 time: 0.158458 Jan 22 21:59:06.777051 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4103/8496] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:06 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:59:06.792972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-23c35b0f-78a7-4752-bb0e-d5b9ea4b7fca tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:06.793648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-23c35b0f-78a7-4752-bb0e-d5b9ea4b7fca tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:06.799646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23c35b0f-78a7-4752-bb0e-d5b9ea4b7fca tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:06.800124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23c35b0f-78a7-4752-bb0e-d5b9ea4b7fca tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:06.800934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23c35b0f-78a7-4752-bb0e-d5b9ea4b7fca tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:06.801399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23c35b0f-78a7-4752-bb0e-d5b9ea4b7fca tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:06.934863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-23c35b0f-78a7-4752-bb0e-d5b9ea4b7fca tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:06.942466 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-23c35b0f-78a7-4752-bb0e-d5b9ea4b7fca tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 200 len: 1513 microversion: 2.1 time: 0.153288 Jan 22 21:59:06.943186 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4394/8497] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:06 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:06.958094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-598c857e-1f85-4dfd-aa47-6e79dcccd888 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:06.963738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-598c857e-1f85-4dfd-aa47-6e79dcccd888 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:06.965011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-598c857e-1f85-4dfd-aa47-6e79dcccd888 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:06.965465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-598c857e-1f85-4dfd-aa47-6e79dcccd888 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:06.966360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-598c857e-1f85-4dfd-aa47-6e79dcccd888 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:06.966804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-598c857e-1f85-4dfd-aa47-6e79dcccd888 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:06.991636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-598c857e-1f85-4dfd-aa47-6e79dcccd888 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 21:59:07.333913 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-598c857e-1f85-4dfd-aa47-6e79dcccd888 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "DELETE /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 204 len: 0 microversion: 2.1 time: 0.379033 Jan 22 21:59:07.334556 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4104/8498] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:59:06 2022] DELETE /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 21:59:07.400259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1960192928", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "4a1708dd-545c-4a2b-9ad3-956c080f69bf"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:59:07.450528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] validate_networks() for [('4a1708dd-545c-4a2b-9ad3-956c080f69bf', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 21:59:07.809766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:59:07.810323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:59:07.810823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:59:07.811247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:59:07.811680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:59:07.821491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:07.821997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:07.822832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:07.823290 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:07.839947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Getting quotas for project ebad5df743954fcfbcbabe08f9049b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 21:59:07.844989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Getting quotas for user 2db0a2ad45bb48fdbaf9e0cb2da999ea and project ebad5df743954fcfbcbabe08f9049b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 21:59:07.857608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 21:59:07.860863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 21:59:07.980485 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-87909249-9105-499d-9663-ae003da05644 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.583969 Jan 22 21:59:07.981164 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4395/8499] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 21:59:07 2022] POST /compute/v2.1/servers => generated 382 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 21:59:07.992222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0dbfddab-f65b-4213-b962-a34ca87ced29 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:07.998270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0dbfddab-f65b-4213-b962-a34ca87ced29 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:08.047665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0dbfddab-f65b-4213-b962-a34ca87ced29 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:08.054852 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0dbfddab-f65b-4213-b962-a34ca87ced29 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1222 microversion: 2.1 time: 0.067448 Jan 22 21:59:08.055855 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4105/8500] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:07 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1222 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:59:09.071902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f89fe818-57b5-49ef-a256-ed1dc58185c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:09.073681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f89fe818-57b5-49ef-a256-ed1dc58185c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:09.082258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f89fe818-57b5-49ef-a256-ed1dc58185c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:09.082982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f89fe818-57b5-49ef-a256-ed1dc58185c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:09.085024 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f89fe818-57b5-49ef-a256-ed1dc58185c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:09.085878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f89fe818-57b5-49ef-a256-ed1dc58185c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:09.158543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f89fe818-57b5-49ef-a256-ed1dc58185c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:09.167406 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f89fe818-57b5-49ef-a256-ed1dc58185c9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1226 microversion: 2.1 time: 0.099696 Jan 22 21:59:09.168325 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4396/8501] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:09 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:09.403455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-bd7331d1-b7c2-4806-83c2-b4179bff1fff req-692263ae-8ebb-4628-8ea1-70406f7ca362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32273408-e773-477a-8fff-660c0ad6cff6", "name": "network-vif-deleted", "tag": "27eedf5c-82a3-45c1-8b16-86b2c3f44e4e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:59:09.405051 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:59:09.405051 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:59:09.413851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bd7331d1-b7c2-4806-83c2-b4179bff1fff req-692263ae-8ebb-4628-8ea1-70406f7ca362 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:09.414300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bd7331d1-b7c2-4806-83c2-b4179bff1fff req-692263ae-8ebb-4628-8ea1-70406f7ca362 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:09.426981 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-bd7331d1-b7c2-4806-83c2-b4179bff1fff req-692263ae-8ebb-4628-8ea1-70406f7ca362 service nova] Creating event network-vif-deleted:27eedf5c-82a3-45c1-8b16-86b2c3f44e4e for instance 32273408-e773-477a-8fff-660c0ad6cff6 on nch2-master-1 Jan 22 21:59:09.432675 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-bd7331d1-b7c2-4806-83c2-b4179bff1fff req-692263ae-8ebb-4628-8ea1-70406f7ca362 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033918 Jan 22 21:59:09.433340 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4106/8502] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:59:10.184187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ba94322f-67a4-491a-a305-e5b145db485c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:10.184824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ba94322f-67a4-491a-a305-e5b145db485c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:10.196913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba94322f-67a4-491a-a305-e5b145db485c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:10.197310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba94322f-67a4-491a-a305-e5b145db485c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:10.198284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba94322f-67a4-491a-a305-e5b145db485c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:10.198761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ba94322f-67a4-491a-a305-e5b145db485c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:10.273387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ba94322f-67a4-491a-a305-e5b145db485c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:10.280908 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ba94322f-67a4-491a-a305-e5b145db485c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1280 microversion: 2.1 time: 0.100442 Jan 22 21:59:10.281496 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4397/8503] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:10 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1280 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:11.299904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-39b02275-c021-46ec-8667-889e10ec3c99 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:11.300609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-39b02275-c021-46ec-8667-889e10ec3c99 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:11.309148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39b02275-c021-46ec-8667-889e10ec3c99 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:11.309638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39b02275-c021-46ec-8667-889e10ec3c99 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:11.310434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39b02275-c021-46ec-8667-889e10ec3c99 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:11.310881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39b02275-c021-46ec-8667-889e10ec3c99 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:11.447260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-d1706035-0404-4e6b-9904-7ff7085307f9 req-95b7f71c-59e1-44e2-a145-fb0aaeb71633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68937473-4a69-4fa4-a153-62adfafa1bd7", "tag": "84c2392a-842a-4fc6-8219-d10b71945484"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:59:11.448923 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:59:11.448923 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:59:11.451078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-39b02275-c021-46ec-8667-889e10ec3c99 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:11.456909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d1706035-0404-4e6b-9904-7ff7085307f9 req-95b7f71c-59e1-44e2-a145-fb0aaeb71633 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:11.457436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d1706035-0404-4e6b-9904-7ff7085307f9 req-95b7f71c-59e1-44e2-a145-fb0aaeb71633 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:11.458758 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-39b02275-c021-46ec-8667-889e10ec3c99 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1322 microversion: 2.1 time: 0.163908 Jan 22 21:59:11.459880 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4107/8504] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:11 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:11.469117 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d1706035-0404-4e6b-9904-7ff7085307f9 req-95b7f71c-59e1-44e2-a145-fb0aaeb71633 service nova] Creating event network-changed:84c2392a-842a-4fc6-8219-d10b71945484 for instance 68937473-4a69-4fa4-a153-62adfafa1bd7 on nch2-master-1 Jan 22 21:59:11.474634 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-d1706035-0404-4e6b-9904-7ff7085307f9 req-95b7f71c-59e1-44e2-a145-fb0aaeb71633 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031687 Jan 22 21:59:11.476224 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4398/8505] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:59:12.477757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-953ea9ae-4e67-48be-b195-99395b042ef4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:12.478375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-953ea9ae-4e67-48be-b195-99395b042ef4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:12.485418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-953ea9ae-4e67-48be-b195-99395b042ef4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:12.485918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-953ea9ae-4e67-48be-b195-99395b042ef4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:12.486691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-953ea9ae-4e67-48be-b195-99395b042ef4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:12.487129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-953ea9ae-4e67-48be-b195-99395b042ef4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:12.631280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-953ea9ae-4e67-48be-b195-99395b042ef4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:12.639171 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-953ea9ae-4e67-48be-b195-99395b042ef4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1322 microversion: 2.1 time: 0.166203 Jan 22 21:59:12.639776 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4108/8506] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:12 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:13.656662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4603f34c-884c-460e-b99d-14b38ce8da80 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:13.657291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4603f34c-884c-460e-b99d-14b38ce8da80 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:13.664622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4603f34c-884c-460e-b99d-14b38ce8da80 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:13.665095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4603f34c-884c-460e-b99d-14b38ce8da80 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:13.665920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4603f34c-884c-460e-b99d-14b38ce8da80 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:13.666439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4603f34c-884c-460e-b99d-14b38ce8da80 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:13.800371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4603f34c-884c-460e-b99d-14b38ce8da80 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:13.808420 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4603f34c-884c-460e-b99d-14b38ce8da80 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1322 microversion: 2.1 time: 0.156004 Jan 22 21:59:13.808992 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4399/8507] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:13 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:14.825271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3fb50c05-57b8-4fba-8971-787c8d02b241 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:14.825967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3fb50c05-57b8-4fba-8971-787c8d02b241 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:14.832703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fb50c05-57b8-4fba-8971-787c8d02b241 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:14.833155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fb50c05-57b8-4fba-8971-787c8d02b241 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:14.833963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fb50c05-57b8-4fba-8971-787c8d02b241 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:14.834409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3fb50c05-57b8-4fba-8971-787c8d02b241 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:14.964986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3fb50c05-57b8-4fba-8971-787c8d02b241 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:14.972327 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3fb50c05-57b8-4fba-8971-787c8d02b241 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1322 microversion: 2.1 time: 0.150784 Jan 22 21:59:14.972898 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4109/8508] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:14 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:15.989851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-39937f2c-f7e0-4703-b226-e90d11332dd4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:15.990543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-39937f2c-f7e0-4703-b226-e90d11332dd4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:15.997920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39937f2c-f7e0-4703-b226-e90d11332dd4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:15.998398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39937f2c-f7e0-4703-b226-e90d11332dd4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:15.999211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39937f2c-f7e0-4703-b226-e90d11332dd4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:15.999672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39937f2c-f7e0-4703-b226-e90d11332dd4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:16.133206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-39937f2c-f7e0-4703-b226-e90d11332dd4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:16.140640 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-39937f2c-f7e0-4703-b226-e90d11332dd4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1322 microversion: 2.1 time: 0.154517 Jan 22 21:59:16.141216 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4400/8509] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:15 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:17.158154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-88e82f33-8bd5-4f31-9d8b-4f0fb189afe4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:17.158689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-88e82f33-8bd5-4f31-9d8b-4f0fb189afe4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:17.165640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88e82f33-8bd5-4f31-9d8b-4f0fb189afe4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:17.166102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88e82f33-8bd5-4f31-9d8b-4f0fb189afe4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:17.166893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88e82f33-8bd5-4f31-9d8b-4f0fb189afe4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:17.167362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88e82f33-8bd5-4f31-9d8b-4f0fb189afe4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:17.299603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-88e82f33-8bd5-4f31-9d8b-4f0fb189afe4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:17.307115 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-88e82f33-8bd5-4f31-9d8b-4f0fb189afe4 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1322 microversion: 2.1 time: 0.152782 Jan 22 21:59:17.308304 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4110/8510] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:17 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:18.324832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6e47bfe3-addf-4470-86b3-64b50c4b2bc9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:18.325466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6e47bfe3-addf-4470-86b3-64b50c4b2bc9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:18.332232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e47bfe3-addf-4470-86b3-64b50c4b2bc9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:18.332709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e47bfe3-addf-4470-86b3-64b50c4b2bc9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:18.333528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e47bfe3-addf-4470-86b3-64b50c4b2bc9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:18.334004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6e47bfe3-addf-4470-86b3-64b50c4b2bc9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:18.476153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6e47bfe3-addf-4470-86b3-64b50c4b2bc9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:18.484391 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6e47bfe3-addf-4470-86b3-64b50c4b2bc9 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1322 microversion: 2.1 time: 0.164101 Jan 22 21:59:18.493757 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4401/8511] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:18 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:18.586660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-997481a0-7cb9-4e46-b25d-b239d1d1333b req-3b5dbf7f-1157-450a-b092-137e43a832e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68937473-4a69-4fa4-a153-62adfafa1bd7", "name": "network-vif-plugged", "status": "completed", "tag": "84c2392a-842a-4fc6-8219-d10b71945484"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:59:18.588199 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:59:18.588199 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:59:18.595978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-997481a0-7cb9-4e46-b25d-b239d1d1333b req-3b5dbf7f-1157-450a-b092-137e43a832e0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:18.596432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-997481a0-7cb9-4e46-b25d-b239d1d1333b req-3b5dbf7f-1157-450a-b092-137e43a832e0 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:18.607922 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-997481a0-7cb9-4e46-b25d-b239d1d1333b req-3b5dbf7f-1157-450a-b092-137e43a832e0 service nova] Creating event network-vif-plugged:84c2392a-842a-4fc6-8219-d10b71945484 for instance 68937473-4a69-4fa4-a153-62adfafa1bd7 on nch2-master-1 Jan 22 21:59:18.612860 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-997481a0-7cb9-4e46-b25d-b239d1d1333b req-3b5dbf7f-1157-450a-b092-137e43a832e0 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030012 Jan 22 21:59:18.613450 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4111/8512] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:59:19.501294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-121c8118-dc56-4a60-8755-32b62620139b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:19.501944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-121c8118-dc56-4a60-8755-32b62620139b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:19.509383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-121c8118-dc56-4a60-8755-32b62620139b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:19.509876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-121c8118-dc56-4a60-8755-32b62620139b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:19.510681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-121c8118-dc56-4a60-8755-32b62620139b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:19.511141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-121c8118-dc56-4a60-8755-32b62620139b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:19.645471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-121c8118-dc56-4a60-8755-32b62620139b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:19.653573 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-121c8118-dc56-4a60-8755-32b62620139b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1322 microversion: 2.1 time: 0.155978 Jan 22 21:59:19.654177 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4402/8513] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:19 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:20.672530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d37a7d4b-fe16-4adc-9bfe-27b45fda8a37 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:20.673161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d37a7d4b-fe16-4adc-9bfe-27b45fda8a37 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:20.680200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d37a7d4b-fe16-4adc-9bfe-27b45fda8a37 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:20.680706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d37a7d4b-fe16-4adc-9bfe-27b45fda8a37 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:20.681526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d37a7d4b-fe16-4adc-9bfe-27b45fda8a37 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:20.682009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d37a7d4b-fe16-4adc-9bfe-27b45fda8a37 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:20.819435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d37a7d4b-fe16-4adc-9bfe-27b45fda8a37 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:20.827580 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d37a7d4b-fe16-4adc-9bfe-27b45fda8a37 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1512 microversion: 2.1 time: 0.160139 Jan 22 21:59:20.828167 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4112/8514] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:20 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:20.844492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-913225b6-bc4d-4343-be5e-b76c23814708 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:20.845147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-913225b6-bc4d-4343-be5e-b76c23814708 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:20.852139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-913225b6-bc4d-4343-be5e-b76c23814708 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:20.852613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-913225b6-bc4d-4343-be5e-b76c23814708 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:20.853423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-913225b6-bc4d-4343-be5e-b76c23814708 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:20.853985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-913225b6-bc4d-4343-be5e-b76c23814708 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:20.983643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-913225b6-bc4d-4343-be5e-b76c23814708 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:20.991192 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-913225b6-bc4d-4343-be5e-b76c23814708 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1512 microversion: 2.1 time: 0.150474 Jan 22 21:59:20.991760 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4403/8515] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:20 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:21.008629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8db60c82-900a-4d25-9311-cbbd657eb478 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:59:21.009687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8db60c82-900a-4d25-9311-cbbd657eb478 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:21.015585 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8db60c82-900a-4d25-9311-cbbd657eb478 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:21.016032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8db60c82-900a-4d25-9311-cbbd657eb478 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:21.016924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8db60c82-900a-4d25-9311-cbbd657eb478 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:21.017364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8db60c82-900a-4d25-9311-cbbd657eb478 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:21.044957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8db60c82-900a-4d25-9311-cbbd657eb478 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:21.050877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8db60c82-900a-4d25-9311-cbbd657eb478 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Old instance type m1.heat2, new instance type m1.heat {{(pid=137033) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 21:59:21.057740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-8db60c82-900a-4d25-9311-cbbd657eb478 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 21:59:21.058168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-8db60c82-900a-4d25-9311-cbbd657eb478 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 21:59:21.058647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-8db60c82-900a-4d25-9311-cbbd657eb478 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 21:59:21.059041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-8db60c82-900a-4d25-9311-cbbd657eb478 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 21:59:21.059457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-8db60c82-900a-4d25-9311-cbbd657eb478 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 21:59:21.274290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8db60c82-900a-4d25-9311-cbbd657eb478 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "POST /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7/action" status: 202 len: 0 microversion: 2.1 time: 0.269634 Jan 22 21:59:21.274923 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4113/8516] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:59:21 2022] POST /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 21:59:21.282851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-555e52ed-a6dc-49c1-8fbd-7fa7dac5961f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:21.283688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-555e52ed-a6dc-49c1-8fbd-7fa7dac5961f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:21.293408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-555e52ed-a6dc-49c1-8fbd-7fa7dac5961f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:21.293408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-555e52ed-a6dc-49c1-8fbd-7fa7dac5961f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:21.293408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-555e52ed-a6dc-49c1-8fbd-7fa7dac5961f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:21.293408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-555e52ed-a6dc-49c1-8fbd-7fa7dac5961f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:21.427753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-555e52ed-a6dc-49c1-8fbd-7fa7dac5961f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:21.436053 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-555e52ed-a6dc-49c1-8fbd-7fa7dac5961f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1519 microversion: 2.1 time: 0.156870 Jan 22 21:59:21.436629 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4404/8517] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:21 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:22.454429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-27a46bdb-3382-473e-b34b-6ddde33d973f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:22.455046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-27a46bdb-3382-473e-b34b-6ddde33d973f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:22.461739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27a46bdb-3382-473e-b34b-6ddde33d973f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:22.462234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27a46bdb-3382-473e-b34b-6ddde33d973f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:22.463042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27a46bdb-3382-473e-b34b-6ddde33d973f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:22.463490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27a46bdb-3382-473e-b34b-6ddde33d973f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:22.597742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-27a46bdb-3382-473e-b34b-6ddde33d973f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:22.606285 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-27a46bdb-3382-473e-b34b-6ddde33d973f tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1519 microversion: 2.1 time: 0.156565 Jan 22 21:59:22.606867 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4114/8518] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:22 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:23.626952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b601cd85-7098-4f6a-a0f2-07020b219898 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:23.628064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b601cd85-7098-4f6a-a0f2-07020b219898 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:23.636403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b601cd85-7098-4f6a-a0f2-07020b219898 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:23.636869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b601cd85-7098-4f6a-a0f2-07020b219898 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:23.637714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b601cd85-7098-4f6a-a0f2-07020b219898 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:23.638173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b601cd85-7098-4f6a-a0f2-07020b219898 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:23.958371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b601cd85-7098-4f6a-a0f2-07020b219898 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:23.966962 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b601cd85-7098-4f6a-a0f2-07020b219898 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1519 microversion: 2.1 time: 0.346016 Jan 22 21:59:23.967562 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4405/8519] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:23 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1519 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:24.987643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3f16bcb0-12c8-44a0-9826-402a393a3b72 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:24.988264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3f16bcb0-12c8-44a0-9826-402a393a3b72 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:24.995933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f16bcb0-12c8-44a0-9826-402a393a3b72 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:24.996383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f16bcb0-12c8-44a0-9826-402a393a3b72 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:24.997198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f16bcb0-12c8-44a0-9826-402a393a3b72 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:24.997678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3f16bcb0-12c8-44a0-9826-402a393a3b72 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:25.132867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3f16bcb0-12c8-44a0-9826-402a393a3b72 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:25.140417 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3f16bcb0-12c8-44a0-9826-402a393a3b72 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.156484 Jan 22 21:59:25.140988 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4115/8520] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:24 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:26.157603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c98c15b2-0c4e-41ee-b3f5-4ff03e62f412 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:26.158294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c98c15b2-0c4e-41ee-b3f5-4ff03e62f412 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:26.165018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c98c15b2-0c4e-41ee-b3f5-4ff03e62f412 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:26.165493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c98c15b2-0c4e-41ee-b3f5-4ff03e62f412 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:26.166328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c98c15b2-0c4e-41ee-b3f5-4ff03e62f412 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:26.166790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c98c15b2-0c4e-41ee-b3f5-4ff03e62f412 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:26.300174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c98c15b2-0c4e-41ee-b3f5-4ff03e62f412 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:26.308133 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c98c15b2-0c4e-41ee-b3f5-4ff03e62f412 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.154294 Jan 22 21:59:26.308709 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4406/8521] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:26 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:27.324952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a92e0828-76b1-4bd7-8927-109dd135cfb2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:27.325545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a92e0828-76b1-4bd7-8927-109dd135cfb2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:27.332412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a92e0828-76b1-4bd7-8927-109dd135cfb2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:27.332877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a92e0828-76b1-4bd7-8927-109dd135cfb2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:27.333707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a92e0828-76b1-4bd7-8927-109dd135cfb2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:27.334164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a92e0828-76b1-4bd7-8927-109dd135cfb2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:27.468095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a92e0828-76b1-4bd7-8927-109dd135cfb2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:27.475570 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a92e0828-76b1-4bd7-8927-109dd135cfb2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.154603 Jan 22 21:59:27.476676 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4116/8522] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:27 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:28.493326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-20b3c113-fa3f-4869-926f-efe9c305f28e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:28.493960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-20b3c113-fa3f-4869-926f-efe9c305f28e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:28.500985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20b3c113-fa3f-4869-926f-efe9c305f28e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:28.501451 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20b3c113-fa3f-4869-926f-efe9c305f28e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:28.502280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20b3c113-fa3f-4869-926f-efe9c305f28e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:28.502733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-20b3c113-fa3f-4869-926f-efe9c305f28e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:28.637045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-20b3c113-fa3f-4869-926f-efe9c305f28e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:28.644432 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-20b3c113-fa3f-4869-926f-efe9c305f28e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.154942 Jan 22 21:59:28.644940 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4407/8523] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:28 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:29.661416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-87db5b05-fb0b-47e6-8ae7-98fac41f6205 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:29.662037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-87db5b05-fb0b-47e6-8ae7-98fac41f6205 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:29.669433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87db5b05-fb0b-47e6-8ae7-98fac41f6205 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:29.676184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87db5b05-fb0b-47e6-8ae7-98fac41f6205 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:29.676184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87db5b05-fb0b-47e6-8ae7-98fac41f6205 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:29.676184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87db5b05-fb0b-47e6-8ae7-98fac41f6205 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:29.807948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-87db5b05-fb0b-47e6-8ae7-98fac41f6205 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:29.815444 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-87db5b05-fb0b-47e6-8ae7-98fac41f6205 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.157893 Jan 22 21:59:29.816022 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4117/8524] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:29 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:30.832789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-232879b0-7cf2-451f-9b17-8f5028ccab44 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:30.833406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-232879b0-7cf2-451f-9b17-8f5028ccab44 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:30.840330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-232879b0-7cf2-451f-9b17-8f5028ccab44 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:30.840803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-232879b0-7cf2-451f-9b17-8f5028ccab44 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:30.841631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-232879b0-7cf2-451f-9b17-8f5028ccab44 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:30.842084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-232879b0-7cf2-451f-9b17-8f5028ccab44 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:30.972047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-232879b0-7cf2-451f-9b17-8f5028ccab44 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:30.979592 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-232879b0-7cf2-451f-9b17-8f5028ccab44 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.150544 Jan 22 21:59:30.980177 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4408/8525] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:30 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:31.996942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c532802a-c68a-4e73-a25f-a03313092616 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:31.997609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c532802a-c68a-4e73-a25f-a03313092616 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:32.004368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c532802a-c68a-4e73-a25f-a03313092616 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:32.004821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c532802a-c68a-4e73-a25f-a03313092616 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:32.005628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c532802a-c68a-4e73-a25f-a03313092616 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:32.006074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c532802a-c68a-4e73-a25f-a03313092616 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:32.140537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c532802a-c68a-4e73-a25f-a03313092616 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:32.148693 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c532802a-c68a-4e73-a25f-a03313092616 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.155050 Jan 22 21:59:32.149427 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4118/8526] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:31 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:33.166579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ec88d875-1269-4713-ac4c-02fbea9e5394 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:33.167212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ec88d875-1269-4713-ac4c-02fbea9e5394 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:33.173981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec88d875-1269-4713-ac4c-02fbea9e5394 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:33.174453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec88d875-1269-4713-ac4c-02fbea9e5394 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:33.175253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec88d875-1269-4713-ac4c-02fbea9e5394 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:33.175709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec88d875-1269-4713-ac4c-02fbea9e5394 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:33.313603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ec88d875-1269-4713-ac4c-02fbea9e5394 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:33.321709 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ec88d875-1269-4713-ac4c-02fbea9e5394 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.159852 Jan 22 21:59:33.322283 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4409/8527] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:33 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:34.339092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-da64ecd6-1c1a-4c18-94c8-1f3732bed73d tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:34.339734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-da64ecd6-1c1a-4c18-94c8-1f3732bed73d tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:34.346536 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da64ecd6-1c1a-4c18-94c8-1f3732bed73d tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:34.347007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da64ecd6-1c1a-4c18-94c8-1f3732bed73d tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:34.347805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da64ecd6-1c1a-4c18-94c8-1f3732bed73d tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:34.348255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-da64ecd6-1c1a-4c18-94c8-1f3732bed73d tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:34.483854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-da64ecd6-1c1a-4c18-94c8-1f3732bed73d tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:34.491321 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-da64ecd6-1c1a-4c18-94c8-1f3732bed73d tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.156456 Jan 22 21:59:34.492394 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4119/8528] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:34 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:35.509108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ccb10425-5f17-432d-9d0e-9d852d3158a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:35.509775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ccb10425-5f17-432d-9d0e-9d852d3158a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:35.516569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccb10425-5f17-432d-9d0e-9d852d3158a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:35.517041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccb10425-5f17-432d-9d0e-9d852d3158a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:35.517879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccb10425-5f17-432d-9d0e-9d852d3158a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:35.518341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccb10425-5f17-432d-9d0e-9d852d3158a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:35.651697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ccb10425-5f17-432d-9d0e-9d852d3158a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:35.659085 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ccb10425-5f17-432d-9d0e-9d852d3158a7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.154328 Jan 22 21:59:35.659659 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4410/8529] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:35 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:36.676089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-94a3a800-4f30-4de9-ba6c-c179cfee1365 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:36.676649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-94a3a800-4f30-4de9-ba6c-c179cfee1365 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:36.683518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94a3a800-4f30-4de9-ba6c-c179cfee1365 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:36.683974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94a3a800-4f30-4de9-ba6c-c179cfee1365 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:36.684756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94a3a800-4f30-4de9-ba6c-c179cfee1365 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:36.685196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-94a3a800-4f30-4de9-ba6c-c179cfee1365 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:36.819364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-94a3a800-4f30-4de9-ba6c-c179cfee1365 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:36.827392 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-94a3a800-4f30-4de9-ba6c-c179cfee1365 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.155143 Jan 22 21:59:36.827970 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4120/8530] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:36 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:37.843552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-de5b59a9-bfe1-48fa-b41e-557cfefe1b7e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:37.844186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-de5b59a9-bfe1-48fa-b41e-557cfefe1b7e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:37.851029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5b59a9-bfe1-48fa-b41e-557cfefe1b7e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:37.852245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5b59a9-bfe1-48fa-b41e-557cfefe1b7e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:37.853056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5b59a9-bfe1-48fa-b41e-557cfefe1b7e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:37.853537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-de5b59a9-bfe1-48fa-b41e-557cfefe1b7e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:37.990183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-de5b59a9-bfe1-48fa-b41e-557cfefe1b7e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:38.002776 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-de5b59a9-bfe1-48fa-b41e-557cfefe1b7e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.162640 Jan 22 21:59:38.003861 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4411/8531] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:37 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:39.019543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-61131cc1-4750-4728-99ba-ebdb8214aec1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:39.020181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-61131cc1-4750-4728-99ba-ebdb8214aec1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:39.027027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61131cc1-4750-4728-99ba-ebdb8214aec1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:39.027487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61131cc1-4750-4728-99ba-ebdb8214aec1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:39.028283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61131cc1-4750-4728-99ba-ebdb8214aec1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:39.028739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61131cc1-4750-4728-99ba-ebdb8214aec1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:39.160064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-61131cc1-4750-4728-99ba-ebdb8214aec1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:39.167469 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-61131cc1-4750-4728-99ba-ebdb8214aec1 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.151626 Jan 22 21:59:39.168037 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4121/8532] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:39 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:40.184710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-abfe1fef-2dad-48bd-9c1e-a3bcb7d679c5 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:40.185399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-abfe1fef-2dad-48bd-9c1e-a3bcb7d679c5 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:40.192585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abfe1fef-2dad-48bd-9c1e-a3bcb7d679c5 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:40.194053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abfe1fef-2dad-48bd-9c1e-a3bcb7d679c5 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:40.194053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abfe1fef-2dad-48bd-9c1e-a3bcb7d679c5 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:40.194420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abfe1fef-2dad-48bd-9c1e-a3bcb7d679c5 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:40.335044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-abfe1fef-2dad-48bd-9c1e-a3bcb7d679c5 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:40.344290 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-abfe1fef-2dad-48bd-9c1e-a3bcb7d679c5 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.163298 Jan 22 21:59:40.344861 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4412/8533] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:40 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:41.362165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b59399b2-abcb-4d26-8cf0-31de685eab5b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:41.362715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b59399b2-abcb-4d26-8cf0-31de685eab5b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:41.370022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b59399b2-abcb-4d26-8cf0-31de685eab5b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:41.370483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b59399b2-abcb-4d26-8cf0-31de685eab5b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:41.371309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b59399b2-abcb-4d26-8cf0-31de685eab5b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:41.371760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b59399b2-abcb-4d26-8cf0-31de685eab5b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:41.510972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b59399b2-abcb-4d26-8cf0-31de685eab5b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:41.518435 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b59399b2-abcb-4d26-8cf0-31de685eab5b tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.160321 Jan 22 21:59:41.519017 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4122/8534] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:41 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:42.536354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d9e08df4-62f3-4b4d-bfce-4bdf74908b6c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:42.536984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d9e08df4-62f3-4b4d-bfce-4bdf74908b6c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:42.544428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9e08df4-62f3-4b4d-bfce-4bdf74908b6c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:42.544896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9e08df4-62f3-4b4d-bfce-4bdf74908b6c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:42.545726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9e08df4-62f3-4b4d-bfce-4bdf74908b6c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:42.546180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d9e08df4-62f3-4b4d-bfce-4bdf74908b6c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:42.676076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d9e08df4-62f3-4b4d-bfce-4bdf74908b6c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:42.683459 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d9e08df4-62f3-4b4d-bfce-4bdf74908b6c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.151123 Jan 22 21:59:42.684024 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4413/8535] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:42 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:43.700322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-212ee170-e78d-476d-a5b7-b8312bd52d83 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:43.700913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-212ee170-e78d-476d-a5b7-b8312bd52d83 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:43.707829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-212ee170-e78d-476d-a5b7-b8312bd52d83 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:43.708283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-212ee170-e78d-476d-a5b7-b8312bd52d83 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:43.709060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-212ee170-e78d-476d-a5b7-b8312bd52d83 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:43.709522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-212ee170-e78d-476d-a5b7-b8312bd52d83 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:43.843735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-212ee170-e78d-476d-a5b7-b8312bd52d83 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:43.851726 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-212ee170-e78d-476d-a5b7-b8312bd52d83 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.154545 Jan 22 21:59:43.852295 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4123/8536] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:43 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:44.868795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bd78d468-9cb7-4754-97ab-9bcdea927b0e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:44.869446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bd78d468-9cb7-4754-97ab-9bcdea927b0e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:44.876330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd78d468-9cb7-4754-97ab-9bcdea927b0e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:44.876802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd78d468-9cb7-4754-97ab-9bcdea927b0e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:44.877616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd78d468-9cb7-4754-97ab-9bcdea927b0e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:44.878073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd78d468-9cb7-4754-97ab-9bcdea927b0e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:45.010809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bd78d468-9cb7-4754-97ab-9bcdea927b0e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:45.018273 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bd78d468-9cb7-4754-97ab-9bcdea927b0e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.153546 Jan 22 21:59:45.018846 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4414/8537] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:44 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:46.035915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8d5b6965-f397-4666-9087-a364202a35ac tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:46.036511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8d5b6965-f397-4666-9087-a364202a35ac tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:46.043684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d5b6965-f397-4666-9087-a364202a35ac tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:46.044142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d5b6965-f397-4666-9087-a364202a35ac tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:46.044929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d5b6965-f397-4666-9087-a364202a35ac tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:46.045376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d5b6965-f397-4666-9087-a364202a35ac tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:46.176463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8d5b6965-f397-4666-9087-a364202a35ac tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:46.184403 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8d5b6965-f397-4666-9087-a364202a35ac tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.152238 Jan 22 21:59:46.185191 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4124/8538] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:46 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:47.201160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8a07c526-f80a-45c4-97a8-b68b7437bed7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:47.201822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8a07c526-f80a-45c4-97a8-b68b7437bed7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:47.208621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a07c526-f80a-45c4-97a8-b68b7437bed7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:47.209096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a07c526-f80a-45c4-97a8-b68b7437bed7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:47.209933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a07c526-f80a-45c4-97a8-b68b7437bed7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:47.211044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a07c526-f80a-45c4-97a8-b68b7437bed7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:47.341858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8a07c526-f80a-45c4-97a8-b68b7437bed7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:47.349352 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8a07c526-f80a-45c4-97a8-b68b7437bed7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.151913 Jan 22 21:59:47.349969 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4415/8539] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:47 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:48.367588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c51508a9-5f12-4e6e-823b-57343d861d4e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:48.368228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c51508a9-5f12-4e6e-823b-57343d861d4e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:48.375496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c51508a9-5f12-4e6e-823b-57343d861d4e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:48.376021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c51508a9-5f12-4e6e-823b-57343d861d4e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:48.376814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c51508a9-5f12-4e6e-823b-57343d861d4e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:48.377281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c51508a9-5f12-4e6e-823b-57343d861d4e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:48.515443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c51508a9-5f12-4e6e-823b-57343d861d4e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:48.523378 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c51508a9-5f12-4e6e-823b-57343d861d4e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.160262 Jan 22 21:59:48.523969 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4125/8540] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:48 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:49.540001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ebe98b1c-10a3-4207-a923-ca59d1ddc406 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:49.540629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ebe98b1c-10a3-4207-a923-ca59d1ddc406 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:49.547398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebe98b1c-10a3-4207-a923-ca59d1ddc406 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:49.547870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebe98b1c-10a3-4207-a923-ca59d1ddc406 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:49.548677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebe98b1c-10a3-4207-a923-ca59d1ddc406 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:49.549140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebe98b1c-10a3-4207-a923-ca59d1ddc406 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:49.677139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ebe98b1c-10a3-4207-a923-ca59d1ddc406 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:49.685912 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ebe98b1c-10a3-4207-a923-ca59d1ddc406 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.150135 Jan 22 21:59:49.686491 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4416/8541] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:49 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:50.703040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0577dde7-db0e-44f5-ba19-4a58e9789784 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:50.703623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0577dde7-db0e-44f5-ba19-4a58e9789784 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:50.710989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0577dde7-db0e-44f5-ba19-4a58e9789784 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:50.711460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0577dde7-db0e-44f5-ba19-4a58e9789784 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:50.712237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0577dde7-db0e-44f5-ba19-4a58e9789784 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:50.712675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0577dde7-db0e-44f5-ba19-4a58e9789784 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:50.845182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0577dde7-db0e-44f5-ba19-4a58e9789784 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:50.853280 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0577dde7-db0e-44f5-ba19-4a58e9789784 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1524 microversion: 2.1 time: 0.154047 Jan 22 21:59:50.853880 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4126/8542] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:50 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1524 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:51.870426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5a82deba-c270-4e27-8a51-77d0c5a4a934 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:51.871055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5a82deba-c270-4e27-8a51-77d0c5a4a934 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:51.877883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a82deba-c270-4e27-8a51-77d0c5a4a934 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:51.878351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a82deba-c270-4e27-8a51-77d0c5a4a934 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:51.879159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a82deba-c270-4e27-8a51-77d0c5a4a934 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:51.879645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5a82deba-c270-4e27-8a51-77d0c5a4a934 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:52.016667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5a82deba-c270-4e27-8a51-77d0c5a4a934 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:52.024953 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5a82deba-c270-4e27-8a51-77d0c5a4a934 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1523 microversion: 2.1 time: 0.159126 Jan 22 21:59:52.025587 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4417/8543] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:51 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:52.266993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-5d4eb583-233c-4450-a7a7-43ae566d0d86 req-438f9b7a-7b4f-45d2-8161-04e1903ec8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68937473-4a69-4fa4-a153-62adfafa1bd7", "name": "network-vif-unplugged", "status": "completed", "tag": "84c2392a-842a-4fc6-8219-d10b71945484"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:59:52.268530 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:59:52.268530 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:59:52.277176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5d4eb583-233c-4450-a7a7-43ae566d0d86 req-438f9b7a-7b4f-45d2-8161-04e1903ec8e9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:52.277830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5d4eb583-233c-4450-a7a7-43ae566d0d86 req-438f9b7a-7b4f-45d2-8161-04e1903ec8e9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:52.292548 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-5d4eb583-233c-4450-a7a7-43ae566d0d86 req-438f9b7a-7b4f-45d2-8161-04e1903ec8e9 service nova] Creating event network-vif-unplugged:84c2392a-842a-4fc6-8219-d10b71945484 for instance 68937473-4a69-4fa4-a153-62adfafa1bd7 on nch1-master-1 Jan 22 21:59:52.297859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-5d4eb583-233c-4450-a7a7-43ae566d0d86 req-438f9b7a-7b4f-45d2-8161-04e1903ec8e9 service nova] Instance 68937473-4a69-4fa4-a153-62adfafa1bd7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:59:52.308791 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-5d4eb583-233c-4450-a7a7-43ae566d0d86 req-438f9b7a-7b4f-45d2-8161-04e1903ec8e9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045480 Jan 22 21:59:52.309395 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4127/8544] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 21:59:53.042746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-77e2e913-7ac2-4d08-aab0-853f3141fef8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:53.043421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-77e2e913-7ac2-4d08-aab0-853f3141fef8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:53.050535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77e2e913-7ac2-4d08-aab0-853f3141fef8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:53.051015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77e2e913-7ac2-4d08-aab0-853f3141fef8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:53.051829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77e2e913-7ac2-4d08-aab0-853f3141fef8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:53.052321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77e2e913-7ac2-4d08-aab0-853f3141fef8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:53.192553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-77e2e913-7ac2-4d08-aab0-853f3141fef8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:53.200850 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-77e2e913-7ac2-4d08-aab0-853f3141fef8 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1523 microversion: 2.1 time: 0.162184 Jan 22 21:59:53.201422 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4418/8545] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:53 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:53.871128 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 21:59:53.871760 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 21:59:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 21:59:54.219242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6a663a9d-8a2f-4976-a290-fbb83471d0c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:54.219862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6a663a9d-8a2f-4976-a290-fbb83471d0c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:54.228639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a663a9d-8a2f-4976-a290-fbb83471d0c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:54.229178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a663a9d-8a2f-4976-a290-fbb83471d0c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:54.230013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a663a9d-8a2f-4976-a290-fbb83471d0c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:54.230467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6a663a9d-8a2f-4976-a290-fbb83471d0c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:54.331171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-6911b3dd-5981-4eec-98e7-cac1e08d9445 req-639207bb-bd32-4d23-a8da-00e62280d3ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68937473-4a69-4fa4-a153-62adfafa1bd7", "tag": "84c2392a-842a-4fc6-8219-d10b71945484"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:59:54.333190 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:59:54.333190 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 21:59:54.342384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6911b3dd-5981-4eec-98e7-cac1e08d9445 req-639207bb-bd32-4d23-a8da-00e62280d3ce service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:54.345354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6911b3dd-5981-4eec-98e7-cac1e08d9445 req-639207bb-bd32-4d23-a8da-00e62280d3ce service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:54.357329 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-6911b3dd-5981-4eec-98e7-cac1e08d9445 req-639207bb-bd32-4d23-a8da-00e62280d3ce service nova] Creating event network-changed:84c2392a-842a-4fc6-8219-d10b71945484 for instance 68937473-4a69-4fa4-a153-62adfafa1bd7 on nch1-master-1 Jan 22 21:59:54.363030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-6911b3dd-5981-4eec-98e7-cac1e08d9445 req-639207bb-bd32-4d23-a8da-00e62280d3ce service nova] Instance 68937473-4a69-4fa4-a153-62adfafa1bd7 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 21:59:54.373402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6a663a9d-8a2f-4976-a290-fbb83471d0c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:54.375919 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-6911b3dd-5981-4eec-98e7-cac1e08d9445 req-639207bb-bd32-4d23-a8da-00e62280d3ce service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048383 Jan 22 21:59:54.377344 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4419/8546] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:59:54.381985 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6a663a9d-8a2f-4976-a290-fbb83471d0c2 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1521 microversion: 2.1 time: 0.167515 Jan 22 21:59:54.382623 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4128/8547] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:54 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:55.400308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3b724ffd-2bf8-4abb-9ee3-b2c6b64fc05a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:55.401039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3b724ffd-2bf8-4abb-9ee3-b2c6b64fc05a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:55.414997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b724ffd-2bf8-4abb-9ee3-b2c6b64fc05a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:55.415571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b724ffd-2bf8-4abb-9ee3-b2c6b64fc05a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:55.416341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b724ffd-2bf8-4abb-9ee3-b2c6b64fc05a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:55.416801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3b724ffd-2bf8-4abb-9ee3-b2c6b64fc05a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:55.565055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3b724ffd-2bf8-4abb-9ee3-b2c6b64fc05a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:55.573225 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3b724ffd-2bf8-4abb-9ee3-b2c6b64fc05a tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1521 microversion: 2.1 time: 0.177595 Jan 22 21:59:55.573836 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4420/8548] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:55 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:56.591138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7339ddf3-9ae0-4903-9aad-65acb85857d3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:56.591786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7339ddf3-9ae0-4903-9aad-65acb85857d3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:56.598702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7339ddf3-9ae0-4903-9aad-65acb85857d3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:56.599160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7339ddf3-9ae0-4903-9aad-65acb85857d3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:56.599944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7339ddf3-9ae0-4903-9aad-65acb85857d3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:56.601161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7339ddf3-9ae0-4903-9aad-65acb85857d3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:56.743510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7339ddf3-9ae0-4903-9aad-65acb85857d3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:56.750997 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7339ddf3-9ae0-4903-9aad-65acb85857d3 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1518 microversion: 2.1 time: 0.163653 Jan 22 21:59:56.751555 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4129/8549] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:56 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:56.767077 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7b4cad4f-0ca2-4bc7-a331-b8cd54408546 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:59:56.767637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7b4cad4f-0ca2-4bc7-a331-b8cd54408546 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:56.775149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b4cad4f-0ca2-4bc7-a331-b8cd54408546 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:56.775630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b4cad4f-0ca2-4bc7-a331-b8cd54408546 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:56.776444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b4cad4f-0ca2-4bc7-a331-b8cd54408546 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:56.776899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b4cad4f-0ca2-4bc7-a331-b8cd54408546 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:56.987501 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7b4cad4f-0ca2-4bc7-a331-b8cd54408546 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "POST /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7/action" status: 204 len: 0 microversion: 2.1 time: 0.223885 Jan 22 21:59:56.988095 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4421/8550] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 21:59:56 2022] POST /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7/action => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 21:59:56.996489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a1a8ef08-80b6-45f0-8798-2439c475a540 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:57.004224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a1a8ef08-80b6-45f0-8798-2439c475a540 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:57.004224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1a8ef08-80b6-45f0-8798-2439c475a540 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:57.004224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1a8ef08-80b6-45f0-8798-2439c475a540 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:57.004903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1a8ef08-80b6-45f0-8798-2439c475a540 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:57.005346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a1a8ef08-80b6-45f0-8798-2439c475a540 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:57.137897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a1a8ef08-80b6-45f0-8798-2439c475a540 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:57.145537 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a1a8ef08-80b6-45f0-8798-2439c475a540 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1518 microversion: 2.1 time: 0.153008 Jan 22 21:59:57.146116 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4130/8551] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:56 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:58.164951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3ee3fa9d-3378-448c-ae2f-aa055f01820c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:58.166297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3ee3fa9d-3378-448c-ae2f-aa055f01820c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:58.172833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ee3fa9d-3378-448c-ae2f-aa055f01820c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:58.173306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ee3fa9d-3378-448c-ae2f-aa055f01820c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:58.174151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ee3fa9d-3378-448c-ae2f-aa055f01820c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:58.175324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3ee3fa9d-3378-448c-ae2f-aa055f01820c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:58.338807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3ee3fa9d-3378-448c-ae2f-aa055f01820c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:58.346313 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3ee3fa9d-3378-448c-ae2f-aa055f01820c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1518 microversion: 2.1 time: 0.186970 Jan 22 21:59:58.350165 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4422/8552] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:58 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:59.363627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e9f02e50-c970-452c-99d3-9693af911fcf tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:59.364203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e9f02e50-c970-452c-99d3-9693af911fcf tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:59.372156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9f02e50-c970-452c-99d3-9693af911fcf tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:59.372651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9f02e50-c970-452c-99d3-9693af911fcf tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:59.373456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9f02e50-c970-452c-99d3-9693af911fcf tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:59.373935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9f02e50-c970-452c-99d3-9693af911fcf tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:59.516971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e9f02e50-c970-452c-99d3-9693af911fcf tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:59.524718 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e9f02e50-c970-452c-99d3-9693af911fcf tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1510 microversion: 2.1 time: 0.164829 Jan 22 21:59:59.525298 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4131/8553] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:59 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 21:59:59.541810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c981d7ff-e9d2-41e5-b7cb-6083262d1e47 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:59.542771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c981d7ff-e9d2-41e5-b7cb-6083262d1e47 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:59.549346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c981d7ff-e9d2-41e5-b7cb-6083262d1e47 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:59.549905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c981d7ff-e9d2-41e5-b7cb-6083262d1e47 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:59.552397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c981d7ff-e9d2-41e5-b7cb-6083262d1e47 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:59.552397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c981d7ff-e9d2-41e5-b7cb-6083262d1e47 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:59.604789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-fae1f9b6-4ae0-459c-b668-83283a4b2052 req-77ad2b9c-419b-4cca-a75a-03266e0b3060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68937473-4a69-4fa4-a153-62adfafa1bd7", "name": "network-vif-plugged", "status": "completed", "tag": "84c2392a-842a-4fc6-8219-d10b71945484"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 21:59:59.606745 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 21:59:59.606745 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 21:59:59.614218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fae1f9b6-4ae0-459c-b668-83283a4b2052 req-77ad2b9c-419b-4cca-a75a-03266e0b3060 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:59.614642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fae1f9b6-4ae0-459c-b668-83283a4b2052 req-77ad2b9c-419b-4cca-a75a-03266e0b3060 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:59.628865 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-fae1f9b6-4ae0-459c-b668-83283a4b2052 req-77ad2b9c-419b-4cca-a75a-03266e0b3060 service nova] Creating event network-vif-plugged:84c2392a-842a-4fc6-8219-d10b71945484 for instance 68937473-4a69-4fa4-a153-62adfafa1bd7 on nch1-master-1 Jan 22 21:59:59.634612 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-fae1f9b6-4ae0-459c-b668-83283a4b2052 req-77ad2b9c-419b-4cca-a75a-03266e0b3060 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034205 Jan 22 21:59:59.635662 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4132/8554] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 21:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 21:59:59.685565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c981d7ff-e9d2-41e5-b7cb-6083262d1e47 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:59.693134 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c981d7ff-e9d2-41e5-b7cb-6083262d1e47 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1510 microversion: 2.1 time: 0.155826 Jan 22 21:59:59.693730 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4423/8555] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:59 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:59.709485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0437fe2f-906d-4939-ae76-c8aa1dbd08fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:59.711043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0437fe2f-906d-4939-ae76-c8aa1dbd08fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:59.717113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0437fe2f-906d-4939-ae76-c8aa1dbd08fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:59.717599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0437fe2f-906d-4939-ae76-c8aa1dbd08fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:59.718390 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0437fe2f-906d-4939-ae76-c8aa1dbd08fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:59.718827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0437fe2f-906d-4939-ae76-c8aa1dbd08fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:59.847472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0437fe2f-906d-4939-ae76-c8aa1dbd08fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 21:59:59.855590 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0437fe2f-906d-4939-ae76-c8aa1dbd08fa tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1510 microversion: 2.1 time: 0.150397 Jan 22 21:59:59.856152 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4133/8556] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 21:59:59 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 21:59:59.871744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6095338a-5c02-43ac-bdb4-8467b7601c70 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 21:59:59.872234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6095338a-5c02-43ac-bdb4-8467b7601c70 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 21:59:59.878224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6095338a-5c02-43ac-bdb4-8467b7601c70 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:59.878700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6095338a-5c02-43ac-bdb4-8467b7601c70 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:59.879504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6095338a-5c02-43ac-bdb4-8467b7601c70 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 21:59:59.879963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6095338a-5c02-43ac-bdb4-8467b7601c70 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 21:59:59.905309 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6095338a-5c02-43ac-bdb4-8467b7601c70 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:00:00.182255 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6095338a-5c02-43ac-bdb4-8467b7601c70 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "DELETE /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 204 len: 0 microversion: 2.1 time: 0.314165 Jan 22 22:00:00.182767 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4424/8557] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 21:59:59 2022] DELETE /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 22:00:00.201138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-83542ff8-41b2-4844-8037-fd91c5bac81c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:00.201673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-83542ff8-41b2-4844-8037-fd91c5bac81c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:00.207748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83542ff8-41b2-4844-8037-fd91c5bac81c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:00.208359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83542ff8-41b2-4844-8037-fd91c5bac81c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:00.209156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83542ff8-41b2-4844-8037-fd91c5bac81c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:00.210260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83542ff8-41b2-4844-8037-fd91c5bac81c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:00.240644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-83542ff8-41b2-4844-8037-fd91c5bac81c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:00:00.289363 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.compute.api [None req-83542ff8-41b2-4844-8037-fd91c5bac81c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Instance is already in deleting state, ignoring this request Jan 22 22:00:00.290223 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-83542ff8-41b2-4844-8037-fd91c5bac81c tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "DELETE /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 204 len: 0 microversion: 2.1 time: 0.093525 Jan 22 22:00:00.290782 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4134/8558] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:00:00 2022] DELETE /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:00:00.299127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6bf45676-7f0f-4618-8769-9345190722e7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:00.299872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6bf45676-7f0f-4618-8769-9345190722e7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:00.306492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bf45676-7f0f-4618-8769-9345190722e7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:00.306961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bf45676-7f0f-4618-8769-9345190722e7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:00.307762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bf45676-7f0f-4618-8769-9345190722e7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:00.308219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bf45676-7f0f-4618-8769-9345190722e7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:00.445376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6bf45676-7f0f-4618-8769-9345190722e7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:00:00.452915 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6bf45676-7f0f-4618-8769-9345190722e7 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1516 microversion: 2.1 time: 0.157778 Jan 22 22:00:00.453520 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4425/8559] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:00 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:00:01.469942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-34413ace-554e-4300-8938-2c7c613d3830 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:01.470575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-34413ace-554e-4300-8938-2c7c613d3830 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:01.478895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34413ace-554e-4300-8938-2c7c613d3830 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:01.479388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34413ace-554e-4300-8938-2c7c613d3830 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:01.480196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34413ace-554e-4300-8938-2c7c613d3830 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:01.480644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-34413ace-554e-4300-8938-2c7c613d3830 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:01.612783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-34413ace-554e-4300-8938-2c7c613d3830 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:00:01.620740 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-34413ace-554e-4300-8938-2c7c613d3830 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1516 microversion: 2.1 time: 0.154576 Jan 22 22:00:01.621326 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4135/8560] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:01 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:00:02.210822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-9ca29113-8615-4165-91b1-89dca525cea2 req-740f2e23-283e-4f5d-85ed-337fde3f632e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68937473-4a69-4fa4-a153-62adfafa1bd7", "name": "network-vif-deleted", "tag": "84c2392a-842a-4fc6-8219-d10b71945484"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:02.212393 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:00:02.212393 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:00:02.223848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9ca29113-8615-4165-91b1-89dca525cea2 req-740f2e23-283e-4f5d-85ed-337fde3f632e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:02.231611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9ca29113-8615-4165-91b1-89dca525cea2 req-740f2e23-283e-4f5d-85ed-337fde3f632e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:02.235997 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-9ca29113-8615-4165-91b1-89dca525cea2 req-740f2e23-283e-4f5d-85ed-337fde3f632e service nova] Creating event network-vif-deleted:84c2392a-842a-4fc6-8219-d10b71945484 for instance 68937473-4a69-4fa4-a153-62adfafa1bd7 on nch1-master-1 Jan 22 22:00:02.240963 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-9ca29113-8615-4165-91b1-89dca525cea2 req-740f2e23-283e-4f5d-85ed-337fde3f632e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033830 Jan 22 22:00:02.241593 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4426/8561] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:00:02.641208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fd72924e-a8ed-435f-ad3e-0ee5ede9287e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:02.641782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fd72924e-a8ed-435f-ad3e-0ee5ede9287e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:02.649138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd72924e-a8ed-435f-ad3e-0ee5ede9287e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:02.649865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd72924e-a8ed-435f-ad3e-0ee5ede9287e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:02.650715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd72924e-a8ed-435f-ad3e-0ee5ede9287e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:02.651199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd72924e-a8ed-435f-ad3e-0ee5ede9287e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:02.687247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd72924e-a8ed-435f-ad3e-0ee5ede9287e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:02.687708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fd72924e-a8ed-435f-ad3e-0ee5ede9287e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:02.688170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-fd72924e-a8ed-435f-ad3e-0ee5ede9287e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lazy-loading 'fault' on Instance uuid 68937473-4a69-4fa4-a153-62adfafa1bd7 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 22:00:02.730176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fd72924e-a8ed-435f-ad3e-0ee5ede9287e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db0a2ad45bb48fdbaf9e0cb2da999ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebad5df743954fcfbcbabe08f9049b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:00:02.737679 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fd72924e-a8ed-435f-ad3e-0ee5ede9287e tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 200 len: 1310 microversion: 2.1 time: 0.100210 Jan 22 22:00:02.738258 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4136/8562] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:02 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:00:03.758865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-697e3d83-1c34-42be-81b0-417385850ded tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:03.759574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-697e3d83-1c34-42be-81b0-417385850ded tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 68937473-4a69-4fa4-a153-62adfafa1bd7] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:03.766651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-697e3d83-1c34-42be-81b0-417385850ded tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:03.767127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-697e3d83-1c34-42be-81b0-417385850ded tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:03.767940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-697e3d83-1c34-42be-81b0-417385850ded tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:03.768403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-697e3d83-1c34-42be-81b0-417385850ded tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:03.784140 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-697e3d83-1c34-42be-81b0-417385850ded tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] HTTP exception thrown: Instance 68937473-4a69-4fa4-a153-62adfafa1bd7 could not be found. Jan 22 22:00:03.784754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-697e3d83-1c34-42be-81b0-417385850ded tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Returning 404 to user: Instance 68937473-4a69-4fa4-a153-62adfafa1bd7 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:00:03.789657 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-697e3d83-1c34-42be-81b0-417385850ded tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7" status: 404 len: 111 microversion: 2.1 time: 0.031244 Jan 22 22:00:03.789657 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4427/8563] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:03 2022] GET /compute/v2.1/servers/68937473-4a69-4fa4-a153-62adfafa1bd7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:00:03.794903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e267568c-38a2-4d6a-8dce-162c9b5f1436 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:03.795397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e267568c-38a2-4d6a-8dce-162c9b5f1436 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:03.802283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e267568c-38a2-4d6a-8dce-162c9b5f1436 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:03.802741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e267568c-38a2-4d6a-8dce-162c9b5f1436 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:03.803526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e267568c-38a2-4d6a-8dce-162c9b5f1436 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:03.803968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e267568c-38a2-4d6a-8dce-162c9b5f1436 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:03.818185 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-e267568c-38a2-4d6a-8dce-162c9b5f1436 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] HTTP exception thrown: Instance 32273408-e773-477a-8fff-660c0ad6cff6 could not be found. Jan 22 22:00:03.818775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e267568c-38a2-4d6a-8dce-162c9b5f1436 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Returning 404 to user: Instance 32273408-e773-477a-8fff-660c0ad6cff6 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:00:03.819598 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e267568c-38a2-4d6a-8dce-162c9b5f1436 tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "DELETE /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 404 len: 111 microversion: 2.1 time: 0.028424 Jan 22 22:00:03.820125 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4137/8564] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:00:03 2022] DELETE /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:00:03.830009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d41341b-53a2-4aae-9fae-a721c8ec2eae tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:03.830639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d41341b-53a2-4aae-9fae-a721c8ec2eae tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] [instance: 32273408-e773-477a-8fff-660c0ad6cff6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:03.836670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d41341b-53a2-4aae-9fae-a721c8ec2eae tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:03.837137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d41341b-53a2-4aae-9fae-a721c8ec2eae tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:03.837975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d41341b-53a2-4aae-9fae-a721c8ec2eae tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:03.838438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d41341b-53a2-4aae-9fae-a721c8ec2eae tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:03.852569 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-0d41341b-53a2-4aae-9fae-a721c8ec2eae tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] HTTP exception thrown: Instance 32273408-e773-477a-8fff-660c0ad6cff6 could not be found. Jan 22 22:00:03.853179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d41341b-53a2-4aae-9fae-a721c8ec2eae tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] Returning 404 to user: Instance 32273408-e773-477a-8fff-660c0ad6cff6 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:00:03.854058 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d41341b-53a2-4aae-9fae-a721c8ec2eae tempest-ServerDiskConfigTestJSON-813776305 tempest-ServerDiskConfigTestJSON-813776305-project] 10.222.0.100 "GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6" status: 404 len: 111 microversion: 2.1 time: 0.027725 Jan 22 22:00:03.854600 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4428/8565] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:03 2022] GET /compute/v2.1/servers/32273408-e773-477a-8fff-660c0ad6cff6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:00:11.836049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f866bfde-5140-45d5-9a08-178ec4859424 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'create', calling method: .version_select at 0x7f1ed4e9ac10>, body: {"keypair": {"name": "tempest-keypair-908140357"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:11.853818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-f866bfde-5140-45d5-9a08-178ec4859424 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for project af530edb3b084c18bf5595f46cffdf35. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:00:11.859342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-f866bfde-5140-45d5-9a08-178ec4859424 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for user d51f7a75cf6144f0b3bf7e63fcea6827 and project af530edb3b084c18bf5595f46cffdf35. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:00:12.560135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-f866bfde-5140-45d5-9a08-178ec4859424 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for project af530edb3b084c18bf5595f46cffdf35. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:00:12.565084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-f866bfde-5140-45d5-9a08-178ec4859424 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for user d51f7a75cf6144f0b3bf7e63fcea6827 and project af530edb3b084c18bf5595f46cffdf35. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:00:12.579054 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f866bfde-5140-45d5-9a08-178ec4859424 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.861798 Jan 22 22:00:12.579660 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4138/8566] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 22:00:11 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:00:14.999569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-62076371", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb9f5138-713d-480c-9e87-dbd89c7312b8"}], "security_groups": [{"name": "tempest-securitygroup--452255190"}], "key_name": "tempest-keypair-908140357", "user_data": "}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:15.107861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] validate_networks() for [('fb9f5138-713d-480c-9e87-dbd89c7312b8', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:00:15.612099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:00:15.612541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:00:15.613036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:00:15.613464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:00:15.613922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:00:15.627562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:15.628031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:15.628866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:15.629332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:15.651419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for project af530edb3b084c18bf5595f46cffdf35. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:00:15.656839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for user d51f7a75cf6144f0b3bf7e63fcea6827 and project af530edb3b084c18bf5595f46cffdf35. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:00:15.670363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:00:15.672746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:00:15.791837 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-08ea7236-a092-4d94-8712-aaeaed8703ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 0.796762 Jan 22 22:00:15.792494 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4429/8567] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:00:14 2022] POST /compute/v2.1/servers => generated 410 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 22:00:15.802210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-88348569-e6b0-4265-98dc-505caca1c085 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:15.802965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-88348569-e6b0-4265-98dc-505caca1c085 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:15.859685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-88348569-e6b0-4265-98dc-505caca1c085 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:00:15.870057 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-88348569-e6b0-4265-98dc-505caca1c085 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1240 microversion: 2.1 time: 0.071450 Jan 22 22:00:15.870645 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4139/8568] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:15 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:00:16.887550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a37c7978-2257-4891-862c-5d032f6cc2fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:16.888175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a37c7978-2257-4891-862c-5d032f6cc2fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:16.894287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a37c7978-2257-4891-862c-5d032f6cc2fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:16.894756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a37c7978-2257-4891-862c-5d032f6cc2fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:16.895549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a37c7978-2257-4891-862c-5d032f6cc2fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:16.896002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a37c7978-2257-4891-862c-5d032f6cc2fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:16.955727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a37c7978-2257-4891-862c-5d032f6cc2fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:00:16.963997 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a37c7978-2257-4891-862c-5d032f6cc2fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1244 microversion: 2.1 time: 0.081161 Jan 22 22:00:16.964577 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4430/8569] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:16 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:00:17.981119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8a93879c-1092-4800-9a36-1c053d4d988b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:17.987006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8a93879c-1092-4800-9a36-1c053d4d988b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:17.988141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a93879c-1092-4800-9a36-1c053d4d988b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:17.988597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a93879c-1092-4800-9a36-1c053d4d988b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:17.989399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a93879c-1092-4800-9a36-1c053d4d988b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:17.989861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a93879c-1092-4800-9a36-1c053d4d988b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:18.065795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8a93879c-1092-4800-9a36-1c053d4d988b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:00:18.074000 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8a93879c-1092-4800-9a36-1c053d4d988b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1300 microversion: 2.1 time: 0.097536 Jan 22 22:00:18.074577 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4140/8570] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:17 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:00:19.092252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-db887b37-f520-47a2-b076-0801ede46bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:19.092889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-db887b37-f520-47a2-b076-0801ede46bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:19.100386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db887b37-f520-47a2-b076-0801ede46bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:19.101029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db887b37-f520-47a2-b076-0801ede46bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:19.101886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db887b37-f520-47a2-b076-0801ede46bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:19.102350 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db887b37-f520-47a2-b076-0801ede46bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:19.234712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-db887b37-f520-47a2-b076-0801ede46bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:00:19.243297 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-db887b37-f520-47a2-b076-0801ede46bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1365 microversion: 2.1 time: 0.156426 Jan 22 22:00:19.243906 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4431/8571] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:19 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:00:19.619475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-9d3bd271-5c8e-4ab4-91f8-d424634b593c req-2d4605d6-1b4b-4657-8a48-323a0786db38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e67ed9-41af-4a15-becf-84fdc7a45619", "tag": "75955176-29de-4070-a66d-138778d81512"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:19.621713 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:00:19.621713 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:00:19.632413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9d3bd271-5c8e-4ab4-91f8-d424634b593c req-2d4605d6-1b4b-4657-8a48-323a0786db38 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:19.632413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9d3bd271-5c8e-4ab4-91f8-d424634b593c req-2d4605d6-1b4b-4657-8a48-323a0786db38 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:19.650297 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-9d3bd271-5c8e-4ab4-91f8-d424634b593c req-2d4605d6-1b4b-4657-8a48-323a0786db38 service nova] Creating event network-changed:75955176-29de-4070-a66d-138778d81512 for instance 95e67ed9-41af-4a15-becf-84fdc7a45619 on nch1-master-1 Jan 22 22:00:19.656339 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-9d3bd271-5c8e-4ab4-91f8-d424634b593c req-2d4605d6-1b4b-4657-8a48-323a0786db38 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042154 Jan 22 22:00:19.657283 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4141/8572] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:00:20.260428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-58abc278-f133-4c0b-8db8-c8582dc23c93 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:20.261241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-58abc278-f133-4c0b-8db8-c8582dc23c93 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:20.268294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58abc278-f133-4c0b-8db8-c8582dc23c93 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:20.268773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58abc278-f133-4c0b-8db8-c8582dc23c93 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:20.269691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58abc278-f133-4c0b-8db8-c8582dc23c93 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:20.270165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58abc278-f133-4c0b-8db8-c8582dc23c93 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:20.410685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-58abc278-f133-4c0b-8db8-c8582dc23c93 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:00:20.418879 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-58abc278-f133-4c0b-8db8-c8582dc23c93 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1365 microversion: 2.1 time: 0.162625 Jan 22 22:00:20.419376 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4432/8573] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:20 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:00:21.437480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-251d79f7-de26-48f4-82cf-867ae9153413 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:21.438234 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-251d79f7-de26-48f4-82cf-867ae9153413 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:21.444379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-251d79f7-de26-48f4-82cf-867ae9153413 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:21.445410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-251d79f7-de26-48f4-82cf-867ae9153413 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:21.446378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-251d79f7-de26-48f4-82cf-867ae9153413 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:21.446829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-251d79f7-de26-48f4-82cf-867ae9153413 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:21.583913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-251d79f7-de26-48f4-82cf-867ae9153413 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:00:21.591380 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-251d79f7-de26-48f4-82cf-867ae9153413 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1365 microversion: 2.1 time: 0.158855 Jan 22 22:00:21.591948 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4142/8574] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:21 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:00:22.607283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c18aef77-2305-4cc6-b2b7-949f053db8f4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:22.607997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c18aef77-2305-4cc6-b2b7-949f053db8f4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:22.614684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c18aef77-2305-4cc6-b2b7-949f053db8f4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:22.615163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c18aef77-2305-4cc6-b2b7-949f053db8f4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:22.615969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c18aef77-2305-4cc6-b2b7-949f053db8f4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:22.616476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c18aef77-2305-4cc6-b2b7-949f053db8f4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:22.747241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c18aef77-2305-4cc6-b2b7-949f053db8f4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:00:22.754945 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c18aef77-2305-4cc6-b2b7-949f053db8f4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1365 microversion: 2.1 time: 0.151408 Jan 22 22:00:22.755528 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4433/8575] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:22 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:00:23.771641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ec0dffa2-eb5a-4ba9-ab74-7754d1f61fe6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:23.772326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ec0dffa2-eb5a-4ba9-ab74-7754d1f61fe6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:23.779522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec0dffa2-eb5a-4ba9-ab74-7754d1f61fe6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:23.779980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec0dffa2-eb5a-4ba9-ab74-7754d1f61fe6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:23.780767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec0dffa2-eb5a-4ba9-ab74-7754d1f61fe6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:23.781206 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec0dffa2-eb5a-4ba9-ab74-7754d1f61fe6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:23.910604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ec0dffa2-eb5a-4ba9-ab74-7754d1f61fe6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:00:23.918601 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ec0dffa2-eb5a-4ba9-ab74-7754d1f61fe6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1365 microversion: 2.1 time: 0.150647 Jan 22 22:00:23.919177 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4143/8576] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:23 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:00:24.935291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-28a7d872-e832-4d16-be87-87f4776cd0ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:24.936132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-28a7d872-e832-4d16-be87-87f4776cd0ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:24.945372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28a7d872-e832-4d16-be87-87f4776cd0ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:24.945875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28a7d872-e832-4d16-be87-87f4776cd0ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:24.946700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28a7d872-e832-4d16-be87-87f4776cd0ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:24.947164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-28a7d872-e832-4d16-be87-87f4776cd0ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:25.106904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-28a7d872-e832-4d16-be87-87f4776cd0ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:00:25.115115 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-28a7d872-e832-4d16-be87-87f4776cd0ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1365 microversion: 2.1 time: 0.183666 Jan 22 22:00:25.115711 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4434/8577] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:24 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:00:25.682298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-fb977cb1-eb71-4124-9962-123ae70e8ab8 req-cab47c4c-b1ae-49db-a5e8-f7f961b581ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e67ed9-41af-4a15-becf-84fdc7a45619", "name": "network-vif-plugged", "status": "completed", "tag": "75955176-29de-4070-a66d-138778d81512"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:25.683821 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:00:25.683821 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:00:25.691335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fb977cb1-eb71-4124-9962-123ae70e8ab8 req-cab47c4c-b1ae-49db-a5e8-f7f961b581ef service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:25.692073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-fb977cb1-eb71-4124-9962-123ae70e8ab8 req-cab47c4c-b1ae-49db-a5e8-f7f961b581ef service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:25.702473 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-fb977cb1-eb71-4124-9962-123ae70e8ab8 req-cab47c4c-b1ae-49db-a5e8-f7f961b581ef service nova] Creating event network-vif-plugged:75955176-29de-4070-a66d-138778d81512 for instance 95e67ed9-41af-4a15-becf-84fdc7a45619 on nch1-master-1 Jan 22 22:00:25.707290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-fb977cb1-eb71-4124-9962-123ae70e8ab8 req-cab47c4c-b1ae-49db-a5e8-f7f961b581ef service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029505 Jan 22 22:00:25.707880 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4144/8578] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:00:26.132641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-66225159-6e02-423b-8da9-309c65c60ca8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:26.133272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-66225159-6e02-423b-8da9-309c65c60ca8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:26.140061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66225159-6e02-423b-8da9-309c65c60ca8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:26.140533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66225159-6e02-423b-8da9-309c65c60ca8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:26.141332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66225159-6e02-423b-8da9-309c65c60ca8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:26.141826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66225159-6e02-423b-8da9-309c65c60ca8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:26.273619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-66225159-6e02-423b-8da9-309c65c60ca8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:00:26.280962 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-66225159-6e02-423b-8da9-309c65c60ca8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1365 microversion: 2.1 time: 0.152363 Jan 22 22:00:26.281698 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4435/8579] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:26 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:00:27.299415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dec799d6-0732-42bd-9cbf-2f176f85bbb6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:27.300143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dec799d6-0732-42bd-9cbf-2f176f85bbb6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:27.306438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dec799d6-0732-42bd-9cbf-2f176f85bbb6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:27.306897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dec799d6-0732-42bd-9cbf-2f176f85bbb6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:27.307689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dec799d6-0732-42bd-9cbf-2f176f85bbb6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:27.308214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dec799d6-0732-42bd-9cbf-2f176f85bbb6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:27.447967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dec799d6-0732-42bd-9cbf-2f176f85bbb6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:00:27.455413 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dec799d6-0732-42bd-9cbf-2f176f85bbb6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1553 microversion: 2.1 time: 0.160872 Jan 22 22:00:27.455977 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4145/8580] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:00:27 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:00:27.471175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a9ab39e0-bee0-4735-9fd8-ee2bc5ded535 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:00:27.471718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a9ab39e0-bee0-4735-9fd8-ee2bc5ded535 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:27.478344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9ab39e0-bee0-4735-9fd8-ee2bc5ded535 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:27.478810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9ab39e0-bee0-4735-9fd8-ee2bc5ded535 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:27.479602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9ab39e0-bee0-4735-9fd8-ee2bc5ded535 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:27.480052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a9ab39e0-bee0-4735-9fd8-ee2bc5ded535 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:27.558830 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a9ab39e0-bee0-4735-9fd8-ee2bc5ded535 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091274 Jan 22 22:00:27.559445 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4436/8581] 10.222.0.100 () {58 vars in 1279 bytes} [Sat Jan 22 22:00:27 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:00:28.595089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f15c9b5b-5550-4b64-94b9-674d80e88590 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:28.596671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f15c9b5b-5550-4b64-94b9-674d80e88590 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:28.605206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-9cb00398-da66-490b-b1c8-061e6000da9a req-f8230912-1f97-4464-9314-fb5177ccc71a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e67ed9-41af-4a15-becf-84fdc7a45619", "tag": "75955176-29de-4070-a66d-138778d81512"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:28.608859 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:00:28.608859 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:00:28.610372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f15c9b5b-5550-4b64-94b9-674d80e88590 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:28.610902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f15c9b5b-5550-4b64-94b9-674d80e88590 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:28.611802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f15c9b5b-5550-4b64-94b9-674d80e88590 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:28.617720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9cb00398-da66-490b-b1c8-061e6000da9a req-f8230912-1f97-4464-9314-fb5177ccc71a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:28.618184 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-9cb00398-da66-490b-b1c8-061e6000da9a req-f8230912-1f97-4464-9314-fb5177ccc71a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:28.618342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f15c9b5b-5550-4b64-94b9-674d80e88590 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:28.630782 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-9cb00398-da66-490b-b1c8-061e6000da9a req-f8230912-1f97-4464-9314-fb5177ccc71a service nova] Creating event network-changed:75955176-29de-4070-a66d-138778d81512 for instance 95e67ed9-41af-4a15-becf-84fdc7a45619 on nch1-master-1 Jan 22 22:00:28.637770 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-9cb00398-da66-490b-b1c8-061e6000da9a req-f8230912-1f97-4464-9314-fb5177ccc71a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044981 Jan 22 22:00:28.642308 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4437/8582] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:00:28.657932 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f15c9b5b-5550-4b64-94b9-674d80e88590 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 14 microversion: 2.1 time: 0.067164 Jan 22 22:00:28.659389 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4146/8583] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:28 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:00:29.670325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-338535de-192d-482f-b85d-fb824a49fb5e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:29.672021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-338535de-192d-482f-b85d-fb824a49fb5e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:29.679914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-338535de-192d-482f-b85d-fb824a49fb5e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:29.680257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-338535de-192d-482f-b85d-fb824a49fb5e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:29.681064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-338535de-192d-482f-b85d-fb824a49fb5e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:29.681647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-338535de-192d-482f-b85d-fb824a49fb5e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:29.719725 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-338535de-192d-482f-b85d-fb824a49fb5e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 14 microversion: 2.1 time: 0.053264 Jan 22 22:00:29.720728 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4438/8584] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:29 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:00:30.732003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8b28bfbe-8321-43ec-beea-0911ed7e8e46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:30.733005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8b28bfbe-8321-43ec-beea-0911ed7e8e46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:30.740407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b28bfbe-8321-43ec-beea-0911ed7e8e46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:30.740866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b28bfbe-8321-43ec-beea-0911ed7e8e46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:30.742886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b28bfbe-8321-43ec-beea-0911ed7e8e46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:30.743330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b28bfbe-8321-43ec-beea-0911ed7e8e46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:30.780538 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8b28bfbe-8321-43ec-beea-0911ed7e8e46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 14 microversion: 2.1 time: 0.052382 Jan 22 22:00:30.781355 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4147/8585] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:30 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 22:00:31.792836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-861c0698-b20e-49f7-94d7-3bd95f35496e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:31.793910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-861c0698-b20e-49f7-94d7-3bd95f35496e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:31.801479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-861c0698-b20e-49f7-94d7-3bd95f35496e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:31.801976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-861c0698-b20e-49f7-94d7-3bd95f35496e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:31.802784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-861c0698-b20e-49f7-94d7-3bd95f35496e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:31.803244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-861c0698-b20e-49f7-94d7-3bd95f35496e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:31.845659 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-861c0698-b20e-49f7-94d7-3bd95f35496e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 14 microversion: 2.1 time: 0.057725 Jan 22 22:00:31.846313 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4439/8586] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:31 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:00:32.861068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e617c1f2-5c5d-4f3f-8fbc-f6c0ea3f6575 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:32.862771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e617c1f2-5c5d-4f3f-8fbc-f6c0ea3f6575 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:32.872466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e617c1f2-5c5d-4f3f-8fbc-f6c0ea3f6575 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:32.872917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e617c1f2-5c5d-4f3f-8fbc-f6c0ea3f6575 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:32.873739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e617c1f2-5c5d-4f3f-8fbc-f6c0ea3f6575 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:32.874184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e617c1f2-5c5d-4f3f-8fbc-f6c0ea3f6575 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:32.915196 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e617c1f2-5c5d-4f3f-8fbc-f6c0ea3f6575 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 14 microversion: 2.1 time: 0.061301 Jan 22 22:00:32.915986 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4148/8587] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:32 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:00:33.926109 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5dd94c9d-27b3-4c07-804f-b1cbbb5f7cc3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:33.927148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5dd94c9d-27b3-4c07-804f-b1cbbb5f7cc3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:33.935105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5dd94c9d-27b3-4c07-804f-b1cbbb5f7cc3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:33.935582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5dd94c9d-27b3-4c07-804f-b1cbbb5f7cc3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:33.936386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5dd94c9d-27b3-4c07-804f-b1cbbb5f7cc3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:33.936877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5dd94c9d-27b3-4c07-804f-b1cbbb5f7cc3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:33.973434 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5dd94c9d-27b3-4c07-804f-b1cbbb5f7cc3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 14 microversion: 2.1 time: 0.051340 Jan 22 22:00:33.974153 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4440/8588] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:33 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:00:34.984886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8f3f382f-2a30-4202-8456-5a75bdb00716 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:34.985855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8f3f382f-2a30-4202-8456-5a75bdb00716 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:34.995137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f3f382f-2a30-4202-8456-5a75bdb00716 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:34.995693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f3f382f-2a30-4202-8456-5a75bdb00716 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:34.996514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f3f382f-2a30-4202-8456-5a75bdb00716 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:34.996994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8f3f382f-2a30-4202-8456-5a75bdb00716 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:35.036546 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8f3f382f-2a30-4202-8456-5a75bdb00716 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 14 microversion: 2.1 time: 0.055714 Jan 22 22:00:35.037163 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4149/8589] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:34 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:00:36.048684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-64e3c52e-74ff-4f1c-8a4c-aa6247b77036 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:36.049745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-64e3c52e-74ff-4f1c-8a4c-aa6247b77036 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:36.057152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64e3c52e-74ff-4f1c-8a4c-aa6247b77036 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:36.057665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64e3c52e-74ff-4f1c-8a4c-aa6247b77036 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:36.058470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64e3c52e-74ff-4f1c-8a4c-aa6247b77036 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:36.058932 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64e3c52e-74ff-4f1c-8a4c-aa6247b77036 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:36.098030 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-64e3c52e-74ff-4f1c-8a4c-aa6247b77036 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 14 microversion: 2.1 time: 0.053366 Jan 22 22:00:36.098649 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4441/8590] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:36 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:00:37.108838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-892da929-5390-46d0-a872-5a38d1de40d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:37.109953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-892da929-5390-46d0-a872-5a38d1de40d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:37.117817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-892da929-5390-46d0-a872-5a38d1de40d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:37.118279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-892da929-5390-46d0-a872-5a38d1de40d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:37.119072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-892da929-5390-46d0-a872-5a38d1de40d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:37.119519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-892da929-5390-46d0-a872-5a38d1de40d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:37.156744 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-892da929-5390-46d0-a872-5a38d1de40d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 14 microversion: 2.1 time: 0.052060 Jan 22 22:00:37.157539 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4150/8591] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:37 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:00:38.169022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6f1a20a7-3214-4895-8b5d-8cccf0484b21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:38.170084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6f1a20a7-3214-4895-8b5d-8cccf0484b21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:38.177625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f1a20a7-3214-4895-8b5d-8cccf0484b21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:38.178092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f1a20a7-3214-4895-8b5d-8cccf0484b21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:38.178947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f1a20a7-3214-4895-8b5d-8cccf0484b21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:38.179397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6f1a20a7-3214-4895-8b5d-8cccf0484b21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:38.219089 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6f1a20a7-3214-4895-8b5d-8cccf0484b21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 14 microversion: 2.1 time: 0.054169 Jan 22 22:00:38.219955 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4442/8592] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:38 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:00:39.230617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5c9cf1b6-969d-43b9-be60-b54f1e01d890 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:39.231677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5c9cf1b6-969d-43b9-be60-b54f1e01d890 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:39.239105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c9cf1b6-969d-43b9-be60-b54f1e01d890 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:39.239565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c9cf1b6-969d-43b9-be60-b54f1e01d890 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:39.240360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c9cf1b6-969d-43b9-be60-b54f1e01d890 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:39.240864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5c9cf1b6-969d-43b9-be60-b54f1e01d890 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:39.280109 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5c9cf1b6-969d-43b9-be60-b54f1e01d890 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 14 microversion: 2.1 time: 0.053374 Jan 22 22:00:39.280730 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4151/8593] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:39 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:00:40.291667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d5338cee-0e82-4c4b-9994-dea01070aa46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:40.292842 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d5338cee-0e82-4c4b-9994-dea01070aa46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:40.300375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5338cee-0e82-4c4b-9994-dea01070aa46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:40.300851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5338cee-0e82-4c4b-9994-dea01070aa46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:40.301695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5338cee-0e82-4c4b-9994-dea01070aa46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:40.302165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d5338cee-0e82-4c4b-9994-dea01070aa46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:40.354065 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d5338cee-0e82-4c4b-9994-dea01070aa46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 8208 microversion: 2.1 time: 0.066814 Jan 22 22:00:40.354701 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4443/8594] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:40 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 8208 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:00:41.365559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ae336e4f-dc67-4d81-80b4-cac43d0591ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:41.366900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ae336e4f-dc67-4d81-80b4-cac43d0591ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:41.377325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae336e4f-dc67-4d81-80b4-cac43d0591ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:41.377325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae336e4f-dc67-4d81-80b4-cac43d0591ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:41.377325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae336e4f-dc67-4d81-80b4-cac43d0591ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:41.377325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae336e4f-dc67-4d81-80b4-cac43d0591ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:41.426409 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ae336e4f-dc67-4d81-80b4-cac43d0591ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 16401 microversion: 2.1 time: 0.064992 Jan 22 22:00:41.427049 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4152/8595] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:41 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 16401 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:42.437992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-67a46b8e-2899-4cb3-bfdb-75d264d8bdf0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:42.438972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-67a46b8e-2899-4cb3-bfdb-75d264d8bdf0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:42.446550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67a46b8e-2899-4cb3-bfdb-75d264d8bdf0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:42.447031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67a46b8e-2899-4cb3-bfdb-75d264d8bdf0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:42.447846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67a46b8e-2899-4cb3-bfdb-75d264d8bdf0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:42.448414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-67a46b8e-2899-4cb3-bfdb-75d264d8bdf0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:42.496778 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-67a46b8e-2899-4cb3-bfdb-75d264d8bdf0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 16401 microversion: 2.1 time: 0.062858 Jan 22 22:00:42.497548 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4444/8596] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:42 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 16401 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:43.508264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8516ac97-d295-478a-aa4e-44d83822d575 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:43.509258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8516ac97-d295-478a-aa4e-44d83822d575 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:43.516873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8516ac97-d295-478a-aa4e-44d83822d575 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:43.522570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8516ac97-d295-478a-aa4e-44d83822d575 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:43.522570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8516ac97-d295-478a-aa4e-44d83822d575 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:43.522570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8516ac97-d295-478a-aa4e-44d83822d575 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:43.557773 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8516ac97-d295-478a-aa4e-44d83822d575 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 16401 microversion: 2.1 time: 0.054112 Jan 22 22:00:43.558409 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4153/8597] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:43 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 16401 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:44.569448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6d94f7ed-02d0-462d-8eef-2dab27e994aa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:44.570498 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6d94f7ed-02d0-462d-8eef-2dab27e994aa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:44.579735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d94f7ed-02d0-462d-8eef-2dab27e994aa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:44.580606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d94f7ed-02d0-462d-8eef-2dab27e994aa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:44.581853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d94f7ed-02d0-462d-8eef-2dab27e994aa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:44.582325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d94f7ed-02d0-462d-8eef-2dab27e994aa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:44.632089 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6d94f7ed-02d0-462d-8eef-2dab27e994aa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 16401 microversion: 2.1 time: 0.066567 Jan 22 22:00:44.632731 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4445/8598] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:44 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 16401 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:45.645032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-52f0ff43-b3af-41b2-b076-670cdbeb9e79 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:45.646062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-52f0ff43-b3af-41b2-b076-670cdbeb9e79 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:45.654700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52f0ff43-b3af-41b2-b076-670cdbeb9e79 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:45.655152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52f0ff43-b3af-41b2-b076-670cdbeb9e79 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:45.655982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52f0ff43-b3af-41b2-b076-670cdbeb9e79 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:45.656424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52f0ff43-b3af-41b2-b076-670cdbeb9e79 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:45.701289 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-52f0ff43-b3af-41b2-b076-670cdbeb9e79 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 16401 microversion: 2.1 time: 0.060777 Jan 22 22:00:45.704854 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4154/8599] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:45 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 16401 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:46.713569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c6900f30-3379-4892-b599-2a2dad1cc9e5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:46.714645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c6900f30-3379-4892-b599-2a2dad1cc9e5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:46.722039 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6900f30-3379-4892-b599-2a2dad1cc9e5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:46.722511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6900f30-3379-4892-b599-2a2dad1cc9e5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:46.723318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6900f30-3379-4892-b599-2a2dad1cc9e5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:46.723777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6900f30-3379-4892-b599-2a2dad1cc9e5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:46.776107 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c6900f30-3379-4892-b599-2a2dad1cc9e5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 24571 microversion: 2.1 time: 0.067315 Jan 22 22:00:46.776957 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4446/8600] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:46 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 24571 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:47.788730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6f19f0ea-da72-45d4-9a75-fc559722ce77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:47.789792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6f19f0ea-da72-45d4-9a75-fc559722ce77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:47.797093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f19f0ea-da72-45d4-9a75-fc559722ce77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:47.797586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f19f0ea-da72-45d4-9a75-fc559722ce77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:47.798376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f19f0ea-da72-45d4-9a75-fc559722ce77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:47.798824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6f19f0ea-da72-45d4-9a75-fc559722ce77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:47.836568 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6f19f0ea-da72-45d4-9a75-fc559722ce77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 24571 microversion: 2.1 time: 0.052445 Jan 22 22:00:47.837228 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4155/8601] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:47 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:48.848550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8eab8aa1-5459-4f63-a96f-bd6f4d4ed1de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:48.849584 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8eab8aa1-5459-4f63-a96f-bd6f4d4ed1de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:48.857555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8eab8aa1-5459-4f63-a96f-bd6f4d4ed1de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:48.858025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8eab8aa1-5459-4f63-a96f-bd6f4d4ed1de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:48.858855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8eab8aa1-5459-4f63-a96f-bd6f4d4ed1de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:48.859307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8eab8aa1-5459-4f63-a96f-bd6f4d4ed1de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:48.904187 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8eab8aa1-5459-4f63-a96f-bd6f4d4ed1de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 24571 microversion: 2.1 time: 0.059585 Jan 22 22:00:48.905120 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4447/8602] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:48 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:49.916983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-50902f95-6f68-4ade-9cd4-d4584541eb77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:49.918029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-50902f95-6f68-4ade-9cd4-d4584541eb77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:49.925350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50902f95-6f68-4ade-9cd4-d4584541eb77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:49.925829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50902f95-6f68-4ade-9cd4-d4584541eb77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:49.926613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50902f95-6f68-4ade-9cd4-d4584541eb77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:49.927054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50902f95-6f68-4ade-9cd4-d4584541eb77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:49.968393 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-50902f95-6f68-4ade-9cd4-d4584541eb77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 24571 microversion: 2.1 time: 0.056339 Jan 22 22:00:49.969235 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4156/8603] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:49 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 24571 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:50.980695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fde1d732-910a-46aa-9d5d-742a397f7ce8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:50.981735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fde1d732-910a-46aa-9d5d-742a397f7ce8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:50.988960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fde1d732-910a-46aa-9d5d-742a397f7ce8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:50.989456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fde1d732-910a-46aa-9d5d-742a397f7ce8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:50.990422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fde1d732-910a-46aa-9d5d-742a397f7ce8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:50.991479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fde1d732-910a-46aa-9d5d-742a397f7ce8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:51.035223 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fde1d732-910a-46aa-9d5d-742a397f7ce8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 24571 microversion: 2.1 time: 0.058554 Jan 22 22:00:51.036162 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4448/8604] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:50 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 24571 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:00:52.047672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e08e1c18-e946-47a4-bf2d-4569d4d5c738 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:52.048678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e08e1c18-e946-47a4-bf2d-4569d4d5c738 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:52.056214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e08e1c18-e946-47a4-bf2d-4569d4d5c738 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:52.056672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e08e1c18-e946-47a4-bf2d-4569d4d5c738 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:52.057467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e08e1c18-e946-47a4-bf2d-4569d4d5c738 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:52.057938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e08e1c18-e946-47a4-bf2d-4569d4d5c738 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:52.097075 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e08e1c18-e946-47a4-bf2d-4569d4d5c738 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 24571 microversion: 2.1 time: 0.053373 Jan 22 22:00:52.097783 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4157/8605] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:52 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:53.110048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e530d1a1-21fd-4152-a87b-83146306291d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:53.111007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e530d1a1-21fd-4152-a87b-83146306291d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:53.118572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e530d1a1-21fd-4152-a87b-83146306291d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:53.119042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e530d1a1-21fd-4152-a87b-83146306291d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:53.119837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e530d1a1-21fd-4152-a87b-83146306291d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:53.120287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e530d1a1-21fd-4152-a87b-83146306291d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:53.161793 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e530d1a1-21fd-4152-a87b-83146306291d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 24571 microversion: 2.1 time: 0.055765 Jan 22 22:00:53.162668 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4449/8606] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:53 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:54.173972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a9ab60a1-3d3c-421d-83ab-ef2605534053 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:54.175040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a9ab60a1-3d3c-421d-83ab-ef2605534053 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:54.182634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ab60a1-3d3c-421d-83ab-ef2605534053 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:54.183093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ab60a1-3d3c-421d-83ab-ef2605534053 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:54.183882 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ab60a1-3d3c-421d-83ab-ef2605534053 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:54.184331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9ab60a1-3d3c-421d-83ab-ef2605534053 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:54.222975 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a9ab60a1-3d3c-421d-83ab-ef2605534053 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 24571 microversion: 2.1 time: 0.053015 Jan 22 22:00:54.223825 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4158/8607] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:54 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:55.236017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e68f6c1c-3aaf-4a23-939c-51fa7323d7b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:55.237019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e68f6c1c-3aaf-4a23-939c-51fa7323d7b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:55.244577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e68f6c1c-3aaf-4a23-939c-51fa7323d7b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:55.245044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e68f6c1c-3aaf-4a23-939c-51fa7323d7b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:55.245868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e68f6c1c-3aaf-4a23-939c-51fa7323d7b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:55.246317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e68f6c1c-3aaf-4a23-939c-51fa7323d7b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:55.286707 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e68f6c1c-3aaf-4a23-939c-51fa7323d7b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 24571 microversion: 2.1 time: 0.054497 Jan 22 22:00:55.287551 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4450/8608] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:55 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:56.299313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2fc3396b-1351-4fd0-a119-8b6367868403 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:56.300342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2fc3396b-1351-4fd0-a119-8b6367868403 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:56.307739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fc3396b-1351-4fd0-a119-8b6367868403 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:56.308207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fc3396b-1351-4fd0-a119-8b6367868403 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:56.308964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fc3396b-1351-4fd0-a119-8b6367868403 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:56.309408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2fc3396b-1351-4fd0-a119-8b6367868403 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:56.353737 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2fc3396b-1351-4fd0-a119-8b6367868403 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 24571 microversion: 2.1 time: 0.058157 Jan 22 22:00:56.354511 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4159/8609] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:56 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 24571 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:57.377864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a3f94720-8a86-4a46-b22c-468104ebef09 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:57.377864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a3f94720-8a86-4a46-b22c-468104ebef09 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:57.377864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3f94720-8a86-4a46-b22c-468104ebef09 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:57.377864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3f94720-8a86-4a46-b22c-468104ebef09 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:57.377864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3f94720-8a86-4a46-b22c-468104ebef09 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:57.378810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3f94720-8a86-4a46-b22c-468104ebef09 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:57.420466 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a3f94720-8a86-4a46-b22c-468104ebef09 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 24571 microversion: 2.1 time: 0.057132 Jan 22 22:00:57.422626 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4451/8610] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:57 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 24571 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:58.432526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eaa4ffde-d27c-4990-8784-e0adeb2205a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:58.433690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eaa4ffde-d27c-4990-8784-e0adeb2205a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:58.441066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaa4ffde-d27c-4990-8784-e0adeb2205a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:58.441543 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaa4ffde-d27c-4990-8784-e0adeb2205a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:58.442338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaa4ffde-d27c-4990-8784-e0adeb2205a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:58.442785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaa4ffde-d27c-4990-8784-e0adeb2205a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:58.488118 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eaa4ffde-d27c-4990-8784-e0adeb2205a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 24571 microversion: 2.1 time: 0.059635 Jan 22 22:00:58.488987 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4160/8611] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:58 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:00:59.500321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c6f5558a-9f3d-4825-85de-2bf06453a748 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:00:59.501343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c6f5558a-9f3d-4825-85de-2bf06453a748 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:00:59.508736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6f5558a-9f3d-4825-85de-2bf06453a748 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:59.509212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6f5558a-9f3d-4825-85de-2bf06453a748 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:59.510108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6f5558a-9f3d-4825-85de-2bf06453a748 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:00:59.510572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c6f5558a-9f3d-4825-85de-2bf06453a748 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:00:59.552998 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c6f5558a-9f3d-4825-85de-2bf06453a748 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 24571 microversion: 2.1 time: 0.056669 Jan 22 22:00:59.553676 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4452/8612] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:00:59 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 24571 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:00.564848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ec21a97d-9062-4b70-b41f-d09bc1155c86 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:00.565903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ec21a97d-9062-4b70-b41f-d09bc1155c86 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:00.573264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec21a97d-9062-4b70-b41f-d09bc1155c86 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:00.573749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec21a97d-9062-4b70-b41f-d09bc1155c86 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:00.574531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec21a97d-9062-4b70-b41f-d09bc1155c86 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:00.574971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec21a97d-9062-4b70-b41f-d09bc1155c86 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:00.613964 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ec21a97d-9062-4b70-b41f-d09bc1155c86 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 24571 microversion: 2.1 time: 0.053018 Jan 22 22:01:00.614591 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4161/8613] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:00 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:01.626471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-65cd2c56-3184-4f36-ae6b-13258ceffb12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:01.627581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-65cd2c56-3184-4f36-ae6b-13258ceffb12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:01.635726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65cd2c56-3184-4f36-ae6b-13258ceffb12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:01.636595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65cd2c56-3184-4f36-ae6b-13258ceffb12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:01.637426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65cd2c56-3184-4f36-ae6b-13258ceffb12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:01.637902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-65cd2c56-3184-4f36-ae6b-13258ceffb12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:01.691953 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-65cd2c56-3184-4f36-ae6b-13258ceffb12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.069256 Jan 22 22:01:01.692548 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4453/8614] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:01 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:02.704789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5e30154f-fd9a-4ad4-8edd-b63f57192726 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:02.705771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5e30154f-fd9a-4ad4-8edd-b63f57192726 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:02.713591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e30154f-fd9a-4ad4-8edd-b63f57192726 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:02.714052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e30154f-fd9a-4ad4-8edd-b63f57192726 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:02.714847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e30154f-fd9a-4ad4-8edd-b63f57192726 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:02.715295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e30154f-fd9a-4ad4-8edd-b63f57192726 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:02.760189 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5e30154f-fd9a-4ad4-8edd-b63f57192726 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.058935 Jan 22 22:01:02.761027 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4162/8615] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:02 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:03.772776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b87129bb-49e4-4a15-90d8-a897104b0377 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:03.773786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b87129bb-49e4-4a15-90d8-a897104b0377 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:03.781467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b87129bb-49e4-4a15-90d8-a897104b0377 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:03.781969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b87129bb-49e4-4a15-90d8-a897104b0377 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:03.782792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b87129bb-49e4-4a15-90d8-a897104b0377 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:03.783258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b87129bb-49e4-4a15-90d8-a897104b0377 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:03.824612 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b87129bb-49e4-4a15-90d8-a897104b0377 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.055903 Jan 22 22:01:03.825536 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4454/8616] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:03 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:01:04.836925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a905ec78-c0a2-456b-b6ad-235ab5ce1200 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:04.837965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a905ec78-c0a2-456b-b6ad-235ab5ce1200 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:04.845532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a905ec78-c0a2-456b-b6ad-235ab5ce1200 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:04.845992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a905ec78-c0a2-456b-b6ad-235ab5ce1200 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:04.846778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a905ec78-c0a2-456b-b6ad-235ab5ce1200 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:04.847222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a905ec78-c0a2-456b-b6ad-235ab5ce1200 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:04.887253 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a905ec78-c0a2-456b-b6ad-235ab5ce1200 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.054261 Jan 22 22:01:04.888132 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4163/8617] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:04 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:01:05.899714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-23fea149-0b2b-46c9-b953-0d16dfabd65e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:05.900751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-23fea149-0b2b-46c9-b953-0d16dfabd65e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:05.908565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23fea149-0b2b-46c9-b953-0d16dfabd65e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:05.909030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23fea149-0b2b-46c9-b953-0d16dfabd65e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:05.911295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23fea149-0b2b-46c9-b953-0d16dfabd65e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:05.911295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-23fea149-0b2b-46c9-b953-0d16dfabd65e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:05.957665 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-23fea149-0b2b-46c9-b953-0d16dfabd65e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.061923 Jan 22 22:01:05.958310 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4455/8618] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:05 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:06.970201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-721904d3-e0d3-42a7-b0ab-9883bf5475e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:06.971197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-721904d3-e0d3-42a7-b0ab-9883bf5475e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:06.978446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-721904d3-e0d3-42a7-b0ab-9883bf5475e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:06.978888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-721904d3-e0d3-42a7-b0ab-9883bf5475e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:06.979660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-721904d3-e0d3-42a7-b0ab-9883bf5475e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:06.980213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-721904d3-e0d3-42a7-b0ab-9883bf5475e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:07.019542 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-721904d3-e0d3-42a7-b0ab-9883bf5475e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.053346 Jan 22 22:01:07.020196 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4164/8619] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:06 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:08.031821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bf67db09-e723-4216-b876-a3e7962de280 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:08.032840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bf67db09-e723-4216-b876-a3e7962de280 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:08.040239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf67db09-e723-4216-b876-a3e7962de280 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:08.040714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf67db09-e723-4216-b876-a3e7962de280 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:08.041541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf67db09-e723-4216-b876-a3e7962de280 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:08.042008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf67db09-e723-4216-b876-a3e7962de280 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:08.084075 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bf67db09-e723-4216-b876-a3e7962de280 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.056941 Jan 22 22:01:08.085015 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4456/8620] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:08 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:09.096487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6d912494-affa-4661-9186-5b165b276f91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:09.097480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6d912494-affa-4661-9186-5b165b276f91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:09.105564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d912494-affa-4661-9186-5b165b276f91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:09.106029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d912494-affa-4661-9186-5b165b276f91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:09.106807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d912494-affa-4661-9186-5b165b276f91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:09.107246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d912494-affa-4661-9186-5b165b276f91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:09.152631 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6d912494-affa-4661-9186-5b165b276f91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.059389 Jan 22 22:01:09.153358 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4165/8621] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:09 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:10.164840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e5e622fe-98d7-43ce-9f1e-b473bb345a3e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:10.165925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e5e622fe-98d7-43ce-9f1e-b473bb345a3e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:10.174065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5e622fe-98d7-43ce-9f1e-b473bb345a3e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:10.174522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5e622fe-98d7-43ce-9f1e-b473bb345a3e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:10.175336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5e622fe-98d7-43ce-9f1e-b473bb345a3e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:10.175796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e5e622fe-98d7-43ce-9f1e-b473bb345a3e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:10.219483 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e5e622fe-98d7-43ce-9f1e-b473bb345a3e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.058597 Jan 22 22:01:10.220158 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4457/8622] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:10 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:11.232246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-27c3ca8c-aec6-4888-9b04-b6aedb4e00a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:11.233269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-27c3ca8c-aec6-4888-9b04-b6aedb4e00a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:11.240201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27c3ca8c-aec6-4888-9b04-b6aedb4e00a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:11.240937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27c3ca8c-aec6-4888-9b04-b6aedb4e00a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:11.241745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27c3ca8c-aec6-4888-9b04-b6aedb4e00a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:11.242198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27c3ca8c-aec6-4888-9b04-b6aedb4e00a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:11.288986 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-27c3ca8c-aec6-4888-9b04-b6aedb4e00a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.061346 Jan 22 22:01:11.289655 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4166/8623] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:11 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:12.302113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-491e22ce-01d0-4fe7-99b9-37f509b5b40c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:12.303135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-491e22ce-01d0-4fe7-99b9-37f509b5b40c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:12.310347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-491e22ce-01d0-4fe7-99b9-37f509b5b40c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:12.310823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-491e22ce-01d0-4fe7-99b9-37f509b5b40c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:12.311633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-491e22ce-01d0-4fe7-99b9-37f509b5b40c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:12.312098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-491e22ce-01d0-4fe7-99b9-37f509b5b40c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:12.359560 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-491e22ce-01d0-4fe7-99b9-37f509b5b40c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.061289 Jan 22 22:01:12.360221 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4458/8624] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:12 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:13.371975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-58affa4d-004f-41b9-a5df-b92163e33ae3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:13.372930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-58affa4d-004f-41b9-a5df-b92163e33ae3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:13.380487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58affa4d-004f-41b9-a5df-b92163e33ae3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:13.380952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58affa4d-004f-41b9-a5df-b92163e33ae3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:13.381919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58affa4d-004f-41b9-a5df-b92163e33ae3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:13.382373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58affa4d-004f-41b9-a5df-b92163e33ae3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:13.432907 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-58affa4d-004f-41b9-a5df-b92163e33ae3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.065050 Jan 22 22:01:13.433494 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4167/8625] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:13 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:14.445372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f922c5b1-b8c4-4dc0-b4d0-be3643d8cc22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:14.446442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f922c5b1-b8c4-4dc0-b4d0-be3643d8cc22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:14.453914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f922c5b1-b8c4-4dc0-b4d0-be3643d8cc22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:14.454389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f922c5b1-b8c4-4dc0-b4d0-be3643d8cc22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:14.455193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f922c5b1-b8c4-4dc0-b4d0-be3643d8cc22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:14.455655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f922c5b1-b8c4-4dc0-b4d0-be3643d8cc22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:14.501931 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f922c5b1-b8c4-4dc0-b4d0-be3643d8cc22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.060845 Jan 22 22:01:14.502583 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4459/8626] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:14 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:15.515104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c18b8032-3f8b-4143-9980-5bd2ea541c14 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:15.516141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c18b8032-3f8b-4143-9980-5bd2ea541c14 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:15.523611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c18b8032-3f8b-4143-9980-5bd2ea541c14 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:15.524067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c18b8032-3f8b-4143-9980-5bd2ea541c14 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:15.524855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c18b8032-3f8b-4143-9980-5bd2ea541c14 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:15.525301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c18b8032-3f8b-4143-9980-5bd2ea541c14 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:15.570478 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c18b8032-3f8b-4143-9980-5bd2ea541c14 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.060441 Jan 22 22:01:15.571110 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4168/8627] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:15 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:16.583366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5cb09f3b-8a25-48c0-a76c-6aa52cdca70d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:16.584387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5cb09f3b-8a25-48c0-a76c-6aa52cdca70d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:16.592108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5cb09f3b-8a25-48c0-a76c-6aa52cdca70d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:16.592507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5cb09f3b-8a25-48c0-a76c-6aa52cdca70d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:16.593317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5cb09f3b-8a25-48c0-a76c-6aa52cdca70d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:16.593815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5cb09f3b-8a25-48c0-a76c-6aa52cdca70d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:16.640113 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5cb09f3b-8a25-48c0-a76c-6aa52cdca70d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.060634 Jan 22 22:01:16.640690 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4460/8628] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:16 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:17.652406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b3c1ef7e-58e9-4193-94b7-d6f7c6da6e0e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:17.653339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b3c1ef7e-58e9-4193-94b7-d6f7c6da6e0e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:17.660822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3c1ef7e-58e9-4193-94b7-d6f7c6da6e0e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:17.666642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3c1ef7e-58e9-4193-94b7-d6f7c6da6e0e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:17.666642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3c1ef7e-58e9-4193-94b7-d6f7c6da6e0e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:17.666642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b3c1ef7e-58e9-4193-94b7-d6f7c6da6e0e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:17.708946 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b3c1ef7e-58e9-4193-94b7-d6f7c6da6e0e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.061027 Jan 22 22:01:17.709630 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4169/8629] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:17 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:18.721773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-94371e95-2899-470c-9e3a-46f5d90541d9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:18.722713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-94371e95-2899-470c-9e3a-46f5d90541d9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:18.730806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94371e95-2899-470c-9e3a-46f5d90541d9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:18.731279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94371e95-2899-470c-9e3a-46f5d90541d9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:18.732088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94371e95-2899-470c-9e3a-46f5d90541d9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:18.732556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94371e95-2899-470c-9e3a-46f5d90541d9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:18.777816 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-94371e95-2899-470c-9e3a-46f5d90541d9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.060119 Jan 22 22:01:18.778473 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4461/8630] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:18 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:19.789174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6d3bd6a1-1ee6-4fdf-bf94-e1aba6f1f849 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:19.790240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6d3bd6a1-1ee6-4fdf-bf94-e1aba6f1f849 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:19.797979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d3bd6a1-1ee6-4fdf-bf94-e1aba6f1f849 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:19.798439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d3bd6a1-1ee6-4fdf-bf94-e1aba6f1f849 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:19.799226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d3bd6a1-1ee6-4fdf-bf94-e1aba6f1f849 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:19.799672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6d3bd6a1-1ee6-4fdf-bf94-e1aba6f1f849 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:19.845018 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6d3bd6a1-1ee6-4fdf-bf94-e1aba6f1f849 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.059759 Jan 22 22:01:19.845681 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4170/8631] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:19 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:20.857817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6bf761d6-84b8-4d52-8826-3acea85d956e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:20.858843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6bf761d6-84b8-4d52-8826-3acea85d956e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:20.866476 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bf761d6-84b8-4d52-8826-3acea85d956e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:20.866951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bf761d6-84b8-4d52-8826-3acea85d956e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:20.867753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bf761d6-84b8-4d52-8826-3acea85d956e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:20.868214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6bf761d6-84b8-4d52-8826-3acea85d956e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:20.913185 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6bf761d6-84b8-4d52-8826-3acea85d956e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.060264 Jan 22 22:01:20.913936 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4462/8632] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:20 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:21.925293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-50a2b612-aedb-408b-81e1-4cec631cccc6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:21.926363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-50a2b612-aedb-408b-81e1-4cec631cccc6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:21.934339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50a2b612-aedb-408b-81e1-4cec631cccc6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:21.934802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50a2b612-aedb-408b-81e1-4cec631cccc6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:21.935628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50a2b612-aedb-408b-81e1-4cec631cccc6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:21.936075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50a2b612-aedb-408b-81e1-4cec631cccc6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:21.985605 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-50a2b612-aedb-408b-81e1-4cec631cccc6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.064275 Jan 22 22:01:21.986244 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4171/8633] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:21 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:22.998198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-da80e56e-2dbe-4854-9634-75b5603a0c3c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:22.999437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-da80e56e-2dbe-4854-9634-75b5603a0c3c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:23.006858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da80e56e-2dbe-4854-9634-75b5603a0c3c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:23.007339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da80e56e-2dbe-4854-9634-75b5603a0c3c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:23.008149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da80e56e-2dbe-4854-9634-75b5603a0c3c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:23.008613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-da80e56e-2dbe-4854-9634-75b5603a0c3c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:23.054309 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-da80e56e-2dbe-4854-9634-75b5603a0c3c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.060604 Jan 22 22:01:23.054959 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4463/8634] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:22 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:24.066789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5774a2e6-6726-4521-889b-46cfe5181f24 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:24.067807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5774a2e6-6726-4521-889b-46cfe5181f24 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:24.075289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5774a2e6-6726-4521-889b-46cfe5181f24 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:24.075745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5774a2e6-6726-4521-889b-46cfe5181f24 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:24.076533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5774a2e6-6726-4521-889b-46cfe5181f24 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:24.076978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5774a2e6-6726-4521-889b-46cfe5181f24 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:24.125258 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5774a2e6-6726-4521-889b-46cfe5181f24 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.062487 Jan 22 22:01:24.125972 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4172/8635] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:24 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:25.136847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-84b876db-9348-41ad-8eb7-6cdf0c605011 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:25.137886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-84b876db-9348-41ad-8eb7-6cdf0c605011 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:25.145121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84b876db-9348-41ad-8eb7-6cdf0c605011 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:25.145612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84b876db-9348-41ad-8eb7-6cdf0c605011 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:25.146410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84b876db-9348-41ad-8eb7-6cdf0c605011 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:25.146867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84b876db-9348-41ad-8eb7-6cdf0c605011 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:25.191432 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-84b876db-9348-41ad-8eb7-6cdf0c605011 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.058640 Jan 22 22:01:25.192082 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4464/8636] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:25 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:26.204277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a332a132-fba9-4f4b-8912-2be52094a796 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:26.205271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a332a132-fba9-4f4b-8912-2be52094a796 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:26.212657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a332a132-fba9-4f4b-8912-2be52094a796 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:26.213108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a332a132-fba9-4f4b-8912-2be52094a796 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:26.214544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a332a132-fba9-4f4b-8912-2be52094a796 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:26.214982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a332a132-fba9-4f4b-8912-2be52094a796 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:26.258866 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a332a132-fba9-4f4b-8912-2be52094a796 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.058511 Jan 22 22:01:26.259613 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4173/8637] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:26 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:27.271850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-34bcb816-bea0-4e1a-bc47-e0af28646ef8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:27.272879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-34bcb816-bea0-4e1a-bc47-e0af28646ef8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:27.280400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34bcb816-bea0-4e1a-bc47-e0af28646ef8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:27.280874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34bcb816-bea0-4e1a-bc47-e0af28646ef8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:27.281740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34bcb816-bea0-4e1a-bc47-e0af28646ef8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:27.282201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34bcb816-bea0-4e1a-bc47-e0af28646ef8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:27.329682 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-34bcb816-bea0-4e1a-bc47-e0af28646ef8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.061713 Jan 22 22:01:27.330330 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4465/8638] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:27 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:28.342500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f141f348-35a7-4c8d-8951-64b0e8b1f7ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:28.343498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f141f348-35a7-4c8d-8951-64b0e8b1f7ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:28.350835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f141f348-35a7-4c8d-8951-64b0e8b1f7ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:28.351285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f141f348-35a7-4c8d-8951-64b0e8b1f7ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:28.352066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f141f348-35a7-4c8d-8951-64b0e8b1f7ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:28.352505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f141f348-35a7-4c8d-8951-64b0e8b1f7ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:28.399021 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f141f348-35a7-4c8d-8951-64b0e8b1f7ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.061216 Jan 22 22:01:28.399687 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4174/8639] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:28 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:29.411022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-285cd7a1-7706-4a37-80af-1a494a03ef79 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:29.414917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-285cd7a1-7706-4a37-80af-1a494a03ef79 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:29.420259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-285cd7a1-7706-4a37-80af-1a494a03ef79 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:29.420732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-285cd7a1-7706-4a37-80af-1a494a03ef79 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:29.421627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-285cd7a1-7706-4a37-80af-1a494a03ef79 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:29.422101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-285cd7a1-7706-4a37-80af-1a494a03ef79 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:29.472103 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-285cd7a1-7706-4a37-80af-1a494a03ef79 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.064969 Jan 22 22:01:29.472761 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4466/8640] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:29 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:30.484495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-58e0c28b-1ef2-4c8e-9808-9bdae77083c8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:30.485599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-58e0c28b-1ef2-4c8e-9808-9bdae77083c8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:30.493130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58e0c28b-1ef2-4c8e-9808-9bdae77083c8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:30.493610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58e0c28b-1ef2-4c8e-9808-9bdae77083c8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:30.494387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58e0c28b-1ef2-4c8e-9808-9bdae77083c8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:30.495353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58e0c28b-1ef2-4c8e-9808-9bdae77083c8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:30.539760 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-58e0c28b-1ef2-4c8e-9808-9bdae77083c8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.059187 Jan 22 22:01:30.540634 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4175/8641] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:30 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:31.552551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4ca6e697-d6a0-44ed-b9f1-b061964ea066 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:31.553780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4ca6e697-d6a0-44ed-b9f1-b061964ea066 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:31.561282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ca6e697-d6a0-44ed-b9f1-b061964ea066 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:31.561786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ca6e697-d6a0-44ed-b9f1-b061964ea066 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:31.562599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ca6e697-d6a0-44ed-b9f1-b061964ea066 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:31.563065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4ca6e697-d6a0-44ed-b9f1-b061964ea066 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:31.607797 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4ca6e697-d6a0-44ed-b9f1-b061964ea066 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.059275 Jan 22 22:01:31.608445 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4467/8642] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:31 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:01:32.620148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5d930fca-c755-4eab-8ef2-3cb49e7711e8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:32.621175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5d930fca-c755-4eab-8ef2-3cb49e7711e8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:32.628534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d930fca-c755-4eab-8ef2-3cb49e7711e8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:32.628999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d930fca-c755-4eab-8ef2-3cb49e7711e8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:32.629814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d930fca-c755-4eab-8ef2-3cb49e7711e8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:32.630265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d930fca-c755-4eab-8ef2-3cb49e7711e8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:32.675903 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5d930fca-c755-4eab-8ef2-3cb49e7711e8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.060651 Jan 22 22:01:32.676552 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4176/8643] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:32 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:33.688714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-435853cd-d560-4caf-afee-20f431a1d665 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:33.689674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-435853cd-d560-4caf-afee-20f431a1d665 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:33.696942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-435853cd-d560-4caf-afee-20f431a1d665 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:33.697406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-435853cd-d560-4caf-afee-20f431a1d665 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:33.698231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-435853cd-d560-4caf-afee-20f431a1d665 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:33.698681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-435853cd-d560-4caf-afee-20f431a1d665 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:33.742283 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-435853cd-d560-4caf-afee-20f431a1d665 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.057550 Jan 22 22:01:33.742916 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4468/8644] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:33 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:34.755159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9b5a7bc5-5c87-4ef1-85dd-582a7d85d06f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:34.756093 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9b5a7bc5-5c87-4ef1-85dd-582a7d85d06f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:34.764244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b5a7bc5-5c87-4ef1-85dd-582a7d85d06f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:34.764703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b5a7bc5-5c87-4ef1-85dd-582a7d85d06f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:34.765493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b5a7bc5-5c87-4ef1-85dd-582a7d85d06f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:34.765969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b5a7bc5-5c87-4ef1-85dd-582a7d85d06f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:34.811362 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9b5a7bc5-5c87-4ef1-85dd-582a7d85d06f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.060236 Jan 22 22:01:34.812007 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4177/8645] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:34 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:34.995114 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:01:34.995678 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:01:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:01:35.823643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-af2e1be2-69ca-4495-add8-bdcc3199a9f3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:35.824654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-af2e1be2-69ca-4495-add8-bdcc3199a9f3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:35.832094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af2e1be2-69ca-4495-add8-bdcc3199a9f3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:35.832570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af2e1be2-69ca-4495-add8-bdcc3199a9f3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:35.833373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af2e1be2-69ca-4495-add8-bdcc3199a9f3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:35.833863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af2e1be2-69ca-4495-add8-bdcc3199a9f3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:35.878782 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-af2e1be2-69ca-4495-add8-bdcc3199a9f3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.059086 Jan 22 22:01:35.887235 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4469/8646] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:35 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:36.891242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-baebacc2-d897-46c7-9fb0-370d75283943 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:36.892238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-baebacc2-d897-46c7-9fb0-370d75283943 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:36.899497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baebacc2-d897-46c7-9fb0-370d75283943 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:36.899951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baebacc2-d897-46c7-9fb0-370d75283943 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:36.900728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baebacc2-d897-46c7-9fb0-370d75283943 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:36.901168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-baebacc2-d897-46c7-9fb0-370d75283943 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:36.947317 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-baebacc2-d897-46c7-9fb0-370d75283943 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.060190 Jan 22 22:01:36.948223 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4178/8647] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:36 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:37.959803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ca727fc2-4cff-4faa-869c-a64753f530a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:37.960829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ca727fc2-4cff-4faa-869c-a64753f530a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:37.968430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca727fc2-4cff-4faa-869c-a64753f530a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:37.968904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca727fc2-4cff-4faa-869c-a64753f530a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:37.969739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca727fc2-4cff-4faa-869c-a64753f530a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:37.970203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca727fc2-4cff-4faa-869c-a64753f530a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:38.014918 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ca727fc2-4cff-4faa-869c-a64753f530a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.059126 Jan 22 22:01:38.015896 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4470/8648] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:37 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:39.026966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cc975c85-dcc1-45fd-9e8b-fe2c31b7b44b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:39.028533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cc975c85-dcc1-45fd-9e8b-fe2c31b7b44b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:39.035981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc975c85-dcc1-45fd-9e8b-fe2c31b7b44b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:39.036433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc975c85-dcc1-45fd-9e8b-fe2c31b7b44b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:39.037216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc975c85-dcc1-45fd-9e8b-fe2c31b7b44b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:39.037686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc975c85-dcc1-45fd-9e8b-fe2c31b7b44b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:39.082054 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cc975c85-dcc1-45fd-9e8b-fe2c31b7b44b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.058932 Jan 22 22:01:39.082681 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4179/8649] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:39 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:40.093319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9b6ad567-c770-4a5d-9e21-ed1072cf99b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:40.094380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9b6ad567-c770-4a5d-9e21-ed1072cf99b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:40.101824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b6ad567-c770-4a5d-9e21-ed1072cf99b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:40.104442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b6ad567-c770-4a5d-9e21-ed1072cf99b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:40.104442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b6ad567-c770-4a5d-9e21-ed1072cf99b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:40.104442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9b6ad567-c770-4a5d-9e21-ed1072cf99b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:40.153873 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9b6ad567-c770-4a5d-9e21-ed1072cf99b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.064542 Jan 22 22:01:40.154525 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4471/8650] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:40 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:41.166146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c7ebcf04-b1c3-4c63-9612-83a1de2fa054 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:41.167140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c7ebcf04-b1c3-4c63-9612-83a1de2fa054 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:41.174673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7ebcf04-b1c3-4c63-9612-83a1de2fa054 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:41.175124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7ebcf04-b1c3-4c63-9612-83a1de2fa054 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:41.175897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7ebcf04-b1c3-4c63-9612-83a1de2fa054 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:41.176336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7ebcf04-b1c3-4c63-9612-83a1de2fa054 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:41.222780 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c7ebcf04-b1c3-4c63-9612-83a1de2fa054 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.060775 Jan 22 22:01:41.223438 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4180/8651] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:41 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:42.235592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d7a44399-4027-4f55-9657-ca6c525e9453 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:42.236771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d7a44399-4027-4f55-9657-ca6c525e9453 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:42.244003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7a44399-4027-4f55-9657-ca6c525e9453 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:42.244472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7a44399-4027-4f55-9657-ca6c525e9453 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:42.245272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7a44399-4027-4f55-9657-ca6c525e9453 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:42.245766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7a44399-4027-4f55-9657-ca6c525e9453 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:42.290868 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d7a44399-4027-4f55-9657-ca6c525e9453 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.059341 Jan 22 22:01:42.291551 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4472/8652] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:42 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:43.303730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2872a3f1-77dc-4f33-b561-012392547790 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:43.304845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2872a3f1-77dc-4f33-b561-012392547790 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:43.312352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2872a3f1-77dc-4f33-b561-012392547790 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:43.312807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2872a3f1-77dc-4f33-b561-012392547790 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:43.313613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2872a3f1-77dc-4f33-b561-012392547790 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:43.314055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2872a3f1-77dc-4f33-b561-012392547790 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:43.360092 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2872a3f1-77dc-4f33-b561-012392547790 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.060419 Jan 22 22:01:43.360742 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4181/8653] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:43 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:44.372434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-01dc42c3-8e33-4e78-bc1d-02efab096892 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:44.373494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-01dc42c3-8e33-4e78-bc1d-02efab096892 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:44.381007 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01dc42c3-8e33-4e78-bc1d-02efab096892 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:44.381484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01dc42c3-8e33-4e78-bc1d-02efab096892 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:44.382343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01dc42c3-8e33-4e78-bc1d-02efab096892 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:44.382843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01dc42c3-8e33-4e78-bc1d-02efab096892 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:44.431323 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-01dc42c3-8e33-4e78-bc1d-02efab096892 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.062994 Jan 22 22:01:44.432240 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4473/8654] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:44 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:45.443695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e57eb23c-6b4c-4f71-b063-1f300c969b4f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:45.444726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e57eb23c-6b4c-4f71-b063-1f300c969b4f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:45.452646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e57eb23c-6b4c-4f71-b063-1f300c969b4f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:45.453100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e57eb23c-6b4c-4f71-b063-1f300c969b4f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:45.453901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e57eb23c-6b4c-4f71-b063-1f300c969b4f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:45.454342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e57eb23c-6b4c-4f71-b063-1f300c969b4f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:45.494930 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e57eb23c-6b4c-4f71-b063-1f300c969b4f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.055187 Jan 22 22:01:45.495886 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4182/8655] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:45 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:46.507499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2aa62fbb-cec0-4094-b185-6cfe110d6a30 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:46.508543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2aa62fbb-cec0-4094-b185-6cfe110d6a30 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:46.516135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aa62fbb-cec0-4094-b185-6cfe110d6a30 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:46.516612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aa62fbb-cec0-4094-b185-6cfe110d6a30 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:46.517426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aa62fbb-cec0-4094-b185-6cfe110d6a30 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:46.517915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2aa62fbb-cec0-4094-b185-6cfe110d6a30 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:46.565089 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2aa62fbb-cec0-4094-b185-6cfe110d6a30 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.061271 Jan 22 22:01:46.566032 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4474/8656] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:46 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:47.579323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-206778af-12bf-40f0-93d8-f8d8b2ba5ddf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:47.580319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-206778af-12bf-40f0-93d8-f8d8b2ba5ddf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:47.588068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-206778af-12bf-40f0-93d8-f8d8b2ba5ddf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:47.588523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-206778af-12bf-40f0-93d8-f8d8b2ba5ddf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:47.589337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-206778af-12bf-40f0-93d8-f8d8b2ba5ddf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:47.589813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-206778af-12bf-40f0-93d8-f8d8b2ba5ddf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:47.636179 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-206778af-12bf-40f0-93d8-f8d8b2ba5ddf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.063234 Jan 22 22:01:47.637806 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4183/8657] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:47 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:48.648733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ae11df4f-fd74-44ca-b320-792d959d1be6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:48.649705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ae11df4f-fd74-44ca-b320-792d959d1be6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:48.657237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae11df4f-fd74-44ca-b320-792d959d1be6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:48.657740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae11df4f-fd74-44ca-b320-792d959d1be6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:48.658577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae11df4f-fd74-44ca-b320-792d959d1be6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:48.659035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ae11df4f-fd74-44ca-b320-792d959d1be6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:48.704394 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ae11df4f-fd74-44ca-b320-792d959d1be6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.059748 Jan 22 22:01:48.705067 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4475/8658] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:48 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:49.717133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-adfd8a9f-6e0e-4bba-883a-27021336cd0c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:49.718149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-adfd8a9f-6e0e-4bba-883a-27021336cd0c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:49.725414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adfd8a9f-6e0e-4bba-883a-27021336cd0c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:49.725896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adfd8a9f-6e0e-4bba-883a-27021336cd0c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:49.726673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adfd8a9f-6e0e-4bba-883a-27021336cd0c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:49.727116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-adfd8a9f-6e0e-4bba-883a-27021336cd0c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:49.774385 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-adfd8a9f-6e0e-4bba-883a-27021336cd0c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.061800 Jan 22 22:01:49.775024 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4184/8659] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:49 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:50.787051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-143d459f-c9e8-4629-b239-fe4381385071 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:50.788079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-143d459f-c9e8-4629-b239-fe4381385071 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:50.797354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-143d459f-c9e8-4629-b239-fe4381385071 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:50.797854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-143d459f-c9e8-4629-b239-fe4381385071 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:50.798672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-143d459f-c9e8-4629-b239-fe4381385071 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:50.799162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-143d459f-c9e8-4629-b239-fe4381385071 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:50.845375 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-143d459f-c9e8-4629-b239-fe4381385071 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.062390 Jan 22 22:01:50.846134 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4476/8660] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:50 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:51.858181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4bedf9d1-8a38-4989-bb27-3f335cea5aa4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:51.859099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4bedf9d1-8a38-4989-bb27-3f335cea5aa4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:51.866907 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bedf9d1-8a38-4989-bb27-3f335cea5aa4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:51.867399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bedf9d1-8a38-4989-bb27-3f335cea5aa4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:51.868190 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bedf9d1-8a38-4989-bb27-3f335cea5aa4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:51.868641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4bedf9d1-8a38-4989-bb27-3f335cea5aa4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:51.912493 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4bedf9d1-8a38-4989-bb27-3f335cea5aa4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.058651 Jan 22 22:01:51.913152 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4185/8661] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:51 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:52.925423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7daff964-f12f-4621-91b4-ab9b47ab8211 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:52.926467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7daff964-f12f-4621-91b4-ab9b47ab8211 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:52.933734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7daff964-f12f-4621-91b4-ab9b47ab8211 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:52.934861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7daff964-f12f-4621-91b4-ab9b47ab8211 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:52.935660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7daff964-f12f-4621-91b4-ab9b47ab8211 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:52.936112 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7daff964-f12f-4621-91b4-ab9b47ab8211 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:52.982634 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7daff964-f12f-4621-91b4-ab9b47ab8211 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.061069 Jan 22 22:01:52.983547 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4477/8662] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:52 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:53.994961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0e5aaace-3715-4e09-baae-66509c51e8ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:53.995961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0e5aaace-3715-4e09-baae-66509c51e8ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:54.003928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e5aaace-3715-4e09-baae-66509c51e8ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:54.004379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e5aaace-3715-4e09-baae-66509c51e8ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:54.005156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e5aaace-3715-4e09-baae-66509c51e8ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:54.005691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e5aaace-3715-4e09-baae-66509c51e8ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:54.049320 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0e5aaace-3715-4e09-baae-66509c51e8ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.058218 Jan 22 22:01:54.050306 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4186/8663] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:53 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:55.062068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-85fd9341-702c-43f4-85a2-d5b881ca8271 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:55.063095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-85fd9341-702c-43f4-85a2-d5b881ca8271 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:55.070433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85fd9341-702c-43f4-85a2-d5b881ca8271 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:55.070904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85fd9341-702c-43f4-85a2-d5b881ca8271 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:55.071708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85fd9341-702c-43f4-85a2-d5b881ca8271 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:55.072167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-85fd9341-702c-43f4-85a2-d5b881ca8271 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:55.117966 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-85fd9341-702c-43f4-85a2-d5b881ca8271 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.060299 Jan 22 22:01:55.118728 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4478/8664] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:55 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:56.129494 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e2dfa560-a8f7-44c0-8254-66c68b5dc9c7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:56.130518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e2dfa560-a8f7-44c0-8254-66c68b5dc9c7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:56.138825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2dfa560-a8f7-44c0-8254-66c68b5dc9c7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:56.139280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2dfa560-a8f7-44c0-8254-66c68b5dc9c7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:56.140067 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2dfa560-a8f7-44c0-8254-66c68b5dc9c7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:56.140511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e2dfa560-a8f7-44c0-8254-66c68b5dc9c7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:56.186755 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e2dfa560-a8f7-44c0-8254-66c68b5dc9c7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.061256 Jan 22 22:01:56.187387 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4187/8665] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:56 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:57.198053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-34359c57-cf41-410f-9756-f4e2561eba28 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:57.199074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-34359c57-cf41-410f-9756-f4e2561eba28 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:57.207214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34359c57-cf41-410f-9756-f4e2561eba28 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:57.207693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34359c57-cf41-410f-9756-f4e2561eba28 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:57.208499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34359c57-cf41-410f-9756-f4e2561eba28 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:57.208960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-34359c57-cf41-410f-9756-f4e2561eba28 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:57.259278 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-34359c57-cf41-410f-9756-f4e2561eba28 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.065215 Jan 22 22:01:57.259938 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4479/8666] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:57 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:58.272117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d2b06072-a81e-4785-8c22-65db743ff303 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:58.273117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d2b06072-a81e-4785-8c22-65db743ff303 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:58.281466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2b06072-a81e-4785-8c22-65db743ff303 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:58.281942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2b06072-a81e-4785-8c22-65db743ff303 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:58.282724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2b06072-a81e-4785-8c22-65db743ff303 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:58.283163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2b06072-a81e-4785-8c22-65db743ff303 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:58.328017 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d2b06072-a81e-4785-8c22-65db743ff303 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.059830 Jan 22 22:01:58.328665 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4188/8667] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:58 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:01:59.340469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f49ec097-16b1-4c33-a9e8-053c332964e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:01:59.341710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f49ec097-16b1-4c33-a9e8-053c332964e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:01:59.349139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f49ec097-16b1-4c33-a9e8-053c332964e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:59.349651 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f49ec097-16b1-4c33-a9e8-053c332964e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:59.350469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f49ec097-16b1-4c33-a9e8-053c332964e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:01:59.350933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f49ec097-16b1-4c33-a9e8-053c332964e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:01:59.399345 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f49ec097-16b1-4c33-a9e8-053c332964e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.063121 Jan 22 22:01:59.406914 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4480/8668] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:01:59 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:02:00.411315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3adc5e2f-3845-4dff-b5a2-fe10ff3bf4a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:00.412354 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3adc5e2f-3845-4dff-b5a2-fe10ff3bf4a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:00.420539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3adc5e2f-3845-4dff-b5a2-fe10ff3bf4a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:00.420996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3adc5e2f-3845-4dff-b5a2-fe10ff3bf4a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:00.421826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3adc5e2f-3845-4dff-b5a2-fe10ff3bf4a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:00.422276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3adc5e2f-3845-4dff-b5a2-fe10ff3bf4a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:00.467675 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3adc5e2f-3845-4dff-b5a2-fe10ff3bf4a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.060304 Jan 22 22:02:00.469018 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4189/8669] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:02:00 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:02:01.480177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-061cb6d3-fc3e-43d4-8428-3ccd141374d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:01.481174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-061cb6d3-fc3e-43d4-8428-3ccd141374d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:01.489268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-061cb6d3-fc3e-43d4-8428-3ccd141374d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:01.489767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-061cb6d3-fc3e-43d4-8428-3ccd141374d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:01.490569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-061cb6d3-fc3e-43d4-8428-3ccd141374d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:01.491027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-061cb6d3-fc3e-43d4-8428-3ccd141374d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:01.535470 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-061cb6d3-fc3e-43d4-8428-3ccd141374d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.059406 Jan 22 22:02:01.536105 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4481/8670] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:02:01 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:02:02.547629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d28011f7-1751-4d84-8778-83db83f49d54 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:02.548633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d28011f7-1751-4d84-8778-83db83f49d54 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:02.556072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d28011f7-1751-4d84-8778-83db83f49d54 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:02.556531 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d28011f7-1751-4d84-8778-83db83f49d54 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:02.557321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d28011f7-1751-4d84-8778-83db83f49d54 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:02.557800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d28011f7-1751-4d84-8778-83db83f49d54 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:02.605291 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d28011f7-1751-4d84-8778-83db83f49d54 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.061687 Jan 22 22:02:02.605962 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4190/8671] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:02:02 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:02:03.617527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9c00b987-7df4-4e15-8c0b-0d5ea845ad4c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:03.618569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9c00b987-7df4-4e15-8c0b-0d5ea845ad4c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:03.626125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c00b987-7df4-4e15-8c0b-0d5ea845ad4c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:03.626599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c00b987-7df4-4e15-8c0b-0d5ea845ad4c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:03.627406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c00b987-7df4-4e15-8c0b-0d5ea845ad4c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:03.627870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c00b987-7df4-4e15-8c0b-0d5ea845ad4c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:03.672580 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9c00b987-7df4-4e15-8c0b-0d5ea845ad4c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.059266 Jan 22 22:02:03.673213 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4482/8672] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:02:03 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:02:04.684823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-46b53631-ad27-43ee-b694-7317f0b1de5c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:04.685769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-46b53631-ad27-43ee-b694-7317f0b1de5c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:04.693058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-46b53631-ad27-43ee-b694-7317f0b1de5c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:04.693590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-46b53631-ad27-43ee-b694-7317f0b1de5c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:04.694325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-46b53631-ad27-43ee-b694-7317f0b1de5c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:04.694762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-46b53631-ad27-43ee-b694-7317f0b1de5c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:04.738185 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-46b53631-ad27-43ee-b694-7317f0b1de5c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.057410 Jan 22 22:02:04.739400 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4191/8673] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:02:04 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:02:05.751896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f7614d7-8ed4-4c09-b755-b9e16f95ff6b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:05.752833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f7614d7-8ed4-4c09-b755-b9e16f95ff6b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:05.760210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f7614d7-8ed4-4c09-b755-b9e16f95ff6b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:05.760685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f7614d7-8ed4-4c09-b755-b9e16f95ff6b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:05.761491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f7614d7-8ed4-4c09-b755-b9e16f95ff6b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:05.761991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f7614d7-8ed4-4c09-b755-b9e16f95ff6b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:05.822322 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f7614d7-8ed4-4c09-b755-b9e16f95ff6b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.075146 Jan 22 22:02:05.823225 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4483/8674] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:02:05 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:02:06.835275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-53bee275-48e7-49a3-9c4c-48493b5389a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:06.836277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-53bee275-48e7-49a3-9c4c-48493b5389a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:06.844133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53bee275-48e7-49a3-9c4c-48493b5389a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:06.844616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53bee275-48e7-49a3-9c4c-48493b5389a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:06.845412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53bee275-48e7-49a3-9c4c-48493b5389a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:06.845869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53bee275-48e7-49a3-9c4c-48493b5389a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:06.892473 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-53bee275-48e7-49a3-9c4c-48493b5389a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.061171 Jan 22 22:02:06.893146 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4192/8675] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:02:06 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:02:07.904914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e843abea-9dff-4d78-8047-8f321aaf9d7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:07.905947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e843abea-9dff-4d78-8047-8f321aaf9d7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:07.913217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e843abea-9dff-4d78-8047-8f321aaf9d7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:07.913720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e843abea-9dff-4d78-8047-8f321aaf9d7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:07.914530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e843abea-9dff-4d78-8047-8f321aaf9d7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:07.914984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e843abea-9dff-4d78-8047-8f321aaf9d7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:07.955137 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e843abea-9dff-4d78-8047-8f321aaf9d7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.054250 Jan 22 22:02:07.956019 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4484/8676] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:02:07 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:02:08.967122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-20ae7bdd-3105-4c71-95e0-9d54a0495d6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:08.968139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-20ae7bdd-3105-4c71-95e0-9d54a0495d6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:08.975551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20ae7bdd-3105-4c71-95e0-9d54a0495d6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:08.976009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20ae7bdd-3105-4c71-95e0-9d54a0495d6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:08.976802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20ae7bdd-3105-4c71-95e0-9d54a0495d6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:08.977254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-20ae7bdd-3105-4c71-95e0-9d54a0495d6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:09.018036 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-20ae7bdd-3105-4c71-95e0-9d54a0495d6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 32644 microversion: 2.1 time: 0.054940 Jan 22 22:02:09.018667 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4193/8677] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:02:08 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:02:10.030338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d7d0f01a-ae70-4fb7-830e-953d77460991 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:10.031368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d7d0f01a-ae70-4fb7-830e-953d77460991 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:10.038835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7d0f01a-ae70-4fb7-830e-953d77460991 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:10.039313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7d0f01a-ae70-4fb7-830e-953d77460991 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:10.040126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7d0f01a-ae70-4fb7-830e-953d77460991 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:10.040589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d7d0f01a-ae70-4fb7-830e-953d77460991 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:10.096939 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d7d0f01a-ae70-4fb7-830e-953d77460991 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 200 len: 40792 microversion: 2.1 time: 0.070573 Jan 22 22:02:10.097923 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4485/8678] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:02:10 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 40792 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:02:10.108302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-968673b2-4390-45cf-aa4e-c0c98af8926b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:10.108993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-968673b2-4390-45cf-aa4e-c0c98af8926b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:10.116511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-968673b2-4390-45cf-aa4e-c0c98af8926b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:10.116961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-968673b2-4390-45cf-aa4e-c0c98af8926b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:10.117769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-968673b2-4390-45cf-aa4e-c0c98af8926b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:10.118210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-968673b2-4390-45cf-aa4e-c0c98af8926b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:10.251119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-968673b2-4390-45cf-aa4e-c0c98af8926b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:10.258684 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-968673b2-4390-45cf-aa4e-c0c98af8926b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1671 microversion: 2.1 time: 0.154498 Jan 22 22:02:10.259260 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4194/8679] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:10 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:10.275465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-107a1293-501f-4096-a120-082f48aa9e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:10.276579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-107a1293-501f-4096-a120-082f48aa9e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:10.288569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-107a1293-501f-4096-a120-082f48aa9e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:10.288569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-107a1293-501f-4096-a120-082f48aa9e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:10.288569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-107a1293-501f-4096-a120-082f48aa9e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:10.288569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-107a1293-501f-4096-a120-082f48aa9e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:10.313563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-107a1293-501f-4096-a120-082f48aa9e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:10.319920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-107a1293-501f-4096-a120-082f48aa9e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Old instance type m1.heat2, new instance type m1.heat {{(pid=137032) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 22:02:10.326191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-107a1293-501f-4096-a120-082f48aa9e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:02:10.326666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-107a1293-501f-4096-a120-082f48aa9e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:02:10.327177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-107a1293-501f-4096-a120-082f48aa9e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:02:10.327591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-107a1293-501f-4096-a120-082f48aa9e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:02:10.328022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-107a1293-501f-4096-a120-082f48aa9e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:02:10.573658 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-107a1293-501f-4096-a120-082f48aa9e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 202 len: 0 microversion: 2.1 time: 0.302125 Jan 22 22:02:10.574203 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4486/8680] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:02:10 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:02:10.582984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c0ee551e-1cce-4523-b556-44a077cf7d4c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:10.583617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c0ee551e-1cce-4523-b556-44a077cf7d4c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:10.590399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0ee551e-1cce-4523-b556-44a077cf7d4c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:10.591621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0ee551e-1cce-4523-b556-44a077cf7d4c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:10.592611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0ee551e-1cce-4523-b556-44a077cf7d4c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:10.593066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0ee551e-1cce-4523-b556-44a077cf7d4c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:10.728710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c0ee551e-1cce-4523-b556-44a077cf7d4c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:10.736240 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c0ee551e-1cce-4523-b556-44a077cf7d4c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1680 microversion: 2.1 time: 0.157345 Jan 22 22:02:10.736826 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4195/8681] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:10 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:11.755398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b407ac13-c2a6-4ceb-b609-05bff55e6bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:11.755958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b407ac13-c2a6-4ceb-b609-05bff55e6bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:11.762980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b407ac13-c2a6-4ceb-b609-05bff55e6bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:11.763448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b407ac13-c2a6-4ceb-b609-05bff55e6bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:11.764266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b407ac13-c2a6-4ceb-b609-05bff55e6bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:11.764732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b407ac13-c2a6-4ceb-b609-05bff55e6bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:11.904988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b407ac13-c2a6-4ceb-b609-05bff55e6bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:11.912653 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b407ac13-c2a6-4ceb-b609-05bff55e6bb3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1680 microversion: 2.1 time: 0.162174 Jan 22 22:02:11.915480 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4487/8682] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:11 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:12.930310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ad421537-3528-410a-973f-176b5ca37e6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:12.931047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ad421537-3528-410a-973f-176b5ca37e6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:12.937841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad421537-3528-410a-973f-176b5ca37e6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:12.938374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad421537-3528-410a-973f-176b5ca37e6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:12.939230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad421537-3528-410a-973f-176b5ca37e6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:12.939741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad421537-3528-410a-973f-176b5ca37e6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:13.144997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ad421537-3528-410a-973f-176b5ca37e6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:13.153553 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ad421537-3528-410a-973f-176b5ca37e6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1680 microversion: 2.1 time: 0.226955 Jan 22 22:02:13.154932 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4196/8683] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:12 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:14.171958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7ea905ff-f853-4ce8-8a4e-3d4535b7a6aa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:14.172725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7ea905ff-f853-4ce8-8a4e-3d4535b7a6aa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:14.179533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ea905ff-f853-4ce8-8a4e-3d4535b7a6aa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:14.180043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ea905ff-f853-4ce8-8a4e-3d4535b7a6aa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:14.180853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ea905ff-f853-4ce8-8a4e-3d4535b7a6aa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:14.181312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ea905ff-f853-4ce8-8a4e-3d4535b7a6aa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:14.321749 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7ea905ff-f853-4ce8-8a4e-3d4535b7a6aa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:14.329318 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7ea905ff-f853-4ce8-8a4e-3d4535b7a6aa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1685 microversion: 2.1 time: 0.161723 Jan 22 22:02:14.329923 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4488/8684] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:14 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:15.347266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a446eeb6-c9b4-4297-a9a3-c256f7ffd13b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:15.347876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a446eeb6-c9b4-4297-a9a3-c256f7ffd13b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:15.354687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a446eeb6-c9b4-4297-a9a3-c256f7ffd13b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:15.355135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a446eeb6-c9b4-4297-a9a3-c256f7ffd13b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:15.355910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a446eeb6-c9b4-4297-a9a3-c256f7ffd13b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:15.356349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a446eeb6-c9b4-4297-a9a3-c256f7ffd13b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:15.489590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a446eeb6-c9b4-4297-a9a3-c256f7ffd13b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:15.496986 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a446eeb6-c9b4-4297-a9a3-c256f7ffd13b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1685 microversion: 2.1 time: 0.154013 Jan 22 22:02:15.497571 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4197/8685] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:15 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:16.513813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-223eca66-6bf6-4210-897c-57e510b4378d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:16.514396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-223eca66-6bf6-4210-897c-57e510b4378d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:16.521242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-223eca66-6bf6-4210-897c-57e510b4378d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:16.521753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-223eca66-6bf6-4210-897c-57e510b4378d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:16.522562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-223eca66-6bf6-4210-897c-57e510b4378d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:16.523065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-223eca66-6bf6-4210-897c-57e510b4378d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:16.656181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-223eca66-6bf6-4210-897c-57e510b4378d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:16.663612 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-223eca66-6bf6-4210-897c-57e510b4378d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1685 microversion: 2.1 time: 0.153601 Jan 22 22:02:16.664190 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4489/8686] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:16 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:17.680404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a43873af-22c5-4922-aaaf-3906351bca24 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:17.681006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a43873af-22c5-4922-aaaf-3906351bca24 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:17.687814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a43873af-22c5-4922-aaaf-3906351bca24 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:17.688258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a43873af-22c5-4922-aaaf-3906351bca24 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:17.689041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a43873af-22c5-4922-aaaf-3906351bca24 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:17.689480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a43873af-22c5-4922-aaaf-3906351bca24 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:17.825634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a43873af-22c5-4922-aaaf-3906351bca24 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:17.833713 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a43873af-22c5-4922-aaaf-3906351bca24 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1685 microversion: 2.1 time: 0.157357 Jan 22 22:02:17.834282 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4198/8687] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:17 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:18.850747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5d131e0f-8014-4e74-b0e4-74738bbae836 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:18.851372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5d131e0f-8014-4e74-b0e4-74738bbae836 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:18.858100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d131e0f-8014-4e74-b0e4-74738bbae836 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:18.859389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d131e0f-8014-4e74-b0e4-74738bbae836 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:18.860401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d131e0f-8014-4e74-b0e4-74738bbae836 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:18.860859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5d131e0f-8014-4e74-b0e4-74738bbae836 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:18.994659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5d131e0f-8014-4e74-b0e4-74738bbae836 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:19.002071 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5d131e0f-8014-4e74-b0e4-74738bbae836 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1685 microversion: 2.1 time: 0.155054 Jan 22 22:02:19.002640 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4490/8688] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:18 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:20.019696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-881401eb-ecf1-42ba-9718-b1eb2b8566b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:20.020338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-881401eb-ecf1-42ba-9718-b1eb2b8566b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:20.027245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-881401eb-ecf1-42ba-9718-b1eb2b8566b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:20.027707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-881401eb-ecf1-42ba-9718-b1eb2b8566b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:20.028500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-881401eb-ecf1-42ba-9718-b1eb2b8566b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:20.028950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-881401eb-ecf1-42ba-9718-b1eb2b8566b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:20.157673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-881401eb-ecf1-42ba-9718-b1eb2b8566b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:20.165148 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-881401eb-ecf1-42ba-9718-b1eb2b8566b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1685 microversion: 2.1 time: 0.149309 Jan 22 22:02:20.165751 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4199/8689] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:20 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:21.181539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d1c19e7a-bbce-4fbb-ac0f-e8205d6e0cdf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:21.182163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d1c19e7a-bbce-4fbb-ac0f-e8205d6e0cdf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:21.189537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1c19e7a-bbce-4fbb-ac0f-e8205d6e0cdf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:21.190012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1c19e7a-bbce-4fbb-ac0f-e8205d6e0cdf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:21.190863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1c19e7a-bbce-4fbb-ac0f-e8205d6e0cdf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:21.191362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d1c19e7a-bbce-4fbb-ac0f-e8205d6e0cdf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:21.320921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d1c19e7a-bbce-4fbb-ac0f-e8205d6e0cdf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:21.328487 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d1c19e7a-bbce-4fbb-ac0f-e8205d6e0cdf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1685 microversion: 2.1 time: 0.150671 Jan 22 22:02:21.329093 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4491/8690] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:21 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:22.346605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0dec9211-da1e-4dd2-8d32-b9c13c2a954f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:22.347233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0dec9211-da1e-4dd2-8d32-b9c13c2a954f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:22.353894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dec9211-da1e-4dd2-8d32-b9c13c2a954f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:22.354355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dec9211-da1e-4dd2-8d32-b9c13c2a954f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:22.355150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dec9211-da1e-4dd2-8d32-b9c13c2a954f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:22.355728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0dec9211-da1e-4dd2-8d32-b9c13c2a954f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:22.493321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0dec9211-da1e-4dd2-8d32-b9c13c2a954f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:22.500791 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0dec9211-da1e-4dd2-8d32-b9c13c2a954f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1685 microversion: 2.1 time: 0.158869 Jan 22 22:02:22.501359 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4200/8691] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:22 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:23.517747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e602f8d7-c601-4df0-9f7c-be0fc413e8d8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:23.518314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e602f8d7-c601-4df0-9f7c-be0fc413e8d8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:23.524988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e602f8d7-c601-4df0-9f7c-be0fc413e8d8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:23.525472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e602f8d7-c601-4df0-9f7c-be0fc413e8d8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:23.526314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e602f8d7-c601-4df0-9f7c-be0fc413e8d8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:23.526787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e602f8d7-c601-4df0-9f7c-be0fc413e8d8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:23.662073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e602f8d7-c601-4df0-9f7c-be0fc413e8d8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:23.669642 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e602f8d7-c601-4df0-9f7c-be0fc413e8d8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1685 microversion: 2.1 time: 0.155774 Jan 22 22:02:23.672364 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4492/8692] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:23 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:24.686903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9d6af38f-6592-4e99-a5c6-c4a754d424fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:24.687488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9d6af38f-6592-4e99-a5c6-c4a754d424fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:24.694794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d6af38f-6592-4e99-a5c6-c4a754d424fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:24.695264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d6af38f-6592-4e99-a5c6-c4a754d424fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:24.696043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d6af38f-6592-4e99-a5c6-c4a754d424fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:24.696481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9d6af38f-6592-4e99-a5c6-c4a754d424fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:24.826859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9d6af38f-6592-4e99-a5c6-c4a754d424fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:24.835007 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9d6af38f-6592-4e99-a5c6-c4a754d424fb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1685 microversion: 2.1 time: 0.151877 Jan 22 22:02:24.835574 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4201/8693] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:24 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:25.852139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d370a58e-d5de-4dfb-bcff-f6e8d248c97e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:25.852787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d370a58e-d5de-4dfb-bcff-f6e8d248c97e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:25.859509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d370a58e-d5de-4dfb-bcff-f6e8d248c97e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:25.860619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d370a58e-d5de-4dfb-bcff-f6e8d248c97e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:25.861426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d370a58e-d5de-4dfb-bcff-f6e8d248c97e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:25.861909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d370a58e-d5de-4dfb-bcff-f6e8d248c97e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:26.007308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d370a58e-d5de-4dfb-bcff-f6e8d248c97e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:26.015056 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d370a58e-d5de-4dfb-bcff-f6e8d248c97e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1685 microversion: 2.1 time: 0.166658 Jan 22 22:02:26.015644 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4493/8694] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:25 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:26.705586 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-78e439ed-9e1f-42d6-bfc4-8045aa699c84 req-c54f3337-651f-48a2-a983-ee111c05f6ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e67ed9-41af-4a15-becf-84fdc7a45619", "name": "network-vif-unplugged", "status": "completed", "tag": "75955176-29de-4070-a66d-138778d81512"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:26.707336 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:02:26.707336 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:02:26.715175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-78e439ed-9e1f-42d6-bfc4-8045aa699c84 req-c54f3337-651f-48a2-a983-ee111c05f6ad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:26.715619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-78e439ed-9e1f-42d6-bfc4-8045aa699c84 req-c54f3337-651f-48a2-a983-ee111c05f6ad service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:26.727294 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-78e439ed-9e1f-42d6-bfc4-8045aa699c84 req-c54f3337-651f-48a2-a983-ee111c05f6ad service nova] Creating event network-vif-unplugged:75955176-29de-4070-a66d-138778d81512 for instance 95e67ed9-41af-4a15-becf-84fdc7a45619 on nch2-master-1 Jan 22 22:02:26.732580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-78e439ed-9e1f-42d6-bfc4-8045aa699c84 req-c54f3337-651f-48a2-a983-ee111c05f6ad service nova] Instance 95e67ed9-41af-4a15-becf-84fdc7a45619 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:02:26.744328 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-78e439ed-9e1f-42d6-bfc4-8045aa699c84 req-c54f3337-651f-48a2-a983-ee111c05f6ad service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042799 Jan 22 22:02:26.744934 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4202/8695] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:02:27.033327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c90b895c-82b1-4fe3-b978-1b0dd6592aad tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:27.034023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c90b895c-82b1-4fe3-b978-1b0dd6592aad tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:27.040965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c90b895c-82b1-4fe3-b978-1b0dd6592aad tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:27.041450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c90b895c-82b1-4fe3-b978-1b0dd6592aad tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:27.042487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c90b895c-82b1-4fe3-b978-1b0dd6592aad tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:27.042957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c90b895c-82b1-4fe3-b978-1b0dd6592aad tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:27.244435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c90b895c-82b1-4fe3-b978-1b0dd6592aad tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:27.251954 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c90b895c-82b1-4fe3-b978-1b0dd6592aad tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1684 microversion: 2.1 time: 0.223585 Jan 22 22:02:27.252521 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4494/8696] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:27 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1684 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:28.270865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-941a9971-a0d6-4596-b449-b3071d4e2529 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:28.271556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-941a9971-a0d6-4596-b449-b3071d4e2529 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:28.277786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-941a9971-a0d6-4596-b449-b3071d4e2529 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:28.278241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-941a9971-a0d6-4596-b449-b3071d4e2529 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:28.279025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-941a9971-a0d6-4596-b449-b3071d4e2529 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:28.279455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-941a9971-a0d6-4596-b449-b3071d4e2529 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:28.436795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-941a9971-a0d6-4596-b449-b3071d4e2529 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:28.447516 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-941a9971-a0d6-4596-b449-b3071d4e2529 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1684 microversion: 2.1 time: 0.182048 Jan 22 22:02:28.448132 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4203/8697] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:28 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:28.759062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-bbdf0b9e-d458-4366-b432-0bbc5de20acd req-2fee7bfb-a2dc-4ead-b1c8-e362955dfd84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e67ed9-41af-4a15-becf-84fdc7a45619", "tag": "75955176-29de-4070-a66d-138778d81512"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:28.760628 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:02:28.760628 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:02:28.773201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bbdf0b9e-d458-4366-b432-0bbc5de20acd req-2fee7bfb-a2dc-4ead-b1c8-e362955dfd84 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:28.774114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bbdf0b9e-d458-4366-b432-0bbc5de20acd req-2fee7bfb-a2dc-4ead-b1c8-e362955dfd84 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:28.796296 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-bbdf0b9e-d458-4366-b432-0bbc5de20acd req-2fee7bfb-a2dc-4ead-b1c8-e362955dfd84 service nova] Creating event network-changed:75955176-29de-4070-a66d-138778d81512 for instance 95e67ed9-41af-4a15-becf-84fdc7a45619 on nch2-master-1 Jan 22 22:02:28.802862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-bbdf0b9e-d458-4366-b432-0bbc5de20acd req-2fee7bfb-a2dc-4ead-b1c8-e362955dfd84 service nova] Instance 95e67ed9-41af-4a15-becf-84fdc7a45619 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:02:28.817719 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-bbdf0b9e-d458-4366-b432-0bbc5de20acd req-2fee7bfb-a2dc-4ead-b1c8-e362955dfd84 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062165 Jan 22 22:02:28.818358 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4495/8698] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:02:29.468003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-308fc86f-aa5a-4275-a2e4-0c394f1ccaae tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:29.468637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-308fc86f-aa5a-4275-a2e4-0c394f1ccaae tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:29.475609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-308fc86f-aa5a-4275-a2e4-0c394f1ccaae tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:29.476064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-308fc86f-aa5a-4275-a2e4-0c394f1ccaae tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:29.476853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-308fc86f-aa5a-4275-a2e4-0c394f1ccaae tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:29.477297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-308fc86f-aa5a-4275-a2e4-0c394f1ccaae tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:29.607535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-308fc86f-aa5a-4275-a2e4-0c394f1ccaae tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:29.616108 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-308fc86f-aa5a-4275-a2e4-0c394f1ccaae tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1682 microversion: 2.1 time: 0.151840 Jan 22 22:02:29.616688 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4204/8699] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:29 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:30.635711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f4889889-d5c0-4b92-b842-b2b4e15195c5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:30.636453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f4889889-d5c0-4b92-b842-b2b4e15195c5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:30.642871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4889889-d5c0-4b92-b842-b2b4e15195c5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:30.643343 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4889889-d5c0-4b92-b842-b2b4e15195c5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:30.644147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4889889-d5c0-4b92-b842-b2b4e15195c5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:30.644609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f4889889-d5c0-4b92-b842-b2b4e15195c5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:30.777253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f4889889-d5c0-4b92-b842-b2b4e15195c5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:30.785740 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f4889889-d5c0-4b92-b842-b2b4e15195c5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1682 microversion: 2.1 time: 0.154959 Jan 22 22:02:30.786316 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4496/8700] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:30 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:31.803613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a9e81128-b7fd-4ce0-88b0-3930312b106c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:31.804254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a9e81128-b7fd-4ce0-88b0-3930312b106c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:31.811089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9e81128-b7fd-4ce0-88b0-3930312b106c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:31.811549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9e81128-b7fd-4ce0-88b0-3930312b106c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:31.812437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9e81128-b7fd-4ce0-88b0-3930312b106c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:31.812877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a9e81128-b7fd-4ce0-88b0-3930312b106c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:31.948300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a9e81128-b7fd-4ce0-88b0-3930312b106c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:31.956131 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a9e81128-b7fd-4ce0-88b0-3930312b106c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1679 microversion: 2.1 time: 0.156422 Jan 22 22:02:31.956708 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4205/8701] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:31 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:31.972918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5ac6154a-37d6-4857-86f1-b85d3cb01e48 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:31.973486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5ac6154a-37d6-4857-86f1-b85d3cb01e48 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:31.980150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ac6154a-37d6-4857-86f1-b85d3cb01e48 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:31.980616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ac6154a-37d6-4857-86f1-b85d3cb01e48 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:31.981412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ac6154a-37d6-4857-86f1-b85d3cb01e48 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:31.981902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ac6154a-37d6-4857-86f1-b85d3cb01e48 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:32.157799 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5ac6154a-37d6-4857-86f1-b85d3cb01e48 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action" status: 204 len: 0 microversion: 2.1 time: 0.188487 Jan 22 22:02:32.158445 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4497/8702] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:02:31 2022] POST /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619/action => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:02:32.166682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1c27c862-0703-41dc-9b32-c62b90bd4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:32.167305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1c27c862-0703-41dc-9b32-c62b90bd4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:32.174230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c27c862-0703-41dc-9b32-c62b90bd4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:32.174600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c27c862-0703-41dc-9b32-c62b90bd4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:32.175410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c27c862-0703-41dc-9b32-c62b90bd4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:32.175857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1c27c862-0703-41dc-9b32-c62b90bd4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:32.343779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1c27c862-0703-41dc-9b32-c62b90bd4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:32.352551 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1c27c862-0703-41dc-9b32-c62b90bd4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1679 microversion: 2.1 time: 0.189628 Jan 22 22:02:32.353143 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4206/8703] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:32 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:33.371186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-47a9b214-f2d8-467a-9137-e4fecd1e73b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:33.371906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-47a9b214-f2d8-467a-9137-e4fecd1e73b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:33.379016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47a9b214-f2d8-467a-9137-e4fecd1e73b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:33.379545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47a9b214-f2d8-467a-9137-e4fecd1e73b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:33.380370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47a9b214-f2d8-467a-9137-e4fecd1e73b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:33.380834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47a9b214-f2d8-467a-9137-e4fecd1e73b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:33.524605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-47a9b214-f2d8-467a-9137-e4fecd1e73b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:33.532132 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-47a9b214-f2d8-467a-9137-e4fecd1e73b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1679 microversion: 2.1 time: 0.165879 Jan 22 22:02:33.532760 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4498/8704] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:33 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:33.652981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-323f765d-5548-4d46-aa37-57d24fbef53f req-32f01d1f-99e4-4870-9f05-1b91292a2b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e67ed9-41af-4a15-becf-84fdc7a45619", "name": "network-vif-plugged", "status": "completed", "tag": "75955176-29de-4070-a66d-138778d81512"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:33.654734 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:02:33.654734 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:02:33.664535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-323f765d-5548-4d46-aa37-57d24fbef53f req-32f01d1f-99e4-4870-9f05-1b91292a2b61 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:33.665477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-323f765d-5548-4d46-aa37-57d24fbef53f req-32f01d1f-99e4-4870-9f05-1b91292a2b61 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:33.682918 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-323f765d-5548-4d46-aa37-57d24fbef53f req-32f01d1f-99e4-4870-9f05-1b91292a2b61 service nova] Creating event network-vif-plugged:75955176-29de-4070-a66d-138778d81512 for instance 95e67ed9-41af-4a15-becf-84fdc7a45619 on nch2-master-1 Jan 22 22:02:33.683160 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-323f765d-5548-4d46-aa37-57d24fbef53f req-32f01d1f-99e4-4870-9f05-1b91292a2b61 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033924 Jan 22 22:02:33.683683 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4207/8705] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:02:34.550302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a5690ae0-ebb6-4a11-b0c3-ad096026a1ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:34.550925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a5690ae0-ebb6-4a11-b0c3-ad096026a1ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:34.557675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5690ae0-ebb6-4a11-b0c3-ad096026a1ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:34.558148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5690ae0-ebb6-4a11-b0c3-ad096026a1ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:34.558947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5690ae0-ebb6-4a11-b0c3-ad096026a1ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:34.559401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5690ae0-ebb6-4a11-b0c3-ad096026a1ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:34.691073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a5690ae0-ebb6-4a11-b0c3-ad096026a1ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:34.698523 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a5690ae0-ebb6-4a11-b0c3-ad096026a1ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1671 microversion: 2.1 time: 0.152496 Jan 22 22:02:34.699130 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4499/8706] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:34 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:34.716167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-61181277-5070-4886-ba2f-432848465902 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:34.716858 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-61181277-5070-4886-ba2f-432848465902 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:34.724870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61181277-5070-4886-ba2f-432848465902 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:34.725321 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61181277-5070-4886-ba2f-432848465902 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:34.726148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61181277-5070-4886-ba2f-432848465902 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:34.726590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61181277-5070-4886-ba2f-432848465902 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:34.863541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-61181277-5070-4886-ba2f-432848465902 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:34.871014 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-61181277-5070-4886-ba2f-432848465902 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1671 microversion: 2.1 time: 0.159703 Jan 22 22:02:34.871590 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4208/8707] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:34 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:34.887272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8c641cb2-b743-464f-aa0f-ef39f5f5cef4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:34.887890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8c641cb2-b743-464f-aa0f-ef39f5f5cef4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:34.894587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c641cb2-b743-464f-aa0f-ef39f5f5cef4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:34.894996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c641cb2-b743-464f-aa0f-ef39f5f5cef4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:34.895808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c641cb2-b743-464f-aa0f-ef39f5f5cef4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:34.896257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c641cb2-b743-464f-aa0f-ef39f5f5cef4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:35.033315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8c641cb2-b743-464f-aa0f-ef39f5f5cef4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:35.040748 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8c641cb2-b743-464f-aa0f-ef39f5f5cef4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1671 microversion: 2.1 time: 0.157077 Jan 22 22:02:35.041394 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4500/8708] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:34 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:35.056780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f840c8f3-e109-4825-a2ac-ea23736ae90d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:35.058784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f840c8f3-e109-4825-a2ac-ea23736ae90d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:35.063852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f840c8f3-e109-4825-a2ac-ea23736ae90d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:35.064377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f840c8f3-e109-4825-a2ac-ea23736ae90d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:35.065164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f840c8f3-e109-4825-a2ac-ea23736ae90d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:35.065647 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f840c8f3-e109-4825-a2ac-ea23736ae90d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:35.090869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f840c8f3-e109-4825-a2ac-ea23736ae90d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:02:35.358390 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f840c8f3-e109-4825-a2ac-ea23736ae90d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "DELETE /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 204 len: 0 microversion: 2.1 time: 0.305073 Jan 22 22:02:35.358991 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4209/8709] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:02:35 2022] DELETE /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:02:35.367690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ec905338-9f8f-42ee-83fa-245fcd6bd106 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:35.368326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ec905338-9f8f-42ee-83fa-245fcd6bd106 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:35.374609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec905338-9f8f-42ee-83fa-245fcd6bd106 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:35.378492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec905338-9f8f-42ee-83fa-245fcd6bd106 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:35.378492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec905338-9f8f-42ee-83fa-245fcd6bd106 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:35.378492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec905338-9f8f-42ee-83fa-245fcd6bd106 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:35.511798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ec905338-9f8f-42ee-83fa-245fcd6bd106 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:35.519980 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ec905338-9f8f-42ee-83fa-245fcd6bd106 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1677 microversion: 2.1 time: 0.156026 Jan 22 22:02:35.520560 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4501/8710] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:35 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:02:36.538667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-08b2e16a-03e0-4df2-9560-511e076e8ac1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:36.539395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-08b2e16a-03e0-4df2-9560-511e076e8ac1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:36.547126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08b2e16a-03e0-4df2-9560-511e076e8ac1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:36.548942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08b2e16a-03e0-4df2-9560-511e076e8ac1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:36.548942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08b2e16a-03e0-4df2-9560-511e076e8ac1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:36.548942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08b2e16a-03e0-4df2-9560-511e076e8ac1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:36.683212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-08b2e16a-03e0-4df2-9560-511e076e8ac1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:36.691631 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-08b2e16a-03e0-4df2-9560-511e076e8ac1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1677 microversion: 2.1 time: 0.157876 Jan 22 22:02:36.692221 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4210/8711] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:36 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:37.706963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5241903d-a654-4cc3-86ea-4abd02577072 req-f0a5ff57-4b39-4b97-ade1-6a7b40be8f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e67ed9-41af-4a15-becf-84fdc7a45619", "name": "network-vif-deleted", "tag": "75955176-29de-4070-a66d-138778d81512"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:37.708183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2b1c082c-3b22-4513-b964-9fec2368d4dd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:37.708806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2b1c082c-3b22-4513-b964-9fec2368d4dd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:37.710306 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:02:37.710306 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:02:37.716113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b1c082c-3b22-4513-b964-9fec2368d4dd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:37.716574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b1c082c-3b22-4513-b964-9fec2368d4dd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:37.724872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b1c082c-3b22-4513-b964-9fec2368d4dd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:37.724872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b1c082c-3b22-4513-b964-9fec2368d4dd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:37.725166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5241903d-a654-4cc3-86ea-4abd02577072 req-f0a5ff57-4b39-4b97-ade1-6a7b40be8f06 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:37.725166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5241903d-a654-4cc3-86ea-4abd02577072 req-f0a5ff57-4b39-4b97-ade1-6a7b40be8f06 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:37.732977 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5241903d-a654-4cc3-86ea-4abd02577072 req-f0a5ff57-4b39-4b97-ade1-6a7b40be8f06 service nova] Creating event network-vif-deleted:75955176-29de-4070-a66d-138778d81512 for instance 95e67ed9-41af-4a15-becf-84fdc7a45619 on nch2-master-1 Jan 22 22:02:37.739656 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-5241903d-a654-4cc3-86ea-4abd02577072 req-f0a5ff57-4b39-4b97-ade1-6a7b40be8f06 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036867 Jan 22 22:02:37.740384 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4502/8712] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:02:37.787322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2b1c082c-3b22-4513-b964-9fec2368d4dd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:37.794935 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2b1c082c-3b22-4513-b964-9fec2368d4dd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 200 len: 1610 microversion: 2.1 time: 0.090593 Jan 22 22:02:37.795605 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4211/8713] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:37 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 1610 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:02:38.814126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c570b404-adf1-48be-bf96-3e99f1a6f713 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:38.814879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c570b404-adf1-48be-bf96-3e99f1a6f713 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:38.821217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c570b404-adf1-48be-bf96-3e99f1a6f713 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:38.821730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c570b404-adf1-48be-bf96-3e99f1a6f713 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:38.822537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c570b404-adf1-48be-bf96-3e99f1a6f713 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:38.823000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c570b404-adf1-48be-bf96-3e99f1a6f713 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:38.837992 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-c570b404-adf1-48be-bf96-3e99f1a6f713 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance 95e67ed9-41af-4a15-becf-84fdc7a45619 could not be found. Jan 22 22:02:38.838602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c570b404-adf1-48be-bf96-3e99f1a6f713 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance 95e67ed9-41af-4a15-becf-84fdc7a45619 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:02:38.839440 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c570b404-adf1-48be-bf96-3e99f1a6f713 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 404 len: 111 microversion: 2.1 time: 0.030299 Jan 22 22:02:38.839980 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4503/8714] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:38 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:02:38.852727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4007fa7-7332-4b77-819b-9d9ea0fc2164 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:38.853341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c4007fa7-7332-4b77-819b-9d9ea0fc2164 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:38.860158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4007fa7-7332-4b77-819b-9d9ea0fc2164 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:38.860558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4007fa7-7332-4b77-819b-9d9ea0fc2164 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:38.861342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4007fa7-7332-4b77-819b-9d9ea0fc2164 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:38.861817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4007fa7-7332-4b77-819b-9d9ea0fc2164 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:38.875861 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-c4007fa7-7332-4b77-819b-9d9ea0fc2164 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance 95e67ed9-41af-4a15-becf-84fdc7a45619 could not be found. Jan 22 22:02:38.876445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4007fa7-7332-4b77-819b-9d9ea0fc2164 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance 95e67ed9-41af-4a15-becf-84fdc7a45619 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:02:38.877265 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c4007fa7-7332-4b77-819b-9d9ea0fc2164 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 404 len: 111 microversion: 2.1 time: 0.028331 Jan 22 22:02:38.877831 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4212/8715] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:38 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:02:38.925163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1097715090", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "fb9f5138-713d-480c-9e87-dbd89c7312b8"}], "security_groups": [{"name": "tempest-securitygroup--452255190"}], "key_name": "tempest-keypair-908140357", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:39.025294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] validate_networks() for [('fb9f5138-713d-480c-9e87-dbd89c7312b8', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:02:39.410409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:02:39.410883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:02:39.411385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:02:39.411814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:02:39.412246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:02:39.420923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:39.422167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:39.422310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:39.422704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:39.439920 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for project af530edb3b084c18bf5595f46cffdf35. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:02:39.445530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for user d51f7a75cf6144f0b3bf7e63fcea6827 and project af530edb3b084c18bf5595f46cffdf35. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:02:39.458095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:02:39.460462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:02:39.570295 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f1824436-5ae5-4627-8303-a7da33e0f43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.648730 Jan 22 22:02:39.570946 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4504/8716] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:02:38 2022] POST /compute/v2.1/servers => generated 407 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 22:02:39.580838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab079c2c-13cc-4df6-92bd-8c59c4088315 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:39.581483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab079c2c-13cc-4df6-92bd-8c59c4088315 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:39.633950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab079c2c-13cc-4df6-92bd-8c59c4088315 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:39.640654 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab079c2c-13cc-4df6-92bd-8c59c4088315 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1242 microversion: 2.1 time: 0.063454 Jan 22 22:02:39.641154 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4213/8717] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:39 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:02:40.658206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8d153916-1458-42d2-8639-8437e297b8a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:40.658843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8d153916-1458-42d2-8639-8437e297b8a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:40.712490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8d153916-1458-42d2-8639-8437e297b8a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:40.719436 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8d153916-1458-42d2-8639-8437e297b8a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1242 microversion: 2.1 time: 0.065777 Jan 22 22:02:40.719998 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4505/8718] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:40 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:41.741757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-70b5f491-7197-4597-a8cc-134d4b039c85 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:41.742853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-70b5f491-7197-4597-a8cc-134d4b039c85 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:41.795235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-70b5f491-7197-4597-a8cc-134d4b039c85 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:41.803570 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-70b5f491-7197-4597-a8cc-134d4b039c85 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1242 microversion: 2.1 time: 0.069703 Jan 22 22:02:41.804128 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4214/8719] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:41 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:42.820146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fa4d7c0c-3ccd-4338-962a-702bbd1b5b22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:42.820769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fa4d7c0c-3ccd-4338-962a-702bbd1b5b22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:42.880904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fa4d7c0c-3ccd-4338-962a-702bbd1b5b22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:42.887509 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fa4d7c0c-3ccd-4338-962a-702bbd1b5b22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1242 microversion: 2.1 time: 0.071080 Jan 22 22:02:42.888115 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4506/8720] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:42 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:43.905221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e5bd973a-ceb0-4b1b-9344-c2e98fea78ab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:43.905873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e5bd973a-ceb0-4b1b-9344-c2e98fea78ab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:43.912753 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e5bd973a-ceb0-4b1b-9344-c2e98fea78ab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:43.913220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e5bd973a-ceb0-4b1b-9344-c2e98fea78ab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:43.914060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e5bd973a-ceb0-4b1b-9344-c2e98fea78ab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:43.914515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e5bd973a-ceb0-4b1b-9344-c2e98fea78ab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:43.978871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e5bd973a-ceb0-4b1b-9344-c2e98fea78ab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:43.986239 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e5bd973a-ceb0-4b1b-9344-c2e98fea78ab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1246 microversion: 2.1 time: 0.084772 Jan 22 22:02:43.986819 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4215/8721] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:43 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:45.005427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ea585216-b81c-45df-8f9b-3fceffef6f8b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:45.006090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ea585216-b81c-45df-8f9b-3fceffef6f8b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:45.013041 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea585216-b81c-45df-8f9b-3fceffef6f8b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:45.013552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea585216-b81c-45df-8f9b-3fceffef6f8b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:45.014882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea585216-b81c-45df-8f9b-3fceffef6f8b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:45.015345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ea585216-b81c-45df-8f9b-3fceffef6f8b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:45.077905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ea585216-b81c-45df-8f9b-3fceffef6f8b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:45.085520 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ea585216-b81c-45df-8f9b-3fceffef6f8b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1294 microversion: 2.1 time: 0.085672 Jan 22 22:02:45.086088 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4507/8722] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:44 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:46.103222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0c687074-ad50-4e65-b6cf-01a554e7d618 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:46.103849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0c687074-ad50-4e65-b6cf-01a554e7d618 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:46.110270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c687074-ad50-4e65-b6cf-01a554e7d618 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:46.110721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c687074-ad50-4e65-b6cf-01a554e7d618 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:46.111508 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c687074-ad50-4e65-b6cf-01a554e7d618 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:46.111943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c687074-ad50-4e65-b6cf-01a554e7d618 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:46.185725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0c687074-ad50-4e65-b6cf-01a554e7d618 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:46.193997 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0c687074-ad50-4e65-b6cf-01a554e7d618 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1300 microversion: 2.1 time: 0.094483 Jan 22 22:02:46.194570 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4216/8723] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:46 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:47.170682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-4f447c37-a1f0-40b9-b385-641e2dc30e93 req-725beefe-a569-4ecb-a87f-8179245e6058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eac993df-5bb7-4ef9-857f-99e4674678cc", "tag": "465b32fb-6c84-430d-a46e-c121d11a251f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:47.172337 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:02:47.172337 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:02:47.180323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4f447c37-a1f0-40b9-b385-641e2dc30e93 req-725beefe-a569-4ecb-a87f-8179245e6058 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:47.180796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4f447c37-a1f0-40b9-b385-641e2dc30e93 req-725beefe-a569-4ecb-a87f-8179245e6058 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:47.192174 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-4f447c37-a1f0-40b9-b385-641e2dc30e93 req-725beefe-a569-4ecb-a87f-8179245e6058 service nova] Creating event network-changed:465b32fb-6c84-430d-a46e-c121d11a251f for instance eac993df-5bb7-4ef9-857f-99e4674678cc on nch2-master-1 Jan 22 22:02:47.197308 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-4f447c37-a1f0-40b9-b385-641e2dc30e93 req-725beefe-a569-4ecb-a87f-8179245e6058 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030208 Jan 22 22:02:47.198191 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4508/8724] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:02:47.211804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-58576f5e-b907-4864-84a0-21ecdd74c4be tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:47.212501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-58576f5e-b907-4864-84a0-21ecdd74c4be tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:47.219680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58576f5e-b907-4864-84a0-21ecdd74c4be tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:47.223069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58576f5e-b907-4864-84a0-21ecdd74c4be tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:47.223069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58576f5e-b907-4864-84a0-21ecdd74c4be tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:47.223069 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-58576f5e-b907-4864-84a0-21ecdd74c4be tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:47.372782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-58576f5e-b907-4864-84a0-21ecdd74c4be tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:47.381677 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-58576f5e-b907-4864-84a0-21ecdd74c4be tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1367 microversion: 2.1 time: 0.173977 Jan 22 22:02:47.383757 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4217/8725] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:47 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:48.400582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-42d284cb-ff29-4723-bb16-9860e8db2dd4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:48.401320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-42d284cb-ff29-4723-bb16-9860e8db2dd4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:48.407500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42d284cb-ff29-4723-bb16-9860e8db2dd4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:48.407965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42d284cb-ff29-4723-bb16-9860e8db2dd4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:48.411637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42d284cb-ff29-4723-bb16-9860e8db2dd4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:48.411637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-42d284cb-ff29-4723-bb16-9860e8db2dd4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:48.544484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-42d284cb-ff29-4723-bb16-9860e8db2dd4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:48.552767 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-42d284cb-ff29-4723-bb16-9860e8db2dd4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1367 microversion: 2.1 time: 0.157073 Jan 22 22:02:48.553701 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4509/8726] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:48 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:49.570950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c21acb80-f8f8-4fb9-88fb-af1e42b08723 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:49.571555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c21acb80-f8f8-4fb9-88fb-af1e42b08723 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:49.578420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c21acb80-f8f8-4fb9-88fb-af1e42b08723 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:49.578876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c21acb80-f8f8-4fb9-88fb-af1e42b08723 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:49.579693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c21acb80-f8f8-4fb9-88fb-af1e42b08723 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:49.580141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c21acb80-f8f8-4fb9-88fb-af1e42b08723 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:49.715791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c21acb80-f8f8-4fb9-88fb-af1e42b08723 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:49.723842 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c21acb80-f8f8-4fb9-88fb-af1e42b08723 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1367 microversion: 2.1 time: 0.157227 Jan 22 22:02:49.724418 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4218/8727] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:49 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:50.741896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0c25ab5c-e204-4dfd-9ede-566e7a93c58e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:50.742472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0c25ab5c-e204-4dfd-9ede-566e7a93c58e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:50.749189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c25ab5c-e204-4dfd-9ede-566e7a93c58e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:50.749695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c25ab5c-e204-4dfd-9ede-566e7a93c58e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:50.750502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c25ab5c-e204-4dfd-9ede-566e7a93c58e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:50.750985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c25ab5c-e204-4dfd-9ede-566e7a93c58e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:50.881625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0c25ab5c-e204-4dfd-9ede-566e7a93c58e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:50.888838 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0c25ab5c-e204-4dfd-9ede-566e7a93c58e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1367 microversion: 2.1 time: 0.151643 Jan 22 22:02:50.889402 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4510/8728] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:50 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:51.906600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-92bccbf6-d25d-4e03-96c4-1506faa0fadf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:51.907562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-92bccbf6-d25d-4e03-96c4-1506faa0fadf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:51.914486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92bccbf6-d25d-4e03-96c4-1506faa0fadf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:51.914950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92bccbf6-d25d-4e03-96c4-1506faa0fadf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:51.915759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92bccbf6-d25d-4e03-96c4-1506faa0fadf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:51.916202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92bccbf6-d25d-4e03-96c4-1506faa0fadf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:52.048624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-92bccbf6-d25d-4e03-96c4-1506faa0fadf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:52.056958 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-92bccbf6-d25d-4e03-96c4-1506faa0fadf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1367 microversion: 2.1 time: 0.154114 Jan 22 22:02:52.057554 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4219/8729] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:51 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:53.074152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4968f57d-d763-4a4a-8733-7336bc151a73 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:53.074791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4968f57d-d763-4a4a-8733-7336bc151a73 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:53.081646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4968f57d-d763-4a4a-8733-7336bc151a73 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:53.082114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4968f57d-d763-4a4a-8733-7336bc151a73 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:53.083719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4968f57d-d763-4a4a-8733-7336bc151a73 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:53.084173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4968f57d-d763-4a4a-8733-7336bc151a73 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:53.214028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4968f57d-d763-4a4a-8733-7336bc151a73 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:53.221318 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4968f57d-d763-4a4a-8733-7336bc151a73 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1367 microversion: 2.1 time: 0.150898 Jan 22 22:02:53.221910 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4511/8730] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:53 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:53.746567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-d7df5fd0-fe91-4607-ad4d-53cacce126b3 req-8e93c0ed-f7ce-4961-a349-dbaeeddd4e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac993df-5bb7-4ef9-857f-99e4674678cc", "name": "network-vif-plugged", "status": "completed", "tag": "465b32fb-6c84-430d-a46e-c121d11a251f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:53.749203 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:02:53.749203 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:02:53.756452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d7df5fd0-fe91-4607-ad4d-53cacce126b3 req-8e93c0ed-f7ce-4961-a349-dbaeeddd4e9e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:53.756911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d7df5fd0-fe91-4607-ad4d-53cacce126b3 req-8e93c0ed-f7ce-4961-a349-dbaeeddd4e9e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:53.768036 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-d7df5fd0-fe91-4607-ad4d-53cacce126b3 req-8e93c0ed-f7ce-4961-a349-dbaeeddd4e9e service nova] Creating event network-vif-plugged:465b32fb-6c84-430d-a46e-c121d11a251f for instance eac993df-5bb7-4ef9-857f-99e4674678cc on nch2-master-1 Jan 22 22:02:53.772939 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-d7df5fd0-fe91-4607-ad4d-53cacce126b3 req-8e93c0ed-f7ce-4961-a349-dbaeeddd4e9e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030150 Jan 22 22:02:53.777786 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4220/8731] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:02:54.238805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ac490adb-c133-496c-861a-f7dfa6211c8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:54.239564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ac490adb-c133-496c-861a-f7dfa6211c8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:54.246704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac490adb-c133-496c-861a-f7dfa6211c8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:54.247207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac490adb-c133-496c-861a-f7dfa6211c8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:54.248021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac490adb-c133-496c-861a-f7dfa6211c8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:54.248518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac490adb-c133-496c-861a-f7dfa6211c8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:54.385054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ac490adb-c133-496c-861a-f7dfa6211c8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:54.392773 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ac490adb-c133-496c-861a-f7dfa6211c8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1367 microversion: 2.1 time: 0.158013 Jan 22 22:02:54.393363 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4512/8732] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:54 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:02:55.412244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0d6ef48b-6c09-41c7-a149-4796873f20a8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:55.413072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0d6ef48b-6c09-41c7-a149-4796873f20a8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:55.419599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d6ef48b-6c09-41c7-a149-4796873f20a8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:55.420004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d6ef48b-6c09-41c7-a149-4796873f20a8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:55.420795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d6ef48b-6c09-41c7-a149-4796873f20a8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:55.421253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d6ef48b-6c09-41c7-a149-4796873f20a8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:55.552306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0d6ef48b-6c09-41c7-a149-4796873f20a8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:02:55.559896 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0d6ef48b-6c09-41c7-a149-4796873f20a8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1554 microversion: 2.1 time: 0.152912 Jan 22 22:02:55.560472 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4221/8733] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:02:55 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:02:55.577523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-11df52fb-1fce-4a12-9229-3d7d9eede36c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:02:55.578062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-11df52fb-1fce-4a12-9229-3d7d9eede36c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:55.585120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11df52fb-1fce-4a12-9229-3d7d9eede36c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:55.585627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11df52fb-1fce-4a12-9229-3d7d9eede36c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:55.586431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11df52fb-1fce-4a12-9229-3d7d9eede36c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:55.586889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-11df52fb-1fce-4a12-9229-3d7d9eede36c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:55.744184 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-11df52fb-1fce-4a12-9229-3d7d9eede36c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170446 Jan 22 22:02:55.744790 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4513/8734] 10.222.0.100 () {58 vars in 1279 bytes} [Sat Jan 22 22:02:55 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:02:56.962207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eae293b9-92a3-427c-bd6a-5a70e2bc69e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:56.963127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eae293b9-92a3-427c-bd6a-5a70e2bc69e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:56.968870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-26518da7-7dd3-40bd-ab35-fd6f1b72a444 req-0741f257-98cc-410e-8fd4-b7cd028b5c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eac993df-5bb7-4ef9-857f-99e4674678cc", "tag": "465b32fb-6c84-430d-a46e-c121d11a251f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:56.971808 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:02:56.971808 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:02:56.976783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eae293b9-92a3-427c-bd6a-5a70e2bc69e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:56.977244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eae293b9-92a3-427c-bd6a-5a70e2bc69e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:56.978071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eae293b9-92a3-427c-bd6a-5a70e2bc69e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:56.978514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eae293b9-92a3-427c-bd6a-5a70e2bc69e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:56.978950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-26518da7-7dd3-40bd-ab35-fd6f1b72a444 req-0741f257-98cc-410e-8fd4-b7cd028b5c44 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:56.979425 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-26518da7-7dd3-40bd-ab35-fd6f1b72a444 req-0741f257-98cc-410e-8fd4-b7cd028b5c44 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:57.000312 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-26518da7-7dd3-40bd-ab35-fd6f1b72a444 req-0741f257-98cc-410e-8fd4-b7cd028b5c44 service nova] Creating event network-changed:465b32fb-6c84-430d-a46e-c121d11a251f for instance eac993df-5bb7-4ef9-857f-99e4674678cc on nch2-master-1 Jan 22 22:02:57.006418 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-26518da7-7dd3-40bd-ab35-fd6f1b72a444 req-0741f257-98cc-410e-8fd4-b7cd028b5c44 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041863 Jan 22 22:02:57.007266 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4514/8735] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:02:57.021601 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eae293b9-92a3-427c-bd6a-5a70e2bc69e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 14 microversion: 2.1 time: 0.062860 Jan 22 22:02:57.022770 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4222/8736] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:02:56 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:02:58.034050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-568484af-39a1-408c-bddb-e225b1db6274 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:58.035049 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-568484af-39a1-408c-bddb-e225b1db6274 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:58.041149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-568484af-39a1-408c-bddb-e225b1db6274 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:58.041658 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-568484af-39a1-408c-bddb-e225b1db6274 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:58.042462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-568484af-39a1-408c-bddb-e225b1db6274 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:58.042914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-568484af-39a1-408c-bddb-e225b1db6274 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:58.079949 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-568484af-39a1-408c-bddb-e225b1db6274 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 14 microversion: 2.1 time: 0.050630 Jan 22 22:02:58.080815 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4515/8737] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:02:58 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:02:59.091885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4c9367fb-0b6b-4069-868c-89f6294bdaeb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:02:59.092871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4c9367fb-0b6b-4069-868c-89f6294bdaeb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:02:59.100241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c9367fb-0b6b-4069-868c-89f6294bdaeb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:59.100695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c9367fb-0b6b-4069-868c-89f6294bdaeb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:59.101469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c9367fb-0b6b-4069-868c-89f6294bdaeb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:02:59.101928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4c9367fb-0b6b-4069-868c-89f6294bdaeb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:02:59.138725 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4c9367fb-0b6b-4069-868c-89f6294bdaeb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 14 microversion: 2.1 time: 0.050836 Jan 22 22:02:59.139499 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4223/8738] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:02:59 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:03:00.150119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-671d75f6-d374-435e-8d82-6013a1d9eb7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:00.151052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-671d75f6-d374-435e-8d82-6013a1d9eb7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:00.158385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-671d75f6-d374-435e-8d82-6013a1d9eb7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:00.158858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-671d75f6-d374-435e-8d82-6013a1d9eb7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:00.159670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-671d75f6-d374-435e-8d82-6013a1d9eb7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:00.160117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-671d75f6-d374-435e-8d82-6013a1d9eb7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:00.200859 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-671d75f6-d374-435e-8d82-6013a1d9eb7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 14 microversion: 2.1 time: 0.054829 Jan 22 22:03:00.201551 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4516/8739] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:00 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:03:01.212903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11c28974-ed72-4168-be32-3b3e0f552be8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:01.213946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-11c28974-ed72-4168-be32-3b3e0f552be8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:01.221297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c28974-ed72-4168-be32-3b3e0f552be8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:01.221796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c28974-ed72-4168-be32-3b3e0f552be8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:01.222590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c28974-ed72-4168-be32-3b3e0f552be8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:01.223276 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c28974-ed72-4168-be32-3b3e0f552be8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:01.260463 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-11c28974-ed72-4168-be32-3b3e0f552be8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 14 microversion: 2.1 time: 0.051664 Jan 22 22:03:01.261117 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4224/8740] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:01 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:03:02.272525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7fe54ffa-a343-44a6-8c50-f873c8c46c5d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:02.273597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7fe54ffa-a343-44a6-8c50-f873c8c46c5d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:02.280941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fe54ffa-a343-44a6-8c50-f873c8c46c5d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:02.281414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fe54ffa-a343-44a6-8c50-f873c8c46c5d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:02.282241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fe54ffa-a343-44a6-8c50-f873c8c46c5d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:02.282700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7fe54ffa-a343-44a6-8c50-f873c8c46c5d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:02.319974 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7fe54ffa-a343-44a6-8c50-f873c8c46c5d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 14 microversion: 2.1 time: 0.052065 Jan 22 22:03:02.320586 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4517/8741] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:02 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:03:03.330938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b1fa501b-ed13-47c4-a678-64685ac2861b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:03.331978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b1fa501b-ed13-47c4-a678-64685ac2861b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:03.339577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1fa501b-ed13-47c4-a678-64685ac2861b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:03.340037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1fa501b-ed13-47c4-a678-64685ac2861b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:03.340831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1fa501b-ed13-47c4-a678-64685ac2861b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:03.341282 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1fa501b-ed13-47c4-a678-64685ac2861b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:03.381577 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b1fa501b-ed13-47c4-a678-64685ac2861b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 14 microversion: 2.1 time: 0.054710 Jan 22 22:03:03.382229 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4225/8742] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:03 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:03:04.397027 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b5091862-923b-4cfa-8d4a-b73faf7eef53 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:04.398026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b5091862-923b-4cfa-8d4a-b73faf7eef53 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:04.405563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b5091862-923b-4cfa-8d4a-b73faf7eef53 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:04.406044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b5091862-923b-4cfa-8d4a-b73faf7eef53 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:04.406899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b5091862-923b-4cfa-8d4a-b73faf7eef53 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:04.407358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b5091862-923b-4cfa-8d4a-b73faf7eef53 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:04.450072 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b5091862-923b-4cfa-8d4a-b73faf7eef53 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 14 microversion: 2.1 time: 0.058593 Jan 22 22:03:04.450877 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4518/8743] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:04 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:03:05.461655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-445a487c-5e43-4ef5-88ca-edd7ca444e22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:05.462592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-445a487c-5e43-4ef5-88ca-edd7ca444e22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:05.469941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-445a487c-5e43-4ef5-88ca-edd7ca444e22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:05.470397 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-445a487c-5e43-4ef5-88ca-edd7ca444e22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:05.471181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-445a487c-5e43-4ef5-88ca-edd7ca444e22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:05.471625 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-445a487c-5e43-4ef5-88ca-edd7ca444e22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:05.511095 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-445a487c-5e43-4ef5-88ca-edd7ca444e22 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 14 microversion: 2.1 time: 0.054285 Jan 22 22:03:05.511703 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4226/8744] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:05 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:03:06.523159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bf37c23e-8303-423f-b35e-71b3c8d5fa78 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:06.524170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bf37c23e-8303-423f-b35e-71b3c8d5fa78 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:06.531513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf37c23e-8303-423f-b35e-71b3c8d5fa78 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:06.532032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf37c23e-8303-423f-b35e-71b3c8d5fa78 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:06.532850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf37c23e-8303-423f-b35e-71b3c8d5fa78 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:06.533287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bf37c23e-8303-423f-b35e-71b3c8d5fa78 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:06.573774 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bf37c23e-8303-423f-b35e-71b3c8d5fa78 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 14 microversion: 2.1 time: 0.055179 Jan 22 22:03:06.574411 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4519/8745] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:06 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:03:07.585744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-242fd916-2dee-4ac1-b510-8d2842095e2e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:07.586749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-242fd916-2dee-4ac1-b510-8d2842095e2e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:07.594180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-242fd916-2dee-4ac1-b510-8d2842095e2e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:07.594639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-242fd916-2dee-4ac1-b510-8d2842095e2e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:07.595436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-242fd916-2dee-4ac1-b510-8d2842095e2e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:07.595889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-242fd916-2dee-4ac1-b510-8d2842095e2e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:07.645914 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-242fd916-2dee-4ac1-b510-8d2842095e2e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 8207 microversion: 2.1 time: 0.064707 Jan 22 22:03:07.646460 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4227/8746] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:07 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 8207 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:03:08.656825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3bf5703f-6274-433c-95c5-a73e3a039e4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:08.657868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3bf5703f-6274-433c-95c5-a73e3a039e4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:08.666395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3bf5703f-6274-433c-95c5-a73e3a039e4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:08.666871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3bf5703f-6274-433c-95c5-a73e3a039e4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:08.667668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3bf5703f-6274-433c-95c5-a73e3a039e4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:08.668129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3bf5703f-6274-433c-95c5-a73e3a039e4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:08.721916 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3bf5703f-6274-433c-95c5-a73e3a039e4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 16400 microversion: 2.1 time: 0.069070 Jan 22 22:03:08.723211 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4520/8747] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:08 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 16400 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:09.734447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2f0f58b1-ff25-4518-aaa6-2d0969e0b292 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:09.735447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2f0f58b1-ff25-4518-aaa6-2d0969e0b292 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:09.743170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0f58b1-ff25-4518-aaa6-2d0969e0b292 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:09.743622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0f58b1-ff25-4518-aaa6-2d0969e0b292 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:09.744406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0f58b1-ff25-4518-aaa6-2d0969e0b292 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:09.744845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2f0f58b1-ff25-4518-aaa6-2d0969e0b292 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:09.783486 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2f0f58b1-ff25-4518-aaa6-2d0969e0b292 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 16400 microversion: 2.1 time: 0.052962 Jan 22 22:03:09.784100 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4228/8748] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:09 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 16400 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:10.796673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3c0557a9-5e7d-4664-aa6f-1542d6b8d93c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:10.797760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3c0557a9-5e7d-4664-aa6f-1542d6b8d93c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:10.805787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c0557a9-5e7d-4664-aa6f-1542d6b8d93c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:10.806270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c0557a9-5e7d-4664-aa6f-1542d6b8d93c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:10.807089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c0557a9-5e7d-4664-aa6f-1542d6b8d93c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:10.807555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c0557a9-5e7d-4664-aa6f-1542d6b8d93c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:10.846285 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3c0557a9-5e7d-4664-aa6f-1542d6b8d93c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 16400 microversion: 2.1 time: 0.054005 Jan 22 22:03:10.846930 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4521/8749] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:10 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 16400 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:11.859003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bb56ca47-1ff4-4cbe-9766-5239b250f61c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:11.860042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bb56ca47-1ff4-4cbe-9766-5239b250f61c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:11.867906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb56ca47-1ff4-4cbe-9766-5239b250f61c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:11.868367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb56ca47-1ff4-4cbe-9766-5239b250f61c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:11.869159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb56ca47-1ff4-4cbe-9766-5239b250f61c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:11.869633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb56ca47-1ff4-4cbe-9766-5239b250f61c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:11.908604 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bb56ca47-1ff4-4cbe-9766-5239b250f61c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 16400 microversion: 2.1 time: 0.053792 Jan 22 22:03:11.909221 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4229/8750] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:11 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 16400 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:12.920752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0b4495e1-eafc-41cb-b723-f0b6905185da tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:12.921817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0b4495e1-eafc-41cb-b723-f0b6905185da tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:12.929167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b4495e1-eafc-41cb-b723-f0b6905185da tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:12.929675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b4495e1-eafc-41cb-b723-f0b6905185da tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:12.930478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b4495e1-eafc-41cb-b723-f0b6905185da tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:12.930938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b4495e1-eafc-41cb-b723-f0b6905185da tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:12.969668 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0b4495e1-eafc-41cb-b723-f0b6905185da tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 16400 microversion: 2.1 time: 0.052980 Jan 22 22:03:12.970327 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4522/8751] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:12 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 16400 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:13.880069 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:03:13.880768 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:03:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:03:13.981473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-52d2aaf9-7273-41d3-b9bb-5a259dfcb475 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:13.982518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-52d2aaf9-7273-41d3-b9bb-5a259dfcb475 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:13.991351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52d2aaf9-7273-41d3-b9bb-5a259dfcb475 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:13.991795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52d2aaf9-7273-41d3-b9bb-5a259dfcb475 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:13.992568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52d2aaf9-7273-41d3-b9bb-5a259dfcb475 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:13.993005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-52d2aaf9-7273-41d3-b9bb-5a259dfcb475 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:14.040095 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-52d2aaf9-7273-41d3-b9bb-5a259dfcb475 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.062465 Jan 22 22:03:14.040729 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4230/8752] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:13 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:15.051872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-894d093c-e92f-4f8d-9c11-23b329376ecc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:15.060864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-894d093c-e92f-4f8d-9c11-23b329376ecc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:15.060864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-894d093c-e92f-4f8d-9c11-23b329376ecc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:15.060864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-894d093c-e92f-4f8d-9c11-23b329376ecc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:15.061543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-894d093c-e92f-4f8d-9c11-23b329376ecc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:15.062002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-894d093c-e92f-4f8d-9c11-23b329376ecc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:15.101047 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-894d093c-e92f-4f8d-9c11-23b329376ecc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.053459 Jan 22 22:03:15.101734 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4523/8753] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:15 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:16.113004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2523adc9-2410-4a42-b24f-bbff1f07dc8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:16.114272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2523adc9-2410-4a42-b24f-bbff1f07dc8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:16.121600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2523adc9-2410-4a42-b24f-bbff1f07dc8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:16.122058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2523adc9-2410-4a42-b24f-bbff1f07dc8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:16.123095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2523adc9-2410-4a42-b24f-bbff1f07dc8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:16.123812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2523adc9-2410-4a42-b24f-bbff1f07dc8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:16.168751 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2523adc9-2410-4a42-b24f-bbff1f07dc8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.059980 Jan 22 22:03:16.169551 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4231/8754] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:16 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:17.181166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4f2461d2-3948-437c-a0fb-b610423e842c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:17.182299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4f2461d2-3948-437c-a0fb-b610423e842c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:17.189535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f2461d2-3948-437c-a0fb-b610423e842c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:17.190004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f2461d2-3948-437c-a0fb-b610423e842c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:17.190798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f2461d2-3948-437c-a0fb-b610423e842c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:17.191256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4f2461d2-3948-437c-a0fb-b610423e842c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:17.230807 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4f2461d2-3948-437c-a0fb-b610423e842c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.053641 Jan 22 22:03:17.231431 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4524/8755] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:17 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:18.242787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ed26a8d7-d43f-47ef-bd3d-1970ce9f8e98 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:18.243796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ed26a8d7-d43f-47ef-bd3d-1970ce9f8e98 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:18.251326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed26a8d7-d43f-47ef-bd3d-1970ce9f8e98 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:18.251831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed26a8d7-d43f-47ef-bd3d-1970ce9f8e98 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:18.252658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed26a8d7-d43f-47ef-bd3d-1970ce9f8e98 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:18.253107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ed26a8d7-d43f-47ef-bd3d-1970ce9f8e98 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:18.292913 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ed26a8d7-d43f-47ef-bd3d-1970ce9f8e98 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.054123 Jan 22 22:03:18.293569 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4232/8756] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:18 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:19.305662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3c90719f-8ab9-4d12-9283-754332922619 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:19.306712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3c90719f-8ab9-4d12-9283-754332922619 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:19.314115 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c90719f-8ab9-4d12-9283-754332922619 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:19.314592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c90719f-8ab9-4d12-9283-754332922619 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:19.315400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c90719f-8ab9-4d12-9283-754332922619 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:19.315858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3c90719f-8ab9-4d12-9283-754332922619 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:19.357688 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3c90719f-8ab9-4d12-9283-754332922619 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.056647 Jan 22 22:03:19.358331 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4525/8757] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:19 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:03:20.369318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-59fa02c9-17aa-49e9-b8bc-80f23bbc35e7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:20.370332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-59fa02c9-17aa-49e9-b8bc-80f23bbc35e7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:20.377669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59fa02c9-17aa-49e9-b8bc-80f23bbc35e7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:20.378125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59fa02c9-17aa-49e9-b8bc-80f23bbc35e7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:20.378966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59fa02c9-17aa-49e9-b8bc-80f23bbc35e7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:20.379409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59fa02c9-17aa-49e9-b8bc-80f23bbc35e7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:20.420424 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-59fa02c9-17aa-49e9-b8bc-80f23bbc35e7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.055004 Jan 22 22:03:20.421579 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4233/8758] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:20 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:21.432879 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f23e2327-94b6-4909-9fc3-7094f538f271 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:21.434000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f23e2327-94b6-4909-9fc3-7094f538f271 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:21.442037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f23e2327-94b6-4909-9fc3-7094f538f271 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:21.445054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f23e2327-94b6-4909-9fc3-7094f538f271 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:21.445054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f23e2327-94b6-4909-9fc3-7094f538f271 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:21.445054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f23e2327-94b6-4909-9fc3-7094f538f271 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:21.484284 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f23e2327-94b6-4909-9fc3-7094f538f271 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.055492 Jan 22 22:03:21.485211 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4526/8759] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:21 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:03:22.496883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ae605a6d-626d-4272-a714-1984f5c90c5f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:22.497896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ae605a6d-626d-4272-a714-1984f5c90c5f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:22.505921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae605a6d-626d-4272-a714-1984f5c90c5f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:22.506399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae605a6d-626d-4272-a714-1984f5c90c5f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:22.507229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae605a6d-626d-4272-a714-1984f5c90c5f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:22.507677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae605a6d-626d-4272-a714-1984f5c90c5f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:22.548650 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ae605a6d-626d-4272-a714-1984f5c90c5f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.055624 Jan 22 22:03:22.549283 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4234/8760] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:22 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:23.561119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-960ea2a2-24a8-4c05-b8a8-7c4f5bc588b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:23.562167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-960ea2a2-24a8-4c05-b8a8-7c4f5bc588b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:23.569826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-960ea2a2-24a8-4c05-b8a8-7c4f5bc588b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:23.572701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-960ea2a2-24a8-4c05-b8a8-7c4f5bc588b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:23.572701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-960ea2a2-24a8-4c05-b8a8-7c4f5bc588b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:23.572701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-960ea2a2-24a8-4c05-b8a8-7c4f5bc588b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:23.618010 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-960ea2a2-24a8-4c05-b8a8-7c4f5bc588b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.061065 Jan 22 22:03:23.618687 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4527/8761] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:23 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:24.630762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-242749f9-40a3-4f92-8f7a-ecf26cdbd4b2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:24.631756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-242749f9-40a3-4f92-8f7a-ecf26cdbd4b2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:24.639121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-242749f9-40a3-4f92-8f7a-ecf26cdbd4b2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:24.639617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-242749f9-40a3-4f92-8f7a-ecf26cdbd4b2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:24.640394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-242749f9-40a3-4f92-8f7a-ecf26cdbd4b2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:24.640831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-242749f9-40a3-4f92-8f7a-ecf26cdbd4b2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:24.681318 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-242749f9-40a3-4f92-8f7a-ecf26cdbd4b2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.055070 Jan 22 22:03:24.682231 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4235/8762] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:24 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:25.694141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ead99a1c-e774-4872-8517-6354ab941d06 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:25.695186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ead99a1c-e774-4872-8517-6354ab941d06 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:25.702667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ead99a1c-e774-4872-8517-6354ab941d06 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:25.703135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ead99a1c-e774-4872-8517-6354ab941d06 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:25.703972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ead99a1c-e774-4872-8517-6354ab941d06 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:25.704457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ead99a1c-e774-4872-8517-6354ab941d06 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:25.743919 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ead99a1c-e774-4872-8517-6354ab941d06 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.054507 Jan 22 22:03:25.744592 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4528/8763] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:25 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:26.756311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c1913d29-3b6f-4369-9653-46bd3ca23875 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:26.757286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c1913d29-3b6f-4369-9653-46bd3ca23875 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:26.764674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1913d29-3b6f-4369-9653-46bd3ca23875 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:26.765125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1913d29-3b6f-4369-9653-46bd3ca23875 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:26.765937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1913d29-3b6f-4369-9653-46bd3ca23875 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:26.766381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1913d29-3b6f-4369-9653-46bd3ca23875 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:26.805349 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c1913d29-3b6f-4369-9653-46bd3ca23875 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.053202 Jan 22 22:03:26.806319 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4236/8764] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:26 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:27.817458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-90afcd0b-52b4-4a07-9ed3-f7f752bce63f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:27.818506 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-90afcd0b-52b4-4a07-9ed3-f7f752bce63f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:27.825943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90afcd0b-52b4-4a07-9ed3-f7f752bce63f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:27.826426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90afcd0b-52b4-4a07-9ed3-f7f752bce63f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:27.827237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90afcd0b-52b4-4a07-9ed3-f7f752bce63f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:27.827702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90afcd0b-52b4-4a07-9ed3-f7f752bce63f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:27.867443 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-90afcd0b-52b4-4a07-9ed3-f7f752bce63f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.054588 Jan 22 22:03:27.868082 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4529/8765] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:27 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:28.878982 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cc979429-7d2a-4c02-9821-d78493b934a4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:28.879985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cc979429-7d2a-4c02-9821-d78493b934a4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:28.887336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc979429-7d2a-4c02-9821-d78493b934a4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:28.887797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc979429-7d2a-4c02-9821-d78493b934a4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:28.888576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc979429-7d2a-4c02-9821-d78493b934a4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:28.889020 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cc979429-7d2a-4c02-9821-d78493b934a4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:28.931711 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cc979429-7d2a-4c02-9821-d78493b934a4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.056658 Jan 22 22:03:28.932408 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4237/8766] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:28 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:29.944754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-40308852-efbc-4c5c-b83e-ab4f2a5877bf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:29.945838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-40308852-efbc-4c5c-b83e-ab4f2a5877bf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:29.953119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40308852-efbc-4c5c-b83e-ab4f2a5877bf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:29.953699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40308852-efbc-4c5c-b83e-ab4f2a5877bf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:29.955724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40308852-efbc-4c5c-b83e-ab4f2a5877bf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:29.956218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40308852-efbc-4c5c-b83e-ab4f2a5877bf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:30.000500 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-40308852-efbc-4c5c-b83e-ab4f2a5877bf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.060221 Jan 22 22:03:30.001648 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4530/8767] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:29 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:31.015406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0baebb66-3331-411b-bd74-0c697b256139 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:31.016467 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0baebb66-3331-411b-bd74-0c697b256139 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:31.024078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0baebb66-3331-411b-bd74-0c697b256139 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:31.024530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0baebb66-3331-411b-bd74-0c697b256139 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:31.025306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0baebb66-3331-411b-bd74-0c697b256139 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:31.025774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0baebb66-3331-411b-bd74-0c697b256139 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:31.064661 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0baebb66-3331-411b-bd74-0c697b256139 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.053178 Jan 22 22:03:31.067524 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4238/8768] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:31 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:32.077526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d8bde07c-385a-499b-a654-9ae6f2819964 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:32.078545 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d8bde07c-385a-499b-a654-9ae6f2819964 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:32.086310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8bde07c-385a-499b-a654-9ae6f2819964 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:32.086773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8bde07c-385a-499b-a654-9ae6f2819964 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:32.087567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8bde07c-385a-499b-a654-9ae6f2819964 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:32.088020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d8bde07c-385a-499b-a654-9ae6f2819964 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:32.129108 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d8bde07c-385a-499b-a654-9ae6f2819964 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.055500 Jan 22 22:03:32.130577 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4531/8769] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:32 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:33.141691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1056c3b5-61ae-4d71-8482-d2617ce944ac tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:33.142739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1056c3b5-61ae-4d71-8482-d2617ce944ac tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:33.150406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1056c3b5-61ae-4d71-8482-d2617ce944ac tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:33.150871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1056c3b5-61ae-4d71-8482-d2617ce944ac tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:33.151659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1056c3b5-61ae-4d71-8482-d2617ce944ac tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:33.152106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1056c3b5-61ae-4d71-8482-d2617ce944ac tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:33.198512 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1056c3b5-61ae-4d71-8482-d2617ce944ac tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.060825 Jan 22 22:03:33.199170 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4239/8770] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:33 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:34.211622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-365f241e-afc5-4126-ba56-f618a36c2e2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:34.212577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-365f241e-afc5-4126-ba56-f618a36c2e2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:34.219939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-365f241e-afc5-4126-ba56-f618a36c2e2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:34.220409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-365f241e-afc5-4126-ba56-f618a36c2e2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:34.221212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-365f241e-afc5-4126-ba56-f618a36c2e2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:34.221698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-365f241e-afc5-4126-ba56-f618a36c2e2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:34.261187 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-365f241e-afc5-4126-ba56-f618a36c2e2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.054427 Jan 22 22:03:34.261902 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4532/8771] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:34 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:35.272870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-14f372a7-3fcb-4be5-bd6c-06fb8d094dd2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:35.274189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-14f372a7-3fcb-4be5-bd6c-06fb8d094dd2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:35.281559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14f372a7-3fcb-4be5-bd6c-06fb8d094dd2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:35.282017 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14f372a7-3fcb-4be5-bd6c-06fb8d094dd2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:35.282824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14f372a7-3fcb-4be5-bd6c-06fb8d094dd2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:35.283260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-14f372a7-3fcb-4be5-bd6c-06fb8d094dd2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:35.326207 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-14f372a7-3fcb-4be5-bd6c-06fb8d094dd2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.057325 Jan 22 22:03:35.327090 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4240/8772] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:35 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:36.338085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a4bc9d17-56c3-43c0-a12e-cfc0915bc10e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:36.339092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a4bc9d17-56c3-43c0-a12e-cfc0915bc10e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:36.346433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4bc9d17-56c3-43c0-a12e-cfc0915bc10e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:36.346909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4bc9d17-56c3-43c0-a12e-cfc0915bc10e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:36.347735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4bc9d17-56c3-43c0-a12e-cfc0915bc10e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:36.350081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a4bc9d17-56c3-43c0-a12e-cfc0915bc10e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:36.393823 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a4bc9d17-56c3-43c0-a12e-cfc0915bc10e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.059620 Jan 22 22:03:36.394511 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4533/8773] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:36 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:37.406976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24e0ad00-c6bb-46f8-8fd8-d28d2fc71802 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:37.407999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-24e0ad00-c6bb-46f8-8fd8-d28d2fc71802 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:37.415439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24e0ad00-c6bb-46f8-8fd8-d28d2fc71802 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:37.418763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24e0ad00-c6bb-46f8-8fd8-d28d2fc71802 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:37.418763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24e0ad00-c6bb-46f8-8fd8-d28d2fc71802 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:37.418763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24e0ad00-c6bb-46f8-8fd8-d28d2fc71802 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:37.457401 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-24e0ad00-c6bb-46f8-8fd8-d28d2fc71802 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.054330 Jan 22 22:03:37.458123 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4241/8774] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:37 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:38.475203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-40145f27-0469-4867-b712-6deda1619ccd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:38.476258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-40145f27-0469-4867-b712-6deda1619ccd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:38.483701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40145f27-0469-4867-b712-6deda1619ccd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:38.484175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40145f27-0469-4867-b712-6deda1619ccd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:38.484976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40145f27-0469-4867-b712-6deda1619ccd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:38.485731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40145f27-0469-4867-b712-6deda1619ccd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:38.525771 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-40145f27-0469-4867-b712-6deda1619ccd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.055398 Jan 22 22:03:38.526426 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4534/8775] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:38 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:39.537902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-06ece8be-3513-4b04-b45e-874829501cc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:39.538913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-06ece8be-3513-4b04-b45e-874829501cc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:39.546361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06ece8be-3513-4b04-b45e-874829501cc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:39.550309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06ece8be-3513-4b04-b45e-874829501cc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:39.550309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06ece8be-3513-4b04-b45e-874829501cc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:39.550309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06ece8be-3513-4b04-b45e-874829501cc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:39.587397 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-06ece8be-3513-4b04-b45e-874829501cc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.053645 Jan 22 22:03:39.588325 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4242/8776] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:39 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:40.600089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-307920a4-cf75-47a4-a7f8-333d669d7904 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:40.601029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-307920a4-cf75-47a4-a7f8-333d669d7904 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:40.608656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-307920a4-cf75-47a4-a7f8-333d669d7904 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:40.609132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-307920a4-cf75-47a4-a7f8-333d669d7904 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:40.609982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-307920a4-cf75-47a4-a7f8-333d669d7904 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:40.610695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-307920a4-cf75-47a4-a7f8-333d669d7904 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:40.649215 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-307920a4-cf75-47a4-a7f8-333d669d7904 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.053780 Jan 22 22:03:40.650108 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4535/8777] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:40 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:41.662673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8d10f4b0-debf-48a2-856b-4238336044a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:41.663697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8d10f4b0-debf-48a2-856b-4238336044a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:41.670764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d10f4b0-debf-48a2-856b-4238336044a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:41.673542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d10f4b0-debf-48a2-856b-4238336044a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:41.673542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d10f4b0-debf-48a2-856b-4238336044a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:41.673542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d10f4b0-debf-48a2-856b-4238336044a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:41.714653 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8d10f4b0-debf-48a2-856b-4238336044a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.056787 Jan 22 22:03:41.715288 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4243/8778] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:41 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:42.727248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-26c288d4-a3e8-48fc-85aa-33a930f99d17 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:42.728180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-26c288d4-a3e8-48fc-85aa-33a930f99d17 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:42.735496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26c288d4-a3e8-48fc-85aa-33a930f99d17 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:42.735972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26c288d4-a3e8-48fc-85aa-33a930f99d17 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:42.736775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26c288d4-a3e8-48fc-85aa-33a930f99d17 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:42.737236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-26c288d4-a3e8-48fc-85aa-33a930f99d17 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:42.776988 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-26c288d4-a3e8-48fc-85aa-33a930f99d17 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.054085 Jan 22 22:03:42.777685 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4536/8779] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:42 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:43.789532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-22ebc7cf-381b-4d30-862d-6f11ca185775 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:43.790557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-22ebc7cf-381b-4d30-862d-6f11ca185775 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:43.797987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22ebc7cf-381b-4d30-862d-6f11ca185775 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:43.798448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22ebc7cf-381b-4d30-862d-6f11ca185775 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:43.799244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22ebc7cf-381b-4d30-862d-6f11ca185775 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:43.799692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22ebc7cf-381b-4d30-862d-6f11ca185775 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:43.838583 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-22ebc7cf-381b-4d30-862d-6f11ca185775 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.053560 Jan 22 22:03:43.839489 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4244/8780] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:43 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:44.851345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ed1b68f2-3896-4b1c-ab20-db0b7a9faa71 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:44.852365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ed1b68f2-3896-4b1c-ab20-db0b7a9faa71 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:44.860217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed1b68f2-3896-4b1c-ab20-db0b7a9faa71 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:44.860690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed1b68f2-3896-4b1c-ab20-db0b7a9faa71 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:44.861494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed1b68f2-3896-4b1c-ab20-db0b7a9faa71 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:44.861981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ed1b68f2-3896-4b1c-ab20-db0b7a9faa71 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:44.904018 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ed1b68f2-3896-4b1c-ab20-db0b7a9faa71 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.057328 Jan 22 22:03:44.904686 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4537/8781] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:44 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:45.916922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2ae3574e-46ca-4671-a883-93f1506cf254 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:45.917956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2ae3574e-46ca-4671-a883-93f1506cf254 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:45.925327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ae3574e-46ca-4671-a883-93f1506cf254 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:45.926685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ae3574e-46ca-4671-a883-93f1506cf254 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:45.927775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ae3574e-46ca-4671-a883-93f1506cf254 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:45.928224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ae3574e-46ca-4671-a883-93f1506cf254 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:45.967037 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2ae3574e-46ca-4671-a883-93f1506cf254 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.054154 Jan 22 22:03:45.967978 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4245/8782] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:45 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:46.979406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-abd47d0b-534c-43e8-99de-aa4198bb9d83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:46.980423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-abd47d0b-534c-43e8-99de-aa4198bb9d83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:46.988203 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abd47d0b-534c-43e8-99de-aa4198bb9d83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:46.989058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abd47d0b-534c-43e8-99de-aa4198bb9d83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:46.989953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abd47d0b-534c-43e8-99de-aa4198bb9d83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:46.990440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-abd47d0b-534c-43e8-99de-aa4198bb9d83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:47.029456 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-abd47d0b-534c-43e8-99de-aa4198bb9d83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.054058 Jan 22 22:03:47.030111 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4538/8783] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:46 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:48.042463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cdc1e430-9698-4b16-a3f4-de5b9b9ba81d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:48.043471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cdc1e430-9698-4b16-a3f4-de5b9b9ba81d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:48.051107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdc1e430-9698-4b16-a3f4-de5b9b9ba81d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:48.051573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdc1e430-9698-4b16-a3f4-de5b9b9ba81d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:48.052369 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdc1e430-9698-4b16-a3f4-de5b9b9ba81d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:48.052819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdc1e430-9698-4b16-a3f4-de5b9b9ba81d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:48.095382 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cdc1e430-9698-4b16-a3f4-de5b9b9ba81d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.056826 Jan 22 22:03:48.096062 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4246/8784] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:48 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:49.108255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-98d7baf8-9a73-46a2-9156-4d6c6d31c98c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:49.109280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-98d7baf8-9a73-46a2-9156-4d6c6d31c98c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:49.117398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98d7baf8-9a73-46a2-9156-4d6c6d31c98c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:49.117896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98d7baf8-9a73-46a2-9156-4d6c6d31c98c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:49.118701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98d7baf8-9a73-46a2-9156-4d6c6d31c98c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:49.119187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-98d7baf8-9a73-46a2-9156-4d6c6d31c98c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:49.160557 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-98d7baf8-9a73-46a2-9156-4d6c6d31c98c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.056089 Jan 22 22:03:49.161228 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4539/8785] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:49 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:50.172617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-125b1e8e-2df7-492c-b383-9f3069e1d899 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:50.173650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-125b1e8e-2df7-492c-b383-9f3069e1d899 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:50.181213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-125b1e8e-2df7-492c-b383-9f3069e1d899 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:50.181708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-125b1e8e-2df7-492c-b383-9f3069e1d899 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:50.182502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-125b1e8e-2df7-492c-b383-9f3069e1d899 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:50.182952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-125b1e8e-2df7-492c-b383-9f3069e1d899 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:50.221288 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-125b1e8e-2df7-492c-b383-9f3069e1d899 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.052605 Jan 22 22:03:50.222205 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4247/8786] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:50 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:51.233980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a3b901f9-8cdc-4c9a-8661-c9b19b3e61c7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:51.235551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a3b901f9-8cdc-4c9a-8661-c9b19b3e61c7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:51.243011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b901f9-8cdc-4c9a-8661-c9b19b3e61c7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:51.243491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b901f9-8cdc-4c9a-8661-c9b19b3e61c7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:51.244301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b901f9-8cdc-4c9a-8661-c9b19b3e61c7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:51.244771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b901f9-8cdc-4c9a-8661-c9b19b3e61c7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:51.284062 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a3b901f9-8cdc-4c9a-8661-c9b19b3e61c7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.054053 Jan 22 22:03:51.284709 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4540/8787] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:51 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:52.296283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-673af710-5b41-4e9a-a9c9-36223edc1983 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:52.297285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-673af710-5b41-4e9a-a9c9-36223edc1983 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:52.305608 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-673af710-5b41-4e9a-a9c9-36223edc1983 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:52.306065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-673af710-5b41-4e9a-a9c9-36223edc1983 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:52.306853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-673af710-5b41-4e9a-a9c9-36223edc1983 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:52.307296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-673af710-5b41-4e9a-a9c9-36223edc1983 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:52.347657 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-673af710-5b41-4e9a-a9c9-36223edc1983 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.055132 Jan 22 22:03:52.348318 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4248/8788] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:52 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:53.360017 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9cb98a0c-76e3-4d65-bc40-074351cd0971 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:53.361023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9cb98a0c-76e3-4d65-bc40-074351cd0971 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:53.369092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cb98a0c-76e3-4d65-bc40-074351cd0971 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:53.369580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cb98a0c-76e3-4d65-bc40-074351cd0971 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:53.370469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cb98a0c-76e3-4d65-bc40-074351cd0971 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:53.370922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cb98a0c-76e3-4d65-bc40-074351cd0971 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:53.412046 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9cb98a0c-76e3-4d65-bc40-074351cd0971 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.056101 Jan 22 22:03:53.412701 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4541/8789] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:53 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:54.425527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-44458df5-c6e8-42fe-b6fd-60b425560be8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:54.426723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-44458df5-c6e8-42fe-b6fd-60b425560be8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:54.434138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44458df5-c6e8-42fe-b6fd-60b425560be8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:54.434602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44458df5-c6e8-42fe-b6fd-60b425560be8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:54.435396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44458df5-c6e8-42fe-b6fd-60b425560be8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:54.435838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-44458df5-c6e8-42fe-b6fd-60b425560be8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:54.478822 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-44458df5-c6e8-42fe-b6fd-60b425560be8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.058408 Jan 22 22:03:54.479519 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4249/8790] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:54 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:55.491210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-37ec7238-b20a-4c17-954d-61501fc39796 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:55.492189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-37ec7238-b20a-4c17-954d-61501fc39796 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:55.499601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37ec7238-b20a-4c17-954d-61501fc39796 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:55.500096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37ec7238-b20a-4c17-954d-61501fc39796 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:55.500919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37ec7238-b20a-4c17-954d-61501fc39796 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:55.501383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-37ec7238-b20a-4c17-954d-61501fc39796 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:55.540514 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-37ec7238-b20a-4c17-954d-61501fc39796 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.054186 Jan 22 22:03:55.541209 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4542/8791] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:55 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:56.552578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4e8f3bce-ea4a-4f98-934a-5e9fa00c2702 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:56.553616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4e8f3bce-ea4a-4f98-934a-5e9fa00c2702 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:56.561015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e8f3bce-ea4a-4f98-934a-5e9fa00c2702 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:56.561476 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e8f3bce-ea4a-4f98-934a-5e9fa00c2702 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:56.562292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e8f3bce-ea4a-4f98-934a-5e9fa00c2702 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:56.562742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e8f3bce-ea4a-4f98-934a-5e9fa00c2702 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:56.602262 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4e8f3bce-ea4a-4f98-934a-5e9fa00c2702 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 24567 microversion: 2.1 time: 0.053682 Jan 22 22:03:56.602906 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4250/8792] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:56 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 24567 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:57.615057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-629ea40a-6def-430a-a6d6-5c3f8e8d999c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:57.616085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-629ea40a-6def-430a-a6d6-5c3f8e8d999c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:57.623501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-629ea40a-6def-430a-a6d6-5c3f8e8d999c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:57.623976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-629ea40a-6def-430a-a6d6-5c3f8e8d999c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:57.624777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-629ea40a-6def-430a-a6d6-5c3f8e8d999c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:57.625239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-629ea40a-6def-430a-a6d6-5c3f8e8d999c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:57.681854 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-629ea40a-6def-430a-a6d6-5c3f8e8d999c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.071716 Jan 22 22:03:57.682513 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4543/8793] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:57 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:58.694845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-65fbb1e3-2c4a-4b3e-99a3-884c5fd19515 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:58.695775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-65fbb1e3-2c4a-4b3e-99a3-884c5fd19515 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:58.704715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65fbb1e3-2c4a-4b3e-99a3-884c5fd19515 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:58.705605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65fbb1e3-2c4a-4b3e-99a3-884c5fd19515 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:58.707246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65fbb1e3-2c4a-4b3e-99a3-884c5fd19515 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:58.708092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-65fbb1e3-2c4a-4b3e-99a3-884c5fd19515 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:58.752463 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-65fbb1e3-2c4a-4b3e-99a3-884c5fd19515 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.062036 Jan 22 22:03:58.753121 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4251/8794] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:58 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:03:59.764701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-481d1c92-2693-4fed-baa0-c43db9722e2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:03:59.765758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-481d1c92-2693-4fed-baa0-c43db9722e2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:03:59.773368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-481d1c92-2693-4fed-baa0-c43db9722e2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:59.773857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-481d1c92-2693-4fed-baa0-c43db9722e2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:59.774652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-481d1c92-2693-4fed-baa0-c43db9722e2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:03:59.775104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-481d1c92-2693-4fed-baa0-c43db9722e2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:03:59.815164 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-481d1c92-2693-4fed-baa0-c43db9722e2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054405 Jan 22 22:03:59.816414 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4544/8795] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:03:59 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:00.828361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d34913e7-2c94-48d9-a369-590b239d508b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:00.829375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d34913e7-2c94-48d9-a369-590b239d508b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:00.837926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d34913e7-2c94-48d9-a369-590b239d508b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:00.838388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d34913e7-2c94-48d9-a369-590b239d508b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:00.839229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d34913e7-2c94-48d9-a369-590b239d508b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:00.839733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d34913e7-2c94-48d9-a369-590b239d508b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:00.881568 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d34913e7-2c94-48d9-a369-590b239d508b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.057231 Jan 22 22:04:00.882211 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4252/8796] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:00 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:01.893914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ee3ab681-e874-4d8f-ab8d-91eb7b04853d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:01.894884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ee3ab681-e874-4d8f-ab8d-91eb7b04853d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:01.902245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee3ab681-e874-4d8f-ab8d-91eb7b04853d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:01.902717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee3ab681-e874-4d8f-ab8d-91eb7b04853d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:01.903509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee3ab681-e874-4d8f-ab8d-91eb7b04853d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:01.903963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee3ab681-e874-4d8f-ab8d-91eb7b04853d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:01.944627 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ee3ab681-e874-4d8f-ab8d-91eb7b04853d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054755 Jan 22 22:04:01.945271 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4545/8797] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:01 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:02.956928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2dcbfca5-a161-4ef0-b358-eab840abf67a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:02.957992 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2dcbfca5-a161-4ef0-b358-eab840abf67a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:02.965345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2dcbfca5-a161-4ef0-b358-eab840abf67a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:02.965829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2dcbfca5-a161-4ef0-b358-eab840abf67a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:02.966619 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2dcbfca5-a161-4ef0-b358-eab840abf67a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:02.967068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2dcbfca5-a161-4ef0-b358-eab840abf67a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:03.007889 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2dcbfca5-a161-4ef0-b358-eab840abf67a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054962 Jan 22 22:04:03.008775 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4253/8798] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:02 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:04.020693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-45f6680f-ecc2-468c-b867-9078d4906bd4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:04.021733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-45f6680f-ecc2-468c-b867-9078d4906bd4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:04.029042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45f6680f-ecc2-468c-b867-9078d4906bd4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:04.029527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45f6680f-ecc2-468c-b867-9078d4906bd4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:04.030321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45f6680f-ecc2-468c-b867-9078d4906bd4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:04.030796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45f6680f-ecc2-468c-b867-9078d4906bd4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:04.072956 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-45f6680f-ecc2-468c-b867-9078d4906bd4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.056506 Jan 22 22:04:04.073669 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4546/8799] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:04 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:05.085553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e6bfb344-2bda-46c8-8129-8d1ff1c3eaee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:05.086554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e6bfb344-2bda-46c8-8129-8d1ff1c3eaee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:05.093846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6bfb344-2bda-46c8-8129-8d1ff1c3eaee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:05.094296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6bfb344-2bda-46c8-8129-8d1ff1c3eaee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:05.095071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6bfb344-2bda-46c8-8129-8d1ff1c3eaee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:05.095511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6bfb344-2bda-46c8-8129-8d1ff1c3eaee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:05.135517 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e6bfb344-2bda-46c8-8129-8d1ff1c3eaee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054408 Jan 22 22:04:05.136189 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4254/8800] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:05 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:06.148610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-790d91d8-269b-49ea-bf34-87767401c167 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:06.149670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-790d91d8-269b-49ea-bf34-87767401c167 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:06.157043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-790d91d8-269b-49ea-bf34-87767401c167 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:06.157546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-790d91d8-269b-49ea-bf34-87767401c167 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:06.158354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-790d91d8-269b-49ea-bf34-87767401c167 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:06.158816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-790d91d8-269b-49ea-bf34-87767401c167 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:06.202964 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-790d91d8-269b-49ea-bf34-87767401c167 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.058992 Jan 22 22:04:06.203609 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4547/8801] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:06 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:04:07.215856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-36731e84-09f2-4e37-92b5-40b77e19ca73 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:07.216860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-36731e84-09f2-4e37-92b5-40b77e19ca73 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:07.225591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36731e84-09f2-4e37-92b5-40b77e19ca73 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:07.226054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36731e84-09f2-4e37-92b5-40b77e19ca73 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:07.226841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36731e84-09f2-4e37-92b5-40b77e19ca73 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:07.227284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-36731e84-09f2-4e37-92b5-40b77e19ca73 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:07.272675 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-36731e84-09f2-4e37-92b5-40b77e19ca73 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.060785 Jan 22 22:04:07.273546 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4255/8802] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:07 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:08.285207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-01101143-6b68-453d-9cef-a1dc28361e89 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:08.286277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-01101143-6b68-453d-9cef-a1dc28361e89 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:08.293736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01101143-6b68-453d-9cef-a1dc28361e89 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:08.295924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01101143-6b68-453d-9cef-a1dc28361e89 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:08.295924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01101143-6b68-453d-9cef-a1dc28361e89 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:08.295924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-01101143-6b68-453d-9cef-a1dc28361e89 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:08.335046 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-01101143-6b68-453d-9cef-a1dc28361e89 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.053964 Jan 22 22:04:08.335692 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4548/8803] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:08 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:09.347249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ee2598d2-17aa-447b-8676-641b985c5e9d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:09.348355 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ee2598d2-17aa-447b-8676-641b985c5e9d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:09.355744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee2598d2-17aa-447b-8676-641b985c5e9d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:09.356203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee2598d2-17aa-447b-8676-641b985c5e9d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:09.357022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee2598d2-17aa-447b-8676-641b985c5e9d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:09.357462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ee2598d2-17aa-447b-8676-641b985c5e9d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:09.404461 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ee2598d2-17aa-447b-8676-641b985c5e9d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.061513 Jan 22 22:04:09.405111 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4256/8804] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:09 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:10.450727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dec48e21-b2ab-4d01-b133-b0c497034a83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:10.450727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dec48e21-b2ab-4d01-b133-b0c497034a83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:10.450727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dec48e21-b2ab-4d01-b133-b0c497034a83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:10.450727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dec48e21-b2ab-4d01-b133-b0c497034a83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:10.450727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dec48e21-b2ab-4d01-b133-b0c497034a83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:10.450727 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dec48e21-b2ab-4d01-b133-b0c497034a83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:10.473880 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dec48e21-b2ab-4d01-b133-b0c497034a83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.060635 Jan 22 22:04:10.474538 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4549/8805] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:10 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:11.486690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4f6e9399-3e00-4319-8167-83071446e2c0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:11.487873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4f6e9399-3e00-4319-8167-83071446e2c0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:11.494885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6e9399-3e00-4319-8167-83071446e2c0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:11.495340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6e9399-3e00-4319-8167-83071446e2c0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:11.496118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6e9399-3e00-4319-8167-83071446e2c0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:11.496559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f6e9399-3e00-4319-8167-83071446e2c0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:11.537053 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4f6e9399-3e00-4319-8167-83071446e2c0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054915 Jan 22 22:04:11.537955 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4257/8806] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:11 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:12.549139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-40969b7f-63df-4650-8d64-91e4df02b4a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:12.550779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-40969b7f-63df-4650-8d64-91e4df02b4a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:12.557949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40969b7f-63df-4650-8d64-91e4df02b4a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:12.558419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40969b7f-63df-4650-8d64-91e4df02b4a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:12.559220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40969b7f-63df-4650-8d64-91e4df02b4a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:12.559680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40969b7f-63df-4650-8d64-91e4df02b4a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:12.599488 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-40969b7f-63df-4650-8d64-91e4df02b4a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054281 Jan 22 22:04:12.600110 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4550/8807] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:12 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:13.612053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f20e7ffb-b94b-4fa3-b228-f8d0e69f8d3c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:13.613676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f20e7ffb-b94b-4fa3-b228-f8d0e69f8d3c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:13.620965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f20e7ffb-b94b-4fa3-b228-f8d0e69f8d3c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:13.621421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f20e7ffb-b94b-4fa3-b228-f8d0e69f8d3c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:13.622230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f20e7ffb-b94b-4fa3-b228-f8d0e69f8d3c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:13.622670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f20e7ffb-b94b-4fa3-b228-f8d0e69f8d3c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:13.663429 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f20e7ffb-b94b-4fa3-b228-f8d0e69f8d3c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.055531 Jan 22 22:04:13.664065 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4258/8808] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:13 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:14.676213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ad31b457-abac-4f7e-8290-fa499ef644ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:14.677159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ad31b457-abac-4f7e-8290-fa499ef644ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:14.684591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad31b457-abac-4f7e-8290-fa499ef644ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:14.685070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad31b457-abac-4f7e-8290-fa499ef644ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:14.685924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad31b457-abac-4f7e-8290-fa499ef644ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:14.686386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ad31b457-abac-4f7e-8290-fa499ef644ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:14.726479 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ad31b457-abac-4f7e-8290-fa499ef644ff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.055073 Jan 22 22:04:14.727117 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4551/8809] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:14 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:15.740114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9b71d70b-5dd9-4a86-9d25-9814a8d2120f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:15.741316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9b71d70b-5dd9-4a86-9d25-9814a8d2120f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:15.749015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b71d70b-5dd9-4a86-9d25-9814a8d2120f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:15.749541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b71d70b-5dd9-4a86-9d25-9814a8d2120f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:15.750353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b71d70b-5dd9-4a86-9d25-9814a8d2120f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:15.750801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b71d70b-5dd9-4a86-9d25-9814a8d2120f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:15.792558 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9b71d70b-5dd9-4a86-9d25-9814a8d2120f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.057190 Jan 22 22:04:15.793382 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4259/8810] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:15 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:16.805869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5392d420-54c7-4ddf-be7a-e3c5cd50ed7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:16.806892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5392d420-54c7-4ddf-be7a-e3c5cd50ed7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:16.814381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5392d420-54c7-4ddf-be7a-e3c5cd50ed7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:16.814856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5392d420-54c7-4ddf-be7a-e3c5cd50ed7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:16.816011 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5392d420-54c7-4ddf-be7a-e3c5cd50ed7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:16.816486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5392d420-54c7-4ddf-be7a-e3c5cd50ed7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:16.855031 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5392d420-54c7-4ddf-be7a-e3c5cd50ed7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.053131 Jan 22 22:04:16.856039 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4552/8811] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:16 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:17.867265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0b6d69d1-dbe4-4e27-8dc6-04a4055c6ba5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:17.868291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0b6d69d1-dbe4-4e27-8dc6-04a4055c6ba5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:17.875652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b6d69d1-dbe4-4e27-8dc6-04a4055c6ba5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:17.876280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b6d69d1-dbe4-4e27-8dc6-04a4055c6ba5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:17.877088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b6d69d1-dbe4-4e27-8dc6-04a4055c6ba5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:17.877626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0b6d69d1-dbe4-4e27-8dc6-04a4055c6ba5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:17.917263 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0b6d69d1-dbe4-4e27-8dc6-04a4055c6ba5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.053902 Jan 22 22:04:17.918206 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4260/8812] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:17 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:18.930346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ca9d3dd5-707c-4f67-8d2a-9ae9b3276977 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:18.931387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ca9d3dd5-707c-4f67-8d2a-9ae9b3276977 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:18.938728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca9d3dd5-707c-4f67-8d2a-9ae9b3276977 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:18.939192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca9d3dd5-707c-4f67-8d2a-9ae9b3276977 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:18.939985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca9d3dd5-707c-4f67-8d2a-9ae9b3276977 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:18.940457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca9d3dd5-707c-4f67-8d2a-9ae9b3276977 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:18.978868 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ca9d3dd5-707c-4f67-8d2a-9ae9b3276977 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.052495 Jan 22 22:04:18.979495 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4553/8813] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:18 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:19.991577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a3a8c33c-b9aa-4112-891a-58d1c17e8854 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:19.992570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a3a8c33c-b9aa-4112-891a-58d1c17e8854 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:19.999916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3a8c33c-b9aa-4112-891a-58d1c17e8854 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:20.000368 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3a8c33c-b9aa-4112-891a-58d1c17e8854 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:20.001142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3a8c33c-b9aa-4112-891a-58d1c17e8854 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:20.001605 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3a8c33c-b9aa-4112-891a-58d1c17e8854 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:20.043394 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a3a8c33c-b9aa-4112-891a-58d1c17e8854 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.055945 Jan 22 22:04:20.044037 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4261/8814] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:19 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:21.056372 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ee25206f-a67d-4f2f-b1d9-639b1577fabf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:21.057441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ee25206f-a67d-4f2f-b1d9-639b1577fabf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:21.064819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee25206f-a67d-4f2f-b1d9-639b1577fabf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:21.066069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee25206f-a67d-4f2f-b1d9-639b1577fabf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:21.067524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee25206f-a67d-4f2f-b1d9-639b1577fabf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:21.068051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ee25206f-a67d-4f2f-b1d9-639b1577fabf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:21.107433 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ee25206f-a67d-4f2f-b1d9-639b1577fabf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.055122 Jan 22 22:04:21.108320 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4554/8815] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:21 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:22.125782 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3c33e291-e22c-4992-a405-9f2dbd53b2a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:22.126801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3c33e291-e22c-4992-a405-9f2dbd53b2a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:22.134855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c33e291-e22c-4992-a405-9f2dbd53b2a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:22.135318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c33e291-e22c-4992-a405-9f2dbd53b2a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:22.136110 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c33e291-e22c-4992-a405-9f2dbd53b2a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:22.136559 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3c33e291-e22c-4992-a405-9f2dbd53b2a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:22.183022 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3c33e291-e22c-4992-a405-9f2dbd53b2a2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.061162 Jan 22 22:04:22.183724 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4262/8816] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:22 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:23.197200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e6bc340-613e-4a97-aafa-b6395242a3f1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:23.198249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e6bc340-613e-4a97-aafa-b6395242a3f1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:23.205700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e6bc340-613e-4a97-aafa-b6395242a3f1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:23.206470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e6bc340-613e-4a97-aafa-b6395242a3f1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:23.207402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e6bc340-613e-4a97-aafa-b6395242a3f1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:23.207861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e6bc340-613e-4a97-aafa-b6395242a3f1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:23.250463 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e6bc340-613e-4a97-aafa-b6395242a3f1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.057175 Jan 22 22:04:23.251131 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4555/8817] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:23 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:24.274507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f95e50cc-4bd9-4063-be95-b3793de17c21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:24.275513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f95e50cc-4bd9-4063-be95-b3793de17c21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:24.282855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f95e50cc-4bd9-4063-be95-b3793de17c21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:24.283307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f95e50cc-4bd9-4063-be95-b3793de17c21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:24.284086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f95e50cc-4bd9-4063-be95-b3793de17c21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:24.284529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f95e50cc-4bd9-4063-be95-b3793de17c21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:24.326353 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f95e50cc-4bd9-4063-be95-b3793de17c21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.056073 Jan 22 22:04:24.326983 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4263/8818] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:24 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:25.339098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0c308acb-f3fd-4534-89c1-4638be3380f8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:25.340160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0c308acb-f3fd-4534-89c1-4638be3380f8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:25.347519 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c308acb-f3fd-4534-89c1-4638be3380f8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:25.348623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c308acb-f3fd-4534-89c1-4638be3380f8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:25.349418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c308acb-f3fd-4534-89c1-4638be3380f8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:25.349896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c308acb-f3fd-4534-89c1-4638be3380f8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:25.388890 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0c308acb-f3fd-4534-89c1-4638be3380f8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.053653 Jan 22 22:04:25.390368 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4556/8819] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:25 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:26.402045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff82e229-ce1e-40c2-8fd0-0386e16e3e90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:26.403168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ff82e229-ce1e-40c2-8fd0-0386e16e3e90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:26.410977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff82e229-ce1e-40c2-8fd0-0386e16e3e90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:26.411523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff82e229-ce1e-40c2-8fd0-0386e16e3e90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:26.412463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff82e229-ce1e-40c2-8fd0-0386e16e3e90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:26.412911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff82e229-ce1e-40c2-8fd0-0386e16e3e90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:26.455352 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff82e229-ce1e-40c2-8fd0-0386e16e3e90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.057416 Jan 22 22:04:26.456306 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4264/8820] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:26 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:27.468497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c89c6cf0-163b-4fa4-bff2-3ddda12d30b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:27.469573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c89c6cf0-163b-4fa4-bff2-3ddda12d30b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:27.477739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c89c6cf0-163b-4fa4-bff2-3ddda12d30b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:27.478245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c89c6cf0-163b-4fa4-bff2-3ddda12d30b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:27.479402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c89c6cf0-163b-4fa4-bff2-3ddda12d30b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:27.480033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c89c6cf0-163b-4fa4-bff2-3ddda12d30b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:27.521848 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c89c6cf0-163b-4fa4-bff2-3ddda12d30b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.057323 Jan 22 22:04:27.522781 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4557/8821] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:27 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:28.534562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bd064945-0a23-4ef8-8a29-483f379ac432 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:28.536197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bd064945-0a23-4ef8-8a29-483f379ac432 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:28.543612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd064945-0a23-4ef8-8a29-483f379ac432 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:28.544064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd064945-0a23-4ef8-8a29-483f379ac432 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:28.544877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd064945-0a23-4ef8-8a29-483f379ac432 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:28.545318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd064945-0a23-4ef8-8a29-483f379ac432 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:28.585260 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bd064945-0a23-4ef8-8a29-483f379ac432 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054611 Jan 22 22:04:28.586231 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4265/8822] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:28 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:29.597147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-697bba87-ec49-4a22-a0d7-15f0dfc333b8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:29.598385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-697bba87-ec49-4a22-a0d7-15f0dfc333b8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:29.605910 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-697bba87-ec49-4a22-a0d7-15f0dfc333b8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:29.606380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-697bba87-ec49-4a22-a0d7-15f0dfc333b8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:29.607183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-697bba87-ec49-4a22-a0d7-15f0dfc333b8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:29.607644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-697bba87-ec49-4a22-a0d7-15f0dfc333b8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:29.647482 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-697bba87-ec49-4a22-a0d7-15f0dfc333b8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054221 Jan 22 22:04:29.648179 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4558/8823] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:29 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:30.660611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3cfd7b72-503f-4f11-9a96-d0aeaa4dca8c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:30.661600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3cfd7b72-503f-4f11-9a96-d0aeaa4dca8c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:30.668946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cfd7b72-503f-4f11-9a96-d0aeaa4dca8c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:30.669415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cfd7b72-503f-4f11-9a96-d0aeaa4dca8c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:30.670228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cfd7b72-503f-4f11-9a96-d0aeaa4dca8c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:30.670676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cfd7b72-503f-4f11-9a96-d0aeaa4dca8c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:30.709841 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3cfd7b72-503f-4f11-9a96-d0aeaa4dca8c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.053816 Jan 22 22:04:30.710476 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4266/8824] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:30 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:31.722388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9d337795-e6c3-4f8b-acba-3c4e0e17abd8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:31.723989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9d337795-e6c3-4f8b-acba-3c4e0e17abd8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:31.731503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d337795-e6c3-4f8b-acba-3c4e0e17abd8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:31.731989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d337795-e6c3-4f8b-acba-3c4e0e17abd8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:31.732805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d337795-e6c3-4f8b-acba-3c4e0e17abd8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:31.733269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d337795-e6c3-4f8b-acba-3c4e0e17abd8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:31.775087 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9d337795-e6c3-4f8b-acba-3c4e0e17abd8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.056551 Jan 22 22:04:31.775774 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4559/8825] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:31 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:32.788223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c588579d-d3d4-4778-b639-3ed5adb07a15 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:32.789242 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c588579d-d3d4-4778-b639-3ed5adb07a15 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:32.796715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c588579d-d3d4-4778-b639-3ed5adb07a15 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:32.797175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c588579d-d3d4-4778-b639-3ed5adb07a15 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:32.797990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c588579d-d3d4-4778-b639-3ed5adb07a15 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:32.798440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c588579d-d3d4-4778-b639-3ed5adb07a15 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:32.840481 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c588579d-d3d4-4778-b639-3ed5adb07a15 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.056886 Jan 22 22:04:32.841170 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4267/8826] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:32 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:33.853358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1cd5a3ca-1690-42aa-b6ad-dc359ec89aab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:33.854398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1cd5a3ca-1690-42aa-b6ad-dc359ec89aab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:33.862025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cd5a3ca-1690-42aa-b6ad-dc359ec89aab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:33.862500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cd5a3ca-1690-42aa-b6ad-dc359ec89aab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:33.863313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cd5a3ca-1690-42aa-b6ad-dc359ec89aab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:33.863772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cd5a3ca-1690-42aa-b6ad-dc359ec89aab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:33.902441 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1cd5a3ca-1690-42aa-b6ad-dc359ec89aab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.053009 Jan 22 22:04:33.903117 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4560/8827] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:33 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:34.914756 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c79b553f-f1cf-4759-8c25-00300a869673 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:34.915764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c79b553f-f1cf-4759-8c25-00300a869673 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:34.923195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c79b553f-f1cf-4759-8c25-00300a869673 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:34.923649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c79b553f-f1cf-4759-8c25-00300a869673 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:34.924439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c79b553f-f1cf-4759-8c25-00300a869673 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:34.924885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c79b553f-f1cf-4759-8c25-00300a869673 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:34.965341 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c79b553f-f1cf-4759-8c25-00300a869673 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054507 Jan 22 22:04:34.966256 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4268/8828] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:34 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:35.977811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1da2efb8-5be3-4882-914a-988746d070c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:35.978880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1da2efb8-5be3-4882-914a-988746d070c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:35.986618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1da2efb8-5be3-4882-914a-988746d070c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:35.987085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1da2efb8-5be3-4882-914a-988746d070c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:35.987869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1da2efb8-5be3-4882-914a-988746d070c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:35.988868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1da2efb8-5be3-4882-914a-988746d070c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:36.031557 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1da2efb8-5be3-4882-914a-988746d070c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.057765 Jan 22 22:04:36.032225 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4561/8829] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:35 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:37.043977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3670bfe5-3915-40eb-978d-81c28c5c00c8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:37.044990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3670bfe5-3915-40eb-978d-81c28c5c00c8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:37.053309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3670bfe5-3915-40eb-978d-81c28c5c00c8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:37.053801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3670bfe5-3915-40eb-978d-81c28c5c00c8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:37.054594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3670bfe5-3915-40eb-978d-81c28c5c00c8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:37.055040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3670bfe5-3915-40eb-978d-81c28c5c00c8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:37.093967 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3670bfe5-3915-40eb-978d-81c28c5c00c8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054016 Jan 22 22:04:37.094598 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4269/8830] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:37 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:38.106952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c5f0dd30-8a1c-4701-925a-552f11d7241c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:38.107974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c5f0dd30-8a1c-4701-925a-552f11d7241c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:38.116116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5f0dd30-8a1c-4701-925a-552f11d7241c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:38.116590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5f0dd30-8a1c-4701-925a-552f11d7241c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:38.118291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5f0dd30-8a1c-4701-925a-552f11d7241c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:38.118760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c5f0dd30-8a1c-4701-925a-552f11d7241c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:38.158071 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c5f0dd30-8a1c-4701-925a-552f11d7241c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.055048 Jan 22 22:04:38.158713 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4562/8831] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:38 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:39.170456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-24296ae1-1e44-44ab-9b3c-3e43101447a4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:39.171480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-24296ae1-1e44-44ab-9b3c-3e43101447a4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:39.179540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24296ae1-1e44-44ab-9b3c-3e43101447a4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:39.179989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24296ae1-1e44-44ab-9b3c-3e43101447a4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:39.180766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24296ae1-1e44-44ab-9b3c-3e43101447a4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:39.181204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-24296ae1-1e44-44ab-9b3c-3e43101447a4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:39.220459 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-24296ae1-1e44-44ab-9b3c-3e43101447a4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.053761 Jan 22 22:04:39.221028 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4270/8832] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:39 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:40.232994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5c8395a2-9c1e-4b5b-95cb-c453a9e99e1b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:40.234079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5c8395a2-9c1e-4b5b-95cb-c453a9e99e1b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:40.242757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c8395a2-9c1e-4b5b-95cb-c453a9e99e1b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:40.255882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c8395a2-9c1e-4b5b-95cb-c453a9e99e1b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:40.255882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c8395a2-9c1e-4b5b-95cb-c453a9e99e1b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:40.255882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c8395a2-9c1e-4b5b-95cb-c453a9e99e1b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:40.283951 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5c8395a2-9c1e-4b5b-95cb-c453a9e99e1b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054942 Jan 22 22:04:40.285077 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4563/8833] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:40 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:41.296827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8a965132-76cd-44e7-9f2d-25be49ffd668 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:41.297884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8a965132-76cd-44e7-9f2d-25be49ffd668 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:41.305049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a965132-76cd-44e7-9f2d-25be49ffd668 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:41.305529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a965132-76cd-44e7-9f2d-25be49ffd668 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:41.306319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a965132-76cd-44e7-9f2d-25be49ffd668 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:41.306763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8a965132-76cd-44e7-9f2d-25be49ffd668 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:41.346906 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8a965132-76cd-44e7-9f2d-25be49ffd668 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054240 Jan 22 22:04:41.348185 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4271/8834] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:41 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:42.360516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-628cd442-9f8e-45b8-bc7d-c1df570f9be1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:42.361564 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-628cd442-9f8e-45b8-bc7d-c1df570f9be1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:42.369746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-628cd442-9f8e-45b8-bc7d-c1df570f9be1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:42.370226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-628cd442-9f8e-45b8-bc7d-c1df570f9be1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:42.371072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-628cd442-9f8e-45b8-bc7d-c1df570f9be1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:42.371535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-628cd442-9f8e-45b8-bc7d-c1df570f9be1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:42.413027 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-628cd442-9f8e-45b8-bc7d-c1df570f9be1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.057137 Jan 22 22:04:42.420650 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4564/8835] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:42 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:43.425343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0e58385a-2f83-451e-a6ac-8a3181f6b55f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:43.426435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0e58385a-2f83-451e-a6ac-8a3181f6b55f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:43.433855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e58385a-2f83-451e-a6ac-8a3181f6b55f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:43.434316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e58385a-2f83-451e-a6ac-8a3181f6b55f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:43.435106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e58385a-2f83-451e-a6ac-8a3181f6b55f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:43.435553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e58385a-2f83-451e-a6ac-8a3181f6b55f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:43.476722 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0e58385a-2f83-451e-a6ac-8a3181f6b55f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.055318 Jan 22 22:04:43.477310 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4272/8836] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:43 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:44.489089 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-57ecd489-0c22-44be-b80d-f2115041214c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:44.490134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-57ecd489-0c22-44be-b80d-f2115041214c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:44.497625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57ecd489-0c22-44be-b80d-f2115041214c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:44.498094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57ecd489-0c22-44be-b80d-f2115041214c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:44.498905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57ecd489-0c22-44be-b80d-f2115041214c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:44.499345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57ecd489-0c22-44be-b80d-f2115041214c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:44.538935 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-57ecd489-0c22-44be-b80d-f2115041214c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.053811 Jan 22 22:04:44.539886 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4565/8837] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:44 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:45.550954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c402b49b-42da-463f-8721-6ec82518321f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:45.552137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c402b49b-42da-463f-8721-6ec82518321f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:45.559339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c402b49b-42da-463f-8721-6ec82518321f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:45.559789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c402b49b-42da-463f-8721-6ec82518321f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:45.560561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c402b49b-42da-463f-8721-6ec82518321f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:45.560997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c402b49b-42da-463f-8721-6ec82518321f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:45.602846 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c402b49b-42da-463f-8721-6ec82518321f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.055829 Jan 22 22:04:45.603520 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4273/8838] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:45 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:46.615627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f45886ee-3831-44f3-b58a-d19c740b67b1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:46.616719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f45886ee-3831-44f3-b58a-d19c740b67b1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:46.624150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f45886ee-3831-44f3-b58a-d19c740b67b1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:46.624625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f45886ee-3831-44f3-b58a-d19c740b67b1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:46.625437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f45886ee-3831-44f3-b58a-d19c740b67b1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:46.625925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f45886ee-3831-44f3-b58a-d19c740b67b1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:46.667527 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f45886ee-3831-44f3-b58a-d19c740b67b1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.056108 Jan 22 22:04:46.668518 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4566/8839] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:46 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:47.680301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5d9bb331-bf71-46b3-a406-8e8ce1350259 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:47.681307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5d9bb331-bf71-46b3-a406-8e8ce1350259 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:47.688763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d9bb331-bf71-46b3-a406-8e8ce1350259 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:47.689330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d9bb331-bf71-46b3-a406-8e8ce1350259 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:47.690179 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d9bb331-bf71-46b3-a406-8e8ce1350259 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:47.690622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d9bb331-bf71-46b3-a406-8e8ce1350259 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:47.734520 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5d9bb331-bf71-46b3-a406-8e8ce1350259 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.058266 Jan 22 22:04:47.735174 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4274/8840] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:47 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:48.746661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d01df053-8944-4f48-89ef-4ee85c5718ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:48.747889 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d01df053-8944-4f48-89ef-4ee85c5718ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:48.755903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d01df053-8944-4f48-89ef-4ee85c5718ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:48.756381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d01df053-8944-4f48-89ef-4ee85c5718ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:48.757194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d01df053-8944-4f48-89ef-4ee85c5718ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:48.757703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d01df053-8944-4f48-89ef-4ee85c5718ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:48.804080 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d01df053-8944-4f48-89ef-4ee85c5718ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.061242 Jan 22 22:04:48.804738 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4567/8841] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:48 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:49.816300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c205c00b-97dd-4881-9b9a-b6bf8778dadd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:49.817542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c205c00b-97dd-4881-9b9a-b6bf8778dadd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:49.824805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c205c00b-97dd-4881-9b9a-b6bf8778dadd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:49.825253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c205c00b-97dd-4881-9b9a-b6bf8778dadd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:49.826058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c205c00b-97dd-4881-9b9a-b6bf8778dadd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:49.826501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c205c00b-97dd-4881-9b9a-b6bf8778dadd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:49.866423 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c205c00b-97dd-4881-9b9a-b6bf8778dadd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054039 Jan 22 22:04:49.867045 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4275/8842] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:49 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:50.878711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a51b0948-661b-4c37-a6b8-93e92bb2eb8a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:50.879870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a51b0948-661b-4c37-a6b8-93e92bb2eb8a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:50.887475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a51b0948-661b-4c37-a6b8-93e92bb2eb8a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:50.887948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a51b0948-661b-4c37-a6b8-93e92bb2eb8a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:50.888769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a51b0948-661b-4c37-a6b8-93e92bb2eb8a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:50.889217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a51b0948-661b-4c37-a6b8-93e92bb2eb8a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:50.929468 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a51b0948-661b-4c37-a6b8-93e92bb2eb8a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054729 Jan 22 22:04:50.932836 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4568/8843] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:50 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:51.943036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c4378ede-9530-4fe3-bb1e-da7027fca18e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:51.944059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c4378ede-9530-4fe3-bb1e-da7027fca18e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:51.951460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4378ede-9530-4fe3-bb1e-da7027fca18e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:51.951924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4378ede-9530-4fe3-bb1e-da7027fca18e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:51.952706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4378ede-9530-4fe3-bb1e-da7027fca18e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:51.953152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c4378ede-9530-4fe3-bb1e-da7027fca18e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:51.992467 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c4378ede-9530-4fe3-bb1e-da7027fca18e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054251 Jan 22 22:04:51.993353 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4276/8844] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:51 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:53.005961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ce086770-73f6-41fd-8212-c4558a41d2ba tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:53.007036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ce086770-73f6-41fd-8212-c4558a41d2ba tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:53.015708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce086770-73f6-41fd-8212-c4558a41d2ba tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:53.016173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce086770-73f6-41fd-8212-c4558a41d2ba tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:53.016989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce086770-73f6-41fd-8212-c4558a41d2ba tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:53.017450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ce086770-73f6-41fd-8212-c4558a41d2ba tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:53.057637 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ce086770-73f6-41fd-8212-c4558a41d2ba tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.056612 Jan 22 22:04:53.058321 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4569/8845] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:52 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:53.945103 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:04:53.945757 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:04:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:04:54.070666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b1a807cc-94fc-48a7-bd90-a2c5df3d17f8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:54.071697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b1a807cc-94fc-48a7-bd90-a2c5df3d17f8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:54.079030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1a807cc-94fc-48a7-bd90-a2c5df3d17f8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:54.079487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1a807cc-94fc-48a7-bd90-a2c5df3d17f8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:54.080268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1a807cc-94fc-48a7-bd90-a2c5df3d17f8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:54.080712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1a807cc-94fc-48a7-bd90-a2c5df3d17f8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:54.121376 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b1a807cc-94fc-48a7-bd90-a2c5df3d17f8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.055538 Jan 22 22:04:54.122059 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4277/8846] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:54 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:04:55.003705 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:04:55.004291 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:04:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:04:55.132788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-50407ebb-dfcf-4dce-b587-e2b7679cb453 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:55.133836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-50407ebb-dfcf-4dce-b587-e2b7679cb453 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:55.141189 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50407ebb-dfcf-4dce-b587-e2b7679cb453 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:55.141692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50407ebb-dfcf-4dce-b587-e2b7679cb453 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:55.142495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50407ebb-dfcf-4dce-b587-e2b7679cb453 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:55.142957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50407ebb-dfcf-4dce-b587-e2b7679cb453 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:55.182288 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-50407ebb-dfcf-4dce-b587-e2b7679cb453 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.053578 Jan 22 22:04:55.183178 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4570/8847] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:55 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:56.195344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9b6f4082-6aec-4c39-ab95-712b2c143e5d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:56.196359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9b6f4082-6aec-4c39-ab95-712b2c143e5d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:56.203826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b6f4082-6aec-4c39-ab95-712b2c143e5d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:56.204287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b6f4082-6aec-4c39-ab95-712b2c143e5d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:56.205079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b6f4082-6aec-4c39-ab95-712b2c143e5d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:56.205541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9b6f4082-6aec-4c39-ab95-712b2c143e5d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:56.245873 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9b6f4082-6aec-4c39-ab95-712b2c143e5d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.055150 Jan 22 22:04:56.246512 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4278/8848] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:56 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:04:57.258961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b701c942-4492-49c1-9f37-debfda7fd1cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:57.259987 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b701c942-4492-49c1-9f37-debfda7fd1cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:57.267378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b701c942-4492-49c1-9f37-debfda7fd1cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:57.267855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b701c942-4492-49c1-9f37-debfda7fd1cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:57.268660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b701c942-4492-49c1-9f37-debfda7fd1cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:57.269121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b701c942-4492-49c1-9f37-debfda7fd1cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:57.308248 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b701c942-4492-49c1-9f37-debfda7fd1cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054080 Jan 22 22:04:57.308879 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4571/8849] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:57 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:58.320450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-919faa6a-cbbb-4fff-a936-1e4b6694dcb0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:58.321458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-919faa6a-cbbb-4fff-a936-1e4b6694dcb0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:58.328988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-919faa6a-cbbb-4fff-a936-1e4b6694dcb0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:58.329445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-919faa6a-cbbb-4fff-a936-1e4b6694dcb0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:58.330248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-919faa6a-cbbb-4fff-a936-1e4b6694dcb0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:58.330688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-919faa6a-cbbb-4fff-a936-1e4b6694dcb0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:58.372502 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-919faa6a-cbbb-4fff-a936-1e4b6694dcb0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.056349 Jan 22 22:04:58.373401 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4279/8850] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:58 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:04:59.384955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f00dbf7-c059-401e-a7e9-9794dbaafa1f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:04:59.386081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8f00dbf7-c059-401e-a7e9-9794dbaafa1f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:04:59.393835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f00dbf7-c059-401e-a7e9-9794dbaafa1f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:59.394303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f00dbf7-c059-401e-a7e9-9794dbaafa1f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:59.395121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f00dbf7-c059-401e-a7e9-9794dbaafa1f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:04:59.395661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f00dbf7-c059-401e-a7e9-9794dbaafa1f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:04:59.436451 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8f00dbf7-c059-401e-a7e9-9794dbaafa1f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.055386 Jan 22 22:04:59.437569 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4572/8851] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:04:59 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:00.449042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb8caaa3-bbf3-4067-87ee-32c78eb92288 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:00.450122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb8caaa3-bbf3-4067-87ee-32c78eb92288 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:00.458492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb8caaa3-bbf3-4067-87ee-32c78eb92288 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:00.458922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb8caaa3-bbf3-4067-87ee-32c78eb92288 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:00.459716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb8caaa3-bbf3-4067-87ee-32c78eb92288 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:00.460160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb8caaa3-bbf3-4067-87ee-32c78eb92288 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:00.502182 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb8caaa3-bbf3-4067-87ee-32c78eb92288 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.057009 Jan 22 22:05:00.502832 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4280/8852] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:00 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:01.514330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-90d2cd64-96c3-4e31-8711-3d0fe0aa13c3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:01.515270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-90d2cd64-96c3-4e31-8711-3d0fe0aa13c3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:01.523136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90d2cd64-96c3-4e31-8711-3d0fe0aa13c3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:01.523605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90d2cd64-96c3-4e31-8711-3d0fe0aa13c3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:01.524394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90d2cd64-96c3-4e31-8711-3d0fe0aa13c3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:01.524847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90d2cd64-96c3-4e31-8711-3d0fe0aa13c3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:01.567892 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-90d2cd64-96c3-4e31-8711-3d0fe0aa13c3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.057573 Jan 22 22:05:01.570465 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4573/8853] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:01 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:02.579623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb50fbe8-e81a-4124-8786-d909e2b62391 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:02.580614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb50fbe8-e81a-4124-8786-d909e2b62391 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:02.589082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb50fbe8-e81a-4124-8786-d909e2b62391 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:02.589558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb50fbe8-e81a-4124-8786-d909e2b62391 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:02.590346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb50fbe8-e81a-4124-8786-d909e2b62391 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:02.590783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb50fbe8-e81a-4124-8786-d909e2b62391 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:02.632507 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb50fbe8-e81a-4124-8786-d909e2b62391 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.056787 Jan 22 22:05:02.633059 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4281/8854] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:02 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:03.644895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-39ae45a5-5dae-49cd-9c48-eac7cd1dde29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:03.645967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-39ae45a5-5dae-49cd-9c48-eac7cd1dde29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:03.653483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39ae45a5-5dae-49cd-9c48-eac7cd1dde29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:03.653979 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39ae45a5-5dae-49cd-9c48-eac7cd1dde29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:03.654793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39ae45a5-5dae-49cd-9c48-eac7cd1dde29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:03.655258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39ae45a5-5dae-49cd-9c48-eac7cd1dde29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:03.695627 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-39ae45a5-5dae-49cd-9c48-eac7cd1dde29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054676 Jan 22 22:05:03.696270 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4574/8855] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:03 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:04.707947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4a10b0af-0c9a-40c4-bf7a-f0be03367edd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:04.708896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4a10b0af-0c9a-40c4-bf7a-f0be03367edd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:04.716971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a10b0af-0c9a-40c4-bf7a-f0be03367edd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:04.717422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a10b0af-0c9a-40c4-bf7a-f0be03367edd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:04.718232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a10b0af-0c9a-40c4-bf7a-f0be03367edd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:04.718670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4a10b0af-0c9a-40c4-bf7a-f0be03367edd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:04.758401 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4a10b0af-0c9a-40c4-bf7a-f0be03367edd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054501 Jan 22 22:05:04.759029 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4282/8856] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:04 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:05.770912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ebc8a7e7-dcd3-40c8-90c6-3b03b649084c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:05.771873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ebc8a7e7-dcd3-40c8-90c6-3b03b649084c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:05.780056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebc8a7e7-dcd3-40c8-90c6-3b03b649084c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:05.780533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebc8a7e7-dcd3-40c8-90c6-3b03b649084c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:05.781344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebc8a7e7-dcd3-40c8-90c6-3b03b649084c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:05.781836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ebc8a7e7-dcd3-40c8-90c6-3b03b649084c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:05.820280 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ebc8a7e7-dcd3-40c8-90c6-3b03b649084c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.053235 Jan 22 22:05:05.821179 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4575/8857] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:05 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:06.832086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5bf7ba59-8897-4f1f-83fb-fe1fa5acb755 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:06.833104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5bf7ba59-8897-4f1f-83fb-fe1fa5acb755 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:06.840678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bf7ba59-8897-4f1f-83fb-fe1fa5acb755 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:06.841130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bf7ba59-8897-4f1f-83fb-fe1fa5acb755 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:06.841943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bf7ba59-8897-4f1f-83fb-fe1fa5acb755 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:06.842378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bf7ba59-8897-4f1f-83fb-fe1fa5acb755 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:06.882383 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5bf7ba59-8897-4f1f-83fb-fe1fa5acb755 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054236 Jan 22 22:05:06.883052 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4283/8858] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:06 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:07.894421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4063f8c3-0c61-4da2-9909-a883cb5f27ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:07.895439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4063f8c3-0c61-4da2-9909-a883cb5f27ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:07.902927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4063f8c3-0c61-4da2-9909-a883cb5f27ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:07.903410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4063f8c3-0c61-4da2-9909-a883cb5f27ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:07.904224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4063f8c3-0c61-4da2-9909-a883cb5f27ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:07.904795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4063f8c3-0c61-4da2-9909-a883cb5f27ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:07.945600 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4063f8c3-0c61-4da2-9909-a883cb5f27ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.055030 Jan 22 22:05:07.947266 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4576/8859] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:07 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:08.958844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ea8b5f55-3d23-4a51-8331-bc140fc5643d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:08.959853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ea8b5f55-3d23-4a51-8331-bc140fc5643d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:08.967233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea8b5f55-3d23-4a51-8331-bc140fc5643d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:08.967702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea8b5f55-3d23-4a51-8331-bc140fc5643d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:08.968493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea8b5f55-3d23-4a51-8331-bc140fc5643d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:08.968940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea8b5f55-3d23-4a51-8331-bc140fc5643d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:09.008998 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ea8b5f55-3d23-4a51-8331-bc140fc5643d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.053343 Jan 22 22:05:09.009651 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4284/8860] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:08 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:10.021293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e9f79d68-a7c5-403f-8826-c1d0911ccfac tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:10.022388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e9f79d68-a7c5-403f-8826-c1d0911ccfac tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:10.029925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9f79d68-a7c5-403f-8826-c1d0911ccfac tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:10.030400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9f79d68-a7c5-403f-8826-c1d0911ccfac tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:10.031213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9f79d68-a7c5-403f-8826-c1d0911ccfac tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:10.031675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9f79d68-a7c5-403f-8826-c1d0911ccfac tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:10.072183 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e9f79d68-a7c5-403f-8826-c1d0911ccfac tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054826 Jan 22 22:05:10.072848 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4577/8861] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:10 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:11.084635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5cdb29c7-463d-4f38-a62a-7a10fd07ace6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:11.085681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5cdb29c7-463d-4f38-a62a-7a10fd07ace6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:11.093143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5cdb29c7-463d-4f38-a62a-7a10fd07ace6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:11.093630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5cdb29c7-463d-4f38-a62a-7a10fd07ace6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:11.094421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5cdb29c7-463d-4f38-a62a-7a10fd07ace6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:11.094866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5cdb29c7-463d-4f38-a62a-7a10fd07ace6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:11.139220 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5cdb29c7-463d-4f38-a62a-7a10fd07ace6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.058670 Jan 22 22:05:11.139881 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4285/8862] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:11 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:05:12.201302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8d4a8bec-3387-4743-a5c9-c2298cf8e643 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:12.202336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8d4a8bec-3387-4743-a5c9-c2298cf8e643 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:12.209178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d4a8bec-3387-4743-a5c9-c2298cf8e643 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:12.209680 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d4a8bec-3387-4743-a5c9-c2298cf8e643 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:12.210488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d4a8bec-3387-4743-a5c9-c2298cf8e643 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:12.210952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d4a8bec-3387-4743-a5c9-c2298cf8e643 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:12.250252 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8d4a8bec-3387-4743-a5c9-c2298cf8e643 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.101869 Jan 22 22:05:12.250864 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4578/8863] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:12 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:13.263103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f4d79842-c846-4699-a30f-6faafe26881b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:13.264122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f4d79842-c846-4699-a30f-6faafe26881b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:13.271542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4d79842-c846-4699-a30f-6faafe26881b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:13.272985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4d79842-c846-4699-a30f-6faafe26881b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:13.272985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4d79842-c846-4699-a30f-6faafe26881b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:13.273204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f4d79842-c846-4699-a30f-6faafe26881b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:13.312470 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f4d79842-c846-4699-a30f-6faafe26881b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.053920 Jan 22 22:05:13.313107 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4286/8864] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:13 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:14.324825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ef84d6d5-2755-4fad-abe2-788341a2add6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:14.326455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ef84d6d5-2755-4fad-abe2-788341a2add6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:14.333840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef84d6d5-2755-4fad-abe2-788341a2add6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:14.334315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef84d6d5-2755-4fad-abe2-788341a2add6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:14.335128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef84d6d5-2755-4fad-abe2-788341a2add6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:14.335612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ef84d6d5-2755-4fad-abe2-788341a2add6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:14.379344 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ef84d6d5-2755-4fad-abe2-788341a2add6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.058484 Jan 22 22:05:14.380722 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4579/8865] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:14 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:05:15.397212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e19575f2-eb28-459f-8af6-5dbcc3910132 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:15.397212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e19575f2-eb28-459f-8af6-5dbcc3910132 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:15.400957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e19575f2-eb28-459f-8af6-5dbcc3910132 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:15.401404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e19575f2-eb28-459f-8af6-5dbcc3910132 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:15.402229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e19575f2-eb28-459f-8af6-5dbcc3910132 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:15.402676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e19575f2-eb28-459f-8af6-5dbcc3910132 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:15.444896 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e19575f2-eb28-459f-8af6-5dbcc3910132 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.057278 Jan 22 22:05:15.445733 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4287/8866] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:15 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:16.457648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1b870a39-282e-4db2-abac-5c4f956c22dc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:16.458670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1b870a39-282e-4db2-abac-5c4f956c22dc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:16.466276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b870a39-282e-4db2-abac-5c4f956c22dc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:16.466750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b870a39-282e-4db2-abac-5c4f956c22dc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:16.467556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b870a39-282e-4db2-abac-5c4f956c22dc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:16.468070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b870a39-282e-4db2-abac-5c4f956c22dc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:16.509379 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1b870a39-282e-4db2-abac-5c4f956c22dc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.055138 Jan 22 22:05:16.510195 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4580/8867] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:16 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:17.521924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-719cf240-4c06-44bf-b567-d7cfda6e3872 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:17.522831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-719cf240-4c06-44bf-b567-d7cfda6e3872 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:17.530310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-719cf240-4c06-44bf-b567-d7cfda6e3872 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:17.530763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-719cf240-4c06-44bf-b567-d7cfda6e3872 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:17.531542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-719cf240-4c06-44bf-b567-d7cfda6e3872 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:17.531976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-719cf240-4c06-44bf-b567-d7cfda6e3872 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:17.572251 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-719cf240-4c06-44bf-b567-d7cfda6e3872 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054398 Jan 22 22:05:17.572874 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4288/8868] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:17 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:18.584538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-242d61a2-2115-4e2c-a849-6c27d5e8750e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:18.585583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-242d61a2-2115-4e2c-a849-6c27d5e8750e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:18.592928 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-242d61a2-2115-4e2c-a849-6c27d5e8750e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:18.593409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-242d61a2-2115-4e2c-a849-6c27d5e8750e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:18.594248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-242d61a2-2115-4e2c-a849-6c27d5e8750e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:18.594711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-242d61a2-2115-4e2c-a849-6c27d5e8750e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:18.635755 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-242d61a2-2115-4e2c-a849-6c27d5e8750e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.055191 Jan 22 22:05:18.636376 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4581/8869] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:18 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:19.648073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f14f3e04-5147-4062-ac45-fd8ac1be2791 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:19.649861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f14f3e04-5147-4062-ac45-fd8ac1be2791 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:19.657229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f14f3e04-5147-4062-ac45-fd8ac1be2791 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:19.657720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f14f3e04-5147-4062-ac45-fd8ac1be2791 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:19.658501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f14f3e04-5147-4062-ac45-fd8ac1be2791 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:19.658941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f14f3e04-5147-4062-ac45-fd8ac1be2791 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:19.699408 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f14f3e04-5147-4062-ac45-fd8ac1be2791 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.055403 Jan 22 22:05:19.700066 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4289/8870] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:19 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:20.712153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eae06cd1-0f96-4163-9aa4-92597d8105d3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:20.713066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eae06cd1-0f96-4163-9aa4-92597d8105d3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:20.720399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eae06cd1-0f96-4163-9aa4-92597d8105d3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:20.720884 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eae06cd1-0f96-4163-9aa4-92597d8105d3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:20.721692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eae06cd1-0f96-4163-9aa4-92597d8105d3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:20.722145 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eae06cd1-0f96-4163-9aa4-92597d8105d3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:20.761366 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eae06cd1-0f96-4163-9aa4-92597d8105d3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.053773 Jan 22 22:05:20.762042 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4582/8871] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:20 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:21.773300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-49947c4c-e8cb-4128-b06b-037cfd332489 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:21.774958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-49947c4c-e8cb-4128-b06b-037cfd332489 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:21.782438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49947c4c-e8cb-4128-b06b-037cfd332489 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:21.782910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49947c4c-e8cb-4128-b06b-037cfd332489 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:21.783696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49947c4c-e8cb-4128-b06b-037cfd332489 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:21.784143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-49947c4c-e8cb-4128-b06b-037cfd332489 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:21.823870 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-49947c4c-e8cb-4128-b06b-037cfd332489 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054553 Jan 22 22:05:21.824756 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4290/8872] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:21 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:22.836865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3e73b6c1-ed2e-4a33-acb6-69f5de4469d4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:22.837914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3e73b6c1-ed2e-4a33-acb6-69f5de4469d4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:22.845149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e73b6c1-ed2e-4a33-acb6-69f5de4469d4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:22.845650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e73b6c1-ed2e-4a33-acb6-69f5de4469d4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:22.846443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e73b6c1-ed2e-4a33-acb6-69f5de4469d4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:22.846903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e73b6c1-ed2e-4a33-acb6-69f5de4469d4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:22.886736 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3e73b6c1-ed2e-4a33-acb6-69f5de4469d4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 32642 microversion: 2.1 time: 0.054480 Jan 22 22:05:22.887365 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4583/8873] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:22 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 32642 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:05:23.899721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-681cb869-1c40-4d46-86c6-db0479bec655 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:23.900725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-681cb869-1c40-4d46-86c6-db0479bec655 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:23.908025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-681cb869-1c40-4d46-86c6-db0479bec655 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:23.908474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-681cb869-1c40-4d46-86c6-db0479bec655 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:23.909248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-681cb869-1c40-4d46-86c6-db0479bec655 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:23.909714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-681cb869-1c40-4d46-86c6-db0479bec655 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:23.963316 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-681cb869-1c40-4d46-86c6-db0479bec655 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 200 len: 40793 microversion: 2.1 time: 0.068217 Jan 22 22:05:23.963962 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4291/8874] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:23 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 40793 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:05:23.974648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0799d30a-6a6a-4333-8492-3146229d0c93 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:23.982422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0799d30a-6a6a-4333-8492-3146229d0c93 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:23.982918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0799d30a-6a6a-4333-8492-3146229d0c93 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:24.005378 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0799d30a-6a6a-4333-8492-3146229d0c93 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Going to try to stop instance {{(pid=137032) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 22 22:05:24.219577 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0799d30a-6a6a-4333-8492-3146229d0c93 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 202 len: 0 microversion: 2.1 time: 0.248801 Jan 22 22:05:24.220121 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4584/8875] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:23 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:05:24.228935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b9817d91-3ea8-401b-857c-ac07ff9248d7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:24.229670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b9817d91-3ea8-401b-857c-ac07ff9248d7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:24.236929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9817d91-3ea8-401b-857c-ac07ff9248d7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:24.237391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9817d91-3ea8-401b-857c-ac07ff9248d7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:24.238214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9817d91-3ea8-401b-857c-ac07ff9248d7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:24.238665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9817d91-3ea8-401b-857c-ac07ff9248d7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:24.423366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b9817d91-3ea8-401b-857c-ac07ff9248d7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:24.431686 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b9817d91-3ea8-401b-857c-ac07ff9248d7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1682 microversion: 2.1 time: 0.207121 Jan 22 22:05:24.432257 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4292/8876] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:24 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:25.449801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e17612c-8f6a-44b6-a38a-d69a76ac9dca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:25.450510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e17612c-8f6a-44b6-a38a-d69a76ac9dca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:25.456632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e17612c-8f6a-44b6-a38a-d69a76ac9dca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:25.457105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e17612c-8f6a-44b6-a38a-d69a76ac9dca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:25.457938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e17612c-8f6a-44b6-a38a-d69a76ac9dca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:25.458397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e17612c-8f6a-44b6-a38a-d69a76ac9dca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:25.595013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5e17612c-8f6a-44b6-a38a-d69a76ac9dca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:25.603058 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e17612c-8f6a-44b6-a38a-d69a76ac9dca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1682 microversion: 2.1 time: 0.158489 Jan 22 22:05:25.603629 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4585/8877] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:25 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:26.620513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-07c4d30a-104c-4f66-94b7-7ebee12c2541 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:26.621139 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-07c4d30a-104c-4f66-94b7-7ebee12c2541 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:26.628003 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07c4d30a-104c-4f66-94b7-7ebee12c2541 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:26.628506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07c4d30a-104c-4f66-94b7-7ebee12c2541 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:26.629323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07c4d30a-104c-4f66-94b7-7ebee12c2541 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:26.629798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-07c4d30a-104c-4f66-94b7-7ebee12c2541 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:26.759850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-07c4d30a-104c-4f66-94b7-7ebee12c2541 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:26.767379 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-07c4d30a-104c-4f66-94b7-7ebee12c2541 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1682 microversion: 2.1 time: 0.151225 Jan 22 22:05:26.767951 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4293/8878] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:26 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:27.785078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-10803c8d-c2bd-4f79-9a8a-0597b2d9ee4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:27.785778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-10803c8d-c2bd-4f79-9a8a-0597b2d9ee4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:27.793265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10803c8d-c2bd-4f79-9a8a-0597b2d9ee4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:27.793835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10803c8d-c2bd-4f79-9a8a-0597b2d9ee4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:27.794659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10803c8d-c2bd-4f79-9a8a-0597b2d9ee4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:27.795129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10803c8d-c2bd-4f79-9a8a-0597b2d9ee4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:27.926248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-10803c8d-c2bd-4f79-9a8a-0597b2d9ee4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:27.933623 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-10803c8d-c2bd-4f79-9a8a-0597b2d9ee4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1682 microversion: 2.1 time: 0.152349 Jan 22 22:05:27.934196 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4586/8879] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:27 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:28.951195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b10fed94-3fc5-4c69-9249-10a206f62fe4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:28.951804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b10fed94-3fc5-4c69-9249-10a206f62fe4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:28.958558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b10fed94-3fc5-4c69-9249-10a206f62fe4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:28.959010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b10fed94-3fc5-4c69-9249-10a206f62fe4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:28.959787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b10fed94-3fc5-4c69-9249-10a206f62fe4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:28.960226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b10fed94-3fc5-4c69-9249-10a206f62fe4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:29.091607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b10fed94-3fc5-4c69-9249-10a206f62fe4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:29.098995 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b10fed94-3fc5-4c69-9249-10a206f62fe4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1682 microversion: 2.1 time: 0.151541 Jan 22 22:05:29.099563 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4294/8880] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:28 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:30.116165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5727f22d-2b34-4a3f-9d3d-a33889b8f15d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:30.116785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5727f22d-2b34-4a3f-9d3d-a33889b8f15d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:30.124354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5727f22d-2b34-4a3f-9d3d-a33889b8f15d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:30.124823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5727f22d-2b34-4a3f-9d3d-a33889b8f15d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:30.125654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5727f22d-2b34-4a3f-9d3d-a33889b8f15d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:30.126114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5727f22d-2b34-4a3f-9d3d-a33889b8f15d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:30.259588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5727f22d-2b34-4a3f-9d3d-a33889b8f15d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:30.267033 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5727f22d-2b34-4a3f-9d3d-a33889b8f15d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1682 microversion: 2.1 time: 0.154551 Jan 22 22:05:30.267654 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4587/8881] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:30 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:31.284493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d716a5c-602d-46e9-b30f-876315536ba6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:31.285140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d716a5c-602d-46e9-b30f-876315536ba6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:31.292259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d716a5c-602d-46e9-b30f-876315536ba6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:31.292721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d716a5c-602d-46e9-b30f-876315536ba6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:31.293534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d716a5c-602d-46e9-b30f-876315536ba6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:31.293985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d716a5c-602d-46e9-b30f-876315536ba6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:31.425238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3d716a5c-602d-46e9-b30f-876315536ba6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:31.433252 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d716a5c-602d-46e9-b30f-876315536ba6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1682 microversion: 2.1 time: 0.152507 Jan 22 22:05:31.433844 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4295/8882] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:31 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:32.450598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0a469af0-bd7c-4510-802a-5c47833744a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:32.451227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0a469af0-bd7c-4510-802a-5c47833744a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:32.458064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a469af0-bd7c-4510-802a-5c47833744a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:32.461748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a469af0-bd7c-4510-802a-5c47833744a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:32.461748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a469af0-bd7c-4510-802a-5c47833744a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:32.461748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a469af0-bd7c-4510-802a-5c47833744a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:32.597950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0a469af0-bd7c-4510-802a-5c47833744a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:32.605390 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0a469af0-bd7c-4510-802a-5c47833744a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1682 microversion: 2.1 time: 0.158725 Jan 22 22:05:32.605988 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4588/8883] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:32 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:33.623455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a4c86b99-c996-4995-b4ed-25d15f1fb168 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:33.624106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a4c86b99-c996-4995-b4ed-25d15f1fb168 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:33.633618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4c86b99-c996-4995-b4ed-25d15f1fb168 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:33.634452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4c86b99-c996-4995-b4ed-25d15f1fb168 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:33.635471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4c86b99-c996-4995-b4ed-25d15f1fb168 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:33.636049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4c86b99-c996-4995-b4ed-25d15f1fb168 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:33.790672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a4c86b99-c996-4995-b4ed-25d15f1fb168 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:33.799065 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a4c86b99-c996-4995-b4ed-25d15f1fb168 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1682 microversion: 2.1 time: 0.179141 Jan 22 22:05:33.799671 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4296/8884] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:33 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:34.815906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3cf00b36-02f3-4bfc-a08c-c82a534aea59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:34.816537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3cf00b36-02f3-4bfc-a08c-c82a534aea59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:34.824156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3cf00b36-02f3-4bfc-a08c-c82a534aea59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:34.824628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3cf00b36-02f3-4bfc-a08c-c82a534aea59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:34.825432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3cf00b36-02f3-4bfc-a08c-c82a534aea59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:34.825914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3cf00b36-02f3-4bfc-a08c-c82a534aea59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:34.954809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3cf00b36-02f3-4bfc-a08c-c82a534aea59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:34.962303 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3cf00b36-02f3-4bfc-a08c-c82a534aea59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1659 microversion: 2.1 time: 0.150108 Jan 22 22:05:34.962875 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4589/8885] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:34 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1659 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:34.978539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3838ac96-a1c1-4d28-86cf-77e5fe3c7a2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:34.979549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3838ac96-a1c1-4d28-86cf-77e5fe3c7a2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:34.986678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3838ac96-a1c1-4d28-86cf-77e5fe3c7a2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:34.987166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3838ac96-a1c1-4d28-86cf-77e5fe3c7a2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:34.987946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3838ac96-a1c1-4d28-86cf-77e5fe3c7a2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:34.988391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3838ac96-a1c1-4d28-86cf-77e5fe3c7a2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:35.019651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3838ac96-a1c1-4d28-86cf-77e5fe3c7a2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:35.026293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3838ac96-a1c1-4d28-86cf-77e5fe3c7a2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Old instance type m1.heat2, new instance type m1.heat {{(pid=137033) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 22:05:35.032343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3838ac96-a1c1-4d28-86cf-77e5fe3c7a2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:05:35.032797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3838ac96-a1c1-4d28-86cf-77e5fe3c7a2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:05:35.033272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3838ac96-a1c1-4d28-86cf-77e5fe3c7a2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:05:35.033725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3838ac96-a1c1-4d28-86cf-77e5fe3c7a2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:05:35.034140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-3838ac96-a1c1-4d28-86cf-77e5fe3c7a2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:05:35.255606 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3838ac96-a1c1-4d28-86cf-77e5fe3c7a2c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 202 len: 0 microversion: 2.1 time: 0.280968 Jan 22 22:05:35.256459 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4297/8886] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:34 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 22:05:35.264740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5c733140-d63a-4ebd-9a70-d86dcc8fbd44 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:35.265448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5c733140-d63a-4ebd-9a70-d86dcc8fbd44 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:35.271535 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c733140-d63a-4ebd-9a70-d86dcc8fbd44 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:35.271999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c733140-d63a-4ebd-9a70-d86dcc8fbd44 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:35.272822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c733140-d63a-4ebd-9a70-d86dcc8fbd44 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:35.273279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c733140-d63a-4ebd-9a70-d86dcc8fbd44 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:35.412364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5c733140-d63a-4ebd-9a70-d86dcc8fbd44 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:35.420345 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5c733140-d63a-4ebd-9a70-d86dcc8fbd44 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1682 microversion: 2.1 time: 0.159244 Jan 22 22:05:35.426981 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4590/8887] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:35 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:36.438153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aa3dc1eb-2388-4914-b989-8b7a59d5dca7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:36.438800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aa3dc1eb-2388-4914-b989-8b7a59d5dca7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:36.444728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa3dc1eb-2388-4914-b989-8b7a59d5dca7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:36.449008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa3dc1eb-2388-4914-b989-8b7a59d5dca7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:36.449008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa3dc1eb-2388-4914-b989-8b7a59d5dca7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:36.449008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aa3dc1eb-2388-4914-b989-8b7a59d5dca7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:36.580796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-aa3dc1eb-2388-4914-b989-8b7a59d5dca7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:36.588627 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aa3dc1eb-2388-4914-b989-8b7a59d5dca7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1682 microversion: 2.1 time: 0.155049 Jan 22 22:05:36.589203 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4298/8888] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:36 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:37.606853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3e4b6993-aeb3-4eca-ac5d-381509524215 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:37.607474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3e4b6993-aeb3-4eca-ac5d-381509524215 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:37.614310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e4b6993-aeb3-4eca-ac5d-381509524215 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:37.614782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e4b6993-aeb3-4eca-ac5d-381509524215 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:37.615589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e4b6993-aeb3-4eca-ac5d-381509524215 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:37.616047 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3e4b6993-aeb3-4eca-ac5d-381509524215 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:37.840551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3e4b6993-aeb3-4eca-ac5d-381509524215 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:37.848017 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3e4b6993-aeb3-4eca-ac5d-381509524215 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1682 microversion: 2.1 time: 0.245676 Jan 22 22:05:37.848591 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4591/8889] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:37 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1682 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:38.864869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-68e2ff5b-c8f3-4191-b268-ea804814ef7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:38.865483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-68e2ff5b-c8f3-4191-b268-ea804814ef7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:38.872481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68e2ff5b-c8f3-4191-b268-ea804814ef7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:38.872942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68e2ff5b-c8f3-4191-b268-ea804814ef7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:38.873767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68e2ff5b-c8f3-4191-b268-ea804814ef7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:38.874214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68e2ff5b-c8f3-4191-b268-ea804814ef7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:39.004644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-68e2ff5b-c8f3-4191-b268-ea804814ef7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:39.013072 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-68e2ff5b-c8f3-4191-b268-ea804814ef7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1687 microversion: 2.1 time: 0.152015 Jan 22 22:05:39.013673 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4299/8890] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:38 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:40.030387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-255ccd40-8f13-4334-9a4a-91ab83b50990 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:40.031008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-255ccd40-8f13-4334-9a4a-91ab83b50990 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:40.037836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-255ccd40-8f13-4334-9a4a-91ab83b50990 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:40.038304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-255ccd40-8f13-4334-9a4a-91ab83b50990 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:40.039130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-255ccd40-8f13-4334-9a4a-91ab83b50990 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:40.040132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-255ccd40-8f13-4334-9a4a-91ab83b50990 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:40.175470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-255ccd40-8f13-4334-9a4a-91ab83b50990 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:40.182846 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-255ccd40-8f13-4334-9a4a-91ab83b50990 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1687 microversion: 2.1 time: 0.156111 Jan 22 22:05:40.183408 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4592/8891] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:40 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:41.200174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d4ebe4b7-e0cb-405b-8d70-e2dc4fd39cb7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:41.200774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d4ebe4b7-e0cb-405b-8d70-e2dc4fd39cb7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:41.207918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4ebe4b7-e0cb-405b-8d70-e2dc4fd39cb7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:41.208384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4ebe4b7-e0cb-405b-8d70-e2dc4fd39cb7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:41.209186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4ebe4b7-e0cb-405b-8d70-e2dc4fd39cb7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:41.209669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4ebe4b7-e0cb-405b-8d70-e2dc4fd39cb7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:41.268505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-7b5098b8-e8d8-4c4a-9264-13b7a6a8ed49 req-3e566675-349d-4a42-92f0-d914d26e3505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac993df-5bb7-4ef9-857f-99e4674678cc", "name": "network-vif-unplugged", "status": "completed", "tag": "465b32fb-6c84-430d-a46e-c121d11a251f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:41.270272 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:05:41.270272 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:05:41.279319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7b5098b8-e8d8-4c4a-9264-13b7a6a8ed49 req-3e566675-349d-4a42-92f0-d914d26e3505 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:41.279779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7b5098b8-e8d8-4c4a-9264-13b7a6a8ed49 req-3e566675-349d-4a42-92f0-d914d26e3505 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:41.291448 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-7b5098b8-e8d8-4c4a-9264-13b7a6a8ed49 req-3e566675-349d-4a42-92f0-d914d26e3505 service nova] Creating event network-vif-unplugged:465b32fb-6c84-430d-a46e-c121d11a251f for instance eac993df-5bb7-4ef9-857f-99e4674678cc on nch1-master-1 Jan 22 22:05:41.297093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-7b5098b8-e8d8-4c4a-9264-13b7a6a8ed49 req-3e566675-349d-4a42-92f0-d914d26e3505 service nova] Instance eac993df-5bb7-4ef9-857f-99e4674678cc is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:05:41.308630 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-7b5098b8-e8d8-4c4a-9264-13b7a6a8ed49 req-3e566675-349d-4a42-92f0-d914d26e3505 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102170 Jan 22 22:05:41.309232 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4593/8892] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:05:41.491314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d4ebe4b7-e0cb-405b-8d70-e2dc4fd39cb7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:41.500069 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d4ebe4b7-e0cb-405b-8d70-e2dc4fd39cb7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1686 microversion: 2.1 time: 0.304147 Jan 22 22:05:41.501040 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4300/8893] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:41 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1686 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:05:42.519700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-814f3519-f5ce-491c-833e-a990ed47a51a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:42.520455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-814f3519-f5ce-491c-833e-a990ed47a51a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:42.527888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-814f3519-f5ce-491c-833e-a990ed47a51a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:42.528398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-814f3519-f5ce-491c-833e-a990ed47a51a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:42.529224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-814f3519-f5ce-491c-833e-a990ed47a51a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:42.529725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-814f3519-f5ce-491c-833e-a990ed47a51a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:42.676725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-814f3519-f5ce-491c-833e-a990ed47a51a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:42.684355 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-814f3519-f5ce-491c-833e-a990ed47a51a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1686 microversion: 2.1 time: 0.170306 Jan 22 22:05:42.684938 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4594/8894] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:42 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:43.344895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-bb764e25-2715-4af9-b86a-59968fe85561 req-4c13783d-385d-4245-90e3-7884e36885de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eac993df-5bb7-4ef9-857f-99e4674678cc", "tag": "465b32fb-6c84-430d-a46e-c121d11a251f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:43.346445 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:05:43.346445 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:05:43.355744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bb764e25-2715-4af9-b86a-59968fe85561 req-4c13783d-385d-4245-90e3-7884e36885de service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:43.356204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bb764e25-2715-4af9-b86a-59968fe85561 req-4c13783d-385d-4245-90e3-7884e36885de service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:43.367871 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-bb764e25-2715-4af9-b86a-59968fe85561 req-4c13783d-385d-4245-90e3-7884e36885de service nova] Creating event network-changed:465b32fb-6c84-430d-a46e-c121d11a251f for instance eac993df-5bb7-4ef9-857f-99e4674678cc on nch1-master-1 Jan 22 22:05:43.373334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-bb764e25-2715-4af9-b86a-59968fe85561 req-4c13783d-385d-4245-90e3-7884e36885de service nova] Instance eac993df-5bb7-4ef9-857f-99e4674678cc is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:05:43.384678 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-bb764e25-2715-4af9-b86a-59968fe85561 req-4c13783d-385d-4245-90e3-7884e36885de service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043492 Jan 22 22:05:43.385283 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4301/8895] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:05:43.701210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-366736a3-d819-4a44-8677-fe74ced2a0d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:43.701848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-366736a3-d819-4a44-8677-fe74ced2a0d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:43.709732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-366736a3-d819-4a44-8677-fe74ced2a0d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:43.710456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-366736a3-d819-4a44-8677-fe74ced2a0d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:43.711433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-366736a3-d819-4a44-8677-fe74ced2a0d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:43.711961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-366736a3-d819-4a44-8677-fe74ced2a0d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:44.203346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-366736a3-d819-4a44-8677-fe74ced2a0d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:44.212398 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-366736a3-d819-4a44-8677-fe74ced2a0d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1684 microversion: 2.1 time: 0.514396 Jan 22 22:05:44.222592 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4595/8896] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:43 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1684 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:45.231959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-577c4116-19dd-4522-b78d-98d1337ce1e1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:45.232646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-577c4116-19dd-4522-b78d-98d1337ce1e1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:45.239007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-577c4116-19dd-4522-b78d-98d1337ce1e1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:45.239460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-577c4116-19dd-4522-b78d-98d1337ce1e1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:45.240235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-577c4116-19dd-4522-b78d-98d1337ce1e1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:45.240672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-577c4116-19dd-4522-b78d-98d1337ce1e1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:45.375930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-577c4116-19dd-4522-b78d-98d1337ce1e1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:45.383667 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-577c4116-19dd-4522-b78d-98d1337ce1e1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1680 microversion: 2.1 time: 0.157095 Jan 22 22:05:45.384241 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4302/8897] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:45 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:45.403669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a2a24400-10eb-45a3-9f26-ed7c93e69d05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:45.404225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a2a24400-10eb-45a3-9f26-ed7c93e69d05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:45.411188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2a24400-10eb-45a3-9f26-ed7c93e69d05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:45.411659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2a24400-10eb-45a3-9f26-ed7c93e69d05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:45.412460 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2a24400-10eb-45a3-9f26-ed7c93e69d05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:45.412917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2a24400-10eb-45a3-9f26-ed7c93e69d05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:45.595094 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a2a24400-10eb-45a3-9f26-ed7c93e69d05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 204 len: 0 microversion: 2.1 time: 0.195871 Jan 22 22:05:45.595748 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4596/8898] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:45 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:05:45.607109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1d243fcc-cad7-4186-ba48-24de260b98c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:45.608104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1d243fcc-cad7-4186-ba48-24de260b98c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:45.614408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d243fcc-cad7-4186-ba48-24de260b98c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:45.614868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d243fcc-cad7-4186-ba48-24de260b98c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:45.615668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d243fcc-cad7-4186-ba48-24de260b98c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:45.616118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1d243fcc-cad7-4186-ba48-24de260b98c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:45.767096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1d243fcc-cad7-4186-ba48-24de260b98c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:45.775855 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1d243fcc-cad7-4186-ba48-24de260b98c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1680 microversion: 2.1 time: 0.174734 Jan 22 22:05:45.781544 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4303/8899] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:45 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:46.795001 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e1a9b175-dc69-4334-b743-9b851384f32f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:46.795708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e1a9b175-dc69-4334-b743-9b851384f32f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:46.802878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1a9b175-dc69-4334-b743-9b851384f32f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:46.803345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1a9b175-dc69-4334-b743-9b851384f32f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:46.804149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1a9b175-dc69-4334-b743-9b851384f32f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:46.804602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e1a9b175-dc69-4334-b743-9b851384f32f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:46.954349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e1a9b175-dc69-4334-b743-9b851384f32f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:46.962414 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e1a9b175-dc69-4334-b743-9b851384f32f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1680 microversion: 2.1 time: 0.171732 Jan 22 22:05:46.963317 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4597/8900] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:46 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:05:47.507041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-9a2d2b6d-348c-4b15-8aee-b37de692ebf0 req-ad9ecd5d-fa00-4966-8bcd-ec074692e411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac993df-5bb7-4ef9-857f-99e4674678cc", "name": "network-vif-plugged", "status": "completed", "tag": "465b32fb-6c84-430d-a46e-c121d11a251f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:47.508763 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:05:47.508763 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:05:47.515939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9a2d2b6d-348c-4b15-8aee-b37de692ebf0 req-ad9ecd5d-fa00-4966-8bcd-ec074692e411 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:47.516386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9a2d2b6d-348c-4b15-8aee-b37de692ebf0 req-ad9ecd5d-fa00-4966-8bcd-ec074692e411 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:47.527565 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-9a2d2b6d-348c-4b15-8aee-b37de692ebf0 req-ad9ecd5d-fa00-4966-8bcd-ec074692e411 service nova] Creating event network-vif-plugged:465b32fb-6c84-430d-a46e-c121d11a251f for instance eac993df-5bb7-4ef9-857f-99e4674678cc on nch1-master-1 Jan 22 22:05:47.532776 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-9a2d2b6d-348c-4b15-8aee-b37de692ebf0 req-ad9ecd5d-fa00-4966-8bcd-ec074692e411 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086389 Jan 22 22:05:47.533817 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4304/8901] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:05:47.980687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0cebf431-0e65-4288-bab6-ee905a974d2e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:47.981285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0cebf431-0e65-4288-bab6-ee905a974d2e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:47.988456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cebf431-0e65-4288-bab6-ee905a974d2e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:47.994830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cebf431-0e65-4288-bab6-ee905a974d2e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:47.994830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cebf431-0e65-4288-bab6-ee905a974d2e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:47.994830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0cebf431-0e65-4288-bab6-ee905a974d2e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:48.127838 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0cebf431-0e65-4288-bab6-ee905a974d2e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:48.135737 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0cebf431-0e65-4288-bab6-ee905a974d2e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1659 microversion: 2.1 time: 0.159442 Jan 22 22:05:48.136293 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4598/8902] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:47 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1659 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:48.153682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-db1fa131-a91a-4bc8-91f8-6d7552a52ec1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:48.154377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-db1fa131-a91a-4bc8-91f8-6d7552a52ec1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:48.160502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db1fa131-a91a-4bc8-91f8-6d7552a52ec1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:48.160956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db1fa131-a91a-4bc8-91f8-6d7552a52ec1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:48.161787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db1fa131-a91a-4bc8-91f8-6d7552a52ec1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:48.162226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-db1fa131-a91a-4bc8-91f8-6d7552a52ec1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:48.295699 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-db1fa131-a91a-4bc8-91f8-6d7552a52ec1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:48.303229 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-db1fa131-a91a-4bc8-91f8-6d7552a52ec1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1659 microversion: 2.1 time: 0.154234 Jan 22 22:05:48.303796 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4305/8903] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:48 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1659 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:48.319827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b38c405-f2bd-4f89-aebf-66152c63802b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:48.326630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b38c405-f2bd-4f89-aebf-66152c63802b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:48.327183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b38c405-f2bd-4f89-aebf-66152c63802b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:48.350395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6b38c405-f2bd-4f89-aebf-66152c63802b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Going to try to start instance {{(pid=137032) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 22 22:05:48.518998 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b38c405-f2bd-4f89-aebf-66152c63802b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action" status: 202 len: 0 microversion: 2.1 time: 0.202623 Jan 22 22:05:48.519529 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4599/8904] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:05:48 2022] POST /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:05:48.528251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7b4c8023-aae0-4c2a-b3d8-af2d6d39d3bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:48.528866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7b4c8023-aae0-4c2a-b3d8-af2d6d39d3bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:48.535660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b4c8023-aae0-4c2a-b3d8-af2d6d39d3bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:48.536149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b4c8023-aae0-4c2a-b3d8-af2d6d39d3bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:48.536942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b4c8023-aae0-4c2a-b3d8-af2d6d39d3bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:48.537382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7b4c8023-aae0-4c2a-b3d8-af2d6d39d3bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:48.670447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7b4c8023-aae0-4c2a-b3d8-af2d6d39d3bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:48.679171 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7b4c8023-aae0-4c2a-b3d8-af2d6d39d3bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1668 microversion: 2.1 time: 0.154477 Jan 22 22:05:48.680760 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4306/8905] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:48 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:49.706686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-66bbecef-e5ae-441d-825a-af7c5904de81 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:49.707283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-66bbecef-e5ae-441d-825a-af7c5904de81 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:49.713855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66bbecef-e5ae-441d-825a-af7c5904de81 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:49.714336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66bbecef-e5ae-441d-825a-af7c5904de81 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:49.715148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66bbecef-e5ae-441d-825a-af7c5904de81 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:49.715615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66bbecef-e5ae-441d-825a-af7c5904de81 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:49.850661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-66bbecef-e5ae-441d-825a-af7c5904de81 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:49.858272 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-66bbecef-e5ae-441d-825a-af7c5904de81 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1668 microversion: 2.1 time: 0.156682 Jan 22 22:05:49.859133 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4600/8906] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:49 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:50.875972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d174965b-432d-497e-a6fd-857b471c5563 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:50.876697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d174965b-432d-497e-a6fd-857b471c5563 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:50.883428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d174965b-432d-497e-a6fd-857b471c5563 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:50.883896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d174965b-432d-497e-a6fd-857b471c5563 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:50.884706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d174965b-432d-497e-a6fd-857b471c5563 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:50.885172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d174965b-432d-497e-a6fd-857b471c5563 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:51.017082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d174965b-432d-497e-a6fd-857b471c5563 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:51.024521 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d174965b-432d-497e-a6fd-857b471c5563 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1672 microversion: 2.1 time: 0.152197 Jan 22 22:05:51.025091 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4307/8907] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:50 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:51.041342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fef58070-98ea-467d-9d1c-345b69f36dff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:51.042604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fef58070-98ea-467d-9d1c-345b69f36dff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:51.049648 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fef58070-98ea-467d-9d1c-345b69f36dff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:51.053730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fef58070-98ea-467d-9d1c-345b69f36dff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:51.053730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fef58070-98ea-467d-9d1c-345b69f36dff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:51.053730 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fef58070-98ea-467d-9d1c-345b69f36dff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:51.076761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fef58070-98ea-467d-9d1c-345b69f36dff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:05:51.361975 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fef58070-98ea-467d-9d1c-345b69f36dff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "DELETE /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 204 len: 0 microversion: 2.1 time: 0.324733 Jan 22 22:05:51.362569 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4601/8908] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:05:51 2022] DELETE /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:05:51.371541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b2ff11f8-6aa3-4c33-843d-4b5892ff5739 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:51.372465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b2ff11f8-6aa3-4c33-843d-4b5892ff5739 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:51.378732 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2ff11f8-6aa3-4c33-843d-4b5892ff5739 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:51.379189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2ff11f8-6aa3-4c33-843d-4b5892ff5739 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:51.380032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2ff11f8-6aa3-4c33-843d-4b5892ff5739 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:51.380444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b2ff11f8-6aa3-4c33-843d-4b5892ff5739 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:51.516063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b2ff11f8-6aa3-4c33-843d-4b5892ff5739 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:51.523538 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b2ff11f8-6aa3-4c33-843d-4b5892ff5739 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1678 microversion: 2.1 time: 0.156479 Jan 22 22:05:51.524204 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4308/8909] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:51 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:52.541441 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eecb57a8-d78e-4414-a6af-9e52814e2d29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:52.542190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eecb57a8-d78e-4414-a6af-9e52814e2d29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:52.548913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eecb57a8-d78e-4414-a6af-9e52814e2d29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:52.549386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eecb57a8-d78e-4414-a6af-9e52814e2d29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:52.550217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eecb57a8-d78e-4414-a6af-9e52814e2d29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:52.550682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eecb57a8-d78e-4414-a6af-9e52814e2d29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:52.689057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-eecb57a8-d78e-4414-a6af-9e52814e2d29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:52.696529 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eecb57a8-d78e-4414-a6af-9e52814e2d29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1678 microversion: 2.1 time: 0.159500 Jan 22 22:05:52.697139 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4602/8910] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:52 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:53.714205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2cd6359e-90da-4ebe-862a-4ff9934d2250 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:53.715400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2cd6359e-90da-4ebe-862a-4ff9934d2250 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:53.722529 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cd6359e-90da-4ebe-862a-4ff9934d2250 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:53.723341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cd6359e-90da-4ebe-862a-4ff9934d2250 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:53.724187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cd6359e-90da-4ebe-862a-4ff9934d2250 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:53.724843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cd6359e-90da-4ebe-862a-4ff9934d2250 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:53.762033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a7a40281-7457-4bc9-9bbc-be71b2472e93 req-e398cf7c-3095-42fc-8572-5482ca524293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eac993df-5bb7-4ef9-857f-99e4674678cc", "name": "network-vif-deleted", "tag": "465b32fb-6c84-430d-a46e-c121d11a251f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:53.763654 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:05:53.763654 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:05:53.772982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a7a40281-7457-4bc9-9bbc-be71b2472e93 req-e398cf7c-3095-42fc-8572-5482ca524293 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:53.775741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a7a40281-7457-4bc9-9bbc-be71b2472e93 req-e398cf7c-3095-42fc-8572-5482ca524293 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:53.787558 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a7a40281-7457-4bc9-9bbc-be71b2472e93 req-e398cf7c-3095-42fc-8572-5482ca524293 service nova] Creating event network-vif-deleted:465b32fb-6c84-430d-a46e-c121d11a251f for instance eac993df-5bb7-4ef9-857f-99e4674678cc on nch1-master-1 Jan 22 22:05:53.792957 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a7a40281-7457-4bc9-9bbc-be71b2472e93 req-e398cf7c-3095-42fc-8572-5482ca524293 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035492 Jan 22 22:05:53.794132 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4603/8911] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:05:53.811991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2cd6359e-90da-4ebe-862a-4ff9934d2250 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:53.820004 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2cd6359e-90da-4ebe-862a-4ff9934d2250 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 200 len: 1611 microversion: 2.1 time: 0.110334 Jan 22 22:05:53.823530 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4309/8912] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:53 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 1611 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:54.840799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d690eac5-cb15-4942-9f55-efe72e3d8194 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:54.841583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d690eac5-cb15-4942-9f55-efe72e3d8194 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:54.849192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d690eac5-cb15-4942-9f55-efe72e3d8194 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:54.849701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d690eac5-cb15-4942-9f55-efe72e3d8194 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:54.854444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d690eac5-cb15-4942-9f55-efe72e3d8194 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:54.854444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d690eac5-cb15-4942-9f55-efe72e3d8194 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:54.866627 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-d690eac5-cb15-4942-9f55-efe72e3d8194 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance eac993df-5bb7-4ef9-857f-99e4674678cc could not be found. Jan 22 22:05:54.867248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d690eac5-cb15-4942-9f55-efe72e3d8194 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance eac993df-5bb7-4ef9-857f-99e4674678cc could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:05:54.869029 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d690eac5-cb15-4942-9f55-efe72e3d8194 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 404 len: 111 microversion: 2.1 time: 0.033123 Jan 22 22:05:54.869562 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4604/8913] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:54 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:05:54.944794 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85e88ba9-db13-4ac3-a107-3e5eda66bb95 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:54.945404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85e88ba9-db13-4ac3-a107-3e5eda66bb95 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:54.953451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85e88ba9-db13-4ac3-a107-3e5eda66bb95 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:54.953954 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85e88ba9-db13-4ac3-a107-3e5eda66bb95 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:54.954754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85e88ba9-db13-4ac3-a107-3e5eda66bb95 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:54.955201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85e88ba9-db13-4ac3-a107-3e5eda66bb95 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:54.969463 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-85e88ba9-db13-4ac3-a107-3e5eda66bb95 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance eac993df-5bb7-4ef9-857f-99e4674678cc could not be found. Jan 22 22:05:54.970090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85e88ba9-db13-4ac3-a107-3e5eda66bb95 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance eac993df-5bb7-4ef9-857f-99e4674678cc could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:05:54.970924 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-85e88ba9-db13-4ac3-a107-3e5eda66bb95 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 404 len: 111 microversion: 2.1 time: 0.029898 Jan 22 22:05:54.971482 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4310/8914] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:54 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:05:55.021276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1847744504", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "fb9f5138-713d-480c-9e87-dbd89c7312b8"}], "security_groups": [{"name": "tempest-securitygroup--452255190"}], "key_name": "tempest-keypair-908140357", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:55.122333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] validate_networks() for [('fb9f5138-713d-480c-9e87-dbd89c7312b8', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:05:55.528074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:05:55.528512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:05:55.529008 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:05:55.529432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:05:55.529881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:05:55.538549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:55.539021 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:55.540125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:55.540582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:55.556629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for project af530edb3b084c18bf5595f46cffdf35. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:05:55.561653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for user d51f7a75cf6144f0b3bf7e63fcea6827 and project af530edb3b084c18bf5595f46cffdf35. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:05:55.574057 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:05:55.576359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:05:55.686920 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-00cc9169-332c-480b-9474-b539399f9d77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.669215 Jan 22 22:05:55.687496 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4605/8915] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:05:55 2022] POST /compute/v2.1/servers => generated 407 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 22:05:55.697548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-20d89971-e41f-431f-a0f2-f482398fa4f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:55.698462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-20d89971-e41f-431f-a0f2-f482398fa4f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:55.751448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-20d89971-e41f-431f-a0f2-f482398fa4f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:55.758495 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-20d89971-e41f-431f-a0f2-f482398fa4f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1242 microversion: 2.1 time: 0.064446 Jan 22 22:05:55.759108 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4311/8916] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:55 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:56.777477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-483e248a-45da-4340-a797-d395d0835c6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:56.778142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-483e248a-45da-4340-a797-d395d0835c6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:56.784204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-483e248a-45da-4340-a797-d395d0835c6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:56.784682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-483e248a-45da-4340-a797-d395d0835c6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:56.785563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-483e248a-45da-4340-a797-d395d0835c6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:56.786084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-483e248a-45da-4340-a797-d395d0835c6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:56.847472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-483e248a-45da-4340-a797-d395d0835c6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:56.856205 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-483e248a-45da-4340-a797-d395d0835c6d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1246 microversion: 2.1 time: 0.084230 Jan 22 22:05:56.857161 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4606/8917] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:56 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:57.874350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ca6375c5-ca74-4525-b054-d9abec74b0a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:57.874955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ca6375c5-ca74-4525-b054-d9abec74b0a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:57.885040 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca6375c5-ca74-4525-b054-d9abec74b0a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:57.885563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca6375c5-ca74-4525-b054-d9abec74b0a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:57.886379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca6375c5-ca74-4525-b054-d9abec74b0a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:57.886830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ca6375c5-ca74-4525-b054-d9abec74b0a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:57.951090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ca6375c5-ca74-4525-b054-d9abec74b0a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:57.958629 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ca6375c5-ca74-4525-b054-d9abec74b0a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1300 microversion: 2.1 time: 0.088032 Jan 22 22:05:57.959216 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4312/8918] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:57 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:58.976119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-71df04b0-5532-48bb-8e99-043f434b3bb5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:05:58.976761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-71df04b0-5532-48bb-8e99-043f434b3bb5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:05:58.984450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71df04b0-5532-48bb-8e99-043f434b3bb5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:58.984926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71df04b0-5532-48bb-8e99-043f434b3bb5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:58.985801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71df04b0-5532-48bb-8e99-043f434b3bb5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:58.986470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71df04b0-5532-48bb-8e99-043f434b3bb5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:59.166685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-71df04b0-5532-48bb-8e99-043f434b3bb5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:05:59.174236 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-71df04b0-5532-48bb-8e99-043f434b3bb5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1367 microversion: 2.1 time: 0.201822 Jan 22 22:05:59.174686 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4607/8919] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:05:58 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:05:59.344943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-522cb3ea-7fc9-4a86-bf24-ad4052e48909 req-40274272-de3e-4379-80f1-93b6618f98e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dabd5c1-4b94-4c10-8332-9a7dfcbd8495", "tag": "e258582b-2939-45c7-9697-deda58402ea1"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:05:59.352033 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:05:59.352033 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:05:59.363098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-522cb3ea-7fc9-4a86-bf24-ad4052e48909 req-40274272-de3e-4379-80f1-93b6618f98e6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:05:59.363600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-522cb3ea-7fc9-4a86-bf24-ad4052e48909 req-40274272-de3e-4379-80f1-93b6618f98e6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:05:59.377939 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-522cb3ea-7fc9-4a86-bf24-ad4052e48909 req-40274272-de3e-4379-80f1-93b6618f98e6 service nova] Creating event network-changed:e258582b-2939-45c7-9697-deda58402ea1 for instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 on nch2-master-1 Jan 22 22:05:59.382925 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-522cb3ea-7fc9-4a86-bf24-ad4052e48909 req-40274272-de3e-4379-80f1-93b6618f98e6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115474 Jan 22 22:05:59.383536 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4313/8920] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:06:00.191857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b1e21f4e-191c-4cc5-b371-fbd2ef662bcd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:06:00.192491 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b1e21f4e-191c-4cc5-b371-fbd2ef662bcd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:00.199896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1e21f4e-191c-4cc5-b371-fbd2ef662bcd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:00.200373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1e21f4e-191c-4cc5-b371-fbd2ef662bcd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:00.201196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1e21f4e-191c-4cc5-b371-fbd2ef662bcd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:00.201692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1e21f4e-191c-4cc5-b371-fbd2ef662bcd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:00.373522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b1e21f4e-191c-4cc5-b371-fbd2ef662bcd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:06:00.380961 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b1e21f4e-191c-4cc5-b371-fbd2ef662bcd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1367 microversion: 2.1 time: 0.192863 Jan 22 22:06:00.381585 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4608/8921] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:06:00 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:06:01.398735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-17414603-1a3e-4b69-951d-4b7d432b53d5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:06:01.399486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-17414603-1a3e-4b69-951d-4b7d432b53d5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:01.407733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17414603-1a3e-4b69-951d-4b7d432b53d5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:01.408182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17414603-1a3e-4b69-951d-4b7d432b53d5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:01.408969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17414603-1a3e-4b69-951d-4b7d432b53d5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:01.409404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17414603-1a3e-4b69-951d-4b7d432b53d5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:01.543431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-17414603-1a3e-4b69-951d-4b7d432b53d5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:06:01.551070 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-17414603-1a3e-4b69-951d-4b7d432b53d5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1367 microversion: 2.1 time: 0.156443 Jan 22 22:06:01.551674 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4314/8922] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:06:01 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:06:02.568104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b1bee9b6-68a7-4817-a446-f29d648d163c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:06:02.568764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b1bee9b6-68a7-4817-a446-f29d648d163c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:02.575657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1bee9b6-68a7-4817-a446-f29d648d163c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:02.576132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1bee9b6-68a7-4817-a446-f29d648d163c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:02.576943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1bee9b6-68a7-4817-a446-f29d648d163c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:02.577405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1bee9b6-68a7-4817-a446-f29d648d163c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:02.731319 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b1bee9b6-68a7-4817-a446-f29d648d163c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:06:02.740585 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b1bee9b6-68a7-4817-a446-f29d648d163c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1367 microversion: 2.1 time: 0.175849 Jan 22 22:06:02.741755 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4609/8923] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:06:02 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:06:03.758479 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-697ac940-4f29-448d-a3c5-acae4ed6039f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:06:03.759082 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-697ac940-4f29-448d-a3c5-acae4ed6039f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:03.766780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-697ac940-4f29-448d-a3c5-acae4ed6039f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:03.767239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-697ac940-4f29-448d-a3c5-acae4ed6039f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:03.768029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-697ac940-4f29-448d-a3c5-acae4ed6039f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:03.768474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-697ac940-4f29-448d-a3c5-acae4ed6039f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:03.903743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-697ac940-4f29-448d-a3c5-acae4ed6039f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:06:03.911154 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-697ac940-4f29-448d-a3c5-acae4ed6039f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1367 microversion: 2.1 time: 0.156367 Jan 22 22:06:03.911723 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4315/8924] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:06:03 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:06:04.789325 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-5ae85da6-3eb8-46f3-9574-f7cf9bb0c087 req-ed7b4c72-86db-4b57-8f03-8571d41a6305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dabd5c1-4b94-4c10-8332-9a7dfcbd8495", "name": "network-vif-plugged", "status": "completed", "tag": "e258582b-2939-45c7-9697-deda58402ea1"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:04.791148 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:06:04.791148 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:06:04.799574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5ae85da6-3eb8-46f3-9574-f7cf9bb0c087 req-ed7b4c72-86db-4b57-8f03-8571d41a6305 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:04.800029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-5ae85da6-3eb8-46f3-9574-f7cf9bb0c087 req-ed7b4c72-86db-4b57-8f03-8571d41a6305 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:04.813765 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-5ae85da6-3eb8-46f3-9574-f7cf9bb0c087 req-ed7b4c72-86db-4b57-8f03-8571d41a6305 service nova] Creating event network-vif-plugged:e258582b-2939-45c7-9697-deda58402ea1 for instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 on nch2-master-1 Jan 22 22:06:04.818966 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-5ae85da6-3eb8-46f3-9574-f7cf9bb0c087 req-ed7b4c72-86db-4b57-8f03-8571d41a6305 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033308 Jan 22 22:06:04.819732 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4610/8925] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:06:04.929018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d3ee2412-03db-4103-be37-a28b75afede5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:06:04.930319 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d3ee2412-03db-4103-be37-a28b75afede5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:04.937306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3ee2412-03db-4103-be37-a28b75afede5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:04.937801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3ee2412-03db-4103-be37-a28b75afede5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:04.938616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3ee2412-03db-4103-be37-a28b75afede5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:04.939066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d3ee2412-03db-4103-be37-a28b75afede5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:05.070019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d3ee2412-03db-4103-be37-a28b75afede5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:06:05.077899 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d3ee2412-03db-4103-be37-a28b75afede5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1367 microversion: 2.1 time: 0.152680 Jan 22 22:06:05.078676 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4316/8926] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:06:04 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:06:06.097336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-94a90b6a-94e1-40ec-b62e-6367e35e6d59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:06:06.098075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-94a90b6a-94e1-40ec-b62e-6367e35e6d59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:06.104308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94a90b6a-94e1-40ec-b62e-6367e35e6d59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:06.104960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94a90b6a-94e1-40ec-b62e-6367e35e6d59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:06.105900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94a90b6a-94e1-40ec-b62e-6367e35e6d59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:06.106363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94a90b6a-94e1-40ec-b62e-6367e35e6d59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:06.236722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-94a90b6a-94e1-40ec-b62e-6367e35e6d59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:06:06.244127 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-94a90b6a-94e1-40ec-b62e-6367e35e6d59 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1367 microversion: 2.1 time: 0.151708 Jan 22 22:06:06.244689 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4611/8927] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:06:06 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:06:07.262711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a4980525-4f41-4afa-9d5e-0b615b9c3f84 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:06:07.263342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a4980525-4f41-4afa-9d5e-0b615b9c3f84 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:07.270259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4980525-4f41-4afa-9d5e-0b615b9c3f84 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:07.270720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4980525-4f41-4afa-9d5e-0b615b9c3f84 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:07.271515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4980525-4f41-4afa-9d5e-0b615b9c3f84 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:07.271963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a4980525-4f41-4afa-9d5e-0b615b9c3f84 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:07.412123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a4980525-4f41-4afa-9d5e-0b615b9c3f84 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:06:07.420609 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a4980525-4f41-4afa-9d5e-0b615b9c3f84 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1555 microversion: 2.1 time: 0.162535 Jan 22 22:06:07.421178 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4317/8928] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:06:07 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:06:07.437053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-47f986e8-8c6b-448f-93f5-da91a92713cc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:06:07.437636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-47f986e8-8c6b-448f-93f5-da91a92713cc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:07.444256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47f986e8-8c6b-448f-93f5-da91a92713cc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:07.444728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47f986e8-8c6b-448f-93f5-da91a92713cc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:07.445602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47f986e8-8c6b-448f-93f5-da91a92713cc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:07.446063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47f986e8-8c6b-448f-93f5-da91a92713cc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:07.528314 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-47f986e8-8c6b-448f-93f5-da91a92713cc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094911 Jan 22 22:06:07.528939 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4612/8929] 10.222.0.100 () {58 vars in 1279 bytes} [Sat Jan 22 22:06:07 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:06:08.770424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-59bc39a2-0d9f-4892-b504-9f74e17dca9f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:08.771341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-59bc39a2-0d9f-4892-b504-9f74e17dca9f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:08.773801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-cd2d04e5-6fec-4c86-be8c-7c93765238ca req-043671d5-5057-430d-b481-261be4bc8d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dabd5c1-4b94-4c10-8332-9a7dfcbd8495", "tag": "e258582b-2939-45c7-9697-deda58402ea1"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:08.775438 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:06:08.775438 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:06:08.778682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59bc39a2-0d9f-4892-b504-9f74e17dca9f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:08.779136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59bc39a2-0d9f-4892-b504-9f74e17dca9f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:08.779919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59bc39a2-0d9f-4892-b504-9f74e17dca9f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:08.780571 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59bc39a2-0d9f-4892-b504-9f74e17dca9f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:08.782471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-cd2d04e5-6fec-4c86-be8c-7c93765238ca req-043671d5-5057-430d-b481-261be4bc8d0e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:08.782935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-cd2d04e5-6fec-4c86-be8c-7c93765238ca req-043671d5-5057-430d-b481-261be4bc8d0e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:08.794751 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-cd2d04e5-6fec-4c86-be8c-7c93765238ca req-043671d5-5057-430d-b481-261be4bc8d0e service nova] Creating event network-changed:e258582b-2939-45c7-9697-deda58402ea1 for instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 on nch2-master-1 Jan 22 22:06:08.800161 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-cd2d04e5-6fec-4c86-be8c-7c93765238ca req-043671d5-5057-430d-b481-261be4bc8d0e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030879 Jan 22 22:06:08.801608 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4613/8930] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:06:08.821583 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-59bc39a2-0d9f-4892-b504-9f74e17dca9f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 14 microversion: 2.1 time: 0.054873 Jan 22 22:06:08.825227 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4318/8931] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:08 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:06:09.834070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2e951504-8844-4871-8039-0487f7f053e5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:09.835119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2e951504-8844-4871-8039-0487f7f053e5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:09.843030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e951504-8844-4871-8039-0487f7f053e5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:09.843503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e951504-8844-4871-8039-0487f7f053e5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:09.844404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e951504-8844-4871-8039-0487f7f053e5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:09.844868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e951504-8844-4871-8039-0487f7f053e5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:09.882508 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2e951504-8844-4871-8039-0487f7f053e5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 14 microversion: 2.1 time: 0.052498 Jan 22 22:06:09.883356 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4614/8932] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:09 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:06:10.894120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-194cbf75-3dd1-4426-8dcd-0bf80b0982e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:10.895115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-194cbf75-3dd1-4426-8dcd-0bf80b0982e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:10.902147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-194cbf75-3dd1-4426-8dcd-0bf80b0982e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:10.903136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-194cbf75-3dd1-4426-8dcd-0bf80b0982e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:10.904264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-194cbf75-3dd1-4426-8dcd-0bf80b0982e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:10.904711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-194cbf75-3dd1-4426-8dcd-0bf80b0982e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:10.941581 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-194cbf75-3dd1-4426-8dcd-0bf80b0982e9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 14 microversion: 2.1 time: 0.051580 Jan 22 22:06:10.942210 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4319/8933] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:10 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 22:06:11.954137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-097b45fd-9811-433d-800e-9afecf08b0ab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:11.955143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-097b45fd-9811-433d-800e-9afecf08b0ab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:11.962213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-097b45fd-9811-433d-800e-9afecf08b0ab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:11.962678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-097b45fd-9811-433d-800e-9afecf08b0ab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:11.963477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-097b45fd-9811-433d-800e-9afecf08b0ab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:11.963929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-097b45fd-9811-433d-800e-9afecf08b0ab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:12.001326 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-097b45fd-9811-433d-800e-9afecf08b0ab tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 14 microversion: 2.1 time: 0.052019 Jan 22 22:06:12.001885 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4615/8934] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:11 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:06:13.012885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0aa55690-84f3-4e48-84f3-779f554ed75a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:13.014023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0aa55690-84f3-4e48-84f3-779f554ed75a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:13.021335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0aa55690-84f3-4e48-84f3-779f554ed75a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:13.021874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0aa55690-84f3-4e48-84f3-779f554ed75a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:13.022678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0aa55690-84f3-4e48-84f3-779f554ed75a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:13.023122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0aa55690-84f3-4e48-84f3-779f554ed75a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:13.061828 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0aa55690-84f3-4e48-84f3-779f554ed75a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 14 microversion: 2.1 time: 0.052986 Jan 22 22:06:13.062449 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4320/8935] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:13 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:06:14.073247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-95614bcf-f7dd-421c-a414-9de4c61f0336 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:14.074284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-95614bcf-f7dd-421c-a414-9de4c61f0336 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:14.082246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95614bcf-f7dd-421c-a414-9de4c61f0336 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:14.082706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95614bcf-f7dd-421c-a414-9de4c61f0336 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:14.083512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95614bcf-f7dd-421c-a414-9de4c61f0336 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:14.083962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95614bcf-f7dd-421c-a414-9de4c61f0336 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:14.120442 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-95614bcf-f7dd-421c-a414-9de4c61f0336 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 14 microversion: 2.1 time: 0.051142 Jan 22 22:06:14.121037 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4616/8936] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:14 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:06:15.132899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-83290ba1-19d5-46d0-9c40-a0ca7e2afefb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:15.133861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-83290ba1-19d5-46d0-9c40-a0ca7e2afefb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:15.141932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83290ba1-19d5-46d0-9c40-a0ca7e2afefb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:15.142395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83290ba1-19d5-46d0-9c40-a0ca7e2afefb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:15.143196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83290ba1-19d5-46d0-9c40-a0ca7e2afefb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:15.143645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-83290ba1-19d5-46d0-9c40-a0ca7e2afefb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:15.180574 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-83290ba1-19d5-46d0-9c40-a0ca7e2afefb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 14 microversion: 2.1 time: 0.051733 Jan 22 22:06:15.181198 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4321/8937] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:15 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:06:16.192084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b3b19ac7-3728-41e5-9e0d-974f48769f77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:16.193037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b3b19ac7-3728-41e5-9e0d-974f48769f77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:16.200487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3b19ac7-3728-41e5-9e0d-974f48769f77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:16.200951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3b19ac7-3728-41e5-9e0d-974f48769f77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:16.201781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3b19ac7-3728-41e5-9e0d-974f48769f77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:16.202235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b3b19ac7-3728-41e5-9e0d-974f48769f77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:16.241451 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b3b19ac7-3728-41e5-9e0d-974f48769f77 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 14 microversion: 2.1 time: 0.053462 Jan 22 22:06:16.242119 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4617/8938] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:16 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:06:17.253662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a7770386-f57e-4f0f-8124-a6b73214aff7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:17.254663 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a7770386-f57e-4f0f-8124-a6b73214aff7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:17.262299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7770386-f57e-4f0f-8124-a6b73214aff7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:17.262933 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7770386-f57e-4f0f-8124-a6b73214aff7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:17.263727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7770386-f57e-4f0f-8124-a6b73214aff7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:17.264170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7770386-f57e-4f0f-8124-a6b73214aff7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:17.301192 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a7770386-f57e-4f0f-8124-a6b73214aff7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 14 microversion: 2.1 time: 0.051536 Jan 22 22:06:17.301851 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4322/8939] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:17 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:06:18.313689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a7313633-0250-4ef2-bdd3-84cc2142a5e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:18.314710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a7313633-0250-4ef2-bdd3-84cc2142a5e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:18.322160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7313633-0250-4ef2-bdd3-84cc2142a5e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:18.322687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7313633-0250-4ef2-bdd3-84cc2142a5e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:18.323493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7313633-0250-4ef2-bdd3-84cc2142a5e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:18.323958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a7313633-0250-4ef2-bdd3-84cc2142a5e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:18.381094 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a7313633-0250-4ef2-bdd3-84cc2142a5e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 8206 microversion: 2.1 time: 0.072382 Jan 22 22:06:18.384481 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4618/8940] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:18 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 8206 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:06:19.392677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f06801a2-1076-4481-8ead-09bd7da9afcf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:19.393790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f06801a2-1076-4481-8ead-09bd7da9afcf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:19.401804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06801a2-1076-4481-8ead-09bd7da9afcf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:19.401804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06801a2-1076-4481-8ead-09bd7da9afcf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:19.403191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06801a2-1076-4481-8ead-09bd7da9afcf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:19.403645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f06801a2-1076-4481-8ead-09bd7da9afcf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:19.458466 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f06801a2-1076-4481-8ead-09bd7da9afcf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 16398 microversion: 2.1 time: 0.069801 Jan 22 22:06:19.459382 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4323/8941] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:19 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 16398 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:20.471193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-016f5ec8-2fd4-4dca-bdb7-0affb32e8cfc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:20.472267 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-016f5ec8-2fd4-4dca-bdb7-0affb32e8cfc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:20.479657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-016f5ec8-2fd4-4dca-bdb7-0affb32e8cfc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:20.480134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-016f5ec8-2fd4-4dca-bdb7-0affb32e8cfc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:20.481053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-016f5ec8-2fd4-4dca-bdb7-0affb32e8cfc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:20.481540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-016f5ec8-2fd4-4dca-bdb7-0affb32e8cfc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:20.519065 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-016f5ec8-2fd4-4dca-bdb7-0affb32e8cfc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 16398 microversion: 2.1 time: 0.051874 Jan 22 22:06:20.525089 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4619/8942] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:20 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 16398 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:06:21.531720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96ca171c-abd6-4cbb-ae97-c3e40fc44dbe tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:21.532727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96ca171c-abd6-4cbb-ae97-c3e40fc44dbe tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:21.540172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96ca171c-abd6-4cbb-ae97-c3e40fc44dbe tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:21.540659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96ca171c-abd6-4cbb-ae97-c3e40fc44dbe tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:21.541446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96ca171c-abd6-4cbb-ae97-c3e40fc44dbe tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:21.541914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96ca171c-abd6-4cbb-ae97-c3e40fc44dbe tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:21.583406 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96ca171c-abd6-4cbb-ae97-c3e40fc44dbe tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 16398 microversion: 2.1 time: 0.056327 Jan 22 22:06:21.584029 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4324/8943] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:21 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 16398 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:22.594594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f08d753d-98d8-4903-8e66-49ebf3fc0e8a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:22.595631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f08d753d-98d8-4903-8e66-49ebf3fc0e8a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:22.602975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f08d753d-98d8-4903-8e66-49ebf3fc0e8a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:22.603440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f08d753d-98d8-4903-8e66-49ebf3fc0e8a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:22.604229 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f08d753d-98d8-4903-8e66-49ebf3fc0e8a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:22.604675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f08d753d-98d8-4903-8e66-49ebf3fc0e8a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:22.656294 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f08d753d-98d8-4903-8e66-49ebf3fc0e8a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 16398 microversion: 2.1 time: 0.065570 Jan 22 22:06:22.656859 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4620/8944] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:22 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 16398 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:23.667878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b0726df4-e2db-4434-910b-6b97e8ff47fc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:23.668881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b0726df4-e2db-4434-910b-6b97e8ff47fc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:23.676976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0726df4-e2db-4434-910b-6b97e8ff47fc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:23.677440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0726df4-e2db-4434-910b-6b97e8ff47fc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:23.678854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0726df4-e2db-4434-910b-6b97e8ff47fc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:23.679308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0726df4-e2db-4434-910b-6b97e8ff47fc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:23.722699 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b0726df4-e2db-4434-910b-6b97e8ff47fc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 16398 microversion: 2.1 time: 0.058809 Jan 22 22:06:23.723322 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4325/8945] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:23 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 16398 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:06:24.735160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-faf27fab-0020-4369-9287-76c3e23e108c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:24.736127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-faf27fab-0020-4369-9287-76c3e23e108c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:24.743555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-faf27fab-0020-4369-9287-76c3e23e108c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:24.744018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-faf27fab-0020-4369-9287-76c3e23e108c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:24.744810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-faf27fab-0020-4369-9287-76c3e23e108c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:24.745264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-faf27fab-0020-4369-9287-76c3e23e108c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:24.797298 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-faf27fab-0020-4369-9287-76c3e23e108c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.066107 Jan 22 22:06:24.798509 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4621/8946] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:24 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:25.809951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-88bc5c44-9d6b-4906-ae29-ca9e7f28eb3f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:25.811480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-88bc5c44-9d6b-4906-ae29-ca9e7f28eb3f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:25.818994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88bc5c44-9d6b-4906-ae29-ca9e7f28eb3f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:25.819514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88bc5c44-9d6b-4906-ae29-ca9e7f28eb3f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:25.820602 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88bc5c44-9d6b-4906-ae29-ca9e7f28eb3f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:25.821230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-88bc5c44-9d6b-4906-ae29-ca9e7f28eb3f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:25.862817 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-88bc5c44-9d6b-4906-ae29-ca9e7f28eb3f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.056872 Jan 22 22:06:25.863470 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4326/8947] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:25 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:26.874540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c9e63cda-4ed4-4e49-b52a-4b174f36a500 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:26.875646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c9e63cda-4ed4-4e49-b52a-4b174f36a500 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:26.882919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9e63cda-4ed4-4e49-b52a-4b174f36a500 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:26.883389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9e63cda-4ed4-4e49-b52a-4b174f36a500 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:26.884192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9e63cda-4ed4-4e49-b52a-4b174f36a500 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:26.884654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c9e63cda-4ed4-4e49-b52a-4b174f36a500 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:26.925183 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c9e63cda-4ed4-4e49-b52a-4b174f36a500 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.054878 Jan 22 22:06:26.925858 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4622/8948] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:26 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:06:27.937299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-09bb56d5-8178-4c2e-837b-753e419464e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:27.938326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-09bb56d5-8178-4c2e-837b-753e419464e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:27.945733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09bb56d5-8178-4c2e-837b-753e419464e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:27.946195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09bb56d5-8178-4c2e-837b-753e419464e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:27.946990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09bb56d5-8178-4c2e-837b-753e419464e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:27.947438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09bb56d5-8178-4c2e-837b-753e419464e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:27.987469 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-09bb56d5-8178-4c2e-837b-753e419464e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.054152 Jan 22 22:06:27.988107 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4327/8949] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:27 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:28.999764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f9a8bd6f-18f9-40df-b648-5c4f80c06bd5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:29.001054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f9a8bd6f-18f9-40df-b648-5c4f80c06bd5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:29.008146 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9a8bd6f-18f9-40df-b648-5c4f80c06bd5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:29.008628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9a8bd6f-18f9-40df-b648-5c4f80c06bd5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:29.009437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9a8bd6f-18f9-40df-b648-5c4f80c06bd5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:29.009921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f9a8bd6f-18f9-40df-b648-5c4f80c06bd5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:29.050483 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f9a8bd6f-18f9-40df-b648-5c4f80c06bd5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.054919 Jan 22 22:06:29.051394 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4623/8950] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:28 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:30.062996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b1cd3df8-ee31-49aa-8ee9-fb935aa9c8a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:30.064006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b1cd3df8-ee31-49aa-8ee9-fb935aa9c8a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:30.071449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1cd3df8-ee31-49aa-8ee9-fb935aa9c8a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:30.071912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1cd3df8-ee31-49aa-8ee9-fb935aa9c8a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:30.072692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1cd3df8-ee31-49aa-8ee9-fb935aa9c8a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:30.073137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1cd3df8-ee31-49aa-8ee9-fb935aa9c8a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:30.131197 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b1cd3df8-ee31-49aa-8ee9-fb935aa9c8a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.072545 Jan 22 22:06:30.132094 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4328/8951] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:30 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:31.143941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-25749c8b-9aaf-45ac-87b0-b85b5cfd50f6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:31.144961 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-25749c8b-9aaf-45ac-87b0-b85b5cfd50f6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:31.152389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25749c8b-9aaf-45ac-87b0-b85b5cfd50f6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:31.152865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25749c8b-9aaf-45ac-87b0-b85b5cfd50f6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:31.153706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25749c8b-9aaf-45ac-87b0-b85b5cfd50f6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:31.154192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-25749c8b-9aaf-45ac-87b0-b85b5cfd50f6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:31.193393 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-25749c8b-9aaf-45ac-87b0-b85b5cfd50f6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.053403 Jan 22 22:06:31.194364 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4624/8952] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:31 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:32.205584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2e1b34c1-ba8f-4c7f-85ba-00bd8d4a0f36 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:32.206584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2e1b34c1-ba8f-4c7f-85ba-00bd8d4a0f36 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:32.213965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e1b34c1-ba8f-4c7f-85ba-00bd8d4a0f36 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:32.214420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e1b34c1-ba8f-4c7f-85ba-00bd8d4a0f36 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:32.215194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e1b34c1-ba8f-4c7f-85ba-00bd8d4a0f36 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:32.215631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e1b34c1-ba8f-4c7f-85ba-00bd8d4a0f36 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:32.254880 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2e1b34c1-ba8f-4c7f-85ba-00bd8d4a0f36 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.053962 Jan 22 22:06:32.255741 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4329/8953] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:32 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:33.267014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bffa5a68-d0b7-4295-8e6f-ceb3d21f1982 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:33.268029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bffa5a68-d0b7-4295-8e6f-ceb3d21f1982 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:33.275354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bffa5a68-d0b7-4295-8e6f-ceb3d21f1982 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:33.275834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bffa5a68-d0b7-4295-8e6f-ceb3d21f1982 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:33.276673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bffa5a68-d0b7-4295-8e6f-ceb3d21f1982 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:33.277097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bffa5a68-d0b7-4295-8e6f-ceb3d21f1982 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:33.325485 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bffa5a68-d0b7-4295-8e6f-ceb3d21f1982 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.062371 Jan 22 22:06:33.326205 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4625/8954] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:33 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:33.888096 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:06:33.888577 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:06:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:06:34.337695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2574774e-3af8-48f3-a1f0-fb154d46f9b7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:34.338690 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2574774e-3af8-48f3-a1f0-fb154d46f9b7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:34.347060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2574774e-3af8-48f3-a1f0-fb154d46f9b7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:34.347513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2574774e-3af8-48f3-a1f0-fb154d46f9b7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:34.348291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2574774e-3af8-48f3-a1f0-fb154d46f9b7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:34.348725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2574774e-3af8-48f3-a1f0-fb154d46f9b7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:34.390934 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2574774e-3af8-48f3-a1f0-fb154d46f9b7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.056721 Jan 22 22:06:34.391179 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4330/8955] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:34 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:06:35.402281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9d0a76ba-aaec-4687-952b-24c2a45ab607 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:35.403320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9d0a76ba-aaec-4687-952b-24c2a45ab607 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:35.411208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d0a76ba-aaec-4687-952b-24c2a45ab607 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:35.411672 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d0a76ba-aaec-4687-952b-24c2a45ab607 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:35.412494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d0a76ba-aaec-4687-952b-24c2a45ab607 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:35.413398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9d0a76ba-aaec-4687-952b-24c2a45ab607 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:35.455767 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9d0a76ba-aaec-4687-952b-24c2a45ab607 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.057338 Jan 22 22:06:35.456425 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4626/8956] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:35 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:36.468305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-229ebefc-acf8-4b4c-941b-0adfc83ecbb5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:36.469967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-229ebefc-acf8-4b4c-941b-0adfc83ecbb5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:36.477400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-229ebefc-acf8-4b4c-941b-0adfc83ecbb5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:36.481617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-229ebefc-acf8-4b4c-941b-0adfc83ecbb5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:36.481617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-229ebefc-acf8-4b4c-941b-0adfc83ecbb5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:36.481617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-229ebefc-acf8-4b4c-941b-0adfc83ecbb5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:36.520182 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-229ebefc-acf8-4b4c-941b-0adfc83ecbb5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.055977 Jan 22 22:06:36.521095 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4331/8957] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:36 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:37.532813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1e8362db-af06-4434-851a-ff97b7083d12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:37.533787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1e8362db-af06-4434-851a-ff97b7083d12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:37.541174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e8362db-af06-4434-851a-ff97b7083d12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:37.541686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e8362db-af06-4434-851a-ff97b7083d12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:37.542500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e8362db-af06-4434-851a-ff97b7083d12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:37.542966 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1e8362db-af06-4434-851a-ff97b7083d12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:37.586189 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1e8362db-af06-4434-851a-ff97b7083d12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.058108 Jan 22 22:06:37.586864 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4627/8958] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:37 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:06:38.598927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7bcaf4a4-ee02-403b-8e73-d76f5b3eda8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:38.600094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7bcaf4a4-ee02-403b-8e73-d76f5b3eda8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:38.607481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bcaf4a4-ee02-403b-8e73-d76f5b3eda8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:38.607944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bcaf4a4-ee02-403b-8e73-d76f5b3eda8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:38.609007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bcaf4a4-ee02-403b-8e73-d76f5b3eda8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:38.610072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bcaf4a4-ee02-403b-8e73-d76f5b3eda8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:38.649065 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7bcaf4a4-ee02-403b-8e73-d76f5b3eda8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.054236 Jan 22 22:06:38.649748 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4332/8959] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:38 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:39.661594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dec3d7d1-ba83-468c-9d26-d9df3c48af40 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:39.662590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dec3d7d1-ba83-468c-9d26-d9df3c48af40 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:39.669960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dec3d7d1-ba83-468c-9d26-d9df3c48af40 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:39.670494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dec3d7d1-ba83-468c-9d26-d9df3c48af40 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:39.671438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dec3d7d1-ba83-468c-9d26-d9df3c48af40 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:39.672596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dec3d7d1-ba83-468c-9d26-d9df3c48af40 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:39.713359 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dec3d7d1-ba83-468c-9d26-d9df3c48af40 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.055829 Jan 22 22:06:39.714319 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4628/8960] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:39 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:40.726236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c91a3f4e-04d1-4bdc-80ba-e483a9bc4e7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:40.727161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c91a3f4e-04d1-4bdc-80ba-e483a9bc4e7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:40.734441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c91a3f4e-04d1-4bdc-80ba-e483a9bc4e7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:40.734904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c91a3f4e-04d1-4bdc-80ba-e483a9bc4e7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:40.736295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c91a3f4e-04d1-4bdc-80ba-e483a9bc4e7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:40.737018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c91a3f4e-04d1-4bdc-80ba-e483a9bc4e7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:40.775511 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c91a3f4e-04d1-4bdc-80ba-e483a9bc4e7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.053480 Jan 22 22:06:40.776408 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4333/8961] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:40 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:06:41.788214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61bb9fc8-86c4-4a47-a1ef-28f8cd40ffd6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:41.789242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-61bb9fc8-86c4-4a47-a1ef-28f8cd40ffd6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:41.796431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61bb9fc8-86c4-4a47-a1ef-28f8cd40ffd6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:41.796906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61bb9fc8-86c4-4a47-a1ef-28f8cd40ffd6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:41.797746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61bb9fc8-86c4-4a47-a1ef-28f8cd40ffd6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:41.799012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61bb9fc8-86c4-4a47-a1ef-28f8cd40ffd6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:41.843242 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61bb9fc8-86c4-4a47-a1ef-28f8cd40ffd6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.059689 Jan 22 22:06:41.844167 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4629/8962] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:41 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:06:42.855962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ea31dae5-4e8a-470f-98c7-fe2b8ea30eaf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:42.856964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ea31dae5-4e8a-470f-98c7-fe2b8ea30eaf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:42.864837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea31dae5-4e8a-470f-98c7-fe2b8ea30eaf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:42.865302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea31dae5-4e8a-470f-98c7-fe2b8ea30eaf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:42.866131 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea31dae5-4e8a-470f-98c7-fe2b8ea30eaf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:42.866575 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea31dae5-4e8a-470f-98c7-fe2b8ea30eaf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:42.906485 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ea31dae5-4e8a-470f-98c7-fe2b8ea30eaf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.054531 Jan 22 22:06:42.907107 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4334/8963] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:42 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:43.918820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aa8f6638-e441-4e8c-8fcf-304d8c851334 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:43.919830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aa8f6638-e441-4e8c-8fcf-304d8c851334 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:43.927809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa8f6638-e441-4e8c-8fcf-304d8c851334 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:43.928273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa8f6638-e441-4e8c-8fcf-304d8c851334 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:43.929067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa8f6638-e441-4e8c-8fcf-304d8c851334 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:43.929543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aa8f6638-e441-4e8c-8fcf-304d8c851334 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:43.972112 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aa8f6638-e441-4e8c-8fcf-304d8c851334 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.057171 Jan 22 22:06:43.972808 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4630/8964] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:43 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:06:44.984023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-56fe4118-7e5e-402d-83ed-48cd03c60213 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:44.985019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-56fe4118-7e5e-402d-83ed-48cd03c60213 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:44.992474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56fe4118-7e5e-402d-83ed-48cd03c60213 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:44.993008 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56fe4118-7e5e-402d-83ed-48cd03c60213 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:44.993864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56fe4118-7e5e-402d-83ed-48cd03c60213 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:44.994304 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-56fe4118-7e5e-402d-83ed-48cd03c60213 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:45.035705 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-56fe4118-7e5e-402d-83ed-48cd03c60213 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.055768 Jan 22 22:06:45.036820 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4335/8965] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:44 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:46.047503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c0cf7983-f4f2-4ff8-a166-ef95345f98ec tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:46.049469 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c0cf7983-f4f2-4ff8-a166-ef95345f98ec tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:46.056999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0cf7983-f4f2-4ff8-a166-ef95345f98ec tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:46.058902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0cf7983-f4f2-4ff8-a166-ef95345f98ec tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:46.058902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0cf7983-f4f2-4ff8-a166-ef95345f98ec tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:46.058902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0cf7983-f4f2-4ff8-a166-ef95345f98ec tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:46.098635 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c0cf7983-f4f2-4ff8-a166-ef95345f98ec tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.055148 Jan 22 22:06:46.099266 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4631/8966] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:46 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:47.111095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a38fbbec-afe1-432e-b47f-6d703e31bcaa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:47.112168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a38fbbec-afe1-432e-b47f-6d703e31bcaa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:47.119657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a38fbbec-afe1-432e-b47f-6d703e31bcaa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:47.120115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a38fbbec-afe1-432e-b47f-6d703e31bcaa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:47.120902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a38fbbec-afe1-432e-b47f-6d703e31bcaa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:47.121348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a38fbbec-afe1-432e-b47f-6d703e31bcaa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:47.161890 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a38fbbec-afe1-432e-b47f-6d703e31bcaa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.055032 Jan 22 22:06:47.162532 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4336/8967] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:47 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:48.174438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9ad0f14a-163b-4713-aa6d-d354cab18176 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:48.175401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9ad0f14a-163b-4713-aa6d-d354cab18176 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:48.182795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ad0f14a-163b-4713-aa6d-d354cab18176 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:48.183271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ad0f14a-163b-4713-aa6d-d354cab18176 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:48.184218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ad0f14a-163b-4713-aa6d-d354cab18176 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:48.184750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9ad0f14a-163b-4713-aa6d-d354cab18176 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:48.226360 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9ad0f14a-163b-4713-aa6d-d354cab18176 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.056316 Jan 22 22:06:48.226831 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4632/8968] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:48 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:49.239002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1ac32def-1d88-4e03-8a74-797f7b3b5bd2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:49.239947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1ac32def-1d88-4e03-8a74-797f7b3b5bd2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:49.247263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ac32def-1d88-4e03-8a74-797f7b3b5bd2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:49.247720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ac32def-1d88-4e03-8a74-797f7b3b5bd2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:49.248503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ac32def-1d88-4e03-8a74-797f7b3b5bd2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:49.248944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1ac32def-1d88-4e03-8a74-797f7b3b5bd2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:49.289599 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1ac32def-1d88-4e03-8a74-797f7b3b5bd2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.054868 Jan 22 22:06:49.290326 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4337/8969] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:49 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:50.305079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-299367a9-c129-42f2-81d5-fa653bd6ba19 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:50.306157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-299367a9-c129-42f2-81d5-fa653bd6ba19 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:50.314607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-299367a9-c129-42f2-81d5-fa653bd6ba19 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:50.315085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-299367a9-c129-42f2-81d5-fa653bd6ba19 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:50.315901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-299367a9-c129-42f2-81d5-fa653bd6ba19 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:50.316364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-299367a9-c129-42f2-81d5-fa653bd6ba19 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:50.357820 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-299367a9-c129-42f2-81d5-fa653bd6ba19 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.059024 Jan 22 22:06:50.358721 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4633/8970] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:50 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:51.370286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e5574c60-f1dd-401e-baa3-d4ffbae6c5cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:51.371314 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e5574c60-f1dd-401e-baa3-d4ffbae6c5cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:51.379398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e5574c60-f1dd-401e-baa3-d4ffbae6c5cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:51.379846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e5574c60-f1dd-401e-baa3-d4ffbae6c5cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:51.380659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e5574c60-f1dd-401e-baa3-d4ffbae6c5cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:51.381099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e5574c60-f1dd-401e-baa3-d4ffbae6c5cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:51.420211 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e5574c60-f1dd-401e-baa3-d4ffbae6c5cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.053774 Jan 22 22:06:51.421119 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4338/8971] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:51 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:52.432847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1d12f815-193c-4d56-8e82-a87d1f7ff8e7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:52.433941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1d12f815-193c-4d56-8e82-a87d1f7ff8e7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:52.441887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d12f815-193c-4d56-8e82-a87d1f7ff8e7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:52.442351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d12f815-193c-4d56-8e82-a87d1f7ff8e7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:52.443137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d12f815-193c-4d56-8e82-a87d1f7ff8e7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:52.443589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d12f815-193c-4d56-8e82-a87d1f7ff8e7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:52.482571 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1d12f815-193c-4d56-8e82-a87d1f7ff8e7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.053860 Jan 22 22:06:52.483775 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4634/8972] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:52 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:53.495885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-59a9c158-ea60-4973-917e-f401df34bc29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:53.496928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-59a9c158-ea60-4973-917e-f401df34bc29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:53.505553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59a9c158-ea60-4973-917e-f401df34bc29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:53.506014 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59a9c158-ea60-4973-917e-f401df34bc29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:53.506809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59a9c158-ea60-4973-917e-f401df34bc29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:53.507255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59a9c158-ea60-4973-917e-f401df34bc29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:53.547065 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-59a9c158-ea60-4973-917e-f401df34bc29 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.055705 Jan 22 22:06:53.547609 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4339/8973] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:53 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:54.559136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-db08497e-d62d-477c-a472-f06b219be3ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:54.560174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-db08497e-d62d-477c-a472-f06b219be3ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:54.567696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db08497e-d62d-477c-a472-f06b219be3ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:54.568162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db08497e-d62d-477c-a472-f06b219be3ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:54.568970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db08497e-d62d-477c-a472-f06b219be3ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:54.569540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-db08497e-d62d-477c-a472-f06b219be3ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:54.612241 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-db08497e-d62d-477c-a472-f06b219be3ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.056976 Jan 22 22:06:54.612969 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4635/8974] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:54 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:55.624557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a3efda83-24fe-4436-a5fe-0449b683f015 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:55.625477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a3efda83-24fe-4436-a5fe-0449b683f015 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:55.633600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3efda83-24fe-4436-a5fe-0449b683f015 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:55.634060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3efda83-24fe-4436-a5fe-0449b683f015 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:55.634845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3efda83-24fe-4436-a5fe-0449b683f015 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:55.635287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3efda83-24fe-4436-a5fe-0449b683f015 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:55.677884 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a3efda83-24fe-4436-a5fe-0449b683f015 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.057335 Jan 22 22:06:55.678565 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4340/8975] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:55 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:56.690700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-51a0045f-b380-4452-aabb-8c7249c1aa46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:56.691637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-51a0045f-b380-4452-aabb-8c7249c1aa46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:56.698952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51a0045f-b380-4452-aabb-8c7249c1aa46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:56.699419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51a0045f-b380-4452-aabb-8c7249c1aa46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:56.700221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51a0045f-b380-4452-aabb-8c7249c1aa46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:56.700681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-51a0045f-b380-4452-aabb-8c7249c1aa46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:56.740462 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-51a0045f-b380-4452-aabb-8c7249c1aa46 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.054345 Jan 22 22:06:56.741094 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4636/8976] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:56 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:57.752682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a861bd6f-3dab-49be-87c1-c025d76b464f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:57.753636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a861bd6f-3dab-49be-87c1-c025d76b464f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:57.761283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a861bd6f-3dab-49be-87c1-c025d76b464f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:57.761789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a861bd6f-3dab-49be-87c1-c025d76b464f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:57.762590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a861bd6f-3dab-49be-87c1-c025d76b464f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:57.763033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a861bd6f-3dab-49be-87c1-c025d76b464f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:57.803424 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a861bd6f-3dab-49be-87c1-c025d76b464f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.054969 Jan 22 22:06:57.804283 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4341/8977] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:57 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:58.815804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-16cf1ec5-b1d8-45d9-86fa-e8cf26b60e5e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:58.816831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-16cf1ec5-b1d8-45d9-86fa-e8cf26b60e5e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:58.824200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16cf1ec5-b1d8-45d9-86fa-e8cf26b60e5e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:58.824673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16cf1ec5-b1d8-45d9-86fa-e8cf26b60e5e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:58.825478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16cf1ec5-b1d8-45d9-86fa-e8cf26b60e5e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:58.825964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-16cf1ec5-b1d8-45d9-86fa-e8cf26b60e5e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:58.869265 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-16cf1ec5-b1d8-45d9-86fa-e8cf26b60e5e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.057539 Jan 22 22:06:58.869940 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4637/8978] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:58 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:06:59.880655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-593a35ab-3978-4856-9fca-0989af08088f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:06:59.881700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-593a35ab-3978-4856-9fca-0989af08088f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:06:59.889045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-593a35ab-3978-4856-9fca-0989af08088f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:59.889527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-593a35ab-3978-4856-9fca-0989af08088f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:59.890325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-593a35ab-3978-4856-9fca-0989af08088f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:06:59.890777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-593a35ab-3978-4856-9fca-0989af08088f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:06:59.933190 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-593a35ab-3978-4856-9fca-0989af08088f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.056666 Jan 22 22:06:59.934124 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4342/8979] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:06:59 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:00.945066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-adb41a3c-88a5-4f76-8691-e6aae428342c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:00.946222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-adb41a3c-88a5-4f76-8691-e6aae428342c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:00.953620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-adb41a3c-88a5-4f76-8691-e6aae428342c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:00.954143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-adb41a3c-88a5-4f76-8691-e6aae428342c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:00.955004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-adb41a3c-88a5-4f76-8691-e6aae428342c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:00.955551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-adb41a3c-88a5-4f76-8691-e6aae428342c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:00.998540 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-adb41a3c-88a5-4f76-8691-e6aae428342c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.057441 Jan 22 22:07:00.999215 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4638/8980] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:00 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:02.010997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a7652a27-ac4f-4aa0-af82-14d7381f78f3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:02.011915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a7652a27-ac4f-4aa0-af82-14d7381f78f3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:02.019716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7652a27-ac4f-4aa0-af82-14d7381f78f3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:02.020165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7652a27-ac4f-4aa0-af82-14d7381f78f3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:02.020949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7652a27-ac4f-4aa0-af82-14d7381f78f3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:02.021395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a7652a27-ac4f-4aa0-af82-14d7381f78f3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:02.059286 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a7652a27-ac4f-4aa0-af82-14d7381f78f3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.052274 Jan 22 22:07:02.060148 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4343/8981] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:02 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:03.071649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-22cc46b7-efbb-4240-a0f9-02d4688695df tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:03.072697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-22cc46b7-efbb-4240-a0f9-02d4688695df tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:03.080781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22cc46b7-efbb-4240-a0f9-02d4688695df tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:03.081268 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22cc46b7-efbb-4240-a0f9-02d4688695df tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:03.082113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22cc46b7-efbb-4240-a0f9-02d4688695df tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:03.082576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22cc46b7-efbb-4240-a0f9-02d4688695df tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:03.122938 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-22cc46b7-efbb-4240-a0f9-02d4688695df tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.055182 Jan 22 22:07:03.123701 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4639/8982] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:03 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:04.135898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-73573e47-f05f-4269-a063-29993fcdf40b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:04.136904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-73573e47-f05f-4269-a063-29993fcdf40b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:04.144717 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73573e47-f05f-4269-a063-29993fcdf40b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:04.145180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73573e47-f05f-4269-a063-29993fcdf40b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:04.146000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73573e47-f05f-4269-a063-29993fcdf40b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:04.146450 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73573e47-f05f-4269-a063-29993fcdf40b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:04.185571 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-73573e47-f05f-4269-a063-29993fcdf40b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.053548 Jan 22 22:07:04.186131 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4344/8983] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:04 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:05.202331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e804b3d4-1fdc-4316-a74c-1a985600a5b6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:05.203675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e804b3d4-1fdc-4316-a74c-1a985600a5b6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:05.213341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e804b3d4-1fdc-4316-a74c-1a985600a5b6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:05.213866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e804b3d4-1fdc-4316-a74c-1a985600a5b6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:05.214690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e804b3d4-1fdc-4316-a74c-1a985600a5b6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:05.215153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e804b3d4-1fdc-4316-a74c-1a985600a5b6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:05.257115 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e804b3d4-1fdc-4316-a74c-1a985600a5b6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.062987 Jan 22 22:07:05.257960 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4640/8984] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:05 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:06.269431 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-139998d6-165f-4c44-9f6b-364c4cc88296 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:06.270458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-139998d6-165f-4c44-9f6b-364c4cc88296 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:06.278080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-139998d6-165f-4c44-9f6b-364c4cc88296 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:06.278545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-139998d6-165f-4c44-9f6b-364c4cc88296 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:06.279377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-139998d6-165f-4c44-9f6b-364c4cc88296 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:06.279825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-139998d6-165f-4c44-9f6b-364c4cc88296 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:06.320612 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-139998d6-165f-4c44-9f6b-364c4cc88296 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 24567 microversion: 2.1 time: 0.054959 Jan 22 22:07:06.321301 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4345/8985] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:06 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:07.335340 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0c2d844f-5a7b-4f6e-9fe9-7cee118c0081 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:07.336370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0c2d844f-5a7b-4f6e-9fe9-7cee118c0081 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:07.343683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c2d844f-5a7b-4f6e-9fe9-7cee118c0081 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:07.344138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c2d844f-5a7b-4f6e-9fe9-7cee118c0081 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:07.344933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c2d844f-5a7b-4f6e-9fe9-7cee118c0081 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:07.345382 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0c2d844f-5a7b-4f6e-9fe9-7cee118c0081 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:07.398418 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0c2d844f-5a7b-4f6e-9fe9-7cee118c0081 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.067770 Jan 22 22:07:07.399576 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4641/8986] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:07 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:08.411513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-06add244-5319-420c-a850-8531181c47a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:08.418031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-06add244-5319-420c-a850-8531181c47a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:08.419866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06add244-5319-420c-a850-8531181c47a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:08.420324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06add244-5319-420c-a850-8531181c47a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:08.421113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06add244-5319-420c-a850-8531181c47a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:08.421591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-06add244-5319-420c-a850-8531181c47a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:08.461154 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-06add244-5319-420c-a850-8531181c47a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054433 Jan 22 22:07:08.462512 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4346/8987] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:08 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:09.474206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f66bbce7-6695-46a4-b39f-6200bbf6e4b3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:09.475209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f66bbce7-6695-46a4-b39f-6200bbf6e4b3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:09.482450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f66bbce7-6695-46a4-b39f-6200bbf6e4b3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:09.482918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f66bbce7-6695-46a4-b39f-6200bbf6e4b3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:09.483976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f66bbce7-6695-46a4-b39f-6200bbf6e4b3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:09.484427 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f66bbce7-6695-46a4-b39f-6200bbf6e4b3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:09.522662 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f66bbce7-6695-46a4-b39f-6200bbf6e4b3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.053070 Jan 22 22:07:09.523539 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4642/8988] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:09 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:10.535271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-92e1e808-b46d-41e2-8629-4d9f741eab8c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:10.536279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-92e1e808-b46d-41e2-8629-4d9f741eab8c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:10.543778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92e1e808-b46d-41e2-8629-4d9f741eab8c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:10.544233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92e1e808-b46d-41e2-8629-4d9f741eab8c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:10.545028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92e1e808-b46d-41e2-8629-4d9f741eab8c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:10.545473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92e1e808-b46d-41e2-8629-4d9f741eab8c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:10.586530 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-92e1e808-b46d-41e2-8629-4d9f741eab8c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.055447 Jan 22 22:07:10.587080 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4347/8989] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:10 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:11.599895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3835afe3-b7c6-47e2-8fbd-ee8a6a586b50 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:11.600870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3835afe3-b7c6-47e2-8fbd-ee8a6a586b50 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:11.608026 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3835afe3-b7c6-47e2-8fbd-ee8a6a586b50 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:11.608763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3835afe3-b7c6-47e2-8fbd-ee8a6a586b50 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:11.609596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3835afe3-b7c6-47e2-8fbd-ee8a6a586b50 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:11.610056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3835afe3-b7c6-47e2-8fbd-ee8a6a586b50 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:11.657352 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3835afe3-b7c6-47e2-8fbd-ee8a6a586b50 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.062294 Jan 22 22:07:11.658074 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4643/8990] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:11 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:12.670985 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-191a1cf5-cf5a-49bf-aa6a-2128abf90310 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:12.671911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-191a1cf5-cf5a-49bf-aa6a-2128abf90310 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:12.679661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-191a1cf5-cf5a-49bf-aa6a-2128abf90310 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:12.680123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-191a1cf5-cf5a-49bf-aa6a-2128abf90310 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:12.680914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-191a1cf5-cf5a-49bf-aa6a-2128abf90310 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:12.681363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-191a1cf5-cf5a-49bf-aa6a-2128abf90310 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:12.724375 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-191a1cf5-cf5a-49bf-aa6a-2128abf90310 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.057531 Jan 22 22:07:12.725310 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4348/8991] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:12 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:13.737907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2d607998-94e4-4139-b0c1-6bba4153049d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:13.738850 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2d607998-94e4-4139-b0c1-6bba4153049d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:13.746224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d607998-94e4-4139-b0c1-6bba4153049d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:13.746702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d607998-94e4-4139-b0c1-6bba4153049d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:13.747513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d607998-94e4-4139-b0c1-6bba4153049d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:13.747976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d607998-94e4-4139-b0c1-6bba4153049d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:13.788309 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2d607998-94e4-4139-b0c1-6bba4153049d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.055585 Jan 22 22:07:13.788950 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4644/8992] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:13 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:14.800922 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-76b7a193-492c-4216-aa31-d76b9e600de6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:14.801993 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-76b7a193-492c-4216-aa31-d76b9e600de6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:14.809419 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76b7a193-492c-4216-aa31-d76b9e600de6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:14.809904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76b7a193-492c-4216-aa31-d76b9e600de6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:14.810696 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76b7a193-492c-4216-aa31-d76b9e600de6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:14.811143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-76b7a193-492c-4216-aa31-d76b9e600de6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:14.851123 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-76b7a193-492c-4216-aa31-d76b9e600de6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054405 Jan 22 22:07:14.851741 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4349/8993] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:14 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:15.864411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-58bb2994-b493-4fb1-a200-be0c424a391e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:15.865637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-58bb2994-b493-4fb1-a200-be0c424a391e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:15.873134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58bb2994-b493-4fb1-a200-be0c424a391e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:15.873646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58bb2994-b493-4fb1-a200-be0c424a391e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:15.874472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58bb2994-b493-4fb1-a200-be0c424a391e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:15.874940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58bb2994-b493-4fb1-a200-be0c424a391e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:15.915054 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-58bb2994-b493-4fb1-a200-be0c424a391e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.055231 Jan 22 22:07:15.915804 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4645/8994] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:15 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:16.928066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c42dcd09-3a58-4b2d-a2d9-78371eb729b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:16.929074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c42dcd09-3a58-4b2d-a2d9-78371eb729b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:16.936504 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c42dcd09-3a58-4b2d-a2d9-78371eb729b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:16.936959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c42dcd09-3a58-4b2d-a2d9-78371eb729b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:16.937778 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c42dcd09-3a58-4b2d-a2d9-78371eb729b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:16.938221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c42dcd09-3a58-4b2d-a2d9-78371eb729b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:16.976906 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c42dcd09-3a58-4b2d-a2d9-78371eb729b9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.053475 Jan 22 22:07:16.977553 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4350/8995] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:16 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:17.989060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5b9f8a22-5a0c-471c-a236-576d3694f1af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:17.990147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5b9f8a22-5a0c-471c-a236-576d3694f1af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:17.997473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b9f8a22-5a0c-471c-a236-576d3694f1af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:17.997986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b9f8a22-5a0c-471c-a236-576d3694f1af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:17.998781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b9f8a22-5a0c-471c-a236-576d3694f1af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:17.999245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b9f8a22-5a0c-471c-a236-576d3694f1af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:18.044342 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5b9f8a22-5a0c-471c-a236-576d3694f1af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.059344 Jan 22 22:07:18.045227 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4646/8996] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:17 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:19.056772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-edeb049a-6202-4ffb-b0a2-e00bf1d72c7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:19.057818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-edeb049a-6202-4ffb-b0a2-e00bf1d72c7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:19.065813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-edeb049a-6202-4ffb-b0a2-e00bf1d72c7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:19.066272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-edeb049a-6202-4ffb-b0a2-e00bf1d72c7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:19.067050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-edeb049a-6202-4ffb-b0a2-e00bf1d72c7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:19.067487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-edeb049a-6202-4ffb-b0a2-e00bf1d72c7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:19.109812 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-edeb049a-6202-4ffb-b0a2-e00bf1d72c7a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.056928 Jan 22 22:07:19.110751 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4351/8997] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:19 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:20.122156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e9c4aa74-6b64-4b7f-893e-c8fba61b5148 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:20.123221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e9c4aa74-6b64-4b7f-893e-c8fba61b5148 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:20.131132 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9c4aa74-6b64-4b7f-893e-c8fba61b5148 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:20.131607 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9c4aa74-6b64-4b7f-893e-c8fba61b5148 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:20.132474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9c4aa74-6b64-4b7f-893e-c8fba61b5148 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:20.132954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9c4aa74-6b64-4b7f-893e-c8fba61b5148 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:20.182102 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e9c4aa74-6b64-4b7f-893e-c8fba61b5148 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.063883 Jan 22 22:07:20.182807 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4647/8998] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:20 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:21.194497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1e1dbfa4-aebc-4ad7-8740-7e34b0c3d5d8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:21.195510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1e1dbfa4-aebc-4ad7-8740-7e34b0c3d5d8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:21.202966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e1dbfa4-aebc-4ad7-8740-7e34b0c3d5d8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:21.203428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e1dbfa4-aebc-4ad7-8740-7e34b0c3d5d8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:21.204223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e1dbfa4-aebc-4ad7-8740-7e34b0c3d5d8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:21.204673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1e1dbfa4-aebc-4ad7-8740-7e34b0c3d5d8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:21.243915 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1e1dbfa4-aebc-4ad7-8740-7e34b0c3d5d8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054258 Jan 22 22:07:21.244542 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4352/8999] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:21 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:22.256346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d6f101e8-032b-49b2-bf44-00b0ffa4a1b4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:22.257384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d6f101e8-032b-49b2-bf44-00b0ffa4a1b4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:22.264825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6f101e8-032b-49b2-bf44-00b0ffa4a1b4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:22.265302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6f101e8-032b-49b2-bf44-00b0ffa4a1b4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:22.266162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6f101e8-032b-49b2-bf44-00b0ffa4a1b4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:22.266622 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d6f101e8-032b-49b2-bf44-00b0ffa4a1b4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:22.312739 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d6f101e8-032b-49b2-bf44-00b0ffa4a1b4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.060518 Jan 22 22:07:22.313652 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4648/9000] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:22 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:23.324748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d89276dd-d81f-4f1b-b281-92e819310dfb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:23.325819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d89276dd-d81f-4f1b-b281-92e819310dfb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:23.333199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d89276dd-d81f-4f1b-b281-92e819310dfb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:23.333701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d89276dd-d81f-4f1b-b281-92e819310dfb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:23.334490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d89276dd-d81f-4f1b-b281-92e819310dfb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:23.334937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d89276dd-d81f-4f1b-b281-92e819310dfb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:23.376898 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d89276dd-d81f-4f1b-b281-92e819310dfb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.056028 Jan 22 22:07:23.378616 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4353/9001] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:23 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:24.388834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a1a5711b-dfec-4ce4-b633-b6f7b307dee7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:24.389924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a1a5711b-dfec-4ce4-b633-b6f7b307dee7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:24.397269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1a5711b-dfec-4ce4-b633-b6f7b307dee7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:24.404497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1a5711b-dfec-4ce4-b633-b6f7b307dee7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:24.404497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1a5711b-dfec-4ce4-b633-b6f7b307dee7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:24.404497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a1a5711b-dfec-4ce4-b633-b6f7b307dee7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:24.440229 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a1a5711b-dfec-4ce4-b633-b6f7b307dee7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.055354 Jan 22 22:07:24.440886 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4649/9002] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:24 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:25.452872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2b710f01-7cd3-4cae-a18d-ceb62945598b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:25.453931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2b710f01-7cd3-4cae-a18d-ceb62945598b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:25.462124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b710f01-7cd3-4cae-a18d-ceb62945598b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:25.462591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b710f01-7cd3-4cae-a18d-ceb62945598b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:25.463410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b710f01-7cd3-4cae-a18d-ceb62945598b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:25.463859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b710f01-7cd3-4cae-a18d-ceb62945598b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:25.507724 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2b710f01-7cd3-4cae-a18d-ceb62945598b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.058815 Jan 22 22:07:25.508619 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4354/9003] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:25 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:26.521164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ac5a51f7-8953-4c6b-abf1-4896c7dfee63 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:26.522200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ac5a51f7-8953-4c6b-abf1-4896c7dfee63 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:26.529410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac5a51f7-8953-4c6b-abf1-4896c7dfee63 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:26.529909 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac5a51f7-8953-4c6b-abf1-4896c7dfee63 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:26.530703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac5a51f7-8953-4c6b-abf1-4896c7dfee63 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:26.531156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ac5a51f7-8953-4c6b-abf1-4896c7dfee63 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:26.570155 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ac5a51f7-8953-4c6b-abf1-4896c7dfee63 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.053843 Jan 22 22:07:26.571036 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4650/9004] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:26 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:07:27.583715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-648726f5-0d0a-4234-8c49-94db3f16a15a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:27.584641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-648726f5-0d0a-4234-8c49-94db3f16a15a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:27.591987 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-648726f5-0d0a-4234-8c49-94db3f16a15a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:27.592449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-648726f5-0d0a-4234-8c49-94db3f16a15a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:27.593233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-648726f5-0d0a-4234-8c49-94db3f16a15a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:27.593709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-648726f5-0d0a-4234-8c49-94db3f16a15a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:27.632736 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-648726f5-0d0a-4234-8c49-94db3f16a15a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.053744 Jan 22 22:07:27.633373 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4355/9005] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:27 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:28.645125 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8c7aadee-7c6b-4efd-988f-5c017a2f211b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:28.646078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8c7aadee-7c6b-4efd-988f-5c017a2f211b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:28.653369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c7aadee-7c6b-4efd-988f-5c017a2f211b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:28.653859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c7aadee-7c6b-4efd-988f-5c017a2f211b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:28.654775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c7aadee-7c6b-4efd-988f-5c017a2f211b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:28.655230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8c7aadee-7c6b-4efd-988f-5c017a2f211b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:28.694490 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8c7aadee-7c6b-4efd-988f-5c017a2f211b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.053452 Jan 22 22:07:28.695146 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4651/9006] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:28 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:29.707800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-637566f1-ccd2-4b18-b94d-1386d704e43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:29.708729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-637566f1-ccd2-4b18-b94d-1386d704e43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:29.716088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-637566f1-ccd2-4b18-b94d-1386d704e43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:29.716549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-637566f1-ccd2-4b18-b94d-1386d704e43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:29.717337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-637566f1-ccd2-4b18-b94d-1386d704e43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:29.717828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-637566f1-ccd2-4b18-b94d-1386d704e43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:29.757250 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-637566f1-ccd2-4b18-b94d-1386d704e43f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054297 Jan 22 22:07:29.757933 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4356/9007] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:29 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:30.769224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-684947c4-1ff3-4ae9-acaf-16c6674b74a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:30.770209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-684947c4-1ff3-4ae9-acaf-16c6674b74a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:30.777585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-684947c4-1ff3-4ae9-acaf-16c6674b74a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:30.778056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-684947c4-1ff3-4ae9-acaf-16c6674b74a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:30.778855 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-684947c4-1ff3-4ae9-acaf-16c6674b74a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:30.779312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-684947c4-1ff3-4ae9-acaf-16c6674b74a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:30.819920 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-684947c4-1ff3-4ae9-acaf-16c6674b74a0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.055009 Jan 22 22:07:30.820733 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4652/9008] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:30 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:31.833064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f1e09910-2793-4ba1-8d0e-1300a858fb92 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:31.834129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f1e09910-2793-4ba1-8d0e-1300a858fb92 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:31.841564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1e09910-2793-4ba1-8d0e-1300a858fb92 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:31.842028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1e09910-2793-4ba1-8d0e-1300a858fb92 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:31.842819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1e09910-2793-4ba1-8d0e-1300a858fb92 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:31.843267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f1e09910-2793-4ba1-8d0e-1300a858fb92 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:31.881495 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f1e09910-2793-4ba1-8d0e-1300a858fb92 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.052981 Jan 22 22:07:31.882516 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4357/9009] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:31 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:32.893330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-71917320-51a0-4c03-8ff1-b32f268645e1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:32.894381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-71917320-51a0-4c03-8ff1-b32f268645e1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:32.901782 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71917320-51a0-4c03-8ff1-b32f268645e1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:32.902262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71917320-51a0-4c03-8ff1-b32f268645e1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:32.903068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71917320-51a0-4c03-8ff1-b32f268645e1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:32.903530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-71917320-51a0-4c03-8ff1-b32f268645e1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:32.945991 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-71917320-51a0-4c03-8ff1-b32f268645e1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.057195 Jan 22 22:07:32.947024 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4653/9010] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:32 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:33.958326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-90510f07-9a63-4a9c-8b3a-9075fb2186b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:33.959330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-90510f07-9a63-4a9c-8b3a-9075fb2186b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:33.966830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90510f07-9a63-4a9c-8b3a-9075fb2186b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:33.967295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90510f07-9a63-4a9c-8b3a-9075fb2186b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:33.968081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90510f07-9a63-4a9c-8b3a-9075fb2186b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:33.968527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-90510f07-9a63-4a9c-8b3a-9075fb2186b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:34.012617 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-90510f07-9a63-4a9c-8b3a-9075fb2186b5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.058435 Jan 22 22:07:34.013255 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4358/9011] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:33 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:07:35.024918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-57df9f43-92c2-4d25-9741-4be8d43b85f4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:35.028717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-57df9f43-92c2-4d25-9741-4be8d43b85f4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:35.033332 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57df9f43-92c2-4d25-9741-4be8d43b85f4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:35.033857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57df9f43-92c2-4d25-9741-4be8d43b85f4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:35.034679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57df9f43-92c2-4d25-9741-4be8d43b85f4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:35.035171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-57df9f43-92c2-4d25-9741-4be8d43b85f4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:35.075611 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-57df9f43-92c2-4d25-9741-4be8d43b85f4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054710 Jan 22 22:07:35.080451 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4654/9012] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:35 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:36.087963 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-63e74df4-c89f-4958-a16e-51e4c26fec8b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:36.088957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-63e74df4-c89f-4958-a16e-51e4c26fec8b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:36.096771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63e74df4-c89f-4958-a16e-51e4c26fec8b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:36.097217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63e74df4-c89f-4958-a16e-51e4c26fec8b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:36.098042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63e74df4-c89f-4958-a16e-51e4c26fec8b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:36.098486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-63e74df4-c89f-4958-a16e-51e4c26fec8b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:36.137859 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-63e74df4-c89f-4958-a16e-51e4c26fec8b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.053833 Jan 22 22:07:36.138500 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4359/9013] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:36 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:37.150611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-220759a8-f739-49e9-be88-a03c9622f8ea tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:37.151668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-220759a8-f739-49e9-be88-a03c9622f8ea tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:37.159306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-220759a8-f739-49e9-be88-a03c9622f8ea tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:37.159781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-220759a8-f739-49e9-be88-a03c9622f8ea tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:37.160592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-220759a8-f739-49e9-be88-a03c9622f8ea tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:37.161054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-220759a8-f739-49e9-be88-a03c9622f8ea tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:37.199722 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-220759a8-f739-49e9-be88-a03c9622f8ea tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.053257 Jan 22 22:07:37.200350 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4655/9014] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:37 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:07:38.212631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a559e7f7-bab8-4016-8bac-dc5f3f6754b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:38.213668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a559e7f7-bab8-4016-8bac-dc5f3f6754b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:38.221828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a559e7f7-bab8-4016-8bac-dc5f3f6754b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:38.222285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a559e7f7-bab8-4016-8bac-dc5f3f6754b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:38.223073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a559e7f7-bab8-4016-8bac-dc5f3f6754b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:38.223520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a559e7f7-bab8-4016-8bac-dc5f3f6754b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:38.264879 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a559e7f7-bab8-4016-8bac-dc5f3f6754b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.056262 Jan 22 22:07:38.265537 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4360/9015] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:38 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:39.276862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5f5ef6b3-ba8e-451d-b074-aad7fc5c406f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:39.277913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5f5ef6b3-ba8e-451d-b074-aad7fc5c406f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:39.287942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f5ef6b3-ba8e-451d-b074-aad7fc5c406f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:39.287942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f5ef6b3-ba8e-451d-b074-aad7fc5c406f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:39.287942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f5ef6b3-ba8e-451d-b074-aad7fc5c406f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:39.287942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5f5ef6b3-ba8e-451d-b074-aad7fc5c406f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:39.329433 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5f5ef6b3-ba8e-451d-b074-aad7fc5c406f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.056565 Jan 22 22:07:39.330974 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4656/9016] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:39 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:07:40.342709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5a621e72-0ba6-4a0f-a7fc-8ca6ec95de01 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:40.343797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5a621e72-0ba6-4a0f-a7fc-8ca6ec95de01 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:40.351815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a621e72-0ba6-4a0f-a7fc-8ca6ec95de01 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:40.352268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a621e72-0ba6-4a0f-a7fc-8ca6ec95de01 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:40.353056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a621e72-0ba6-4a0f-a7fc-8ca6ec95de01 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:40.353495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5a621e72-0ba6-4a0f-a7fc-8ca6ec95de01 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:40.396321 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5a621e72-0ba6-4a0f-a7fc-8ca6ec95de01 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.057570 Jan 22 22:07:40.400328 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4361/9017] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:40 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:41.409808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bd6529ea-0fed-41c2-a04e-2f7f90fc40b8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:41.411239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bd6529ea-0fed-41c2-a04e-2f7f90fc40b8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:41.418681 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd6529ea-0fed-41c2-a04e-2f7f90fc40b8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:41.419154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd6529ea-0fed-41c2-a04e-2f7f90fc40b8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:41.419968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd6529ea-0fed-41c2-a04e-2f7f90fc40b8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:41.420432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd6529ea-0fed-41c2-a04e-2f7f90fc40b8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:41.460729 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bd6529ea-0fed-41c2-a04e-2f7f90fc40b8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.056133 Jan 22 22:07:41.461626 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4657/9018] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:41 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:42.473716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ec224568-a722-407b-9a94-2590bd179f58 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:42.474761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ec224568-a722-407b-9a94-2590bd179f58 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:42.481952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec224568-a722-407b-9a94-2590bd179f58 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:42.482416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec224568-a722-407b-9a94-2590bd179f58 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:42.483477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec224568-a722-407b-9a94-2590bd179f58 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:42.483923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec224568-a722-407b-9a94-2590bd179f58 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:42.524003 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ec224568-a722-407b-9a94-2590bd179f58 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054938 Jan 22 22:07:42.524660 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4362/9019] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:42 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:43.535732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9cf9ff2d-7681-420b-800e-f2049aad32ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:43.536750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9cf9ff2d-7681-420b-800e-f2049aad32ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:43.544349 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cf9ff2d-7681-420b-800e-f2049aad32ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:43.544820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cf9ff2d-7681-420b-800e-f2049aad32ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:43.545664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cf9ff2d-7681-420b-800e-f2049aad32ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:43.546126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9cf9ff2d-7681-420b-800e-f2049aad32ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:43.587429 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9cf9ff2d-7681-420b-800e-f2049aad32ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.055771 Jan 22 22:07:43.587976 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4658/9020] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:43 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:44.599965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3a309abe-de20-42bc-81da-ff314d1c7659 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:44.600886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3a309abe-de20-42bc-81da-ff314d1c7659 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:44.609286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a309abe-de20-42bc-81da-ff314d1c7659 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:44.609854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a309abe-de20-42bc-81da-ff314d1c7659 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:44.610639 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a309abe-de20-42bc-81da-ff314d1c7659 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:44.611076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3a309abe-de20-42bc-81da-ff314d1c7659 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:44.650109 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3a309abe-de20-42bc-81da-ff314d1c7659 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054124 Jan 22 22:07:44.650984 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4363/9021] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:44 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:45.662798 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5e27f05d-6088-4762-b67d-9e7d7f4ca322 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:45.663799 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5e27f05d-6088-4762-b67d-9e7d7f4ca322 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:45.671328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e27f05d-6088-4762-b67d-9e7d7f4ca322 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:45.677375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e27f05d-6088-4762-b67d-9e7d7f4ca322 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:45.677375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e27f05d-6088-4762-b67d-9e7d7f4ca322 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:45.677375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5e27f05d-6088-4762-b67d-9e7d7f4ca322 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:45.721479 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5e27f05d-6088-4762-b67d-9e7d7f4ca322 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.062814 Jan 22 22:07:45.722195 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4659/9022] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:45 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:46.734349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5bfd1095-a071-48fe-9a5b-de7428ae9105 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:46.735271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5bfd1095-a071-48fe-9a5b-de7428ae9105 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:46.742591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bfd1095-a071-48fe-9a5b-de7428ae9105 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:46.743043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bfd1095-a071-48fe-9a5b-de7428ae9105 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:46.743822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bfd1095-a071-48fe-9a5b-de7428ae9105 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:46.744261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5bfd1095-a071-48fe-9a5b-de7428ae9105 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:46.783873 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5bfd1095-a071-48fe-9a5b-de7428ae9105 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.053779 Jan 22 22:07:46.788717 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4364/9023] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:46 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:47.796872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f5bbecc2-f3bf-4d05-8dce-8b04a511e76b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:47.797905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f5bbecc2-f3bf-4d05-8dce-8b04a511e76b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:47.806025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5bbecc2-f3bf-4d05-8dce-8b04a511e76b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:47.806499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5bbecc2-f3bf-4d05-8dce-8b04a511e76b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:47.807306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5bbecc2-f3bf-4d05-8dce-8b04a511e76b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:47.807764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f5bbecc2-f3bf-4d05-8dce-8b04a511e76b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:47.846230 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f5bbecc2-f3bf-4d05-8dce-8b04a511e76b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.053388 Jan 22 22:07:47.846859 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4660/9024] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:47 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:07:48.858798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-214fe87e-0a79-4125-8388-07473a2b1ce5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:48.859798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-214fe87e-0a79-4125-8388-07473a2b1ce5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:48.867850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-214fe87e-0a79-4125-8388-07473a2b1ce5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:48.868299 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-214fe87e-0a79-4125-8388-07473a2b1ce5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:48.869081 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-214fe87e-0a79-4125-8388-07473a2b1ce5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:48.869542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-214fe87e-0a79-4125-8388-07473a2b1ce5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:48.909840 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-214fe87e-0a79-4125-8388-07473a2b1ce5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.055159 Jan 22 22:07:48.910528 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4365/9025] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:48 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:49.922120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c0be4dc5-7397-4987-b3b0-ec48ae504212 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:49.923157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c0be4dc5-7397-4987-b3b0-ec48ae504212 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:49.930982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0be4dc5-7397-4987-b3b0-ec48ae504212 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:49.931455 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0be4dc5-7397-4987-b3b0-ec48ae504212 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:49.932246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0be4dc5-7397-4987-b3b0-ec48ae504212 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:49.932695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c0be4dc5-7397-4987-b3b0-ec48ae504212 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:49.972201 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c0be4dc5-7397-4987-b3b0-ec48ae504212 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054086 Jan 22 22:07:49.973351 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4661/9026] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:49 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:50.984838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fcd98ffa-9202-4215-a43b-1ed6d33379c9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:50.985875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fcd98ffa-9202-4215-a43b-1ed6d33379c9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:50.993951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcd98ffa-9202-4215-a43b-1ed6d33379c9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:50.994414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcd98ffa-9202-4215-a43b-1ed6d33379c9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:50.995221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcd98ffa-9202-4215-a43b-1ed6d33379c9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:50.995664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fcd98ffa-9202-4215-a43b-1ed6d33379c9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:51.038599 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fcd98ffa-9202-4215-a43b-1ed6d33379c9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.057912 Jan 22 22:07:51.039292 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4366/9027] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:50 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:52.051351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a17eb1f7-93d8-4bb7-b060-3e76661cd582 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:52.052542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a17eb1f7-93d8-4bb7-b060-3e76661cd582 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:52.060131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a17eb1f7-93d8-4bb7-b060-3e76661cd582 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:52.060606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a17eb1f7-93d8-4bb7-b060-3e76661cd582 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:52.061412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a17eb1f7-93d8-4bb7-b060-3e76661cd582 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:52.061901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a17eb1f7-93d8-4bb7-b060-3e76661cd582 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:52.101140 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a17eb1f7-93d8-4bb7-b060-3e76661cd582 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054115 Jan 22 22:07:52.101827 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4662/9028] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:52 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:53.113100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cdadf77c-782e-4ed0-81ab-bcbf55bbe8d6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:53.114189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cdadf77c-782e-4ed0-81ab-bcbf55bbe8d6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:53.121568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdadf77c-782e-4ed0-81ab-bcbf55bbe8d6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:53.122034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdadf77c-782e-4ed0-81ab-bcbf55bbe8d6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:53.122824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdadf77c-782e-4ed0-81ab-bcbf55bbe8d6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:53.123272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdadf77c-782e-4ed0-81ab-bcbf55bbe8d6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:53.418847 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cdadf77c-782e-4ed0-81ab-bcbf55bbe8d6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.309615 Jan 22 22:07:53.419520 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4367/9029] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:53 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:54.431751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-75b07c13-9b0e-4a7e-b1ca-e0bf81214238 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:54.432793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-75b07c13-9b0e-4a7e-b1ca-e0bf81214238 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:54.440217 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75b07c13-9b0e-4a7e-b1ca-e0bf81214238 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:54.440703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75b07c13-9b0e-4a7e-b1ca-e0bf81214238 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:54.442194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75b07c13-9b0e-4a7e-b1ca-e0bf81214238 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:54.442980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-75b07c13-9b0e-4a7e-b1ca-e0bf81214238 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:54.483247 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-75b07c13-9b0e-4a7e-b1ca-e0bf81214238 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.055371 Jan 22 22:07:54.483899 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4663/9030] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:54 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:55.495868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9bf9c7a4-bb29-4d6c-8c26-00ff9d5b0584 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:55.496877 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9bf9c7a4-bb29-4d6c-8c26-00ff9d5b0584 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:55.504923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bf9c7a4-bb29-4d6c-8c26-00ff9d5b0584 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:55.505593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bf9c7a4-bb29-4d6c-8c26-00ff9d5b0584 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:55.506391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bf9c7a4-bb29-4d6c-8c26-00ff9d5b0584 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:55.506840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9bf9c7a4-bb29-4d6c-8c26-00ff9d5b0584 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:55.547042 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9bf9c7a4-bb29-4d6c-8c26-00ff9d5b0584 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.055110 Jan 22 22:07:55.547650 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4368/9031] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:55 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:56.558537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f2773744-3327-48ec-8bd9-3312714cc59f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:56.559544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f2773744-3327-48ec-8bd9-3312714cc59f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:56.567728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2773744-3327-48ec-8bd9-3312714cc59f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:56.568186 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2773744-3327-48ec-8bd9-3312714cc59f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:56.568989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2773744-3327-48ec-8bd9-3312714cc59f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:56.569442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2773744-3327-48ec-8bd9-3312714cc59f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:56.608684 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f2773744-3327-48ec-8bd9-3312714cc59f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054163 Jan 22 22:07:56.610106 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4664/9032] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:56 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:57.621122 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-35750509-4e9a-4c1f-9d44-19e6d1910daa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:57.622073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-35750509-4e9a-4c1f-9d44-19e6d1910daa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:57.629460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35750509-4e9a-4c1f-9d44-19e6d1910daa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:57.630051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35750509-4e9a-4c1f-9d44-19e6d1910daa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:57.630844 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35750509-4e9a-4c1f-9d44-19e6d1910daa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:57.631289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-35750509-4e9a-4c1f-9d44-19e6d1910daa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:57.671448 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-35750509-4e9a-4c1f-9d44-19e6d1910daa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054388 Jan 22 22:07:57.672060 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4369/9033] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:57 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:58.683883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-64c9c789-1879-4cdf-9f8f-27750e38a443 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:58.684822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-64c9c789-1879-4cdf-9f8f-27750e38a443 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:58.693246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64c9c789-1879-4cdf-9f8f-27750e38a443 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:58.693752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64c9c789-1879-4cdf-9f8f-27750e38a443 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:58.694569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64c9c789-1879-4cdf-9f8f-27750e38a443 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:58.695032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64c9c789-1879-4cdf-9f8f-27750e38a443 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:58.736571 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-64c9c789-1879-4cdf-9f8f-27750e38a443 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.056767 Jan 22 22:07:58.737214 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4665/9034] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:58 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:07:59.748904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d99b88da-c533-4c37-8435-c969d92d82a1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:07:59.749867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d99b88da-c533-4c37-8435-c969d92d82a1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:07:59.757596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d99b88da-c533-4c37-8435-c969d92d82a1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:59.758061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d99b88da-c533-4c37-8435-c969d92d82a1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:59.758856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d99b88da-c533-4c37-8435-c969d92d82a1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:07:59.759305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d99b88da-c533-4c37-8435-c969d92d82a1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:07:59.799849 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d99b88da-c533-4c37-8435-c969d92d82a1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054971 Jan 22 22:07:59.800502 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4370/9035] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:07:59 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:00.812711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-87165cd3-865f-410d-9f74-c876f8d5f110 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:00.813770 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-87165cd3-865f-410d-9f74-c876f8d5f110 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:00.821472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87165cd3-865f-410d-9f74-c876f8d5f110 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:00.821975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87165cd3-865f-410d-9f74-c876f8d5f110 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:00.822784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87165cd3-865f-410d-9f74-c876f8d5f110 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:00.823240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-87165cd3-865f-410d-9f74-c876f8d5f110 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:00.865106 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-87165cd3-865f-410d-9f74-c876f8d5f110 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.056300 Jan 22 22:08:00.865776 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4666/9036] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:00 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:01.876962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c80a207e-ac89-4779-b2f7-bb4c3d47f356 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:01.877996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c80a207e-ac89-4779-b2f7-bb4c3d47f356 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:01.885318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c80a207e-ac89-4779-b2f7-bb4c3d47f356 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:01.885754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c80a207e-ac89-4779-b2f7-bb4c3d47f356 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:01.886518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c80a207e-ac89-4779-b2f7-bb4c3d47f356 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:01.886956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c80a207e-ac89-4779-b2f7-bb4c3d47f356 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:01.928847 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c80a207e-ac89-4779-b2f7-bb4c3d47f356 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.055882 Jan 22 22:08:01.929660 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4371/9037] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:01 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:02.941201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2fbf671f-113c-49b1-b43d-4a859247242f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:02.942492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2fbf671f-113c-49b1-b43d-4a859247242f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:02.949869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fbf671f-113c-49b1-b43d-4a859247242f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:02.950346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fbf671f-113c-49b1-b43d-4a859247242f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:02.951152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fbf671f-113c-49b1-b43d-4a859247242f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:02.951655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2fbf671f-113c-49b1-b43d-4a859247242f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:02.991193 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2fbf671f-113c-49b1-b43d-4a859247242f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.053962 Jan 22 22:08:02.992073 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4667/9038] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:02 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:04.003313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e80fb4b1-7012-4d9f-8a75-4da581a85f3d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:04.005238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e80fb4b1-7012-4d9f-8a75-4da581a85f3d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:04.012792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e80fb4b1-7012-4d9f-8a75-4da581a85f3d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:04.013249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e80fb4b1-7012-4d9f-8a75-4da581a85f3d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:04.014088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e80fb4b1-7012-4d9f-8a75-4da581a85f3d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:04.014537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e80fb4b1-7012-4d9f-8a75-4da581a85f3d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:04.058016 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e80fb4b1-7012-4d9f-8a75-4da581a85f3d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.058808 Jan 22 22:08:04.058687 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4372/9039] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:03 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:05.071248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4a13adea-c0d5-4da0-a0ce-4c0954c233d9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:05.072294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4a13adea-c0d5-4da0-a0ce-4c0954c233d9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:05.079777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a13adea-c0d5-4da0-a0ce-4c0954c233d9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:05.080254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a13adea-c0d5-4da0-a0ce-4c0954c233d9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:05.081295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a13adea-c0d5-4da0-a0ce-4c0954c233d9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:05.081525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4a13adea-c0d5-4da0-a0ce-4c0954c233d9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:05.123513 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4a13adea-c0d5-4da0-a0ce-4c0954c233d9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.057000 Jan 22 22:08:05.124171 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4668/9040] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:05 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:06.136155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ada3bcd-5707-47db-8f7e-a2f86231c155 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:06.137158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3ada3bcd-5707-47db-8f7e-a2f86231c155 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:06.144526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ada3bcd-5707-47db-8f7e-a2f86231c155 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:06.144989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ada3bcd-5707-47db-8f7e-a2f86231c155 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:06.146311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ada3bcd-5707-47db-8f7e-a2f86231c155 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:06.146781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ada3bcd-5707-47db-8f7e-a2f86231c155 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:06.186404 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3ada3bcd-5707-47db-8f7e-a2f86231c155 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054248 Jan 22 22:08:06.187294 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4373/9041] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:06 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:08:07.199079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8a04148a-77d1-4b23-94e0-732f83bd71f6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:07.200091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8a04148a-77d1-4b23-94e0-732f83bd71f6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:07.207397 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a04148a-77d1-4b23-94e0-732f83bd71f6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:07.207864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a04148a-77d1-4b23-94e0-732f83bd71f6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:07.209374 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a04148a-77d1-4b23-94e0-732f83bd71f6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:07.209852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8a04148a-77d1-4b23-94e0-732f83bd71f6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:07.249561 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8a04148a-77d1-4b23-94e0-732f83bd71f6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054410 Jan 22 22:08:07.250443 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4669/9042] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:07 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:08.261934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f7a567c1-0632-4877-81f7-3641a8504c43 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:08.262932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f7a567c1-0632-4877-81f7-3641a8504c43 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:08.270201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7a567c1-0632-4877-81f7-3641a8504c43 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:08.270656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7a567c1-0632-4877-81f7-3641a8504c43 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:08.272141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7a567c1-0632-4877-81f7-3641a8504c43 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:08.272591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7a567c1-0632-4877-81f7-3641a8504c43 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:08.312395 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f7a567c1-0632-4877-81f7-3641a8504c43 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054452 Jan 22 22:08:08.313048 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4374/9043] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:08 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:09.325419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cd4a3f13-af6d-4559-9eea-0fddc300dbf8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:09.326483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cd4a3f13-af6d-4559-9eea-0fddc300dbf8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:09.333967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd4a3f13-af6d-4559-9eea-0fddc300dbf8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:09.335171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd4a3f13-af6d-4559-9eea-0fddc300dbf8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:09.335986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd4a3f13-af6d-4559-9eea-0fddc300dbf8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:09.336449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cd4a3f13-af6d-4559-9eea-0fddc300dbf8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:09.376420 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cd4a3f13-af6d-4559-9eea-0fddc300dbf8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054968 Jan 22 22:08:09.377333 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4670/9044] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:09 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:10.390416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-542095a8-4343-43b6-98e6-403df7e0464e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:10.391214 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-542095a8-4343-43b6-98e6-403df7e0464e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:10.399309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-542095a8-4343-43b6-98e6-403df7e0464e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:10.399777 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-542095a8-4343-43b6-98e6-403df7e0464e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:10.400578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-542095a8-4343-43b6-98e6-403df7e0464e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:10.401025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-542095a8-4343-43b6-98e6-403df7e0464e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:10.441559 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-542095a8-4343-43b6-98e6-403df7e0464e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.056625 Jan 22 22:08:10.442465 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4375/9045] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:10 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:11.454687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-77683e23-2ed4-4b17-be74-338078097920 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:11.455706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-77683e23-2ed4-4b17-be74-338078097920 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:11.463695 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77683e23-2ed4-4b17-be74-338078097920 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:11.464164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77683e23-2ed4-4b17-be74-338078097920 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:11.464965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77683e23-2ed4-4b17-be74-338078097920 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:11.465422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-77683e23-2ed4-4b17-be74-338078097920 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:11.509040 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-77683e23-2ed4-4b17-be74-338078097920 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.058410 Jan 22 22:08:11.510001 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4671/9046] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:11 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:12.522036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a66a0295-1751-4d8f-8e3d-7be7bf52b12f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:12.523700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a66a0295-1751-4d8f-8e3d-7be7bf52b12f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:12.530792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a66a0295-1751-4d8f-8e3d-7be7bf52b12f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:12.531246 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a66a0295-1751-4d8f-8e3d-7be7bf52b12f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:12.532057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a66a0295-1751-4d8f-8e3d-7be7bf52b12f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:12.532499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a66a0295-1751-4d8f-8e3d-7be7bf52b12f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:12.572046 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a66a0295-1751-4d8f-8e3d-7be7bf52b12f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054009 Jan 22 22:08:12.572999 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4376/9047] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:12 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:13.584611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-21a99122-51d0-48d0-a091-3ae870423bc0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:13.586183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-21a99122-51d0-48d0-a091-3ae870423bc0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:13.593446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21a99122-51d0-48d0-a091-3ae870423bc0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:13.594025 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21a99122-51d0-48d0-a091-3ae870423bc0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:13.594835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21a99122-51d0-48d0-a091-3ae870423bc0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:13.595288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21a99122-51d0-48d0-a091-3ae870423bc0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:13.635161 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-21a99122-51d0-48d0-a091-3ae870423bc0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054585 Jan 22 22:08:13.636046 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4672/9048] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:13 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:13.953370 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:08:13.954040 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:08:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:08:14.647260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5657d2fd-c655-4dc6-bf27-192a87374fc8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:14.649065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5657d2fd-c655-4dc6-bf27-192a87374fc8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:14.656481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5657d2fd-c655-4dc6-bf27-192a87374fc8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:14.656948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5657d2fd-c655-4dc6-bf27-192a87374fc8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:14.657761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5657d2fd-c655-4dc6-bf27-192a87374fc8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:14.658209 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5657d2fd-c655-4dc6-bf27-192a87374fc8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:14.697571 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5657d2fd-c655-4dc6-bf27-192a87374fc8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054394 Jan 22 22:08:14.698193 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4377/9049] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:14 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:08:15.012039 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:08:15.012589 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:08:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:08:15.708951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0a84a257-96e7-465f-8380-ebc64431059e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:15.709914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0a84a257-96e7-465f-8380-ebc64431059e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:15.717373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a84a257-96e7-465f-8380-ebc64431059e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:15.717868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a84a257-96e7-465f-8380-ebc64431059e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:15.718673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a84a257-96e7-465f-8380-ebc64431059e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:15.719131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0a84a257-96e7-465f-8380-ebc64431059e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:15.758369 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0a84a257-96e7-465f-8380-ebc64431059e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.053552 Jan 22 22:08:15.759316 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4673/9050] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:15 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:16.770866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a79a2474-bab3-4966-9732-93c944435374 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:16.771788 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a79a2474-bab3-4966-9732-93c944435374 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:16.779971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a79a2474-bab3-4966-9732-93c944435374 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:16.780440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a79a2474-bab3-4966-9732-93c944435374 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:16.781224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a79a2474-bab3-4966-9732-93c944435374 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:16.781712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a79a2474-bab3-4966-9732-93c944435374 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:16.825628 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a79a2474-bab3-4966-9732-93c944435374 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.058842 Jan 22 22:08:16.826519 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4378/9051] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:16 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:17.838239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8169fb57-d2d3-43c7-8290-8fe22b8d1ecb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:17.839257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8169fb57-d2d3-43c7-8290-8fe22b8d1ecb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:17.846639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8169fb57-d2d3-43c7-8290-8fe22b8d1ecb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:17.847114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8169fb57-d2d3-43c7-8290-8fe22b8d1ecb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:17.847927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8169fb57-d2d3-43c7-8290-8fe22b8d1ecb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:17.848389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8169fb57-d2d3-43c7-8290-8fe22b8d1ecb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:17.888688 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8169fb57-d2d3-43c7-8290-8fe22b8d1ecb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.055125 Jan 22 22:08:17.889598 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4674/9052] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:17 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:18.901580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0180087d-c71f-4f70-a412-6efdf563a7a8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:18.902631 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0180087d-c71f-4f70-a412-6efdf563a7a8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:18.910024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0180087d-c71f-4f70-a412-6efdf563a7a8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:18.910486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0180087d-c71f-4f70-a412-6efdf563a7a8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:18.911278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0180087d-c71f-4f70-a412-6efdf563a7a8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:18.911724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0180087d-c71f-4f70-a412-6efdf563a7a8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:18.950610 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0180087d-c71f-4f70-a412-6efdf563a7a8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.053799 Jan 22 22:08:18.951263 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4379/9053] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:18 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:19.963282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a934147a-3d6a-4c00-a7ce-982fa3d091b4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:19.964299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a934147a-3d6a-4c00-a7ce-982fa3d091b4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:19.971765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a934147a-3d6a-4c00-a7ce-982fa3d091b4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:19.972237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a934147a-3d6a-4c00-a7ce-982fa3d091b4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:19.973046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a934147a-3d6a-4c00-a7ce-982fa3d091b4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:19.973531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a934147a-3d6a-4c00-a7ce-982fa3d091b4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:20.014154 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a934147a-3d6a-4c00-a7ce-982fa3d091b4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.055181 Jan 22 22:08:20.014969 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4675/9054] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:19 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:21.026839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5df8b9f9-4973-415b-b9c4-c4f0e576f24e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:21.027904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5df8b9f9-4973-415b-b9c4-c4f0e576f24e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:21.035503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5df8b9f9-4973-415b-b9c4-c4f0e576f24e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:21.037338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5df8b9f9-4973-415b-b9c4-c4f0e576f24e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:21.037338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5df8b9f9-4973-415b-b9c4-c4f0e576f24e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:21.037338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5df8b9f9-4973-415b-b9c4-c4f0e576f24e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:21.077351 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5df8b9f9-4973-415b-b9c4-c4f0e576f24e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054844 Jan 22 22:08:21.078033 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4380/9055] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:21 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:22.090510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-af875975-ed51-4d9a-ae35-1d4ccc18e5a5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:22.091532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-af875975-ed51-4d9a-ae35-1d4ccc18e5a5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:22.098841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af875975-ed51-4d9a-ae35-1d4ccc18e5a5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:22.099312 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af875975-ed51-4d9a-ae35-1d4ccc18e5a5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:22.100117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af875975-ed51-4d9a-ae35-1d4ccc18e5a5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:22.100573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af875975-ed51-4d9a-ae35-1d4ccc18e5a5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:22.143748 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-af875975-ed51-4d9a-ae35-1d4ccc18e5a5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.058021 Jan 22 22:08:22.144390 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4676/9056] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:22 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:23.156703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-303fe7ea-03dd-4ee0-b17c-876c609d1230 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:23.157742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-303fe7ea-03dd-4ee0-b17c-876c609d1230 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:23.165614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-303fe7ea-03dd-4ee0-b17c-876c609d1230 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:23.166078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-303fe7ea-03dd-4ee0-b17c-876c609d1230 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:23.166869 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-303fe7ea-03dd-4ee0-b17c-876c609d1230 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:23.167316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-303fe7ea-03dd-4ee0-b17c-876c609d1230 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:23.206141 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-303fe7ea-03dd-4ee0-b17c-876c609d1230 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.053415 Jan 22 22:08:23.206764 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4381/9057] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:23 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:24.218623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f2cd0795-135d-4fc6-ba77-5a6fad028024 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:24.219638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f2cd0795-135d-4fc6-ba77-5a6fad028024 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:24.226984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2cd0795-135d-4fc6-ba77-5a6fad028024 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:24.227683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2cd0795-135d-4fc6-ba77-5a6fad028024 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:24.228559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2cd0795-135d-4fc6-ba77-5a6fad028024 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:24.229019 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2cd0795-135d-4fc6-ba77-5a6fad028024 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:24.275050 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f2cd0795-135d-4fc6-ba77-5a6fad028024 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.060417 Jan 22 22:08:24.275692 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4677/9058] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:24 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:25.286525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fa79cb43-f764-40a6-8c85-fa50094eeb31 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:25.287563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fa79cb43-f764-40a6-8c85-fa50094eeb31 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:25.294945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa79cb43-f764-40a6-8c85-fa50094eeb31 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:25.295405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa79cb43-f764-40a6-8c85-fa50094eeb31 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:25.296195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa79cb43-f764-40a6-8c85-fa50094eeb31 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:25.296641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fa79cb43-f764-40a6-8c85-fa50094eeb31 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:25.338640 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fa79cb43-f764-40a6-8c85-fa50094eeb31 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.056095 Jan 22 22:08:25.339309 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4382/9059] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:25 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:26.350191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bceeb221-29af-4f42-bf9d-c3c125f619a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:26.351212 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bceeb221-29af-4f42-bf9d-c3c125f619a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:26.359133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bceeb221-29af-4f42-bf9d-c3c125f619a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:26.359605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bceeb221-29af-4f42-bf9d-c3c125f619a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:26.360402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bceeb221-29af-4f42-bf9d-c3c125f619a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:26.360860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bceeb221-29af-4f42-bf9d-c3c125f619a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:26.669525 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bceeb221-29af-4f42-bf9d-c3c125f619a6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.323143 Jan 22 22:08:26.670094 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4678/9060] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:26 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:27.682267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f7cc8c4e-c3a6-4d9c-91da-62894d393024 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:27.683196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f7cc8c4e-c3a6-4d9c-91da-62894d393024 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:27.690633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7cc8c4e-c3a6-4d9c-91da-62894d393024 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:27.691098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7cc8c4e-c3a6-4d9c-91da-62894d393024 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:27.691889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7cc8c4e-c3a6-4d9c-91da-62894d393024 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:27.692337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f7cc8c4e-c3a6-4d9c-91da-62894d393024 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:27.732866 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f7cc8c4e-c3a6-4d9c-91da-62894d393024 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.054514 Jan 22 22:08:27.733836 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4383/9061] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:27 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:28.745837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1a1205b8-ee4c-4673-9f91-b2d48d4e19f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:28.748693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1a1205b8-ee4c-4673-9f91-b2d48d4e19f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:28.757102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a1205b8-ee4c-4673-9f91-b2d48d4e19f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:28.757860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a1205b8-ee4c-4673-9f91-b2d48d4e19f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:28.760038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a1205b8-ee4c-4673-9f91-b2d48d4e19f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:28.760890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1a1205b8-ee4c-4673-9f91-b2d48d4e19f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:28.800943 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1a1205b8-ee4c-4673-9f91-b2d48d4e19f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.059693 Jan 22 22:08:28.801621 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4679/9062] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:28 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:29.812828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fb68ba0a-a31e-46cb-8611-30a1122099c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:29.822588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fb68ba0a-a31e-46cb-8611-30a1122099c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:29.822588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb68ba0a-a31e-46cb-8611-30a1122099c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:29.822588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb68ba0a-a31e-46cb-8611-30a1122099c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:29.823412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb68ba0a-a31e-46cb-8611-30a1122099c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:29.823860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fb68ba0a-a31e-46cb-8611-30a1122099c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:29.867579 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fb68ba0a-a31e-46cb-8611-30a1122099c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.058712 Jan 22 22:08:29.868472 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4384/9063] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:29 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:30.879690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b1cd8010-fe86-4bdd-a91b-430f18c47526 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:30.880762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b1cd8010-fe86-4bdd-a91b-430f18c47526 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:30.888499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1cd8010-fe86-4bdd-a91b-430f18c47526 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:30.888973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1cd8010-fe86-4bdd-a91b-430f18c47526 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:30.889813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1cd8010-fe86-4bdd-a91b-430f18c47526 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:30.890275 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b1cd8010-fe86-4bdd-a91b-430f18c47526 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:30.935623 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b1cd8010-fe86-4bdd-a91b-430f18c47526 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.059922 Jan 22 22:08:30.936256 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4680/9064] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:30 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:08:31.948072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2b0f3820-48dd-4bf5-99ce-350b2d718a9e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:31.949078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2b0f3820-48dd-4bf5-99ce-350b2d718a9e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:31.956525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b0f3820-48dd-4bf5-99ce-350b2d718a9e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:31.956988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b0f3820-48dd-4bf5-99ce-350b2d718a9e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:31.957814 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b0f3820-48dd-4bf5-99ce-350b2d718a9e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:31.958268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2b0f3820-48dd-4bf5-99ce-350b2d718a9e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:32.000672 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2b0f3820-48dd-4bf5-99ce-350b2d718a9e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 32639 microversion: 2.1 time: 0.056609 Jan 22 22:08:32.001630 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4385/9065] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:31 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:33.013493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0bd6e8f3-6964-4581-9cba-3b1c37a3a350 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:33.014530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0bd6e8f3-6964-4581-9cba-3b1c37a3a350 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:33.022278 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bd6e8f3-6964-4581-9cba-3b1c37a3a350 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:33.022745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bd6e8f3-6964-4581-9cba-3b1c37a3a350 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:33.023540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bd6e8f3-6964-4581-9cba-3b1c37a3a350 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:33.024443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bd6e8f3-6964-4581-9cba-3b1c37a3a350 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:33.076685 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0bd6e8f3-6964-4581-9cba-3b1c37a3a350 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 200 len: 40785 microversion: 2.1 time: 0.067129 Jan 22 22:08:33.077665 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4681/9066] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:33 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 40785 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:08:33.088818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cd7626d8-bade-4596-ac75-e30e1c90149f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:33.089914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cd7626d8-bade-4596-ac75-e30e1c90149f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:33.097316 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd7626d8-bade-4596-ac75-e30e1c90149f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:33.097805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd7626d8-bade-4596-ac75-e30e1c90149f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:33.098606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd7626d8-bade-4596-ac75-e30e1c90149f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:33.099063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cd7626d8-bade-4596-ac75-e30e1c90149f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:33.241436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cd7626d8-bade-4596-ac75-e30e1c90149f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:33.249802 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cd7626d8-bade-4596-ac75-e30e1c90149f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Old instance type m1.heat2, new instance type m1.heat {{(pid=137033) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 22:08:33.255988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-cd7626d8-bade-4596-ac75-e30e1c90149f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:08:33.256415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-cd7626d8-bade-4596-ac75-e30e1c90149f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:08:33.256898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-cd7626d8-bade-4596-ac75-e30e1c90149f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:08:33.257318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-cd7626d8-bade-4596-ac75-e30e1c90149f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:08:33.257769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-cd7626d8-bade-4596-ac75-e30e1c90149f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:08:33.481621 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cd7626d8-bade-4596-ac75-e30e1c90149f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 202 len: 0 microversion: 2.1 time: 0.397708 Jan 22 22:08:33.482488 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4386/9067] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:33 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:08:33.491034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-43e69f3c-7ab6-4f5b-8efb-da6dbb5b3d5f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:33.491683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-43e69f3c-7ab6-4f5b-8efb-da6dbb5b3d5f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:33.499578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43e69f3c-7ab6-4f5b-8efb-da6dbb5b3d5f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:33.500059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43e69f3c-7ab6-4f5b-8efb-da6dbb5b3d5f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:33.500871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43e69f3c-7ab6-4f5b-8efb-da6dbb5b3d5f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:33.501329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-43e69f3c-7ab6-4f5b-8efb-da6dbb5b3d5f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:33.731362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-43e69f3c-7ab6-4f5b-8efb-da6dbb5b3d5f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:33.739210 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-43e69f3c-7ab6-4f5b-8efb-da6dbb5b3d5f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1682 microversion: 2.1 time: 0.252357 Jan 22 22:08:33.739773 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4682/9068] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:33 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1682 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:08:34.756926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7d07a868-79ea-425c-ba08-f0391698d3c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:34.758254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7d07a868-79ea-425c-ba08-f0391698d3c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:34.766217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d07a868-79ea-425c-ba08-f0391698d3c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:34.766713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d07a868-79ea-425c-ba08-f0391698d3c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:34.767681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d07a868-79ea-425c-ba08-f0391698d3c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:34.768162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7d07a868-79ea-425c-ba08-f0391698d3c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:34.914685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7d07a868-79ea-425c-ba08-f0391698d3c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:34.923090 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7d07a868-79ea-425c-ba08-f0391698d3c1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1682 microversion: 2.1 time: 0.170743 Jan 22 22:08:34.923677 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4387/9069] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:34 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:35.941242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7f3a3527-d0d1-477e-b7ed-1ef5d6f9ea90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:35.942144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7f3a3527-d0d1-477e-b7ed-1ef5d6f9ea90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:35.949802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f3a3527-d0d1-477e-b7ed-1ef5d6f9ea90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:35.950272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f3a3527-d0d1-477e-b7ed-1ef5d6f9ea90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:35.951105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f3a3527-d0d1-477e-b7ed-1ef5d6f9ea90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:35.951589 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7f3a3527-d0d1-477e-b7ed-1ef5d6f9ea90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:36.156848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7f3a3527-d0d1-477e-b7ed-1ef5d6f9ea90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:36.164467 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7f3a3527-d0d1-477e-b7ed-1ef5d6f9ea90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1682 microversion: 2.1 time: 0.226990 Jan 22 22:08:36.165054 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4683/9070] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:35 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1682 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:37.180745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0e2e5e52-8f09-457f-8ea7-ce082362d90b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:37.181410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0e2e5e52-8f09-457f-8ea7-ce082362d90b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:37.188513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e2e5e52-8f09-457f-8ea7-ce082362d90b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:37.188975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e2e5e52-8f09-457f-8ea7-ce082362d90b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:37.189806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e2e5e52-8f09-457f-8ea7-ce082362d90b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:37.190255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e2e5e52-8f09-457f-8ea7-ce082362d90b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:37.333452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0e2e5e52-8f09-457f-8ea7-ce082362d90b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:37.343018 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0e2e5e52-8f09-457f-8ea7-ce082362d90b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1687 microversion: 2.1 time: 0.165982 Jan 22 22:08:37.343590 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4388/9071] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:37 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:38.363439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c84361b4-b17d-418f-a117-4d4795d6e940 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:38.364072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c84361b4-b17d-418f-a117-4d4795d6e940 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:38.371639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c84361b4-b17d-418f-a117-4d4795d6e940 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:38.372120 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c84361b4-b17d-418f-a117-4d4795d6e940 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:38.372946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c84361b4-b17d-418f-a117-4d4795d6e940 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:38.373426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c84361b4-b17d-418f-a117-4d4795d6e940 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:38.514554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c84361b4-b17d-418f-a117-4d4795d6e940 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:38.522062 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c84361b4-b17d-418f-a117-4d4795d6e940 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1687 microversion: 2.1 time: 0.165034 Jan 22 22:08:38.522638 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4684/9072] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:38 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:39.539755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eca85b15-844b-40b7-84fa-4cd5dfa16d76 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:39.540370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eca85b15-844b-40b7-84fa-4cd5dfa16d76 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:39.547703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eca85b15-844b-40b7-84fa-4cd5dfa16d76 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:39.548171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eca85b15-844b-40b7-84fa-4cd5dfa16d76 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:39.548997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eca85b15-844b-40b7-84fa-4cd5dfa16d76 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:39.549448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eca85b15-844b-40b7-84fa-4cd5dfa16d76 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:39.682402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eca85b15-844b-40b7-84fa-4cd5dfa16d76 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:39.690058 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eca85b15-844b-40b7-84fa-4cd5dfa16d76 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1687 microversion: 2.1 time: 0.153993 Jan 22 22:08:39.690635 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4389/9073] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:39 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:40.707289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-70f7f018-7d53-44ca-8566-92ae2945edf4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:40.707848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-70f7f018-7d53-44ca-8566-92ae2945edf4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:40.714317 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70f7f018-7d53-44ca-8566-92ae2945edf4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:40.714824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70f7f018-7d53-44ca-8566-92ae2945edf4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:40.715627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70f7f018-7d53-44ca-8566-92ae2945edf4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:40.716090 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-70f7f018-7d53-44ca-8566-92ae2945edf4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:40.844580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-70f7f018-7d53-44ca-8566-92ae2945edf4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:40.852034 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-70f7f018-7d53-44ca-8566-92ae2945edf4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1687 microversion: 2.1 time: 0.148734 Jan 22 22:08:40.852602 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4685/9074] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:40 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:41.871023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3ef1d192-03af-4911-8b4e-b2227d5f4043 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:41.871904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3ef1d192-03af-4911-8b4e-b2227d5f4043 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:41.878510 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ef1d192-03af-4911-8b4e-b2227d5f4043 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:41.879007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ef1d192-03af-4911-8b4e-b2227d5f4043 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:41.879895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ef1d192-03af-4911-8b4e-b2227d5f4043 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:41.880347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3ef1d192-03af-4911-8b4e-b2227d5f4043 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:42.013530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3ef1d192-03af-4911-8b4e-b2227d5f4043 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:42.020849 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3ef1d192-03af-4911-8b4e-b2227d5f4043 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1687 microversion: 2.1 time: 0.154621 Jan 22 22:08:42.021460 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4390/9075] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:41 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:43.038439 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-800f494a-bec2-4786-99f8-ea0fa78b4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:43.039100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-800f494a-bec2-4786-99f8-ea0fa78b4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:43.046718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-800f494a-bec2-4786-99f8-ea0fa78b4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:43.047195 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-800f494a-bec2-4786-99f8-ea0fa78b4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:43.048003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-800f494a-bec2-4786-99f8-ea0fa78b4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:43.048467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-800f494a-bec2-4786-99f8-ea0fa78b4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:43.179188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-800f494a-bec2-4786-99f8-ea0fa78b4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:43.187677 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-800f494a-bec2-4786-99f8-ea0fa78b4717 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1687 microversion: 2.1 time: 0.152921 Jan 22 22:08:43.188875 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4686/9076] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:43 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:44.205087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4ac06675-990a-414e-b95e-7aa96c321276 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:44.205850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4ac06675-990a-414e-b95e-7aa96c321276 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:44.212499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ac06675-990a-414e-b95e-7aa96c321276 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:44.212953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ac06675-990a-414e-b95e-7aa96c321276 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:44.213776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ac06675-990a-414e-b95e-7aa96c321276 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:44.222243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ac06675-990a-414e-b95e-7aa96c321276 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:44.352079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4ac06675-990a-414e-b95e-7aa96c321276 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:44.360737 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4ac06675-990a-414e-b95e-7aa96c321276 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1687 microversion: 2.1 time: 0.159678 Jan 22 22:08:44.361313 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4391/9077] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:44 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:45.377296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-eef8bb53-ab1c-433b-827e-8d053aac1e43 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:45.377952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-eef8bb53-ab1c-433b-827e-8d053aac1e43 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:45.385121 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eef8bb53-ab1c-433b-827e-8d053aac1e43 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:45.394744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eef8bb53-ab1c-433b-827e-8d053aac1e43 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:45.394744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eef8bb53-ab1c-433b-827e-8d053aac1e43 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:45.394744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-eef8bb53-ab1c-433b-827e-8d053aac1e43 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:45.533754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-eef8bb53-ab1c-433b-827e-8d053aac1e43 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:45.541673 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-eef8bb53-ab1c-433b-827e-8d053aac1e43 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1687 microversion: 2.1 time: 0.168068 Jan 22 22:08:45.542894 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4687/9078] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:45 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:46.559402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f99c3c58-1bc0-4b78-8efc-d76938dd459a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:46.560034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f99c3c58-1bc0-4b78-8efc-d76938dd459a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:46.566766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f99c3c58-1bc0-4b78-8efc-d76938dd459a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:46.567221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f99c3c58-1bc0-4b78-8efc-d76938dd459a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:46.567996 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f99c3c58-1bc0-4b78-8efc-d76938dd459a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:46.568435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f99c3c58-1bc0-4b78-8efc-d76938dd459a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:46.702162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f99c3c58-1bc0-4b78-8efc-d76938dd459a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:46.709787 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f99c3c58-1bc0-4b78-8efc-d76938dd459a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1687 microversion: 2.1 time: 0.154156 Jan 22 22:08:46.710365 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4392/9079] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:46 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:47.726823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e07d3f2d-2a34-4294-a9c3-b8f0d7f55ed6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:47.727426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e07d3f2d-2a34-4294-a9c3-b8f0d7f55ed6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:47.734936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e07d3f2d-2a34-4294-a9c3-b8f0d7f55ed6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:47.735411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e07d3f2d-2a34-4294-a9c3-b8f0d7f55ed6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:47.736218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e07d3f2d-2a34-4294-a9c3-b8f0d7f55ed6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:47.736712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e07d3f2d-2a34-4294-a9c3-b8f0d7f55ed6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:47.864885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e07d3f2d-2a34-4294-a9c3-b8f0d7f55ed6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:47.874042 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e07d3f2d-2a34-4294-a9c3-b8f0d7f55ed6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1687 microversion: 2.1 time: 0.150974 Jan 22 22:08:47.874634 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4688/9080] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:47 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:48.891653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fc1f61a7-3291-4533-9677-7dcedcd29e40 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:48.892272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fc1f61a7-3291-4533-9677-7dcedcd29e40 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:48.899062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc1f61a7-3291-4533-9677-7dcedcd29e40 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:48.899521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc1f61a7-3291-4533-9677-7dcedcd29e40 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:48.900317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc1f61a7-3291-4533-9677-7dcedcd29e40 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:48.900764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fc1f61a7-3291-4533-9677-7dcedcd29e40 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:49.165514 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fc1f61a7-3291-4533-9677-7dcedcd29e40 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:49.173863 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fc1f61a7-3291-4533-9677-7dcedcd29e40 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1686 microversion: 2.1 time: 0.285960 Jan 22 22:08:49.174445 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4393/9081] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:48 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1686 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:49.255591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-083917b0-55d1-4a9b-bb3a-0db068d3fb90 req-6df42bcd-dfb5-4a8e-b3ab-102620af9123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dabd5c1-4b94-4c10-8332-9a7dfcbd8495", "name": "network-vif-unplugged", "status": "completed", "tag": "e258582b-2939-45c7-9697-deda58402ea1"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:49.258019 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:08:49.258019 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:08:49.267148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-083917b0-55d1-4a9b-bb3a-0db068d3fb90 req-6df42bcd-dfb5-4a8e-b3ab-102620af9123 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:49.267650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-083917b0-55d1-4a9b-bb3a-0db068d3fb90 req-6df42bcd-dfb5-4a8e-b3ab-102620af9123 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:49.280192 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-083917b0-55d1-4a9b-bb3a-0db068d3fb90 req-6df42bcd-dfb5-4a8e-b3ab-102620af9123 service nova] Creating event network-vif-unplugged:e258582b-2939-45c7-9697-deda58402ea1 for instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 on nch1-master-1 Jan 22 22:08:49.285809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-083917b0-55d1-4a9b-bb3a-0db068d3fb90 req-6df42bcd-dfb5-4a8e-b3ab-102620af9123 service nova] Instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:08:49.297307 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-083917b0-55d1-4a9b-bb3a-0db068d3fb90 req-6df42bcd-dfb5-4a8e-b3ab-102620af9123 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045358 Jan 22 22:08:49.297963 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4689/9082] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:08:50.192410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-97df7b4d-869a-4dc9-b07b-e7c42d15ddfa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:50.193027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-97df7b4d-869a-4dc9-b07b-e7c42d15ddfa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:50.200481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97df7b4d-869a-4dc9-b07b-e7c42d15ddfa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:50.200935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97df7b4d-869a-4dc9-b07b-e7c42d15ddfa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:50.201766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97df7b4d-869a-4dc9-b07b-e7c42d15ddfa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:50.202207 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97df7b4d-869a-4dc9-b07b-e7c42d15ddfa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:50.433418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-97df7b4d-869a-4dc9-b07b-e7c42d15ddfa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:50.440950 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-97df7b4d-869a-4dc9-b07b-e7c42d15ddfa tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1686 microversion: 2.1 time: 0.252994 Jan 22 22:08:50.441551 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4394/9083] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:50 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1686 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:51.314874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-07007019-623f-4d30-bcf5-27abc4476d32 req-fd250782-9296-46fe-954d-3f3409e063e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dabd5c1-4b94-4c10-8332-9a7dfcbd8495", "tag": "e258582b-2939-45c7-9697-deda58402ea1"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:51.316434 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:08:51.316434 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:08:51.323803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-07007019-623f-4d30-bcf5-27abc4476d32 req-fd250782-9296-46fe-954d-3f3409e063e6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:51.324352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-07007019-623f-4d30-bcf5-27abc4476d32 req-fd250782-9296-46fe-954d-3f3409e063e6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:51.338340 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-07007019-623f-4d30-bcf5-27abc4476d32 req-fd250782-9296-46fe-954d-3f3409e063e6 service nova] Creating event network-changed:e258582b-2939-45c7-9697-deda58402ea1 for instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 on nch1-master-1 Jan 22 22:08:51.344502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-07007019-623f-4d30-bcf5-27abc4476d32 req-fd250782-9296-46fe-954d-3f3409e063e6 service nova] Instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:08:51.356516 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-07007019-623f-4d30-bcf5-27abc4476d32 req-fd250782-9296-46fe-954d-3f3409e063e6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046915 Jan 22 22:08:51.357384 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4690/9084] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:08:51.459533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fe9df12c-db0e-4daa-943f-982fd027b581 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:51.460221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fe9df12c-db0e-4daa-943f-982fd027b581 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:51.468409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe9df12c-db0e-4daa-943f-982fd027b581 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:51.469015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe9df12c-db0e-4daa-943f-982fd027b581 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:51.469955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe9df12c-db0e-4daa-943f-982fd027b581 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:51.470546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe9df12c-db0e-4daa-943f-982fd027b581 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:51.681184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fe9df12c-db0e-4daa-943f-982fd027b581 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:51.689293 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fe9df12c-db0e-4daa-943f-982fd027b581 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1684 microversion: 2.1 time: 0.233703 Jan 22 22:08:51.699518 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4395/9085] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:51 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1684 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:52.708302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d4e20871-4d63-4036-abe6-0ce3393008de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:52.708937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d4e20871-4d63-4036-abe6-0ce3393008de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:52.715174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4e20871-4d63-4036-abe6-0ce3393008de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:52.715652 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4e20871-4d63-4036-abe6-0ce3393008de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:52.716458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4e20871-4d63-4036-abe6-0ce3393008de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:52.716924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d4e20871-4d63-4036-abe6-0ce3393008de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:52.848322 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d4e20871-4d63-4036-abe6-0ce3393008de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:52.856645 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d4e20871-4d63-4036-abe6-0ce3393008de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1681 microversion: 2.1 time: 0.153310 Jan 22 22:08:52.857494 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4691/9086] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:52 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:52.874349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-13413b38-9d66-44a6-bd0f-e0eb9463c257 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:52.874931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-13413b38-9d66-44a6-bd0f-e0eb9463c257 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:52.881702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13413b38-9d66-44a6-bd0f-e0eb9463c257 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:52.882166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13413b38-9d66-44a6-bd0f-e0eb9463c257 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:52.882957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13413b38-9d66-44a6-bd0f-e0eb9463c257 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:52.883403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13413b38-9d66-44a6-bd0f-e0eb9463c257 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:52.918892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13413b38-9d66-44a6-bd0f-e0eb9463c257 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:52.919351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13413b38-9d66-44a6-bd0f-e0eb9463c257 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:52.920175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13413b38-9d66-44a6-bd0f-e0eb9463c257 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:52.920623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-13413b38-9d66-44a6-bd0f-e0eb9463c257 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:52.943711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-13413b38-9d66-44a6-bd0f-e0eb9463c257 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for project af530edb3b084c18bf5595f46cffdf35. Resources: {'cores', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:08:52.949818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-13413b38-9d66-44a6-bd0f-e0eb9463c257 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for user d51f7a75cf6144f0b3bf7e63fcea6827 and project af530edb3b084c18bf5595f46cffdf35. Resources: {'cores', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:08:53.303948 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-13413b38-9d66-44a6-bd0f-e0eb9463c257 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action" status: 202 len: 0 microversion: 2.1 time: 0.434173 Jan 22 22:08:53.304917 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4396/9087] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:08:52 2022] POST /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:08:53.313379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9531c463-1b11-4760-ab00-b52d32c7c646 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:53.314144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9531c463-1b11-4760-ab00-b52d32c7c646 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:53.320127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9531c463-1b11-4760-ab00-b52d32c7c646 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:53.320603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9531c463-1b11-4760-ab00-b52d32c7c646 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:53.321457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9531c463-1b11-4760-ab00-b52d32c7c646 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:53.321960 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9531c463-1b11-4760-ab00-b52d32c7c646 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:53.462291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9531c463-1b11-4760-ab00-b52d32c7c646 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:53.470342 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9531c463-1b11-4760-ab00-b52d32c7c646 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1680 microversion: 2.1 time: 0.160706 Jan 22 22:08:53.471141 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4692/9088] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:53 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:54.488828 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b502e917-982b-4a67-bba3-7419a3d70b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:54.489668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b502e917-982b-4a67-bba3-7419a3d70b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:54.497459 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b502e917-982b-4a67-bba3-7419a3d70b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:54.497956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b502e917-982b-4a67-bba3-7419a3d70b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:54.498767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b502e917-982b-4a67-bba3-7419a3d70b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:54.499220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b502e917-982b-4a67-bba3-7419a3d70b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:54.640900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b502e917-982b-4a67-bba3-7419a3d70b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:54.648539 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b502e917-982b-4a67-bba3-7419a3d70b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1680 microversion: 2.1 time: 0.163868 Jan 22 22:08:54.649111 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4397/9089] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:54 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:55.673201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-014b7460-744e-46cc-8735-d6ca0a95d084 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:55.673831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-014b7460-744e-46cc-8735-d6ca0a95d084 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:55.680984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-014b7460-744e-46cc-8735-d6ca0a95d084 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:55.681484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-014b7460-744e-46cc-8735-d6ca0a95d084 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:55.687492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-014b7460-744e-46cc-8735-d6ca0a95d084 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:55.687492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-014b7460-744e-46cc-8735-d6ca0a95d084 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:55.816059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-014b7460-744e-46cc-8735-d6ca0a95d084 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:55.823565 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-014b7460-744e-46cc-8735-d6ca0a95d084 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1680 microversion: 2.1 time: 0.154365 Jan 22 22:08:55.824878 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4693/9090] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:55 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:56.172746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f1d99603-7473-44c1-962c-73e07a37f026 req-e376c35e-8753-4e04-8e60-12ec2a8cf59c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dabd5c1-4b94-4c10-8332-9a7dfcbd8495", "name": "network-vif-plugged", "status": "completed", "tag": "e258582b-2939-45c7-9697-deda58402ea1"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:56.174359 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:08:56.174359 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:08:56.181534 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f1d99603-7473-44c1-962c-73e07a37f026 req-e376c35e-8753-4e04-8e60-12ec2a8cf59c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:56.182071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f1d99603-7473-44c1-962c-73e07a37f026 req-e376c35e-8753-4e04-8e60-12ec2a8cf59c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:56.194535 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f1d99603-7473-44c1-962c-73e07a37f026 req-e376c35e-8753-4e04-8e60-12ec2a8cf59c service nova] Creating event network-vif-plugged:e258582b-2939-45c7-9697-deda58402ea1 for instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 on nch1-master-1 Jan 22 22:08:56.200719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-f1d99603-7473-44c1-962c-73e07a37f026 req-e376c35e-8753-4e04-8e60-12ec2a8cf59c service nova] Instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:08:56.211733 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f1d99603-7473-44c1-962c-73e07a37f026 req-e376c35e-8753-4e04-8e60-12ec2a8cf59c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045257 Jan 22 22:08:56.212347 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4398/9091] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:08:56.841916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7b8e2bfe-5bb2-48b2-9038-2823594f6777 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:56.842494 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7b8e2bfe-5bb2-48b2-9038-2823594f6777 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:56.849130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b8e2bfe-5bb2-48b2-9038-2823594f6777 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:56.849645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b8e2bfe-5bb2-48b2-9038-2823594f6777 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:56.850467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b8e2bfe-5bb2-48b2-9038-2823594f6777 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:56.850929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b8e2bfe-5bb2-48b2-9038-2823594f6777 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:57.056599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7b8e2bfe-5bb2-48b2-9038-2823594f6777 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:57.065334 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7b8e2bfe-5bb2-48b2-9038-2823594f6777 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1680 microversion: 2.1 time: 0.227903 Jan 22 22:08:57.066185 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4694/9092] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:56 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:57.109423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-98f96b3b-8b80-432c-bdf1-7a4ca5cbefc0 req-e1f9bd91-d05e-4722-aba6-49d887e8388e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dabd5c1-4b94-4c10-8332-9a7dfcbd8495", "name": "network-vif-unplugged", "status": "completed", "tag": "e258582b-2939-45c7-9697-deda58402ea1"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:57.110951 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:08:57.110951 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:08:57.118174 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-98f96b3b-8b80-432c-bdf1-7a4ca5cbefc0 req-e1f9bd91-d05e-4722-aba6-49d887e8388e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:57.118759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-98f96b3b-8b80-432c-bdf1-7a4ca5cbefc0 req-e1f9bd91-d05e-4722-aba6-49d887e8388e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:57.130736 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-98f96b3b-8b80-432c-bdf1-7a4ca5cbefc0 req-e1f9bd91-d05e-4722-aba6-49d887e8388e service nova] Creating event network-vif-unplugged:e258582b-2939-45c7-9697-deda58402ea1 for instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 on nch2-master-1 Jan 22 22:08:57.136023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-98f96b3b-8b80-432c-bdf1-7a4ca5cbefc0 req-e1f9bd91-d05e-4722-aba6-49d887e8388e service nova] Instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:08:57.147013 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-98f96b3b-8b80-432c-bdf1-7a4ca5cbefc0 req-e1f9bd91-d05e-4722-aba6-49d887e8388e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041989 Jan 22 22:08:57.147611 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4399/9093] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:08:58.083035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-776cc436-5f0d-49f5-9a1e-ffcb934cd41e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:58.083698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-776cc436-5f0d-49f5-9a1e-ffcb934cd41e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:58.090660 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-776cc436-5f0d-49f5-9a1e-ffcb934cd41e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:58.091149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-776cc436-5f0d-49f5-9a1e-ffcb934cd41e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:58.091968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-776cc436-5f0d-49f5-9a1e-ffcb934cd41e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:58.092432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-776cc436-5f0d-49f5-9a1e-ffcb934cd41e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:58.242747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-776cc436-5f0d-49f5-9a1e-ffcb934cd41e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:58.250287 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-776cc436-5f0d-49f5-9a1e-ffcb934cd41e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1680 microversion: 2.1 time: 0.171100 Jan 22 22:08:58.250865 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4695/9094] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:58 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:08:59.162739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-41022508-e2ad-481c-998f-1275e86d6349 req-6414b357-ddd7-41bb-9849-c00994a4a990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dabd5c1-4b94-4c10-8332-9a7dfcbd8495", "tag": "e258582b-2939-45c7-9697-deda58402ea1"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:08:59.164186 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:08:59.164186 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:08:59.171478 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-41022508-e2ad-481c-998f-1275e86d6349 req-6414b357-ddd7-41bb-9849-c00994a4a990 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:59.171930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-41022508-e2ad-481c-998f-1275e86d6349 req-6414b357-ddd7-41bb-9849-c00994a4a990 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:59.183614 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-41022508-e2ad-481c-998f-1275e86d6349 req-6414b357-ddd7-41bb-9849-c00994a4a990 service nova] Creating event network-changed:e258582b-2939-45c7-9697-deda58402ea1 for instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 on nch2-master-1 Jan 22 22:08:59.189050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-41022508-e2ad-481c-998f-1275e86d6349 req-6414b357-ddd7-41bb-9849-c00994a4a990 service nova] Instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:08:59.200193 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-41022508-e2ad-481c-998f-1275e86d6349 req-6414b357-ddd7-41bb-9849-c00994a4a990 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042179 Jan 22 22:08:59.200792 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4400/9095] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:08:59.267918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7908ba5a-8ffa-4ee2-95d1-a576e25f2b37 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:08:59.268556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7908ba5a-8ffa-4ee2-95d1-a576e25f2b37 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:08:59.275502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7908ba5a-8ffa-4ee2-95d1-a576e25f2b37 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:59.275983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7908ba5a-8ffa-4ee2-95d1-a576e25f2b37 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:59.277390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7908ba5a-8ffa-4ee2-95d1-a576e25f2b37 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:08:59.277973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7908ba5a-8ffa-4ee2-95d1-a576e25f2b37 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:08:59.513399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7908ba5a-8ffa-4ee2-95d1-a576e25f2b37 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:08:59.521170 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7908ba5a-8ffa-4ee2-95d1-a576e25f2b37 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1680 microversion: 2.1 time: 0.257050 Jan 22 22:08:59.521936 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4696/9096] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:08:59 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1680 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:00.540318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-628b064c-955c-43f3-99c2-b26d3f123b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:00.541021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-628b064c-955c-43f3-99c2-b26d3f123b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:00.547603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-628b064c-955c-43f3-99c2-b26d3f123b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:00.548068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-628b064c-955c-43f3-99c2-b26d3f123b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:00.548862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-628b064c-955c-43f3-99c2-b26d3f123b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:00.549312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-628b064c-955c-43f3-99c2-b26d3f123b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:00.700670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-628b064c-955c-43f3-99c2-b26d3f123b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:00.708298 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-628b064c-955c-43f3-99c2-b26d3f123b23 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1680 microversion: 2.1 time: 0.172895 Jan 22 22:09:00.708872 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4401/9097] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:00 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:01.726495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0b8e4bf2-8b90-4146-bc87-f4e8e6ff5d7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:01.727190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0b8e4bf2-8b90-4146-bc87-f4e8e6ff5d7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:01.734402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b8e4bf2-8b90-4146-bc87-f4e8e6ff5d7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:01.734871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b8e4bf2-8b90-4146-bc87-f4e8e6ff5d7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:01.735674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b8e4bf2-8b90-4146-bc87-f4e8e6ff5d7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:01.736138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0b8e4bf2-8b90-4146-bc87-f4e8e6ff5d7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:01.869789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0b8e4bf2-8b90-4146-bc87-f4e8e6ff5d7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:01.879081 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0b8e4bf2-8b90-4146-bc87-f4e8e6ff5d7b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1673 microversion: 2.1 time: 0.156202 Jan 22 22:09:01.879899 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4697/9098] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:01 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:09:01.896308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-12fd4122-2b5c-4aec-8246-4819e2966758 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:01.896879 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-12fd4122-2b5c-4aec-8246-4819e2966758 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:01.903751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12fd4122-2b5c-4aec-8246-4819e2966758 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:01.904475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12fd4122-2b5c-4aec-8246-4819e2966758 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:01.905461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12fd4122-2b5c-4aec-8246-4819e2966758 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:01.905929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12fd4122-2b5c-4aec-8246-4819e2966758 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:02.036588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-12fd4122-2b5c-4aec-8246-4819e2966758 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:02.044135 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-12fd4122-2b5c-4aec-8246-4819e2966758 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1673 microversion: 2.1 time: 0.151767 Jan 22 22:09:02.044713 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4402/9099] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:01 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:02.060627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-99bb6a53-12e9-496f-a594-0094fd36fdd0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:02.061279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-99bb6a53-12e9-496f-a594-0094fd36fdd0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:02.067155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99bb6a53-12e9-496f-a594-0094fd36fdd0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:02.067618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99bb6a53-12e9-496f-a594-0094fd36fdd0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:02.068409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99bb6a53-12e9-496f-a594-0094fd36fdd0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:02.068861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99bb6a53-12e9-496f-a594-0094fd36fdd0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:02.202548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-99bb6a53-12e9-496f-a594-0094fd36fdd0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:02.209993 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-99bb6a53-12e9-496f-a594-0094fd36fdd0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1673 microversion: 2.1 time: 0.153835 Jan 22 22:09:02.210558 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4698/9100] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:02 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:02.226210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-23032c19-13e5-4b7d-8abb-9dc32d754eff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:02.226733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-23032c19-13e5-4b7d-8abb-9dc32d754eff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:02.233474 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23032c19-13e5-4b7d-8abb-9dc32d754eff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:02.233972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23032c19-13e5-4b7d-8abb-9dc32d754eff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:02.234797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23032c19-13e5-4b7d-8abb-9dc32d754eff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:02.235250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23032c19-13e5-4b7d-8abb-9dc32d754eff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:02.260686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-23032c19-13e5-4b7d-8abb-9dc32d754eff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:09:02.567716 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-23032c19-13e5-4b7d-8abb-9dc32d754eff tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 204 len: 0 microversion: 2.1 time: 0.345032 Jan 22 22:09:02.568343 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4403/9101] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:09:02 2022] DELETE /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:09:02.578160 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e4ef3674-e834-4f29-8952-0b63c5f922bf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:02.579403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e4ef3674-e834-4f29-8952-0b63c5f922bf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:02.586675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4ef3674-e834-4f29-8952-0b63c5f922bf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:02.587155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4ef3674-e834-4f29-8952-0b63c5f922bf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:02.588053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4ef3674-e834-4f29-8952-0b63c5f922bf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:02.588526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e4ef3674-e834-4f29-8952-0b63c5f922bf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:02.721482 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e4ef3674-e834-4f29-8952-0b63c5f922bf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:02.728903 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e4ef3674-e834-4f29-8952-0b63c5f922bf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1679 microversion: 2.1 time: 0.156174 Jan 22 22:09:02.729531 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4699/9102] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:02 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:03.749395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d97a5083-bcc6-4879-844e-f585e84030d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:03.750127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d97a5083-bcc6-4879-844e-f585e84030d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:03.756943 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d97a5083-bcc6-4879-844e-f585e84030d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:03.757389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d97a5083-bcc6-4879-844e-f585e84030d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:03.758256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d97a5083-bcc6-4879-844e-f585e84030d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:03.758657 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d97a5083-bcc6-4879-844e-f585e84030d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:03.898780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-16930a66-fbea-47c4-b08d-d4753dab1f1f req-e9e55bce-0f28-44a5-9764-3191eaebfed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dabd5c1-4b94-4c10-8332-9a7dfcbd8495", "name": "network-vif-plugged", "status": "completed", "tag": "e258582b-2939-45c7-9697-deda58402ea1"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:03.900796 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:09:03.900796 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:09:03.905860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d97a5083-bcc6-4879-844e-f585e84030d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:03.910747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-16930a66-fbea-47c4-b08d-d4753dab1f1f req-e9e55bce-0f28-44a5-9764-3191eaebfed9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:03.911216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-16930a66-fbea-47c4-b08d-d4753dab1f1f req-e9e55bce-0f28-44a5-9764-3191eaebfed9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:03.913739 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d97a5083-bcc6-4879-844e-f585e84030d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1679 microversion: 2.1 time: 0.169073 Jan 22 22:09:03.916349 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4404/9103] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:03 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:03.923745 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-16930a66-fbea-47c4-b08d-d4753dab1f1f req-e9e55bce-0f28-44a5-9764-3191eaebfed9 service nova] Creating event network-vif-plugged:e258582b-2939-45c7-9697-deda58402ea1 for instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 on nch2-master-1 Jan 22 22:09:03.928768 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-16930a66-fbea-47c4-b08d-d4753dab1f1f req-e9e55bce-0f28-44a5-9764-3191eaebfed9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034834 Jan 22 22:09:03.929308 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4700/9104] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:09:04.871243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-29a801aa-c57b-4a9a-9d54-f32ad9ae5af7 req-5ac8119e-fb42-4e03-8083-aba0c154a206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dabd5c1-4b94-4c10-8332-9a7dfcbd8495", "name": "network-vif-deleted", "tag": "e258582b-2939-45c7-9697-deda58402ea1"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:04.874190 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:09:04.874190 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:09:04.882217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-29a801aa-c57b-4a9a-9d54-f32ad9ae5af7 req-5ac8119e-fb42-4e03-8083-aba0c154a206 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:04.882677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-29a801aa-c57b-4a9a-9d54-f32ad9ae5af7 req-5ac8119e-fb42-4e03-8083-aba0c154a206 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:04.895729 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-29a801aa-c57b-4a9a-9d54-f32ad9ae5af7 req-5ac8119e-fb42-4e03-8083-aba0c154a206 service nova] Creating event network-vif-deleted:e258582b-2939-45c7-9697-deda58402ea1 for instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 on nch2-master-1 Jan 22 22:09:04.900730 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-29a801aa-c57b-4a9a-9d54-f32ad9ae5af7 req-5ac8119e-fb42-4e03-8083-aba0c154a206 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033518 Jan 22 22:09:04.901347 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4405/9105] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:09:04.933513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9063577b-209b-47be-bd3c-8e3f3beb8698 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:04.935064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9063577b-209b-47be-bd3c-8e3f3beb8698 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:04.941823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9063577b-209b-47be-bd3c-8e3f3beb8698 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:04.944509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9063577b-209b-47be-bd3c-8e3f3beb8698 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:04.944509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9063577b-209b-47be-bd3c-8e3f3beb8698 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:04.944509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9063577b-209b-47be-bd3c-8e3f3beb8698 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:05.012860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9063577b-209b-47be-bd3c-8e3f3beb8698 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:05.033020 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9063577b-209b-47be-bd3c-8e3f3beb8698 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 200 len: 1612 microversion: 2.1 time: 0.104402 Jan 22 22:09:05.036712 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4701/9106] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:04 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 1612 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:06.051678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8888e235-7abc-4fbd-9787-23eb2d7e010b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:06.052379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8888e235-7abc-4fbd-9787-23eb2d7e010b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:06.058610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8888e235-7abc-4fbd-9787-23eb2d7e010b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:06.059199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8888e235-7abc-4fbd-9787-23eb2d7e010b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:06.060056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8888e235-7abc-4fbd-9787-23eb2d7e010b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:06.060503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8888e235-7abc-4fbd-9787-23eb2d7e010b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:06.078908 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-8888e235-7abc-4fbd-9787-23eb2d7e010b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 could not be found. Jan 22 22:09:06.079506 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8888e235-7abc-4fbd-9787-23eb2d7e010b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:09:06.080347 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8888e235-7abc-4fbd-9787-23eb2d7e010b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 404 len: 111 microversion: 2.1 time: 0.033678 Jan 22 22:09:06.080899 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4406/9107] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:06 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 22:09:06.154358 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-21c943d2-4453-4f37-8274-d750b7ff1d1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:06.154976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-21c943d2-4453-4f37-8274-d750b7ff1d1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:06.161711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21c943d2-4453-4f37-8274-d750b7ff1d1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:06.162182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21c943d2-4453-4f37-8274-d750b7ff1d1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:06.162983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21c943d2-4453-4f37-8274-d750b7ff1d1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:06.163437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21c943d2-4453-4f37-8274-d750b7ff1d1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:06.176527 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-21c943d2-4453-4f37-8274-d750b7ff1d1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 could not be found. Jan 22 22:09:06.177153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-21c943d2-4453-4f37-8274-d750b7ff1d1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:09:06.178015 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-21c943d2-4453-4f37-8274-d750b7ff1d1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 404 len: 111 microversion: 2.1 time: 0.028150 Jan 22 22:09:06.178540 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4702/9108] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:06 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:09:06.224791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1414409121", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "fb9f5138-713d-480c-9e87-dbd89c7312b8"}], "security_groups": [{"name": "tempest-securitygroup--452255190"}], "key_name": "tempest-keypair-908140357", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:06.334944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] validate_networks() for [('fb9f5138-713d-480c-9e87-dbd89c7312b8', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:09:07.017263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:09:07.017740 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:09:07.018226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:09:07.018651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:09:07.019096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:09:07.027894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:07.028500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:07.029367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:07.029845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:07.046356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for project af530edb3b084c18bf5595f46cffdf35. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:09:07.052086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for user d51f7a75cf6144f0b3bf7e63fcea6827 and project af530edb3b084c18bf5595f46cffdf35. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:09:07.064769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:09:07.067120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:09:07.175188 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7f569a02-117f-42f3-92f9-09e37573ccf7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.954052 Jan 22 22:09:07.175766 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4407/9109] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:09:06 2022] POST /compute/v2.1/servers => generated 407 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 22:09:07.186098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8bb020b3-4f06-454e-b53f-ab3d040ea250 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:07.186710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8bb020b3-4f06-454e-b53f-ab3d040ea250 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:07.238863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8bb020b3-4f06-454e-b53f-ab3d040ea250 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:07.246816 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8bb020b3-4f06-454e-b53f-ab3d040ea250 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1242 microversion: 2.1 time: 0.064366 Jan 22 22:09:07.247765 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4703/9110] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:07 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:08.265018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-79d561ea-c160-4141-988d-3709d4e8db83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:08.265613 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-79d561ea-c160-4141-988d-3709d4e8db83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:08.272637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79d561ea-c160-4141-988d-3709d4e8db83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:08.273101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79d561ea-c160-4141-988d-3709d4e8db83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:08.273934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79d561ea-c160-4141-988d-3709d4e8db83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:08.274384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79d561ea-c160-4141-988d-3709d4e8db83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:08.334095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-79d561ea-c160-4141-988d-3709d4e8db83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:08.342092 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-79d561ea-c160-4141-988d-3709d4e8db83 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1238 microversion: 2.1 time: 0.081988 Jan 22 22:09:08.342668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4408/9111] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:08 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:09.360587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0e9e3f4a-a105-47aa-90bc-4afdcda9096a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:09.361218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0e9e3f4a-a105-47aa-90bc-4afdcda9096a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:09.368159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e9e3f4a-a105-47aa-90bc-4afdcda9096a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:09.368638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e9e3f4a-a105-47aa-90bc-4afdcda9096a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:09.369457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e9e3f4a-a105-47aa-90bc-4afdcda9096a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:09.369951 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e9e3f4a-a105-47aa-90bc-4afdcda9096a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:09.439389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0e9e3f4a-a105-47aa-90bc-4afdcda9096a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:09.447001 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0e9e3f4a-a105-47aa-90bc-4afdcda9096a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1300 microversion: 2.1 time: 0.091091 Jan 22 22:09:09.447583 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4704/9112] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:09 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:09:10.464597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6454229e-84b8-408b-a184-5f05dea5626a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:10.466000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6454229e-84b8-408b-a184-5f05dea5626a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:10.473136 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6454229e-84b8-408b-a184-5f05dea5626a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:10.473722 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6454229e-84b8-408b-a184-5f05dea5626a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:10.474517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6454229e-84b8-408b-a184-5f05dea5626a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:10.474965 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6454229e-84b8-408b-a184-5f05dea5626a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:10.597636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-cd6fa7cf-a681-4b70-8f9d-8db16244c1fd req-b21d9121-7b19-4fe3-a874-146776cc8677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec51a754-f593-4092-9576-bcc7ae40474c", "tag": "90a83623-9a26-44c1-88ee-1101a43e6d5f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:10.600301 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:09:10.600301 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:09:10.610949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-cd6fa7cf-a681-4b70-8f9d-8db16244c1fd req-b21d9121-7b19-4fe3-a874-146776cc8677 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:10.611416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-cd6fa7cf-a681-4b70-8f9d-8db16244c1fd req-b21d9121-7b19-4fe3-a874-146776cc8677 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:10.623715 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-cd6fa7cf-a681-4b70-8f9d-8db16244c1fd req-b21d9121-7b19-4fe3-a874-146776cc8677 service nova] Creating event network-changed:90a83623-9a26-44c1-88ee-1101a43e6d5f for instance ec51a754-f593-4092-9576-bcc7ae40474c on nch1-master-1 Jan 22 22:09:10.628679 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-cd6fa7cf-a681-4b70-8f9d-8db16244c1fd req-b21d9121-7b19-4fe3-a874-146776cc8677 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035717 Jan 22 22:09:10.629298 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4705/9113] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:09:10.736757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6454229e-84b8-408b-a184-5f05dea5626a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:10.744605 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6454229e-84b8-408b-a184-5f05dea5626a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1367 microversion: 2.1 time: 0.283795 Jan 22 22:09:10.745194 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4409/9114] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:10 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:11.762945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0535c2fc-f669-4396-84b9-ca104f7618ba tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:11.763667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0535c2fc-f669-4396-84b9-ca104f7618ba tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:11.769981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0535c2fc-f669-4396-84b9-ca104f7618ba tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:11.770461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0535c2fc-f669-4396-84b9-ca104f7618ba tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:11.771271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0535c2fc-f669-4396-84b9-ca104f7618ba tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:11.771737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0535c2fc-f669-4396-84b9-ca104f7618ba tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:11.904497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0535c2fc-f669-4396-84b9-ca104f7618ba tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:11.911887 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0535c2fc-f669-4396-84b9-ca104f7618ba tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1367 microversion: 2.1 time: 0.154157 Jan 22 22:09:11.912489 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4706/9115] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:11 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:12.929712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3376cfa3-092e-4448-bf46-74bfa86967ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:12.930307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3376cfa3-092e-4448-bf46-74bfa86967ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:12.938671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3376cfa3-092e-4448-bf46-74bfa86967ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:12.939132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3376cfa3-092e-4448-bf46-74bfa86967ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:12.939944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3376cfa3-092e-4448-bf46-74bfa86967ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:12.940384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3376cfa3-092e-4448-bf46-74bfa86967ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:13.079537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3376cfa3-092e-4448-bf46-74bfa86967ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:13.086952 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3376cfa3-092e-4448-bf46-74bfa86967ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1367 microversion: 2.1 time: 0.161046 Jan 22 22:09:13.087526 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4410/9116] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:12 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:14.103925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d3c94165-fc16-4cdf-9046-1abee9920d87 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:14.104546 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d3c94165-fc16-4cdf-9046-1abee9920d87 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:14.112171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3c94165-fc16-4cdf-9046-1abee9920d87 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:14.112633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3c94165-fc16-4cdf-9046-1abee9920d87 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:14.113428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3c94165-fc16-4cdf-9046-1abee9920d87 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:14.113907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d3c94165-fc16-4cdf-9046-1abee9920d87 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:14.247228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d3c94165-fc16-4cdf-9046-1abee9920d87 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:14.254645 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d3c94165-fc16-4cdf-9046-1abee9920d87 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1367 microversion: 2.1 time: 0.154396 Jan 22 22:09:14.255230 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4707/9117] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:14 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:15.271807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-31d4b22f-72b1-4fb6-b73b-4d70aafab88c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:15.272452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-31d4b22f-72b1-4fb6-b73b-4d70aafab88c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:15.280072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31d4b22f-72b1-4fb6-b73b-4d70aafab88c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:15.280538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31d4b22f-72b1-4fb6-b73b-4d70aafab88c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:15.281334 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31d4b22f-72b1-4fb6-b73b-4d70aafab88c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:15.281818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-31d4b22f-72b1-4fb6-b73b-4d70aafab88c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:15.417460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-31d4b22f-72b1-4fb6-b73b-4d70aafab88c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:15.426902 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-31d4b22f-72b1-4fb6-b73b-4d70aafab88c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1367 microversion: 2.1 time: 0.158792 Jan 22 22:09:15.427496 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4411/9118] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:15 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:16.450373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19ad8d3a-bd58-43c9-b421-761badb49a9a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:16.451035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-19ad8d3a-bd58-43c9-b421-761badb49a9a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:16.457967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19ad8d3a-bd58-43c9-b421-761badb49a9a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:16.458462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19ad8d3a-bd58-43c9-b421-761badb49a9a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:16.459263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19ad8d3a-bd58-43c9-b421-761badb49a9a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:16.459717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19ad8d3a-bd58-43c9-b421-761badb49a9a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:16.591416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-19ad8d3a-bd58-43c9-b421-761badb49a9a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:16.598856 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19ad8d3a-bd58-43c9-b421-761badb49a9a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1367 microversion: 2.1 time: 0.153012 Jan 22 22:09:16.599811 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4708/9119] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:16 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:17.616088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8842c38a-84e9-44cf-8539-417e44ee2779 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:17.616807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8842c38a-84e9-44cf-8539-417e44ee2779 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:17.623780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8842c38a-84e9-44cf-8539-417e44ee2779 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:17.624239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8842c38a-84e9-44cf-8539-417e44ee2779 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:17.625045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8842c38a-84e9-44cf-8539-417e44ee2779 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:17.625485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8842c38a-84e9-44cf-8539-417e44ee2779 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:17.762302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8842c38a-84e9-44cf-8539-417e44ee2779 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:17.769660 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8842c38a-84e9-44cf-8539-417e44ee2779 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1367 microversion: 2.1 time: 0.157331 Jan 22 22:09:17.770236 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4412/9120] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:17 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:18.375711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-1b086865-4b79-4b7d-af76-91f37d5ec76f req-e3c3eefb-f18c-4322-abda-d1ffa9c7058c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec51a754-f593-4092-9576-bcc7ae40474c", "name": "network-vif-plugged", "status": "completed", "tag": "90a83623-9a26-44c1-88ee-1101a43e6d5f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:18.377541 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:09:18.377541 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:09:18.385636 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1b086865-4b79-4b7d-af76-91f37d5ec76f req-e3c3eefb-f18c-4322-abda-d1ffa9c7058c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:18.386198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1b086865-4b79-4b7d-af76-91f37d5ec76f req-e3c3eefb-f18c-4322-abda-d1ffa9c7058c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:18.397923 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-1b086865-4b79-4b7d-af76-91f37d5ec76f req-e3c3eefb-f18c-4322-abda-d1ffa9c7058c service nova] Creating event network-vif-plugged:90a83623-9a26-44c1-88ee-1101a43e6d5f for instance ec51a754-f593-4092-9576-bcc7ae40474c on nch1-master-1 Jan 22 22:09:18.403538 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-1b086865-4b79-4b7d-af76-91f37d5ec76f req-e3c3eefb-f18c-4322-abda-d1ffa9c7058c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031669 Jan 22 22:09:18.404236 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4709/9121] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:09:18.786779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-22adaadb-2cd0-44c9-987e-4676e00ade14 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:18.787414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-22adaadb-2cd0-44c9-987e-4676e00ade14 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:18.795079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22adaadb-2cd0-44c9-987e-4676e00ade14 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:18.804456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22adaadb-2cd0-44c9-987e-4676e00ade14 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:18.804456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22adaadb-2cd0-44c9-987e-4676e00ade14 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:18.804456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22adaadb-2cd0-44c9-987e-4676e00ade14 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:18.930417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-22adaadb-2cd0-44c9-987e-4676e00ade14 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:18.938090 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-22adaadb-2cd0-44c9-987e-4676e00ade14 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1367 microversion: 2.1 time: 0.155203 Jan 22 22:09:18.938659 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4413/9122] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:18 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:19.958143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-baf4c929-d0c7-4d91-ba24-c1d64003885a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:19.958935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-baf4c929-d0c7-4d91-ba24-c1d64003885a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:19.966443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-baf4c929-d0c7-4d91-ba24-c1d64003885a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:19.966929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-baf4c929-d0c7-4d91-ba24-c1d64003885a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:19.967741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-baf4c929-d0c7-4d91-ba24-c1d64003885a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:19.968202 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-baf4c929-d0c7-4d91-ba24-c1d64003885a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:20.105854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-baf4c929-d0c7-4d91-ba24-c1d64003885a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:09:20.114051 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-baf4c929-d0c7-4d91-ba24-c1d64003885a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1554 microversion: 2.1 time: 0.161961 Jan 22 22:09:20.114635 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4710/9123] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:09:19 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:20.131267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6724cdfc-aad7-469f-afa8-7032b00d2f8e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:09:20.131773 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6724cdfc-aad7-469f-afa8-7032b00d2f8e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:20.139441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6724cdfc-aad7-469f-afa8-7032b00d2f8e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:20.139908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6724cdfc-aad7-469f-afa8-7032b00d2f8e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:20.140709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6724cdfc-aad7-469f-afa8-7032b00d2f8e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:20.141167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6724cdfc-aad7-469f-afa8-7032b00d2f8e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:20.223648 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6724cdfc-aad7-469f-afa8-7032b00d2f8e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096004 Jan 22 22:09:20.224257 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4414/9124] 10.222.0.100 () {58 vars in 1279 bytes} [Sat Jan 22 22:09:20 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:09:21.212726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-40fb4f70-0081-4844-a54a-0eaf24927ee2 req-79d8de44-a2fb-4af4-a57b-347b2c6422fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec51a754-f593-4092-9576-bcc7ae40474c", "tag": "90a83623-9a26-44c1-88ee-1101a43e6d5f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:21.214331 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:09:21.214331 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:09:21.216108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e884a333-9e5f-409e-9a73-e891d0915328 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:21.217097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e884a333-9e5f-409e-9a73-e891d0915328 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:21.225890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e884a333-9e5f-409e-9a73-e891d0915328 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:21.226803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e884a333-9e5f-409e-9a73-e891d0915328 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:21.227411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-40fb4f70-0081-4844-a54a-0eaf24927ee2 req-79d8de44-a2fb-4af4-a57b-347b2c6422fd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:21.227774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e884a333-9e5f-409e-9a73-e891d0915328 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:21.227900 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-40fb4f70-0081-4844-a54a-0eaf24927ee2 req-79d8de44-a2fb-4af4-a57b-347b2c6422fd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:21.228247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e884a333-9e5f-409e-9a73-e891d0915328 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:21.241925 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-40fb4f70-0081-4844-a54a-0eaf24927ee2 req-79d8de44-a2fb-4af4-a57b-347b2c6422fd service nova] Creating event network-changed:90a83623-9a26-44c1-88ee-1101a43e6d5f for instance ec51a754-f593-4092-9576-bcc7ae40474c on nch1-master-1 Jan 22 22:09:21.247982 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-40fb4f70-0081-4844-a54a-0eaf24927ee2 req-79d8de44-a2fb-4af4-a57b-347b2c6422fd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039457 Jan 22 22:09:21.248594 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4415/9125] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:09:21.270769 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e884a333-9e5f-409e-9a73-e891d0915328 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 14 microversion: 2.1 time: 0.066741 Jan 22 22:09:21.271661 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4711/9126] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:21 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:09:22.283819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d91dad9b-5a98-4ffd-8770-3f06fb0e6980 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:22.284862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d91dad9b-5a98-4ffd-8770-3f06fb0e6980 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:22.291437 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d91dad9b-5a98-4ffd-8770-3f06fb0e6980 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:22.291920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d91dad9b-5a98-4ffd-8770-3f06fb0e6980 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:22.292730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d91dad9b-5a98-4ffd-8770-3f06fb0e6980 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:22.293948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d91dad9b-5a98-4ffd-8770-3f06fb0e6980 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:22.334124 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d91dad9b-5a98-4ffd-8770-3f06fb0e6980 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 14 microversion: 2.1 time: 0.054996 Jan 22 22:09:22.337406 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4416/9127] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:22 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:09:23.345814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-793f6b50-e56c-4e78-8d22-02a878e211cc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:23.346839 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-793f6b50-e56c-4e78-8d22-02a878e211cc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:23.354237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-793f6b50-e56c-4e78-8d22-02a878e211cc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:23.354723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-793f6b50-e56c-4e78-8d22-02a878e211cc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:23.356108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-793f6b50-e56c-4e78-8d22-02a878e211cc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:23.357015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-793f6b50-e56c-4e78-8d22-02a878e211cc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:23.398716 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-793f6b50-e56c-4e78-8d22-02a878e211cc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 14 microversion: 2.1 time: 0.056859 Jan 22 22:09:23.402146 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4712/9128] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:23 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:09:24.410161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff659f03-3dc5-4413-b1aa-1ff78cd6642b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:24.411199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ff659f03-3dc5-4413-b1aa-1ff78cd6642b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:24.419175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff659f03-3dc5-4413-b1aa-1ff78cd6642b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:24.422021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff659f03-3dc5-4413-b1aa-1ff78cd6642b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:24.422021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff659f03-3dc5-4413-b1aa-1ff78cd6642b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:24.422021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ff659f03-3dc5-4413-b1aa-1ff78cd6642b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:24.461900 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff659f03-3dc5-4413-b1aa-1ff78cd6642b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 14 microversion: 2.1 time: 0.055713 Jan 22 22:09:24.462519 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4417/9129] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:24 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:09:25.473068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6889ee9-e3ee-49f4-892d-499b8866f638 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:25.474194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b6889ee9-e3ee-49f4-892d-499b8866f638 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:25.482687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6889ee9-e3ee-49f4-892d-499b8866f638 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:25.483155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6889ee9-e3ee-49f4-892d-499b8866f638 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:25.483957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6889ee9-e3ee-49f4-892d-499b8866f638 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:25.484412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6889ee9-e3ee-49f4-892d-499b8866f638 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:25.523664 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b6889ee9-e3ee-49f4-892d-499b8866f638 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 14 microversion: 2.1 time: 0.054593 Jan 22 22:09:25.524305 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4713/9130] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:25 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:09:26.535945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96b4991b-6cc2-4264-a656-a13484216112 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:26.537024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96b4991b-6cc2-4264-a656-a13484216112 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:26.545410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96b4991b-6cc2-4264-a656-a13484216112 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:26.545916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96b4991b-6cc2-4264-a656-a13484216112 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:26.546751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96b4991b-6cc2-4264-a656-a13484216112 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:26.547201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96b4991b-6cc2-4264-a656-a13484216112 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:26.588116 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96b4991b-6cc2-4264-a656-a13484216112 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 14 microversion: 2.1 time: 0.056249 Jan 22 22:09:26.588757 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4418/9131] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:26 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:09:27.600514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-462ea555-3ebf-4b01-95db-eac73f481ad1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:27.601559 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-462ea555-3ebf-4b01-95db-eac73f481ad1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:27.610242 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-462ea555-3ebf-4b01-95db-eac73f481ad1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:27.610720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-462ea555-3ebf-4b01-95db-eac73f481ad1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:27.611592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-462ea555-3ebf-4b01-95db-eac73f481ad1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:27.612054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-462ea555-3ebf-4b01-95db-eac73f481ad1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:27.650061 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-462ea555-3ebf-4b01-95db-eac73f481ad1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 14 microversion: 2.1 time: 0.053693 Jan 22 22:09:27.650915 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4714/9132] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:27 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 22 22:09:28.662436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d9b98616-80d0-4831-aaa9-da815eb21a96 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:28.663374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d9b98616-80d0-4831-aaa9-da815eb21a96 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:28.671412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9b98616-80d0-4831-aaa9-da815eb21a96 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:28.671881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9b98616-80d0-4831-aaa9-da815eb21a96 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:28.672681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9b98616-80d0-4831-aaa9-da815eb21a96 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:28.673133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9b98616-80d0-4831-aaa9-da815eb21a96 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:28.714740 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d9b98616-80d0-4831-aaa9-da815eb21a96 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 14 microversion: 2.1 time: 0.056514 Jan 22 22:09:28.715361 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4419/9133] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:28 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:09:29.726387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-617645a9-696f-4a43-afe2-e2035ee154ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:29.727320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-617645a9-696f-4a43-afe2-e2035ee154ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:29.735464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-617645a9-696f-4a43-afe2-e2035ee154ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:29.735948 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-617645a9-696f-4a43-afe2-e2035ee154ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:29.736756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-617645a9-696f-4a43-afe2-e2035ee154ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:29.737218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-617645a9-696f-4a43-afe2-e2035ee154ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:29.775905 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-617645a9-696f-4a43-afe2-e2035ee154ca tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 14 microversion: 2.1 time: 0.053546 Jan 22 22:09:29.776529 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4715/9134] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:29 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:09:30.787465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cdb78a25-79e3-4e57-a4b6-c7fe26aa4d6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:30.788500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cdb78a25-79e3-4e57-a4b6-c7fe26aa4d6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:30.796682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdb78a25-79e3-4e57-a4b6-c7fe26aa4d6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:30.797145 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdb78a25-79e3-4e57-a4b6-c7fe26aa4d6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:30.797980 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdb78a25-79e3-4e57-a4b6-c7fe26aa4d6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:30.798432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cdb78a25-79e3-4e57-a4b6-c7fe26aa4d6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:30.849870 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cdb78a25-79e3-4e57-a4b6-c7fe26aa4d6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 14 microversion: 2.1 time: 0.066306 Jan 22 22:09:30.852394 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4420/9135] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:30 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:09:31.862339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0bfa2b07-e0b8-4d67-bbda-4c769974e45e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:31.863416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0bfa2b07-e0b8-4d67-bbda-4c769974e45e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:31.870868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bfa2b07-e0b8-4d67-bbda-4c769974e45e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:31.871347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bfa2b07-e0b8-4d67-bbda-4c769974e45e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:31.872398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bfa2b07-e0b8-4d67-bbda-4c769974e45e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:31.872918 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0bfa2b07-e0b8-4d67-bbda-4c769974e45e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:31.911363 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0bfa2b07-e0b8-4d67-bbda-4c769974e45e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 14 microversion: 2.1 time: 0.053058 Jan 22 22:09:31.912011 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4716/9136] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:31 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:09:32.922942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e9849007-9fba-4ae1-bd38-aac263f49ee1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:32.923949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e9849007-9fba-4ae1-bd38-aac263f49ee1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:32.931353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9849007-9fba-4ae1-bd38-aac263f49ee1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:32.931807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9849007-9fba-4ae1-bd38-aac263f49ee1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:32.932587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9849007-9fba-4ae1-bd38-aac263f49ee1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:32.933027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e9849007-9fba-4ae1-bd38-aac263f49ee1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:32.984406 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e9849007-9fba-4ae1-bd38-aac263f49ee1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 8207 microversion: 2.1 time: 0.065493 Jan 22 22:09:32.985058 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4421/9137] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:32 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 8207 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:09:33.995585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2506e5dd-e4ea-47c6-963b-44e4bea50dc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:33.996611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2506e5dd-e4ea-47c6-963b-44e4bea50dc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:34.004586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2506e5dd-e4ea-47c6-963b-44e4bea50dc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:34.005064 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2506e5dd-e4ea-47c6-963b-44e4bea50dc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:34.005902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2506e5dd-e4ea-47c6-963b-44e4bea50dc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:34.006368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2506e5dd-e4ea-47c6-963b-44e4bea50dc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:34.053548 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2506e5dd-e4ea-47c6-963b-44e4bea50dc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 16398 microversion: 2.1 time: 0.061945 Jan 22 22:09:34.054412 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4717/9138] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:33 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 16398 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:35.065381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-73eda104-6565-4554-b411-58339c29ac6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:35.066445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-73eda104-6565-4554-b411-58339c29ac6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:35.073898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73eda104-6565-4554-b411-58339c29ac6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:35.074323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73eda104-6565-4554-b411-58339c29ac6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:35.075132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73eda104-6565-4554-b411-58339c29ac6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:35.075569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-73eda104-6565-4554-b411-58339c29ac6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:35.113899 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-73eda104-6565-4554-b411-58339c29ac6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 16398 microversion: 2.1 time: 0.052515 Jan 22 22:09:35.114530 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4422/9139] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:35 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 16398 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:09:36.126731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2a607da8-e577-4267-8362-2a32d1746935 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:36.127779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2a607da8-e577-4267-8362-2a32d1746935 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:36.135134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a607da8-e577-4267-8362-2a32d1746935 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:36.135598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a607da8-e577-4267-8362-2a32d1746935 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:36.136399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a607da8-e577-4267-8362-2a32d1746935 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:36.136856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a607da8-e577-4267-8362-2a32d1746935 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:36.177659 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2a607da8-e577-4267-8362-2a32d1746935 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 16398 microversion: 2.1 time: 0.055734 Jan 22 22:09:36.178548 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4718/9140] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:36 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 16398 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:37.189729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c996a613-d248-4a52-9083-80cb590cf7a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:37.190733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c996a613-d248-4a52-9083-80cb590cf7a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:37.198149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c996a613-d248-4a52-9083-80cb590cf7a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:37.198604 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c996a613-d248-4a52-9083-80cb590cf7a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:37.199385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c996a613-d248-4a52-9083-80cb590cf7a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:37.199870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c996a613-d248-4a52-9083-80cb590cf7a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:37.240972 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c996a613-d248-4a52-9083-80cb590cf7a7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 16398 microversion: 2.1 time: 0.055372 Jan 22 22:09:37.241632 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4423/9141] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:37 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 16398 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:38.253331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1b84dc69-5da7-4662-a87c-93b960f67210 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:38.254366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1b84dc69-5da7-4662-a87c-93b960f67210 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:38.261594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b84dc69-5da7-4662-a87c-93b960f67210 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:38.262059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b84dc69-5da7-4662-a87c-93b960f67210 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:38.263418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b84dc69-5da7-4662-a87c-93b960f67210 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:38.263916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b84dc69-5da7-4662-a87c-93b960f67210 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:38.314579 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1b84dc69-5da7-4662-a87c-93b960f67210 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 16398 microversion: 2.1 time: 0.065081 Jan 22 22:09:38.315355 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4719/9142] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:38 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 16398 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:39.326643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f92d44d2-2bdc-49ff-9a36-ab11732c970c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:39.327671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f92d44d2-2bdc-49ff-9a36-ab11732c970c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:39.335129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f92d44d2-2bdc-49ff-9a36-ab11732c970c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:39.335593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f92d44d2-2bdc-49ff-9a36-ab11732c970c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:39.336399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f92d44d2-2bdc-49ff-9a36-ab11732c970c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:39.336848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f92d44d2-2bdc-49ff-9a36-ab11732c970c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:39.390791 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f92d44d2-2bdc-49ff-9a36-ab11732c970c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 24570 microversion: 2.1 time: 0.068727 Jan 22 22:09:39.391717 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4424/9143] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:39 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 24570 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:09:40.410534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b88d2554-6af7-4c62-9337-cb54dcb7be41 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:40.413215 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b88d2554-6af7-4c62-9337-cb54dcb7be41 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:40.419594 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b88d2554-6af7-4c62-9337-cb54dcb7be41 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:40.420079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b88d2554-6af7-4c62-9337-cb54dcb7be41 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:40.420896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b88d2554-6af7-4c62-9337-cb54dcb7be41 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:40.421362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b88d2554-6af7-4c62-9337-cb54dcb7be41 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:40.463412 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b88d2554-6af7-4c62-9337-cb54dcb7be41 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 24570 microversion: 2.1 time: 0.056891 Jan 22 22:09:40.464074 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4720/9144] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:40 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 24570 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:09:41.475124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0fd03d64-3537-4ba8-87bd-1c7de7ff4d6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:41.476167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0fd03d64-3537-4ba8-87bd-1c7de7ff4d6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:41.484351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fd03d64-3537-4ba8-87bd-1c7de7ff4d6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:41.484815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fd03d64-3537-4ba8-87bd-1c7de7ff4d6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:41.485688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fd03d64-3537-4ba8-87bd-1c7de7ff4d6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:41.486141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0fd03d64-3537-4ba8-87bd-1c7de7ff4d6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:41.525542 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0fd03d64-3537-4ba8-87bd-1c7de7ff4d6f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 24570 microversion: 2.1 time: 0.054615 Jan 22 22:09:41.526184 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4425/9145] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:41 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 24570 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:42.538536 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-58d4c18a-e268-41cf-b8f7-65a96e920a25 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:42.539539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-58d4c18a-e268-41cf-b8f7-65a96e920a25 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:42.547308 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58d4c18a-e268-41cf-b8f7-65a96e920a25 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:42.547775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58d4c18a-e268-41cf-b8f7-65a96e920a25 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:42.548575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58d4c18a-e268-41cf-b8f7-65a96e920a25 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:42.549029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-58d4c18a-e268-41cf-b8f7-65a96e920a25 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:42.588923 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-58d4c18a-e268-41cf-b8f7-65a96e920a25 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 24570 microversion: 2.1 time: 0.054479 Jan 22 22:09:42.589571 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4721/9146] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:42 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 24570 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:43.601477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-39f49e4e-2ca6-4fed-85b1-218ef17ced8f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:43.602540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-39f49e4e-2ca6-4fed-85b1-218ef17ced8f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:43.611263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f49e4e-2ca6-4fed-85b1-218ef17ced8f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:43.611714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f49e4e-2ca6-4fed-85b1-218ef17ced8f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:43.612505 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f49e4e-2ca6-4fed-85b1-218ef17ced8f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:43.612948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f49e4e-2ca6-4fed-85b1-218ef17ced8f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:43.658650 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-39f49e4e-2ca6-4fed-85b1-218ef17ced8f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 24570 microversion: 2.1 time: 0.061303 Jan 22 22:09:43.659458 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4426/9147] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:43 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 24570 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:44.672550 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c59d7d11-3aa6-4a07-aec6-1a5177961112 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:44.673473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c59d7d11-3aa6-4a07-aec6-1a5177961112 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:44.680781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c59d7d11-3aa6-4a07-aec6-1a5177961112 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:44.681245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c59d7d11-3aa6-4a07-aec6-1a5177961112 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:44.682076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c59d7d11-3aa6-4a07-aec6-1a5177961112 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:44.682532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c59d7d11-3aa6-4a07-aec6-1a5177961112 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:44.720500 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c59d7d11-3aa6-4a07-aec6-1a5177961112 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 24570 microversion: 2.1 time: 0.052937 Jan 22 22:09:44.721119 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4722/9148] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:44 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 24570 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:45.732310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc9df779-3ebd-4876-bbd2-ad140506ab0c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:45.733241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bc9df779-3ebd-4876-bbd2-ad140506ab0c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:45.741123 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc9df779-3ebd-4876-bbd2-ad140506ab0c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:45.741658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc9df779-3ebd-4876-bbd2-ad140506ab0c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:45.742468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc9df779-3ebd-4876-bbd2-ad140506ab0c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:45.742920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc9df779-3ebd-4876-bbd2-ad140506ab0c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:45.784952 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bc9df779-3ebd-4876-bbd2-ad140506ab0c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 24570 microversion: 2.1 time: 0.056920 Jan 22 22:09:45.785663 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4427/9149] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:45 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 24570 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:46.797191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e74f660b-3966-428b-8563-6650bad41832 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:46.798241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e74f660b-3966-428b-8563-6650bad41832 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:46.805646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e74f660b-3966-428b-8563-6650bad41832 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:46.806124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e74f660b-3966-428b-8563-6650bad41832 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:46.806935 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e74f660b-3966-428b-8563-6650bad41832 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:46.807401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e74f660b-3966-428b-8563-6650bad41832 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:46.849530 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e74f660b-3966-428b-8563-6650bad41832 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 24570 microversion: 2.1 time: 0.056565 Jan 22 22:09:46.850423 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4723/9150] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:46 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 24570 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:47.862208 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e759a593-4992-46e1-a33f-cc615ae7ff96 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:47.863254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e759a593-4992-46e1-a33f-cc615ae7ff96 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:47.870632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e759a593-4992-46e1-a33f-cc615ae7ff96 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:47.871098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e759a593-4992-46e1-a33f-cc615ae7ff96 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:47.871891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e759a593-4992-46e1-a33f-cc615ae7ff96 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:47.872942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e759a593-4992-46e1-a33f-cc615ae7ff96 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:47.913368 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e759a593-4992-46e1-a33f-cc615ae7ff96 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 24570 microversion: 2.1 time: 0.055160 Jan 22 22:09:47.914143 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4428/9151] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:47 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 24570 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:48.925990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0319ab2a-22c6-4247-a8e9-1791e6afe230 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:48.927045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0319ab2a-22c6-4247-a8e9-1791e6afe230 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:48.935180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0319ab2a-22c6-4247-a8e9-1791e6afe230 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:48.935717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0319ab2a-22c6-4247-a8e9-1791e6afe230 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:48.936548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0319ab2a-22c6-4247-a8e9-1791e6afe230 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:48.937053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0319ab2a-22c6-4247-a8e9-1791e6afe230 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:48.980622 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0319ab2a-22c6-4247-a8e9-1791e6afe230 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 24570 microversion: 2.1 time: 0.058672 Jan 22 22:09:48.982474 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4724/9152] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:48 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 24570 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:49.994495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dd73995f-60e5-4467-9309-0b19b8618f86 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:49.995426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dd73995f-60e5-4467-9309-0b19b8618f86 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:50.003154 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd73995f-60e5-4467-9309-0b19b8618f86 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:50.003615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd73995f-60e5-4467-9309-0b19b8618f86 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:50.004401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd73995f-60e5-4467-9309-0b19b8618f86 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:50.004847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd73995f-60e5-4467-9309-0b19b8618f86 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:50.045328 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dd73995f-60e5-4467-9309-0b19b8618f86 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 24570 microversion: 2.1 time: 0.053970 Jan 22 22:09:50.045992 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4429/9153] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:49 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 24570 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:51.056952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4b781d64-1143-4f5e-ac8e-abef5426504a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:51.058015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4b781d64-1143-4f5e-ac8e-abef5426504a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:51.065416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b781d64-1143-4f5e-ac8e-abef5426504a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:51.065922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b781d64-1143-4f5e-ac8e-abef5426504a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:51.066723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b781d64-1143-4f5e-ac8e-abef5426504a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:51.067214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4b781d64-1143-4f5e-ac8e-abef5426504a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:51.106998 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4b781d64-1143-4f5e-ac8e-abef5426504a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 24570 microversion: 2.1 time: 0.054017 Jan 22 22:09:51.107637 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4725/9154] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:51 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 24570 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:52.119641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b1800dba-b9d8-4017-92f7-b7b5cd5ee0ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:52.121433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b1800dba-b9d8-4017-92f7-b7b5cd5ee0ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:52.130352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1800dba-b9d8-4017-92f7-b7b5cd5ee0ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:52.130818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1800dba-b9d8-4017-92f7-b7b5cd5ee0ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:52.131622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1800dba-b9d8-4017-92f7-b7b5cd5ee0ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:52.132074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b1800dba-b9d8-4017-92f7-b7b5cd5ee0ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:52.179086 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b1800dba-b9d8-4017-92f7-b7b5cd5ee0ee tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 24570 microversion: 2.1 time: 0.064084 Jan 22 22:09:52.179764 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4430/9155] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:52 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 24570 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:53.191134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b918ee5f-4002-475a-8c62-735dec97ab81 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:53.192137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b918ee5f-4002-475a-8c62-735dec97ab81 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:53.199540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b918ee5f-4002-475a-8c62-735dec97ab81 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:53.200532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b918ee5f-4002-475a-8c62-735dec97ab81 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:53.201593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b918ee5f-4002-475a-8c62-735dec97ab81 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:53.202052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b918ee5f-4002-475a-8c62-735dec97ab81 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:53.243622 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b918ee5f-4002-475a-8c62-735dec97ab81 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 24570 microversion: 2.1 time: 0.056410 Jan 22 22:09:53.244296 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4726/9156] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:53 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 24570 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:53.896581 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:09:53.897193 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:09:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:09:54.255520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bd2d60ac-0145-43ea-9373-abaf01853881 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:54.256440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bd2d60ac-0145-43ea-9373-abaf01853881 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:54.264588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd2d60ac-0145-43ea-9373-abaf01853881 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:54.265042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd2d60ac-0145-43ea-9373-abaf01853881 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:54.265870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd2d60ac-0145-43ea-9373-abaf01853881 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:54.266315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bd2d60ac-0145-43ea-9373-abaf01853881 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:54.318933 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bd2d60ac-0145-43ea-9373-abaf01853881 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.067431 Jan 22 22:09:54.319619 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4431/9157] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:54 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:55.331945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-55928cef-2596-432b-af4d-90cd5eaeea90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:55.332985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-55928cef-2596-432b-af4d-90cd5eaeea90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:55.340334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55928cef-2596-432b-af4d-90cd5eaeea90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:55.340831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55928cef-2596-432b-af4d-90cd5eaeea90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:55.341664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55928cef-2596-432b-af4d-90cd5eaeea90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:55.342117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55928cef-2596-432b-af4d-90cd5eaeea90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:55.384181 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-55928cef-2596-432b-af4d-90cd5eaeea90 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.056160 Jan 22 22:09:55.385134 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4727/9158] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:55 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:56.396978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5ded5201-076f-4003-a9b1-79921b9d1eb1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:56.398032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5ded5201-076f-4003-a9b1-79921b9d1eb1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:56.406398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ded5201-076f-4003-a9b1-79921b9d1eb1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:56.406856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ded5201-076f-4003-a9b1-79921b9d1eb1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:56.407650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ded5201-076f-4003-a9b1-79921b9d1eb1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:56.408092 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5ded5201-076f-4003-a9b1-79921b9d1eb1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:56.449582 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5ded5201-076f-4003-a9b1-79921b9d1eb1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.056780 Jan 22 22:09:56.450234 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4432/9159] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:56 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:57.462196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3878da75-b32b-47c0-aa9d-32953bf42a05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:57.463228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3878da75-b32b-47c0-aa9d-32953bf42a05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:57.471471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3878da75-b32b-47c0-aa9d-32953bf42a05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:57.471949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3878da75-b32b-47c0-aa9d-32953bf42a05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:57.472795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3878da75-b32b-47c0-aa9d-32953bf42a05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:57.473256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3878da75-b32b-47c0-aa9d-32953bf42a05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:57.515398 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3878da75-b32b-47c0-aa9d-32953bf42a05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.057334 Jan 22 22:09:57.516087 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4728/9160] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:57 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:58.527587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-81253beb-0aed-429c-9493-54b6ee6f0106 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:58.528588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-81253beb-0aed-429c-9493-54b6ee6f0106 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:58.535968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81253beb-0aed-429c-9493-54b6ee6f0106 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:58.536444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81253beb-0aed-429c-9493-54b6ee6f0106 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:58.537230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81253beb-0aed-429c-9493-54b6ee6f0106 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:58.537701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-81253beb-0aed-429c-9493-54b6ee6f0106 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:58.579666 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-81253beb-0aed-429c-9493-54b6ee6f0106 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.056044 Jan 22 22:09:58.580302 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4433/9161] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:58 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:09:59.592835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8ff8042e-081e-4c47-b3ed-b86d4dffdf68 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:09:59.593888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8ff8042e-081e-4c47-b3ed-b86d4dffdf68 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:09:59.601221 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ff8042e-081e-4c47-b3ed-b86d4dffdf68 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:59.601724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ff8042e-081e-4c47-b3ed-b86d4dffdf68 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:59.602533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ff8042e-081e-4c47-b3ed-b86d4dffdf68 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:09:59.602990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ff8042e-081e-4c47-b3ed-b86d4dffdf68 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:09:59.643579 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8ff8042e-081e-4c47-b3ed-b86d4dffdf68 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.055539 Jan 22 22:09:59.644360 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4729/9162] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:09:59 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:00.656818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9075d4c4-bd0a-4579-b858-c800caf143e3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:00.657785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9075d4c4-bd0a-4579-b858-c800caf143e3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:00.665143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9075d4c4-bd0a-4579-b858-c800caf143e3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:00.665641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9075d4c4-bd0a-4579-b858-c800caf143e3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:00.666432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9075d4c4-bd0a-4579-b858-c800caf143e3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:00.666948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9075d4c4-bd0a-4579-b858-c800caf143e3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:00.712215 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9075d4c4-bd0a-4579-b858-c800caf143e3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.060369 Jan 22 22:10:00.712891 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4434/9163] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:00 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:01.725363 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d611e9ad-b871-496a-8832-b09a464ae70c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:01.726478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d611e9ad-b871-496a-8832-b09a464ae70c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:01.735227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d611e9ad-b871-496a-8832-b09a464ae70c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:01.735703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d611e9ad-b871-496a-8832-b09a464ae70c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:01.736568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d611e9ad-b871-496a-8832-b09a464ae70c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:01.738084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d611e9ad-b871-496a-8832-b09a464ae70c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:01.785771 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d611e9ad-b871-496a-8832-b09a464ae70c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.064495 Jan 22 22:10:01.786446 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4730/9164] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:01 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:02.798668 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-753adc5e-37b3-4873-9a6c-1305c60f7ae8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:02.799680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-753adc5e-37b3-4873-9a6c-1305c60f7ae8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:02.807114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-753adc5e-37b3-4873-9a6c-1305c60f7ae8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:02.807567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-753adc5e-37b3-4873-9a6c-1305c60f7ae8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:02.808345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-753adc5e-37b3-4873-9a6c-1305c60f7ae8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:02.808787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-753adc5e-37b3-4873-9a6c-1305c60f7ae8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:02.849549 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-753adc5e-37b3-4873-9a6c-1305c60f7ae8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.055129 Jan 22 22:10:02.850187 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4435/9165] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:02 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:03.862599 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a60d124e-36dc-43c4-aa27-86ba48698b05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:03.863618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a60d124e-36dc-43c4-aa27-86ba48698b05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:03.871116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a60d124e-36dc-43c4-aa27-86ba48698b05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:03.871588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a60d124e-36dc-43c4-aa27-86ba48698b05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:03.872402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a60d124e-36dc-43c4-aa27-86ba48698b05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:03.872864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a60d124e-36dc-43c4-aa27-86ba48698b05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:03.919568 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a60d124e-36dc-43c4-aa27-86ba48698b05 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.061438 Jan 22 22:10:03.920257 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4731/9166] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:03 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:04.932700 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-43127a6c-9d5d-45ea-bf5f-55bb06f1e641 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:04.933771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-43127a6c-9d5d-45ea-bf5f-55bb06f1e641 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:04.941448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43127a6c-9d5d-45ea-bf5f-55bb06f1e641 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:04.941939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43127a6c-9d5d-45ea-bf5f-55bb06f1e641 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:04.942883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43127a6c-9d5d-45ea-bf5f-55bb06f1e641 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:04.943331 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43127a6c-9d5d-45ea-bf5f-55bb06f1e641 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:04.992097 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-43127a6c-9d5d-45ea-bf5f-55bb06f1e641 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.063385 Jan 22 22:10:04.992779 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4436/9167] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:04 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:06.005153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bee84495-b150-42f9-8f8f-1512cb8255e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:06.006246 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bee84495-b150-42f9-8f8f-1512cb8255e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:06.013582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bee84495-b150-42f9-8f8f-1512cb8255e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:06.014063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bee84495-b150-42f9-8f8f-1512cb8255e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:06.014890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bee84495-b150-42f9-8f8f-1512cb8255e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:06.015390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bee84495-b150-42f9-8f8f-1512cb8255e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:06.060739 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bee84495-b150-42f9-8f8f-1512cb8255e4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.059636 Jan 22 22:10:06.063542 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4732/9168] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:05 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:07.073115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c926d646-0df7-47c8-97ba-6d34e42af815 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:07.074156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c926d646-0df7-47c8-97ba-6d34e42af815 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:07.082013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c926d646-0df7-47c8-97ba-6d34e42af815 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:07.082477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c926d646-0df7-47c8-97ba-6d34e42af815 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:07.083273 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c926d646-0df7-47c8-97ba-6d34e42af815 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:07.083725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c926d646-0df7-47c8-97ba-6d34e42af815 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:07.130086 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c926d646-0df7-47c8-97ba-6d34e42af815 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.060922 Jan 22 22:10:07.130730 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4437/9169] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:07 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:08.142786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ec94fc2e-4af5-4fe7-b60c-cf6d01791e38 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:08.143830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ec94fc2e-4af5-4fe7-b60c-cf6d01791e38 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:08.151379 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec94fc2e-4af5-4fe7-b60c-cf6d01791e38 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:08.151858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec94fc2e-4af5-4fe7-b60c-cf6d01791e38 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:08.152677 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec94fc2e-4af5-4fe7-b60c-cf6d01791e38 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:08.153140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ec94fc2e-4af5-4fe7-b60c-cf6d01791e38 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:08.197590 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ec94fc2e-4af5-4fe7-b60c-cf6d01791e38 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.059055 Jan 22 22:10:08.198217 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4733/9170] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:08 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:09.210219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-51fa4c32-1e58-4d38-9f02-763a99fb0312 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:09.211240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-51fa4c32-1e58-4d38-9f02-763a99fb0312 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:09.218806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51fa4c32-1e58-4d38-9f02-763a99fb0312 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:09.219272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51fa4c32-1e58-4d38-9f02-763a99fb0312 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:09.220071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51fa4c32-1e58-4d38-9f02-763a99fb0312 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:09.220522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-51fa4c32-1e58-4d38-9f02-763a99fb0312 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:09.263584 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-51fa4c32-1e58-4d38-9f02-763a99fb0312 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.057439 Jan 22 22:10:09.264238 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4438/9171] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:09 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:10.276819 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-56306f4b-1185-4fa6-8540-946b1f0c4f58 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:10.278013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-56306f4b-1185-4fa6-8540-946b1f0c4f58 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:10.285965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56306f4b-1185-4fa6-8540-946b1f0c4f58 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:10.286442 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56306f4b-1185-4fa6-8540-946b1f0c4f58 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:10.287258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56306f4b-1185-4fa6-8540-946b1f0c4f58 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:10.287718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56306f4b-1185-4fa6-8540-946b1f0c4f58 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:10.335872 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-56306f4b-1185-4fa6-8540-946b1f0c4f58 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.063035 Jan 22 22:10:10.336597 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4734/9172] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:10 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:11.348834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-afd70af2-3e30-49ab-ace6-3bbe16981783 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:11.349888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-afd70af2-3e30-49ab-ace6-3bbe16981783 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:11.357344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afd70af2-3e30-49ab-ace6-3bbe16981783 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:11.357842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afd70af2-3e30-49ab-ace6-3bbe16981783 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:11.359275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afd70af2-3e30-49ab-ace6-3bbe16981783 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:11.359855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-afd70af2-3e30-49ab-ace6-3bbe16981783 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:11.408070 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-afd70af2-3e30-49ab-ace6-3bbe16981783 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.063183 Jan 22 22:10:11.408783 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4439/9173] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:11 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:12.611190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e79fca47-36be-473c-8918-d478b04723cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:12.612264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e79fca47-36be-473c-8918-d478b04723cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:12.618538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e79fca47-36be-473c-8918-d478b04723cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:12.619015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e79fca47-36be-473c-8918-d478b04723cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:12.619847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e79fca47-36be-473c-8918-d478b04723cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:12.620295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e79fca47-36be-473c-8918-d478b04723cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:12.665345 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e79fca47-36be-473c-8918-d478b04723cd tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.248706 Jan 22 22:10:12.666024 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4735/9174] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:12 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:13.678152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7744409b-9a41-4082-abbf-879da260370b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:13.679141 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7744409b-9a41-4082-abbf-879da260370b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:13.687080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7744409b-9a41-4082-abbf-879da260370b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:13.687697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7744409b-9a41-4082-abbf-879da260370b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:13.688497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7744409b-9a41-4082-abbf-879da260370b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:13.688949 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7744409b-9a41-4082-abbf-879da260370b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:13.734893 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7744409b-9a41-4082-abbf-879da260370b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.060835 Jan 22 22:10:13.735540 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4440/9175] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:13 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:14.746534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9f6abf0a-acda-4af0-8ac5-ae41ef22e740 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:14.747497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9f6abf0a-acda-4af0-8ac5-ae41ef22e740 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:14.755568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f6abf0a-acda-4af0-8ac5-ae41ef22e740 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:14.756103 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f6abf0a-acda-4af0-8ac5-ae41ef22e740 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:14.756939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f6abf0a-acda-4af0-8ac5-ae41ef22e740 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:14.757393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f6abf0a-acda-4af0-8ac5-ae41ef22e740 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:14.803173 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9f6abf0a-acda-4af0-8ac5-ae41ef22e740 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.060687 Jan 22 22:10:14.804072 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4736/9176] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:14 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:15.815114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-05993253-3ceb-4dba-b4ba-4863e08a4d2a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:15.816132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-05993253-3ceb-4dba-b4ba-4863e08a4d2a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:15.823624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05993253-3ceb-4dba-b4ba-4863e08a4d2a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:15.824087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05993253-3ceb-4dba-b4ba-4863e08a4d2a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:15.824878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05993253-3ceb-4dba-b4ba-4863e08a4d2a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:15.825358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-05993253-3ceb-4dba-b4ba-4863e08a4d2a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:15.870646 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-05993253-3ceb-4dba-b4ba-4863e08a4d2a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.059616 Jan 22 22:10:15.871303 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4441/9177] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:15 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:16.882808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7c6ac49c-40da-48b6-955d-d6eb0d1a2ace tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:16.883847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7c6ac49c-40da-48b6-955d-d6eb0d1a2ace tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:16.891426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c6ac49c-40da-48b6-955d-d6eb0d1a2ace tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:16.891903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c6ac49c-40da-48b6-955d-d6eb0d1a2ace tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:16.892724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c6ac49c-40da-48b6-955d-d6eb0d1a2ace tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:16.893185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7c6ac49c-40da-48b6-955d-d6eb0d1a2ace tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:16.938733 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7c6ac49c-40da-48b6-955d-d6eb0d1a2ace tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.059872 Jan 22 22:10:16.939401 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4737/9178] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:16 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:17.951042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0c302cd3-3ec0-49db-b9d1-d97c2603f337 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:17.952074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0c302cd3-3ec0-49db-b9d1-d97c2603f337 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:17.959584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c302cd3-3ec0-49db-b9d1-d97c2603f337 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:17.960047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c302cd3-3ec0-49db-b9d1-d97c2603f337 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:17.960838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c302cd3-3ec0-49db-b9d1-d97c2603f337 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:17.961286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0c302cd3-3ec0-49db-b9d1-d97c2603f337 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:18.009122 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0c302cd3-3ec0-49db-b9d1-d97c2603f337 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.062041 Jan 22 22:10:18.009814 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4442/9179] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:17 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:19.021676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-19634be8-8e88-4ef1-b266-80f3b41e3221 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:19.022706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-19634be8-8e88-4ef1-b266-80f3b41e3221 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:19.030873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19634be8-8e88-4ef1-b266-80f3b41e3221 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:19.031520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19634be8-8e88-4ef1-b266-80f3b41e3221 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:19.032327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19634be8-8e88-4ef1-b266-80f3b41e3221 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:19.032788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-19634be8-8e88-4ef1-b266-80f3b41e3221 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:19.078967 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-19634be8-8e88-4ef1-b266-80f3b41e3221 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.061283 Jan 22 22:10:19.079609 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4738/9180] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:19 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:20.091637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d2cdb705-96fe-4133-864e-b2b249e2ceef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:20.093520 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d2cdb705-96fe-4133-864e-b2b249e2ceef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:20.101098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2cdb705-96fe-4133-864e-b2b249e2ceef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:20.101579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2cdb705-96fe-4133-864e-b2b249e2ceef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:20.102377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2cdb705-96fe-4133-864e-b2b249e2ceef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:20.102823 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d2cdb705-96fe-4133-864e-b2b249e2ceef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:20.149530 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d2cdb705-96fe-4133-864e-b2b249e2ceef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.061763 Jan 22 22:10:20.150292 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4443/9181] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:20 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:21.162399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0007bae5-79ea-4a0c-9bf0-9fd7d639efaf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:21.163418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0007bae5-79ea-4a0c-9bf0-9fd7d639efaf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:21.170946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0007bae5-79ea-4a0c-9bf0-9fd7d639efaf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:21.171422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0007bae5-79ea-4a0c-9bf0-9fd7d639efaf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:21.172237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0007bae5-79ea-4a0c-9bf0-9fd7d639efaf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:21.172702 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0007bae5-79ea-4a0c-9bf0-9fd7d639efaf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:21.218541 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0007bae5-79ea-4a0c-9bf0-9fd7d639efaf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.060119 Jan 22 22:10:21.219177 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4739/9182] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:21 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:22.231051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bb564d4f-976b-4e6a-bf32-c8675e85ff1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:22.232107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bb564d4f-976b-4e6a-bf32-c8675e85ff1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:22.239600 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb564d4f-976b-4e6a-bf32-c8675e85ff1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:22.240063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb564d4f-976b-4e6a-bf32-c8675e85ff1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:22.240857 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb564d4f-976b-4e6a-bf32-c8675e85ff1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:22.241308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bb564d4f-976b-4e6a-bf32-c8675e85ff1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:22.286052 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bb564d4f-976b-4e6a-bf32-c8675e85ff1c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.059238 Jan 22 22:10:22.286733 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4444/9183] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:22 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:23.297926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-be016a60-7513-4c8a-89c4-f028bdffec4a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:23.298958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-be016a60-7513-4c8a-89c4-f028bdffec4a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:23.306401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be016a60-7513-4c8a-89c4-f028bdffec4a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:23.315000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be016a60-7513-4c8a-89c4-f028bdffec4a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:23.315000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be016a60-7513-4c8a-89c4-f028bdffec4a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:23.315000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-be016a60-7513-4c8a-89c4-f028bdffec4a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:23.353671 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-be016a60-7513-4c8a-89c4-f028bdffec4a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.059722 Jan 22 22:10:23.354636 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4740/9184] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:23 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:24.366330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-886eb6bb-6396-40e2-b3a6-4d968b3846ec tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:24.367346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-886eb6bb-6396-40e2-b3a6-4d968b3846ec tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:24.375733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-886eb6bb-6396-40e2-b3a6-4d968b3846ec tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:24.376197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-886eb6bb-6396-40e2-b3a6-4d968b3846ec tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:24.377005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-886eb6bb-6396-40e2-b3a6-4d968b3846ec tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:24.377452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-886eb6bb-6396-40e2-b3a6-4d968b3846ec tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:24.426880 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-886eb6bb-6396-40e2-b3a6-4d968b3846ec tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.064592 Jan 22 22:10:24.427542 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4445/9185] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:24 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:25.439762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2f381b3e-da21-4130-a7d0-10ea8db29149 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:25.440788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2f381b3e-da21-4130-a7d0-10ea8db29149 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:25.448231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f381b3e-da21-4130-a7d0-10ea8db29149 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:25.451054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f381b3e-da21-4130-a7d0-10ea8db29149 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:25.451054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f381b3e-da21-4130-a7d0-10ea8db29149 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:25.451054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2f381b3e-da21-4130-a7d0-10ea8db29149 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:25.495222 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2f381b3e-da21-4130-a7d0-10ea8db29149 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.060297 Jan 22 22:10:25.495889 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4741/9186] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:25 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:26.510185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4015cdee-ba80-4328-9826-5052d907bad2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:26.511226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4015cdee-ba80-4328-9826-5052d907bad2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:26.521249 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4015cdee-ba80-4328-9826-5052d907bad2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:26.521744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4015cdee-ba80-4328-9826-5052d907bad2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:26.522558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4015cdee-ba80-4328-9826-5052d907bad2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:26.523011 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4015cdee-ba80-4328-9826-5052d907bad2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:26.568764 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4015cdee-ba80-4328-9826-5052d907bad2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.064372 Jan 22 22:10:26.569421 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4446/9187] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:26 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:27.581487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5fe46bfe-4059-43dc-9502-c429d43f709c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:27.582515 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5fe46bfe-4059-43dc-9502-c429d43f709c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:27.589791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5fe46bfe-4059-43dc-9502-c429d43f709c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:27.590262 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5fe46bfe-4059-43dc-9502-c429d43f709c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:27.591059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5fe46bfe-4059-43dc-9502-c429d43f709c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:27.591512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5fe46bfe-4059-43dc-9502-c429d43f709c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:27.639711 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5fe46bfe-4059-43dc-9502-c429d43f709c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.062152 Jan 22 22:10:27.640403 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4742/9188] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:27 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:28.652041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-32444518-953c-4f1e-9548-b4b9bdbe76de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:28.652999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-32444518-953c-4f1e-9548-b4b9bdbe76de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:28.661381 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32444518-953c-4f1e-9548-b4b9bdbe76de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:28.661864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32444518-953c-4f1e-9548-b4b9bdbe76de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:28.662654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32444518-953c-4f1e-9548-b4b9bdbe76de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:28.663101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32444518-953c-4f1e-9548-b4b9bdbe76de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:28.709024 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-32444518-953c-4f1e-9548-b4b9bdbe76de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.060976 Jan 22 22:10:28.709693 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4447/9189] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:28 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:29.723527 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e9f9c4e0-1e2d-46ff-96d4-eb7ef327a746 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:29.724284 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e9f9c4e0-1e2d-46ff-96d4-eb7ef327a746 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:29.732369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9f9c4e0-1e2d-46ff-96d4-eb7ef327a746 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:29.733679 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9f9c4e0-1e2d-46ff-96d4-eb7ef327a746 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:29.743342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9f9c4e0-1e2d-46ff-96d4-eb7ef327a746 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:29.743342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9f9c4e0-1e2d-46ff-96d4-eb7ef327a746 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:29.780624 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e9f9c4e0-1e2d-46ff-96d4-eb7ef327a746 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.063104 Jan 22 22:10:29.781293 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4743/9190] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:29 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:30.792656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3dfd541e-22fe-4233-993c-3a13de0f4555 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:30.793781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3dfd541e-22fe-4233-993c-3a13de0f4555 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:30.801956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3dfd541e-22fe-4233-993c-3a13de0f4555 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:30.802423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3dfd541e-22fe-4233-993c-3a13de0f4555 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:30.803251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3dfd541e-22fe-4233-993c-3a13de0f4555 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:30.803705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3dfd541e-22fe-4233-993c-3a13de0f4555 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:30.847782 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3dfd541e-22fe-4233-993c-3a13de0f4555 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.058963 Jan 22 22:10:30.848471 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4448/9191] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:30 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:31.860508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8524eecc-74c5-49d6-88df-ddfbc2deba12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:31.861639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8524eecc-74c5-49d6-88df-ddfbc2deba12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:31.868848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8524eecc-74c5-49d6-88df-ddfbc2deba12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:31.869313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8524eecc-74c5-49d6-88df-ddfbc2deba12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:31.870166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8524eecc-74c5-49d6-88df-ddfbc2deba12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:31.870617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8524eecc-74c5-49d6-88df-ddfbc2deba12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:31.914608 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8524eecc-74c5-49d6-88df-ddfbc2deba12 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.059135 Jan 22 22:10:31.915232 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4744/9192] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:31 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:32.927030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2070c9cd-9b8b-4de7-ba09-787314a9859e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:32.928044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2070c9cd-9b8b-4de7-ba09-787314a9859e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:32.935540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2070c9cd-9b8b-4de7-ba09-787314a9859e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:32.936903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2070c9cd-9b8b-4de7-ba09-787314a9859e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:32.937742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2070c9cd-9b8b-4de7-ba09-787314a9859e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:32.938228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2070c9cd-9b8b-4de7-ba09-787314a9859e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:32.983794 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2070c9cd-9b8b-4de7-ba09-787314a9859e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.060157 Jan 22 22:10:32.984454 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4449/9193] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:32 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:33.996180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-efcff33d-2254-4b6b-8c19-5966459692f7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:33.997191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-efcff33d-2254-4b6b-8c19-5966459692f7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:34.005367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-efcff33d-2254-4b6b-8c19-5966459692f7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:34.005864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-efcff33d-2254-4b6b-8c19-5966459692f7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:34.006653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-efcff33d-2254-4b6b-8c19-5966459692f7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:34.007105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-efcff33d-2254-4b6b-8c19-5966459692f7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:34.052861 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-efcff33d-2254-4b6b-8c19-5966459692f7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.060706 Jan 22 22:10:34.053519 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4745/9194] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:33 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:35.064889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6e4e5b39-7a35-4457-b2d5-58068a369e30 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:35.065942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6e4e5b39-7a35-4457-b2d5-58068a369e30 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:35.073373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e4e5b39-7a35-4457-b2d5-58068a369e30 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:35.076221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e4e5b39-7a35-4457-b2d5-58068a369e30 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:35.076221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e4e5b39-7a35-4457-b2d5-58068a369e30 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:35.076221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e4e5b39-7a35-4457-b2d5-58068a369e30 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:35.120806 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6e4e5b39-7a35-4457-b2d5-58068a369e30 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.059984 Jan 22 22:10:35.121564 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4450/9195] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:35 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:36.134381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-93de69c9-6303-478f-b73b-e031c581a021 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:36.135413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-93de69c9-6303-478f-b73b-e031c581a021 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:36.143420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93de69c9-6303-478f-b73b-e031c581a021 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:36.143893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93de69c9-6303-478f-b73b-e031c581a021 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:36.144705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93de69c9-6303-478f-b73b-e031c581a021 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:36.145167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-93de69c9-6303-478f-b73b-e031c581a021 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:36.190867 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-93de69c9-6303-478f-b73b-e031c581a021 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.060491 Jan 22 22:10:36.191497 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4746/9196] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:36 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:37.204113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2d069569-6d43-4490-8f51-8454a0793245 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:37.205151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2d069569-6d43-4490-8f51-8454a0793245 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:37.212609 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d069569-6d43-4490-8f51-8454a0793245 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:37.213074 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d069569-6d43-4490-8f51-8454a0793245 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:37.213896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d069569-6d43-4490-8f51-8454a0793245 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:37.214349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d069569-6d43-4490-8f51-8454a0793245 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:37.262707 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2d069569-6d43-4490-8f51-8454a0793245 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.063004 Jan 22 22:10:37.263369 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4451/9197] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:37 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:38.275686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1357c96f-16e6-41cc-9b56-91ae3fdf47ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:38.276693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1357c96f-16e6-41cc-9b56-91ae3fdf47ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:38.284586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1357c96f-16e6-41cc-9b56-91ae3fdf47ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:38.285292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1357c96f-16e6-41cc-9b56-91ae3fdf47ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:38.286183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1357c96f-16e6-41cc-9b56-91ae3fdf47ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:38.286757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1357c96f-16e6-41cc-9b56-91ae3fdf47ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:38.334681 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1357c96f-16e6-41cc-9b56-91ae3fdf47ef tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.062902 Jan 22 22:10:38.335334 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4747/9198] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:38 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:10:39.347202 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bfbc7bec-063f-4d91-b3cc-d7d611efb055 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:39.348212 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bfbc7bec-063f-4d91-b3cc-d7d611efb055 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:39.355920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfbc7bec-063f-4d91-b3cc-d7d611efb055 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:39.356383 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfbc7bec-063f-4d91-b3cc-d7d611efb055 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:39.357183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfbc7bec-063f-4d91-b3cc-d7d611efb055 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:39.358298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bfbc7bec-063f-4d91-b3cc-d7d611efb055 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:39.404943 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bfbc7bec-063f-4d91-b3cc-d7d611efb055 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.061921 Jan 22 22:10:39.405650 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4452/9199] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:39 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:10:40.416775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17b51970-ddac-4681-a450-42e3fe90a601 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:40.418666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17b51970-ddac-4681-a450-42e3fe90a601 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:40.425105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17b51970-ddac-4681-a450-42e3fe90a601 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:40.425598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17b51970-ddac-4681-a450-42e3fe90a601 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:40.426398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17b51970-ddac-4681-a450-42e3fe90a601 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:40.426852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17b51970-ddac-4681-a450-42e3fe90a601 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:40.472826 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17b51970-ddac-4681-a450-42e3fe90a601 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.060041 Jan 22 22:10:40.473466 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4748/9200] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:40 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:41.486188 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f3497cd8-9661-4a40-adcd-3dcc2818974b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:41.487200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f3497cd8-9661-4a40-adcd-3dcc2818974b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:41.494508 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3497cd8-9661-4a40-adcd-3dcc2818974b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:41.494974 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3497cd8-9661-4a40-adcd-3dcc2818974b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:41.495772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3497cd8-9661-4a40-adcd-3dcc2818974b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:41.496225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3497cd8-9661-4a40-adcd-3dcc2818974b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:41.541554 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f3497cd8-9661-4a40-adcd-3dcc2818974b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.060775 Jan 22 22:10:41.542211 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4453/9201] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:41 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:42.554241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-40187572-9567-4cdf-9c6d-0b7fac52b630 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:42.555253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-40187572-9567-4cdf-9c6d-0b7fac52b630 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:42.563013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40187572-9567-4cdf-9c6d-0b7fac52b630 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:42.563483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40187572-9567-4cdf-9c6d-0b7fac52b630 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:42.564302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40187572-9567-4cdf-9c6d-0b7fac52b630 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:42.564760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40187572-9567-4cdf-9c6d-0b7fac52b630 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:42.623983 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-40187572-9567-4cdf-9c6d-0b7fac52b630 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.072871 Jan 22 22:10:42.624936 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4749/9202] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:42 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:43.636587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a973eda4-b7d3-4ba4-a29a-95b86cbfb77a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:43.639743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a973eda4-b7d3-4ba4-a29a-95b86cbfb77a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:43.647674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a973eda4-b7d3-4ba4-a29a-95b86cbfb77a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:43.647674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a973eda4-b7d3-4ba4-a29a-95b86cbfb77a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:43.647674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a973eda4-b7d3-4ba4-a29a-95b86cbfb77a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:43.647674 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a973eda4-b7d3-4ba4-a29a-95b86cbfb77a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:43.697933 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a973eda4-b7d3-4ba4-a29a-95b86cbfb77a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.065253 Jan 22 22:10:43.698851 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4454/9203] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:43 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:44.710836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-76e8cc1a-5a7d-4b37-a31e-482279d5dcd6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:44.711760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-76e8cc1a-5a7d-4b37-a31e-482279d5dcd6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:44.719684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76e8cc1a-5a7d-4b37-a31e-482279d5dcd6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:44.720159 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76e8cc1a-5a7d-4b37-a31e-482279d5dcd6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:44.720954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76e8cc1a-5a7d-4b37-a31e-482279d5dcd6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:44.721410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76e8cc1a-5a7d-4b37-a31e-482279d5dcd6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:44.767083 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-76e8cc1a-5a7d-4b37-a31e-482279d5dcd6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.060290 Jan 22 22:10:44.767696 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4750/9204] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:44 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:45.779820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5d45c32b-4cb5-4d20-9903-433bd30e5a75 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:45.780866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5d45c32b-4cb5-4d20-9903-433bd30e5a75 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:45.788277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d45c32b-4cb5-4d20-9903-433bd30e5a75 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:45.788738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d45c32b-4cb5-4d20-9903-433bd30e5a75 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:45.789551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d45c32b-4cb5-4d20-9903-433bd30e5a75 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:45.790007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d45c32b-4cb5-4d20-9903-433bd30e5a75 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:45.836993 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5d45c32b-4cb5-4d20-9903-433bd30e5a75 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.061180 Jan 22 22:10:45.837668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4455/9205] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:45 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:46.849232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab0969be-8e33-4059-89ae-2974dd043a49 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:46.850293 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ab0969be-8e33-4059-89ae-2974dd043a49 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:46.858065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab0969be-8e33-4059-89ae-2974dd043a49 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:46.858547 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab0969be-8e33-4059-89ae-2974dd043a49 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:46.859384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab0969be-8e33-4059-89ae-2974dd043a49 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:46.859856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab0969be-8e33-4059-89ae-2974dd043a49 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:46.906007 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab0969be-8e33-4059-89ae-2974dd043a49 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.060749 Jan 22 22:10:46.906744 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4751/9206] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:46 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:47.918470 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-258ef8ec-e8dc-434c-8a59-fba567bfe4a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:47.919521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-258ef8ec-e8dc-434c-8a59-fba567bfe4a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:47.929434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-258ef8ec-e8dc-434c-8a59-fba567bfe4a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:47.929942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-258ef8ec-e8dc-434c-8a59-fba567bfe4a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:47.930760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-258ef8ec-e8dc-434c-8a59-fba567bfe4a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:47.931224 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-258ef8ec-e8dc-434c-8a59-fba567bfe4a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:47.988998 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-258ef8ec-e8dc-434c-8a59-fba567bfe4a9 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.074490 Jan 22 22:10:47.989696 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4456/9207] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:47 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:49.001823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8316af1f-c3ff-4039-ad42-d5ab212d2e8e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:49.002847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8316af1f-c3ff-4039-ad42-d5ab212d2e8e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:49.010279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8316af1f-c3ff-4039-ad42-d5ab212d2e8e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:49.010757 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8316af1f-c3ff-4039-ad42-d5ab212d2e8e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:49.011567 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8316af1f-c3ff-4039-ad42-d5ab212d2e8e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:49.012032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8316af1f-c3ff-4039-ad42-d5ab212d2e8e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:49.053533 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8316af1f-c3ff-4039-ad42-d5ab212d2e8e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.056265 Jan 22 22:10:49.054415 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4752/9208] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:48 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:50.066408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-deaf95c0-53b9-4a64-873e-4df674772e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:50.067448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-deaf95c0-53b9-4a64-873e-4df674772e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:50.075533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-deaf95c0-53b9-4a64-873e-4df674772e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:50.075991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-deaf95c0-53b9-4a64-873e-4df674772e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:50.076801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-deaf95c0-53b9-4a64-873e-4df674772e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:50.077237 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-deaf95c0-53b9-4a64-873e-4df674772e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:50.118935 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-deaf95c0-53b9-4a64-873e-4df674772e51 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.056599 Jan 22 22:10:50.119806 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4457/9209] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:50 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:51.131865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab085f77-983c-464a-ae48-a070404c2478 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:51.132864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ab085f77-983c-464a-ae48-a070404c2478 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:51.140699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab085f77-983c-464a-ae48-a070404c2478 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:51.141164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab085f77-983c-464a-ae48-a070404c2478 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:51.141990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab085f77-983c-464a-ae48-a070404c2478 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:51.142446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab085f77-983c-464a-ae48-a070404c2478 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:51.187211 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab085f77-983c-464a-ae48-a070404c2478 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.059271 Jan 22 22:10:51.187858 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4753/9210] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:51 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:52.198745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2d74474f-5890-4749-93b6-bb1adac29e2b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:52.199767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2d74474f-5890-4749-93b6-bb1adac29e2b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:52.207359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d74474f-5890-4749-93b6-bb1adac29e2b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:52.212461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d74474f-5890-4749-93b6-bb1adac29e2b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:52.212461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d74474f-5890-4749-93b6-bb1adac29e2b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:52.212461 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2d74474f-5890-4749-93b6-bb1adac29e2b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:52.256908 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2d74474f-5890-4749-93b6-bb1adac29e2b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.062193 Jan 22 22:10:52.257820 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4458/9211] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:52 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:53.269955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-90e2edab-e53f-43f0-9fe6-c9c2d35b8b21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:53.270974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-90e2edab-e53f-43f0-9fe6-c9c2d35b8b21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:53.278361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90e2edab-e53f-43f0-9fe6-c9c2d35b8b21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:53.278833 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90e2edab-e53f-43f0-9fe6-c9c2d35b8b21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:53.279675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90e2edab-e53f-43f0-9fe6-c9c2d35b8b21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:53.281070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-90e2edab-e53f-43f0-9fe6-c9c2d35b8b21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:53.330018 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-90e2edab-e53f-43f0-9fe6-c9c2d35b8b21 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.064091 Jan 22 22:10:53.330676 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4754/9212] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:53 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:54.342341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8353a682-5655-42c1-8181-d9b044ed9957 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:54.343343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8353a682-5655-42c1-8181-d9b044ed9957 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:54.350761 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8353a682-5655-42c1-8181-d9b044ed9957 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:54.351213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8353a682-5655-42c1-8181-d9b044ed9957 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:54.351990 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8353a682-5655-42c1-8181-d9b044ed9957 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:54.352435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8353a682-5655-42c1-8181-d9b044ed9957 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:54.398910 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8353a682-5655-42c1-8181-d9b044ed9957 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.060568 Jan 22 22:10:54.399629 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4459/9213] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:54 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:55.412106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2631ea49-2dc3-4504-92f9-d7f171d9d971 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:55.413135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2631ea49-2dc3-4504-92f9-d7f171d9d971 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:55.420743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2631ea49-2dc3-4504-92f9-d7f171d9d971 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:55.421873 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2631ea49-2dc3-4504-92f9-d7f171d9d971 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:55.422101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2631ea49-2dc3-4504-92f9-d7f171d9d971 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:55.422572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2631ea49-2dc3-4504-92f9-d7f171d9d971 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:55.468085 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2631ea49-2dc3-4504-92f9-d7f171d9d971 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.059337 Jan 22 22:10:55.468852 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4755/9214] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:55 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:56.480875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7a6ad5ee-ebe3-43b1-a876-f45e87a74f19 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:56.481918 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7a6ad5ee-ebe3-43b1-a876-f45e87a74f19 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:56.489664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a6ad5ee-ebe3-43b1-a876-f45e87a74f19 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:56.490125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a6ad5ee-ebe3-43b1-a876-f45e87a74f19 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:56.490911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a6ad5ee-ebe3-43b1-a876-f45e87a74f19 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:56.491356 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a6ad5ee-ebe3-43b1-a876-f45e87a74f19 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:56.534722 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7a6ad5ee-ebe3-43b1-a876-f45e87a74f19 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.058073 Jan 22 22:10:56.535414 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4460/9215] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:56 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:57.547639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0e37ce9d-b026-4ea0-bd10-e15c5d1f8dc6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:57.548655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0e37ce9d-b026-4ea0-bd10-e15c5d1f8dc6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:57.556015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e37ce9d-b026-4ea0-bd10-e15c5d1f8dc6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:57.556459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e37ce9d-b026-4ea0-bd10-e15c5d1f8dc6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:57.557260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e37ce9d-b026-4ea0-bd10-e15c5d1f8dc6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:57.557735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e37ce9d-b026-4ea0-bd10-e15c5d1f8dc6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:57.608125 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0e37ce9d-b026-4ea0-bd10-e15c5d1f8dc6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.065121 Jan 22 22:10:57.608781 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4756/9216] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:57 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:58.620819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e6bb332b-b860-417d-93f2-711cf3abf9fc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:58.621875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e6bb332b-b860-417d-93f2-711cf3abf9fc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:58.629734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6bb332b-b860-417d-93f2-711cf3abf9fc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:58.630201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6bb332b-b860-417d-93f2-711cf3abf9fc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:58.630995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6bb332b-b860-417d-93f2-711cf3abf9fc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:58.631441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e6bb332b-b860-417d-93f2-711cf3abf9fc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:58.672787 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e6bb332b-b860-417d-93f2-711cf3abf9fc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.055936 Jan 22 22:10:58.673660 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4461/9217] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:58 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:10:59.684686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c386363f-e131-4203-be59-906b194aadb2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:10:59.685724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c386363f-e131-4203-be59-906b194aadb2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:10:59.693142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c386363f-e131-4203-be59-906b194aadb2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:59.693632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c386363f-e131-4203-be59-906b194aadb2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:59.694432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c386363f-e131-4203-be59-906b194aadb2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:10:59.694886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c386363f-e131-4203-be59-906b194aadb2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:10:59.738916 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c386363f-e131-4203-be59-906b194aadb2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.058165 Jan 22 22:10:59.739592 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4757/9218] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:10:59 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:11:00.751893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b936f4e4-55d1-4acd-a35d-253e3a722494 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:11:00.752812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b936f4e4-55d1-4acd-a35d-253e3a722494 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:00.760164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b936f4e4-55d1-4acd-a35d-253e3a722494 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:00.760616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b936f4e4-55d1-4acd-a35d-253e3a722494 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:00.761396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b936f4e4-55d1-4acd-a35d-253e3a722494 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:00.761861 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b936f4e4-55d1-4acd-a35d-253e3a722494 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:00.802953 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b936f4e4-55d1-4acd-a35d-253e3a722494 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.055228 Jan 22 22:11:00.803599 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4462/9219] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:11:00 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:11:01.815563 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d2d17195-326d-4794-b297-cb5b6e4e5741 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:11:01.816610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d2d17195-326d-4794-b297-cb5b6e4e5741 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:01.824067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2d17195-326d-4794-b297-cb5b6e4e5741 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:01.824538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2d17195-326d-4794-b297-cb5b6e4e5741 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:01.825345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2d17195-326d-4794-b297-cb5b6e4e5741 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:01.825836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d2d17195-326d-4794-b297-cb5b6e4e5741 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:01.867357 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d2d17195-326d-4794-b297-cb5b6e4e5741 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.056084 Jan 22 22:11:01.869476 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4758/9220] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:11:01 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:11:02.879754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7a8fb268-b796-4799-b9d1-951b77da83d7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:11:02.880797 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7a8fb268-b796-4799-b9d1-951b77da83d7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:02.888348 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a8fb268-b796-4799-b9d1-951b77da83d7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:02.888806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a8fb268-b796-4799-b9d1-951b77da83d7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:02.889634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a8fb268-b796-4799-b9d1-951b77da83d7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:02.890086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a8fb268-b796-4799-b9d1-951b77da83d7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:02.935214 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7a8fb268-b796-4799-b9d1-951b77da83d7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 32640 microversion: 2.1 time: 0.059479 Jan 22 22:11:02.935862 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4463/9221] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:11:02 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 32640 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:11:03.947982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-79355a61-db9c-4b67-afc9-4fd6b24eb7d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:11:03.949053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-79355a61-db9c-4b67-afc9-4fd6b24eb7d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:03.957326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79355a61-db9c-4b67-afc9-4fd6b24eb7d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:03.957836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79355a61-db9c-4b67-afc9-4fd6b24eb7d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:03.958664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79355a61-db9c-4b67-afc9-4fd6b24eb7d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:03.959130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-79355a61-db9c-4b67-afc9-4fd6b24eb7d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:04.014697 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-79355a61-db9c-4b67-afc9-4fd6b24eb7d0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 200 len: 40789 microversion: 2.1 time: 0.070989 Jan 22 22:11:04.016202 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4759/9222] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:11:03 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 40789 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:11:05.723310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e950be94-665a-4566-991e-50a2400df78d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:05.724025 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e950be94-665a-4566-991e-50a2400df78d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:05.731886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e950be94-665a-4566-991e-50a2400df78d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:05.732363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e950be94-665a-4566-991e-50a2400df78d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:05.733163 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e950be94-665a-4566-991e-50a2400df78d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:05.733646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e950be94-665a-4566-991e-50a2400df78d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:05.917022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e950be94-665a-4566-991e-50a2400df78d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:05.925346 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e950be94-665a-4566-991e-50a2400df78d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1672 microversion: 2.1 time: 0.206233 Jan 22 22:11:05.925977 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4464/9223] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:05 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1672 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:05.942976 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-82d91c9b-6638-4447-9bc3-e70f52ad61c6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6306e2dc-90a5-4e80-bc1e-986664ed75cd"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:11:05.944141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-82d91c9b-6638-4447-9bc3-e70f52ad61c6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:05.951764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82d91c9b-6638-4447-9bc3-e70f52ad61c6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:05.952238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82d91c9b-6638-4447-9bc3-e70f52ad61c6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:05.953050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82d91c9b-6638-4447-9bc3-e70f52ad61c6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:05.953530 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82d91c9b-6638-4447-9bc3-e70f52ad61c6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:06.699619 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-82d91c9b-6638-4447-9bc3-e70f52ad61c6 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761387 Jan 22 22:11:06.700439 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4760/9224] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 22:11:05 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:11:11.025222 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5715dbd8-f72a-4a53-b487-3c7e05d44050 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:11:11.043493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5715dbd8-f72a-4a53-b487-3c7e05d44050 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:11.043493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5715dbd8-f72a-4a53-b487-3c7e05d44050 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:11.043493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5715dbd8-f72a-4a53-b487-3c7e05d44050 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:11.043493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5715dbd8-f72a-4a53-b487-3c7e05d44050 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:11.043493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5715dbd8-f72a-4a53-b487-3c7e05d44050 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:11.063180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5715dbd8-f72a-4a53-b487-3c7e05d44050 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:11.069112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5715dbd8-f72a-4a53-b487-3c7e05d44050 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Old instance type m1.heat2, new instance type m1.heat {{(pid=137033) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 22:11:11.075751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-5715dbd8-f72a-4a53-b487-3c7e05d44050 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:11:11.076191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-5715dbd8-f72a-4a53-b487-3c7e05d44050 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:11:11.076679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-5715dbd8-f72a-4a53-b487-3c7e05d44050 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:11:11.077104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-5715dbd8-f72a-4a53-b487-3c7e05d44050 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:11:11.077553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-5715dbd8-f72a-4a53-b487-3c7e05d44050 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:11:11.281658 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5715dbd8-f72a-4a53-b487-3c7e05d44050 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 202 len: 0 microversion: 2.1 time: 0.260206 Jan 22 22:11:11.282264 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4465/9225] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:11:11 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:11:11.292473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-221d575b-40c6-4e9c-8f09-3fdc57626e72 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:11.293193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-221d575b-40c6-4e9c-8f09-3fdc57626e72 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:11.300329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-221d575b-40c6-4e9c-8f09-3fdc57626e72 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:11.301144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-221d575b-40c6-4e9c-8f09-3fdc57626e72 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:11.301970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-221d575b-40c6-4e9c-8f09-3fdc57626e72 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:11.302433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-221d575b-40c6-4e9c-8f09-3fdc57626e72 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:11.436786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-221d575b-40c6-4e9c-8f09-3fdc57626e72 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:11.445846 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-221d575b-40c6-4e9c-8f09-3fdc57626e72 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1727 microversion: 2.1 time: 0.158487 Jan 22 22:11:11.446436 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4761/9226] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:11 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:12.466279 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-47676482-7fb0-4f51-9711-ee08a984cee8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:12.467060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-47676482-7fb0-4f51-9711-ee08a984cee8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:12.474649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47676482-7fb0-4f51-9711-ee08a984cee8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:12.478400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47676482-7fb0-4f51-9711-ee08a984cee8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:12.478400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47676482-7fb0-4f51-9711-ee08a984cee8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:12.478400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-47676482-7fb0-4f51-9711-ee08a984cee8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:12.620801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-47676482-7fb0-4f51-9711-ee08a984cee8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:12.629281 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-47676482-7fb0-4f51-9711-ee08a984cee8 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1727 microversion: 2.1 time: 0.168173 Jan 22 22:11:12.629912 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4466/9227] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:12 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:13.648116 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fcee828b-5f2f-4ce0-a96c-cfbae9d8f5d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:13.648678 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fcee828b-5f2f-4ce0-a96c-cfbae9d8f5d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:13.655592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcee828b-5f2f-4ce0-a96c-cfbae9d8f5d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:13.656074 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcee828b-5f2f-4ce0-a96c-cfbae9d8f5d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:13.656903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcee828b-5f2f-4ce0-a96c-cfbae9d8f5d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:13.657370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fcee828b-5f2f-4ce0-a96c-cfbae9d8f5d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:13.801558 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fcee828b-5f2f-4ce0-a96c-cfbae9d8f5d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:13.810050 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fcee828b-5f2f-4ce0-a96c-cfbae9d8f5d2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1727 microversion: 2.1 time: 0.165706 Jan 22 22:11:13.810656 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4762/9228] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:13 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:11:14.827903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d4acfb16-2842-464b-ba26-958fcc4f5063 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:14.828517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d4acfb16-2842-464b-ba26-958fcc4f5063 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:14.835723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4acfb16-2842-464b-ba26-958fcc4f5063 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:14.836178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4acfb16-2842-464b-ba26-958fcc4f5063 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:14.836969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4acfb16-2842-464b-ba26-958fcc4f5063 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:14.837412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d4acfb16-2842-464b-ba26-958fcc4f5063 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:14.968946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d4acfb16-2842-464b-ba26-958fcc4f5063 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:14.977299 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d4acfb16-2842-464b-ba26-958fcc4f5063 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1732 microversion: 2.1 time: 0.153068 Jan 22 22:11:14.978119 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4467/9229] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:14 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:15.995470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-228028b7-0257-4b6c-bbb6-e2617ffe4394 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:15.996100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-228028b7-0257-4b6c-bbb6-e2617ffe4394 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:16.003612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-228028b7-0257-4b6c-bbb6-e2617ffe4394 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:16.004086 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-228028b7-0257-4b6c-bbb6-e2617ffe4394 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:16.004893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-228028b7-0257-4b6c-bbb6-e2617ffe4394 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:16.005357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-228028b7-0257-4b6c-bbb6-e2617ffe4394 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:16.136352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-228028b7-0257-4b6c-bbb6-e2617ffe4394 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:16.145463 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-228028b7-0257-4b6c-bbb6-e2617ffe4394 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1732 microversion: 2.1 time: 0.153758 Jan 22 22:11:16.146076 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4763/9230] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:15 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:17.162842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ad8723d0-01e3-45bb-8e69-70e841c51fbf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:17.163442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ad8723d0-01e3-45bb-8e69-70e841c51fbf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:17.170342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad8723d0-01e3-45bb-8e69-70e841c51fbf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:17.170804 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad8723d0-01e3-45bb-8e69-70e841c51fbf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:17.171598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad8723d0-01e3-45bb-8e69-70e841c51fbf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:17.172049 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ad8723d0-01e3-45bb-8e69-70e841c51fbf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:17.303392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ad8723d0-01e3-45bb-8e69-70e841c51fbf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:17.311379 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ad8723d0-01e3-45bb-8e69-70e841c51fbf tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1732 microversion: 2.1 time: 0.152592 Jan 22 22:11:17.311951 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4468/9231] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:17 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:18.329324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-107a8d75-08fc-409c-9043-fb5664d55cc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:18.330135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-107a8d75-08fc-409c-9043-fb5664d55cc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:18.336921 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-107a8d75-08fc-409c-9043-fb5664d55cc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:18.337396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-107a8d75-08fc-409c-9043-fb5664d55cc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:18.338233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-107a8d75-08fc-409c-9043-fb5664d55cc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:18.338697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-107a8d75-08fc-409c-9043-fb5664d55cc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:18.479445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-107a8d75-08fc-409c-9043-fb5664d55cc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:18.487517 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-107a8d75-08fc-409c-9043-fb5664d55cc7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1732 microversion: 2.1 time: 0.161978 Jan 22 22:11:18.488103 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4764/9232] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:18 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:19.505126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b5c0f4be-4108-4196-ae9e-6afc14388a16 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:19.505880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b5c0f4be-4108-4196-ae9e-6afc14388a16 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:19.512714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5c0f4be-4108-4196-ae9e-6afc14388a16 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:19.513182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5c0f4be-4108-4196-ae9e-6afc14388a16 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:19.514009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5c0f4be-4108-4196-ae9e-6afc14388a16 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:19.514455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5c0f4be-4108-4196-ae9e-6afc14388a16 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:19.651811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b5c0f4be-4108-4196-ae9e-6afc14388a16 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:19.660239 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b5c0f4be-4108-4196-ae9e-6afc14388a16 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1732 microversion: 2.1 time: 0.159849 Jan 22 22:11:19.660802 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4469/9233] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:19 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:20.677256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a16c2e7-6393-48a1-b436-308f41ec29c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:20.677864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a16c2e7-6393-48a1-b436-308f41ec29c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:20.684572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a16c2e7-6393-48a1-b436-308f41ec29c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:20.685040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a16c2e7-6393-48a1-b436-308f41ec29c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:20.685870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a16c2e7-6393-48a1-b436-308f41ec29c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:20.686327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a16c2e7-6393-48a1-b436-308f41ec29c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:20.848105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6a16c2e7-6393-48a1-b436-308f41ec29c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:20.848105 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a16c2e7-6393-48a1-b436-308f41ec29c2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1732 microversion: 2.1 time: 0.164868 Jan 22 22:11:20.848105 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4765/9234] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:20 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:21.855337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a83c5aef-64f2-43f3-9401-7d17e7a212de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:21.855947 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a83c5aef-64f2-43f3-9401-7d17e7a212de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:21.862957 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a83c5aef-64f2-43f3-9401-7d17e7a212de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:21.863420 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a83c5aef-64f2-43f3-9401-7d17e7a212de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:21.864219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a83c5aef-64f2-43f3-9401-7d17e7a212de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:21.864670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a83c5aef-64f2-43f3-9401-7d17e7a212de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:21.995211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a83c5aef-64f2-43f3-9401-7d17e7a212de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:22.004227 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a83c5aef-64f2-43f3-9401-7d17e7a212de tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1732 microversion: 2.1 time: 0.152918 Jan 22 22:11:22.004817 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4470/9235] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:21 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:23.021683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-afba7e4e-3308-4a06-b2dc-1464ed5864f5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:23.022321 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-afba7e4e-3308-4a06-b2dc-1464ed5864f5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:23.029126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afba7e4e-3308-4a06-b2dc-1464ed5864f5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:23.029646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afba7e4e-3308-4a06-b2dc-1464ed5864f5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:23.030462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afba7e4e-3308-4a06-b2dc-1464ed5864f5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:23.030929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afba7e4e-3308-4a06-b2dc-1464ed5864f5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:23.167391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-afba7e4e-3308-4a06-b2dc-1464ed5864f5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:23.175810 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-afba7e4e-3308-4a06-b2dc-1464ed5864f5 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1732 microversion: 2.1 time: 0.158076 Jan 22 22:11:23.176385 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4766/9236] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:23 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:24.193283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e92cc6b5-6344-42fe-a604-5a1d437ae00f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:24.194055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e92cc6b5-6344-42fe-a604-5a1d437ae00f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:24.201883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e92cc6b5-6344-42fe-a604-5a1d437ae00f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:24.202344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e92cc6b5-6344-42fe-a604-5a1d437ae00f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:24.203149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e92cc6b5-6344-42fe-a604-5a1d437ae00f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:24.203599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e92cc6b5-6344-42fe-a604-5a1d437ae00f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:24.346415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e92cc6b5-6344-42fe-a604-5a1d437ae00f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:24.355191 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e92cc6b5-6344-42fe-a604-5a1d437ae00f tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1732 microversion: 2.1 time: 0.166204 Jan 22 22:11:24.355770 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4471/9237] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:24 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:25.372053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-070c4bb2-9797-42df-8257-a1d2fe43de8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:25.372693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-070c4bb2-9797-42df-8257-a1d2fe43de8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:25.379807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-070c4bb2-9797-42df-8257-a1d2fe43de8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:25.380283 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-070c4bb2-9797-42df-8257-a1d2fe43de8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:25.381105 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-070c4bb2-9797-42df-8257-a1d2fe43de8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:25.381605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-070c4bb2-9797-42df-8257-a1d2fe43de8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:25.511421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-070c4bb2-9797-42df-8257-a1d2fe43de8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:25.519935 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-070c4bb2-9797-42df-8257-a1d2fe43de8d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1732 microversion: 2.1 time: 0.151626 Jan 22 22:11:25.520532 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4767/9238] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:25 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:26.536517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d872d36f-6897-4ed8-bbb6-f3293d4c1595 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:26.537216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d872d36f-6897-4ed8-bbb6-f3293d4c1595 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:26.544310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d872d36f-6897-4ed8-bbb6-f3293d4c1595 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:26.544772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d872d36f-6897-4ed8-bbb6-f3293d4c1595 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:26.545598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d872d36f-6897-4ed8-bbb6-f3293d4c1595 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:26.546052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d872d36f-6897-4ed8-bbb6-f3293d4c1595 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:26.681871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d872d36f-6897-4ed8-bbb6-f3293d4c1595 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:26.690565 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d872d36f-6897-4ed8-bbb6-f3293d4c1595 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1732 microversion: 2.1 time: 0.158290 Jan 22 22:11:26.691153 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4472/9239] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:26 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:27.708300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bab49663-9e23-47e7-8059-de58fae1a47b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:27.708720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bab49663-9e23-47e7-8059-de58fae1a47b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:27.716876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bab49663-9e23-47e7-8059-de58fae1a47b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:27.717342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bab49663-9e23-47e7-8059-de58fae1a47b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:27.718181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bab49663-9e23-47e7-8059-de58fae1a47b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:27.718637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bab49663-9e23-47e7-8059-de58fae1a47b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:27.854562 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bab49663-9e23-47e7-8059-de58fae1a47b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:27.863065 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bab49663-9e23-47e7-8059-de58fae1a47b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1732 microversion: 2.1 time: 0.159493 Jan 22 22:11:27.863642 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4768/9240] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:27 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:28.766744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-bda27487-1a04-46dd-a378-d23b71264287 req-c268a0b4-9e22-497d-a5c2-2696e639d450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec51a754-f593-4092-9576-bcc7ae40474c", "name": "network-vif-unplugged", "status": "completed", "tag": "90a83623-9a26-44c1-88ee-1101a43e6d5f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:11:28.768325 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:11:28.768325 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:11:28.775277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bda27487-1a04-46dd-a378-d23b71264287 req-c268a0b4-9e22-497d-a5c2-2696e639d450 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:28.779864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-bda27487-1a04-46dd-a378-d23b71264287 req-c268a0b4-9e22-497d-a5c2-2696e639d450 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:28.787911 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-bda27487-1a04-46dd-a378-d23b71264287 req-c268a0b4-9e22-497d-a5c2-2696e639d450 service nova] Creating event network-vif-unplugged:90a83623-9a26-44c1-88ee-1101a43e6d5f for instance ec51a754-f593-4092-9576-bcc7ae40474c on nch2-master-1 Jan 22 22:11:28.793295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-bda27487-1a04-46dd-a378-d23b71264287 req-c268a0b4-9e22-497d-a5c2-2696e639d450 service nova] Instance ec51a754-f593-4092-9576-bcc7ae40474c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:11:28.805261 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-bda27487-1a04-46dd-a378-d23b71264287 req-c268a0b4-9e22-497d-a5c2-2696e639d450 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096356 Jan 22 22:11:28.807768 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4473/9241] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:11:28.880430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a6b10a7b-9b3e-4bae-94de-81e9238a5c2d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:28.884307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a6b10a7b-9b3e-4bae-94de-81e9238a5c2d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:28.895475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6b10a7b-9b3e-4bae-94de-81e9238a5c2d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:28.902803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6b10a7b-9b3e-4bae-94de-81e9238a5c2d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:28.902803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6b10a7b-9b3e-4bae-94de-81e9238a5c2d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:28.902803 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6b10a7b-9b3e-4bae-94de-81e9238a5c2d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:29.158124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a6b10a7b-9b3e-4bae-94de-81e9238a5c2d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:29.166175 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a6b10a7b-9b3e-4bae-94de-81e9238a5c2d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1731 microversion: 2.1 time: 0.289866 Jan 22 22:11:29.166754 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4769/9242] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:28 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1731 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:30.185517 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b939071a-8983-4ee2-b3e7-a500d57c31f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:30.186274 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b939071a-8983-4ee2-b3e7-a500d57c31f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:30.193975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b939071a-8983-4ee2-b3e7-a500d57c31f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:30.198627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b939071a-8983-4ee2-b3e7-a500d57c31f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:30.198627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b939071a-8983-4ee2-b3e7-a500d57c31f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:30.198627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b939071a-8983-4ee2-b3e7-a500d57c31f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:30.338818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b939071a-8983-4ee2-b3e7-a500d57c31f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:30.347395 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b939071a-8983-4ee2-b3e7-a500d57c31f2 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1729 microversion: 2.1 time: 0.166949 Jan 22 22:11:30.347973 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4474/9243] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:30 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:30.831973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-00b07d56-c8cf-4698-b7b8-82b8b287ada1 req-cef798ef-a4dd-4bad-b92b-8fa837df4bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec51a754-f593-4092-9576-bcc7ae40474c", "tag": "90a83623-9a26-44c1-88ee-1101a43e6d5f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:11:30.833698 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:11:30.833698 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:11:30.841431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-00b07d56-c8cf-4698-b7b8-82b8b287ada1 req-cef798ef-a4dd-4bad-b92b-8fa837df4bf5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:30.841943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-00b07d56-c8cf-4698-b7b8-82b8b287ada1 req-cef798ef-a4dd-4bad-b92b-8fa837df4bf5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:30.854506 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-00b07d56-c8cf-4698-b7b8-82b8b287ada1 req-cef798ef-a4dd-4bad-b92b-8fa837df4bf5 service nova] Creating event network-changed:90a83623-9a26-44c1-88ee-1101a43e6d5f for instance ec51a754-f593-4092-9576-bcc7ae40474c on nch2-master-1 Jan 22 22:11:30.860137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-00b07d56-c8cf-4698-b7b8-82b8b287ada1 req-cef798ef-a4dd-4bad-b92b-8fa837df4bf5 service nova] Instance ec51a754-f593-4092-9576-bcc7ae40474c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:11:30.872069 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-00b07d56-c8cf-4698-b7b8-82b8b287ada1 req-cef798ef-a4dd-4bad-b92b-8fa837df4bf5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043696 Jan 22 22:11:30.872673 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4770/9244] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:11:31.366887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f8e0496c-e735-4f6d-b07d-51e670e6e0d3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:31.368318 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f8e0496c-e735-4f6d-b07d-51e670e6e0d3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:31.379871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8e0496c-e735-4f6d-b07d-51e670e6e0d3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:31.380680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8e0496c-e735-4f6d-b07d-51e670e6e0d3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:31.381826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8e0496c-e735-4f6d-b07d-51e670e6e0d3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:31.382746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8e0496c-e735-4f6d-b07d-51e670e6e0d3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:31.550022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f8e0496c-e735-4f6d-b07d-51e670e6e0d3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:31.558417 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f8e0496c-e735-4f6d-b07d-51e670e6e0d3 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1729 microversion: 2.1 time: 0.198149 Jan 22 22:11:31.559010 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4475/9245] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:31 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:32.577351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8ee7b436-717a-45d1-9555-5de7b885eded tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:32.578100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8ee7b436-717a-45d1-9555-5de7b885eded tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:32.585035 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ee7b436-717a-45d1-9555-5de7b885eded tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:32.585525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ee7b436-717a-45d1-9555-5de7b885eded tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:32.586352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ee7b436-717a-45d1-9555-5de7b885eded tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:32.586820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8ee7b436-717a-45d1-9555-5de7b885eded tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:32.724187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8ee7b436-717a-45d1-9555-5de7b885eded tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:32.732524 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8ee7b436-717a-45d1-9555-5de7b885eded tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1729 microversion: 2.1 time: 0.160098 Jan 22 22:11:32.733099 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4771/9246] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:32 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:33.749646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-375b288b-8192-41c8-b3d4-5acbbddb3c4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:33.750205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-375b288b-8192-41c8-b3d4-5acbbddb3c4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:33.757764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-375b288b-8192-41c8-b3d4-5acbbddb3c4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:33.758223 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-375b288b-8192-41c8-b3d4-5acbbddb3c4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:33.759030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-375b288b-8192-41c8-b3d4-5acbbddb3c4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:33.759475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-375b288b-8192-41c8-b3d4-5acbbddb3c4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:33.894444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-375b288b-8192-41c8-b3d4-5acbbddb3c4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:33.902483 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-375b288b-8192-41c8-b3d4-5acbbddb3c4d tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1729 microversion: 2.1 time: 0.156717 Jan 22 22:11:33.903634 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4476/9247] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:33 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:34.685183 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:11:34.685789 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:11:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:11:34.920512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5eca4cab-af94-4ebb-8891-63b07aca0352 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:34.921134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5eca4cab-af94-4ebb-8891-63b07aca0352 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:34.938009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eca4cab-af94-4ebb-8891-63b07aca0352 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:34.938426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eca4cab-af94-4ebb-8891-63b07aca0352 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:34.940126 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eca4cab-af94-4ebb-8891-63b07aca0352 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:34.940592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5eca4cab-af94-4ebb-8891-63b07aca0352 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:35.019920 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:11:35.020770 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:11:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c (ip 10.222.0.100) !!! Jan 22 22:11:35.083641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5eca4cab-af94-4ebb-8891-63b07aca0352 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:35.091917 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5eca4cab-af94-4ebb-8891-63b07aca0352 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1729 microversion: 2.1 time: 0.175079 Jan 22 22:11:35.092513 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4772/9248] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:34 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:36.109149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48ddec42-8a28-4198-b9c9-261065b57d36 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:36.109793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48ddec42-8a28-4198-b9c9-261065b57d36 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:36.117338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48ddec42-8a28-4198-b9c9-261065b57d36 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:36.117908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48ddec42-8a28-4198-b9c9-261065b57d36 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:36.118692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48ddec42-8a28-4198-b9c9-261065b57d36 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:36.119137 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48ddec42-8a28-4198-b9c9-261065b57d36 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:36.251687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-48ddec42-8a28-4198-b9c9-261065b57d36 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:36.259734 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48ddec42-8a28-4198-b9c9-261065b57d36 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1729 microversion: 2.1 time: 0.154330 Jan 22 22:11:36.260543 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4477/9249] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:36 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:37.276014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dd6d8eba-f19e-40f5-8da8-8db6d087063e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:37.276629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dd6d8eba-f19e-40f5-8da8-8db6d087063e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:37.283601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd6d8eba-f19e-40f5-8da8-8db6d087063e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:37.284076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd6d8eba-f19e-40f5-8da8-8db6d087063e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:37.284892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd6d8eba-f19e-40f5-8da8-8db6d087063e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:37.285360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd6d8eba-f19e-40f5-8da8-8db6d087063e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:37.421127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dd6d8eba-f19e-40f5-8da8-8db6d087063e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:37.430298 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dd6d8eba-f19e-40f5-8da8-8db6d087063e tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1726 microversion: 2.1 time: 0.157938 Jan 22 22:11:37.430831 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4773/9250] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:37 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:37.447524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:11:37.448087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:37.456365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:37.456830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:37.457661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:37.458113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:37.493564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:37.494026 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:37.494853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:37.495303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:37.515507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for project af530edb3b084c18bf5595f46cffdf35. Resources: {'cores', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:11:37.520598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Getting quotas for user d51f7a75cf6144f0b3bf7e63fcea6827 and project af530edb3b084c18bf5595f46cffdf35. Resources: {'cores', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:11:37.913896 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1bbe8c5e-6748-47dc-9d88-b571ec473cbb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action" status: 202 len: 0 microversion: 2.1 time: 0.469866 Jan 22 22:11:37.914522 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4478/9251] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:11:37 2022] POST /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:11:37.922756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-41aae2ab-203c-4674-9fa0-e6072edbcc33 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:37.923420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-41aae2ab-203c-4674-9fa0-e6072edbcc33 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:37.929874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41aae2ab-203c-4674-9fa0-e6072edbcc33 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:37.930396 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41aae2ab-203c-4674-9fa0-e6072edbcc33 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:37.931216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41aae2ab-203c-4674-9fa0-e6072edbcc33 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:37.931807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41aae2ab-203c-4674-9fa0-e6072edbcc33 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:38.138716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-41aae2ab-203c-4674-9fa0-e6072edbcc33 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:38.147463 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-41aae2ab-203c-4674-9fa0-e6072edbcc33 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1725 microversion: 2.1 time: 0.228544 Jan 22 22:11:38.148146 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4774/9252] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:37 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:39.166267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8fe40dc7-0b13-4de2-b400-5c1198ec8670 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:39.167001 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8fe40dc7-0b13-4de2-b400-5c1198ec8670 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:39.173221 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fe40dc7-0b13-4de2-b400-5c1198ec8670 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:39.173650 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fe40dc7-0b13-4de2-b400-5c1198ec8670 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:39.175106 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fe40dc7-0b13-4de2-b400-5c1198ec8670 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:39.175544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8fe40dc7-0b13-4de2-b400-5c1198ec8670 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:39.317094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8fe40dc7-0b13-4de2-b400-5c1198ec8670 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:39.325296 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8fe40dc7-0b13-4de2-b400-5c1198ec8670 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1725 microversion: 2.1 time: 0.164123 Jan 22 22:11:39.325903 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4479/9253] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:39 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:40.342957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e9860109-71a0-4a11-a14f-ab180339b99a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:40.343590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e9860109-71a0-4a11-a14f-ab180339b99a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:40.351218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9860109-71a0-4a11-a14f-ab180339b99a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:40.351691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9860109-71a0-4a11-a14f-ab180339b99a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:40.352508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9860109-71a0-4a11-a14f-ab180339b99a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:40.352970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e9860109-71a0-4a11-a14f-ab180339b99a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:40.495694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e9860109-71a0-4a11-a14f-ab180339b99a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:40.504080 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e9860109-71a0-4a11-a14f-ab180339b99a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1725 microversion: 2.1 time: 0.164923 Jan 22 22:11:40.504866 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4775/9254] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:40 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:40.638665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-8e7fefc1-fe08-4131-bb04-d7b8b3dc637a req-8d4030f0-8d26-4da6-aa96-a0572b5b34d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec51a754-f593-4092-9576-bcc7ae40474c", "name": "network-vif-plugged", "status": "completed", "tag": "90a83623-9a26-44c1-88ee-1101a43e6d5f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:11:40.640185 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:11:40.640185 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:11:40.647959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8e7fefc1-fe08-4131-bb04-d7b8b3dc637a req-8d4030f0-8d26-4da6-aa96-a0572b5b34d9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:40.649220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8e7fefc1-fe08-4131-bb04-d7b8b3dc637a req-8d4030f0-8d26-4da6-aa96-a0572b5b34d9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:40.660588 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8e7fefc1-fe08-4131-bb04-d7b8b3dc637a req-8d4030f0-8d26-4da6-aa96-a0572b5b34d9 service nova] Creating event network-vif-plugged:90a83623-9a26-44c1-88ee-1101a43e6d5f for instance ec51a754-f593-4092-9576-bcc7ae40474c on nch2-master-1 Jan 22 22:11:40.665843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-8e7fefc1-fe08-4131-bb04-d7b8b3dc637a req-8d4030f0-8d26-4da6-aa96-a0572b5b34d9 service nova] Instance ec51a754-f593-4092-9576-bcc7ae40474c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:11:40.677451 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-8e7fefc1-fe08-4131-bb04-d7b8b3dc637a req-8d4030f0-8d26-4da6-aa96-a0572b5b34d9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094791 Jan 22 22:11:40.678258 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4480/9255] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:11:41.520945 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7cf8d137-21f3-41d4-a129-61dd6e0bbf08 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:41.521602 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7cf8d137-21f3-41d4-a129-61dd6e0bbf08 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:41.528002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cf8d137-21f3-41d4-a129-61dd6e0bbf08 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:41.528483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cf8d137-21f3-41d4-a129-61dd6e0bbf08 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:41.529298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cf8d137-21f3-41d4-a129-61dd6e0bbf08 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:41.529811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cf8d137-21f3-41d4-a129-61dd6e0bbf08 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:41.668645 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7cf8d137-21f3-41d4-a129-61dd6e0bbf08 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:41.677133 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7cf8d137-21f3-41d4-a129-61dd6e0bbf08 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1725 microversion: 2.1 time: 0.159897 Jan 22 22:11:41.677754 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4776/9256] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:41 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:42.456311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-8a182ab3-47ba-4323-a61f-435108cda1e1 req-53076de8-c879-4cb8-b634-b44649b91660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec51a754-f593-4092-9576-bcc7ae40474c", "name": "network-vif-unplugged", "status": "completed", "tag": "90a83623-9a26-44c1-88ee-1101a43e6d5f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:11:42.457931 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:11:42.457931 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:11:42.465120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8a182ab3-47ba-4323-a61f-435108cda1e1 req-53076de8-c879-4cb8-b634-b44649b91660 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:42.465544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8a182ab3-47ba-4323-a61f-435108cda1e1 req-53076de8-c879-4cb8-b634-b44649b91660 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:42.477282 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8a182ab3-47ba-4323-a61f-435108cda1e1 req-53076de8-c879-4cb8-b634-b44649b91660 service nova] Creating event network-vif-unplugged:90a83623-9a26-44c1-88ee-1101a43e6d5f for instance ec51a754-f593-4092-9576-bcc7ae40474c on nch1-master-1 Jan 22 22:11:42.482820 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-8a182ab3-47ba-4323-a61f-435108cda1e1 req-53076de8-c879-4cb8-b634-b44649b91660 service nova] Instance ec51a754-f593-4092-9576-bcc7ae40474c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:11:42.493993 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-8a182ab3-47ba-4323-a61f-435108cda1e1 req-53076de8-c879-4cb8-b634-b44649b91660 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112028 Jan 22 22:11:42.497999 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4481/9257] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:11:42.697863 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-645d7248-45ce-439c-85ca-fc087e7218d4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:42.699099 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-645d7248-45ce-439c-85ca-fc087e7218d4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:42.706459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-645d7248-45ce-439c-85ca-fc087e7218d4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:42.706929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-645d7248-45ce-439c-85ca-fc087e7218d4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:42.707758 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-645d7248-45ce-439c-85ca-fc087e7218d4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:42.708356 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-645d7248-45ce-439c-85ca-fc087e7218d4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:42.847386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-645d7248-45ce-439c-85ca-fc087e7218d4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:42.856229 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-645d7248-45ce-439c-85ca-fc087e7218d4 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1725 microversion: 2.1 time: 0.165514 Jan 22 22:11:42.856925 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4777/9258] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:42 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:43.875295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-866237fd-759b-4f35-98d0-fbf4fd67daf1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:43.876060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-866237fd-759b-4f35-98d0-fbf4fd67daf1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:43.882587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-866237fd-759b-4f35-98d0-fbf4fd67daf1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:43.883045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-866237fd-759b-4f35-98d0-fbf4fd67daf1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:43.883856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-866237fd-759b-4f35-98d0-fbf4fd67daf1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:43.884372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-866237fd-759b-4f35-98d0-fbf4fd67daf1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:44.018937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-866237fd-759b-4f35-98d0-fbf4fd67daf1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:44.036974 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-866237fd-759b-4f35-98d0-fbf4fd67daf1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1725 microversion: 2.1 time: 0.166682 Jan 22 22:11:44.037597 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4482/9259] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:43 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:44.508950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-0d586292-db9d-4b9b-b1db-be55597b1e77 req-472645be-ad24-405a-885a-621ed10c4a9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec51a754-f593-4092-9576-bcc7ae40474c", "tag": "90a83623-9a26-44c1-88ee-1101a43e6d5f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:11:44.510699 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:11:44.510699 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:11:44.518593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0d586292-db9d-4b9b-b1db-be55597b1e77 req-472645be-ad24-405a-885a-621ed10c4a9a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:44.519102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0d586292-db9d-4b9b-b1db-be55597b1e77 req-472645be-ad24-405a-885a-621ed10c4a9a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:44.530897 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-0d586292-db9d-4b9b-b1db-be55597b1e77 req-472645be-ad24-405a-885a-621ed10c4a9a service nova] Creating event network-changed:90a83623-9a26-44c1-88ee-1101a43e6d5f for instance ec51a754-f593-4092-9576-bcc7ae40474c on nch1-master-1 Jan 22 22:11:44.537119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-0d586292-db9d-4b9b-b1db-be55597b1e77 req-472645be-ad24-405a-885a-621ed10c4a9a service nova] Instance ec51a754-f593-4092-9576-bcc7ae40474c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:11:44.547580 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-0d586292-db9d-4b9b-b1db-be55597b1e77 req-472645be-ad24-405a-885a-621ed10c4a9a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042500 Jan 22 22:11:44.548097 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4778/9260] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:11:45.054834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e0730834-b6a0-4b95-b92c-7e5aad02ee38 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:45.055886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e0730834-b6a0-4b95-b92c-7e5aad02ee38 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:45.062853 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0730834-b6a0-4b95-b92c-7e5aad02ee38 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:45.063443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0730834-b6a0-4b95-b92c-7e5aad02ee38 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:45.064357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0730834-b6a0-4b95-b92c-7e5aad02ee38 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:45.065077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0730834-b6a0-4b95-b92c-7e5aad02ee38 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:45.202187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e0730834-b6a0-4b95-b92c-7e5aad02ee38 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:45.210380 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e0730834-b6a0-4b95-b92c-7e5aad02ee38 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1725 microversion: 2.1 time: 0.160542 Jan 22 22:11:45.210985 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4483/9261] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:45 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:11:46.230048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-41995081-60b0-4b8d-957a-36fd20e8a5cb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:46.230767 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-41995081-60b0-4b8d-957a-36fd20e8a5cb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:46.237150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41995081-60b0-4b8d-957a-36fd20e8a5cb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:46.237663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41995081-60b0-4b8d-957a-36fd20e8a5cb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:46.238507 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41995081-60b0-4b8d-957a-36fd20e8a5cb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:46.238972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41995081-60b0-4b8d-957a-36fd20e8a5cb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:46.373930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-41995081-60b0-4b8d-957a-36fd20e8a5cb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:46.382696 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-41995081-60b0-4b8d-957a-36fd20e8a5cb tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1725 microversion: 2.1 time: 0.158726 Jan 22 22:11:46.383289 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4779/9262] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:46 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:47.401088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2e162023-b402-4c58-af0f-94e52609c325 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:47.401752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2e162023-b402-4c58-af0f-94e52609c325 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:47.408562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e162023-b402-4c58-af0f-94e52609c325 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:47.409022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e162023-b402-4c58-af0f-94e52609c325 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:47.409835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e162023-b402-4c58-af0f-94e52609c325 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:47.410289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e162023-b402-4c58-af0f-94e52609c325 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:47.546591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2e162023-b402-4c58-af0f-94e52609c325 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:47.555410 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2e162023-b402-4c58-af0f-94e52609c325 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1725 microversion: 2.1 time: 0.158196 Jan 22 22:11:47.555992 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4484/9263] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:47 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:48.572341 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ff23d4d4-54b6-4562-a865-9f9c6f17426c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:48.573042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ff23d4d4-54b6-4562-a865-9f9c6f17426c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:48.580065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff23d4d4-54b6-4562-a865-9f9c6f17426c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:48.580570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff23d4d4-54b6-4562-a865-9f9c6f17426c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:48.581470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff23d4d4-54b6-4562-a865-9f9c6f17426c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:48.581986 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ff23d4d4-54b6-4562-a865-9f9c6f17426c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:48.724207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ff23d4d4-54b6-4562-a865-9f9c6f17426c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:48.736814 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ff23d4d4-54b6-4562-a865-9f9c6f17426c tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1718 microversion: 2.1 time: 0.167850 Jan 22 22:11:48.737778 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4780/9264] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:48 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1718 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:48.755855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eb7d20d6-c834-445f-a20e-954edd88d9bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:48.756612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eb7d20d6-c834-445f-a20e-954edd88d9bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:48.763564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb7d20d6-c834-445f-a20e-954edd88d9bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:48.764022 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb7d20d6-c834-445f-a20e-954edd88d9bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:48.764821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb7d20d6-c834-445f-a20e-954edd88d9bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:48.765265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eb7d20d6-c834-445f-a20e-954edd88d9bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:48.903681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eb7d20d6-c834-445f-a20e-954edd88d9bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:48.912641 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eb7d20d6-c834-445f-a20e-954edd88d9bc tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1718 microversion: 2.1 time: 0.161365 Jan 22 22:11:48.913245 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4485/9265] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:48 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:48.929012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b143b1d5-0a51-4b6e-8677-4ab34ba816fe tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:48.929581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b143b1d5-0a51-4b6e-8677-4ab34ba816fe tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:48.935513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b143b1d5-0a51-4b6e-8677-4ab34ba816fe tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:48.935985 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b143b1d5-0a51-4b6e-8677-4ab34ba816fe tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:48.936785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b143b1d5-0a51-4b6e-8677-4ab34ba816fe tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:48.937239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b143b1d5-0a51-4b6e-8677-4ab34ba816fe tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:49.068908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b143b1d5-0a51-4b6e-8677-4ab34ba816fe tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:49.076968 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b143b1d5-0a51-4b6e-8677-4ab34ba816fe tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1718 microversion: 2.1 time: 0.152196 Jan 22 22:11:49.077567 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4781/9266] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:48 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:49.093712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ef6dc410-3192-4089-8ccd-b9bb6f9672b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:49.094247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ef6dc410-3192-4089-8ccd-b9bb6f9672b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:49.100436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef6dc410-3192-4089-8ccd-b9bb6f9672b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:49.104635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef6dc410-3192-4089-8ccd-b9bb6f9672b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:49.104635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef6dc410-3192-4089-8ccd-b9bb6f9672b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:49.104635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ef6dc410-3192-4089-8ccd-b9bb6f9672b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:49.127615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ef6dc410-3192-4089-8ccd-b9bb6f9672b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:11:49.418590 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ef6dc410-3192-4089-8ccd-b9bb6f9672b0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 204 len: 0 microversion: 2.1 time: 0.328282 Jan 22 22:11:49.419204 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4486/9267] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:11:49 2022] DELETE /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:11:49.428045 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-880d84c2-05b5-4d5e-b3bc-078acf5c2ca1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:49.428869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-880d84c2-05b5-4d5e-b3bc-078acf5c2ca1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:49.435413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-880d84c2-05b5-4d5e-b3bc-078acf5c2ca1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:49.435891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-880d84c2-05b5-4d5e-b3bc-078acf5c2ca1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:49.436707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-880d84c2-05b5-4d5e-b3bc-078acf5c2ca1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:49.437231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-880d84c2-05b5-4d5e-b3bc-078acf5c2ca1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:49.573133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-880d84c2-05b5-4d5e-b3bc-078acf5c2ca1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:49.581602 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-880d84c2-05b5-4d5e-b3bc-078acf5c2ca1 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1724 microversion: 2.1 time: 0.157920 Jan 22 22:11:49.582187 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4782/9268] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:49 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:50.601532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b0d9149f-eeb3-4fff-bec1-9aa6478fe074 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:50.602280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b0d9149f-eeb3-4fff-bec1-9aa6478fe074 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:50.609244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0d9149f-eeb3-4fff-bec1-9aa6478fe074 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:50.609744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0d9149f-eeb3-4fff-bec1-9aa6478fe074 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:50.610528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0d9149f-eeb3-4fff-bec1-9aa6478fe074 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:50.610966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0d9149f-eeb3-4fff-bec1-9aa6478fe074 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:50.743056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b0d9149f-eeb3-4fff-bec1-9aa6478fe074 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:50.759488 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b0d9149f-eeb3-4fff-bec1-9aa6478fe074 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1724 microversion: 2.1 time: 0.161975 Jan 22 22:11:50.760083 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4487/9269] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:50 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:51.091942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-42127c0c-9628-4a36-a972-ac53a61d49b6 req-c74fafd6-0636-4b45-9377-75694a62a858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec51a754-f593-4092-9576-bcc7ae40474c", "name": "network-vif-plugged", "status": "completed", "tag": "90a83623-9a26-44c1-88ee-1101a43e6d5f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:11:51.093532 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:11:51.093532 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:11:51.102038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-42127c0c-9628-4a36-a972-ac53a61d49b6 req-c74fafd6-0636-4b45-9377-75694a62a858 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:51.102514 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-42127c0c-9628-4a36-a972-ac53a61d49b6 req-c74fafd6-0636-4b45-9377-75694a62a858 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:51.114251 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-42127c0c-9628-4a36-a972-ac53a61d49b6 req-c74fafd6-0636-4b45-9377-75694a62a858 service nova] Creating event network-vif-plugged:90a83623-9a26-44c1-88ee-1101a43e6d5f for instance ec51a754-f593-4092-9576-bcc7ae40474c on nch1-master-1 Jan 22 22:11:51.119394 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-42127c0c-9628-4a36-a972-ac53a61d49b6 req-c74fafd6-0636-4b45-9377-75694a62a858 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031271 Jan 22 22:11:51.119996 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4783/9270] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:11:51.777554 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-96501411-c3ae-478c-930b-a97919f88586 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:51.778191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-96501411-c3ae-478c-930b-a97919f88586 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:51.785233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96501411-c3ae-478c-930b-a97919f88586 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:51.786293 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96501411-c3ae-478c-930b-a97919f88586 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:51.787100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96501411-c3ae-478c-930b-a97919f88586 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:51.787594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-96501411-c3ae-478c-930b-a97919f88586 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:51.927876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-96501411-c3ae-478c-930b-a97919f88586 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:51.935836 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-96501411-c3ae-478c-930b-a97919f88586 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1724 microversion: 2.1 time: 0.162067 Jan 22 22:11:51.936399 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4488/9271] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:51 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:52.596731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-68d750bb-2a65-4fe2-98d7-2df697a20fc1 req-15a4b0f4-0680-415f-8691-2613db579dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec51a754-f593-4092-9576-bcc7ae40474c", "name": "network-vif-deleted", "tag": "90a83623-9a26-44c1-88ee-1101a43e6d5f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:11:52.598295 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:11:52.598295 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:11:52.606272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-68d750bb-2a65-4fe2-98d7-2df697a20fc1 req-15a4b0f4-0680-415f-8691-2613db579dda service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:52.606752 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-68d750bb-2a65-4fe2-98d7-2df697a20fc1 req-15a4b0f4-0680-415f-8691-2613db579dda service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:52.618026 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-68d750bb-2a65-4fe2-98d7-2df697a20fc1 req-15a4b0f4-0680-415f-8691-2613db579dda service nova] Creating event network-vif-deleted:90a83623-9a26-44c1-88ee-1101a43e6d5f for instance ec51a754-f593-4092-9576-bcc7ae40474c on nch1-master-1 Jan 22 22:11:52.622886 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-68d750bb-2a65-4fe2-98d7-2df697a20fc1 req-15a4b0f4-0680-415f-8691-2613db579dda service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033619 Jan 22 22:11:52.623613 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4784/9272] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:11:52.953669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c1e93df3-11af-4002-8fa0-ec04d51cd0b7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:52.954392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c1e93df3-11af-4002-8fa0-ec04d51cd0b7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:52.970396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1e93df3-11af-4002-8fa0-ec04d51cd0b7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:52.971787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1e93df3-11af-4002-8fa0-ec04d51cd0b7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:52.972173 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1e93df3-11af-4002-8fa0-ec04d51cd0b7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:52.972635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c1e93df3-11af-4002-8fa0-ec04d51cd0b7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:53.035291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c1e93df3-11af-4002-8fa0-ec04d51cd0b7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd51f7a75cf6144f0b3bf7e63fcea6827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af530edb3b084c18bf5595f46cffdf35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:11:53.043139 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c1e93df3-11af-4002-8fa0-ec04d51cd0b7 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 200 len: 1373 microversion: 2.1 time: 0.093408 Jan 22 22:11:53.043740 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4489/9273] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:52 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 1373 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:11:54.061630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-44b9f22e-d0d5-4d73-bbe4-fb354a0b55af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:54.062351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-44b9f22e-d0d5-4d73-bbe4-fb354a0b55af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:54.069459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44b9f22e-d0d5-4d73-bbe4-fb354a0b55af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:54.069962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44b9f22e-d0d5-4d73-bbe4-fb354a0b55af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:54.070775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44b9f22e-d0d5-4d73-bbe4-fb354a0b55af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:54.071245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44b9f22e-d0d5-4d73-bbe4-fb354a0b55af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:54.085739 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-44b9f22e-d0d5-4d73-bbe4-fb354a0b55af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance ec51a754-f593-4092-9576-bcc7ae40474c could not be found. Jan 22 22:11:54.086370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-44b9f22e-d0d5-4d73-bbe4-fb354a0b55af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance ec51a754-f593-4092-9576-bcc7ae40474c could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:11:54.087209 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-44b9f22e-d0d5-4d73-bbe4-fb354a0b55af tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 404 len: 111 microversion: 2.1 time: 0.030732 Jan 22 22:11:54.087788 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4785/9274] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:54 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:11:54.143901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a5864f61-0397-4a3d-9bab-bae702331104 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:54.144977 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a5864f61-0397-4a3d-9bab-bae702331104 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:54.152589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5864f61-0397-4a3d-9bab-bae702331104 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:54.153198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5864f61-0397-4a3d-9bab-bae702331104 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:54.154098 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5864f61-0397-4a3d-9bab-bae702331104 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:54.154618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a5864f61-0397-4a3d-9bab-bae702331104 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:54.167638 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-a5864f61-0397-4a3d-9bab-bae702331104 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance ec51a754-f593-4092-9576-bcc7ae40474c could not be found. Jan 22 22:11:54.168240 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a5864f61-0397-4a3d-9bab-bae702331104 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance ec51a754-f593-4092-9576-bcc7ae40474c could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:11:54.169082 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a5864f61-0397-4a3d-9bab-bae702331104 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029041 Jan 22 22:11:54.169674 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4490/9275] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 22:11:54 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:11:58.654420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-46c414db-0059-45b8-a58c-46f0638f1d3b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:58.654936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-46c414db-0059-45b8-a58c-46f0638f1d3b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:58.661992 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46c414db-0059-45b8-a58c-46f0638f1d3b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.662492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46c414db-0059-45b8-a58c-46f0638f1d3b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.663297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46c414db-0059-45b8-a58c-46f0638f1d3b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.663760 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-46c414db-0059-45b8-a58c-46f0638f1d3b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.677854 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-46c414db-0059-45b8-a58c-46f0638f1d3b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance ec51a754-f593-4092-9576-bcc7ae40474c could not be found. Jan 22 22:11:58.678452 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-46c414db-0059-45b8-a58c-46f0638f1d3b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance ec51a754-f593-4092-9576-bcc7ae40474c could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:11:58.679317 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-46c414db-0059-45b8-a58c-46f0638f1d3b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 404 len: 111 microversion: 2.1 time: 0.028876 Jan 22 22:11:58.679839 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4786/9276] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:11:58 2022] DELETE /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:11:58.688429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a833ddeb-f5b3-450a-ba57-7415ed2fa29b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:58.689070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a833ddeb-f5b3-450a-ba57-7415ed2fa29b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: ec51a754-f593-4092-9576-bcc7ae40474c] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:58.695904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a833ddeb-f5b3-450a-ba57-7415ed2fa29b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.696358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a833ddeb-f5b3-450a-ba57-7415ed2fa29b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.697235 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a833ddeb-f5b3-450a-ba57-7415ed2fa29b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.697671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a833ddeb-f5b3-450a-ba57-7415ed2fa29b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.710866 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-a833ddeb-f5b3-450a-ba57-7415ed2fa29b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance ec51a754-f593-4092-9576-bcc7ae40474c could not be found. Jan 22 22:11:58.711455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a833ddeb-f5b3-450a-ba57-7415ed2fa29b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance ec51a754-f593-4092-9576-bcc7ae40474c could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:11:58.712777 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a833ddeb-f5b3-450a-ba57-7415ed2fa29b tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c" status: 404 len: 111 microversion: 2.1 time: 0.027637 Jan 22 22:11:58.713305 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4491/9277] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:58 2022] GET /compute/v2.1/servers/ec51a754-f593-4092-9576-bcc7ae40474c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:11:58.721315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f525449-2962-4b3b-ab95-6b02439fd9e0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:58.721870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8f525449-2962-4b3b-ab95-6b02439fd9e0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:58.728628 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f525449-2962-4b3b-ab95-6b02439fd9e0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.729694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f525449-2962-4b3b-ab95-6b02439fd9e0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.731106 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f525449-2962-4b3b-ab95-6b02439fd9e0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.732250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f525449-2962-4b3b-ab95-6b02439fd9e0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.750877 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-8f525449-2962-4b3b-ab95-6b02439fd9e0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 could not be found. Jan 22 22:11:58.751496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f525449-2962-4b3b-ab95-6b02439fd9e0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:11:58.752353 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8f525449-2962-4b3b-ab95-6b02439fd9e0 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "DELETE /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 404 len: 111 microversion: 2.1 time: 0.034849 Jan 22 22:11:58.752910 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4787/9278] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:11:58 2022] DELETE /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:11:58.760752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f52d1a1b-a6bd-4507-8ba4-84efe77f2379 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:58.761387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f52d1a1b-a6bd-4507-8ba4-84efe77f2379 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:58.767371 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f52d1a1b-a6bd-4507-8ba4-84efe77f2379 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.767821 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f52d1a1b-a6bd-4507-8ba4-84efe77f2379 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.768599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f52d1a1b-a6bd-4507-8ba4-84efe77f2379 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.769039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f52d1a1b-a6bd-4507-8ba4-84efe77f2379 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.785275 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-f52d1a1b-a6bd-4507-8ba4-84efe77f2379 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 could not be found. Jan 22 22:11:58.785892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f52d1a1b-a6bd-4507-8ba4-84efe77f2379 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance 7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:11:58.786718 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f52d1a1b-a6bd-4507-8ba4-84efe77f2379 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495" status: 404 len: 111 microversion: 2.1 time: 0.029703 Jan 22 22:11:58.787251 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4492/9279] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:58 2022] GET /compute/v2.1/servers/7dabd5c1-4b94-4c10-8332-9a7dfcbd8495 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:11:58.795718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2da69647-665d-4443-8bea-b16110fe5814 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:58.806662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2da69647-665d-4443-8bea-b16110fe5814 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:58.806662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2da69647-665d-4443-8bea-b16110fe5814 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.806662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2da69647-665d-4443-8bea-b16110fe5814 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.806662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2da69647-665d-4443-8bea-b16110fe5814 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.806662 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2da69647-665d-4443-8bea-b16110fe5814 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.818220 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-2da69647-665d-4443-8bea-b16110fe5814 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance eac993df-5bb7-4ef9-857f-99e4674678cc could not be found. Jan 22 22:11:58.818829 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2da69647-665d-4443-8bea-b16110fe5814 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance eac993df-5bb7-4ef9-857f-99e4674678cc could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:11:58.819670 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2da69647-665d-4443-8bea-b16110fe5814 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "DELETE /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 404 len: 111 microversion: 2.1 time: 0.027776 Jan 22 22:11:58.820210 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4788/9280] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:11:58 2022] DELETE /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:11:58.828103 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-32d29d72-2f23-420c-87ec-2ea6c9a95366 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:58.828781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-32d29d72-2f23-420c-87ec-2ea6c9a95366 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: eac993df-5bb7-4ef9-857f-99e4674678cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:58.834781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32d29d72-2f23-420c-87ec-2ea6c9a95366 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.837956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32d29d72-2f23-420c-87ec-2ea6c9a95366 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.837956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32d29d72-2f23-420c-87ec-2ea6c9a95366 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.837956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-32d29d72-2f23-420c-87ec-2ea6c9a95366 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.851122 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-32d29d72-2f23-420c-87ec-2ea6c9a95366 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance eac993df-5bb7-4ef9-857f-99e4674678cc could not be found. Jan 22 22:11:58.851713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-32d29d72-2f23-420c-87ec-2ea6c9a95366 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance eac993df-5bb7-4ef9-857f-99e4674678cc could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:11:58.852542 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-32d29d72-2f23-420c-87ec-2ea6c9a95366 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc" status: 404 len: 111 microversion: 2.1 time: 0.028135 Jan 22 22:11:58.854076 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4493/9281] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:58 2022] GET /compute/v2.1/servers/eac993df-5bb7-4ef9-857f-99e4674678cc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:11:58.862196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-afda276f-48d5-4e81-b2d3-fae1e236f29a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:58.862712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-afda276f-48d5-4e81-b2d3-fae1e236f29a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:58.868858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afda276f-48d5-4e81-b2d3-fae1e236f29a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.869329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afda276f-48d5-4e81-b2d3-fae1e236f29a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.870213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afda276f-48d5-4e81-b2d3-fae1e236f29a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.870667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-afda276f-48d5-4e81-b2d3-fae1e236f29a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.883822 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-afda276f-48d5-4e81-b2d3-fae1e236f29a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance 95e67ed9-41af-4a15-becf-84fdc7a45619 could not be found. Jan 22 22:11:58.884450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-afda276f-48d5-4e81-b2d3-fae1e236f29a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance 95e67ed9-41af-4a15-becf-84fdc7a45619 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:11:58.885261 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-afda276f-48d5-4e81-b2d3-fae1e236f29a tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "DELETE /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 404 len: 111 microversion: 2.1 time: 0.026752 Jan 22 22:11:58.885816 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4789/9282] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:11:58 2022] DELETE /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:11:58.893468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-62c76c44-c2fc-4977-bf30-4862a474bc91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:58.916269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-62c76c44-c2fc-4977-bf30-4862a474bc91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] [instance: 95e67ed9-41af-4a15-becf-84fdc7a45619] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:11:58.916269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62c76c44-c2fc-4977-bf30-4862a474bc91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.916269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62c76c44-c2fc-4977-bf30-4862a474bc91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.916269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62c76c44-c2fc-4977-bf30-4862a474bc91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:11:58.916269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-62c76c44-c2fc-4977-bf30-4862a474bc91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:11:58.917070 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-62c76c44-c2fc-4977-bf30-4862a474bc91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] HTTP exception thrown: Instance 95e67ed9-41af-4a15-becf-84fdc7a45619 could not be found. Jan 22 22:11:58.917735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-62c76c44-c2fc-4977-bf30-4862a474bc91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Returning 404 to user: Instance 95e67ed9-41af-4a15-becf-84fdc7a45619 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:11:58.918580 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-62c76c44-c2fc-4977-bf30-4862a474bc91 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619" status: 404 len: 111 microversion: 2.1 time: 0.028750 Jan 22 22:11:58.919134 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4494/9283] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:11:58 2022] GET /compute/v2.1/servers/95e67ed9-41af-4a15-becf-84fdc7a45619 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:11:58.927052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5be54e88-86ae-4bf7-9c4f-dbc488f81924 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] Calling method '.version_select at 0x7f1ed5df83a0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:11:59.216354 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5be54e88-86ae-4bf7-9c4f-dbc488f81924 tempest-ServerActionsTestJSON-602623794 tempest-ServerActionsTestJSON-602623794-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-908140357" status: 202 len: 0 microversion: 2.1 time: 0.292775 Jan 22 22:11:59.216921 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4790/9284] 10.222.0.100 () {58 vars in 1222 bytes} [Sat Jan 22 22:11:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-908140357 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:12:07.092738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-504736158", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "762f2e39-11db-4d42-92a5-6018f23cc3eb"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:12:07.144132 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] validate_networks() for [('762f2e39-11db-4d42-92a5-6018f23cc3eb', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:12:07.480931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:12:07.481366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:12:07.481891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:12:07.482347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:12:07.482805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:12:07.491661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:07.492127 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:07.492958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:07.494152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:07.510627 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Getting quotas for project 9aeee610f18c4c75aa5e44535628a42e. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:12:07.515811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Getting quotas for user b069b2066b2b4b9ea7241de23f07d5e8 and project 9aeee610f18c4c75aa5e44535628a42e. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:12:07.527806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:12:07.530180 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:12:07.627762 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c7528674-7982-4bc8-acc5-65790c7ba171 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.645508 Jan 22 22:12:07.628418 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4495/9285] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:12:06 2022] POST /compute/v2.1/servers => generated 382 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 22:12:07.638509 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d624436b-a4a3-497a-96bf-99fc89b609e6 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:07.639140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d624436b-a4a3-497a-96bf-99fc89b609e6 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:07.694642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d624436b-a4a3-497a-96bf-99fc89b609e6 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:07.702743 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d624436b-a4a3-497a-96bf-99fc89b609e6 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1220 microversion: 2.1 time: 0.068195 Jan 22 22:12:07.703398 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4791/9286] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:07 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1220 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:08.720391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7a54209f-3312-48d2-abe2-dd5088c5d0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:08.721095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7a54209f-3312-48d2-abe2-dd5088c5d0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:08.728114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a54209f-3312-48d2-abe2-dd5088c5d0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:08.729021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a54209f-3312-48d2-abe2-dd5088c5d0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:08.731500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a54209f-3312-48d2-abe2-dd5088c5d0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:08.731500 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7a54209f-3312-48d2-abe2-dd5088c5d0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:08.791851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7a54209f-3312-48d2-abe2-dd5088c5d0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:08.799609 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7a54209f-3312-48d2-abe2-dd5088c5d0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1224 microversion: 2.1 time: 0.083838 Jan 22 22:12:08.800188 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4496/9287] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:08 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:09.816231 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-64913dc6-a381-4a09-895d-4148d90677ae tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:09.817297 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-64913dc6-a381-4a09-895d-4148d90677ae tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:09.824917 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64913dc6-a381-4a09-895d-4148d90677ae tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:09.825699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64913dc6-a381-4a09-895d-4148d90677ae tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:09.826785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64913dc6-a381-4a09-895d-4148d90677ae tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:09.827576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-64913dc6-a381-4a09-895d-4148d90677ae tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:09.901490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-64913dc6-a381-4a09-895d-4148d90677ae tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:09.908936 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-64913dc6-a381-4a09-895d-4148d90677ae tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1290 microversion: 2.1 time: 0.096655 Jan 22 22:12:09.909752 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4792/9288] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:09 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1290 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:10.927522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5d114fde-de78-4147-aec4-2e995124a918 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:10.928142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5d114fde-de78-4147-aec4-2e995124a918 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:10.935068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d114fde-de78-4147-aec4-2e995124a918 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:10.935537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d114fde-de78-4147-aec4-2e995124a918 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:10.936357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d114fde-de78-4147-aec4-2e995124a918 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:10.936810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5d114fde-de78-4147-aec4-2e995124a918 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:11.081091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5d114fde-de78-4147-aec4-2e995124a918 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:11.092232 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5d114fde-de78-4147-aec4-2e995124a918 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1320 microversion: 2.1 time: 0.168956 Jan 22 22:12:11.093352 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4497/9289] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:10 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1320 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:11.110785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-dabdd9d4-75b8-427e-a070-bb2eb4d0d02b req-1f805535-a03d-4fcb-9ed0-a2bf78290e11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "827d2494-07a5-419a-a3f8-2a4931c2fa9f", "tag": "212be01c-a249-4ecf-b84d-50b7f8f1a12f"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:12:11.113792 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:12:11.113792 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:12:11.122044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-dabdd9d4-75b8-427e-a070-bb2eb4d0d02b req-1f805535-a03d-4fcb-9ed0-a2bf78290e11 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:11.122518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-dabdd9d4-75b8-427e-a070-bb2eb4d0d02b req-1f805535-a03d-4fcb-9ed0-a2bf78290e11 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:11.134095 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-dabdd9d4-75b8-427e-a070-bb2eb4d0d02b req-1f805535-a03d-4fcb-9ed0-a2bf78290e11 service nova] Creating event network-changed:212be01c-a249-4ecf-b84d-50b7f8f1a12f for instance 827d2494-07a5-419a-a3f8-2a4931c2fa9f on nch2-master-1 Jan 22 22:12:11.138617 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-dabdd9d4-75b8-427e-a070-bb2eb4d0d02b req-1f805535-a03d-4fcb-9ed0-a2bf78290e11 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032222 Jan 22 22:12:11.139219 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4793/9290] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:12:12.110118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2cc103d4-ecd9-4581-b2ec-f506af9a44f7 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:12.110728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2cc103d4-ecd9-4581-b2ec-f506af9a44f7 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:12.119029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cc103d4-ecd9-4581-b2ec-f506af9a44f7 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:12.119525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cc103d4-ecd9-4581-b2ec-f506af9a44f7 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:12.120396 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cc103d4-ecd9-4581-b2ec-f506af9a44f7 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:12.120848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2cc103d4-ecd9-4581-b2ec-f506af9a44f7 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:12.253066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2cc103d4-ecd9-4581-b2ec-f506af9a44f7 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:12.260647 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2cc103d4-ecd9-4581-b2ec-f506af9a44f7 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1320 microversion: 2.1 time: 0.154337 Jan 22 22:12:12.261223 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4498/9291] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:12 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:13.278272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-040ea201-1d9c-46fe-ae50-ab1032dbb15d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:13.278980 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-040ea201-1d9c-46fe-ae50-ab1032dbb15d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:13.285177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-040ea201-1d9c-46fe-ae50-ab1032dbb15d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:13.285691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-040ea201-1d9c-46fe-ae50-ab1032dbb15d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:13.286486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-040ea201-1d9c-46fe-ae50-ab1032dbb15d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:13.286941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-040ea201-1d9c-46fe-ae50-ab1032dbb15d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:13.418704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-040ea201-1d9c-46fe-ae50-ab1032dbb15d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:13.426126 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-040ea201-1d9c-46fe-ae50-ab1032dbb15d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1320 microversion: 2.1 time: 0.152969 Jan 22 22:12:13.426695 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4794/9292] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:13 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:14.443332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a486f36b-2907-4e4f-9d65-4394bd407917 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:14.443946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a486f36b-2907-4e4f-9d65-4394bd407917 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:14.451598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a486f36b-2907-4e4f-9d65-4394bd407917 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:14.452052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a486f36b-2907-4e4f-9d65-4394bd407917 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:14.452843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a486f36b-2907-4e4f-9d65-4394bd407917 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:14.453289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a486f36b-2907-4e4f-9d65-4394bd407917 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:14.586579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a486f36b-2907-4e4f-9d65-4394bd407917 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:14.594842 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a486f36b-2907-4e4f-9d65-4394bd407917 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1320 microversion: 2.1 time: 0.155212 Jan 22 22:12:14.595416 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4499/9293] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:14 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:15.613965 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f395e87e-3209-4206-be4a-ceebbafa542a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:15.614591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f395e87e-3209-4206-be4a-ceebbafa542a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:15.622698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f395e87e-3209-4206-be4a-ceebbafa542a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:15.623194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f395e87e-3209-4206-be4a-ceebbafa542a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:15.624030 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f395e87e-3209-4206-be4a-ceebbafa542a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:15.624486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f395e87e-3209-4206-be4a-ceebbafa542a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:15.760237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f395e87e-3209-4206-be4a-ceebbafa542a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:15.767756 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f395e87e-3209-4206-be4a-ceebbafa542a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1320 microversion: 2.1 time: 0.157521 Jan 22 22:12:15.768339 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4795/9294] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:15 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:16.784413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0d267c3f-5965-4def-a4f1-1b6bd5a47003 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:16.785031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0d267c3f-5965-4def-a4f1-1b6bd5a47003 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:16.792051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d267c3f-5965-4def-a4f1-1b6bd5a47003 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:16.792490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d267c3f-5965-4def-a4f1-1b6bd5a47003 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:16.793285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d267c3f-5965-4def-a4f1-1b6bd5a47003 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:16.793759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0d267c3f-5965-4def-a4f1-1b6bd5a47003 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:16.928191 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0d267c3f-5965-4def-a4f1-1b6bd5a47003 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:16.946120 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0d267c3f-5965-4def-a4f1-1b6bd5a47003 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1320 microversion: 2.1 time: 0.165385 Jan 22 22:12:16.946718 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4500/9295] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:16 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:17.963982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f490752e-10e5-441b-a9d3-2632066b8d92 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:17.964615 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f490752e-10e5-441b-a9d3-2632066b8d92 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:17.971474 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f490752e-10e5-441b-a9d3-2632066b8d92 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:17.971953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f490752e-10e5-441b-a9d3-2632066b8d92 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:17.972762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f490752e-10e5-441b-a9d3-2632066b8d92 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:17.973227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f490752e-10e5-441b-a9d3-2632066b8d92 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:18.103028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f490752e-10e5-441b-a9d3-2632066b8d92 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:18.111292 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f490752e-10e5-441b-a9d3-2632066b8d92 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1320 microversion: 2.1 time: 0.151051 Jan 22 22:12:18.111868 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4796/9296] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:17 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1320 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:18.684058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-f5a596bd-0cb9-4746-abfe-6e0165b90a9f req-8e38352f-f67d-4146-8d2a-d9be22cd8061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827d2494-07a5-419a-a3f8-2a4931c2fa9f", "name": "network-vif-plugged", "status": "completed", "tag": "212be01c-a249-4ecf-b84d-50b7f8f1a12f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:12:18.685788 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:12:18.685788 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:12:18.693409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f5a596bd-0cb9-4746-abfe-6e0165b90a9f req-8e38352f-f67d-4146-8d2a-d9be22cd8061 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:18.693896 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-f5a596bd-0cb9-4746-abfe-6e0165b90a9f req-8e38352f-f67d-4146-8d2a-d9be22cd8061 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:18.704743 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-f5a596bd-0cb9-4746-abfe-6e0165b90a9f req-8e38352f-f67d-4146-8d2a-d9be22cd8061 service nova] Creating event network-vif-plugged:212be01c-a249-4ecf-b84d-50b7f8f1a12f for instance 827d2494-07a5-419a-a3f8-2a4931c2fa9f on nch2-master-1 Jan 22 22:12:18.709745 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-f5a596bd-0cb9-4746-abfe-6e0165b90a9f req-8e38352f-f67d-4146-8d2a-d9be22cd8061 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029287 Jan 22 22:12:18.710333 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4501/9297] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:12:19.128108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dab184af-7212-4f44-a2e8-e0f28cb3d8d1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:19.128726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dab184af-7212-4f44-a2e8-e0f28cb3d8d1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:19.136407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dab184af-7212-4f44-a2e8-e0f28cb3d8d1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:19.136893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dab184af-7212-4f44-a2e8-e0f28cb3d8d1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:19.137733 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dab184af-7212-4f44-a2e8-e0f28cb3d8d1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:19.138194 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dab184af-7212-4f44-a2e8-e0f28cb3d8d1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:19.273384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dab184af-7212-4f44-a2e8-e0f28cb3d8d1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:19.282025 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dab184af-7212-4f44-a2e8-e0f28cb3d8d1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1320 microversion: 2.1 time: 0.157594 Jan 22 22:12:19.282808 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4797/9298] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:19 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:20.301117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6794be46-3228-4861-aaee-99eaab86b686 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:20.301997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6794be46-3228-4861-aaee-99eaab86b686 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:20.308812 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6794be46-3228-4861-aaee-99eaab86b686 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:20.310807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6794be46-3228-4861-aaee-99eaab86b686 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:20.310807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6794be46-3228-4861-aaee-99eaab86b686 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:20.310807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6794be46-3228-4861-aaee-99eaab86b686 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:20.445172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6794be46-3228-4861-aaee-99eaab86b686 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:20.453476 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6794be46-3228-4861-aaee-99eaab86b686 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1510 microversion: 2.1 time: 0.157400 Jan 22 22:12:20.454108 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4502/9299] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:20 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:20.508456 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-714637433", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "762f2e39-11db-4d42-92a5-6018f23cc3eb"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:12:20.559596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] validate_networks() for [('762f2e39-11db-4d42-92a5-6018f23cc3eb', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:12:20.962169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:12:20.962620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:12:20.963119 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:12:20.963656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:12:20.964128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:12:20.973104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:20.973614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:20.974464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:20.974931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:20.993033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Getting quotas for project 9aeee610f18c4c75aa5e44535628a42e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:12:20.999357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Getting quotas for user b069b2066b2b4b9ea7241de23f07d5e8 and project 9aeee610f18c4c75aa5e44535628a42e. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:12:21.012385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:12:21.014783 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:12:21.164877 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c3664197-f44e-40ec-937b-e79a39c9254c tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.659958 Jan 22 22:12:21.165459 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4798/9300] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:12:20 2022] POST /compute/v2.1/servers => generated 382 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 22:12:21.175620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9e7977e2-7f90-4216-ac35-8f1b53424668 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:21.182789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9e7977e2-7f90-4216-ac35-8f1b53424668 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:21.233118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9e7977e2-7f90-4216-ac35-8f1b53424668 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:21.242835 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9e7977e2-7f90-4216-ac35-8f1b53424668 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 200 len: 1220 microversion: 2.1 time: 0.071018 Jan 22 22:12:21.243438 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4503/9301] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:21 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 1220 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:22.269885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-82fc8c6e-3447-4321-9a29-2064cbe1590a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:22.273714 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-82fc8c6e-3447-4321-9a29-2064cbe1590a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:22.279991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82fc8c6e-3447-4321-9a29-2064cbe1590a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:22.280471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82fc8c6e-3447-4321-9a29-2064cbe1590a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:22.281282 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82fc8c6e-3447-4321-9a29-2064cbe1590a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:22.281776 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-82fc8c6e-3447-4321-9a29-2064cbe1590a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:22.349856 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-82fc8c6e-3447-4321-9a29-2064cbe1590a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:22.358692 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-82fc8c6e-3447-4321-9a29-2064cbe1590a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 200 len: 1224 microversion: 2.1 time: 0.093441 Jan 22 22:12:22.359300 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4799/9302] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:22 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:23.375412 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-faa36392-82de-4d6b-97ee-e283b9856726 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:23.376497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-faa36392-82de-4d6b-97ee-e283b9856726 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:23.384068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-faa36392-82de-4d6b-97ee-e283b9856726 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:23.389593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-faa36392-82de-4d6b-97ee-e283b9856726 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:23.389593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-faa36392-82de-4d6b-97ee-e283b9856726 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:23.389593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-faa36392-82de-4d6b-97ee-e283b9856726 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:23.457695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-faa36392-82de-4d6b-97ee-e283b9856726 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:23.466514 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-faa36392-82de-4d6b-97ee-e283b9856726 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 200 len: 1272 microversion: 2.1 time: 0.094972 Jan 22 22:12:23.467106 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4504/9303] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:23 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:24.483654 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-909e6463-45e7-428a-9bd2-103494e7292d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:24.484318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-909e6463-45e7-428a-9bd2-103494e7292d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:24.491183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-909e6463-45e7-428a-9bd2-103494e7292d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:24.494630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-909e6463-45e7-428a-9bd2-103494e7292d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:24.494630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-909e6463-45e7-428a-9bd2-103494e7292d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:24.494630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-909e6463-45e7-428a-9bd2-103494e7292d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:24.626154 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-909e6463-45e7-428a-9bd2-103494e7292d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:24.633547 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-909e6463-45e7-428a-9bd2-103494e7292d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 200 len: 1320 microversion: 2.1 time: 0.153876 Jan 22 22:12:24.634113 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4800/9304] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:24 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 1320 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:25.026477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-d11304f9-3745-44af-91c0-02de7c8b8980 req-14397282-e185-4e23-a6a5-0c5fd3b1251c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f0af9dc-de29-4a3e-a2db-52d410a696a6", "tag": "89cd29e5-d6a0-431b-8d6d-f088120f230e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:12:25.030453 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:12:25.030453 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:12:25.038487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d11304f9-3745-44af-91c0-02de7c8b8980 req-14397282-e185-4e23-a6a5-0c5fd3b1251c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:25.039393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d11304f9-3745-44af-91c0-02de7c8b8980 req-14397282-e185-4e23-a6a5-0c5fd3b1251c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:25.052344 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-d11304f9-3745-44af-91c0-02de7c8b8980 req-14397282-e185-4e23-a6a5-0c5fd3b1251c service nova] Creating event network-changed:89cd29e5-d6a0-431b-8d6d-f088120f230e for instance 5f0af9dc-de29-4a3e-a2db-52d410a696a6 on nch1-master-1 Jan 22 22:12:25.057516 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-d11304f9-3745-44af-91c0-02de7c8b8980 req-14397282-e185-4e23-a6a5-0c5fd3b1251c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034994 Jan 22 22:12:25.058763 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4505/9305] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:12:25.651079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fab9a9ca-7baf-4a15-9c93-bda14485bd49 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:25.652337 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fab9a9ca-7baf-4a15-9c93-bda14485bd49 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:25.659516 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fab9a9ca-7baf-4a15-9c93-bda14485bd49 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:25.659991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fab9a9ca-7baf-4a15-9c93-bda14485bd49 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:25.660817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fab9a9ca-7baf-4a15-9c93-bda14485bd49 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:25.661285 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fab9a9ca-7baf-4a15-9c93-bda14485bd49 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:25.799787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fab9a9ca-7baf-4a15-9c93-bda14485bd49 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:25.807304 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fab9a9ca-7baf-4a15-9c93-bda14485bd49 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 200 len: 1320 microversion: 2.1 time: 0.160097 Jan 22 22:12:25.808715 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4801/9306] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:25 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 1320 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:26.826211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-421dd982-626c-462a-9006-3cd5a149cd67 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:26.826915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-421dd982-626c-462a-9006-3cd5a149cd67 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:26.833146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-421dd982-626c-462a-9006-3cd5a149cd67 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:26.833636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-421dd982-626c-462a-9006-3cd5a149cd67 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:26.834432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-421dd982-626c-462a-9006-3cd5a149cd67 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:26.834881 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-421dd982-626c-462a-9006-3cd5a149cd67 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:26.976435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-421dd982-626c-462a-9006-3cd5a149cd67 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:26.984877 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-421dd982-626c-462a-9006-3cd5a149cd67 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 200 len: 1320 microversion: 2.1 time: 0.163664 Jan 22 22:12:26.985458 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4506/9307] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:26 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 1320 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:28.001464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1cd23d98-0ff5-4945-ac54-595ec1e5553e tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:28.002248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1cd23d98-0ff5-4945-ac54-595ec1e5553e tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:28.009206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cd23d98-0ff5-4945-ac54-595ec1e5553e tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:28.009740 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cd23d98-0ff5-4945-ac54-595ec1e5553e tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:28.011054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cd23d98-0ff5-4945-ac54-595ec1e5553e tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:28.011827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1cd23d98-0ff5-4945-ac54-595ec1e5553e tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:28.142721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1cd23d98-0ff5-4945-ac54-595ec1e5553e tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:28.150198 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1cd23d98-0ff5-4945-ac54-595ec1e5553e tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 200 len: 1320 microversion: 2.1 time: 0.152547 Jan 22 22:12:28.150772 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4802/9308] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:27 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:29.165818 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-89451558-231f-4e06-8aeb-fe1cd79090ac tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:29.166576 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-89451558-231f-4e06-8aeb-fe1cd79090ac tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:29.173772 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89451558-231f-4e06-8aeb-fe1cd79090ac tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:29.174238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89451558-231f-4e06-8aeb-fe1cd79090ac tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:29.175045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89451558-231f-4e06-8aeb-fe1cd79090ac tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:29.175497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-89451558-231f-4e06-8aeb-fe1cd79090ac tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:29.310204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-89451558-231f-4e06-8aeb-fe1cd79090ac tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:29.317632 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-89451558-231f-4e06-8aeb-fe1cd79090ac tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 200 len: 1320 microversion: 2.1 time: 0.155533 Jan 22 22:12:29.318234 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4507/9309] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:29 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:30.335241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a312052b-ed66-471a-b036-e444da2182c9 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:30.335814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a312052b-ed66-471a-b036-e444da2182c9 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:30.350939 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a312052b-ed66-471a-b036-e444da2182c9 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:30.351438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a312052b-ed66-471a-b036-e444da2182c9 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:30.352311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a312052b-ed66-471a-b036-e444da2182c9 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:30.352791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a312052b-ed66-471a-b036-e444da2182c9 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:30.488277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a312052b-ed66-471a-b036-e444da2182c9 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:30.496715 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a312052b-ed66-471a-b036-e444da2182c9 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 200 len: 1320 microversion: 2.1 time: 0.165312 Jan 22 22:12:30.497293 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4803/9310] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:30 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:31.246884 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-5044b95c-3575-4051-837c-32da722d6227 req-aabcd536-b244-42be-a5c3-87a9d3033db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f0af9dc-de29-4a3e-a2db-52d410a696a6", "name": "network-vif-plugged", "status": "completed", "tag": "89cd29e5-d6a0-431b-8d6d-f088120f230e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:12:31.248493 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:12:31.248493 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:12:31.256099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5044b95c-3575-4051-837c-32da722d6227 req-aabcd536-b244-42be-a5c3-87a9d3033db9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:31.256546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5044b95c-3575-4051-837c-32da722d6227 req-aabcd536-b244-42be-a5c3-87a9d3033db9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:31.268476 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-5044b95c-3575-4051-837c-32da722d6227 req-aabcd536-b244-42be-a5c3-87a9d3033db9 service nova] Creating event network-vif-plugged:89cd29e5-d6a0-431b-8d6d-f088120f230e for instance 5f0af9dc-de29-4a3e-a2db-52d410a696a6 on nch1-master-1 Jan 22 22:12:31.273218 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-5044b95c-3575-4051-837c-32da722d6227 req-aabcd536-b244-42be-a5c3-87a9d3033db9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030521 Jan 22 22:12:31.277125 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4508/9311] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:12:31.513255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f930d99f-70d0-4324-8ff1-b5fa00545e74 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:31.513927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f930d99f-70d0-4324-8ff1-b5fa00545e74 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:31.520893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f930d99f-70d0-4324-8ff1-b5fa00545e74 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:31.521978 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f930d99f-70d0-4324-8ff1-b5fa00545e74 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:31.522832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f930d99f-70d0-4324-8ff1-b5fa00545e74 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:31.523300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f930d99f-70d0-4324-8ff1-b5fa00545e74 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:31.655453 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f930d99f-70d0-4324-8ff1-b5fa00545e74 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:31.662987 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f930d99f-70d0-4324-8ff1-b5fa00545e74 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 200 len: 1320 microversion: 2.1 time: 0.153539 Jan 22 22:12:31.663602 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4804/9312] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:31 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 1320 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:32.681272 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2709da0d-de01-4ac3-a66f-38a4b34aa76d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:32.681995 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2709da0d-de01-4ac3-a66f-38a4b34aa76d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:32.689158 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2709da0d-de01-4ac3-a66f-38a4b34aa76d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:32.689649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2709da0d-de01-4ac3-a66f-38a4b34aa76d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:32.690451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2709da0d-de01-4ac3-a66f-38a4b34aa76d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:32.690959 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2709da0d-de01-4ac3-a66f-38a4b34aa76d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:32.832666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2709da0d-de01-4ac3-a66f-38a4b34aa76d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:32.841349 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2709da0d-de01-4ac3-a66f-38a4b34aa76d tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 200 len: 1320 microversion: 2.1 time: 0.165062 Jan 22 22:12:32.842320 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4509/9313] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:32 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:33.858362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-397ce42e-c7b3-4ec3-8330-0506fddd51b8 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:33.858995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-397ce42e-c7b3-4ec3-8330-0506fddd51b8 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:33.865808 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-397ce42e-c7b3-4ec3-8330-0506fddd51b8 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:33.866279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-397ce42e-c7b3-4ec3-8330-0506fddd51b8 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:33.867084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-397ce42e-c7b3-4ec3-8330-0506fddd51b8 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:33.867541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-397ce42e-c7b3-4ec3-8330-0506fddd51b8 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:34.007052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-397ce42e-c7b3-4ec3-8330-0506fddd51b8 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:34.012130 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-397ce42e-c7b3-4ec3-8330-0506fddd51b8 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 200 len: 1509 microversion: 2.1 time: 0.157568 Jan 22 22:12:34.012708 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4805/9314] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:33 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:34.028076 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-16ba159f-0c3a-4dc4-a883-9fbb70c62ece tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:34.028626 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-16ba159f-0c3a-4dc4-a883-9fbb70c62ece tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:34.035439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16ba159f-0c3a-4dc4-a883-9fbb70c62ece tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:34.035904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16ba159f-0c3a-4dc4-a883-9fbb70c62ece tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:34.036689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16ba159f-0c3a-4dc4-a883-9fbb70c62ece tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:34.037135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-16ba159f-0c3a-4dc4-a883-9fbb70c62ece tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:34.063537 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-16ba159f-0c3a-4dc4-a883-9fbb70c62ece tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:12:34.328418 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-16ba159f-0c3a-4dc4-a883-9fbb70c62ece tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 204 len: 0 microversion: 2.1 time: 0.304050 Jan 22 22:12:34.329033 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4510/9315] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:12:34 2022] DELETE /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:12:34.336791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-090c8ffe-0bee-432f-a2c0-7da327c50818 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:34.337454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-090c8ffe-0bee-432f-a2c0-7da327c50818 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:34.343696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-090c8ffe-0bee-432f-a2c0-7da327c50818 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:34.344172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-090c8ffe-0bee-432f-a2c0-7da327c50818 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:34.344970 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-090c8ffe-0bee-432f-a2c0-7da327c50818 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:34.345428 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-090c8ffe-0bee-432f-a2c0-7da327c50818 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:34.481973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-090c8ffe-0bee-432f-a2c0-7da327c50818 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:34.489469 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-090c8ffe-0bee-432f-a2c0-7da327c50818 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 200 len: 1515 microversion: 2.1 time: 0.156390 Jan 22 22:12:34.490078 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4806/9316] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:34 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:35.507177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-064c2f74-777b-4bc3-9f7d-d2d7f1fd05f3 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:35.507928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-064c2f74-777b-4bc3-9f7d-d2d7f1fd05f3 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:35.515659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-064c2f74-777b-4bc3-9f7d-d2d7f1fd05f3 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:35.516120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-064c2f74-777b-4bc3-9f7d-d2d7f1fd05f3 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:35.516906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-064c2f74-777b-4bc3-9f7d-d2d7f1fd05f3 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:35.517352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-064c2f74-777b-4bc3-9f7d-d2d7f1fd05f3 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:35.653002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-064c2f74-777b-4bc3-9f7d-d2d7f1fd05f3 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:35.660603 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-064c2f74-777b-4bc3-9f7d-d2d7f1fd05f3 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 200 len: 1515 microversion: 2.1 time: 0.157619 Jan 22 22:12:35.661195 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4511/9317] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:35 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:12:36.343886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-8869fa91-351b-4b02-afda-ec32cd1a5632 req-0f393600-026c-4c67-a9c9-1a292366519e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f0af9dc-de29-4a3e-a2db-52d410a696a6", "name": "network-vif-deleted", "tag": "89cd29e5-d6a0-431b-8d6d-f088120f230e"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:12:36.345536 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:12:36.345536 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:12:36.353859 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8869fa91-351b-4b02-afda-ec32cd1a5632 req-0f393600-026c-4c67-a9c9-1a292366519e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:36.354983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-8869fa91-351b-4b02-afda-ec32cd1a5632 req-0f393600-026c-4c67-a9c9-1a292366519e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:36.367704 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-8869fa91-351b-4b02-afda-ec32cd1a5632 req-0f393600-026c-4c67-a9c9-1a292366519e service nova] Creating event network-vif-deleted:89cd29e5-d6a0-431b-8d6d-f088120f230e for instance 5f0af9dc-de29-4a3e-a2db-52d410a696a6 on nch1-master-1 Jan 22 22:12:36.374855 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-8869fa91-351b-4b02-afda-ec32cd1a5632 req-0f393600-026c-4c67-a9c9-1a292366519e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035489 Jan 22 22:12:36.378892 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4807/9318] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:12:36.677556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-03abb60c-6b9f-4b97-81e7-d5a15316680a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:36.678194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-03abb60c-6b9f-4b97-81e7-d5a15316680a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:36.685228 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03abb60c-6b9f-4b97-81e7-d5a15316680a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:36.685729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03abb60c-6b9f-4b97-81e7-d5a15316680a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:36.686539 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03abb60c-6b9f-4b97-81e7-d5a15316680a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:36.686988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03abb60c-6b9f-4b97-81e7-d5a15316680a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:36.719109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03abb60c-6b9f-4b97-81e7-d5a15316680a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:36.719574 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03abb60c-6b9f-4b97-81e7-d5a15316680a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:36.720036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-03abb60c-6b9f-4b97-81e7-d5a15316680a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lazy-loading 'fault' on Instance uuid 5f0af9dc-de29-4a3e-a2db-52d410a696a6 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 22:12:36.758746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-03abb60c-6b9f-4b97-81e7-d5a15316680a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:36.766424 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-03abb60c-6b9f-4b97-81e7-d5a15316680a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 200 len: 1310 microversion: 2.1 time: 0.092707 Jan 22 22:12:36.766996 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4512/9319] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:36 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:37.785342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d14e236e-a102-4680-bb0a-eca5533f816a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:37.786081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d14e236e-a102-4680-bb0a-eca5533f816a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:37.792577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d14e236e-a102-4680-bb0a-eca5533f816a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:37.793053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d14e236e-a102-4680-bb0a-eca5533f816a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:37.793893 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d14e236e-a102-4680-bb0a-eca5533f816a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:37.794353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d14e236e-a102-4680-bb0a-eca5533f816a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:37.809240 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-d14e236e-a102-4680-bb0a-eca5533f816a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] HTTP exception thrown: Instance 5f0af9dc-de29-4a3e-a2db-52d410a696a6 could not be found. Jan 22 22:12:37.809885 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d14e236e-a102-4680-bb0a-eca5533f816a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Returning 404 to user: Instance 5f0af9dc-de29-4a3e-a2db-52d410a696a6 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:12:37.810724 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d14e236e-a102-4680-bb0a-eca5533f816a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 404 len: 111 microversion: 2.1 time: 0.030402 Jan 22 22:12:37.811266 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4808/9320] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:37 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:12:37.819673 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8bdcd570-8582-455a-9c89-574514f40354 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:37.820286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8bdcd570-8582-455a-9c89-574514f40354 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:37.827661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bdcd570-8582-455a-9c89-574514f40354 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:37.828120 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bdcd570-8582-455a-9c89-574514f40354 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:37.828905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bdcd570-8582-455a-9c89-574514f40354 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:37.829350 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8bdcd570-8582-455a-9c89-574514f40354 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:37.964124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8bdcd570-8582-455a-9c89-574514f40354 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:37.971448 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8bdcd570-8582-455a-9c89-574514f40354 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1510 microversion: 2.1 time: 0.155550 Jan 22 22:12:37.972028 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4513/9321] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:37 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:37.988113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bfed8d0c-c3ce-4530-b49c-4f6be4803247 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:12:37.989072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bfed8d0c-c3ce-4530-b49c-4f6be4803247 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 891424ff-7ad4-45b3-b045-34946540422d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:37.994427 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-bfed8d0c-c3ce-4530-b49c-4f6be4803247 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] HTTP exception thrown: Instance 891424ff-7ad4-45b3-b045-34946540422d could not be found. Jan 22 22:12:37.995650 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bfed8d0c-c3ce-4530-b49c-4f6be4803247 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Returning 404 to user: Instance 891424ff-7ad4-45b3-b045-34946540422d could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:12:37.996494 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bfed8d0c-c3ce-4530-b49c-4f6be4803247 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "POST /compute/v2.1/servers/891424ff-7ad4-45b3-b045-34946540422d/action" status: 404 len: 111 microversion: 2.1 time: 0.012227 Jan 22 22:12:37.997020 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4809/9322] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:12:37 2022] POST /compute/v2.1/servers/891424ff-7ad4-45b3-b045-34946540422d/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:12:38.004677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a65f9eff-b69b-4022-bbd6-9ebee36680fd tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:38.005300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a65f9eff-b69b-4022-bbd6-9ebee36680fd tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:38.011378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a65f9eff-b69b-4022-bbd6-9ebee36680fd tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.011841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a65f9eff-b69b-4022-bbd6-9ebee36680fd tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.012637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a65f9eff-b69b-4022-bbd6-9ebee36680fd tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.013088 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a65f9eff-b69b-4022-bbd6-9ebee36680fd tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.148775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a65f9eff-b69b-4022-bbd6-9ebee36680fd tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:38.156720 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a65f9eff-b69b-4022-bbd6-9ebee36680fd tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1510 microversion: 2.1 time: 0.155354 Jan 22 22:12:38.157305 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4514/9323] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:37 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:38.173616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-40e45dc7-517a-4530-9b16-2205b6750965 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:38.174265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-40e45dc7-517a-4530-9b16-2205b6750965 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:38.181138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40e45dc7-517a-4530-9b16-2205b6750965 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.181626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40e45dc7-517a-4530-9b16-2205b6750965 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.182993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40e45dc7-517a-4530-9b16-2205b6750965 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.183495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-40e45dc7-517a-4530-9b16-2205b6750965 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.317065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-40e45dc7-517a-4530-9b16-2205b6750965 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:38.324823 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-40e45dc7-517a-4530-9b16-2205b6750965 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1510 microversion: 2.1 time: 0.154905 Jan 22 22:12:38.325400 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4810/9324] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:38 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:12:38.341388 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b9c3831b-cde6-47c0-a9d5-9be6d4df6a00 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "b2edcc37-21bd-4fe1-a3d4-20a9d8f8dcf3"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:12:38.342380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b9c3831b-cde6-47c0-a9d5-9be6d4df6a00 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:38.348297 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9c3831b-cde6-47c0-a9d5-9be6d4df6a00 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.348697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9c3831b-cde6-47c0-a9d5-9be6d4df6a00 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.349475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9c3831b-cde6-47c0-a9d5-9be6d4df6a00 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.349939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b9c3831b-cde6-47c0-a9d5-9be6d4df6a00 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.378315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b9c3831b-cde6-47c0-a9d5-9be6d4df6a00 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:38.384129 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-b9c3831b-cde6-47c0-a9d5-9be6d4df6a00 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] HTTP exception thrown: Flavor b2edcc37-21bd-4fe1-a3d4-20a9d8f8dcf3 could not be found. Jan 22 22:12:38.384744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b9c3831b-cde6-47c0-a9d5-9be6d4df6a00 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Returning 400 to user: Flavor b2edcc37-21bd-4fe1-a3d4-20a9d8f8dcf3 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:12:38.385724 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b9c3831b-cde6-47c0-a9d5-9be6d4df6a00 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "POST /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f/action" status: 400 len: 107 microversion: 2.1 time: 0.048636 Jan 22 22:12:38.386331 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4515/9325] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:12:38 2022] POST /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f/action => generated 107 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 22:12:38.394569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a43806ae-e2c5-487b-830f-5a3bac6d05c2 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:38.395193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a43806ae-e2c5-487b-830f-5a3bac6d05c2 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:38.401878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a43806ae-e2c5-487b-830f-5a3bac6d05c2 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.402496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a43806ae-e2c5-487b-830f-5a3bac6d05c2 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.403207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a43806ae-e2c5-487b-830f-5a3bac6d05c2 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.403665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a43806ae-e2c5-487b-830f-5a3bac6d05c2 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.539493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a43806ae-e2c5-487b-830f-5a3bac6d05c2 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:38.547065 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a43806ae-e2c5-487b-830f-5a3bac6d05c2 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1510 microversion: 2.1 time: 0.156149 Jan 22 22:12:38.547644 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4811/9326] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:38 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:12:38.563720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a3abe5e1-61b8-4dc6-8461-44f13ba7d2b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:38.564327 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a3abe5e1-61b8-4dc6-8461-44f13ba7d2b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:38.570277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3abe5e1-61b8-4dc6-8461-44f13ba7d2b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.570728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3abe5e1-61b8-4dc6-8461-44f13ba7d2b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.571507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3abe5e1-61b8-4dc6-8461-44f13ba7d2b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.571948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a3abe5e1-61b8-4dc6-8461-44f13ba7d2b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.702816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a3abe5e1-61b8-4dc6-8461-44f13ba7d2b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:38.710265 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a3abe5e1-61b8-4dc6-8461-44f13ba7d2b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1510 microversion: 2.1 time: 0.150180 Jan 22 22:12:38.710827 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4516/9327] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:38 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:38.727338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-82c99d61-d066-4103-97af-a6a9043d349e tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:12:38.728748 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-82c99d61-d066-4103-97af-a6a9043d349e tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:12:38.729949 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-82c99d61-d066-4103-97af-a6a9043d349e tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "POST /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f/action" status: 400 len: 113 microversion: 2.1 time: 0.006386 Jan 22 22:12:38.730471 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4812/9328] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:12:38 2022] POST /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f/action => generated 113 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 22 22:12:38.737815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-69f639af-4c27-440e-ae52-1f3a78b4b838 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:38.738433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-69f639af-4c27-440e-ae52-1f3a78b4b838 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:38.744489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69f639af-4c27-440e-ae52-1f3a78b4b838 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.745147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69f639af-4c27-440e-ae52-1f3a78b4b838 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.746138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69f639af-4c27-440e-ae52-1f3a78b4b838 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.746588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69f639af-4c27-440e-ae52-1f3a78b4b838 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.881952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-69f639af-4c27-440e-ae52-1f3a78b4b838 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:38.886417 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-69f639af-4c27-440e-ae52-1f3a78b4b838 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1510 microversion: 2.1 time: 0.152099 Jan 22 22:12:38.886989 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4517/9329] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:38 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:38.908165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-81858141-7597-4fba-8e60-3c80fb70d612 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:38.908165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-81858141-7597-4fba-8e60-3c80fb70d612 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:38.914853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81858141-7597-4fba-8e60-3c80fb70d612 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.915320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81858141-7597-4fba-8e60-3c80fb70d612 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.916114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81858141-7597-4fba-8e60-3c80fb70d612 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.917197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81858141-7597-4fba-8e60-3c80fb70d612 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.930164 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-81858141-7597-4fba-8e60-3c80fb70d612 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] HTTP exception thrown: Instance 5f0af9dc-de29-4a3e-a2db-52d410a696a6 could not be found. Jan 22 22:12:38.930768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-81858141-7597-4fba-8e60-3c80fb70d612 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Returning 404 to user: Instance 5f0af9dc-de29-4a3e-a2db-52d410a696a6 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:12:38.931602 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-81858141-7597-4fba-8e60-3c80fb70d612 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 404 len: 111 microversion: 2.1 time: 0.028907 Jan 22 22:12:38.932185 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4813/9330] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:12:38 2022] DELETE /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:12:38.940436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bcce58f8-b763-4736-a9d7-3993355ea0ba tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:38.941056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bcce58f8-b763-4736-a9d7-3993355ea0ba tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 5f0af9dc-de29-4a3e-a2db-52d410a696a6] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:38.947028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcce58f8-b763-4736-a9d7-3993355ea0ba tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.947488 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcce58f8-b763-4736-a9d7-3993355ea0ba tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.948603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcce58f8-b763-4736-a9d7-3993355ea0ba tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.949402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bcce58f8-b763-4736-a9d7-3993355ea0ba tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.964179 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-bcce58f8-b763-4736-a9d7-3993355ea0ba tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] HTTP exception thrown: Instance 5f0af9dc-de29-4a3e-a2db-52d410a696a6 could not be found. Jan 22 22:12:38.964902 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bcce58f8-b763-4736-a9d7-3993355ea0ba tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Returning 404 to user: Instance 5f0af9dc-de29-4a3e-a2db-52d410a696a6 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:12:38.965860 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bcce58f8-b763-4736-a9d7-3993355ea0ba tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6" status: 404 len: 111 microversion: 2.1 time: 0.029179 Jan 22 22:12:38.966410 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4518/9331] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:38 2022] GET /compute/v2.1/servers/5f0af9dc-de29-4a3e-a2db-52d410a696a6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:12:38.974408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ca0bc4ea-43cf-4b20-9291-1b2b9f71e06f tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:38.980852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ca0bc4ea-43cf-4b20-9291-1b2b9f71e06f tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:38.981964 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca0bc4ea-43cf-4b20-9291-1b2b9f71e06f tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.982432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca0bc4ea-43cf-4b20-9291-1b2b9f71e06f tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:38.983218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca0bc4ea-43cf-4b20-9291-1b2b9f71e06f tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:38.983674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca0bc4ea-43cf-4b20-9291-1b2b9f71e06f tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:39.009153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ca0bc4ea-43cf-4b20-9291-1b2b9f71e06f tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:12:39.287844 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ca0bc4ea-43cf-4b20-9291-1b2b9f71e06f tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "DELETE /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 204 len: 0 microversion: 2.1 time: 0.316815 Jan 22 22:12:39.288455 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4814/9332] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:12:38 2022] DELETE /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 22:12:39.297704 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ac8958df-e4d8-423b-b284-7849c22c7b5a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:39.298719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ac8958df-e4d8-423b-b284-7849c22c7b5a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:39.304590 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac8958df-e4d8-423b-b284-7849c22c7b5a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:39.305043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac8958df-e4d8-423b-b284-7849c22c7b5a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:39.305867 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac8958df-e4d8-423b-b284-7849c22c7b5a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:39.306338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ac8958df-e4d8-423b-b284-7849c22c7b5a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:39.461649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ac8958df-e4d8-423b-b284-7849c22c7b5a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:39.470788 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ac8958df-e4d8-423b-b284-7849c22c7b5a tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1516 microversion: 2.1 time: 0.177225 Jan 22 22:12:39.473115 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4519/9333] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:39 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:40.489207 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-88d1683d-0d6d-4b20-8eec-520f4f61c0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:40.489955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-88d1683d-0d6d-4b20-8eec-520f4f61c0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:40.497073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88d1683d-0d6d-4b20-8eec-520f4f61c0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:40.497578 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88d1683d-0d6d-4b20-8eec-520f4f61c0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:40.498395 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88d1683d-0d6d-4b20-8eec-520f4f61c0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:40.498861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-88d1683d-0d6d-4b20-8eec-520f4f61c0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:40.631625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-88d1683d-0d6d-4b20-8eec-520f4f61c0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:40.640050 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-88d1683d-0d6d-4b20-8eec-520f4f61c0e1 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1516 microversion: 2.1 time: 0.155033 Jan 22 22:12:40.640672 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4815/9334] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:40 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:41.474831 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-21976271-90ec-478b-854a-580e04ec76b4 req-e9e339e7-24d0-4667-aadd-b4a9fd934d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827d2494-07a5-419a-a3f8-2a4931c2fa9f", "name": "network-vif-deleted", "tag": "212be01c-a249-4ecf-b84d-50b7f8f1a12f"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:12:41.476323 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:12:41.476323 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:12:41.484492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-21976271-90ec-478b-854a-580e04ec76b4 req-e9e339e7-24d0-4667-aadd-b4a9fd934d69 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:41.484981 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-21976271-90ec-478b-854a-580e04ec76b4 req-e9e339e7-24d0-4667-aadd-b4a9fd934d69 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:41.497424 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-21976271-90ec-478b-854a-580e04ec76b4 req-e9e339e7-24d0-4667-aadd-b4a9fd934d69 service nova] Creating event network-vif-deleted:212be01c-a249-4ecf-b84d-50b7f8f1a12f for instance 827d2494-07a5-419a-a3f8-2a4931c2fa9f on nch2-master-1 Jan 22 22:12:41.502731 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-21976271-90ec-478b-854a-580e04ec76b4 req-e9e339e7-24d0-4667-aadd-b4a9fd934d69 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032254 Jan 22 22:12:41.503331 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4520/9335] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:12:41.657108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-56c8cb40-dd70-4f68-b846-4693ff7459b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:41.657807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-56c8cb40-dd70-4f68-b846-4693ff7459b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:41.664148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56c8cb40-dd70-4f68-b846-4693ff7459b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:41.664625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56c8cb40-dd70-4f68-b846-4693ff7459b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:41.665435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56c8cb40-dd70-4f68-b846-4693ff7459b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:41.665925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-56c8cb40-dd70-4f68-b846-4693ff7459b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:41.727583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-56c8cb40-dd70-4f68-b846-4693ff7459b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b069b2066b2b4b9ea7241de23f07d5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aeee610f18c4c75aa5e44535628a42e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:12:41.737237 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-56c8cb40-dd70-4f68-b846-4693ff7459b0 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 200 len: 1305 microversion: 2.1 time: 0.083906 Jan 22 22:12:41.738392 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4816/9336] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:41 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 1305 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:12:42.755671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-818f1fd7-d468-42e8-885b-53d58febafa5 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:12:42.756291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-818f1fd7-d468-42e8-885b-53d58febafa5 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] [instance: 827d2494-07a5-419a-a3f8-2a4931c2fa9f] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:12:42.764275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-818f1fd7-d468-42e8-885b-53d58febafa5 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:42.764746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-818f1fd7-d468-42e8-885b-53d58febafa5 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:42.765561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-818f1fd7-d468-42e8-885b-53d58febafa5 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:12:42.766000 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-818f1fd7-d468-42e8-885b-53d58febafa5 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:12:42.779364 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-818f1fd7-d468-42e8-885b-53d58febafa5 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] HTTP exception thrown: Instance 827d2494-07a5-419a-a3f8-2a4931c2fa9f could not be found. Jan 22 22:12:42.779950 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-818f1fd7-d468-42e8-885b-53d58febafa5 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] Returning 404 to user: Instance 827d2494-07a5-419a-a3f8-2a4931c2fa9f could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:12:42.780772 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-818f1fd7-d468-42e8-885b-53d58febafa5 tempest-ServersNegativeTestJSON-711822578 tempest-ServersNegativeTestJSON-711822578-project] 10.222.0.100 "GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f" status: 404 len: 111 microversion: 2.1 time: 0.029309 Jan 22 22:12:42.781301 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4521/9337] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:12:42 2022] GET /compute/v2.1/servers/827d2494-07a5-419a-a3f8-2a4931c2fa9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:13:13.905888 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:13:13.906556 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:13:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:13:34.897724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-15f88f3c-e385-4816-a744-826a9e14f91a tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Action: 'create', calling method: .version_select at 0x7f1ed6048310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-496493273"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:13:34.912118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-15f88f3c-e385-4816-a744-826a9e14f91a tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Getting quotas for project 6837a6f34c6c422cad0019e0f9cb0768. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:13:34.917161 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-15f88f3c-e385-4816-a744-826a9e14f91a tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Getting quotas for user 838fe30d39014d209302ec73128bf703 and project 6837a6f34c6c422cad0019e0f9cb0768. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:13:35.222750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-15f88f3c-e385-4816-a744-826a9e14f91a tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Getting quotas for project 6837a6f34c6c422cad0019e0f9cb0768. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:13:35.227824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-15f88f3c-e385-4816-a744-826a9e14f91a tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Getting quotas for user 838fe30d39014d209302ec73128bf703 and project 6837a6f34c6c422cad0019e0f9cb0768. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:13:35.242961 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-15f88f3c-e385-4816-a744-826a9e14f91a tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.349696 Jan 22 22:13:35.243761 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4817/9338] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 22:13:34 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:13:35.293726 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-774196465", "imageRef": "57588925-0505-497a-8df8-0d5dca0b3f5e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-496493273", "networks": [{"uuid": "aec89db1-5aac-4c4c-904d-0301641e8487"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:13:35.344063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] validate_networks() for [('aec89db1-5aac-4c4c-904d-0301641e8487', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:13:35.803515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:13:35.803942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:13:35.804471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:13:35.804904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:13:35.805323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:13:35.814475 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:35.814929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:35.815738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:35.816181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:35.833058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Getting quotas for project 6837a6f34c6c422cad0019e0f9cb0768. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:13:35.838165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Getting quotas for user 838fe30d39014d209302ec73128bf703 and project 6837a6f34c6c422cad0019e0f9cb0768. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:13:35.850759 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:13:35.853232 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57588925-0505-497a-8df8-0d5dca0b3f5e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:13:35.962641 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-761d136d-b320-4cd3-992e-c6d8545c07d0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.672995 Jan 22 22:13:35.963300 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4522/9339] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:13:35 2022] POST /compute/v2.1/servers => generated 382 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 22:13:35.974792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-97ae142a-c746-4bd0-911c-cccec587ef54 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:35.979492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-97ae142a-c746-4bd0-911c-cccec587ef54 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:36.150785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-97ae142a-c746-4bd0-911c-cccec587ef54 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:36.159213 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-97ae142a-c746-4bd0-911c-cccec587ef54 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1261 microversion: 2.1 time: 0.189316 Jan 22 22:13:36.159780 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4818/9340] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:35 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:37.179612 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-be41f3fb-eb6d-42f6-930c-599e61ba80bb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:37.180256 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-be41f3fb-eb6d-42f6-930c-599e61ba80bb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:37.189465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be41f3fb-eb6d-42f6-930c-599e61ba80bb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:37.197114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be41f3fb-eb6d-42f6-930c-599e61ba80bb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:37.197114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be41f3fb-eb6d-42f6-930c-599e61ba80bb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:37.197114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be41f3fb-eb6d-42f6-930c-599e61ba80bb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:37.260260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-be41f3fb-eb6d-42f6-930c-599e61ba80bb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:37.268161 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-be41f3fb-eb6d-42f6-930c-599e61ba80bb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1257 microversion: 2.1 time: 0.095509 Jan 22 22:13:37.268730 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4523/9341] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:37 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1257 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:38.285484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-097494fd-4cb8-4fb5-8e80-d66c27ebb5c4 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:38.286144 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-097494fd-4cb8-4fb5-8e80-d66c27ebb5c4 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:38.292994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-097494fd-4cb8-4fb5-8e80-d66c27ebb5c4 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:38.293472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-097494fd-4cb8-4fb5-8e80-d66c27ebb5c4 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:38.294394 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-097494fd-4cb8-4fb5-8e80-d66c27ebb5c4 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:38.294908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-097494fd-4cb8-4fb5-8e80-d66c27ebb5c4 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:38.407205 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-097494fd-4cb8-4fb5-8e80-d66c27ebb5c4 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:38.415701 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-097494fd-4cb8-4fb5-8e80-d66c27ebb5c4 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1319 microversion: 2.1 time: 0.134009 Jan 22 22:13:38.416921 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4819/9342] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:38 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1319 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:39.443938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-97895817-c928-4f44-ab98-31445328fdb7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:39.443938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-97895817-c928-4f44-ab98-31445328fdb7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:39.447725 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97895817-c928-4f44-ab98-31445328fdb7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:39.448218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97895817-c928-4f44-ab98-31445328fdb7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:39.449033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97895817-c928-4f44-ab98-31445328fdb7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:39.449632 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97895817-c928-4f44-ab98-31445328fdb7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:39.599386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-97895817-c928-4f44-ab98-31445328fdb7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:39.607285 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-97895817-c928-4f44-ab98-31445328fdb7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.175418 Jan 22 22:13:39.608192 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4524/9343] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:39 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:40.625557 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-29ca2840-b838-4a43-844b-87a1c01c0ac0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:40.626993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-29ca2840-b838-4a43-844b-87a1c01c0ac0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:40.634943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29ca2840-b838-4a43-844b-87a1c01c0ac0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:40.635423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29ca2840-b838-4a43-844b-87a1c01c0ac0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:40.636255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29ca2840-b838-4a43-844b-87a1c01c0ac0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:40.636746 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29ca2840-b838-4a43-844b-87a1c01c0ac0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:40.824150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-29ca2840-b838-4a43-844b-87a1c01c0ac0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:40.839956 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-29ca2840-b838-4a43-844b-87a1c01c0ac0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.218213 Jan 22 22:13:40.840825 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4820/9344] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:40 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:41.858217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-87e42550-63be-4ad6-9134-a1fddb5467e0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:41.858815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-87e42550-63be-4ad6-9134-a1fddb5467e0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:41.865177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87e42550-63be-4ad6-9134-a1fddb5467e0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:41.865681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87e42550-63be-4ad6-9134-a1fddb5467e0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:41.866482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87e42550-63be-4ad6-9134-a1fddb5467e0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:41.866927 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87e42550-63be-4ad6-9134-a1fddb5467e0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:42.000829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-87e42550-63be-4ad6-9134-a1fddb5467e0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:42.008372 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-87e42550-63be-4ad6-9134-a1fddb5467e0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.154481 Jan 22 22:13:42.008949 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4525/9345] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:41 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:43.026061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-84b8a892-4935-4058-ba02-a68c61a07ff3 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:43.026690 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-84b8a892-4935-4058-ba02-a68c61a07ff3 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:43.033903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84b8a892-4935-4058-ba02-a68c61a07ff3 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:43.034368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84b8a892-4935-4058-ba02-a68c61a07ff3 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:43.035163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84b8a892-4935-4058-ba02-a68c61a07ff3 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:43.035618 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84b8a892-4935-4058-ba02-a68c61a07ff3 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:43.198479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-84b8a892-4935-4058-ba02-a68c61a07ff3 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:43.208612 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-84b8a892-4935-4058-ba02-a68c61a07ff3 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.186446 Jan 22 22:13:43.210111 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4821/9346] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:43 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:44.226405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c71ee465-432e-4aad-8bd7-1ae36e3caa70 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:44.227328 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c71ee465-432e-4aad-8bd7-1ae36e3caa70 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:44.234352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c71ee465-432e-4aad-8bd7-1ae36e3caa70 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:44.234813 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c71ee465-432e-4aad-8bd7-1ae36e3caa70 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:44.235615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c71ee465-432e-4aad-8bd7-1ae36e3caa70 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:44.236066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c71ee465-432e-4aad-8bd7-1ae36e3caa70 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:44.394633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c71ee465-432e-4aad-8bd7-1ae36e3caa70 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:44.402726 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c71ee465-432e-4aad-8bd7-1ae36e3caa70 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.179946 Jan 22 22:13:44.406145 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4526/9347] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:44 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:13:45.420058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a2c56b3a-cfd3-4cf5-85fd-5643b7ead3f0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:45.421630 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a2c56b3a-cfd3-4cf5-85fd-5643b7ead3f0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:45.428486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2c56b3a-cfd3-4cf5-85fd-5643b7ead3f0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:45.428962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2c56b3a-cfd3-4cf5-85fd-5643b7ead3f0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:45.429926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2c56b3a-cfd3-4cf5-85fd-5643b7ead3f0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:45.430391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a2c56b3a-cfd3-4cf5-85fd-5643b7ead3f0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:45.584072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a2c56b3a-cfd3-4cf5-85fd-5643b7ead3f0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:45.592415 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a2c56b3a-cfd3-4cf5-85fd-5643b7ead3f0 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.175932 Jan 22 22:13:45.593895 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4822/9348] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:45 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:46.620107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ceccee8e-5703-4dab-865b-e578b0605f40 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:46.620868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ceccee8e-5703-4dab-865b-e578b0605f40 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:46.628720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ceccee8e-5703-4dab-865b-e578b0605f40 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:46.634084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ceccee8e-5703-4dab-865b-e578b0605f40 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:46.634084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ceccee8e-5703-4dab-865b-e578b0605f40 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:46.634084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ceccee8e-5703-4dab-865b-e578b0605f40 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:46.766292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ceccee8e-5703-4dab-865b-e578b0605f40 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:46.774841 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ceccee8e-5703-4dab-865b-e578b0605f40 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.158634 Jan 22 22:13:46.775430 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4527/9349] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:46 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:47.791947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-52b70d1e-c308-4fb1-9332-64aa297bde20 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:47.792687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-52b70d1e-c308-4fb1-9332-64aa297bde20 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:47.800102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52b70d1e-c308-4fb1-9332-64aa297bde20 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:47.800573 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52b70d1e-c308-4fb1-9332-64aa297bde20 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:47.801422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52b70d1e-c308-4fb1-9332-64aa297bde20 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:47.801919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-52b70d1e-c308-4fb1-9332-64aa297bde20 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:47.947070 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-52b70d1e-c308-4fb1-9332-64aa297bde20 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:47.956716 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-52b70d1e-c308-4fb1-9332-64aa297bde20 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.168412 Jan 22 22:13:47.966845 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4823/9350] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:47 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:48.973734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-97d9bbb3-40c5-4627-b2e2-9ba6f6ee6c3b tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:48.974307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-97d9bbb3-40c5-4627-b2e2-9ba6f6ee6c3b tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:48.981250 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97d9bbb3-40c5-4627-b2e2-9ba6f6ee6c3b tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:48.981733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97d9bbb3-40c5-4627-b2e2-9ba6f6ee6c3b tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:48.982515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97d9bbb3-40c5-4627-b2e2-9ba6f6ee6c3b tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:48.982962 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-97d9bbb3-40c5-4627-b2e2-9ba6f6ee6c3b tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:49.111111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-97d9bbb3-40c5-4627-b2e2-9ba6f6ee6c3b tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:49.118433 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-97d9bbb3-40c5-4627-b2e2-9ba6f6ee6c3b tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.148504 Jan 22 22:13:49.119003 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4528/9351] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:48 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:50.135901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-54cb074d-5348-488f-ba3d-03bccf4e2b6f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:50.136541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-54cb074d-5348-488f-ba3d-03bccf4e2b6f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:50.143446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54cb074d-5348-488f-ba3d-03bccf4e2b6f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:50.143927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54cb074d-5348-488f-ba3d-03bccf4e2b6f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:50.144747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54cb074d-5348-488f-ba3d-03bccf4e2b6f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:50.145213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-54cb074d-5348-488f-ba3d-03bccf4e2b6f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:50.276461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-54cb074d-5348-488f-ba3d-03bccf4e2b6f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:50.283903 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-54cb074d-5348-488f-ba3d-03bccf4e2b6f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.151778 Jan 22 22:13:50.284493 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4824/9352] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:50 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:51.300063 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-483423f7-3409-46a8-a12b-26e8360c78bc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:51.300680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-483423f7-3409-46a8-a12b-26e8360c78bc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:51.307485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-483423f7-3409-46a8-a12b-26e8360c78bc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:51.307948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-483423f7-3409-46a8-a12b-26e8360c78bc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:51.308746 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-483423f7-3409-46a8-a12b-26e8360c78bc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:51.309195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-483423f7-3409-46a8-a12b-26e8360c78bc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:51.454570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-483423f7-3409-46a8-a12b-26e8360c78bc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:51.461948 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-483423f7-3409-46a8-a12b-26e8360c78bc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.165579 Jan 22 22:13:51.462519 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4529/9353] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:51 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:52.479637 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1893be0d-c2be-4991-9e95-4e95df053aa9 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:52.480265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1893be0d-c2be-4991-9e95-4e95df053aa9 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:52.487775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1893be0d-c2be-4991-9e95-4e95df053aa9 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:52.488197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1893be0d-c2be-4991-9e95-4e95df053aa9 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:52.489133 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1893be0d-c2be-4991-9e95-4e95df053aa9 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:52.489458 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1893be0d-c2be-4991-9e95-4e95df053aa9 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:52.604967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-c46e0be7-ed54-46be-8015-e1f76ac2702b req-9fa67e4a-f583-4721-9db5-5b22c31baaae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c59a0705-e5a3-4dc5-b000-6e8b2e6150fd", "tag": "5c02f459-aee7-47b5-8072-0ab1d534bc80"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:13:52.609441 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:13:52.609441 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:13:52.619227 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c46e0be7-ed54-46be-8015-e1f76ac2702b req-9fa67e4a-f583-4721-9db5-5b22c31baaae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:52.619688 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c46e0be7-ed54-46be-8015-e1f76ac2702b req-9fa67e4a-f583-4721-9db5-5b22c31baaae service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:52.636826 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-c46e0be7-ed54-46be-8015-e1f76ac2702b req-9fa67e4a-f583-4721-9db5-5b22c31baaae service nova] Creating event network-changed:5c02f459-aee7-47b5-8072-0ab1d534bc80 for instance c59a0705-e5a3-4dc5-b000-6e8b2e6150fd on nch2-master-1 Jan 22 22:13:52.646840 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-c46e0be7-ed54-46be-8015-e1f76ac2702b req-9fa67e4a-f583-4721-9db5-5b22c31baaae service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045432 Jan 22 22:13:52.648530 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4530/9354] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:13:52.714273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1893be0d-c2be-4991-9e95-4e95df053aa9 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:52.723264 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1893be0d-c2be-4991-9e95-4e95df053aa9 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.247569 Jan 22 22:13:52.723985 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4825/9355] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:52 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:53.741591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d8e5960-189e-460c-9c02-4f80c0d2f9b8 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:53.742317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d8e5960-189e-460c-9c02-4f80c0d2f9b8 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:53.750326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d8e5960-189e-460c-9c02-4f80c0d2f9b8 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:53.750791 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d8e5960-189e-460c-9c02-4f80c0d2f9b8 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:53.751595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d8e5960-189e-460c-9c02-4f80c0d2f9b8 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:53.752044 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d8e5960-189e-460c-9c02-4f80c0d2f9b8 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:53.882862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3d8e5960-189e-460c-9c02-4f80c0d2f9b8 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:53.890553 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d8e5960-189e-460c-9c02-4f80c0d2f9b8 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.153073 Jan 22 22:13:53.891136 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4531/9356] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:53 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:54.907991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f6a990e0-777c-4c1a-bead-ad91a5024571 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:54.908693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f6a990e0-777c-4c1a-bead-ad91a5024571 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:54.915601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6a990e0-777c-4c1a-bead-ad91a5024571 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:54.916072 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6a990e0-777c-4c1a-bead-ad91a5024571 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:54.916882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6a990e0-777c-4c1a-bead-ad91a5024571 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:54.917342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f6a990e0-777c-4c1a-bead-ad91a5024571 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:55.047923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f6a990e0-777c-4c1a-bead-ad91a5024571 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:55.055464 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f6a990e0-777c-4c1a-bead-ad91a5024571 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.152056 Jan 22 22:13:55.056065 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4826/9357] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:54 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:56.072456 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-74026915-a345-461d-98c7-b03778869909 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:56.073073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-74026915-a345-461d-98c7-b03778869909 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:56.080440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74026915-a345-461d-98c7-b03778869909 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:56.080904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74026915-a345-461d-98c7-b03778869909 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:56.081731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74026915-a345-461d-98c7-b03778869909 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:56.082184 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74026915-a345-461d-98c7-b03778869909 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:56.215868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-74026915-a345-461d-98c7-b03778869909 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:56.223716 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-74026915-a345-461d-98c7-b03778869909 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.154998 Jan 22 22:13:56.224327 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4532/9358] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:56 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:57.240701 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74d02802-a526-44c7-8831-05c34e57e72c tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:57.241328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-74d02802-a526-44c7-8831-05c34e57e72c tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:57.248169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74d02802-a526-44c7-8831-05c34e57e72c tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:57.249198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74d02802-a526-44c7-8831-05c34e57e72c tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:57.249982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74d02802-a526-44c7-8831-05c34e57e72c tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:57.250434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74d02802-a526-44c7-8831-05c34e57e72c tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:57.383952 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-74d02802-a526-44c7-8831-05c34e57e72c tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:57.392272 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-74d02802-a526-44c7-8831-05c34e57e72c tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.155511 Jan 22 22:13:57.392857 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4827/9359] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:57 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:58.410118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0e1a0d02-b81a-4596-98ec-02802e5859ff tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:58.410736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0e1a0d02-b81a-4596-98ec-02802e5859ff tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:58.416852 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e1a0d02-b81a-4596-98ec-02802e5859ff tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:58.417315 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e1a0d02-b81a-4596-98ec-02802e5859ff tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:58.418175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e1a0d02-b81a-4596-98ec-02802e5859ff tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:58.418624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0e1a0d02-b81a-4596-98ec-02802e5859ff tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:58.551391 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0e1a0d02-b81a-4596-98ec-02802e5859ff tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:58.558817 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0e1a0d02-b81a-4596-98ec-02802e5859ff tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.154530 Jan 22 22:13:58.559395 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4533/9360] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:58 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:13:59.201219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-cbc24f74-2da7-4637-8c9c-f6b4869be27e req-5a98ba85-8784-4921-89d1-d96ef3bd4890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c59a0705-e5a3-4dc5-b000-6e8b2e6150fd", "name": "network-vif-plugged", "status": "completed", "tag": "5c02f459-aee7-47b5-8072-0ab1d534bc80"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:13:59.203840 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:13:59.203840 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:13:59.211761 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-cbc24f74-2da7-4637-8c9c-f6b4869be27e req-5a98ba85-8784-4921-89d1-d96ef3bd4890 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:59.212238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-cbc24f74-2da7-4637-8c9c-f6b4869be27e req-5a98ba85-8784-4921-89d1-d96ef3bd4890 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:59.224183 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-cbc24f74-2da7-4637-8c9c-f6b4869be27e req-5a98ba85-8784-4921-89d1-d96ef3bd4890 service nova] Creating event network-vif-plugged:5c02f459-aee7-47b5-8072-0ab1d534bc80 for instance c59a0705-e5a3-4dc5-b000-6e8b2e6150fd on nch2-master-1 Jan 22 22:13:59.229384 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-cbc24f74-2da7-4637-8c9c-f6b4869be27e req-5a98ba85-8784-4921-89d1-d96ef3bd4890 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031839 Jan 22 22:13:59.230009 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4828/9361] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:13:59.574551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b86833d9-f833-4bb6-8f53-86029f8da421 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:13:59.575167 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b86833d9-f833-4bb6-8f53-86029f8da421 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:13:59.582178 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b86833d9-f833-4bb6-8f53-86029f8da421 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:59.582648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b86833d9-f833-4bb6-8f53-86029f8da421 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:59.583443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b86833d9-f833-4bb6-8f53-86029f8da421 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:13:59.583895 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b86833d9-f833-4bb6-8f53-86029f8da421 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:13:59.713370 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b86833d9-f833-4bb6-8f53-86029f8da421 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:13:59.721924 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b86833d9-f833-4bb6-8f53-86029f8da421 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.151077 Jan 22 22:13:59.722498 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4534/9362] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:13:59 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:14:00.743069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6eecb99d-33ef-4a26-8f64-9ba8e4d11f51 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:14:00.744167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6eecb99d-33ef-4a26-8f64-9ba8e4d11f51 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:14:00.751696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6eecb99d-33ef-4a26-8f64-9ba8e4d11f51 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:00.752175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6eecb99d-33ef-4a26-8f64-9ba8e4d11f51 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:00.753029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6eecb99d-33ef-4a26-8f64-9ba8e4d11f51 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:00.753477 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6eecb99d-33ef-4a26-8f64-9ba8e4d11f51 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:00.891462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6eecb99d-33ef-4a26-8f64-9ba8e4d11f51 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:14:00.899031 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6eecb99d-33ef-4a26-8f64-9ba8e4d11f51 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1361 microversion: 2.1 time: 0.162973 Jan 22 22:14:00.899654 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4829/9363] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:14:00 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:14:01.915800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-cad2975e-63b6-41a4-9326-acc1364adfc1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:14:01.916423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-cad2975e-63b6-41a4-9326-acc1364adfc1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:14:01.923591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cad2975e-63b6-41a4-9326-acc1364adfc1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:01.924112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cad2975e-63b6-41a4-9326-acc1364adfc1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:01.924854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cad2975e-63b6-41a4-9326-acc1364adfc1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:01.925307 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-cad2975e-63b6-41a4-9326-acc1364adfc1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:02.059579 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-cad2975e-63b6-41a4-9326-acc1364adfc1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:14:02.068270 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-cad2975e-63b6-41a4-9326-acc1364adfc1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1551 microversion: 2.1 time: 0.156194 Jan 22 22:14:02.068867 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4535/9364] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:14:01 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:14:02.084588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b015c95e-7583-4165-98cb-6d792b431328 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:14:02.085225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b015c95e-7583-4165-98cb-6d792b431328 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:14:02.091974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b015c95e-7583-4165-98cb-6d792b431328 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:02.092457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b015c95e-7583-4165-98cb-6d792b431328 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:02.093263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b015c95e-7583-4165-98cb-6d792b431328 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:02.093763 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b015c95e-7583-4165-98cb-6d792b431328 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:02.225587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b015c95e-7583-4165-98cb-6d792b431328 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:14:02.233819 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b015c95e-7583-4165-98cb-6d792b431328 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1551 microversion: 2.1 time: 0.152519 Jan 22 22:14:02.234628 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4830/9365] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:14:02 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:14:02.249835 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9e8da611-e373-49ce-851c-7668be2dcc3e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:14:02.253036 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:14:02.253036 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:14:02.254077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9e8da611-e373-49ce-851c-7668be2dcc3e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:14:02.254864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9e8da611-e373-49ce-851c-7668be2dcc3e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Searching by: {'deleted': False, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768'} {{(pid=137033) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 22 22:14:02.260245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e8da611-e373-49ce-851c-7668be2dcc3e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:02.260706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e8da611-e373-49ce-851c-7668be2dcc3e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:02.261558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e8da611-e373-49ce-851c-7668be2dcc3e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:02.262019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e8da611-e373-49ce-851c-7668be2dcc3e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:02.288349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.multi_cell_list [None req-9e8da611-e373-49ce-851c-7668be2dcc3e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137033) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 22 22:14:02.318436 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9e8da611-e373-49ce-851c-7668be2dcc3e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.072724 Jan 22 22:14:02.319027 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4536/9366] 10.222.0.100 () {58 vars in 1129 bytes} [Sat Jan 22 22:14:02 2022] GET /compute/v2.1/servers => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:14:02.330080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1b1c4de6-88b7-4c01-9ac0-be51e224ccfa tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:14:02.330731 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1b1c4de6-88b7-4c01-9ac0-be51e224ccfa tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:14:02.336693 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b1c4de6-88b7-4c01-9ac0-be51e224ccfa tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:02.337166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b1c4de6-88b7-4c01-9ac0-be51e224ccfa tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:02.338004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b1c4de6-88b7-4c01-9ac0-be51e224ccfa tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:02.338466 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b1c4de6-88b7-4c01-9ac0-be51e224ccfa tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:02.469338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1b1c4de6-88b7-4c01-9ac0-be51e224ccfa tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:14:02.477243 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1b1c4de6-88b7-4c01-9ac0-be51e224ccfa tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1551 microversion: 2.1 time: 0.151818 Jan 22 22:14:02.477868 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4831/9367] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:14:02 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:14:04.316387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-23626ab8-6f90-4873-9fe4-746282253b2f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fa161d7-5601-4846-82ec-131a92a4cdbb"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:14:04.317448 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-23626ab8-6f90-4873-9fe4-746282253b2f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:14:04.324168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23626ab8-6f90-4873-9fe4-746282253b2f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:04.324628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23626ab8-6f90-4873-9fe4-746282253b2f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:04.325414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23626ab8-6f90-4873-9fe4-746282253b2f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:04.325917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-23626ab8-6f90-4873-9fe4-746282253b2f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:04.992092 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-23626ab8-6f90-4873-9fe4-746282253b2f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "POST /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.679510 Jan 22 22:14:04.992758 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4537/9368] 10.222.0.100 () {60 vars in 1327 bytes} [Sat Jan 22 22:14:04 2022] POST /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/os-volume_attachments => generated 194 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:14:08.301886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1dda5940-6f13-48e6-802f-8d4aaad46b56 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:14:08.302525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1dda5940-6f13-48e6-802f-8d4aaad46b56 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:14:08.309281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1dda5940-6f13-48e6-802f-8d4aaad46b56 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:08.309800 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1dda5940-6f13-48e6-802f-8d4aaad46b56 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:08.310614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1dda5940-6f13-48e6-802f-8d4aaad46b56 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:08.311080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1dda5940-6f13-48e6-802f-8d4aaad46b56 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:08.446907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1dda5940-6f13-48e6-802f-8d4aaad46b56 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:14:08.456012 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1dda5940-6f13-48e6-802f-8d4aaad46b56 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1597 microversion: 2.1 time: 0.158306 Jan 22 22:14:08.456600 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4832/9369] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:14:08 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1597 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:14:10.306588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-3d885a15-25b2-45f1-adfe-ac41e2dca08c req-0e475f9b-d7a4-4e21-87d8-b4b19eb64406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c59a0705-e5a3-4dc5-b000-6e8b2e6150fd", "tag": "5c02f459-aee7-47b5-8072-0ab1d534bc80"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:14:10.308426 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:14:10.308426 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:14:10.316670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3d885a15-25b2-45f1-adfe-ac41e2dca08c req-0e475f9b-d7a4-4e21-87d8-b4b19eb64406 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:10.317464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-3d885a15-25b2-45f1-adfe-ac41e2dca08c req-0e475f9b-d7a4-4e21-87d8-b4b19eb64406 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:10.330487 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-3d885a15-25b2-45f1-adfe-ac41e2dca08c req-0e475f9b-d7a4-4e21-87d8-b4b19eb64406 service nova] Creating event network-changed:5c02f459-aee7-47b5-8072-0ab1d534bc80 for instance c59a0705-e5a3-4dc5-b000-6e8b2e6150fd on nch2-master-1 Jan 22 22:14:10.335318 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-3d885a15-25b2-45f1-adfe-ac41e2dca08c req-0e475f9b-d7a4-4e21-87d8-b4b19eb64406 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033972 Jan 22 22:14:10.335920 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4538/9370] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:14:12.526336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7ce1dcf3-88ca-402c-b231-0de29e6f7d12 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-268954095"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:14:12.527006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7ce1dcf3-88ca-402c-b231-0de29e6f7d12 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:14:12.534386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ce1dcf3-88ca-402c-b231-0de29e6f7d12 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:12.534871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ce1dcf3-88ca-402c-b231-0de29e6f7d12 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:12.535704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ce1dcf3-88ca-402c-b231-0de29e6f7d12 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:12.536169 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7ce1dcf3-88ca-402c-b231-0de29e6f7d12 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:12.669546 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.network.security_group_api [None req-7ce1dcf3-88ca-402c-b231-0de29e6f7d12 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Adding security group 2e66c4d0-90b0-41ea-ba95-93cce52f37f2 to port 5c02f459-aee7-47b5-8072-0ab1d534bc80 Jan 22 22:14:13.046391 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7ce1dcf3-88ca-402c-b231-0de29e6f7d12 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "POST /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/action" status: 202 len: 0 microversion: 2.1 time: 0.524704 Jan 22 22:14:13.047426 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4833/9371] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:14:12 2022] POST /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:14:13.056037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f792dd1b-847a-438e-874d-7973989088db tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:14:13.057325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f792dd1b-847a-438e-874d-7973989088db tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:14:13.061840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-bd80bc92-4f89-4696-9564-23bc85d30677 req-6d15e65c-5ad5-4ba5-975c-ae09e920c9ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c59a0705-e5a3-4dc5-b000-6e8b2e6150fd", "tag": "5c02f459-aee7-47b5-8072-0ab1d534bc80"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:14:13.063430 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:14:13.063430 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:14:13.067312 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f792dd1b-847a-438e-874d-7973989088db tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:13.067975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f792dd1b-847a-438e-874d-7973989088db tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:13.068926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f792dd1b-847a-438e-874d-7973989088db tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:13.069535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f792dd1b-847a-438e-874d-7973989088db tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:13.072490 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bd80bc92-4f89-4696-9564-23bc85d30677 req-6d15e65c-5ad5-4ba5-975c-ae09e920c9ea service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:14:13.072959 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bd80bc92-4f89-4696-9564-23bc85d30677 req-6d15e65c-5ad5-4ba5-975c-ae09e920c9ea service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:14:13.092653 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-bd80bc92-4f89-4696-9564-23bc85d30677 req-6d15e65c-5ad5-4ba5-975c-ae09e920c9ea service nova] Creating event network-changed:5c02f459-aee7-47b5-8072-0ab1d534bc80 for instance c59a0705-e5a3-4dc5-b000-6e8b2e6150fd on nch2-master-1 Jan 22 22:14:13.099373 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-bd80bc92-4f89-4696-9564-23bc85d30677 req-6d15e65c-5ad5-4ba5-975c-ae09e920c9ea service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040909 Jan 22 22:14:13.115199 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4834/9372] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:14:13.270955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f792dd1b-847a-438e-874d-7973989088db tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:14:13.284680 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f792dd1b-847a-438e-874d-7973989088db tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1762 microversion: 2.1 time: 0.232669 Jan 22 22:14:13.285735 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4539/9373] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:14:13 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1762 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:14:54.694907 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:14:54.695457 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:14:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:15:13.793069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-13643a48-0205-4af8-81ae-9bbed1dea1c8 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:15:13.794135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-13643a48-0205-4af8-81ae-9bbed1dea1c8 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:15:13.800472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13643a48-0205-4af8-81ae-9bbed1dea1c8 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:13.800977 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13643a48-0205-4af8-81ae-9bbed1dea1c8 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:13.802328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13643a48-0205-4af8-81ae-9bbed1dea1c8 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:13.802796 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13643a48-0205-4af8-81ae-9bbed1dea1c8 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:14.019172 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-13643a48-0205-4af8-81ae-9bbed1dea1c8 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "POST /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/action" status: 202 len: 0 microversion: 2.1 time: 0.232449 Jan 22 22:15:14.019836 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4835/9374] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:15:13 2022] POST /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:15:14.028846 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ec31df28-2026-46a4-8aa4-a0657db69170 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:15:14.029477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ec31df28-2026-46a4-8aa4-a0657db69170 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:15:14.036021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec31df28-2026-46a4-8aa4-a0657db69170 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:14.036566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec31df28-2026-46a4-8aa4-a0657db69170 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:14.037352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec31df28-2026-46a4-8aa4-a0657db69170 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:14.037824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ec31df28-2026-46a4-8aa4-a0657db69170 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:14.187366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ec31df28-2026-46a4-8aa4-a0657db69170 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:15:14.202311 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ec31df28-2026-46a4-8aa4-a0657db69170 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1754 microversion: 2.1 time: 0.177112 Jan 22 22:15:14.213629 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4540/9375] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:15:14 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:15:15.222091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-04b2f09c-5219-43db-829a-5156d44811e1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:15:15.222823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-04b2f09c-5219-43db-829a-5156d44811e1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:15:15.229301 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04b2f09c-5219-43db-829a-5156d44811e1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:15.229814 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04b2f09c-5219-43db-829a-5156d44811e1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:15.230634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04b2f09c-5219-43db-829a-5156d44811e1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:15.231083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-04b2f09c-5219-43db-829a-5156d44811e1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:15.379463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-04b2f09c-5219-43db-829a-5156d44811e1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:15:15.387622 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-04b2f09c-5219-43db-829a-5156d44811e1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1759 microversion: 2.1 time: 0.170449 Jan 22 22:15:15.388200 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4836/9376] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:15:15 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:15:16.405151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4f34ce86-2416-4edc-9a63-6e731d95080f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:15:16.405868 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4f34ce86-2416-4edc-9a63-6e731d95080f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:15:16.412941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f34ce86-2416-4edc-9a63-6e731d95080f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:16.413404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f34ce86-2416-4edc-9a63-6e731d95080f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:16.414238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f34ce86-2416-4edc-9a63-6e731d95080f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:16.414691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4f34ce86-2416-4edc-9a63-6e731d95080f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:16.572226 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4f34ce86-2416-4edc-9a63-6e731d95080f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:15:16.580209 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4f34ce86-2416-4edc-9a63-6e731d95080f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1759 microversion: 2.1 time: 0.178863 Jan 22 22:15:16.590055 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4541/9377] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:15:16 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1759 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:15:17.597243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2b0e6f3a-e0a1-40dc-b7d9-7781ac7c33b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:15:17.597897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2b0e6f3a-e0a1-40dc-b7d9-7781ac7c33b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:15:17.604993 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b0e6f3a-e0a1-40dc-b7d9-7781ac7c33b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:17.605457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b0e6f3a-e0a1-40dc-b7d9-7781ac7c33b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:17.606271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b0e6f3a-e0a1-40dc-b7d9-7781ac7c33b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:17.606723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2b0e6f3a-e0a1-40dc-b7d9-7781ac7c33b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:17.753257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2b0e6f3a-e0a1-40dc-b7d9-7781ac7c33b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:15:17.761709 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2b0e6f3a-e0a1-40dc-b7d9-7781ac7c33b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1759 microversion: 2.1 time: 0.168092 Jan 22 22:15:17.762273 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4837/9378] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:15:17 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:15:18.779233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-be2a65e8-7566-4c93-a36d-f507683abb93 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:15:18.788121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-be2a65e8-7566-4c93-a36d-f507683abb93 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:15:18.788121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be2a65e8-7566-4c93-a36d-f507683abb93 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:18.788121 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be2a65e8-7566-4c93-a36d-f507683abb93 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:18.788764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be2a65e8-7566-4c93-a36d-f507683abb93 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:18.789216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be2a65e8-7566-4c93-a36d-f507683abb93 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:18.934117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-be2a65e8-7566-4c93-a36d-f507683abb93 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:15:18.942557 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-be2a65e8-7566-4c93-a36d-f507683abb93 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1759 microversion: 2.1 time: 0.166827 Jan 22 22:15:18.943141 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4542/9379] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:15:18 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:15:19.958754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-39772c8e-6b5f-462d-9ed9-be59f5294cdb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:15:19.959388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-39772c8e-6b5f-462d-9ed9-be59f5294cdb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:15:19.966219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39772c8e-6b5f-462d-9ed9-be59f5294cdb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:19.966687 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39772c8e-6b5f-462d-9ed9-be59f5294cdb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:19.967495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39772c8e-6b5f-462d-9ed9-be59f5294cdb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:19.967957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-39772c8e-6b5f-462d-9ed9-be59f5294cdb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:20.111013 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-39772c8e-6b5f-462d-9ed9-be59f5294cdb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:15:20.119887 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-39772c8e-6b5f-462d-9ed9-be59f5294cdb tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1759 microversion: 2.1 time: 0.164994 Jan 22 22:15:20.120468 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4838/9380] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:15:19 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:15:21.142416 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b985298-9420-4229-8953-5f27a0326dd6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:15:21.143071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4b985298-9420-4229-8953-5f27a0326dd6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:15:21.150641 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b985298-9420-4229-8953-5f27a0326dd6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:21.151105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b985298-9420-4229-8953-5f27a0326dd6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:21.151913 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b985298-9420-4229-8953-5f27a0326dd6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:21.152364 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b985298-9420-4229-8953-5f27a0326dd6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:21.296691 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4b985298-9420-4229-8953-5f27a0326dd6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:15:21.305388 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b985298-9420-4229-8953-5f27a0326dd6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1759 microversion: 2.1 time: 0.166792 Jan 22 22:15:21.306001 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4543/9381] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:15:21 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:15:22.322775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-380f69a5-dba5-4870-9e65-85c1b5b6a5c6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:15:22.323405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-380f69a5-dba5-4870-9e65-85c1b5b6a5c6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:15:22.330251 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-380f69a5-dba5-4870-9e65-85c1b5b6a5c6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:22.330725 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-380f69a5-dba5-4870-9e65-85c1b5b6a5c6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:22.331533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-380f69a5-dba5-4870-9e65-85c1b5b6a5c6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:22.331994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-380f69a5-dba5-4870-9e65-85c1b5b6a5c6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:22.484014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-380f69a5-dba5-4870-9e65-85c1b5b6a5c6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:15:22.492365 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-380f69a5-dba5-4870-9e65-85c1b5b6a5c6 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1759 microversion: 2.1 time: 0.173318 Jan 22 22:15:22.492926 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4839/9382] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:15:22 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:15:23.509784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-15886306-2828-4dfc-805e-a91f0b7e8239 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:15:23.510393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-15886306-2828-4dfc-805e-a91f0b7e8239 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:15:23.517165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15886306-2828-4dfc-805e-a91f0b7e8239 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:23.517659 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15886306-2828-4dfc-805e-a91f0b7e8239 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:23.518449 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15886306-2828-4dfc-805e-a91f0b7e8239 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:23.518893 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-15886306-2828-4dfc-805e-a91f0b7e8239 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:23.671588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-15886306-2828-4dfc-805e-a91f0b7e8239 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:15:23.679641 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-15886306-2828-4dfc-805e-a91f0b7e8239 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1759 microversion: 2.1 time: 0.173958 Jan 22 22:15:23.680213 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4544/9383] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:15:23 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:15:24.696663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-38bd2b36-d39b-4a52-9e4a-a5d8ee97e468 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:15:24.697225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-38bd2b36-d39b-4a52-9e4a-a5d8ee97e468 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:15:24.704142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38bd2b36-d39b-4a52-9e4a-a5d8ee97e468 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:24.704611 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38bd2b36-d39b-4a52-9e4a-a5d8ee97e468 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:24.705412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38bd2b36-d39b-4a52-9e4a-a5d8ee97e468 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:24.705896 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-38bd2b36-d39b-4a52-9e4a-a5d8ee97e468 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:24.851367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-38bd2b36-d39b-4a52-9e4a-a5d8ee97e468 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:15:24.859387 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-38bd2b36-d39b-4a52-9e4a-a5d8ee97e468 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1759 microversion: 2.1 time: 0.167011 Jan 22 22:15:24.859961 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4840/9384] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:15:24 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:15:25.876046 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2344d19e-804a-45ed-ba47-56d96f371718 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:15:25.876686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2344d19e-804a-45ed-ba47-56d96f371718 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:15:25.884372 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2344d19e-804a-45ed-ba47-56d96f371718 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:25.884830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2344d19e-804a-45ed-ba47-56d96f371718 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:25.885685 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2344d19e-804a-45ed-ba47-56d96f371718 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:15:25.886138 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2344d19e-804a-45ed-ba47-56d96f371718 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:15:26.034362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2344d19e-804a-45ed-ba47-56d96f371718 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:15:26.045868 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2344d19e-804a-45ed-ba47-56d96f371718 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1762 microversion: 2.1 time: 0.173506 Jan 22 22:15:26.046457 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4545/9385] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:15:25 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1762 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:16:29.334858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2448c4d3-2116-4a84-b084-eceea1aa14a7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-268954095"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:16:29.335486 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2448c4d3-2116-4a84-b084-eceea1aa14a7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:16:29.341435 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2448c4d3-2116-4a84-b084-eceea1aa14a7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:29.341930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2448c4d3-2116-4a84-b084-eceea1aa14a7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:29.342722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2448c4d3-2116-4a84-b084-eceea1aa14a7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:29.343179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2448c4d3-2116-4a84-b084-eceea1aa14a7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:29.477733 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.network.security_group_api [None req-2448c4d3-2116-4a84-b084-eceea1aa14a7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Removing security group 2e66c4d0-90b0-41ea-ba95-93cce52f37f2 from port 5c02f459-aee7-47b5-8072-0ab1d534bc80 Jan 22 22:16:29.887175 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2448c4d3-2116-4a84-b084-eceea1aa14a7 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "POST /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/action" status: 202 len: 0 microversion: 2.1 time: 0.557040 Jan 22 22:16:29.888281 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4841/9386] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:16:29 2022] POST /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:16:29.978617 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-8f8768cf-5974-4570-93d6-bb1a80eeed05 req-d0805ba5-547d-4846-8704-d5b6213272d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c59a0705-e5a3-4dc5-b000-6e8b2e6150fd", "tag": "5c02f459-aee7-47b5-8072-0ab1d534bc80"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:16:29.980672 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:16:29.980672 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:16:29.988452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8f8768cf-5974-4570-93d6-bb1a80eeed05 req-d0805ba5-547d-4846-8704-d5b6213272d6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:29.988848 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-8f8768cf-5974-4570-93d6-bb1a80eeed05 req-d0805ba5-547d-4846-8704-d5b6213272d6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:30.008797 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-8f8768cf-5974-4570-93d6-bb1a80eeed05 req-d0805ba5-547d-4846-8704-d5b6213272d6 service nova] Creating event network-changed:5c02f459-aee7-47b5-8072-0ab1d534bc80 for instance c59a0705-e5a3-4dc5-b000-6e8b2e6150fd on nch2-master-1 Jan 22 22:16:30.013734 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [req-8f8768cf-5974-4570-93d6-bb1a80eeed05 req-d0805ba5-547d-4846-8704-d5b6213272d6 service nova] [f962eaa4-b2c4-4269-b24d-bd2b807893d1] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 22:16:31.021973 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [req-8f8768cf-5974-4570-93d6-bb1a80eeed05 req-d0805ba5-547d-4846-8704-d5b6213272d6 service nova] [f962eaa4-b2c4-4269-b24d-bd2b807893d1] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 60696. Jan 22 22:16:31.026254 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-8f8768cf-5974-4570-93d6-bb1a80eeed05 req-d0805ba5-547d-4846-8704-d5b6213272d6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.139106 Jan 22 22:16:31.026864 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4546/9387] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:16:31.090936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6b681b7b-ab8b-44ef-8dc7-02024e32910e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:16:31.091462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6b681b7b-ab8b-44ef-8dc7-02024e32910e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:16:31.092952 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-6144b510-6607-4cd9-8362-d4cb506dedc0 req-081e0f0f-bf17-4df6-a663-382ba92b18e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c59a0705-e5a3-4dc5-b000-6e8b2e6150fd", "tag": "5c02f459-aee7-47b5-8072-0ab1d534bc80"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:16:31.095728 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:16:31.095728 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:16:31.098583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b681b7b-ab8b-44ef-8dc7-02024e32910e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:31.099062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b681b7b-ab8b-44ef-8dc7-02024e32910e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:31.099864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b681b7b-ab8b-44ef-8dc7-02024e32910e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:31.100518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6b681b7b-ab8b-44ef-8dc7-02024e32910e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:31.106736 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6144b510-6607-4cd9-8362-d4cb506dedc0 req-081e0f0f-bf17-4df6-a663-382ba92b18e6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:31.107911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-6144b510-6607-4cd9-8362-d4cb506dedc0 req-081e0f0f-bf17-4df6-a663-382ba92b18e6 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:31.125315 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-6144b510-6607-4cd9-8362-d4cb506dedc0 req-081e0f0f-bf17-4df6-a663-382ba92b18e6 service nova] Creating event network-changed:5c02f459-aee7-47b5-8072-0ab1d534bc80 for instance c59a0705-e5a3-4dc5-b000-6e8b2e6150fd on nch2-master-1 Jan 22 22:16:31.130808 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-6144b510-6607-4cd9-8362-d4cb506dedc0 req-081e0f0f-bf17-4df6-a663-382ba92b18e6 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043868 Jan 22 22:16:31.136233 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4547/9388] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:16:31.192050 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-6b681b7b-ab8b-44ef-8dc7-02024e32910e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lazy-loading 'services' on Instance uuid c59a0705-e5a3-4dc5-b000-6e8b2e6150fd {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 22:16:31.398872 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6b681b7b-ab8b-44ef-8dc7-02024e32910e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/os-volume_attachments/8fa161d7-5601-4846-82ec-131a92a4cdbb" status: 202 len: 0 microversion: 2.1 time: 0.314292 Jan 22 22:16:31.405230 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4842/9389] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 22:16:31 2022] DELETE /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/os-volume_attachments/8fa161d7-5601-4846-82ec-131a92a4cdbb => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:16:31.409057 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-12855ef1-1bbb-4a0b-92ce-1d18c111a318 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:16:31.410130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-12855ef1-1bbb-4a0b-92ce-1d18c111a318 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:16:31.417358 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12855ef1-1bbb-4a0b-92ce-1d18c111a318 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:31.417859 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12855ef1-1bbb-4a0b-92ce-1d18c111a318 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:31.418976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12855ef1-1bbb-4a0b-92ce-1d18c111a318 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:31.419446 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-12855ef1-1bbb-4a0b-92ce-1d18c111a318 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:31.454941 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-12855ef1-1bbb-4a0b-92ce-1d18c111a318 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050078 Jan 22 22:16:31.455525 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4548/9390] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 22:16:31 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:16:32.467593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-768258f8-1d62-48a0-8414-977c62e0b16c tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:16:32.468666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-768258f8-1d62-48a0-8414-977c62e0b16c tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:16:32.476234 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-768258f8-1d62-48a0-8414-977c62e0b16c tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:32.476705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-768258f8-1d62-48a0-8414-977c62e0b16c tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:32.477552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-768258f8-1d62-48a0-8414-977c62e0b16c tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:32.478211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-768258f8-1d62-48a0-8414-977c62e0b16c tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:32.507202 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-768258f8-1d62-48a0-8414-977c62e0b16c tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044894 Jan 22 22:16:32.507775 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4843/9391] 10.222.0.100 () {58 vars in 1306 bytes} [Sat Jan 22 22:16:32 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 22 22:16:32.518322 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85380313-0138-4ac3-9c94-92de775c4d62 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:16:32.518838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-85380313-0138-4ac3-9c94-92de775c4d62 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:16:32.526147 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85380313-0138-4ac3-9c94-92de775c4d62 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:32.526597 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85380313-0138-4ac3-9c94-92de775c4d62 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:32.527378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85380313-0138-4ac3-9c94-92de775c4d62 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:32.527816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-85380313-0138-4ac3-9c94-92de775c4d62 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:32.770681 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-85380313-0138-4ac3-9c94-92de775c4d62 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] HTTP exception thrown: Instance c59a0705-e5a3-4dc5-b000-6e8b2e6150fd is not attached to volume 8fa161d7-5601-4846-82ec-131a92a4cdbb Jan 22 22:16:32.771292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-85380313-0138-4ac3-9c94-92de775c4d62 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Returning 404 to user: Instance c59a0705-e5a3-4dc5-b000-6e8b2e6150fd is not attached to volume 8fa161d7-5601-4846-82ec-131a92a4cdbb {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:16:32.772131 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-85380313-0138-4ac3-9c94-92de775c4d62 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/os-volume_attachments/8fa161d7-5601-4846-82ec-131a92a4cdbb" status: 404 len: 154 microversion: 2.1 time: 0.257721 Jan 22 22:16:32.772722 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4549/9392] 10.222.0.100 () {58 vars in 1420 bytes} [Sat Jan 22 22:16:32 2022] DELETE /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd/os-volume_attachments/8fa161d7-5601-4846-82ec-131a92a4cdbb => generated 154 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:16:33.916813 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:16:33.917429 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:16:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:16:33.965836 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:16:33.966012 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:16:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:16:35.032428 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:16:35.033302 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:16:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:16:37.197384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-45ee501d-bd05-4d71-a069-b28e5a65f6fc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:16:37.198100 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-45ee501d-bd05-4d71-a069-b28e5a65f6fc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:16:37.206659 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45ee501d-bd05-4d71-a069-b28e5a65f6fc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:37.207135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45ee501d-bd05-4d71-a069-b28e5a65f6fc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:37.207957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45ee501d-bd05-4d71-a069-b28e5a65f6fc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:37.208419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-45ee501d-bd05-4d71-a069-b28e5a65f6fc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:37.234052 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-45ee501d-bd05-4d71-a069-b28e5a65f6fc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:16:37.549310 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-45ee501d-bd05-4d71-a069-b28e5a65f6fc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "DELETE /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 204 len: 0 microversion: 2.1 time: 0.355491 Jan 22 22:16:37.549956 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4844/9393] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:16:37 2022] DELETE /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 22:16:37.558783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9a832d0a-354b-48c5-a572-07f334aaa53e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:16:37.559894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9a832d0a-354b-48c5-a572-07f334aaa53e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:16:37.567345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a832d0a-354b-48c5-a572-07f334aaa53e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:37.567792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a832d0a-354b-48c5-a572-07f334aaa53e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:37.568573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a832d0a-354b-48c5-a572-07f334aaa53e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:37.569012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9a832d0a-354b-48c5-a572-07f334aaa53e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:37.703825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9a832d0a-354b-48c5-a572-07f334aaa53e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:16:37.711318 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9a832d0a-354b-48c5-a572-07f334aaa53e tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1557 microversion: 2.1 time: 0.156956 Jan 22 22:16:37.711880 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4550/9394] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:16:37 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:16:38.729661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0341b1be-2449-45b2-91b4-ae8da6f681b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:16:38.730542 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0341b1be-2449-45b2-91b4-ae8da6f681b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:16:38.737360 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0341b1be-2449-45b2-91b4-ae8da6f681b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:38.737864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0341b1be-2449-45b2-91b4-ae8da6f681b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:38.738674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0341b1be-2449-45b2-91b4-ae8da6f681b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:38.739135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0341b1be-2449-45b2-91b4-ae8da6f681b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:38.872123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0341b1be-2449-45b2-91b4-ae8da6f681b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:16:38.879850 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0341b1be-2449-45b2-91b4-ae8da6f681b1 tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1557 microversion: 2.1 time: 0.154484 Jan 22 22:16:38.880431 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4845/9395] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:16:38 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:16:39.897883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fde18cb1-efe2-4331-8335-245ec2da6f4f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:16:39.898532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fde18cb1-efe2-4331-8335-245ec2da6f4f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:16:39.906374 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fde18cb1-efe2-4331-8335-245ec2da6f4f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:39.906935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fde18cb1-efe2-4331-8335-245ec2da6f4f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:39.907706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fde18cb1-efe2-4331-8335-245ec2da6f4f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:39.908144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fde18cb1-efe2-4331-8335-245ec2da6f4f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:39.982560 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fde18cb1-efe2-4331-8335-245ec2da6f4f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '838fe30d39014d209302ec73128bf703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6837a6f34c6c422cad0019e0f9cb0768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:16:39.994062 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fde18cb1-efe2-4331-8335-245ec2da6f4f tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 200 len: 1515 microversion: 2.1 time: 0.100228 Jan 22 22:16:39.994858 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4551/9396] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:16:39 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 1515 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:16:40.017417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-7a3f1865-8d64-4cd3-9d85-b0c19c47daf7 req-632a0ba4-a89f-4e9c-b3a7-c874737aaac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c59a0705-e5a3-4dc5-b000-6e8b2e6150fd", "name": "network-vif-deleted", "tag": "5c02f459-aee7-47b5-8072-0ab1d534bc80"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:16:40.018985 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:16:40.018985 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:16:40.027508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7a3f1865-8d64-4cd3-9d85-b0c19c47daf7 req-632a0ba4-a89f-4e9c-b3a7-c874737aaac8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:40.028200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-7a3f1865-8d64-4cd3-9d85-b0c19c47daf7 req-632a0ba4-a89f-4e9c-b3a7-c874737aaac8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:40.039234 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-7a3f1865-8d64-4cd3-9d85-b0c19c47daf7 req-632a0ba4-a89f-4e9c-b3a7-c874737aaac8 service nova] Creating event network-vif-deleted:5c02f459-aee7-47b5-8072-0ab1d534bc80 for instance c59a0705-e5a3-4dc5-b000-6e8b2e6150fd on nch2-master-1 Jan 22 22:16:40.044201 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-7a3f1865-8d64-4cd3-9d85-b0c19c47daf7 req-632a0ba4-a89f-4e9c-b3a7-c874737aaac8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030531 Jan 22 22:16:40.044795 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4846/9397] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:16:41.012588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2ae3c16d-fbc5-4e72-9834-e0a62df5ca0a tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:16:41.013118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2ae3c16d-fbc5-4e72-9834-e0a62df5ca0a tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] [instance: c59a0705-e5a3-4dc5-b000-6e8b2e6150fd] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:16:41.019669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ae3c16d-fbc5-4e72-9834-e0a62df5ca0a tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:41.020124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ae3c16d-fbc5-4e72-9834-e0a62df5ca0a tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:41.020951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ae3c16d-fbc5-4e72-9834-e0a62df5ca0a tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:16:41.021392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2ae3c16d-fbc5-4e72-9834-e0a62df5ca0a tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:16:41.037189 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-2ae3c16d-fbc5-4e72-9834-e0a62df5ca0a tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] HTTP exception thrown: Instance c59a0705-e5a3-4dc5-b000-6e8b2e6150fd could not be found. Jan 22 22:16:41.037806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2ae3c16d-fbc5-4e72-9834-e0a62df5ca0a tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Returning 404 to user: Instance c59a0705-e5a3-4dc5-b000-6e8b2e6150fd could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:16:41.039425 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2ae3c16d-fbc5-4e72-9834-e0a62df5ca0a tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd" status: 404 len: 111 microversion: 2.1 time: 0.031006 Jan 22 22:16:41.039425 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4552/9398] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:16:41 2022] GET /compute/v2.1/servers/c59a0705-e5a3-4dc5-b000-6e8b2e6150fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:16:41.048860 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-62cb6349-d521-4394-a1c6-30f0af2d6ddc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] Calling method '.version_select at 0x7f1edaf8e550>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:16:41.144867 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-62cb6349-d521-4394-a1c6-30f0af2d6ddc tempest-TestMinimumBasicScenario-1689229000 tempest-TestMinimumBasicScenario-1689229000-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-496493273" status: 202 len: 0 microversion: 2.1 time: 0.100805 Jan 22 22:16:41.145486 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4847/9399] 10.222.0.100 () {58 vars in 1273 bytes} [Sat Jan 22 22:16:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-496493273 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 22:16:53.360910 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7e0e631a-aa6b-4d5c-8e17-dfcd8189b4e7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'create', calling method: .version_select at 0x7f1ed5daba60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-601649118"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:16:53.377095 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7e0e631a-aa6b-4d5c-8e17-dfcd8189b4e7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:16:53.381288 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7e0e631a-aa6b-4d5c-8e17-dfcd8189b4e7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for user a9e6a7e25c0f4a9fbd1cc64635c2ed66 and project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:16:53.993783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7e0e631a-aa6b-4d5c-8e17-dfcd8189b4e7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:16:53.999285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-7e0e631a-aa6b-4d5c-8e17-dfcd8189b4e7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for user a9e6a7e25c0f4a9fbd1cc64635c2ed66 and project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:16:54.014005 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7e0e631a-aa6b-4d5c-8e17-dfcd8189b4e7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.812944 Jan 22 22:16:54.014605 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4553/9400] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 22:16:53 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:17:02.503950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1811992199", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "0310dbc0-bb9a-4aae-8398-66a8ea949d04"}], "key_name": "tempest-TestNetworkAdvancedServerOps-601649118", "security_groups": [{"name": "tempest-secgroup-smoke-1525264244"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:17:02.620208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] validate_networks() for [('0310dbc0-bb9a-4aae-8398-66a8ea949d04', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:17:03.100280 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:17:03.101130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:17:03.101682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:17:03.102124 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:17:03.102568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:17:03.112575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:03.113470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:03.114592 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:03.115058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:03.137908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:17:03.144143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for user a9e6a7e25c0f4a9fbd1cc64635c2ed66 and project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:17:03.158785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:17:03.161329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:17:03.286599 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7b4405e7-7cf4-4273-843c-2aba3cea2bb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.787685 Jan 22 22:17:03.287669 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4848/9401] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:17:02 2022] POST /compute/v2.1/servers => generated 408 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 22:17:03.302997 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f4dd54cc-5cb2-4757-82b3-c4e345676ef1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:17:03.307366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f4dd54cc-5cb2-4757-82b3-c4e345676ef1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:17:03.398146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f4dd54cc-5cb2-4757-82b3-c4e345676ef1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:17:03.406743 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f4dd54cc-5cb2-4757-82b3-c4e345676ef1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1270 microversion: 2.1 time: 0.112339 Jan 22 22:17:03.415147 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4554/9402] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:17:03 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1270 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:17:04.435682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4f8a626b-893d-4045-ac47-0c45749bbd39 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:17:04.435682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4f8a626b-893d-4045-ac47-0c45749bbd39 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:17:04.483399 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4f8a626b-893d-4045-ac47-0c45749bbd39 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:17:04.491581 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4f8a626b-893d-4045-ac47-0c45749bbd39 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1270 microversion: 2.1 time: 0.070660 Jan 22 22:17:04.492249 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4849/9403] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:17:04 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1270 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:17:05.508233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dfaaf74c-18a1-42d5-a577-4670da37148c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:17:05.509413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dfaaf74c-18a1-42d5-a577-4670da37148c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:17:05.517999 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfaaf74c-18a1-42d5-a577-4670da37148c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:05.518810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfaaf74c-18a1-42d5-a577-4670da37148c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:05.531107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfaaf74c-18a1-42d5-a577-4670da37148c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:05.531107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dfaaf74c-18a1-42d5-a577-4670da37148c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:05.585268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dfaaf74c-18a1-42d5-a577-4670da37148c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:17:05.594307 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dfaaf74c-18a1-42d5-a577-4670da37148c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1330 microversion: 2.1 time: 0.089711 Jan 22 22:17:05.595797 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4555/9404] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:17:05 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1330 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:17:06.612473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-66cd26b2-c0f7-4d20-aad0-4899a674ca97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:17:06.613032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-66cd26b2-c0f7-4d20-aad0-4899a674ca97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:17:06.620248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66cd26b2-c0f7-4d20-aad0-4899a674ca97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:06.621295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66cd26b2-c0f7-4d20-aad0-4899a674ca97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:06.622152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66cd26b2-c0f7-4d20-aad0-4899a674ca97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:06.622778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-66cd26b2-c0f7-4d20-aad0-4899a674ca97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:06.872303 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-66cd26b2-c0f7-4d20-aad0-4899a674ca97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:17:06.879647 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-66cd26b2-c0f7-4d20-aad0-4899a674ca97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1396 microversion: 2.1 time: 0.270941 Jan 22 22:17:06.882747 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4850/9405] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:17:06 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1396 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:17:07.342051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-19a1fe38-3bb1-4016-90e1-ce5c8ca8ba9a req-918eb5d1-16de-463f-a04a-a5fbde58cd60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8352a3-80a7-490d-8991-661fb971284d", "tag": "37b82fae-f227-496f-a47d-2ad7addf39e9"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:17:07.343634 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:17:07.343634 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:17:07.356672 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-19a1fe38-3bb1-4016-90e1-ce5c8ca8ba9a req-918eb5d1-16de-463f-a04a-a5fbde58cd60 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:07.357243 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-19a1fe38-3bb1-4016-90e1-ce5c8ca8ba9a req-918eb5d1-16de-463f-a04a-a5fbde58cd60 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:07.369636 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-19a1fe38-3bb1-4016-90e1-ce5c8ca8ba9a req-918eb5d1-16de-463f-a04a-a5fbde58cd60 service nova] Creating event network-changed:37b82fae-f227-496f-a47d-2ad7addf39e9 for instance 5f8352a3-80a7-490d-8991-661fb971284d on nch2-master-1 Jan 22 22:17:07.377337 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-19a1fe38-3bb1-4016-90e1-ce5c8ca8ba9a req-918eb5d1-16de-463f-a04a-a5fbde58cd60 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037567 Jan 22 22:17:07.377337 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4556/9406] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:17:07.897904 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7de2aaee-d6cb-4d3e-8c48-3eb9fcacc521 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:17:07.898642 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7de2aaee-d6cb-4d3e-8c48-3eb9fcacc521 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:17:07.905786 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7de2aaee-d6cb-4d3e-8c48-3eb9fcacc521 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:07.906269 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7de2aaee-d6cb-4d3e-8c48-3eb9fcacc521 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:07.907081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7de2aaee-d6cb-4d3e-8c48-3eb9fcacc521 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:07.907538 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7de2aaee-d6cb-4d3e-8c48-3eb9fcacc521 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:08.130989 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7de2aaee-d6cb-4d3e-8c48-3eb9fcacc521 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:17:08.139268 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7de2aaee-d6cb-4d3e-8c48-3eb9fcacc521 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1396 microversion: 2.1 time: 0.245308 Jan 22 22:17:08.139848 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4851/9407] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:17:07 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1396 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:17:09.158009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-92e3dac1-5561-41e9-9c1c-1a9281c4d655 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:17:09.158713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-92e3dac1-5561-41e9-9c1c-1a9281c4d655 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:17:09.164912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92e3dac1-5561-41e9-9c1c-1a9281c4d655 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:09.165379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92e3dac1-5561-41e9-9c1c-1a9281c4d655 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:09.166203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92e3dac1-5561-41e9-9c1c-1a9281c4d655 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:09.166655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-92e3dac1-5561-41e9-9c1c-1a9281c4d655 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:09.302599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-92e3dac1-5561-41e9-9c1c-1a9281c4d655 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:17:09.310385 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-92e3dac1-5561-41e9-9c1c-1a9281c4d655 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1396 microversion: 2.1 time: 0.157576 Jan 22 22:17:09.310956 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4557/9408] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:17:09 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1396 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:17:10.327815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5ad1d5bf-5734-46f8-85f9-465687f14347 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:17:10.328446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5ad1d5bf-5734-46f8-85f9-465687f14347 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:17:10.335610 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ad1d5bf-5734-46f8-85f9-465687f14347 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:10.336083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ad1d5bf-5734-46f8-85f9-465687f14347 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:10.336906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ad1d5bf-5734-46f8-85f9-465687f14347 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:10.337366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ad1d5bf-5734-46f8-85f9-465687f14347 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:10.470807 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5ad1d5bf-5734-46f8-85f9-465687f14347 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:17:10.479479 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5ad1d5bf-5734-46f8-85f9-465687f14347 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1396 microversion: 2.1 time: 0.156233 Jan 22 22:17:10.480749 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4852/9409] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:17:10 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1396 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:17:11.497306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8d10101a-1b7e-452b-b41c-784afebc9296 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:17:11.497953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8d10101a-1b7e-452b-b41c-784afebc9296 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:17:11.504114 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d10101a-1b7e-452b-b41c-784afebc9296 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:11.504578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d10101a-1b7e-452b-b41c-784afebc9296 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:11.505377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d10101a-1b7e-452b-b41c-784afebc9296 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:11.505850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8d10101a-1b7e-452b-b41c-784afebc9296 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:11.639161 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8d10101a-1b7e-452b-b41c-784afebc9296 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:17:11.646582 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8d10101a-1b7e-452b-b41c-784afebc9296 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1396 microversion: 2.1 time: 0.153198 Jan 22 22:17:11.647157 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4558/9410] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:17:11 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1396 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:17:12.664418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e7d3812f-72e3-48a5-a1f7-381f2821b6a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:17:12.665162 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e7d3812f-72e3-48a5-a1f7-381f2821b6a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:17:12.671876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7d3812f-72e3-48a5-a1f7-381f2821b6a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:12.672352 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7d3812f-72e3-48a5-a1f7-381f2821b6a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:12.673142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7d3812f-72e3-48a5-a1f7-381f2821b6a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:12.673623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7d3812f-72e3-48a5-a1f7-381f2821b6a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:12.816478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e7d3812f-72e3-48a5-a1f7-381f2821b6a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:17:12.824410 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e7d3812f-72e3-48a5-a1f7-381f2821b6a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1396 microversion: 2.1 time: 0.163980 Jan 22 22:17:12.824979 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4853/9411] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:17:12 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1396 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:17:13.841931 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7bfead4d-7cb4-4acf-b0d9-590260a13667 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:17:13.842556 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7bfead4d-7cb4-4acf-b0d9-590260a13667 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:17:13.849714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bfead4d-7cb4-4acf-b0d9-590260a13667 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:13.850181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bfead4d-7cb4-4acf-b0d9-590260a13667 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:13.850973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bfead4d-7cb4-4acf-b0d9-590260a13667 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:13.851423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bfead4d-7cb4-4acf-b0d9-590260a13667 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:13.988803 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7bfead4d-7cb4-4acf-b0d9-590260a13667 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:17:13.997335 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7bfead4d-7cb4-4acf-b0d9-590260a13667 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1396 microversion: 2.1 time: 0.159756 Jan 22 22:17:13.997986 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4559/9412] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:17:13 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1396 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:17:14.280510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-4a0a3870-7b53-43ef-81c3-8126e627cc91 req-8e440694-791d-4a9c-bfa9-7f7f428d8ffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8352a3-80a7-490d-8991-661fb971284d", "name": "network-vif-plugged", "status": "completed", "tag": "37b82fae-f227-496f-a47d-2ad7addf39e9"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:17:14.282152 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:17:14.282152 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:17:14.289135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4a0a3870-7b53-43ef-81c3-8126e627cc91 req-8e440694-791d-4a9c-bfa9-7f7f428d8ffa service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:14.289625 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-4a0a3870-7b53-43ef-81c3-8126e627cc91 req-8e440694-791d-4a9c-bfa9-7f7f428d8ffa service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:14.301662 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-4a0a3870-7b53-43ef-81c3-8126e627cc91 req-8e440694-791d-4a9c-bfa9-7f7f428d8ffa service nova] Creating event network-vif-plugged:37b82fae-f227-496f-a47d-2ad7addf39e9 for instance 5f8352a3-80a7-490d-8991-661fb971284d on nch2-master-1 Jan 22 22:17:14.306594 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-4a0a3870-7b53-43ef-81c3-8126e627cc91 req-8e440694-791d-4a9c-bfa9-7f7f428d8ffa service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089569 Jan 22 22:17:14.307198 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4854/9413] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:17:15.014637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-25b7df62-61de-46cd-a359-42f595f85a91 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:17:15.015252 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-25b7df62-61de-46cd-a359-42f595f85a91 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:17:15.022041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25b7df62-61de-46cd-a359-42f595f85a91 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:15.022502 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25b7df62-61de-46cd-a359-42f595f85a91 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:15.023298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25b7df62-61de-46cd-a359-42f595f85a91 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:15.023748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25b7df62-61de-46cd-a359-42f595f85a91 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:15.155681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-25b7df62-61de-46cd-a359-42f595f85a91 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:17:15.163083 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-25b7df62-61de-46cd-a359-42f595f85a91 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1396 microversion: 2.1 time: 0.152715 Jan 22 22:17:15.163668 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4560/9414] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:17:15 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1396 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:17:16.181178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08edf12c-786b-407e-825f-edee937939bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:17:16.181922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-08edf12c-786b-407e-825f-edee937939bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:17:16.188868 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08edf12c-786b-407e-825f-edee937939bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:16.189336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08edf12c-786b-407e-825f-edee937939bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:16.190164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08edf12c-786b-407e-825f-edee937939bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:16.190627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08edf12c-786b-407e-825f-edee937939bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:16.325848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-08edf12c-786b-407e-825f-edee937939bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:17:16.333206 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-08edf12c-786b-407e-825f-edee937939bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1569 microversion: 2.1 time: 0.156964 Jan 22 22:17:16.333804 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4855/9415] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:17:16 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:17:16.349409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-59c7df18-3661-401b-8936-5bb0cc10ee56 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:17:16.350055 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-59c7df18-3661-401b-8936-5bb0cc10ee56 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:17:16.356776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59c7df18-3661-401b-8936-5bb0cc10ee56 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:16.357266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59c7df18-3661-401b-8936-5bb0cc10ee56 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:16.358090 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59c7df18-3661-401b-8936-5bb0cc10ee56 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:16.358542 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-59c7df18-3661-401b-8936-5bb0cc10ee56 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:16.493932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-59c7df18-3661-401b-8936-5bb0cc10ee56 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:17:16.502094 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-59c7df18-3661-401b-8936-5bb0cc10ee56 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1569 microversion: 2.1 time: 0.156694 Jan 22 22:17:16.502692 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4561/9416] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:17:16 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:17:18.797141 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9346ea5a-9ecd-4064-8a89-4373d679cc5e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:17:18.797823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9346ea5a-9ecd-4064-8a89-4373d679cc5e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:17:18.799259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-d569340e-e1b4-4ea4-af3a-e930b1da789d req-7d1e9641-08a6-4b24-829f-a3b450d23169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8352a3-80a7-490d-8991-661fb971284d", "tag": "37b82fae-f227-496f-a47d-2ad7addf39e9"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:17:18.800863 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:17:18.800863 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:17:18.804871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9346ea5a-9ecd-4064-8a89-4373d679cc5e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:18.805354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9346ea5a-9ecd-4064-8a89-4373d679cc5e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:18.806539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9346ea5a-9ecd-4064-8a89-4373d679cc5e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:18.806539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9346ea5a-9ecd-4064-8a89-4373d679cc5e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:18.810733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d569340e-e1b4-4ea4-af3a-e930b1da789d req-7d1e9641-08a6-4b24-829f-a3b450d23169 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:18.811263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-d569340e-e1b4-4ea4-af3a-e930b1da789d req-7d1e9641-08a6-4b24-829f-a3b450d23169 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:18.823921 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-d569340e-e1b4-4ea4-af3a-e930b1da789d req-7d1e9641-08a6-4b24-829f-a3b450d23169 service nova] Creating event network-changed:37b82fae-f227-496f-a47d-2ad7addf39e9 for instance 5f8352a3-80a7-490d-8991-661fb971284d on nch2-master-1 Jan 22 22:17:18.829141 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-d569340e-e1b4-4ea4-af3a-e930b1da789d req-7d1e9641-08a6-4b24-829f-a3b450d23169 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033661 Jan 22 22:17:18.830058 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4562/9417] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:17:19.038398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9346ea5a-9ecd-4064-8a89-4373d679cc5e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:17:19.048213 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9346ea5a-9ecd-4064-8a89-4373d679cc5e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1569 microversion: 2.1 time: 0.255031 Jan 22 22:17:19.048861 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4856/9418] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:17:18 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1569 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:17:52.338050 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9cb21dd5-ee8d-4ae1-9655-402d4d54bbce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:17:52.339052 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9cb21dd5-ee8d-4ae1-9655-402d4d54bbce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:17:52.345492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9cb21dd5-ee8d-4ae1-9655-402d4d54bbce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:52.346303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9cb21dd5-ee8d-4ae1-9655-402d4d54bbce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:52.347097 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9cb21dd5-ee8d-4ae1-9655-402d4d54bbce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:17:52.347546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9cb21dd5-ee8d-4ae1-9655-402d4d54bbce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:17:52.402065 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9cb21dd5-ee8d-4ae1-9655-402d4d54bbce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d/action" status: 200 len: 24566 microversion: 2.1 time: 0.068896 Jan 22 22:17:52.402730 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4563/9419] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:17:52 2022] POST /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d/action => generated 24566 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:18:22.854832 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9e304ffa-6bc3-4aed-9358-b69408ab68a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:18:22.855407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9e304ffa-6bc3-4aed-9358-b69408ab68a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:22.861919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e304ffa-6bc3-4aed-9358-b69408ab68a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:22.862387 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e304ffa-6bc3-4aed-9358-b69408ab68a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:22.863185 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e304ffa-6bc3-4aed-9358-b69408ab68a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:22.863639 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9e304ffa-6bc3-4aed-9358-b69408ab68a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:23.110354 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9e304ffa-6bc3-4aed-9358-b69408ab68a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d/action" status: 202 len: 0 microversion: 2.1 time: 0.260031 Jan 22 22:18:23.110989 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4857/9420] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:18:22 2022] POST /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:18:23.120108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c9ce020e-95cc-405a-a9c9-6aeaf4a6b6cb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:23.120925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c9ce020e-95cc-405a-a9c9-6aeaf4a6b6cb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:23.128563 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9ce020e-95cc-405a-a9c9-6aeaf4a6b6cb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:23.129013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9ce020e-95cc-405a-a9c9-6aeaf4a6b6cb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:23.129832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9ce020e-95cc-405a-a9c9-6aeaf4a6b6cb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:23.130281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c9ce020e-95cc-405a-a9c9-6aeaf4a6b6cb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:23.271656 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c9ce020e-95cc-405a-a9c9-6aeaf4a6b6cb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:23.279225 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c9ce020e-95cc-405a-a9c9-6aeaf4a6b6cb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1693 microversion: 2.1 time: 0.163495 Jan 22 22:18:23.280838 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4564/9421] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:23 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:24.299239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1fdce23f-bc86-4974-95a0-583d13165c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:24.299949 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1fdce23f-bc86-4974-95a0-583d13165c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:24.306210 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1fdce23f-bc86-4974-95a0-583d13165c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:24.306692 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1fdce23f-bc86-4974-95a0-583d13165c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:24.307501 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1fdce23f-bc86-4974-95a0-583d13165c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:24.307969 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1fdce23f-bc86-4974-95a0-583d13165c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:24.443243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1fdce23f-bc86-4974-95a0-583d13165c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:24.450734 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1fdce23f-bc86-4974-95a0-583d13165c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1673 microversion: 2.1 time: 0.156641 Jan 22 22:18:24.452164 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4858/9422] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:24 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:25.539860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3bbf437e-cb96-4058-ad93-1b27ad986431 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:18:25.540840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3bbf437e-cb96-4058-ad93-1b27ad986431 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:25.549012 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3bbf437e-cb96-4058-ad93-1b27ad986431 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:25.549601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3bbf437e-cb96-4058-ad93-1b27ad986431 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:25.550393 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3bbf437e-cb96-4058-ad93-1b27ad986431 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:25.550839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3bbf437e-cb96-4058-ad93-1b27ad986431 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:25.606491 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3bbf437e-cb96-4058-ad93-1b27ad986431 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d/action" status: 200 len: 32632 microversion: 2.1 time: 0.070152 Jan 22 22:18:25.607157 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4565/9423] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:18:25 2022] POST /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d/action => generated 32632 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:18:25.618888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-535dfb60-762c-4287-8bf7-890c7f835fd2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:18:25.619450 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-535dfb60-762c-4287-8bf7-890c7f835fd2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:25.626981 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-535dfb60-762c-4287-8bf7-890c7f835fd2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:25.627459 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-535dfb60-762c-4287-8bf7-890c7f835fd2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:25.628270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-535dfb60-762c-4287-8bf7-890c7f835fd2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:25.628736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-535dfb60-762c-4287-8bf7-890c7f835fd2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:25.943947 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-535dfb60-762c-4287-8bf7-890c7f835fd2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d/action" status: 202 len: 0 microversion: 2.1 time: 0.328691 Jan 22 22:18:25.944606 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4859/9424] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:18:25 2022] POST /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:18:25.955917 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c914f3e1-f6cf-4fa8-a904-0db8bf74991f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:25.956920 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c914f3e1-f6cf-4fa8-a904-0db8bf74991f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:25.963890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c914f3e1-f6cf-4fa8-a904-0db8bf74991f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:25.964351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c914f3e1-f6cf-4fa8-a904-0db8bf74991f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:25.965148 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c914f3e1-f6cf-4fa8-a904-0db8bf74991f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:25.965616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c914f3e1-f6cf-4fa8-a904-0db8bf74991f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:26.116367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c914f3e1-f6cf-4fa8-a904-0db8bf74991f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:26.124304 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c914f3e1-f6cf-4fa8-a904-0db8bf74991f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1680 microversion: 2.1 time: 0.174811 Jan 22 22:18:26.124900 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4566/9425] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:25 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:27.143655 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-10230f3e-04ce-4745-944a-1714bbd6d47d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:27.144406 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-10230f3e-04ce-4745-944a-1714bbd6d47d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:27.151436 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10230f3e-04ce-4745-944a-1714bbd6d47d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:27.151912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10230f3e-04ce-4745-944a-1714bbd6d47d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:27.152726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10230f3e-04ce-4745-944a-1714bbd6d47d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:27.153191 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-10230f3e-04ce-4745-944a-1714bbd6d47d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:27.291257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-10230f3e-04ce-4745-944a-1714bbd6d47d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:27.299674 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-10230f3e-04ce-4745-944a-1714bbd6d47d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1688 microversion: 2.1 time: 0.160221 Jan 22 22:18:27.300246 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4860/9426] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:27 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:27.397824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-25f04131-0666-4758-9c20-7b9798b220b2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:18:27.398728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-25f04131-0666-4758-9c20-7b9798b220b2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:27.406709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25f04131-0666-4758-9c20-7b9798b220b2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:27.407172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25f04131-0666-4758-9c20-7b9798b220b2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:27.407975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25f04131-0666-4758-9c20-7b9798b220b2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:27.408428 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-25f04131-0666-4758-9c20-7b9798b220b2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:27.473696 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-25f04131-0666-4758-9c20-7b9798b220b2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d/action" status: 200 len: 37224 microversion: 2.1 time: 0.079535 Jan 22 22:18:27.474371 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4567/9427] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:18:27 2022] POST /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d/action => generated 37224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:18:28.868135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b5a1a4c-7e4a-44b1-9ced-faf8385d3db7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:28.868641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b5a1a4c-7e4a-44b1-9ced-faf8385d3db7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:28.875894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b5a1a4c-7e4a-44b1-9ced-faf8385d3db7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:28.876370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b5a1a4c-7e4a-44b1-9ced-faf8385d3db7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:28.877174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b5a1a4c-7e4a-44b1-9ced-faf8385d3db7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:28.877682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b5a1a4c-7e4a-44b1-9ced-faf8385d3db7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:28.903414 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b5a1a4c-7e4a-44b1-9ced-faf8385d3db7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:18:28.925156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-766f02b0-b09c-4feb-b9e5-62da5b941a3a req-e15e1230-4cc7-46a5-92e7-988c9d2d6c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8352a3-80a7-490d-8991-661fb971284d", "tag": "37b82fae-f227-496f-a47d-2ad7addf39e9"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:18:28.926861 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:18:28.926861 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:18:28.936113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-766f02b0-b09c-4feb-b9e5-62da5b941a3a req-e15e1230-4cc7-46a5-92e7-988c9d2d6c54 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:28.936942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-766f02b0-b09c-4feb-b9e5-62da5b941a3a req-e15e1230-4cc7-46a5-92e7-988c9d2d6c54 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:28.948088 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-766f02b0-b09c-4feb-b9e5-62da5b941a3a req-e15e1230-4cc7-46a5-92e7-988c9d2d6c54 service nova] Creating event network-changed:37b82fae-f227-496f-a47d-2ad7addf39e9 for instance 5f8352a3-80a7-490d-8991-661fb971284d on nch2-master-1 Jan 22 22:18:28.953758 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-766f02b0-b09c-4feb-b9e5-62da5b941a3a req-e15e1230-4cc7-46a5-92e7-988c9d2d6c54 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094260 Jan 22 22:18:28.954402 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4568/9428] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:18:29.180615 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b5a1a4c-7e4a-44b1-9ced-faf8385d3db7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "DELETE /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 204 len: 0 microversion: 2.1 time: 0.324772 Jan 22 22:18:29.184281 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4861/9429] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:18:28 2022] DELETE /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 22 22:18:29.190741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9694b7ea-9c50-481c-af4b-2e3c14b49326 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:29.193876 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9694b7ea-9c50-481c-af4b-2e3c14b49326 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:29.198603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9694b7ea-9c50-481c-af4b-2e3c14b49326 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:29.199385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9694b7ea-9c50-481c-af4b-2e3c14b49326 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:29.200187 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9694b7ea-9c50-481c-af4b-2e3c14b49326 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:29.200909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9694b7ea-9c50-481c-af4b-2e3c14b49326 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:29.349156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9694b7ea-9c50-481c-af4b-2e3c14b49326 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:29.362032 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9694b7ea-9c50-481c-af4b-2e3c14b49326 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1694 microversion: 2.1 time: 0.175711 Jan 22 22:18:29.362857 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4569/9430] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:29 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:18:30.381903 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f99447c7-7f42-48b4-a76d-1abefcd2134f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:30.382624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f99447c7-7f42-48b4-a76d-1abefcd2134f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:30.389922 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f99447c7-7f42-48b4-a76d-1abefcd2134f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:30.390403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f99447c7-7f42-48b4-a76d-1abefcd2134f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:30.392974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f99447c7-7f42-48b4-a76d-1abefcd2134f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:30.392974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f99447c7-7f42-48b4-a76d-1abefcd2134f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:30.529708 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f99447c7-7f42-48b4-a76d-1abefcd2134f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:30.537123 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f99447c7-7f42-48b4-a76d-1abefcd2134f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1575 microversion: 2.1 time: 0.159387 Jan 22 22:18:30.537715 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4862/9431] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:30 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:31.513347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-c28bced9-5d49-4d39-ab33-7bf35d74860b req-6d1c7bed-6e15-42aa-a6e0-9808da058c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8352a3-80a7-490d-8991-661fb971284d", "name": "network-vif-deleted", "tag": "37b82fae-f227-496f-a47d-2ad7addf39e9"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:18:31.515060 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:18:31.515060 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:18:31.522886 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c28bced9-5d49-4d39-ab33-7bf35d74860b req-6d1c7bed-6e15-42aa-a6e0-9808da058c0d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:31.523337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c28bced9-5d49-4d39-ab33-7bf35d74860b req-6d1c7bed-6e15-42aa-a6e0-9808da058c0d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:31.534634 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-c28bced9-5d49-4d39-ab33-7bf35d74860b req-6d1c7bed-6e15-42aa-a6e0-9808da058c0d service nova] Creating event network-vif-deleted:37b82fae-f227-496f-a47d-2ad7addf39e9 for instance 5f8352a3-80a7-490d-8991-661fb971284d on nch2-master-1 Jan 22 22:18:31.539584 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-c28bced9-5d49-4d39-ab33-7bf35d74860b req-6d1c7bed-6e15-42aa-a6e0-9808da058c0d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029980 Jan 22 22:18:31.540185 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4570/9432] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:18:31.554753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d20f700b-bdf6-4f1e-bda9-51eed41d5397 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:31.555430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d20f700b-bdf6-4f1e-bda9-51eed41d5397 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:31.562955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d20f700b-bdf6-4f1e-bda9-51eed41d5397 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:31.563575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d20f700b-bdf6-4f1e-bda9-51eed41d5397 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:31.564389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d20f700b-bdf6-4f1e-bda9-51eed41d5397 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:31.564854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d20f700b-bdf6-4f1e-bda9-51eed41d5397 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:31.629130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d20f700b-bdf6-4f1e-bda9-51eed41d5397 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:31.637231 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d20f700b-bdf6-4f1e-bda9-51eed41d5397 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 200 len: 1507 microversion: 2.1 time: 0.086156 Jan 22 22:18:31.637932 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4863/9433] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:31 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 1507 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:32.655128 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-efcc75d2-b04d-4cd4-b4db-c92543175d53 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:32.656087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-efcc75d2-b04d-4cd4-b4db-c92543175d53 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 5f8352a3-80a7-490d-8991-661fb971284d] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:32.662323 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efcc75d2-b04d-4cd4-b4db-c92543175d53 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:32.662786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efcc75d2-b04d-4cd4-b4db-c92543175d53 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:32.663615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efcc75d2-b04d-4cd4-b4db-c92543175d53 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:32.664072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-efcc75d2-b04d-4cd4-b4db-c92543175d53 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:32.677343 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-efcc75d2-b04d-4cd4-b4db-c92543175d53 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] HTTP exception thrown: Instance 5f8352a3-80a7-490d-8991-661fb971284d could not be found. Jan 22 22:18:32.677968 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-efcc75d2-b04d-4cd4-b4db-c92543175d53 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Returning 404 to user: Instance 5f8352a3-80a7-490d-8991-661fb971284d could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:18:32.678809 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-efcc75d2-b04d-4cd4-b4db-c92543175d53 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d" status: 404 len: 111 microversion: 2.1 time: 0.028798 Jan 22 22:18:32.679343 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4571/9434] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:32 2022] GET /compute/v2.1/servers/5f8352a3-80a7-490d-8991-661fb971284d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:18:36.198256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-49f4b28c-7277-4ad7-a177-1551ea3776a8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '.version_select at 0x7f1ed57ebdc0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:36.267148 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-49f4b28c-7277-4ad7-a177-1551ea3776a8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-601649118" status: 202 len: 0 microversion: 2.1 time: 0.073652 Jan 22 22:18:36.267658 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4864/9435] 10.222.0.100 () {58 vars in 1285 bytes} [Sat Jan 22 22:18:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-601649118 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:18:36.296526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-55e754ab-59a7-46c1-b114-373129790891 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'create', calling method: .version_select at 0x7f1ed5ae1280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1682899758"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:18:36.312071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-55e754ab-59a7-46c1-b114-373129790891 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:18:36.319308 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-55e754ab-59a7-46c1-b114-373129790891 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for user a9e6a7e25c0f4a9fbd1cc64635c2ed66 and project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:18:36.522183 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-55e754ab-59a7-46c1-b114-373129790891 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:18:36.527116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-55e754ab-59a7-46c1-b114-373129790891 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for user a9e6a7e25c0f4a9fbd1cc64635c2ed66 and project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:18:36.542207 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-55e754ab-59a7-46c1-b114-373129790891 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.251051 Jan 22 22:18:36.542836 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4572/9436] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 22:18:36 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:44.683512 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1148673382", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "5d3ba2e9-81dd-4d36-b5cb-d769e0261bc8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1682899758", "security_groups": [{"name": "tempest-secgroup-smoke-1434544242"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:18:44.991214 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] validate_networks() for [('5d3ba2e9-81dd-4d36-b5cb-d769e0261bc8', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:18:45.414649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:18:45.415095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:18:45.415591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:18:45.416056 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:18:45.416500 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:18:45.426058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:45.426523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:45.427369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:45.427801 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:45.445012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:18:45.450127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for user a9e6a7e25c0f4a9fbd1cc64635c2ed66 and project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:18:45.463043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:18:45.465471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:18:45.594301 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f2642b1b-1e7c-4d10-af7d-ded16df68cc3 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.915384 Jan 22 22:18:45.595688 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4865/9437] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:18:44 2022] POST /compute/v2.1/servers => generated 408 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 22:18:45.608010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-037f8cc4-7cc8-4556-99d7-ce73831bd0ad tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:45.608010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-037f8cc4-7cc8-4556-99d7-ce73831bd0ad tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:45.666914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-037f8cc4-7cc8-4556-99d7-ce73831bd0ad tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:45.676414 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-037f8cc4-7cc8-4556-99d7-ce73831bd0ad tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1271 microversion: 2.1 time: 0.073892 Jan 22 22:18:45.677636 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4573/9438] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:45 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1271 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:18:46.696454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-917b851a-5bed-44b4-8b08-12abba71f176 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:46.698270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-917b851a-5bed-44b4-8b08-12abba71f176 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:46.707927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-917b851a-5bed-44b4-8b08-12abba71f176 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:46.710018 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-917b851a-5bed-44b4-8b08-12abba71f176 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:46.715211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-917b851a-5bed-44b4-8b08-12abba71f176 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:46.715211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-917b851a-5bed-44b4-8b08-12abba71f176 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:46.794255 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-917b851a-5bed-44b4-8b08-12abba71f176 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:46.809710 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-917b851a-5bed-44b4-8b08-12abba71f176 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1275 microversion: 2.1 time: 0.118691 Jan 22 22:18:46.810312 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4866/9439] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:46 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:47.826496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0ed4143c-1d37-468c-bd77-754f87c99d13 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:47.828432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-0ed4143c-1d37-468c-bd77-754f87c99d13 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:47.836248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ed4143c-1d37-468c-bd77-754f87c99d13 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:47.836712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ed4143c-1d37-468c-bd77-754f87c99d13 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:47.837721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ed4143c-1d37-468c-bd77-754f87c99d13 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:47.838171 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-0ed4143c-1d37-468c-bd77-754f87c99d13 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:47.913487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-0ed4143c-1d37-468c-bd77-754f87c99d13 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:47.922405 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0ed4143c-1d37-468c-bd77-754f87c99d13 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1331 microversion: 2.1 time: 0.099535 Jan 22 22:18:47.923206 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4574/9440] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:47 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:48.943840 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-96291bd2-8e43-4144-9c1d-72d92766022b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:48.946721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-96291bd2-8e43-4144-9c1d-72d92766022b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:48.957299 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96291bd2-8e43-4144-9c1d-72d92766022b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:48.957802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96291bd2-8e43-4144-9c1d-72d92766022b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:48.958638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96291bd2-8e43-4144-9c1d-72d92766022b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:48.959108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-96291bd2-8e43-4144-9c1d-72d92766022b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:49.111012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-96291bd2-8e43-4144-9c1d-72d92766022b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:49.121774 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-96291bd2-8e43-4144-9c1d-72d92766022b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1397 microversion: 2.1 time: 0.183570 Jan 22 22:18:49.122373 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4867/9441] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:48 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1397 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:49.613157 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-7b66cf93-831d-4a5b-89ba-6face1656d06 req-de6cb55a-b3c5-4aa3-ba85-e85c4c35a37a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ff42d9d-86af-4d43-829e-ea9154f812c8", "tag": "528afb94-61e8-4a80-8429-11ef58c5ad01"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:18:49.615391 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:18:49.615391 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:18:49.626967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7b66cf93-831d-4a5b-89ba-6face1656d06 req-de6cb55a-b3c5-4aa3-ba85-e85c4c35a37a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:49.627389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7b66cf93-831d-4a5b-89ba-6face1656d06 req-de6cb55a-b3c5-4aa3-ba85-e85c4c35a37a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:49.639815 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-7b66cf93-831d-4a5b-89ba-6face1656d06 req-de6cb55a-b3c5-4aa3-ba85-e85c4c35a37a service nova] Creating event network-changed:528afb94-61e8-4a80-8429-11ef58c5ad01 for instance 1ff42d9d-86af-4d43-829e-ea9154f812c8 on nch1-master-1 Jan 22 22:18:49.645331 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-7b66cf93-831d-4a5b-89ba-6face1656d06 req-de6cb55a-b3c5-4aa3-ba85-e85c4c35a37a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037732 Jan 22 22:18:49.646755 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4575/9442] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:18:50.139223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-00fabf5d-b91d-43c4-8d52-20ca0fd74c97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:50.140361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-00fabf5d-b91d-43c4-8d52-20ca0fd74c97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:50.147318 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00fabf5d-b91d-43c4-8d52-20ca0fd74c97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:50.147793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00fabf5d-b91d-43c4-8d52-20ca0fd74c97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:50.148606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00fabf5d-b91d-43c4-8d52-20ca0fd74c97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:50.149068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-00fabf5d-b91d-43c4-8d52-20ca0fd74c97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:50.288173 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-00fabf5d-b91d-43c4-8d52-20ca0fd74c97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:50.295578 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-00fabf5d-b91d-43c4-8d52-20ca0fd74c97 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1397 microversion: 2.1 time: 0.160089 Jan 22 22:18:50.296197 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4868/9443] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:50 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1397 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:51.313339 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dadf162b-1c39-474f-9a26-7dd57ee822ce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:51.314096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dadf162b-1c39-474f-9a26-7dd57ee822ce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:51.320380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dadf162b-1c39-474f-9a26-7dd57ee822ce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:51.320841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dadf162b-1c39-474f-9a26-7dd57ee822ce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:51.321662 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dadf162b-1c39-474f-9a26-7dd57ee822ce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:51.322115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dadf162b-1c39-474f-9a26-7dd57ee822ce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:51.455944 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dadf162b-1c39-474f-9a26-7dd57ee822ce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:51.463536 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dadf162b-1c39-474f-9a26-7dd57ee822ce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1397 microversion: 2.1 time: 0.155470 Jan 22 22:18:51.464151 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4576/9444] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:51 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1397 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:52.480437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6d370cbd-5da4-43d2-837d-c0b9de0172a8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:52.481094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6d370cbd-5da4-43d2-837d-c0b9de0172a8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:52.488510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d370cbd-5da4-43d2-837d-c0b9de0172a8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:52.488923 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d370cbd-5da4-43d2-837d-c0b9de0172a8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:52.489805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d370cbd-5da4-43d2-837d-c0b9de0172a8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:52.490254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6d370cbd-5da4-43d2-837d-c0b9de0172a8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:52.623158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6d370cbd-5da4-43d2-837d-c0b9de0172a8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:52.631423 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6d370cbd-5da4-43d2-837d-c0b9de0172a8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1397 microversion: 2.1 time: 0.154801 Jan 22 22:18:52.633813 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4869/9445] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:52 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1397 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:53.648229 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eaed6171-d8a7-4bd4-ab9e-eed095861e19 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:53.648955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eaed6171-d8a7-4bd4-ab9e-eed095861e19 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:53.656415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaed6171-d8a7-4bd4-ab9e-eed095861e19 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:53.657059 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaed6171-d8a7-4bd4-ab9e-eed095861e19 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:53.657899 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaed6171-d8a7-4bd4-ab9e-eed095861e19 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:53.658346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaed6171-d8a7-4bd4-ab9e-eed095861e19 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:53.797581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eaed6171-d8a7-4bd4-ab9e-eed095861e19 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:53.804959 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eaed6171-d8a7-4bd4-ab9e-eed095861e19 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1397 microversion: 2.1 time: 0.160506 Jan 22 22:18:53.805604 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4577/9446] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:53 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1397 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:54.822130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8435e856-429d-4c6c-ad47-b4d516199131 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:54.822765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8435e856-429d-4c6c-ad47-b4d516199131 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:54.829590 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8435e856-429d-4c6c-ad47-b4d516199131 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:54.830069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8435e856-429d-4c6c-ad47-b4d516199131 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:54.830882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8435e856-429d-4c6c-ad47-b4d516199131 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:54.831347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8435e856-429d-4c6c-ad47-b4d516199131 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:54.968806 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8435e856-429d-4c6c-ad47-b4d516199131 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:54.977198 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8435e856-429d-4c6c-ad47-b4d516199131 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1397 microversion: 2.1 time: 0.158759 Jan 22 22:18:54.977823 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4870/9447] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:54 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1397 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:55.143825 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-0eb15a18-51c6-4209-aa4b-2c2af0893198 req-fcb9e8cf-f742-4d80-99e6-131475284d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff42d9d-86af-4d43-829e-ea9154f812c8", "name": "network-vif-plugged", "status": "completed", "tag": "528afb94-61e8-4a80-8429-11ef58c5ad01"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:18:55.145359 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:18:55.145359 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:18:55.153466 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-0eb15a18-51c6-4209-aa4b-2c2af0893198 req-fcb9e8cf-f742-4d80-99e6-131475284d91 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:55.153955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-0eb15a18-51c6-4209-aa4b-2c2af0893198 req-fcb9e8cf-f742-4d80-99e6-131475284d91 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:55.165442 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-0eb15a18-51c6-4209-aa4b-2c2af0893198 req-fcb9e8cf-f742-4d80-99e6-131475284d91 service nova] Creating event network-vif-plugged:528afb94-61e8-4a80-8429-11ef58c5ad01 for instance 1ff42d9d-86af-4d43-829e-ea9154f812c8 on nch1-master-1 Jan 22 22:18:55.170487 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-0eb15a18-51c6-4209-aa4b-2c2af0893198 req-fcb9e8cf-f742-4d80-99e6-131475284d91 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030474 Jan 22 22:18:55.171073 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4578/9448] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:18:55.994313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6da0cced-47d5-4102-8101-2ae15ec4628a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:55.994943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6da0cced-47d5-4102-8101-2ae15ec4628a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:56.001895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6da0cced-47d5-4102-8101-2ae15ec4628a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:56.002368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6da0cced-47d5-4102-8101-2ae15ec4628a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:56.003172 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6da0cced-47d5-4102-8101-2ae15ec4628a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:56.003631 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6da0cced-47d5-4102-8101-2ae15ec4628a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:56.139174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-6da0cced-47d5-4102-8101-2ae15ec4628a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:56.146697 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6da0cced-47d5-4102-8101-2ae15ec4628a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1397 microversion: 2.1 time: 0.156189 Jan 22 22:18:56.147284 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4871/9449] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:55 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1397 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:57.165549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a435b02e-cb46-419c-b451-bc02d44a9e3c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:57.166172 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a435b02e-cb46-419c-b451-bc02d44a9e3c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:57.172433 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a435b02e-cb46-419c-b451-bc02d44a9e3c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:57.172966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a435b02e-cb46-419c-b451-bc02d44a9e3c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:57.173842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a435b02e-cb46-419c-b451-bc02d44a9e3c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:57.174295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a435b02e-cb46-419c-b451-bc02d44a9e3c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:57.309889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a435b02e-cb46-419c-b451-bc02d44a9e3c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:57.317972 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a435b02e-cb46-419c-b451-bc02d44a9e3c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1570 microversion: 2.1 time: 0.157430 Jan 22 22:18:57.318547 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4579/9450] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:57 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:57.334370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9c6e3453-fa60-401c-a7b9-f6ad002ed40e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:57.335032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9c6e3453-fa60-401c-a7b9-f6ad002ed40e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:57.341865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c6e3453-fa60-401c-a7b9-f6ad002ed40e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:57.342344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c6e3453-fa60-401c-a7b9-f6ad002ed40e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:57.343155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c6e3453-fa60-401c-a7b9-f6ad002ed40e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:57.343621 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c6e3453-fa60-401c-a7b9-f6ad002ed40e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:57.479413 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9c6e3453-fa60-401c-a7b9-f6ad002ed40e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:57.487069 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9c6e3453-fa60-401c-a7b9-f6ad002ed40e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1570 microversion: 2.1 time: 0.156345 Jan 22 22:18:57.487652 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4872/9451] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:57 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:18:59.376618 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7e6a993a-f3f8-4c3c-bf62-b756c0c9d2ea tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:18:59.378664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7e6a993a-f3f8-4c3c-bf62-b756c0c9d2ea tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:18:59.390021 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e6a993a-f3f8-4c3c-bf62-b756c0c9d2ea tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:59.390752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e6a993a-f3f8-4c3c-bf62-b756c0c9d2ea tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:59.391291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e6a993a-f3f8-4c3c-bf62-b756c0c9d2ea tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:59.391749 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e6a993a-f3f8-4c3c-bf62-b756c0c9d2ea tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:59.392735 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-eac5fece-b26b-4dfd-92b3-84df668302c5 req-6202faa8-1b8d-4d84-b08a-e5bfa38f3467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ff42d9d-86af-4d43-829e-ea9154f812c8", "tag": "528afb94-61e8-4a80-8429-11ef58c5ad01"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:18:59.395211 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:18:59.395211 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:18:59.403657 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-eac5fece-b26b-4dfd-92b3-84df668302c5 req-6202faa8-1b8d-4d84-b08a-e5bfa38f3467 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:18:59.404122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-eac5fece-b26b-4dfd-92b3-84df668302c5 req-6202faa8-1b8d-4d84-b08a-e5bfa38f3467 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:18:59.416885 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-eac5fece-b26b-4dfd-92b3-84df668302c5 req-6202faa8-1b8d-4d84-b08a-e5bfa38f3467 service nova] Creating event network-changed:528afb94-61e8-4a80-8429-11ef58c5ad01 for instance 1ff42d9d-86af-4d43-829e-ea9154f812c8 on nch1-master-1 Jan 22 22:18:59.422019 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-eac5fece-b26b-4dfd-92b3-84df668302c5 req-6202faa8-1b8d-4d84-b08a-e5bfa38f3467 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046933 Jan 22 22:18:59.422784 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4873/9452] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:18:59.626615 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7e6a993a-f3f8-4c3c-bf62-b756c0c9d2ea tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:18:59.635147 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7e6a993a-f3f8-4c3c-bf62-b756c0c9d2ea tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1570 microversion: 2.1 time: 0.262210 Jan 22 22:18:59.635953 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4580/9453] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:18:59 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1570 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:19:23.312054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-119f8e5d-39e7-4702-894f-e48bb6bd76fb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:19:23.313093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-119f8e5d-39e7-4702-894f-e48bb6bd76fb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:19:23.320355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-119f8e5d-39e7-4702-894f-e48bb6bd76fb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:23.320827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-119f8e5d-39e7-4702-894f-e48bb6bd76fb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:23.321661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-119f8e5d-39e7-4702-894f-e48bb6bd76fb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:23.322123 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-119f8e5d-39e7-4702-894f-e48bb6bd76fb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:23.373517 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-119f8e5d-39e7-4702-894f-e48bb6bd76fb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8/action" status: 200 len: 24559 microversion: 2.1 time: 0.066298 Jan 22 22:19:23.374190 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4874/9454] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:19:23 2022] POST /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8/action => generated 24559 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 22 22:19:34.388259 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9766d30c-fe01-4292-a345-49f4cc4129bb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:19:34.389989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9766d30c-fe01-4292-a345-49f4cc4129bb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:19:34.396682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9766d30c-fe01-4292-a345-49f4cc4129bb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:34.397143 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9766d30c-fe01-4292-a345-49f4cc4129bb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:34.397979 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9766d30c-fe01-4292-a345-49f4cc4129bb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:34.398439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9766d30c-fe01-4292-a345-49f4cc4129bb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:34.594632 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9766d30c-fe01-4292-a345-49f4cc4129bb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8/action" status: 202 len: 0 microversion: 2.1 time: 0.210237 Jan 22 22:19:34.595286 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4581/9455] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:19:34 2022] POST /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:19:34.604170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-027a93a4-460e-41fc-b9b7-ed6db9985cdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:19:34.604887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-027a93a4-460e-41fc-b9b7-ed6db9985cdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:19:34.612741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-027a93a4-460e-41fc-b9b7-ed6db9985cdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:34.613230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-027a93a4-460e-41fc-b9b7-ed6db9985cdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:34.614114 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-027a93a4-460e-41fc-b9b7-ed6db9985cdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:34.615175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-027a93a4-460e-41fc-b9b7-ed6db9985cdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:34.753983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-027a93a4-460e-41fc-b9b7-ed6db9985cdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:19:34.762411 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-027a93a4-460e-41fc-b9b7-ed6db9985cdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1681 microversion: 2.1 time: 0.162414 Jan 22 22:19:34.762981 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4875/9456] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:19:34 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:19:35.780851 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f12b07ba-d323-4549-a6b4-08b7d35b23c4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:19:35.781565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f12b07ba-d323-4549-a6b4-08b7d35b23c4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:19:35.789806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f12b07ba-d323-4549-a6b4-08b7d35b23c4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:35.790260 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f12b07ba-d323-4549-a6b4-08b7d35b23c4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:35.795089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f12b07ba-d323-4549-a6b4-08b7d35b23c4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:35.795089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f12b07ba-d323-4549-a6b4-08b7d35b23c4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:35.932708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f12b07ba-d323-4549-a6b4-08b7d35b23c4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:19:35.940256 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f12b07ba-d323-4549-a6b4-08b7d35b23c4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1686 microversion: 2.1 time: 0.163568 Jan 22 22:19:35.940823 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4582/9457] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:19:35 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:19:36.962670 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0d18305b-8385-4fa6-ae76-a34aa0a17fb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:19:36.963298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0d18305b-8385-4fa6-ae76-a34aa0a17fb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:19:36.971031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d18305b-8385-4fa6-ae76-a34aa0a17fb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:36.971508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d18305b-8385-4fa6-ae76-a34aa0a17fb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:36.972313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d18305b-8385-4fa6-ae76-a34aa0a17fb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:36.972778 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0d18305b-8385-4fa6-ae76-a34aa0a17fb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:37.109768 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0d18305b-8385-4fa6-ae76-a34aa0a17fb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:19:37.118043 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0d18305b-8385-4fa6-ae76-a34aa0a17fb1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1686 microversion: 2.1 time: 0.159907 Jan 22 22:19:37.118619 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4876/9458] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:19:36 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:19:38.135413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-252d3d57-6c98-4505-b340-e6f6b543e95c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:19:38.136028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-252d3d57-6c98-4505-b340-e6f6b543e95c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:19:38.142807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-252d3d57-6c98-4505-b340-e6f6b543e95c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:38.143268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-252d3d57-6c98-4505-b340-e6f6b543e95c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:38.144083 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-252d3d57-6c98-4505-b340-e6f6b543e95c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:38.144516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-252d3d57-6c98-4505-b340-e6f6b543e95c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:38.290541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-252d3d57-6c98-4505-b340-e6f6b543e95c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:19:38.298007 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-252d3d57-6c98-4505-b340-e6f6b543e95c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1686 microversion: 2.1 time: 0.166395 Jan 22 22:19:38.299862 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4583/9459] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:19:38 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:19:39.315756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7cc74ea2-4d34-4e21-bb4b-3ac34e54e0cd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:19:39.316403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7cc74ea2-4d34-4e21-bb4b-3ac34e54e0cd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:19:39.323933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cc74ea2-4d34-4e21-bb4b-3ac34e54e0cd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:39.324400 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cc74ea2-4d34-4e21-bb4b-3ac34e54e0cd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:39.325197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cc74ea2-4d34-4e21-bb4b-3ac34e54e0cd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:39.325688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7cc74ea2-4d34-4e21-bb4b-3ac34e54e0cd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:39.459827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7cc74ea2-4d34-4e21-bb4b-3ac34e54e0cd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:19:39.467284 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7cc74ea2-4d34-4e21-bb4b-3ac34e54e0cd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1686 microversion: 2.1 time: 0.155231 Jan 22 22:19:39.467861 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4877/9460] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:19:39 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:19:40.485283 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-863a35e8-2df9-4547-9e56-3b54c927b3af tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:19:40.485939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-863a35e8-2df9-4547-9e56-3b54c927b3af tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:19:40.493010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-863a35e8-2df9-4547-9e56-3b54c927b3af tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:40.493527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-863a35e8-2df9-4547-9e56-3b54c927b3af tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:40.494320 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-863a35e8-2df9-4547-9e56-3b54c927b3af tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:40.494770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-863a35e8-2df9-4547-9e56-3b54c927b3af tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:40.632593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-863a35e8-2df9-4547-9e56-3b54c927b3af tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:19:40.640307 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-863a35e8-2df9-4547-9e56-3b54c927b3af tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1686 microversion: 2.1 time: 0.158757 Jan 22 22:19:40.640826 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4584/9461] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:19:40 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:19:41.657891 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e25da8b1-6af8-4315-8507-1bdbed8e8156 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:19:41.658424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e25da8b1-6af8-4315-8507-1bdbed8e8156 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:19:41.664996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e25da8b1-6af8-4315-8507-1bdbed8e8156 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:41.665447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e25da8b1-6af8-4315-8507-1bdbed8e8156 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:41.666277 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e25da8b1-6af8-4315-8507-1bdbed8e8156 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:41.666732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e25da8b1-6af8-4315-8507-1bdbed8e8156 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:41.799665 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e25da8b1-6af8-4315-8507-1bdbed8e8156 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:19:41.807155 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e25da8b1-6af8-4315-8507-1bdbed8e8156 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1686 microversion: 2.1 time: 0.153022 Jan 22 22:19:41.807741 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4878/9462] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:19:41 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:19:42.824170 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5e61b08e-fe1f-46c8-997a-a9b29aa7f9b0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:19:42.824789 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5e61b08e-fe1f-46c8-997a-a9b29aa7f9b0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:19:42.831068 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e61b08e-fe1f-46c8-997a-a9b29aa7f9b0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:42.831532 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e61b08e-fe1f-46c8-997a-a9b29aa7f9b0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:42.832324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e61b08e-fe1f-46c8-997a-a9b29aa7f9b0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:42.832774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5e61b08e-fe1f-46c8-997a-a9b29aa7f9b0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:42.965360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5e61b08e-fe1f-46c8-997a-a9b29aa7f9b0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:19:42.973067 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5e61b08e-fe1f-46c8-997a-a9b29aa7f9b0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1686 microversion: 2.1 time: 0.153304 Jan 22 22:19:42.973663 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4585/9463] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:19:42 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:19:43.990252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-99fb0dd7-efec-405b-9351-6f3a53c40708 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:19:43.990784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-99fb0dd7-efec-405b-9351-6f3a53c40708 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:19:43.998544 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99fb0dd7-efec-405b-9351-6f3a53c40708 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:43.999023 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99fb0dd7-efec-405b-9351-6f3a53c40708 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:43.999827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99fb0dd7-efec-405b-9351-6f3a53c40708 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:44.000289 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-99fb0dd7-efec-405b-9351-6f3a53c40708 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:44.135737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-99fb0dd7-efec-405b-9351-6f3a53c40708 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:19:44.143316 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-99fb0dd7-efec-405b-9351-6f3a53c40708 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1686 microversion: 2.1 time: 0.156804 Jan 22 22:19:44.143912 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4879/9464] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:19:43 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:19:45.160481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-39f26845-4d67-4585-93c8-cbea02e5180d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:19:45.161100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-39f26845-4d67-4585-93c8-cbea02e5180d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:19:45.167919 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f26845-4d67-4585-93c8-cbea02e5180d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:45.168387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f26845-4d67-4585-93c8-cbea02e5180d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:45.169182 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f26845-4d67-4585-93c8-cbea02e5180d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:45.169658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-39f26845-4d67-4585-93c8-cbea02e5180d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:45.301748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-39f26845-4d67-4585-93c8-cbea02e5180d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:19:45.309825 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-39f26845-4d67-4585-93c8-cbea02e5180d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1686 microversion: 2.1 time: 0.153059 Jan 22 22:19:45.310400 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4586/9465] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:19:45 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:19:46.327281 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-d241bb22-13dc-4dd4-818b-5c361f3b65bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:19:46.327887 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-d241bb22-13dc-4dd4-818b-5c361f3b65bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:19:46.334661 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d241bb22-13dc-4dd4-818b-5c361f3b65bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:46.335130 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d241bb22-13dc-4dd4-818b-5c361f3b65bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:46.336586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d241bb22-13dc-4dd4-818b-5c361f3b65bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:19:46.337034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-d241bb22-13dc-4dd4-818b-5c361f3b65bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:19:46.472862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-d241bb22-13dc-4dd4-818b-5c361f3b65bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:19:46.480904 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-d241bb22-13dc-4dd4-818b-5c361f3b65bf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1689 microversion: 2.1 time: 0.157441 Jan 22 22:19:46.481492 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4880/9466] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:19:46 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:19:53.974365 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:19:53.974904 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:19:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:20:12.685682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-22ef6b41-8443-48b3-8b1d-705f9465d6fc tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:20:12.686538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-22ef6b41-8443-48b3-8b1d-705f9465d6fc tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:12.692989 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22ef6b41-8443-48b3-8b1d-705f9465d6fc tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:12.693666 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22ef6b41-8443-48b3-8b1d-705f9465d6fc tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:12.694464 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22ef6b41-8443-48b3-8b1d-705f9465d6fc tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:12.694906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-22ef6b41-8443-48b3-8b1d-705f9465d6fc tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:12.754722 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-22ef6b41-8443-48b3-8b1d-705f9465d6fc tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8/action" status: 200 len: 69093 microversion: 2.1 time: 0.072914 Jan 22 22:20:12.755374 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4587/9467] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:20:12 2022] POST /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8/action => generated 69093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:20:20.037061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bd82cb0e-b2ba-4e3e-b9d7-9a84e9ec211e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:20.043643 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-18d1c0a1-4151-4cae-846f-34ba08b5dfc7 req-a88aa1a9-4257-4465-966c-5fa309a026fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ff42d9d-86af-4d43-829e-ea9154f812c8", "tag": "528afb94-61e8-4a80-8429-11ef58c5ad01"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:20:20.044315 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bd82cb0e-b2ba-4e3e-b9d7-9a84e9ec211e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:20.045255 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:20:20.045255 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:20:20.051241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd82cb0e-b2ba-4e3e-b9d7-9a84e9ec211e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:20.051811 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd82cb0e-b2ba-4e3e-b9d7-9a84e9ec211e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:20.052634 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd82cb0e-b2ba-4e3e-b9d7-9a84e9ec211e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:20.053094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bd82cb0e-b2ba-4e3e-b9d7-9a84e9ec211e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:20.054096 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-18d1c0a1-4151-4cae-846f-34ba08b5dfc7 req-a88aa1a9-4257-4465-966c-5fa309a026fe service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:20.054811 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-18d1c0a1-4151-4cae-846f-34ba08b5dfc7 req-a88aa1a9-4257-4465-966c-5fa309a026fe service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:20.066394 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-18d1c0a1-4151-4cae-846f-34ba08b5dfc7 req-a88aa1a9-4257-4465-966c-5fa309a026fe service nova] Creating event network-changed:528afb94-61e8-4a80-8429-11ef58c5ad01 for instance 1ff42d9d-86af-4d43-829e-ea9154f812c8 on nch1-master-1 Jan 22 22:20:20.072186 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-18d1c0a1-4151-4cae-846f-34ba08b5dfc7 req-a88aa1a9-4257-4465-966c-5fa309a026fe service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033060 Jan 22 22:20:20.073036 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4588/9468] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:20:20.080900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bd82cb0e-b2ba-4e3e-b9d7-9a84e9ec211e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:20:20.358732 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bd82cb0e-b2ba-4e3e-b9d7-9a84e9ec211e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 204 len: 0 microversion: 2.1 time: 0.322081 Jan 22 22:20:20.358732 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4881/9469] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:20:20 2022] DELETE /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:20:20.371932 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-03ca7427-b912-493a-91e9-cec6b481340f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:20.373442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-03ca7427-b912-493a-91e9-cec6b481340f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:20.385854 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03ca7427-b912-493a-91e9-cec6b481340f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:20.386988 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03ca7427-b912-493a-91e9-cec6b481340f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:20.388752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03ca7427-b912-493a-91e9-cec6b481340f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:20.391108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-03ca7427-b912-493a-91e9-cec6b481340f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:20.642572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-03ca7427-b912-493a-91e9-cec6b481340f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:20.650465 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-03ca7427-b912-493a-91e9-cec6b481340f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1695 microversion: 2.1 time: 0.287800 Jan 22 22:20:20.651053 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4589/9470] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:20 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1695 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:21.668641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-08668215-0922-417a-b51a-e5a4aa0ffbdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:21.669304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-08668215-0922-417a-b51a-e5a4aa0ffbdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:21.676088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08668215-0922-417a-b51a-e5a4aa0ffbdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:21.676566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08668215-0922-417a-b51a-e5a4aa0ffbdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:21.677373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08668215-0922-417a-b51a-e5a4aa0ffbdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:21.677866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-08668215-0922-417a-b51a-e5a4aa0ffbdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:21.821370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-08668215-0922-417a-b51a-e5a4aa0ffbdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:21.828827 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-08668215-0922-417a-b51a-e5a4aa0ffbdf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1576 microversion: 2.1 time: 0.164389 Jan 22 22:20:21.829404 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4882/9471] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:21 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:22.802829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-b36ff8b2-5b8c-42d3-823a-edb31b0e834c req-6136060a-8e09-421e-a2e6-8c7a1b0f48c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff42d9d-86af-4d43-829e-ea9154f812c8", "name": "network-vif-deleted", "tag": "528afb94-61e8-4a80-8429-11ef58c5ad01"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:20:22.804390 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:20:22.804390 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:20:22.813159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-b36ff8b2-5b8c-42d3-823a-edb31b0e834c req-6136060a-8e09-421e-a2e6-8c7a1b0f48c8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:22.819633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-b36ff8b2-5b8c-42d3-823a-edb31b0e834c req-6136060a-8e09-421e-a2e6-8c7a1b0f48c8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:22.826073 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-b36ff8b2-5b8c-42d3-823a-edb31b0e834c req-6136060a-8e09-421e-a2e6-8c7a1b0f48c8 service nova] Creating event network-vif-deleted:528afb94-61e8-4a80-8429-11ef58c5ad01 for instance 1ff42d9d-86af-4d43-829e-ea9154f812c8 on nch1-master-1 Jan 22 22:20:22.830962 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-b36ff8b2-5b8c-42d3-823a-edb31b0e834c req-6136060a-8e09-421e-a2e6-8c7a1b0f48c8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031821 Jan 22 22:20:22.831645 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4590/9472] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:20:22.846710 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-794df93c-862d-43d7-b135-a9c12e316e72 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:22.847517 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-794df93c-862d-43d7-b135-a9c12e316e72 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:22.854926 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-794df93c-862d-43d7-b135-a9c12e316e72 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:22.855405 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-794df93c-862d-43d7-b135-a9c12e316e72 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:22.856219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-794df93c-862d-43d7-b135-a9c12e316e72 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:22.856682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-794df93c-862d-43d7-b135-a9c12e316e72 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:22.917385 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-794df93c-862d-43d7-b135-a9c12e316e72 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:22.924916 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-794df93c-862d-43d7-b135-a9c12e316e72 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 200 len: 1508 microversion: 2.1 time: 0.081915 Jan 22 22:20:22.925495 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4883/9473] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:22 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 1508 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:23.944538 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2e286937-8434-4a44-89d0-93af295cd33d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:23.945901 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2e286937-8434-4a44-89d0-93af295cd33d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: 1ff42d9d-86af-4d43-829e-ea9154f812c8] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:23.952351 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e286937-8434-4a44-89d0-93af295cd33d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:23.952816 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e286937-8434-4a44-89d0-93af295cd33d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:23.953651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e286937-8434-4a44-89d0-93af295cd33d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:23.954104 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e286937-8434-4a44-89d0-93af295cd33d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:23.967713 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-2e286937-8434-4a44-89d0-93af295cd33d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] HTTP exception thrown: Instance 1ff42d9d-86af-4d43-829e-ea9154f812c8 could not be found. Jan 22 22:20:23.968302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2e286937-8434-4a44-89d0-93af295cd33d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Returning 404 to user: Instance 1ff42d9d-86af-4d43-829e-ea9154f812c8 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:20:23.969129 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2e286937-8434-4a44-89d0-93af295cd33d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8" status: 404 len: 111 microversion: 2.1 time: 0.029675 Jan 22 22:20:23.969703 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4591/9474] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:23 2022] GET /compute/v2.1/servers/1ff42d9d-86af-4d43-829e-ea9154f812c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:20:27.709320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-585549f3-d0d8-4eca-a65c-c857e35e49ce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '.version_select at 0x7f1edae73d30>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:27.826101 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-585549f3-d0d8-4eca-a65c-c857e35e49ce tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1682899758" status: 202 len: 0 microversion: 2.1 time: 0.120977 Jan 22 22:20:27.827324 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4884/9475] 10.222.0.100 () {58 vars in 1288 bytes} [Sat Jan 22 22:20:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1682899758 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:20:27.855519 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-404faeb3-e6f8-4b16-9c14-0f419a15f125 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'create', calling method: .version_select at 0x7f1ed60d9310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2135759894"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:20:27.871786 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-404faeb3-e6f8-4b16-9c14-0f419a15f125 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:20:27.876780 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-404faeb3-e6f8-4b16-9c14-0f419a15f125 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for user a9e6a7e25c0f4a9fbd1cc64635c2ed66 and project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:20:28.135760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-404faeb3-e6f8-4b16-9c14-0f419a15f125 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:20:28.140594 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-404faeb3-e6f8-4b16-9c14-0f419a15f125 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for user a9e6a7e25c0f4a9fbd1cc64635c2ed66 and project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:20:28.154666 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-404faeb3-e6f8-4b16-9c14-0f419a15f125 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.303082 Jan 22 22:20:28.155264 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4592/9476] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 22:20:27 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:36.738165 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-860097226", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "9cd24dee-2cbc-41fb-9272-f6e18cfac3e6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2135759894", "security_groups": [{"name": "tempest-secgroup-smoke-1102428464"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:20:36.855433 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] validate_networks() for [('9cd24dee-2cbc-41fb-9272-f6e18cfac3e6', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:20:37.269111 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:20:37.269580 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:20:37.270541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:20:37.271147 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:20:37.271603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:20:37.280820 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:37.281440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:37.282320 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:37.282780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:37.300534 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:20:37.307028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for user a9e6a7e25c0f4a9fbd1cc64635c2ed66 and project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:20:37.319276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:20:37.321997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:20:37.424829 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-62212274-d6bf-44a0-b81e-3dc03a090f6c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.691465 Jan 22 22:20:37.426145 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4885/9477] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:20:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 22:20:37.436375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dd76c3da-3bf6-43d1-851a-7d3ce85a68e2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:37.438144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dd76c3da-3bf6-43d1-851a-7d3ce85a68e2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:37.497432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dd76c3da-3bf6-43d1-851a-7d3ce85a68e2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:37.506028 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dd76c3da-3bf6-43d1-851a-7d3ce85a68e2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1270 microversion: 2.1 time: 0.073417 Jan 22 22:20:37.506635 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4593/9478] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:37 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1270 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:38.524174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-482574c2-fe29-4ad3-acce-f5653306568c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:38.528998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-482574c2-fe29-4ad3-acce-f5653306568c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:38.532193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-482574c2-fe29-4ad3-acce-f5653306568c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:38.532673 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-482574c2-fe29-4ad3-acce-f5653306568c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:38.533524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-482574c2-fe29-4ad3-acce-f5653306568c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:38.534032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-482574c2-fe29-4ad3-acce-f5653306568c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:38.598950 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-482574c2-fe29-4ad3-acce-f5653306568c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:38.607913 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-482574c2-fe29-4ad3-acce-f5653306568c tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1274 microversion: 2.1 time: 0.088388 Jan 22 22:20:38.609421 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4886/9479] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:38 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:39.624216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8b3ebb14-9aab-49eb-aadd-0fc2cf37b830 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:39.624739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8b3ebb14-9aab-49eb-aadd-0fc2cf37b830 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:39.635075 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b3ebb14-9aab-49eb-aadd-0fc2cf37b830 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:39.635545 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b3ebb14-9aab-49eb-aadd-0fc2cf37b830 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:39.636359 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b3ebb14-9aab-49eb-aadd-0fc2cf37b830 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:39.636819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b3ebb14-9aab-49eb-aadd-0fc2cf37b830 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:39.697624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8b3ebb14-9aab-49eb-aadd-0fc2cf37b830 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:39.705522 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8b3ebb14-9aab-49eb-aadd-0fc2cf37b830 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1340 microversion: 2.1 time: 0.085082 Jan 22 22:20:39.706123 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4594/9480] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:39 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1340 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:40.724002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9c866b4b-5c97-4792-83bd-cda64af9b7d2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:40.724626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9c866b4b-5c97-4792-83bd-cda64af9b7d2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:40.732096 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c866b4b-5c97-4792-83bd-cda64af9b7d2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:40.732566 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c866b4b-5c97-4792-83bd-cda64af9b7d2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:40.733381 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c866b4b-5c97-4792-83bd-cda64af9b7d2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:40.733871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9c866b4b-5c97-4792-83bd-cda64af9b7d2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:40.985227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9c866b4b-5c97-4792-83bd-cda64af9b7d2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:40.995701 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9c866b4b-5c97-4792-83bd-cda64af9b7d2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1396 microversion: 2.1 time: 0.276054 Jan 22 22:20:40.996443 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4887/9481] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:40 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1396 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:41.205333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-2fad03d5-ca6b-42ee-b0c8-97de4f970af0 req-a9878740-5986-41c7-863e-ddb9d4b01b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc", "tag": "d6094f73-6ea1-4d72-bf15-5bb791353490"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:20:41.206959 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:20:41.206959 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:20:41.215667 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2fad03d5-ca6b-42ee-b0c8-97de4f970af0 req-a9878740-5986-41c7-863e-ddb9d4b01b5a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:41.216129 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2fad03d5-ca6b-42ee-b0c8-97de4f970af0 req-a9878740-5986-41c7-863e-ddb9d4b01b5a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:41.230027 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-2fad03d5-ca6b-42ee-b0c8-97de4f970af0 req-a9878740-5986-41c7-863e-ddb9d4b01b5a service nova] Creating event network-changed:d6094f73-6ea1-4d72-bf15-5bb791353490 for instance a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc on nch2-master-1 Jan 22 22:20:41.235596 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-2fad03d5-ca6b-42ee-b0c8-97de4f970af0 req-a9878740-5986-41c7-863e-ddb9d4b01b5a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033830 Jan 22 22:20:41.236812 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4595/9482] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:20:42.012941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e3c10328-714c-46d7-b18e-0b5a5e04ea55 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:42.013593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e3c10328-714c-46d7-b18e-0b5a5e04ea55 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:42.020674 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3c10328-714c-46d7-b18e-0b5a5e04ea55 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:42.021152 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3c10328-714c-46d7-b18e-0b5a5e04ea55 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:42.022009 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3c10328-714c-46d7-b18e-0b5a5e04ea55 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:42.022472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e3c10328-714c-46d7-b18e-0b5a5e04ea55 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:42.155443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e3c10328-714c-46d7-b18e-0b5a5e04ea55 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:42.162841 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e3c10328-714c-46d7-b18e-0b5a5e04ea55 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1396 microversion: 2.1 time: 0.154507 Jan 22 22:20:42.163418 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4888/9483] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:42 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1396 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:43.180298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dd5cc6a9-66cf-4ea7-9167-9743149432fb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:43.181118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dd5cc6a9-66cf-4ea7-9167-9743149432fb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:43.188007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd5cc6a9-66cf-4ea7-9167-9743149432fb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:43.188471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd5cc6a9-66cf-4ea7-9167-9743149432fb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:43.189265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd5cc6a9-66cf-4ea7-9167-9743149432fb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:43.189755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dd5cc6a9-66cf-4ea7-9167-9743149432fb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:43.323522 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dd5cc6a9-66cf-4ea7-9167-9743149432fb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:43.330877 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dd5cc6a9-66cf-4ea7-9167-9743149432fb tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1396 microversion: 2.1 time: 0.154804 Jan 22 22:20:43.331437 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4596/9484] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:43 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1396 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:44.348101 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1f3e2ccf-60ff-4448-ad6e-4540d5cdd7d6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:44.348765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1f3e2ccf-60ff-4448-ad6e-4540d5cdd7d6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:44.356421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f3e2ccf-60ff-4448-ad6e-4540d5cdd7d6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:44.356902 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f3e2ccf-60ff-4448-ad6e-4540d5cdd7d6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:44.357745 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f3e2ccf-60ff-4448-ad6e-4540d5cdd7d6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:44.358213 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1f3e2ccf-60ff-4448-ad6e-4540d5cdd7d6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:44.493780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1f3e2ccf-60ff-4448-ad6e-4540d5cdd7d6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:44.501769 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1f3e2ccf-60ff-4448-ad6e-4540d5cdd7d6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1396 microversion: 2.1 time: 0.157385 Jan 22 22:20:44.502345 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4889/9485] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:44 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1396 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:45.519472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b72f8519-9165-4917-ab22-e7a6e1b57cff tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:45.520079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b72f8519-9165-4917-ab22-e7a6e1b57cff tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:45.527880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b72f8519-9165-4917-ab22-e7a6e1b57cff tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:45.528330 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b72f8519-9165-4917-ab22-e7a6e1b57cff tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:45.529133 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b72f8519-9165-4917-ab22-e7a6e1b57cff tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:45.529607 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b72f8519-9165-4917-ab22-e7a6e1b57cff tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:45.673443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b72f8519-9165-4917-ab22-e7a6e1b57cff tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:45.681115 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b72f8519-9165-4917-ab22-e7a6e1b57cff tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1396 microversion: 2.1 time: 0.165423 Jan 22 22:20:45.682104 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4597/9486] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:45 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1396 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:46.698423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4bc78730-d167-4c3f-89de-74d5d7814a28 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:46.699261 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4bc78730-d167-4c3f-89de-74d5d7814a28 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:46.706240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bc78730-d167-4c3f-89de-74d5d7814a28 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:46.706737 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bc78730-d167-4c3f-89de-74d5d7814a28 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:46.707552 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bc78730-d167-4c3f-89de-74d5d7814a28 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:46.708014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4bc78730-d167-4c3f-89de-74d5d7814a28 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:46.842071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4bc78730-d167-4c3f-89de-74d5d7814a28 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:46.849637 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4bc78730-d167-4c3f-89de-74d5d7814a28 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1396 microversion: 2.1 time: 0.155044 Jan 22 22:20:46.850240 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4890/9487] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:46 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1396 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:47.137005 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-422d56d2-ac0b-4785-8893-0164a95d91b1 req-576abef9-dd7b-4e3c-af2c-6c135f60bfc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc", "name": "network-vif-plugged", "status": "completed", "tag": "d6094f73-6ea1-4d72-bf15-5bb791353490"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:20:47.138952 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:20:47.138952 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:20:47.147077 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-422d56d2-ac0b-4785-8893-0164a95d91b1 req-576abef9-dd7b-4e3c-af2c-6c135f60bfc5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:47.147526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-422d56d2-ac0b-4785-8893-0164a95d91b1 req-576abef9-dd7b-4e3c-af2c-6c135f60bfc5 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:47.158905 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-422d56d2-ac0b-4785-8893-0164a95d91b1 req-576abef9-dd7b-4e3c-af2c-6c135f60bfc5 service nova] Creating event network-vif-plugged:d6094f73-6ea1-4d72-bf15-5bb791353490 for instance a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc on nch2-master-1 Jan 22 22:20:47.164133 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-422d56d2-ac0b-4785-8893-0164a95d91b1 req-576abef9-dd7b-4e3c-af2c-6c135f60bfc5 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031001 Jan 22 22:20:47.164726 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4598/9488] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:20:47.867088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5b88dec4-b3ad-44ec-8756-ec65377b1672 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:47.867713 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5b88dec4-b3ad-44ec-8756-ec65377b1672 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:47.875531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b88dec4-b3ad-44ec-8756-ec65377b1672 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:47.876003 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b88dec4-b3ad-44ec-8756-ec65377b1672 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:47.876809 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b88dec4-b3ad-44ec-8756-ec65377b1672 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:47.877270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5b88dec4-b3ad-44ec-8756-ec65377b1672 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:48.023663 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5b88dec4-b3ad-44ec-8756-ec65377b1672 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:48.031747 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5b88dec4-b3ad-44ec-8756-ec65377b1672 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1396 microversion: 2.1 time: 0.168417 Jan 22 22:20:48.032322 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4891/9489] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:47 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1396 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:49.049648 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9e4b965c-e6e1-4a12-b6d2-a1945f795812 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:49.050337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9e4b965c-e6e1-4a12-b6d2-a1945f795812 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:49.057888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e4b965c-e6e1-4a12-b6d2-a1945f795812 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:49.058342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e4b965c-e6e1-4a12-b6d2-a1945f795812 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:49.059130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e4b965c-e6e1-4a12-b6d2-a1945f795812 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:49.059573 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9e4b965c-e6e1-4a12-b6d2-a1945f795812 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:49.190501 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9e4b965c-e6e1-4a12-b6d2-a1945f795812 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:49.198592 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9e4b965c-e6e1-4a12-b6d2-a1945f795812 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1566 microversion: 2.1 time: 0.152999 Jan 22 22:20:49.199327 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4599/9490] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:49 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:49.215353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-62778a2f-f3aa-4049-8fa7-d70374ef816b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:49.215924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-62778a2f-f3aa-4049-8fa7-d70374ef816b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:49.222944 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62778a2f-f3aa-4049-8fa7-d70374ef816b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:49.223422 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62778a2f-f3aa-4049-8fa7-d70374ef816b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:49.224226 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62778a2f-f3aa-4049-8fa7-d70374ef816b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:49.224691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-62778a2f-f3aa-4049-8fa7-d70374ef816b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:49.356470 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-62778a2f-f3aa-4049-8fa7-d70374ef816b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:49.364084 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-62778a2f-f3aa-4049-8fa7-d70374ef816b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1566 microversion: 2.1 time: 0.153154 Jan 22 22:20:49.364663 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4892/9491] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:49 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:20:51.395939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6aa40bcf-d8c8-486a-9cb3-685a8e28d735 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:20:51.396658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6aa40bcf-d8c8-486a-9cb3-685a8e28d735 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:20:51.398391 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-bb6b0ed0-0c8a-43a2-a15d-b34a49dc0bec req-fc26ea75-8671-4b8a-8424-d3b03e63ee12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc", "tag": "d6094f73-6ea1-4d72-bf15-5bb791353490"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:20:51.401172 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:20:51.401172 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:20:51.404342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aa40bcf-d8c8-486a-9cb3-685a8e28d735 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:51.404806 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aa40bcf-d8c8-486a-9cb3-685a8e28d735 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:51.405994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aa40bcf-d8c8-486a-9cb3-685a8e28d735 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:51.406598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6aa40bcf-d8c8-486a-9cb3-685a8e28d735 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:51.410402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bb6b0ed0-0c8a-43a2-a15d-b34a49dc0bec req-fc26ea75-8671-4b8a-8424-d3b03e63ee12 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:20:51.410875 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bb6b0ed0-0c8a-43a2-a15d-b34a49dc0bec req-fc26ea75-8671-4b8a-8424-d3b03e63ee12 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:20:51.422842 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-bb6b0ed0-0c8a-43a2-a15d-b34a49dc0bec req-fc26ea75-8671-4b8a-8424-d3b03e63ee12 service nova] Creating event network-changed:d6094f73-6ea1-4d72-bf15-5bb791353490 for instance a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc on nch2-master-1 Jan 22 22:20:51.427866 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-bb6b0ed0-0c8a-43a2-a15d-b34a49dc0bec req-fc26ea75-8671-4b8a-8424-d3b03e63ee12 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033487 Jan 22 22:20:51.428483 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4893/9492] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:20:51.559150 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6aa40bcf-d8c8-486a-9cb3-685a8e28d735 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:20:51.566700 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6aa40bcf-d8c8-486a-9cb3-685a8e28d735 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1566 microversion: 2.1 time: 0.174649 Jan 22 22:20:51.568200 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4600/9493] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:20:51 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:21:22.851467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-caf14cb6-a2f1-49f2-8ee3-4537094f0737 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:21:22.852480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-caf14cb6-a2f1-49f2-8ee3-4537094f0737 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:21:22.858802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-caf14cb6-a2f1-49f2-8ee3-4537094f0737 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:22.859273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-caf14cb6-a2f1-49f2-8ee3-4537094f0737 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:22.860082 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-caf14cb6-a2f1-49f2-8ee3-4537094f0737 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:22.860540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-caf14cb6-a2f1-49f2-8ee3-4537094f0737 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:22.911170 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-caf14cb6-a2f1-49f2-8ee3-4537094f0737 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc/action" status: 200 len: 24569 microversion: 2.1 time: 0.064579 Jan 22 22:21:22.911797 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4894/9494] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:21:22 2022] POST /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc/action => generated 24569 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:21:53.339019 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c89ed046-6c20-40e0-851f-835ebb15ab5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:21:53.340343 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c89ed046-6c20-40e0-851f-835ebb15ab5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:21:53.347124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c89ed046-6c20-40e0-851f-835ebb15ab5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:53.347587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c89ed046-6c20-40e0-851f-835ebb15ab5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:53.348382 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c89ed046-6c20-40e0-851f-835ebb15ab5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:53.348830 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c89ed046-6c20-40e0-851f-835ebb15ab5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:53.434708 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c89ed046-6c20-40e0-851f-835ebb15ab5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:21:53.441426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c89ed046-6c20-40e0-851f-835ebb15ab5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Old instance type m1.heat2, new instance type m1.heat {{(pid=137033) resize /opt/stack/nova/nova/compute/api.py:4097}} Jan 22 22:21:53.447687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c89ed046-6c20-40e0-851f-835ebb15ab5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:21:53.455976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c89ed046-6c20-40e0-851f-835ebb15ab5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:21:53.455976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c89ed046-6c20-40e0-851f-835ebb15ab5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:21:53.455976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c89ed046-6c20-40e0-851f-835ebb15ab5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:21:53.455976 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-c89ed046-6c20-40e0-851f-835ebb15ab5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:21:53.678822 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c89ed046-6c20-40e0-851f-835ebb15ab5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc/action" status: 202 len: 0 microversion: 2.1 time: 0.344424 Jan 22 22:21:53.679348 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4601/9495] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:21:53 2022] POST /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:21:53.757471 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-379e920f-1705-42b0-9d5d-1eab8ac68142 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:21:53.758245 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-379e920f-1705-42b0-9d5d-1eab8ac68142 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:21:53.765585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-379e920f-1705-42b0-9d5d-1eab8ac68142 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:53.766068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-379e920f-1705-42b0-9d5d-1eab8ac68142 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:53.766881 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-379e920f-1705-42b0-9d5d-1eab8ac68142 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:53.767339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-379e920f-1705-42b0-9d5d-1eab8ac68142 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:53.904667 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-379e920f-1705-42b0-9d5d-1eab8ac68142 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:21:53.913608 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-379e920f-1705-42b0-9d5d-1eab8ac68142 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1694 microversion: 2.1 time: 0.229601 Jan 22 22:21:53.914296 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4895/9496] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:21:53 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1694 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:21:54.934109 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-683d5b0d-d5ca-47b5-8609-22c07c931d8d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:21:54.934724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-683d5b0d-d5ca-47b5-8609-22c07c931d8d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:21:54.941819 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-683d5b0d-d5ca-47b5-8609-22c07c931d8d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:54.942284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-683d5b0d-d5ca-47b5-8609-22c07c931d8d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:54.943078 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-683d5b0d-d5ca-47b5-8609-22c07c931d8d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:54.943525 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-683d5b0d-d5ca-47b5-8609-22c07c931d8d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:55.133840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-683d5b0d-d5ca-47b5-8609-22c07c931d8d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:21:55.141461 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-683d5b0d-d5ca-47b5-8609-22c07c931d8d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1694 microversion: 2.1 time: 0.212457 Jan 22 22:21:55.142114 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4602/9497] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:21:54 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1694 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:21:56.159685 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-09ab30ff-8614-4f3d-bbf9-cad19b873c7e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:21:56.160310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-09ab30ff-8614-4f3d-bbf9-cad19b873c7e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:21:56.167354 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09ab30ff-8614-4f3d-bbf9-cad19b873c7e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:56.167816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09ab30ff-8614-4f3d-bbf9-cad19b873c7e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:56.168613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09ab30ff-8614-4f3d-bbf9-cad19b873c7e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:56.169066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09ab30ff-8614-4f3d-bbf9-cad19b873c7e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:56.372802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-09ab30ff-8614-4f3d-bbf9-cad19b873c7e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:21:56.381203 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-09ab30ff-8614-4f3d-bbf9-cad19b873c7e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1694 microversion: 2.1 time: 0.225947 Jan 22 22:21:56.381825 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4896/9498] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:21:56 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1694 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:21:57.398614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-075dab2d-19a3-4a08-9374-03e39ce098c8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:21:57.399264 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-075dab2d-19a3-4a08-9374-03e39ce098c8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:21:57.406156 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-075dab2d-19a3-4a08-9374-03e39ce098c8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:57.406623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-075dab2d-19a3-4a08-9374-03e39ce098c8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:57.407923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-075dab2d-19a3-4a08-9374-03e39ce098c8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:57.408377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-075dab2d-19a3-4a08-9374-03e39ce098c8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:57.540833 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-075dab2d-19a3-4a08-9374-03e39ce098c8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:21:57.549275 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-075dab2d-19a3-4a08-9374-03e39ce098c8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1699 microversion: 2.1 time: 0.154448 Jan 22 22:21:57.549886 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4603/9499] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:21:57 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:21:58.566522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-641a8beb-04d9-424b-9269-43fc86a93fda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:21:58.567148 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-641a8beb-04d9-424b-9269-43fc86a93fda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:21:58.573895 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-641a8beb-04d9-424b-9269-43fc86a93fda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:58.574475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-641a8beb-04d9-424b-9269-43fc86a93fda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:58.575271 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-641a8beb-04d9-424b-9269-43fc86a93fda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:58.575726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-641a8beb-04d9-424b-9269-43fc86a93fda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:58.710576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-641a8beb-04d9-424b-9269-43fc86a93fda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:21:58.718366 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-641a8beb-04d9-424b-9269-43fc86a93fda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1699 microversion: 2.1 time: 0.155593 Jan 22 22:21:58.719057 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4897/9500] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:21:58 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:21:59.736790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e3dc6917-26de-4cb9-9e16-4a0c3fcf78ee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:21:59.736790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e3dc6917-26de-4cb9-9e16-4a0c3fcf78ee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:21:59.743633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e3dc6917-26de-4cb9-9e16-4a0c3fcf78ee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:59.744084 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e3dc6917-26de-4cb9-9e16-4a0c3fcf78ee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:59.744865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e3dc6917-26de-4cb9-9e16-4a0c3fcf78ee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:21:59.745303 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e3dc6917-26de-4cb9-9e16-4a0c3fcf78ee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:21:59.881710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e3dc6917-26de-4cb9-9e16-4a0c3fcf78ee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:21:59.889249 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e3dc6917-26de-4cb9-9e16-4a0c3fcf78ee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1699 microversion: 2.1 time: 0.157020 Jan 22 22:21:59.889872 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4604/9501] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:21:59 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1699 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:00.907513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-179c356f-27c0-4815-a6d2-13beee56ed6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:00.908279 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-179c356f-27c0-4815-a6d2-13beee56ed6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:00.915032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-179c356f-27c0-4815-a6d2-13beee56ed6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:00.915520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-179c356f-27c0-4815-a6d2-13beee56ed6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:00.916323 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-179c356f-27c0-4815-a6d2-13beee56ed6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:00.916785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-179c356f-27c0-4815-a6d2-13beee56ed6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:01.048742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-179c356f-27c0-4815-a6d2-13beee56ed6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:01.056255 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-179c356f-27c0-4815-a6d2-13beee56ed6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1699 microversion: 2.1 time: 0.152982 Jan 22 22:22:01.056832 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4898/9502] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:00 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1699 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:02.073845 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-68ec95c0-6a3e-4b11-8e4c-bfdbee3dbdac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:02.074460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-68ec95c0-6a3e-4b11-8e4c-bfdbee3dbdac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:02.081983 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68ec95c0-6a3e-4b11-8e4c-bfdbee3dbdac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:02.082443 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68ec95c0-6a3e-4b11-8e4c-bfdbee3dbdac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:02.083261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68ec95c0-6a3e-4b11-8e4c-bfdbee3dbdac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:02.083713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-68ec95c0-6a3e-4b11-8e4c-bfdbee3dbdac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:02.216686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-68ec95c0-6a3e-4b11-8e4c-bfdbee3dbdac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:02.226039 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-68ec95c0-6a3e-4b11-8e4c-bfdbee3dbdac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1699 microversion: 2.1 time: 0.155890 Jan 22 22:22:02.226607 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4605/9503] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:02 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:03.242743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-29f209a3-0c17-44b4-9d4b-ff3eccd4c6e2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:03.243368 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-29f209a3-0c17-44b4-9d4b-ff3eccd4c6e2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:03.250139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29f209a3-0c17-44b4-9d4b-ff3eccd4c6e2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:03.251386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29f209a3-0c17-44b4-9d4b-ff3eccd4c6e2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:03.252345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29f209a3-0c17-44b4-9d4b-ff3eccd4c6e2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:03.252810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-29f209a3-0c17-44b4-9d4b-ff3eccd4c6e2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:03.395420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-29f209a3-0c17-44b4-9d4b-ff3eccd4c6e2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:03.396165 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-29f209a3-0c17-44b4-9d4b-ff3eccd4c6e2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1699 microversion: 2.1 time: 0.156753 Jan 22 22:22:03.396262 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4899/9504] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:03 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1699 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:04.412715 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-61e7f75d-ab86-4324-ad0b-90c327e9299e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:04.413333 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-61e7f75d-ab86-4324-ad0b-90c327e9299e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:04.420176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61e7f75d-ab86-4324-ad0b-90c327e9299e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:04.420640 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61e7f75d-ab86-4324-ad0b-90c327e9299e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:04.421434 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61e7f75d-ab86-4324-ad0b-90c327e9299e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:04.421911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-61e7f75d-ab86-4324-ad0b-90c327e9299e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:04.563363 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-61e7f75d-ab86-4324-ad0b-90c327e9299e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:04.570889 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-61e7f75d-ab86-4324-ad0b-90c327e9299e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1699 microversion: 2.1 time: 0.162007 Jan 22 22:22:04.571460 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4606/9505] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:04 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1699 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:05.588513 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-50aa2112-5d54-47f6-8bce-f1912a9ecc17 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:05.589407 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-50aa2112-5d54-47f6-8bce-f1912a9ecc17 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:05.597263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50aa2112-5d54-47f6-8bce-f1912a9ecc17 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:05.597772 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50aa2112-5d54-47f6-8bce-f1912a9ecc17 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:05.598581 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50aa2112-5d54-47f6-8bce-f1912a9ecc17 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:05.599044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-50aa2112-5d54-47f6-8bce-f1912a9ecc17 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:05.734180 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-50aa2112-5d54-47f6-8bce-f1912a9ecc17 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:05.742756 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-50aa2112-5d54-47f6-8bce-f1912a9ecc17 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1699 microversion: 2.1 time: 0.157947 Jan 22 22:22:05.743340 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4900/9506] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:05 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1699 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:06.759660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-999eb148-d238-4cc4-b7ec-dbeaa4c72b6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:06.760291 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-999eb148-d238-4cc4-b7ec-dbeaa4c72b6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:06.767923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-999eb148-d238-4cc4-b7ec-dbeaa4c72b6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:06.768379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-999eb148-d238-4cc4-b7ec-dbeaa4c72b6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:06.769185 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-999eb148-d238-4cc4-b7ec-dbeaa4c72b6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:06.769665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-999eb148-d238-4cc4-b7ec-dbeaa4c72b6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:06.912395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-999eb148-d238-4cc4-b7ec-dbeaa4c72b6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:06.920568 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-999eb148-d238-4cc4-b7ec-dbeaa4c72b6b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1699 microversion: 2.1 time: 0.164668 Jan 22 22:22:06.921359 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4607/9507] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:06 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1699 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:07.938209 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2704a06a-5a33-403c-bbb3-9d08a69ff219 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:07.938867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2704a06a-5a33-403c-bbb3-9d08a69ff219 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:07.946193 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2704a06a-5a33-403c-bbb3-9d08a69ff219 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:07.946668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2704a06a-5a33-403c-bbb3-9d08a69ff219 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:07.947479 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2704a06a-5a33-403c-bbb3-9d08a69ff219 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:07.947942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2704a06a-5a33-403c-bbb3-9d08a69ff219 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:08.081190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2704a06a-5a33-403c-bbb3-9d08a69ff219 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:08.088694 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2704a06a-5a33-403c-bbb3-9d08a69ff219 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1699 microversion: 2.1 time: 0.154208 Jan 22 22:22:08.089551 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4901/9508] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:07 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:09.110894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fef57192-e21e-4283-85e8-49991098ebcf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:09.112462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fef57192-e21e-4283-85e8-49991098ebcf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:09.119503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fef57192-e21e-4283-85e8-49991098ebcf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:09.124399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fef57192-e21e-4283-85e8-49991098ebcf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:09.124399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fef57192-e21e-4283-85e8-49991098ebcf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:09.124399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fef57192-e21e-4283-85e8-49991098ebcf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:09.256345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fef57192-e21e-4283-85e8-49991098ebcf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:09.264093 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fef57192-e21e-4283-85e8-49991098ebcf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1698 microversion: 2.1 time: 0.157490 Jan 22 22:22:09.264671 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4608/9509] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:09 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:09.683095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-f442f51d-a83e-4249-8d85-6b54ddeec1ac req-9a65c836-d6f8-4ccf-947a-d1d87d10b89b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc", "name": "network-vif-unplugged", "status": "completed", "tag": "d6094f73-6ea1-4d72-bf15-5bb791353490"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:22:09.684823 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:22:09.684823 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:22:09.693676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f442f51d-a83e-4249-8d85-6b54ddeec1ac req-9a65c836-d6f8-4ccf-947a-d1d87d10b89b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:09.694117 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f442f51d-a83e-4249-8d85-6b54ddeec1ac req-9a65c836-d6f8-4ccf-947a-d1d87d10b89b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:09.706296 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f442f51d-a83e-4249-8d85-6b54ddeec1ac req-9a65c836-d6f8-4ccf-947a-d1d87d10b89b service nova] Creating event network-vif-unplugged:d6094f73-6ea1-4d72-bf15-5bb791353490 for instance a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc on nch1-master-1 Jan 22 22:22:09.711495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [req-f442f51d-a83e-4249-8d85-6b54ddeec1ac req-9a65c836-d6f8-4ccf-947a-d1d87d10b89b service nova] Instance a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137032) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:22:09.722568 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-f442f51d-a83e-4249-8d85-6b54ddeec1ac req-9a65c836-d6f8-4ccf-947a-d1d87d10b89b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043267 Jan 22 22:22:09.723137 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4902/9510] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:22:10.281570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b19bb128-f14b-41d4-90ee-e29c831000d4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:10.282842 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b19bb128-f14b-41d4-90ee-e29c831000d4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:10.290588 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b19bb128-f14b-41d4-90ee-e29c831000d4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:10.291047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b19bb128-f14b-41d4-90ee-e29c831000d4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:10.291847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b19bb128-f14b-41d4-90ee-e29c831000d4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:10.292289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b19bb128-f14b-41d4-90ee-e29c831000d4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:10.537255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b19bb128-f14b-41d4-90ee-e29c831000d4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:10.544960 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b19bb128-f14b-41d4-90ee-e29c831000d4 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1698 microversion: 2.1 time: 0.266874 Jan 22 22:22:10.545751 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4609/9511] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:10 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1698 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:11.563338 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3db764ce-9389-4923-909c-4c4097328f64 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:11.564040 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3db764ce-9389-4923-909c-4c4097328f64 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:11.570346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3db764ce-9389-4923-909c-4c4097328f64 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:11.570813 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3db764ce-9389-4923-909c-4c4097328f64 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:11.571605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3db764ce-9389-4923-909c-4c4097328f64 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:11.572085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3db764ce-9389-4923-909c-4c4097328f64 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:11.710314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3db764ce-9389-4923-909c-4c4097328f64 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:11.718371 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3db764ce-9389-4923-909c-4c4097328f64 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1696 microversion: 2.1 time: 0.159946 Jan 22 22:22:11.718966 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4903/9512] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:11 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:11.737345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-4e72a21c-1e36-4aba-8dd3-2d7ce1caac07 req-52d367ab-1640-4b5f-a539-628608a8958b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc", "tag": "d6094f73-6ea1-4d72-bf15-5bb791353490"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:22:11.738924 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:22:11.738924 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:22:11.746060 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4e72a21c-1e36-4aba-8dd3-2d7ce1caac07 req-52d367ab-1640-4b5f-a539-628608a8958b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:11.746512 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-4e72a21c-1e36-4aba-8dd3-2d7ce1caac07 req-52d367ab-1640-4b5f-a539-628608a8958b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:11.758763 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-4e72a21c-1e36-4aba-8dd3-2d7ce1caac07 req-52d367ab-1640-4b5f-a539-628608a8958b service nova] Creating event network-changed:d6094f73-6ea1-4d72-bf15-5bb791353490 for instance a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc on nch1-master-1 Jan 22 22:22:11.764217 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [req-4e72a21c-1e36-4aba-8dd3-2d7ce1caac07 req-52d367ab-1640-4b5f-a539-628608a8958b service nova] Instance a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137033) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Jan 22 22:22:11.775729 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-4e72a21c-1e36-4aba-8dd3-2d7ce1caac07 req-52d367ab-1640-4b5f-a539-628608a8958b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042258 Jan 22 22:22:11.776323 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4610/9513] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:22:12.735919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0e02ed08-b8b3-409b-8673-82e90f80a9aa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:12.737248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0e02ed08-b8b3-409b-8673-82e90f80a9aa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:12.744080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e02ed08-b8b3-409b-8673-82e90f80a9aa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:12.744561 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e02ed08-b8b3-409b-8673-82e90f80a9aa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:12.745376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e02ed08-b8b3-409b-8673-82e90f80a9aa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:12.745865 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e02ed08-b8b3-409b-8673-82e90f80a9aa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:12.883016 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0e02ed08-b8b3-409b-8673-82e90f80a9aa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:12.890920 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0e02ed08-b8b3-409b-8673-82e90f80a9aa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1696 microversion: 2.1 time: 0.158660 Jan 22 22:22:12.891708 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4904/9514] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:12 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:22:13.909829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c7dfa495-932a-457b-9ba2-d05ef7a205d1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:13.910527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c7dfa495-932a-457b-9ba2-d05ef7a205d1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:13.916863 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7dfa495-932a-457b-9ba2-d05ef7a205d1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:13.917326 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7dfa495-932a-457b-9ba2-d05ef7a205d1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:13.918142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7dfa495-932a-457b-9ba2-d05ef7a205d1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:13.918596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7dfa495-932a-457b-9ba2-d05ef7a205d1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:14.051424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c7dfa495-932a-457b-9ba2-d05ef7a205d1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:14.058892 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c7dfa495-932a-457b-9ba2-d05ef7a205d1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1693 microversion: 2.1 time: 0.154194 Jan 22 22:22:14.059463 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4611/9515] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:13 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:14.075515 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4dcb147e-1204-423c-956e-a080cb718194 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:22:14.076087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4dcb147e-1204-423c-956e-a080cb718194 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:14.083686 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dcb147e-1204-423c-956e-a080cb718194 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:14.084196 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dcb147e-1204-423c-956e-a080cb718194 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:14.085014 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dcb147e-1204-423c-956e-a080cb718194 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:14.085481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4dcb147e-1204-423c-956e-a080cb718194 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:14.307315 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4dcb147e-1204-423c-956e-a080cb718194 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc/action" status: 204 len: 0 microversion: 2.1 time: 0.235427 Jan 22 22:22:14.307993 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4905/9516] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:22:14 2022] POST /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc/action => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:22:14.316677 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a466bbea-cfca-4363-840d-d5f2f8cf5ca5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:14.317300 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a466bbea-cfca-4363-840d-d5f2f8cf5ca5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:14.323421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a466bbea-cfca-4363-840d-d5f2f8cf5ca5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:14.323878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a466bbea-cfca-4363-840d-d5f2f8cf5ca5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:14.324679 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a466bbea-cfca-4363-840d-d5f2f8cf5ca5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:14.325124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-a466bbea-cfca-4363-840d-d5f2f8cf5ca5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:14.470236 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a466bbea-cfca-4363-840d-d5f2f8cf5ca5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:14.478002 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a466bbea-cfca-4363-840d-d5f2f8cf5ca5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1693 microversion: 2.1 time: 0.165682 Jan 22 22:22:14.478735 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4612/9517] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:14 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:14.495914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b076bf74-672d-45f6-997c-488e4b803de5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:14.496627 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b076bf74-672d-45f6-997c-488e4b803de5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:14.503345 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b076bf74-672d-45f6-997c-488e4b803de5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:14.503825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b076bf74-672d-45f6-997c-488e4b803de5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:14.504638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b076bf74-672d-45f6-997c-488e4b803de5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:14.505294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b076bf74-672d-45f6-997c-488e4b803de5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:14.989529 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b076bf74-672d-45f6-997c-488e4b803de5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:14.996876 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b076bf74-672d-45f6-997c-488e4b803de5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1693 microversion: 2.1 time: 0.505752 Jan 22 22:22:14.997448 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4906/9518] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:14 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1693 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:16.014843 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c7b17a8d-7c13-4243-8e1e-23e003c8f7fd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:16.015375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c7b17a8d-7c13-4243-8e1e-23e003c8f7fd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:16.022800 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7b17a8d-7c13-4243-8e1e-23e003c8f7fd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:16.023254 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7b17a8d-7c13-4243-8e1e-23e003c8f7fd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:16.024036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7b17a8d-7c13-4243-8e1e-23e003c8f7fd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:16.024482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c7b17a8d-7c13-4243-8e1e-23e003c8f7fd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:16.172032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c7b17a8d-7c13-4243-8e1e-23e003c8f7fd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:16.180767 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c7b17a8d-7c13-4243-8e1e-23e003c8f7fd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1693 microversion: 2.1 time: 0.169694 Jan 22 22:22:16.190494 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4613/9519] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:16 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:16.445377 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-df985cd5-6691-4677-9306-6f5b00d2ac05 req-eb5a09b9-fb1e-429e-991b-2245bfb6c173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc", "name": "network-vif-plugged", "status": "completed", "tag": "d6094f73-6ea1-4d72-bf15-5bb791353490"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:22:16.446969 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:22:16.446969 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:22:16.454314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-df985cd5-6691-4677-9306-6f5b00d2ac05 req-eb5a09b9-fb1e-429e-991b-2245bfb6c173 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:16.454785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-df985cd5-6691-4677-9306-6f5b00d2ac05 req-eb5a09b9-fb1e-429e-991b-2245bfb6c173 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:16.466523 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-df985cd5-6691-4677-9306-6f5b00d2ac05 req-eb5a09b9-fb1e-429e-991b-2245bfb6c173 service nova] Creating event network-vif-plugged:d6094f73-6ea1-4d72-bf15-5bb791353490 for instance a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc on nch1-master-1 Jan 22 22:22:16.471547 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-df985cd5-6691-4677-9306-6f5b00d2ac05 req-eb5a09b9-fb1e-429e-991b-2245bfb6c173 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081097 Jan 22 22:22:16.472375 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4907/9520] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:22:17.197829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b50df960-500d-4bd3-bed4-88f05ccf59e8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:17.198442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b50df960-500d-4bd3-bed4-88f05ccf59e8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:17.205544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b50df960-500d-4bd3-bed4-88f05ccf59e8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:17.206009 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b50df960-500d-4bd3-bed4-88f05ccf59e8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:17.206796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b50df960-500d-4bd3-bed4-88f05ccf59e8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:17.208018 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b50df960-500d-4bd3-bed4-88f05ccf59e8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:17.357653 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b50df960-500d-4bd3-bed4-88f05ccf59e8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:17.365749 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b50df960-500d-4bd3-bed4-88f05ccf59e8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1685 microversion: 2.1 time: 0.171651 Jan 22 22:22:17.366325 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4614/9521] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:17 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:39.598079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cc16aa99-1e41-4526-bcd6-e464361d2a66 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:22:39.599156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cc16aa99-1e41-4526-bcd6-e464361d2a66 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:39.605866 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc16aa99-1e41-4526-bcd6-e464361d2a66 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:39.606339 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc16aa99-1e41-4526-bcd6-e464361d2a66 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:39.607138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc16aa99-1e41-4526-bcd6-e464361d2a66 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:39.607593 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc16aa99-1e41-4526-bcd6-e464361d2a66 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:39.666573 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cc16aa99-1e41-4526-bcd6-e464361d2a66 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc/action" status: 200 len: 24566 microversion: 2.1 time: 0.073422 Jan 22 22:22:39.667445 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4908/9522] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:22:39 2022] POST /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc/action => generated 24566 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:22:51.959127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-027a8869-0ce2-4200-8988-1b17e7dcc312 req-83013d8d-4409-4765-8231-dff70cfae65b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc", "tag": "d6094f73-6ea1-4d72-bf15-5bb791353490"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:22:51.960637 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:22:51.960637 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:22:51.968071 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5230567f-eb25-4eda-bf78-14dc5a91b630 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:51.968568 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5230567f-eb25-4eda-bf78-14dc5a91b630 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:51.970179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-027a8869-0ce2-4200-8988-1b17e7dcc312 req-83013d8d-4409-4765-8231-dff70cfae65b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:51.970699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-027a8869-0ce2-4200-8988-1b17e7dcc312 req-83013d8d-4409-4765-8231-dff70cfae65b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:51.974676 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5230567f-eb25-4eda-bf78-14dc5a91b630 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:51.975399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5230567f-eb25-4eda-bf78-14dc5a91b630 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:51.976196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5230567f-eb25-4eda-bf78-14dc5a91b630 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:51.976810 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5230567f-eb25-4eda-bf78-14dc5a91b630 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:51.983421 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-027a8869-0ce2-4200-8988-1b17e7dcc312 req-83013d8d-4409-4765-8231-dff70cfae65b service nova] Creating event network-changed:d6094f73-6ea1-4d72-bf15-5bb791353490 for instance a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc on nch1-master-1 Jan 22 22:22:51.988534 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-027a8869-0ce2-4200-8988-1b17e7dcc312 req-83013d8d-4409-4765-8231-dff70cfae65b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033397 Jan 22 22:22:51.989402 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4909/9523] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:22:52.004435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5230567f-eb25-4eda-bf78-14dc5a91b630 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:22:52.291392 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5230567f-eb25-4eda-bf78-14dc5a91b630 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "DELETE /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 204 len: 0 microversion: 2.1 time: 0.338327 Jan 22 22:22:52.293148 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4615/9524] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:22:51 2022] DELETE /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:22:52.301816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2c8d074e-ef60-48e0-a79e-1de78763f5cf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:52.303175 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2c8d074e-ef60-48e0-a79e-1de78763f5cf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:52.310488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c8d074e-ef60-48e0-a79e-1de78763f5cf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:52.310975 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c8d074e-ef60-48e0-a79e-1de78763f5cf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:52.311795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c8d074e-ef60-48e0-a79e-1de78763f5cf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:52.312481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2c8d074e-ef60-48e0-a79e-1de78763f5cf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:52.492675 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2c8d074e-ef60-48e0-a79e-1de78763f5cf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:52.502314 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2c8d074e-ef60-48e0-a79e-1de78763f5cf tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1691 microversion: 2.1 time: 0.204112 Jan 22 22:22:52.504292 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4910/9525] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:52 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1691 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:53.525108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-169a1b2d-8f86-4c2b-96b2-aa8e03edef38 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:53.525972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-169a1b2d-8f86-4c2b-96b2-aa8e03edef38 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:53.532680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-169a1b2d-8f86-4c2b-96b2-aa8e03edef38 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:53.533135 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-169a1b2d-8f86-4c2b-96b2-aa8e03edef38 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:53.533955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-169a1b2d-8f86-4c2b-96b2-aa8e03edef38 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:53.534427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-169a1b2d-8f86-4c2b-96b2-aa8e03edef38 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:53.669432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-169a1b2d-8f86-4c2b-96b2-aa8e03edef38 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:53.677247 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-169a1b2d-8f86-4c2b-96b2-aa8e03edef38 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1572 microversion: 2.1 time: 0.156183 Jan 22 22:22:53.677900 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4616/9526] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:53 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:54.468220 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-f5896e65-831d-45c5-9f44-6157d7d9ac7c req-aa0c4fab-f14d-4001-b475-953390ca408b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc", "name": "network-vif-deleted", "tag": "d6094f73-6ea1-4d72-bf15-5bb791353490"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:22:54.469768 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:22:54.469768 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:22:54.477393 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f5896e65-831d-45c5-9f44-6157d7d9ac7c req-aa0c4fab-f14d-4001-b475-953390ca408b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:54.477899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f5896e65-831d-45c5-9f44-6157d7d9ac7c req-aa0c4fab-f14d-4001-b475-953390ca408b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:54.489285 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f5896e65-831d-45c5-9f44-6157d7d9ac7c req-aa0c4fab-f14d-4001-b475-953390ca408b service nova] Creating event network-vif-deleted:d6094f73-6ea1-4d72-bf15-5bb791353490 for instance a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc on nch1-master-1 Jan 22 22:22:54.494245 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-f5896e65-831d-45c5-9f44-6157d7d9ac7c req-aa0c4fab-f14d-4001-b475-953390ca408b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031264 Jan 22 22:22:54.495616 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4911/9527] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:22:54.694550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-090993d4-fc38-4dec-9ecc-4b51a0e3542e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:54.695086 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-090993d4-fc38-4dec-9ecc-4b51a0e3542e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:54.702509 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-090993d4-fc38-4dec-9ecc-4b51a0e3542e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:54.702973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-090993d4-fc38-4dec-9ecc-4b51a0e3542e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:54.703767 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-090993d4-fc38-4dec-9ecc-4b51a0e3542e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:54.704220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-090993d4-fc38-4dec-9ecc-4b51a0e3542e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:54.768622 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-090993d4-fc38-4dec-9ecc-4b51a0e3542e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:22:54.777706 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-090993d4-fc38-4dec-9ecc-4b51a0e3542e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 200 len: 1355 microversion: 2.1 time: 0.086933 Jan 22 22:22:54.778287 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4617/9528] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:54 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 1355 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:22:55.795755 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-76369b46-d365-4dfd-b7ba-378efcf54756 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:55.796468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-76369b46-d365-4dfd-b7ba-378efcf54756 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:22:55.802747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76369b46-d365-4dfd-b7ba-378efcf54756 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:55.803223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76369b46-d365-4dfd-b7ba-378efcf54756 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:55.804022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76369b46-d365-4dfd-b7ba-378efcf54756 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:22:55.804480 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-76369b46-d365-4dfd-b7ba-378efcf54756 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:22:55.817749 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-76369b46-d365-4dfd-b7ba-378efcf54756 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] HTTP exception thrown: Instance a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc could not be found. Jan 22 22:22:55.818386 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-76369b46-d365-4dfd-b7ba-378efcf54756 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Returning 404 to user: Instance a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:22:55.819224 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-76369b46-d365-4dfd-b7ba-378efcf54756 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc" status: 404 len: 111 microversion: 2.1 time: 0.028384 Jan 22 22:22:55.819761 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4912/9529] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:22:55 2022] GET /compute/v2.1/servers/a3ee5e4b-1ccb-40b4-9f45-62a0b31aa2cc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 22 22:22:59.256570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-38821fb6-2e59-4ff3-93e9-25d4ad5f525f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '.version_select at 0x7f1ed5e2d280>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:22:59.261614 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [None req-38821fb6-2e59-4ff3-93e9-25d4ad5f525f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [5ae1cfda-c842-4ad6-9e4a-94babe62e9a0] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 22:23:00.268551 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [None req-38821fb6-2e59-4ff3-93e9-25d4ad5f525f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [5ae1cfda-c842-4ad6-9e4a-94babe62e9a0] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 33396. Jan 22 22:23:00.332164 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-38821fb6-2e59-4ff3-93e9-25d4ad5f525f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2135759894" status: 202 len: 0 microversion: 2.1 time: 1.079602 Jan 22 22:23:00.332667 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4618/9530] 10.222.0.100 () {58 vars in 1288 bytes} [Sat Jan 22 22:22:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2135759894 => generated 0 bytes in 1081 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:23:00.358140 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-776aff84-5fe6-4a50-82f4-5e8ad545e13d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'create', calling method: .version_select at 0x7f1ed61770d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1164177205"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:23:00.373238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-776aff84-5fe6-4a50-82f4-5e8ad545e13d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:23:00.379206 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-776aff84-5fe6-4a50-82f4-5e8ad545e13d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for user a9e6a7e25c0f4a9fbd1cc64635c2ed66 and project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:23:00.392994 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [None req-776aff84-5fe6-4a50-82f4-5e8ad545e13d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [85f419c8-2329-4931-a9bc-29598b4c1148] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 22:23:01.399525 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [None req-776aff84-5fe6-4a50-82f4-5e8ad545e13d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [85f419c8-2329-4931-a9bc-29598b4c1148] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 33400. Jan 22 22:23:01.725540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-776aff84-5fe6-4a50-82f4-5e8ad545e13d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:23:01.730511 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-776aff84-5fe6-4a50-82f4-5e8ad545e13d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for user a9e6a7e25c0f4a9fbd1cc64635c2ed66 and project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:23:01.744774 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-776aff84-5fe6-4a50-82f4-5e8ad545e13d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 1.390473 Jan 22 22:23:01.745553 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4913/9531] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 22:23:00 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:10.145130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1301725157", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "b2326ecd-1542-4373-9312-f7bcbee6c1ed"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1164177205", "security_groups": [{"name": "tempest-secgroup-smoke-789256992"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:23:10.255441 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] validate_networks() for [('b2326ecd-1542-4373-9312-f7bcbee6c1ed', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:23:10.645091 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:23:10.645701 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:23:10.646296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:23:10.646787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:23:10.647399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:23:10.657912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:10.658507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:10.659385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:10.659834 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:10.678395 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:23:10.684275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for user a9e6a7e25c0f4a9fbd1cc64635c2ed66 and project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:23:10.699665 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:23:10.703727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:23:10.840540 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e24b47f9-83ad-4c17-aade-4ce7879ddc1b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.700080 Jan 22 22:23:10.841527 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4619/9532] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:23:10 2022] POST /compute/v2.1/servers => generated 407 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 22:23:10.852445 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bd2ae71f-fbfc-49fb-b989-4539d5766a83 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:10.853326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bd2ae71f-fbfc-49fb-b989-4539d5766a83 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:10.909620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bd2ae71f-fbfc-49fb-b989-4539d5766a83 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:10.918665 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bd2ae71f-fbfc-49fb-b989-4539d5766a83 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1271 microversion: 2.1 time: 0.070455 Jan 22 22:23:10.919159 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4914/9533] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:10 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1271 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:11.936611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c809f8a8-e2c0-45e4-95be-f9ab4fae41fd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:11.938118 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c809f8a8-e2c0-45e4-95be-f9ab4fae41fd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:12.003231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c809f8a8-e2c0-45e4-95be-f9ab4fae41fd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:12.013168 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c809f8a8-e2c0-45e4-95be-f9ab4fae41fd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1271 microversion: 2.1 time: 0.081780 Jan 22 22:23:12.014003 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4620/9534] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:11 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:13.040182 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8d72b1af-cdf1-4198-9b9c-6dcf9a5bac4a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:13.041644 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8d72b1af-cdf1-4198-9b9c-6dcf9a5bac4a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:13.109094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8d72b1af-cdf1-4198-9b9c-6dcf9a5bac4a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:13.116027 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8d72b1af-cdf1-4198-9b9c-6dcf9a5bac4a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1271 microversion: 2.1 time: 0.086430 Jan 22 22:23:13.116626 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4915/9535] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:13 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:14.132890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-a810e3d3-9f64-4e01-bf62-64398760d80f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:14.133550 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-a810e3d3-9f64-4e01-bf62-64398760d80f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:14.184580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-a810e3d3-9f64-4e01-bf62-64398760d80f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:14.192106 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-a810e3d3-9f64-4e01-bf62-64398760d80f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1271 microversion: 2.1 time: 0.062900 Jan 22 22:23:14.192655 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4621/9536] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:14 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1271 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:14.708342 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:23:14.708920 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:23:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:23:15.209083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b592582b-6ad3-4f8e-9438-475b0ce7251e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:15.209754 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b592582b-6ad3-4f8e-9438-475b0ce7251e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:15.218142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b592582b-6ad3-4f8e-9438-475b0ce7251e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:15.218626 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b592582b-6ad3-4f8e-9438-475b0ce7251e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:15.219448 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b592582b-6ad3-4f8e-9438-475b0ce7251e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:15.219940 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b592582b-6ad3-4f8e-9438-475b0ce7251e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:15.278646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b592582b-6ad3-4f8e-9438-475b0ce7251e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:15.286045 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b592582b-6ad3-4f8e-9438-475b0ce7251e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1275 microversion: 2.1 time: 0.080610 Jan 22 22:23:15.286618 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4916/9537] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:15 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1275 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:16.302776 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e3e59469-38cd-4661-994f-7accc0285402 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:16.303422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e3e59469-38cd-4661-994f-7accc0285402 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:16.310986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e3e59469-38cd-4661-994f-7accc0285402 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:16.311445 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e3e59469-38cd-4661-994f-7accc0285402 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:16.312239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e3e59469-38cd-4661-994f-7accc0285402 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:16.312686 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e3e59469-38cd-4661-994f-7accc0285402 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:16.379477 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e3e59469-38cd-4661-994f-7accc0285402 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:16.388188 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e3e59469-38cd-4661-994f-7accc0285402 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1323 microversion: 2.1 time: 0.089147 Jan 22 22:23:16.390413 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4622/9538] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:16 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1323 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:23:17.405131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-94b7b972-0596-4227-9661-02049b46aaa9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:17.405810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-94b7b972-0596-4227-9661-02049b46aaa9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:17.413005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94b7b972-0596-4227-9661-02049b46aaa9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:17.413473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94b7b972-0596-4227-9661-02049b46aaa9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:17.414355 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94b7b972-0596-4227-9661-02049b46aaa9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:17.414818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-94b7b972-0596-4227-9661-02049b46aaa9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:17.620292 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-94b7b972-0596-4227-9661-02049b46aaa9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:17.628113 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-94b7b972-0596-4227-9661-02049b46aaa9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1396 microversion: 2.1 time: 0.226743 Jan 22 22:23:17.628714 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4917/9539] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:17 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1396 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:18.392362 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-48edacb2-875d-428f-8b60-8ec88daf3022 req-04606ff0-585e-4e7a-a18f-738802080a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d666a047-b047-4add-9109-e43a4c20ec12", "tag": "6707164e-fd29-44d0-8ee4-13e49e171e6e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:23:18.394130 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:23:18.394130 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:23:18.402521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-48edacb2-875d-428f-8b60-8ec88daf3022 req-04606ff0-585e-4e7a-a18f-738802080a2f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:18.402973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-48edacb2-875d-428f-8b60-8ec88daf3022 req-04606ff0-585e-4e7a-a18f-738802080a2f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:18.415091 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-48edacb2-875d-428f-8b60-8ec88daf3022 req-04606ff0-585e-4e7a-a18f-738802080a2f service nova] Creating event network-changed:6707164e-fd29-44d0-8ee4-13e49e171e6e for instance d666a047-b047-4add-9109-e43a4c20ec12 on nch2-master-1 Jan 22 22:23:18.420712 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-48edacb2-875d-428f-8b60-8ec88daf3022 req-04606ff0-585e-4e7a-a18f-738802080a2f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111344 Jan 22 22:23:18.421916 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4623/9540] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:23:18.648142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0ac9fad7-7353-47e6-9869-bdbc586073a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:18.648775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0ac9fad7-7353-47e6-9869-bdbc586073a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:18.655704 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ac9fad7-7353-47e6-9869-bdbc586073a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:18.656178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ac9fad7-7353-47e6-9869-bdbc586073a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:18.656994 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ac9fad7-7353-47e6-9869-bdbc586073a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:18.657461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ac9fad7-7353-47e6-9869-bdbc586073a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:18.885426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0ac9fad7-7353-47e6-9869-bdbc586073a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:18.893102 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0ac9fad7-7353-47e6-9869-bdbc586073a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1396 microversion: 2.1 time: 0.248596 Jan 22 22:23:18.894020 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4918/9541] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:18 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1396 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:19.910862 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3cbea5d1-6d6f-4300-9363-32ecb3fb991b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:19.911558 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3cbea5d1-6d6f-4300-9363-32ecb3fb991b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:19.919482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cbea5d1-6d6f-4300-9363-32ecb3fb991b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:19.919938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cbea5d1-6d6f-4300-9363-32ecb3fb991b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:19.920731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cbea5d1-6d6f-4300-9363-32ecb3fb991b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:19.921176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3cbea5d1-6d6f-4300-9363-32ecb3fb991b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:20.055971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3cbea5d1-6d6f-4300-9363-32ecb3fb991b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:20.063701 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3cbea5d1-6d6f-4300-9363-32ecb3fb991b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1396 microversion: 2.1 time: 0.156914 Jan 22 22:23:20.064271 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4624/9542] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:19 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1396 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:21.080078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9590de62-8052-4393-bf1b-dfe8308c78fa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:21.080706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9590de62-8052-4393-bf1b-dfe8308c78fa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:21.088093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9590de62-8052-4393-bf1b-dfe8308c78fa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:21.088601 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9590de62-8052-4393-bf1b-dfe8308c78fa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:21.089409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9590de62-8052-4393-bf1b-dfe8308c78fa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:21.089901 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9590de62-8052-4393-bf1b-dfe8308c78fa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:21.231997 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9590de62-8052-4393-bf1b-dfe8308c78fa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:21.239347 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9590de62-8052-4393-bf1b-dfe8308c78fa tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1396 microversion: 2.1 time: 0.163159 Jan 22 22:23:21.239930 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4919/9543] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:21 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1396 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:22.256836 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b5860b25-7940-49ec-87d8-605a391c8f79 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:22.257442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b5860b25-7940-49ec-87d8-605a391c8f79 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:22.264544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5860b25-7940-49ec-87d8-605a391c8f79 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:22.265006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5860b25-7940-49ec-87d8-605a391c8f79 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:22.265961 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5860b25-7940-49ec-87d8-605a391c8f79 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:22.266402 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b5860b25-7940-49ec-87d8-605a391c8f79 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:22.411598 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b5860b25-7940-49ec-87d8-605a391c8f79 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:22.420027 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b5860b25-7940-49ec-87d8-605a391c8f79 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1396 microversion: 2.1 time: 0.166932 Jan 22 22:23:22.420604 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4625/9544] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:22 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1396 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:23.436858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8e76739a-2188-49d6-830f-7b39d4de76a0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:23.437492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8e76739a-2188-49d6-830f-7b39d4de76a0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:23.444707 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e76739a-2188-49d6-830f-7b39d4de76a0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:23.445265 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e76739a-2188-49d6-830f-7b39d4de76a0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:23.446568 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e76739a-2188-49d6-830f-7b39d4de76a0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:23.447075 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8e76739a-2188-49d6-830f-7b39d4de76a0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:23.581244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8e76739a-2188-49d6-830f-7b39d4de76a0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:23.589804 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8e76739a-2188-49d6-830f-7b39d4de76a0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1396 microversion: 2.1 time: 0.156721 Jan 22 22:23:23.590683 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4920/9545] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:23 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1396 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:23.788689 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-93f64a8c-8b44-4389-8352-06f284ca2402 req-fa738519-fe9d-4ffb-94be-89421b52cb30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d666a047-b047-4add-9109-e43a4c20ec12", "name": "network-vif-plugged", "status": "completed", "tag": "6707164e-fd29-44d0-8ee4-13e49e171e6e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:23:23.790375 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:23:23.790375 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:23:23.799346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-93f64a8c-8b44-4389-8352-06f284ca2402 req-fa738519-fe9d-4ffb-94be-89421b52cb30 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:23.799799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-93f64a8c-8b44-4389-8352-06f284ca2402 req-fa738519-fe9d-4ffb-94be-89421b52cb30 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:23.811931 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-93f64a8c-8b44-4389-8352-06f284ca2402 req-fa738519-fe9d-4ffb-94be-89421b52cb30 service nova] Creating event network-vif-plugged:6707164e-fd29-44d0-8ee4-13e49e171e6e for instance d666a047-b047-4add-9109-e43a4c20ec12 on nch2-master-1 Jan 22 22:23:23.817100 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-93f64a8c-8b44-4389-8352-06f284ca2402 req-fa738519-fe9d-4ffb-94be-89421b52cb30 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032278 Jan 22 22:23:23.817736 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4626/9546] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:23:24.607136 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5c825454-7263-4da4-ba8e-83b23f77bc9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:24.607788 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5c825454-7263-4da4-ba8e-83b23f77bc9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:24.614576 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c825454-7263-4da4-ba8e-83b23f77bc9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:24.615097 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c825454-7263-4da4-ba8e-83b23f77bc9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:24.615890 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c825454-7263-4da4-ba8e-83b23f77bc9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:24.616344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5c825454-7263-4da4-ba8e-83b23f77bc9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:24.750088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5c825454-7263-4da4-ba8e-83b23f77bc9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:24.757843 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5c825454-7263-4da4-ba8e-83b23f77bc9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1396 microversion: 2.1 time: 0.154463 Jan 22 22:23:24.758414 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4921/9547] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:24 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1396 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:25.774569 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-00767c65-fe75-4ca7-bd07-120a8879b02b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:25.775423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-00767c65-fe75-4ca7-bd07-120a8879b02b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:25.782751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00767c65-fe75-4ca7-bd07-120a8879b02b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:25.783213 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00767c65-fe75-4ca7-bd07-120a8879b02b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:25.784010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00767c65-fe75-4ca7-bd07-120a8879b02b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:25.784458 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-00767c65-fe75-4ca7-bd07-120a8879b02b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:25.924716 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-00767c65-fe75-4ca7-bd07-120a8879b02b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:25.932469 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-00767c65-fe75-4ca7-bd07-120a8879b02b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1566 microversion: 2.1 time: 0.161967 Jan 22 22:23:25.933871 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4627/9548] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:25 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:25.949709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2e23c300-b857-4972-865f-ff7e3f8affac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:25.950369 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2e23c300-b857-4972-865f-ff7e3f8affac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:25.957110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e23c300-b857-4972-865f-ff7e3f8affac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:25.957617 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e23c300-b857-4972-865f-ff7e3f8affac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:25.958420 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e23c300-b857-4972-865f-ff7e3f8affac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:25.958880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2e23c300-b857-4972-865f-ff7e3f8affac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:26.097588 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2e23c300-b857-4972-865f-ff7e3f8affac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:26.105626 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2e23c300-b857-4972-865f-ff7e3f8affac tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1566 microversion: 2.1 time: 0.159751 Jan 22 22:23:26.106202 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4922/9549] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:25 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:27.978832 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7bc00884-8448-455e-b752-e9b0688a11e0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:23:27.979439 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7bc00884-8448-455e-b752-e9b0688a11e0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:27.987048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bc00884-8448-455e-b752-e9b0688a11e0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:27.987048 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bc00884-8448-455e-b752-e9b0688a11e0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:27.987849 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bc00884-8448-455e-b752-e9b0688a11e0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:27.988302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7bc00884-8448-455e-b752-e9b0688a11e0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:28.041390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-960c910d-44e2-48de-997f-e429fe394f22 req-e57b88ee-bf91-4c74-a852-de4a802a1e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d666a047-b047-4add-9109-e43a4c20ec12", "tag": "6707164e-fd29-44d0-8ee4-13e49e171e6e"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:23:28.043510 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:23:28.043510 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:23:28.050781 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-960c910d-44e2-48de-997f-e429fe394f22 req-e57b88ee-bf91-4c74-a852-de4a802a1e69 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:28.051256 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-960c910d-44e2-48de-997f-e429fe394f22 req-e57b88ee-bf91-4c74-a852-de4a802a1e69 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:28.063092 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-960c910d-44e2-48de-997f-e429fe394f22 req-e57b88ee-bf91-4c74-a852-de4a802a1e69 service nova] Creating event network-changed:6707164e-fd29-44d0-8ee4-13e49e171e6e for instance d666a047-b047-4add-9109-e43a4c20ec12 on nch2-master-1 Jan 22 22:23:28.068281 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-960c910d-44e2-48de-997f-e429fe394f22 req-e57b88ee-bf91-4c74-a852-de4a802a1e69 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090612 Jan 22 22:23:28.068876 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4923/9550] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:23:28.134978 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7bc00884-8448-455e-b752-e9b0688a11e0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:23:28.143626 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7bc00884-8448-455e-b752-e9b0688a11e0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1566 microversion: 2.1 time: 0.168585 Jan 22 22:23:28.149617 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4628/9551] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:23:27 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:23:59.414034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3f72fcaf-62ed-44f7-b342-49dd04fe4c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:23:59.415073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3f72fcaf-62ed-44f7-b342-49dd04fe4c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:23:59.422373 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f72fcaf-62ed-44f7-b342-49dd04fe4c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:59.422785 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f72fcaf-62ed-44f7-b342-49dd04fe4c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:59.423596 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f72fcaf-62ed-44f7-b342-49dd04fe4c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:23:59.424054 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3f72fcaf-62ed-44f7-b342-49dd04fe4c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:23:59.473818 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3f72fcaf-62ed-44f7-b342-49dd04fe4c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12/action" status: 200 len: 24558 microversion: 2.1 time: 0.064788 Jan 22 22:23:59.474708 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4924/9552] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:23:59 2022] POST /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12/action => generated 24558 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:24:29.969211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-123d1ac4-6dd8-490c-853d-5929e86cb95b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:24:29.975306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-123d1ac4-6dd8-490c-853d-5929e86cb95b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:29.975757 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-123d1ac4-6dd8-490c-853d-5929e86cb95b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:30.000513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-123d1ac4-6dd8-490c-853d-5929e86cb95b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Going to try to stop instance {{(pid=137033) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 22 22:24:30.205835 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-123d1ac4-6dd8-490c-853d-5929e86cb95b tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12/action" status: 202 len: 0 microversion: 2.1 time: 0.241171 Jan 22 22:24:30.206691 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4629/9553] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:24:29 2022] POST /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:24:30.215583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b7938258-474c-4ff8-bca7-f382f1c4f60a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:24:30.216302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b7938258-474c-4ff8-bca7-f382f1c4f60a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:24:30.224254 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7938258-474c-4ff8-bca7-f382f1c4f60a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:30.224734 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7938258-474c-4ff8-bca7-f382f1c4f60a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:30.225583 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7938258-474c-4ff8-bca7-f382f1c4f60a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:30.226048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b7938258-474c-4ff8-bca7-f382f1c4f60a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:30.413656 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b7938258-474c-4ff8-bca7-f382f1c4f60a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:24:30.421063 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b7938258-474c-4ff8-bca7-f382f1c4f60a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1695 microversion: 2.1 time: 0.209760 Jan 22 22:24:30.422103 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4925/9554] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:24:30 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1695 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:24:31.441523 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-bc1e1027-a5fe-4382-b7a1-6fa4aaf424d5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:24:31.442280 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-bc1e1027-a5fe-4382-b7a1-6fa4aaf424d5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:24:31.448495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc1e1027-a5fe-4382-b7a1-6fa4aaf424d5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:31.448953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc1e1027-a5fe-4382-b7a1-6fa4aaf424d5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:31.449769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc1e1027-a5fe-4382-b7a1-6fa4aaf424d5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:31.450219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-bc1e1027-a5fe-4382-b7a1-6fa4aaf424d5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:31.586721 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-bc1e1027-a5fe-4382-b7a1-6fa4aaf424d5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:24:31.594321 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-bc1e1027-a5fe-4382-b7a1-6fa4aaf424d5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1695 microversion: 2.1 time: 0.158899 Jan 22 22:24:31.595174 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4630/9555] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:24:31 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:24:32.623423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-767529c6-9ba5-4d43-9269-a574ee010dc1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:24:32.623958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-767529c6-9ba5-4d43-9269-a574ee010dc1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:24:32.634962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-767529c6-9ba5-4d43-9269-a574ee010dc1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:32.635443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-767529c6-9ba5-4d43-9269-a574ee010dc1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:32.636257 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-767529c6-9ba5-4d43-9269-a574ee010dc1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:32.636717 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-767529c6-9ba5-4d43-9269-a574ee010dc1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:32.770211 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-767529c6-9ba5-4d43-9269-a574ee010dc1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:24:32.777537 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-767529c6-9ba5-4d43-9269-a574ee010dc1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1695 microversion: 2.1 time: 0.157973 Jan 22 22:24:32.778123 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4926/9556] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:24:32 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:24:33.794033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b36b050-58a0-469d-9a19-a92ad7cb0390 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:24:33.794750 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4b36b050-58a0-469d-9a19-a92ad7cb0390 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:24:33.801984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b36b050-58a0-469d-9a19-a92ad7cb0390 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:33.802480 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b36b050-58a0-469d-9a19-a92ad7cb0390 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:33.803284 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b36b050-58a0-469d-9a19-a92ad7cb0390 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:33.803752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b36b050-58a0-469d-9a19-a92ad7cb0390 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:33.940030 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4b36b050-58a0-469d-9a19-a92ad7cb0390 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:24:33.948031 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b36b050-58a0-469d-9a19-a92ad7cb0390 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1695 microversion: 2.1 time: 0.157824 Jan 22 22:24:33.948607 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4631/9557] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:24:33 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:24:34.965972 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17032d59-de5b-497a-aadd-11f6cb0c6eb5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:24:34.966603 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17032d59-de5b-497a-aadd-11f6cb0c6eb5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:24:34.974288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17032d59-de5b-497a-aadd-11f6cb0c6eb5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:34.974765 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17032d59-de5b-497a-aadd-11f6cb0c6eb5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:34.975577 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17032d59-de5b-497a-aadd-11f6cb0c6eb5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:34.976043 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17032d59-de5b-497a-aadd-11f6cb0c6eb5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:35.112465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-17032d59-de5b-497a-aadd-11f6cb0c6eb5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:24:35.120492 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17032d59-de5b-497a-aadd-11f6cb0c6eb5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1695 microversion: 2.1 time: 0.158185 Jan 22 22:24:35.121257 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4927/9558] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:24:34 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:24:36.138247 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-7e671584-dd14-454e-9225-259b6d2c027a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:24:36.138787 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-7e671584-dd14-454e-9225-259b6d2c027a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:24:36.146029 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e671584-dd14-454e-9225-259b6d2c027a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:36.146526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e671584-dd14-454e-9225-259b6d2c027a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:36.147357 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e671584-dd14-454e-9225-259b6d2c027a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:36.147807 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-7e671584-dd14-454e-9225-259b6d2c027a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:36.284153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-7e671584-dd14-454e-9225-259b6d2c027a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:24:36.291604 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-7e671584-dd14-454e-9225-259b6d2c027a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1695 microversion: 2.1 time: 0.157268 Jan 22 22:24:36.292174 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4632/9559] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:24:36 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:24:37.312005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4d35e4e5-de27-4f6e-9812-ff8d8e79c92e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:24:37.312640 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4d35e4e5-de27-4f6e-9812-ff8d8e79c92e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:24:37.320380 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d35e4e5-de27-4f6e-9812-ff8d8e79c92e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:37.320858 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d35e4e5-de27-4f6e-9812-ff8d8e79c92e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:37.321705 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d35e4e5-de27-4f6e-9812-ff8d8e79c92e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:37.322174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4d35e4e5-de27-4f6e-9812-ff8d8e79c92e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:37.458869 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4d35e4e5-de27-4f6e-9812-ff8d8e79c92e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:24:37.466623 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4d35e4e5-de27-4f6e-9812-ff8d8e79c92e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1695 microversion: 2.1 time: 0.158335 Jan 22 22:24:37.467204 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4928/9560] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:24:37 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:24:38.483967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-be0d0a16-1fc9-4751-ae47-c785507eccb0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:24:38.484583 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-be0d0a16-1fc9-4751-ae47-c785507eccb0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:24:38.492481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be0d0a16-1fc9-4751-ae47-c785507eccb0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:38.492940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be0d0a16-1fc9-4751-ae47-c785507eccb0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:38.493769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be0d0a16-1fc9-4751-ae47-c785507eccb0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:38.494216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-be0d0a16-1fc9-4751-ae47-c785507eccb0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:38.629408 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-be0d0a16-1fc9-4751-ae47-c785507eccb0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:24:38.636909 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-be0d0a16-1fc9-4751-ae47-c785507eccb0 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1695 microversion: 2.1 time: 0.156707 Jan 22 22:24:38.637471 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4633/9561] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:24:38 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:24:39.654431 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-17034d54-ff96-4a0a-bc8e-8a74080dd11e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:24:39.654999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-17034d54-ff96-4a0a-bc8e-8a74080dd11e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:24:39.661795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17034d54-ff96-4a0a-bc8e-8a74080dd11e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:39.662259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17034d54-ff96-4a0a-bc8e-8a74080dd11e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:39.663053 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17034d54-ff96-4a0a-bc8e-8a74080dd11e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:39.663549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-17034d54-ff96-4a0a-bc8e-8a74080dd11e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:39.797834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-17034d54-ff96-4a0a-bc8e-8a74080dd11e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:24:39.805899 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-17034d54-ff96-4a0a-bc8e-8a74080dd11e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1695 microversion: 2.1 time: 0.155248 Jan 22 22:24:39.806492 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4929/9562] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:24:39 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:24:40.823530 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ea528a46-4d51-4b2e-9a4c-82d242e47191 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:24:40.824152 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ea528a46-4d51-4b2e-9a4c-82d242e47191 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:24:40.830637 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea528a46-4d51-4b2e-9a4c-82d242e47191 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:40.831360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea528a46-4d51-4b2e-9a4c-82d242e47191 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:40.832159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea528a46-4d51-4b2e-9a4c-82d242e47191 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:40.832611 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ea528a46-4d51-4b2e-9a4c-82d242e47191 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:40.970340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ea528a46-4d51-4b2e-9a4c-82d242e47191 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:24:40.977943 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ea528a46-4d51-4b2e-9a4c-82d242e47191 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1672 microversion: 2.1 time: 0.158129 Jan 22 22:24:40.978519 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4634/9563] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:24:40 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:24:42.070612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7dd8c2a2-032f-41b0-a3aa-0e1e2754b121 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:24:42.071485 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7dd8c2a2-032f-41b0-a3aa-0e1e2754b121 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:24:42.077769 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dd8c2a2-032f-41b0-a3aa-0e1e2754b121 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:42.078237 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dd8c2a2-032f-41b0-a3aa-0e1e2754b121 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:42.079029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dd8c2a2-032f-41b0-a3aa-0e1e2754b121 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:42.079484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dd8c2a2-032f-41b0-a3aa-0e1e2754b121 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:42.129787 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7dd8c2a2-032f-41b0-a3aa-0e1e2754b121 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12/action" status: 200 len: 36549 microversion: 2.1 time: 0.062820 Jan 22 22:24:42.130418 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4930/9564] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:24:42 2022] POST /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12/action => generated 36549 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:24:42.141140 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e0a3b58f-c9e9-4c22-853c-5ebc6caebb5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:24:42.148039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0a3b58f-c9e9-4c22-853c-5ebc6caebb5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:42.148491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e0a3b58f-c9e9-4c22-853c-5ebc6caebb5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:42.170429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e0a3b58f-c9e9-4c22-853c-5ebc6caebb5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Going to try to start instance {{(pid=137033) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 22 22:24:42.342614 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e0a3b58f-c9e9-4c22-853c-5ebc6caebb5a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12/action" status: 202 len: 0 microversion: 2.1 time: 0.204826 Jan 22 22:24:42.343145 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4635/9565] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:24:42 2022] POST /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:24:42.352700 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a5ce4954-6b94-4133-ac7c-afc3d759c353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:24:42.353416 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a5ce4954-6b94-4133-ac7c-afc3d759c353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:24:42.360402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5ce4954-6b94-4133-ac7c-afc3d759c353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:42.360876 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5ce4954-6b94-4133-ac7c-afc3d759c353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:42.362874 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5ce4954-6b94-4133-ac7c-afc3d759c353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:42.363055 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a5ce4954-6b94-4133-ac7c-afc3d759c353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:42.506314 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a5ce4954-6b94-4133-ac7c-afc3d759c353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:24:42.513792 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a5ce4954-6b94-4133-ac7c-afc3d759c353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1681 microversion: 2.1 time: 0.165237 Jan 22 22:24:42.514363 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4931/9566] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:24:42 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:24:43.533004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d1df6f68-4227-4bc2-92b2-77d471ecad44 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:24:43.534365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d1df6f68-4227-4bc2-92b2-77d471ecad44 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:24:43.540754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1df6f68-4227-4bc2-92b2-77d471ecad44 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:43.541193 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1df6f68-4227-4bc2-92b2-77d471ecad44 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:43.542087 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1df6f68-4227-4bc2-92b2-77d471ecad44 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:43.542541 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d1df6f68-4227-4bc2-92b2-77d471ecad44 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:43.684258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d1df6f68-4227-4bc2-92b2-77d471ecad44 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:24:43.692886 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d1df6f68-4227-4bc2-92b2-77d471ecad44 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1681 microversion: 2.1 time: 0.164773 Jan 22 22:24:43.693469 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4636/9567] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:24:43 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:24:44.710941 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c924e6c1-e774-4719-bb55-c3d5e118fdee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:24:44.711481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c924e6c1-e774-4719-bb55-c3d5e118fdee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:24:44.718219 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c924e6c1-e774-4719-bb55-c3d5e118fdee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:44.718694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c924e6c1-e774-4719-bb55-c3d5e118fdee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:44.719493 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c924e6c1-e774-4719-bb55-c3d5e118fdee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:24:44.719956 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c924e6c1-e774-4719-bb55-c3d5e118fdee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:24:44.862722 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c924e6c1-e774-4719-bb55-c3d5e118fdee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:24:44.870182 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c924e6c1-e774-4719-bb55-c3d5e118fdee tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1685 microversion: 2.1 time: 0.163342 Jan 22 22:24:44.870754 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4932/9568] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:24:44 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:25:17.079336 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c2e6efcf-c0c8-4667-b140-c024aa208ff8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:25:17.080289 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c2e6efcf-c0c8-4667-b140-c024aa208ff8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:25:17.087166 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2e6efcf-c0c8-4667-b140-c024aa208ff8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:17.087621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2e6efcf-c0c8-4667-b140-c024aa208ff8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:17.088398 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2e6efcf-c0c8-4667-b140-c024aa208ff8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:17.088841 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c2e6efcf-c0c8-4667-b140-c024aa208ff8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:17.141244 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c2e6efcf-c0c8-4667-b140-c024aa208ff8 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12/action" status: 200 len: 61110 microversion: 2.1 time: 0.065640 Jan 22 22:25:17.141922 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4637/9569] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:25:17 2022] POST /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12/action => generated 61110 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:25:34.795703 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e7e83f50-9ea3-4c6d-b57d-9b15bad56a39 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:25:34.796197 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e7e83f50-9ea3-4c6d-b57d-9b15bad56a39 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:25:34.803572 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-22067b1f-f4f5-4220-887f-d25030e19521 req-92fe7ad8-66a3-4513-a3ec-e24c43662019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d666a047-b047-4add-9109-e43a4c20ec12", "tag": "6707164e-fd29-44d0-8ee4-13e49e171e6e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:25:34.805040 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:25:34.805040 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:25:34.811789 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7e83f50-9ea3-4c6d-b57d-9b15bad56a39 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:34.812457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7e83f50-9ea3-4c6d-b57d-9b15bad56a39 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:34.813721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7e83f50-9ea3-4c6d-b57d-9b15bad56a39 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:34.814300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e7e83f50-9ea3-4c6d-b57d-9b15bad56a39 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:34.815345 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-22067b1f-f4f5-4220-887f-d25030e19521 req-92fe7ad8-66a3-4513-a3ec-e24c43662019 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:34.815817 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-22067b1f-f4f5-4220-887f-d25030e19521 req-92fe7ad8-66a3-4513-a3ec-e24c43662019 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:34.829546 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-22067b1f-f4f5-4220-887f-d25030e19521 req-92fe7ad8-66a3-4513-a3ec-e24c43662019 service nova] Creating event network-changed:6707164e-fd29-44d0-8ee4-13e49e171e6e for instance d666a047-b047-4add-9109-e43a4c20ec12 on nch2-master-1 Jan 22 22:25:34.835290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-22067b1f-f4f5-4220-887f-d25030e19521 req-92fe7ad8-66a3-4513-a3ec-e24c43662019 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036226 Jan 22 22:25:34.836222 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4638/9570] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:25:34.848098 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e7e83f50-9ea3-4c6d-b57d-9b15bad56a39 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:25:35.120199 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e7e83f50-9ea3-4c6d-b57d-9b15bad56a39 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "DELETE /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 204 len: 0 microversion: 2.1 time: 0.328075 Jan 22 22:25:35.121107 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4933/9571] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:25:34 2022] DELETE /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:25:35.130378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-784c4117-45dd-45ef-acf2-17c3dfa9b7bd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:25:35.131245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-784c4117-45dd-45ef-acf2-17c3dfa9b7bd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:25:35.138417 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-784c4117-45dd-45ef-acf2-17c3dfa9b7bd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:35.138958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-784c4117-45dd-45ef-acf2-17c3dfa9b7bd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:35.139824 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-784c4117-45dd-45ef-acf2-17c3dfa9b7bd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:35.140490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-784c4117-45dd-45ef-acf2-17c3dfa9b7bd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:35.299914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-784c4117-45dd-45ef-acf2-17c3dfa9b7bd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:25:35.308453 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-784c4117-45dd-45ef-acf2-17c3dfa9b7bd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1691 microversion: 2.1 time: 0.182366 Jan 22 22:25:35.309176 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4639/9572] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:25:35 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:25:36.327604 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2a50cf18-e26d-4322-975a-0dbe55631b2e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:25:36.328310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2a50cf18-e26d-4322-975a-0dbe55631b2e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:25:36.335967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a50cf18-e26d-4322-975a-0dbe55631b2e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:36.336438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a50cf18-e26d-4322-975a-0dbe55631b2e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:36.337238 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a50cf18-e26d-4322-975a-0dbe55631b2e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:36.337726 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a50cf18-e26d-4322-975a-0dbe55631b2e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:36.479122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2a50cf18-e26d-4322-975a-0dbe55631b2e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:25:36.486677 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2a50cf18-e26d-4322-975a-0dbe55631b2e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1572 microversion: 2.1 time: 0.163162 Jan 22 22:25:36.487247 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4934/9573] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:25:36 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:25:37.385707 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-373acf83-e916-444b-8250-630d1deeba9e req-9c3d074b-673e-49da-ac5d-390d84361760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d666a047-b047-4add-9109-e43a4c20ec12", "name": "network-vif-deleted", "tag": "6707164e-fd29-44d0-8ee4-13e49e171e6e"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:25:37.387691 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:25:37.387691 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:25:37.397340 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-373acf83-e916-444b-8250-630d1deeba9e req-9c3d074b-673e-49da-ac5d-390d84361760 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:37.397826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-373acf83-e916-444b-8250-630d1deeba9e req-9c3d074b-673e-49da-ac5d-390d84361760 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:37.408453 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-373acf83-e916-444b-8250-630d1deeba9e req-9c3d074b-673e-49da-ac5d-390d84361760 service nova] Creating event network-vif-deleted:6707164e-fd29-44d0-8ee4-13e49e171e6e for instance d666a047-b047-4add-9109-e43a4c20ec12 on nch2-master-1 Jan 22 22:25:37.414200 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-373acf83-e916-444b-8250-630d1deeba9e req-9c3d074b-673e-49da-ac5d-390d84361760 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032799 Jan 22 22:25:37.414793 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4640/9574] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:25:37.503591 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-61653c96-1d89-40b4-ba57-c9227d9f5c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:25:37.504222 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-61653c96-1d89-40b4-ba57-c9227d9f5c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:25:37.511174 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61653c96-1d89-40b4-ba57-c9227d9f5c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:37.511653 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61653c96-1d89-40b4-ba57-c9227d9f5c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:37.512457 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61653c96-1d89-40b4-ba57-c9227d9f5c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:37.512916 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-61653c96-1d89-40b4-ba57-c9227d9f5c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:37.576228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-61653c96-1d89-40b4-ba57-c9227d9f5c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:25:37.584521 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-61653c96-1d89-40b4-ba57-c9227d9f5c21 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 200 len: 1505 microversion: 2.1 time: 0.084646 Jan 22 22:25:37.585099 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4935/9575] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:25:37 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 1505 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:25:38.603037 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-87808f9e-22c3-4d89-b3c4-e6773afb45a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:25:38.603739 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-87808f9e-22c3-4d89-b3c4-e6773afb45a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: d666a047-b047-4add-9109-e43a4c20ec12] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:25:38.610010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87808f9e-22c3-4d89-b3c4-e6773afb45a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:38.610465 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87808f9e-22c3-4d89-b3c4-e6773afb45a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:38.611294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87808f9e-22c3-4d89-b3c4-e6773afb45a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:38.611741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-87808f9e-22c3-4d89-b3c4-e6773afb45a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:38.625406 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-87808f9e-22c3-4d89-b3c4-e6773afb45a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] HTTP exception thrown: Instance d666a047-b047-4add-9109-e43a4c20ec12 could not be found. Jan 22 22:25:38.626028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-87808f9e-22c3-4d89-b3c4-e6773afb45a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Returning 404 to user: Instance d666a047-b047-4add-9109-e43a4c20ec12 could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:25:38.626857 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-87808f9e-22c3-4d89-b3c4-e6773afb45a1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12" status: 404 len: 111 microversion: 2.1 time: 0.028984 Jan 22 22:25:38.627394 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4641/9576] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:25:38 2022] GET /compute/v2.1/servers/d666a047-b047-4add-9109-e43a4c20ec12 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:25:42.189122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ea88c94d-a2f6-4504-b66e-5e53f108ef57 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '.version_select at 0x7f1edaf46280>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:25:42.260159 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ea88c94d-a2f6-4504-b66e-5e53f108ef57 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1164177205" status: 202 len: 0 microversion: 2.1 time: 0.074682 Jan 22 22:25:42.260751 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4936/9577] 10.222.0.100 () {58 vars in 1288 bytes} [Sat Jan 22 22:25:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1164177205 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:25:42.291219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ff574868-d535-4ef4-bc14-d236b8b975dd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'create', calling method: .version_select at 0x7f1ed5ab2700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1529915893"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:25:42.305496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-ff574868-d535-4ef4-bc14-d236b8b975dd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:25:42.311296 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-ff574868-d535-4ef4-bc14-d236b8b975dd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for user a9e6a7e25c0f4a9fbd1cc64635c2ed66 and project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:25:42.629047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-ff574868-d535-4ef4-bc14-d236b8b975dd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:25:42.634887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-ff574868-d535-4ef4-bc14-d236b8b975dd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for user a9e6a7e25c0f4a9fbd1cc64635c2ed66 and project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:25:42.649980 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ff574868-d535-4ef4-bc14-d236b8b975dd tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.363097 Jan 22 22:25:42.650522 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4642/9578] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 22:25:42 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:25:51.186258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-694901330", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "networks": [{"uuid": "8e7a4acd-c749-4d87-b0f3-59100dd39a9d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1529915893", "security_groups": [{"name": "tempest-secgroup-smoke-663555266"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:25:51.312697 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] validate_networks() for [('8e7a4acd-c749-4d87-b0f3-59100dd39a9d', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:25:52.099990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:25:52.100510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:25:52.101113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:25:52.102502 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:25:52.103085 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:25:52.112163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:52.112715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:52.113598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:52.114068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:52.131171 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:25:52.136635 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Getting quotas for user a9e6a7e25c0f4a9fbd1cc64635c2ed66 and project a606e10077cc424c94edab0a0e4dd9ff. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:25:52.149587 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:25:52.151958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:25:52.281120 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fdde9420-7588-4843-8135-2c1148fcc712 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.099393 Jan 22 22:25:52.282865 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4937/9579] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:25:51 2022] POST /compute/v2.1/servers => generated 407 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 22 22:25:52.298887 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1804c3ea-8409-4f01-9349-590ee1392636 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:25:52.299496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1804c3ea-8409-4f01-9349-590ee1392636 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:25:52.359905 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1804c3ea-8409-4f01-9349-590ee1392636 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:25:52.367328 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1804c3ea-8409-4f01-9349-590ee1392636 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1270 microversion: 2.1 time: 0.078336 Jan 22 22:25:52.367929 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4643/9580] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:25:52 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1270 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:25:53.385033 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2150bae4-6066-4fc6-9946-21de6c5f7656 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:25:53.385815 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2150bae4-6066-4fc6-9946-21de6c5f7656 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:25:53.392232 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2150bae4-6066-4fc6-9946-21de6c5f7656 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:53.392698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2150bae4-6066-4fc6-9946-21de6c5f7656 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:53.393518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2150bae4-6066-4fc6-9946-21de6c5f7656 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:53.394065 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2150bae4-6066-4fc6-9946-21de6c5f7656 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:53.458304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2150bae4-6066-4fc6-9946-21de6c5f7656 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:25:53.466978 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2150bae4-6066-4fc6-9946-21de6c5f7656 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1274 microversion: 2.1 time: 0.086917 Jan 22 22:25:53.467573 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4938/9581] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:25:53 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:25:54.486309 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1f8d4474-7439-4182-8273-9bc4e98eca8f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:25:54.487422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1f8d4474-7439-4182-8273-9bc4e98eca8f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:25:54.503945 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f8d4474-7439-4182-8273-9bc4e98eca8f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:54.504414 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f8d4474-7439-4182-8273-9bc4e98eca8f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:54.507233 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f8d4474-7439-4182-8273-9bc4e98eca8f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:54.508743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1f8d4474-7439-4182-8273-9bc4e98eca8f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:54.596702 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1f8d4474-7439-4182-8273-9bc4e98eca8f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:25:54.606126 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1f8d4474-7439-4182-8273-9bc4e98eca8f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1330 microversion: 2.1 time: 0.124788 Jan 22 22:25:54.607075 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4644/9582] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:25:54 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1330 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:25:55.625478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-652eaba1-62b3-4eb7-b73a-1f44aad1e4a6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:25:55.626487 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-652eaba1-62b3-4eb7-b73a-1f44aad1e4a6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:25:55.637664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-652eaba1-62b3-4eb7-b73a-1f44aad1e4a6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:55.637664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-652eaba1-62b3-4eb7-b73a-1f44aad1e4a6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:55.637664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-652eaba1-62b3-4eb7-b73a-1f44aad1e4a6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:55.637664 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-652eaba1-62b3-4eb7-b73a-1f44aad1e4a6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:55.775153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-652eaba1-62b3-4eb7-b73a-1f44aad1e4a6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:25:55.782713 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-652eaba1-62b3-4eb7-b73a-1f44aad1e4a6 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1395 microversion: 2.1 time: 0.160985 Jan 22 22:25:55.783294 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4939/9583] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:25:55 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1395 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:25:56.233681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-c3335f85-4e80-4674-8e9c-65bcc0241a41 req-1b7e8fbe-293d-4c89-8e4c-cd1c7609f285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5795b2-f898-4353-a9d2-b804b64bcecb", "tag": "572afd11-3b8f-460d-bdc1-f070d456afd2"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:25:56.235279 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:25:56.235279 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:25:56.243872 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c3335f85-4e80-4674-8e9c-65bcc0241a41 req-1b7e8fbe-293d-4c89-8e4c-cd1c7609f285 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:56.244342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c3335f85-4e80-4674-8e9c-65bcc0241a41 req-1b7e8fbe-293d-4c89-8e4c-cd1c7609f285 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:56.258879 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-c3335f85-4e80-4674-8e9c-65bcc0241a41 req-1b7e8fbe-293d-4c89-8e4c-cd1c7609f285 service nova] Creating event network-changed:572afd11-3b8f-460d-bdc1-f070d456afd2 for instance ad5795b2-f898-4353-a9d2-b804b64bcecb on nch1-master-1 Jan 22 22:25:56.264280 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-c3335f85-4e80-4674-8e9c-65bcc0241a41 req-1b7e8fbe-293d-4c89-8e4c-cd1c7609f285 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034536 Jan 22 22:25:56.265518 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4645/9584] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:25:56.801719 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8cff8818-33b3-449b-9f67-63289ed9ef45 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:25:56.805699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8cff8818-33b3-449b-9f67-63289ed9ef45 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:25:56.809982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8cff8818-33b3-449b-9f67-63289ed9ef45 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:56.810505 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8cff8818-33b3-449b-9f67-63289ed9ef45 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:56.811328 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8cff8818-33b3-449b-9f67-63289ed9ef45 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:56.811793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8cff8818-33b3-449b-9f67-63289ed9ef45 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:56.948163 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8cff8818-33b3-449b-9f67-63289ed9ef45 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:25:56.955700 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8cff8818-33b3-449b-9f67-63289ed9ef45 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1395 microversion: 2.1 time: 0.157786 Jan 22 22:25:56.956276 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4940/9585] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:25:56 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1395 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:25:57.974125 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-450eb669-546d-4952-8ecd-23ca13d36af2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:25:57.974827 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-450eb669-546d-4952-8ecd-23ca13d36af2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:25:57.981714 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-450eb669-546d-4952-8ecd-23ca13d36af2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:57.982177 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-450eb669-546d-4952-8ecd-23ca13d36af2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:57.982969 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-450eb669-546d-4952-8ecd-23ca13d36af2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:57.983422 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-450eb669-546d-4952-8ecd-23ca13d36af2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:58.116710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-450eb669-546d-4952-8ecd-23ca13d36af2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:25:58.124242 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-450eb669-546d-4952-8ecd-23ca13d36af2 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1395 microversion: 2.1 time: 0.155032 Jan 22 22:25:58.124821 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4646/9586] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:25:57 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1395 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:25:59.140802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-21921a09-3a2b-456f-8205-bd1979388e7d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:25:59.141913 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-21921a09-3a2b-456f-8205-bd1979388e7d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:25:59.150063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21921a09-3a2b-456f-8205-bd1979388e7d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:59.150540 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21921a09-3a2b-456f-8205-bd1979388e7d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:59.151361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21921a09-3a2b-456f-8205-bd1979388e7d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:25:59.151825 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-21921a09-3a2b-456f-8205-bd1979388e7d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:25:59.281336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-21921a09-3a2b-456f-8205-bd1979388e7d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:25:59.288997 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-21921a09-3a2b-456f-8205-bd1979388e7d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1395 microversion: 2.1 time: 0.151848 Jan 22 22:25:59.289794 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4941/9587] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:25:59 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1395 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:26:00.305366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-09eeccbc-3e88-46c2-b4a8-9b8098e5543f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:00.306285 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-09eeccbc-3e88-46c2-b4a8-9b8098e5543f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:00.313107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09eeccbc-3e88-46c2-b4a8-9b8098e5543f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:00.313610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09eeccbc-3e88-46c2-b4a8-9b8098e5543f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:00.314413 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09eeccbc-3e88-46c2-b4a8-9b8098e5543f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:00.314865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-09eeccbc-3e88-46c2-b4a8-9b8098e5543f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:00.451870 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-09eeccbc-3e88-46c2-b4a8-9b8098e5543f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:26:00.459461 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-09eeccbc-3e88-46c2-b4a8-9b8098e5543f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1395 microversion: 2.1 time: 0.158034 Jan 22 22:26:00.460034 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4647/9588] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:26:00 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1395 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:26:01.476995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e785616d-df1b-4820-b6ca-df2b3736992d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:01.479437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e785616d-df1b-4820-b6ca-df2b3736992d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:01.479551 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-dd81936d-f25c-4719-b869-1b3072693a4a req-df580635-b223-4032-b6dc-671014497c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5795b2-f898-4353-a9d2-b804b64bcecb", "name": "network-vif-plugged", "status": "completed", "tag": "572afd11-3b8f-460d-bdc1-f070d456afd2"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:26:01.480909 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:26:01.480909 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:26:01.484892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e785616d-df1b-4820-b6ca-df2b3736992d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:01.485371 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e785616d-df1b-4820-b6ca-df2b3736992d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:01.486204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e785616d-df1b-4820-b6ca-df2b3736992d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:01.486684 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e785616d-df1b-4820-b6ca-df2b3736992d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:01.488856 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-dd81936d-f25c-4719-b869-1b3072693a4a req-df580635-b223-4032-b6dc-671014497c4a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:01.489310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-dd81936d-f25c-4719-b869-1b3072693a4a req-df580635-b223-4032-b6dc-671014497c4a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:01.504715 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-dd81936d-f25c-4719-b869-1b3072693a4a req-df580635-b223-4032-b6dc-671014497c4a service nova] Creating event network-vif-plugged:572afd11-3b8f-460d-bdc1-f070d456afd2 for instance ad5795b2-f898-4353-a9d2-b804b64bcecb on nch1-master-1 Jan 22 22:26:01.510584 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-dd81936d-f25c-4719-b869-1b3072693a4a req-df580635-b223-4032-b6dc-671014497c4a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036609 Jan 22 22:26:01.511220 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4648/9589] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:26:01.631029 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e785616d-df1b-4820-b6ca-df2b3736992d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:26:01.640405 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e785616d-df1b-4820-b6ca-df2b3736992d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1395 microversion: 2.1 time: 0.167712 Jan 22 22:26:01.641008 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4942/9590] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:26:01 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1395 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:26:02.657958 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2c0bbd33-72c4-4207-a732-7667d2c03117 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:02.658581 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2c0bbd33-72c4-4207-a732-7667d2c03117 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:02.666425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c0bbd33-72c4-4207-a732-7667d2c03117 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:02.666888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c0bbd33-72c4-4207-a732-7667d2c03117 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:02.667743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c0bbd33-72c4-4207-a732-7667d2c03117 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:02.668268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2c0bbd33-72c4-4207-a732-7667d2c03117 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:02.807058 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2c0bbd33-72c4-4207-a732-7667d2c03117 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:26:02.817198 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2c0bbd33-72c4-4207-a732-7667d2c03117 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1395 microversion: 2.1 time: 0.163379 Jan 22 22:26:02.817821 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4649/9591] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:26:02 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1395 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:26:03.833883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9382def5-bef4-42f3-a3b3-480ea0ab58f9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:03.834504 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9382def5-bef4-42f3-a3b3-480ea0ab58f9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:03.842006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9382def5-bef4-42f3-a3b3-480ea0ab58f9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:03.842472 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9382def5-bef4-42f3-a3b3-480ea0ab58f9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:03.843270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9382def5-bef4-42f3-a3b3-480ea0ab58f9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:03.843724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9382def5-bef4-42f3-a3b3-480ea0ab58f9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:03.978629 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9382def5-bef4-42f3-a3b3-480ea0ab58f9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:26:03.987544 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9382def5-bef4-42f3-a3b3-480ea0ab58f9 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1567 microversion: 2.1 time: 0.157720 Jan 22 22:26:03.988130 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4943/9592] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:26:03 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:26:04.009230 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-1daa8669-d14f-4670-822f-527799a6aeba tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:04.009897 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-1daa8669-d14f-4670-822f-527799a6aeba tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:04.016684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1daa8669-d14f-4670-822f-527799a6aeba tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:04.017142 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1daa8669-d14f-4670-822f-527799a6aeba tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:04.017970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1daa8669-d14f-4670-822f-527799a6aeba tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:04.018418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-1daa8669-d14f-4670-822f-527799a6aeba tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:04.159195 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-1daa8669-d14f-4670-822f-527799a6aeba tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:26:04.168347 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-1daa8669-d14f-4670-822f-527799a6aeba tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1567 microversion: 2.1 time: 0.162758 Jan 22 22:26:04.169091 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4650/9593] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:26:04 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:26:06.171706 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2432f067-d6e1-4010-b291-18bba9c4b4ed tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:06.172426 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2432f067-d6e1-4010-b291-18bba9c4b4ed tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:06.173973 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-9704fbc1-0a32-48a0-a33c-9f426a5bd742 req-1860440b-d468-47db-b290-eb883c6ffbff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5795b2-f898-4353-a9d2-b804b64bcecb", "tag": "572afd11-3b8f-460d-bdc1-f070d456afd2"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:26:06.175520 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:26:06.175520 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:26:06.179900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2432f067-d6e1-4010-b291-18bba9c4b4ed tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:06.181272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2432f067-d6e1-4010-b291-18bba9c4b4ed tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:06.182548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2432f067-d6e1-4010-b291-18bba9c4b4ed tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:06.183067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2432f067-d6e1-4010-b291-18bba9c4b4ed tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:06.184010 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9704fbc1-0a32-48a0-a33c-9f426a5bd742 req-1860440b-d468-47db-b290-eb883c6ffbff service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:06.184473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-9704fbc1-0a32-48a0-a33c-9f426a5bd742 req-1860440b-d468-47db-b290-eb883c6ffbff service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:06.197643 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-9704fbc1-0a32-48a0-a33c-9f426a5bd742 req-1860440b-d468-47db-b290-eb883c6ffbff service nova] Creating event network-changed:572afd11-3b8f-460d-bdc1-f070d456afd2 for instance ad5795b2-f898-4353-a9d2-b804b64bcecb on nch1-master-1 Jan 22 22:26:06.203135 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-9704fbc1-0a32-48a0-a33c-9f426a5bd742 req-1860440b-d468-47db-b290-eb883c6ffbff service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032771 Jan 22 22:26:06.204139 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4651/9594] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:26:06.330605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2432f067-d6e1-4010-b291-18bba9c4b4ed tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:26:06.338569 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2432f067-d6e1-4010-b291-18bba9c4b4ed tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1567 microversion: 2.1 time: 0.170880 Jan 22 22:26:06.339347 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4944/9595] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:26:06 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:26:29.668107 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e037cefb-2cd3-41ef-ae23-a9cdfb46aa30 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:26:29.669056 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e037cefb-2cd3-41ef-ae23-a9cdfb46aa30 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:29.675292 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e037cefb-2cd3-41ef-ae23-a9cdfb46aa30 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:29.676649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e037cefb-2cd3-41ef-ae23-a9cdfb46aa30 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:29.676649 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e037cefb-2cd3-41ef-ae23-a9cdfb46aa30 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:29.677102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e037cefb-2cd3-41ef-ae23-a9cdfb46aa30 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:29.747761 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e037cefb-2cd3-41ef-ae23-a9cdfb46aa30 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb/action" status: 200 len: 24572 microversion: 2.1 time: 0.085006 Jan 22 22:26:29.748779 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4652/9596] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:26:29 2022] POST /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb/action => generated 24572 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:26:40.662963 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ca63d0dc-1c8f-41ac-867d-4ddc9db1de27 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:26:40.663528 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ca63d0dc-1c8f-41ac-867d-4ddc9db1de27 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:40.670031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca63d0dc-1c8f-41ac-867d-4ddc9db1de27 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:40.670508 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca63d0dc-1c8f-41ac-867d-4ddc9db1de27 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:40.671316 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca63d0dc-1c8f-41ac-867d-4ddc9db1de27 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:40.671775 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca63d0dc-1c8f-41ac-867d-4ddc9db1de27 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:40.699780 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.objects.instance [None req-ca63d0dc-1c8f-41ac-867d-4ddc9db1de27 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lazy-loading 'flavor' on Instance uuid ad5795b2-f898-4353-a9d2-b804b64bcecb {{(pid=137032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 22:26:40.967203 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ca63d0dc-1c8f-41ac-867d-4ddc9db1de27 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb/action" status: 202 len: 0 microversion: 2.1 time: 0.308063 Jan 22 22:26:40.967764 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4945/9597] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:26:40 2022] POST /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:26:40.976306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e11a1546-f651-4cf5-bc0a-89242998a98a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:40.977099 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e11a1546-f651-4cf5-bc0a-89242998a98a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:40.984796 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e11a1546-f651-4cf5-bc0a-89242998a98a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:40.985255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e11a1546-f651-4cf5-bc0a-89242998a98a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:40.986072 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e11a1546-f651-4cf5-bc0a-89242998a98a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:40.986515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e11a1546-f651-4cf5-bc0a-89242998a98a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:41.145301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e11a1546-f651-4cf5-bc0a-89242998a98a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:26:41.153575 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e11a1546-f651-4cf5-bc0a-89242998a98a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1693 microversion: 2.1 time: 0.181348 Jan 22 22:26:41.154342 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4653/9598] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:26:40 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1693 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:26:42.173872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0aec5551-8ef9-4f76-be28-97bb14fe3353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:42.174492 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0aec5551-8ef9-4f76-be28-97bb14fe3353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:42.180694 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0aec5551-8ef9-4f76-be28-97bb14fe3353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:42.181847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0aec5551-8ef9-4f76-be28-97bb14fe3353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:42.182738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0aec5551-8ef9-4f76-be28-97bb14fe3353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:42.183192 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0aec5551-8ef9-4f76-be28-97bb14fe3353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:42.316216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0aec5551-8ef9-4f76-be28-97bb14fe3353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:26:42.324418 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0aec5551-8ef9-4f76-be28-97bb14fe3353 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1676 microversion: 2.1 time: 0.155724 Jan 22 22:26:42.324992 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4946/9599] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:26:42 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:26:43.417994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-643fdbad-be01-44bb-a632-76c577c6f8c5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:26:43.418916 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-643fdbad-be01-44bb-a632-76c577c6f8c5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:43.426436 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-643fdbad-be01-44bb-a632-76c577c6f8c5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:43.426890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-643fdbad-be01-44bb-a632-76c577c6f8c5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:43.427678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-643fdbad-be01-44bb-a632-76c577c6f8c5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:43.428117 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-643fdbad-be01-44bb-a632-76c577c6f8c5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:43.497463 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-643fdbad-be01-44bb-a632-76c577c6f8c5 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb/action" status: 200 len: 37191 microversion: 2.1 time: 0.083462 Jan 22 22:26:43.498175 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4654/9600] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:26:43 2022] POST /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb/action => generated 37191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:26:43.509200 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-cc2534bf-fd52-480e-b085-0f1bdfb56c9e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:26:43.509804 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-cc2534bf-fd52-480e-b085-0f1bdfb56c9e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:43.516582 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc2534bf-fd52-480e-b085-0f1bdfb56c9e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:43.517051 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc2534bf-fd52-480e-b085-0f1bdfb56c9e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:43.517872 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc2534bf-fd52-480e-b085-0f1bdfb56c9e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:43.518331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-cc2534bf-fd52-480e-b085-0f1bdfb56c9e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:43.718138 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-cc2534bf-fd52-480e-b085-0f1bdfb56c9e tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb/action" status: 202 len: 0 microversion: 2.1 time: 0.212331 Jan 22 22:26:43.718721 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4947/9601] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:26:43 2022] POST /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 22 22:26:43.727669 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6e9980f7-54fa-4d3f-9021-a061975def14 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:43.728375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6e9980f7-54fa-4d3f-9021-a061975def14 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:43.735693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e9980f7-54fa-4d3f-9021-a061975def14 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:43.736151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e9980f7-54fa-4d3f-9021-a061975def14 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:43.736948 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e9980f7-54fa-4d3f-9021-a061975def14 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:43.737392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e9980f7-54fa-4d3f-9021-a061975def14 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:43.875203 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6e9980f7-54fa-4d3f-9021-a061975def14 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:26:43.882688 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6e9980f7-54fa-4d3f-9021-a061975def14 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1682 microversion: 2.1 time: 0.159126 Jan 22 22:26:43.883270 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4655/9602] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:26:43 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:26:44.901481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c2ba726d-746f-448d-af50-4f53aa2a53dc tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:44.902831 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c2ba726d-746f-448d-af50-4f53aa2a53dc tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:44.909079 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2ba726d-746f-448d-af50-4f53aa2a53dc tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:44.909579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2ba726d-746f-448d-af50-4f53aa2a53dc tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:44.910388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2ba726d-746f-448d-af50-4f53aa2a53dc tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:44.910848 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c2ba726d-746f-448d-af50-4f53aa2a53dc tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:45.046187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c2ba726d-746f-448d-af50-4f53aa2a53dc tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:26:45.053630 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c2ba726d-746f-448d-af50-4f53aa2a53dc tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1682 microversion: 2.1 time: 0.157069 Jan 22 22:26:45.054201 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4948/9603] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:26:44 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:26:46.071306 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11c048c2-db21-4ed8-82cb-06ac9999718f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:46.071914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-11c048c2-db21-4ed8-82cb-06ac9999718f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:46.079149 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c048c2-db21-4ed8-82cb-06ac9999718f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:46.084698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c048c2-db21-4ed8-82cb-06ac9999718f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:46.084698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c048c2-db21-4ed8-82cb-06ac9999718f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:46.084698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11c048c2-db21-4ed8-82cb-06ac9999718f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:46.220102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-11c048c2-db21-4ed8-82cb-06ac9999718f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:26:46.227554 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-11c048c2-db21-4ed8-82cb-06ac9999718f tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1685 microversion: 2.1 time: 0.159979 Jan 22 22:26:46.228129 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4656/9604] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:26:46 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:26:46.329036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c26ad561-815d-4255-8920-6983c2f198f1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:26:46.330094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c26ad561-815d-4255-8920-6983c2f198f1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:46.337139 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c26ad561-815d-4255-8920-6983c2f198f1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:46.337641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c26ad561-815d-4255-8920-6983c2f198f1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:46.338443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c26ad561-815d-4255-8920-6983c2f198f1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:46.338929 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c26ad561-815d-4255-8920-6983c2f198f1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:46.381854 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c26ad561-815d-4255-8920-6983c2f198f1 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "POST /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb/action" status: 200 len: 37191 microversion: 2.1 time: 0.056937 Jan 22 22:26:46.382758 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4949/9605] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:26:46 2022] POST /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb/action => generated 37191 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:26:47.477204 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3aee6716-81dc-4d59-bc24-f9af3d57065d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:47.484012 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-2c5d08b3-4372-480b-84a4-9c41bd623d43 req-4443ce79-f54f-4aae-ba1e-7b126d5ea931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5795b2-f898-4353-a9d2-b804b64bcecb", "tag": "572afd11-3b8f-460d-bdc1-f070d456afd2"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:26:47.484711 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3aee6716-81dc-4d59-bc24-f9af3d57065d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:47.489206 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:26:47.489206 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:26:47.492469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3aee6716-81dc-4d59-bc24-f9af3d57065d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:47.492469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3aee6716-81dc-4d59-bc24-f9af3d57065d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:47.493004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3aee6716-81dc-4d59-bc24-f9af3d57065d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:47.493595 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3aee6716-81dc-4d59-bc24-f9af3d57065d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:47.498258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2c5d08b3-4372-480b-84a4-9c41bd623d43 req-4443ce79-f54f-4aae-ba1e-7b126d5ea931 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:47.498732 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2c5d08b3-4372-480b-84a4-9c41bd623d43 req-4443ce79-f54f-4aae-ba1e-7b126d5ea931 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:47.510262 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-2c5d08b3-4372-480b-84a4-9c41bd623d43 req-4443ce79-f54f-4aae-ba1e-7b126d5ea931 service nova] Creating event network-changed:572afd11-3b8f-460d-bdc1-f070d456afd2 for instance ad5795b2-f898-4353-a9d2-b804b64bcecb on nch1-master-1 Jan 22 22:26:47.516109 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-2c5d08b3-4372-480b-84a4-9c41bd623d43 req-4443ce79-f54f-4aae-ba1e-7b126d5ea931 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036915 Jan 22 22:26:47.517099 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4950/9606] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:26:47.521784 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3aee6716-81dc-4d59-bc24-f9af3d57065d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:26:47.812745 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3aee6716-81dc-4d59-bc24-f9af3d57065d tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "DELETE /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 204 len: 0 microversion: 2.1 time: 0.339024 Jan 22 22:26:47.813848 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4657/9607] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:26:47 2022] DELETE /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:26:47.823143 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-81b74a93-d43d-498e-8be1-3f5c412716e7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:47.829375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-81b74a93-d43d-498e-8be1-3f5c412716e7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:47.832698 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81b74a93-d43d-498e-8be1-3f5c412716e7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:47.833244 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81b74a93-d43d-498e-8be1-3f5c412716e7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:47.834304 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81b74a93-d43d-498e-8be1-3f5c412716e7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:47.834934 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-81b74a93-d43d-498e-8be1-3f5c412716e7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:47.992867 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-81b74a93-d43d-498e-8be1-3f5c412716e7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:26:48.000977 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-81b74a93-d43d-498e-8be1-3f5c412716e7 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1691 microversion: 2.1 time: 0.182721 Jan 22 22:26:48.001603 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4951/9608] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:26:47 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:26:49.019748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b0594abb-c388-4416-ba50-78478f6dee9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:49.020481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b0594abb-c388-4416-ba50-78478f6dee9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:49.027278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0594abb-c388-4416-ba50-78478f6dee9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:49.028566 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0594abb-c388-4416-ba50-78478f6dee9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:49.029384 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0594abb-c388-4416-ba50-78478f6dee9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:49.029860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b0594abb-c388-4416-ba50-78478f6dee9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:49.163423 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b0594abb-c388-4416-ba50-78478f6dee9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:26:49.170956 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b0594abb-c388-4416-ba50-78478f6dee9a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1573 microversion: 2.1 time: 0.155357 Jan 22 22:26:49.171562 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4658/9609] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:26:49 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:26:50.187888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bbef4bcb-471d-4f16-adce-38a7c9211bda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:50.188555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bbef4bcb-471d-4f16-adce-38a7c9211bda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:50.195095 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbef4bcb-471d-4f16-adce-38a7c9211bda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:50.195571 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbef4bcb-471d-4f16-adce-38a7c9211bda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:50.196390 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbef4bcb-471d-4f16-adce-38a7c9211bda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:50.196853 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bbef4bcb-471d-4f16-adce-38a7c9211bda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:50.218360 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-29a7f61d-3794-4915-928b-71637f1b911c req-06c37875-5ec3-4a2f-8e75-08a9fb24e791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5795b2-f898-4353-a9d2-b804b64bcecb", "name": "network-vif-deleted", "tag": "572afd11-3b8f-460d-bdc1-f070d456afd2"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:26:50.220596 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:26:50.220596 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:26:50.227733 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-29a7f61d-3794-4915-928b-71637f1b911c req-06c37875-5ec3-4a2f-8e75-08a9fb24e791 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:50.228271 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-29a7f61d-3794-4915-928b-71637f1b911c req-06c37875-5ec3-4a2f-8e75-08a9fb24e791 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:50.241723 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-29a7f61d-3794-4915-928b-71637f1b911c req-06c37875-5ec3-4a2f-8e75-08a9fb24e791 service nova] Creating event network-vif-deleted:572afd11-3b8f-460d-bdc1-f070d456afd2 for instance ad5795b2-f898-4353-a9d2-b804b64bcecb on nch1-master-1 Jan 22 22:26:50.247450 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-29a7f61d-3794-4915-928b-71637f1b911c req-06c37875-5ec3-4a2f-8e75-08a9fb24e791 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033493 Jan 22 22:26:50.248167 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4659/9610] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:26:50.264155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-bbef4bcb-471d-4f16-adce-38a7c9211bda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e6a7e25c0f4a9fbd1cc64635c2ed66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a606e10077cc424c94edab0a0e4dd9ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:26:50.269671 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bbef4bcb-471d-4f16-adce-38a7c9211bda tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 200 len: 1506 microversion: 2.1 time: 0.085733 Jan 22 22:26:50.270254 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4952/9611] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:26:50 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 1506 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:26:51.288768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2719dce5-fd7c-4da0-914c-fb86451e065a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:51.289496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2719dce5-fd7c-4da0-914c-fb86451e065a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] [instance: ad5795b2-f898-4353-a9d2-b804b64bcecb] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:26:51.295984 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2719dce5-fd7c-4da0-914c-fb86451e065a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:51.296451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2719dce5-fd7c-4da0-914c-fb86451e065a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:51.297253 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2719dce5-fd7c-4da0-914c-fb86451e065a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:26:51.297734 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2719dce5-fd7c-4da0-914c-fb86451e065a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:26:51.310980 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-2719dce5-fd7c-4da0-914c-fb86451e065a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] HTTP exception thrown: Instance ad5795b2-f898-4353-a9d2-b804b64bcecb could not be found. Jan 22 22:26:51.311580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2719dce5-fd7c-4da0-914c-fb86451e065a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Returning 404 to user: Instance ad5795b2-f898-4353-a9d2-b804b64bcecb could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:26:51.312418 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2719dce5-fd7c-4da0-914c-fb86451e065a tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb" status: 404 len: 111 microversion: 2.1 time: 0.028694 Jan 22 22:26:51.312963 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4660/9612] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:26:51 2022] GET /compute/v2.1/servers/ad5795b2-f898-4353-a9d2-b804b64bcecb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:26:54.976510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0bbc50a0-6bce-4a64-9bdb-01af9e702d63 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] Calling method '.version_select at 0x7f1ed5d4aaf0>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:26:55.061617 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0bbc50a0-6bce-4a64-9bdb-01af9e702d63 tempest-TestNetworkAdvancedServerOps-1172575969 tempest-TestNetworkAdvancedServerOps-1172575969-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1529915893" status: 202 len: 0 microversion: 2.1 time: 0.088720 Jan 22 22:26:55.062218 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4953/9613] 10.222.0.100 () {58 vars in 1288 bytes} [Sat Jan 22 22:26:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1529915893 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:27:10.400389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-0f20f274-4c85-40ef-9462-20d9abb97858 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Action: 'create', calling method: .version_select at 0x7f1ed510f0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1638098758"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:27:10.415219 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0f20f274-4c85-40ef-9462-20d9abb97858 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Getting quotas for project bfe266ea1db64cb8ad21a3f40b9f0cf3. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:27:10.421335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0f20f274-4c85-40ef-9462-20d9abb97858 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Getting quotas for user e377dada2c4e44ed9749fd92ec9d29ae and project bfe266ea1db64cb8ad21a3f40b9f0cf3. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:27:10.756432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0f20f274-4c85-40ef-9462-20d9abb97858 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Getting quotas for project bfe266ea1db64cb8ad21a3f40b9f0cf3. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:27:10.762349 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-0f20f274-4c85-40ef-9462-20d9abb97858 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Getting quotas for user e377dada2c4e44ed9749fd92ec9d29ae and project bfe266ea1db64cb8ad21a3f40b9f0cf3. Resources: {'key_pairs'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:27:10.777475 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-0f20f274-4c85-40ef-9462-20d9abb97858 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.561522 Jan 22 22:27:10.778270 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4661/9614] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 22:27:10 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:13.689526 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-703110533", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1638098758", "security_groups": [{"name": "tempest-secgroup-smoke-1959820787"}], "networks": [{"uuid": "0a2a203b-1825-47db-92ae-2a2b610a7c3e"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:27:13.800216 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] validate_networks() for [('0a2a203b-1825-47db-92ae-2a2b610a7c3e', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:27:14.230999 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:27:14.231520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:27:14.232066 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:27:14.232499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:27:14.232936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:27:14.243046 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:14.243518 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:14.244357 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:14.244816 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:14.264792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Getting quotas for project bfe266ea1db64cb8ad21a3f40b9f0cf3. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:27:14.270187 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Getting quotas for user e377dada2c4e44ed9749fd92ec9d29ae and project bfe266ea1db64cb8ad21a3f40b9f0cf3. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:27:14.283682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:27:14.286127 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:27:14.413065 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e54bf6d1-4a3e-4d09-998b-71838a0c4b2d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.728178 Jan 22 22:27:14.413771 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4954/9615] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:27:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 22:27:14.423763 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-358c928b-f157-4228-94ef-4f13c2b2b99f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:14.424409 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-358c928b-f157-4228-94ef-4f13c2b2b99f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:14.573047 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-358c928b-f157-4228-94ef-4f13c2b2b99f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:14.580043 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-358c928b-f157-4228-94ef-4f13c2b2b99f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1250 microversion: 2.1 time: 0.160326 Jan 22 22:27:14.580886 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4662/9616] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:14 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1250 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:15.597927 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e1a706f1-7f62-409b-b0c9-9860d94e6a69 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:15.598555 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e1a706f1-7f62-409b-b0c9-9860d94e6a69 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:15.651412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e1a706f1-7f62-409b-b0c9-9860d94e6a69 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:15.659230 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e1a706f1-7f62-409b-b0c9-9860d94e6a69 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1250 microversion: 2.1 time: 0.065855 Jan 22 22:27:15.669853 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4955/9617] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:15 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1250 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:16.676151 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8291b785-3362-4157-b6b2-a5e4690027dd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:16.676764 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8291b785-3362-4157-b6b2-a5e4690027dd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:16.729366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8291b785-3362-4157-b6b2-a5e4690027dd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:16.738733 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8291b785-3362-4157-b6b2-a5e4690027dd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1250 microversion: 2.1 time: 0.066209 Jan 22 22:27:16.739314 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4663/9618] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:16 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1250 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:17.755287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f53dd8e1-8345-495a-b57e-cc738287eb10 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:17.755843 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f53dd8e1-8345-495a-b57e-cc738287eb10 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:17.807620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f53dd8e1-8345-495a-b57e-cc738287eb10 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:17.814345 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f53dd8e1-8345-495a-b57e-cc738287eb10 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1250 microversion: 2.1 time: 0.062920 Jan 22 22:27:17.814924 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4956/9619] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:17 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1250 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:18.831768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-aefdae84-b8bc-483c-8ed0-5984afc79cc1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:18.832378 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-aefdae84-b8bc-483c-8ed0-5984afc79cc1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:18.839405 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aefdae84-b8bc-483c-8ed0-5984afc79cc1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:18.840367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aefdae84-b8bc-483c-8ed0-5984afc79cc1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:18.841421 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aefdae84-b8bc-483c-8ed0-5984afc79cc1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:18.841890 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-aefdae84-b8bc-483c-8ed0-5984afc79cc1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:18.901769 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-aefdae84-b8bc-483c-8ed0-5984afc79cc1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:18.909896 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-aefdae84-b8bc-483c-8ed0-5984afc79cc1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1254 microversion: 2.1 time: 0.082137 Jan 22 22:27:18.910473 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4664/9620] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:18 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1254 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:19.927699 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-9f620e3c-52b0-4dfd-9c1e-51f1bf00a1af tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:19.928326 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-9f620e3c-52b0-4dfd-9c1e-51f1bf00a1af tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:19.935974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f620e3c-52b0-4dfd-9c1e-51f1bf00a1af tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:19.936440 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f620e3c-52b0-4dfd-9c1e-51f1bf00a1af tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:19.937294 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f620e3c-52b0-4dfd-9c1e-51f1bf00a1af tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:19.937792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-9f620e3c-52b0-4dfd-9c1e-51f1bf00a1af tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:20.002720 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-9f620e3c-52b0-4dfd-9c1e-51f1bf00a1af tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:20.010151 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-9f620e3c-52b0-4dfd-9c1e-51f1bf00a1af tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1302 microversion: 2.1 time: 0.086514 Jan 22 22:27:20.010722 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4957/9621] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:19 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1302 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:21.027418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-43f69f3e-8aed-4a5b-83d3-998d8541d534 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:21.028159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-43f69f3e-8aed-4a5b-83d3-998d8541d534 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:21.035033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43f69f3e-8aed-4a5b-83d3-998d8541d534 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:21.035473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43f69f3e-8aed-4a5b-83d3-998d8541d534 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:21.036268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43f69f3e-8aed-4a5b-83d3-998d8541d534 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:21.036744 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-43f69f3e-8aed-4a5b-83d3-998d8541d534 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:21.182752 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-43f69f3e-8aed-4a5b-83d3-998d8541d534 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:21.191744 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-43f69f3e-8aed-4a5b-83d3-998d8541d534 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1376 microversion: 2.1 time: 0.168093 Jan 22 22:27:21.192375 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4665/9622] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:21 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:22.109483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-37db4622-71eb-4ee9-9271-efa0787d7922 req-96b7617b-6442-48ba-9606-b7a147b12db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d05c4a9c-c495-412f-a483-aa343463792a", "tag": "d99ad49d-1710-4642-9128-1a3e38043d9b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:27:22.112193 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:27:22.112193 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:27:22.120463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-37db4622-71eb-4ee9-9271-efa0787d7922 req-96b7617b-6442-48ba-9606-b7a147b12db8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:22.122190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-37db4622-71eb-4ee9-9271-efa0787d7922 req-96b7617b-6442-48ba-9606-b7a147b12db8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:22.134078 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-37db4622-71eb-4ee9-9271-efa0787d7922 req-96b7617b-6442-48ba-9606-b7a147b12db8 service nova] Creating event network-changed:d99ad49d-1710-4642-9128-1a3e38043d9b for instance d05c4a9c-c495-412f-a483-aa343463792a on nch2-master-1 Jan 22 22:27:22.140057 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-37db4622-71eb-4ee9-9271-efa0787d7922 req-96b7617b-6442-48ba-9606-b7a147b12db8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035369 Jan 22 22:27:22.140672 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4958/9623] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:27:22.211513 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-178856ba-dcf2-4869-bc1b-17a9cd610df8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:22.211994 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-178856ba-dcf2-4869-bc1b-17a9cd610df8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:22.219503 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178856ba-dcf2-4869-bc1b-17a9cd610df8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:22.220116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178856ba-dcf2-4869-bc1b-17a9cd610df8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:22.221041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178856ba-dcf2-4869-bc1b-17a9cd610df8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:22.221633 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-178856ba-dcf2-4869-bc1b-17a9cd610df8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:22.366024 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-178856ba-dcf2-4869-bc1b-17a9cd610df8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:22.374238 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-178856ba-dcf2-4869-bc1b-17a9cd610df8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1376 microversion: 2.1 time: 0.166667 Jan 22 22:27:22.393590 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4666/9624] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:22 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1376 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:23.393331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-74c1e925-a6bf-4d66-b9c0-acf07c9c64ef tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:23.394076 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-74c1e925-a6bf-4d66-b9c0-acf07c9c64ef tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:23.400324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74c1e925-a6bf-4d66-b9c0-acf07c9c64ef tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:23.400794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74c1e925-a6bf-4d66-b9c0-acf07c9c64ef tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:23.401619 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74c1e925-a6bf-4d66-b9c0-acf07c9c64ef tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:23.402612 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-74c1e925-a6bf-4d66-b9c0-acf07c9c64ef tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:23.544155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-74c1e925-a6bf-4d66-b9c0-acf07c9c64ef tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:23.551777 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-74c1e925-a6bf-4d66-b9c0-acf07c9c64ef tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1376 microversion: 2.1 time: 0.163514 Jan 22 22:27:23.552355 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4959/9625] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:23 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1376 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:24.568644 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c085fe70-1e4e-4a91-b667-89f1a368190e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:24.569258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c085fe70-1e4e-4a91-b667-89f1a368190e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:24.576822 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c085fe70-1e4e-4a91-b667-89f1a368190e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:24.577281 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c085fe70-1e4e-4a91-b667-89f1a368190e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:24.578105 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c085fe70-1e4e-4a91-b667-89f1a368190e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:24.578548 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c085fe70-1e4e-4a91-b667-89f1a368190e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:24.712126 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c085fe70-1e4e-4a91-b667-89f1a368190e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:24.719824 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c085fe70-1e4e-4a91-b667-89f1a368190e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1376 microversion: 2.1 time: 0.154887 Jan 22 22:27:24.720519 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4667/9626] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:24 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1376 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:25.736847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-499f356f-af55-4fef-bc12-16baef8cbe75 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:25.737419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-499f356f-af55-4fef-bc12-16baef8cbe75 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:25.744250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-499f356f-af55-4fef-bc12-16baef8cbe75 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:25.744716 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-499f356f-af55-4fef-bc12-16baef8cbe75 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:25.745524 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-499f356f-af55-4fef-bc12-16baef8cbe75 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:25.745984 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-499f356f-af55-4fef-bc12-16baef8cbe75 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:25.879836 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-499f356f-af55-4fef-bc12-16baef8cbe75 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:25.887799 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-499f356f-af55-4fef-bc12-16baef8cbe75 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1376 microversion: 2.1 time: 0.154363 Jan 22 22:27:25.888370 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4960/9627] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:25 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1376 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:26.905278 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b325866d-f240-4aed-b6e0-c1f739346205 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:26.906062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b325866d-f240-4aed-b6e0-c1f739346205 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:26.913111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b325866d-f240-4aed-b6e0-c1f739346205 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:26.913684 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b325866d-f240-4aed-b6e0-c1f739346205 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:26.914486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b325866d-f240-4aed-b6e0-c1f739346205 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:26.914935 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b325866d-f240-4aed-b6e0-c1f739346205 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:27.054335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b325866d-f240-4aed-b6e0-c1f739346205 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:27.063309 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b325866d-f240-4aed-b6e0-c1f739346205 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1376 microversion: 2.1 time: 0.162830 Jan 22 22:27:27.063893 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4668/9628] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:26 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1376 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:28.081417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4c3c1a9c-2b76-41d1-8c53-51ef438b3ab0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:28.082073 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-4c3c1a9c-2b76-41d1-8c53-51ef438b3ab0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:28.088954 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c3c1a9c-2b76-41d1-8c53-51ef438b3ab0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:28.089424 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c3c1a9c-2b76-41d1-8c53-51ef438b3ab0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:28.090919 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c3c1a9c-2b76-41d1-8c53-51ef438b3ab0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:28.091597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-4c3c1a9c-2b76-41d1-8c53-51ef438b3ab0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:28.237000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-4c3c1a9c-2b76-41d1-8c53-51ef438b3ab0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:28.244406 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4c3c1a9c-2b76-41d1-8c53-51ef438b3ab0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1376 microversion: 2.1 time: 0.166984 Jan 22 22:27:28.245002 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4961/9629] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:28 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1376 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:29.082630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-5c07232b-d29f-4415-adbe-4f903914553b req-1dd5b4af-96af-4008-9484-60ccb3663017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05c4a9c-c495-412f-a483-aa343463792a", "name": "network-vif-plugged", "status": "completed", "tag": "d99ad49d-1710-4642-9128-1a3e38043d9b"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:27:29.084134 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:27:29.084134 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:27:29.092400 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5c07232b-d29f-4415-adbe-4f903914553b req-1dd5b4af-96af-4008-9484-60ccb3663017 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:29.092883 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-5c07232b-d29f-4415-adbe-4f903914553b req-1dd5b4af-96af-4008-9484-60ccb3663017 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:29.103627 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-5c07232b-d29f-4415-adbe-4f903914553b req-1dd5b4af-96af-4008-9484-60ccb3663017 service nova] Creating event network-vif-plugged:d99ad49d-1710-4642-9128-1a3e38043d9b for instance d05c4a9c-c495-412f-a483-aa343463792a on nch2-master-1 Jan 22 22:27:29.108976 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-5c07232b-d29f-4415-adbe-4f903914553b req-1dd5b4af-96af-4008-9484-60ccb3663017 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083041 Jan 22 22:27:29.109637 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4669/9630] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:27:29.260616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-af37145b-3ed4-4173-80ab-846a06123b02 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:29.261253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-af37145b-3ed4-4173-80ab-846a06123b02 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:29.268264 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af37145b-3ed4-4173-80ab-846a06123b02 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:29.268741 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af37145b-3ed4-4173-80ab-846a06123b02 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:29.269572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af37145b-3ed4-4173-80ab-846a06123b02 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:29.270037 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-af37145b-3ed4-4173-80ab-846a06123b02 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:29.401570 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-af37145b-3ed4-4173-80ab-846a06123b02 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:29.409393 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-af37145b-3ed4-4173-80ab-846a06123b02 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1376 microversion: 2.1 time: 0.152601 Jan 22 22:27:29.410006 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4962/9631] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:29 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1376 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:30.428111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-48b4c1e8-464f-40d5-bb81-7ac2dd3027ea tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:30.428808 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-48b4c1e8-464f-40d5-bb81-7ac2dd3027ea tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:30.435043 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48b4c1e8-464f-40d5-bb81-7ac2dd3027ea tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:30.435496 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48b4c1e8-464f-40d5-bb81-7ac2dd3027ea tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:30.436286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48b4c1e8-464f-40d5-bb81-7ac2dd3027ea tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:30.436723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-48b4c1e8-464f-40d5-bb81-7ac2dd3027ea tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:30.570567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-48b4c1e8-464f-40d5-bb81-7ac2dd3027ea tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:30.578626 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-48b4c1e8-464f-40d5-bb81-7ac2dd3027ea tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1376 microversion: 2.1 time: 0.155406 Jan 22 22:27:30.579183 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4670/9632] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:30 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:31.595967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5ce9cae1-0cc2-4897-9cf2-2b135b62f1b5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:31.596597 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5ce9cae1-0cc2-4897-9cf2-2b135b62f1b5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:31.603461 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ce9cae1-0cc2-4897-9cf2-2b135b62f1b5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:31.603931 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ce9cae1-0cc2-4897-9cf2-2b135b62f1b5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:31.604729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ce9cae1-0cc2-4897-9cf2-2b135b62f1b5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:31.605188 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5ce9cae1-0cc2-4897-9cf2-2b135b62f1b5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:31.745862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5ce9cae1-0cc2-4897-9cf2-2b135b62f1b5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:31.754739 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5ce9cae1-0cc2-4897-9cf2-2b135b62f1b5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1559 microversion: 2.1 time: 0.162435 Jan 22 22:27:31.755328 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4963/9633] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:31 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:31.776805 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4ea7c2ba-1090-4a91-bc7b-c117f4a5d8f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:27:31.777415 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4ea7c2ba-1090-4a91-bc7b-c117f4a5d8f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:27:31.784079 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ea7c2ba-1090-4a91-bc7b-c117f4a5d8f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:31.784526 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ea7c2ba-1090-4a91-bc7b-c117f4a5d8f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:31.785305 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ea7c2ba-1090-4a91-bc7b-c117f4a5d8f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:31.785775 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4ea7c2ba-1090-4a91-bc7b-c117f4a5d8f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:31.919194 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4ea7c2ba-1090-4a91-bc7b-c117f4a5d8f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:27:31.927005 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4ea7c2ba-1090-4a91-bc7b-c117f4a5d8f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1559 microversion: 2.1 time: 0.153847 Jan 22 22:27:31.927562 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4671/9634] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:27:31 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:27:33.946204 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-d40e25e5-8a65-402a-b5a5-3087e2b01c6b req-4a1d4d6c-b9a6-4f1c-9623-7eff43e4c18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d05c4a9c-c495-412f-a483-aa343463792a", "tag": "d99ad49d-1710-4642-9128-1a3e38043d9b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:27:33.948561 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:27:33.948561 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:27:33.957712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d40e25e5-8a65-402a-b5a5-3087e2b01c6b req-4a1d4d6c-b9a6-4f1c-9623-7eff43e4c18b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:27:33.958183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-d40e25e5-8a65-402a-b5a5-3087e2b01c6b req-4a1d4d6c-b9a6-4f1c-9623-7eff43e4c18b service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:27:33.969757 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-d40e25e5-8a65-402a-b5a5-3087e2b01c6b req-4a1d4d6c-b9a6-4f1c-9623-7eff43e4c18b service nova] Creating event network-changed:d99ad49d-1710-4642-9128-1a3e38043d9b for instance d05c4a9c-c495-412f-a483-aa343463792a on nch2-master-1 Jan 22 22:27:33.975386 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-d40e25e5-8a65-402a-b5a5-3087e2b01c6b req-4a1d4d6c-b9a6-4f1c-9623-7eff43e4c18b service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032920 Jan 22 22:27:33.976456 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4964/9635] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:28:13.991997 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:28:13.992517 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:28:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:29:54.724336 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:29:54.724908 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:29:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:29:55.052282 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:29:55.052498 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:29:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:29:59.863936 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5c65b53b-7dc4-496f-937e-a7dc1df2041e] AMQP server on 10.222.0.100:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 22 22:29:59.864913 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [-] [913664d8-58d1-4bc9-a0cb-33264365d7dc] AMQP server on 10.222.0.100:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 22 22:29:59.868681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6e69cc3d-5dda-445c-b342-70a8c7dbca6a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:29:59.869218 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6e69cc3d-5dda-445c-b342-70a8c7dbca6a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:29:59.875251 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e69cc3d-5dda-445c-b342-70a8c7dbca6a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:29:59.875703 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e69cc3d-5dda-445c-b342-70a8c7dbca6a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:29:59.876491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e69cc3d-5dda-445c-b342-70a8c7dbca6a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:29:59.876938 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6e69cc3d-5dda-445c-b342-70a8c7dbca6a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:29:59.900533 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-6e69cc3d-5dda-445c-b342-70a8c7dbca6a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lazy-loading 'flavor' on Instance uuid d05c4a9c-c495-412f-a483-aa343463792a {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 22:30:00.394440 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6e69cc3d-5dda-445c-b342-70a8c7dbca6a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [f962eaa4-b2c4-4269-b24d-bd2b807893d1] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 22:30:00.874209 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] [5c65b53b-7dc4-496f-937e-a7dc1df2041e] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 34138. Jan 22 22:30:00.878602 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] [913664d8-58d1-4bc9-a0cb-33264365d7dc] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 34140. Jan 22 22:30:01.401304 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [None req-6e69cc3d-5dda-445c-b342-70a8c7dbca6a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [f962eaa4-b2c4-4269-b24d-bd2b807893d1] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 34142. Jan 22 22:30:01.404867 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6e69cc3d-5dda-445c-b342-70a8c7dbca6a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "POST /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a/action" status: 202 len: 0 microversion: 2.1 time: 1.542751 Jan 22 22:30:01.405528 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4672/9636] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:29:59 2022] POST /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a/action => generated 0 bytes in 1544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:30:01.414829 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edc45ac6-e555-423c-baf2-d131dfc2b608] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 22:30:01.415658 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7ed686d-6f24-47e8-978c-4287ce754ef2] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 22:30:01.420236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8d764b2b-5062-4381-83c0-b1901f4d0da5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:01.420983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8d764b2b-5062-4381-83c0-b1901f4d0da5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:01.428633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d764b2b-5062-4381-83c0-b1901f4d0da5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:01.429092 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d764b2b-5062-4381-83c0-b1901f4d0da5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:01.429942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d764b2b-5062-4381-83c0-b1901f4d0da5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:01.430398 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8d764b2b-5062-4381-83c0-b1901f4d0da5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:01.682565 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8d764b2b-5062-4381-83c0-b1901f4d0da5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:01.690618 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8d764b2b-5062-4381-83c0-b1901f4d0da5 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1684 microversion: 2.1 time: 0.277533 Jan 22 22:30:01.691190 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4965/9637] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:01 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1684 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:02.710495 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-79ed6f7b-b30f-4d07-8d98-8e5471420771 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:02.711112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-79ed6f7b-b30f-4d07-8d98-8e5471420771 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:02.720451 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79ed6f7b-b30f-4d07-8d98-8e5471420771 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:02.720911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79ed6f7b-b30f-4d07-8d98-8e5471420771 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:02.721748 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79ed6f7b-b30f-4d07-8d98-8e5471420771 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:02.722427 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-79ed6f7b-b30f-4d07-8d98-8e5471420771 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:02.855457 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-79ed6f7b-b30f-4d07-8d98-8e5471420771 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:02.863061 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-79ed6f7b-b30f-4d07-8d98-8e5471420771 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1684 microversion: 2.1 time: 0.157807 Jan 22 22:30:02.863630 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4673/9638] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:02 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:03.880015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-44291452-29fa-40e5-b30e-bac1f010e865 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:03.880937 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-44291452-29fa-40e5-b30e-bac1f010e865 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:03.893249 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44291452-29fa-40e5-b30e-bac1f010e865 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:03.893742 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44291452-29fa-40e5-b30e-bac1f010e865 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:03.894543 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44291452-29fa-40e5-b30e-bac1f010e865 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:03.894996 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-44291452-29fa-40e5-b30e-bac1f010e865 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:03.901229 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] [edc45ac6-e555-423c-baf2-d131dfc2b608] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 34156. Jan 22 22:30:03.903305 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7ed686d-6f24-47e8-978c-4287ce754ef2] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 34158. Jan 22 22:30:04.033794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-44291452-29fa-40e5-b30e-bac1f010e865 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:04.043933 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-44291452-29fa-40e5-b30e-bac1f010e865 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1684 microversion: 2.1 time: 0.167706 Jan 22 22:30:04.044517 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4966/9639] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:03 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:05.061799 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3981fac7-bbeb-4891-86a3-20ed11d8f53d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:05.062424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3981fac7-bbeb-4891-86a3-20ed11d8f53d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:05.070889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3981fac7-bbeb-4891-86a3-20ed11d8f53d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:05.071353 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3981fac7-bbeb-4891-86a3-20ed11d8f53d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:05.072153 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3981fac7-bbeb-4891-86a3-20ed11d8f53d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:05.072606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3981fac7-bbeb-4891-86a3-20ed11d8f53d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:05.213875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3981fac7-bbeb-4891-86a3-20ed11d8f53d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:05.221430 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3981fac7-bbeb-4891-86a3-20ed11d8f53d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1684 microversion: 2.1 time: 0.163386 Jan 22 22:30:05.222038 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4674/9640] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:05 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:06.239250 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f73f0d1d-14e0-49ee-91a5-4c086d2e6cf9 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:06.240787 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f73f0d1d-14e0-49ee-91a5-4c086d2e6cf9 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:06.247641 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f73f0d1d-14e0-49ee-91a5-4c086d2e6cf9 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:06.248108 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f73f0d1d-14e0-49ee-91a5-4c086d2e6cf9 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:06.248930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f73f0d1d-14e0-49ee-91a5-4c086d2e6cf9 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:06.249389 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f73f0d1d-14e0-49ee-91a5-4c086d2e6cf9 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:06.392449 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f73f0d1d-14e0-49ee-91a5-4c086d2e6cf9 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:06.400622 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f73f0d1d-14e0-49ee-91a5-4c086d2e6cf9 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1684 microversion: 2.1 time: 0.165114 Jan 22 22:30:06.401253 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4967/9641] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:06 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:07.417729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-64b2b4f0-9dac-4dce-87a9-92f44286b858 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:07.418346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-64b2b4f0-9dac-4dce-87a9-92f44286b858 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:07.425144 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64b2b4f0-9dac-4dce-87a9-92f44286b858 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:07.425638 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64b2b4f0-9dac-4dce-87a9-92f44286b858 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:07.426463 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64b2b4f0-9dac-4dce-87a9-92f44286b858 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:07.426911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-64b2b4f0-9dac-4dce-87a9-92f44286b858 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:07.558730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-64b2b4f0-9dac-4dce-87a9-92f44286b858 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:07.566175 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-64b2b4f0-9dac-4dce-87a9-92f44286b858 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1684 microversion: 2.1 time: 0.152279 Jan 22 22:30:07.566741 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4675/9642] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:07 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:08.583605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f18297cb-c466-4f19-8125-d0938cdfbc38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:08.584223 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f18297cb-c466-4f19-8125-d0938cdfbc38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:08.590907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f18297cb-c466-4f19-8125-d0938cdfbc38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:08.591367 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f18297cb-c466-4f19-8125-d0938cdfbc38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:08.592156 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f18297cb-c466-4f19-8125-d0938cdfbc38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:08.592606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f18297cb-c466-4f19-8125-d0938cdfbc38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:08.724729 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f18297cb-c466-4f19-8125-d0938cdfbc38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:08.732153 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f18297cb-c466-4f19-8125-d0938cdfbc38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1684 microversion: 2.1 time: 0.152376 Jan 22 22:30:08.732749 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4968/9643] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:08 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:09.749809 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-19e84888-c429-4970-8cf6-e2618394a2df tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:09.750387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-19e84888-c429-4970-8cf6-e2618394a2df tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:09.757347 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19e84888-c429-4970-8cf6-e2618394a2df tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:09.757839 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19e84888-c429-4970-8cf6-e2618394a2df tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:09.758620 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19e84888-c429-4970-8cf6-e2618394a2df tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:09.759061 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-19e84888-c429-4970-8cf6-e2618394a2df tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:09.889549 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-19e84888-c429-4970-8cf6-e2618394a2df tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:09.897663 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-19e84888-c429-4970-8cf6-e2618394a2df tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1684 microversion: 2.1 time: 0.151645 Jan 22 22:30:09.898236 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4676/9644] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:09 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:10.915291 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1b44456a-d34c-4406-bd46-2997065ddb10 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:10.915851 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1b44456a-d34c-4406-bd46-2997065ddb10 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:10.922688 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b44456a-d34c-4406-bd46-2997065ddb10 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:10.923164 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b44456a-d34c-4406-bd46-2997065ddb10 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:10.923973 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b44456a-d34c-4406-bd46-2997065ddb10 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:10.924437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1b44456a-d34c-4406-bd46-2997065ddb10 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:11.058553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1b44456a-d34c-4406-bd46-2997065ddb10 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:11.066216 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1b44456a-d34c-4406-bd46-2997065ddb10 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1684 microversion: 2.1 time: 0.155412 Jan 22 22:30:11.066827 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4969/9645] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:10 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:12.083923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-727fbb5d-3375-469a-8801-27818521add0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:12.084544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-727fbb5d-3375-469a-8801-27818521add0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:12.091313 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-727fbb5d-3375-469a-8801-27818521add0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:12.091774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-727fbb5d-3375-469a-8801-27818521add0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:12.092565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-727fbb5d-3375-469a-8801-27818521add0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:12.093013 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-727fbb5d-3375-469a-8801-27818521add0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:12.228940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-727fbb5d-3375-469a-8801-27818521add0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:12.236363 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-727fbb5d-3375-469a-8801-27818521add0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1684 microversion: 2.1 time: 0.156499 Jan 22 22:30:12.236934 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4677/9646] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:12 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:13.253473 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-95ba4521-a54b-43e6-9ace-38a6b4b671f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:13.254118 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-95ba4521-a54b-43e6-9ace-38a6b4b671f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:13.260818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95ba4521-a54b-43e6-9ace-38a6b4b671f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:13.261270 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95ba4521-a54b-43e6-9ace-38a6b4b671f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:13.262094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95ba4521-a54b-43e6-9ace-38a6b4b671f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:13.262549 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-95ba4521-a54b-43e6-9ace-38a6b4b671f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:13.396401 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-95ba4521-a54b-43e6-9ace-38a6b4b671f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:13.403903 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-95ba4521-a54b-43e6-9ace-38a6b4b671f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1705 microversion: 2.1 time: 0.154175 Jan 22 22:30:13.404477 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4970/9647] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:13 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1705 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:14.421440 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-2e1fd4a5-5bf2-440d-8bcd-3914261b65f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:14.422073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-2e1fd4a5-5bf2-440d-8bcd-3914261b65f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:14.429426 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e1fd4a5-5bf2-440d-8bcd-3914261b65f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:14.429903 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e1fd4a5-5bf2-440d-8bcd-3914261b65f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:14.430682 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e1fd4a5-5bf2-440d-8bcd-3914261b65f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:14.431146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-2e1fd4a5-5bf2-440d-8bcd-3914261b65f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:14.571840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-2e1fd4a5-5bf2-440d-8bcd-3914261b65f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:14.579520 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-2e1fd4a5-5bf2-440d-8bcd-3914261b65f8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1705 microversion: 2.1 time: 0.161841 Jan 22 22:30:14.580094 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4678/9648] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:14 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1705 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:15.596946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-008565da-3e71-4a6a-9a1c-89285ff932e2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:15.597605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-008565da-3e71-4a6a-9a1c-89285ff932e2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:15.604990 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-008565da-3e71-4a6a-9a1c-89285ff932e2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:15.605464 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-008565da-3e71-4a6a-9a1c-89285ff932e2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:15.606311 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-008565da-3e71-4a6a-9a1c-89285ff932e2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:15.606774 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-008565da-3e71-4a6a-9a1c-89285ff932e2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:15.744756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-008565da-3e71-4a6a-9a1c-89285ff932e2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:15.752359 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-008565da-3e71-4a6a-9a1c-89285ff932e2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1705 microversion: 2.1 time: 0.159018 Jan 22 22:30:15.753028 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4971/9649] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:15 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1705 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:16.770070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f3fb2b0e-60fe-4bf4-8ae2-08125dd18341 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:16.771403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f3fb2b0e-60fe-4bf4-8ae2-08125dd18341 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:16.778473 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3fb2b0e-60fe-4bf4-8ae2-08125dd18341 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:16.778936 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3fb2b0e-60fe-4bf4-8ae2-08125dd18341 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:16.779738 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3fb2b0e-60fe-4bf4-8ae2-08125dd18341 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:16.780186 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f3fb2b0e-60fe-4bf4-8ae2-08125dd18341 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:16.919695 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f3fb2b0e-60fe-4bf4-8ae2-08125dd18341 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:16.927860 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f3fb2b0e-60fe-4bf4-8ae2-08125dd18341 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1705 microversion: 2.1 time: 0.161458 Jan 22 22:30:16.928442 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4679/9650] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:16 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1705 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:17.698295 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-2cca2854-6a8c-4ba8-93ae-d10597d5a4ff req-036ff201-ed52-4952-a424-701aa6c1201d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05c4a9c-c495-412f-a483-aa343463792a", "name": "network-vif-plugged", "status": "completed", "tag": "d99ad49d-1710-4642-9128-1a3e38043d9b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:30:17.699580 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:30:17.699580 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:30:17.708335 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2cca2854-6a8c-4ba8-93ae-d10597d5a4ff req-036ff201-ed52-4952-a424-701aa6c1201d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:17.709258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2cca2854-6a8c-4ba8-93ae-d10597d5a4ff req-036ff201-ed52-4952-a424-701aa6c1201d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:17.719841 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-2cca2854-6a8c-4ba8-93ae-d10597d5a4ff req-036ff201-ed52-4952-a424-701aa6c1201d service nova] Creating event network-vif-plugged:d99ad49d-1710-4642-9128-1a3e38043d9b for instance d05c4a9c-c495-412f-a483-aa343463792a on nch2-master-1 Jan 22 22:30:17.725782 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-2cca2854-6a8c-4ba8-93ae-d10597d5a4ff req-036ff201-ed52-4952-a424-701aa6c1201d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031327 Jan 22 22:30:17.726388 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4972/9651] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:30:17.945452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-26b46dbf-c5e1-4990-a889-f8c39359046d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:17.946032 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-26b46dbf-c5e1-4990-a889-f8c39359046d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:17.953054 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26b46dbf-c5e1-4990-a889-f8c39359046d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:17.953540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26b46dbf-c5e1-4990-a889-f8c39359046d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:17.954341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26b46dbf-c5e1-4990-a889-f8c39359046d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:17.954790 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-26b46dbf-c5e1-4990-a889-f8c39359046d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:18.090864 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-26b46dbf-c5e1-4990-a889-f8c39359046d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:18.098858 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-26b46dbf-c5e1-4990-a889-f8c39359046d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1705 microversion: 2.1 time: 0.157842 Jan 22 22:30:18.099425 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4680/9652] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:17 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1705 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:19.117446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-471a2f60-b5eb-4810-8488-6d0683e81358 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:19.118817 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-471a2f60-b5eb-4810-8488-6d0683e81358 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:19.132094 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-471a2f60-b5eb-4810-8488-6d0683e81358 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:19.132852 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-471a2f60-b5eb-4810-8488-6d0683e81358 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:19.133711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-471a2f60-b5eb-4810-8488-6d0683e81358 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:19.134168 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-471a2f60-b5eb-4810-8488-6d0683e81358 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:19.303190 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-471a2f60-b5eb-4810-8488-6d0683e81358 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:19.311364 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-471a2f60-b5eb-4810-8488-6d0683e81358 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1700 microversion: 2.1 time: 0.198401 Jan 22 22:30:19.312127 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4973/9653] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:19 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1700 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:20.329880 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-acd1a3bc-5c8b-4ae3-9d40-2feb7079c92a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:20.331115 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-acd1a3bc-5c8b-4ae3-9d40-2feb7079c92a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:20.340561 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acd1a3bc-5c8b-4ae3-9d40-2feb7079c92a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:20.341407 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acd1a3bc-5c8b-4ae3-9d40-2feb7079c92a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:20.342245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acd1a3bc-5c8b-4ae3-9d40-2feb7079c92a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:20.342693 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-acd1a3bc-5c8b-4ae3-9d40-2feb7079c92a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:20.503268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-acd1a3bc-5c8b-4ae3-9d40-2feb7079c92a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:20.511414 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-acd1a3bc-5c8b-4ae3-9d40-2feb7079c92a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1700 microversion: 2.1 time: 0.185141 Jan 22 22:30:20.512002 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4681/9654] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:20 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1700 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:21.532181 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-22171fe5-6a02-4bbf-9653-1f66cc639012 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:21.533063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-22171fe5-6a02-4bbf-9653-1f66cc639012 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:21.540930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22171fe5-6a02-4bbf-9653-1f66cc639012 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:21.541411 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22171fe5-6a02-4bbf-9653-1f66cc639012 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:21.542324 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22171fe5-6a02-4bbf-9653-1f66cc639012 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:21.542723 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-22171fe5-6a02-4bbf-9653-1f66cc639012 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:21.692946 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-22171fe5-6a02-4bbf-9653-1f66cc639012 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:21.701927 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-22171fe5-6a02-4bbf-9653-1f66cc639012 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1700 microversion: 2.1 time: 0.175253 Jan 22 22:30:21.702549 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4974/9655] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:21 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1700 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:22.719380 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ae51cb42-b63a-4ea6-bcef-5ab23582fcbd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:22.724277 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ae51cb42-b63a-4ea6-bcef-5ab23582fcbd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:22.732066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae51cb42-b63a-4ea6-bcef-5ab23582fcbd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:22.732521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae51cb42-b63a-4ea6-bcef-5ab23582fcbd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:22.733324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae51cb42-b63a-4ea6-bcef-5ab23582fcbd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:22.733793 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ae51cb42-b63a-4ea6-bcef-5ab23582fcbd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:22.901892 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ae51cb42-b63a-4ea6-bcef-5ab23582fcbd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:22.909822 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ae51cb42-b63a-4ea6-bcef-5ab23582fcbd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1700 microversion: 2.1 time: 0.194184 Jan 22 22:30:22.910602 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4682/9656] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:22 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1700 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:23.931330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-3a8e55cf-dbb3-4b31-a2cd-048475299660 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:23.932930 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-3a8e55cf-dbb3-4b31-a2cd-048475299660 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:23.940088 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a8e55cf-dbb3-4b31-a2cd-048475299660 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:23.940773 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a8e55cf-dbb3-4b31-a2cd-048475299660 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:23.942753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a8e55cf-dbb3-4b31-a2cd-048475299660 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:23.943218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-3a8e55cf-dbb3-4b31-a2cd-048475299660 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:24.125067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-3a8e55cf-dbb3-4b31-a2cd-048475299660 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:24.134131 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-3a8e55cf-dbb3-4b31-a2cd-048475299660 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1700 microversion: 2.1 time: 0.208011 Jan 22 22:30:24.144871 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4975/9657] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:23 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1700 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:25.151100 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e1139281-5c83-465b-a26f-ea7be8c243cb tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:25.152444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e1139281-5c83-465b-a26f-ea7be8c243cb tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:25.159911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1139281-5c83-465b-a26f-ea7be8c243cb tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:25.161406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1139281-5c83-465b-a26f-ea7be8c243cb tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:25.162430 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1139281-5c83-465b-a26f-ea7be8c243cb tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:25.162885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e1139281-5c83-465b-a26f-ea7be8c243cb tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:25.304940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e1139281-5c83-465b-a26f-ea7be8c243cb tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:25.312758 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e1139281-5c83-465b-a26f-ea7be8c243cb tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1700 microversion: 2.1 time: 0.165414 Jan 22 22:30:25.313680 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4683/9658] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:25 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1700 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:26.334166 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-aad9a51b-84ec-4bfa-bf80-35460d6db490 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:26.334877 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-aad9a51b-84ec-4bfa-bf80-35460d6db490 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:26.342020 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aad9a51b-84ec-4bfa-bf80-35460d6db490 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:26.342499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aad9a51b-84ec-4bfa-bf80-35460d6db490 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:26.343375 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aad9a51b-84ec-4bfa-bf80-35460d6db490 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:26.344004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-aad9a51b-84ec-4bfa-bf80-35460d6db490 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:26.507523 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-aad9a51b-84ec-4bfa-bf80-35460d6db490 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:26.515664 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-aad9a51b-84ec-4bfa-bf80-35460d6db490 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1700 microversion: 2.1 time: 0.186662 Jan 22 22:30:26.516450 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4976/9659] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:26 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1700 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:27.534064 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-136fa734-bf41-4d77-b853-54800494019d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:27.535361 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-136fa734-bf41-4d77-b853-54800494019d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:27.542942 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-136fa734-bf41-4d77-b853-54800494019d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:27.543394 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-136fa734-bf41-4d77-b853-54800494019d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:27.544239 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-136fa734-bf41-4d77-b853-54800494019d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:27.544680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-136fa734-bf41-4d77-b853-54800494019d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:27.703432 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-136fa734-bf41-4d77-b853-54800494019d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:27.712066 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-136fa734-bf41-4d77-b853-54800494019d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1700 microversion: 2.1 time: 0.181906 Jan 22 22:30:27.712644 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4684/9660] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:27 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1700 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:28.730488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7dfc180c-8c4b-4fbc-ac8d-895800293b76 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:28.731061 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7dfc180c-8c4b-4fbc-ac8d-895800293b76 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:28.738465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dfc180c-8c4b-4fbc-ac8d-895800293b76 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:28.738943 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dfc180c-8c4b-4fbc-ac8d-895800293b76 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:28.739824 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dfc180c-8c4b-4fbc-ac8d-895800293b76 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:28.740383 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7dfc180c-8c4b-4fbc-ac8d-895800293b76 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:28.874063 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7dfc180c-8c4b-4fbc-ac8d-895800293b76 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:28.883183 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7dfc180c-8c4b-4fbc-ac8d-895800293b76 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1700 microversion: 2.1 time: 0.156578 Jan 22 22:30:28.883770 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4977/9661] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:28 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1700 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:29.901089 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e8aa24a0-27c5-4f7e-b4d7-2e41c5d13c38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:29.901743 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e8aa24a0-27c5-4f7e-b4d7-2e41c5d13c38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:29.908460 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8aa24a0-27c5-4f7e-b4d7-2e41c5d13c38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:29.908915 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8aa24a0-27c5-4f7e-b4d7-2e41c5d13c38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:29.909731 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8aa24a0-27c5-4f7e-b4d7-2e41c5d13c38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:29.910175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8aa24a0-27c5-4f7e-b4d7-2e41c5d13c38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:30.056344 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e8aa24a0-27c5-4f7e-b4d7-2e41c5d13c38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:30.063885 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e8aa24a0-27c5-4f7e-b4d7-2e41c5d13c38 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1682 microversion: 2.1 time: 0.166572 Jan 22 22:30:30.064468 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4685/9662] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:29 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:30:31.082447 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-1d747111-6126-468b-859d-a9b9fb5ae165 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:31.083015 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-1d747111-6126-468b-859d-a9b9fb5ae165 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:31.090721 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d747111-6126-468b-859d-a9b9fb5ae165 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:31.092241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d747111-6126-468b-859d-a9b9fb5ae165 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:31.092241 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d747111-6126-468b-859d-a9b9fb5ae165 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:31.092548 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-1d747111-6126-468b-859d-a9b9fb5ae165 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:31.231342 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-1d747111-6126-468b-859d-a9b9fb5ae165 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:31.238820 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-1d747111-6126-468b-859d-a9b9fb5ae165 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1682 microversion: 2.1 time: 0.160181 Jan 22 22:30:31.239397 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4978/9663] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:31 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:32.257377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dc24373b-a627-40bf-8b69-30dd9bddd6a7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:32.263508 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dc24373b-a627-40bf-8b69-30dd9bddd6a7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:32.264261 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc24373b-a627-40bf-8b69-30dd9bddd6a7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:32.264719 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc24373b-a627-40bf-8b69-30dd9bddd6a7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:32.265518 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc24373b-a627-40bf-8b69-30dd9bddd6a7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:32.265971 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dc24373b-a627-40bf-8b69-30dd9bddd6a7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:32.406162 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dc24373b-a627-40bf-8b69-30dd9bddd6a7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:32.414022 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dc24373b-a627-40bf-8b69-30dd9bddd6a7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1682 microversion: 2.1 time: 0.160410 Jan 22 22:30:32.414604 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4686/9664] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:32 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:33.431253 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-e6d19d93-4161-489a-9aef-a31748fafed8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:33.431911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-e6d19d93-4161-489a-9aef-a31748fafed8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:33.438777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6d19d93-4161-489a-9aef-a31748fafed8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:33.439252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6d19d93-4161-489a-9aef-a31748fafed8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:33.440058 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6d19d93-4161-489a-9aef-a31748fafed8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:33.440525 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-e6d19d93-4161-489a-9aef-a31748fafed8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:33.574991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-e6d19d93-4161-489a-9aef-a31748fafed8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:33.583010 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-e6d19d93-4161-489a-9aef-a31748fafed8 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1625 microversion: 2.1 time: 0.155464 Jan 22 22:30:33.584520 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4979/9665] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:33 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1625 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:33.604270 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f0eb0f5-48af-4046-9a05-319df53d67ad tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:30:33.605015 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9f0eb0f5-48af-4046-9a05-319df53d67ad tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:33.611930 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f0eb0f5-48af-4046-9a05-319df53d67ad tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:33.612486 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f0eb0f5-48af-4046-9a05-319df53d67ad tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:33.613555 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f0eb0f5-48af-4046-9a05-319df53d67ad tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:33.614175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f0eb0f5-48af-4046-9a05-319df53d67ad tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:33.691649 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-03f36166-2a92-4377-86b0-60144988cf9c req-d6b90c56-5d41-4287-aaa8-f2c46fafc37c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05c4a9c-c495-412f-a483-aa343463792a", "name": "network-vif-unplugged", "status": "completed", "tag": "d99ad49d-1710-4642-9128-1a3e38043d9b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:30:33.693909 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:30:33.693909 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:30:33.707556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-03f36166-2a92-4377-86b0-60144988cf9c req-d6b90c56-5d41-4287-aaa8-f2c46fafc37c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:33.707556 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-03f36166-2a92-4377-86b0-60144988cf9c req-d6b90c56-5d41-4287-aaa8-f2c46fafc37c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:33.717288 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.compute.server_external_events [req-03f36166-2a92-4377-86b0-60144988cf9c req-d6b90c56-5d41-4287-aaa8-f2c46fafc37c service nova] Unable to find a host for instance d05c4a9c-c495-412f-a483-aa343463792a. Dropping event network-vif-unplugged {{(pid=137032) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 22 22:30:33.718453 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-03f36166-2a92-4377-86b0-60144988cf9c req-d6b90c56-5d41-4287-aaa8-f2c46fafc37c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030353 Jan 22 22:30:33.719060 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4980/9666] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 22 22:30:33.887526 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9f0eb0f5-48af-4046-9a05-319df53d67ad tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "POST /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a/action" status: 202 len: 0 microversion: 2.1 time: 0.289981 Jan 22 22:30:33.891434 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4687/9667] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:30:33 2022] POST /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:30:33.897857 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ccfe6127-d70e-4465-ab78-5d21f3a4daf4 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:33.899287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ccfe6127-d70e-4465-ab78-5d21f3a4daf4 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:33.905361 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccfe6127-d70e-4465-ab78-5d21f3a4daf4 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:33.906329 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccfe6127-d70e-4465-ab78-5d21f3a4daf4 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:33.907031 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccfe6127-d70e-4465-ab78-5d21f3a4daf4 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:33.907484 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ccfe6127-d70e-4465-ab78-5d21f3a4daf4 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:34.069022 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ccfe6127-d70e-4465-ab78-5d21f3a4daf4 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:34.076969 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ccfe6127-d70e-4465-ab78-5d21f3a4daf4 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1633 microversion: 2.1 time: 0.183830 Jan 22 22:30:34.077650 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4981/9668] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:33 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1633 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:35.094891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eaaee786-ff27-47e9-abf4-47b9447a7592 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:35.095671 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eaaee786-ff27-47e9-abf4-47b9447a7592 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:35.103317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaaee786-ff27-47e9-abf4-47b9447a7592 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:35.103779 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaaee786-ff27-47e9-abf4-47b9447a7592 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:35.104577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaaee786-ff27-47e9-abf4-47b9447a7592 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:35.105028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eaaee786-ff27-47e9-abf4-47b9447a7592 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:35.240798 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-eaaee786-ff27-47e9-abf4-47b9447a7592 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:35.248338 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eaaee786-ff27-47e9-abf4-47b9447a7592 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1633 microversion: 2.1 time: 0.157248 Jan 22 22:30:35.248901 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4688/9669] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:35 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1633 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:36.265912 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a553d590-9113-41c4-8960-f1a77e50129b tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:36.266537 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a553d590-9113-41c4-8960-f1a77e50129b tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:36.273541 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a553d590-9113-41c4-8960-f1a77e50129b tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:36.274042 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a553d590-9113-41c4-8960-f1a77e50129b tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:36.274844 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a553d590-9113-41c4-8960-f1a77e50129b tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:36.275298 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a553d590-9113-41c4-8960-f1a77e50129b tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:36.435791 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a553d590-9113-41c4-8960-f1a77e50129b tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:36.447109 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a553d590-9113-41c4-8960-f1a77e50129b tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1691 microversion: 2.1 time: 0.183906 Jan 22 22:30:36.447931 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4982/9670] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:36 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1691 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:36.890210 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-2c353b7d-829a-450b-89b9-23c44b2c4eba req-05e35f1f-4b1d-40b8-823b-9bd873b3c2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d05c4a9c-c495-412f-a483-aa343463792a", "tag": "d99ad49d-1710-4642-9128-1a3e38043d9b"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:30:36.892096 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:30:36.892096 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:30:36.901540 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2c353b7d-829a-450b-89b9-23c44b2c4eba req-05e35f1f-4b1d-40b8-823b-9bd873b3c2d8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:36.902258 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-2c353b7d-829a-450b-89b9-23c44b2c4eba req-05e35f1f-4b1d-40b8-823b-9bd873b3c2d8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:36.916690 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-2c353b7d-829a-450b-89b9-23c44b2c4eba req-05e35f1f-4b1d-40b8-823b-9bd873b3c2d8 service nova] Creating event network-changed:d99ad49d-1710-4642-9128-1a3e38043d9b for instance d05c4a9c-c495-412f-a483-aa343463792a on nch1-master-1 Jan 22 22:30:36.922594 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-2c353b7d-829a-450b-89b9-23c44b2c4eba req-05e35f1f-4b1d-40b8-823b-9bd873b3c2d8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099149 Jan 22 22:30:36.923424 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4689/9671] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:30:37.464888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a3b021cd-705a-4b88-8320-7a04a8784947 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:37.465575 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a3b021cd-705a-4b88-8320-7a04a8784947 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:37.472609 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b021cd-705a-4b88-8320-7a04a8784947 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:37.473080 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b021cd-705a-4b88-8320-7a04a8784947 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:37.474522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b021cd-705a-4b88-8320-7a04a8784947 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:37.474982 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a3b021cd-705a-4b88-8320-7a04a8784947 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:37.618998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a3b021cd-705a-4b88-8320-7a04a8784947 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:37.627397 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a3b021cd-705a-4b88-8320-7a04a8784947 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1691 microversion: 2.1 time: 0.166188 Jan 22 22:30:37.628277 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4983/9672] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:37 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:38.645742 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-74e5eeb5-f972-4ddb-ae91-e925bfd16673 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:38.646487 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-74e5eeb5-f972-4ddb-ae91-e925bfd16673 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:38.653646 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74e5eeb5-f972-4ddb-ae91-e925bfd16673 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:38.654101 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74e5eeb5-f972-4ddb-ae91-e925bfd16673 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:38.654873 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74e5eeb5-f972-4ddb-ae91-e925bfd16673 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:38.655310 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-74e5eeb5-f972-4ddb-ae91-e925bfd16673 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:38.811490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-74e5eeb5-f972-4ddb-ae91-e925bfd16673 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:38.820887 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-74e5eeb5-f972-4ddb-ae91-e925bfd16673 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1691 microversion: 2.1 time: 0.179345 Jan 22 22:30:38.821577 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4690/9673] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:38 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:39.838302 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c1149a4a-9962-40d3-b183-b8059b38b407 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:39.840044 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c1149a4a-9962-40d3-b183-b8059b38b407 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:39.848646 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1149a4a-9962-40d3-b183-b8059b38b407 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:39.849753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1149a4a-9962-40d3-b183-b8059b38b407 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:39.850586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1149a4a-9962-40d3-b183-b8059b38b407 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:39.851201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c1149a4a-9962-40d3-b183-b8059b38b407 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:39.999847 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-c1149a4a-9962-40d3-b183-b8059b38b407 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:40.008822 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c1149a4a-9962-40d3-b183-b8059b38b407 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1691 microversion: 2.1 time: 0.175260 Jan 22 22:30:40.009406 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4984/9674] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:39 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:41.026654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d133f69e-d8d8-4bbc-9edc-f51a8038a472 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:41.027483 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d133f69e-d8d8-4bbc-9edc-f51a8038a472 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:41.034570 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d133f69e-d8d8-4bbc-9edc-f51a8038a472 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:41.035031 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d133f69e-d8d8-4bbc-9edc-f51a8038a472 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:41.035840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d133f69e-d8d8-4bbc-9edc-f51a8038a472 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:41.036385 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d133f69e-d8d8-4bbc-9edc-f51a8038a472 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:41.194546 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d133f69e-d8d8-4bbc-9edc-f51a8038a472 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:41.204491 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d133f69e-d8d8-4bbc-9edc-f51a8038a472 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1691 microversion: 2.1 time: 0.181369 Jan 22 22:30:41.205269 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4691/9675] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:41 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:42.222715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-80e055b6-a6ee-4c96-ac0f-49fdcb46908d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:42.224228 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-80e055b6-a6ee-4c96-ac0f-49fdcb46908d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:42.232905 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80e055b6-a6ee-4c96-ac0f-49fdcb46908d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:42.233605 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80e055b6-a6ee-4c96-ac0f-49fdcb46908d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:42.234569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80e055b6-a6ee-4c96-ac0f-49fdcb46908d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:42.235135 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-80e055b6-a6ee-4c96-ac0f-49fdcb46908d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:42.418682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-80e055b6-a6ee-4c96-ac0f-49fdcb46908d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:42.426742 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-80e055b6-a6ee-4c96-ac0f-49fdcb46908d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1691 microversion: 2.1 time: 0.208073 Jan 22 22:30:42.429545 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4985/9676] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:42 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1691 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:43.446006 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-27fdf82b-de58-48b8-8c3a-ffc04a010967 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:43.447972 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-27fdf82b-de58-48b8-8c3a-ffc04a010967 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:43.458564 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27fdf82b-de58-48b8-8c3a-ffc04a010967 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:43.459680 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27fdf82b-de58-48b8-8c3a-ffc04a010967 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:43.461053 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27fdf82b-de58-48b8-8c3a-ffc04a010967 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:43.461706 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-27fdf82b-de58-48b8-8c3a-ffc04a010967 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:43.608498 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-27fdf82b-de58-48b8-8c3a-ffc04a010967 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:43.617290 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-27fdf82b-de58-48b8-8c3a-ffc04a010967 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1691 microversion: 2.1 time: 0.175558 Jan 22 22:30:43.618243 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4692/9677] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:43 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:44.636327 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fc163722-7186-4b8e-8545-344b8079aa71 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:44.637743 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fc163722-7186-4b8e-8545-344b8079aa71 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:44.645032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc163722-7186-4b8e-8545-344b8079aa71 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:44.646104 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc163722-7186-4b8e-8545-344b8079aa71 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:44.647084 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc163722-7186-4b8e-8545-344b8079aa71 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:44.647554 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc163722-7186-4b8e-8545-344b8079aa71 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:44.799310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fc163722-7186-4b8e-8545-344b8079aa71 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:44.808772 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fc163722-7186-4b8e-8545-344b8079aa71 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1691 microversion: 2.1 time: 0.177346 Jan 22 22:30:44.809885 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4986/9678] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:44 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:45.826164 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f2aea9b-a4ba-4293-adc6-beb7c28d3ea1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:45.826760 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9f2aea9b-a4ba-4293-adc6-beb7c28d3ea1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:45.833492 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f2aea9b-a4ba-4293-adc6-beb7c28d3ea1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:45.833967 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f2aea9b-a4ba-4293-adc6-beb7c28d3ea1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:45.834745 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f2aea9b-a4ba-4293-adc6-beb7c28d3ea1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:45.835189 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f2aea9b-a4ba-4293-adc6-beb7c28d3ea1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:45.974801 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9f2aea9b-a4ba-4293-adc6-beb7c28d3ea1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:45.982239 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9f2aea9b-a4ba-4293-adc6-beb7c28d3ea1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1691 microversion: 2.1 time: 0.159997 Jan 22 22:30:45.982821 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4693/9679] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:45 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:46.999718 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-47922405-2073-4ccf-89eb-41504071d86d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:47.000276 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-47922405-2073-4ccf-89eb-41504071d86d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:47.008134 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47922405-2073-4ccf-89eb-41504071d86d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:47.008606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47922405-2073-4ccf-89eb-41504071d86d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:47.009412 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47922405-2073-4ccf-89eb-41504071d86d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:47.009908 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-47922405-2073-4ccf-89eb-41504071d86d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:47.148827 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-47922405-2073-4ccf-89eb-41504071d86d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:47.153031 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-47922405-2073-4ccf-89eb-41504071d86d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1691 microversion: 2.1 time: 0.157140 Jan 22 22:30:47.153637 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4987/9680] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:46 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:48.170645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-11e0c3ab-76fe-4638-84e9-c62a00501618 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:48.171248 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-11e0c3ab-76fe-4638-84e9-c62a00501618 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:48.177975 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11e0c3ab-76fe-4638-84e9-c62a00501618 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:48.178425 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11e0c3ab-76fe-4638-84e9-c62a00501618 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:48.179205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11e0c3ab-76fe-4638-84e9-c62a00501618 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:48.179642 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-11e0c3ab-76fe-4638-84e9-c62a00501618 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:48.311130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-11e0c3ab-76fe-4638-84e9-c62a00501618 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:48.319255 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-11e0c3ab-76fe-4638-84e9-c62a00501618 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1691 microversion: 2.1 time: 0.152308 Jan 22 22:30:48.319824 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4694/9681] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:48 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:49.337624 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-814a65ca-d498-48c8-806d-166ff1d5e846 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:49.338258 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-814a65ca-d498-48c8-806d-166ff1d5e846 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:49.345093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-814a65ca-d498-48c8-806d-166ff1d5e846 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:49.345598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-814a65ca-d498-48c8-806d-166ff1d5e846 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:49.346410 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-814a65ca-d498-48c8-806d-166ff1d5e846 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:49.346900 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-814a65ca-d498-48c8-806d-166ff1d5e846 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:49.490032 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-814a65ca-d498-48c8-806d-166ff1d5e846 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:49.497513 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-814a65ca-d498-48c8-806d-166ff1d5e846 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1691 microversion: 2.1 time: 0.164422 Jan 22 22:30:49.498104 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4988/9682] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:49 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:50.516940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4e5a169a-7e78-42f5-854e-c4702188df19 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:50.517577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4e5a169a-7e78-42f5-854e-c4702188df19 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:50.524710 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e5a169a-7e78-42f5-854e-c4702188df19 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:50.525175 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e5a169a-7e78-42f5-854e-c4702188df19 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:50.526004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e5a169a-7e78-42f5-854e-c4702188df19 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:50.526452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4e5a169a-7e78-42f5-854e-c4702188df19 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:50.641574 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-661f6766-1847-4f38-83aa-3fa03d3d2535 req-51045c91-7017-4bf4-88ae-5249e9ce71ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05c4a9c-c495-412f-a483-aa343463792a", "name": "network-vif-plugged", "status": "completed", "tag": "d99ad49d-1710-4642-9128-1a3e38043d9b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:30:50.643247 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:30:50.643247 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:30:50.651478 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-661f6766-1847-4f38-83aa-3fa03d3d2535 req-51045c91-7017-4bf4-88ae-5249e9ce71ab service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:50.651947 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-661f6766-1847-4f38-83aa-3fa03d3d2535 req-51045c91-7017-4bf4-88ae-5249e9ce71ab service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:50.663693 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-661f6766-1847-4f38-83aa-3fa03d3d2535 req-51045c91-7017-4bf4-88ae-5249e9ce71ab service nova] Creating event network-vif-plugged:d99ad49d-1710-4642-9128-1a3e38043d9b for instance d05c4a9c-c495-412f-a483-aa343463792a on nch1-master-1 Jan 22 22:30:50.669012 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-661f6766-1847-4f38-83aa-3fa03d3d2535 req-51045c91-7017-4bf4-88ae-5249e9ce71ab service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031574 Jan 22 22:30:50.669656 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4989/9683] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:30:50.670424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4e5a169a-7e78-42f5-854e-c4702188df19 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:50.679071 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4e5a169a-7e78-42f5-854e-c4702188df19 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1691 microversion: 2.1 time: 0.165826 Jan 22 22:30:50.679633 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4695/9684] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:50 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:51.697310 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-5bdadc5a-3cd3-4bff-ba6e-c36f811b0305 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:51.698004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-5bdadc5a-3cd3-4bff-ba6e-c36f811b0305 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:51.704522 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bdadc5a-3cd3-4bff-ba6e-c36f811b0305 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:51.704998 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bdadc5a-3cd3-4bff-ba6e-c36f811b0305 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:51.705841 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bdadc5a-3cd3-4bff-ba6e-c36f811b0305 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:51.706307 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-5bdadc5a-3cd3-4bff-ba6e-c36f811b0305 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:51.845093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-5bdadc5a-3cd3-4bff-ba6e-c36f811b0305 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:51.853309 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-5bdadc5a-3cd3-4bff-ba6e-c36f811b0305 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1691 microversion: 2.1 time: 0.161019 Jan 22 22:30:51.854110 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4990/9685] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:51 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:52.871002 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-4b9942e0-4526-4398-9b0e-43f974e25a15 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:52.871528 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-4b9942e0-4526-4398-9b0e-43f974e25a15 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:52.878325 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b9942e0-4526-4398-9b0e-43f974e25a15 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:52.878781 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b9942e0-4526-4398-9b0e-43f974e25a15 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:52.879565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b9942e0-4526-4398-9b0e-43f974e25a15 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:52.880041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-4b9942e0-4526-4398-9b0e-43f974e25a15 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:53.018885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-4b9942e0-4526-4398-9b0e-43f974e25a15 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:53.026927 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-4b9942e0-4526-4398-9b0e-43f974e25a15 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1691 microversion: 2.1 time: 0.159658 Jan 22 22:30:53.027660 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4696/9686] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:52 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:30:54.044006 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-55a36958-296e-4972-bed5-4cda7b9459fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:30:54.044632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-55a36958-296e-4972-bed5-4cda7b9459fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:30:54.051409 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55a36958-296e-4972-bed5-4cda7b9459fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:54.052510 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55a36958-296e-4972-bed5-4cda7b9459fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:54.053348 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55a36958-296e-4972-bed5-4cda7b9459fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:30:54.053899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-55a36958-296e-4972-bed5-4cda7b9459fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:30:54.187914 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-55a36958-296e-4972-bed5-4cda7b9459fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:30:54.196120 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-55a36958-296e-4972-bed5-4cda7b9459fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1678 microversion: 2.1 time: 0.155889 Jan 22 22:30:54.196700 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4991/9687] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:30:54 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:08.111294 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-53722a11-d861-41c2-8997-ad14f989dbba tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:08.111837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-53722a11-d861-41c2-8997-ad14f989dbba tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:08.118925 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53722a11-d861-41c2-8997-ad14f989dbba tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:08.119623 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53722a11-d861-41c2-8997-ad14f989dbba tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:08.120178 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-f586db29-6992-4c89-9153-a25c69de257d req-f99df3a0-921b-4c1e-9ac2-b66f542ec008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d05c4a9c-c495-412f-a483-aa343463792a", "tag": "d99ad49d-1710-4642-9128-1a3e38043d9b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:32:08.120723 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53722a11-d861-41c2-8997-ad14f989dbba tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:08.120865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-53722a11-d861-41c2-8997-ad14f989dbba tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:08.121705 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:32:08.121705 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:32:08.129183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f586db29-6992-4c89-9153-a25c69de257d req-f99df3a0-921b-4c1e-9ac2-b66f542ec008 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:08.129995 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f586db29-6992-4c89-9153-a25c69de257d req-f99df3a0-921b-4c1e-9ac2-b66f542ec008 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:08.142309 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f586db29-6992-4c89-9153-a25c69de257d req-f99df3a0-921b-4c1e-9ac2-b66f542ec008 service nova] Creating event network-changed:d99ad49d-1710-4642-9128-1a3e38043d9b for instance d05c4a9c-c495-412f-a483-aa343463792a on nch1-master-1 Jan 22 22:32:08.148015 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-f586db29-6992-4c89-9153-a25c69de257d req-f99df3a0-921b-4c1e-9ac2-b66f542ec008 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032908 Jan 22 22:32:08.148838 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4992/9688] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:32:08.149028 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-53722a11-d861-41c2-8997-ad14f989dbba tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:32:08.425756 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-53722a11-d861-41c2-8997-ad14f989dbba tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "DELETE /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 204 len: 0 microversion: 2.1 time: 0.318954 Jan 22 22:32:08.426590 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4697/9689] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:32:08 2022] DELETE /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:32:08.435669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-fc485a7f-6403-444b-af2a-2a0110420b18 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:08.436376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-fc485a7f-6403-444b-af2a-2a0110420b18 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:08.443572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc485a7f-6403-444b-af2a-2a0110420b18 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:08.443572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc485a7f-6403-444b-af2a-2a0110420b18 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:08.443957 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc485a7f-6403-444b-af2a-2a0110420b18 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:08.444418 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-fc485a7f-6403-444b-af2a-2a0110420b18 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:08.595715 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-fc485a7f-6403-444b-af2a-2a0110420b18 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:08.604222 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-fc485a7f-6403-444b-af2a-2a0110420b18 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1684 microversion: 2.1 time: 0.172542 Jan 22 22:32:08.605028 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4993/9690] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:08 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:32:09.682795 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e8223e7b-e652-4da7-b930-c01f56b0714d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:09.683606 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e8223e7b-e652-4da7-b930-c01f56b0714d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:09.690051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8223e7b-e652-4da7-b930-c01f56b0714d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:09.690511 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8223e7b-e652-4da7-b930-c01f56b0714d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:09.691338 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8223e7b-e652-4da7-b930-c01f56b0714d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:09.691783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e8223e7b-e652-4da7-b930-c01f56b0714d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:09.836603 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e8223e7b-e652-4da7-b930-c01f56b0714d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:09.844254 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e8223e7b-e652-4da7-b930-c01f56b0714d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1565 microversion: 2.1 time: 0.224890 Jan 22 22:32:09.844827 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4698/9691] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:09 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1565 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:10.551239 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-f2f685b1-8157-4f78-9533-87c6b9d1756a req-29a92890-9383-4d0d-ac6b-e3053b1da7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05c4a9c-c495-412f-a483-aa343463792a", "name": "network-vif-deleted", "tag": "d99ad49d-1710-4642-9128-1a3e38043d9b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:32:10.553036 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:32:10.553036 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:32:10.561762 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f2f685b1-8157-4f78-9533-87c6b9d1756a req-29a92890-9383-4d0d-ac6b-e3053b1da7cd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:10.562235 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f2f685b1-8157-4f78-9533-87c6b9d1756a req-29a92890-9383-4d0d-ac6b-e3053b1da7cd service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:10.575834 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f2f685b1-8157-4f78-9533-87c6b9d1756a req-29a92890-9383-4d0d-ac6b-e3053b1da7cd service nova] Creating event network-vif-deleted:d99ad49d-1710-4642-9128-1a3e38043d9b for instance d05c4a9c-c495-412f-a483-aa343463792a on nch1-master-1 Jan 22 22:32:10.581718 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-f2f685b1-8157-4f78-9533-87c6b9d1756a req-29a92890-9383-4d0d-ac6b-e3053b1da7cd service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033142 Jan 22 22:32:10.581718 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4994/9692] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:32:10.861624 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-5dc0b676-d953-4b3b-a4f1-9eff009138c7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:10.862335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-5dc0b676-d953-4b3b-a4f1-9eff009138c7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:10.870578 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5dc0b676-d953-4b3b-a4f1-9eff009138c7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:10.871146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5dc0b676-d953-4b3b-a4f1-9eff009138c7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:10.872035 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5dc0b676-d953-4b3b-a4f1-9eff009138c7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:10.872557 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5dc0b676-d953-4b3b-a4f1-9eff009138c7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:10.906160 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5dc0b676-d953-4b3b-a4f1-9eff009138c7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:10.906729 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-5dc0b676-d953-4b3b-a4f1-9eff009138c7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:10.907269 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-5dc0b676-d953-4b3b-a4f1-9eff009138c7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lazy-loading 'fault' on Instance uuid d05c4a9c-c495-412f-a483-aa343463792a {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 22:32:10.948499 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-5dc0b676-d953-4b3b-a4f1-9eff009138c7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:10.956213 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-5dc0b676-d953-4b3b-a4f1-9eff009138c7 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 200 len: 1340 microversion: 2.1 time: 0.098645 Jan 22 22:32:10.956795 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4699/9693] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:10 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 1340 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:11.974616 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b861291-5387-41c0-a4e8-e271c4fb3574 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:11.975404 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8b861291-5387-41c0-a4e8-e271c4fb3574 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: d05c4a9c-c495-412f-a483-aa343463792a] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:11.981614 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b861291-5387-41c0-a4e8-e271c4fb3574 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:11.982081 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b861291-5387-41c0-a4e8-e271c4fb3574 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:11.982899 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b861291-5387-41c0-a4e8-e271c4fb3574 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:11.983346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8b861291-5387-41c0-a4e8-e271c4fb3574 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:11.996531 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-8b861291-5387-41c0-a4e8-e271c4fb3574 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] HTTP exception thrown: Instance d05c4a9c-c495-412f-a483-aa343463792a could not be found. Jan 22 22:32:12.000822 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8b861291-5387-41c0-a4e8-e271c4fb3574 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Returning 404 to user: Instance d05c4a9c-c495-412f-a483-aa343463792a could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:32:12.000822 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8b861291-5387-41c0-a4e8-e271c4fb3574 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a" status: 404 len: 111 microversion: 2.1 time: 0.028336 Jan 22 22:32:12.000822 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4995/9694] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:11 2022] GET /compute/v2.1/servers/d05c4a9c-c495-412f-a483-aa343463792a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:32:12.221860 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ad268b57-758c-4f85-afb9-cc5ef3e0736b tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '.version_select at 0x7f1ed4d86160>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:12.225398 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ad268b57-758c-4f85-afb9-cc5ef3e0736b tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [5ae1cfda-c842-4ad6-9e4a-94babe62e9a0] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 22:32:13.232995 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [None req-ad268b57-758c-4f85-afb9-cc5ef3e0736b tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [5ae1cfda-c842-4ad6-9e4a-94babe62e9a0] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 34468. Jan 22 22:32:13.318266 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ad268b57-758c-4f85-afb9-cc5ef3e0736b tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1638098758" status: 202 len: 0 microversion: 2.1 time: 1.100167 Jan 22 22:32:13.318858 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4700/9695] 10.222.0.100 () {58 vars in 1258 bytes} [Sat Jan 22 22:32:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1638098758 => generated 0 bytes in 1102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:32:13.343862 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-999010b2-88dc-4d1b-967c-8746d8225cdb tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Action: 'create', calling method: .version_select at 0x7f1ed4f62820>, body: {"keypair": {"name": "tempest-TestShelveInstance-379541643"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:32:13.358826 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-999010b2-88dc-4d1b-967c-8746d8225cdb tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Getting quotas for project bfe266ea1db64cb8ad21a3f40b9f0cf3. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:32:13.364595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-999010b2-88dc-4d1b-967c-8746d8225cdb tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Getting quotas for user e377dada2c4e44ed9749fd92ec9d29ae and project bfe266ea1db64cb8ad21a3f40b9f0cf3. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:32:13.622539 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-999010b2-88dc-4d1b-967c-8746d8225cdb tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Getting quotas for project bfe266ea1db64cb8ad21a3f40b9f0cf3. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:32:13.627586 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-999010b2-88dc-4d1b-967c-8746d8225cdb tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Getting quotas for user e377dada2c4e44ed9749fd92ec9d29ae and project bfe266ea1db64cb8ad21a3f40b9f0cf3. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:32:13.642301 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-999010b2-88dc-4d1b-967c-8746d8225cdb tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.302308 Jan 22 22:32:13.642900 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4996/9696] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 22:32:13 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:21.114929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1485739403", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-379541643", "security_groups": [{"name": "tempest-secgroup-smoke-1545979168"}], "networks": [{"uuid": "0a2a203b-1825-47db-92ae-2a2b610a7c3e"}], "block_device_mapping_v2": [{"uuid": "0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:32:21.410912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] validate_networks() for [('0a2a203b-1825-47db-92ae-2a2b610a7c3e', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:32:21.772287 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:32:21.772955 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:32:21.773444 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:32:21.773911 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:32:21.774332 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:32:21.783468 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:21.783929 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:21.784754 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:21.785200 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:21.802727 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Getting quotas for project bfe266ea1db64cb8ad21a3f40b9f0cf3. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:32:21.808592 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Getting quotas for user e377dada2c4e44ed9749fd92ec9d29ae and project bfe266ea1db64cb8ad21a3f40b9f0cf3. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:32:21.864670 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:32:21.867562 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0cd27e59-cbf1-4e87-9871-9b39e1e0cbc9',volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:32:22.243494 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f8edfb28-a99c-4bb7-9615-f99e4ec5ba11 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.133199 Jan 22 22:32:22.248999 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4701/9697] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:32:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 22:32:22.256102 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-113fa1e7-c634-48f1-beba-c4b192b0bf0f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:22.256834 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-113fa1e7-c634-48f1-beba-c4b192b0bf0f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:22.309691 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-113fa1e7-c634-48f1-beba-c4b192b0bf0f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:22.316344 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-113fa1e7-c634-48f1-beba-c4b192b0bf0f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1091 microversion: 2.1 time: 0.064728 Jan 22 22:32:22.316922 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4997/9698] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:22 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1091 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 22 22:32:23.334130 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-17384492-ba3e-4dba-83fc-e143448716f4 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:23.335376 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-17384492-ba3e-4dba-83fc-e143448716f4 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:23.389238 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-17384492-ba3e-4dba-83fc-e143448716f4 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:23.395799 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-17384492-ba3e-4dba-83fc-e143448716f4 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1091 microversion: 2.1 time: 0.066302 Jan 22 22:32:23.396360 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4702/9699] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:23 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1091 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:24.414962 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab739de2-0680-463a-b4bc-5e61f80ca0d0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:24.415647 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ab739de2-0680-463a-b4bc-5e61f80ca0d0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:24.469953 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ab739de2-0680-463a-b4bc-5e61f80ca0d0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:24.477720 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab739de2-0680-463a-b4bc-5e61f80ca0d0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1091 microversion: 2.1 time: 0.067539 Jan 22 22:32:24.478519 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4998/9700] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:24 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1091 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:25.495268 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-13a1dc85-3870-4482-905d-1da437eade4a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:25.495878 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-13a1dc85-3870-4482-905d-1da437eade4a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:25.547051 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-13a1dc85-3870-4482-905d-1da437eade4a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:25.554430 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-13a1dc85-3870-4482-905d-1da437eade4a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1091 microversion: 2.1 time: 0.062836 Jan 22 22:32:25.555179 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4703/9701] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:25 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1091 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:26.572149 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-84705231-915f-40ca-8792-3b63fcc5ea52 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:26.572784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-84705231-915f-40ca-8792-3b63fcc5ea52 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:26.579595 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84705231-915f-40ca-8792-3b63fcc5ea52 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:26.580071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84705231-915f-40ca-8792-3b63fcc5ea52 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:26.580878 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84705231-915f-40ca-8792-3b63fcc5ea52 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:26.581344 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-84705231-915f-40ca-8792-3b63fcc5ea52 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:26.639430 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-84705231-915f-40ca-8792-3b63fcc5ea52 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:26.646781 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-84705231-915f-40ca-8792-3b63fcc5ea52 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1141 microversion: 2.1 time: 0.079451 Jan 22 22:32:26.648004 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 4999/9702] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:26 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1141 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:27.664108 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e425f8b5-4cb8-4ea2-b490-fbaffb675bbc tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:27.664724 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e425f8b5-4cb8-4ea2-b490-fbaffb675bbc tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:27.671535 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e425f8b5-4cb8-4ea2-b490-fbaffb675bbc tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:27.672004 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e425f8b5-4cb8-4ea2-b490-fbaffb675bbc tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:27.672840 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e425f8b5-4cb8-4ea2-b490-fbaffb675bbc tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:27.673286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e425f8b5-4cb8-4ea2-b490-fbaffb675bbc tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:27.736735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-e425f8b5-4cb8-4ea2-b490-fbaffb675bbc tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:27.744787 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e425f8b5-4cb8-4ea2-b490-fbaffb675bbc tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1133 microversion: 2.1 time: 0.084476 Jan 22 22:32:27.745365 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4704/9703] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:27 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1133 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:28.764333 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab35c4e9-e4e6-4a4c-b66d-3b3d3d08611c tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:28.765093 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ab35c4e9-e4e6-4a4c-b66d-3b3d3d08611c tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:28.772739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab35c4e9-e4e6-4a4c-b66d-3b3d3d08611c tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:28.773273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab35c4e9-e4e6-4a4c-b66d-3b3d3d08611c tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:28.774263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab35c4e9-e4e6-4a4c-b66d-3b3d3d08611c tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:28.774779 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab35c4e9-e4e6-4a4c-b66d-3b3d3d08611c tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:28.865247 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ab35c4e9-e4e6-4a4c-b66d-3b3d3d08611c tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:28.872996 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab35c4e9-e4e6-4a4c-b66d-3b3d3d08611c tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1207 microversion: 2.1 time: 0.112494 Jan 22 22:32:28.873590 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5000/9704] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:28 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1207 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:29.889815 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-603294e3-60b9-457f-b840-0d8bb9085c50 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:29.891267 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-603294e3-60b9-457f-b840-0d8bb9085c50 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:29.897406 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-603294e3-60b9-457f-b840-0d8bb9085c50 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:29.898168 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-603294e3-60b9-457f-b840-0d8bb9085c50 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:29.898953 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-603294e3-60b9-457f-b840-0d8bb9085c50 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:29.899401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-603294e3-60b9-457f-b840-0d8bb9085c50 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:30.046635 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-603294e3-60b9-457f-b840-0d8bb9085c50 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:30.057369 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-603294e3-60b9-457f-b840-0d8bb9085c50 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1275 microversion: 2.1 time: 0.170963 Jan 22 22:32:30.067757 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4705/9705] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:29 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:30.108747 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-6b63fccd-6232-4d56-8bf7-8915f70e09f8 req-43e31664-781a-48ba-8df2-f9de5b1d1e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afaf757e-3449-454c-a04d-7cb0e89cddd3", "tag": "67eaee44-6909-4944-958a-ff2727c23570"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:32:30.110388 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:32:30.110388 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:32:30.118362 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6b63fccd-6232-4d56-8bf7-8915f70e09f8 req-43e31664-781a-48ba-8df2-f9de5b1d1e7a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:30.122938 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-6b63fccd-6232-4d56-8bf7-8915f70e09f8 req-43e31664-781a-48ba-8df2-f9de5b1d1e7a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:30.130470 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-6b63fccd-6232-4d56-8bf7-8915f70e09f8 req-43e31664-781a-48ba-8df2-f9de5b1d1e7a service nova] Creating event network-changed:67eaee44-6909-4944-958a-ff2727c23570 for instance afaf757e-3449-454c-a04d-7cb0e89cddd3 on nch2-master-1 Jan 22 22:32:30.136642 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-6b63fccd-6232-4d56-8bf7-8915f70e09f8 req-43e31664-781a-48ba-8df2-f9de5b1d1e7a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116493 Jan 22 22:32:30.137252 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5001/9706] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:32:31.075634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-9f82f665-433b-46ab-a938-015987ff946d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:31.076241 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-9f82f665-433b-46ab-a938-015987ff946d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:31.082263 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f82f665-433b-46ab-a938-015987ff946d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:31.082713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f82f665-433b-46ab-a938-015987ff946d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:31.083485 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f82f665-433b-46ab-a938-015987ff946d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:31.083923 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-9f82f665-433b-46ab-a938-015987ff946d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:31.221493 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-9f82f665-433b-46ab-a938-015987ff946d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:31.230345 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-9f82f665-433b-46ab-a938-015987ff946d tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1263 microversion: 2.1 time: 0.158533 Jan 22 22:32:31.230926 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4706/9707] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:31 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:32.250048 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0e785bdd-f010-48f9-abec-5042129b307e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:32.250766 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0e785bdd-f010-48f9-abec-5042129b307e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:32.257454 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e785bdd-f010-48f9-abec-5042129b307e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:32.258002 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e785bdd-f010-48f9-abec-5042129b307e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:32.258794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e785bdd-f010-48f9-abec-5042129b307e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:32.259243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0e785bdd-f010-48f9-abec-5042129b307e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:32.403419 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0e785bdd-f010-48f9-abec-5042129b307e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:32.411092 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0e785bdd-f010-48f9-abec-5042129b307e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1263 microversion: 2.1 time: 0.166003 Jan 22 22:32:32.411671 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5002/9708] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:32 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:33.428045 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-17ef2229-d67f-482d-81f0-cb56acfdc90f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:33.429302 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-17ef2229-d67f-482d-81f0-cb56acfdc90f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:33.436041 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17ef2229-d67f-482d-81f0-cb56acfdc90f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:33.436489 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17ef2229-d67f-482d-81f0-cb56acfdc90f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:33.437266 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17ef2229-d67f-482d-81f0-cb56acfdc90f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:33.437751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-17ef2229-d67f-482d-81f0-cb56acfdc90f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:33.580198 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-17ef2229-d67f-482d-81f0-cb56acfdc90f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:33.588179 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-17ef2229-d67f-482d-81f0-cb56acfdc90f tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1263 microversion: 2.1 time: 0.163846 Jan 22 22:32:33.588749 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4707/9709] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:33 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:34.605346 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-b6c5cfc1-9ce3-4584-9b86-21213ffcb8b1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:34.605991 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-b6c5cfc1-9ce3-4584-9b86-21213ffcb8b1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:34.612388 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6c5cfc1-9ce3-4584-9b86-21213ffcb8b1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:34.612870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6c5cfc1-9ce3-4584-9b86-21213ffcb8b1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:34.613712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6c5cfc1-9ce3-4584-9b86-21213ffcb8b1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:34.614179 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-b6c5cfc1-9ce3-4584-9b86-21213ffcb8b1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:34.748795 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-b6c5cfc1-9ce3-4584-9b86-21213ffcb8b1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:34.756255 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-b6c5cfc1-9ce3-4584-9b86-21213ffcb8b1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1263 microversion: 2.1 time: 0.154738 Jan 22 22:32:34.756926 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5003/9710] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:34 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:35.773681 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-fe418d00-763c-4b99-9022-927741b461b0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:35.774829 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-fe418d00-763c-4b99-9022-927741b461b0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:35.781199 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe418d00-763c-4b99-9022-927741b461b0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:35.781698 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe418d00-763c-4b99-9022-927741b461b0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:35.782577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe418d00-763c-4b99-9022-927741b461b0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:35.783033 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-fe418d00-763c-4b99-9022-927741b461b0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:35.919553 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-fe418d00-763c-4b99-9022-927741b461b0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:35.927225 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-fe418d00-763c-4b99-9022-927741b461b0 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1263 microversion: 2.1 time: 0.158028 Jan 22 22:32:35.927796 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4708/9711] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:35 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:36.944446 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-784a63b5-1cc6-4fba-8e43-fd168d3f05fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:36.945967 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-784a63b5-1cc6-4fba-8e43-fd168d3f05fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:36.952682 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-784a63b5-1cc6-4fba-8e43-fd168d3f05fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:36.953155 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-784a63b5-1cc6-4fba-8e43-fd168d3f05fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:36.954000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-784a63b5-1cc6-4fba-8e43-fd168d3f05fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:36.954481 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-784a63b5-1cc6-4fba-8e43-fd168d3f05fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:37.091598 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-784a63b5-1cc6-4fba-8e43-fd168d3f05fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:37.099006 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-784a63b5-1cc6-4fba-8e43-fd168d3f05fd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1263 microversion: 2.1 time: 0.158993 Jan 22 22:32:37.099600 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5004/9712] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:36 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:38.122404 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-f6aa8546-4a96-4563-8554-45310c0be884 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:38.123007 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-f6aa8546-4a96-4563-8554-45310c0be884 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:38.129697 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6aa8546-4a96-4563-8554-45310c0be884 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:38.130155 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6aa8546-4a96-4563-8554-45310c0be884 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:38.130928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6aa8546-4a96-4563-8554-45310c0be884 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:38.131908 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-f6aa8546-4a96-4563-8554-45310c0be884 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:38.270424 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-f6aa8546-4a96-4563-8554-45310c0be884 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:38.278149 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-f6aa8546-4a96-4563-8554-45310c0be884 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1263 microversion: 2.1 time: 0.159467 Jan 22 22:32:38.282449 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4709/9713] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:38 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:38.520620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-31e45148-d5dd-4470-86ca-298f114cc581 req-4e3db2c2-6c16-493d-86fc-986b98e9ec18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afaf757e-3449-454c-a04d-7cb0e89cddd3", "name": "network-vif-plugged", "status": "completed", "tag": "67eaee44-6909-4944-958a-ff2727c23570"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:32:38.522786 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:32:38.522786 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:32:38.530091 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-31e45148-d5dd-4470-86ca-298f114cc581 req-4e3db2c2-6c16-493d-86fc-986b98e9ec18 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:38.530551 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-31e45148-d5dd-4470-86ca-298f114cc581 req-4e3db2c2-6c16-493d-86fc-986b98e9ec18 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:38.542573 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-31e45148-d5dd-4470-86ca-298f114cc581 req-4e3db2c2-6c16-493d-86fc-986b98e9ec18 service nova] Creating event network-vif-plugged:67eaee44-6909-4944-958a-ff2727c23570 for instance afaf757e-3449-454c-a04d-7cb0e89cddd3 on nch2-master-1 Jan 22 22:32:38.547535 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-31e45148-d5dd-4470-86ca-298f114cc581 req-4e3db2c2-6c16-493d-86fc-986b98e9ec18 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080234 Jan 22 22:32:38.548192 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5005/9714] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:32:39.294392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-21fd6565-441f-4ae2-b53d-2312898a0d35 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:39.295027 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-21fd6565-441f-4ae2-b53d-2312898a0d35 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:39.301768 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21fd6565-441f-4ae2-b53d-2312898a0d35 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:39.302165 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21fd6565-441f-4ae2-b53d-2312898a0d35 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:39.302946 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21fd6565-441f-4ae2-b53d-2312898a0d35 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:39.303940 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-21fd6565-441f-4ae2-b53d-2312898a0d35 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:39.438652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-21fd6565-441f-4ae2-b53d-2312898a0d35 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:39.446968 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-21fd6565-441f-4ae2-b53d-2312898a0d35 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1263 microversion: 2.1 time: 0.156276 Jan 22 22:32:39.447523 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4710/9715] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:39 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:40.465870 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-12cd5eac-c50c-4beb-a961-0bb486c81575 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:40.466613 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-12cd5eac-c50c-4beb-a961-0bb486c81575 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:40.472883 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12cd5eac-c50c-4beb-a961-0bb486c81575 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:40.473351 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12cd5eac-c50c-4beb-a961-0bb486c81575 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:40.474252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12cd5eac-c50c-4beb-a961-0bb486c81575 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:40.474711 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-12cd5eac-c50c-4beb-a961-0bb486c81575 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:40.608347 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-12cd5eac-c50c-4beb-a961-0bb486c81575 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:40.615853 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-12cd5eac-c50c-4beb-a961-0bb486c81575 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1446 microversion: 2.1 time: 0.155177 Jan 22 22:32:40.616522 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5006/9716] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:40 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1446 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:40.632628 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8b84f149-e5aa-4e80-9f44-9b5cf9d32436 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:32:40.633346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8b84f149-e5aa-4e80-9f44-9b5cf9d32436 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:32:40.640311 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b84f149-e5aa-4e80-9f44-9b5cf9d32436 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:40.640692 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b84f149-e5aa-4e80-9f44-9b5cf9d32436 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:40.641482 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b84f149-e5aa-4e80-9f44-9b5cf9d32436 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:40.641951 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8b84f149-e5aa-4e80-9f44-9b5cf9d32436 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:40.773515 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8b84f149-e5aa-4e80-9f44-9b5cf9d32436 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:32:40.781002 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8b84f149-e5aa-4e80-9f44-9b5cf9d32436 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1446 microversion: 2.1 time: 0.153058 Jan 22 22:32:40.781595 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4711/9717] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:32:40 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1446 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:32:43.039408 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-1fea8c42-3ab9-41cd-a27f-b0ffa22404f4 req-fedf37d5-5f16-4fd6-9399-0dda2244fe21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afaf757e-3449-454c-a04d-7cb0e89cddd3", "tag": "67eaee44-6909-4944-958a-ff2727c23570"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:32:43.039408 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:32:43.039408 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:32:43.045131 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1fea8c42-3ab9-41cd-a27f-b0ffa22404f4 req-fedf37d5-5f16-4fd6-9399-0dda2244fe21 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:32:43.045633 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1fea8c42-3ab9-41cd-a27f-b0ffa22404f4 req-fedf37d5-5f16-4fd6-9399-0dda2244fe21 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:32:43.057259 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-1fea8c42-3ab9-41cd-a27f-b0ffa22404f4 req-fedf37d5-5f16-4fd6-9399-0dda2244fe21 service nova] Creating event network-changed:67eaee44-6909-4944-958a-ff2727c23570 for instance afaf757e-3449-454c-a04d-7cb0e89cddd3 on nch2-master-1 Jan 22 22:32:43.062535 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-1fea8c42-3ab9-41cd-a27f-b0ffa22404f4 req-fedf37d5-5f16-4fd6-9399-0dda2244fe21 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030690 Jan 22 22:32:43.063337 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5007/9718] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:33:14.732592 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:33:14.733256 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:33:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:34:55.061698 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:34:55.062425 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:34:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:35:10.351382 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:35:10.351958 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:35:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:36:05.013190 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [-] [913664d8-58d1-4bc9-a0cb-33264365d7dc] AMQP server on 10.222.0.100:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 22 22:36:05.014409 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5c65b53b-7dc4-496f-937e-a7dc1df2041e] AMQP server on 10.222.0.100:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 22 22:36:05.017934 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6baa1b2f-d49f-4ebc-91e8-4a30336aa35a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:36:05.019937 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6baa1b2f-d49f-4ebc-91e8-4a30336aa35a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:05.026197 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6baa1b2f-d49f-4ebc-91e8-4a30336aa35a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:05.026652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6baa1b2f-d49f-4ebc-91e8-4a30336aa35a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:05.027435 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6baa1b2f-d49f-4ebc-91e8-4a30336aa35a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:05.027875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6baa1b2f-d49f-4ebc-91e8-4a30336aa35a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:06.022354 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] [913664d8-58d1-4bc9-a0cb-33264365d7dc] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 34796. Jan 22 22:36:06.023085 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] [5c65b53b-7dc4-496f-937e-a7dc1df2041e] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 34798. Jan 22 22:36:06.027191 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6baa1b2f-d49f-4ebc-91e8-4a30336aa35a tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "POST /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3/action" status: 200 len: 24563 microversion: 2.1 time: 1.015850 Jan 22 22:36:06.030183 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4712/9719] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:36:05 2022] POST /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3/action => generated 24563 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 22 22:36:06.984834 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edc45ac6-e555-423c-baf2-d131dfc2b608] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 22:36:06.985711 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7ed686d-6f24-47e8-978c-4287ce754ef2] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 22:36:06.990365 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:06.991336 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:06.998753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:07.000821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:07.000821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:07.000821 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:07.032463 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Going to try to terminate instance {{(pid=137032) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:36:07.049346 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-7df4f4e8-355f-4b16-84cc-0839e4702e26 req-d27cc8ff-4950-4200-9497-6797d775e5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afaf757e-3449-454c-a04d-7cb0e89cddd3", "tag": "67eaee44-6909-4944-958a-ff2727c23570"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:36:07.051271 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:36:07.051271 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:36:07.059694 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7df4f4e8-355f-4b16-84cc-0839e4702e26 req-d27cc8ff-4950-4200-9497-6797d775e5c8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:07.060379 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-7df4f4e8-355f-4b16-84cc-0839e4702e26 req-d27cc8ff-4950-4200-9497-6797d775e5c8 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:07.072190 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-7df4f4e8-355f-4b16-84cc-0839e4702e26 req-d27cc8ff-4950-4200-9497-6797d775e5c8 service nova] Creating event network-changed:67eaee44-6909-4944-958a-ff2727c23570 for instance afaf757e-3449-454c-a04d-7cb0e89cddd3 on nch2-master-1 Jan 22 22:36:07.077667 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-7df4f4e8-355f-4b16-84cc-0839e4702e26 req-d27cc8ff-4950-4200-9497-6797d775e5c8 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093036 Jan 22 22:36:07.078527 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4713/9720] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:36:07.491161 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-bfae310e-4fe0-4c0c-9ab0-ee42aed66352 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "DELETE /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 204 len: 0 microversion: 2.1 time: 0.508452 Jan 22 22:36:07.500201 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5008/9721] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:36:06 2022] DELETE /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:36:07.501023 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-67435ccc-2fc5-4632-97cb-ae79884c02c1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:07.501755 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-67435ccc-2fc5-4632-97cb-ae79884c02c1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:07.508367 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67435ccc-2fc5-4632-97cb-ae79884c02c1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:07.508826 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67435ccc-2fc5-4632-97cb-ae79884c02c1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:07.509652 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67435ccc-2fc5-4632-97cb-ae79884c02c1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:07.510275 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-67435ccc-2fc5-4632-97cb-ae79884c02c1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:07.655636 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-67435ccc-2fc5-4632-97cb-ae79884c02c1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:07.663943 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-67435ccc-2fc5-4632-97cb-ae79884c02c1 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1570 microversion: 2.1 time: 0.167346 Jan 22 22:36:07.664522 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4714/9722] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:07 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:08.683668 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-13a8b2a7-08b5-46f1-b261-0ef4f1ddb52e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:08.684296 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-13a8b2a7-08b5-46f1-b261-0ef4f1ddb52e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:08.696376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13a8b2a7-08b5-46f1-b261-0ef4f1ddb52e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:08.696854 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13a8b2a7-08b5-46f1-b261-0ef4f1ddb52e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:08.697689 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13a8b2a7-08b5-46f1-b261-0ef4f1ddb52e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:08.698151 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-13a8b2a7-08b5-46f1-b261-0ef4f1ddb52e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:08.704289 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] [edc45ac6-e555-423c-baf2-d131dfc2b608] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 34816. Jan 22 22:36:08.715482 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7ed686d-6f24-47e8-978c-4287ce754ef2] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 34818. Jan 22 22:36:08.896150 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-13a8b2a7-08b5-46f1-b261-0ef4f1ddb52e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:08.903687 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-13a8b2a7-08b5-46f1-b261-0ef4f1ddb52e tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1452 microversion: 2.1 time: 0.224223 Jan 22 22:36:08.904251 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5009/9723] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:08 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1452 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:09.840865 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-aa40b0b7-b0b1-4d74-a899-23e952aa7222 req-9e1cf020-cf1f-46ee-85d5-a36021a4e11f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afaf757e-3449-454c-a04d-7cb0e89cddd3", "name": "network-vif-deleted", "tag": "67eaee44-6909-4944-958a-ff2727c23570"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:36:09.842434 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:36:09.842434 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:36:09.851591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-aa40b0b7-b0b1-4d74-a899-23e952aa7222 req-9e1cf020-cf1f-46ee-85d5-a36021a4e11f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:09.852038 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-aa40b0b7-b0b1-4d74-a899-23e952aa7222 req-9e1cf020-cf1f-46ee-85d5-a36021a4e11f service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:09.867032 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-aa40b0b7-b0b1-4d74-a899-23e952aa7222 req-9e1cf020-cf1f-46ee-85d5-a36021a4e11f service nova] Creating event network-vif-deleted:67eaee44-6909-4944-958a-ff2727c23570 for instance afaf757e-3449-454c-a04d-7cb0e89cddd3 on nch2-master-1 Jan 22 22:36:09.875204 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-aa40b0b7-b0b1-4d74-a899-23e952aa7222 req-9e1cf020-cf1f-46ee-85d5-a36021a4e11f service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037888 Jan 22 22:36:09.875872 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4715/9724] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:36:09.923177 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8456557f-b230-4b1c-aea3-cff95c783470 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:09.923823 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8456557f-b230-4b1c-aea3-cff95c783470 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:09.931421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8456557f-b230-4b1c-aea3-cff95c783470 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:09.931892 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8456557f-b230-4b1c-aea3-cff95c783470 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:09.932712 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8456557f-b230-4b1c-aea3-cff95c783470 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:09.933170 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8456557f-b230-4b1c-aea3-cff95c783470 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:10.027802 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8456557f-b230-4b1c-aea3-cff95c783470 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:10.037202 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8456557f-b230-4b1c-aea3-cff95c783470 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1384 microversion: 2.1 time: 0.118894 Jan 22 22:36:10.037767 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5010/9725] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:09 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1384 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:11.057181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b56215c2-2d1f-4862-9853-1a6620e8bed2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:11.057894 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b56215c2-2d1f-4862-9853-1a6620e8bed2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:11.064342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b56215c2-2d1f-4862-9853-1a6620e8bed2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:11.065411 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b56215c2-2d1f-4862-9853-1a6620e8bed2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:11.066286 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b56215c2-2d1f-4862-9853-1a6620e8bed2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:11.066728 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b56215c2-2d1f-4862-9853-1a6620e8bed2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:11.097762 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b56215c2-2d1f-4862-9853-1a6620e8bed2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:11.098211 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b56215c2-2d1f-4862-9853-1a6620e8bed2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:11.098661 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.objects.instance [None req-b56215c2-2d1f-4862-9853-1a6620e8bed2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lazy-loading 'fault' on Instance uuid afaf757e-3449-454c-a04d-7cb0e89cddd3 {{(pid=137033) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 22 22:36:11.139645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-b56215c2-2d1f-4862-9853-1a6620e8bed2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e377dada2c4e44ed9749fd92ec9d29ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe266ea1db64cb8ad21a3f40b9f0cf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:11.147275 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b56215c2-2d1f-4862-9853-1a6620e8bed2 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 200 len: 1227 microversion: 2.1 time: 0.094938 Jan 22 22:36:11.147842 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4716/9726] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:11 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 1227 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:12.164818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a56e8709-0323-4820-ae64-8055fc318d59 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:12.165438 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a56e8709-0323-4820-ae64-8055fc318d59 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] [instance: afaf757e-3449-454c-a04d-7cb0e89cddd3] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:12.172306 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a56e8709-0323-4820-ae64-8055fc318d59 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:12.172771 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a56e8709-0323-4820-ae64-8055fc318d59 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:12.173585 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a56e8709-0323-4820-ae64-8055fc318d59 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:12.174038 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a56e8709-0323-4820-ae64-8055fc318d59 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:12.187907 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-a56e8709-0323-4820-ae64-8055fc318d59 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] HTTP exception thrown: Instance afaf757e-3449-454c-a04d-7cb0e89cddd3 could not be found. Jan 22 22:36:12.188503 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a56e8709-0323-4820-ae64-8055fc318d59 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Returning 404 to user: Instance afaf757e-3449-454c-a04d-7cb0e89cddd3 could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:36:12.189652 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a56e8709-0323-4820-ae64-8055fc318d59 tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3" status: 404 len: 111 microversion: 2.1 time: 0.028356 Jan 22 22:36:12.193199 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5011/9727] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:12 2022] GET /compute/v2.1/servers/afaf757e-3449-454c-a04d-7cb0e89cddd3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:36:12.732629 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b01d98ec-6fba-4b00-bd99-de3378cd89cd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] Calling method '.version_select at 0x7f1ed490e310>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:12.858073 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b01d98ec-6fba-4b00-bd99-de3378cd89cd tempest-TestShelveInstance-355964544 tempest-TestShelveInstance-355964544-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-379541643" status: 202 len: 0 microversion: 2.1 time: 0.129100 Jan 22 22:36:12.858575 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4717/9728] 10.222.0.100 () {58 vars in 1255 bytes} [Sat Jan 22 22:36:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-379541643 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:36:34.741045 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:36:34.741686 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:36:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:36:35.053240 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-4d99f4c6-7853-4516-98b2-bdf0bfa0898e tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Action: 'create', calling method: .version_select at 0x7f1ed5ef79d0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-486558719"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:36:35.069353 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-4d99f4c6-7853-4516-98b2-bdf0bfa0898e tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Getting quotas for project f9292458261d44258ffafe58e92393ed. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:36:35.074632 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-4d99f4c6-7853-4516-98b2-bdf0bfa0898e tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Getting quotas for user ae576def5e8d429996b8ea20a75f308e and project f9292458261d44258ffafe58e92393ed. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:36:35.441886 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-4d99f4c6-7853-4516-98b2-bdf0bfa0898e tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Getting quotas for project f9292458261d44258ffafe58e92393ed. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:36:35.446924 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-4d99f4c6-7853-4516-98b2-bdf0bfa0898e tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Getting quotas for user ae576def5e8d429996b8ea20a75f308e and project f9292458261d44258ffafe58e92393ed. Resources: {'key_pairs'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:36:35.462883 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-4d99f4c6-7853-4516-98b2-bdf0bfa0898e tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.576509 Jan 22 22:36:35.463494 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5012/9729] 10.222.0.100 () {60 vars in 1162 bytes} [Sat Jan 22 22:36:34 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:37.951231 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1609359835", "imageRef": "373cb480-3bc4-4821-93e2-442b4e852b80", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-486558719", "security_groups": [{"name": "tempest-secgroup-smoke-852283943"}], "networks": [{"uuid": "99573483-cbe4-4189-9d4f-418f987e2d54"}]}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:36:38.066516 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.network.neutron [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] validate_networks() for [('99573483-cbe4-4189-9d4f-418f987e2d54', None, None, None, None, None)] {{(pid=137033) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:36:38.586960 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Flavor limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:36:38.587389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Image limits 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:36:38.587866 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Flavor pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:36:38.588490 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Image pref 0:0:0 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:36:38.588904 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.virt.hardware [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137033) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:36:38.599660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:38.600389 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:38.601399 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:38.601874 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:38.620891 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Getting quotas for project f9292458261d44258ffafe58e92393ed. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:36:38.626373 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.quota [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Getting quotas for user ae576def5e8d429996b8ea20a75f308e and project f9292458261d44258ffafe58e92393ed. Resources: {'cores', 'instances', 'ram'} {{(pid=137033) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:36:38.639176 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Going to run 1 instances... {{(pid=137033) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:36:38.641837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='373cb480-3bc4-4821-93e2-442b4e852b80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137033) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:36:38.755581 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-af263dd8-e1fe-410c-a568-57110e7f24fe tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.809188 Jan 22 22:36:38.756252 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4718/9730] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:36:37 2022] POST /compute/v2.1/servers => generated 407 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 22:36:38.767087 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-20fe498a-9021-452d-8b4e-20b0c870e1cb tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:38.767906 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-20fe498a-9021-452d-8b4e-20b0c870e1cb tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:38.832818 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-20fe498a-9021-452d-8b4e-20b0c870e1cb tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:38.840091 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-20fe498a-9021-452d-8b4e-20b0c870e1cb tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 200 len: 1252 microversion: 2.1 time: 0.077686 Jan 22 22:36:38.840673 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5013/9731] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:38 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 1252 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:39.858265 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-094883f8-ea54-4e33-b84b-4ec97be01980 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:39.858898 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-094883f8-ea54-4e33-b84b-4ec97be01980 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:39.912102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-094883f8-ea54-4e33-b84b-4ec97be01980 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:39.919703 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-094883f8-ea54-4e33-b84b-4ec97be01980 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 200 len: 1252 microversion: 2.1 time: 0.065458 Jan 22 22:36:39.920243 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4719/9732] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:39 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 1252 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:40.936243 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2d89c114-cce5-4435-ac2d-f2c3703efcee tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:40.936861 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2d89c114-cce5-4435-ac2d-f2c3703efcee tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:40.945225 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d89c114-cce5-4435-ac2d-f2c3703efcee tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:40.945736 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d89c114-cce5-4435-ac2d-f2c3703efcee tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:40.946553 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d89c114-cce5-4435-ac2d-f2c3703efcee tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:40.947137 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2d89c114-cce5-4435-ac2d-f2c3703efcee tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:41.007805 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2d89c114-cce5-4435-ac2d-f2c3703efcee tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:41.015477 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2d89c114-cce5-4435-ac2d-f2c3703efcee tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 200 len: 1304 microversion: 2.1 time: 0.083009 Jan 22 22:36:41.019005 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5014/9733] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:40 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 1304 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:42.032220 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-3d6985af-45d3-42c7-b4b2-2a46e701908a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:42.032889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-3d6985af-45d3-42c7-b4b2-2a46e701908a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:42.044196 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d6985af-45d3-42c7-b4b2-2a46e701908a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:42.044660 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d6985af-45d3-42c7-b4b2-2a46e701908a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:42.045730 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d6985af-45d3-42c7-b4b2-2a46e701908a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:42.046181 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-3d6985af-45d3-42c7-b4b2-2a46e701908a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:42.189751 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-3d6985af-45d3-42c7-b4b2-2a46e701908a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:42.197302 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-3d6985af-45d3-42c7-b4b2-2a46e701908a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 200 len: 1377 microversion: 2.1 time: 0.168804 Jan 22 22:36:42.197829 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4720/9734] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:42 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 1377 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:42.757958 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-43aabce2-cc15-45a6-b614-cd38b0c93f5c req-8bc04c06-9ff6-4040-bab6-61e5663e242a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1782fc3d-3b9b-4b33-b930-5e9d5bd872ab", "tag": "5856dfc5-f02c-4f51-b409-169c3fb3a0e0"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:36:42.759576 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:36:42.759576 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:36:42.768835 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-43aabce2-cc15-45a6-b614-cd38b0c93f5c req-8bc04c06-9ff6-4040-bab6-61e5663e242a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:42.769392 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-43aabce2-cc15-45a6-b614-cd38b0c93f5c req-8bc04c06-9ff6-4040-bab6-61e5663e242a service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:42.781328 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-43aabce2-cc15-45a6-b614-cd38b0c93f5c req-8bc04c06-9ff6-4040-bab6-61e5663e242a service nova] Creating event network-changed:5856dfc5-f02c-4f51-b409-169c3fb3a0e0 for instance 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab on nch2-master-1 Jan 22 22:36:42.787451 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-43aabce2-cc15-45a6-b614-cd38b0c93f5c req-8bc04c06-9ff6-4040-bab6-61e5663e242a service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033557 Jan 22 22:36:42.788494 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5015/9735] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:36:43.213774 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-69e8c298-3d0e-4514-aae9-67827008c9ac tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:43.214587 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-69e8c298-3d0e-4514-aae9-67827008c9ac tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:43.223524 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69e8c298-3d0e-4514-aae9-67827008c9ac tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:43.223991 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69e8c298-3d0e-4514-aae9-67827008c9ac tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:43.224871 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69e8c298-3d0e-4514-aae9-67827008c9ac tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:43.225392 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-69e8c298-3d0e-4514-aae9-67827008c9ac tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:43.380447 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-69e8c298-3d0e-4514-aae9-67827008c9ac tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:43.392653 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-69e8c298-3d0e-4514-aae9-67827008c9ac tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 200 len: 1377 microversion: 2.1 time: 0.182629 Jan 22 22:36:43.393256 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4721/9736] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:43 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 1377 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:44.411744 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2508c2b9-9b22-4918-a379-3f912b9dd6aa tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:44.412495 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2508c2b9-9b22-4918-a379-3f912b9dd6aa tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:44.418797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2508c2b9-9b22-4918-a379-3f912b9dd6aa tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:44.419266 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2508c2b9-9b22-4918-a379-3f912b9dd6aa tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:44.420069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2508c2b9-9b22-4918-a379-3f912b9dd6aa tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:44.420531 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2508c2b9-9b22-4918-a379-3f912b9dd6aa tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:44.564370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2508c2b9-9b22-4918-a379-3f912b9dd6aa tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:44.572039 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2508c2b9-9b22-4918-a379-3f912b9dd6aa tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 200 len: 1377 microversion: 2.1 time: 0.166051 Jan 22 22:36:44.572642 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5016/9737] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:44 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 1377 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:45.588070 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-30319f64-0687-4e47-b412-ff605a204bf7 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:45.588687 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-30319f64-0687-4e47-b412-ff605a204bf7 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:45.595497 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30319f64-0687-4e47-b412-ff605a204bf7 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:45.596616 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30319f64-0687-4e47-b412-ff605a204bf7 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:45.597418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30319f64-0687-4e47-b412-ff605a204bf7 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:45.597889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-30319f64-0687-4e47-b412-ff605a204bf7 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:45.729924 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-30319f64-0687-4e47-b412-ff605a204bf7 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:45.737296 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-30319f64-0687-4e47-b412-ff605a204bf7 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 200 len: 1377 microversion: 2.1 time: 0.152933 Jan 22 22:36:45.737894 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4722/9738] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:45 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 1377 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:46.754208 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-09ff16e7-7ec1-4491-9e37-dec4321a8950 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:46.754871 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-09ff16e7-7ec1-4491-9e37-dec4321a8950 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:46.761750 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09ff16e7-7ec1-4491-9e37-dec4321a8950 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:46.762227 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09ff16e7-7ec1-4491-9e37-dec4321a8950 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:46.763034 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09ff16e7-7ec1-4491-9e37-dec4321a8950 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:46.763496 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-09ff16e7-7ec1-4491-9e37-dec4321a8950 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:46.897403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-09ff16e7-7ec1-4491-9e37-dec4321a8950 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:46.904734 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-09ff16e7-7ec1-4491-9e37-dec4321a8950 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 200 len: 1377 microversion: 2.1 time: 0.154976 Jan 22 22:36:46.905293 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5017/9739] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:46 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 1377 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:47.922116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d9eb2ecc-f00b-44db-8c7c-f60a7070ae91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:47.922664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d9eb2ecc-f00b-44db-8c7c-f60a7070ae91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:47.929928 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9eb2ecc-f00b-44db-8c7c-f60a7070ae91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:47.931593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9eb2ecc-f00b-44db-8c7c-f60a7070ae91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:47.931593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9eb2ecc-f00b-44db-8c7c-f60a7070ae91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:47.931593 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d9eb2ecc-f00b-44db-8c7c-f60a7070ae91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:48.070544 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d9eb2ecc-f00b-44db-8c7c-f60a7070ae91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:48.078066 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d9eb2ecc-f00b-44db-8c7c-f60a7070ae91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 200 len: 1377 microversion: 2.1 time: 0.159743 Jan 22 22:36:48.078640 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4723/9740] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:47 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 1377 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:49.095272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8509feff-edd0-4bcd-b40b-2837874cebec tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:49.095942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8509feff-edd0-4bcd-b40b-2837874cebec tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:49.102790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8509feff-edd0-4bcd-b40b-2837874cebec tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:49.103263 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8509feff-edd0-4bcd-b40b-2837874cebec tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:49.104069 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8509feff-edd0-4bcd-b40b-2837874cebec tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:49.104533 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8509feff-edd0-4bcd-b40b-2837874cebec tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:49.239638 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8509feff-edd0-4bcd-b40b-2837874cebec tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:49.247039 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8509feff-edd0-4bcd-b40b-2837874cebec tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 200 len: 1377 microversion: 2.1 time: 0.155474 Jan 22 22:36:49.247622 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5018/9741] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:49 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 1377 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:49.808080 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-c07190bf-fd21-4506-834e-61f9c2da6642 req-1bc897d4-e989-48d4-afbc-d76505e3e04d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1782fc3d-3b9b-4b33-b930-5e9d5bd872ab", "name": "network-vif-plugged", "status": "completed", "tag": "5856dfc5-f02c-4f51-b409-169c3fb3a0e0"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:36:49.809742 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:36:49.809742 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:36:49.819036 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c07190bf-fd21-4506-834e-61f9c2da6642 req-1bc897d4-e989-48d4-afbc-d76505e3e04d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:49.819491 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-c07190bf-fd21-4506-834e-61f9c2da6642 req-1bc897d4-e989-48d4-afbc-d76505e3e04d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:49.830555 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-c07190bf-fd21-4506-834e-61f9c2da6642 req-1bc897d4-e989-48d4-afbc-d76505e3e04d service nova] Creating event network-vif-plugged:5856dfc5-f02c-4f51-b409-169c3fb3a0e0 for instance 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab on nch2-master-1 Jan 22 22:36:49.836797 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-c07190bf-fd21-4506-834e-61f9c2da6642 req-1bc897d4-e989-48d4-afbc-d76505e3e04d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032576 Jan 22 22:36:49.837410 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4724/9742] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:36:50.264110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-404dd24c-9735-4e02-bd3e-15ead54edc10 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:50.264739 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-404dd24c-9735-4e02-bd3e-15ead54edc10 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:50.272062 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-404dd24c-9735-4e02-bd3e-15ead54edc10 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:50.272532 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-404dd24c-9735-4e02-bd3e-15ead54edc10 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:50.273334 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-404dd24c-9735-4e02-bd3e-15ead54edc10 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:50.273830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-404dd24c-9735-4e02-bd3e-15ead54edc10 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:50.407751 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-404dd24c-9735-4e02-bd3e-15ead54edc10 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:50.415382 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-404dd24c-9735-4e02-bd3e-15ead54edc10 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 200 len: 1377 microversion: 2.1 time: 0.154965 Jan 22 22:36:50.415968 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5019/9743] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:50 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 1377 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:51.432589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-45b5c8e3-3562-4b25-85c5-2604336c4ece tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:51.433298 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-45b5c8e3-3562-4b25-85c5-2604336c4ece tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:51.440770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45b5c8e3-3562-4b25-85c5-2604336c4ece tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:51.441225 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45b5c8e3-3562-4b25-85c5-2604336c4ece tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:51.442039 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45b5c8e3-3562-4b25-85c5-2604336c4ece tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:51.442481 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-45b5c8e3-3562-4b25-85c5-2604336c4ece tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:51.579507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-45b5c8e3-3562-4b25-85c5-2604336c4ece tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:51.587689 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-45b5c8e3-3562-4b25-85c5-2604336c4ece tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 200 len: 1563 microversion: 2.1 time: 0.159186 Jan 22 22:36:51.588257 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4725/9744] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:51 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:51.604366 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ca6b0b3e-ae02-424f-bbab-91580e51827d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:36:51.605060 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ca6b0b3e-ae02-424f-bbab-91580e51827d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:36:51.611955 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca6b0b3e-ae02-424f-bbab-91580e51827d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:51.612569 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca6b0b3e-ae02-424f-bbab-91580e51827d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:51.613384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca6b0b3e-ae02-424f-bbab-91580e51827d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:51.613882 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ca6b0b3e-ae02-424f-bbab-91580e51827d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:51.750753 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ca6b0b3e-ae02-424f-bbab-91580e51827d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:36:51.758399 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ca6b0b3e-ae02-424f-bbab-91580e51827d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 200 len: 1563 microversion: 2.1 time: 0.157760 Jan 22 22:36:51.766716 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5020/9745] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:36:51 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:36:54.057855 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-67cd7f56-c586-4399-a3bc-2ecdebc28d31 req-6f480a60-d44a-4bda-8c46-8903d7bc3ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1782fc3d-3b9b-4b33-b930-5e9d5bd872ab", "tag": "5856dfc5-f02c-4f51-b409-169c3fb3a0e0"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:36:54.063839 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:36:54.063839 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:36:54.068201 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-67cd7f56-c586-4399-a3bc-2ecdebc28d31 req-6f480a60-d44a-4bda-8c46-8903d7bc3ede service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:36:54.068651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-67cd7f56-c586-4399-a3bc-2ecdebc28d31 req-6f480a60-d44a-4bda-8c46-8903d7bc3ede service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:36:54.079865 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-67cd7f56-c586-4399-a3bc-2ecdebc28d31 req-6f480a60-d44a-4bda-8c46-8903d7bc3ede service nova] Creating event network-changed:5856dfc5-f02c-4f51-b409-169c3fb3a0e0 for instance 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab on nch2-master-1 Jan 22 22:36:54.084929 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-67cd7f56-c586-4399-a3bc-2ecdebc28d31 req-6f480a60-d44a-4bda-8c46-8903d7bc3ede service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030825 Jan 22 22:36:54.085748 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4726/9746] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:38:13.944433 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:38:13.945247 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:38:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:39:20.077450 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [-] [edc45ac6-e555-423c-baf2-d131dfc2b608] AMQP server on 10.222.0.100:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 22 22:39:20.078472 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a7ed686d-6f24-47e8-978c-4287ce754ef2] AMQP server on 10.222.0.100:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 22 22:39:20.082252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c7a4002d-3ccc-477a-ac49-d5a0c9018486 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-347162815"}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:39:20.083273 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-c7a4002d-3ccc-477a-ac49-d5a0c9018486 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:20.090129 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7a4002d-3ccc-477a-ac49-d5a0c9018486 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:20.090608 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7a4002d-3ccc-477a-ac49-d5a0c9018486 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:20.091417 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7a4002d-3ccc-477a-ac49-d5a0c9018486 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:20.091880 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-c7a4002d-3ccc-477a-ac49-d5a0c9018486 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:20.588200 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c7a4002d-3ccc-477a-ac49-d5a0c9018486 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "POST /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab/action" status: 202 len: 0 microversion: 2.1 time: 0.511946 Jan 22 22:39:20.588841 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5021/9747] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:39:20 2022] POST /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 22 22:39:28.620413 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5c65b53b-7dc4-496f-937e-a7dc1df2041e] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 22:39:28.621252 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [-] [913664d8-58d1-4bc9-a0cb-33264365d7dc] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 22:39:28.698159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-98031840-d7d2-439a-bdf5-132cd5c2de30 req-437db516-2914-4323-b0ae-34ca906df8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1782fc3d-3b9b-4b33-b930-5e9d5bd872ab", "name": "network-vif-plugged", "status": "completed", "tag": "5856dfc5-f02c-4f51-b409-169c3fb3a0e0"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:39:28.699742 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:39:28.699742 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:39:28.707654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-98031840-d7d2-439a-bdf5-132cd5c2de30 req-437db516-2914-4323-b0ae-34ca906df8af service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:28.708112 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-98031840-d7d2-439a-bdf5-132cd5c2de30 req-437db516-2914-4323-b0ae-34ca906df8af service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:28.719451 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-98031840-d7d2-439a-bdf5-132cd5c2de30 req-437db516-2914-4323-b0ae-34ca906df8af service nova] Creating event network-vif-plugged:5856dfc5-f02c-4f51-b409-169c3fb3a0e0 for instance 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab on nch2-master-1 Jan 22 22:39:28.722929 ncdv-master-1 devstack@n-api.service[137033]: ERROR oslo.messaging._drivers.impl_rabbit [req-98031840-d7d2-439a-bdf5-132cd5c2de30 req-437db516-2914-4323-b0ae-34ca906df8af service nova] [f962eaa4-b2c4-4269-b24d-bd2b807893d1] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 22:39:29.631010 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] [913664d8-58d1-4bc9-a0cb-33264365d7dc] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 35254. Jan 22 22:39:29.631982 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] [5c65b53b-7dc4-496f-937e-a7dc1df2041e] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 35252. Jan 22 22:39:29.732281 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [req-98031840-d7d2-439a-bdf5-132cd5c2de30 req-437db516-2914-4323-b0ae-34ca906df8af service nova] [f962eaa4-b2c4-4269-b24d-bd2b807893d1] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 35256. Jan 22 22:39:29.735814 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-98031840-d7d2-439a-bdf5-132cd5c2de30 req-437db516-2914-4323-b0ae-34ca906df8af service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.118023 Jan 22 22:39:29.736412 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4727/9748] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:39:40.318004 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1419458275", "imageRef": "4490d602-2eb8-4d38-a803-505498a0dc34", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-486558719", "security_groups": [{"name": "tempest-secgroup-smoke-852283943"}], "networks": [{"uuid": "99573483-cbe4-4189-9d4f-418f987e2d54"}]}} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:39:40.339404 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] [a7ed686d-6f24-47e8-978c-4287ce754ef2] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 35338. Jan 22 22:39:40.340071 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] [edc45ac6-e555-423c-baf2-d131dfc2b608] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 35336. Jan 22 22:39:40.427330 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.network.neutron [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] validate_networks() for [('99573483-cbe4-4189-9d4f-418f987e2d54', None, None, None, None, None)] {{(pid=137032) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 22 22:39:40.842784 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Flavor limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 22 22:39:40.852198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Image limits 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 22 22:39:40.852198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Flavor pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 22 22:39:40.852198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Image pref 0:0:0 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 22 22:39:40.852198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.virt.hardware [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 22 22:39:40.853579 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:40.854010 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:40.854894 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:40.855359 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:40.872936 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Getting quotas for project f9292458261d44258ffafe58e92393ed. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 22 22:39:40.878078 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.quota [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Getting quotas for user ae576def5e8d429996b8ea20a75f308e and project f9292458261d44258ffafe58e92393ed. Resources: {'cores', 'instances', 'ram'} {{(pid=137032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 22 22:39:40.891236 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Going to run 1 instances... {{(pid=137032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 22 22:39:40.893897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4490d602-2eb8-4d38-a803-505498a0dc34',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 22 22:39:41.025689 ncdv-master-1 devstack@n-api.service[137032]: ERROR oslo.messaging._drivers.impl_rabbit [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [4a072d27-0db7-45bb-97aa-2c81015ea852] AMQP server on 10.222.0.100:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 22 22:39:42.033608 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [4a072d27-0db7-45bb-97aa-2c81015ea852] Reconnected to AMQP server on 10.222.0.100:5672 via [amqp] client with port 35350. Jan 22 22:39:42.037662 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-59546242-0e16-4833-ba02-c1d94ab223ad tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.725882 Jan 22 22:39:42.038318 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5022/9749] 10.222.0.100 () {60 vars in 1151 bytes} [Sat Jan 22 22:39:40 2022] POST /compute/v2.1/servers => generated 407 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 22 22:39:42.049921 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c57e90b5-81f9-4390-afce-10671f5e9325 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:39:42.050614 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c57e90b5-81f9-4390-afce-10671f5e9325 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:42.159885 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c57e90b5-81f9-4390-afce-10671f5e9325 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:39:42.166682 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c57e90b5-81f9-4390-afce-10671f5e9325 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1252 microversion: 2.1 time: 0.121568 Jan 22 22:39:42.167386 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4728/9750] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:39:42 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1252 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:39:42.666059 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-a490861e-f5b1-4885-ac48-43c834298ba4 req-5b9948a6-8b3c-421a-90b3-8a4207141d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1782fc3d-3b9b-4b33-b930-5e9d5bd872ab", "name": "network-vif-unplugged", "status": "completed", "tag": "5856dfc5-f02c-4f51-b409-169c3fb3a0e0"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:39:42.669403 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:39:42.669403 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:39:42.675756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a490861e-f5b1-4885-ac48-43c834298ba4 req-5b9948a6-8b3c-421a-90b3-8a4207141d5e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:42.676233 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-a490861e-f5b1-4885-ac48-43c834298ba4 req-5b9948a6-8b3c-421a-90b3-8a4207141d5e service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:42.687829 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-a490861e-f5b1-4885-ac48-43c834298ba4 req-5b9948a6-8b3c-421a-90b3-8a4207141d5e service nova] Creating event network-vif-unplugged:5856dfc5-f02c-4f51-b409-169c3fb3a0e0 for instance 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab on nch2-master-1 Jan 22 22:39:42.693043 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-a490861e-f5b1-4885-ac48-43c834298ba4 req-5b9948a6-8b3c-421a-90b3-8a4207141d5e service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032276 Jan 22 22:39:42.693685 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5023/9751] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:39:43.184785 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-50d7452c-7ab8-4a3c-992a-db9bd3b6ea40 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:39:43.185401 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-50d7452c-7ab8-4a3c-992a-db9bd3b6ea40 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:43.192377 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50d7452c-7ab8-4a3c-992a-db9bd3b6ea40 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:43.192838 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50d7452c-7ab8-4a3c-992a-db9bd3b6ea40 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:43.193675 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50d7452c-7ab8-4a3c-992a-db9bd3b6ea40 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:43.194124 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-50d7452c-7ab8-4a3c-992a-db9bd3b6ea40 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:43.258565 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-50d7452c-7ab8-4a3c-992a-db9bd3b6ea40 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:39:43.270594 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-50d7452c-7ab8-4a3c-992a-db9bd3b6ea40 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1256 microversion: 2.1 time: 0.086528 Jan 22 22:39:43.270594 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4729/9752] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:39:43 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1256 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:39:44.285259 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-7489660c-cc6a-4d09-ac89-bb2588512d42 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:39:44.286520 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-7489660c-cc6a-4d09-ac89-bb2588512d42 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:44.292915 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7489660c-cc6a-4d09-ac89-bb2588512d42 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:44.293432 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7489660c-cc6a-4d09-ac89-bb2588512d42 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:44.294669 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7489660c-cc6a-4d09-ac89-bb2588512d42 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:44.295158 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-7489660c-cc6a-4d09-ac89-bb2588512d42 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:44.367224 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-7489660c-cc6a-4d09-ac89-bb2588512d42 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:39:44.375102 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-7489660c-cc6a-4d09-ac89-bb2588512d42 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1322 microversion: 2.1 time: 0.095090 Jan 22 22:39:44.375686 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5024/9753] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:39:44 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1322 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:39:45.394783 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-212e2f57-90f3-4972-99ec-7d5e7ad6b93d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:39:45.395589 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-212e2f57-90f3-4972-99ec-7d5e7ad6b93d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:45.405610 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-212e2f57-90f3-4972-99ec-7d5e7ad6b93d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:45.406507 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-212e2f57-90f3-4972-99ec-7d5e7ad6b93d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:45.407324 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-212e2f57-90f3-4972-99ec-7d5e7ad6b93d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:45.407770 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-212e2f57-90f3-4972-99ec-7d5e7ad6b93d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:45.567837 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-212e2f57-90f3-4972-99ec-7d5e7ad6b93d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:39:45.576860 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-212e2f57-90f3-4972-99ec-7d5e7ad6b93d tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1377 microversion: 2.1 time: 0.187485 Jan 22 22:39:45.577558 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4730/9754] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:39:45 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1377 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:39:46.597792 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-8f509564-f50b-4eda-a32f-716b2b7c91b4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:39:46.599036 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-8f509564-f50b-4eda-a32f-716b2b7c91b4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:46.606483 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f509564-f50b-4eda-a32f-716b2b7c91b4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:46.607620 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f509564-f50b-4eda-a32f-716b2b7c91b4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:46.608443 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f509564-f50b-4eda-a32f-716b2b7c91b4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:46.608911 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-8f509564-f50b-4eda-a32f-716b2b7c91b4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:46.759005 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-8f509564-f50b-4eda-a32f-716b2b7c91b4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:39:46.767419 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-8f509564-f50b-4eda-a32f-716b2b7c91b4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1377 microversion: 2.1 time: 0.176152 Jan 22 22:39:46.768203 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5025/9755] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:39:46 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1377 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:39:47.785116 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-55bde326-8c23-4bfd-a98b-2c9624cb4926 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:39:47.785771 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-55bde326-8c23-4bfd-a98b-2c9624cb4926 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:47.792889 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55bde326-8c23-4bfd-a98b-2c9624cb4926 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:47.793906 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55bde326-8c23-4bfd-a98b-2c9624cb4926 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:47.795735 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55bde326-8c23-4bfd-a98b-2c9624cb4926 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:47.796403 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-55bde326-8c23-4bfd-a98b-2c9624cb4926 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:47.952664 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-55bde326-8c23-4bfd-a98b-2c9624cb4926 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:39:47.960633 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-55bde326-8c23-4bfd-a98b-2c9624cb4926 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1377 microversion: 2.1 time: 0.179675 Jan 22 22:39:47.970115 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4731/9756] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:39:47 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1377 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:39:48.977683 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-dd107b73-0d33-4e0a-9c75-fc021109c86a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:39:48.978437 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-dd107b73-0d33-4e0a-9c75-fc021109c86a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:48.985837 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd107b73-0d33-4e0a-9c75-fc021109c86a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:48.986313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd107b73-0d33-4e0a-9c75-fc021109c86a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:48.987157 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd107b73-0d33-4e0a-9c75-fc021109c86a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:48.987623 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-dd107b73-0d33-4e0a-9c75-fc021109c86a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:49.144403 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-dd107b73-0d33-4e0a-9c75-fc021109c86a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:39:49.152651 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-dd107b73-0d33-4e0a-9c75-fc021109c86a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1377 microversion: 2.1 time: 0.178628 Jan 22 22:39:49.163567 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5026/9757] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:39:48 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1377 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:39:50.171094 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-c0ca58d2-9fc5-430d-af91-09ea3fb9b159 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:39:50.172410 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-c0ca58d2-9fc5-430d-af91-09ea3fb9b159 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:50.179580 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0ca58d2-9fc5-430d-af91-09ea3fb9b159 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:50.180042 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0ca58d2-9fc5-430d-af91-09ea3fb9b159 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:50.181245 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0ca58d2-9fc5-430d-af91-09ea3fb9b159 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:50.181418 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-c0ca58d2-9fc5-430d-af91-09ea3fb9b159 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:50.333337 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-c0ca58d2-9fc5-430d-af91-09ea3fb9b159 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:39:50.342092 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-c0ca58d2-9fc5-430d-af91-09ea3fb9b159 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1377 microversion: 2.1 time: 0.174569 Jan 22 22:39:50.342980 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4732/9758] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:39:50 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1377 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:39:51.361384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-0ffb12a3-294d-432b-9bb1-28ab4c27e087 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:39:51.362230 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-0ffb12a3-294d-432b-9bb1-28ab4c27e087 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:51.373465 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ffb12a3-294d-432b-9bb1-28ab4c27e087 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:51.375764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ffb12a3-294d-432b-9bb1-28ab4c27e087 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:51.375764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ffb12a3-294d-432b-9bb1-28ab4c27e087 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:51.375764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-0ffb12a3-294d-432b-9bb1-28ab4c27e087 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:51.548028 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-0ffb12a3-294d-432b-9bb1-28ab4c27e087 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:39:51.556515 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-0ffb12a3-294d-432b-9bb1-28ab4c27e087 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1377 microversion: 2.1 time: 0.200800 Jan 22 22:39:51.557118 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5027/9759] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:39:51 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1377 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:39:52.573599 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-ab79bef9-a2c2-4f60-be2f-3fd8595e2508 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:39:52.574452 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-ab79bef9-a2c2-4f60-be2f-3fd8595e2508 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:52.581601 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab79bef9-a2c2-4f60-be2f-3fd8595e2508 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:52.582062 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab79bef9-a2c2-4f60-be2f-3fd8595e2508 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:52.582850 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab79bef9-a2c2-4f60-be2f-3fd8595e2508 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:52.583295 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-ab79bef9-a2c2-4f60-be2f-3fd8595e2508 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:52.793073 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-ab79bef9-a2c2-4f60-be2f-3fd8595e2508 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:39:52.801104 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-ab79bef9-a2c2-4f60-be2f-3fd8595e2508 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1377 microversion: 2.1 time: 0.231217 Jan 22 22:39:52.801720 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4733/9760] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:39:52 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1377 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:39:53.192444 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-48e40221-245d-456e-87cd-d87af1137ed0 req-b6927274-1765-48b0-86ec-48b7656b4baf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e", "tag": "9d63134b-c19b-48fa-ba38-47ebafcb528b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:39:53.194383 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:39:53.194383 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:39:53.212790 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-48e40221-245d-456e-87cd-d87af1137ed0 req-b6927274-1765-48b0-86ec-48b7656b4baf service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:53.213272 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-48e40221-245d-456e-87cd-d87af1137ed0 req-b6927274-1765-48b0-86ec-48b7656b4baf service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:53.226314 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-48e40221-245d-456e-87cd-d87af1137ed0 req-b6927274-1765-48b0-86ec-48b7656b4baf service nova] Creating event network-changed:9d63134b-c19b-48fa-ba38-47ebafcb528b for instance 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e on nch1-master-1 Jan 22 22:39:53.231453 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-48e40221-245d-456e-87cd-d87af1137ed0 req-b6927274-1765-48b0-86ec-48b7656b4baf service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042725 Jan 22 22:39:53.232679 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5028/9761] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:39:53.818658 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-6ba3687a-f87f-4ca8-9611-cd30fa81f207 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:39:53.820584 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-6ba3687a-f87f-4ca8-9611-cd30fa81f207 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:53.826634 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ba3687a-f87f-4ca8-9611-cd30fa81f207 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:53.827102 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ba3687a-f87f-4ca8-9611-cd30fa81f207 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:53.827909 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ba3687a-f87f-4ca8-9611-cd30fa81f207 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:53.828352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-6ba3687a-f87f-4ca8-9611-cd30fa81f207 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:54.008845 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:39:54.009069 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e (ip 10.222.0.100) !!! Jan 22 22:39:54.349065 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-6ba3687a-f87f-4ca8-9611-cd30fa81f207 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:39:54.357263 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-6ba3687a-f87f-4ca8-9611-cd30fa81f207 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1377 microversion: 2.1 time: 0.541663 Jan 22 22:39:54.358095 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4734/9762] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:39:53 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1377 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:39:55.073143 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:39:55.073714 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:39:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:39:55.376497 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-41585aaa-5b4b-49dd-917a-eeb48ed7c4df tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:39:55.377201 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-41585aaa-5b4b-49dd-917a-eeb48ed7c4df tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:55.383983 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41585aaa-5b4b-49dd-917a-eeb48ed7c4df tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:55.384462 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41585aaa-5b4b-49dd-917a-eeb48ed7c4df tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:55.385287 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41585aaa-5b4b-49dd-917a-eeb48ed7c4df tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:55.385797 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-41585aaa-5b4b-49dd-917a-eeb48ed7c4df tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:55.520728 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-41585aaa-5b4b-49dd-917a-eeb48ed7c4df tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:39:55.528111 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-41585aaa-5b4b-49dd-917a-eeb48ed7c4df tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1377 microversion: 2.1 time: 0.157237 Jan 22 22:39:55.529083 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5029/9763] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:39:55 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1377 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:39:56.546146 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-8e4f79d5-c465-4c07-9e18-2d66798afbf9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:39:56.546766 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-8e4f79d5-c465-4c07-9e18-2d66798afbf9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:56.553654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e4f79d5-c465-4c07-9e18-2d66798afbf9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:56.554119 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e4f79d5-c465-4c07-9e18-2d66798afbf9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:56.554914 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e4f79d5-c465-4c07-9e18-2d66798afbf9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:56.555366 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-8e4f79d5-c465-4c07-9e18-2d66798afbf9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:56.693875 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-8e4f79d5-c465-4c07-9e18-2d66798afbf9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:39:56.701816 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-8e4f79d5-c465-4c07-9e18-2d66798afbf9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1377 microversion: 2.1 time: 0.159697 Jan 22 22:39:56.702385 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4735/9764] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:39:56 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1377 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:39:57.719475 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-2a5abef7-ba64-49c6-b778-3414b23935a9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:39:57.720142 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-2a5abef7-ba64-49c6-b778-3414b23935a9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:57.726907 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a5abef7-ba64-49c6-b778-3414b23935a9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:57.727376 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a5abef7-ba64-49c6-b778-3414b23935a9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:57.728313 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a5abef7-ba64-49c6-b778-3414b23935a9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:57.728777 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-2a5abef7-ba64-49c6-b778-3414b23935a9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:57.863724 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-2a5abef7-ba64-49c6-b778-3414b23935a9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:39:57.871069 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-2a5abef7-ba64-49c6-b778-3414b23935a9 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1377 microversion: 2.1 time: 0.156119 Jan 22 22:39:57.871646 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5030/9765] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:39:57 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1377 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:39:58.888205 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-796f7782-808b-41dd-849a-8be85f32e8db tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:39:58.888986 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-796f7782-808b-41dd-849a-8be85f32e8db tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:39:58.895655 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-796f7782-808b-41dd-849a-8be85f32e8db tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:58.896111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-796f7782-808b-41dd-849a-8be85f32e8db tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:58.896888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-796f7782-808b-41dd-849a-8be85f32e8db tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:58.897335 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-796f7782-808b-41dd-849a-8be85f32e8db tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:59.033847 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-796f7782-808b-41dd-849a-8be85f32e8db tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:39:59.041219 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-796f7782-808b-41dd-849a-8be85f32e8db tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1377 microversion: 2.1 time: 0.156875 Jan 22 22:39:59.041815 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4736/9766] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:39:58 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1377 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:39:59.359676 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-bb898cdd-27cc-459b-ad46-d99c85f48e6e req-dd260f2a-999b-4fa1-9c33-0a351e92229c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e", "name": "network-vif-plugged", "status": "completed", "tag": "9d63134b-c19b-48fa-ba38-47ebafcb528b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:39:59.361192 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:39:59.361192 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:39:59.369107 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bb898cdd-27cc-459b-ad46-d99c85f48e6e req-dd260f2a-999b-4fa1-9c33-0a351e92229c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:39:59.369606 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-bb898cdd-27cc-459b-ad46-d99c85f48e6e req-dd260f2a-999b-4fa1-9c33-0a351e92229c service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:39:59.383913 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-bb898cdd-27cc-459b-ad46-d99c85f48e6e req-dd260f2a-999b-4fa1-9c33-0a351e92229c service nova] Creating event network-vif-plugged:9d63134b-c19b-48fa-ba38-47ebafcb528b for instance 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e on nch1-master-1 Jan 22 22:39:59.389527 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-bb898cdd-27cc-459b-ad46-d99c85f48e6e req-dd260f2a-999b-4fa1-9c33-0a351e92229c service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033788 Jan 22 22:39:59.394278 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5031/9767] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:40:00.058596 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-57ce5e0b-9627-456d-bc2b-3d1b9ef9352a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:40:00.059591 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-57ce5e0b-9627-456d-bc2b-3d1b9ef9352a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:40:00.070577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57ce5e0b-9627-456d-bc2b-3d1b9ef9352a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:40:00.071705 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57ce5e0b-9627-456d-bc2b-3d1b9ef9352a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:40:00.072567 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57ce5e0b-9627-456d-bc2b-3d1b9ef9352a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:40:00.073066 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-57ce5e0b-9627-456d-bc2b-3d1b9ef9352a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:40:00.207387 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-57ce5e0b-9627-456d-bc2b-3d1b9ef9352a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:40:00.215265 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-57ce5e0b-9627-456d-bc2b-3d1b9ef9352a tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1377 microversion: 2.1 time: 0.161898 Jan 22 22:40:00.215832 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4737/9768] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:40:00 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1377 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:40:01.234113 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-ab117594-76f2-454d-81ed-1988b49c9641 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:40:01.234830 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-ab117594-76f2-454d-81ed-1988b49c9641 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:40:01.241153 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab117594-76f2-454d-81ed-1988b49c9641 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:40:01.241666 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab117594-76f2-454d-81ed-1988b49c9641 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:40:01.242468 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab117594-76f2-454d-81ed-1988b49c9641 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:40:01.242933 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-ab117594-76f2-454d-81ed-1988b49c9641 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:40:01.381421 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-ab117594-76f2-454d-81ed-1988b49c9641 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:40:01.389478 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-ab117594-76f2-454d-81ed-1988b49c9641 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1562 microversion: 2.1 time: 0.160216 Jan 22 22:40:01.390064 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5032/9769] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:40:01 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:40:01.406034 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-850478ad-b2d1-4987-96be-b135495af2d6 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:40:01.406654 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-850478ad-b2d1-4987-96be-b135495af2d6 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:40:01.413365 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-850478ad-b2d1-4987-96be-b135495af2d6 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:40:01.413941 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-850478ad-b2d1-4987-96be-b135495af2d6 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:40:01.414712 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-850478ad-b2d1-4987-96be-b135495af2d6 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:40:01.415159 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-850478ad-b2d1-4987-96be-b135495af2d6 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:40:01.550630 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-850478ad-b2d1-4987-96be-b135495af2d6 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:40:01.558281 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-850478ad-b2d1-4987-96be-b135495af2d6 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1562 microversion: 2.1 time: 0.156284 Jan 22 22:40:01.558847 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4738/9770] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:40:01 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:40:03.470897 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-0cd199da-2c2b-44ef-be63-43f1568421b8 req-d64babdc-b288-49d1-8c26-a46a81f8aea4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e", "tag": "9d63134b-c19b-48fa-ba38-47ebafcb528b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:40:03.473079 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:40:03.473079 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:40:03.481331 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0cd199da-2c2b-44ef-be63-43f1568421b8 req-d64babdc-b288-49d1-8c26-a46a81f8aea4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:40:03.482000 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-0cd199da-2c2b-44ef-be63-43f1568421b8 req-d64babdc-b288-49d1-8c26-a46a81f8aea4 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:40:03.493928 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-0cd199da-2c2b-44ef-be63-43f1568421b8 req-d64babdc-b288-49d1-8c26-a46a81f8aea4 service nova] Creating event network-changed:9d63134b-c19b-48fa-ba38-47ebafcb528b for instance 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e on nch1-master-1 Jan 22 22:40:03.500197 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-0cd199da-2c2b-44ef-be63-43f1568421b8 req-d64babdc-b288-49d1-8c26-a46a81f8aea4 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033114 Jan 22 22:40:03.500732 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5033/9771] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:41:31.927442 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-e442bc89-271b-4cd9-a033-912a9e8a4436 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1186574087"}} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:41:31.928472 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-e442bc89-271b-4cd9-a033-912a9e8a4436 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:41:31.934956 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e442bc89-271b-4cd9-a033-912a9e8a4436 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:31.935438 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e442bc89-271b-4cd9-a033-912a9e8a4436 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:31.936317 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e442bc89-271b-4cd9-a033-912a9e8a4436 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:31.936792 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-e442bc89-271b-4cd9-a033-912a9e8a4436 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:32.410314 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-e442bc89-271b-4cd9-a033-912a9e8a4436 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "POST /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e/action" status: 202 len: 0 microversion: 2.1 time: 0.488148 Jan 22 22:41:32.411664 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4739/9772] 10.222.0.100 () {60 vars in 1282 bytes} [Sat Jan 22 22:41:31 2022] POST /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 22 22:41:33.953413 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:41:33.954146 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:41:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:41:37.816925 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-1145bbef-5c6b-4bdd-bdb1-1773083721f7 req-fadafcba-3d4e-4f41-b1f2-9070eee1e05d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e", "name": "network-vif-plugged", "status": "completed", "tag": "9d63134b-c19b-48fa-ba38-47ebafcb528b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:41:37.819544 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:41:37.819544 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:41:37.828764 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1145bbef-5c6b-4bdd-bdb1-1773083721f7 req-fadafcba-3d4e-4f41-b1f2-9070eee1e05d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:37.829370 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-1145bbef-5c6b-4bdd-bdb1-1773083721f7 req-fadafcba-3d4e-4f41-b1f2-9070eee1e05d service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:37.842777 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-1145bbef-5c6b-4bdd-bdb1-1773083721f7 req-fadafcba-3d4e-4f41-b1f2-9070eee1e05d service nova] Creating event network-vif-plugged:9d63134b-c19b-48fa-ba38-47ebafcb528b for instance 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e on nch1-master-1 Jan 22 22:41:37.848723 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-1145bbef-5c6b-4bdd-bdb1-1773083721f7 req-fadafcba-3d4e-4f41-b1f2-9070eee1e05d service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040254 Jan 22 22:41:37.849606 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5034/9773] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:41:49.152113 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-b4995dce-09d0-4036-9f23-2151bd769f5e tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:41:49.152713 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b4995dce-09d0-4036-9f23-2151bd769f5e tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:41:49.159912 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4995dce-09d0-4036-9f23-2151bd769f5e tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:49.160471 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4995dce-09d0-4036-9f23-2151bd769f5e tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:49.161352 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4995dce-09d0-4036-9f23-2151bd769f5e tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:49.161888 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-b4995dce-09d0-4036-9f23-2151bd769f5e tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:49.192964 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-b4995dce-09d0-4036-9f23-2151bd769f5e tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:41:49.228364 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-f17f1fac-d249-434a-a56a-c9e96c6ca06f req-fe229963-a33b-478e-9b52-799a19d38de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e", "tag": "9d63134b-c19b-48fa-ba38-47ebafcb528b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:41:49.230709 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:41:49.230709 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:41:49.239709 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f17f1fac-d249-434a-a56a-c9e96c6ca06f req-fe229963-a33b-478e-9b52-799a19d38de2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:49.240252 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-f17f1fac-d249-434a-a56a-c9e96c6ca06f req-fe229963-a33b-478e-9b52-799a19d38de2 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:49.251073 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-f17f1fac-d249-434a-a56a-c9e96c6ca06f req-fe229963-a33b-478e-9b52-799a19d38de2 service nova] Creating event network-changed:9d63134b-c19b-48fa-ba38-47ebafcb528b for instance 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e on nch1-master-1 Jan 22 22:41:49.256775 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-f17f1fac-d249-434a-a56a-c9e96c6ca06f req-fe229963-a33b-478e-9b52-799a19d38de2 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107426 Jan 22 22:41:49.257383 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5035/9774] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:41:49.481897 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-b4995dce-09d0-4036-9f23-2151bd769f5e tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "DELETE /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 204 len: 0 microversion: 2.1 time: 0.335061 Jan 22 22:41:49.485004 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4740/9775] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:41:49 2022] DELETE /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:41:49.493300 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-185e9ff9-156d-4fbc-892f-df7c98f5938f tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:41:49.494068 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-185e9ff9-156d-4fbc-892f-df7c98f5938f tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:41:49.500423 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-185e9ff9-156d-4fbc-892f-df7c98f5938f tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:49.501138 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-185e9ff9-156d-4fbc-892f-df7c98f5938f tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:49.502248 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-185e9ff9-156d-4fbc-892f-df7c98f5938f tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:49.502968 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-185e9ff9-156d-4fbc-892f-df7c98f5938f tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:49.704198 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-185e9ff9-156d-4fbc-892f-df7c98f5938f tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:41:49.714292 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-185e9ff9-156d-4fbc-892f-df7c98f5938f tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1687 microversion: 2.1 time: 0.226434 Jan 22 22:41:49.716121 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5036/9776] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:41:49 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1687 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:41:49.817462 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [req-b74f63c8-1adb-476b-9adf-d7cab06d5348 req-824bce6e-a3ea-424b-825a-07682942e777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e", "name": "network-vif-unplugged", "status": "completed", "tag": "9d63134b-c19b-48fa-ba38-47ebafcb528b"}]} {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:41:49.819360 ncdv-master-1 devstack@n-api.service[137033]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:41:49.819360 ncdv-master-1 devstack@n-api.service[137033]: warnings.warn(msg) Jan 22 22:41:49.826527 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-b74f63c8-1adb-476b-9adf-d7cab06d5348 req-824bce6e-a3ea-424b-825a-07682942e777 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:49.828926 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [req-b74f63c8-1adb-476b-9adf-d7cab06d5348 req-824bce6e-a3ea-424b-825a-07682942e777 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:49.838977 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.compute.server_external_events [req-b74f63c8-1adb-476b-9adf-d7cab06d5348 req-824bce6e-a3ea-424b-825a-07682942e777 service nova] Creating event network-vif-unplugged:9d63134b-c19b-48fa-ba38-47ebafcb528b for instance 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e on nch1-master-1 Jan 22 22:41:49.845058 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [req-b74f63c8-1adb-476b-9adf-d7cab06d5348 req-824bce6e-a3ea-424b-825a-07682942e777 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032039 Jan 22 22:41:49.847162 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4741/9777] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:41:50.733756 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-f90c01b3-27d7-4106-99b9-622c0d3d2c41 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:41:50.734384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-f90c01b3-27d7-4106-99b9-622c0d3d2c41 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:41:50.741696 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f90c01b3-27d7-4106-99b9-622c0d3d2c41 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:50.742167 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f90c01b3-27d7-4106-99b9-622c0d3d2c41 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:50.742974 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f90c01b3-27d7-4106-99b9-622c0d3d2c41 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:50.743434 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-f90c01b3-27d7-4106-99b9-622c0d3d2c41 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:50.878988 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-f90c01b3-27d7-4106-99b9-622c0d3d2c41 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:41:50.886580 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-f90c01b3-27d7-4106-99b9-622c0d3d2c41 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1568 microversion: 2.1 time: 0.156525 Jan 22 22:41:50.887155 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5037/9778] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:41:50 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:41:51.905577 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-dcd9eb74-d82b-4265-852f-9e5ce01f5aab tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:41:51.906341 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-dcd9eb74-d82b-4265-852f-9e5ce01f5aab tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:41:51.915375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcd9eb74-d82b-4265-852f-9e5ce01f5aab tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:51.915375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcd9eb74-d82b-4265-852f-9e5ce01f5aab tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:51.915375 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcd9eb74-d82b-4265-852f-9e5ce01f5aab tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:51.915651 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-dcd9eb74-d82b-4265-852f-9e5ce01f5aab tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:51.947467 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-2d41e185-b5bd-499f-af70-4668a6a927fd req-9db9b09b-f7c2-4a05-80b4-d769b144f915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e", "name": "network-vif-deleted", "tag": "9d63134b-c19b-48fa-ba38-47ebafcb528b"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:41:51.949916 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:41:51.949916 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:41:51.959083 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2d41e185-b5bd-499f-af70-4668a6a927fd req-9db9b09b-f7c2-4a05-80b4-d769b144f915 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:51.959810 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-2d41e185-b5bd-499f-af70-4668a6a927fd req-9db9b09b-f7c2-4a05-80b4-d769b144f915 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:51.972131 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-2d41e185-b5bd-499f-af70-4668a6a927fd req-9db9b09b-f7c2-4a05-80b4-d769b144f915 service nova] Creating event network-vif-deleted:9d63134b-c19b-48fa-ba38-47ebafcb528b for instance 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e on nch1-master-1 Jan 22 22:41:51.977146 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-2d41e185-b5bd-499f-af70-4668a6a927fd req-9db9b09b-f7c2-4a05-80b4-d769b144f915 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033970 Jan 22 22:41:51.977787 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5038/9779] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:41:51.987111 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-dcd9eb74-d82b-4265-852f-9e5ce01f5aab tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:41:51.994827 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-dcd9eb74-d82b-4265-852f-9e5ce01f5aab tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 200 len: 1501 microversion: 2.1 time: 0.094255 Jan 22 22:41:51.995397 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4742/9780] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:41:51 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 1501 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:41:53.013864 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a22a4db-38d8-4b3c-9c1c-c1d9edb11b91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:41:53.014488 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-6a22a4db-38d8-4b3c-9c1c-c1d9edb11b91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:41:53.020794 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a22a4db-38d8-4b3c-9c1c-c1d9edb11b91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:53.021260 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a22a4db-38d8-4b3c-9c1c-c1d9edb11b91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:53.022122 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a22a4db-38d8-4b3c-9c1c-c1d9edb11b91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:53.022572 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-6a22a4db-38d8-4b3c-9c1c-c1d9edb11b91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:53.036288 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.wsgi [None req-6a22a4db-38d8-4b3c-9c1c-c1d9edb11b91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] HTTP exception thrown: Instance 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e could not be found. Jan 22 22:41:53.036888 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-6a22a4db-38d8-4b3c-9c1c-c1d9edb11b91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Returning 404 to user: Instance 0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e could not be found. {{(pid=137032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:41:53.037744 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-6a22a4db-38d8-4b3c-9c1c-c1d9edb11b91 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e" status: 404 len: 111 microversion: 2.1 time: 0.028956 Jan 22 22:41:53.038291 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5039/9781] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:41:53 2022] GET /compute/v2.1/servers/0e0ca4d0-28da-46c5-88a2-5e6a4b8ab83e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:41:55.218741 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-eeca7b86-edca-4329-a0f1-2b89c48ec285 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:41:55.219244 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eeca7b86-edca-4329-a0f1-2b89c48ec285 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:41:55.222183 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-ac90044e-152a-4013-b91a-6d5889f9c99f req-fa5874af-17e6-4ba2-9457-11399562ad02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1782fc3d-3b9b-4b33-b930-5e9d5bd872ab", "tag": "5856dfc5-f02c-4f51-b409-169c3fb3a0e0"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:41:55.224220 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:41:55.224220 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:41:55.227257 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eeca7b86-edca-4329-a0f1-2b89c48ec285 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:55.227720 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eeca7b86-edca-4329-a0f1-2b89c48ec285 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:55.228521 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eeca7b86-edca-4329-a0f1-2b89c48ec285 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:55.228966 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-eeca7b86-edca-4329-a0f1-2b89c48ec285 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:55.235071 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ac90044e-152a-4013-b91a-6d5889f9c99f req-fa5874af-17e6-4ba2-9457-11399562ad02 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:55.235793 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-ac90044e-152a-4013-b91a-6d5889f9c99f req-fa5874af-17e6-4ba2-9457-11399562ad02 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:55.246889 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-ac90044e-152a-4013-b91a-6d5889f9c99f req-fa5874af-17e6-4ba2-9457-11399562ad02 service nova] Creating event network-changed:5856dfc5-f02c-4f51-b409-169c3fb3a0e0 for instance 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab on nch2-master-1 Jan 22 22:41:55.252315 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-ac90044e-152a-4013-b91a-6d5889f9c99f req-fa5874af-17e6-4ba2-9457-11399562ad02 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034673 Jan 22 22:41:55.253288 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5040/9782] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 22 22:41:55.255342 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-eeca7b86-edca-4329-a0f1-2b89c48ec285 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Going to try to terminate instance {{(pid=137033) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 22 22:41:55.548014 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-eeca7b86-edca-4329-a0f1-2b89c48ec285 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "DELETE /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 204 len: 0 microversion: 2.1 time: 0.332923 Jan 22 22:41:55.548687 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4743/9783] 10.222.0.100 () {58 vars in 1243 bytes} [Sat Jan 22 22:41:55 2022] DELETE /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 22 22:41:55.558499 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-a6ca2735-2854-4627-8505-907c747e8ae4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:41:55.559218 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.compute.api [None req-a6ca2735-2854-4627-8505-907c747e8ae4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137032) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:41:55.567384 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6ca2735-2854-4627-8505-907c747e8ae4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:55.567738 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6ca2735-2854-4627-8505-907c747e8ae4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:55.568643 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6ca2735-2854-4627-8505-907c747e8ae4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:55.569110 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [None req-a6ca2735-2854-4627-8505-907c747e8ae4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:55.798128 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.policy [None req-a6ca2735-2854-4627-8505-907c747e8ae4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137032) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:41:55.808914 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-a6ca2735-2854-4627-8505-907c747e8ae4 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 200 len: 1688 microversion: 2.1 time: 0.254739 Jan 22 22:41:55.809847 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5041/9784] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:41:55 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 1688 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:41:56.828621 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-d0bdd73e-a621-4c21-aace-f1a70cd4796c tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:41:56.829255 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-d0bdd73e-a621-4c21-aace-f1a70cd4796c tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:41:56.836939 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0bdd73e-a621-4c21-aace-f1a70cd4796c tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:56.837386 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0bdd73e-a621-4c21-aace-f1a70cd4796c tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:56.838216 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0bdd73e-a621-4c21-aace-f1a70cd4796c tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:56.838709 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-d0bdd73e-a621-4c21-aace-f1a70cd4796c tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:56.978678 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.policy [None req-d0bdd73e-a621-4c21-aace-f1a70cd4796c tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae576def5e8d429996b8ea20a75f308e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9292458261d44258ffafe58e92393ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137033) authorize /opt/stack/nova/nova/policy.py:199}} Jan 22 22:41:56.991809 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-d0bdd73e-a621-4c21-aace-f1a70cd4796c tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 200 len: 1569 microversion: 2.1 time: 0.162327 Jan 22 22:41:56.991809 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4744/9785] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:41:56 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 22 22:41:57.099067 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [req-32be8860-6fdc-40dd-a2e7-839d4981eff3 req-bcd66d4f-9ca5-4695-aae9-95af10336be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1782fc3d-3b9b-4b33-b930-5e9d5bd872ab", "name": "network-vif-deleted", "tag": "5856dfc5-f02c-4f51-b409-169c3fb3a0e0"}]} {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 22 22:41:57.100737 ncdv-master-1 devstack@n-api.service[137032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 22 22:41:57.100737 ncdv-master-1 devstack@n-api.service[137032]: warnings.warn(msg) Jan 22 22:41:57.107942 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-32be8860-6fdc-40dd-a2e7-839d4981eff3 req-bcd66d4f-9ca5-4695-aae9-95af10336be9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:57.108402 ncdv-master-1 devstack@n-api.service[137032]: DEBUG oslo_concurrency.lockutils [req-32be8860-6fdc-40dd-a2e7-839d4981eff3 req-bcd66d4f-9ca5-4695-aae9-95af10336be9 service nova] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:57.119724 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.compute.server_external_events [req-32be8860-6fdc-40dd-a2e7-839d4981eff3 req-bcd66d4f-9ca5-4695-aae9-95af10336be9 service nova] Creating event network-vif-deleted:5856dfc5-f02c-4f51-b409-169c3fb3a0e0 for instance 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab on nch2-master-1 Jan 22 22:41:57.124557 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [req-32be8860-6fdc-40dd-a2e7-839d4981eff3 req-bcd66d4f-9ca5-4695-aae9-95af10336be9 service nova] 10.222.0.100 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084977 Jan 22 22:41:57.128622 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5042/9786] 10.222.0.100 () {64 vars in 1322 bytes} [Sat Jan 22 22:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 22 22:41:58.004645 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-08981733-ba61-49fb-997f-80c15edadf15 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '>' {{(pid=137033) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:41:58.005301 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.compute.api [None req-08981733-ba61-49fb-997f-80c15edadf15 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] [instance: 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab] Fetching instance by UUID {{(pid=137033) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 22 22:41:58.013469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08981733-ba61-49fb-997f-80c15edadf15 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:58.013469 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08981733-ba61-49fb-997f-80c15edadf15 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:58.013970 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08981733-ba61-49fb-997f-80c15edadf15 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 22 22:41:58.014455 ncdv-master-1 devstack@n-api.service[137033]: DEBUG oslo_concurrency.lockutils [None req-08981733-ba61-49fb-997f-80c15edadf15 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Lock "52f5c6ef-d4de-4047-a310-d7aef14748aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137033) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 22 22:41:58.027834 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.wsgi [None req-08981733-ba61-49fb-997f-80c15edadf15 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] HTTP exception thrown: Instance 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab could not be found. Jan 22 22:41:58.028429 ncdv-master-1 devstack@n-api.service[137033]: DEBUG nova.api.openstack.wsgi [None req-08981733-ba61-49fb-997f-80c15edadf15 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Returning 404 to user: Instance 1782fc3d-3b9b-4b33-b930-5e9d5bd872ab could not be found. {{(pid=137033) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 22 22:41:58.029258 ncdv-master-1 devstack@n-api.service[137033]: INFO nova.api.openstack.requestlog [None req-08981733-ba61-49fb-997f-80c15edadf15 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab" status: 404 len: 111 microversion: 2.1 time: 0.029439 Jan 22 22:41:58.029826 ncdv-master-1 devstack@n-api.service[137033]: [pid: 137033|app: 0|req: 4745/9787] 10.222.0.100 () {58 vars in 1240 bytes} [Sat Jan 22 22:41:57 2022] GET /compute/v2.1/servers/1782fc3d-3b9b-4b33-b930-5e9d5bd872ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 22 22:41:58.249846 ncdv-master-1 devstack@n-api.service[137032]: DEBUG nova.api.openstack.wsgi [None req-c2434af9-fb8e-481d-bac8-ab333a0920b5 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] Calling method '.version_select at 0x7f1ed512a790>' {{(pid=137032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 22 22:41:58.323378 ncdv-master-1 devstack@n-api.service[137032]: INFO nova.api.openstack.requestlog [None req-c2434af9-fb8e-481d-bac8-ab333a0920b5 tempest-TestSnapshotPattern-2033791478 tempest-TestSnapshotPattern-2033791478-project] 10.222.0.100 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-486558719" status: 202 len: 0 microversion: 2.1 time: 0.079561 Jan 22 22:41:58.324005 ncdv-master-1 devstack@n-api.service[137032]: [pid: 137032|app: 0|req: 5043/9788] 10.222.0.100 () {58 vars in 1258 bytes} [Sat Jan 22 22:41:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-486558719 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 22 22:43:14.018428 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:43:14.019073 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:43:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:44:53.962331 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:44:53.963050 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:44:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:44:54.757807 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:44:54.758331 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:44:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:44:55.082542 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:44:55.082761 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:44:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:45:05.230632 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:45:05.231235 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:45:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:45:10.366010 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:45:10.366806 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:45:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:46:34.028463 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:46:34.029158 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:46:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:48:13.970161 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:48:13.973022 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:48:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:48:14.765705 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:48:14.766314 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:48:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:48:15.090522 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:48:15.090909 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:48:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:48:25.238658 ncdv-master-1 devstack@n-api.service[137032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:48:25.239418 ncdv-master-1 devstack@n-api.service[137032]: Sat Jan 22 22:48:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:48:30.374667 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:48:30.375218 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:48:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 22 22:49:54.036396 ncdv-master-1 devstack@n-api.service[137033]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 22 22:49:54.037187 ncdv-master-1 devstack@n-api.service[137033]: Sat Jan 22 22:49:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!